2022-01-10T01:14:16.994 INFO:root:teuthology version: 1.1.0-95a7d479 2022-01-10T01:14:16.995 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} --name teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi --owner scheduled_teuthology@teuthology --verbose --archive /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546 -- /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/orig.config.yaml 2022-01-10T01:14:17.043 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-01-10T01:14:17.115 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546 branch: octopus description: fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '6600546' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: octopus ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - POOL_APP_NOT_ENABLED - has not responded to cap revoke by MDS for over - MDS_CLIENT_LATE_RELEASE - responding to mclientcaps log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: octopus sha1: f6d564868a58503a158361f4a4d03aeb91ddeca2 owner: scheduled_teuthology@teuthology priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 sha1: cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be sleep_before_teardown: 0 suite: fs suite_branch: octopus suite_path: /home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: f6d564868a58503a158361f4a4d03aeb91ddeca2 targets: smithi036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt8kBw/PvnRw9qnS5uKJoG1PhFhoPhyoj8v/xyDGkaGIJVe67+lsjto/VCfBVEIvAAysI31UIVom//9I7YMiQOBZcFVLoVUyPYGK/cgewwFbJ/4eweNBlZyS59mAYaETseG5gv7e44rz1G8PrVY+loecNLR16BMheDR/E9HeUy5Fw+B8zlZVY3ALwkOs61mCcQs8G46j64rg8t/7zb1Pcze2FIWGQmR3UB0x00HsHWNru2Av7s/s43ipsvDez5YSmk2Qc7u8iLQLWPukmEZ3hzXAQJRKMDYdBy9cManx8bG8uyN6+pWqnGCQtVmTGTzafzL8XoCvcX1DTNwErFX2oJbaXq7eFS4xw4Of3JYZpJhfIJ/C4H2J11uCr7FhPs69J0lBEP25GiDgG8+jzrXiPHOWdUuAeXqCOKt8ttqH5DiungohOI/PyTO34EcEt/osREbd9v7Fgy3psqDpG0xYaxxgK7SNo03xrix8VWLoQMRpcIu0EuAf69ZrYYDhBDde8= smithi059.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL/SXtmTozlyt69LHVZEmf6Y+qjLMVhpB+dam1Jof58t3EJp34mtrHPFnnkJ5g72STeq4+oGJLPgiMY6uenqrtq35usK9ZOGbPmnYg+dViyk6sEci6C52+3+pCbKrZIGXjSfGbBSBUaAn1/7l+99vY2cMdyYkf1ZbykEdIsjh+4drYyv6w9u2nPnkwduw6KDOMRRhN1eCxucZoVVMl864yBt7Hs52iMutGJUSgAetWcHbnWM9XkM8/R6FDV+HeR5e3ooHTCLczGtZFlFYo2siUit3Sb6GRfuw5I1PMN5+1TzZe7EJg+Ow+AkUTbRsTq6nOOZJ6zFc6uloMz82euZg/dao+JnaStbdfkhQ+H4piuCo+j6Z72Lcz7NVFDCVdAYOe/Gak6xOYseUCsE9aEjLLc3vPLWS4q0QbP6ataGCEW+NDxWGw6rQ+jq1LBEsLSY6IfAUJOQPOLG3YINVxRz6FwOt80mM5Tsb5wkrRl1gWfy9s2gdOk5pLvdvjao5qt1E= smithi139.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnd0MtsGTQ8NJXDA8VzgSH5sNriccarBEC+hUv0qufI5af6aIYWp76wWJN4rC3RRMAUwfH5rS4N3uLZt+FNd0QzBgnfWulyXgtgNmO9KUEwW/rhyI73hf4+n5kMbJlQ4B8RExUOCTlVhGMvscoyzoM19m81XiO9vh2zhxfIGOQqm+49owUuOvyHFxuwWVlge0q8mdxNdHcX1IYI14gTF3UsWhnJvC7FnIvqSeb8JlYDJ5og3hAL3AECQxgrMvFBYUq/lCfK53OkvXxziLmcDU7qyk3GXhPwLPGaK+5IBke49ZnlbHcWmLbW9u/j14sHZ6G7FpOKqrIP6JJ6Oow6mst83kUKgBXPVWDDIN3tRfCOxS299xFRBKrotEy9vbgqMm9VxS2249t1bk+NyEoQOmhBlqkeQUAztRfvZJtSr12XsddBdu3Ik52WpI4mCM3Nvu+owuhbjUogLqdFdRYhqM4UBbUBouFgz8gwfAE/aNp4x1vGLsDczwmnKRgbsMMoWs= smithi166.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwxtrrTVh7S3IBsvwF8F+QDOVUKUei0CsbK+Of0ohQ+3Pv3QATs/7jVgd8bSEy6JirmZNjIHO3p/uZTB22rdoyBV0nC/hNURA5rfQ1Mu+a2U/1LtOjrLcmUDyWDeXcAJmZNch/zHrZRIJTbxvrdZqJ8JN0VHfwzYiEH32p8lVqlbOfYGJTvMqmgXL994eLVVaPEYp2Uf0MFrj1z/Nh3OwzOa9J/Nj7xlTTWa0ES5Hks/4/7xI8moWXDF4R8s0JtSY5N6rH1Mofze0RVCwGAF/RUmi3H1oDsk0PmM0mFwPn3hQ+ZqcB7hlmf1Wp3k7XsRguYgdOgJ9AaXPD4p/ROqTOmtOpy1InCXxerqEoeq2I+/n0mZoypdRQorZ5gdnseDRdgSMJKnJ0YkU8Wl8Bd4hbp0KEP1H3aTrz12NKMeOfJZGlDHBn+0VD8c8LEye06pUKpgKAh5EYfbpdpVgjppqC1fFfvhtBgeWb3qQxcSD3wOZ/asy1xRCz4cIbs2hv/4E= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_misc teuthology_branch: master teuthology_sha1: 95a7d4799b562f3bbb5ec66107094963abd62fa1 timestamp: 2022-01-07_04:10:02 tube: smithi user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.20261 2022-01-10T01:14:17.116 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa; will attempt to use it 2022-01-10T01:14:17.117 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks 2022-01-10T01:14:17.117 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-01-10T01:14:17.119 INFO:teuthology.task.internal:Checking packages... 2022-01-10T01:14:17.142 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be' 2022-01-10T01:14:17.143 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-01-10T01:14:17.144 INFO:teuthology.packaging:ref: None 2022-01-10T01:14:17.144 INFO:teuthology.packaging:tag: None 2022-01-10T01:14:17.144 INFO:teuthology.packaging:branch: octopus 2022-01-10T01:14:17.145 INFO:teuthology.packaging:sha1: cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be 2022-01-10T01:14:17.145 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2022-01-10T01:14:17.394 INFO:teuthology.task.internal:Found packages for ceph version 15.2.15-126-gb7887018-1focal 2022-01-10T01:14:17.395 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-01-10T01:14:17.407 INFO:teuthology.task.internal:no buildpackages task found 2022-01-10T01:14:17.407 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-01-10T01:14:17.443 INFO:teuthology.task.internal:Saving configuration 2022-01-10T01:14:17.460 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-01-10T01:14:17.472 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-10T01:14:17.495 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi036.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-01-10 01:08:06.279099', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBeDl28ie5bEp5KZVaUed6c1W09eDsoNmk5JS4SO6SeQ'} 2022-01-10T01:14:17.516 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-01-10 01:08:06.277649', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO3sjhtcgr76d8nd32bIwBsWFHUKB8ge5q/eqDEucDYf'} 2022-01-10T01:14:17.540 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi139.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-01-10 01:08:06.281235', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHE9NSue3ARLbgI9ibjJZOKJi3yzvERn0jwFTt5UDHUk'} 2022-01-10T01:14:17.564 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi166.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-01-10 01:08:06.280173', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIExCfpmokDJB8RQvvOLeiHYhANaoWZ1goKggnH5sLejs'} 2022-01-10T01:14:17.565 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-01-10T01:14:17.577 INFO:teuthology.task.internal:roles: ubuntu@smithi036.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2022-01-10T01:14:17.578 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-01-10T01:14:17.578 INFO:teuthology.task.internal:roles: ubuntu@smithi139.front.sepia.ceph.com - ['client.0'] 2022-01-10T01:14:17.579 INFO:teuthology.task.internal:roles: ubuntu@smithi166.front.sepia.ceph.com - ['client.1'] 2022-01-10T01:14:17.579 INFO:teuthology.run_tasks:Running task console_log... 2022-01-10T01:14:17.723 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9f5443cbf8>, signals=[15]) 2022-01-10T01:14:17.724 INFO:teuthology.run_tasks:Running task internal.connect... 2022-01-10T01:14:17.736 INFO:teuthology.task.internal:Opening connections... 2022-01-10T01:14:17.736 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi036.front.sepia.ceph.com 2022-01-10T01:14:17.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:14:17.798 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2022-01-10T01:14:17.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:14:17.853 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi139.front.sepia.ceph.com 2022-01-10T01:14:17.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:14:17.897 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi166.front.sepia.ceph.com 2022-01-10T01:14:17.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:14:17.945 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-01-10T01:14:17.954 DEBUG:teuthology.orchestra.run.smithi036:> uname -m 2022-01-10T01:14:17.962 INFO:teuthology.orchestra.run.smithi036.stdout:x86_64 2022-01-10T01:14:17.962 DEBUG:teuthology.orchestra.run.smithi036:> cat /etc/os-release 2022-01-10T01:14:18.011 INFO:teuthology.orchestra.run.smithi036.stdout:NAME="Ubuntu" 2022-01-10T01:14:18.011 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-10T01:14:18.011 INFO:teuthology.orchestra.run.smithi036.stdout:ID=ubuntu 2022-01-10T01:14:18.012 INFO:teuthology.orchestra.run.smithi036.stdout:ID_LIKE=debian 2022-01-10T01:14:18.012 INFO:teuthology.orchestra.run.smithi036.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-10T01:14:18.012 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_ID="20.04" 2022-01-10T01:14:18.012 INFO:teuthology.orchestra.run.smithi036.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-10T01:14:18.012 INFO:teuthology.orchestra.run.smithi036.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-10T01:14:18.013 INFO:teuthology.orchestra.run.smithi036.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-10T01:14:18.013 INFO:teuthology.orchestra.run.smithi036.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-10T01:14:18.013 INFO:teuthology.orchestra.run.smithi036.stdout:VERSION_CODENAME=focal 2022-01-10T01:14:18.013 INFO:teuthology.orchestra.run.smithi036.stdout:UBUNTU_CODENAME=focal 2022-01-10T01:14:18.014 INFO:teuthology.lock.ops:Updating smithi036.front.sepia.ceph.com on lock server 2022-01-10T01:14:18.033 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2022-01-10T01:14:18.040 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2022-01-10T01:14:18.041 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2022-01-10T01:14:18.089 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Ubuntu" 2022-01-10T01:14:18.089 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-10T01:14:18.089 INFO:teuthology.orchestra.run.smithi059.stdout:ID=ubuntu 2022-01-10T01:14:18.089 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE=debian 2022-01-10T01:14:18.090 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-10T01:14:18.090 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="20.04" 2022-01-10T01:14:18.090 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-10T01:14:18.090 INFO:teuthology.orchestra.run.smithi059.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-10T01:14:18.091 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-10T01:14:18.091 INFO:teuthology.orchestra.run.smithi059.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-10T01:14:18.091 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_CODENAME=focal 2022-01-10T01:14:18.091 INFO:teuthology.orchestra.run.smithi059.stdout:UBUNTU_CODENAME=focal 2022-01-10T01:14:18.092 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2022-01-10T01:14:18.109 DEBUG:teuthology.orchestra.run.smithi139:> uname -m 2022-01-10T01:14:18.116 INFO:teuthology.orchestra.run.smithi139.stdout:x86_64 2022-01-10T01:14:18.116 DEBUG:teuthology.orchestra.run.smithi139:> cat /etc/os-release 2022-01-10T01:14:18.164 INFO:teuthology.orchestra.run.smithi139.stdout:NAME="Ubuntu" 2022-01-10T01:14:18.164 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-10T01:14:18.165 INFO:teuthology.orchestra.run.smithi139.stdout:ID=ubuntu 2022-01-10T01:14:18.165 INFO:teuthology.orchestra.run.smithi139.stdout:ID_LIKE=debian 2022-01-10T01:14:18.165 INFO:teuthology.orchestra.run.smithi139.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-10T01:14:18.165 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_ID="20.04" 2022-01-10T01:14:18.166 INFO:teuthology.orchestra.run.smithi139.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-10T01:14:18.166 INFO:teuthology.orchestra.run.smithi139.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-10T01:14:18.166 INFO:teuthology.orchestra.run.smithi139.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-10T01:14:18.166 INFO:teuthology.orchestra.run.smithi139.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-10T01:14:18.167 INFO:teuthology.orchestra.run.smithi139.stdout:VERSION_CODENAME=focal 2022-01-10T01:14:18.167 INFO:teuthology.orchestra.run.smithi139.stdout:UBUNTU_CODENAME=focal 2022-01-10T01:14:18.167 INFO:teuthology.lock.ops:Updating smithi139.front.sepia.ceph.com on lock server 2022-01-10T01:14:18.185 DEBUG:teuthology.orchestra.run.smithi166:> uname -m 2022-01-10T01:14:18.192 INFO:teuthology.orchestra.run.smithi166.stdout:x86_64 2022-01-10T01:14:18.193 DEBUG:teuthology.orchestra.run.smithi166:> cat /etc/os-release 2022-01-10T01:14:18.242 INFO:teuthology.orchestra.run.smithi166.stdout:NAME="Ubuntu" 2022-01-10T01:14:18.242 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-10T01:14:18.243 INFO:teuthology.orchestra.run.smithi166.stdout:ID=ubuntu 2022-01-10T01:14:18.243 INFO:teuthology.orchestra.run.smithi166.stdout:ID_LIKE=debian 2022-01-10T01:14:18.243 INFO:teuthology.orchestra.run.smithi166.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-10T01:14:18.243 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION_ID="20.04" 2022-01-10T01:14:18.244 INFO:teuthology.orchestra.run.smithi166.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-10T01:14:18.244 INFO:teuthology.orchestra.run.smithi166.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-10T01:14:18.244 INFO:teuthology.orchestra.run.smithi166.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-10T01:14:18.244 INFO:teuthology.orchestra.run.smithi166.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-10T01:14:18.245 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION_CODENAME=focal 2022-01-10T01:14:18.245 INFO:teuthology.orchestra.run.smithi166.stdout:UBUNTU_CODENAME=focal 2022-01-10T01:14:18.245 INFO:teuthology.lock.ops:Updating smithi166.front.sepia.ceph.com on lock server 2022-01-10T01:14:18.263 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-01-10T01:14:18.278 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-01-10T01:14:18.307 INFO:teuthology.task.internal:Checking for old test directory... 2022-01-10T01:14:18.308 DEBUG:teuthology.orchestra.run.smithi036:> test '!' -e /home/ubuntu/cephtest 2022-01-10T01:14:18.311 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2022-01-10T01:14:18.315 DEBUG:teuthology.orchestra.run.smithi139:> test '!' -e /home/ubuntu/cephtest 2022-01-10T01:14:18.319 DEBUG:teuthology.orchestra.run.smithi166:> test '!' -e /home/ubuntu/cephtest 2022-01-10T01:14:18.326 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-01-10T01:14:18.336 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-01-10T01:14:18.337 DEBUG:teuthology.orchestra.run.smithi036:> test -z $(ls -A /var/lib/ceph) 2022-01-10T01:14:18.362 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2022-01-10T01:14:18.365 DEBUG:teuthology.orchestra.run.smithi139:> test -z $(ls -A /var/lib/ceph) 2022-01-10T01:14:18.367 DEBUG:teuthology.orchestra.run.smithi166:> test -z $(ls -A /var/lib/ceph) 2022-01-10T01:14:18.385 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-01-10T01:14:18.492 INFO:teuthology.run_tasks:Running task kernel... 2022-01-10T01:14:18.512 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2022-01-10T01:14:18.513 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2022-01-10T01:14:18.513 DEBUG:teuthology.orchestra.run.smithi036:> uname -r 2022-01-10T01:14:18.514 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2022-01-10T01:14:18.515 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2022-01-10T01:14:18.516 DEBUG:teuthology.orchestra.run.smithi166:> uname -r 2022-01-10T01:14:18.522 INFO:teuthology.orchestra.run.smithi139.stdout:5.4.0-88-generic 2022-01-10T01:14:18.523 INFO:teuthology.task.kernel:Running kernel on smithi139: 5.4.0-88-generic 2022-01-10T01:14:18.523 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get clean 2022-01-10T01:14:18.525 INFO:teuthology.orchestra.run.smithi166.stdout:5.4.0-88-generic 2022-01-10T01:14:18.526 INFO:teuthology.orchestra.run.smithi036.stdout:5.4.0-88-generic 2022-01-10T01:14:18.526 INFO:teuthology.orchestra.run.smithi059.stdout:5.4.0-88-generic 2022-01-10T01:14:18.526 INFO:teuthology.task.kernel:Running kernel on smithi166: 5.4.0-88-generic 2022-01-10T01:14:18.527 DEBUG:teuthology.orchestra.run.smithi166:> sudo apt-get clean 2022-01-10T01:14:18.527 INFO:teuthology.task.kernel:Running kernel on smithi036: 5.4.0-88-generic 2022-01-10T01:14:18.527 DEBUG:teuthology.orchestra.run.smithi036:> sudo apt-get clean 2022-01-10T01:14:18.528 INFO:teuthology.task.kernel:Running kernel on smithi059: 5.4.0-88-generic 2022-01-10T01:14:18.528 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get clean 2022-01-10T01:14:18.591 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2022-01-10T01:14:18.625 DEBUG:teuthology.orchestra.run.smithi036:> sudo apt-get update 2022-01-10T01:14:18.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get update 2022-01-10T01:14:18.648 DEBUG:teuthology.orchestra.run.smithi166:> sudo apt-get update 2022-01-10T01:14:18.806 INFO:teuthology.orchestra.run.smithi036.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2022-01-10T01:14:18.884 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2022-01-10T01:14:18.884 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2022-01-10T01:14:18.922 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2022-01-10T01:14:18.945 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2022-01-10T01:14:18.958 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2022-01-10T01:14:18.959 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2022-01-10T01:14:18.972 INFO:teuthology.orchestra.run.smithi166.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2022-01-10T01:14:18.974 INFO:teuthology.orchestra.run.smithi166.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2022-01-10T01:14:19.007 INFO:teuthology.orchestra.run.smithi036.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2022-01-10T01:14:19.026 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2022-01-10T01:14:19.030 INFO:teuthology.orchestra.run.smithi166.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2022-01-10T01:14:19.108 INFO:teuthology.orchestra.run.smithi036.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [351 kB] 2022-01-10T01:14:19.183 INFO:teuthology.orchestra.run.smithi036.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,109 kB] 2022-01-10T01:14:19.218 INFO:teuthology.orchestra.run.smithi036.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [202 kB] 2022-01-10T01:14:19.223 INFO:teuthology.orchestra.run.smithi036.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [9,104 B] 2022-01-10T01:14:19.223 INFO:teuthology.orchestra.run.smithi036.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [609 kB] 2022-01-10T01:14:19.239 INFO:teuthology.orchestra.run.smithi036.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.5 kB] 2022-01-10T01:14:19.239 INFO:teuthology.orchestra.run.smithi036.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [86.8 kB] 2022-01-10T01:14:19.240 INFO:teuthology.orchestra.run.smithi036.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [536 B] 2022-01-10T01:14:19.240 INFO:teuthology.orchestra.run.smithi036.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [675 kB] 2022-01-10T01:14:19.242 INFO:teuthology.orchestra.run.smithi036.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [532 kB] 2022-01-10T01:14:19.248 INFO:teuthology.orchestra.run.smithi036.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [114 kB] 2022-01-10T01:14:19.249 INFO:teuthology.orchestra.run.smithi036.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [13.0 kB] 2022-01-10T01:14:19.260 INFO:teuthology.orchestra.run.smithi036.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.8 kB] 2022-01-10T01:14:19.260 INFO:teuthology.orchestra.run.smithi036.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,176 B] 2022-01-10T01:14:19.260 INFO:teuthology.orchestra.run.smithi036.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [536 B] 2022-01-10T01:14:19.317 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2022-01-10T01:14:19.355 INFO:teuthology.orchestra.run.smithi036.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2022-01-10T01:14:19.377 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2022-01-10T01:14:19.383 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [351 kB] 2022-01-10T01:14:19.384 INFO:teuthology.orchestra.run.smithi166.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2022-01-10T01:14:19.443 INFO:teuthology.orchestra.run.smithi166.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,109 kB] 2022-01-10T01:14:19.463 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [351 kB] 2022-01-10T01:14:19.498 INFO:teuthology.orchestra.run.smithi036.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [581 kB] 2022-01-10T01:14:19.529 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,445 kB] 2022-01-10T01:14:19.592 INFO:teuthology.orchestra.run.smithi166.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,445 kB] 2022-01-10T01:14:19.617 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,445 kB] 2022-01-10T01:14:19.675 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,109 kB] 2022-01-10T01:14:19.683 INFO:teuthology.orchestra.run.smithi036.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,445 kB] 2022-01-10T01:14:19.725 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,109 kB] 2022-01-10T01:14:19.834 INFO:teuthology.orchestra.run.smithi036.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [289 kB] 2022-01-10T01:14:19.835 INFO:teuthology.orchestra.run.smithi166.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [351 kB] 2022-01-10T01:14:19.848 INFO:teuthology.orchestra.run.smithi036.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.7 kB] 2022-01-10T01:14:19.848 INFO:teuthology.orchestra.run.smithi036.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.8 kB] 2022-01-10T01:14:19.849 INFO:teuthology.orchestra.run.smithi166.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [202 kB] 2022-01-10T01:14:19.849 INFO:teuthology.orchestra.run.smithi036.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [663 kB] 2022-01-10T01:14:19.850 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [202 kB] 2022-01-10T01:14:19.855 INFO:teuthology.orchestra.run.smithi166.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [9,104 B] 2022-01-10T01:14:19.855 INFO:teuthology.orchestra.run.smithi166.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [609 kB] 2022-01-10T01:14:19.863 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [9,104 B] 2022-01-10T01:14:19.864 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [609 kB] 2022-01-10T01:14:19.874 INFO:teuthology.orchestra.run.smithi036.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [94.6 kB] 2022-01-10T01:14:19.875 INFO:teuthology.orchestra.run.smithi166.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.5 kB] 2022-01-10T01:14:19.875 INFO:teuthology.orchestra.run.smithi166.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [86.8 kB] 2022-01-10T01:14:19.882 INFO:teuthology.orchestra.run.smithi036.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [532 B] 2022-01-10T01:14:19.882 INFO:teuthology.orchestra.run.smithi036.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [662 kB] 2022-01-10T01:14:19.906 INFO:teuthology.orchestra.run.smithi139.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.5 kB] 2022-01-10T01:14:19.906 INFO:teuthology.orchestra.run.smithi139.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [86.8 kB] 2022-01-10T01:14:19.907 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [202 kB] 2022-01-10T01:14:19.912 INFO:teuthology.orchestra.run.smithi139.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [536 B] 2022-01-10T01:14:19.912 INFO:teuthology.orchestra.run.smithi139.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [532 kB] 2022-01-10T01:14:19.915 INFO:teuthology.orchestra.run.smithi036.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [892 kB] 2022-01-10T01:14:19.921 INFO:teuthology.orchestra.run.smithi059.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [9,104 B] 2022-01-10T01:14:19.921 INFO:teuthology.orchestra.run.smithi059.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [20.5 kB] 2022-01-10T01:14:19.922 INFO:teuthology.orchestra.run.smithi059.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [609 kB] 2022-01-10T01:14:19.923 INFO:teuthology.orchestra.run.smithi166.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [536 B] 2022-01-10T01:14:19.923 INFO:teuthology.orchestra.run.smithi166.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [532 kB] 2022-01-10T01:14:19.931 INFO:teuthology.orchestra.run.smithi139.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [581 kB] 2022-01-10T01:14:19.940 INFO:teuthology.orchestra.run.smithi166.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [675 kB] 2022-01-10T01:14:19.942 INFO:teuthology.orchestra.run.smithi139.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [675 kB] 2022-01-10T01:14:19.943 INFO:teuthology.orchestra.run.smithi036.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [195 kB] 2022-01-10T01:14:19.946 INFO:teuthology.orchestra.run.smithi036.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [20.0 kB] 2022-01-10T01:14:19.951 INFO:teuthology.orchestra.run.smithi166.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [581 kB] 2022-01-10T01:14:19.954 INFO:teuthology.orchestra.run.smithi139.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [289 kB] 2022-01-10T01:14:19.965 INFO:teuthology.orchestra.run.smithi166.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [114 kB] 2022-01-10T01:14:19.966 INFO:teuthology.orchestra.run.smithi139.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.7 kB] 2022-01-10T01:14:19.966 INFO:teuthology.orchestra.run.smithi139.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [663 kB] 2022-01-10T01:14:19.967 INFO:teuthology.orchestra.run.smithi139.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [114 kB] 2022-01-10T01:14:19.968 INFO:teuthology.orchestra.run.smithi036.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.8 kB] 2022-01-10T01:14:19.968 INFO:teuthology.orchestra.run.smithi166.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [13.0 kB] 2022-01-10T01:14:19.969 INFO:teuthology.orchestra.run.smithi036.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,432 B] 2022-01-10T01:14:19.969 INFO:teuthology.orchestra.run.smithi036.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,928 B] 2022-01-10T01:14:19.969 INFO:teuthology.orchestra.run.smithi036.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2022-01-10T01:14:19.970 INFO:teuthology.orchestra.run.smithi059.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [86.8 kB] 2022-01-10T01:14:19.970 INFO:teuthology.orchestra.run.smithi036.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [34.5 kB] 2022-01-10T01:14:19.971 INFO:teuthology.orchestra.run.smithi139.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [13.0 kB] 2022-01-10T01:14:19.974 INFO:teuthology.orchestra.run.smithi166.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [289 kB] 2022-01-10T01:14:19.976 INFO:teuthology.orchestra.run.smithi059.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [536 B] 2022-01-10T01:14:19.977 INFO:teuthology.orchestra.run.smithi059.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [532 kB] 2022-01-10T01:14:19.977 INFO:teuthology.orchestra.run.smithi059.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [581 kB] 2022-01-10T01:14:19.987 INFO:teuthology.orchestra.run.smithi166.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.7 kB] 2022-01-10T01:14:19.988 INFO:teuthology.orchestra.run.smithi166.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.8 kB] 2022-01-10T01:14:19.988 INFO:teuthology.orchestra.run.smithi166.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [663 kB] 2022-01-10T01:14:20.001 INFO:teuthology.orchestra.run.smithi059.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [289 kB] 2022-01-10T01:14:20.004 INFO:teuthology.orchestra.run.smithi059.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [675 kB] 2022-01-10T01:14:20.012 INFO:teuthology.orchestra.run.smithi059.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [14.7 kB] 2022-01-10T01:14:20.013 INFO:teuthology.orchestra.run.smithi059.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [663 kB] 2022-01-10T01:14:20.013 INFO:teuthology.orchestra.run.smithi036.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [42.0 kB] 2022-01-10T01:14:20.015 INFO:teuthology.orchestra.run.smithi166.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [94.6 kB] 2022-01-10T01:14:20.015 INFO:teuthology.orchestra.run.smithi036.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [10.0 kB] 2022-01-10T01:14:20.017 INFO:teuthology.orchestra.run.smithi139.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.8 kB] 2022-01-10T01:14:20.018 INFO:teuthology.orchestra.run.smithi139.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [94.6 kB] 2022-01-10T01:14:20.021 INFO:teuthology.orchestra.run.smithi166.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.8 kB] 2022-01-10T01:14:20.022 INFO:teuthology.orchestra.run.smithi139.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [532 B] 2022-01-10T01:14:20.023 INFO:teuthology.orchestra.run.smithi139.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [892 kB] 2022-01-10T01:14:20.023 INFO:teuthology.orchestra.run.smithi166.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,176 B] 2022-01-10T01:14:20.023 INFO:teuthology.orchestra.run.smithi166.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [536 B] 2022-01-10T01:14:20.025 INFO:teuthology.orchestra.run.smithi139.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,176 B] 2022-01-10T01:14:20.027 INFO:teuthology.orchestra.run.smithi059.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [114 kB] 2022-01-10T01:14:20.027 INFO:teuthology.orchestra.run.smithi139.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.8 kB] 2022-01-10T01:14:20.027 INFO:teuthology.orchestra.run.smithi139.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [536 B] 2022-01-10T01:14:20.028 INFO:teuthology.orchestra.run.smithi059.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [13.0 kB] 2022-01-10T01:14:20.038 INFO:teuthology.orchestra.run.smithi166.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [532 B] 2022-01-10T01:14:20.039 INFO:teuthology.orchestra.run.smithi166.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [892 kB] 2022-01-10T01:14:20.040 INFO:teuthology.orchestra.run.smithi059.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [21.8 kB] 2022-01-10T01:14:20.040 INFO:teuthology.orchestra.run.smithi059.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [94.6 kB] 2022-01-10T01:14:20.058 INFO:teuthology.orchestra.run.smithi139.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [662 kB] 2022-01-10T01:14:20.065 INFO:teuthology.orchestra.run.smithi059.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [532 B] 2022-01-10T01:14:20.065 INFO:teuthology.orchestra.run.smithi059.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [892 kB] 2022-01-10T01:14:20.074 INFO:teuthology.orchestra.run.smithi166.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [662 kB] 2022-01-10T01:14:20.081 INFO:teuthology.orchestra.run.smithi059.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,176 B] 2022-01-10T01:14:20.082 INFO:teuthology.orchestra.run.smithi059.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.8 kB] 2022-01-10T01:14:20.082 INFO:teuthology.orchestra.run.smithi059.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [536 B] 2022-01-10T01:14:20.083 INFO:teuthology.orchestra.run.smithi139.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [195 kB] 2022-01-10T01:14:20.089 INFO:teuthology.orchestra.run.smithi139.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [20.0 kB] 2022-01-10T01:14:20.098 INFO:teuthology.orchestra.run.smithi166.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [195 kB] 2022-01-10T01:14:20.099 INFO:teuthology.orchestra.run.smithi036.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [864 B] 2022-01-10T01:14:20.099 INFO:teuthology.orchestra.run.smithi036.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [19.3 kB] 2022-01-10T01:14:20.100 INFO:teuthology.orchestra.run.smithi036.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [10.9 kB] 2022-01-10T01:14:20.100 INFO:teuthology.orchestra.run.smithi036.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [13.3 kB] 2022-01-10T01:14:20.101 INFO:teuthology.orchestra.run.smithi036.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [656 B] 2022-01-10T01:14:20.102 INFO:teuthology.orchestra.run.smithi059.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [662 kB] 2022-01-10T01:14:20.104 INFO:teuthology.orchestra.run.smithi166.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [20.0 kB] 2022-01-10T01:14:20.108 INFO:teuthology.orchestra.run.smithi139.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,432 B] 2022-01-10T01:14:20.109 INFO:teuthology.orchestra.run.smithi139.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.8 kB] 2022-01-10T01:14:20.109 INFO:teuthology.orchestra.run.smithi139.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,928 B] 2022-01-10T01:14:20.110 INFO:teuthology.orchestra.run.smithi139.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2022-01-10T01:14:20.110 INFO:teuthology.orchestra.run.smithi139.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [42.0 kB] 2022-01-10T01:14:20.124 INFO:teuthology.orchestra.run.smithi059.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [195 kB] 2022-01-10T01:14:20.126 INFO:teuthology.orchestra.run.smithi166.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.8 kB] 2022-01-10T01:14:20.127 INFO:teuthology.orchestra.run.smithi166.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,432 B] 2022-01-10T01:14:20.127 INFO:teuthology.orchestra.run.smithi166.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,928 B] 2022-01-10T01:14:20.128 INFO:teuthology.orchestra.run.smithi139.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [34.5 kB] 2022-01-10T01:14:20.129 INFO:teuthology.orchestra.run.smithi166.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2022-01-10T01:14:20.129 INFO:teuthology.orchestra.run.smithi166.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [34.5 kB] 2022-01-10T01:14:20.130 INFO:teuthology.orchestra.run.smithi059.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [20.0 kB] 2022-01-10T01:14:20.149 INFO:teuthology.orchestra.run.smithi166.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [42.0 kB] 2022-01-10T01:14:20.152 INFO:teuthology.orchestra.run.smithi059.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,432 B] 2022-01-10T01:14:20.153 INFO:teuthology.orchestra.run.smithi059.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.8 kB] 2022-01-10T01:14:20.153 INFO:teuthology.orchestra.run.smithi059.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,928 B] 2022-01-10T01:14:20.154 INFO:teuthology.orchestra.run.smithi059.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2022-01-10T01:14:20.154 INFO:teuthology.orchestra.run.smithi059.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [42.0 kB] 2022-01-10T01:14:20.175 INFO:teuthology.orchestra.run.smithi059.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [34.5 kB] 2022-01-10T01:14:20.196 INFO:teuthology.orchestra.run.smithi139.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [10.0 kB] 2022-01-10T01:14:20.197 INFO:teuthology.orchestra.run.smithi139.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [864 B] 2022-01-10T01:14:20.197 INFO:teuthology.orchestra.run.smithi139.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [19.3 kB] 2022-01-10T01:14:20.198 INFO:teuthology.orchestra.run.smithi139.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [10.9 kB] 2022-01-10T01:14:20.198 INFO:teuthology.orchestra.run.smithi139.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [13.3 kB] 2022-01-10T01:14:20.213 INFO:teuthology.orchestra.run.smithi139.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [656 B] 2022-01-10T01:14:20.214 INFO:teuthology.orchestra.run.smithi166.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [10.0 kB] 2022-01-10T01:14:20.214 INFO:teuthology.orchestra.run.smithi166.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [864 B] 2022-01-10T01:14:20.215 INFO:teuthology.orchestra.run.smithi166.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [10.9 kB] 2022-01-10T01:14:20.215 INFO:teuthology.orchestra.run.smithi166.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [19.3 kB] 2022-01-10T01:14:20.216 INFO:teuthology.orchestra.run.smithi166.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [13.3 kB] 2022-01-10T01:14:20.234 INFO:teuthology.orchestra.run.smithi166.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [656 B] 2022-01-10T01:14:20.240 INFO:teuthology.orchestra.run.smithi059.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [10.0 kB] 2022-01-10T01:14:20.243 INFO:teuthology.orchestra.run.smithi059.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [864 B] 2022-01-10T01:14:20.244 INFO:teuthology.orchestra.run.smithi059.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [10.9 kB] 2022-01-10T01:14:20.244 INFO:teuthology.orchestra.run.smithi059.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [19.3 kB] 2022-01-10T01:14:20.245 INFO:teuthology.orchestra.run.smithi059.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [13.3 kB] 2022-01-10T01:14:20.260 INFO:teuthology.orchestra.run.smithi059.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [656 B] 2022-01-10T01:14:23.547 INFO:teuthology.orchestra.run.smithi036.stdout:Fetched 9,137 kB in 2s (5,551 kB/s) 2022-01-10T01:14:23.727 INFO:teuthology.orchestra.run.smithi166.stdout:Fetched 9,137 kB in 2s (4,596 kB/s) 2022-01-10T01:14:23.809 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 9,137 kB in 2s (4,264 kB/s) 2022-01-10T01:14:24.030 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 9,137 kB in 2s (4,217 kB/s) 2022-01-10T01:14:24.733 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2022-01-10T01:14:24.757 DEBUG:teuthology.orchestra.run.smithi036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2022-01-10T01:14:24.825 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2022-01-10T01:14:24.904 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2022-01-10T01:14:24.916 INFO:teuthology.orchestra.run.smithi166.stdout:Reading package lists... 2022-01-10T01:14:24.927 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2022-01-10T01:14:24.940 DEBUG:teuthology.orchestra.run.smithi166:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2022-01-10T01:14:24.994 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2022-01-10T01:14:24.999 INFO:teuthology.orchestra.run.smithi036.stdout:Building dependency tree... 2022-01-10T01:14:25.000 INFO:teuthology.orchestra.run.smithi036.stdout:Reading state information... 2022-01-10T01:14:25.004 INFO:teuthology.orchestra.run.smithi166.stdout:Reading package lists... 2022-01-10T01:14:25.144 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2022-01-10T01:14:25.145 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2022-01-10T01:14:25.157 INFO:teuthology.orchestra.run.smithi036.stdout:The following package was automatically installed and is no longer required: 2022-01-10T01:14:25.158 INFO:teuthology.orchestra.run.smithi036.stdout: libllvm11 2022-01-10T01:14:25.158 INFO:teuthology.orchestra.run.smithi036.stdout:Use 'sudo apt autoremove' to remove it. 2022-01-10T01:14:25.159 INFO:teuthology.orchestra.run.smithi036.stdout:The following additional packages will be installed: 2022-01-10T01:14:25.159 INFO:teuthology.orchestra.run.smithi036.stdout: linux-generic linux-headers-5.4.0-92 linux-headers-5.4.0-92-generic 2022-01-10T01:14:25.159 INFO:teuthology.orchestra.run.smithi036.stdout: linux-headers-generic linux-image-5.4.0-92-generic 2022-01-10T01:14:25.160 INFO:teuthology.orchestra.run.smithi036.stdout: linux-modules-5.4.0-92-generic linux-modules-extra-5.4.0-92-generic 2022-01-10T01:14:25.160 INFO:teuthology.orchestra.run.smithi036.stdout:Suggested packages: 2022-01-10T01:14:25.160 INFO:teuthology.orchestra.run.smithi036.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2022-01-10T01:14:25.161 INFO:teuthology.orchestra.run.smithi036.stdout:Recommended packages: 2022-01-10T01:14:25.161 INFO:teuthology.orchestra.run.smithi036.stdout: thermald 2022-01-10T01:14:25.175 INFO:teuthology.orchestra.run.smithi166.stdout:Building dependency tree... 2022-01-10T01:14:25.175 INFO:teuthology.orchestra.run.smithi166.stdout:Reading state information... 2022-01-10T01:14:25.213 INFO:teuthology.orchestra.run.smithi036.stdout:The following NEW packages will be installed: 2022-01-10T01:14:25.214 INFO:teuthology.orchestra.run.smithi036.stdout: linux-headers-5.4.0-92 linux-headers-5.4.0-92-generic 2022-01-10T01:14:25.214 INFO:teuthology.orchestra.run.smithi036.stdout: linux-image-5.4.0-92-generic linux-modules-5.4.0-92-generic 2022-01-10T01:14:25.215 INFO:teuthology.orchestra.run.smithi036.stdout: linux-modules-extra-5.4.0-92-generic 2022-01-10T01:14:25.215 INFO:teuthology.orchestra.run.smithi036.stdout:The following packages will be upgraded: 2022-01-10T01:14:25.215 INFO:teuthology.orchestra.run.smithi036.stdout: linux-generic linux-headers-generic linux-image-generic 2022-01-10T01:14:25.276 INFO:teuthology.orchestra.run.smithi139.stdout:The following package was automatically installed and is no longer required: 2022-01-10T01:14:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: libllvm11 2022-01-10T01:14:25.277 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove it. 2022-01-10T01:14:25.277 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2022-01-10T01:14:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: linux-generic linux-headers-5.4.0-92 linux-headers-5.4.0-92-generic 2022-01-10T01:14:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: linux-headers-generic linux-image-5.4.0-92-generic 2022-01-10T01:14:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: linux-modules-5.4.0-92-generic linux-modules-extra-5.4.0-92-generic 2022-01-10T01:14:25.279 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2022-01-10T01:14:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2022-01-10T01:14:25.279 INFO:teuthology.orchestra.run.smithi139.stdout:Recommended packages: 2022-01-10T01:14:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: thermald 2022-01-10T01:14:25.292 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2022-01-10T01:14:25.315 DEBUG:teuthology.orchestra.run.smithi059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2022-01-10T01:14:25.324 INFO:teuthology.orchestra.run.smithi166.stdout:The following package was automatically installed and is no longer required: 2022-01-10T01:14:25.325 INFO:teuthology.orchestra.run.smithi166.stdout: libllvm11 2022-01-10T01:14:25.325 INFO:teuthology.orchestra.run.smithi166.stdout:Use 'sudo apt autoremove' to remove it. 2022-01-10T01:14:25.326 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2022-01-10T01:14:25.326 INFO:teuthology.orchestra.run.smithi139.stdout: linux-headers-5.4.0-92 linux-headers-5.4.0-92-generic 2022-01-10T01:14:25.327 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.4.0-92-generic linux-modules-5.4.0-92-generic 2022-01-10T01:14:25.327 INFO:teuthology.orchestra.run.smithi139.stdout: linux-modules-extra-5.4.0-92-generic 2022-01-10T01:14:25.327 INFO:teuthology.orchestra.run.smithi166.stdout:The following additional packages will be installed: 2022-01-10T01:14:25.327 INFO:teuthology.orchestra.run.smithi166.stdout: linux-generic linux-headers-5.4.0-92 linux-headers-5.4.0-92-generic 2022-01-10T01:14:25.328 INFO:teuthology.orchestra.run.smithi166.stdout: linux-headers-generic linux-image-5.4.0-92-generic 2022-01-10T01:14:25.328 INFO:teuthology.orchestra.run.smithi166.stdout: linux-modules-5.4.0-92-generic linux-modules-extra-5.4.0-92-generic 2022-01-10T01:14:25.329 INFO:teuthology.orchestra.run.smithi166.stdout:Suggested packages: 2022-01-10T01:14:25.329 INFO:teuthology.orchestra.run.smithi166.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2022-01-10T01:14:25.329 INFO:teuthology.orchestra.run.smithi166.stdout:Recommended packages: 2022-01-10T01:14:25.329 INFO:teuthology.orchestra.run.smithi166.stdout: thermald 2022-01-10T01:14:25.330 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages will be upgraded: 2022-01-10T01:14:25.330 INFO:teuthology.orchestra.run.smithi139.stdout: linux-generic linux-headers-generic linux-image-generic 2022-01-10T01:14:25.365 INFO:teuthology.orchestra.run.smithi166.stdout:The following NEW packages will be installed: 2022-01-10T01:14:25.366 INFO:teuthology.orchestra.run.smithi166.stdout: linux-headers-5.4.0-92 linux-headers-5.4.0-92-generic 2022-01-10T01:14:25.366 INFO:teuthology.orchestra.run.smithi166.stdout: linux-image-5.4.0-92-generic linux-modules-5.4.0-92-generic 2022-01-10T01:14:25.367 INFO:teuthology.orchestra.run.smithi166.stdout: linux-modules-extra-5.4.0-92-generic 2022-01-10T01:14:25.367 INFO:teuthology.orchestra.run.smithi166.stdout:The following packages will be upgraded: 2022-01-10T01:14:25.367 INFO:teuthology.orchestra.run.smithi166.stdout: linux-generic linux-headers-generic linux-image-generic 2022-01-10T01:14:25.387 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2022-01-10T01:14:25.407 INFO:teuthology.orchestra.run.smithi036.stdout:3 upgraded, 5 newly installed, 0 to remove and 96 not upgraded. 2022-01-10T01:14:25.407 INFO:teuthology.orchestra.run.smithi036.stdout:Need to get 77.1 MB of archives. 2022-01-10T01:14:25.408 INFO:teuthology.orchestra.run.smithi036.stdout:After this operation, 380 MB of additional disk space will be used. 2022-01-10T01:14:25.408 INFO:teuthology.orchestra.run.smithi036.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-92-generic amd64 5.4.0-92.103 [14.8 MB] 2022-01-10T01:14:25.519 INFO:teuthology.orchestra.run.smithi139.stdout:3 upgraded, 5 newly installed, 0 to remove and 96 not upgraded. 2022-01-10T01:14:25.519 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 77.1 MB of archives. 2022-01-10T01:14:25.519 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 380 MB of additional disk space will be used. 2022-01-10T01:14:25.520 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-92-generic amd64 5.4.0-92.103 [14.8 MB] 2022-01-10T01:14:25.561 INFO:teuthology.orchestra.run.smithi166.stdout:3 upgraded, 5 newly installed, 0 to remove and 96 not upgraded. 2022-01-10T01:14:25.561 INFO:teuthology.orchestra.run.smithi166.stdout:Need to get 77.1 MB of archives. 2022-01-10T01:14:25.561 INFO:teuthology.orchestra.run.smithi166.stdout:After this operation, 380 MB of additional disk space will be used. 2022-01-10T01:14:25.562 INFO:teuthology.orchestra.run.smithi166.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-92-generic amd64 5.4.0-92.103 [14.8 MB] 2022-01-10T01:14:25.562 INFO:teuthology.orchestra.run.smithi059.stdout:Building dependency tree... 2022-01-10T01:14:25.563 INFO:teuthology.orchestra.run.smithi059.stdout:Reading state information... 2022-01-10T01:14:25.714 INFO:teuthology.orchestra.run.smithi059.stdout:The following package was automatically installed and is no longer required: 2022-01-10T01:14:25.715 INFO:teuthology.orchestra.run.smithi059.stdout: libllvm11 2022-01-10T01:14:25.716 INFO:teuthology.orchestra.run.smithi059.stdout:Use 'sudo apt autoremove' to remove it. 2022-01-10T01:14:25.716 INFO:teuthology.orchestra.run.smithi059.stdout:The following additional packages will be installed: 2022-01-10T01:14:25.716 INFO:teuthology.orchestra.run.smithi059.stdout: linux-generic linux-headers-5.4.0-92 linux-headers-5.4.0-92-generic 2022-01-10T01:14:25.716 INFO:teuthology.orchestra.run.smithi059.stdout: linux-headers-generic linux-image-5.4.0-92-generic 2022-01-10T01:14:25.717 INFO:teuthology.orchestra.run.smithi059.stdout: linux-modules-5.4.0-92-generic linux-modules-extra-5.4.0-92-generic 2022-01-10T01:14:25.717 INFO:teuthology.orchestra.run.smithi059.stdout:Suggested packages: 2022-01-10T01:14:25.718 INFO:teuthology.orchestra.run.smithi059.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2022-01-10T01:14:25.718 INFO:teuthology.orchestra.run.smithi059.stdout:Recommended packages: 2022-01-10T01:14:25.718 INFO:teuthology.orchestra.run.smithi059.stdout: thermald 2022-01-10T01:14:25.768 INFO:teuthology.orchestra.run.smithi059.stdout:The following NEW packages will be installed: 2022-01-10T01:14:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: linux-headers-5.4.0-92 linux-headers-5.4.0-92-generic 2022-01-10T01:14:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: linux-image-5.4.0-92-generic linux-modules-5.4.0-92-generic 2022-01-10T01:14:25.768 INFO:teuthology.orchestra.run.smithi059.stdout: linux-modules-extra-5.4.0-92-generic 2022-01-10T01:14:25.769 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages will be upgraded: 2022-01-10T01:14:25.769 INFO:teuthology.orchestra.run.smithi059.stdout: linux-generic linux-headers-generic linux-image-generic 2022-01-10T01:14:25.959 INFO:teuthology.orchestra.run.smithi059.stdout:3 upgraded, 5 newly installed, 0 to remove and 96 not upgraded. 2022-01-10T01:14:25.959 INFO:teuthology.orchestra.run.smithi059.stdout:Need to get 77.1 MB of archives. 2022-01-10T01:14:25.959 INFO:teuthology.orchestra.run.smithi059.stdout:After this operation, 380 MB of additional disk space will be used. 2022-01-10T01:14:25.959 INFO:teuthology.orchestra.run.smithi059.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-92-generic amd64 5.4.0-92.103 [14.8 MB] 2022-01-10T01:14:26.633 INFO:teuthology.orchestra.run.smithi036.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-92-generic amd64 5.4.0-92.103 [10.5 MB] 2022-01-10T01:14:26.690 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-92-generic amd64 5.4.0-92.103 [10.5 MB] 2022-01-10T01:14:26.786 INFO:teuthology.orchestra.run.smithi166.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-92-generic amd64 5.4.0-92.103 [10.5 MB] 2022-01-10T01:14:26.982 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-92-generic amd64 5.4.0-92.103 [39.4 MB] 2022-01-10T01:14:27.074 INFO:teuthology.orchestra.run.smithi166.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-92-generic amd64 5.4.0-92.103 [39.4 MB] 2022-01-10T01:14:27.099 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-92-generic amd64 5.4.0-92.103 [10.5 MB] 2022-01-10T01:14:27.384 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-92-generic amd64 5.4.0-92.103 [39.4 MB] 2022-01-10T01:14:27.649 INFO:teuthology.orchestra.run.smithi036.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-92-generic amd64 5.4.0-92.103 [39.4 MB] 2022-01-10T01:14:28.339 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.92.96 [1,900 B] 2022-01-10T01:14:28.375 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.92.96 [2,576 B] 2022-01-10T01:14:28.375 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-92 all 5.4.0-92.103 [11.0 MB] 2022-01-10T01:14:28.464 INFO:teuthology.orchestra.run.smithi166.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.92.96 [1,900 B] 2022-01-10T01:14:28.464 INFO:teuthology.orchestra.run.smithi166.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.92.96 [2,576 B] 2022-01-10T01:14:28.465 INFO:teuthology.orchestra.run.smithi166.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-92 all 5.4.0-92.103 [11.0 MB] 2022-01-10T01:14:28.674 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-92-generic amd64 5.4.0-92.103 [1,406 kB] 2022-01-10T01:14:28.712 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.92.96 [2,448 B] 2022-01-10T01:14:28.759 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.92.96 [1,900 B] 2022-01-10T01:14:28.759 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.92.96 [2,576 B] 2022-01-10T01:14:28.760 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-92 all 5.4.0-92.103 [11.0 MB] 2022-01-10T01:14:28.761 INFO:teuthology.orchestra.run.smithi166.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-92-generic amd64 5.4.0-92.103 [1,406 kB] 2022-01-10T01:14:28.799 INFO:teuthology.orchestra.run.smithi166.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.92.96 [2,448 B] 2022-01-10T01:14:29.049 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-92-generic amd64 5.4.0-92.103 [1,406 kB] 2022-01-10T01:14:29.065 INFO:teuthology.orchestra.run.smithi036.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.92.96 [1,900 B] 2022-01-10T01:14:29.109 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.92.96 [2,448 B] 2022-01-10T01:14:29.130 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 77.1 MB in 3s (22.8 MB/s) 2022-01-10T01:14:29.152 INFO:teuthology.orchestra.run.smithi036.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.92.96 [2,576 B] 2022-01-10T01:14:29.225 INFO:teuthology.orchestra.run.smithi166.stdout:Fetched 77.1 MB in 3s (22.5 MB/s) 2022-01-10T01:14:29.238 INFO:teuthology.orchestra.run.smithi036.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-92 all 5.4.0-92.103 [11.0 MB] 2022-01-10T01:14:29.322 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-modules-5.4.0-92-generic. 2022-01-10T01:14:29.422 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package linux-modules-5.4.0-92-generic. 2022-01-10T01:14:29.544 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 77.1 MB in 3s (23.1 MB/s) 2022-01-10T01:14:29.693 INFO:teuthology.orchestra.run.smithi036.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-92-generic amd64 5.4.0-92.103 [1,406 kB] 2022-01-10T01:14:29.722 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-modules-5.4.0-92-generic. 2022-01-10T01:14:29.816 INFO:teuthology.orchestra.run.smithi036.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.92.96 [2,448 B] 2022-01-10T01:14:30.231 INFO:teuthology.orchestra.run.smithi036.stdout:Fetched 77.1 MB in 5s (16.8 MB/s) 2022-01-10T01:14:30.398 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package linux-modules-5.4.0-92-generic. 2022-01-10T01:14:31.115 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2022-01-10T01:14:31.122 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../0-linux-modules-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:31.245 INFO:teuthology.orchestra.run.smithi166.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2022-01-10T01:14:31.251 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../0-linux-modules-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:31.252 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-modules-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:31.497 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking linux-modules-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:31.499 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2022-01-10T01:14:31.506 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../0-linux-modules-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:31.693 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-modules-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:32.233 INFO:teuthology.orchestra.run.smithi036.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138265 files and directories currently installed.) 2022-01-10T01:14:32.239 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../0-linux-modules-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:32.333 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-modules-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:33.305 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-image-5.4.0-92-generic. 2022-01-10T01:14:33.322 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../1-linux-image-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:33.411 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-image-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:33.647 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package linux-image-5.4.0-92-generic. 2022-01-10T01:14:33.666 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../1-linux-image-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:33.773 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking linux-image-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:33.914 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-image-5.4.0-92-generic. 2022-01-10T01:14:33.930 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../1-linux-image-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:34.020 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-image-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:34.529 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-92-generic. 2022-01-10T01:14:34.548 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:34.588 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-modules-extra-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:34.734 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package linux-image-5.4.0-92-generic. 2022-01-10T01:14:34.750 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../1-linux-image-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:34.843 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-image-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:34.908 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-92-generic. 2022-01-10T01:14:34.926 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:34.968 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking linux-modules-extra-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:35.116 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-92-generic. 2022-01-10T01:14:35.134 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:35.177 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-modules-extra-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:35.948 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-92-generic. 2022-01-10T01:14:35.964 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:36.006 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-modules-extra-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:39.981 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../3-linux-generic_5.4.0.92.96_amd64.deb ... 2022-01-10T01:14:40.140 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-generic (5.4.0.92.96) over (5.4.0.88.92) ... 2022-01-10T01:14:40.199 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../3-linux-generic_5.4.0.92.96_amd64.deb ... 2022-01-10T01:14:40.317 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking linux-generic (5.4.0.92.96) over (5.4.0.88.92) ... 2022-01-10T01:14:40.494 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.92.96_amd64.deb ... 2022-01-10T01:14:40.500 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../3-linux-generic_5.4.0.92.96_amd64.deb ... 2022-01-10T01:14:40.622 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-image-generic (5.4.0.92.96) over (5.4.0.88.92) ... 2022-01-10T01:14:40.653 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-generic (5.4.0.92.96) over (5.4.0.88.92) ... 2022-01-10T01:14:40.715 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.92.96_amd64.deb ... 2022-01-10T01:14:40.866 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking linux-image-generic (5.4.0.92.96) over (5.4.0.88.92) ... 2022-01-10T01:14:40.992 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-headers-5.4.0-92. 2022-01-10T01:14:41.008 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../5-linux-headers-5.4.0-92_5.4.0-92.103_all.deb ... 2022-01-10T01:14:41.025 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.92.96_amd64.deb ... 2022-01-10T01:14:41.032 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../3-linux-generic_5.4.0.92.96_amd64.deb ... 2022-01-10T01:14:41.050 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-5.4.0-92 (5.4.0-92.103) ... 2022-01-10T01:14:41.165 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-generic (5.4.0.92.96) over (5.4.0.88.92) ... 2022-01-10T01:14:41.175 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-image-generic (5.4.0.92.96) over (5.4.0.88.92) ... 2022-01-10T01:14:41.250 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package linux-headers-5.4.0-92. 2022-01-10T01:14:41.270 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../5-linux-headers-5.4.0-92_5.4.0-92.103_all.deb ... 2022-01-10T01:14:41.315 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking linux-headers-5.4.0-92 (5.4.0-92.103) ... 2022-01-10T01:14:41.528 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-headers-5.4.0-92. 2022-01-10T01:14:41.530 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.92.96_amd64.deb ... 2022-01-10T01:14:41.546 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../5-linux-headers-5.4.0-92_5.4.0-92.103_all.deb ... 2022-01-10T01:14:41.604 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-headers-5.4.0-92 (5.4.0-92.103) ... 2022-01-10T01:14:41.639 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-image-generic (5.4.0.92.96) over (5.4.0.88.92) ... 2022-01-10T01:14:41.967 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package linux-headers-5.4.0-92. 2022-01-10T01:14:41.984 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../5-linux-headers-5.4.0-92_5.4.0-92.103_all.deb ... 2022-01-10T01:14:42.026 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-headers-5.4.0-92 (5.4.0-92.103) ... 2022-01-10T01:14:47.370 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package linux-headers-5.4.0-92-generic. 2022-01-10T01:14:47.395 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../6-linux-headers-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:47.436 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:47.973 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package linux-headers-5.4.0-92-generic. 2022-01-10T01:14:47.998 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../6-linux-headers-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:48.047 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-headers-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:48.060 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-headers-5.4.0-92-generic. 2022-01-10T01:14:48.064 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package linux-headers-5.4.0-92-generic. 2022-01-10T01:14:48.084 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../6-linux-headers-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:48.090 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../6-linux-headers-5.4.0-92-generic_5.4.0-92.103_amd64.deb ... 2022-01-10T01:14:48.126 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-headers-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:48.231 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking linux-headers-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:50.029 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.92.96_amd64.deb ... 2022-01-10T01:14:50.164 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking linux-headers-generic (5.4.0.92.96) over (5.4.0.88.92) ... 2022-01-10T01:14:50.541 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-modules-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:50.957 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.92.96_amd64.deb ... 2022-01-10T01:14:51.024 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.92.96_amd64.deb ... 2022-01-10T01:14:51.081 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking linux-headers-generic (5.4.0.92.96) over (5.4.0.88.92) ... 2022-01-10T01:14:51.167 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-headers-generic (5.4.0.92.96) over (5.4.0.88.92) ... 2022-01-10T01:14:51.225 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.92.96_amd64.deb ... 2022-01-10T01:14:51.349 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking linux-headers-generic (5.4.0.92.96) over (5.4.0.88.92) ... 2022-01-10T01:14:51.482 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up linux-modules-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:51.553 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-modules-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:51.727 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-modules-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:52.235 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-5.4.0-92 (5.4.0-92.103) ... 2022-01-10T01:14:52.361 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-image-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:52.703 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up linux-headers-5.4.0-92 (5.4.0-92.103) ... 2022-01-10T01:14:52.772 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-headers-5.4.0-92 (5.4.0-92.103) ... 2022-01-10T01:14:52.846 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up linux-image-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:52.898 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-image-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:52.954 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-headers-5.4.0-92 (5.4.0-92.103) ... 2022-01-10T01:14:53.089 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-image-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:53.472 INFO:teuthology.orchestra.run.smithi139.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2022-01-10T01:14:53.472 INFO:teuthology.orchestra.run.smithi139.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2022-01-10T01:14:53.473 INFO:teuthology.orchestra.run.smithi139.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-92-generic 2022-01-10T01:14:53.473 INFO:teuthology.orchestra.run.smithi139.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-92-generic 2022-01-10T01:14:53.630 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-modules-extra-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:54.002 INFO:teuthology.orchestra.run.smithi166.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2022-01-10T01:14:54.002 INFO:teuthology.orchestra.run.smithi166.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2022-01-10T01:14:54.002 INFO:teuthology.orchestra.run.smithi166.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-92-generic 2022-01-10T01:14:54.002 INFO:teuthology.orchestra.run.smithi166.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-92-generic 2022-01-10T01:14:54.132 INFO:teuthology.orchestra.run.smithi059.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2022-01-10T01:14:54.132 INFO:teuthology.orchestra.run.smithi059.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2022-01-10T01:14:54.133 INFO:teuthology.orchestra.run.smithi059.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-92-generic 2022-01-10T01:14:54.133 INFO:teuthology.orchestra.run.smithi059.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-92-generic 2022-01-10T01:14:54.156 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up linux-modules-extra-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:54.243 INFO:teuthology.orchestra.run.smithi036.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.4.0-88-generic 2022-01-10T01:14:54.244 INFO:teuthology.orchestra.run.smithi036.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.4.0-88-generic 2022-01-10T01:14:54.244 INFO:teuthology.orchestra.run.smithi036.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-92-generic 2022-01-10T01:14:54.244 INFO:teuthology.orchestra.run.smithi036.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-92-generic 2022-01-10T01:14:54.391 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-modules-extra-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:54.641 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-modules-extra-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:54.823 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:54.949 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-image-generic (5.4.0.92.96) ... 2022-01-10T01:14:55.075 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-headers-generic (5.4.0.92.96) ... 2022-01-10T01:14:55.201 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up linux-generic (5.4.0.92.96) ... 2022-01-10T01:14:55.308 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up linux-headers-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:55.352 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for linux-image-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:55.467 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up linux-image-generic (5.4.0.92.96) ... 2022-01-10T01:14:55.535 INFO:teuthology.orchestra.run.smithi139.stdout:/etc/kernel/postinst.d/initramfs-tools: 2022-01-10T01:14:55.536 INFO:teuthology.orchestra.run.smithi139.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-92-generic 2022-01-10T01:14:55.610 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up linux-headers-generic (5.4.0.92.96) ... 2022-01-10T01:14:55.736 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up linux-generic (5.4.0.92.96) ... 2022-01-10T01:14:55.879 INFO:teuthology.orchestra.run.smithi166.stdout:Processing triggers for linux-image-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:55.884 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-headers-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:55.992 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-headers-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:56.035 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-image-generic (5.4.0.92.96) ... 2022-01-10T01:14:56.065 INFO:teuthology.orchestra.run.smithi166.stdout:/etc/kernel/postinst.d/initramfs-tools: 2022-01-10T01:14:56.065 INFO:teuthology.orchestra.run.smithi166.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-92-generic 2022-01-10T01:14:56.127 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-image-generic (5.4.0.92.96) ... 2022-01-10T01:14:56.161 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-headers-generic (5.4.0.92.96) ... 2022-01-10T01:14:56.244 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-headers-generic (5.4.0.92.96) ... 2022-01-10T01:14:56.304 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-generic (5.4.0.92.96) ... 2022-01-10T01:14:56.353 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up linux-generic (5.4.0.92.96) ... 2022-01-10T01:14:56.406 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for linux-image-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:56.480 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for linux-image-5.4.0-92-generic (5.4.0-92.103) ... 2022-01-10T01:14:56.629 INFO:teuthology.orchestra.run.smithi059.stdout:/etc/kernel/postinst.d/initramfs-tools: 2022-01-10T01:14:56.629 INFO:teuthology.orchestra.run.smithi059.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-92-generic 2022-01-10T01:14:56.671 INFO:teuthology.orchestra.run.smithi036.stdout:/etc/kernel/postinst.d/initramfs-tools: 2022-01-10T01:14:56.671 INFO:teuthology.orchestra.run.smithi036.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-92-generic 2022-01-10T01:15:17.429 INFO:teuthology.orchestra.run.smithi139.stdout:/etc/kernel/postinst.d/zz-update-grub: 2022-01-10T01:15:17.430 INFO:teuthology.orchestra.run.smithi139.stdout:Sourcing file `/etc/default/grub' 2022-01-10T01:15:17.453 INFO:teuthology.orchestra.run.smithi139.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2022-01-10T01:15:17.484 INFO:teuthology.orchestra.run.smithi139.stdout:Generating grub configuration file ... 2022-01-10T01:15:17.814 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.4.0-92-generic 2022-01-10T01:15:17.849 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.4.0-92-generic 2022-01-10T01:15:18.243 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2022-01-10T01:15:18.253 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2022-01-10T01:15:18.317 INFO:teuthology.orchestra.run.smithi166.stdout:/etc/kernel/postinst.d/zz-update-grub: 2022-01-10T01:15:18.318 INFO:teuthology.orchestra.run.smithi166.stdout:Sourcing file `/etc/default/grub' 2022-01-10T01:15:18.338 INFO:teuthology.orchestra.run.smithi166.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2022-01-10T01:15:18.359 INFO:teuthology.orchestra.run.smithi139.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2022-01-10T01:15:18.365 INFO:teuthology.orchestra.run.smithi166.stdout:Generating grub configuration file ... 2022-01-10T01:15:18.371 INFO:teuthology.orchestra.run.smithi139.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2022-01-10T01:15:18.744 INFO:teuthology.orchestra.run.smithi166.stdout:Found linux image: /boot/vmlinuz-5.4.0-92-generic 2022-01-10T01:15:18.769 INFO:teuthology.orchestra.run.smithi166.stdout:Found initrd image: /boot/initrd.img-5.4.0-92-generic 2022-01-10T01:15:19.033 INFO:teuthology.orchestra.run.smithi036.stdout:/etc/kernel/postinst.d/zz-update-grub: 2022-01-10T01:15:19.033 INFO:teuthology.orchestra.run.smithi036.stdout:Sourcing file `/etc/default/grub' 2022-01-10T01:15:19.060 INFO:teuthology.orchestra.run.smithi036.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2022-01-10T01:15:19.083 INFO:teuthology.orchestra.run.smithi036.stdout:Generating grub configuration file ... 2022-01-10T01:15:19.229 INFO:teuthology.orchestra.run.smithi166.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2022-01-10T01:15:19.240 INFO:teuthology.orchestra.run.smithi059.stdout:/etc/kernel/postinst.d/zz-update-grub: 2022-01-10T01:15:19.240 INFO:teuthology.orchestra.run.smithi059.stdout:Sourcing file `/etc/default/grub' 2022-01-10T01:15:19.241 INFO:teuthology.orchestra.run.smithi166.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2022-01-10T01:15:19.259 INFO:teuthology.orchestra.run.smithi059.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2022-01-10T01:15:19.290 INFO:teuthology.orchestra.run.smithi059.stdout:Generating grub configuration file ... 2022-01-10T01:15:19.360 INFO:teuthology.orchestra.run.smithi166.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2022-01-10T01:15:19.372 INFO:teuthology.orchestra.run.smithi166.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2022-01-10T01:15:19.447 INFO:teuthology.orchestra.run.smithi036.stdout:Found linux image: /boot/vmlinuz-5.4.0-92-generic 2022-01-10T01:15:19.468 INFO:teuthology.orchestra.run.smithi036.stdout:Found initrd image: /boot/initrd.img-5.4.0-92-generic 2022-01-10T01:15:19.646 INFO:teuthology.orchestra.run.smithi059.stdout:Found linux image: /boot/vmlinuz-5.4.0-92-generic 2022-01-10T01:15:19.674 INFO:teuthology.orchestra.run.smithi059.stdout:Found initrd image: /boot/initrd.img-5.4.0-92-generic 2022-01-10T01:15:19.859 INFO:teuthology.orchestra.run.smithi036.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2022-01-10T01:15:19.870 INFO:teuthology.orchestra.run.smithi036.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2022-01-10T01:15:19.987 INFO:teuthology.orchestra.run.smithi036.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2022-01-10T01:15:19.998 INFO:teuthology.orchestra.run.smithi036.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2022-01-10T01:15:20.110 INFO:teuthology.orchestra.run.smithi059.stdout:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2022-01-10T01:15:20.122 INFO:teuthology.orchestra.run.smithi059.stdout:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2022-01-10T01:15:20.235 INFO:teuthology.orchestra.run.smithi059.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2022-01-10T01:15:20.247 INFO:teuthology.orchestra.run.smithi059.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2022-01-10T01:15:21.045 INFO:teuthology.orchestra.run.smithi139.stdout:done 2022-01-10T01:15:21.454 DEBUG:teuthology.orchestra.run.smithi139:> dpkg -s linux-image-generic 2022-01-10T01:15:21.487 INFO:teuthology.orchestra.run.smithi139.stdout:Package: linux-image-generic 2022-01-10T01:15:21.488 INFO:teuthology.orchestra.run.smithi139.stdout:Status: install ok installed 2022-01-10T01:15:21.488 INFO:teuthology.orchestra.run.smithi139.stdout:Priority: optional 2022-01-10T01:15:21.488 INFO:teuthology.orchestra.run.smithi139.stdout:Section: kernel 2022-01-10T01:15:21.488 INFO:teuthology.orchestra.run.smithi139.stdout:Installed-Size: 18 2022-01-10T01:15:21.489 INFO:teuthology.orchestra.run.smithi139.stdout:Maintainer: Ubuntu Kernel Team 2022-01-10T01:15:21.489 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: amd64 2022-01-10T01:15:21.489 INFO:teuthology.orchestra.run.smithi139.stdout:Source: linux-meta 2022-01-10T01:15:21.489 INFO:teuthology.orchestra.run.smithi139.stdout:Version: 5.4.0.92.96 2022-01-10T01:15:21.489 INFO:teuthology.orchestra.run.smithi139.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2022-01-10T01:15:21.490 INFO:teuthology.orchestra.run.smithi139.stdout:Depends: linux-image-5.4.0-92-generic, linux-modules-extra-5.4.0-92-generic, linux-firmware, intel-microcode, amd64-microcode 2022-01-10T01:15:21.490 INFO:teuthology.orchestra.run.smithi139.stdout:Recommends: thermald 2022-01-10T01:15:21.490 INFO:teuthology.orchestra.run.smithi139.stdout:Description: Generic Linux kernel image 2022-01-10T01:15:21.490 INFO:teuthology.orchestra.run.smithi139.stdout: This package will always depend on the latest generic kernel image 2022-01-10T01:15:21.491 INFO:teuthology.orchestra.run.smithi139.stdout: available. 2022-01-10T01:15:21.491 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-92-generic 2022-01-10T01:15:21.491 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2022-01-10T01:15:21.492 DEBUG:teuthology.task.kernel:src is distro, skipping download 2022-01-10T01:15:21.492 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2022-01-10T01:15:21.492 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi139.front.sepia.ceph.com, path=None, version=distro) 2022-01-10T01:15:21.493 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get clean 2022-01-10T01:15:21.572 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2022-01-10T01:15:21.843 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2022-01-10T01:15:21.843 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2022-01-10T01:15:21.918 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2022-01-10T01:15:22.004 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2022-01-10T01:15:22.028 INFO:teuthology.orchestra.run.smithi166.stdout:done 2022-01-10T01:15:22.477 DEBUG:teuthology.orchestra.run.smithi166:> dpkg -s linux-image-generic 2022-01-10T01:15:22.510 INFO:teuthology.orchestra.run.smithi166.stdout:Package: linux-image-generic 2022-01-10T01:15:22.510 INFO:teuthology.orchestra.run.smithi166.stdout:Status: install ok installed 2022-01-10T01:15:22.511 INFO:teuthology.orchestra.run.smithi166.stdout:Priority: optional 2022-01-10T01:15:22.511 INFO:teuthology.orchestra.run.smithi166.stdout:Section: kernel 2022-01-10T01:15:22.511 INFO:teuthology.orchestra.run.smithi166.stdout:Installed-Size: 18 2022-01-10T01:15:22.511 INFO:teuthology.orchestra.run.smithi166.stdout:Maintainer: Ubuntu Kernel Team 2022-01-10T01:15:22.511 INFO:teuthology.orchestra.run.smithi166.stdout:Architecture: amd64 2022-01-10T01:15:22.512 INFO:teuthology.orchestra.run.smithi166.stdout:Source: linux-meta 2022-01-10T01:15:22.512 INFO:teuthology.orchestra.run.smithi166.stdout:Version: 5.4.0.92.96 2022-01-10T01:15:22.512 INFO:teuthology.orchestra.run.smithi166.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2022-01-10T01:15:22.512 INFO:teuthology.orchestra.run.smithi166.stdout:Depends: linux-image-5.4.0-92-generic, linux-modules-extra-5.4.0-92-generic, linux-firmware, intel-microcode, amd64-microcode 2022-01-10T01:15:22.513 INFO:teuthology.orchestra.run.smithi166.stdout:Recommends: thermald 2022-01-10T01:15:22.513 INFO:teuthology.orchestra.run.smithi166.stdout:Description: Generic Linux kernel image 2022-01-10T01:15:22.513 INFO:teuthology.orchestra.run.smithi166.stdout: This package will always depend on the latest generic kernel image 2022-01-10T01:15:22.513 INFO:teuthology.orchestra.run.smithi166.stdout: available. 2022-01-10T01:15:22.514 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-92-generic 2022-01-10T01:15:22.515 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2022-01-10T01:15:22.515 DEBUG:teuthology.task.kernel:src is distro, skipping download 2022-01-10T01:15:22.515 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2022-01-10T01:15:22.516 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi166.front.sepia.ceph.com, path=None, version=distro) 2022-01-10T01:15:22.516 DEBUG:teuthology.orchestra.run.smithi166:> sudo apt-get clean 2022-01-10T01:15:22.625 INFO:teuthology.orchestra.run.smithi036.stdout:done 2022-01-10T01:15:22.632 DEBUG:teuthology.orchestra.run.smithi166:> sudo apt-get update 2022-01-10T01:15:22.904 INFO:teuthology.orchestra.run.smithi166.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2022-01-10T01:15:22.904 INFO:teuthology.orchestra.run.smithi166.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2022-01-10T01:15:22.908 INFO:teuthology.orchestra.run.smithi059.stdout:done 2022-01-10T01:15:22.978 INFO:teuthology.orchestra.run.smithi166.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2022-01-10T01:15:23.021 DEBUG:teuthology.orchestra.run.smithi036:> dpkg -s linux-image-generic 2022-01-10T01:15:23.054 INFO:teuthology.orchestra.run.smithi036.stdout:Package: linux-image-generic 2022-01-10T01:15:23.055 INFO:teuthology.orchestra.run.smithi036.stdout:Status: install ok installed 2022-01-10T01:15:23.055 INFO:teuthology.orchestra.run.smithi036.stdout:Priority: optional 2022-01-10T01:15:23.055 INFO:teuthology.orchestra.run.smithi036.stdout:Section: kernel 2022-01-10T01:15:23.055 INFO:teuthology.orchestra.run.smithi036.stdout:Installed-Size: 18 2022-01-10T01:15:23.055 INFO:teuthology.orchestra.run.smithi036.stdout:Maintainer: Ubuntu Kernel Team 2022-01-10T01:15:23.056 INFO:teuthology.orchestra.run.smithi036.stdout:Architecture: amd64 2022-01-10T01:15:23.056 INFO:teuthology.orchestra.run.smithi036.stdout:Source: linux-meta 2022-01-10T01:15:23.056 INFO:teuthology.orchestra.run.smithi036.stdout:Version: 5.4.0.92.96 2022-01-10T01:15:23.056 INFO:teuthology.orchestra.run.smithi036.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2022-01-10T01:15:23.057 INFO:teuthology.orchestra.run.smithi036.stdout:Depends: linux-image-5.4.0-92-generic, linux-modules-extra-5.4.0-92-generic, linux-firmware, intel-microcode, amd64-microcode 2022-01-10T01:15:23.057 INFO:teuthology.orchestra.run.smithi036.stdout:Recommends: thermald 2022-01-10T01:15:23.057 INFO:teuthology.orchestra.run.smithi036.stdout:Description: Generic Linux kernel image 2022-01-10T01:15:23.057 INFO:teuthology.orchestra.run.smithi036.stdout: This package will always depend on the latest generic kernel image 2022-01-10T01:15:23.057 INFO:teuthology.orchestra.run.smithi036.stdout: available. 2022-01-10T01:15:23.058 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-92-generic 2022-01-10T01:15:23.058 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2022-01-10T01:15:23.058 DEBUG:teuthology.task.kernel:src is distro, skipping download 2022-01-10T01:15:23.059 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2022-01-10T01:15:23.059 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi036.front.sepia.ceph.com, path=None, version=distro) 2022-01-10T01:15:23.059 DEBUG:teuthology.orchestra.run.smithi036:> sudo apt-get clean 2022-01-10T01:15:23.063 INFO:teuthology.orchestra.run.smithi166.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2022-01-10T01:15:23.125 DEBUG:teuthology.orchestra.run.smithi036:> sudo apt-get update 2022-01-10T01:15:23.285 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2022-01-10T01:15:23.373 DEBUG:teuthology.orchestra.run.smithi059:> dpkg -s linux-image-generic 2022-01-10T01:15:23.374 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2022-01-10T01:15:23.384 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2022-01-10T01:15:23.395 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2022-01-10T01:15:23.407 INFO:teuthology.orchestra.run.smithi059.stdout:Package: linux-image-generic 2022-01-10T01:15:23.408 INFO:teuthology.orchestra.run.smithi059.stdout:Status: install ok installed 2022-01-10T01:15:23.408 INFO:teuthology.orchestra.run.smithi059.stdout:Priority: optional 2022-01-10T01:15:23.408 INFO:teuthology.orchestra.run.smithi059.stdout:Section: kernel 2022-01-10T01:15:23.408 INFO:teuthology.orchestra.run.smithi059.stdout:Installed-Size: 18 2022-01-10T01:15:23.409 INFO:teuthology.orchestra.run.smithi059.stdout:Maintainer: Ubuntu Kernel Team 2022-01-10T01:15:23.409 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: amd64 2022-01-10T01:15:23.409 INFO:teuthology.orchestra.run.smithi059.stdout:Source: linux-meta 2022-01-10T01:15:23.409 INFO:teuthology.orchestra.run.smithi059.stdout:Version: 5.4.0.92.96 2022-01-10T01:15:23.410 INFO:teuthology.orchestra.run.smithi059.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2022-01-10T01:15:23.410 INFO:teuthology.orchestra.run.smithi059.stdout:Depends: linux-image-5.4.0-92-generic, linux-modules-extra-5.4.0-92-generic, linux-firmware, intel-microcode, amd64-microcode 2022-01-10T01:15:23.410 INFO:teuthology.orchestra.run.smithi059.stdout:Recommends: thermald 2022-01-10T01:15:23.410 INFO:teuthology.orchestra.run.smithi059.stdout:Description: Generic Linux kernel image 2022-01-10T01:15:23.410 INFO:teuthology.orchestra.run.smithi059.stdout: This package will always depend on the latest generic kernel image 2022-01-10T01:15:23.411 INFO:teuthology.orchestra.run.smithi059.stdout: available. 2022-01-10T01:15:23.411 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-88-generic Expected: 5.4.0-92-generic 2022-01-10T01:15:23.411 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2022-01-10T01:15:23.412 DEBUG:teuthology.task.kernel:src is distro, skipping download 2022-01-10T01:15:23.412 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2022-01-10T01:15:23.412 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi059.front.sepia.ceph.com, path=None, version=distro) 2022-01-10T01:15:23.412 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get clean 2022-01-10T01:15:23.460 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2022-01-10T01:15:23.470 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2022-01-10T01:15:23.482 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get update 2022-01-10T01:15:23.556 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2022-01-10T01:15:23.631 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2022-01-10T01:15:23.632 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2022-01-10T01:15:23.748 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2022-01-10T01:15:23.749 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2022-01-10T01:15:23.775 INFO:teuthology.orchestra.run.smithi139.stdout:linux-image-generic is already the newest version (5.4.0.92.96). 2022-01-10T01:15:23.775 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2022-01-10T01:15:23.775 INFO:teuthology.orchestra.run.smithi139.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2022-01-10T01:15:23.776 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2022-01-10T01:15:23.776 INFO:teuthology.orchestra.run.smithi139.stdout: linux-modules-extra-5.4.0-66-generic 2022-01-10T01:15:23.777 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2022-01-10T01:15:23.815 INFO:teuthology.orchestra.run.smithi139.stdout:0 upgraded, 0 newly installed, 0 to remove and 96 not upgraded. 2022-01-10T01:15:23.817 DEBUG:teuthology.orchestra.run.smithi139:> dpkg -s linux-image-generic 2022-01-10T01:15:23.823 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2022-01-10T01:15:23.838 INFO:teuthology.orchestra.run.smithi139.stdout:Package: linux-image-generic 2022-01-10T01:15:23.838 INFO:teuthology.orchestra.run.smithi139.stdout:Status: install ok installed 2022-01-10T01:15:23.839 INFO:teuthology.orchestra.run.smithi139.stdout:Priority: optional 2022-01-10T01:15:23.839 INFO:teuthology.orchestra.run.smithi139.stdout:Section: kernel 2022-01-10T01:15:23.839 INFO:teuthology.orchestra.run.smithi139.stdout:Installed-Size: 18 2022-01-10T01:15:23.839 INFO:teuthology.orchestra.run.smithi139.stdout:Maintainer: Ubuntu Kernel Team 2022-01-10T01:15:23.840 INFO:teuthology.orchestra.run.smithi139.stdout:Architecture: amd64 2022-01-10T01:15:23.840 INFO:teuthology.orchestra.run.smithi139.stdout:Source: linux-meta 2022-01-10T01:15:23.840 INFO:teuthology.orchestra.run.smithi139.stdout:Version: 5.4.0.92.96 2022-01-10T01:15:23.840 INFO:teuthology.orchestra.run.smithi139.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2022-01-10T01:15:23.840 INFO:teuthology.orchestra.run.smithi139.stdout:Depends: linux-image-5.4.0-92-generic, linux-modules-extra-5.4.0-92-generic, linux-firmware, intel-microcode, amd64-microcode 2022-01-10T01:15:23.841 INFO:teuthology.orchestra.run.smithi139.stdout:Recommends: thermald 2022-01-10T01:15:23.841 INFO:teuthology.orchestra.run.smithi139.stdout:Description: Generic Linux kernel image 2022-01-10T01:15:23.841 INFO:teuthology.orchestra.run.smithi139.stdout: This package will always depend on the latest generic kernel image 2022-01-10T01:15:23.841 INFO:teuthology.orchestra.run.smithi139.stdout: available. 2022-01-10T01:15:23.842 DEBUG:teuthology.orchestra.run.smithi139:> mktemp 2022-01-10T01:15:23.848 INFO:teuthology.orchestra.run.smithi139.stdout:/tmp/tmp.6ljdibZ2yD 2022-01-10T01:15:23.848 DEBUG:teuthology.orchestra.run.smithi139:> sudo cp /boot/grub/grub.cfg /tmp/tmp.6ljdibZ2yD 2022-01-10T01:15:23.904 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0666 /tmp/tmp.6ljdibZ2yD 2022-01-10T01:15:23.917 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2022-01-10T01:15:23.945 DEBUG:teuthology.orchestra.remote:smithi139:/tmp/tmp.6ljdibZ2yD is 10KB 2022-01-10T01:15:23.960 DEBUG:teuthology.orchestra.run.smithi139:> rm -fr /tmp/tmp.6ljdibZ2yD 2022-01-10T01:15:23.967 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2022-01-10T01:15:24.026 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2022-01-10T01:15:24.026 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/grub.d/01_ceph_kernel 2022-01-10T01:15:24.027 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2022-01-10T01:15:24.074 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-92-generic 2022-01-10T01:15:24.075 DEBUG:teuthology.orchestra.run.smithi139:> sudo update-grub 2022-01-10T01:15:24.425 INFO:teuthology.orchestra.run.smithi166.stdout:Reading package lists... 2022-01-10T01:15:24.448 DEBUG:teuthology.orchestra.run.smithi166:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2022-01-10T01:15:24.513 INFO:teuthology.orchestra.run.smithi166.stdout:Reading package lists... 2022-01-10T01:15:24.664 INFO:teuthology.orchestra.run.smithi166.stdout:Building dependency tree... 2022-01-10T01:15:24.665 INFO:teuthology.orchestra.run.smithi166.stdout:Reading state information... 2022-01-10T01:15:24.791 INFO:teuthology.orchestra.run.smithi166.stdout:linux-image-generic is already the newest version (5.4.0.92.96). 2022-01-10T01:15:24.791 INFO:teuthology.orchestra.run.smithi166.stdout:The following packages were automatically installed and are no longer required: 2022-01-10T01:15:24.792 INFO:teuthology.orchestra.run.smithi166.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2022-01-10T01:15:24.792 INFO:teuthology.orchestra.run.smithi166.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2022-01-10T01:15:24.792 INFO:teuthology.orchestra.run.smithi166.stdout: linux-modules-extra-5.4.0-66-generic 2022-01-10T01:15:24.793 INFO:teuthology.orchestra.run.smithi166.stdout:Use 'sudo apt autoremove' to remove them. 2022-01-10T01:15:24.830 INFO:teuthology.orchestra.run.smithi166.stdout:0 upgraded, 0 newly installed, 0 to remove and 96 not upgraded. 2022-01-10T01:15:24.832 DEBUG:teuthology.orchestra.run.smithi166:> dpkg -s linux-image-generic 2022-01-10T01:15:24.845 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2022-01-10T01:15:24.851 INFO:teuthology.orchestra.run.smithi166.stdout:Package: linux-image-generic 2022-01-10T01:15:24.851 INFO:teuthology.orchestra.run.smithi166.stdout:Status: install ok installed 2022-01-10T01:15:24.851 INFO:teuthology.orchestra.run.smithi166.stdout:Priority: optional 2022-01-10T01:15:24.852 INFO:teuthology.orchestra.run.smithi166.stdout:Section: kernel 2022-01-10T01:15:24.852 INFO:teuthology.orchestra.run.smithi166.stdout:Installed-Size: 18 2022-01-10T01:15:24.852 INFO:teuthology.orchestra.run.smithi166.stdout:Maintainer: Ubuntu Kernel Team 2022-01-10T01:15:24.852 INFO:teuthology.orchestra.run.smithi166.stdout:Architecture: amd64 2022-01-10T01:15:24.852 INFO:teuthology.orchestra.run.smithi166.stdout:Source: linux-meta 2022-01-10T01:15:24.853 INFO:teuthology.orchestra.run.smithi166.stdout:Version: 5.4.0.92.96 2022-01-10T01:15:24.853 INFO:teuthology.orchestra.run.smithi166.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2022-01-10T01:15:24.853 INFO:teuthology.orchestra.run.smithi166.stdout:Depends: linux-image-5.4.0-92-generic, linux-modules-extra-5.4.0-92-generic, linux-firmware, intel-microcode, amd64-microcode 2022-01-10T01:15:24.854 INFO:teuthology.orchestra.run.smithi166.stdout:Recommends: thermald 2022-01-10T01:15:24.854 INFO:teuthology.orchestra.run.smithi166.stdout:Description: Generic Linux kernel image 2022-01-10T01:15:24.855 INFO:teuthology.orchestra.run.smithi166.stdout: This package will always depend on the latest generic kernel image 2022-01-10T01:15:24.855 INFO:teuthology.orchestra.run.smithi166.stdout: available. 2022-01-10T01:15:24.856 DEBUG:teuthology.orchestra.run.smithi166:> mktemp 2022-01-10T01:15:24.862 INFO:teuthology.orchestra.run.smithi166.stdout:/tmp/tmp.FxxDDWuJiJ 2022-01-10T01:15:24.862 DEBUG:teuthology.orchestra.run.smithi166:> sudo cp /boot/grub/grub.cfg /tmp/tmp.FxxDDWuJiJ 2022-01-10T01:15:24.869 DEBUG:teuthology.orchestra.run.smithi036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2022-01-10T01:15:24.873 DEBUG:teuthology.orchestra.run.smithi166:> sudo chmod 0666 /tmp/tmp.FxxDDWuJiJ 2022-01-10T01:15:24.943 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2022-01-10T01:15:24.952 DEBUG:teuthology.orchestra.remote:smithi166:/tmp/tmp.FxxDDWuJiJ is 10KB 2022-01-10T01:15:24.966 DEBUG:teuthology.orchestra.run.smithi166:> rm -fr /tmp/tmp.FxxDDWuJiJ 2022-01-10T01:15:24.971 DEBUG:teuthology.orchestra.run.smithi166:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2022-01-10T01:15:25.027 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-01-10T01:15:25.027 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd of=/etc/grub.d/01_ceph_kernel 2022-01-10T01:15:25.028 DEBUG:teuthology.orchestra.run.smithi166:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2022-01-10T01:15:25.089 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-92-generic 2022-01-10T01:15:25.090 DEBUG:teuthology.orchestra.run.smithi166:> sudo update-grub 2022-01-10T01:15:25.115 INFO:teuthology.orchestra.run.smithi036.stdout:Building dependency tree... 2022-01-10T01:15:25.116 INFO:teuthology.orchestra.run.smithi036.stdout:Reading state information... 2022-01-10T01:15:25.267 INFO:teuthology.orchestra.run.smithi036.stdout:linux-image-generic is already the newest version (5.4.0.92.96). 2022-01-10T01:15:25.267 INFO:teuthology.orchestra.run.smithi036.stdout:The following packages were automatically installed and are no longer required: 2022-01-10T01:15:25.267 INFO:teuthology.orchestra.run.smithi036.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2022-01-10T01:15:25.268 INFO:teuthology.orchestra.run.smithi036.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2022-01-10T01:15:25.268 INFO:teuthology.orchestra.run.smithi036.stdout: linux-modules-extra-5.4.0-66-generic 2022-01-10T01:15:25.268 INFO:teuthology.orchestra.run.smithi036.stdout:Use 'sudo apt autoremove' to remove them. 2022-01-10T01:15:25.307 INFO:teuthology.orchestra.run.smithi036.stdout:0 upgraded, 0 newly installed, 0 to remove and 96 not upgraded. 2022-01-10T01:15:25.309 DEBUG:teuthology.orchestra.run.smithi036:> dpkg -s linux-image-generic 2022-01-10T01:15:25.332 INFO:teuthology.orchestra.run.smithi036.stdout:Package: linux-image-generic 2022-01-10T01:15:25.332 INFO:teuthology.orchestra.run.smithi036.stdout:Status: install ok installed 2022-01-10T01:15:25.333 INFO:teuthology.orchestra.run.smithi036.stdout:Priority: optional 2022-01-10T01:15:25.333 INFO:teuthology.orchestra.run.smithi036.stdout:Section: kernel 2022-01-10T01:15:25.333 INFO:teuthology.orchestra.run.smithi036.stdout:Installed-Size: 18 2022-01-10T01:15:25.333 INFO:teuthology.orchestra.run.smithi036.stdout:Maintainer: Ubuntu Kernel Team 2022-01-10T01:15:25.334 INFO:teuthology.orchestra.run.smithi036.stdout:Architecture: amd64 2022-01-10T01:15:25.334 INFO:teuthology.orchestra.run.smithi036.stdout:Source: linux-meta 2022-01-10T01:15:25.334 INFO:teuthology.orchestra.run.smithi036.stdout:Version: 5.4.0.92.96 2022-01-10T01:15:25.334 INFO:teuthology.orchestra.run.smithi036.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2022-01-10T01:15:25.335 INFO:teuthology.orchestra.run.smithi036.stdout:Depends: linux-image-5.4.0-92-generic, linux-modules-extra-5.4.0-92-generic, linux-firmware, intel-microcode, amd64-microcode 2022-01-10T01:15:25.335 INFO:teuthology.orchestra.run.smithi036.stdout:Recommends: thermald 2022-01-10T01:15:25.335 INFO:teuthology.orchestra.run.smithi036.stdout:Description: Generic Linux kernel image 2022-01-10T01:15:25.335 INFO:teuthology.orchestra.run.smithi036.stdout: This package will always depend on the latest generic kernel image 2022-01-10T01:15:25.336 INFO:teuthology.orchestra.run.smithi036.stdout: available. 2022-01-10T01:15:25.336 DEBUG:teuthology.orchestra.run.smithi036:> mktemp 2022-01-10T01:15:25.342 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.G1Fo4dqAt7 2022-01-10T01:15:25.343 DEBUG:teuthology.orchestra.run.smithi036:> sudo cp /boot/grub/grub.cfg /tmp/tmp.G1Fo4dqAt7 2022-01-10T01:15:25.343 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2022-01-10T01:15:25.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2022-01-10T01:15:25.373 INFO:teuthology.orchestra.run.smithi139.stderr:Sourcing file `/etc/default/grub' 2022-01-10T01:15:25.375 INFO:teuthology.orchestra.run.smithi139.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2022-01-10T01:15:25.390 INFO:teuthology.orchestra.run.smithi139.stderr:Generating grub configuration file ... 2022-01-10T01:15:25.413 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.G1Fo4dqAt7 2022-01-10T01:15:25.434 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2022-01-10T01:15:25.469 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.G1Fo4dqAt7 is 10KB 2022-01-10T01:15:25.484 DEBUG:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.G1Fo4dqAt7 2022-01-10T01:15:25.491 DEBUG:teuthology.orchestra.run.smithi036:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2022-01-10T01:15:25.549 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2022-01-10T01:15:25.550 DEBUG:teuthology.orchestra.run.smithi036:> sudo dd of=/etc/grub.d/01_ceph_kernel 2022-01-10T01:15:25.550 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2022-01-10T01:15:25.591 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-92-generic 2022-01-10T01:15:25.591 DEBUG:teuthology.orchestra.run.smithi036:> sudo update-grub 2022-01-10T01:15:25.608 INFO:teuthology.orchestra.run.smithi059.stdout:Building dependency tree... 2022-01-10T01:15:25.608 INFO:teuthology.orchestra.run.smithi059.stdout:Reading state information... 2022-01-10T01:15:25.629 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.4.0-92-generic 2022-01-10T01:15:25.641 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.4.0-92-generic 2022-01-10T01:15:25.757 INFO:teuthology.orchestra.run.smithi059.stdout:linux-image-generic is already the newest version (5.4.0.92.96). 2022-01-10T01:15:25.758 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages were automatically installed and are no longer required: 2022-01-10T01:15:25.758 INFO:teuthology.orchestra.run.smithi059.stdout: libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2022-01-10T01:15:25.758 INFO:teuthology.orchestra.run.smithi059.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2022-01-10T01:15:25.759 INFO:teuthology.orchestra.run.smithi059.stdout: linux-modules-extra-5.4.0-66-generic 2022-01-10T01:15:25.759 INFO:teuthology.orchestra.run.smithi059.stdout:Use 'sudo apt autoremove' to remove them. 2022-01-10T01:15:25.797 INFO:teuthology.orchestra.run.smithi059.stdout:0 upgraded, 0 newly installed, 0 to remove and 96 not upgraded. 2022-01-10T01:15:25.799 DEBUG:teuthology.orchestra.run.smithi059:> dpkg -s linux-image-generic 2022-01-10T01:15:25.819 INFO:teuthology.orchestra.run.smithi059.stdout:Package: linux-image-generic 2022-01-10T01:15:25.820 INFO:teuthology.orchestra.run.smithi059.stdout:Status: install ok installed 2022-01-10T01:15:25.820 INFO:teuthology.orchestra.run.smithi059.stdout:Priority: optional 2022-01-10T01:15:25.820 INFO:teuthology.orchestra.run.smithi059.stdout:Section: kernel 2022-01-10T01:15:25.820 INFO:teuthology.orchestra.run.smithi059.stdout:Installed-Size: 18 2022-01-10T01:15:25.821 INFO:teuthology.orchestra.run.smithi059.stdout:Maintainer: Ubuntu Kernel Team 2022-01-10T01:15:25.821 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: amd64 2022-01-10T01:15:25.821 INFO:teuthology.orchestra.run.smithi059.stdout:Source: linux-meta 2022-01-10T01:15:25.821 INFO:teuthology.orchestra.run.smithi059.stdout:Version: 5.4.0.92.96 2022-01-10T01:15:25.822 INFO:teuthology.orchestra.run.smithi059.stdout:Provides: virtualbox-guest-modules (= 6.1.26-dfsg-3~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.13) 2022-01-10T01:15:25.822 INFO:teuthology.orchestra.run.smithi059.stdout:Depends: linux-image-5.4.0-92-generic, linux-modules-extra-5.4.0-92-generic, linux-firmware, intel-microcode, amd64-microcode 2022-01-10T01:15:25.822 INFO:teuthology.orchestra.run.smithi059.stdout:Recommends: thermald 2022-01-10T01:15:25.822 INFO:teuthology.orchestra.run.smithi059.stdout:Description: Generic Linux kernel image 2022-01-10T01:15:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: This package will always depend on the latest generic kernel image 2022-01-10T01:15:25.823 INFO:teuthology.orchestra.run.smithi059.stdout: available. 2022-01-10T01:15:25.823 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2022-01-10T01:15:25.870 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.4kFbjNzUhb 2022-01-10T01:15:25.870 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /boot/grub/grub.cfg /tmp/tmp.4kFbjNzUhb 2022-01-10T01:15:25.885 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.4kFbjNzUhb 2022-01-10T01:15:25.933 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.4kFbjNzUhb is 10KB 2022-01-10T01:15:25.946 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.4kFbjNzUhb 2022-01-10T01:15:25.953 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2022-01-10T01:15:26.012 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2022-01-10T01:15:26.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/grub.d/01_ceph_kernel 2022-01-10T01:15:26.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2022-01-10T01:15:26.021 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2022-01-10T01:15:26.033 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2022-01-10T01:15:26.079 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-92-generic 2022-01-10T01:15:26.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo update-grub 2022-01-10T01:15:26.129 INFO:teuthology.orchestra.run.smithi139.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2022-01-10T01:15:26.140 INFO:teuthology.orchestra.run.smithi139.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2022-01-10T01:15:26.459 INFO:teuthology.orchestra.run.smithi166.stderr:Sourcing file `/etc/default/grub' 2022-01-10T01:15:26.461 INFO:teuthology.orchestra.run.smithi166.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2022-01-10T01:15:26.472 INFO:teuthology.orchestra.run.smithi166.stderr:Generating grub configuration file ... 2022-01-10T01:15:26.774 INFO:teuthology.orchestra.run.smithi166.stderr:Found linux image: /boot/vmlinuz-5.4.0-92-generic 2022-01-10T01:15:26.785 INFO:teuthology.orchestra.run.smithi166.stderr:Found initrd image: /boot/initrd.img-5.4.0-92-generic 2022-01-10T01:15:26.908 INFO:teuthology.orchestra.run.smithi036.stderr:Sourcing file `/etc/default/grub' 2022-01-10T01:15:26.910 INFO:teuthology.orchestra.run.smithi036.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2022-01-10T01:15:26.924 INFO:teuthology.orchestra.run.smithi036.stderr:Generating grub configuration file ... 2022-01-10T01:15:27.158 INFO:teuthology.orchestra.run.smithi036.stderr:Found linux image: /boot/vmlinuz-5.4.0-92-generic 2022-01-10T01:15:27.169 INFO:teuthology.orchestra.run.smithi036.stderr:Found initrd image: /boot/initrd.img-5.4.0-92-generic 2022-01-10T01:15:27.200 INFO:teuthology.orchestra.run.smithi166.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2022-01-10T01:15:27.212 INFO:teuthology.orchestra.run.smithi166.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2022-01-10T01:15:27.309 INFO:teuthology.orchestra.run.smithi166.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2022-01-10T01:15:27.320 INFO:teuthology.orchestra.run.smithi166.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2022-01-10T01:15:27.416 INFO:teuthology.orchestra.run.smithi059.stderr:Sourcing file `/etc/default/grub' 2022-01-10T01:15:27.418 INFO:teuthology.orchestra.run.smithi059.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2022-01-10T01:15:27.430 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2022-01-10T01:15:27.531 INFO:teuthology.orchestra.run.smithi036.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2022-01-10T01:15:27.543 INFO:teuthology.orchestra.run.smithi036.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2022-01-10T01:15:27.640 INFO:teuthology.orchestra.run.smithi036.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2022-01-10T01:15:27.651 INFO:teuthology.orchestra.run.smithi036.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2022-01-10T01:15:27.704 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.4.0-92-generic 2022-01-10T01:15:27.715 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.4.0-92-generic 2022-01-10T01:15:27.781 INFO:teuthology.orchestra.run.smithi139.stderr:done 2022-01-10T01:15:27.783 DEBUG:teuthology.orchestra.run.smithi139:> sudo shutdown -r now 2022-01-10T01:15:28.096 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.4.0-88-generic 2022-01-10T01:15:28.107 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.4.0-88-generic 2022-01-10T01:15:28.202 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2022-01-10T01:15:28.213 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2022-01-10T01:15:28.885 INFO:teuthology.orchestra.run.smithi166.stderr:done 2022-01-10T01:15:28.887 DEBUG:teuthology.orchestra.run.smithi166:> sudo shutdown -r now 2022-01-10T01:15:29.269 INFO:teuthology.orchestra.run.smithi036.stderr:done 2022-01-10T01:15:29.271 DEBUG:teuthology.orchestra.run.smithi036:> sudo shutdown -r now 2022-01-10T01:15:29.959 INFO:teuthology.orchestra.run.smithi059.stderr:done 2022-01-10T01:15:29.960 DEBUG:teuthology.orchestra.run.smithi059:> sudo shutdown -r now 2022-01-10T01:15:57.811 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2022-01-10T01:15:57.811 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2022-01-10T01:15:57.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:15:58.890 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2022-01-10T01:15:58.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi166.front.sepia.ceph.com' 2022-01-10T01:15:58.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:15:59.276 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2022-01-10T01:15:59.277 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com' 2022-01-10T01:15:59.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:15:59.964 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2022-01-10T01:15:59.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2022-01-10T01:15:59.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:17:16.259 DEBUG:teuthology.orchestra.remote:timed out 2022-01-10T01:17:17.488 DEBUG:teuthology.orchestra.remote:timed out 2022-01-10T01:17:17.739 DEBUG:teuthology.orchestra.remote:timed out 2022-01-10T01:17:18.512 DEBUG:teuthology.orchestra.remote:timed out 2022-01-10T01:17:46.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2022-01-10T01:17:46.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:17:46.477 DEBUG:teuthology.orchestra.run.smithi139:> true 2022-01-10T01:17:47.038 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi139.front.sepia.ceph.com' 2022-01-10T01:17:47.038 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.4.0-92-generic"... 2022-01-10T01:17:47.039 DEBUG:teuthology.orchestra.run.smithi139:> uname -r 2022-01-10T01:17:47.089 INFO:teuthology.orchestra.run.smithi139.stdout:5.4.0-92-generic 2022-01-10T01:17:47.089 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-92-generic vs 5.4.0-92-generic 2022-01-10T01:17:47.089 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-01-10T01:17:47.090 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2022-01-10T01:17:47.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi166.front.sepia.ceph.com' 2022-01-10T01:17:47.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:17:47.703 DEBUG:teuthology.orchestra.run.smithi166:> true 2022-01-10T01:17:47.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com' 2022-01-10T01:17:47.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:17:47.861 DEBUG:teuthology.orchestra.run.smithi036:> true 2022-01-10T01:17:48.091 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2022-01-10T01:17:48.091 DEBUG:teuthology.orchestra.run.smithi139:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-01-10T01:17:48.168 INFO:teuthology.orchestra.run.smithi139.stdout:ttyS1 2022-01-10T01:17:48.200 DEBUG:teuthology.parallel:result is None 2022-01-10T01:17:48.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi166.front.sepia.ceph.com' 2022-01-10T01:17:48.290 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.4.0-92-generic"... 2022-01-10T01:17:48.290 DEBUG:teuthology.orchestra.run.smithi166:> uname -r 2022-01-10T01:17:48.298 INFO:teuthology.orchestra.run.smithi166.stdout:5.4.0-92-generic 2022-01-10T01:17:48.298 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-92-generic vs 5.4.0-92-generic 2022-01-10T01:17:48.299 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-01-10T01:17:48.299 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2022-01-10T01:17:48.433 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi036.front.sepia.ceph.com' 2022-01-10T01:17:48.433 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-92-generic"... 2022-01-10T01:17:48.434 DEBUG:teuthology.orchestra.run.smithi036:> uname -r 2022-01-10T01:17:48.440 INFO:teuthology.orchestra.run.smithi036.stdout:5.4.0-92-generic 2022-01-10T01:17:48.441 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-92-generic vs 5.4.0-92-generic 2022-01-10T01:17:48.441 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-01-10T01:17:48.441 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2022-01-10T01:17:48.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2022-01-10T01:17:48.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:17:48.647 DEBUG:teuthology.orchestra.run.smithi059:> true 2022-01-10T01:17:49.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2022-01-10T01:17:49.263 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-92-generic"... 2022-01-10T01:17:49.263 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2022-01-10T01:17:49.270 INFO:teuthology.orchestra.run.smithi059.stdout:5.4.0-92-generic 2022-01-10T01:17:49.271 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-92-generic vs 5.4.0-92-generic 2022-01-10T01:17:49.271 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-01-10T01:17:49.271 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2022-01-10T01:17:49.301 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2022-01-10T01:17:49.302 DEBUG:teuthology.orchestra.run.smithi166:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-01-10T01:17:49.379 INFO:teuthology.orchestra.run.smithi166.stdout:ttyS1 2022-01-10T01:17:49.413 DEBUG:teuthology.parallel:result is None 2022-01-10T01:17:49.443 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2022-01-10T01:17:49.443 DEBUG:teuthology.orchestra.run.smithi036:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-01-10T01:17:49.529 INFO:teuthology.orchestra.run.smithi036.stdout:ttyS1 2022-01-10T01:17:49.557 DEBUG:teuthology.parallel:result is None 2022-01-10T01:17:50.273 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2022-01-10T01:17:50.273 DEBUG:teuthology.orchestra.run.smithi059:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-01-10T01:17:50.343 INFO:teuthology.orchestra.run.smithi059.stdout:ttyS1 2022-01-10T01:17:50.365 DEBUG:teuthology.parallel:result is None 2022-01-10T01:17:50.366 INFO:teuthology.run_tasks:Running task internal.base... 2022-01-10T01:17:50.377 INFO:teuthology.task.internal:Creating test directory... 2022-01-10T01:17:50.378 DEBUG:teuthology.orchestra.run.smithi036:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-01-10T01:17:50.382 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-01-10T01:17:50.392 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-01-10T01:17:50.395 DEBUG:teuthology.orchestra.run.smithi166:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-01-10T01:17:50.403 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-01-10T01:17:50.428 INFO:teuthology.run_tasks:Running task internal.archive... 2022-01-10T01:17:50.445 INFO:teuthology.task.internal:Creating archive directory... 2022-01-10T01:17:50.445 DEBUG:teuthology.orchestra.run.smithi036:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-01-10T01:17:50.448 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-01-10T01:17:50.451 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-01-10T01:17:50.453 DEBUG:teuthology.orchestra.run.smithi166:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-01-10T01:17:50.497 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-01-10T01:17:50.507 INFO:teuthology.task.internal:Enabling coredump saving... 2022-01-10T01:17:50.507 DEBUG:teuthology.orchestra.run.smithi036:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-01-10T01:17:50.510 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-01-10T01:17:50.512 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-01-10T01:17:50.515 DEBUG:teuthology.orchestra.run.smithi166:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-01-10T01:17:50.530 INFO:teuthology.orchestra.run.smithi036.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-01-10T01:17:50.532 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-01-10T01:17:50.541 INFO:teuthology.orchestra.run.smithi036.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-01-10T01:17:50.541 INFO:teuthology.orchestra.run.smithi166.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-01-10T01:17:50.543 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-01-10T01:17:50.551 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-01-10T01:17:50.552 INFO:teuthology.orchestra.run.smithi166.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-01-10T01:17:50.562 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-01-10T01:17:50.563 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-01-10T01:17:50.573 INFO:teuthology.task.internal:Configuring sudo... 2022-01-10T01:17:50.574 DEBUG:teuthology.orchestra.run.smithi036:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-01-10T01:17:50.588 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-01-10T01:17:50.591 DEBUG:teuthology.orchestra.run.smithi139:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-01-10T01:17:50.593 DEBUG:teuthology.orchestra.run.smithi166:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-01-10T01:17:50.610 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-01-10T01:17:50.622 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-01-10T01:17:50.623 DEBUG:teuthology.orchestra.run.smithi036:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-01-10T01:17:50.625 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-01-10T01:17:50.628 DEBUG:teuthology.orchestra.run.smithi139:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-01-10T01:17:50.652 DEBUG:teuthology.orchestra.run.smithi166:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-01-10T01:17:50.659 DEBUG:teuthology.orchestra.run.smithi036:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-01-10T01:17:50.677 DEBUG:teuthology.orchestra.run.smithi036:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-01-10T01:17:50.685 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2022-01-10T01:17:50.686 DEBUG:teuthology.orchestra.run.smithi036:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-01-10T01:17:50.704 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-01-10T01:17:50.711 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-01-10T01:17:50.719 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2022-01-10T01:17:50.719 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-01-10T01:17:50.758 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-01-10T01:17:50.766 DEBUG:teuthology.orchestra.run.smithi139:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-01-10T01:17:50.774 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2022-01-10T01:17:50.775 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-01-10T01:17:50.847 DEBUG:teuthology.orchestra.run.smithi166:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-01-10T01:17:50.856 DEBUG:teuthology.orchestra.run.smithi166:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-01-10T01:17:50.864 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-01-10T01:17:50.865 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-01-10T01:17:50.891 DEBUG:teuthology.orchestra.run.smithi036:> sudo service rsyslog restart 2022-01-10T01:17:50.894 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2022-01-10T01:17:50.896 DEBUG:teuthology.orchestra.run.smithi139:> sudo service rsyslog restart 2022-01-10T01:17:50.899 DEBUG:teuthology.orchestra.run.smithi166:> sudo service rsyslog restart 2022-01-10T01:17:50.990 INFO:teuthology.run_tasks:Running task internal.timer... 2022-01-10T01:17:51.001 INFO:teuthology.task.internal:Starting timer... 2022-01-10T01:17:51.001 INFO:teuthology.run_tasks:Running task pcp... 2022-01-10T01:17:51.045 INFO:teuthology.run_tasks:Running task selinux... 2022-01-10T01:17:51.058 DEBUG:teuthology.task.selinux:Excluding smithi036: OS 'ubuntu' does not support SELinux 2022-01-10T01:17:51.059 DEBUG:teuthology.task.selinux:Excluding smithi059: OS 'ubuntu' does not support SELinux 2022-01-10T01:17:51.059 DEBUG:teuthology.task.selinux:Excluding smithi139: OS 'ubuntu' does not support SELinux 2022-01-10T01:17:51.060 DEBUG:teuthology.task.selinux:Excluding smithi166: OS 'ubuntu' does not support SELinux 2022-01-10T01:17:51.060 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-01-10T01:17:51.060 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2022-01-10T01:17:51.061 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-01-10T01:17:51.061 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-01-10T01:17:51.080 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2022-01-10T01:17:51.086 INFO:teuthology.repo_utils:Fetching master from origin 2022-01-10T01:17:51.119 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2022-01-10T01:17:51.137 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-01-10T01:17:51.139 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi036.front.sepia.ceph.com,smithi059.front.sepia.ceph.com,smithi139.front.sepia.ceph.com,smithi166.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2022-01-10T01:17:51.512 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2022-01-10T01:17:52.352 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2022-01-10T01:17:55.342 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2022-01-10T01:17:55.465 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:55 +0000 (0:00:00.140) 0:00:00.140 ******** 2022-01-10T01:17:55.478 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:55 +0000 (0:00:00.012) 0:00:00.153 ******** 2022-01-10T01:17:55.489 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:55 +0000 (0:00:00.010) 0:00:00.163 ******** 2022-01-10T01:17:55.500 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:55 +0000 (0:00:00.011) 0:00:00.175 ******** 2022-01-10T01:17:57.488 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2022-01-10T01:17:57.490 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi059.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi059.front.sepia.ceph.com] 2022-01-10T01:17:57.541 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:57 +0000 (0:00:02.041) 0:00:02.216 ******** 2022-01-10T01:17:57.555 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi139.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi139.front.sepia.ceph.com] 2022-01-10T01:17:57.607 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:57 +0000 (0:00:00.066) 0:00:02.282 ******** 2022-01-10T01:17:57.620 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi166.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi166.front.sepia.ceph.com] 2022-01-10T01:17:57.655 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi036.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi036.front.sepia.ceph.com] 2022-01-10T01:17:57.697 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:57 +0000 (0:00:00.090) 0:00:02.372 ******** 2022-01-10T01:17:57.728 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:57 +0000 (0:00:00.030) 0:00:02.403 ******** 2022-01-10T01:17:57.777 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2022-01-10T01:17:57.779 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2022-01-10T01:17:57.803 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:57 +0000 (0:00:00.074) 0:00:02.478 ******** 2022-01-10T01:17:57.824 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:57 +0000 (0:00:00.020) 0:00:02.498 ******** 2022-01-10T01:17:57.842 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2022-01-10T01:17:57.867 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:57 +0000 (0:00:00.043) 0:00:02.542 ******** 2022-01-10T01:17:57.874 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2022-01-10T01:17:57.905 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:57 +0000 (0:00:00.038) 0:00:02.580 ******** 2022-01-10T01:17:58.296 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi139.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2022-01-10T01:17:58.326 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:58 +0000 (0:00:00.420) 0:00:03.000 ******** 2022-01-10T01:17:58.338 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2022-01-10T01:17:58.340 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2022-01-10T01:17:58.342 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2022-01-10T01:17:58.368 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:58 +0000 (0:00:00.042) 0:00:03.043 ******** 2022-01-10T01:17:58.390 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:58 +0000 (0:00:00.021) 0:00:03.064 ******** 2022-01-10T01:17:58.425 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:58 +0000 (0:00:00.034) 0:00:03.099 ******** 2022-01-10T01:17:58.435 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:17:58.465 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:58 +0000 (0:00:00.040) 0:00:03.140 ******** 2022-01-10T01:17:58.473 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:17:58.501 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:58 +0000 (0:00:00.036) 0:00:03.176 ******** 2022-01-10T01:17:58.508 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:17:58.510 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:17:58.535 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:58 +0000 (0:00:00.033) 0:00:03.209 ******** 2022-01-10T01:17:58.558 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:58 +0000 (0:00:00.022) 0:00:03.232 ******** 2022-01-10T01:17:58.692 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2022-01-10T01:17:58.694 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:17:58.695 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:17:58.730 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:58 +0000 (0:00:00.172) 0:00:03.404 ******** 2022-01-10T01:17:58.751 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:58 +0000 (0:00:00.021) 0:00:03.426 ******** 2022-01-10T01:17:58.771 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:58 +0000 (0:00:00.020) 0:00:03.446 ******** 2022-01-10T01:17:58.791 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:58 +0000 (0:00:00.019) 0:00:03.466 ******** 2022-01-10T01:17:59.591 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2022-01-10T01:17:59.593 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2022-01-10T01:17:59.595 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2022-01-10T01:17:59.617 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:59 +0000 (0:00:00.826) 0:00:04.292 ******** 2022-01-10T01:17:59.638 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:59 +0000 (0:00:00.021) 0:00:04.313 ******** 2022-01-10T01:17:59.664 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:59 +0000 (0:00:00.025) 0:00:04.339 ******** 2022-01-10T01:17:59.673 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/cephlab_sudo", "size": 182, "state": "file", "uid": 0} 2022-01-10T01:17:59.699 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:17:59 +0000 (0:00:00.034) 0:00:04.373 ******** 2022-01-10T01:18:00.095 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtC 2022-01-10T01:18:00.097 INFO:teuthology.task.ansible.out:toHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2022-01-10T01:18:00.118 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2022-01-10T01:18:00.120 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2022-01-10T01:18:00.167 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2022-01-10T01:18:00.169 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2022-01-10T01:18:00.171 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2022-01-10T01:18:00.172 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2022-01-10T01:18:00.304 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2022-01-10T01:18:00.306 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2022-01-10T01:18:00.320 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Monday 10 January 2022 01:18:00 +0000 (0:00:00.621) 0:00:04.995 ******** 2022-01-10T01:18:01.032 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] 2022-01-10T01:18:01.084 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] 2022-01-10T01:18:01.105 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] 2022-01-10T01:18:03.068 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] 2022-01-10T01:18:03.089 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** 2022-01-10T01:18:03.091 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:03 +0000 (0:00:02.768) 0:00:07.764 ******** 2022-01-10T01:18:03.118 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2022-01-10T01:18:03.143 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2022-01-10T01:18:03.167 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2022-01-10T01:18:03.178 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2022-01-10T01:18:03.183 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2022-01-10T01:18:03.371 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:03 +0000 (0:00:00.282) 0:00:08.046 ******** 2022-01-10T01:18:03.395 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:03 +0000 (0:00:00.023) 0:00:08.070 ******** 2022-01-10T01:18:03.422 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:03 +0000 (0:00:00.027) 0:00:08.097 ******** 2022-01-10T01:18:03.444 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:03 +0000 (0:00:00.021) 0:00:08.119 ******** 2022-01-10T01:18:04.283 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi036.front.sepia.ceph.com] 2022-01-10T01:18:04.319 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] 2022-01-10T01:18:04.330 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] 2022-01-10T01:18:04.343 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] 2022-01-10T01:18:04.374 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Monday 10 January 2022 01:18:04 +0000 (0:00:00.930) 0:00:09.049 ******** 2022-01-10T01:18:04.445 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:04 +0000 (0:00:00.070) 0:00:09.120 ******** 2022-01-10T01:18:04.472 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:04 +0000 (0:00:00.026) 0:00:09.146 ******** 2022-01-10T01:18:04.503 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:04 +0000 (0:00:00.031) 0:00:09.178 ******** 2022-01-10T01:18:05.019 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2022-01-10T01:18:05.021 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.168054", "end": "2022-01-10 01:18:04.990615", "rc": 0, "start": "2022-01-10 01:18:04.822561", "stderr": "", "stderr_lines": [], "stdout": "b39424e053d42ee607f17b88c1886c2d02811d8f", "stdout_lines": ["b39424e053d42ee607f17b88c1886c2d02811d8f"]} changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.182449", "end": "2022-01-10 01:18:04.994938", "rc": 0, "start": "2022-01-10 01:18:04.812489", "stderr": "", "stderr_lines": [], "stdout": "b39424e053d42ee607f17b88c1886c2d02811d8f", "stdout_lines": ["b39424e053d42ee607f17b88c1886c2d02811d8f"]} 2022-01-10T01:18:05.044 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.540) 0:00:09.719 ******** 2022-01-10T01:18:05.067 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.022) 0:00:09.741 ******** 2022-01-10T01:18:05.074 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.188474", "end": "2022-01-10 01:18:05.032286", "rc": 0, "start": "2022-01-10 01:18:04.843812", "stderr": "", "stderr_lines": [], "stdout": "b39424e053d42ee607f17b88c1886c2d02811d8f", "stdout_lines": ["b39424e053d42ee607f17b88c1886c2d02811d8f"]} 2022-01-10T01:18:05.108 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.040) 0:00:09.782 ******** 2022-01-10T01:18:05.119 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.202983", "end": "2022-01-10 01:18:05.072669", "rc": 0, "start": "2022-01-10 01:18:04.869686", "stderr": "", "stderr_lines": [], "stdout": "b39424e053d42ee607f17b88c1886c2d02811d8f", "stdout_lines": ["b39424e053d42ee607f17b88c1886c2d02811d8f"]} 2022-01-10T01:18:05.297 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.189) 0:00:09.972 ******** 2022-01-10T01:18:05.305 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008204", "end": "2022-01-10 01:18:05.124002", "failed_when_result": false, "rc": 0, "start": "2022-01-10 01:18:05.115798", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2022-01-10T01:18:05.306 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.012430", "end": "2022-01-10 01:18:04.851427", "failed_when_result": false, "rc": 0, "start": "2022-01-10 01:18:04.838997", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2022-01-10T01:18:05.307 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.020325", "end": "2022-01-10 01:18:04.882684", "failed_when_result": false, "rc": 0, "start": "2022-01-10 01:18:04.862359", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} 2022-01-10T01:18:05.333 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.036) 0:00:10.008 ******** 2022-01-10T01:18:05.357 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.023) 0:00:10.031 ******** 2022-01-10T01:18:05.380 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.022) 0:00:10.054 ******** 2022-01-10T01:18:05.397 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2022-01-10T01:18:05.399 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.423 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.043) 0:00:10.098 ******** 2022-01-10T01:18:05.430 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.456 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.032) 0:00:10.130 ******** 2022-01-10T01:18:05.463 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2022-01-10T01:18:05.464 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014584", "end": "2022-01-10 01:18:05.619134", "failed_when_result": false, "rc": 0, "start": "2022-01-10 01:18:05.604550", "stderr": "", "stderr_lines": [], "stdout": "be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec", "stdout_lines": ["be157e19c0bfe2e4e07c6f889b0dbfb8dd2c65ec"]} TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.490 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.034) 0:00:10.165 ******** 2022-01-10T01:18:05.513 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.022) 0:00:10.187 ******** 2022-01-10T01:18:05.519 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2022-01-10T01:18:05.521 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.546 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.033) 0:00:10.221 ******** 2022-01-10T01:18:05.554 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.580 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.033) 0:00:10.254 ******** 2022-01-10T01:18:05.587 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.613 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.033) 0:00:10.288 ******** 2022-01-10T01:18:05.620 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2022-01-10T01:18:05.622 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.647 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.033) 0:00:10.321 ******** 2022-01-10T01:18:05.653 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2022-01-10T01:18:05.655 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.688 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.041) 0:00:10.362 ******** 2022-01-10T01:18:05.714 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.026) 0:00:10.389 ******** 2022-01-10T01:18:05.722 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.749 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.034) 0:00:10.423 ******** 2022-01-10T01:18:05.757 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2022-01-10T01:18:05.759 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.784 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.035) 0:00:10.459 ******** 2022-01-10T01:18:05.792 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.817 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.033) 0:00:10.492 ******** 2022-01-10T01:18:05.825 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.826 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.852 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.034) 0:00:10.526 ******** 2022-01-10T01:18:05.875 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.022) 0:00:10.549 ******** 2022-01-10T01:18:05.882 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2022-01-10T01:18:05.884 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [Filter the managed_admin_users list] ************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.914 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.039) 0:00:10.589 ******** 2022-01-10T01:18:05.938 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.023) 0:00:10.613 ******** 2022-01-10T01:18:05.945 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:05.972 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:05 +0000 (0:00:00.034) 0:00:10.647 ******** 2022-01-10T01:18:05.980 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:06.007 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:06 +0000 (0:00:00.034) 0:00:10.681 ******** 2022-01-10T01:18:06.013 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2022-01-10T01:18:06.016 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:06.040 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:06 +0000 (0:00:00.032) 0:00:10.714 ******** 2022-01-10T01:18:06.099 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2022-01-10T01:18:06.101 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:18:06.128 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:06 +0000 (0:00:00.088) 0:00:10.803 ******** 2022-01-10T01:18:06.136 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2022-01-10T01:18:06.137 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:06.164 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:06 +0000 (0:00:00.035) 0:00:10.838 ******** 2022-01-10T01:18:06.171 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2022-01-10T01:18:06.173 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:18:06.197 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:06 +0000 (0:00:00.033) 0:00:10.872 ******** 2022-01-10T01:18:06.206 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:18:06.233 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:06 +0000 (0:00:00.035) 0:00:10.907 ******** 2022-01-10T01:18:06.336 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:18:06.362 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:06 +0000 (0:00:00.128) 0:00:11.036 ******** 2022-01-10T01:18:06.369 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2022-01-10T01:18:06.371 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2022-01-10T01:18:06.447 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2022-01-10T01:18:06.482 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2022-01-10T01:18:06.515 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2022-01-10T01:18:06.581 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2022-01-10T01:18:06.614 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2022-01-10T01:18:06.625 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2022-01-10T01:18:06.658 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2022-01-10T01:18:06.735 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2022-01-10T01:18:06.756 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2022-01-10T01:18:06.768 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2022-01-10T01:18:06.812 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2022-01-10T01:18:06.876 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2022-01-10T01:18:06.898 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2022-01-10T01:18:06.911 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2022-01-10T01:18:06.954 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2022-01-10T01:18:07.029 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2022-01-10T01:18:07.041 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2022-01-10T01:18:07.063 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2022-01-10T01:18:07.095 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2022-01-10T01:18:07.180 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2022-01-10T01:18:07.181 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2022-01-10T01:18:07.204 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2022-01-10T01:18:07.238 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2022-01-10T01:18:07.324 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2022-01-10T01:18:07.336 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2022-01-10T01:18:07.349 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2022-01-10T01:18:07.392 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2022-01-10T01:18:07.478 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2022-01-10T01:18:07.491 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2022-01-10T01:18:07.493 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2022-01-10T01:18:07.537 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2022-01-10T01:18:07.625 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2022-01-10T01:18:07.637 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2022-01-10T01:18:07.650 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2022-01-10T01:18:07.683 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2022-01-10T01:18:07.768 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2022-01-10T01:18:07.780 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2022-01-10T01:18:07.804 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2022-01-10T01:18:07.827 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2022-01-10T01:18:07.913 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2022-01-10T01:18:07.925 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2022-01-10T01:18:07.948 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2022-01-10T01:18:07.971 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2022-01-10T01:18:08.067 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2022-01-10T01:18:08.068 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2022-01-10T01:18:08.090 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2022-01-10T01:18:08.123 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2022-01-10T01:18:08.210 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2022-01-10T01:18:08.222 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2022-01-10T01:18:08.234 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2022-01-10T01:18:08.268 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2022-01-10T01:18:08.364 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2022-01-10T01:18:08.365 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2022-01-10T01:18:08.378 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2022-01-10T01:18:08.411 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2022-01-10T01:18:08.498 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2022-01-10T01:18:08.500 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2022-01-10T01:18:08.512 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2022-01-10T01:18:08.559 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2022-01-10T01:18:08.644 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2022-01-10T01:18:08.655 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2022-01-10T01:18:08.667 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2022-01-10T01:18:08.710 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2022-01-10T01:18:08.795 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2022-01-10T01:18:08.807 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2022-01-10T01:18:08.808 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2022-01-10T01:18:08.852 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2022-01-10T01:18:08.937 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2022-01-10T01:18:08.949 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2022-01-10T01:18:08.961 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2022-01-10T01:18:08.995 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2022-01-10T01:18:09.081 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2022-01-10T01:18:09.095 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2022-01-10T01:18:09.108 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2022-01-10T01:18:09.141 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2022-01-10T01:18:09.215 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2022-01-10T01:18:09.249 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2022-01-10T01:18:09.251 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2022-01-10T01:18:09.284 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2022-01-10T01:18:09.360 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2022-01-10T01:18:09.391 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2022-01-10T01:18:09.403 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2022-01-10T01:18:09.436 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2022-01-10T01:18:09.524 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2022-01-10T01:18:09.547 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2022-01-10T01:18:09.558 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2022-01-10T01:18:09.581 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2022-01-10T01:18:09.667 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2022-01-10T01:18:09.690 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2022-01-10T01:18:09.703 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2022-01-10T01:18:09.726 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2022-01-10T01:18:09.812 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2022-01-10T01:18:09.835 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2022-01-10T01:18:09.847 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2022-01-10T01:18:09.869 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2022-01-10T01:18:09.967 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2022-01-10T01:18:09.989 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2022-01-10T01:18:10.001 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2022-01-10T01:18:10.012 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2022-01-10T01:18:10.108 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2022-01-10T01:18:10.130 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2022-01-10T01:18:10.142 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2022-01-10T01:18:10.164 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2022-01-10T01:18:10.250 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2022-01-10T01:18:10.282 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2022-01-10T01:18:10.296 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2022-01-10T01:18:10.317 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2022-01-10T01:18:10.393 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2022-01-10T01:18:10.427 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2022-01-10T01:18:10.438 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2022-01-10T01:18:10.461 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2022-01-10T01:18:10.535 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2022-01-10T01:18:10.579 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2022-01-10T01:18:10.590 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2022-01-10T01:18:10.602 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2022-01-10T01:18:10.688 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2022-01-10T01:18:10.732 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2022-01-10T01:18:10.734 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2022-01-10T01:18:10.755 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2022-01-10T01:18:10.839 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2022-01-10T01:18:10.872 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2022-01-10T01:18:10.875 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2022-01-10T01:18:10.906 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2022-01-10T01:18:10.981 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2022-01-10T01:18:11.014 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2022-01-10T01:18:11.027 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2022-01-10T01:18:11.061 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2022-01-10T01:18:11.125 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2022-01-10T01:18:11.158 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2022-01-10T01:18:11.181 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2022-01-10T01:18:11.204 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2022-01-10T01:18:11.268 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2022-01-10T01:18:11.301 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2022-01-10T01:18:11.312 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2022-01-10T01:18:11.355 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2022-01-10T01:18:11.409 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2022-01-10T01:18:11.452 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2022-01-10T01:18:11.464 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2022-01-10T01:18:11.497 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2022-01-10T01:18:11.551 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2022-01-10T01:18:11.595 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2022-01-10T01:18:11.607 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2022-01-10T01:18:11.649 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2022-01-10T01:18:11.693 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2022-01-10T01:18:11.738 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2022-01-10T01:18:11.749 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2022-01-10T01:18:11.794 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2022-01-10T01:18:11.851 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2022-01-10T01:18:11.895 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2022-01-10T01:18:11.896 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2022-01-10T01:18:11.929 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2022-01-10T01:18:11.994 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2022-01-10T01:18:12.037 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2022-01-10T01:18:12.040 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2022-01-10T01:18:12.081 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2022-01-10T01:18:12.135 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2022-01-10T01:18:12.189 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2022-01-10T01:18:12.265 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2022-01-10T01:18:12.287 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2022-01-10T01:18:12.330 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2022-01-10T01:18:12.342 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2022-01-10T01:18:12.386 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2022-01-10T01:18:12.429 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2022-01-10T01:18:12.472 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2022-01-10T01:18:12.484 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2022-01-10T01:18:12.527 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2022-01-10T01:18:12.582 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2022-01-10T01:18:12.615 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2022-01-10T01:18:12.627 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2022-01-10T01:18:12.681 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2022-01-10T01:18:12.724 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2022-01-10T01:18:12.757 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2022-01-10T01:18:12.768 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2022-01-10T01:18:12.822 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2022-01-10T01:18:12.865 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2022-01-10T01:18:12.899 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2022-01-10T01:18:12.921 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2022-01-10T01:18:12.964 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2022-01-10T01:18:13.007 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2022-01-10T01:18:13.040 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2022-01-10T01:18:13.062 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2022-01-10T01:18:13.105 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2022-01-10T01:18:13.148 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2022-01-10T01:18:13.182 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2022-01-10T01:18:13.216 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2022-01-10T01:18:13.250 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2022-01-10T01:18:13.292 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2022-01-10T01:18:13.328 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2022-01-10T01:18:13.371 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2022-01-10T01:18:13.394 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2022-01-10T01:18:13.449 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2022-01-10T01:18:13.473 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2022-01-10T01:18:13.517 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2022-01-10T01:18:13.539 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2022-01-10T01:18:13.593 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2022-01-10T01:18:13.638 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2022-01-10T01:18:13.672 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2022-01-10T01:18:13.694 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2022-01-10T01:18:13.738 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2022-01-10T01:18:13.781 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2022-01-10T01:18:13.813 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2022-01-10T01:18:13.846 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2022-01-10T01:18:13.879 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2022-01-10T01:18:13.934 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2022-01-10T01:18:13.967 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2022-01-10T01:18:13.989 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2022-01-10T01:18:14.032 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2022-01-10T01:18:14.074 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2022-01-10T01:18:14.107 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2022-01-10T01:18:14.140 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2022-01-10T01:18:14.172 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2022-01-10T01:18:14.226 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2022-01-10T01:18:14.259 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2022-01-10T01:18:14.281 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2022-01-10T01:18:14.325 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2022-01-10T01:18:14.379 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2022-01-10T01:18:14.401 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2022-01-10T01:18:14.433 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2022-01-10T01:18:14.477 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2022-01-10T01:18:14.520 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2022-01-10T01:18:14.542 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2022-01-10T01:18:14.585 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2022-01-10T01:18:14.608 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2022-01-10T01:18:14.661 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2022-01-10T01:18:14.693 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2022-01-10T01:18:14.726 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2022-01-10T01:18:14.758 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2022-01-10T01:18:14.813 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2022-01-10T01:18:14.835 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2022-01-10T01:18:14.878 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2022-01-10T01:18:14.913 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2022-01-10T01:18:14.957 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2022-01-10T01:18:14.980 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2022-01-10T01:18:15.024 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2022-01-10T01:18:15.067 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2022-01-10T01:18:15.110 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2022-01-10T01:18:15.122 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2022-01-10T01:18:15.165 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2022-01-10T01:18:15.208 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2022-01-10T01:18:15.251 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2022-01-10T01:18:15.263 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2022-01-10T01:18:15.317 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2022-01-10T01:18:15.350 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2022-01-10T01:18:15.394 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2022-01-10T01:18:15.416 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2022-01-10T01:18:15.460 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2022-01-10T01:18:15.503 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2022-01-10T01:18:15.557 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2022-01-10T01:18:15.558 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2022-01-10T01:18:15.601 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2022-01-10T01:18:15.644 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2022-01-10T01:18:15.704 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2022-01-10T01:18:15.717 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2022-01-10T01:18:15.750 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2022-01-10T01:18:15.794 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2022-01-10T01:18:15.858 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2022-01-10T01:18:15.859 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2022-01-10T01:18:15.892 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2022-01-10T01:18:15.935 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2022-01-10T01:18:15.999 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2022-01-10T01:18:16.010 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2022-01-10T01:18:16.012 INFO:teuthology.task.ansible.out: 2022-01-10T01:18:16.034 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2022-01-10T01:18:16.078 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2022-01-10T01:18:16.143 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2022-01-10T01:18:16.165 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2022-01-10T01:18:16.187 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2022-01-10T01:18:16.221 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2022-01-10T01:18:16.285 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2022-01-10T01:18:16.318 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2022-01-10T01:18:16.329 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2022-01-10T01:18:16.362 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2022-01-10T01:18:16.425 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2022-01-10T01:18:16.470 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2022-01-10T01:18:16.471 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2022-01-10T01:18:16.515 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2022-01-10T01:18:16.569 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2022-01-10T01:18:16.613 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2022-01-10T01:18:16.614 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2022-01-10T01:18:16.658 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2022-01-10T01:18:16.724 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2022-01-10T01:18:16.759 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2022-01-10T01:18:16.761 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2022-01-10T01:18:16.804 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2022-01-10T01:18:16.860 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2022-01-10T01:18:16.904 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2022-01-10T01:18:16.905 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2022-01-10T01:18:16.952 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2022-01-10T01:18:17.007 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2022-01-10T01:18:17.064 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2022-01-10T01:18:17.066 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2022-01-10T01:18:17.100 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2022-01-10T01:18:17.153 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2022-01-10T01:18:17.206 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2022-01-10T01:18:17.207 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2022-01-10T01:18:17.252 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2022-01-10T01:18:17.296 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2022-01-10T01:18:17.349 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2022-01-10T01:18:17.350 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2022-01-10T01:18:17.396 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2022-01-10T01:18:17.439 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2022-01-10T01:18:17.493 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2022-01-10T01:18:17.508 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2022-01-10T01:18:17.542 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2022-01-10T01:18:17.596 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2022-01-10T01:18:17.640 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2022-01-10T01:18:17.652 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2022-01-10T01:18:17.685 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2022-01-10T01:18:17.739 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2022-01-10T01:18:17.795 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2022-01-10T01:18:17.796 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2022-01-10T01:18:17.830 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2022-01-10T01:18:17.884 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2022-01-10T01:18:17.940 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2022-01-10T01:18:17.942 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2022-01-10T01:18:17.976 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2022-01-10T01:18:18.019 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2022-01-10T01:18:18.093 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2022-01-10T01:18:18.094 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2022-01-10T01:18:18.127 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2022-01-10T01:18:18.169 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2022-01-10T01:18:18.235 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2022-01-10T01:18:18.236 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2022-01-10T01:18:18.269 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2022-01-10T01:18:18.314 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2022-01-10T01:18:18.379 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2022-01-10T01:18:18.381 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2022-01-10T01:18:18.423 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2022-01-10T01:18:18.457 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2022-01-10T01:18:18.522 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2022-01-10T01:18:18.524 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2022-01-10T01:18:18.568 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2022-01-10T01:18:18.604 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2022-01-10T01:18:18.669 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2022-01-10T01:18:18.670 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2022-01-10T01:18:18.703 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2022-01-10T01:18:18.757 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2022-01-10T01:18:18.821 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2022-01-10T01:18:18.822 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2022-01-10T01:18:18.856 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2022-01-10T01:18:18.900 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2022-01-10T01:18:18.964 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2022-01-10T01:18:18.976 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2022-01-10T01:18:18.998 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2022-01-10T01:18:19.051 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2022-01-10T01:18:19.105 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2022-01-10T01:18:19.116 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2022-01-10T01:18:19.138 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2022-01-10T01:18:19.192 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2022-01-10T01:18:19.256 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2022-01-10T01:18:19.258 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2022-01-10T01:18:19.279 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2022-01-10T01:18:19.343 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2022-01-10T01:18:19.398 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2022-01-10T01:18:19.400 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2022-01-10T01:18:19.437 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2022-01-10T01:18:19.489 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2022-01-10T01:18:19.555 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2022-01-10T01:18:19.557 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2022-01-10T01:18:19.581 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2022-01-10T01:18:19.625 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2022-01-10T01:18:19.700 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2022-01-10T01:18:19.722 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2022-01-10T01:18:19.745 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2022-01-10T01:18:19.768 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2022-01-10T01:18:19.843 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2022-01-10T01:18:19.865 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2022-01-10T01:18:19.887 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2022-01-10T01:18:19.920 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2022-01-10T01:18:19.985 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2022-01-10T01:18:20.028 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2022-01-10T01:18:20.040 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2022-01-10T01:18:20.062 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2022-01-10T01:18:20.138 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2022-01-10T01:18:20.170 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2022-01-10T01:18:20.183 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2022-01-10T01:18:20.206 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2022-01-10T01:18:20.292 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2022-01-10T01:18:20.315 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2022-01-10T01:18:20.327 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2022-01-10T01:18:20.350 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2022-01-10T01:18:20.430 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2022-01-10T01:18:20.464 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2022-01-10T01:18:20.476 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2022-01-10T01:18:20.498 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2022-01-10T01:18:20.574 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2022-01-10T01:18:20.617 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2022-01-10T01:18:20.618 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2022-01-10T01:18:20.641 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2022-01-10T01:18:20.728 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2022-01-10T01:18:20.761 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2022-01-10T01:18:20.763 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2022-01-10T01:18:20.805 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2022-01-10T01:18:20.879 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2022-01-10T01:18:20.901 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2022-01-10T01:18:20.913 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2022-01-10T01:18:20.946 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2022-01-10T01:18:21.021 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2022-01-10T01:18:21.054 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2022-01-10T01:18:21.066 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2022-01-10T01:18:21.088 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2022-01-10T01:18:21.164 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2022-01-10T01:18:21.197 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2022-01-10T01:18:21.208 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2022-01-10T01:18:21.230 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2022-01-10T01:18:21.305 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2022-01-10T01:18:21.349 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2022-01-10T01:18:21.360 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2022-01-10T01:18:21.372 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2022-01-10T01:18:21.447 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2022-01-10T01:18:21.501 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2022-01-10T01:18:21.513 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2022-01-10T01:18:21.525 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2022-01-10T01:18:21.591 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2022-01-10T01:18:21.646 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2022-01-10T01:18:21.668 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2022-01-10T01:18:21.669 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2022-01-10T01:18:21.734 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2022-01-10T01:18:21.790 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2022-01-10T01:18:21.813 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2022-01-10T01:18:21.815 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2022-01-10T01:18:21.891 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2022-01-10T01:18:21.934 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2022-01-10T01:18:21.957 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2022-01-10T01:18:21.958 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2022-01-10T01:18:22.044 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2022-01-10T01:18:22.076 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2022-01-10T01:18:22.099 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2022-01-10T01:18:22.100 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2022-01-10T01:18:22.188 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2022-01-10T01:18:22.222 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2022-01-10T01:18:22.243 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2022-01-10T01:18:22.246 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2022-01-10T01:18:22.330 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2022-01-10T01:18:22.373 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2022-01-10T01:18:22.385 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2022-01-10T01:18:22.396 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2022-01-10T01:18:22.481 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2022-01-10T01:18:22.514 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2022-01-10T01:18:22.536 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2022-01-10T01:18:22.537 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2022-01-10T01:18:22.633 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2022-01-10T01:18:22.667 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2022-01-10T01:18:22.678 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2022-01-10T01:18:22.689 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2022-01-10T01:18:22.785 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2022-01-10T01:18:22.808 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2022-01-10T01:18:22.820 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2022-01-10T01:18:22.843 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2022-01-10T01:18:22.929 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2022-01-10T01:18:22.951 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2022-01-10T01:18:22.963 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2022-01-10T01:18:22.985 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2022-01-10T01:18:23.081 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2022-01-10T01:18:23.093 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2022-01-10T01:18:23.104 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2022-01-10T01:18:23.137 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2022-01-10T01:18:23.222 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2022-01-10T01:18:23.244 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2022-01-10T01:18:23.245 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2022-01-10T01:18:23.278 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2022-01-10T01:18:23.366 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2022-01-10T01:18:23.389 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2022-01-10T01:18:23.390 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2022-01-10T01:18:23.423 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2022-01-10T01:18:23.519 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2022-01-10T01:18:23.542 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2022-01-10T01:18:23.544 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2022-01-10T01:18:23.575 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2022-01-10T01:18:23.660 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2022-01-10T01:18:23.682 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2022-01-10T01:18:23.694 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2022-01-10T01:18:23.716 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2022-01-10T01:18:23.802 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2022-01-10T01:18:23.834 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2022-01-10T01:18:23.835 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2022-01-10T01:18:23.868 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2022-01-10T01:18:23.954 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2022-01-10T01:18:23.978 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2022-01-10T01:18:24.012 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2022-01-10T01:18:24.108 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2022-01-10T01:18:24.119 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2022-01-10T01:18:24.131 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2022-01-10T01:18:24.164 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2022-01-10T01:18:24.260 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2022-01-10T01:18:24.273 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2022-01-10T01:18:24.274 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2022-01-10T01:18:24.307 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2022-01-10T01:18:24.403 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2022-01-10T01:18:24.404 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2022-01-10T01:18:24.416 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2022-01-10T01:18:24.459 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2022-01-10T01:18:24.545 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2022-01-10T01:18:24.559 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2022-01-10T01:18:24.612 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2022-01-10T01:18:24.698 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2022-01-10T01:18:24.699 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2022-01-10T01:18:24.711 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2022-01-10T01:18:24.754 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2022-01-10T01:18:24.839 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2022-01-10T01:18:24.851 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2022-01-10T01:18:24.853 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2022-01-10T01:18:24.907 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2022-01-10T01:18:24.994 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2022-01-10T01:18:24.996 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2022-01-10T01:18:24.998 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2022-01-10T01:18:25.052 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2022-01-10T01:18:25.138 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2022-01-10T01:18:25.140 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2022-01-10T01:18:25.151 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2022-01-10T01:18:25.206 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2022-01-10T01:18:25.280 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2022-01-10T01:18:25.292 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2022-01-10T01:18:25.294 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2022-01-10T01:18:25.348 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2022-01-10T01:18:25.422 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2022-01-10T01:18:25.433 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2022-01-10T01:18:25.447 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2022-01-10T01:18:25.501 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2022-01-10T01:18:25.576 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2022-01-10T01:18:25.577 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2022-01-10T01:18:25.599 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2022-01-10T01:18:25.654 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2022-01-10T01:18:25.718 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2022-01-10T01:18:25.729 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2022-01-10T01:18:25.741 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2022-01-10T01:18:25.806 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2022-01-10T01:18:25.860 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2022-01-10T01:18:25.872 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2022-01-10T01:18:25.894 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 10102} 2022-01-10T01:18:25.951 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2022-01-10T01:18:26.016 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2022-01-10T01:18:26.028 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2022-01-10T01:18:26.051 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 10103} 2022-01-10T01:18:26.094 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2022-01-10T01:18:26.158 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2022-01-10T01:18:26.174 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2022-01-10T01:18:26.203 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 10104} 2022-01-10T01:18:26.246 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2022-01-10T01:18:26.300 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2022-01-10T01:18:26.312 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2022-01-10T01:18:26.345 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 10105} 2022-01-10T01:18:26.403 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2022-01-10T01:18:26.448 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2022-01-10T01:18:26.472 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2022-01-10T01:18:26.495 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 10106} 2022-01-10T01:18:26.542 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2022-01-10T01:18:26.593 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2022-01-10T01:18:26.616 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2022-01-10T01:18:26.650 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 10107} 2022-01-10T01:18:26.694 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2022-01-10T01:18:26.738 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2022-01-10T01:18:26.771 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2022-01-10T01:18:26.805 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 10108} 2022-01-10T01:18:26.839 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2022-01-10T01:18:26.882 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2022-01-10T01:18:26.927 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2022-01-10T01:18:26.950 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 10109} 2022-01-10T01:18:26.993 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2022-01-10T01:18:27.027 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2022-01-10T01:18:27.072 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2022-01-10T01:18:27.097 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 10110} 2022-01-10T01:18:27.150 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2022-01-10T01:18:27.183 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2022-01-10T01:18:27.226 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2022-01-10T01:18:27.248 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 10111} 2022-01-10T01:18:27.303 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2022-01-10T01:18:27.326 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2022-01-10T01:18:27.380 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2022-01-10T01:18:27.403 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 10112} 2022-01-10T01:18:27.456 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2022-01-10T01:18:27.478 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2022-01-10T01:18:27.521 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2022-01-10T01:18:27.556 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 10113} 2022-01-10T01:18:27.599 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2022-01-10T01:18:27.622 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2022-01-10T01:18:27.665 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2022-01-10T01:18:27.697 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 10114} 2022-01-10T01:18:27.751 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2022-01-10T01:18:27.762 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2022-01-10T01:18:27.806 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2022-01-10T01:18:27.859 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 10115} 2022-01-10T01:18:27.902 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2022-01-10T01:18:27.903 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2022-01-10T01:18:27.947 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2022-01-10T01:18:28.000 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 10116} 2022-01-10T01:18:28.044 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2022-01-10T01:18:28.045 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2022-01-10T01:18:28.094 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2022-01-10T01:18:28.147 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10118, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 10117} 2022-01-10T01:18:28.190 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2022-01-10T01:18:28.191 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2022-01-10T01:18:28.245 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2022-01-10T01:18:28.299 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10119, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 10118} 2022-01-10T01:18:28.331 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2022-01-10T01:18:28.332 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2022-01-10T01:18:28.386 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2022-01-10T01:18:28.451 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10120, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "move_home": false, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "uid": 10119} 2022-01-10T01:18:28.474 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2022-01-10T01:18:28.475 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2022-01-10T01:18:28.528 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2022-01-10T01:18:28.592 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10121, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "move_home": false, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "uid": 10120} 2022-01-10T01:18:28.625 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2022-01-10T01:18:28.626 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2022-01-10T01:18:28.681 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2022-01-10T01:18:28.735 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10122, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "move_home": false, "name": "xuwang", "shell": "/bin/bash", "state": "present", "uid": 10121} 2022-01-10T01:18:28.768 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2022-01-10T01:18:28.822 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2022-01-10T01:18:28.897 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10123, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "move_home": false, "name": "blaine", "shell": "/bin/bash", "state": "present", "uid": 10122} 2022-01-10T01:18:29.215 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2022-01-10T01:18:29.323 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2022-01-10T01:18:29.378 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2022-01-10T01:18:29.485 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10124, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10123} 2022-01-10T01:18:29.768 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10125, "groups": "sudo", "home": "/home/oro", "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "name": "oro", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10124} 2022-01-10T01:18:29.842 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10125, "groups": "sudo", "home": "/home/oro", "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "name": "oro", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10124} 2022-01-10T01:18:29.854 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10125, "groups": "sudo", "home": "/home/oro", "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "name": "oro", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10124} 2022-01-10T01:18:30.024 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10125, "groups": "sudo", "home": "/home/oro", "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "name": "oro", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10124} 2022-01-10T01:18:30.247 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10126, "groups": "sudo", "home": "/home/mrfreezeex", "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "name": "mrfreezeex", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10125} 2022-01-10T01:18:30.390 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:30 +0000 (0:00:24.028) 0:00:35.065 ******** 2022-01-10T01:18:30.420 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10126, "groups": "sudo", "home": "/home/mrfreezeex", "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "name": "mrfreezeex", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10125} 2022-01-10T01:18:30.422 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10126, "groups": "sudo", "home": "/home/mrfreezeex", "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "name": "mrfreezeex", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10125} 2022-01-10T01:18:30.761 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2022-01-10T01:18:30.763 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10126, "groups": "sudo", "home": "/home/mrfreezeex", "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "name": "mrfreezeex", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10125} 2022-01-10T01:18:30.863 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:30 +0000 (0:00:00.472) 0:00:35.537 ******** 2022-01-10T01:18:30.886 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:30 +0000 (0:00:00.023) 0:00:35.560 ******** 2022-01-10T01:18:30.911 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:30 +0000 (0:00:00.024) 0:00:35.585 ******** 2022-01-10T01:18:30.937 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:30 +0000 (0:00:00.025) 0:00:35.611 ******** 2022-01-10T01:18:30.943 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2022-01-10T01:18:30.981 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:30 +0000 (0:00:00.044) 0:00:35.655 ******** 2022-01-10T01:18:31.014 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:31 +0000 (0:00:00.033) 0:00:35.689 ******** 2022-01-10T01:18:31.025 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2022-01-10T01:18:31.027 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2022-01-10T01:18:31.028 INFO:teuthology.task.ansible.out: QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2022-01-10T01:18:31.030 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2022-01-10T01:18:31.032 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2022-01-10T01:18:31.033 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2022-01-10T01:18:31.035 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2022-01-10T01:18:31.037 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a9 2022-01-10T01:18:31.037 INFO:teuthology.task.ansible.out:5579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2022-01-10T01:18:31.039 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2022-01-10T01:18:31.040 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2022-01-10T01:18:31.042 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2022-01-10T01:18:31.043 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, 2022-01-10T01:18:31.044 INFO:teuthology.task.ansible.out: {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2022-01-10T01:18:31.045 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 2022-01-10T01:18:31.047 INFO:teuthology.task.ansible.out:3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", 2022-01-10T01:18:31.049 INFO:teuthology.task.ansible.out:"ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}]}, "changed": false} TASK [Create all users without sudo access.] *********************************** 2022-01-10T01:18:31.077 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:31 +0000 (0:00:00.062) 0:00:35.751 ******** 2022-01-10T01:18:31.105 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:31 +0000 (0:00:00.028) 0:00:35.780 ******** 2022-01-10T01:18:31.115 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2022-01-10T01:18:31.118 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2022-01-10T01:18:31.120 INFO:teuthology.task.ansible.out: QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2022-01-10T01:18:31.121 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2022-01-10T01:18:31.123 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2022-01-10T01:18:31.124 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9eb 2022-01-10T01:18:31.125 INFO:teuthology.task.ansible.out:ba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2022-01-10T01:18:31.126 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2022-01-10T01:18:31.128 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2022-01-10T01:18:31.130 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2022-01-10T01:18:31.131 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2022-01-10T01:18:31.133 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2022-01-10T01:18:31.134 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2022-01-10T01:18:31.136 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 2022-01-10T01:18:31.138 INFO:teuthology.task.ansible.out:3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e4810233 2022-01-10T01:18:31.138 INFO:teuthology.task.ansible.out:0631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", 2022-01-10T01:18:31.140 INFO:teuthology.task.ansible.out:"ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}]}, "changed": false} 2022-01-10T01:18:31.145 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2022-01-10T01:18:31.147 INFO:teuthology.task.ansible.out: QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2022-01-10T01:18:31.148 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2022-01-10T01:18:31.150 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2022-01-10T01:18:31.152 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2022-01-10T01:18:31.153 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2022-01-10T01:18:31.155 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2022-01-10T01:18:31.157 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2022-01-10T01:18:31.158 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2022-01-10T01:18:31.160 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2022-01-10T01:18:31.162 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432 2022-01-10T01:18:31.162 INFO:teuthology.task.ansible.out:aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2022-01-10T01:18:31.164 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 2022-01-10T01:18:31.166 INFO:teuthology.task.ansible.out:3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", 2022-01-10T01:18:31.167 INFO:teuthology.task.ansible.out:"ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}]}, "changed": false} 2022-01-10T01:18:31.196 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:31 +0000 (0:00:00.090) 0:00:35.870 ******** 2022-01-10T01:18:31.222 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:31 +0000 (0:00:00.026) 0:00:35.897 ******** 2022-01-10T01:18:31.240 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2022-01-10T01:18:31.242 INFO:teuthology.task.ansible.out: QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b26 2022-01-10T01:18:31.244 INFO:teuthology.task.ansible.out:5c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed20 2022-01-10T01:18:31.245 INFO:teuthology.task.ansible.out:82caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name" 2022-01-10T01:18:31.247 INFO:teuthology.task.ansible.out:: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9eb 2022-01-10T01:18:31.248 INFO:teuthology.task.ansible.out:ba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915 2022-01-10T01:18:31.249 INFO:teuthology.task.ansible.out:d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZ 2022-01-10T01:18:31.251 INFO:teuthology.task.ansible.out:YM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2022-01-10T01:18:31.253 INFO:teuthology.task.ansible.out: 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp 2022-01-10T01:18:31.255 INFO:teuthology.task.ansible.out:", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3 2022-01-10T01:18:31.256 INFO:teuthology.task.ansible.out:624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jj 2022-01-10T01:18:31.258 INFO:teuthology.task.ansible.out:enDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432 2022-01-10T01:18:31.259 INFO:teuthology.task.ansible.out:aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "sh 2022-01-10T01:18:31.261 INFO:teuthology.task.ansible.out:yamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 2022-01-10T01:18:31.262 INFO:teuthology.task.ansible.out:3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", 2022-01-10T01:18:31.264 INFO:teuthology.task.ansible.out:"ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}]}, "changed": false} 2022-01-10T01:18:31.291 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:31 +0000 (0:00:00.068) 0:00:35.966 ******** 2022-01-10T01:18:31.840 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2022-01-10T01:18:31.842 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"after": "b39424e053d42ee607f17b88c1886c2d02811d8f", "attempts": 1, "before": "b39424e053d42ee607f17b88c1886c2d02811d8f", "changed": false, "remote_url_changed": false} 2022-01-10T01:18:31.867 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:31 +0000 (0:00:00.575) 0:00:36.541 ******** 2022-01-10T01:18:31.875 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"after": "b39424e053d42ee607f17b88c1886c2d02811d8f", "attempts": 1, "before": "b39424e053d42ee607f17b88c1886c2d02811d8f", "changed": false, "remote_url_changed": false} 2022-01-10T01:18:31.903 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:31 +0000 (0:00:00.037) 0:00:36.578 ******** 2022-01-10T01:18:31.923 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"after": "b39424e053d42ee607f17b88c1886c2d02811d8f", "attempts": 1, "before": "b39424e053d42ee607f17b88c1886c2d02811d8f", "changed": false, "remote_url_changed": false} 2022-01-10T01:18:31.952 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:31 +0000 (0:00:00.048) 0:00:36.626 ******** 2022-01-10T01:18:32.088 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"after": "b39424e053d42ee607f17b88c1886c2d02811d8f", "attempts": 1, "before": "b39424e053d42ee607f17b88c1886c2d02811d8f", "changed": false, "remote_url_changed": false} 2022-01-10T01:18:32.112 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:32 +0000 (0:00:00.160) 0:00:36.787 ******** 2022-01-10T01:18:32.120 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2022-01-10T01:18:32.120 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2022-01-10T01:18:32.164 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2022-01-10T01:18:32.218 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2022-01-10T01:18:32.250 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2022-01-10T01:18:32.304 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2022-01-10T01:18:32.358 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2022-01-10T01:18:32.360 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2022-01-10T01:18:32.381 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2022-01-10T01:18:32.435 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2022-01-10T01:18:32.489 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2022-01-10T01:18:32.510 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2022-01-10T01:18:32.511 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2022-01-10T01:18:32.513 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2022-01-10T01:18:32.565 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2022-01-10T01:18:32.567 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2022-01-10T01:18:32.618 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2022-01-10T01:18:32.620 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2022-01-10T01:18:32.641 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2022-01-10T01:18:32.641 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2022-01-10T01:18:32.696 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2022-01-10T01:18:32.742 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2022-01-10T01:18:32.775 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2022-01-10T01:18:32.777 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y 2022-01-10T01:18:32.779 INFO:teuthology.task.ansible.out:+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2022-01-10T01:18:32.831 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2022-01-10T01:18:32.833 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2022-01-10T01:18:32.884 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2022-01-10T01:18:32.886 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2022-01-10T01:18:32.906 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2022-01-10T01:18:32.929 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2022-01-10T01:18:32.962 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2022-01-10T01:18:33.015 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2022-01-10T01:18:33.037 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2022-01-10T01:18:33.060 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2022-01-10T01:18:33.062 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2022-01-10T01:18:33.103 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2022-01-10T01:18:33.146 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2022-01-10T01:18:33.179 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2022-01-10T01:18:33.181 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:33.191 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2022-01-10T01:18:33.237 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2022-01-10T01:18:33.248 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:33.279 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2022-01-10T01:18:33.290 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:33.322 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2022-01-10T01:18:33.324 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2022-01-10T01:18:33.387 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2022-01-10T01:18:33.389 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2022-01-10T01:18:33.430 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2022-01-10T01:18:33.432 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2022-01-10T01:18:33.462 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2022-01-10T01:18:33.464 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2022-01-10T01:18:33.465 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2022-01-10T01:18:33.473 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:33.475 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55 2022-01-10T01:18:33.477 INFO:teuthology.task.ansible.out:rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:33.538 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2022-01-10T01:18:33.540 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2022-01-10T01:18:33.549 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:33.550 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:33.571 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2022-01-10T01:18:33.573 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:33.583 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:33.595 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2022-01-10T01:18:33.596 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2022-01-10T01:18:33.606 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2022-01-10T01:18:33.680 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2022-01-10T01:18:33.723 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2022-01-10T01:18:33.735 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2022-01-10T01:18:33.737 INFO:teuthology.task.ansible.out:son", "validate_certs": true} ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOB 2022-01-10T01:18:33.737 INFO:teuthology.task.ansible.out:NDOY3vltuNCgUiQgVWOYhUaVpj+2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJ 2022-01-10T01:18:33.739 INFO:teuthology.task.ansible.out:n7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:33.748 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:33.812 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2022-01-10T01:18:33.814 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2022-01-10T01:18:33.855 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2022-01-10T01:18:33.857 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2022-01-10T01:18:33.866 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2022-01-10T01:18:33.878 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2022-01-10T01:18:33.954 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2022-01-10T01:18:33.986 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2022-01-10T01:18:33.997 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2022-01-10T01:18:34.009 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2022-01-10T01:18:34.011 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2022-01-10T01:18:34.084 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2022-01-10T01:18:34.116 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2022-01-10T01:18:34.128 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2022-01-10T01:18:34.139 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2022-01-10T01:18:34.224 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2022-01-10T01:18:34.246 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2022-01-10T01:18:34.268 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2022-01-10T01:18:34.270 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2022-01-10T01:18:34.280 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2022-01-10T01:18:34.354 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2022-01-10T01:18:34.356 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2022-01-10T01:18:34.387 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2022-01-10T01:18:34.389 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2022-01-10T01:18:34.409 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2022-01-10T01:18:34.430 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2022-01-10T01:18:34.434 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2022-01-10T01:18:34.484 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2022-01-10T01:18:34.486 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2022-01-10T01:18:34.527 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2022-01-10T01:18:34.529 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2022-01-10T01:18:34.538 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2022-01-10T01:18:34.540 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2022-01-10T01:18:34.581 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2022-01-10T01:18:34.625 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2022-01-10T01:18:34.657 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2022-01-10T01:18:34.668 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2022-01-10T01:18:34.670 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2022-01-10T01:18:34.721 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2022-01-10T01:18:34.757 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2022-01-10T01:18:34.789 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2022-01-10T01:18:34.800 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2022-01-10T01:18:34.863 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2022-01-10T01:18:34.865 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2022-01-10T01:18:34.895 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2022-01-10T01:18:34.897 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2022-01-10T01:18:34.938 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2022-01-10T01:18:34.959 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2022-01-10T01:18:34.961 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2022-01-10T01:18:34.992 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2022-01-10T01:18:35.024 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2022-01-10T01:18:35.089 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2022-01-10T01:18:35.100 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlI 2022-01-10T01:18:35.101 INFO:teuthology.task.ansible.out:Qv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2022-01-10T01:18:35.122 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2022-01-10T01:18:35.154 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2022-01-10T01:18:35.219 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2022-01-10T01:18:35.231 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2022-01-10T01:18:35.274 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2022-01-10T01:18:35.285 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2022-01-10T01:18:35.359 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2022-01-10T01:18:35.360 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2022-01-10T01:18:35.414 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2022-01-10T01:18:35.416 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2022-01-10T01:18:35.490 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2022-01-10T01:18:35.501 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2022-01-10T01:18:35.544 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2022-01-10T01:18:35.546 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2022-01-10T01:18:35.629 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2022-01-10T01:18:35.631 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2022-01-10T01:18:35.673 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2022-01-10T01:18:35.675 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2022-01-10T01:18:35.685 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2022-01-10T01:18:35.687 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2022-01-10T01:18:35.760 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2022-01-10T01:18:35.762 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2022-01-10T01:18:35.771 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2022-01-10T01:18:35.804 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2022-01-10T01:18:35.815 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2022-01-10T01:18:35.889 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2022-01-10T01:18:35.911 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2022-01-10T01:18:35.913 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2022-01-10T01:18:35.944 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2022-01-10T01:18:35.946 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2022-01-10T01:18:36.030 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2022-01-10T01:18:36.052 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2022-01-10T01:18:36.073 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2022-01-10T01:18:36.075 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2022-01-10T01:18:36.162 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2022-01-10T01:18:36.184 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2022-01-10T01:18:36.217 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2022-01-10T01:18:36.229 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2022-01-10T01:18:36.293 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2022-01-10T01:18:36.314 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2022-01-10T01:18:36.360 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2022-01-10T01:18:36.361 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2022-01-10T01:18:36.426 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2022-01-10T01:18:36.437 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2022-01-10T01:18:36.490 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2022-01-10T01:18:36.502 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2022-01-10T01:18:36.555 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2022-01-10T01:18:36.577 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2022-01-10T01:18:36.620 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2022-01-10T01:18:36.633 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2022-01-10T01:18:36.635 INFO:teuthology.task.ansible.out: 2022-01-10T01:18:36.687 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2022-01-10T01:18:36.719 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2022-01-10T01:18:36.751 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2022-01-10T01:18:36.753 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2022-01-10T01:18:36.762 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2022-01-10T01:18:36.764 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2022-01-10T01:18:36.826 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2022-01-10T01:18:36.828 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2022-01-10T01:18:36.848 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2022-01-10T01:18:36.891 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2022-01-10T01:18:36.892 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2022-01-10T01:18:36.913 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2022-01-10T01:18:36.914 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2022-01-10T01:18:36.957 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2022-01-10T01:18:36.960 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2022-01-10T01:18:36.980 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2022-01-10T01:18:36.981 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2022-01-10T01:18:37.025 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2022-01-10T01:18:37.047 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2022-01-10T01:18:37.102 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2022-01-10T01:18:37.113 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2022-01-10T01:18:37.115 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2022-01-10T01:18:37.168 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2022-01-10T01:18:37.179 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2022-01-10T01:18:37.226 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2022-01-10T01:18:37.249 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2022-01-10T01:18:37.302 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2022-01-10T01:18:37.304 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2022-01-10T01:18:37.367 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2022-01-10T01:18:37.378 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2022-01-10T01:18:37.453 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2022-01-10T01:18:37.454 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQD 2022-01-10T01:18:37.456 INFO:teuthology.task.ansible.out:mOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2022-01-10T01:18:37.507 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2022-01-10T01:18:37.509 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2022-01-10T01:18:37.593 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2022-01-10T01:18:37.595 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2022-01-10T01:18:37.596 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMS 2022-01-10T01:18:37.598 INFO:teuthology.task.ansible.out:woj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf 2022-01-10T01:18:37.599 INFO:teuthology.task.ansible.out:53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2022-01-10T01:18:37.647 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2022-01-10T01:18:37.649 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2022-01-10T01:18:37.650 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2022-01-10T01:18:37.659 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNH 2022-01-10T01:18:37.661 INFO:teuthology.task.ansible.out:ORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2022-01-10T01:18:37.725 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2022-01-10T01:18:37.726 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2022-01-10T01:18:37.780 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2022-01-10T01:18:37.791 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2022-01-10T01:18:37.793 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2022-01-10T01:18:37.794 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2022-01-10T01:18:37.856 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2022-01-10T01:18:37.867 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2022-01-10T01:18:37.910 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2022-01-10T01:18:37.932 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2022-01-10T01:18:37.985 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2022-01-10T01:18:37.998 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2022-01-10T01:18:38.041 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2022-01-10T01:18:38.063 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2022-01-10T01:18:38.117 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2022-01-10T01:18:38.128 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2022-01-10T01:18:38.173 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2022-01-10T01:18:38.194 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2022-01-10T01:18:38.247 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2022-01-10T01:18:38.259 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2022-01-10T01:18:38.314 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2022-01-10T01:18:38.325 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2022-01-10T01:18:38.379 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2022-01-10T01:18:38.381 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2022-01-10T01:18:38.402 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2022-01-10T01:18:38.404 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2022-01-10T01:18:38.446 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2022-01-10T01:18:38.448 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2022-01-10T01:18:38.457 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2022-01-10T01:18:38.552 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2022-01-10T01:18:38.574 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2022-01-10T01:18:38.586 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2022-01-10T01:18:38.588 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2022-01-10T01:18:38.597 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2022-01-10T01:18:38.682 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2022-01-10T01:18:38.716 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2022-01-10T01:18:38.728 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2022-01-10T01:18:38.750 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2022-01-10T01:18:38.824 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2022-01-10T01:18:38.827 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2022-01-10T01:18:38.846 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2022-01-10T01:18:38.848 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2022-01-10T01:18:38.869 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2022-01-10T01:18:38.871 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2022-01-10T01:18:38.880 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2022-01-10T01:18:38.955 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2022-01-10T01:18:38.979 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2022-01-10T01:18:39.005 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2022-01-10T01:18:39.007 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2022-01-10T01:18:39.008 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2022-01-10T01:18:39.091 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2022-01-10T01:18:39.112 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2022-01-10T01:18:39.134 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2022-01-10T01:18:39.147 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2022-01-10T01:18:39.220 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2022-01-10T01:18:39.221 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2022-01-10T01:18:39.252 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2022-01-10T01:18:39.254 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2022-01-10T01:18:39.274 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2022-01-10T01:18:39.276 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2022-01-10T01:18:39.277 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2022-01-10T01:18:39.353 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2022-01-10T01:18:39.387 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2022-01-10T01:18:39.398 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2022-01-10T01:18:39.410 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2022-01-10T01:18:39.412 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2022-01-10T01:18:39.495 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2022-01-10T01:18:39.518 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2022-01-10T01:18:39.540 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2022-01-10T01:18:39.541 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2022-01-10T01:18:39.626 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2022-01-10T01:18:39.650 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2022-01-10T01:18:39.673 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2022-01-10T01:18:39.675 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2022-01-10T01:18:39.750 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2022-01-10T01:18:39.793 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2022-01-10T01:18:39.814 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2022-01-10T01:18:39.816 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2022-01-10T01:18:39.890 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2022-01-10T01:18:39.934 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2022-01-10T01:18:39.945 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2022-01-10T01:18:39.978 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2022-01-10T01:18:40.032 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2022-01-10T01:18:40.065 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2022-01-10T01:18:40.087 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2022-01-10T01:18:40.109 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2022-01-10T01:18:40.163 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2022-01-10T01:18:40.196 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2022-01-10T01:18:40.228 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2022-01-10T01:18:40.239 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2022-01-10T01:18:40.305 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2022-01-10T01:18:40.327 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2022-01-10T01:18:40.366 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2022-01-10T01:18:40.369 INFO:teuthology.task.ansible.out: ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2022-01-10T01:18:40.442 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2022-01-10T01:18:40.496 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2022-01-10T01:18:40.509 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2022-01-10T01:18:40.519 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2022-01-10T01:18:40.575 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2022-01-10T01:18:40.632 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2022-01-10T01:18:40.644 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2022-01-10T01:18:40.655 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2022-01-10T01:18:40.720 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2022-01-10T01:18:40.762 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2022-01-10T01:18:40.776 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2022-01-10T01:18:40.788 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2022-01-10T01:18:40.854 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2022-01-10T01:18:40.899 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2022-01-10T01:18:40.924 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2022-01-10T01:18:40.936 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2022-01-10T01:18:40.937 INFO:teuthology.task.ansible.out: 2022-01-10T01:18:40.981 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2022-01-10T01:18:41.035 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2022-01-10T01:18:41.060 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2022-01-10T01:18:41.071 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2022-01-10T01:18:41.104 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2022-01-10T01:18:41.170 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2022-01-10T01:18:41.193 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2022-01-10T01:18:41.205 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2022-01-10T01:18:41.271 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2022-01-10T01:18:41.314 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2022-01-10T01:18:41.326 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2022-01-10T01:18:41.349 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2022-01-10T01:18:41.403 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2022-01-10T01:18:41.456 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2022-01-10T01:18:41.479 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2022-01-10T01:18:41.491 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2022-01-10T01:18:41.534 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2022-01-10T01:18:41.587 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2022-01-10T01:18:41.620 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2022-01-10T01:18:41.622 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2022-01-10T01:18:41.679 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2022-01-10T01:18:41.722 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2022-01-10T01:18:41.757 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ 2022-01-10T01:18:41.759 INFO:teuthology.task.ansible.out:ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2022-01-10T01:18:41.812 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2022-01-10T01:18:41.813 INFO:teuthology.task.ansible.out: 2022-01-10T01:18:41.856 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2022-01-10T01:18:41.899 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2022-01-10T01:18:41.901 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2022-01-10T01:18:41.958 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2022-01-10T01:18:42.007 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2022-01-10T01:18:42.043 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwT 2022-01-10T01:18:42.045 INFO:teuthology.task.ansible.out:iaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2022-01-10T01:18:42.086 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2022-01-10T01:18:42.088 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2022-01-10T01:18:42.141 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2022-01-10T01:18:42.143 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2022-01-10T01:18:42.173 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2022-01-10T01:18:42.175 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2022-01-10T01:18:42.227 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2022-01-10T01:18:42.281 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2022-01-10T01:18:42.303 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2022-01-10T01:18:42.305 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2022-01-10T01:18:42.357 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2022-01-10T01:18:42.411 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2022-01-10T01:18:42.443 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2022-01-10T01:18:42.445 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2022-01-10T01:18:42.487 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2022-01-10T01:18:42.541 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2022-01-10T01:18:42.573 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2022-01-10T01:18:42.575 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2022-01-10T01:18:42.616 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2022-01-10T01:18:42.618 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2022-01-10T01:18:42.680 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2022-01-10T01:18:42.682 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2022-01-10T01:18:42.703 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2022-01-10T01:18:42.705 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2022-01-10T01:18:42.706 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2022-01-10T01:18:42.760 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2022-01-10T01:18:42.813 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2022-01-10T01:18:42.847 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2022-01-10T01:18:42.849 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2 2022-01-10T01:18:42.851 INFO:teuthology.task.ansible.out:CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2022-01-10T01:18:42.890 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2022-01-10T01:18:42.944 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2022-01-10T01:18:42.987 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2022-01-10T01:18:42.987 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2022-01-10T01:18:43.030 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2022-01-10T01:18:43.075 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2022-01-10T01:18:43.119 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2022-01-10T01:18:43.121 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2022-01-10T01:18:43.165 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2022-01-10T01:18:43.208 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2022-01-10T01:18:43.263 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2022-01-10T01:18:43.275 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2022-01-10T01:18:43.297 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2022-01-10T01:18:43.339 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2022-01-10T01:18:43.394 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comm 2022-01-10T01:18:43.395 INFO:teuthology.task.ansible.out:ent": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2022-01-10T01:18:43.426 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2022-01-10T01:18:43.480 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2022-01-10T01:18:43.530 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2022-01-10T01:18:43.535 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2022-01-10T01:18:43.572 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2022-01-10T01:18:43.615 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2022-01-10T01:18:43.658 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2022-01-10T01:18:43.659 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2022-01-10T01:18:43.704 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2022-01-10T01:18:43.706 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2022-01-10T01:18:43.758 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2022-01-10T01:18:43.760 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2022-01-10T01:18:43.791 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2022-01-10T01:18:43.793 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2022-01-10T01:18:43.802 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2022-01-10T01:18:43.834 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2022-01-10T01:18:43.888 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2022-01-10T01:18:43.920 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2022-01-10T01:18:43.942 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2022-01-10T01:18:43.944 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2022-01-10T01:18:43.965 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2022-01-10T01:18:44.020 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2022-01-10T01:18:44.063 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2022-01-10T01:18:44.075 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2022-01-10T01:18:44.119 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2022-01-10T01:18:44.153 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2022-01-10T01:18:44.197 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2022-01-10T01:18:44.219 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2022-01-10T01:18:44.251 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2022-01-10T01:18:44.316 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2022-01-10T01:18:44.328 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2022-01-10T01:18:44.371 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2022-01-10T01:18:44.383 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2022-01-10T01:18:44.457 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2022-01-10T01:18:44.469 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2022-01-10T01:18:44.513 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2022-01-10T01:18:44.514 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2022-01-10T01:18:44.601 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2022-01-10T01:18:44.603 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2022-01-10T01:18:44.657 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2022-01-10T01:18:44.659 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2022-01-10T01:18:44.661 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2022-01-10T01:18:44.733 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2022-01-10T01:18:44.735 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWe 2022-01-10T01:18:44.737 INFO:teuthology.task.ansible.out:uU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2022-01-10T01:18:44.782 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2022-01-10T01:18:44.784 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2022-01-10T01:18:44.870 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2022-01-10T01:18:44.872 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2022-01-10T01:18:44.923 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2022-01-10T01:18:44.926 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate 2022-01-10T01:18:44.928 INFO:teuthology.task.ansible.out:_certs": true} 2022-01-10T01:18:44.998 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2022-01-10T01:18:44.999 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2022-01-10T01:18:45.044 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2022-01-10T01:18:45.056 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2022-01-10T01:18:45.129 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2022-01-10T01:18:45.130 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2022-01-10T01:18:45.182 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2022-01-10T01:18:45.194 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2022-01-10T01:18:45.269 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2022-01-10T01:18:45.271 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2022-01-10T01:18:45.324 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2022-01-10T01:18:45.348 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2022-01-10T01:18:45.391 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2022-01-10T01:18:45.415 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2022-01-10T01:18:45.468 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2022-01-10T01:18:45.480 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2022-01-10T01:18:45.534 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2022-01-10T01:18:45.537 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2022-01-10T01:18:45.603 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2022-01-10T01:18:45.614 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2022-01-10T01:18:45.681 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2022-01-10T01:18:45.749 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2022-01-10T01:18:45.751 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2022-01-10T01:18:45.828 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2022-01-10T01:18:45.830 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2022-01-10T01:18:45.884 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2022-01-10T01:18:45.898 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2022-01-10T01:18:45.955 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2022-01-10T01:18:45.957 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2022-01-10T01:18:46.032 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2022-01-10T01:18:46.034 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2022-01-10T01:18:46.101 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH 2022-01-10T01:18:46.103 INFO:teuthology.task.ansible.out:8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2022-01-10T01:18:46.158 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2022-01-10T01:18:46.179 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2022-01-10T01:18:46.244 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", 2022-01-10T01:18:46.245 INFO:teuthology.task.ansible.out: "validate_certs": true} 2022-01-10T01:18:46.300 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2022-01-10T01:18:46.311 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2022-01-10T01:18:46.375 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2022-01-10T01:18:46.387 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2022-01-10T01:18:46.440 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2022-01-10T01:18:46.442 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2022-01-10T01:18:46.522 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "stat 2022-01-10T01:18:46.524 INFO:teuthology.task.ansible.out:e": "present", "user": "shraddhaag", "validate_certs": true} 2022-01-10T01:18:46.574 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2022-01-10T01:18:46.576 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2022-01-10T01:18:46.655 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2022-01-10T01:18:46.667 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2022-01-10T01:18:46.710 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2022-01-10T01:18:46.732 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2022-01-10T01:18:46.798 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2022-01-10T01:18:46.810 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2022-01-10T01:18:46.846 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2022-01-10T01:18:46.870 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2022-01-10T01:18:46.934 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2022-01-10T01:18:46.947 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2022-01-10T01:18:46.980 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2022-01-10T01:18:47.002 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2022-01-10T01:18:47.067 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2022-01-10T01:18:47.079 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2022-01-10T01:18:47.114 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2022-01-10T01:18:47.146 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2022-01-10T01:18:47.211 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2022-01-10T01:18:47.224 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2022-01-10T01:18:47.256 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2022-01-10T01:18:47.278 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2022-01-10T01:18:47.280 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2022-01-10T01:18:47.332 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2022-01-10T01:18:47.334 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2022-01-10T01:18:47.354 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2022-01-10T01:18:47.356 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2022-01-10T01:18:47.387 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2022-01-10T01:18:47.430 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2022-01-10T01:18:47.464 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2022-01-10T01:18:47.487 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2022-01-10T01:18:47.534 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2022-01-10T01:18:47.535 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2022-01-10T01:18:47.587 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2022-01-10T01:18:47.610 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2022-01-10T01:18:47.621 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2022-01-10T01:18:47.664 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2022-01-10T01:18:47.717 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2022-01-10T01:18:47.739 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2022-01-10T01:18:47.761 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2022-01-10T01:18:47.803 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2022-01-10T01:18:47.857 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2022-01-10T01:18:47.879 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2022-01-10T01:18:47.912 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2022-01-10T01:18:47.934 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2022-01-10T01:18:47.988 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2022-01-10T01:18:48.010 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2022-01-10T01:18:48.042 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2022-01-10T01:18:48.076 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2022-01-10T01:18:48.140 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2022-01-10T01:18:48.152 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2022-01-10T01:18:48.184 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2022-01-10T01:18:48.217 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2022-01-10T01:18:48.271 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2022-01-10T01:18:48.282 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2022-01-10T01:18:48.314 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2022-01-10T01:18:48.357 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2022-01-10T01:18:48.411 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2022-01-10T01:18:48.413 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2022-01-10T01:18:48.444 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2022-01-10T01:18:48.487 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2022-01-10T01:18:48.544 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2022-01-10T01:18:48.546 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2022-01-10T01:18:48.578 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2022-01-10T01:18:48.621 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2022-01-10T01:18:48.674 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2022-01-10T01:18:48.676 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2022-01-10T01:18:48.718 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2022-01-10T01:18:48.750 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2022-01-10T01:18:48.804 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2022-01-10T01:18:48.805 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2022-01-10T01:18:48.853 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2022-01-10T01:18:48.886 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2022-01-10T01:18:48.941 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2022-01-10T01:18:48.954 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2022-01-10T01:18:48.987 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2022-01-10T01:18:49.020 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2022-01-10T01:18:49.084 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "k 2022-01-10T01:18:49.086 INFO:teuthology.task.ansible.out:eyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2022-01-10T01:18:49.106 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "k 2022-01-10T01:18:49.107 INFO:teuthology.task.ansible.out:eyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2022-01-10T01:18:49.138 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "k 2022-01-10T01:18:49.140 INFO:teuthology.task.ansible.out:eyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2022-01-10T01:18:49.149 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2022-01-10T01:18:49.213 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2022-01-10T01:18:49.236 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2022-01-10T01:18:49.268 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2022-01-10T01:18:49.290 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "k 2022-01-10T01:18:49.292 INFO:teuthology.task.ansible.out:eyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2022-01-10T01:18:49.354 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2022-01-10T01:18:49.388 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2022-01-10T01:18:49.421 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2022-01-10T01:18:49.423 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2022-01-10T01:18:49.520 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2022-01-10T01:18:49.522 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2022-01-10T01:18:49.540 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2022-01-10T01:18:49.542 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2022-01-10T01:18:49.568 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2022-01-10T01:18:49.570 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2022-01-10T01:18:49.578 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2022-01-10T01:18:49.654 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC++MYddG6qYt7fXIvbaR1IXivOySDR//T+sQR3iRtmDQHZGPGiWshltpzeCboa51qeXurN8JYIYq1ZqvLEaOvwbEMtSLthPNl+FZMfe8E4YsuS3212fgbPhEwEBYo+7QZThCseDCewnE5Iz2I/tqlT69T10QZgbyHoZzT9aTPQBQHMF8by7ze9+V+cTD9ZrTG+fMIostxhJAOC+AsTGXwmtcWWrmZXKm/+2g7FTicZyCujXVzXY01c6rJhi1anRQh3pdfm+e6pmf37wHpPunHY2Xhiuy88o5WrzxKcLDUavwI+NI0+la54c0Qiv52LZPmDvPpbNh/7zmCu2vWHVayz1DZb52K5vP1Lqb7oD/cFfQEZ8m4UqzmtemT4gowJ/hFMh8RKPxCho3DlRAw4a7EhBvGiTgyvlcCKVk3S0aeIhvXsewWjOoRNHHvxbvKRCm2b0kSfnDnsZYyAsA8QpTbZYTmbbXHdyLLBS8gfFtB0aDPOPb2Nry2+ic/3hrIY5/c= nizamudeena@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2022-01-10T01:18:49.676 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC++MYddG6qYt7fXIvbaR1IXivOySDR//T+sQR3iRtmDQHZGPGiWshltpzeCboa51qeXurN8JYIYq1ZqvLEaOvwbEMtSLthPNl+FZMfe8E4YsuS3212fgbPhEwEBYo+7QZThCseDCewnE5Iz2I/tqlT69T10QZgbyHoZzT9aTPQBQHMF8by7ze9+V+cTD9ZrTG+fMIostxhJAOC+AsTGXwmtcWWrmZXKm/+2g7FTicZyCujXVzXY01c6rJhi1anRQh3pdfm+e6pmf37wHpPunHY2Xhiuy88o5WrzxKcLDUavwI+NI0+la54c0Qiv52LZPmDvPpbNh/7zmCu2vWHVayz1DZb52K5vP1Lqb7oD/cFfQEZ8m4UqzmtemT4gowJ/hFMh8RKPxCho3DlRAw4a7EhBvGiTgyvlcCKVk3S0aeIhvXsewWjOoRNHHvxbvKRCm2b0kSfnDnsZYyAsA8QpTbZYTmbbXHdyLLBS8gfFtB0aDPOPb2Nry2+ic/3hrIY5/c= nizamudeena@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2022-01-10T01:18:49.710 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC++MYddG6qYt7fXIvbaR1IXivOySDR//T+sQR3iRtmDQHZGPGiWshltpzeCboa51qeXurN8JYIYq1ZqvLEaOvwbEMtSLthPNl+FZMfe8E4YsuS3212fgbPhEwEBYo+7QZThCseDCewnE5Iz2I/tqlT69T10QZgbyHoZzT9aTPQBQHMF8by7ze9+V+cTD9ZrTG+fMIostxhJAOC+AsTGXwmtcWWrmZXKm/+2g7FTicZyCujXVzXY01c6rJhi1anRQh3pdfm+e6pmf37wHpPunHY2Xhiuy88o5WrzxKcLDUavwI+NI0+la54c0Qiv52LZPmDvPpbNh/7zmCu2vWHVayz1DZb52K5vP1Lqb7oD/cFfQEZ8m4UqzmtemT4gowJ/hFMh8RKPxCho3DlRAw4a7EhBvGiTgyvlcCKVk3S0aeIhvXsewWjOoRNHHvxbvKRCm2b0kSfnDnsZYyAsA8QpTbZYTmbbXHdyLLBS8gfFtB0aDPOPb2Nry2+ic/3hrIY5/c= nizamudeena@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2022-01-10T01:18:49.732 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_ 2022-01-10T01:18:49.734 INFO:teuthology.task.ansible.out:options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2022-01-10T01:18:49.812 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2022-01-10T01:18:49.855 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC++MYddG6qYt7fXIvbaR1IXivOySDR//T+sQR3iRtmDQHZGPGiWshltpzeCboa51qeXurN8JYIYq1ZqvLEaOvwbEMtSLthPNl+FZMfe8E4YsuS3212fgbPhEwEBYo+7QZThCseDCewnE5Iz2I/tqlT69T10QZgbyHoZzT9aTPQBQHMF8by7ze9+V+cTD9ZrTG+fMIostxhJAOC+AsTGXwmtcWWrmZXKm/+2g7FTicZyCujXVzXY01c6rJhi1anRQh3pdfm+e6pmf37wHpPunHY2Xhiuy88o5WrzxKcLDUavwI+NI0+la54c0Qiv52LZPmDvPpbNh/7zmCu2vWHVayz1DZb52K5vP1Lqb7oD/cFfQEZ8m4UqzmtemT4gowJ/hFMh8RKPxCho3DlRAw4a7EhBvGiTgyvlcCKVk3S0aeIhvXsewWjOoRNHHvxbvKRCm2b0kSfnDnsZYyAsA8QpTbZYTmbbXHdyLLBS8gfFtB0aDPOPb2Nry2+ic/3hrIY5/c= nizamudeena@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2022-01-10T01:18:49.867 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2022-01-10T01:18:49.879 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2022-01-10T01:18:49.945 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2022-01-10T01:18:50.010 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2022-01-10T01:18:50.013 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2022-01-10T01:18:50.059 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2022-01-10T01:18:50.093 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2022-01-10T01:18:50.148 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2022-01-10T01:18:50.150 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2022-01-10T01:18:50.205 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2022-01-10T01:18:50.227 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2022-01-10T01:18:50.282 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2022-01-10T01:18:50.293 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2022-01-10T01:18:50.349 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2022-01-10T01:18:50.372 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2022-01-10T01:18:50.427 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2022-01-10T01:18:50.437 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2022-01-10T01:18:50.482 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2022-01-10T01:18:50.526 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2022-01-10T01:18:50.559 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2022-01-10T01:18:50.571 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2022-01-10T01:18:50.614 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2022-01-10T01:18:50.667 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2022-01-10T01:18:50.700 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2022-01-10T01:18:50.711 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2022-01-10T01:18:50.745 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2022-01-10T01:18:50.800 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2022-01-10T01:18:50.844 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2022-01-10T01:18:50.879 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2022-01-10T01:18:50.932 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2022-01-10T01:18:50.985 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2022-01-10T01:18:50.998 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2022-01-10T01:18:51.009 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2022-01-10T01:18:51.065 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2022-01-10T01:18:51.119 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2022-01-10T01:18:51.122 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2022-01-10T01:18:51.153 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2022-01-10T01:18:51.218 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2022-01-10T01:18:51.263 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2022-01-10T01:18:51.264 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2022-01-10T01:18:51.298 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2022-01-10T01:18:51.341 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2022-01-10T01:18:51.394 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2022-01-10T01:18:51.406 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2022-01-10T01:18:51.428 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2022-01-10T01:18:51.472 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2022-01-10T01:18:51.537 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2022-01-10T01:18:51.539 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2022-01-10T01:18:51.572 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2022-01-10T01:18:51.606 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2022-01-10T01:18:51.659 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2022-01-10T01:18:51.661 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2022-01-10T01:18:51.704 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2022-01-10T01:18:51.746 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2022-01-10T01:18:51.801 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2022-01-10T01:18:51.803 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2022-01-10T01:18:51.834 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2022-01-10T01:18:51.876 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2022-01-10T01:18:51.929 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2022-01-10T01:18:51.931 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2022-01-10T01:18:51.963 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2022-01-10T01:18:52.016 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2022-01-10T01:18:52.069 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2022-01-10T01:18:52.091 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2022-01-10T01:18:52.092 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2022-01-10T01:18:52.167 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2022-01-10T01:18:52.210 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2022-01-10T01:18:52.232 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2022-01-10T01:18:52.265 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2022-01-10T01:18:52.308 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2022-01-10T01:18:52.361 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2022-01-10T01:18:52.383 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2022-01-10T01:18:52.416 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2022-01-10T01:18:52.458 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2022-01-10T01:18:52.501 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2022-01-10T01:18:52.534 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2022-01-10T01:18:52.567 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2022-01-10T01:18:52.609 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2022-01-10T01:18:52.642 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2022-01-10T01:18:52.675 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2022-01-10T01:18:52.739 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2022-01-10T01:18:52.750 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2022-01-10T01:18:52.772 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2022-01-10T01:18:52.818 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2022-01-10T01:18:52.873 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAqZvQXoWrH8ZaQ9Y8KK1B9JBCuD8Zspp2mWtjrWXGotKBCSGdDn3QSDEFtwpoK6vXZ3BijhUmrQ1bNUSo59556+T+wpfJAPJjuvB9i7A2lKSX74heuDl0QhJwHdt9mbCtpZ//7+IU0srzTn5qKwJ16GXeomgcyOZmefSGi/sbn0wRUR/UGA/LOJ3EK0nXcxyrv3iDfv75KRL87kaXtPRJRvSlXB5PSuDQtIoXhzMuD4nnh879Gwy0sYE/FUXcbl7LQb+/9rNJLE2POVNjArGv7RMp3y0K3k2/02AjbZvQwhfuIVayzTpmUiGY2Fo6hJRkH8ZT0aYF8uotfweGK18EYw== rsa-key-20151116", "key_options": null, "keyfile": "/home/oro/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oro", "validate_certs": true} 2022-01-10T01:18:52.874 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2022-01-10T01:18:52.907 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAqZvQXoWrH8ZaQ9Y8KK1B9JBCuD8Zspp2mWtjrWXGotKBCSGdDn3QSDEFtwpoK6vXZ3BijhUmrQ1bNUSo59556+T+wpfJAPJjuvB9i7A2lKSX74heuDl0QhJwHdt9mbCtpZ//7+IU0srzTn5qKwJ16GXeomgcyOZmefSGi/sbn0wRUR/UGA/LOJ3EK0nXcxyrv3iDfv75KRL87kaXtPRJRvSlXB5PSuDQtIoXhzMuD4nnh879Gwy0sYE/FUXcbl7LQb+/9rNJLE2POVNjArGv7RMp3y0K3k2/02AjbZvQwhfuIVayzTpmUiGY2Fo6hJRkH8ZT0aYF8uotfweGK18EYw== rsa-key-20151116", "key_options": null, "keyfile": "/home/oro/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oro", "validate_certs": true} 2022-01-10T01:18:52.950 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2022-01-10T01:18:53.013 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIADWYnXrwweaWs8/3gaUDctlaelfSPRh0Cs3G2SHbER0 mrfreezeex@inferno", "key_options": null, "keyfile": "/home/mrfreezeex/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mrfreezeex", "validate_certs": true} 2022-01-10T01:18:53.014 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAqZvQXoWrH8ZaQ9Y8KK1B9JBCuD8Zspp2mWtjrWXGotKBCSGdDn3QSDEFtwpoK6vXZ3BijhUmrQ1bNUSo59556+T+wpfJAPJjuvB9i7A2lKSX74heuDl0QhJwHdt9mbCtpZ//7+IU0srzTn5qKwJ16GXeomgcyOZmefSGi/sbn0wRUR/UGA/LOJ3EK0nXcxyrv3iDfv75KRL87kaXtPRJRvSlXB5PSuDQtIoXhzMuD4nnh879Gwy0sYE/FUXcbl7LQb+/9rNJLE2POVNjArGv7RMp3y0K3k2/02AjbZvQwhfuIVayzTpmUiGY2Fo6hJRkH8ZT0aYF8uotfweGK18EYw== rsa-key-20151116", "key_options": null, "keyfile": "/home/oro/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oro", "validate_certs": true} 2022-01-10T01:18:53.092 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIADWYnXrwweaWs8/3gaUDctlaelfSPRh0Cs3G2SHbER0 mrfreezeex@inferno", "key_options": null, "keyfile": "/home/mrfreezeex/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mrfreezeex", "validate_certs": true} 2022-01-10T01:18:53.143 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAqZvQXoWrH8ZaQ9Y8KK1B9JBCuD8Zspp2mWtjrWXGotKBCSGdDn3QSDEFtwpoK6vXZ3BijhUmrQ1bNUSo59556+T+wpfJAPJjuvB9i7A2lKSX74heuDl0QhJwHdt9mbCtpZ//7+IU0srzTn5qKwJ16GXeomgcyOZmefSGi/sbn0wRUR/UGA/LOJ3EK0nXcxyrv3iDfv75KRL87kaXtPRJRvSlXB5PSuDQtIoXhzMuD4nnh879Gwy0sYE/FUXcbl7LQb+/9rNJLE2POVNjArGv7RMp3y0K3k2/02AjbZvQwhfuIVayzTpmUiGY2Fo6hJRkH8ZT0aYF8uotfweGK18EYw== rsa-key-20151116", "key_options": null, "keyfile": "/home/oro/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oro", "validate_certs": true} 2022-01-10T01:18:53.167 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:53 +0000 (0:00:21.054) 0:00:57.842 ******** 2022-01-10T01:18:53.196 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:53 +0000 (0:00:00.028) 0:00:57.871 ******** 2022-01-10T01:18:53.205 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIADWYnXrwweaWs8/3gaUDctlaelfSPRh0Cs3G2SHbER0 mrfreezeex@inferno", "key_options": null, "keyfile": "/home/mrfreezeex/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mrfreezeex", "validate_certs": true} 2022-01-10T01:18:53.270 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIADWYnXrwweaWs8/3gaUDctlaelfSPRh0Cs3G2SHbER0 mrfreezeex@inferno", "key_options": null, "keyfile": "/home/mrfreezeex/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mrfreezeex", "validate_certs": true} 2022-01-10T01:18:53.324 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.325 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.325 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.325 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.326 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/ 2022-01-10T01:18:53.329 INFO:teuthology.task.ansible.out:v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.357 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:53 +0000 (0:00:00.161) 0:00:58.032 ******** 2022-01-10T01:18:53.380 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:53 +0000 (0:00:00.022) 0:00:58.054 ******** 2022-01-10T01:18:53.389 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.390 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.391 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841e 2022-01-10T01:18:53.394 INFO:teuthology.task.ansible.out:e62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27 2022-01-10T01:18:53.396 INFO:teuthology.task.ansible.out:045"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.443 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.454 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.466 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.467 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.479 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.480 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2022-01-10T01:18:53.480 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a26 2022-01-10T01:18:53.482 INFO:teuthology.task.ansible.out:69cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.492 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.494 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f30 2022-01-10T01:18:53.495 INFO:teuthology.task.ansible.out:09adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2022-01-10T01:18:53.497 INFO:teuthology.task.ansible.out: 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.506 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.508 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpN 2022-01-10T01:18:53.510 INFO:teuthology.task.ansible.out:wSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.519 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.521 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.521 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.532 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.632 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2022-01-10T01:18:53.654 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2022-01-10T01:18:53.669 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e 2022-01-10T01:18:53.671 INFO:teuthology.task.ansible.out:1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@par 2022-01-10T01:18:53.673 INFO:teuthology.task.ansible.out:kour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.679 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.682 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.767 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2022-01-10T01:18:53.778 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.780 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.789 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.790 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2022-01-10T01:18:53.792 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.802 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.805 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hG 2022-01-10T01:18:53.806 INFO:teuthology.task.ansible.out:tB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2022-01-10T01:18:53.815 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.817 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABA 2022-01-10T01:18:53.819 INFO:teuthology.task.ansible.out:QCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89 2022-01-10T01:18:53.820 INFO:teuthology.task.ansible.out:b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.830 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.832 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.844 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de 2022-01-10T01:18:53.847 INFO:teuthology.task.ansible.out:3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.849 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.850 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.861 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.863 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.873 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.875 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.885 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.887 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.898 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.900 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.912 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.914 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.924 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.925 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.926 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.938 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.940 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.951 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.963 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2022-01-10T01:18:53.964 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2022-01-10T01:18:53.965 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.967 INFO:teuthology.task.ansible.out: skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.967 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.968 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.968 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c 2022-01-10T01:18:53.970 INFO:teuthology.task.ansible.out:4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.981 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.983 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nv 2022-01-10T01:18:53.984 INFO:teuthology.task.ansible.out:asu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387af 2022-01-10T01:18:53.986 INFO:teuthology.task.ansible.out:fca90aed"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.995 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:53.997 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.008 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.010 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.012 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.013 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.013 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-Virtu 2022-01-10T01:18:54.015 INFO:teuthology.task.ansible.out:alBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.026 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.028 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.029 INFO:teuthology.task.ansible.out:skipping: [smithi139.fron 2022-01-10T01:18:54.031 INFO:teuthology.task.ansible.out:t.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb 2022-01-10T01:18:54.033 INFO:teuthology.task.ansible.out:79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.043 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.045 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.046 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.048 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.048 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.049 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.049 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.061 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.063 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia. 2022-01-10T01:18:54.065 INFO:teuthology.task.ansible.out:ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.076 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.079 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.080 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f 2022-01-10T01:18:54.081 INFO:teuthology.task.ansible.out:9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.083 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.094 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.095 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.096 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.098 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.100 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.100 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.102 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.114 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.115 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.117 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.117 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.119 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.120 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.122 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.123 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.125 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.136 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.138 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.138 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", 2022-01-10T01:18:54.140 INFO:teuthology.task.ansible.out:"ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.152 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.153 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.154 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.154 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.154 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT 2022-01-10T01:18:54.156 INFO:teuthology.task.ansible.out:9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.166 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.168 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb 2022-01-10T01:18:54.169 INFO:teuthology.task.ansible.out:7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", 2022-01-10T01:18:54.171 INFO:teuthology.task.ansible.out: "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.173 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.186 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.188 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.189 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.189 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'nam 2022-01-10T01:18:54.191 INFO:teuthology.task.ansible.out:e': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.192 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144d 2022-01-10T01:18:54.194 INFO:teuthology.task.ansible.out:babc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.195 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.195 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.207 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.209 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.209 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.210 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.210 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54s 2022-01-10T01:18:54.212 INFO:teuthology.task.ansible.out:dB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.223 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.225 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.225 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.227 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.228 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.229 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name 2022-01-10T01:18:54.232 INFO:teuthology.task.ansible.out:": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5a 2022-01-10T01:18:54.234 INFO:teuthology.task.ansible.out:af255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.242 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.244 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.244 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.255 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.257 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.268 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.269 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.270 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.281 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.282 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.282 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.283 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.283 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon h 2022-01-10T01:18:54.285 INFO:teuthology.task.ansible.out:yRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.285 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.287 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.287 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.288 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.288 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@red 2022-01-10T01:18:54.290 INFO:teuthology.task.ansible.out:hat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.290 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, 2022-01-10T01:18:54.292 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.304 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.306 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.307 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.309 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.311 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.313 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.316 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.329 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.330 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.342 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.343 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.344 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.345 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.348 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.350 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.362 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.373 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.376 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.378 INFO:teuthology.task.ansible.out: 2022-01-10T01:18:54.388 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.399 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.401 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.405 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.418 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.420 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalh 2022-01-10T01:18:54.422 INFO:teuthology.task.ansible.out:ojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.433 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.435 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.436 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name 2022-01-10T01:18:54.439 INFO:teuthology.task.ansible.out:": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.443 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.445 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.446 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjk 2022-01-10T01:18:54.448 INFO:teuthology.task.ansible.out:Asj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop d 2022-01-10T01:18:54.450 INFO:teuthology.task.ansible.out:dAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.460 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.462 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.463 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.464 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.464 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau 2022-01-10T01:18:54.466 INFO:teuthology.task.ansible.out:", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.466 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.467 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thin 2022-01-10T01:18:54.468 INFO:teuthology.task.ansible.out:kpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.469 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf9 2022-01-10T01:18:54.470 INFO:teuthology.task.ansible.out:32ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.471 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reas 2022-01-10T01:18:54.473 INFO:teuthology.task.ansible.out:on": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.483 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.485 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.487 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.487 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.488 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"n 2022-01-10T01:18:54.489 INFO:teuthology.task.ansible.out:ame": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7 2022-01-10T01:18:54.491 INFO:teuthology.task.ansible.out:d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.492 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.492 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.492 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1 2022-01-10T01:18:54.494 INFO:teuthology.task.ansible.out:a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.495 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item" 2022-01-10T01:18:54.496 INFO:teuthology.task.ansible.out:, "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.497 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.497 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => 2022-01-10T01:18:54.498 INFO:teuthology.task.ansible.out: (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.508 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.510 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.524 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.526 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.528 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.529 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.529 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.531 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.542 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.543 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.546 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.550 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.551 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.552 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.555 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.558 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.559 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.561 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.561 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.562 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.562 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "ch 2022-01-10T01:18:54.564 INFO:teuthology.task.ansible.out:anged": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.564 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.566 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.566 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.566 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.567 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh 2022-01-10T01:18:54.568 INFO:teuthology.task.ansible.out:", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.569 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.569 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd 2022-01-10T01:18:54.571 INFO:teuthology.task.ansible.out:1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.572 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.573 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.573 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea5003401 2022-01-10T01:18:54.575 INFO:teuthology.task.ansible.out:40144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.586 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.587 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.609 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.611 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.611 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.612 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {" 2022-01-10T01:18:54.613 INFO:teuthology.task.ansible.out:name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.614 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.614 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkp 2022-01-10T01:18:54.615 INFO:teuthology.task.ansible.out:ad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.616 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e529929 2022-01-10T01:18:54.617 INFO:teuthology.task.ansible.out:8461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.628 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.629 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.631 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.631 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.633 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.634 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.636 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.637 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.637 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.637 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.638 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khirema 2022-01-10T01:18:54.640 INFO:teuthology.task.ansible.out:t@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.649 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.651 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.652 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "o 2022-01-10T01:18:54.653 INFO:teuthology.task.ansible.out:vpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.664 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.666 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.667 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.668 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.669 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.670 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.672 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.683 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.685 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.687 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.687 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.689 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.690 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.691 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.692 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.693 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.705 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.707 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.720 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.724 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.733 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.734 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.736 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.738 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.739 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.741 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.743 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.746 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.748 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.751 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.752 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.753 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.753 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oro", "ovpn 2022-01-10T01:18:54.756 INFO:teuthology.task.ansible.out:": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.758 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.759 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.760 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002 2022-01-10T01:18:54.762 INFO:teuthology.task.ansible.out:d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.784 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.786 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.811 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:54 +0000 (0:00:01.430) 0:00:59.486 ******** 2022-01-10T01:18:54.819 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.820 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.821 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.823 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.825 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.826 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.827 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.847 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.849 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.850 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "chang 2022-01-10T01:18:54.852 INFO:teuthology.task.ansible.out:ed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovp 2022-01-10T01:18:54.853 INFO:teuthology.task.ansible.out:n": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nizamial09@thinkpad 4GoNn989LSUMJ1XNW0dGtA 3f8a1ef7c25bb0491b8e3db6946e69bb0dea077048ff8140382fbae5a02206f7"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.887 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:54 +0000 (0:00:00.076) 0:00:59.562 ******** 2022-01-10T01:18:54.900 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.901 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.901 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.902 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.904 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.904 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.906 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.906 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.908 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.909 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.910 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.912 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** 2022-01-10T01:18:54.912 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.913 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.915 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.946 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:54 +0000 (0:00:00.059) 0:00:59.621 ******** 2022-01-10T01:18:54.956 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.957 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.958 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.959 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.960 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.960 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.961 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'Aru 2022-01-10T01:18:54.962 INFO:teuthology.task.ansible.out:naSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:54.963 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-b 2022-01-10T01:18:54.965 INFO:teuthology.task.ansible.out:m r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:55.002 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:55.004 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:55.004 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:55.005 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Condition 2022-01-10T01:18:55.006 INFO:teuthology.task.ansible.out:al result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'oro', 'ovpn': 'oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oro", "ovpn": "oro@oro-ubuntu-bm r1PDxMqo/AP6wFx5ZWQ3eg 18bf1a1177da6dc89958adf65a4813a7da3e899cd94dc86384240ea3b5e00361"}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'name': 'mrfreezeex', 'ovpn': 'mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mrfreezeex", "ovpn": "mrfreezeex@inferno ade2FH1BYDNTWeREZEJpFQ 32d052805908bc929983119748701a6c882cfbd2dd32c511bdcfbe6d32efb7ef"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:55.034 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:55 +0000 (0:00:00.087) 0:00:59.708 ******** 2022-01-10T01:18:55.063 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:55 +0000 (0:00:00.029) 0:00:59.737 ******** 2022-01-10T01:18:55.128 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:55 +0000 (0:00:00.064) 0:00:59.802 ******** 2022-01-10T01:18:55.136 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:55.170 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:55 +0000 (0:00:00.042) 0:00:59.845 ******** 2022-01-10T01:18:55.181 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2022-01-10T01:18:55.182 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2022-01-10T01:18:55.194 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:18:55.227 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:18:55 +0000 (0:00:00.056) 0:00:59.902 ******** 2022-01-10T01:18:55.257 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2022-01-10T01:18:55.259 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2022-01-10T01:18:55.302 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2022-01-10T01:18:55.389 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2022-01-10T01:18:55.390 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2022-01-10T01:18:55.444 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2022-01-10T01:18:55.446 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2022-01-10T01:18:55.521 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2022-01-10T01:18:55.533 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2022-01-10T01:18:55.576 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2022-01-10T01:18:55.588 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2022-01-10T01:18:55.663 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2022-01-10T01:18:55.664 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2022-01-10T01:18:55.718 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2022-01-10T01:18:55.719 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2022-01-10T01:18:55.793 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2022-01-10T01:18:55.804 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2022-01-10T01:18:55.858 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2022-01-10T01:18:55.859 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2022-01-10T01:18:55.923 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2022-01-10T01:18:55.935 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2022-01-10T01:18:55.988 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2022-01-10T01:18:55.990 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2022-01-10T01:18:56.064 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2022-01-10T01:18:56.086 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2022-01-10T01:18:56.130 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2022-01-10T01:18:56.131 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2022-01-10T01:18:56.195 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2022-01-10T01:18:56.217 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2022-01-10T01:18:56.261 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2022-01-10T01:18:56.261 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2022-01-10T01:18:56.336 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2022-01-10T01:18:56.348 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2022-01-10T01:18:56.392 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2022-01-10T01:18:56.404 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2022-01-10T01:18:56.472 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2022-01-10T01:18:56.484 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2022-01-10T01:18:56.528 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2022-01-10T01:18:56.529 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2022-01-10T01:18:56.612 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2022-01-10T01:18:56.624 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2022-01-10T01:18:56.667 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2022-01-10T01:18:56.668 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2022-01-10T01:18:56.742 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2022-01-10T01:18:56.753 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2022-01-10T01:18:56.797 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2022-01-10T01:18:56.808 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2022-01-10T01:18:56.883 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2022-01-10T01:18:56.895 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2022-01-10T01:18:56.928 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2022-01-10T01:18:56.950 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2022-01-10T01:18:57.016 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2022-01-10T01:18:57.039 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2022-01-10T01:18:57.084 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2022-01-10T01:18:57.095 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2022-01-10T01:18:57.160 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2022-01-10T01:18:57.193 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2022-01-10T01:18:57.215 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2022-01-10T01:18:57.237 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2022-01-10T01:18:57.293 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2022-01-10T01:18:57.336 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2022-01-10T01:18:57.347 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2022-01-10T01:18:57.369 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2022-01-10T01:18:57.433 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2022-01-10T01:18:57.477 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2022-01-10T01:18:57.489 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2022-01-10T01:18:57.511 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2022-01-10T01:18:57.577 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2022-01-10T01:18:57.611 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2022-01-10T01:18:57.622 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2022-01-10T01:18:57.624 INFO:teuthology.task.ansible.out: 2022-01-10T01:18:57.657 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2022-01-10T01:18:57.711 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2022-01-10T01:18:57.755 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2022-01-10T01:18:57.767 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2022-01-10T01:18:57.789 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2022-01-10T01:18:57.852 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2022-01-10T01:18:57.895 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2022-01-10T01:18:57.897 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2022-01-10T01:18:57.928 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2022-01-10T01:18:57.992 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2022-01-10T01:18:58.025 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2022-01-10T01:18:58.036 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2022-01-10T01:18:58.069 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2022-01-10T01:18:58.122 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2022-01-10T01:18:58.165 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2022-01-10T01:18:58.167 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2022-01-10T01:18:58.208 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2022-01-10T01:18:58.252 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2022-01-10T01:18:58.487 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} ok: [smithi036.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} ok: [smithi059.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} ok: [smithi139.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} ok: [smithi166.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} ok: [smithi036.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2022-01-10T01:18:58.489 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2022-01-10T01:18:58.531 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2022-01-10T01:18:58.574 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2022-01-10T01:18:58.576 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2022-01-10T01:18:58.628 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2022-01-10T01:18:58.662 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2022-01-10T01:18:58.704 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2022-01-10T01:18:58.706 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2022-01-10T01:18:58.759 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2022-01-10T01:18:58.802 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2022-01-10T01:18:58.834 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2022-01-10T01:18:58.845 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2022-01-10T01:18:58.898 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2022-01-10T01:18:58.941 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2022-01-10T01:18:58.973 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2022-01-10T01:18:58.975 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2022-01-10T01:18:59.038 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2022-01-10T01:18:59.083 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2022-01-10T01:18:59.115 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2022-01-10T01:18:59.116 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2022-01-10T01:18:59.180 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2022-01-10T01:18:59.214 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2022-01-10T01:18:59.247 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2022-01-10T01:18:59.260 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2022-01-10T01:18:59.324 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2022-01-10T01:18:59.346 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2022-01-10T01:18:59.378 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2022-01-10T01:18:59.379 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2022-01-10T01:18:59.465 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2022-01-10T01:18:59.477 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2022-01-10T01:18:59.510 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2022-01-10T01:18:59.512 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2022-01-10T01:18:59.597 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2022-01-10T01:18:59.619 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2022-01-10T01:18:59.652 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2022-01-10T01:18:59.654 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2022-01-10T01:18:59.728 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2022-01-10T01:18:59.751 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2022-01-10T01:18:59.794 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2022-01-10T01:18:59.794 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2022-01-10T01:18:59.871 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2022-01-10T01:18:59.882 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2022-01-10T01:18:59.936 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2022-01-10T01:18:59.939 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2022-01-10T01:19:00.004 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2022-01-10T01:19:00.026 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2022-01-10T01:19:00.069 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2022-01-10T01:19:00.080 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2022-01-10T01:19:00.146 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2022-01-10T01:19:00.167 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2022-01-10T01:19:00.210 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2022-01-10T01:19:00.212 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2022-01-10T01:19:00.276 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2022-01-10T01:19:00.298 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2022-01-10T01:19:00.341 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2022-01-10T01:19:00.343 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2022-01-10T01:19:00.417 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2022-01-10T01:19:00.428 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2022-01-10T01:19:00.481 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2022-01-10T01:19:00.482 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2022-01-10T01:19:00.556 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2022-01-10T01:19:00.567 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2022-01-10T01:19:00.611 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2022-01-10T01:19:00.613 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2022-01-10T01:19:00.696 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2022-01-10T01:19:00.698 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2022-01-10T01:19:00.740 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": false, "item": "davidz", "name": "davidz", "state": "absent"} 2022-01-10T01:19:00.752 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2022-01-10T01:19:00.828 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2022-01-10T01:19:00.840 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2022-01-10T01:19:00.882 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": false, "item": "wusui", "name": "wusui", "state": "absent"} 2022-01-10T01:19:00.894 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2022-01-10T01:19:00.961 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2022-01-10T01:19:00.973 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2022-01-10T01:19:01.016 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": false, "item": "nwatkins", "name": "nwatkins", "state": "absent"} 2022-01-10T01:19:01.017 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2022-01-10T01:19:01.101 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2022-01-10T01:19:01.102 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2022-01-10T01:19:01.145 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": false, "item": "sidharthanup", "name": "sidharthanup", "state": "absent"} 2022-01-10T01:19:01.158 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2022-01-10T01:19:01.232 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2022-01-10T01:19:01.243 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2022-01-10T01:19:01.286 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": false, "item": "varsha", "name": "varsha", "state": "absent"} 2022-01-10T01:19:01.297 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2022-01-10T01:19:01.371 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2022-01-10T01:19:01.383 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2022-01-10T01:19:01.426 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": false, "item": "hmunjulu", "name": "hmunjulu", "state": "absent"} 2022-01-10T01:19:01.438 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2022-01-10T01:19:01.513 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2022-01-10T01:19:01.515 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2022-01-10T01:19:01.557 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2022-01-10T01:19:01.568 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2022-01-10T01:19:01.652 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2022-01-10T01:19:01.655 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2022-01-10T01:19:01.696 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2022-01-10T01:19:01.707 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2022-01-10T01:19:01.782 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2022-01-10T01:19:01.784 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2022-01-10T01:19:01.836 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2022-01-10T01:19:01.838 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2022-01-10T01:19:01.921 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2022-01-10T01:19:01.922 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2022-01-10T01:19:01.965 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2022-01-10T01:19:01.977 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2022-01-10T01:19:02.061 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2022-01-10T01:19:02.072 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2022-01-10T01:19:02.105 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2022-01-10T01:19:02.106 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2022-01-10T01:19:02.190 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2022-01-10T01:19:02.201 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2022-01-10T01:19:02.245 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2022-01-10T01:19:02.246 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2022-01-10T01:19:02.331 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2022-01-10T01:19:02.342 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2022-01-10T01:19:02.375 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2022-01-10T01:19:02.386 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2022-01-10T01:19:02.471 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2022-01-10T01:19:02.473 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2022-01-10T01:19:02.505 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2022-01-10T01:19:02.517 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2022-01-10T01:19:02.603 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2022-01-10T01:19:02.603 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2022-01-10T01:19:02.667 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:02 +0000 (0:00:07.439) 0:01:07.341 ******** 2022-01-10T01:19:02.675 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2022-01-10T01:19:02.677 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2022-01-10T01:19:02.726 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:02 +0000 (0:00:00.059) 0:01:07.401 ******** 2022-01-10T01:19:02.751 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2022-01-10T01:19:02.805 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:02 +0000 (0:00:00.078) 0:01:07.479 ******** 2022-01-10T01:19:02.813 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2022-01-10T01:19:02.864 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:02 +0000 (0:00:00.058) 0:01:07.538 ******** 2022-01-10T01:19:03.357 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2022-01-10T01:19:03.359 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "checksum": "080c38644b4bda11c886c07a56ac73cb2edfd0d3", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "10f9e32e8b4d88eeb5766f85e234cf69", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1641777542.850061-11678-214977531830019/source", "state": "file", "uid": 0} changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "checksum": "080c38644b4bda11c886c07a56ac73cb2edfd0d3", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "10f9e32e8b4d88eeb5766f85e234cf69", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1641777542.9602587-11701-99016108558997/source", "state": "file", "uid": 0} 2022-01-10T01:19:03.359 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "checksum": "080c38644b4bda11c886c07a56ac73cb2edfd0d3", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "10f9e32e8b4d88eeb5766f85e234cf69", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1641777542.7505236-11675-81588404198296/source", "state": "file", "uid": 0} 2022-01-10T01:19:03.385 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.521) 0:01:08.060 ******** 2022-01-10T01:19:03.409 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.022) 0:01:08.082 ******** 2022-01-10T01:19:03.432 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.024) 0:01:08.107 ******** 2022-01-10T01:19:03.440 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "checksum": "080c38644b4bda11c886c07a56ac73cb2edfd0d3", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "10f9e32e8b4d88eeb5766f85e234cf69", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1641777542.8900669-11692-161720698615516/source", "state": "file", "uid": 0} 2022-01-10T01:19:03.469 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.036) 0:01:08.143 ******** 2022-01-10T01:19:03.477 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2022-01-10T01:19:03.479 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => { "msg": "Host smithi036.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } ok: [smithi059.front.sepia.ceph.com] => { "msg": "Host smithi059.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2022-01-10T01:19:03.505 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.036) 0:01:08.180 ******** 2022-01-10T01:19:03.531 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.025) 0:01:08.205 ******** 2022-01-10T01:19:03.538 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => { "msg": "Host smithi166.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2022-01-10T01:19:03.540 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => { "msg": "Host smithi139.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2022-01-10T01:19:03.568 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.037) 0:01:08.242 ******** 2022-01-10T01:19:03.593 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.024) 0:01:08.267 ******** 2022-01-10T01:19:03.602 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2022-01-10T01:19:03.604 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2022-01-10T01:19:03.606 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2022-01-10T01:19:03.633 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.040) 0:01:08.308 ******** 2022-01-10T01:19:03.656 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.022) 0:01:08.330 ******** 2022-01-10T01:19:03.663 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2022-01-10T01:19:03.690 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.034) 0:01:08.365 ******** 2022-01-10T01:19:03.698 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2022-01-10T01:19:03.724 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.033) 0:01:08.399 ******** 2022-01-10T01:19:03.731 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2022-01-10T01:19:03.733 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:03.758 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.033) 0:01:08.432 ******** 2022-01-10T01:19:03.765 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:03.766 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:03.791 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.033) 0:01:08.465 ******** 2022-01-10T01:19:03.821 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.029) 0:01:08.495 ******** 2022-01-10T01:19:03.829 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:03.831 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:03.856 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.035) 0:01:08.531 ******** 2022-01-10T01:19:03.880 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.023) 0:01:08.554 ******** 2022-01-10T01:19:03.887 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:03.889 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:03.914 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.034) 0:01:08.589 ******** 2022-01-10T01:19:03.937 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.022) 0:01:08.612 ******** 2022-01-10T01:19:03.944 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2022-01-10T01:19:03.946 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:03.973 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:03 +0000 (0:00:00.035) 0:01:08.647 ******** 2022-01-10T01:19:03.981 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2022-01-10T01:19:03.982 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.008 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.035) 0:01:08.683 ******** 2022-01-10T01:19:04.032 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.022) 0:01:08.706 ******** 2022-01-10T01:19:04.038 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.040 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.065 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.033) 0:01:08.739 ******** 2022-01-10T01:19:04.087 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.022) 0:01:08.762 ******** 2022-01-10T01:19:04.094 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.120 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.032) 0:01:08.794 ******** 2022-01-10T01:19:04.127 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2022-01-10T01:19:04.129 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.154 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.033) 0:01:08.828 ******** 2022-01-10T01:19:04.160 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2022-01-10T01:19:04.162 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.194 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.040) 0:01:08.869 ******** 2022-01-10T01:19:04.217 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.023) 0:01:08.892 ******** 2022-01-10T01:19:04.225 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2022-01-10T01:19:04.227 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.252 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.034) 0:01:08.927 ******** 2022-01-10T01:19:04.260 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2022-01-10T01:19:04.262 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.288 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.035) 0:01:08.962 ******** 2022-01-10T01:19:04.310 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.022) 0:01:08.985 ******** 2022-01-10T01:19:04.317 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2022-01-10T01:19:04.319 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.344 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.033) 0:01:09.019 ******** 2022-01-10T01:19:04.367 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.022) 0:01:09.042 ******** 2022-01-10T01:19:04.375 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2022-01-10T01:19:04.377 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.402 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.034) 0:01:09.077 ******** 2022-01-10T01:19:04.424 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.021) 0:01:09.098 ******** 2022-01-10T01:19:04.431 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2022-01-10T01:19:04.432 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.457 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.033) 0:01:09.132 ******** 2022-01-10T01:19:04.465 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2022-01-10T01:19:04.466 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.501 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.044) 0:01:09.176 ******** 2022-01-10T01:19:04.508 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2022-01-10T01:19:04.510 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.536 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.034) 0:01:09.210 ******** 2022-01-10T01:19:04.566 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.029) 0:01:09.240 ******** 2022-01-10T01:19:04.573 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2022-01-10T01:19:04.575 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.601 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.035) 0:01:09.275 ******** 2022-01-10T01:19:04.609 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2022-01-10T01:19:04.611 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi036.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:04.637 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.036) 0:01:09.312 ******** 2022-01-10T01:19:04.660 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.023) 0:01:09.335 ******** 2022-01-10T01:19:04.667 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2022-01-10T01:19:04.669 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.669 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2022-01-10T01:19:04.669 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:04.670 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:04.696 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.035) 0:01:09.370 ******** 2022-01-10T01:19:04.719 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.022) 0:01:09.393 ******** 2022-01-10T01:19:04.725 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2022-01-10T01:19:04.727 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.754 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.035) 0:01:09.428 ******** 2022-01-10T01:19:04.782 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.027) 0:01:09.456 ******** 2022-01-10T01:19:04.790 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2022-01-10T01:19:04.791 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.817 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.035) 0:01:09.492 ******** 2022-01-10T01:19:04.840 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.022) 0:01:09.514 ******** 2022-01-10T01:19:04.847 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2022-01-10T01:19:04.848 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.873 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.033) 0:01:09.548 ******** 2022-01-10T01:19:04.880 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2022-01-10T01:19:04.882 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi139.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:04.907 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.034) 0:01:09.582 ******** 2022-01-10T01:19:04.915 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2022-01-10T01:19:04.917 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.948 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.040) 0:01:09.623 ******** 2022-01-10T01:19:04.956 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2022-01-10T01:19:04.957 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set the releasever] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:04.990 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:04 +0000 (0:00:00.041) 0:01:09.664 ******** 2022-01-10T01:19:05.014 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.023) 0:01:09.688 ******** 2022-01-10T01:19:05.021 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2022-01-10T01:19:05.022 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:05.048 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.034) 0:01:09.723 ******** 2022-01-10T01:19:05.055 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2022-01-10T01:19:05.057 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:05.084 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.036) 0:01:09.759 ******** 2022-01-10T01:19:05.108 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.023) 0:01:09.782 ******** 2022-01-10T01:19:05.115 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2022-01-10T01:19:05.116 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:05.142 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.034) 0:01:09.817 ******** 2022-01-10T01:19:05.166 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.023) 0:01:09.840 ******** 2022-01-10T01:19:05.172 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2022-01-10T01:19:05.173 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:05.174 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2022-01-10T01:19:05.174 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:05.200 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.034) 0:01:09.875 ******** 2022-01-10T01:19:05.224 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.023) 0:01:09.899 ******** 2022-01-10T01:19:05.232 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2022-01-10T01:19:05.234 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:05.258 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.033) 0:01:09.933 ******** 2022-01-10T01:19:05.266 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2022-01-10T01:19:05.267 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:05.292 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.033) 0:01:09.966 ******** 2022-01-10T01:19:05.299 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:05.332 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.039) 0:01:10.006 ******** 2022-01-10T01:19:05.339 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2022-01-10T01:19:05.341 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi139.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:05.366 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.035) 0:01:10.041 ******** 2022-01-10T01:19:05.390 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.023) 0:01:10.064 ******** 2022-01-10T01:19:05.398 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2022-01-10T01:19:05.400 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:05.426 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.036) 0:01:10.101 ******** 2022-01-10T01:19:05.448 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.022) 0:01:10.123 ******** 2022-01-10T01:19:05.455 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2022-01-10T01:19:05.457 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:05.483 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.035) 0:01:10.158 ******** 2022-01-10T01:19:05.507 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.022) 0:01:10.181 ******** 2022-01-10T01:19:05.514 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:05.540 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.033) 0:01:10.215 ******** 2022-01-10T01:19:05.547 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2022-01-10T01:19:05.548 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:05.573 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.033) 0:01:10.248 ******** 2022-01-10T01:19:05.581 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2022-01-10T01:19:05.583 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:05.609 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.035) 0:01:10.284 ******** 2022-01-10T01:19:05.618 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2022-01-10T01:19:05.620 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:05.651 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.041) 0:01:10.325 ******** 2022-01-10T01:19:05.779 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2022-01-10T01:19:05.780 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:05.804 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.153) 0:01:10.479 ******** 2022-01-10T01:19:05.822 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2022-01-10T01:19:05.824 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:05.854 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:05 +0000 (0:00:00.049) 0:01:10.528 ******** 2022-01-10T01:19:05.861 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2022-01-10T01:19:05.863 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.026 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.172) 0:01:10.700 ******** 2022-01-10T01:19:06.034 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2022-01-10T01:19:06.036 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.061 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.035) 0:01:10.736 ******** 2022-01-10T01:19:06.070 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.072 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:06.099 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.037) 0:01:10.773 ******** 2022-01-10T01:19:06.123 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.023) 0:01:10.797 ******** 2022-01-10T01:19:06.130 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2022-01-10T01:19:06.132 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.157 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.034) 0:01:10.832 ******** 2022-01-10T01:19:06.182 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.024) 0:01:10.857 ******** 2022-01-10T01:19:06.190 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2022-01-10T01:19:06.192 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.218 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.035) 0:01:10.892 ******** 2022-01-10T01:19:06.243 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.025) 0:01:10.918 ******** 2022-01-10T01:19:06.250 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2022-01-10T01:19:06.252 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.277 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.034) 0:01:10.952 ******** 2022-01-10T01:19:06.285 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2022-01-10T01:19:06.286 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.313 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.035) 0:01:10.988 ******** 2022-01-10T01:19:06.320 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2022-01-10T01:19:06.322 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.350 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.037) 0:01:11.025 ******** 2022-01-10T01:19:06.375 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.024) 0:01:11.049 ******** 2022-01-10T01:19:06.381 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2022-01-10T01:19:06.383 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:06.415 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.040) 0:01:11.090 ******** 2022-01-10T01:19:06.423 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2022-01-10T01:19:06.425 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.451 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.035) 0:01:11.126 ******** 2022-01-10T01:19:06.475 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.024) 0:01:11.150 ******** 2022-01-10T01:19:06.485 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2022-01-10T01:19:06.487 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.513 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.037) 0:01:11.188 ******** 2022-01-10T01:19:06.537 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.023) 0:01:11.211 ******** 2022-01-10T01:19:06.543 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2022-01-10T01:19:06.545 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi139.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:06.571 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.034) 0:01:11.246 ******** 2022-01-10T01:19:06.594 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.023) 0:01:11.269 ******** 2022-01-10T01:19:06.602 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2022-01-10T01:19:06.604 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.629 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.034) 0:01:11.304 ******** 2022-01-10T01:19:06.637 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2022-01-10T01:19:06.639 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.665 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.035) 0:01:11.340 ******** 2022-01-10T01:19:06.672 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2022-01-10T01:19:06.673 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.700 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.034) 0:01:11.374 ******** 2022-01-10T01:19:06.724 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.024) 0:01:11.398 ******** 2022-01-10T01:19:06.731 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2022-01-10T01:19:06.734 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.759 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.035) 0:01:11.433 ******** 2022-01-10T01:19:06.766 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2022-01-10T01:19:06.767 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:06.769 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.798 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.039) 0:01:11.473 ******** 2022-01-10T01:19:06.821 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.023) 0:01:11.496 ******** 2022-01-10T01:19:06.830 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2022-01-10T01:19:06.832 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.860 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.038) 0:01:11.535 ******** 2022-01-10T01:19:06.870 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2022-01-10T01:19:06.872 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.898 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.037) 0:01:11.572 ******** 2022-01-10T01:19:06.921 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.023) 0:01:11.595 ******** 2022-01-10T01:19:06.929 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2022-01-10T01:19:06.930 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:06.957 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.035) 0:01:11.631 ******** 2022-01-10T01:19:06.980 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:06 +0000 (0:00:00.023) 0:01:11.655 ******** 2022-01-10T01:19:06.993 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2022-01-10T01:19:06.995 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:07.021 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.039) 0:01:11.695 ******** 2022-01-10T01:19:07.028 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2022-01-10T01:19:07.030 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.056 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.035) 0:01:11.730 ******** 2022-01-10T01:19:07.064 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2022-01-10T01:19:07.066 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.094 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.038) 0:01:11.769 ******** 2022-01-10T01:19:07.118 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.023) 0:01:11.792 ******** 2022-01-10T01:19:07.125 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2022-01-10T01:19:07.128 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.155 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.037) 0:01:11.830 ******** 2022-01-10T01:19:07.163 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2022-01-10T01:19:07.165 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.198 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.042) 0:01:11.873 ******** 2022-01-10T01:19:07.236 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.037) 0:01:11.910 ******** 2022-01-10T01:19:07.247 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2022-01-10T01:19:07.249 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.276 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.039) 0:01:11.950 ******** 2022-01-10T01:19:07.304 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.028) 0:01:11.979 ******** 2022-01-10T01:19:07.312 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2022-01-10T01:19:07.314 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.346 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.041) 0:01:12.020 ******** 2022-01-10T01:19:07.378 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.032) 0:01:12.053 ******** 2022-01-10T01:19:07.386 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2022-01-10T01:19:07.388 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.416 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.037) 0:01:12.090 ******** 2022-01-10T01:19:07.440 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.023) 0:01:12.114 ******** 2022-01-10T01:19:07.448 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2022-01-10T01:19:07.449 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.476 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.036) 0:01:12.151 ******** 2022-01-10T01:19:07.487 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2022-01-10T01:19:07.489 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:07.520 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.043) 0:01:12.194 ******** 2022-01-10T01:19:07.530 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2022-01-10T01:19:07.532 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.532 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.534 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.562 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.042) 0:01:12.236 ******** 2022-01-10T01:19:07.587 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.025) 0:01:12.262 ******** 2022-01-10T01:19:07.596 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2022-01-10T01:19:07.598 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.634 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.046) 0:01:12.309 ******** 2022-01-10T01:19:07.643 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.674 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.040) 0:01:12.349 ******** 2022-01-10T01:19:07.681 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2022-01-10T01:19:07.683 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if newly-subscribed] ********************* 2022-01-10T01:19:07.684 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.710 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.035) 0:01:12.385 ******** 2022-01-10T01:19:07.734 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.023) 0:01:12.408 ******** 2022-01-10T01:19:07.741 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2022-01-10T01:19:07.744 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.768 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.034) 0:01:12.443 ******** 2022-01-10T01:19:07.775 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2022-01-10T01:19:07.778 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.802 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.034) 0:01:12.477 ******** 2022-01-10T01:19:07.810 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2022-01-10T01:19:07.812 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.837 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.034) 0:01:12.512 ******** 2022-01-10T01:19:07.845 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2022-01-10T01:19:07.847 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:07.874 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.036) 0:01:12.549 ******** 2022-01-10T01:19:07.881 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2022-01-10T01:19:07.882 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.884 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.911 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.036) 0:01:12.586 ******** 2022-01-10T01:19:07.939 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.027) 0:01:12.614 ******** 2022-01-10T01:19:07.960 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2022-01-10T01:19:07.962 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:07.986 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:07 +0000 (0:00:00.046) 0:01:12.661 ******** 2022-01-10T01:19:08.004 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2022-01-10T01:19:08.006 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.035 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.048) 0:01:12.709 ******** 2022-01-10T01:19:08.043 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2022-01-10T01:19:08.045 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.046 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012228", "end": "2022-01-10 01:19:07.973656", "rc": 0, "start": "2022-01-10 01:19:07.961428", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2022-01-10T01:19:08.076 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.041) 0:01:12.751 ******** 2022-01-10T01:19:08.100 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.023) 0:01:12.774 ******** 2022-01-10T01:19:08.108 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2022-01-10T01:19:08.110 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.135 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.035) 0:01:12.809 ******** 2022-01-10T01:19:08.143 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2022-01-10T01:19:08.145 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.170 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.035) 0:01:12.845 ******** 2022-01-10T01:19:08.178 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2022-01-10T01:19:08.180 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi139.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.207 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.037) 0:01:12.882 ******** 2022-01-10T01:19:08.230 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.022) 0:01:12.905 ******** 2022-01-10T01:19:08.237 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2022-01-10T01:19:08.239 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.265 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.034) 0:01:12.939 ******** 2022-01-10T01:19:08.272 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2022-01-10T01:19:08.274 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.299 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.034) 0:01:12.974 ******** 2022-01-10T01:19:08.307 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2022-01-10T01:19:08.308 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.334 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.034) 0:01:13.008 ******** 2022-01-10T01:19:08.362 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2022-01-10T01:19:08.363 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.363 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.390 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.056) 0:01:13.065 ******** 2022-01-10T01:19:08.398 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2022-01-10T01:19:08.399 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.015341", "end": "2022-01-10 01:19:08.016007", "rc": 0, "start": "2022-01-10 01:19:08.000666", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2022-01-10T01:19:08.425 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.034) 0:01:13.099 ******** 2022-01-10T01:19:08.464 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2022-01-10T01:19:08.465 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.475 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.501 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.076) 0:01:13.175 ******** 2022-01-10T01:19:08.507 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2022-01-10T01:19:08.509 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.543 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.042) 0:01:13.218 ******** 2022-01-10T01:19:08.562 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2022-01-10T01:19:08.565 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.023543", "end": "2022-01-10 01:19:08.170573", "rc": 0, "start": "2022-01-10 01:19:08.147030", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2022-01-10T01:19:08.590 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.047) 0:01:13.265 ******** 2022-01-10T01:19:08.599 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2022-01-10T01:19:08.601 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.633 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.042) 0:01:13.307 ******** 2022-01-10T01:19:08.640 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2022-01-10T01:19:08.642 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.668 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.035) 0:01:13.343 ******** 2022-01-10T01:19:08.675 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2022-01-10T01:19:08.677 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.702 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.033) 0:01:13.377 ******** 2022-01-10T01:19:08.782 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2022-01-10T01:19:08.784 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.807 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.105) 0:01:13.482 ******** 2022-01-10T01:19:08.836 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.016874", "end": "2022-01-10 01:19:09.000835", "rc": 0, "start": "2022-01-10 01:19:08.983961", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2022-01-10T01:19:08.862 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.054) 0:01:13.537 ******** 2022-01-10T01:19:08.890 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2022-01-10T01:19:08.892 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2022-01-10T01:19:08.914 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-initrd-fallback.service grub-common.service"}} 2022-01-10T01:19:08.936 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2022-01-10T01:19:08.937 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:08.965 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:08 +0000 (0:00:00.102) 0:01:13.640 ******** 2022-01-10T01:19:09.045 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2022-01-10T01:19:09.047 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:09.070 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.105) 0:01:13.745 ******** 2022-01-10T01:19:09.078 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2022-01-10T01:19:09.079 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-common.service grub-initrd-fallback.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-initrd-fallback.service grub-common.service"}} 2022-01-10T01:19:09.081 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2022-01-10T01:19:09.092 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2022-01-10T01:19:09.253 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2022-01-10T01:19:09.254 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2022-01-10T01:19:09.276 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2022-01-10T01:19:09.330 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "grub-initrd-fallback.service grub-common.service", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/sleep.target", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked", "Wants": "grub-common.service grub-initrd-fallback.service"}} 2022-01-10T01:19:09.427 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2022-01-10T01:19:09.429 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2022-01-10T01:19:09.472 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.401) 0:01:14.146 ******** 2022-01-10T01:19:09.481 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2022-01-10T01:19:09.515 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.042) 0:01:14.189 ******** 2022-01-10T01:19:09.525 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/suspend.target", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2022-01-10T01:19:09.537 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2022-01-10T01:19:09.539 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:09.564 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.049) 0:01:14.239 ******** 2022-01-10T01:19:09.583 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:09.612 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.046) 0:01:14.285 ******** 2022-01-10T01:19:09.618 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2022-01-10T01:19:09.620 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2022-01-10T01:19:09.649 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.038) 0:01:14.324 ******** 2022-01-10T01:19:09.659 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2022-01-10T01:19:09.661 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:09.689 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.039) 0:01:14.363 ******** 2022-01-10T01:19:09.699 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:09.730 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.040) 0:01:14.404 ******** 2022-01-10T01:19:09.737 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2022-01-10T01:19:09.738 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hibernate.target", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2022-01-10T01:19:09.739 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:09.768 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.038) 0:01:14.443 ******** 2022-01-10T01:19:09.777 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:09.813 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.044) 0:01:14.487 ******** 2022-01-10T01:19:09.824 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:09.852 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.038) 0:01:14.526 ******** 2022-01-10T01:19:09.859 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2022-01-10T01:19:09.861 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:09.892 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.040) 0:01:14.567 ******** 2022-01-10T01:19:09.900 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2022-01-10T01:19:09.902 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/etc/systemd/system/hybrid-sleep.target", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFilePreset": "enabled", "UnitFileState": "masked"}} 2022-01-10T01:19:09.905 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2022-01-10T01:19:09.907 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:09.931 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.039) 0:01:14.606 ******** 2022-01-10T01:19:09.956 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.024) 0:01:14.630 ******** 2022-01-10T01:19:09.964 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:09.966 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:09.992 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:09 +0000 (0:00:00.036) 0:01:14.667 ******** 2022-01-10T01:19:10.015 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.022) 0:01:14.690 ******** 2022-01-10T01:19:10.022 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2022-01-10T01:19:10.024 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:10.050 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.034) 0:01:14.724 ******** 2022-01-10T01:19:10.073 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.022) 0:01:14.747 ******** 2022-01-10T01:19:10.079 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2022-01-10T01:19:10.081 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:10.106 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.033) 0:01:14.781 ******** 2022-01-10T01:19:10.114 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2022-01-10T01:19:10.115 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:10.141 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.034) 0:01:14.816 ******** 2022-01-10T01:19:10.148 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2022-01-10T01:19:10.150 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:10.179 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.037) 0:01:14.853 ******** 2022-01-10T01:19:10.207 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2022-01-10T01:19:10.209 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:10.237 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.058) 0:01:14.912 ******** 2022-01-10T01:19:10.255 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2022-01-10T01:19:10.257 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:10.282 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.044) 0:01:14.957 ******** 2022-01-10T01:19:10.355 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2022-01-10T01:19:10.357 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:10.392 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.110) 0:01:15.067 ******** 2022-01-10T01:19:10.463 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:10.487 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.094) 0:01:15.162 ******** 2022-01-10T01:19:10.568 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2022-01-10T01:19:10.570 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.380615", "end": "2022-01-10 01:19:10.500380", "rc": 0, "start": "2022-01-10 01:19:10.119765", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:19:10.598 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.110) 0:01:15.272 ******** 2022-01-10T01:19:10.679 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2022-01-10T01:19:10.681 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:10.705 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.107) 0:01:15.379 ******** 2022-01-10T01:19:10.880 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2022-01-10T01:19:10.882 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.632143", "end": "2022-01-10 01:19:10.518134", "rc": 0, "start": "2022-01-10 01:19:09.885991", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.511206", "end": "2022-01-10 01:19:10.500512", "rc": 0, "start": "2022-01-10 01:19:09.989306", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:19:10.907 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.202) 0:01:15.582 ******** 2022-01-10T01:19:10.931 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.024) 0:01:15.606 ******** 2022-01-10T01:19:10.972 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2022-01-10T01:19:10.974 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:10.998 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:10 +0000 (0:00:00.067) 0:01:15.673 ******** 2022-01-10T01:19:11.016 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2022-01-10T01:19:11.018 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.112649", "end": "2022-01-10 01:19:10.947560", "rc": 0, "start": "2022-01-10 01:19:10.834911", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:11.046 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:11 +0000 (0:00:00.047) 0:01:15.720 ******** 2022-01-10T01:19:11.069 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:11 +0000 (0:00:00.023) 0:01:15.744 ******** 2022-01-10T01:19:11.318 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2022-01-10T01:19:11.321 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.123091", "end": "2022-01-10 01:19:10.951813", "rc": 0, "start": "2022-01-10 01:19:10.828722", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:19:11.344 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:11 +0000 (0:00:00.275) 0:01:16.019 ******** 2022-01-10T01:19:11.352 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2022-01-10T01:19:11.354 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.704349", "end": "2022-01-10 01:19:11.500414", "rc": 0, "start": "2022-01-10 01:19:10.796065", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:19:11.380 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:11 +0000 (0:00:00.035) 0:01:16.054 ******** 2022-01-10T01:19:11.387 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2022-01-10T01:19:11.388 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.112694", "end": "2022-01-10 01:19:10.989952", "rc": 0, "start": "2022-01-10 01:19:10.877258", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:19:11.424 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:11 +0000 (0:00:00.043) 0:01:16.098 ******** 2022-01-10T01:19:11.464 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2022-01-10T01:19:11.466 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:11.490 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:11 +0000 (0:00:00.066) 0:01:16.165 ******** 2022-01-10T01:19:11.780 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2022-01-10T01:19:11.782 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.106622", "end": "2022-01-10 01:19:11.946896", "rc": 0, "start": "2022-01-10 01:19:11.840274", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:19:11.805 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:11 +0000 (0:00:00.314) 0:01:16.479 ******** 2022-01-10T01:19:15.008 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2022-01-10T01:19:15.009 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1641777260, "cache_updated": false, "changed": false} 2022-01-10T01:19:15.037 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:15 +0000 (0:00:03.232) 0:01:19.712 ******** 2022-01-10T01:19:15.109 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:15.139 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:15 +0000 (0:00:00.101) 0:01:19.814 ******** 2022-01-10T01:19:15.379 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:15.404 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:15 +0000 (0:00:00.264) 0:01:20.079 ******** 2022-01-10T01:19:15.434 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:15.473 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:15 +0000 (0:00:00.068) 0:01:20.148 ******** 2022-01-10T01:19:15.801 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2022-01-10T01:19:15.803 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": false} 2022-01-10T01:19:15.827 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:15 +0000 (0:00:00.354) 0:01:20.502 ******** 2022-01-10T01:19:15.899 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2022-01-10T01:19:15.901 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:15.924 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:15 +0000 (0:00:00.097) 0:01:20.599 ******** 2022-01-10T01:19:15.947 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:15 +0000 (0:00:00.022) 0:01:20.622 ******** 2022-01-10T01:19:16.020 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2022-01-10T01:19:16.022 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:16.045 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:16 +0000 (0:00:00.097) 0:01:20.720 ******** 2022-01-10T01:19:16.179 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2022-01-10T01:19:16.181 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:16.205 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:16 +0000 (0:00:00.160) 0:01:20.880 ******** 2022-01-10T01:19:16.225 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:16.250 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:16 +0000 (0:00:00.045) 0:01:20.925 ******** 2022-01-10T01:19:16.279 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2022-01-10T01:19:16.281 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:16.322 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:16 +0000 (0:00:00.071) 0:01:20.996 ******** 2022-01-10T01:19:16.331 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2022-01-10T01:19:16.333 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:16.360 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:16 +0000 (0:00:00.038) 0:01:21.035 ******** 2022-01-10T01:19:16.385 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:16 +0000 (0:00:00.024) 0:01:21.059 ******** 2022-01-10T01:19:16.457 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2022-01-10T01:19:16.459 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2022-01-10T01:19:16.494 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:16 +0000 (0:00:00.109) 0:01:21.169 ******** 2022-01-10T01:19:16.714 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2022-01-10T01:19:16.744 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:16 +0000 (0:00:00.250) 0:01:21.419 ******** 2022-01-10T01:19:16.774 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2022-01-10T01:19:16.803 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:16 +0000 (0:00:00.058) 0:01:21.477 ******** 2022-01-10T01:19:17.096 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": false} 2022-01-10T01:19:17.121 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:17 +0000 (0:00:00.317) 0:01:21.795 ******** 2022-01-10T01:19:17.243 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:17.274 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:17 +0000 (0:00:00.153) 0:01:21.949 ******** 2022-01-10T01:19:17.504 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:17.528 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:17 +0000 (0:00:00.254) 0:01:22.203 ******** 2022-01-10T01:19:17.536 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2022-01-10T01:19:17.536 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2022-01-10T01:19:17.538 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:17.566 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:17 +0000 (0:00:00.037) 0:01:22.241 ******** 2022-01-10T01:19:17.692 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2022-01-10T01:19:17.694 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2022-01-10T01:19:17.863 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2022-01-10T01:19:17.927 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2022-01-10T01:19:17.992 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2022-01-10T01:19:18.025 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2022-01-10T01:19:18.162 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2022-01-10T01:19:18.189 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:18 +0000 (0:00:00.622) 0:01:22.863 ******** 2022-01-10T01:19:18.270 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2022-01-10T01:19:18.324 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2022-01-10T01:19:18.327 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2022-01-10T01:19:18.328 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2022-01-10T01:19:18.328 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:19:18.352 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:18 +0000 (0:00:00.163) 0:01:23.027 ******** 2022-01-10T01:19:18.375 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:18 +0000 (0:00:00.023) 0:01:23.050 ******** 2022-01-10T01:19:18.518 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:19:18.543 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:18 +0000 (0:00:00.167) 0:01:23.217 ******** 2022-01-10T01:19:18.560 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2022-01-10T01:19:18.562 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2022-01-10T01:19:18.590 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:18 +0000 (0:00:00.047) 0:01:23.265 ******** 2022-01-10T01:19:18.630 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2022-01-10T01:19:18.658 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:18 +0000 (0:00:00.068) 0:01:23.333 ******** 2022-01-10T01:19:18.729 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2022-01-10T01:19:18.731 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:19:18.882 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:18 +0000 (0:00:00.104) 0:01:23.438 ******** TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi036.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} Monday 10 January 2022 01:19:18 +0000 (0:00:00.057) 0:01:23.495 ******** 2022-01-10T01:19:18.924 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2022-01-10T01:19:18.926 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2022-01-10T01:19:19.033 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2022-01-10T01:19:19.144 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2022-01-10T01:19:19.218 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2022-01-10T01:19:19.219 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2022-01-10T01:19:19.348 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2022-01-10T01:19:19.413 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.592) 0:01:24.088 ******** 2022-01-10T01:19:19.432 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2022-01-10T01:19:19.445 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2022-01-10T01:19:19.469 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.055) 0:01:24.143 ******** 2022-01-10T01:19:19.496 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2022-01-10T01:19:19.498 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:19.520 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.051) 0:01:24.195 ******** 2022-01-10T01:19:19.528 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi166.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2022-01-10T01:19:19.540 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2022-01-10T01:19:19.567 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.047) 0:01:24.242 ******** 2022-01-10T01:19:19.575 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2022-01-10T01:19:19.578 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:19.588 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:19.613 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.045) 0:01:24.288 ******** 2022-01-10T01:19:19.620 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2022-01-10T01:19:19.621 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2022-01-10T01:19:19.648 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.035) 0:01:24.323 ******** 2022-01-10T01:19:19.657 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2022-01-10T01:19:19.659 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:19.684 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.035) 0:01:24.358 ******** 2022-01-10T01:19:19.691 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2022-01-10T01:19:19.692 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:19.718 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.034) 0:01:24.393 ******** 2022-01-10T01:19:19.736 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2022-01-10T01:19:19.738 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2022-01-10T01:19:19.764 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.045) 0:01:24.439 ******** 2022-01-10T01:19:19.773 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2022-01-10T01:19:19.775 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:19.785 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:19.787 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:19.810 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.046) 0:01:24.485 ******** 2022-01-10T01:19:19.817 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2022-01-10T01:19:19.819 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2022-01-10T01:19:19.843 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.032) 0:01:24.518 ******** 2022-01-10T01:19:19.850 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2022-01-10T01:19:19.852 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3612, "state": "file", "uid": 0} 2022-01-10T01:19:19.854 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:19.879 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.035) 0:01:24.553 ******** 2022-01-10T01:19:19.900 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.021) 0:01:24.575 ******** 2022-01-10T01:19:19.907 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2022-01-10T01:19:19.908 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:19.933 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.033) 0:01:24.608 ******** 2022-01-10T01:19:19.941 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2022-01-10T01:19:19.967 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:19 +0000 (0:00:00.033) 0:01:24.641 ******** 2022-01-10T01:19:19.974 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2022-01-10T01:19:19.976 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:19.987 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:19.989 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:20.012 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:20 +0000 (0:00:00.045) 0:01:24.686 ******** 2022-01-10T01:19:20.018 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2022-01-10T01:19:20.020 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:20.045 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:20 +0000 (0:00:00.033) 0:01:24.719 ******** 2022-01-10T01:19:20.051 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2022-01-10T01:19:20.053 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:20.085 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:20 +0000 (0:00:00.039) 0:01:24.759 ******** 2022-01-10T01:19:20.103 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2022-01-10T01:19:20.105 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:20.115 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:20.141 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:20 +0000 (0:00:00.056) 0:01:24.816 ******** 2022-01-10T01:19:20.168 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2022-01-10T01:19:20.170 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:20.193 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:20 +0000 (0:00:00.051) 0:01:24.867 ******** 2022-01-10T01:19:20.408 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2022-01-10T01:19:20.410 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": false} 2022-01-10T01:19:20.434 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:20 +0000 (0:00:00.241) 0:01:25.108 ******** 2022-01-10T01:19:20.592 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:20.626 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:20 +0000 (0:00:00.192) 0:01:25.301 ******** 2022-01-10T01:19:20.784 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2022-01-10T01:19:20.786 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2022-01-10T01:19:20.810 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:20 +0000 (0:00:00.183) 0:01:25.485 ******** 2022-01-10T01:19:20.819 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2022-01-10T01:19:20.821 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:20.848 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:20 +0000 (0:00:00.037) 0:01:25.522 ******** 2022-01-10T01:19:20.898 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:20.925 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:20 +0000 (0:00:00.077) 0:01:25.600 ******** 2022-01-10T01:19:20.964 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2022-01-10T01:19:20.966 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2022-01-10T01:19:20.990 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:20 +0000 (0:00:00.064) 0:01:25.665 ******** 2022-01-10T01:19:21.177 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2022-01-10T01:19:21.177 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2022-01-10T01:19:21.178 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2022-01-10T01:19:21.205 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.214) 0:01:25.879 ******** 2022-01-10T01:19:21.230 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.025) 0:01:25.905 ******** 2022-01-10T01:19:21.260 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2022-01-10T01:19:21.290 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.059) 0:01:25.965 ******** 2022-01-10T01:19:21.350 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2022-01-10T01:19:21.352 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2022-01-10T01:19:21.384 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.093) 0:01:26.058 ******** 2022-01-10T01:19:21.392 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2022-01-10T01:19:21.394 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2022-01-10T01:19:21.478 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2022-01-10T01:19:21.505 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.121) 0:01:26.180 ******** 2022-01-10T01:19:21.535 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2022-01-10T01:19:21.536 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:21.560 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.054) 0:01:26.235 ******** 2022-01-10T01:19:21.589 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2022-01-10T01:19:21.591 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:21.617 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.056) 0:01:26.291 ******** 2022-01-10T01:19:21.625 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2022-01-10T01:19:21.627 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2022-01-10T01:19:21.658 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.040) 0:01:26.332 ******** 2022-01-10T01:19:21.667 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2022-01-10T01:19:21.669 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2022-01-10T01:19:21.671 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2022-01-10T01:19:21.671 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2022-01-10T01:19:21.713 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.054) 0:01:26.387 ******** 2022-01-10T01:19:21.738 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.025) 0:01:26.413 ******** 2022-01-10T01:19:21.765 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.026) 0:01:26.439 ******** 2022-01-10T01:19:21.783 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2022-01-10T01:19:21.785 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:21.810 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.044) 0:01:26.484 ******** 2022-01-10T01:19:21.817 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2022-01-10T01:19:21.818 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2022-01-10T01:19:21.841 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi059.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:21.864 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.054) 0:01:26.539 ******** 2022-01-10T01:19:21.892 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:21.918 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.053) 0:01:26.592 ******** 2022-01-10T01:19:21.927 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2022-01-10T01:19:21.929 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} ok: [smithi139.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2022-01-10T01:19:21.958 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:21 +0000 (0:00:00.040) 0:01:26.633 ******** 2022-01-10T01:19:21.997 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2022-01-10T01:19:21.999 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.028 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.069) 0:01:26.703 ******** 2022-01-10T01:19:22.037 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2022-01-10T01:19:22.038 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2022-01-10T01:19:22.066 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.037) 0:01:26.741 ******** 2022-01-10T01:19:22.073 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2022-01-10T01:19:22.075 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:22.099 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.033) 0:01:26.774 ******** 2022-01-10T01:19:22.107 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2022-01-10T01:19:22.109 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.134 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.035) 0:01:26.809 ******** 2022-01-10T01:19:22.157 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.022) 0:01:26.832 ******** 2022-01-10T01:19:22.164 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2022-01-10T01:19:22.166 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.191 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.033) 0:01:26.866 ******** 2022-01-10T01:19:22.200 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi166.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2022-01-10T01:19:22.225 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.033) 0:01:26.900 ******** 2022-01-10T01:19:22.252 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2022-01-10T01:19:22.254 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.276 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.051) 0:01:26.951 ******** 2022-01-10T01:19:22.283 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2022-01-10T01:19:22.284 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2022-01-10T01:19:22.309 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.032) 0:01:26.983 ******** 2022-01-10T01:19:22.360 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2022-01-10T01:19:22.362 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:16:58 UTC", "ActiveEnterTimestampMonotonic": "16970169", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target remote-fs.target systemd-tmpfiles-setup.service network.target systemd-journald.socket var-run.mount time-sync.target local-fs.target basic.target sysinit.target system.slice -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:16:58 UTC", "AssertTimestampMonotonic": "16968913", "Before": "getty@tty1.service multi-user.target shutdown.target xdm.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:16:58 UTC", "Co 2022-01-10T01:19:22.363 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "16968913", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "837", "ExecMainStartTimestamp": "Mon 2022-01-10 01:16:58 UTC", "ExecMainStartTimestampMonotonic": "16970034", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2022-01-10 01:16:58 UTC] ; stop_time=[n/a] ; pid=837 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2022-01-10 01:16:58 UTC] ; stop_time=[n/a] ; pid=837 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2022-01-10T01:19:22.365 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2022-01-10 01:16:58 UTC", "InactiveExitTimestampMonotonic": "16970169", "InvocationID": "de0aa560c5be4834b424ecb91de80e57", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "837", "MemoryAccounting": "yes", "MemoryCurrent": "1384448", "MemoryD 2022-01-10T01:19:22.366 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:16:58 UTC", "StateChangeTimestampMonotonic": "16970169", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2022-01-10T01:19:22.368 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38334", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2022-01-10T01:19:22.389 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.080) 0:01:27.064 ******** 2022-01-10T01:19:22.417 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2022-01-10T01:19:22.419 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.441 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.051) 0:01:27.116 ******** 2022-01-10T01:19:22.469 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2022-01-10T01:19:22.470 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.499 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.058) 0:01:27.174 ******** 2022-01-10T01:19:22.528 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2022-01-10T01:19:22.529 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:16:57 UTC", "ActiveEnterTimestampMonotonic": "16788668", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target sysinit.target network.target local-fs.target basic.target var-run.mount nss-lookup.target system.slice -.mount systemd-tmpfiles-setup.service systemd-journald.socket remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:16:57 UTC", "AssertTimestampMonotonic": "16776631", "Before": "xdm.service shutdown.target multi-user.target plymouth-quit.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:16:57 UTC", "Co 2022-01-10T01:19:22.530 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "16776630", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "846", "ExecMainStartTimestamp": "Mon 2022-01-10 01:16:57 UTC", "ExecMainStartTimestampMonotonic": "16788529", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2022-01-10 01:16:57 UTC] ; stop_time=[n/a] ; pid=846 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2022-01-10 01:16:57 UTC] ; stop_time=[n/a] ; pid=846 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2022-01-10T01:19:22.532 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2022-01-10 01:16:57 UTC", "InactiveExitTimestampMonotonic": "16788668", "InvocationID": "1d0c7b7d417045328c6825e81b9528ac", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "846", "MemoryAccounting": "yes", "MemoryCurrent": "1323008", "MemoryD 2022-01-10T01:19:22.534 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:16:57 UTC", "StateChangeTimestampMonotonic": "16788668", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2022-01-10T01:19:22.535 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", 2022-01-10T01:19:22.536 INFO:teuthology.task.ansible.out: "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38334", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2022-01-10T01:19:22.538 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2022-01-10T01:19:22.539 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2022-01-10T01:19:22.563 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.063) 0:01:27.238 ******** 2022-01-10T01:19:22.592 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.027) 0:01:27.266 ******** 2022-01-10T01:19:22.618 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.026) 0:01:27.292 ******** 2022-01-10T01:19:22.625 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2022-01-10T01:19:22.627 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2022-01-10T01:19:22.629 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.656 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.038) 0:01:27.330 ******** 2022-01-10T01:19:22.679 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.023) 0:01:27.354 ******** 2022-01-10T01:19:22.701 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.021) 0:01:27.376 ******** 2022-01-10T01:19:22.707 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2022-01-10T01:19:22.709 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.734 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.033) 0:01:27.409 ******** 2022-01-10T01:19:22.756 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.021) 0:01:27.430 ******** 2022-01-10T01:19:22.762 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2022-01-10T01:19:22.764 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.788 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.032) 0:01:27.463 ******** 2022-01-10T01:19:22.795 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2022-01-10T01:19:22.797 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.822 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.032) 0:01:27.496 ******** 2022-01-10T01:19:22.828 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2022-01-10T01:19:22.829 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.859 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.038) 0:01:27.534 ******** 2022-01-10T01:19:22.867 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2022-01-10T01:19:22.869 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:17:06 UTC", "ActiveEnterTimestampMonotonic": "15224706", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "time-sync.target var-run.mount local-fs.target systemd-tmpfiles-setup.service sysinit.target system.slice -.mount network.target basic.target nss-lookup.target systemd-journald.socket remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:17:06 UTC", "AssertTimestampMonotonic": "15212366", "Before": "multi-user.target getty@tty1.service xdm.service plymouth-quit.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:17:06 UTC", "Co 2022-01-10T01:19:22.870 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15212366", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "858", "ExecMainStartTimestamp": "Mon 2022-01-10 01:17:06 UTC", "ExecMainStartTimestampMonotonic": "15224521", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2022-01-10 01:17:06 UTC] ; stop_time=[n/a] ; pid=858 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2022-01-10 01:17:06 UTC] ; stop_time=[n/a] ; pid=858 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2022-01-10T01:19:22.872 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2022-01-10 01:17:06 UTC", "InactiveExitTimestampMonotonic": "15224706", "InvocationID": "58b2317eb25045fbbb60d818fdf95760", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127757", "LimitNPROCSoft": "127757", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127757", "LimitSIGPENDINGSoft": "127757", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "858", "MemoryAccounting": "yes", "MemoryCurrent": "1314816", "MemoryD 2022-01-10T01:19:22.874 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:17:06 UTC", "StateChangeTimestampMonotonic": "15224706", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2022-01-10T01:19:22.875 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38327", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.897 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.037) 0:01:27.571 ******** 2022-01-10T01:19:22.920 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.023) 0:01:27.595 ******** 2022-01-10T01:19:22.927 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2022-01-10T01:19:22.929 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.929 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2022-01-10T01:19:22.931 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:17:02 UTC", "ActiveEnterTimestampMonotonic": "15078329", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount remote-fs.target nss-lookup.target var-run.mount basic.target system.slice systemd-tmpfiles-setup.service local-fs.target systemd-journald.socket network.target sysinit.target time-sync.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:17:02 UTC", "AssertTimestampMonotonic": "15076551", "Before": "multi-user.target xdm.service plymouth-quit.service shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:17:02 UTC", "Co 2022-01-10T01:19:22.932 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15076550", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "881", "ExecMainStartTimestamp": "Mon 2022-01-10 01:17:02 UTC", "ExecMainStartTimestampMonotonic": "15078179", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2022-01-10 01:17:02 UTC] ; stop_time=[n/a] ; pid=881 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2022-01-10 01:17:02 UTC] ; stop_time=[n/a] ; pid=881 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2022-01-10T01:19:22.934 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2022-01-10 01:17:02 UTC", "InactiveExitTimestampMonotonic": "15078329", "InvocationID": "de6f600d4b8e4d0882d842313a0377a2", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127757", "LimitNPROCSoft": "127757", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127757", "LimitSIGPENDINGSoft": "127757", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "881", "MemoryAccounting": "yes", "MemoryCurrent": "1265664", "MemoryD 2022-01-10T01:19:22.936 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:17:02 UTC", "StateChangeTimestampMonotonic": "15078329", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2022-01-10T01:19:22.937 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", 2022-01-10T01:19:22.938 INFO:teuthology.task.ansible.out: "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38327", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2022-01-10T01:19:22.940 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.941 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:22.964 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.043) 0:01:27.639 ******** 2022-01-10T01:19:22.986 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:22 +0000 (0:00:00.022) 0:01:27.661 ******** 2022-01-10T01:19:23.008 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.021) 0:01:27.683 ******** 2022-01-10T01:19:23.031 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.022) 0:01:27.705 ******** 2022-01-10T01:19:23.037 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2022-01-10T01:19:23.038 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:23.038 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:23.064 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.033) 0:01:27.738 ******** 2022-01-10T01:19:23.086 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.021) 0:01:27.761 ******** 2022-01-10T01:19:23.109 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.022) 0:01:27.783 ******** 2022-01-10T01:19:23.121 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2022-01-10T01:19:23.123 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:23.153 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.043) 0:01:27.827 ******** 2022-01-10T01:19:23.175 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.021) 0:01:27.849 ******** 2022-01-10T01:19:23.200 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.024) 0:01:27.874 ******** 2022-01-10T01:19:23.209 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2022-01-10T01:19:23.211 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include package type specific vars.] ************************** ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2022-01-10T01:19:23.236 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.036) 0:01:27.910 ******** 2022-01-10T01:19:23.258 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.022) 0:01:27.933 ******** 2022-01-10T01:19:23.267 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:23.269 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:23.292 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.033) 0:01:27.967 ******** 2022-01-10T01:19:23.315 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.022) 0:01:27.990 ******** 2022-01-10T01:19:23.322 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2022-01-10T01:19:23.323 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2022-01-10T01:19:23.326 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2022-01-10T01:19:23.327 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:23.352 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.036) 0:01:28.027 ******** 2022-01-10T01:19:23.375 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.023) 0:01:28.050 ******** 2022-01-10T01:19:23.398 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.023) 0:01:28.073 ******** 2022-01-10T01:19:23.404 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2022-01-10T01:19:23.406 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including major version specific variables.] ****************** ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2022-01-10T01:19:23.408 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:23.434 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.035) 0:01:28.108 ******** 2022-01-10T01:19:23.456 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.022) 0:01:28.131 ******** 2022-01-10T01:19:23.488 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.031) 0:01:28.162 ******** 2022-01-10T01:19:23.495 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2022-01-10T01:19:23.496 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including version specific variables.] ************************ ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2022-01-10T01:19:23.498 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2022-01-10T01:19:23.641 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.152) 0:01:28.315 ******** 2022-01-10T01:19:23.663 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.022) 0:01:28.338 ******** 2022-01-10T01:19:23.687 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.023) 0:01:28.362 ******** 2022-01-10T01:19:23.696 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2022-01-10T01:19:23.698 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:23.722 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.035) 0:01:28.397 ******** 2022-01-10T01:19:23.730 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2022-01-10T01:19:23.732 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2022-01-10T01:19:23.733 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:23.758 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.035) 0:01:28.433 ******** 2022-01-10T01:19:23.781 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.023) 0:01:28.456 ******** 2022-01-10T01:19:23.788 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2022-01-10T01:19:23.790 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2022-01-10T01:19:23.815 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.034) 0:01:28.490 ******** 2022-01-10T01:19:23.837 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.021) 0:01:28.511 ******** 2022-01-10T01:19:23.844 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2022-01-10T01:19:23.846 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2022-01-10T01:19:23.846 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:23.872 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.035) 0:01:28.547 ******** 2022-01-10T01:19:23.894 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.021) 0:01:28.568 ******** 2022-01-10T01:19:23.901 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2022-01-10T01:19:23.903 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:23.927 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.033) 0:01:28.602 ******** 2022-01-10T01:19:23.934 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2022-01-10T01:19:23.935 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:23.960 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.032) 0:01:28.635 ******** 2022-01-10T01:19:23.991 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:23 +0000 (0:00:00.030) 0:01:28.666 ******** 2022-01-10T01:19:23.999 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2022-01-10T01:19:24.001 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2022-01-10T01:19:24.026 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.034) 0:01:28.700 ******** 2022-01-10T01:19:24.049 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.023) 0:01:28.723 ******** 2022-01-10T01:19:24.056 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2022-01-10T01:19:24.058 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:24.093 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.043) 0:01:28.767 ******** 2022-01-10T01:19:24.117 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.024) 0:01:28.792 ******** 2022-01-10T01:19:24.124 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2022-01-10T01:19:24.126 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:24.161 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.043) 0:01:28.835 ******** 2022-01-10T01:19:24.184 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.022) 0:01:28.858 ******** 2022-01-10T01:19:24.208 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.024) 0:01:28.883 ******** 2022-01-10T01:19:24.216 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2022-01-10T01:19:24.218 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:24.243 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.035) 0:01:28.918 ******** 2022-01-10T01:19:24.250 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2022-01-10T01:19:24.252 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:24.277 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.033) 0:01:28.952 ******** 2022-01-10T01:19:24.284 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2022-01-10T01:19:24.286 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2022-01-10T01:19:24.311 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.033) 0:01:28.986 ******** 2022-01-10T01:19:24.318 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2022-01-10T01:19:24.321 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:24.345 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.033) 0:01:29.019 ******** 2022-01-10T01:19:24.351 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2022-01-10T01:19:24.353 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2022-01-10T01:19:24.353 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2022-01-10T01:19:24.354 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2022-01-10T01:19:24.355 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2022-01-10T01:19:24.384 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.038) 0:01:29.058 ******** 2022-01-10T01:19:24.408 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.024) 0:01:29.083 ******** 2022-01-10T01:19:24.419 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2022-01-10T01:19:24.421 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2022-01-10T01:19:24.447 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.038) 0:01:29.121 ******** 2022-01-10T01:19:24.471 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.023) 0:01:29.145 ******** 2022-01-10T01:19:24.478 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2022-01-10T01:19:24.479 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:24.505 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.034) 0:01:29.180 ******** 2022-01-10T01:19:24.513 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2022-01-10T01:19:24.514 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2022-01-10T01:19:24.539 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.034) 0:01:29.214 ******** 2022-01-10T01:19:24.547 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2022-01-10T01:19:24.548 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common", "libgnutls30"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2022-01-10T01:19:24.550 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2022-01-10T01:19:24.551 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:24.576 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.036) 0:01:29.251 ******** 2022-01-10T01:19:24.600 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.023) 0:01:29.274 ******** 2022-01-10T01:19:24.607 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2022-01-10T01:19:24.608 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2022-01-10T01:19:24.635 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.035) 0:01:29.310 ******** 2022-01-10T01:19:24.642 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2022-01-10T01:19:24.644 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-venv", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2022-01-10T01:19:24.672 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.036) 0:01:29.347 ******** 2022-01-10T01:19:24.712 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2022-01-10T01:19:24.714 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2022-01-10T01:19:24.737 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.065) 0:01:29.412 ******** 2022-01-10T01:19:24.755 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2022-01-10T01:19:24.757 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2022-01-10T01:19:24.784 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.046) 0:01:29.458 ******** 2022-01-10T01:19:24.791 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2022-01-10T01:19:24.793 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2022-01-10T01:19:24.826 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.042) 0:01:29.501 ******** 2022-01-10T01:19:24.834 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2022-01-10T01:19:24.837 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2022-01-10T01:19:24.864 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.037) 0:01:29.538 ******** 2022-01-10T01:19:24.883 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2022-01-10T01:19:24.885 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2022-01-10T01:19:24.910 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.045) 0:01:29.584 ******** 2022-01-10T01:19:24.919 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2022-01-10T01:19:24.921 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi036"}, "changed": false} 2022-01-10T01:19:24.947 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.036) 0:01:29.620 ******** 2022-01-10T01:19:24.964 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2022-01-10T01:19:24.992 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:24 +0000 (0:00:00.045) 0:01:29.666 ******** 2022-01-10T01:19:25.020 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2022-01-10T01:19:25.022 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:25.047 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.054) 0:01:29.721 ******** 2022-01-10T01:19:25.064 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2022-01-10T01:19:25.066 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2022-01-10T01:19:25.091 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.043) 0:01:29.765 ******** 2022-01-10T01:19:25.098 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2022-01-10T01:19:25.100 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:25.125 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.034) 0:01:29.800 ******** 2022-01-10T01:19:25.134 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2022-01-10T01:19:25.136 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:25.163 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.038) 0:01:29.838 ******** 2022-01-10T01:19:25.192 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:25.217 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.053) 0:01:29.892 ******** 2022-01-10T01:19:25.226 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2022-01-10T01:19:25.228 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2022-01-10T01:19:25.255 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.037) 0:01:29.929 ******** 2022-01-10T01:19:25.296 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2022-01-10T01:19:25.298 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi059"}, "changed": false} TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi139.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2022-01-10T01:19:25.322 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.067) 0:01:29.997 ******** 2022-01-10T01:19:25.354 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.031) 0:01:30.028 ******** 2022-01-10T01:19:25.395 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2022-01-10T01:19:25.421 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.067) 0:01:30.096 ******** 2022-01-10T01:19:25.693 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2022-01-10T01:19:25.695 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi036.front.sepia.ceph.com", "ansible_hostname": "smithi036", "ansible_nodename": "smithi036"}, "changed": true, "name": "smithi036"} 2022-01-10T01:19:25.719 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.298) 0:01:30.394 ******** 2022-01-10T01:19:25.739 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi059.front.sepia.ceph.com", "ansible_hostname": "smithi059", "ansible_nodename": "smithi059"}, "changed": true, "name": "smithi059"} 2022-01-10T01:19:25.766 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.046) 0:01:30.441 ******** 2022-01-10T01:19:25.774 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2022-01-10T01:19:25.776 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2022-01-10T01:19:25.804 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.037) 0:01:30.479 ******** 2022-01-10T01:19:25.842 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2022-01-10T01:19:25.844 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi139"}, "changed": false} 2022-01-10T01:19:25.867 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.063) 0:01:30.542 ******** 2022-01-10T01:19:25.891 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.022) 0:01:30.565 ******** 2022-01-10T01:19:25.929 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi166"}, "changed": false} 2022-01-10T01:19:25.954 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:25 +0000 (0:00:00.063) 0:01:30.629 ******** 2022-01-10T01:19:26.056 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2022-01-10T01:19:26.058 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2022-01-10T01:19:26.084 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:26 +0000 (0:00:00.128) 0:01:30.758 ******** 2022-01-10T01:19:26.112 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2022-01-10T01:19:26.139 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:26 +0000 (0:00:00.055) 0:01:30.814 ******** 2022-01-10T01:19:26.262 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2022-01-10T01:19:26.264 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi139.front.sepia.ceph.com", "ansible_hostname": "smithi139", "ansible_nodename": "smithi139"}, "changed": true, "name": "smithi139"} 2022-01-10T01:19:26.288 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:26 +0000 (0:00:00.148) 0:01:30.963 ******** 2022-01-10T01:19:26.368 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi166.front.sepia.ceph.com", "ansible_hostname": "smithi166", "ansible_nodename": "smithi166"}, "changed": true, "name": "smithi166"} 2022-01-10T01:19:26.401 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:26 +0000 (0:00:00.112) 0:01:31.075 ******** 2022-01-10T01:19:26.440 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2022-01-10T01:19:26.442 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2022-01-10T01:19:26.467 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:26 +0000 (0:00:00.065) 0:01:31.141 ******** 2022-01-10T01:19:26.485 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2022-01-10T01:19:26.511 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:26 +0000 (0:00:00.044) 0:01:31.186 ******** 2022-01-10T01:19:26.645 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2022-01-10T01:19:26.647 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2022-01-10T01:19:26.670 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:26 +0000 (0:00:00.159) 0:01:31.345 ******** 2022-01-10T01:19:26.731 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2022-01-10T01:19:26.757 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:26 +0000 (0:00:00.086) 0:01:31.431 ******** 2022-01-10T01:19:26.952 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2022-01-10T01:19:26.954 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2022-01-10T01:19:26.979 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:26 +0000 (0:00:00.222) 0:01:31.654 ******** 2022-01-10T01:19:26.987 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2022-01-10T01:19:27.014 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.034) 0:01:31.689 ******** 2022-01-10T01:19:27.021 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2022-01-10T01:19:27.023 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2022-01-10T01:19:27.048 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.033) 0:01:31.722 ******** 2022-01-10T01:19:27.071 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.023) 0:01:31.746 ******** 2022-01-10T01:19:27.077 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2022-01-10T01:19:27.079 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.105 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.033) 0:01:31.779 ******** 2022-01-10T01:19:27.129 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.023) 0:01:31.803 ******** 2022-01-10T01:19:27.136 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2022-01-10T01:19:27.138 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.163 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.034) 0:01:31.838 ******** 2022-01-10T01:19:27.192 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.029) 0:01:31.867 ******** 2022-01-10T01:19:27.200 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2022-01-10T01:19:27.202 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.231 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.038) 0:01:31.906 ******** 2022-01-10T01:19:27.258 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.024) 0:01:31.930 ******** 2022-01-10T01:19:27.263 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2022-01-10T01:19:27.265 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.289 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.033) 0:01:31.964 ******** 2022-01-10T01:19:27.296 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2022-01-10T01:19:27.298 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.323 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.033) 0:01:31.997 ******** 2022-01-10T01:19:27.331 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2022-01-10T01:19:27.332 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.356 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.033) 0:01:32.031 ******** 2022-01-10T01:19:27.362 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2022-01-10T01:19:27.365 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.387 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.031) 0:01:32.062 ******** 2022-01-10T01:19:27.393 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2022-01-10T01:19:27.395 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.419 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.031) 0:01:32.093 ******** 2022-01-10T01:19:27.425 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2022-01-10T01:19:27.427 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.451 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.032) 0:01:32.126 ******** 2022-01-10T01:19:27.458 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2022-01-10T01:19:27.459 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.484 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.032) 0:01:32.159 ******** 2022-01-10T01:19:27.491 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2022-01-10T01:19:27.493 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.517 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.033) 0:01:32.192 ******** 2022-01-10T01:19:27.525 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:19:27.527 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.550 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.033) 0:01:32.225 ******** 2022-01-10T01:19:27.559 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2022-01-10T01:19:27.560 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.592 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.041) 0:01:32.267 ******** 2022-01-10T01:19:27.616 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.023) 0:01:32.291 ******** 2022-01-10T01:19:27.623 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2022-01-10T01:19:27.625 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.650 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.034) 0:01:32.325 ******** 2022-01-10T01:19:27.675 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.024) 0:01:32.349 ******** 2022-01-10T01:19:27.682 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2022-01-10T01:19:27.683 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.685 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi166.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2022-01-10T01:19:27.685 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.712 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.037) 0:01:32.387 ******** 2022-01-10T01:19:27.735 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.023) 0:01:32.410 ******** 2022-01-10T01:19:27.757 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.021) 0:01:32.432 ******** 2022-01-10T01:19:27.763 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:19:27.765 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.790 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.032) 0:01:32.465 ******** 2022-01-10T01:19:27.812 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.021) 0:01:32.487 ******** 2022-01-10T01:19:27.835 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.022) 0:01:32.509 ******** 2022-01-10T01:19:27.842 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2022-01-10T01:19:27.844 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2022-01-10T01:19:27.845 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* skipping: [smithi059.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.869 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.034) 0:01:32.544 ******** 2022-01-10T01:19:27.890 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.021) 0:01:32.565 ******** 2022-01-10T01:19:27.920 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.029) 0:01:32.594 ******** 2022-01-10T01:19:27.926 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2022-01-10T01:19:27.928 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable copr repos] ******************************************** TASK [testnode : Configure local mirrorlists] ********************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:27.953 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.032) 0:01:32.627 ******** 2022-01-10T01:19:27.975 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.022) 0:01:32.649 ******** 2022-01-10T01:19:27.998 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:27 +0000 (0:00:00.023) 0:01:32.672 ******** 2022-01-10T01:19:28.004 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2022-01-10T01:19:28.006 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2022-01-10T01:19:28.030 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.032) 0:01:32.705 ******** 2022-01-10T01:19:28.053 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.023) 0:01:32.728 ******** 2022-01-10T01:19:28.077 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.023) 0:01:32.752 ******** 2022-01-10T01:19:28.083 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2022-01-10T01:19:28.085 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.085 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.087 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2022-01-10T01:19:28.113 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.035) 0:01:32.787 ******** 2022-01-10T01:19:28.135 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.022) 0:01:32.810 ******** 2022-01-10T01:19:28.157 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.022) 0:01:32.832 ******** 2022-01-10T01:19:28.164 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2022-01-10T01:19:28.166 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable copr repos] ******************************************** 2022-01-10T01:19:28.191 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.033) 0:01:32.865 ******** 2022-01-10T01:19:28.212 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.021) 0:01:32.887 ******** 2022-01-10T01:19:28.241 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.028) 0:01:32.915 ******** 2022-01-10T01:19:28.248 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2022-01-10T01:19:28.250 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.276 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.035) 0:01:32.951 ******** 2022-01-10T01:19:28.305 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.029) 0:01:32.980 ******** 2022-01-10T01:19:28.331 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.025) 0:01:33.005 ******** 2022-01-10T01:19:28.341 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2022-01-10T01:19:28.343 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* 2022-01-10T01:19:28.343 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.345 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi059.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.345 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.346 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.378 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.047) 0:01:33.052 ******** 2022-01-10T01:19:28.401 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.022) 0:01:33.075 ******** 2022-01-10T01:19:28.426 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.025) 0:01:33.101 ******** 2022-01-10T01:19:28.432 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2022-01-10T01:19:28.434 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.460 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.033) 0:01:33.135 ******** 2022-01-10T01:19:28.483 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.022) 0:01:33.157 ******** 2022-01-10T01:19:28.503 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.020) 0:01:33.178 ******** 2022-01-10T01:19:28.509 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2022-01-10T01:19:28.511 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.535 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.032) 0:01:33.210 ******** 2022-01-10T01:19:28.556 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.020) 0:01:33.231 ******** 2022-01-10T01:19:28.582 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.026) 0:01:33.257 ******** 2022-01-10T01:19:28.589 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2022-01-10T01:19:28.591 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.615 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.033) 0:01:33.290 ******** 2022-01-10T01:19:28.637 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.021) 0:01:33.312 ******** 2022-01-10T01:19:28.659 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.021) 0:01:33.333 ******** 2022-01-10T01:19:28.665 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2022-01-10T01:19:28.666 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.667 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.692 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.033) 0:01:33.366 ******** 2022-01-10T01:19:28.713 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.021) 0:01:33.388 ******** 2022-01-10T01:19:28.737 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.023) 0:01:33.411 ******** 2022-01-10T01:19:28.743 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2022-01-10T01:19:28.745 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.770 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.033) 0:01:33.444 ******** 2022-01-10T01:19:28.792 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.021) 0:01:33.466 ******** 2022-01-10T01:19:28.798 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2022-01-10T01:19:28.800 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.825 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.033) 0:01:33.500 ******** 2022-01-10T01:19:28.847 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.022) 0:01:33.522 ******** 2022-01-10T01:19:28.868 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.021) 0:01:33.543 ******** 2022-01-10T01:19:28.875 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:19:28.877 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.905 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.037) 0:01:33.580 ******** 2022-01-10T01:19:28.928 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.022) 0:01:33.603 ******** 2022-01-10T01:19:28.951 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.022) 0:01:33.626 ******** 2022-01-10T01:19:28.959 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2022-01-10T01:19:28.960 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.960 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.960 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:28.986 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:28 +0000 (0:00:00.035) 0:01:33.661 ******** 2022-01-10T01:19:29.008 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.021) 0:01:33.683 ******** 2022-01-10T01:19:29.031 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.022) 0:01:33.705 ******** 2022-01-10T01:19:29.037 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2022-01-10T01:19:29.039 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* 2022-01-10T01:19:29.039 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.040 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.064 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.033) 0:01:33.739 ******** 2022-01-10T01:19:29.085 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.021) 0:01:33.760 ******** 2022-01-10T01:19:29.106 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.020) 0:01:33.781 ******** 2022-01-10T01:19:29.112 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:19:29.114 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.139 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.032) 0:01:33.813 ******** 2022-01-10T01:19:29.161 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.021) 0:01:33.835 ******** 2022-01-10T01:19:29.187 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.026) 0:01:33.862 ******** 2022-01-10T01:19:29.194 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2022-01-10T01:19:29.196 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.227 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.040) 0:01:33.902 ******** 2022-01-10T01:19:29.254 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.026) 0:01:33.929 ******** 2022-01-10T01:19:29.280 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.025) 0:01:33.954 ******** 2022-01-10T01:19:29.287 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2022-01-10T01:19:29.289 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** 2022-01-10T01:19:29.289 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.291 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.315 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.035) 0:01:33.990 ******** 2022-01-10T01:19:29.339 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.023) 0:01:34.013 ******** 2022-01-10T01:19:29.365 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.026) 0:01:34.040 ******** 2022-01-10T01:19:29.372 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2022-01-10T01:19:29.373 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2022-01-10T01:19:29.374 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.374 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2022-01-10T01:19:29.375 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.401 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.035) 0:01:34.075 ******** 2022-01-10T01:19:29.423 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.022) 0:01:34.098 ******** 2022-01-10T01:19:29.446 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.022) 0:01:34.121 ******** 2022-01-10T01:19:29.453 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2022-01-10T01:19:29.455 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.480 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.034) 0:01:34.155 ******** 2022-01-10T01:19:29.504 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.023) 0:01:34.178 ******** 2022-01-10T01:19:29.525 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.021) 0:01:34.200 ******** 2022-01-10T01:19:29.532 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2022-01-10T01:19:29.533 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2022-01-10T01:19:29.533 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.534 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.562 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.037) 0:01:34.237 ******** 2022-01-10T01:19:29.585 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.022) 0:01:34.259 ******** 2022-01-10T01:19:29.608 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.023) 0:01:34.282 ******** 2022-01-10T01:19:29.616 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2022-01-10T01:19:29.617 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2022-01-10T01:19:29.618 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.618 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.643 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.035) 0:01:34.318 ******** 2022-01-10T01:19:29.666 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.023) 0:01:34.341 ******** 2022-01-10T01:19:29.689 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.022) 0:01:34.364 ******** 2022-01-10T01:19:29.696 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2022-01-10T01:19:29.698 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.723 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.034) 0:01:34.398 ******** 2022-01-10T01:19:29.747 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.023) 0:01:34.422 ******** 2022-01-10T01:19:29.771 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.023) 0:01:34.445 ******** 2022-01-10T01:19:29.780 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** TASK [testnode : Enable abrt-auto-reporting] *********************************** 2022-01-10T01:19:29.782 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.805 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.034) 0:01:34.480 ******** 2022-01-10T01:19:29.829 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.023) 0:01:34.503 ******** 2022-01-10T01:19:29.836 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2022-01-10T01:19:29.837 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.862 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.033) 0:01:34.537 ******** 2022-01-10T01:19:29.891 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.028) 0:01:34.566 ******** 2022-01-10T01:19:29.899 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2022-01-10T01:19:29.900 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2022-01-10T01:19:29.900 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005416", "end": "2022-01-10 01:19:29.806702", "rc": 0, "start": "2022-01-10 01:19:29.801286", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:19:29.902 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.929 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.037) 0:01:34.603 ******** 2022-01-10T01:19:29.953 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.023) 0:01:34.627 ******** 2022-01-10T01:19:29.977 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:29 +0000 (0:00:00.023) 0:01:34.651 ******** 2022-01-10T01:19:29.984 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2022-01-10T01:19:29.985 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:29.987 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2022-01-10T01:19:30.012 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.035) 0:01:34.687 ******** 2022-01-10T01:19:30.036 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.024) 0:01:34.711 ******** 2022-01-10T01:19:30.045 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2022-01-10T01:19:30.047 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.074 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.037) 0:01:34.748 ******** 2022-01-10T01:19:30.098 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.024) 0:01:34.773 ******** 2022-01-10T01:19:30.106 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2022-01-10T01:19:30.108 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.134 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.036) 0:01:34.809 ******** 2022-01-10T01:19:30.143 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2022-01-10T01:19:30.145 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.156 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": false, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS", "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.189 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.054) 0:01:34.863 ******** 2022-01-10T01:19:30.197 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:19:30.198 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.225 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.036) 0:01:34.900 ******** 2022-01-10T01:19:30.233 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2022-01-10T01:19:30.235 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005352", "end": "2022-01-10 01:19:29.862028", "rc": 0, "start": "2022-01-10 01:19:29.856676", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.261 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.036) 0:01:34.936 ******** 2022-01-10T01:19:30.292 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.030) 0:01:34.966 ******** 2022-01-10T01:19:30.299 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2022-01-10T01:19:30.301 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** 2022-01-10T01:19:30.326 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.034) 0:01:35.001 ******** 2022-01-10T01:19:30.352 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.025) 0:01:35.026 ******** 2022-01-10T01:19:30.359 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:19:30.361 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set apt preferences] ****************************************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2022-01-10T01:19:30.388 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.036) 0:01:35.063 ******** 2022-01-10T01:19:30.413 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.023) 0:01:35.087 ******** 2022-01-10T01:19:30.422 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2022-01-10T01:19:30.424 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add sources list] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.449 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.037) 0:01:35.124 ******** 2022-01-10T01:19:30.473 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.023) 0:01:35.148 ******** 2022-01-10T01:19:30.482 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2022-01-10T01:19:30.483 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.509 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.036) 0:01:35.184 ******** 2022-01-10T01:19:30.517 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2022-01-10T01:19:30.518 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.544 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.034) 0:01:35.218 ******** 2022-01-10T01:19:30.551 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2022-01-10T01:19:30.553 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.577 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.033) 0:01:35.252 ******** 2022-01-10T01:19:30.585 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2022-01-10T01:19:30.587 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.612 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.034) 0:01:35.286 ******** 2022-01-10T01:19:30.620 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2022-01-10T01:19:30.622 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.646 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.034) 0:01:35.321 ******** 2022-01-10T01:19:30.654 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2022-01-10T01:19:30.656 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.685 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.038) 0:01:35.360 ******** 2022-01-10T01:19:30.694 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2022-01-10T01:19:30.694 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2022-01-10T01:19:30.696 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.721 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.035) 0:01:35.396 ******** 2022-01-10T01:19:30.746 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.024) 0:01:35.420 ******** 2022-01-10T01:19:30.757 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2022-01-10T01:19:30.759 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add sources list] ********************************************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.785 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.039) 0:01:35.459 ******** 2022-01-10T01:19:30.809 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.023) 0:01:35.483 ******** 2022-01-10T01:19:30.817 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2022-01-10T01:19:30.819 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.845 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.036) 0:01:35.520 ******** 2022-01-10T01:19:30.851 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2022-01-10T01:19:30.853 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.878 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.032) 0:01:35.553 ******** 2022-01-10T01:19:30.888 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2022-01-10T01:19:30.890 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.914 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.036) 0:01:35.589 ******** 2022-01-10T01:19:30.922 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2022-01-10T01:19:30.924 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.949 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.033) 0:01:35.623 ******** 2022-01-10T01:19:30.956 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2022-01-10T01:19:30.958 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:30.982 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:30 +0000 (0:00:00.033) 0:01:35.657 ******** 2022-01-10T01:19:30.988 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2022-01-10T01:19:30.990 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.014 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.032) 0:01:35.689 ******** 2022-01-10T01:19:31.022 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2022-01-10T01:19:31.024 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.048 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.033) 0:01:35.722 ******** 2022-01-10T01:19:31.055 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2022-01-10T01:19:31.056 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.085 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.037) 0:01:35.760 ******** 2022-01-10T01:19:31.093 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2022-01-10T01:19:31.095 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.119 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.033) 0:01:35.793 ******** 2022-01-10T01:19:31.126 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2022-01-10T01:19:31.127 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.153 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.034) 0:01:35.828 ******** 2022-01-10T01:19:31.160 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2022-01-10T01:19:31.162 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.187 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.034) 0:01:35.862 ******** 2022-01-10T01:19:31.204 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2022-01-10T01:19:31.206 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.229 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.042) 0:01:35.904 ******** 2022-01-10T01:19:31.238 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2022-01-10T01:19:31.240 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.266 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.036) 0:01:35.940 ******** 2022-01-10T01:19:31.273 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2022-01-10T01:19:31.274 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.303 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.037) 0:01:35.978 ******** 2022-01-10T01:19:31.310 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2022-01-10T01:19:31.311 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.337 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.033) 0:01:36.012 ******** 2022-01-10T01:19:31.345 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2022-01-10T01:19:31.346 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.380 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.043) 0:01:36.055 ******** 2022-01-10T01:19:31.388 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2022-01-10T01:19:31.390 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.427 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.046) 0:01:36.101 ******** 2022-01-10T01:19:31.435 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2022-01-10T01:19:31.437 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.461 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.034) 0:01:36.136 ******** 2022-01-10T01:19:31.469 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2022-01-10T01:19:31.471 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.494 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.032) 0:01:36.169 ******** 2022-01-10T01:19:31.501 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2022-01-10T01:19:31.503 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.531 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.036) 0:01:36.205 ******** 2022-01-10T01:19:31.538 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2022-01-10T01:19:31.540 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.564 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.033) 0:01:36.238 ******** 2022-01-10T01:19:31.570 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.596 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.032) 0:01:36.271 ******** 2022-01-10T01:19:31.603 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2022-01-10T01:19:31.605 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.629 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.033) 0:01:36.304 ******** 2022-01-10T01:19:31.636 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2022-01-10T01:19:31.638 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.662 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.032) 0:01:36.337 ******** 2022-01-10T01:19:31.669 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2022-01-10T01:19:31.672 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.697 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.034) 0:01:36.371 ******** 2022-01-10T01:19:31.726 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2022-01-10T01:19:31.729 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:31.749 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.052) 0:01:36.424 ******** 2022-01-10T01:19:31.800 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2022-01-10T01:19:31.802 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2022-01-10T01:19:31.813 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2022-01-10T01:19:31.815 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005429", "end": "2022-01-10 01:19:31.428690", "rc": 0, "start": "2022-01-10 01:19:31.423261", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:19:31.841 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.091) 0:01:36.515 ******** 2022-01-10T01:19:31.869 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2022-01-10T01:19:31.894 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.053) 0:01:36.569 ******** 2022-01-10T01:19:31.901 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2022-01-10T01:19:31.903 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2022-01-10T01:19:31.913 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2022-01-10T01:19:31.915 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005416", "end": "2022-01-10 01:19:32.072216", "rc": 0, "start": "2022-01-10 01:19:32.066800", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:19:31.940 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.045) 0:01:36.614 ******** 2022-01-10T01:19:31.972 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2022-01-10T01:19:31.998 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:31 +0000 (0:00:00.058) 0:01:36.672 ******** 2022-01-10T01:19:32.226 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2022-01-10T01:19:32.228 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2022-01-10T01:19:32.262 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:32 +0000 (0:00:00.264) 0:01:36.937 ******** 2022-01-10T01:19:32.291 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2022-01-10T01:19:32.293 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:32.315 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:32 +0000 (0:00:00.052) 0:01:36.990 ******** 2022-01-10T01:19:32.354 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2022-01-10T01:19:32.356 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2022-01-10T01:19:32.382 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:32 +0000 (0:00:00.066) 0:01:37.056 ******** 2022-01-10T01:19:32.410 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2022-01-10T01:19:32.412 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:32.435 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:32 +0000 (0:00:00.053) 0:01:37.110 ******** 2022-01-10T01:19:32.810 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2022-01-10T01:19:32.812 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2022-01-10T01:19:32.837 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:32 +0000 (0:00:00.402) 0:01:37.512 ******** 2022-01-10T01:19:32.910 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2022-01-10T01:19:32.937 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:32 +0000 (0:00:00.099) 0:01:37.612 ******** 2022-01-10T01:19:33.388 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2022-01-10T01:19:33.514 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2022-01-10T01:19:33.556 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": false} 2022-01-10T01:19:33.584 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:33 +0000 (0:00:00.646) 0:01:38.258 ******** 2022-01-10T01:19:33.612 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2022-01-10T01:19:33.637 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:33 +0000 (0:00:00.052) 0:01:38.311 ******** 2022-01-10T01:19:33.665 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:33.691 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:33 +0000 (0:00:00.054) 0:01:38.366 ******** 2022-01-10T01:19:33.719 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2022-01-10T01:19:33.752 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:33 +0000 (0:00:00.060) 0:01:38.427 ******** 2022-01-10T01:19:33.803 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2022-01-10T01:19:33.805 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.028112", "end": "2022-01-10 01:19:33.741673", "rc": 0, "start": "2022-01-10 01:19:33.713561", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:19:33.830 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:33 +0000 (0:00:00.078) 0:01:38.505 ******** 2022-01-10T01:19:33.934 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.031717", "end": "2022-01-10 01:19:33.571653", "rc": 0, "start": "2022-01-10 01:19:33.539936", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:19:33.960 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:33 +0000 (0:00:00.129) 0:01:38.635 ******** 2022-01-10T01:19:34.378 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2022-01-10T01:19:34.380 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2022-01-10T01:19:34.405 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:34 +0000 (0:00:00.444) 0:01:39.080 ******** 2022-01-10T01:19:34.509 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2022-01-10T01:19:34.536 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:34 +0000 (0:00:00.130) 0:01:39.211 ******** 2022-01-10T01:19:35.113 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2022-01-10T01:19:35.115 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:35.139 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:35 +0000 (0:00:00.603) 0:01:39.814 ******** 2022-01-10T01:19:35.167 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2022-01-10T01:19:35.191 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:35 +0000 (0:00:00.052) 0:01:39.866 ******** 2022-01-10T01:19:35.231 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2022-01-10T01:19:35.233 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:35.261 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:35 +0000 (0:00:00.069) 0:01:39.936 ******** 2022-01-10T01:19:35.289 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2022-01-10T01:19:35.316 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:35 +0000 (0:00:00.054) 0:01:39.990 ******** 2022-01-10T01:19:35.375 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2022-01-10T01:19:35.377 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.032873", "end": "2022-01-10 01:19:34.989069", "rc": 0, "start": "2022-01-10 01:19:34.956196", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:19:35.402 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:35 +0000 (0:00:00.086) 0:01:40.076 ******** 2022-01-10T01:19:35.495 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.031578", "end": "2022-01-10 01:19:35.661116", "rc": 0, "start": "2022-01-10 01:19:35.629538", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:19:35.533 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:35 +0000 (0:00:00.131) 0:01:40.208 ******** 2022-01-10T01:19:36.238 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2022-01-10T01:19:36.239 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": false} 2022-01-10T01:19:36.271 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:36 +0000 (0:00:00.737) 0:01:40.945 ******** 2022-01-10T01:19:36.365 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:36.394 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:36 +0000 (0:00:00.123) 0:01:41.069 ******** 2022-01-10T01:19:37.621 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:37.647 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:37 +0000 (0:00:01.252) 0:01:42.321 ******** 2022-01-10T01:19:37.919 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:19:37.946 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:37 +0000 (0:00:00.299) 0:01:42.621 ******** 2022-01-10T01:19:44.546 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2022-01-10T01:19:44.548 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 90 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2022-01-10T01:19:44.550 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174688 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 90 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2022-01-10T01:19:44.551 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174688 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2022-01-10T01:19:44.573 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:44 +0000 (0:00:06.626) 0:01:49.248 ******** 2022-01-10T01:19:44.676 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 90 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2022-01-10T01:19:44.678 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174688 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 90 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2022-01-10T01:19:44.680 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174688 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2022-01-10T01:19:44.703 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:44 +0000 (0:00:00.129) 0:01:49.377 ******** 2022-01-10T01:19:45.918 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 90 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2022-01-10T01:19:45.920 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174688 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 90 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2022-01-10T01:19:45.922 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174688 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2022-01-10T01:19:45.946 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:45 +0000 (0:00:01.242) 0:01:50.620 ******** 2022-01-10T01:19:46.061 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 90 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading datab 2022-01-10T01:19:46.063 INFO:teuthology.task.ansible.out:ase ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174688 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nRemoving librbd1 (15.2.13-0ubuntu0.20.04.2) ...\r\nRemoving librados2 (15.2.13-0ubuntu0.20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 90 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Read 2022-01-10T01:19:46.065 INFO:teuthology.task.ansible.out:ing database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174688 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.17) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Removing librbd1 (15.2.13-0ubuntu0.20.04.2) ...", "Removing librados2 (15.2.13-0ubuntu0.20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2022-01-10T01:19:46.088 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:46 +0000 (0:00:00.142) 0:01:50.763 ******** 2022-01-10T01:19:59.915 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2022-01-10T01:19:59.917 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 86 not upgraded.\nNeed to get 1518 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.9 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.9 [11 2022-01-10T01:19:59.918 INFO:teuthology.task.ansible.out:80 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.9 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.9 [84.3 kB]\nFetched 1518 kB in 1s (1671 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174616 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.9_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.9_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.9_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.9_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.9) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.9) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.9) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.9) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and a 2022-01-10T01:19:59.920 INFO:teuthology.task.ansible.out:re no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 86 not upgraded.", "Need to get 1518 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.9 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.9 [1180 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.9 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.9 [84.3 kB]", "Fetched 1518 kB in 1s (1671 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databa 2022-01-10T01:19:59.922 INFO:teuthology.task.ansible.out:se ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174616 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.9_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.9_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.9_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.9_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.9) ...", "Setting up apache2-data (2.4.41-4ubuntu3.9) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.9) ...", "Setting up apache2 (2.4.41-4ubuntu3.9) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2022-01-10T01:19:59.940 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:59 +0000 (0:00:13.851) 0:02:04.615 ******** 2022-01-10T01:19:59.970 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2022-01-10T01:19:59.972 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:19:59.994 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:19:59 +0000 (0:00:00.053) 0:02:04.668 ******** 2022-01-10T01:20:00.360 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2022-01-10T01:20:00.362 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 86 not upgraded.\nNeed to get 1518 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.9 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.9 [11 2022-01-10T01:20:00.363 INFO:teuthology.task.ansible.out:80 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.9 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.9 [84.3 kB]\nFetched 1518 kB in 1s (1643 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174616 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.9_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.9_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.9_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.9_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.9) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.9) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.9) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.9) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and a 2022-01-10T01:20:00.365 INFO:teuthology.task.ansible.out:re no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 86 not upgraded.", "Need to get 1518 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.9 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.9 [1180 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.9 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.9 [84.3 kB]", "Fetched 1518 kB in 1s (1643 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databa 2022-01-10T01:20:00.367 INFO:teuthology.task.ansible.out:se ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174616 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.9_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.9_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.9_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.9_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.9) ...", "Setting up apache2-data (2.4.41-4ubuntu3.9) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.9) ...", "Setting up apache2 (2.4.41-4ubuntu3.9) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2022-01-10T01:20:00.387 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:00 +0000 (0:00:00.392) 0:02:05.061 ******** 2022-01-10T01:20:00.416 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2022-01-10T01:20:00.418 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:00.441 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:00 +0000 (0:00:00.054) 0:02:05.116 ******** 2022-01-10T01:20:01.618 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2022-01-10T01:20:01.620 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 86 not upgraded.\nNeed to get 1518 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.9 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.9 [11 2022-01-10T01:20:01.621 INFO:teuthology.task.ansible.out:80 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.9 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.9 [84.3 kB]\nFetched 1518 kB in 1s (1773 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174616 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.9_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.9_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.9_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.9_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.9) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.9) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.9) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.9) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and a 2022-01-10T01:20:01.623 INFO:teuthology.task.ansible.out:re no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 86 not upgraded.", "Need to get 1518 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.9 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.9 [1180 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.9 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.9 [84.3 kB]", "Fetched 1518 kB in 1s (1773 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databa 2022-01-10T01:20:01.625 INFO:teuthology.task.ansible.out:se ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174616 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.9_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.9_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.9_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.9_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.9) ...", "Setting up apache2-data (2.4.41-4ubuntu3.9) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.9) ...", "Setting up apache2 (2.4.41-4ubuntu3.9) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2022-01-10T01:20:01.646 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:01 +0000 (0:00:01.204) 0:02:06.321 ******** 2022-01-10T01:20:01.674 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2022-01-10T01:20:01.676 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:01.703 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:01 +0000 (0:00:00.056) 0:02:06.378 ******** 2022-01-10T01:20:01.850 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2022-01-10T01:20:01.852 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11\n liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5\n libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0\n libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common\n libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data\n qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils\n4 upgraded, 0 newly installed, 0 to remove and 86 not upgraded.\nNeed to get 1518 kB of archives.\nAfter this operation, 3072 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.9 [95.5 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.9 [11 2022-01-10T01:20:01.853 INFO:teuthology.task.ansible.out:80 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.9 [159 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.9 [84.3 kB]\nFetched 1518 kB in 1s (1711 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174616 files and directories currently installed.)\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.9_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.9_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.9_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.9_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.9) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.9) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.9) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.9) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.13) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and a 2022-01-10T01:20:01.855 INFO:teuthology.task.ansible.out:re no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 libllvm11", " liborc-0.4-0 libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5", " libtag1v5-vanilla libusbredirparser1 libv4l-0 libv4lconvert0", " libvirglrenderer1 libvisual-0.4-0 libvte-2.91-0 libvte-2.91-common", " libwayland-server0 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic msr-tools ovmf qemu-system-data", " qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils", "4 upgraded, 0 newly installed, 0 to remove and 86 not upgraded.", "Need to get 1518 kB of archives.", "After this operation, 3072 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.9 [95.5 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.9 [1180 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.9 [159 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.9 [84.3 kB]", "Fetched 1518 kB in 1s (1711 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading databa 2022-01-10T01:20:01.857 INFO:teuthology.task.ansible.out:se ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174616 files and directories currently installed.)", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.9_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.9_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.9_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.9_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.9) over (2.4.41-4ubuntu3.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.9) ...", "Setting up apache2-data (2.4.41-4ubuntu3.9) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.9) ...", "Setting up apache2 (2.4.41-4ubuntu3.9) ...", "Processing triggers for systemd (245.4-4ubuntu3.13) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for ufw (0.36-6) ..."]} 2022-01-10T01:20:01.881 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:01 +0000 (0:00:00.177) 0:02:06.556 ******** 2022-01-10T01:20:01.913 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2022-01-10T01:20:01.915 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:01.939 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:01 +0000 (0:00:00.057) 0:02:06.614 ******** 2022-01-10T01:20:12.150 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2022-01-10T01:20:12.152 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 84 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.2 [3212 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.2 [1623 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.19 [54.9 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.19 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2022-01-10T01:20:12.153 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.19 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.19 [6731 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.19 [970 kB]\nFetched 14.3 MB in 1s (11.0 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174616 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.19) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.19_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.19) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2022-01-10T01:20:12.155 INFO:teuthology.task.ansible.out:buntu6.19) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.19) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.19) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.2) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.19) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.2) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.19) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2022-01-10T01:20:12.157 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 84 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.2 [3212 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.2 [1623 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.19 [54.9 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.19 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.19 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.19 [6731 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.19 [970 kB]", "Fetched 14.3 MB in 1s (11.0 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174616 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.2) ... 2022-01-10T01:20:12.158 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.19) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.19_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.19) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.19) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.19) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.19) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.2) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.19) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.2) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.19) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.19) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.19) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.19) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2022-01-10T01:20:12.177 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:12 +0000 (0:00:10.238) 0:02:16.852 ******** 2022-01-10T01:20:12.188 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 84 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.2 [3212 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.2 [1623 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.19 [54.9 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.19 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2022-01-10T01:20:12.190 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.19 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.19 [6731 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.19 [970 kB]\nFetched 14.3 MB in 1s (11.3 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174616 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.19) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.19_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.19) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2022-01-10T01:20:12.191 INFO:teuthology.task.ansible.out:buntu6.19) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.19) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.19) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.2) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.19) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.2) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.19) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2022-01-10T01:20:12.193 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 84 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.2 [3212 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.2 [1623 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.19 [54.9 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.19 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.19 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.19 [6731 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.19 [970 kB]", "Fetched 14.3 MB in 1s (11.3 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174616 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.2) ... 2022-01-10T01:20:12.195 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.19) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.19_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.19) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.19) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.19) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.19) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.2) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.19) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.2) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.19) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.19) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.19) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.19) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2022-01-10T01:20:12.226 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:12 +0000 (0:00:00.048) 0:02:16.900 ******** 2022-01-10T01:20:12.884 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2022-01-10T01:20:12.886 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:12.910 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:12 +0000 (0:00:00.684) 0:02:17.585 ******** 2022-01-10T01:20:12.928 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": false} 2022-01-10T01:20:12.954 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:12 +0000 (0:00:00.044) 0:02:17.629 ******** 2022-01-10T01:20:13.594 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2022-01-10T01:20:13.596 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:13.620 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:13 +0000 (0:00:00.665) 0:02:18.294 ******** 2022-01-10T01:20:13.660 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": false} 2022-01-10T01:20:13.688 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:13 +0000 (0:00:00.067) 0:02:18.362 ******** 2022-01-10T01:20:13.758 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2022-01-10T01:20:13.759 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2022-01-10T01:20:13.785 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:13 +0000 (0:00:00.097) 0:02:18.460 ******** 2022-01-10T01:20:13.793 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2022-01-10T01:20:13.794 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 84 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.2 [3212 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.2 [1623 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.19 [54.9 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.19 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2022-01-10T01:20:13.796 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.19 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.19 [6731 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.19 [970 kB]\nFetched 14.3 MB in 1s (10.4 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174616 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.19) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.19_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.19) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2022-01-10T01:20:13.798 INFO:teuthology.task.ansible.out:buntu6.19) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.19) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.19) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.2) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.19) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.2) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.19) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2022-01-10T01:20:13.799 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 84 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.2 [3212 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.2 [1623 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.19 [54.9 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.19 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.19 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.19 [6731 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.19 [970 kB]", "Fetched 14.3 MB in 1s (10.4 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174616 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.2) ... 2022-01-10T01:20:13.801 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.2) ...", "Selectin 2022-01-10T01:20:13.801 INFO:teuthology.task.ansible.out:g previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.19) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.19_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.19) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.19) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.19) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.19) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.2) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.19) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.2) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.19) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.19) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.19) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.19) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2022-01-10T01:20:13.828 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:13 +0000 (0:00:00.042) 0:02:18.502 ******** 2022-01-10T01:20:13.834 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2022-01-10T01:20:13.836 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2022-01-10T01:20:13.862 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:13 +0000 (0:00:00.034) 0:02:18.536 ******** 2022-01-10T01:20:13.884 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:13 +0000 (0:00:00.021) 0:02:18.558 ******** 2022-01-10T01:20:13.902 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2022-01-10T01:20:13.904 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:13.929 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:13 +0000 (0:00:00.045) 0:02:18.603 ******** 2022-01-10T01:20:14.020 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2022-01-10T01:20:14.022 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2022-01-10T01:20:14.047 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:14 +0000 (0:00:00.117) 0:02:18.721 ******** 2022-01-10T01:20:14.075 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2022-01-10T01:20:14.116 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:14 +0000 (0:00:00.069) 0:02:18.791 ******** 2022-01-10T01:20:14.266 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2022-01-10T01:20:14.268 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3.2).\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n qemu-system-data qemu-system-gui\n2 upgraded, 6 newly installed, 0 to remove and 84 not upgraded.\nNeed to get 14.3 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.2 [3212 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.2 [1623 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.19 [54.9 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.19 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19 [563 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 q 2022-01-10T01:20:14.270 INFO:teuthology.task.ansible.out:emu-system-gui amd64 1:4.2-3ubuntu6.19 [40.8 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.19 [6731 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.19 [970 kB]\nFetched 14.3 MB in 1s (11.1 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174616 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librados2 (15.2.14-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librbd1 (15.2.14-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.19) ...\r\nPreparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.19_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.19) over (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 (1:4.2-3u 2022-01-10T01:20:14.271 INFO:teuthology.task.ansible.out:buntu6.19) over (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.19) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.19_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.19) ...\r\nSetting up librados2 (15.2.14-0ubuntu0.20.04.2) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.19) ...\r\nSetting up librbd1 (15.2.14-0ubuntu0.20.04.2) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.19) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.19) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.25.1-1ubuntu3.2).", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " qemu-system-data qemu-system-gui", "2 upgrad 2022-01-10T01:20:14.273 INFO:teuthology.task.ansible.out:ed, 6 newly installed, 0 to remove and 84 not upgraded.", "Need to get 14.3 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.14-0ubuntu0.20.04.2 [3212 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.14-0ubuntu0.20.04.2 [1623 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.19 [54.9 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.19 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.19 [563 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.19 [40.8 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.19 [6731 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.19 [970 kB]", "Fetched 14.3 MB in 1s (11.1 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174616 files and directories currently installed.)", "Preparing to unpack .../0-librados2_15.2.14-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librados2 (15.2.14-0ubuntu0.20.04.2) ... 2022-01-10T01:20:14.275 INFO:teuthology.task.ansible.out:", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.14-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librbd1 (15.2.14-0ubuntu0.20.04.2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.19) ...", "Preparing to unpack .../4-qemu-system-data_1%3a4.2-3ubuntu6.19_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.19) over (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-gui_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.19) over (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../6-qemu-system-x86_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.19) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../7-qemu-utils_1%3a4.2-3ubuntu6.19_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.19) ...", "Setting up librados2 (15.2.14-0ubuntu0.20.04.2) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.19) ...", "Setting up librbd1 (15.2.14-0ubuntu0.20.04.2) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.19) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.19) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.19) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.19) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.19) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for mime-support (3.64ubuntu1) ..."]} 2022-01-10T01:20:14.314 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:14 +0000 (0:00:00.198) 0:02:18.989 ******** 2022-01-10T01:20:14.406 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2022-01-10T01:20:14.408 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2022-01-10T01:20:14.433 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:14 +0000 (0:00:00.118) 0:02:19.108 ******** 2022-01-10T01:20:14.485 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2022-01-10T01:20:14.516 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:14 +0000 (0:00:00.083) 0:02:19.191 ******** 2022-01-10T01:20:14.526 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2022-01-10T01:20:14.527 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:14.563 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:14 +0000 (0:00:00.046) 0:02:19.238 ******** 2022-01-10T01:20:14.603 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2022-01-10T01:20:14.605 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2022-01-10T01:20:14.630 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:14 +0000 (0:00:00.067) 0:02:19.305 ******** 2022-01-10T01:20:14.703 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2022-01-10T01:20:14.729 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:14 +0000 (0:00:00.098) 0:02:19.404 ******** 2022-01-10T01:20:14.771 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2022-01-10T01:20:14.772 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:20:14.797 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:14 +0000 (0:00:00.067) 0:02:19.472 ******** 2022-01-10T01:20:14.878 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:20:14.905 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:14 +0000 (0:00:00.107) 0:02:19.579 ******** 2022-01-10T01:20:15.007 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2022-01-10T01:20:15.009 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:15.036 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.131) 0:02:19.710 ******** 2022-01-10T01:20:15.088 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2022-01-10T01:20:15.089 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:19:57 UTC", "ActiveEnterTimestampMonotonic": "196816182", "ActiveExitTimestamp": "Mon 2022-01-10 01:19:57 UTC", "ActiveExitTimestampMonotonic": "196726076", "ActiveState": "active", "After": "-.mount nss-lookup.target basic.target systemd-journald.socket systemd-tmpfiles-setup.service system.slice remote-fs.target network.target sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:19:57 UTC", "AssertTimestampMonotonic": "196777650", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:19:57 UTC", "ConditionTimestampMonotonic": "196777649", "ConfigurationDirec 2022-01-10T01:20:15.091 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6465", "ExecMainStartTimestamp": "Mon 2022-01-10 01:19:57 UTC", "ExecMainStartTimestampMonotonic": "196816164", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2022-01-10T01:20:15.093 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2022-01-10 01:19:57 UTC", "InactiveEnterTimestampMonotonic": "196776259", "InactiveExitTimestamp": "Mon 2022-01-10 01:19:57 UTC", "InactiveExitTimestampMonotonic": "196780003", "InvocationID": "be985353f8804cc9b415371cffd88a33", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6465", "MemoryAccounting": "yes", "MemoryCurrent": "6975488", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2022-01-10T01:20:15.094 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:19:57 UTC", "StateChangeTimestampMonotonic": "196816182", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2022-01-10T01:20:15.096 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38334", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2022-01-10T01:20:15.116 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.080) 0:02:19.791 ******** 2022-01-10T01:20:15.144 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:15.178 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.061) 0:02:19.853 ******** 2022-01-10T01:20:15.190 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2022-01-10T01:20:15.193 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:19:57 UTC", "ActiveEnterTimestampMonotonic": "196648650", "ActiveExitTimestamp": "Mon 2022-01-10 01:19:57 UTC", "ActiveExitTimestampMonotonic": "196568077", "ActiveState": "active", "After": "remote-fs.target -.mount sysinit.target system.slice basic.target systemd-journald.socket network.target nss-lookup.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:19:57 UTC", "AssertTimestampMonotonic": "196617799", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:19:57 UTC", "ConditionTimestampMonotonic": "196617799", "ConfigurationDirec 2022-01-10T01:20:15.195 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6475", "ExecMainStartTimestamp": "Mon 2022-01-10 01:19:57 UTC", "ExecMainStartTimestampMonotonic": "196648621", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2022-01-10T01:20:15.196 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2022-01-10 01:19:57 UTC", "InactiveEnterTimestampMonotonic": "196616503", "InactiveExitTimestamp": "Mon 2022-01-10 01:19:57 UTC", "InactiveExitTimestampMonotonic": "196619685", "InvocationID": "3176e5ef2a334366b40ca29c26241a9e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6475", "MemoryAccounting": "yes", "MemoryCurrent": "6909952", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2022-01-10T01:20:15.198 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:19:57 UTC", "StateChangeTimestampMonotonic": "196648650", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2022-01-10T01:20:15.200 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38334", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartU 2022-01-10T01:20:15.200 INFO:teuthology.task.ansible.out:Sec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2022-01-10T01:20:15.232 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.054) 0:02:19.907 ******** 2022-01-10T01:20:15.241 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2022-01-10T01:20:15.242 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:15.268 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.035) 0:02:19.943 ******** 2022-01-10T01:20:15.275 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2022-01-10T01:20:15.277 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:15.306 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.038) 0:02:19.981 ******** 2022-01-10T01:20:15.330 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.024) 0:02:20.005 ******** 2022-01-10T01:20:15.337 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2022-01-10T01:20:15.339 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:15.367 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.036) 0:02:20.041 ******** 2022-01-10T01:20:15.392 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.025) 0:02:20.067 ******** 2022-01-10T01:20:15.400 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2022-01-10T01:20:15.402 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:15.426 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.033) 0:02:20.101 ******** 2022-01-10T01:20:15.433 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2022-01-10T01:20:15.435 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:15.459 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.033) 0:02:20.134 ******** 2022-01-10T01:20:15.469 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:15.470 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2022-01-10T01:20:15.471 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2022-01-10T01:20:15.496 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.036) 0:02:20.171 ******** 2022-01-10T01:20:15.519 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.022) 0:02:20.193 ******** 2022-01-10T01:20:15.526 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2022-01-10T01:20:15.528 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:15.555 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.036) 0:02:20.230 ******** 2022-01-10T01:20:15.582 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.027) 0:02:20.257 ******** 2022-01-10T01:20:15.590 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2022-01-10T01:20:15.591 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:15.616 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.033) 0:02:20.291 ******** 2022-01-10T01:20:15.640 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.023) 0:02:20.314 ******** 2022-01-10T01:20:15.647 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:15.649 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:15.675 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.034) 0:02:20.349 ******** 2022-01-10T01:20:15.697 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.021) 0:02:20.371 ******** 2022-01-10T01:20:15.704 INFO:teuthology.task.ansible.out: 2022-01-10T01:20:15.706 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages with --no-install-recommends] **************** ok: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:15.732 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.035) 0:02:20.407 ******** 2022-01-10T01:20:15.755 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.022) 0:02:20.429 ******** 2022-01-10T01:20:15.762 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2022-01-10T01:20:15.764 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:15.794 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.039) 0:02:20.469 ******** 2022-01-10T01:20:15.821 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.026) 0:02:20.495 ******** 2022-01-10T01:20:15.828 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2022-01-10T01:20:15.830 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2022-01-10T01:20:15.830 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:15.855 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.034) 0:02:20.530 ******** 2022-01-10T01:20:15.877 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.021) 0:02:20.552 ******** 2022-01-10T01:20:15.883 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2022-01-10T01:20:15.885 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:15.911 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.033) 0:02:20.586 ******** 2022-01-10T01:20:15.919 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2022-01-10T01:20:15.921 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2022-01-10T01:20:15.955 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.044) 0:02:20.630 ******** 2022-01-10T01:20:15.988 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:15 +0000 (0:00:00.032) 0:02:20.663 ******** 2022-01-10T01:20:15.997 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:15.999 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.028 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.039) 0:02:20.702 ******** 2022-01-10T01:20:16.055 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.027) 0:02:20.730 ******** 2022-01-10T01:20:16.064 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2022-01-10T01:20:16.066 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.090 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.035) 0:02:20.765 ******** 2022-01-10T01:20:16.116 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.025) 0:02:20.791 ******** 2022-01-10T01:20:16.123 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2022-01-10T01:20:16.125 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.153 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.037) 0:02:20.828 ******** 2022-01-10T01:20:16.177 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.023) 0:02:20.852 ******** 2022-01-10T01:20:16.195 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2022-01-10T01:20:16.197 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.228 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.050) 0:02:20.903 ******** 2022-01-10T01:20:16.238 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2022-01-10T01:20:16.240 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.263 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.034) 0:02:20.938 ******** 2022-01-10T01:20:16.270 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2022-01-10T01:20:16.273 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.299 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.035) 0:02:20.973 ******** 2022-01-10T01:20:16.322 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.023) 0:02:20.996 ******** 2022-01-10T01:20:16.355 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.033) 0:02:21.030 ******** 2022-01-10T01:20:16.363 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2022-01-10T01:20:16.365 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.394 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.036) 0:02:21.067 ******** 2022-01-10T01:20:16.425 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.033) 0:02:21.100 ******** 2022-01-10T01:20:16.436 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2022-01-10T01:20:16.438 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.462 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.037) 0:02:21.137 ******** 2022-01-10T01:20:16.469 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2022-01-10T01:20:16.471 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.495 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.032) 0:02:21.169 ******** 2022-01-10T01:20:16.502 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2022-01-10T01:20:16.504 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.528 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.033) 0:02:21.203 ******** 2022-01-10T01:20:16.535 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2022-01-10T01:20:16.536 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi166.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2022-01-10T01:20:16.561 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.032) 0:02:21.235 ******** 2022-01-10T01:20:16.583 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.021) 0:02:21.257 ******** 2022-01-10T01:20:16.588 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2022-01-10T01:20:16.590 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.616 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.033) 0:02:21.290 ******** 2022-01-10T01:20:16.623 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2022-01-10T01:20:16.625 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.650 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.033) 0:02:21.324 ******** 2022-01-10T01:20:16.656 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2022-01-10T01:20:16.658 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.682 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.032) 0:02:21.357 ******** 2022-01-10T01:20:16.689 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2022-01-10T01:20:16.691 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.715 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.033) 0:02:21.390 ******** 2022-01-10T01:20:16.722 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2022-01-10T01:20:16.724 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.726 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:20:16.755 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.039) 0:02:21.429 ******** 2022-01-10T01:20:16.778 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.022) 0:02:21.452 ******** 2022-01-10T01:20:16.802 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.023) 0:02:21.476 ******** 2022-01-10T01:20:16.812 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2022-01-10T01:20:16.814 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.844 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.042) 0:02:21.519 ******** 2022-01-10T01:20:16.876 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.031) 0:02:21.551 ******** 2022-01-10T01:20:16.885 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2022-01-10T01:20:16.888 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.912 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.035) 0:02:21.586 ******** 2022-01-10T01:20:16.921 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2022-01-10T01:20:16.923 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:16.950 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.038) 0:02:21.625 ******** 2022-01-10T01:20:16.959 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2022-01-10T01:20:16.961 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi139.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2022-01-10T01:20:16.992 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:16 +0000 (0:00:00.041) 0:02:21.666 ******** 2022-01-10T01:20:17.019 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.027) 0:02:21.693 ******** 2022-01-10T01:20:17.026 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2022-01-10T01:20:17.028 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set grub config.] ********************************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.054 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.035) 0:02:21.729 ******** 2022-01-10T01:20:17.077 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.022) 0:02:21.752 ******** 2022-01-10T01:20:17.087 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2022-01-10T01:20:17.090 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:19:59 UTC", "ActiveEnterTimestampMonotonic": "192603360", "ActiveExitTimestamp": "Mon 2022-01-10 01:19:59 UTC", "ActiveExitTimestampMonotonic": "192520386", "ActiveState": "active", "After": "remote-fs.target basic.target -.mount sysinit.target nss-lookup.target systemd-journald.socket network.target systemd-tmpfiles-setup.service system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:19:59 UTC", "AssertTimestampMonotonic": "192571760", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:19:59 UTC", "ConditionTimestampMonotonic": "192571759", "ConfigurationDirec 2022-01-10T01:20:17.092 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6516", "ExecMainStartTimestamp": "Mon 2022-01-10 01:19:59 UTC", "ExecMainStartTimestampMonotonic": "192603332", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2022-01-10T01:20:17.093 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2022-01-10 01:19:59 UTC", "InactiveEnterTimestampMonotonic": "192570366", "InactiveExitTimestamp": "Mon 2022-01-10 01:19:59 UTC", "InactiveExitTimestampMonotonic": "192574314", "InvocationID": "b7034321072a49c6bbc2539d95b8aae7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127757", "LimitNPROCSoft": "127757", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127757", "LimitSIGPENDINGSoft": "127757", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6516", "MemoryAccounting": "yes", "MemoryCurrent": "6770688", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2022-01-10T01:20:17.095 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:19:59 UTC", "StateChangeTimestampMonotonic": "192603360", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2022-01-10T01:20:17.096 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38327", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2022-01-10T01:20:17.117 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.038) 0:02:21.790 ******** 2022-01-10T01:20:17.122 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2022-01-10T01:20:17.124 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.162 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.045) 0:02:21.836 ******** 2022-01-10T01:20:17.170 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.197 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.035) 0:02:21.872 ******** 2022-01-10T01:20:17.204 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2022-01-10T01:20:17.206 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* 2022-01-10T01:20:17.207 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2022-01-10T01:20:17.233 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.035) 0:02:21.907 ******** 2022-01-10T01:20:17.259 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.025) 0:02:21.933 ******** 2022-01-10T01:20:17.282 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.023) 0:02:21.957 ******** 2022-01-10T01:20:17.290 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2022-01-10T01:20:17.291 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.317 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.034) 0:02:21.991 ******** 2022-01-10T01:20:17.324 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2022-01-10T01:20:17.325 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.351 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.034) 0:02:22.026 ******** 2022-01-10T01:20:17.358 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2022-01-10T01:20:17.360 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.384 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.032) 0:02:22.059 ******** 2022-01-10T01:20:17.391 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2022-01-10T01:20:17.393 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.418 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.034) 0:02:22.093 ******** 2022-01-10T01:20:17.426 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2022-01-10T01:20:17.428 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.463 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.044) 0:02:22.137 ******** 2022-01-10T01:20:17.471 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2022-01-10T01:20:17.473 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.497 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.034) 0:02:22.172 ******** 2022-01-10T01:20:17.504 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2022-01-10T01:20:17.506 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.530 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.033) 0:02:22.205 ******** 2022-01-10T01:20:17.537 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2022-01-10T01:20:17.539 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.571 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.040) 0:02:22.246 ******** 2022-01-10T01:20:17.581 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2022-01-10T01:20:17.582 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:19:59 UTC", "ActiveEnterTimestampMonotonic": "188242030", "ActiveExitTimestamp": "Mon 2022-01-10 01:19:59 UTC", "ActiveExitTimestampMonotonic": "188155283", "ActiveState": "active", "After": "network.target system.slice remote-fs.target systemd-tmpfiles-setup.service systemd-journald.socket sysinit.target nss-lookup.target basic.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:19:59 UTC", "AssertTimestampMonotonic": "188205850", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:19:59 UTC", "ConditionTimestampMonotonic": "188205849", "ConfigurationDirec 2022-01-10T01:20:17.584 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6512", "ExecMainStartTimestamp": "Mon 2022-01-10 01:19:59 UTC", "ExecMainStartTimestampMonotonic": "188242010", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2022-01-10T01:20:17.586 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2022-01-10 01:19:59 UTC", "InactiveEnterTimestampMonotonic": "188204427", "InactiveExitTimestamp": "Mon 2022-01-10 01:19:59 UTC", "InactiveExitTimestampMonotonic": "188208890", "InvocationID": "2716de52a2bf402ebd03ff57a280a049", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127757", "LimitNPROCSoft": "127757", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127757", "LimitSIGPENDINGSoft": "127757", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6512", "MemoryAccounting": "yes", "MemoryCurrent": "6701056", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2022-01-10T01:20:17.587 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:19:59 UTC", "StateChangeTimestampMonotonic": "188242030", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2022-01-10T01:20:17.589 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38327", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2022-01-10T01:20:17.609 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.038) 0:02:22.284 ******** 2022-01-10T01:20:17.633 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.023) 0:02:22.307 ******** 2022-01-10T01:20:17.655 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.021) 0:02:22.329 ******** 2022-01-10T01:20:17.662 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2022-01-10T01:20:17.664 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.689 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.034) 0:02:22.363 ******** 2022-01-10T01:20:17.711 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.021) 0:02:22.385 ******** 2022-01-10T01:20:17.734 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.023) 0:02:22.408 ******** 2022-01-10T01:20:17.740 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2022-01-10T01:20:17.742 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.768 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.034) 0:02:22.443 ******** 2022-01-10T01:20:17.775 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2022-01-10T01:20:17.777 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.803 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.035) 0:02:22.478 ******** 2022-01-10T01:20:17.811 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2022-01-10T01:20:17.813 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.845 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.041) 0:02:22.519 ******** 2022-01-10T01:20:17.852 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2022-01-10T01:20:17.854 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.855 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2022-01-10T01:20:17.880 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.035) 0:02:22.555 ******** 2022-01-10T01:20:17.911 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.030) 0:02:22.585 ******** 2022-01-10T01:20:17.918 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:17.920 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.947 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.034) 0:02:22.620 ******** 2022-01-10T01:20:17.953 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2022-01-10T01:20:17.954 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:17.979 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:17 +0000 (0:00:00.034) 0:02:22.654 ******** 2022-01-10T01:20:17.986 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2022-01-10T01:20:17.988 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.012 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.032) 0:02:22.686 ******** 2022-01-10T01:20:18.018 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2022-01-10T01:20:18.020 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.046 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.034) 0:02:22.721 ******** 2022-01-10T01:20:18.053 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2022-01-10T01:20:18.055 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} TASK [testnode : Install packages] ********************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.082 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.035) 0:02:22.757 ******** 2022-01-10T01:20:18.109 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.027) 0:02:22.784 ******** 2022-01-10T01:20:18.116 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2022-01-10T01:20:18.117 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.144 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.034) 0:02:22.818 ******** 2022-01-10T01:20:18.151 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2022-01-10T01:20:18.153 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.179 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.035) 0:02:22.854 ******** 2022-01-10T01:20:18.188 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2022-01-10T01:20:18.190 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.219 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.039) 0:02:22.893 ******** 2022-01-10T01:20:18.225 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2022-01-10T01:20:18.227 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2022-01-10T01:20:18.228 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2022-01-10T01:20:18.252 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.033) 0:02:22.927 ******** 2022-01-10T01:20:18.276 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.023) 0:02:22.951 ******** 2022-01-10T01:20:18.283 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2022-01-10T01:20:18.285 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.317 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.040) 0:02:22.991 ******** 2022-01-10T01:20:18.341 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.024) 0:02:23.016 ******** 2022-01-10T01:20:18.350 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2022-01-10T01:20:18.352 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.378 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.036) 0:02:23.052 ******** 2022-01-10T01:20:18.385 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:18.387 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.419 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.041) 0:02:23.094 ******** 2022-01-10T01:20:18.426 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2022-01-10T01:20:18.428 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2022-01-10T01:20:18.455 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.035) 0:02:23.130 ******** 2022-01-10T01:20:18.478 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.022) 0:02:23.153 ******** 2022-01-10T01:20:18.486 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2022-01-10T01:20:18.488 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.513 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.035) 0:02:23.188 ******** 2022-01-10T01:20:18.520 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2022-01-10T01:20:18.522 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.549 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.035) 0:02:23.223 ******** 2022-01-10T01:20:18.556 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2022-01-10T01:20:18.558 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.585 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.035) 0:02:23.259 ******** 2022-01-10T01:20:18.592 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2022-01-10T01:20:18.594 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.618 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.033) 0:02:23.293 ******** 2022-01-10T01:20:18.624 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2022-01-10T01:20:18.626 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.650 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.032) 0:02:23.325 ******** 2022-01-10T01:20:18.657 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2022-01-10T01:20:18.659 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.684 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.033) 0:02:23.359 ******** 2022-01-10T01:20:18.691 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2022-01-10T01:20:18.692 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.724 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.039) 0:02:23.398 ******** 2022-01-10T01:20:18.749 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.025) 0:02:23.424 ******** 2022-01-10T01:20:18.759 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2022-01-10T01:20:18.761 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.787 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.037) 0:02:23.461 ******** 2022-01-10T01:20:18.794 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2022-01-10T01:20:18.796 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2022-01-10T01:20:18.796 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2022-01-10T01:20:18.823 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.036) 0:02:23.497 ******** 2022-01-10T01:20:18.848 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.024) 0:02:23.522 ******** 2022-01-10T01:20:18.857 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2022-01-10T01:20:18.859 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.886 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.038) 0:02:23.561 ******** 2022-01-10T01:20:18.895 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2022-01-10T01:20:18.896 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.922 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.035) 0:02:23.596 ******** 2022-01-10T01:20:18.929 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2022-01-10T01:20:18.930 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.956 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.034) 0:02:23.630 ******** 2022-01-10T01:20:18.963 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2022-01-10T01:20:18.965 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:18.990 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:18 +0000 (0:00:00.034) 0:02:23.664 ******** 2022-01-10T01:20:18.997 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2022-01-10T01:20:18.998 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:20:19.000 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.023 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.033) 0:02:23.698 ******** 2022-01-10T01:20:19.047 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.023) 0:02:23.721 ******** 2022-01-10T01:20:19.054 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2022-01-10T01:20:19.055 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.055 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.057 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2022-01-10T01:20:19.081 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.034) 0:02:23.755 ******** 2022-01-10T01:20:19.109 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.027) 0:02:23.783 ******** 2022-01-10T01:20:19.131 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.022) 0:02:23.806 ******** 2022-01-10T01:20:19.141 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2022-01-10T01:20:19.142 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop collectl] ************************************************ skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.168 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.036) 0:02:23.843 ******** 2022-01-10T01:20:19.192 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.024) 0:02:23.867 ******** 2022-01-10T01:20:19.200 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2022-01-10T01:20:19.201 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.226 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.033) 0:02:23.901 ******** 2022-01-10T01:20:19.249 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.022) 0:02:23.923 ******** 2022-01-10T01:20:19.255 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2022-01-10T01:20:19.256 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.257 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.282 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.033) 0:02:23.957 ******** 2022-01-10T01:20:19.306 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.023) 0:02:23.980 ******** 2022-01-10T01:20:19.313 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2022-01-10T01:20:19.315 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.342 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.036) 0:02:24.017 ******** 2022-01-10T01:20:19.371 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.028) 0:02:24.045 ******** 2022-01-10T01:20:19.378 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2022-01-10T01:20:19.380 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2022-01-10T01:20:19.406 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.035) 0:02:24.080 ******** 2022-01-10T01:20:19.429 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.023) 0:02:24.104 ******** 2022-01-10T01:20:19.437 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2022-01-10T01:20:19.438 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.468 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.039) 0:02:24.143 ******** 2022-01-10T01:20:19.477 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2022-01-10T01:20:19.479 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} TASK [testnode : Set grub config.] ********************************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** 2022-01-10T01:20:19.480 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.480 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.507 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.038) 0:02:24.182 ******** 2022-01-10T01:20:19.534 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.026) 0:02:24.209 ******** 2022-01-10T01:20:19.542 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.544 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.545 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** ok: [smithi036.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2022-01-10T01:20:19.546 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.547 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.547 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.548 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.548 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.548 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.549 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.586 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.051) 0:02:24.260 ******** 2022-01-10T01:20:19.612 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.026) 0:02:24.287 ******** 2022-01-10T01:20:19.643 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2022-01-10T01:20:19.645 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.668 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.055) 0:02:24.343 ******** 2022-01-10T01:20:19.676 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2022-01-10T01:20:19.678 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:20:19.703 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.035) 0:02:24.378 ******** 2022-01-10T01:20:19.710 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2022-01-10T01:20:19.712 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.738 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.034) 0:02:24.413 ******** 2022-01-10T01:20:19.762 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.023) 0:02:24.436 ******** 2022-01-10T01:20:19.770 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2022-01-10T01:20:19.772 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.800 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.037) 0:02:24.474 ******** 2022-01-10T01:20:19.823 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.023) 0:02:24.498 ******** 2022-01-10T01:20:19.831 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2022-01-10T01:20:19.832 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003678", "end": "2022-01-10 01:20:19.764658", "rc": 0, "start": "2022-01-10 01:20:19.760980", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock"]} TASK [testnode : Stop collectl] ************************************************ skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.860 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.036) 0:02:24.535 ******** 2022-01-10T01:20:19.891 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.030) 0:02:24.566 ******** 2022-01-10T01:20:19.899 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2022-01-10T01:20:19.900 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.925 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.033) 0:02:24.599 ******** 2022-01-10T01:20:19.932 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2022-01-10T01:20:19.934 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:19.960 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.035) 0:02:24.635 ******** 2022-01-10T01:20:19.984 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:19 +0000 (0:00:00.023) 0:02:24.659 ******** 2022-01-10T01:20:19.992 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2022-01-10T01:20:19.994 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.019 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.034) 0:02:24.693 ******** 2022-01-10T01:20:20.043 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.023) 0:02:24.717 ******** 2022-01-10T01:20:20.050 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2022-01-10T01:20:20.052 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.087 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.044) 0:02:24.761 ******** 2022-01-10T01:20:20.115 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.028) 0:02:24.790 ******** 2022-01-10T01:20:20.123 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2022-01-10T01:20:20.125 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2022-01-10T01:20:20.159 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.044) 0:02:24.834 ******** 2022-01-10T01:20:20.171 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2022-01-10T01:20:20.173 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.203 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.043) 0:02:24.878 ******** 2022-01-10T01:20:20.213 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2022-01-10T01:20:20.214 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.240 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.037) 0:02:24.915 ******** 2022-01-10T01:20:20.262 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.021) 0:02:24.937 ******** 2022-01-10T01:20:20.269 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:20.271 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2022-01-10T01:20:20.310 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.047) 0:02:24.985 ******** 2022-01-10T01:20:20.359 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2022-01-10T01:20:20.362 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.371 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.373 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.382 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.384 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.394 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2022-01-10T01:20:20.405 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.407 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.418 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.420 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.430 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.431 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.442 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.443 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.470 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.160) 0:02:25.145 ******** 2022-01-10T01:20:20.582 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2022-01-10T01:20:20.585 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2022-01-10T01:20:20.610 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.139) 0:02:25.284 ******** 2022-01-10T01:20:20.628 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2022-01-10T01:20:20.630 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2022-01-10T01:20:20.654 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.044) 0:02:25.329 ******** 2022-01-10T01:20:20.662 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2022-01-10T01:20:20.663 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.690 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.035) 0:02:25.364 ******** 2022-01-10T01:20:20.696 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2022-01-10T01:20:20.698 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003490", "end": "2022-01-10 01:20:20.658591", "rc": 0, "start": "2022-01-10 01:20:20.655101", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock"]} 2022-01-10T01:20:20.728 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.038) 0:02:25.403 ******** 2022-01-10T01:20:20.766 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2022-01-10T01:20:20.767 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.799 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.070) 0:02:25.473 ******** 2022-01-10T01:20:20.806 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2022-01-10T01:20:20.809 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": false} 2022-01-10T01:20:20.834 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.035) 0:02:25.509 ******** 2022-01-10T01:20:20.841 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2022-01-10T01:20:20.844 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.868 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.034) 0:02:25.543 ******** 2022-01-10T01:20:20.875 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2022-01-10T01:20:20.877 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.902 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.033) 0:02:25.577 ******** 2022-01-10T01:20:20.910 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2022-01-10T01:20:20.911 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:20.937 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.034) 0:02:25.612 ******** 2022-01-10T01:20:20.945 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2022-01-10T01:20:20.946 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item={'block_used': 14052051, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226043057, 'size_available': 925872361472, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187085, 'block_size': 4096, 'inode_available': 60867891}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226043057, "block_size": 4096, "block_total": 240095108, "block_used": 14052051, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867891, "inode_total": 61054976, "inode_used": 187085, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925872361472, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2022-01-10T01:20:20.987 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:20 +0000 (0:00:00.050) 0:02:25.662 ******** 2022-01-10T01:20:20.994 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2022-01-10T01:20:20.997 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2022-01-10T01:20:21.034 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.046) 0:02:25.708 ******** 2022-01-10T01:20:21.042 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2022-01-10T01:20:21.044 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2022-01-10T01:20:21.070 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.035) 0:02:25.745 ******** 2022-01-10T01:20:21.140 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2022-01-10T01:20:21.142 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009555", "end": "2022-01-10 01:20:21.123371", "rc": 0, "start": "2022-01-10 01:20:21.113816", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:21.167 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.097) 0:02:25.842 ******** 2022-01-10T01:20:21.206 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2022-01-10T01:20:21.208 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'block_used': 14052051, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226043057, 'size_available': 925872361472, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187085, 'block_size': 4096, 'inode_available': 60867891}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226043057, "block_size": 4096, "block_total": 240095108, "block_used": 14052051, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867891, "inode_total": 61054976, "inode_used": 187085, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925872361472, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:21.232 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.065) 0:02:25.907 ******** 2022-01-10T01:20:21.260 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2022-01-10T01:20:21.284 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.051) 0:02:25.959 ******** 2022-01-10T01:20:21.333 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2022-01-10T01:20:21.334 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:21.365 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2022-01-10T01:20:21.367 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2022-01-10T01:20:21.391 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.107) 0:02:26.066 ******** 2022-01-10T01:20:21.409 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2022-01-10T01:20:21.410 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2022-01-10T01:20:21.436 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.044) 0:02:26.110 ******** 2022-01-10T01:20:21.528 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2022-01-10T01:20:21.529 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:20:21.554 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.118) 0:02:26.229 ******** 2022-01-10T01:20:21.585 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2022-01-10T01:20:21.586 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:21.610 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.055) 0:02:26.285 ******** 2022-01-10T01:20:21.640 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2022-01-10T01:20:21.642 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} TASK [testnode : Stop collectl] ************************************************ skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:21.665 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.054) 0:02:26.340 ******** 2022-01-10T01:20:21.697 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.031) 0:02:26.371 ******** 2022-01-10T01:20:21.706 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:21.732 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.035) 0:02:26.407 ******** 2022-01-10T01:20:21.742 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2022-01-10T01:20:21.744 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:21.781 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.048) 0:02:26.455 ******** 2022-01-10T01:20:21.787 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2022-01-10T01:20:21.788 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} TASK [testnode : Set root disk] ************************************************ 2022-01-10T01:20:21.789 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item={'block_used': 14052050, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226043058, 'size_available': 925872365568, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187085, 'block_size': 4096, 'inode_available': 60867891}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226043058, "block_size": 4096, "block_total": 240095108, "block_used": 14052050, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867891, "inode_total": 61054976, "inode_used": 187085, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925872365568, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2022-01-10T01:20:21.815 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.034) 0:02:26.490 ******** 2022-01-10T01:20:21.838 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.022) 0:02:26.513 ******** 2022-01-10T01:20:21.846 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2022-01-10T01:20:21.848 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:21.876 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.037) 0:02:26.550 ******** 2022-01-10T01:20:21.902 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2022-01-10T01:20:21.904 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:21.927 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.050) 0:02:26.601 ******** 2022-01-10T01:20:21.954 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:21.956 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2022-01-10T01:20:21.979 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:21 +0000 (0:00:00.051) 0:02:26.653 ******** 2022-01-10T01:20:21.985 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2022-01-10T01:20:21.987 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009458", "end": "2022-01-10 01:20:21.946119", "rc": 0, "start": "2022-01-10 01:20:21.936661", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2022-01-10T01:20:21.987 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:20:22.013 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.034) 0:02:26.688 ******** 2022-01-10T01:20:22.037 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.023) 0:02:26.712 ******** 2022-01-10T01:20:22.045 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2022-01-10T01:20:22.046 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.047 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.048 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.059 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2022-01-10T01:20:22.061 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'block_used': 14052050, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226043058, 'size_available': 925872365568, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187085, 'block_size': 4096, 'inode_available': 60867891}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226043058, "block_size": 4096, "block_total": 240095108, "block_used": 14052050, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867891, "inode_total": 61054976, "inode_used": 187085, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925872365568, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi166.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.061 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.062 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** ok: [smithi166.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2022-01-10T01:20:22.086 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.048) 0:02:26.760 ******** 2022-01-10T01:20:22.108 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.022) 0:02:26.783 ******** 2022-01-10T01:20:22.115 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.117 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.117 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.118 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.118 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.120 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi166.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.144 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.036) 0:02:26.819 ******** 2022-01-10T01:20:22.168 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.023) 0:02:26.842 ******** 2022-01-10T01:20:22.175 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2022-01-10T01:20:22.176 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.210 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.042) 0:02:26.885 ******** 2022-01-10T01:20:22.218 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2022-01-10T01:20:22.218 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.241 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2022-01-10T01:20:22.243 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.265 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.054) 0:02:26.939 ******** 2022-01-10T01:20:22.291 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2022-01-10T01:20:22.293 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.316 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.051) 0:02:26.991 ******** 2022-01-10T01:20:22.343 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2022-01-10T01:20:22.345 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.368 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.051) 0:02:27.042 ******** 2022-01-10T01:20:22.374 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2022-01-10T01:20:22.376 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003862", "end": "2022-01-10 01:20:22.339006", "rc": 0, "start": "2022-01-10 01:20:22.335144", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock"]} 2022-01-10T01:20:22.404 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.036) 0:02:27.079 ******** 2022-01-10T01:20:22.411 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:22.412 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2022-01-10T01:20:22.438 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.033) 0:02:27.113 ******** 2022-01-10T01:20:22.444 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2022-01-10T01:20:22.446 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.473 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.035) 0:02:27.148 ******** 2022-01-10T01:20:22.491 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2022-01-10T01:20:22.492 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.503 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.505 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi139.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.528 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.054) 0:02:27.203 ******** 2022-01-10T01:20:22.536 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.537 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2022-01-10T01:20:22.538 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.549 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.551 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.560 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.562 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi139.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.585 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.057) 0:02:27.260 ******** 2022-01-10T01:20:22.592 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.623 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.036) 0:02:27.297 ******** 2022-01-10T01:20:22.817 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2022-01-10T01:20:22.819 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003415", "end": "2022-01-10 01:20:22.791618", "rc": 0, "start": "2022-01-10 01:20:22.788203", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology-lock"]} 2022-01-10T01:20:22.845 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.222) 0:02:27.519 ******** 2022-01-10T01:20:22.872 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2022-01-10T01:20:22.874 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.899 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.054) 0:02:27.573 ******** 2022-01-10T01:20:22.926 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2022-01-10T01:20:22.928 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:22.958 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:22 +0000 (0:00:00.058) 0:02:27.632 ******** 2022-01-10T01:20:22.985 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2022-01-10T01:20:22.987 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:23.009 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:23 +0000 (0:00:00.051) 0:02:27.684 ******** 2022-01-10T01:20:23.141 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2022-01-10T01:20:23.143 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRReCWBCbs3iC4X4I5JmTMwDXdToGl7MrpYt'], 'uuids': ['cf6f91c5-e7ad-4519-a7f2-3b495ffa4f16']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.665881", "end": "2022-01-10 01:20:23.106384", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRReCWBCbs3iC4X4I5JmTMwDXdToGl7MrpYt"], "labels": [], "masters": [], "uuids": ["cf6f91c5-e7ad-4519-a7f2-3b495ffa4f16"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:21.440503", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi036.front 2022-01-10T01:20:23.144 INFO:teuthology.task.ansible.out:.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:23.154 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:23.281 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2022-01-10T01:20:23.283 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:23.306 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:23 +0000 (0:00:00.297) 0:02:27.981 ******** 2022-01-10T01:20:23.334 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2022-01-10T01:20:23.336 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:23.358 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:23 +0000 (0:00:00.052) 0:02:28.033 ******** 2022-01-10T01:20:23.405 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2022-01-10T01:20:23.407 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item={'block_used': 14052042, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226043066, 'size_available': 925872398336, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187084, 'block_size': 4096, 'inode_available': 60867892}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226043066, "block_size": 4096, "block_total": 240095108, "block_used": 14052042, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867892, "inode_total": 61054976, "inode_used": 187084, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925872398336, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2022-01-10T01:20:23.431 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:23 +0000 (0:00:00.072) 0:02:28.105 ******** 2022-01-10T01:20:23.582 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2022-01-10T01:20:23.584 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.008900", "end": "2022-01-10 01:20:23.559246", "rc": 0, "start": "2022-01-10 01:20:23.550346", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:23.611 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:23 +0000 (0:00:00.180) 0:02:28.286 ******** 2022-01-10T01:20:23.649 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2022-01-10T01:20:23.651 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'block_used': 14052042, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226043066, 'size_available': 925872398336, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187084, 'block_size': 4096, 'inode_available': 60867892}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226043066, "block_size": 4096, "block_total": 240095108, "block_used": 14052042, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867892, "inode_total": 61054976, "inode_used": 187084, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925872398336, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:23.675 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:23 +0000 (0:00:00.063) 0:02:28.349 ******** 2022-01-10T01:20:23.692 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2022-01-10T01:20:23.693 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:23.716 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:23 +0000 (0:00:00.041) 0:02:28.391 ******** 2022-01-10T01:20:23.723 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2022-01-10T01:20:23.749 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:23 +0000 (0:00:00.033) 0:02:28.424 ******** 2022-01-10T01:20:23.757 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2022-01-10T01:20:23.758 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:23.784 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:23 +0000 (0:00:00.034) 0:02:28.459 ******** 2022-01-10T01:20:23.803 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2022-01-10T01:20:23.805 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:23.826 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2022-01-10T01:20:23.827 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item={'block_used': 14052033, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226043075, 'size_available': 925872435200, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187084, 'block_size': 4096, 'inode_available': 60867892}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226043075, "block_size": 4096, "block_total": 240095108, "block_used": 14052033, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867892, "inode_total": 61054976, "inode_used": 187084, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925872435200, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2022-01-10T01:20:23.851 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:23 +0000 (0:00:00.066) 0:02:28.526 ******** 2022-01-10T01:20:23.922 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2022-01-10T01:20:23.924 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHxFOMz0YZ9vM5ayipiv834SaMwoOt52o4'], 'uuids': ['4bc95945-d550-41c0-878c-4e0625f33dd3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.593927", "end": "2022-01-10 01:20:23.897360", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHxFOMz0YZ9vM5ayipiv834SaMwoOt52o4"], "labels": [], "masters": [], "uuids": ["4bc95945-d550-41c0-878c-4e0625f33dd3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:22.303433", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:23.934 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:23.946 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:23.999 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2022-01-10T01:20:24.001 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009391", "end": "2022-01-10 01:20:23.616900", "rc": 0, "start": "2022-01-10 01:20:23.607509", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:24.028 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:24 +0000 (0:00:00.176) 0:02:28.703 ******** 2022-01-10T01:20:24.067 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2022-01-10T01:20:24.069 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'block_used': 14052033, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226043075, 'size_available': 925872435200, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187084, 'block_size': 4096, 'inode_available': 60867892}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226043075, "block_size": 4096, "block_total": 240095108, "block_used": 14052033, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867892, "inode_total": 61054976, "inode_used": 187084, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925872435200, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:24.092 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:24 +0000 (0:00:00.064) 0:02:28.767 ******** 2022-01-10T01:20:24.120 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2022-01-10T01:20:24.144 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:24 +0000 (0:00:00.051) 0:02:28.818 ******** 2022-01-10T01:20:24.192 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2022-01-10T01:20:24.194 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:24.393 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRRe6pBdCG3Mkz4zCBUXL5QYvfboqdCGZAQR'], 'uuids': ['a7518f07-4f57-4791-bc4c-bacdb0b8c7c3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.109323", "end": "2022-01-10 01:20:24.366139", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRRe6pBdCG3Mkz4zCBUXL5QYvfboqdCGZAQR"], "labels": [], "masters": [], "uuids": ["a7518f07-4f57-4791-bc4c-bacdb0b8c7c3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:23.256816", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:24.405 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS', 'wwn-0x5000c500871b68bf'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1', 'wwn-0x5000c500871b68bf-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871b68bf', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4J2QS', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS", "wwn-0x5000c500871b68bf"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1", "wwn-0x5000c500871b68bf-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2QS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b68bf"}}, 2022-01-10T01:20:24.407 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2022-01-10T01:20:25.197 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHW67P00WhEVs11JgfyFsidFzzsXD8iLgh'], 'uuids': ['122af64d-3aa8-4afe-a856-588d48cc4352']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.122625", "end": "2022-01-10 01:20:25.170944", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHW67P00WhEVs11JgfyFsidFzzsXD8iLgh"], "labels": [], "masters": [], "uuids": ["122af64d-3aa8-4afe-a856-588d48cc4352"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:24.048319", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:25.209 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2P7', 'wwn-0x5000c500871b7b3d'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2P7-part1', 'wwn-0x5000c500871b7b3d-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871b7b3d', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4J2P7', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2P7", "wwn-0x5000c500871b7b3d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2P7-part1", "wwn-0x5000c500871b7b3d-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2P7", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b7b3d"}}, 2022-01-10T01:20:25.211 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2022-01-10T01:20:25.601 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDSifWY445291TD1v0LjMfVs2IRxfWmp9q'], 'uuids': ['6512e23c-0793-4d71-8ced-382b299be298']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.663468", "end": "2022-01-10 01:20:25.570662", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDSifWY445291TD1v0LjMfVs2IRxfWmp9q"], "labels": [], "masters": [], "uuids": ["6512e23c-0793-4d71-8ced-382b299be298"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:23.907194", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:25.612 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:25.624 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:25.815 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-mJQ3Pu-EYqe-L6mK-pgeh-KUDr-m3Bg-w90gOD', 'nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN', 'nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.276102", "end": "2022-01-10 01:20:25.781515", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-mJQ3Pu-EYqe-L6mK-pgeh-KUDr-m3Bg-w90gOD", "nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN", "nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:24.505413", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2022-01-10T01:20:25.817 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:25.827 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:25.828 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:26.062 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9pmybGGpI9PFVA9HdglP8opdR9MGJ0bLm'], 'uuids': ['23c8d513-c21b-4cc4-b4f3-095532a7778b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.731355", "end": "2022-01-10 01:20:26.029780", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9pmybGGpI9PFVA9HdglP8opdR9MGJ0bLm"], "labels": [], "masters": [], "uuids": ["23c8d513-c21b-4cc4-b4f3-095532a7778b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:24.298425", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:26.075 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:26.078 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:26.466 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-quPQNx-7TH8-rMWl-Yhky-mdls-3kmd-IkYVQW', 'nvme-INTEL_SSDPEDMD400G4_CVFT5330009L400BGN', 'nvme-nvme.8086-43564654353333303030394c34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.125633", "end": "2022-01-10 01:20:26.437417", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-quPQNx-7TH8-rMWl-Yhky-mdls-3kmd-IkYVQW", "nvme-INTEL_SSDPEDMD400G4_CVFT5330009L400BGN", "nvme-nvme.8086-43564654353333303030394c34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:25.311784", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2022-01-10T01:20:26.468 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:26.478 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:26.490 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:26.890 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MD5srju3WJrJuwquteHodtZH0SKAdoEOdN'], 'uuids': ['7b3a22dc-c37e-4865-afe5-0484fe647d10']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.137347", "end": "2022-01-10 01:20:26.862338", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MD5srju3WJrJuwquteHodtZH0SKAdoEOdN"], "labels": [], "masters": [], "uuids": ["7b3a22dc-c37e-4865-afe5-0484fe647d10"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:25.724991", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:26.902 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XMNS', 'wwn-0x5000c5009293883c'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XMNS-part1', 'wwn-0x5000c5009293883c-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293883c', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XMNS', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XMNS", "wwn-0x5000c5009293883c"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XMNS-part1", "wwn-0x5000c5009293883c-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XMNS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293883c"}}, 2022-01-10T01:20:26.904 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2022-01-10T01:20:27.123 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRReKOZtk0x6tQT6fh0cJ3M3GEYnedNirY1m'], 'uuids': ['45eeff84-7da7-4d37-88cb-4e42f46f9741']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.160043", "end": "2022-01-10 01:20:27.094408", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRReKOZtk0x6tQT6fh0cJ3M3GEYnedNirY1m"], "labels": [], "masters": [], "uuids": ["45eeff84-7da7-4d37-88cb-4e42f46f9741"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:25.934365", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:27.135 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:27.137 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:27.327 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9v5WXWIjqLxcZ7Etdnsvmr1SV9LUAnU1F'], 'uuids': ['65a25d1a-f38a-4b11-a7ec-8415ecda3478']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.113183", "end": "2022-01-10 01:20:27.294322", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9v5WXWIjqLxcZ7Etdnsvmr1SV9LUAnU1F"], "labels": [], "masters": [], "uuids": ["65a25d1a-f38a-4b11-a7ec-8415ecda3478"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:26.181139", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:27.328 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFR4', 'wwn-0x5000c500929226ed'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFR4-part1', 'wwn-0x5000c500929226ed-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500929226ed', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XFR4', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFR4", "wwn-0x5000c500929226ed"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFR4-part1", "wwn-0x5000c500929226ed-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFR4", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500929226ed"}}, 2022-01-10T01:20:27.330 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2022-01-10T01:20:27.762 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHah6RIFvWlI2oP75D0mgGNYtQLzd0IUJq'], 'uuids': ['85899711-b628-45c0-802e-ece7fe18f449']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.132347", "end": "2022-01-10 01:20:27.731775", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHah6RIFvWlI2oP75D0mgGNYtQLzd0IUJq"], "labels": [], "masters": [], "uuids": ["85899711-b628-45c0-802e-ece7fe18f449"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:26.599428", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:27.764 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:27.775 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:28.194 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-905l2U-Y6zO-4dKj-vQ3M-Wxxi-iBb2-wPfXKE', 'nvme-INTEL_SSDPEDMD400G4_PHFT620401AC400BGN', 'nvme-nvme.8086-50484654363230343031414334303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.165907", "end": "2022-01-10 01:20:28.165315", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-905l2U-Y6zO-4dKj-vQ3M-Wxxi-iBb2-wPfXKE", "nvme-INTEL_SSDPEDMD400G4_PHFT620401AC400BGN", "nvme-nvme.8086-50484654363230343031414334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:26.999408", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2022-01-10T01:20:28.196 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:28.205 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:28.206 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:28.374 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRReEzyEt6pVkLq8BM1BYH7L1YKdEwnjz17y'], 'uuids': ['1d53dde2-3861-4e1e-8645-e903262baafc']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.099725", "end": "2022-01-10 01:20:28.345727", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRReEzyEt6pVkLq8BM1BYH7L1YKdEwnjz17y"], "labels": [], "masters": [], "uuids": ["1d53dde2-3861-4e1e-8645-e903262baafc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:27.246002", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:28.386 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:28.649 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-1r3u2e-gv71-31HN-7gA5-xoAm-canx-7KgKBu', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500N6400BGN', 'nvme-nvme.8086-504846543632303530304e3634303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.188508", "end": "2022-01-10 01:20:28.622966", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-1r3u2e-gv71-31HN-7gA5-xoAm-canx-7KgKBu", "nvme-INTEL_SSDPEDMD400G4_PHFT620500N6400BGN", "nvme-nvme.8086-504846543632303530304e3634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:27.434458", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2022-01-10T01:20:28.651 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:28.661 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:28.672 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:29.020 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHsTvZCUXqrbE5D6XExgLAJ2XnVRsoAQoF'], 'uuids': ['2f344a50-1ecb-4ed3-94a7-50ab14049ae7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.102246", "end": "2022-01-10 01:20:28.982437", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHsTvZCUXqrbE5D6XExgLAJ2XnVRsoAQoF"], "labels": [], "masters": [], "uuids": ["2f344a50-1ecb-4ed3-94a7-50ab14049ae7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:27.880191", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:29.021 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:29.494 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDvh61l81C0FE9SQjQd4LBCMgAcfvGgVWQ'], 'uuids': ['a8e5496a-561e-4a3f-a4b6-3725e64b89ae']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.155827", "end": "2022-01-10 01:20:29.466371", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDvh61l81C0FE9SQjQd4LBCMgAcfvGgVWQ"], "labels": [], "masters": [], "uuids": ["a8e5496a-561e-4a3f-a4b6-3725e64b89ae"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:28.310544", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:29.506 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:29.518 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:29.625 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRRel9FXrPKKO6SQGI7IMiShFYJFrWKKkoEd'], 'uuids': ['0771075c-16c7-4577-a6de-c995d2406aae']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.111355", "end": "2022-01-10 01:20:29.596196", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRRel9FXrPKKO6SQGI7IMiShFYJFrWKKkoEd"], "labels": [], "masters": [], "uuids": ["0771075c-16c7-4577-a6de-c995d2406aae"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:28.484841", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:29.662 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:29 +0000 (0:00:05.517) 0:02:34.336 ******** 2022-01-10T01:20:29.870 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:29.872 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:29.946 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2022-01-10T01:20:29.948 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9Dy2OZhE8cro18ozJaNCK8uFs3jDwiSCn'], 'uuids': ['27373078-03ca-459d-86dc-6113fb033521']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.137680", "end": "2022-01-10 01:20:29.916910", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9Dy2OZhE8cro18ozJaNCK8uFs3jDwiSCn"], "labels": [], "masters": [], "uuids": ["27373078-03ca-459d-86dc-6113fb033521"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:28.779230", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:29.958 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:29.959 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:30.159 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:30.161 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRReCWBCbs3iC4X4I5JmTMwDXdToGl7MrpYt'], 'uuids': ['cf6f91c5-e7ad-4519-a7f2-3b495ffa4f16']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.158421", "end": "2022-01-10 01:20:30.137284", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRReCWBCbs3iC4X4I5JmTMwDXdToGl7MrpYt"], "labels": [], "masters": [], "uuids": ["cf6f91c5-e7ad-4519-a7f2-3b495ffa4f16"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:29.978863", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153515 s, 751 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153515 s, 751 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:30.172 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:30.183 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:30.268 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2022-01-10T01:20:30.269 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHGAJ9FL4q3i3iafOTZRLDQ7UlhU0gD0Ex'], 'uuids': ['a3767c63-7e6d-4888-9899-3b61b0ac4882']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.110267", "end": "2022-01-10 01:20:30.241342", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHGAJ9FL4q3i3iafOTZRLDQ7UlhU0gD0Ex"], "labels": [], "masters": [], "uuids": ["a3767c63-7e6d-4888-9899-3b61b0ac4882"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:29.131075", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:30.313 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:30 +0000 (0:00:00.651) 0:02:34.988 ******** 2022-01-10T01:20:30.384 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:30.386 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:30.484 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRRe6pBdCG3Mkz4zCBUXL5QYvfboqdCGZAQR'], 'uuids': ['a7518f07-4f57-4791-bc4c-bacdb0b8c7c3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.159711", "end": "2022-01-10 01:20:30.451044", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRRe6pBdCG3Mkz4zCBUXL5QYvfboqdCGZAQR"], "labels": [], "masters": [], "uuids": ["a7518f07-4f57-4791-bc4c-bacdb0b8c7c3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:30.291333", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154643 s, 746 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154643 s, 746 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:31.288 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS', 'wwn-0x5000c500871b68bf'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1', 'wwn-0x5000c500871b68bf-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871b68bf', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4J2QS', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS", "wwn-0x5000c500871b68bf"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2QS-part1", "wwn-0x5000c500871b68bf-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2QS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b68bf"}}, 2022-01-10T01:20:31.290 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHxFOMz0YZ9vM5ayipiv834SaMwoOt52o4'], 'uuids': ['4bc95945-d550-41c0-878c-4e0625f33dd3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.159211", "end": "2022-01-10 01:20:30.646701", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHxFOMz0YZ9vM5ayipiv834SaMwoOt52o4"], "labels": [], "masters": [], "uuids": ["4bc95945-d550-41c0-878c-4e0625f33dd3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:30.487490", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154151 s, 748 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154151 s, 748 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 2022-01-10T01:20:31.292 INFO:teuthology.task.ansible.out: 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-mJQ3Pu-EYqe-L6mK-pgeh-KUDr-m3Bg-w90gOD', 'nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN', 'nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.056742", "end": "2022-01-10 01:20:30.660184", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-mJQ3Pu-EYqe-L6mK-pgeh-KUDr-m3Bg-w90gOD", "nvme-INTEL_SSDPEDMD400G4_CVFT53300040400BGN", "nvme-nvme.8086-43564654353333303030343034303042474e-494e54454c205353445 2022-01-10T01:20:31.293 INFO:teuthology.task.ansible.out:045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:30.603442", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0517201 s, 2.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0517201 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_dis 2022-01-10T01:20:31.296 INFO:teuthology.task.ansible.out:card': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDMssAAHjedbCJduaDQ1YQWledYDbV03NT'], 'uuids': ['6df6abf0-ae8c-47f3-ad4d-e9ae9c9fc575']}, 'sas_device_handle': None, 'sas_address': None, 'vir 2022-01-10T01:20:31.297 INFO:teuthology.task.ansible.out:tual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.117379", "end": "2022-01-10 01:20:30.730023", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDMssAAHjedbCJduaDQ1YQWledYDbV03NT"], "labels": [], "masters": [], "uuids": ["6df6abf0-ae8c-47f3-ad4d-e9ae9c9fc575"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:29.612644", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => 2022-01-10T01:20:31.299 INFO:teuthology.task.ansible.out:{"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHW67P00WhEVs11JgfyFsidFzzsXD8iLgh'], 'uuids': ['122af64d-3aa8-4afe-a856-588d48cc4352']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.161910", "end": "2022-01-10 01:20:30.958304", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHW67P00WhEVs11JgfyFsidFzzsXD8iLgh"], "labels": [], "masters": [], "uuids": ["122af64d-3aa8-4afe-a856-588d48cc4352"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:30.796394", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158615 s, 727 MB/s", " 2022-01-10T01:20:31.301 INFO:teuthology.task.ansible.out:stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158615 s, 727 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:31.301 INFO:teuthology.task.ansible.out: 2022-01-10T01:20:31.303 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRReKOZtk0x6tQT6fh0cJ3M3GEYnedNirY1m'], 'uuids': ['45eeff84-7da7-4d37-88cb-4e42f46f9741']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.152119", "end": "2022-01-10 01:20:30.969030", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRReKOZtk0x6tQT6fh0cJ3M3GEYnedNirY1m"], "labels": [], "masters": [], "uuids": ["45eeff84-7da7-4d37-88cb-4e42f46f9741"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:30.816911", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.14781 s, 780 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.14781 s, 780 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:31.305 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2P7', 'wwn-0x5000c500871b7b3d'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4J2P7-part1', 'wwn-0x5000c500871b7b3d-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871b7b3d', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4J2P7', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2P7", "wwn-0x5000c500871b7b3d"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2P7-part1", "wwn-0x5000c500871b7b3d-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2P7", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b7b3d"}}, 2022-01-10T01:20:31.306 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:31.308 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-quPQNx-7TH8-rMWl-Yhky-mdls-3kmd-IkYVQW', 'nvme-INTEL_SSDPEDMD400G4_CVFT5330009L400BGN', 'nvme-nvme.8086-43564654353333303030394c34303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.057820", "end": "2022-01-10 01:20:31.161026", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-quPQNx-7TH8-rMWl-Yhky-mdls-3kmd-IkYVQW", "nvme-INTEL_SSDPEDMD400G4_CVFT5330009L400BGN", "nvme-nvme.8086-43564654353333303030394c34303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:31.103206", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0528402 s, 2.2 GB/s", "std 2022-01-10T01:20:31.310 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0528402 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:31.310 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result wa 2022-01-10T01:20:31.312 INFO:teuthology.task.ansible.out:s False"} TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9HfIG9wnHzLipPllVk0KaRIG2U0HuHodU'], 'uuids': ['8daad6dc-5d05-43d2-a178-a7ebcabf37d9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.135561", "end": "2022-01-10 01:20:31.208330", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9HfIG9wnHzLipPllVk0KaRIG2U0HuHodU"], "labels": [], "masters": [], "uuids": ["8daad6dc-5d05-43d2-a178-a7ebcabf37d9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:30.072769", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! Y 2022-01-10T01:20:31.313 INFO:teuthology.task.ansible.out:ou may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:31.314 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRReEzyEt6pVkLq8BM1BYH7L1YKdEwnjz17y'], 'uuids': ['1d53dde2-3861-4e1e-8645-e903262baafc']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.165592", "end": "2022-01-10 01:20:31.276443", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRReEzyEt6pVkLq8BM1BYH7L1YKdEwnjz17y" 2022-01-10T01:20:31.316 INFO:teuthology.task.ansible.out:], "labels": [], "masters": [], "uuids": ["1d53dde2-3861-4e1e-8645-e903262baafc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:31.110851", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.16056 s, 718 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.16056 s, 718 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:31.326 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:31.490 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHah6RIFvWlI2oP75D0mgGNYtQLzd0IUJq'], 'uuids': ['85899711-b628-45c0-802e-ece7fe18f449']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.156350", "end": "2022-01-10 01:20:31.464713", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHah6RIFvWlI2oP75D0mgGNYtQLzd0IUJq"], "labels": [], "masters": [], "uuids": ["85899711-b628-45c0-802e-ece7fe18f449"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:31.308363", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152418 s, 757 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152418 s, 757 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:31.503 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:31.515 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:31.615 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRRel9FXrPKKO6SQGI7IMiShFYJFrWKKkoEd'], 'uuids': ['0771075c-16c7-4577-a6de-c995d2406aae']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.164032", "end": "2022-01-10 01:20:31.586139", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-aDp8Hc0ijc0lIrWnlKqfMcM5Pwo2mRRel9FXrPKKO6SQGI7IMiShFYJFrWKKkoEd"], "labels": [], "masters": [], "uuids": ["0771075c-16c7-4577-a6de-c995d2406aae"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:31.422107", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159128 s, 725 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159128 s, 725 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:31.648 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:31 +0000 (0:00:01.335) 0:02:36.323 ******** 2022-01-10T01:20:31.818 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHsTvZCUXqrbE5D6XExgLAJ2XnVRsoAQoF'], 'uuids': ['2f344a50-1ecb-4ed3-94a7-50ab14049ae7']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.163117", "end": "2022-01-10 01:20:31.789335", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHsTvZCUXqrbE5D6XExgLAJ2XnVRsoAQoF"], "labels": [], "masters": [], "uuids": ["2f344a50-1ecb-4ed3-94a7-50ab14049ae7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:31.626218", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158075 s, 730 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158075 s, 730 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:31.830 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:31.949 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2022-01-10T01:20:31.953 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.141572", "end": "2022-01-10 01:20:31.921328", "rc": 0, "start": "2022-01-10 01:20:31.779756", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:31.979 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:31 +0000 (0:00:00.330) 0:02:36.653 ******** 2022-01-10T01:20:32.009 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2022-01-10T01:20:32.012 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDajcF5GOcwEbIaXuxZqCeWTmuu9ntqsKu'], 'uuids': ['46b83fd2-96ef-4a1d-8c3d-12e7b6d352af']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.115876", "end": "2022-01-10 01:20:31.981957", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDajcF5GOcwEbIaXuxZqCeWTmuu9ntqsKu"], "labels": [], "masters": [], "uuids": ["46b83fd2-96ef-4a1d-8c3d-12e7b6d352af"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:30.866081", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:32.212 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.233) 0:02:36.887 ******** 2022-01-10T01:20:32.222 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:32.223 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHGAJ9FL4q3i3iafOTZRLDQ7UlhU0gD0Ex'], 'uuids': ['a3767c63-7e6d-4888-9899-3b61b0ac4882']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.162277", "end": "2022-01-10 01:20:32.089571", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-U4D7Ck1311bpzfOdc7oPjRLcgel79XvHGAJ9FL4q3i3iafOTZRLDQ7UlhU0gD0Ex"], "labels": [], "masters": [], "uuids": ["a3767c63-7e6d-4888-9899-3b61b0ac4882"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:31.927294", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157262 s, 733 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157262 s, 733 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:32.235 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2022-01-10T01:20:32.236 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.078324", "end": "2022-01-10 01:20:32.178352", "rc": 0, "start": "2022-01-10 01:20:32.100028", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:32.263 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.050) 0:02:36.938 ******** 2022-01-10T01:20:32.287 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.023) 0:02:36.962 ******** 2022-01-10T01:20:32.295 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:32.297 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Remove physical volumes] ************************************** 2022-01-10T01:20:32.330 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.043) 0:02:37.005 ******** 2022-01-10T01:20:32.358 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2022-01-10T01:20:32.360 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:32.398 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.068) 0:02:37.073 ******** 2022-01-10T01:20:32.426 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2022-01-10T01:20:32.428 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:32.453 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.054) 0:02:37.127 ******** 2022-01-10T01:20:32.484 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2022-01-10T01:20:32.485 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:32.517 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.064) 0:02:37.192 ******** 2022-01-10T01:20:32.525 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2022-01-10T01:20:32.526 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9lGdiMKaUUTF2J8oUoUmQ0FDZu8Kxx3iO'], 'uuids': ['145d0bd6-e88e-4013-9305-8cb429ae2c8f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.124990", "end": "2022-01-10 01:20:32.486500", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9lGdiMKaUUTF2J8oUoUmQ0FDZu8Kxx3iO"], "labels": [], "masters": [], "uuids": ["145d0bd6-e88e-4013-9305-8cb429ae2c8f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:31.361510", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2022-01-10T01:20:32.573 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.055) 0:02:37.247 ******** 2022-01-10T01:20:32.581 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2022-01-10T01:20:32.582 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:32.584 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDSifWY445291TD1v0LjMfVs2IRxfWmp9q'], 'uuids': ['6512e23c-0793-4d71-8ced-382b299be298']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.165302", "end": "2022-01-10 01:20:32.533933", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDSifWY445291TD1v0LjMfVs2IRxfWmp9q"], "labels": [], "masters": [], "uuids": ["6512e23c-0793-4d71-8ced-382b299be298"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:32.368631", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.160457 s, 719 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.160457 s, 719 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:32.585 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:32.587 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:32.589 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi059.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.148055", "end": "2022-01-10 01:20:32.557111", "rc": 0, "start": "2022-01-10 01:20:32.409056", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:32.617 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.043) 0:02:37.291 ******** 2022-01-10T01:20:32.642 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.025) 0:02:37.317 ******** 2022-01-10T01:20:32.650 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:32.651 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:32.758 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2022-01-10T01:20:32.760 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:20:32.785 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.142) 0:02:37.459 ******** 2022-01-10T01:20:32.834 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2022-01-10T01:20:32.836 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'block_used': 14052051, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226043057, 'size_available': 925872361472, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187085, 'block_size': 4096, 'inode_available': 60867891}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226043057, "block_size": 4096, "block_total": 240095108, "block_used": 14052051, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867891, "inode_total": 61054976, "inode_used": 187085, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925872361472, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:32.865 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.080) 0:02:37.540 ******** 2022-01-10T01:20:32.873 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2022-01-10T01:20:32.875 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.074774", "end": "2022-01-10 01:20:32.838211", "rc": 0, "start": "2022-01-10 01:20:32.763437", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:32.876 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:32.876 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MD5srju3WJrJuwquteHodtZH0SKAdoEOdN'], 'uuids': ['7b3a22dc-c37e-4865-afe5-0484fe647d10']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.161661", "end": "2022-01-10 01:20:32.841139", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MD5srju3WJrJuwquteHodtZH0SKAdoEOdN"], "labels": [], "masters": [], "uuids": ["7b3a22dc-c37e-4865-afe5-0484fe647d10"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:32.679478", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158543 s, 728 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158543 s, 728 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:32.878 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XMNS', 'wwn-0x5000c5009293883c'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XMNS-part1', 'wwn-0x5000c5009293883c-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293883c', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XMNS', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XMNS", "wwn-0x5000c5009293883c"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XMNS-part1", "wwn-0x5000c5009293883c-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XMNS", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293883c"}}, 2022-01-10T01:20:32.880 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2022-01-10T01:20:32.904 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.038) 0:02:37.578 ******** 2022-01-10T01:20:32.911 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2022-01-10T01:20:32.913 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:32.937 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.033) 0:02:37.612 ******** 2022-01-10T01:20:32.945 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:32.946 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9pmybGGpI9PFVA9HdglP8opdR9MGJ0bLm'], 'uuids': ['23c8d513-c21b-4cc4-b4f3-095532a7778b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.162427", "end": "2022-01-10 01:20:32.895422", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9pmybGGpI9PFVA9HdglP8opdR9MGJ0bLm"], "labels": [], "masters": [], "uuids": ["23c8d513-c21b-4cc4-b4f3-095532a7778b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:32.732995", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157389 s, 733 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157389 s, 733 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:32.947 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2022-01-10T01:20:32.948 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:32.949 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:32.978 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:32 +0000 (0:00:00.040) 0:02:37.653 ******** 2022-01-10T01:20:32.986 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.012 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.034) 0:02:37.687 ******** 2022-01-10T01:20:33.020 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2022-01-10T01:20:33.021 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.049 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.036) 0:02:37.724 ******** 2022-01-10T01:20:33.057 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:33.058 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.082 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.033) 0:02:37.757 ******** 2022-01-10T01:20:33.090 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:33.091 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-905l2U-Y6zO-4dKj-vQ3M-Wxxi-iBb2-wPfXKE', 'nvme-INTEL_SSDPEDMD400G4_PHFT620401AC400BGN', 'nvme-nvme.8086-50484654363230343031414334303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.059476", "end": "2022-01-10 01:20:33.036807", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-905l2U-Y6zO-4dKj-vQ3M-Wxxi-iBb2-wPfXKE", "nvme-INTEL_SSDPEDMD400G4_PHFT620401AC400BGN", "nvme-nvme.8086-50484654363230343031414334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:32.977331", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0546447 s, 2.1 GB/s", "std 2022-01-10T01:20:33.093 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0546447 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.094 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.125 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.042) 0:02:37.800 ******** 2022-01-10T01:20:33.133 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2022-01-10T01:20:33.135 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.159 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.033) 0:02:37.834 ******** 2022-01-10T01:20:33.167 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2022-01-10T01:20:33.169 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.197 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.037) 0:02:37.871 ******** 2022-01-10T01:20:33.204 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2022-01-10T01:20:33.206 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.231 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.034) 0:02:37.906 ******** 2022-01-10T01:20:33.239 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2022-01-10T01:20:33.240 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:33.242 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9v5WXWIjqLxcZ7Etdnsvmr1SV9LUAnU1F'], 'uuids': ['65a25d1a-f38a-4b11-a7ec-8415ecda3478']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.167231", "end": "2022-01-10 01:20:33.208184", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9v5WXWIjqLxcZ7Etdnsvmr1SV9LUAnU1F"], "labels": [], "masters": [], "uuids": ["65a25d1a-f38a-4b11-a7ec-8415ecda3478"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:33.040953", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.16392 s, 704 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.16392 s, 704 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:33.266 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.034) 0:02:37.941 ******** 2022-01-10T01:20:33.274 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFR4', 'wwn-0x5000c500929226ed'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XFR4-part1', 'wwn-0x5000c500929226ed-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500929226ed', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XFR4', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFR4", "wwn-0x5000c500929226ed"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XFR4-part1", "wwn-0x5000c500929226ed-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XFR4", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500929226ed"}}, 2022-01-10T01:20:33.276 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.303 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.036) 0:02:37.977 ******** 2022-01-10T01:20:33.374 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:33.376 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDvh61l81C0FE9SQjQd4LBCMgAcfvGgVWQ'], 'uuids': ['a8e5496a-561e-4a3f-a4b6-3725e64b89ae']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.157021", "end": "2022-01-10 01:20:33.343879", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDvh61l81C0FE9SQjQd4LBCMgAcfvGgVWQ"], "labels": [], "masters": [], "uuids": ["a8e5496a-561e-4a3f-a4b6-3725e64b89ae"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:33.186858", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151813 s, 760 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151813 s, 760 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:33.387 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.398 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.410 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2022-01-10T01:20:33.412 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:20:33.436 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.133) 0:02:38.111 ******** 2022-01-10T01:20:33.444 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:33.445 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-1r3u2e-gv71-31HN-7gA5-xoAm-canx-7KgKBu', 'nvme-INTEL_SSDPEDMD400G4_PHFT620500N6400BGN', 'nvme-nvme.8086-504846543632303530304e3634303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.055231", "end": "2022-01-10 01:20:33.398189", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-1r3u2e-gv71-31HN-7gA5-xoAm-canx-7KgKBu", "nvme-INTEL_SSDPEDMD400G4_PHFT620500N6400BGN", "nvme-nvme.8086-504846543632303530304e3634303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:33.342958", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0503169 s, 2.3 GB/s", "std 2022-01-10T01:20:33.447 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0503169 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.448 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.482 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi059.front.sepia.ceph.com] => (item={'block_used': 14052050, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226043058, 'size_available': 925872365568, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187085, 'block_size': 4096, 'inode_available': 60867891}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226043058, "block_size": 4096, "block_total": 240095108, "block_used": 14052050, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867891, "inode_total": 61054976, "inode_used": 187085, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925872365568, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.509 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.073) 0:02:38.184 ******** 2022-01-10T01:20:33.538 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2022-01-10T01:20:33.540 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.563 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.053) 0:02:38.238 ******** 2022-01-10T01:20:33.601 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:33.603 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.626 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.063) 0:02:38.301 ******** 2022-01-10T01:20:33.655 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:33.656 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.679 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.052) 0:02:38.354 ******** 2022-01-10T01:20:33.703 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:33.704 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDMssAAHjedbCJduaDQ1YQWledYDbV03NT'], 'uuids': ['6df6abf0-ae8c-47f3-ad4d-e9ae9c9fc575']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.164245", "end": "2022-01-10 01:20:33.655510", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDMssAAHjedbCJduaDQ1YQWledYDbV03NT"], "labels": [], "masters": [], "uuids": ["6df6abf0-ae8c-47f3-ad4d-e9ae9c9fc575"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:33.491265", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159258 s, 724 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159258 s, 724 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:33.705 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.716 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.745 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.066) 0:02:38.420 ******** 2022-01-10T01:20:33.753 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:33.754 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9Dy2OZhE8cro18ozJaNCK8uFs3jDwiSCn'], 'uuids': ['27373078-03ca-459d-86dc-6113fb033521']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.160222", "end": "2022-01-10 01:20:33.710710", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9Dy2OZhE8cro18ozJaNCK8uFs3jDwiSCn"], "labels": [], "masters": [], "uuids": ["27373078-03ca-459d-86dc-6113fb033521"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:33.550488", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155358 s, 742 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155358 s, 742 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:33.756 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.768 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.779 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.803 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.058) 0:02:38.478 ******** 2022-01-10T01:20:33.831 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2022-01-10T01:20:33.833 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:33.856 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:33 +0000 (0:00:00.052) 0:02:38.531 ******** 2022-01-10T01:20:33.979 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2022-01-10T01:20:33.981 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2022-01-10T01:20:34.007 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:34 +0000 (0:00:00.150) 0:02:38.681 ******** 2022-01-10T01:20:34.017 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2022-01-10T01:20:34.018 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDajcF5GOcwEbIaXuxZqCeWTmuu9ntqsKu'], 'uuids': ['46b83fd2-96ef-4a1d-8c3d-12e7b6d352af']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.166955", "end": "2022-01-10 01:20:33.964301", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-FME1tErIcUMCO3sYbrIJw8ViX1hOi0MDajcF5GOcwEbIaXuxZqCeWTmuu9ntqsKu"], "labels": [], "masters": [], "uuids": ["46b83fd2-96ef-4a1d-8c3d-12e7b6d352af"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:33.797346", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.162102 s, 712 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.162102 s, 712 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:34.057 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:34 +0000 (0:00:00.050) 0:02:38.732 ******** 2022-01-10T01:20:34.069 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9HfIG9wnHzLipPllVk0KaRIG2U0HuHodU'], 'uuids': ['8daad6dc-5d05-43d2-a178-a7ebcabf37d9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.161308", "end": "2022-01-10 01:20:34.017721", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9HfIG9wnHzLipPllVk0KaRIG2U0HuHodU"], "labels": [], "masters": [], "uuids": ["8daad6dc-5d05-43d2-a178-a7ebcabf37d9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:33.856413", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156338 s, 738 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156338 s, 738 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:34.071 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:34.349 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9lGdiMKaUUTF2J8oUoUmQ0FDZu8Kxx3iO'], 'uuids': ['145d0bd6-e88e-4013-9305-8cb429ae2c8f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.164677", "end": "2022-01-10 01:20:34.325130", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-DbcMCvBkzdezamSHgJFCQvRKzBxaZ0T9lGdiMKaUUTF2J8oUoUmQ0FDZu8Kxx3iO"], "labels": [], "masters": [], "uuids": ["145d0bd6-e88e-4013-9305-8cb429ae2c8f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2022-01-10 01:20:34.160453", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159723 s, 722 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159723 s, 722 MB/s"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:34.386 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:34 +0000 (0:00:00.328) 0:02:39.060 ******** 2022-01-10T01:20:34.393 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2022-01-10T01:20:34.395 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.174085", "end": "2022-01-10 01:20:34.352862", "rc": 0, "start": "2022-01-10 01:20:34.178777", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:34.424 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:34 +0000 (0:00:00.038) 0:02:39.099 ******** 2022-01-10T01:20:34.431 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2022-01-10T01:20:34.433 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2022-01-10T01:20:34.460 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:34 +0000 (0:00:00.036) 0:02:39.135 ******** 2022-01-10T01:20:34.595 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:34.597 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:34.638 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2022-01-10T01:20:34.640 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.079243", "end": "2022-01-10 01:20:34.617865", "rc": 0, "start": "2022-01-10 01:20:34.538622", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:34.666 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:34 +0000 (0:00:00.205) 0:02:39.341 ******** 2022-01-10T01:20:34.673 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2022-01-10T01:20:34.675 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.130957", "end": "2022-01-10 01:20:34.634778", "rc": 0, "start": "2022-01-10 01:20:34.503821", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:34.701 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:34 +0000 (0:00:00.034) 0:02:39.375 ******** 2022-01-10T01:20:34.708 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2022-01-10T01:20:34.741 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:34 +0000 (0:00:00.039) 0:02:39.415 ******** 2022-01-10T01:20:34.769 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2022-01-10T01:20:34.771 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:34.796 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:34 +0000 (0:00:00.055) 0:02:39.471 ******** 2022-01-10T01:20:34.824 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2022-01-10T01:20:34.826 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:34.849 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:34 +0000 (0:00:00.052) 0:02:39.524 ******** 2022-01-10T01:20:34.877 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2022-01-10T01:20:34.879 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:34.904 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:34 +0000 (0:00:00.054) 0:02:39.579 ******** 2022-01-10T01:20:34.914 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:34.925 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2022-01-10T01:20:34.927 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.081944", "end": "2022-01-10 01:20:34.899841", "rc": 0, "start": "2022-01-10 01:20:34.817897", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:34.953 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:34 +0000 (0:00:00.048) 0:02:39.628 ******** 2022-01-10T01:20:34.963 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2022-01-10T01:20:34.965 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:34.995 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:34 +0000 (0:00:00.041) 0:02:39.669 ******** 2022-01-10T01:20:35.001 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2022-01-10T01:20:35.002 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:35.004 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:35.033 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.038) 0:02:39.707 ******** 2022-01-10T01:20:35.061 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2022-01-10T01:20:35.062 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.087 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.054) 0:02:39.762 ******** 2022-01-10T01:20:35.115 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2022-01-10T01:20:35.117 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.146 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.058) 0:02:39.821 ******** 2022-01-10T01:20:35.154 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2022-01-10T01:20:35.156 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2022-01-10T01:20:35.183 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.036) 0:02:39.858 ******** 2022-01-10T01:20:35.190 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2022-01-10T01:20:35.192 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.222 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.039) 0:02:39.897 ******** 2022-01-10T01:20:35.229 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2022-01-10T01:20:35.232 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'block_used': 14052042, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226043066, 'size_available': 925872398336, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187084, 'block_size': 4096, 'inode_available': 60867892}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226043066, "block_size": 4096, "block_total": 240095108, "block_used": 14052042, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867892, "inode_total": 61054976, "inode_used": 187084, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925872398336, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.261 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.038) 0:02:39.935 ******** 2022-01-10T01:20:35.270 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2022-01-10T01:20:35.272 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.308 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.047) 0:02:39.983 ******** 2022-01-10T01:20:35.318 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2022-01-10T01:20:35.319 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:35.320 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:35.353 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.044) 0:02:40.027 ******** 2022-01-10T01:20:35.395 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:35.397 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.423 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.069) 0:02:40.097 ******** 2022-01-10T01:20:35.451 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2022-01-10T01:20:35.453 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : set_fact] ***************************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.479 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.056) 0:02:40.154 ******** 2022-01-10T01:20:35.513 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.033) 0:02:40.188 ******** 2022-01-10T01:20:35.534 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2022-01-10T01:20:35.535 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'block_used': 14052033, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226043075, 'size_available': 925872435200, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 187084, 'block_size': 4096, 'inode_available': 60867892}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226043075, "block_size": 4096, "block_total": 240095108, "block_used": 14052033, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60867892, "inode_total": 61054976, "inode_used": 187084, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 925872435200, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.559 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.046) 0:02:40.234 ******** 2022-01-10T01:20:35.566 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2022-01-10T01:20:35.568 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.594 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.034) 0:02:40.269 ******** 2022-01-10T01:20:35.601 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2022-01-10T01:20:35.603 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.626 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.031) 0:02:40.301 ******** 2022-01-10T01:20:35.633 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2022-01-10T01:20:35.635 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.664 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.037) 0:02:40.339 ******** 2022-01-10T01:20:35.672 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:35.674 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.706 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.040) 0:02:40.380 ******** 2022-01-10T01:20:35.712 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2022-01-10T01:20:35.714 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.738 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.033) 0:02:40.413 ******** 2022-01-10T01:20:35.745 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:35.747 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : set_fact] ***************************************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.774 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.035) 0:02:40.448 ******** 2022-01-10T01:20:35.782 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:35.808 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.832 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.058) 0:02:40.507 ******** 2022-01-10T01:20:35.860 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2022-01-10T01:20:35.862 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.884 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.051) 0:02:40.559 ******** 2022-01-10T01:20:35.922 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2022-01-10T01:20:35.924 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:35.947 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:35 +0000 (0:00:00.062) 0:02:40.622 ******** 2022-01-10T01:20:36.132 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:36.134 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:36.186 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:36.213 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:36 +0000 (0:00:00.266) 0:02:40.888 ******** 2022-01-10T01:20:36.327 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2022-01-10T01:20:36.330 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2022-01-10T01:20:36.356 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:36 +0000 (0:00:00.142) 0:02:41.031 ******** 2022-01-10T01:20:36.374 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2022-01-10T01:20:36.376 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2022-01-10T01:20:36.400 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:36 +0000 (0:00:00.044) 0:02:41.075 ******** 2022-01-10T01:20:36.473 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2022-01-10T01:20:36.475 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2022-01-10T01:20:36.502 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:36 +0000 (0:00:00.101) 0:02:41.177 ******** 2022-01-10T01:20:36.522 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:36.523 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:36.560 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:36 +0000 (0:00:00.058) 0:02:41.235 ******** 2022-01-10T01:20:36.579 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2022-01-10T01:20:36.580 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:36.708 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2022-01-10T01:20:36.710 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2022-01-10T01:20:36.710 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2022-01-10T01:20:36.711 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:36.738 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:36 +0000 (0:00:00.178) 0:02:41.413 ******** 2022-01-10T01:20:36.809 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:36.811 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:36.833 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2022-01-10T01:20:36.834 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:36.900 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:36.944 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:36.956 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:36.959 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:36.960 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:36.985 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:36 +0000 (0:00:00.246) 0:02:41.659 ******** 2022-01-10T01:20:37.015 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2022-01-10T01:20:37.017 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:37.040 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:37 +0000 (0:00:00.055) 0:02:41.715 ******** 2022-01-10T01:20:37.068 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2022-01-10T01:20:37.070 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:37.092 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:37 +0000 (0:00:00.051) 0:02:41.767 ******** 2022-01-10T01:20:37.141 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2022-01-10T01:20:37.143 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:37.195 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:37.197 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:37.239 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:20:37.271 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:37 +0000 (0:00:00.179) 0:02:41.946 ******** 2022-01-10T01:20:37.283 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2022-01-10T01:20:37.284 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:37.297 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:37.325 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:37 +0000 (0:00:00.053) 0:02:41.999 ******** 2022-01-10T01:20:37.337 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2022-01-10T01:20:37.370 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:37 +0000 (0:00:00.044) 0:02:42.044 ******** 2022-01-10T01:20:37.377 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2022-01-10T01:20:37.380 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:37.406 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:37 +0000 (0:00:00.036) 0:02:42.081 ******** 2022-01-10T01:20:37.414 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:37.415 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:37.439 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:37.463 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:37 +0000 (0:00:00.056) 0:02:42.138 ******** 2022-01-10T01:20:37.587 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:37.589 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:37.610 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2022-01-10T01:20:37.611 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:20:37.635 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:37 +0000 (0:00:00.172) 0:02:42.310 ******** 2022-01-10T01:20:37.673 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2022-01-10T01:20:37.675 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2022-01-10T01:20:37.701 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:37 +0000 (0:00:00.065) 0:02:42.376 ******** 2022-01-10T01:20:37.823 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:37.825 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:37.866 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2022-01-10T01:20:37.868 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true} 2022-01-10T01:20:37.894 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:37 +0000 (0:00:00.193) 0:02:42.569 ******** 2022-01-10T01:20:37.977 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:37.979 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi059.front.sepia.ceph.com] => {"changed": true} 2022-01-10T01:20:38.008 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.113) 0:02:42.682 ******** 2022-01-10T01:20:38.195 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:38.197 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:38.207 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2022-01-10T01:20:38.209 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2022-01-10T01:20:38.239 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.230) 0:02:42.913 ******** 2022-01-10T01:20:38.257 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2022-01-10T01:20:38.282 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.043) 0:02:42.957 ******** 2022-01-10T01:20:38.290 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2022-01-10T01:20:38.292 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:38.317 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.034) 0:02:42.992 ******** 2022-01-10T01:20:38.325 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:38.352 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.034) 0:02:43.027 ******** 2022-01-10T01:20:38.361 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2022-01-10T01:20:38.363 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:38.386 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.034) 0:02:43.061 ******** 2022-01-10T01:20:38.394 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:38.396 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:38.398 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:38.423 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.036) 0:02:43.098 ******** 2022-01-10T01:20:38.446 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.022) 0:02:43.121 ******** 2022-01-10T01:20:38.452 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2022-01-10T01:20:38.454 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:38.480 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.033) 0:02:43.154 ******** 2022-01-10T01:20:38.501 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.021) 0:02:43.176 ******** 2022-01-10T01:20:38.508 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2022-01-10T01:20:38.511 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:38.543 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.041) 0:02:43.218 ******** 2022-01-10T01:20:38.551 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:38.588 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.045) 0:02:43.263 ******** 2022-01-10T01:20:38.595 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2022-01-10T01:20:38.597 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2022-01-10T01:20:38.624 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.035) 0:02:43.299 ******** 2022-01-10T01:20:38.642 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2022-01-10T01:20:38.644 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2022-01-10T01:20:38.671 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.046) 0:02:43.346 ******** 2022-01-10T01:20:38.699 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2022-01-10T01:20:38.701 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2022-01-10T01:20:38.726 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.055) 0:02:43.401 ******** 2022-01-10T01:20:38.745 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2022-01-10T01:20:38.771 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.044) 0:02:43.446 ******** 2022-01-10T01:20:38.789 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2022-01-10T01:20:38.791 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:38.812 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2022-01-10T01:20:38.838 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.066) 0:02:43.513 ******** 2022-01-10T01:20:38.877 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2022-01-10T01:20:38.879 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:20:38.904 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.065) 0:02:43.578 ******** 2022-01-10T01:20:38.912 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2022-01-10T01:20:38.913 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:38.935 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2022-01-10T01:20:38.936 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:20:38.961 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:38 +0000 (0:00:00.056) 0:02:43.635 ******** 2022-01-10T01:20:38.999 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2022-01-10T01:20:39.000 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:39.032 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:39.117 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:39.150 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:39.161 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:39.189 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.228) 0:02:43.864 ******** 2022-01-10T01:20:39.216 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2022-01-10T01:20:39.217 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:39.241 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.052) 0:02:43.916 ******** 2022-01-10T01:20:39.248 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2022-01-10T01:20:39.250 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2022-01-10T01:20:39.261 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2022-01-10T01:20:39.263 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2022-01-10T01:20:39.293 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.051) 0:02:43.967 ******** 2022-01-10T01:20:39.301 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2022-01-10T01:20:39.302 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:39.328 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.035) 0:02:44.003 ******** 2022-01-10T01:20:39.335 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2022-01-10T01:20:39.337 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2022-01-10T01:20:39.364 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.036) 0:02:44.039 ******** 2022-01-10T01:20:39.372 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2022-01-10T01:20:39.374 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi139.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:39.412 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.047) 0:02:44.086 ******** 2022-01-10T01:20:39.442 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2022-01-10T01:20:39.444 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:39.467 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.054) 0:02:44.141 ******** 2022-01-10T01:20:39.484 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2022-01-10T01:20:39.486 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:20:39.509 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.042) 0:02:44.184 ******** 2022-01-10T01:20:39.516 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2022-01-10T01:20:39.518 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:39.543 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.033) 0:02:44.218 ******** 2022-01-10T01:20:39.549 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2022-01-10T01:20:39.551 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2022-01-10T01:20:39.576 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.033) 0:02:44.251 ******** 2022-01-10T01:20:39.637 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2022-01-10T01:20:39.662 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.085) 0:02:44.337 ******** 2022-01-10T01:20:39.681 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2022-01-10T01:20:39.683 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:20:39.707 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.045) 0:02:44.382 ******** 2022-01-10T01:20:39.729 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2022-01-10T01:20:39.731 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2022-01-10T01:20:39.754 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.046) 0:02:44.429 ******** 2022-01-10T01:20:39.761 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2022-01-10T01:20:39.763 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2022-01-10T01:20:39.787 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.032) 0:02:44.461 ******** 2022-01-10T01:20:39.867 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2022-01-10T01:20:39.869 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true} 2022-01-10T01:20:39.901 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:39 +0000 (0:00:00.114) 0:02:44.576 ******** 2022-01-10T01:20:40.067 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true} 2022-01-10T01:20:40.093 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.191) 0:02:44.768 ******** 2022-01-10T01:20:40.133 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2022-01-10T01:20:40.134 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2022-01-10T01:20:40.160 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.066) 0:02:44.835 ******** 2022-01-10T01:20:40.188 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2022-01-10T01:20:40.190 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:40.213 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.052) 0:02:44.888 ******** 2022-01-10T01:20:40.241 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:40.264 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.051) 0:02:44.939 ******** 2022-01-10T01:20:40.291 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2022-01-10T01:20:40.293 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:40.316 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.051) 0:02:44.990 ******** 2022-01-10T01:20:40.343 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2022-01-10T01:20:40.345 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:40.368 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.052) 0:02:45.043 ******** 2022-01-10T01:20:40.376 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2022-01-10T01:20:40.378 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": false} 2022-01-10T01:20:40.404 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.035) 0:02:45.079 ******** 2022-01-10T01:20:40.454 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:40.480 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.075) 0:02:45.155 ******** 2022-01-10T01:20:40.531 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2022-01-10T01:20:40.533 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2022-01-10T01:20:40.558 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.077) 0:02:45.233 ******** 2022-01-10T01:20:40.659 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2022-01-10T01:20:40.661 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.110420", "end": "2022-01-10 01:20:40.639369", "rc": 0, "start": "2022-01-10 01:20:40.528949", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2022-01-10T01:20:40.685 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.127) 0:02:45.360 ******** 2022-01-10T01:20:40.713 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2022-01-10T01:20:40.715 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:40.737 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.051) 0:02:45.412 ******** 2022-01-10T01:20:40.745 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2022-01-10T01:20:40.746 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:20:40.774 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.036) 0:02:45.449 ******** 2022-01-10T01:20:40.781 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2022-01-10T01:20:40.783 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.117688", "end": "2022-01-10 01:20:40.728650", "rc": 0, "start": "2022-01-10 01:20:40.610962", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:40.815 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.041) 0:02:45.490 ******** 2022-01-10T01:20:40.842 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.026) 0:02:45.517 ******** 2022-01-10T01:20:40.881 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2022-01-10T01:20:40.883 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:40.906 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.063) 0:02:45.581 ******** 2022-01-10T01:20:40.934 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2022-01-10T01:20:40.936 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:40.959 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:40 +0000 (0:00:00.053) 0:02:45.634 ******** 2022-01-10T01:20:41.134 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2022-01-10T01:20:41.136 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2022-01-10T01:20:41.163 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:41 +0000 (0:00:00.203) 0:02:45.837 ******** 2022-01-10T01:20:41.338 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2022-01-10T01:20:41.340 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2022-01-10T01:20:41.363 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:41 +0000 (0:00:00.200) 0:02:46.038 ******** 2022-01-10T01:20:41.392 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2022-01-10T01:20:41.393 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:41.414 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:41 +0000 (0:00:00.051) 0:02:46.089 ******** 2022-01-10T01:20:41.441 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2022-01-10T01:20:41.443 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:41.465 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:41 +0000 (0:00:00.050) 0:02:46.139 ******** 2022-01-10T01:20:41.492 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2022-01-10T01:20:41.494 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:41.516 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:41 +0000 (0:00:00.051) 0:02:46.191 ******** 2022-01-10T01:20:41.522 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2022-01-10T01:20:41.524 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2022-01-10T01:20:41.548 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:41 +0000 (0:00:00.031) 0:02:46.222 ******** 2022-01-10T01:20:41.553 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2022-01-10T01:20:41.555 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": false} TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:41.588 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:41 +0000 (0:00:00.040) 0:02:46.262 ******** 2022-01-10T01:20:41.611 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:41 +0000 (0:00:00.023) 0:02:46.286 ******** 2022-01-10T01:20:41.619 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2022-01-10T01:20:41.621 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:41.646 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:41 +0000 (0:00:00.034) 0:02:46.320 ******** 2022-01-10T01:20:41.663 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2022-01-10T01:20:41.665 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:41.693 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:41 +0000 (0:00:00.047) 0:02:46.368 ******** 2022-01-10T01:20:41.722 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2022-01-10T01:20:41.724 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:41.751 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:41 +0000 (0:00:00.057) 0:02:46.425 ******** 2022-01-10T01:20:41.779 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2022-01-10T01:20:41.781 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2022-01-10T01:20:41.808 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:41 +0000 (0:00:00.057) 0:02:46.483 ******** 2022-01-10T01:20:41.974 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2022-01-10T01:20:41.976 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:20:42.010 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.201) 0:02:46.685 ******** 2022-01-10T01:20:42.020 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2022-01-10T01:20:42.020 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2022-01-10T01:20:42.049 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.038) 0:02:46.724 ******** 2022-01-10T01:20:42.077 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2022-01-10T01:20:42.079 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:42.103 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.054) 0:02:46.778 ******** 2022-01-10T01:20:42.111 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2022-01-10T01:20:42.112 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2022-01-10T01:20:42.141 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.037) 0:02:46.815 ******** 2022-01-10T01:20:42.168 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2022-01-10T01:20:42.170 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:42.192 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.051) 0:02:46.866 ******** 2022-01-10T01:20:42.230 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2022-01-10T01:20:42.232 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:42.257 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.064) 0:02:46.931 ******** 2022-01-10T01:20:42.318 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2022-01-10T01:20:42.329 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:16:58 UTC", "ActiveEnterTimestampMonotonic": "17027027", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target basic.target sysinit.target system.slice systemd-journald.socket -.mount systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:16:57 UTC", "AssertTimestampMonotonic": "16848532", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:16:57 UTC", "ConditionTimestampMonotonic": "16848531", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2022-01-10T01:20:42.331 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "831", "ExecMainStartTimestamp": "Mon 2022-01-10 01:16:58 UTC", "ExecMainStartTimestampMonotonic": "17027014", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2022-01-10 01:16:57 UTC", "InactiveExitTimestampMonotonic": "16849368", "InvocationID": "d50f69b56dca44888813b48b386472f1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2022-01-10T01:20:42.333 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "831", "MemoryAccounting": "yes", "MemoryCurrent": "3735552", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "Requi 2022-01-10T01:20:42.334 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:16:58 UTC", "StateChangeTimestampMonotonic": "17027027", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38334", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2022-01-10T01:20:42.355 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.098) 0:02:47.030 ******** 2022-01-10T01:20:42.373 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2022-01-10T01:20:42.375 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2022-01-10T01:20:42.398 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.043) 0:02:47.073 ******** 2022-01-10T01:20:42.407 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:42.409 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2022-01-10T01:20:42.434 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.035) 0:02:47.108 ******** 2022-01-10T01:20:42.442 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2022-01-10T01:20:42.443 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:16:57 UTC", "ActiveEnterTimestampMonotonic": "16853894", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target sysinit.target -.mount systemd-tmpfiles-setup.service systemd-journald.socket basic.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:16:57 UTC", "AssertTimestampMonotonic": "16628528", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:16:57 UTC", "ConditionTimestampMonotonic": "16628526", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2022-01-10T01:20:42.445 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "829", "ExecMainStartTimestamp": "Mon 2022-01-10 01:16:57 UTC", "ExecMainStartTimestampMonotonic": "16853881", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2022-01-10 01:16:57 UTC", "InactiveExitTimestampMonotonic": "16629629", "InvocationID": "d0ea25fe03564f349e61395f789f7ad4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2022-01-10T01:20:42.447 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "829", "MemoryAccounting": "yes", "MemoryCurrent": "3846144", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "Requi 2022-01-10T01:20:42.448 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:16:57 UTC", "StateChangeTimestampMonotonic": "16853894", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38334", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2022-01-10T01:20:42.471 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.037) 0:02:47.146 ******** 2022-01-10T01:20:42.479 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:42.481 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2022-01-10T01:20:42.505 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.034) 0:02:47.180 ******** 2022-01-10T01:20:42.514 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:42.515 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2022-01-10T01:20:42.540 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.035) 0:02:47.215 ******** 2022-01-10T01:20:42.548 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2022-01-10T01:20:42.550 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.130973", "end": "2022-01-10 01:20:42.507960", "rc": 0, "start": "2022-01-10 01:20:42.376987", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:42.582 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.041) 0:02:47.256 ******** 2022-01-10T01:20:42.610 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.027) 0:02:47.284 ******** 2022-01-10T01:20:42.617 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:42.619 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2022-01-10T01:20:42.645 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.035) 0:02:47.320 ******** 2022-01-10T01:20:42.652 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2022-01-10T01:20:42.654 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:42.680 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.035) 0:02:47.355 ******** 2022-01-10T01:20:42.688 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2022-01-10T01:20:42.689 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:42.716 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.036) 0:02:47.391 ******** 2022-01-10T01:20:42.725 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2022-01-10T01:20:42.726 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:42.765 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.048) 0:02:47.439 ******** 2022-01-10T01:20:42.774 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2022-01-10T01:20:42.776 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2022-01-10T01:20:42.805 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:42 +0000 (0:00:00.040) 0:02:47.480 ******** 2022-01-10T01:20:43.452 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2022-01-10T01:20:43.454 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:43.479 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:43 +0000 (0:00:00.673) 0:02:48.154 ******** 2022-01-10T01:20:43.507 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2022-01-10T01:20:43.508 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:43.532 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:43 +0000 (0:00:00.052) 0:02:48.206 ******** 2022-01-10T01:20:43.557 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:43 +0000 (0:00:00.025) 0:02:48.232 ******** 2022-01-10T01:20:43.629 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2022-01-10T01:20:43.631 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": false} 2022-01-10T01:20:43.655 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:43 +0000 (0:00:00.098) 0:02:48.330 ******** 2022-01-10T01:20:43.685 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2022-01-10T01:20:43.687 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:43.709 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:43 +0000 (0:00:00.053) 0:02:48.384 ******** 2022-01-10T01:20:43.812 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2022-01-10T01:20:43.814 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:43.838 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:43 +0000 (0:00:00.128) 0:02:48.513 ******** 2022-01-10T01:20:43.845 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2022-01-10T01:20:43.847 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.146710", "end": "2022-01-10 01:20:43.804878", "rc": 0, "start": "2022-01-10 01:20:43.658168", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2022-01-10T01:20:43.872 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:43 +0000 (0:00:00.033) 0:02:48.547 ******** 2022-01-10T01:20:43.879 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2022-01-10T01:20:43.881 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:43.905 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:43 +0000 (0:00:00.032) 0:02:48.580 ******** 2022-01-10T01:20:43.912 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2022-01-10T01:20:43.914 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:43.914 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2022-01-10T01:20:43.915 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2022-01-10T01:20:43.948 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:43 +0000 (0:00:00.043) 0:02:48.623 ******** 2022-01-10T01:20:43.971 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:43 +0000 (0:00:00.023) 0:02:48.646 ******** 2022-01-10T01:20:43.995 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:43 +0000 (0:00:00.023) 0:02:48.670 ******** 2022-01-10T01:20:44.003 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2022-01-10T01:20:44.005 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:44.029 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:44 +0000 (0:00:00.033) 0:02:48.704 ******** 2022-01-10T01:20:44.035 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2022-01-10T01:20:44.037 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:44.062 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:44 +0000 (0:00:00.033) 0:02:48.737 ******** 2022-01-10T01:20:44.090 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2022-01-10T01:20:44.092 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2022-01-10T01:20:44.116 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:44 +0000 (0:00:00.053) 0:02:48.791 ******** 2022-01-10T01:20:44.282 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2022-01-10T01:20:44.283 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:17:00 UTC", "ActiveEnterTimestampMonotonic": "13799304", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service sysinit.target systemd-journald.socket basic.target network.target -.mount system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:17:00 UTC", "AssertTimestampMonotonic": "13628201", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:17:00 UTC", "ConditionTimestampMonotonic": "13628199", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2022-01-10T01:20:44.285 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "834", "ExecMainStartTimestamp": "Mon 2022-01-10 01:17:00 UTC", "ExecMainStartTimestampMonotonic": "13799273", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2022-01-10 01:17:00 UTC", "InactiveExitTimestampMonotonic": "13629278", "InvocationID": "fa21535c734b495384dadc4053bccf96", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2022-01-10T01:20:44.286 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127757", "LimitNPROCSoft": "127757", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127757", "LimitSIGPENDINGSoft": "127757", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "834", "MemoryAccounting": "yes", "MemoryCurrent": "3710976", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requi 2022-01-10T01:20:44.288 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:17:00 UTC", "StateChangeTimestampMonotonic": "13799304", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38327", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2022-01-10T01:20:44.309 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:44 +0000 (0:00:00.193) 0:02:48.984 ******** 2022-01-10T01:20:44.337 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:44.338 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2022-01-10T01:20:44.361 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:44 +0000 (0:00:00.051) 0:02:49.036 ******** 2022-01-10T01:20:44.400 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:44.401 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2022-01-10T01:20:44.425 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:44 +0000 (0:00:00.063) 0:02:49.100 ******** 2022-01-10T01:20:44.450 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:44 +0000 (0:00:00.024) 0:02:49.124 ******** 2022-01-10T01:20:44.478 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2022-01-10T01:20:44.480 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:44.503 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:44 +0000 (0:00:00.053) 0:02:49.178 ******** 2022-01-10T01:20:44.553 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2022-01-10T01:20:44.554 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2022-01-10T01:20:44.596 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:44 +0000 (0:00:00.092) 0:02:49.271 ******** 2022-01-10T01:20:44.721 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2022-01-10T01:20:44.723 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:44.748 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:44 +0000 (0:00:00.152) 0:02:49.423 ******** 2022-01-10T01:20:44.777 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:44.801 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:44 +0000 (0:00:00.052) 0:02:49.476 ******** 2022-01-10T01:20:45.133 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2022-01-10T01:20:45.135 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2022-01-10T01:20:45.158 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:45 +0000 (0:00:00.356) 0:02:49.832 ******** 2022-01-10T01:20:45.186 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2022-01-10T01:20:45.187 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:45.211 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:45 +0000 (0:00:00.052) 0:02:49.885 ******** 2022-01-10T01:20:45.428 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2022-01-10T01:20:45.429 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:17:05 UTC", "ActiveEnterTimestampMonotonic": "14582846", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target sysinit.target systemd-journald.socket basic.target system.slice -.mount systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:17:05 UTC", "AssertTimestampMonotonic": "14308094", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:17:05 UTC", "ConditionTimestampMonotonic": "14308093", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2022-01-10T01:20:45.431 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "841", "ExecMainStartTimestamp": "Mon 2022-01-10 01:17:05 UTC", "ExecMainStartTimestampMonotonic": "14582833", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2022-01-10 01:17:05 UTC", "InactiveExitTimestampMonotonic": "14308985", "InvocationID": "f6dfedbfc38e4d128cc91ae2f5d89fc9", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2022-01-10T01:20:45.432 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127757", "LimitNPROCSoft": "127757", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127757", "LimitSIGPENDINGSoft": "127757", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "841", "MemoryAccounting": "yes", "MemoryCurrent": "3538944", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "Requi 2022-01-10T01:20:45.434 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:17:05 UTC", "StateChangeTimestampMonotonic": "14582846", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38327", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2022-01-10T01:20:45.454 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:45 +0000 (0:00:00.243) 0:02:50.129 ******** 2022-01-10T01:20:45.482 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:45.483 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2022-01-10T01:20:45.506 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:45 +0000 (0:00:00.052) 0:02:50.181 ******** 2022-01-10T01:20:45.545 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:45.547 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2022-01-10T01:20:45.569 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:45 +0000 (0:00:00.062) 0:02:50.244 ******** 2022-01-10T01:20:45.597 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2022-01-10T01:20:45.599 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:45.621 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:45 +0000 (0:00:00.051) 0:02:50.295 ******** 2022-01-10T01:20:45.627 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2022-01-10T01:20:45.629 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:45.654 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:45 +0000 (0:00:00.032) 0:02:50.328 ******** 2022-01-10T01:20:45.682 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2022-01-10T01:20:45.683 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:45.713 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:45 +0000 (0:00:00.059) 0:02:50.387 ******** 2022-01-10T01:20:45.898 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2022-01-10T01:20:45.900 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2022-01-10T01:20:45.923 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:45 +0000 (0:00:00.210) 0:02:50.598 ******** 2022-01-10T01:20:46.350 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2022-01-10T01:20:46.351 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2022-01-10T01:20:46.374 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:46 +0000 (0:00:00.450) 0:02:51.048 ******** 2022-01-10T01:20:46.769 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2022-01-10T01:20:46.770 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:20:46.794 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:46 +0000 (0:00:00.420) 0:02:51.469 ******** 2022-01-10T01:20:46.823 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2022-01-10T01:20:46.825 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:46.846 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:46 +0000 (0:00:00.051) 0:02:51.521 ******** 2022-01-10T01:20:46.894 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2022-01-10T01:20:46.896 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2022-01-10T01:20:46.921 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:46 +0000 (0:00:00.074) 0:02:51.596 ******** 2022-01-10T01:20:47.024 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2022-01-10T01:20:47.026 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2022-01-10T01:20:47.051 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:47 +0000 (0:00:00.130) 0:02:51.726 ******** 2022-01-10T01:20:47.101 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2022-01-10T01:20:47.103 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2022-01-10T01:20:47.130 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:47 +0000 (0:00:00.078) 0:02:51.804 ******** 2022-01-10T01:20:47.477 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2022-01-10T01:20:47.478 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false} 2022-01-10T01:20:47.503 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:47 +0000 (0:00:00.373) 0:02:52.178 ******** 2022-01-10T01:20:47.511 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2022-01-10T01:20:47.512 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2022-01-10T01:20:47.545 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:47 +0000 (0:00:00.041) 0:02:52.220 ******** 2022-01-10T01:20:47.554 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2022-01-10T01:20:47.556 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2022-01-10T01:20:47.582 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:47 +0000 (0:00:00.036) 0:02:52.257 ******** 2022-01-10T01:20:47.684 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2022-01-10T01:20:47.686 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false} 2022-01-10T01:20:47.710 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:47 +0000 (0:00:00.128) 0:02:52.385 ******** 2022-01-10T01:20:47.739 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2022-01-10T01:20:47.741 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2022-01-10T01:20:47.765 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:47 +0000 (0:00:00.054) 0:02:52.439 ******** 2022-01-10T01:20:47.785 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2022-01-10T01:20:47.791 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1641777167.4475794, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1641777167.4435794, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1641777167.4435794, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2022-01-10T01:20:47.813 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:47 +0000 (0:00:00.048) 0:02:52.488 ******** 2022-01-10T01:20:47.960 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1641777164.3035855, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1641777164.2995858, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1641777164.2995858, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2022-01-10T01:20:47.987 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:47 +0000 (0:00:00.173) 0:02:52.662 ******** 2022-01-10T01:20:48.216 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2022-01-10T01:20:48.218 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "msg": ""} ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2022-01-10T01:20:48.241 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.253) 0:02:52.915 ******** 2022-01-10T01:20:48.263 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.022) 0:02:52.937 ******** 2022-01-10T01:20:48.281 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2022-01-10T01:20:48.283 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2022-01-10T01:20:48.305 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.042) 0:02:52.980 ******** 2022-01-10T01:20:48.313 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2022-01-10T01:20:48.339 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.033) 0:02:53.013 ******** 2022-01-10T01:20:48.347 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2022-01-10T01:20:48.348 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:48.374 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.035) 0:02:53.049 ******** 2022-01-10T01:20:48.382 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:48.416 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.041) 0:02:53.091 ******** 2022-01-10T01:20:48.550 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2022-01-10T01:20:48.552 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2022-01-10T01:20:48.577 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.160) 0:02:53.252 ******** 2022-01-10T01:20:48.596 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2022-01-10T01:20:48.623 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.045) 0:02:53.297 ******** 2022-01-10T01:20:48.757 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2022-01-10T01:20:48.759 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2022-01-10T01:20:48.784 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.160) 0:02:53.458 ******** 2022-01-10T01:20:48.802 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2022-01-10T01:20:48.826 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.042) 0:02:53.501 ******** 2022-01-10T01:20:48.833 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2022-01-10T01:20:48.835 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:48.860 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.034) 0:02:53.535 ******** 2022-01-10T01:20:48.868 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:48.870 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2022-01-10T01:20:48.897 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.036) 0:02:53.571 ******** 2022-01-10T01:20:48.925 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.027) 0:02:53.599 ******** 2022-01-10T01:20:48.932 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2022-01-10T01:20:48.934 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:48.934 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:48.935 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:48.935 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:48.963 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.038) 0:02:53.638 ******** 2022-01-10T01:20:48.971 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:48.972 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:48.972 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:48.973 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:48.973 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:48.974 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.001 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:48 +0000 (0:00:00.038) 0:02:53.676 ******** 2022-01-10T01:20:49.009 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2022-01-10T01:20:49.011 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.012 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.023 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.024 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.051 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.049) 0:02:53.726 ******** 2022-01-10T01:20:49.060 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.061 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.062 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.063 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.064 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.064 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result 2022-01-10T01:20:49.066 INFO:teuthology.task.ansible.out: was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.076 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:49.078 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.103 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.051) 0:02:53.777 ******** 2022-01-10T01:20:49.133 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.030) 0:02:53.808 ******** 2022-01-10T01:20:49.140 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2022-01-10T01:20:49.142 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.168 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.035) 0:02:53.843 ******** 2022-01-10T01:20:49.175 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:49.177 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.203 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.035) 0:02:53.878 ******** 2022-01-10T01:20:49.211 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2022-01-10T01:20:49.212 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.239 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.035) 0:02:53.914 ******** 2022-01-10T01:20:49.247 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2022-01-10T01:20:49.249 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.273 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.034) 0:02:53.948 ******** 2022-01-10T01:20:49.280 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2022-01-10T01:20:49.282 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.306 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.033) 0:02:53.981 ******** 2022-01-10T01:20:49.314 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2022-01-10T01:20:49.316 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.343 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.036) 0:02:54.017 ******** 2022-01-10T01:20:49.349 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2022-01-10T01:20:49.351 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.377 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.034) 0:02:54.052 ******** 2022-01-10T01:20:49.385 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2022-01-10T01:20:49.387 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.411 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.033) 0:02:54.086 ******** 2022-01-10T01:20:49.418 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2022-01-10T01:20:49.420 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.446 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.035) 0:02:54.121 ******** 2022-01-10T01:20:49.455 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2022-01-10T01:20:49.456 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.483 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.036) 0:02:54.158 ******** 2022-01-10T01:20:49.489 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2022-01-10T01:20:49.491 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false} TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.518 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.035) 0:02:54.193 ******** 2022-01-10T01:20:49.547 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.028) 0:02:54.221 ******** 2022-01-10T01:20:49.554 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2022-01-10T01:20:49.556 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.581 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.034) 0:02:54.255 ******** 2022-01-10T01:20:49.606 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.025) 0:02:54.281 ******** 2022-01-10T01:20:49.614 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2022-01-10T01:20:49.615 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2022-01-10T01:20:49.642 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.035) 0:02:54.316 ******** 2022-01-10T01:20:49.649 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2022-01-10T01:20:49.651 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.680 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.038) 0:02:54.355 ******** 2022-01-10T01:20:49.708 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2022-01-10T01:20:49.710 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:49.732 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.052) 0:02:54.407 ******** 2022-01-10T01:20:49.791 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2022-01-10T01:20:49.793 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010624", "end": "2022-01-10 01:20:49.757752", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2022-01-10 01:20:49.747128", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:49.825 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2022-01-10T01:20:49.825 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1641777196.5153666, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1641777196.5113668, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1641777196.5113668, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2022-01-10T01:20:49.853 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.120) 0:02:54.527 ******** 2022-01-10T01:20:49.862 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2022-01-10T01:20:49.863 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2022-01-10T01:20:49.902 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:49 +0000 (0:00:00.049) 0:02:54.577 ******** 2022-01-10T01:20:49.952 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2022-01-10T01:20:49.954 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010579", "end": "2022-01-10 01:20:49.909623", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2022-01-10 01:20:49.899044", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ok: [smithi036.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006096", "end": "2022-01-10 01:20:49.925373", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2022-01-10 01:20:49.919277", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:50.038 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2022-01-10T01:20:50.040 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2022-01-10T01:20:50.064 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:50 +0000 (0:00:00.162) 0:02:54.739 ******** 2022-01-10T01:20:50.093 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2022-01-10T01:20:50.095 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2022-01-10T01:20:50.119 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:50 +0000 (0:00:00.053) 0:02:54.793 ******** 2022-01-10T01:20:50.126 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2022-01-10T01:20:50.127 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005657", "end": "2022-01-10 01:20:50.084877", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2022-01-10 01:20:50.079220", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} ok: [smithi059.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005928", "end": "2022-01-10 01:20:50.085431", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2022-01-10 01:20:50.079503", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:50.149 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2022-01-10T01:20:50.151 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:50.174 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:50 +0000 (0:00:00.055) 0:02:54.849 ******** 2022-01-10T01:20:50.285 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2022-01-10T01:20:50.287 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005493", "end": "2022-01-10 01:20:50.255794", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2022-01-10 01:20:50.250301", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:50.297 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.028449", "end": "2022-01-10 01:20:50.270127", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2022-01-10 01:20:50.241678", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:50.324 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:50 +0000 (0:00:00.150) 0:02:54.999 ******** 2022-01-10T01:20:50.344 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2022-01-10T01:20:50.346 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2022-01-10T01:20:50.376 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:50 +0000 (0:00:00.051) 0:02:55.051 ******** 2022-01-10T01:20:50.383 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2022-01-10T01:20:50.413 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:50 +0000 (0:00:00.036) 0:02:55.087 ******** 2022-01-10T01:20:50.422 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2022-01-10T01:20:50.424 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false} 2022-01-10T01:20:50.452 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:50 +0000 (0:00:00.039) 0:02:55.127 ******** 2022-01-10T01:20:50.462 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2022-01-10T01:20:50.463 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:50.492 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2022-01-10T01:20:50.494 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.030635", "end": "2022-01-10 01:20:50.441662", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2022-01-10 01:20:50.411027", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:50.496 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2022-01-10T01:20:50.534 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:50 +0000 (0:00:00.082) 0:02:55.209 ******** 2022-01-10T01:20:50.559 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:50 +0000 (0:00:00.024) 0:02:55.234 ******** 2022-01-10T01:20:50.568 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2022-01-10T01:20:50.569 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2022-01-10T01:20:50.597 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:50 +0000 (0:00:00.037) 0:02:55.271 ******** 2022-01-10T01:20:50.621 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:50 +0000 (0:00:00.024) 0:02:55.296 ******** 2022-01-10T01:20:50.632 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2022-01-10T01:20:50.634 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:50.659 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:50.698 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:50 +0000 (0:00:00.076) 0:02:55.373 ******** 2022-01-10T01:20:50.738 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2022-01-10T01:20:50.740 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:50.749 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:50.750 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2022-01-10T01:20:50.752 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1641777203.5074208, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1641777203.503421, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1641777203.503421, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi166.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:50.779 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:50 +0000 (0:00:00.081) 0:02:55.454 ******** 2022-01-10T01:20:50.787 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:50.789 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:50.968 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:50 +0000 (0:00:00.188) 0:02:55.643 ******** 2022-01-10T01:20:50.978 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2022-01-10T01:20:50.979 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2022-01-10T01:20:51.017 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.048) 0:02:55.692 ******** 2022-01-10T01:20:51.027 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2022-01-10T01:20:51.029 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.040 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.042 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi166.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.066 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.049) 0:02:55.741 ******** 2022-01-10T01:20:51.074 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2022-01-10T01:20:51.076 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2022-01-10T01:20:51.100 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.033) 0:02:55.775 ******** 2022-01-10T01:20:51.107 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2022-01-10T01:20:51.109 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.136 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.036) 0:02:55.811 ******** 2022-01-10T01:20:51.145 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2022-01-10T01:20:51.146 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.171 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.034) 0:02:55.846 ******** 2022-01-10T01:20:51.178 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2022-01-10T01:20:51.179 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.205 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.033) 0:02:55.880 ******** 2022-01-10T01:20:51.232 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2022-01-10T01:20:51.234 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.260 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.055) 0:02:55.935 ******** 2022-01-10T01:20:51.288 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.316 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.055) 0:02:55.990 ******** 2022-01-10T01:20:51.344 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2022-01-10T01:20:51.346 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi139.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2022-01-10T01:20:51.370 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.054) 0:02:56.044 ******** 2022-01-10T01:20:51.399 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.029) 0:02:56.074 ******** 2022-01-10T01:20:51.429 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2022-01-10T01:20:51.430 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.458 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.058) 0:02:56.132 ******** 2022-01-10T01:20:51.486 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2022-01-10T01:20:51.488 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.530 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.071) 0:02:56.204 ******** 2022-01-10T01:20:51.549 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2022-01-10T01:20:51.551 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2022-01-10T01:20:51.575 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.045) 0:02:56.250 ******** 2022-01-10T01:20:51.583 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2022-01-10T01:20:51.585 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.610 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.034) 0:02:56.284 ******** 2022-01-10T01:20:51.619 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2022-01-10T01:20:51.621 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.655 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.044) 0:02:56.329 ******** 2022-01-10T01:20:51.692 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2022-01-10T01:20:51.694 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=docker0) => {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.706 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.717 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.749 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.094) 0:02:56.423 ******** 2022-01-10T01:20:51.791 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2022-01-10T01:20:51.792 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'docker0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "docker0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi139.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.803 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.805 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.815 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.816 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.850 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.101) 0:02:56.525 ******** 2022-01-10T01:20:51.859 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2022-01-10T01:20:51.860 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010254", "end": "2022-01-10 01:20:51.789020", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2022-01-10 01:20:51.778766", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:51.882 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.908 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.057) 0:02:56.583 ******** 2022-01-10T01:20:51.936 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2022-01-10T01:20:51.938 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:51.960 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:51 +0000 (0:00:00.052) 0:02:56.635 ******** 2022-01-10T01:20:51.988 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2022-01-10T01:20:51.990 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005797", "end": "2022-01-10 01:20:51.954553", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2022-01-10 01:20:51.948756", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:52.019 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:52 +0000 (0:00:00.058) 0:02:56.693 ******** 2022-01-10T01:20:52.047 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:52.072 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:52 +0000 (0:00:00.053) 0:02:56.747 ******** 2022-01-10T01:20:52.100 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2022-01-10T01:20:52.102 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:52.127 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:52 +0000 (0:00:00.055) 0:02:56.802 ******** 2022-01-10T01:20:52.145 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2022-01-10T01:20:52.147 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.004032", "end": "2022-01-10 01:20:52.110029", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2022-01-10 01:20:52.105997", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:52.158 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:52.184 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:52 +0000 (0:00:00.056) 0:02:56.859 ******** 2022-01-10T01:20:52.212 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2022-01-10T01:20:52.214 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:52.251 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:52 +0000 (0:00:00.066) 0:02:56.925 ******** 2022-01-10T01:20:52.279 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2022-01-10T01:20:52.281 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:52.308 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:52 +0000 (0:00:00.056) 0:02:56.982 ******** 2022-01-10T01:20:52.328 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2022-01-10T01:20:52.330 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.030115", "end": "2022-01-10 01:20:52.299915", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2022-01-10 01:20:52.269800", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:52.357 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:52 +0000 (0:00:00.049) 0:02:57.031 ******** 2022-01-10T01:20:52.385 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2022-01-10T01:20:52.410 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:52 +0000 (0:00:00.052) 0:02:57.084 ******** 2022-01-10T01:20:52.439 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2022-01-10T01:20:52.441 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:52.506 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2022-01-10T01:20:52.508 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010593", "end": "2022-01-10 01:20:52.480693", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2022-01-10 01:20:52.470100", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:52.673 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006012", "end": "2022-01-10 01:20:52.646446", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2022-01-10 01:20:52.640434", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:52.839 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005604", "end": "2022-01-10 01:20:52.808055", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2022-01-10 01:20:52.802451", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:53.037 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.038937", "end": "2022-01-10 01:20:53.002394", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2022-01-10 01:20:52.963457", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:20:53.073 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:53 +0000 (0:00:00.663) 0:02:57.748 ******** 2022-01-10T01:20:53.105 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2022-01-10T01:20:53.128 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:53 +0000 (0:00:00.055) 0:02:57.803 ******** 2022-01-10T01:20:53.156 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2022-01-10T01:20:53.158 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:53.232 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2022-01-10T01:20:53.257 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:53 +0000 (0:00:00.128) 0:02:57.932 ******** 2022-01-10T01:20:53.279 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:53 +0000 (0:00:00.022) 0:02:57.954 ******** 2022-01-10T01:20:53.301 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:53 +0000 (0:00:00.021) 0:02:57.976 ******** 2022-01-10T01:20:53.324 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:53 +0000 (0:00:00.022) 0:02:57.999 ******** 2022-01-10T01:20:54.296 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi036.front.sepia.ceph.com] 2022-01-10T01:20:54.335 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] 2022-01-10T01:20:54.345 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] 2022-01-10T01:20:54.356 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] 2022-01-10T01:20:54.385 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:01.061) 0:02:59.060 ******** 2022-01-10T01:20:54.434 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2022-01-10T01:20:54.437 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2022-01-10T01:20:54.458 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.071) 0:02:59.132 ******** 2022-01-10T01:20:54.480 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.022) 0:02:59.154 ******** 2022-01-10T01:20:54.502 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.022) 0:02:59.177 ******** 2022-01-10T01:20:54.525 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.022) 0:02:59.200 ******** 2022-01-10T01:20:54.534 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:54.535 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2022-01-10T01:20:54.560 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.035) 0:02:59.235 ******** 2022-01-10T01:20:54.583 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.022) 0:02:59.258 ******** 2022-01-10T01:20:54.605 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.021) 0:02:59.279 ******** 2022-01-10T01:20:54.611 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2022-01-10T01:20:54.612 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2022-01-10T01:20:54.612 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io", "python3-setuptools", "python3-pip"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2022-01-10T01:20:54.614 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:54.638 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.033) 0:02:59.312 ******** 2022-01-10T01:20:54.659 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.020) 0:02:59.333 ******** 2022-01-10T01:20:54.681 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.022) 0:02:59.356 ******** 2022-01-10T01:20:54.688 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:54.721 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.040) 0:02:59.396 ******** 2022-01-10T01:20:54.729 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2022-01-10T01:20:54.731 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io", "python3-setuptools", "python3-pip"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2022-01-10T01:20:54.731 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:20:54.757 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.035) 0:02:59.432 ******** 2022-01-10T01:20:54.782 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.024) 0:02:59.456 ******** 2022-01-10T01:20:54.788 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2022-01-10T01:20:54.790 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io", "python3-setuptools", "python3-pip"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2022-01-10T01:20:54.816 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.035) 0:02:59.491 ******** 2022-01-10T01:20:54.834 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io", "python3-setuptools", "python3-pip"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2022-01-10T01:20:54.860 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:20:54 +0000 (0:00:00.043) 0:02:59.535 ******** 2022-01-10T01:21:11.150 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2022-01-10T01:21:11.152 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 83 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (18.0 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174688 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", 2022-01-10T01:21:11.154 INFO:teuthology.task.ansible.out:"Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 83 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (18.0 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174688 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2022-01-10T01:21:11.176 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:16.316) 0:03:15.851 ******** 2022-01-10T01:21:11.206 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2022-01-10T01:21:11.208 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:21:11.230 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:00.053) 0:03:15.905 ******** 2022-01-10T01:21:11.269 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2022-01-10T01:21:11.271 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2022-01-10T01:21:11.294 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:00.063) 0:03:15.969 ******** 2022-01-10T01:21:11.324 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2022-01-10T01:21:11.326 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 83 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (18.1 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174688 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", 2022-01-10T01:21:11.327 INFO:teuthology.task.ansible.out:"Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 83 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (18.1 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174688 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2022-01-10T01:21:11.352 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:00.056) 0:03:16.025 ******** 2022-01-10T01:21:11.360 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 83 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (18.1 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174688 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", 2022-01-10T01:21:11.361 INFO:teuthology.task.ansible.out:"Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 83 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (18.1 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174688 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2022-01-10T01:21:11.385 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:00.034) 0:03:16.060 ******** 2022-01-10T01:21:11.394 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2022-01-10T01:21:11.396 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:21:11.419 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:00.033) 0:03:16.094 ******** 2022-01-10T01:21:11.427 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:21:11.455 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:00.035) 0:03:16.129 ******** 2022-01-10T01:21:11.462 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2022-01-10T01:21:11.465 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2022-01-10T01:21:11.492 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:00.037) 0:03:16.167 ******** 2022-01-10T01:21:11.503 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2022-01-10T01:21:11.530 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:00.037) 0:03:16.204 ******** 2022-01-10T01:21:11.538 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2022-01-10T01:21:11.540 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:21:11.699 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:21:11.700 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:21:11.733 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:00.203) 0:03:16.407 ******** 2022-01-10T01:21:11.752 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:21:11.784 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2022-01-10T01:21:11.786 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic\n linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic\n linux-modules-extra-5.4.0-66-generic\nUse 'sudo apt autoremove' to remove them.\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 83 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 4096 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (18.3 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 174688 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...\r\nUnpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...\r\nSetting up docker.io (20.10.7-0ubuntu5~20.04.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", 2022-01-10T01:21:11.788 INFO:teuthology.task.ansible.out:"Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " libllvm11 linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic", " linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic", " linux-modules-extra-5.4.0-66-generic", "Use 'sudo apt autoremove' to remove them.", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 83 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 4096 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.7-0ubuntu5~20.04.2 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (18.3 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 174688 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.7-0ubuntu5~20.04.2_amd64.deb ...", "Unpacking docker.io (20.10.7-0ubuntu5~20.04.2) over (20.10.7-0ubuntu1~20.04.1) ...", "Setting up docker.io (20.10.7-0ubuntu5~20.04.2) ...", "Processing triggers for man-db (2.9.1-1) ..."]} 2022-01-10T01:21:11.811 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:00.077) 0:03:16.485 ******** 2022-01-10T01:21:11.838 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2022-01-10T01:21:11.839 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:21:11.861 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:00.050) 0:03:16.536 ******** 2022-01-10T01:21:11.878 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* ok: [smithi036.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:21:11.904 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:00.042) 0:03:16.579 ******** 2022-01-10T01:21:11.912 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2022-01-10T01:21:11.913 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2022-01-10T01:21:11.938 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:00.033) 0:03:16.612 ******** 2022-01-10T01:21:11.945 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2022-01-10T01:21:11.947 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:21:11.974 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:11 +0000 (0:00:00.035) 0:03:16.648 ******** 2022-01-10T01:21:12.150 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:21:12.182 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2022-01-10T01:21:12.184 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2022-01-10T01:21:12.310 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2022-01-10T01:21:12.312 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2022-01-10T01:21:12.340 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:12 +0000 (0:00:00.366) 0:03:17.015 ******** 2022-01-10T01:21:12.349 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2022-01-10T01:21:12.350 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2022-01-10T01:21:12.424 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2022-01-10T01:21:12.582 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2022-01-10T01:21:12.609 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:12 +0000 (0:00:00.268) 0:03:17.284 ******** 2022-01-10T01:21:12.743 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2022-01-10T01:21:12.782 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:12 +0000 (0:00:00.172) 0:03:17.456 ******** 2022-01-10T01:21:12.791 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2022-01-10T01:21:12.824 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2022-01-10T01:21:12.852 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:12 +0000 (0:00:00.069) 0:03:17.526 ******** 2022-01-10T01:21:13.186 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "size": 2334, "state": "file", "uid": 0} 2022-01-10T01:21:13.213 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:13 +0000 (0:00:00.360) 0:03:17.887 ******** 2022-01-10T01:21:13.411 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2022-01-10T01:21:13.413 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:21:13.437 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:13 +0000 (0:00:00.224) 0:03:18.112 ******** 2022-01-10T01:21:13.582 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"cache_update_time": 1641777260, "cache_updated": false, "changed": false} 2022-01-10T01:21:13.610 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:13 +0000 (0:00:00.172) 0:03:18.285 ******** 2022-01-10T01:21:13.632 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:21:13.658 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:13 +0000 (0:00:00.047) 0:03:18.333 ******** 2022-01-10T01:21:14.012 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"cache_update_time": 1641777261, "cache_updated": false, "changed": false} 2022-01-10T01:21:14.038 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:14 +0000 (0:00:00.380) 0:03:18.713 ******** 2022-01-10T01:21:17.718 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2022-01-10T01:21:17.720 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-5ki9j7jd\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-5ki9j7jd"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-5ki9j7jd\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=1b13def5d6a63033b8c3849f5235066462bdc1e52c47997447a0f4018e2835c3\n Stored in directory: /tmp/pip-ephem-wheel-cache-1gllmx4k/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2022-01-10T01:21:17.722 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-5ki9j7jd", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=1b13def5d6a63033b8c3849f5235066462bdc1e52c47997447a0f4018e2835c3", " Stored in directory: /tmp/pip-ephem-wheel-cache-1gllmx4k/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2022-01-10T01:21:17.744 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:17 +0000 (0:00:03.705) 0:03:22.418 ******** 2022-01-10T01:21:17.868 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-ysib07fs\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-ysib07fs"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-ysib07fs\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=c8931a439eaf7c43e57f9bdde859f673ce1e1db016ccda2945aaccc273b4014d\n Stored in directory: /tmp/pip-ephem-wheel-cache-mo_q0453/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2022-01-10T01:21:17.870 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-ysib07fs", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=c8931a439eaf7c43e57f9bdde859f673ce1e1db016ccda2945aaccc273b4014d", " Stored in directory: /tmp/pip-ephem-wheel-cache-mo_q0453/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2022-01-10T01:21:17.906 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:17 +0000 (0:00:00.162) 0:03:22.581 ******** 2022-01-10T01:21:17.929 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-uy471pni\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-uy471pni"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-uy471pni\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=c8931a439eaf7c43e57f9bdde859f673ce1e1db016ccda2945aaccc273b4014d\n Stored in directory: /tmp/pip-ephem-wheel-cache-y677h2wj/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2022-01-10T01:21:17.931 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-uy471pni", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=c8931a439eaf7c43e57f9bdde859f673ce1e1db016ccda2945aaccc273b4014d", " Stored in directory: /tmp/pip-ephem-wheel-cache-y677h2wj/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2022-01-10T01:21:17.969 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:17 +0000 (0:00:00.062) 0:03:22.643 ******** 2022-01-10T01:21:17.980 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2022-01-10T01:21:17.981 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1641777155.315833, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2022-01-10T01:21:18.009 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:18 +0000 (0:00:00.040) 0:03:22.684 ******** 2022-01-10T01:21:18.048 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2022-01-10T01:21:18.049 INFO:teuthology.task.ansible.out:skipping: [smithi059.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:21:18.072 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:18 +0000 (0:00:00.063) 0:03:22.747 ******** 2022-01-10T01:21:18.111 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2022-01-10T01:21:18.113 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1641777186.279895, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2022-01-10T01:21:18.139 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:18 +0000 (0:00:00.066) 0:03:22.813 ******** 2022-01-10T01:21:18.177 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1641777157.0798643, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2022-01-10T01:21:18.178 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2022-01-10T01:21:18.179 INFO:teuthology.task.ansible.out:skipping: [smithi139.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:21:18.203 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:18 +0000 (0:00:00.064) 0:03:22.877 ******** 2022-01-10T01:21:18.232 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:18 +0000 (0:00:00.029) 0:03:22.907 ******** 2022-01-10T01:21:18.241 INFO:teuthology.task.ansible.out:skipping: [smithi036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:21:18.268 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:18 +0000 (0:00:00.036) 0:03:22.943 ******** 2022-01-10T01:21:18.276 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2022-01-10T01:21:18.277 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-0hg2fcoq\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-0hg2fcoq"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-0hg2fcoq\nRequirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)\nRequirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)\nBuilding wheels for collected packages: registries-conf-ctl\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=c8931a439eaf7c43e57f9bdde859f673ce1e1db016ccda2945aaccc273b4014d\n Stored in directory: /tmp/pip-ephem-wheel-cache-rmpx9wmr/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\nSuccessfully built registries-conf-ctl\nInstalling collected packages: registries-conf-ctl\n Attempting uninstall: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/reg 2022-01-10T01:21:18.279 INFO:teuthology.task.ansible.out:istries-conf-ctl to ./pip-req-build-0hg2fcoq", "Requirement already satisfied, skipping upgrade: docopt in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.6.2)", "Requirement already satisfied, skipping upgrade: toml in /usr/local/lib/python3.8/dist-packages (from registries-conf-ctl==1.0) (0.10.2)", "Building wheels for collected packages: registries-conf-ctl", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=8264 sha256=c8931a439eaf7c43e57f9bdde859f673ce1e1db016ccda2945aaccc273b4014d", " Stored in directory: /tmp/pip-ephem-wheel-cache-rmpx9wmr/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", "Successfully built registries-conf-ctl", "Installing collected packages: registries-conf-ctl", " Attempting uninstall: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2022-01-10T01:21:18.304 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:18 +0000 (0:00:00.035) 0:03:22.979 ******** 2022-01-10T01:21:18.333 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2022-01-10T01:21:18.335 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.072610", "end": "2022-01-10 01:21:18.311221", "rc": 0, "start": "2022-01-10 01:21:18.238611", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:21:18.359 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:18 +0000 (0:00:00.055) 0:03:23.034 ******** 2022-01-10T01:21:18.504 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.086643", "end": "2022-01-10 01:21:18.479287", "rc": 0, "start": "2022-01-10 01:21:18.392644", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:21:18.529 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:18 +0000 (0:00:00.169) 0:03:23.204 ******** 2022-01-10T01:21:18.536 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2022-01-10T01:21:18.537 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1641777179.2358422, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "13ed9dbcd1f35408627b14794589868021e7d546", "ctime": 1633105205.2901182, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 95289, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1633105205.2901182, "nlink": 1, "path": "/etc/docker/daemon.json", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 151, "uid": 0, "version": "2929411125", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2022-01-10T01:21:18.564 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:18 +0000 (0:00:00.035) 0:03:23.239 ******** 2022-01-10T01:21:18.571 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2022-01-10T01:21:18.573 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.086045", "end": "2022-01-10 01:21:18.529823", "rc": 0, "start": "2022-01-10 01:21:18.443778", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:21:18.598 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:18 +0000 (0:00:00.033) 0:03:23.273 ******** 2022-01-10T01:21:18.605 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2022-01-10T01:21:18.607 INFO:teuthology.task.ansible.out:skipping: [smithi166.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2022-01-10T01:21:18.631 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:18 +0000 (0:00:00.033) 0:03:23.306 ******** 2022-01-10T01:21:18.901 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2022-01-10T01:21:18.902 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.080746", "end": "2022-01-10 01:21:18.877438", "rc": 0, "start": "2022-01-10 01:21:18.796692", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2022-01-10T01:21:18.925 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:18 +0000 (0:00:00.293) 0:03:23.600 ******** 2022-01-10T01:21:20.123 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2022-01-10T01:21:20.125 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:21:06 UTC", "ActiveEnterTimestampMonotonic": "265576362", "ActiveExitTimestamp": "Mon 2022-01-10 01:21:05 UTC", "ActiveExitTimestampMonotonic": "264503150", "ActiveState": "active", "After": "sysinit.target docker.socket containerd.service systemd-journald.socket system.slice firewalld.service basic.target network-online.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:21:05 UTC", "AssertTimestampMonotonic": "264516866", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:21:05 UTC", "ConditionTimestampMonotonic": "264516865", "ConfigurationDirectoryMode": "0755" 2022-01-10T01:21:20.127 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8247", "ExecMainStartTimestamp": "Mon 2022-01-10 01:21:05 UTC", "ExecMainStartTimestampMonotonic": "264518515", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2022-01-10T01:21:20.129 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2022-01-10 01:21:05 UTC", "InactiveEnterTimestampMonotonic": "264508213", "InactiveExitTimestamp": "Mon 2022-01-10 01:21:05 UTC", "InactiveExitTimestampMonotonic": "264518935", "InvocationID": "95cc47a981fb4c4db1d336355c900361", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8247", "MemoryAccounting": "yes", "MemoryCurrent": "45576192", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2022-01-10T01:21:20.131 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:21:06 UTC", "StateChangeTimestampMonotonic": "265576362", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2022-01-10T01:21:20.133 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2022-01-10T01:21:20.405 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:21:07 UTC", "ActiveEnterTimestampMonotonic": "265875605", "ActiveExitTimestamp": "Mon 2022-01-10 01:21:05 UTC", "ActiveExitTimestampMonotonic": "264719302", "ActiveState": "active", "After": "systemd-journald.socket system.slice basic.target containerd.service network-online.target sysinit.target docker.socket firewalld.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:21:05 UTC", "AssertTimestampMonotonic": "264729745", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:21:05 UTC", "ConditionTimestampMonotonic": "264729744", "ConfigurationDirectoryMode": "0755" 2022-01-10T01:21:20.407 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8258", "ExecMainStartTimestamp": "Mon 2022-01-10 01:21:05 UTC", "ExecMainStartTimestampMonotonic": "264731015", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2022-01-10T01:21:20.409 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2022-01-10 01:21:05 UTC", "InactiveEnterTimestampMonotonic": "264722996", "InactiveExitTimestamp": "Mon 2022-01-10 01:21:05 UTC", "InactiveExitTimestampMonotonic": "264732083", "InvocationID": "2e3b3a1c193d481b89c23a543a9051fa", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8258", "MemoryAccounting": "yes", "MemoryCurrent": "43905024", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2022-01-10T01:21:20.410 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:21:07 UTC", "StateChangeTimestampMonotonic": "265875605", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2022-01-10T01:21:20.412 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2022-01-10T01:21:20.445 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:21:07 UTC", "ActiveEnterTimestampMonotonic": "255843031", "ActiveExitTimestamp": "Mon 2022-01-10 01:21:06 UTC", "ActiveExitTimestampMonotonic": "254763742", "ActiveState": "active", "After": "network-online.target containerd.service basic.target firewalld.service sysinit.target docker.socket systemd-journald.socket system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:21:06 UTC", "AssertTimestampMonotonic": "254774207", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:21:06 UTC", "ConditionTimestampMonotonic": "254774206", "ConfigurationDirectoryMode": "0755" 2022-01-10T01:21:20.447 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8325", "ExecMainStartTimestamp": "Mon 2022-01-10 01:21:06 UTC", "ExecMainStartTimestampMonotonic": "254774927", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2022-01-10T01:21:20.449 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2022-01-10 01:21:06 UTC", "InactiveEnterTimestampMonotonic": "254769145", "InactiveExitTimestamp": "Mon 2022-01-10 01:21:06 UTC", "InactiveExitTimestampMonotonic": "254775791", "InvocationID": "44b58be834cb48c4a856b34cd67757e7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127757", "LimitSIGPENDINGSoft": "127757", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8325", "MemoryAccounting": "yes", "MemoryCurrent": "46096384", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2022-01-10T01:21:20.450 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:21:07 UTC", "StateChangeTimestampMonotonic": "255843031", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2022-01-10T01:21:20.452 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "ini 2022-01-10T01:21:20.452 INFO:teuthology.task.ansible.out:t", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2022-01-10T01:21:20.769 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2022-01-10 01:21:07 UTC", "ActiveEnterTimestampMonotonic": "260555357", "ActiveExitTimestamp": "Mon 2022-01-10 01:21:06 UTC", "ActiveExitTimestampMonotonic": "259376565", "ActiveState": "active", "After": "sysinit.target docker.socket containerd.service firewalld.service network-online.target system.slice basic.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2022-01-10 01:21:06 UTC", "AssertTimestampMonotonic": "259387815", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2022-01-10 01:21:06 UTC", "ConditionTimestampMonotonic": "259387815", "ConfigurationDirectoryMode": "0755" 2022-01-10T01:21:20.771 INFO:teuthology.task.ansible.out:, "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8289", "ExecMainStartTimestamp": "Mon 2022-01-10 01:21:06 UTC", "ExecMainStartTimestampMonotonic": "259388881", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "I 2022-01-10T01:21:20.772 INFO:teuthology.task.ansible.out:PIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2022-01-10 01:21:06 UTC", "InactiveEnterTimestampMonotonic": "259381557", "InactiveExitTimestamp": "Mon 2022-01-10 01:21:06 UTC", "InactiveExitTimestampMonotonic": "259389933", "InvocationID": "e19733b1fe414c47a9e0789e70369897", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127757", "LimitSIGPENDINGSoft": "127757", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8289", "MemoryAccounting": "yes", "MemoryCurrent": "46346240", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges" 2022-01-10T01:21:20.775 INFO:teuthology.task.ansible.out:: "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice docker.socket sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2022-01-10 01:21:07 UTC", "StateChangeTimestampMonotonic": "260555357", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "15", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStart 2022-01-10T01:21:20.776 INFO:teuthology.task.ansible.out:USec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSe 2022-01-10T01:21:20.777 INFO:teuthology.task.ansible.out:c": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2022-01-10T01:21:20.851 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2022-01-10T01:21:20.852 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2022-01-10T01:21:20.854 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2022-01-10T01:21:20.855 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2022-01-10T01:21:20.869 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2022-01-10T01:21:20.871 INFO:teuthology.task.ansible.out:Monday 10 January 2022 01:21:20 +0000 (0:00:01.944) 0:03:25.544 ******** 2022-01-10T01:21:21.911 INFO:teuthology.task.ansible.out:ok: [smithi139.front.sepia.ceph.com] 2022-01-10T01:21:21.931 INFO:teuthology.task.ansible.out:ok: [smithi059.front.sepia.ceph.com] 2022-01-10T01:21:21.942 INFO:teuthology.task.ansible.out:ok: [smithi036.front.sepia.ceph.com] 2022-01-10T01:21:21.953 INFO:teuthology.task.ansible.out:ok: [smithi166.front.sepia.ceph.com] 2022-01-10T01:21:21.973 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Monday 10 January 2022 01:21:21 +0000 (0:00:01.103) 0:03:26.648 ******** 2022-01-10T01:21:22.159 INFO:teuthology.task.ansible.out:changed: [smithi036.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2022-01-10T01:21:22.191 INFO:teuthology.task.ansible.out:changed: [smithi059.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2022-01-10T01:21:22.203 INFO:teuthology.task.ansible.out:changed: [smithi139.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2022-01-10T01:21:22.245 INFO:teuthology.task.ansible.out:changed: [smithi166.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2022-01-10T01:21:22.248 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi036.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 2022-01-10T01:21:22.250 INFO:teuthology.task.ansible.out:smithi059.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 smithi139.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 smithi166.front.sepia.ceph.com : ok=131 changed=32 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 Monday 10 January 2022 01:21:22 +0000 (0:00:00.275) 0:03:26.923 ******** =============================================================================== Create all admin users with sudo access. ------------------------------- 24.03s users : Update authorized_keys using the keys repo --------------------- 21.05s container-host : Install container packages ---------------------------- 16.32s testnode : Upgrade packages -------------------------------------------- 13.85s testnode : Install packages -------------------------------------------- 10.24s Remove revoked users ---------------------------------------------------- 7.44s testnode : Ensure packages are not present. ----------------------------- 6.63s testnode : Zap all non-root disks --------------------------------------- 5.52s container-host : Install registries-conf-ctl ---------------------------- 3.71s common : Update apt cache ----------------------------------------------- 3.23s Gathering Facts --------------------------------------------------------- 2.77s Gathering Facts --------------------------------------------------------- 2.04s container-host : Restart docker service --------------------------------- 1.94s users : Update authorized_keys for each user with literal keys ---------- 1.43s Gathering Facts --------------------------------------------------------- 1.10s Gathering Facts --------------------------------------------------------- 1.06s Gathering Facts --------------------------------------------------------- 0.93s 2022-01-10T01:21:22.250 INFO:teuthology.task.ansible.out:ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.83s testnod 2022-01-10T01:21:22.252 INFO:teuthology.task.ansible.out:e : Update apt cache. -------------------------------------------- 0.74s testnode : Ensure perl-doc is installed on apt systems. ----------------- 0.67s 2022-01-10T01:21:22.671 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi036.front.sepia.ceph.com'), Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi139.front.sepia.ceph.com'), Remote(name='ubuntu@smithi166.front.sepia.ceph.com')] 2022-01-10T01:21:22.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi036.front.sepia.ceph.com' 2022-01-10T01:21:22.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:21:22.737 DEBUG:teuthology.orchestra.run.smithi036:> true 2022-01-10T01:21:22.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2022-01-10T01:21:22.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:21:22.909 DEBUG:teuthology.orchestra.run.smithi059:> true 2022-01-10T01:21:23.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi139.front.sepia.ceph.com' 2022-01-10T01:21:23.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi139.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:21:23.083 DEBUG:teuthology.orchestra.run.smithi139:> true 2022-01-10T01:21:23.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi166.front.sepia.ceph.com' 2022-01-10T01:21:23.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi166.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-01-10T01:21:23.256 DEBUG:teuthology.orchestra.run.smithi166:> true 2022-01-10T01:21:23.380 INFO:teuthology.run_tasks:Running task clock... 2022-01-10T01:21:23.397 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-01-10T01:21:23.398 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-01-10T01:21:23.401 DEBUG:teuthology.orchestra.run.smithi036:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-01-10T01:21:23.404 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-01-10T01:21:23.404 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-01-10T01:21:23.406 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-01-10T01:21:23.407 DEBUG:teuthology.orchestra.run.smithi139:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-01-10T01:21:23.409 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-01-10T01:21:23.410 DEBUG:teuthology.orchestra.run.smithi166:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-01-10T01:21:23.439 INFO:teuthology.orchestra.run.smithi059.stdout:10 Jan 01:21:23 ntpd[9682]: ntpd 4.2.8p12@1.3728-o (1): Starting 2022-01-10T01:21:23.439 INFO:teuthology.orchestra.run.smithi059.stdout:10 Jan 01:21:23 ntpd[9682]: Command line: ntpd -gq 2022-01-10T01:21:23.440 INFO:teuthology.orchestra.run.smithi036.stdout:10 Jan 01:21:23 ntpd[9680]: ntpd 4.2.8p12@1.3728-o (1): Starting 2022-01-10T01:21:23.440 INFO:teuthology.orchestra.run.smithi036.stdout:10 Jan 01:21:23 ntpd[9680]: Command line: ntpd -gq 2022-01-10T01:21:23.441 INFO:teuthology.orchestra.run.smithi059.stdout:10 Jan 01:21:23 ntpd[9682]: proto: precision = 0.167 usec (-22) 2022-01-10T01:21:23.441 INFO:teuthology.orchestra.run.smithi036.stdout:10 Jan 01:21:23 ntpd[9680]: proto: precision = 0.307 usec (-22) 2022-01-10T01:21:23.443 INFO:teuthology.orchestra.run.smithi059.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2022-01-10T01:21:23.443 INFO:teuthology.orchestra.run.smithi036.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2022-01-10T01:21:23.444 INFO:teuthology.orchestra.run.smithi059.stdout:10 Jan 01:21:23 ntpd[9682]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2022-01-10T01:21:23.444 INFO:teuthology.orchestra.run.smithi059.stdout:10 Jan 01:21:23 ntpd[9682]: restrict ::: KOD does nothing without LIMITED. 2022-01-10T01:21:23.445 INFO:teuthology.orchestra.run.smithi036.stdout:10 Jan 01:21:23 ntpd[9680]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2022-01-10T01:21:23.445 INFO:teuthology.orchestra.run.smithi059.stderr:restrict ::: KOD does nothing without LIMITED. 2022-01-10T01:21:23.446 INFO:teuthology.orchestra.run.smithi036.stderr:restrict ::: KOD does nothing without LIMITED. 2022-01-10T01:21:23.448 INFO:teuthology.orchestra.run.smithi059.stdout:10 Jan 01:21:23 ntpd[9682]: Listen and drop on 0 v6wildcard [::]:123 2022-01-10T01:21:23.449 INFO:teuthology.orchestra.run.smithi059.stdout:10 Jan 01:21:23 ntpd[9682]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2022-01-10T01:21:23.449 INFO:teuthology.orchestra.run.smithi059.stdout:10 Jan 01:21:23 ntpd[9682]: Listen normally on 2 lo 127.0.0.1:123 2022-01-10T01:21:23.449 INFO:teuthology.orchestra.run.smithi059.stdout:10 Jan 01:21:23 ntpd[9682]: Listen normally on 3 ens1f0 172.21.15.59:123 2022-01-10T01:21:23.449 INFO:teuthology.orchestra.run.smithi059.stdout:10 Jan 01:21:23 ntpd[9682]: Listen normally on 4 lo [::1]:123 2022-01-10T01:21:23.450 INFO:teuthology.orchestra.run.smithi059.stdout:10 Jan 01:21:23 ntpd[9682]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:192a%4]:123 2022-01-10T01:21:23.450 INFO:teuthology.orchestra.run.smithi059.stdout:10 Jan 01:21:23 ntpd[9682]: Listening on routing socket on fd #22 for interface updates 2022-01-10T01:21:23.451 INFO:teuthology.orchestra.run.smithi036.stdout:10 Jan 01:21:23 ntpd[9680]: restrict ::: KOD does nothing without LIMITED. 2022-01-10T01:21:23.451 INFO:teuthology.orchestra.run.smithi036.stdout:10 Jan 01:21:23 ntpd[9680]: Listen and drop on 0 v6wildcard [::]:123 2022-01-10T01:21:23.451 INFO:teuthology.orchestra.run.smithi036.stdout:10 Jan 01:21:23 ntpd[9680]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2022-01-10T01:21:23.451 INFO:teuthology.orchestra.run.smithi036.stdout:10 Jan 01:21:23 ntpd[9680]: Listen normally on 2 lo 127.0.0.1:123 2022-01-10T01:21:23.452 INFO:teuthology.orchestra.run.smithi036.stdout:10 Jan 01:21:23 ntpd[9680]: Listen normally on 3 ens1f0 172.21.15.36:123 2022-01-10T01:21:23.452 INFO:teuthology.orchestra.run.smithi036.stdout:10 Jan 01:21:23 ntpd[9680]: Listen normally on 4 lo [::1]:123 2022-01-10T01:21:23.452 INFO:teuthology.orchestra.run.smithi036.stdout:10 Jan 01:21:23 ntpd[9680]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2542%4]:123 2022-01-10T01:21:23.452 INFO:teuthology.orchestra.run.smithi036.stdout:10 Jan 01:21:23 ntpd[9680]: Listening on routing socket on fd #22 for interface updates 2022-01-10T01:21:23.453 INFO:teuthology.orchestra.run.smithi139.stdout:10 Jan 01:21:23 ntpd[9753]: ntpd 4.2.8p12@1.3728-o (1): Starting 2022-01-10T01:21:23.453 INFO:teuthology.orchestra.run.smithi139.stdout:10 Jan 01:21:23 ntpd[9753]: Command line: ntpd -gq 2022-01-10T01:21:23.453 INFO:teuthology.orchestra.run.smithi139.stdout:10 Jan 01:21:23 ntpd[9753]: proto: precision = 0.120 usec (-23) 2022-01-10T01:21:23.454 INFO:teuthology.orchestra.run.smithi166.stdout:10 Jan 01:21:23 ntpd[9764]: ntpd 4.2.8p12@1.3728-o (1): Starting 2022-01-10T01:21:23.454 INFO:teuthology.orchestra.run.smithi166.stdout:10 Jan 01:21:23 ntpd[9764]: Command line: ntpd -gq 2022-01-10T01:21:23.454 INFO:teuthology.orchestra.run.smithi166.stdout:10 Jan 01:21:23 ntpd[9764]: proto: precision = 0.120 usec (-23) 2022-01-10T01:21:23.455 INFO:teuthology.orchestra.run.smithi139.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2022-01-10T01:21:23.455 INFO:teuthology.orchestra.run.smithi166.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2022-01-10T01:21:23.456 INFO:teuthology.orchestra.run.smithi139.stdout:10 Jan 01:21:23 ntpd[9753]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2022-01-10T01:21:23.456 INFO:teuthology.orchestra.run.smithi166.stdout:10 Jan 01:21:23 ntpd[9764]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2022-01-10T01:21:23.457 INFO:teuthology.orchestra.run.smithi139.stderr:restrict ::: KOD does nothing without LIMITED. 2022-01-10T01:21:23.457 INFO:teuthology.orchestra.run.smithi166.stderr:restrict ::: KOD does nothing without LIMITED. 2022-01-10T01:21:23.459 INFO:teuthology.orchestra.run.smithi139.stdout:10 Jan 01:21:23 ntpd[9753]: restrict ::: KOD does nothing without LIMITED. 2022-01-10T01:21:23.460 INFO:teuthology.orchestra.run.smithi139.stdout:10 Jan 01:21:23 ntpd[9753]: Listen and drop on 0 v6wildcard [::]:123 2022-01-10T01:21:23.460 INFO:teuthology.orchestra.run.smithi139.stdout:10 Jan 01:21:23 ntpd[9753]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2022-01-10T01:21:23.460 INFO:teuthology.orchestra.run.smithi139.stdout:10 Jan 01:21:23 ntpd[9753]: Listen normally on 2 lo 127.0.0.1:123 2022-01-10T01:21:23.461 INFO:teuthology.orchestra.run.smithi139.stdout:10 Jan 01:21:23 ntpd[9753]: Listen normally on 3 enp3s0f1 172.21.15.139:123 2022-01-10T01:21:23.461 INFO:teuthology.orchestra.run.smithi139.stdout:10 Jan 01:21:23 ntpd[9753]: Listen normally on 4 lo [::1]:123 2022-01-10T01:21:23.461 INFO:teuthology.orchestra.run.smithi139.stdout:10 Jan 01:21:23 ntpd[9753]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f59%5]:123 2022-01-10T01:21:23.461 INFO:teuthology.orchestra.run.smithi139.stdout:10 Jan 01:21:23 ntpd[9753]: Listening on routing socket on fd #22 for interface updates 2022-01-10T01:21:23.461 INFO:teuthology.orchestra.run.smithi166.stdout:10 Jan 01:21:23 ntpd[9764]: restrict ::: KOD does nothing without LIMITED. 2022-01-10T01:21:23.462 INFO:teuthology.orchestra.run.smithi166.stdout:10 Jan 01:21:23 ntpd[9764]: Listen and drop on 0 v6wildcard [::]:123 2022-01-10T01:21:23.462 INFO:teuthology.orchestra.run.smithi166.stdout:10 Jan 01:21:23 ntpd[9764]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2022-01-10T01:21:23.462 INFO:teuthology.orchestra.run.smithi166.stdout:10 Jan 01:21:23 ntpd[9764]: Listen normally on 2 lo 127.0.0.1:123 2022-01-10T01:21:23.462 INFO:teuthology.orchestra.run.smithi166.stdout:10 Jan 01:21:23 ntpd[9764]: Listen normally on 3 enp3s0f1 172.21.15.166:123 2022-01-10T01:21:23.463 INFO:teuthology.orchestra.run.smithi166.stdout:10 Jan 01:21:23 ntpd[9764]: Listen normally on 4 lo [::1]:123 2022-01-10T01:21:23.463 INFO:teuthology.orchestra.run.smithi166.stdout:10 Jan 01:21:23 ntpd[9764]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77ed%5]:123 2022-01-10T01:21:23.463 INFO:teuthology.orchestra.run.smithi166.stdout:10 Jan 01:21:23 ntpd[9764]: Listening on routing socket on fd #22 for interface updates 2022-01-10T01:21:24.440 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:24 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:24.440 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:24 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:24 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:24 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:24 ntpd[9682]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:24 ntpd[9682]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:24.443 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:24 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:24.444 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:24 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:24.444 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:24 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:24.444 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:24 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:24.444 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:24 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:24.444 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:24 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:24.445 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:24 ntpd[9680]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:24.445 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:24 ntpd[9680]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:24.445 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:24 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:24.445 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:24 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:24.445 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:24 ntpd[9680]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:24.446 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:24 ntpd[9680]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:24.447 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:24 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:24.447 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:24 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:24.447 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:24 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:24.448 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:24 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:24.448 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:24 ntpd[9753]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:24.448 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:24 ntpd[9753]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:25 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:25 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:25 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:25.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:25 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:25 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:25 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:25 ntpd[9682]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:25.442 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:25 ntpd[9682]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:25.443 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:25 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:25.443 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:25 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:25.443 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:25 ntpd[9682]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:25.443 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:25 ntpd[9682]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:25 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:25.446 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:25 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:25 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:25 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:25 ntpd[9753]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:25.447 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:25 ntpd[9753]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:25.448 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:25 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:25.448 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:25 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:25.448 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:25 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:25.449 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:25 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:25.449 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:25 ntpd[9680]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:25.449 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:25 ntpd[9680]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:25.450 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:25 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:25.450 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:25 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:25.450 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:25 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:25.451 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:25 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:25.451 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:25 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:25.451 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:25 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:25.452 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:25 ntpd[9764]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:25.452 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:25 ntpd[9764]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:25.452 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:25 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:25.452 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:25 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:25.452 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:25 ntpd[9764]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:25.453 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:25 ntpd[9764]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:26.440 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:26 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:26.440 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:26 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:26.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:26 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:26.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:26 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:26.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:26 ntpd[9682]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:26.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:26 ntpd[9682]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:26.444 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:26.444 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:26.445 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:26.445 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:26.445 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:26.445 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:26.446 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:26.446 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:26.446 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:26.447 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:26.447 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:26.447 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:26.448 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:26.448 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:26.449 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:26.449 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:26.449 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:26.450 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:26 ntpd[9680]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:26.453 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:26 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:26.453 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:26 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:26.454 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:26 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:26.454 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:26 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:26.454 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:26 ntpd[9764]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:26.455 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:26 ntpd[9764]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:26.455 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:26 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:26.456 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:26 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:26.456 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:26 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:26.456 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:26 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:26.457 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:26 ntpd[9753]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:26.457 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:26 ntpd[9753]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:27.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:27.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:27.442 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:27.442 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:27.442 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:27.443 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:27.443 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:27.443 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:27.443 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:27.444 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:27.444 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:27.444 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:27.444 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:27.445 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:27.445 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:27.445 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:27.445 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:27.445 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:27 ntpd[9682]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:27.448 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:27 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:27.448 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:27 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:27.448 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:27 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:27.449 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:27 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:27.449 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:27 ntpd[9753]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:27.449 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:27 ntpd[9753]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:27.450 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:27 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:27.450 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:27 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:27.451 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:27 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:27.451 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:27 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:27.452 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:27 ntpd[9680]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:27.452 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:27 ntpd[9680]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:27.453 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:27 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:27.453 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:27 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:27.454 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:27 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:27.454 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:27 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:27.454 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:27 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:27.454 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:27 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:27.455 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:27 ntpd[9764]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:27.455 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:27 ntpd[9764]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:27.455 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:27 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:27.455 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:27 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:27.455 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:27 ntpd[9764]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:27.456 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:27 ntpd[9764]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:28.440 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:28 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.440 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:28 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:28 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:28 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:28 ntpd[9682]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:28.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:28 ntpd[9682]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:28.444 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.444 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.444 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.444 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.445 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.445 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.445 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.445 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.446 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:28.446 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:28.446 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.446 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.447 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:28.447 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:28.447 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.447 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.447 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:28.448 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:28 ntpd[9680]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:28.450 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:28 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.451 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:28 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.451 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:28 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.451 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:28 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.451 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:28 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.452 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:28 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.452 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:28 ntpd[9764]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:28.452 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:28 ntpd[9764]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:28.452 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:28 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.453 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:28 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.453 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:28 ntpd[9764]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:28.453 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:28 ntpd[9764]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:28.454 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.454 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.455 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.455 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.455 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.455 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.456 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.456 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.456 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:28.456 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:28.456 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.457 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.457 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:28.457 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:28.457 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:28.458 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:28.458 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:28.458 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:28 ntpd[9753]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:29.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:29.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:29.442 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:29.442 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:29.442 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:29.443 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:29.443 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:29.443 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:29.443 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:29.443 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:29.444 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:29.444 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:29.444 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:29.444 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:29.445 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:29.445 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:29.445 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:29.445 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:29 ntpd[9682]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:29.448 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:29 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:29.448 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:29 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:29.448 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:29 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:29.448 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:29 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:29.449 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:29 ntpd[9753]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:29.449 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:29 ntpd[9753]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:29.449 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:29 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:29.449 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:29 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:29.450 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:29 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:29.450 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:29 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:29.450 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:29 ntpd[9680]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:29.450 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:29 ntpd[9680]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:29.451 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:29 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:29.452 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:29 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:29.452 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:29 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:29.452 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:29 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:29.452 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:29 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:29.453 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:29 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:29.453 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:29 ntpd[9764]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:29.453 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:29 ntpd[9764]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:29.453 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:29 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:29.453 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:29 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:29.454 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:29 ntpd[9764]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:29.454 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:29 ntpd[9764]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:30.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:30 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.441 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:30 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.442 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:30 ntpd[9682]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.442 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:30 ntpd[9682]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.442 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:30 ntpd[9682]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:30.442 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:30 ntpd[9682]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:30.443 INFO:teuthology.orchestra.run.smithi059.stdout:10 Jan 01:21:30 ntpd[9682]: ntpd: time slew +0.001119 s 2022-01-10T01:21:30.443 INFO:teuthology.orchestra.run.smithi059.stdout:ntpd: time slew +0.001119s 2022-01-10T01:21:30.444 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:30 ntpd[9682]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2022-01-10T01:21:30.444 INFO:teuthology.orchestra.run.smithi059.stderr:10 Jan 01:21:30 ntpd[9682]: can't open /var/log/ntpstats/loopstats.20220110: Permission denied 2022-01-10T01:21:30.449 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:30 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.449 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:30 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.449 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:30 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.449 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:30 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.450 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:30 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.450 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:30 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.450 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:30 ntpd[9764]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:30.450 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:30 ntpd[9764]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:30.451 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:30 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.451 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:30 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.451 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:30 ntpd[9764]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:30.451 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:30 ntpd[9764]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:30.452 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.452 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.452 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.453 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.453 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.453 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.453 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.453 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.454 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.455 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:30.455 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:30.455 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.455 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.456 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.456 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.456 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.456 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.457 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.457 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.457 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:30.457 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:30.457 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:30.458 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:30.458 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:30.458 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:30.459 INFO:teuthology.orchestra.run.smithi139.stdout:10 Jan 01:21:30 ntpd[9753]: ntpd: time slew +0.000785 s 2022-01-10T01:21:30.459 INFO:teuthology.orchestra.run.smithi139.stdout:ntpd: time slew +0.000785s 2022-01-10T01:21:30.459 INFO:teuthology.orchestra.run.smithi036.stdout:10 Jan 01:21:30 ntpd[9680]: ntpd: time slew +0.001277 s 2022-01-10T01:21:30.459 INFO:teuthology.orchestra.run.smithi036.stdout:ntpd: time slew +0.001277s 2022-01-10T01:21:30.460 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2022-01-10T01:21:30.460 INFO:teuthology.orchestra.run.smithi139.stderr:10 Jan 01:21:30 ntpd[9753]: can't open /var/log/ntpstats/loopstats.20220110: Permission denied 2022-01-10T01:21:30.461 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2022-01-10T01:21:30.461 INFO:teuthology.orchestra.run.smithi036.stderr:10 Jan 01:21:30 ntpd[9680]: can't open /var/log/ntpstats/loopstats.20220110: Permission denied 2022-01-10T01:21:30.494 INFO:teuthology.orchestra.run.smithi059.stdout: remote refid st t when poll reach delay offset jitter 2022-01-10T01:21:30.495 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================== 2022-01-10T01:21:30.495 INFO:teuthology.orchestra.run.smithi059.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:30.495 INFO:teuthology.orchestra.run.smithi059.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:30.495 INFO:teuthology.orchestra.run.smithi059.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:30.496 INFO:teuthology.orchestra.run.smithi059.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:30.511 INFO:teuthology.orchestra.run.smithi036.stdout: remote refid st t when poll reach delay offset jitter 2022-01-10T01:21:30.511 INFO:teuthology.orchestra.run.smithi036.stdout:============================================================================== 2022-01-10T01:21:30.511 INFO:teuthology.orchestra.run.smithi036.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:30.511 INFO:teuthology.orchestra.run.smithi036.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:30.512 INFO:teuthology.orchestra.run.smithi036.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:30.512 INFO:teuthology.orchestra.run.smithi036.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:30.514 INFO:teuthology.orchestra.run.smithi139.stdout: remote refid st t when poll reach delay offset jitter 2022-01-10T01:21:30.514 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================== 2022-01-10T01:21:30.514 INFO:teuthology.orchestra.run.smithi139.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:30.514 INFO:teuthology.orchestra.run.smithi139.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:30.515 INFO:teuthology.orchestra.run.smithi139.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:30.515 INFO:teuthology.orchestra.run.smithi139.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:31.444 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:31 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:31.445 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:31 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:31.445 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:31 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:31.445 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:31 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:31.446 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:31 ntpd[9764]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-01-10T01:21:31.446 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:31 ntpd[9764]: can't open /var/log/ntpstats/rawstats.20220110: Permission denied 2022-01-10T01:21:31.446 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:31 ntpd[9764]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-01-10T01:21:31.446 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:31 ntpd[9764]: can't open /var/log/ntpstats/peerstats.20220110: Permission denied 2022-01-10T01:21:31.447 INFO:teuthology.orchestra.run.smithi166.stdout:10 Jan 01:21:31 ntpd[9764]: ntpd: time slew +0.000477 s 2022-01-10T01:21:31.447 INFO:teuthology.orchestra.run.smithi166.stdout:ntpd: time slew +0.000477s 2022-01-10T01:21:31.448 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:31 ntpd[9764]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2022-01-10T01:21:31.448 INFO:teuthology.orchestra.run.smithi166.stderr:10 Jan 01:21:31 ntpd[9764]: can't open /var/log/ntpstats/loopstats.20220110: Permission denied 2022-01-10T01:21:31.513 INFO:teuthology.orchestra.run.smithi166.stdout: remote refid st t when poll reach delay offset jitter 2022-01-10T01:21:31.513 INFO:teuthology.orchestra.run.smithi166.stdout:============================================================================== 2022-01-10T01:21:31.514 INFO:teuthology.orchestra.run.smithi166.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:31.514 INFO:teuthology.orchestra.run.smithi166.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:31.515 INFO:teuthology.orchestra.run.smithi166.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:31.515 INFO:teuthology.orchestra.run.smithi166.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-01-10T01:21:31.516 INFO:teuthology.run_tasks:Running task install... 2022-01-10T01:21:31.532 DEBUG:teuthology.task.install:project ceph 2022-01-10T01:21:31.533 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be'}} 2022-01-10T01:21:31.533 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be'} 2022-01-10T01:21:31.534 INFO:teuthology.task.install:Using flavor: default 2022-01-10T01:21:31.546 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-01-10T01:21:31.547 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2022-01-10T01:21:31.548 DEBUG:teuthology.orchestra.run.smithi036:> sudo lsb_release -is 2022-01-10T01:21:31.602 INFO:teuthology.orchestra.run.smithi036.stdout:Ubuntu 2022-01-10T01:21:31.607 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-01-10T01:21:31.608 DEBUG:teuthology.orchestra.run.smithi059:> sudo lsb_release -is 2022-01-10T01:21:31.609 DEBUG:teuthology.orchestra.run.smithi036:> sudo apt-key list | grep Ceph 2022-01-10T01:21:31.661 INFO:teuthology.orchestra.run.smithi059.stdout:Ubuntu 2022-01-10T01:21:31.667 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-01-10T01:21:31.668 DEBUG:teuthology.orchestra.run.smithi139:> sudo lsb_release -is 2022-01-10T01:21:31.668 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-key list | grep Ceph 2022-01-10T01:21:31.712 INFO:teuthology.orchestra.run.smithi036.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2022-01-10T01:21:31.720 INFO:teuthology.orchestra.run.smithi139.stdout:Ubuntu 2022-01-10T01:21:31.726 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-01-10T01:21:31.726 DEBUG:teuthology.orchestra.run.smithi166:> sudo lsb_release -is 2022-01-10T01:21:31.727 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-key list | grep Ceph 2022-01-10T01:21:31.766 INFO:teuthology.orchestra.run.smithi036.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2022-01-10T01:21:31.766 INFO:teuthology.orchestra.run.smithi036.stdout:uid [ unknown] Ceph.com (release key) 2022-01-10T01:21:31.768 DEBUG:teuthology.orchestra.run.smithi036:> sudo lsb_release -is 2022-01-10T01:21:31.770 INFO:teuthology.orchestra.run.smithi059.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2022-01-10T01:21:31.777 INFO:teuthology.orchestra.run.smithi166.stdout:Ubuntu 2022-01-10T01:21:31.782 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-01-10T01:21:31.783 DEBUG:teuthology.orchestra.run.smithi166:> sudo apt-key list | grep Ceph 2022-01-10T01:21:31.817 INFO:teuthology.orchestra.run.smithi036.stdout:Ubuntu 2022-01-10T01:21:31.822 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-01-10T01:21:31.823 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2022-01-10T01:21:31.823 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2022-01-10T01:21:31.824 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be 2022-01-10T01:21:31.829 INFO:teuthology.orchestra.run.smithi139.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2022-01-10T01:21:31.830 INFO:teuthology.orchestra.run.smithi059.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2022-01-10T01:21:31.831 INFO:teuthology.orchestra.run.smithi059.stdout:uid [ unknown] Ceph.com (release key) 2022-01-10T01:21:31.831 DEBUG:teuthology.orchestra.run.smithi059:> sudo lsb_release -is 2022-01-10T01:21:31.879 INFO:teuthology.orchestra.run.smithi059.stdout:Ubuntu 2022-01-10T01:21:31.880 INFO:teuthology.orchestra.run.smithi139.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2022-01-10T01:21:31.881 INFO:teuthology.orchestra.run.smithi139.stdout:uid [ unknown] Ceph.com (release key) 2022-01-10T01:21:31.881 DEBUG:teuthology.orchestra.run.smithi139:> sudo lsb_release -is 2022-01-10T01:21:31.882 INFO:teuthology.orchestra.run.smithi166.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2022-01-10T01:21:31.884 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-01-10T01:21:31.885 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2022-01-10T01:21:31.885 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2022-01-10T01:21:31.885 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be 2022-01-10T01:21:31.930 INFO:teuthology.orchestra.run.smithi139.stdout:Ubuntu 2022-01-10T01:21:31.935 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-01-10T01:21:31.936 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2022-01-10T01:21:31.936 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2022-01-10T01:21:31.936 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be 2022-01-10T01:21:31.941 INFO:teuthology.orchestra.run.smithi166.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2022-01-10T01:21:31.942 INFO:teuthology.orchestra.run.smithi166.stdout:uid [ unknown] Ceph.com (release key) 2022-01-10T01:21:31.942 DEBUG:teuthology.orchestra.run.smithi166:> sudo lsb_release -is 2022-01-10T01:21:31.992 INFO:teuthology.orchestra.run.smithi166.stdout:Ubuntu 2022-01-10T01:21:31.997 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-01-10T01:21:31.998 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2022-01-10T01:21:31.998 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2022-01-10T01:21:31.999 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be 2022-01-10T01:21:32.038 INFO:teuthology.task.install.deb:Pulling from https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default/ 2022-01-10T01:21:32.039 INFO:teuthology.task.install.deb:Package version is 15.2.14-1focal 2022-01-10T01:21:32.079 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2022-01-10T01:21:32.079 DEBUG:teuthology.orchestra.run.smithi036:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2022-01-10T01:21:32.096 DEBUG:teuthology.orchestra.run.smithi036:> sudo apt-get update 2022-01-10T01:21:32.104 INFO:teuthology.task.install.deb:Pulling from https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default/ 2022-01-10T01:21:32.105 INFO:teuthology.task.install.deb:Package version is 15.2.14-1focal 2022-01-10T01:21:32.129 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2022-01-10T01:21:32.129 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2022-01-10T01:21:32.145 INFO:teuthology.task.install.deb:Pulling from https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default/ 2022-01-10T01:21:32.145 INFO:teuthology.task.install.deb:Package version is 15.2.14-1focal 2022-01-10T01:21:32.149 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get update 2022-01-10T01:21:32.179 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2022-01-10T01:21:32.179 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2022-01-10T01:21:32.197 DEBUG:teuthology.orchestra.run.smithi139:> sudo apt-get update 2022-01-10T01:21:32.211 INFO:teuthology.task.install.deb:Pulling from https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default/ 2022-01-10T01:21:32.212 INFO:teuthology.task.install.deb:Package version is 15.2.14-1focal 2022-01-10T01:21:32.224 INFO:teuthology.orchestra.run.smithi036.stdout:Ign:1 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal InRelease 2022-01-10T01:21:32.226 INFO:teuthology.orchestra.run.smithi036.stdout:Get:2 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal Release [7,689 B] 2022-01-10T01:21:32.228 INFO:teuthology.orchestra.run.smithi036.stdout:Ign:3 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal Release.gpg 2022-01-10T01:21:32.229 INFO:teuthology.orchestra.run.smithi036.stdout:Get:4 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main i386 Packages [3,253 B] 2022-01-10T01:21:32.239 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-01-10T01:21:32.239 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2022-01-10T01:21:32.251 INFO:teuthology.orchestra.run.smithi036.stdout:Get:5 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 Packages [16.0 kB] 2022-01-10T01:21:32.255 DEBUG:teuthology.orchestra.run.smithi166:> sudo apt-get update 2022-01-10T01:21:32.312 INFO:teuthology.orchestra.run.smithi059.stdout:Ign:1 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal InRelease 2022-01-10T01:21:32.313 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal Release [7,689 B] 2022-01-10T01:21:32.314 INFO:teuthology.orchestra.run.smithi059.stdout:Ign:3 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal Release.gpg 2022-01-10T01:21:32.315 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main i386 Packages [3,253 B] 2022-01-10T01:21:32.346 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2022-01-10T01:21:32.347 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 Packages [16.0 kB] 2022-01-10T01:21:32.357 INFO:teuthology.orchestra.run.smithi139.stdout:Ign:1 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal InRelease 2022-01-10T01:21:32.358 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal Release [7,689 B] 2022-01-10T01:21:32.361 INFO:teuthology.orchestra.run.smithi139.stdout:Ign:3 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal Release.gpg 2022-01-10T01:21:32.362 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main i386 Packages [3,253 B] 2022-01-10T01:21:32.369 INFO:teuthology.orchestra.run.smithi166.stdout:Ign:1 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal InRelease 2022-01-10T01:21:32.369 INFO:teuthology.orchestra.run.smithi166.stdout:Get:2 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal Release [7,689 B] 2022-01-10T01:21:32.372 INFO:teuthology.orchestra.run.smithi166.stdout:Ign:3 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal Release.gpg 2022-01-10T01:21:32.373 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal InRelease 2022-01-10T01:21:32.374 INFO:teuthology.orchestra.run.smithi166.stdout:Get:4 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main i386 Packages [3,253 B] 2022-01-10T01:21:32.385 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 Packages [16.0 kB] 2022-01-10T01:21:32.404 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2022-01-10T01:21:32.405 INFO:teuthology.orchestra.run.smithi166.stdout:Get:5 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 Packages [16.0 kB] 2022-01-10T01:21:32.448 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2022-01-10T01:21:32.465 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal InRelease 2022-01-10T01:21:32.520 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal InRelease 2022-01-10T01:21:32.520 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2022-01-10T01:21:32.533 INFO:teuthology.orchestra.run.smithi036.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2022-01-10T01:21:32.534 INFO:teuthology.orchestra.run.smithi166.stdout:Hit:6 http://security.ubuntu.com/ubuntu focal-security InRelease 2022-01-10T01:21:32.534 INFO:teuthology.orchestra.run.smithi166.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal InRelease 2022-01-10T01:21:32.551 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2022-01-10T01:21:32.594 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2022-01-10T01:21:32.609 INFO:teuthology.orchestra.run.smithi166.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2022-01-10T01:21:32.637 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2022-01-10T01:21:32.679 INFO:teuthology.orchestra.run.smithi139.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2022-01-10T01:21:32.694 INFO:teuthology.orchestra.run.smithi166.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2022-01-10T01:21:33.032 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 26.9 kB in 1s (40.5 kB/s) 2022-01-10T01:21:33.053 INFO:teuthology.orchestra.run.smithi036.stdout:Fetched 26.9 kB in 1s (34.0 kB/s) 2022-01-10T01:21:33.184 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 26.9 kB in 1s (34.5 kB/s) 2022-01-10T01:21:33.187 INFO:teuthology.orchestra.run.smithi166.stdout:Fetched 26.9 kB in 1s (34.5 kB/s) 2022-01-10T01:21:33.869 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2022-01-10T01:21:33.893 DEBUG:teuthology.orchestra.run.smithi059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-1focal cephadm=15.2.14-1focal ceph-mds=15.2.14-1focal ceph-mgr=15.2.14-1focal ceph-common=15.2.14-1focal ceph-fuse=15.2.14-1focal ceph-test=15.2.14-1focal radosgw=15.2.14-1focal python3-rados=15.2.14-1focal python3-rgw=15.2.14-1focal python3-cephfs=15.2.14-1focal python3-rbd=15.2.14-1focal libcephfs2=15.2.14-1focal libcephfs-dev=15.2.14-1focal librados2=15.2.14-1focal librbd1=15.2.14-1focal rbd-fuse=15.2.14-1focal python3-cephfs=15.2.14-1focal cephfs-shell=15.2.14-1focal 2022-01-10T01:21:33.901 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2022-01-10T01:21:33.923 DEBUG:teuthology.orchestra.run.smithi036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-1focal cephadm=15.2.14-1focal ceph-mds=15.2.14-1focal ceph-mgr=15.2.14-1focal ceph-common=15.2.14-1focal ceph-fuse=15.2.14-1focal ceph-test=15.2.14-1focal radosgw=15.2.14-1focal python3-rados=15.2.14-1focal python3-rgw=15.2.14-1focal python3-cephfs=15.2.14-1focal python3-rbd=15.2.14-1focal libcephfs2=15.2.14-1focal libcephfs-dev=15.2.14-1focal librados2=15.2.14-1focal librbd1=15.2.14-1focal rbd-fuse=15.2.14-1focal python3-cephfs=15.2.14-1focal cephfs-shell=15.2.14-1focal 2022-01-10T01:21:33.964 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2022-01-10T01:21:33.993 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2022-01-10T01:21:33.995 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2022-01-10T01:21:34.002 INFO:teuthology.orchestra.run.smithi166.stdout:Reading package lists... 2022-01-10T01:21:34.018 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-1focal cephadm=15.2.14-1focal ceph-mds=15.2.14-1focal ceph-mgr=15.2.14-1focal ceph-common=15.2.14-1focal ceph-fuse=15.2.14-1focal ceph-test=15.2.14-1focal radosgw=15.2.14-1focal python3-rados=15.2.14-1focal python3-rgw=15.2.14-1focal python3-cephfs=15.2.14-1focal python3-rbd=15.2.14-1focal libcephfs2=15.2.14-1focal libcephfs-dev=15.2.14-1focal librados2=15.2.14-1focal librbd1=15.2.14-1focal rbd-fuse=15.2.14-1focal python3-cephfs=15.2.14-1focal cephfs-shell=15.2.14-1focal 2022-01-10T01:21:34.025 DEBUG:teuthology.orchestra.run.smithi166:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.14-1focal cephadm=15.2.14-1focal ceph-mds=15.2.14-1focal ceph-mgr=15.2.14-1focal ceph-common=15.2.14-1focal ceph-fuse=15.2.14-1focal ceph-test=15.2.14-1focal radosgw=15.2.14-1focal python3-rados=15.2.14-1focal python3-rgw=15.2.14-1focal python3-cephfs=15.2.14-1focal python3-rbd=15.2.14-1focal libcephfs2=15.2.14-1focal libcephfs-dev=15.2.14-1focal librados2=15.2.14-1focal librbd1=15.2.14-1focal rbd-fuse=15.2.14-1focal python3-cephfs=15.2.14-1focal cephfs-shell=15.2.14-1focal 2022-01-10T01:21:34.087 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2022-01-10T01:21:34.089 INFO:teuthology.orchestra.run.smithi166.stdout:Reading package lists... 2022-01-10T01:21:34.138 INFO:teuthology.orchestra.run.smithi059.stdout:Building dependency tree... 2022-01-10T01:21:34.139 INFO:teuthology.orchestra.run.smithi059.stdout:Reading state information... 2022-01-10T01:21:34.152 INFO:teuthology.orchestra.run.smithi036.stdout:Building dependency tree... 2022-01-10T01:21:34.153 INFO:teuthology.orchestra.run.smithi036.stdout:Reading state information... 2022-01-10T01:21:34.238 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2022-01-10T01:21:34.239 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2022-01-10T01:21:34.259 INFO:teuthology.orchestra.run.smithi166.stdout:Building dependency tree... 2022-01-10T01:21:34.260 INFO:teuthology.orchestra.run.smithi166.stdout:Reading state information... 2022-01-10T01:21:34.290 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages were automatically installed and are no longer required: 2022-01-10T01:21:34.290 INFO:teuthology.orchestra.run.smithi059.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2022-01-10T01:21:34.290 INFO:teuthology.orchestra.run.smithi059.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2022-01-10T01:21:34.290 INFO:teuthology.orchestra.run.smithi059.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2022-01-10T01:21:34.292 INFO:teuthology.orchestra.run.smithi059.stdout: linux-modules-extra-5.4.0-66-generic 2022-01-10T01:21:34.292 INFO:teuthology.orchestra.run.smithi059.stdout:Use 'sudo apt autoremove' to remove them. 2022-01-10T01:21:34.293 INFO:teuthology.orchestra.run.smithi059.stdout:The following additional packages will be installed: 2022-01-10T01:21:34.293 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2022-01-10T01:21:34.293 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2022-01-10T01:21:34.293 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2022-01-10T01:21:34.294 INFO:teuthology.orchestra.run.smithi059.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2022-01-10T01:21:34.294 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2022-01-10T01:21:34.294 INFO:teuthology.orchestra.run.smithi059.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2022-01-10T01:21:34.294 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2022-01-10T01:21:34.295 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2022-01-10T01:21:34.295 INFO:teuthology.orchestra.run.smithi059.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2022-01-10T01:21:34.295 INFO:teuthology.orchestra.run.smithi059.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2022-01-10T01:21:34.295 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2022-01-10T01:21:34.295 INFO:teuthology.orchestra.run.smithi059.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2022-01-10T01:21:34.296 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2022-01-10T01:21:34.296 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2022-01-10T01:21:34.296 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2022-01-10T01:21:34.296 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2022-01-10T01:21:34.297 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2022-01-10T01:21:34.297 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2022-01-10T01:21:34.297 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2022-01-10T01:21:34.297 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet 2022-01-10T01:21:34.298 INFO:teuthology.orchestra.run.smithi059.stdout:Suggested packages: 2022-01-10T01:21:34.298 INFO:teuthology.orchestra.run.smithi059.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2022-01-10T01:21:34.298 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2022-01-10T01:21:34.298 INFO:teuthology.orchestra.run.smithi059.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2022-01-10T01:21:34.298 INFO:teuthology.orchestra.run.smithi059.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2022-01-10T01:21:34.299 INFO:teuthology.orchestra.run.smithi059.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2022-01-10T01:21:34.299 INFO:teuthology.orchestra.run.smithi059.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2022-01-10T01:21:34.299 INFO:teuthology.orchestra.run.smithi059.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2022-01-10T01:21:34.299 INFO:teuthology.orchestra.run.smithi059.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2022-01-10T01:21:34.300 INFO:teuthology.orchestra.run.smithi059.stdout:Recommended packages: 2022-01-10T01:21:34.300 INFO:teuthology.orchestra.run.smithi059.stdout: btrfs-tools 2022-01-10T01:21:34.302 INFO:teuthology.orchestra.run.smithi036.stdout:The following packages were automatically installed and are no longer required: 2022-01-10T01:21:34.302 INFO:teuthology.orchestra.run.smithi036.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2022-01-10T01:21:34.302 INFO:teuthology.orchestra.run.smithi036.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2022-01-10T01:21:34.302 INFO:teuthology.orchestra.run.smithi036.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2022-01-10T01:21:34.303 INFO:teuthology.orchestra.run.smithi036.stdout: linux-modules-extra-5.4.0-66-generic 2022-01-10T01:21:34.303 INFO:teuthology.orchestra.run.smithi036.stdout:Use 'sudo apt autoremove' to remove them. 2022-01-10T01:21:34.303 INFO:teuthology.orchestra.run.smithi036.stdout:The following additional packages will be installed: 2022-01-10T01:21:34.303 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2022-01-10T01:21:34.304 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2022-01-10T01:21:34.304 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2022-01-10T01:21:34.304 INFO:teuthology.orchestra.run.smithi036.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2022-01-10T01:21:34.304 INFO:teuthology.orchestra.run.smithi036.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2022-01-10T01:21:34.305 INFO:teuthology.orchestra.run.smithi036.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2022-01-10T01:21:34.305 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2022-01-10T01:21:34.305 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2022-01-10T01:21:34.305 INFO:teuthology.orchestra.run.smithi036.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2022-01-10T01:21:34.305 INFO:teuthology.orchestra.run.smithi036.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2022-01-10T01:21:34.306 INFO:teuthology.orchestra.run.smithi036.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2022-01-10T01:21:34.306 INFO:teuthology.orchestra.run.smithi036.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2022-01-10T01:21:34.306 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2022-01-10T01:21:34.306 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2022-01-10T01:21:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2022-01-10T01:21:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2022-01-10T01:21:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2022-01-10T01:21:34.307 INFO:teuthology.orchestra.run.smithi036.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2022-01-10T01:21:34.308 INFO:teuthology.orchestra.run.smithi036.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2022-01-10T01:21:34.308 INFO:teuthology.orchestra.run.smithi036.stdout: xmlstarlet 2022-01-10T01:21:34.308 INFO:teuthology.orchestra.run.smithi036.stdout:Suggested packages: 2022-01-10T01:21:34.308 INFO:teuthology.orchestra.run.smithi036.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2022-01-10T01:21:34.308 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2022-01-10T01:21:34.309 INFO:teuthology.orchestra.run.smithi036.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2022-01-10T01:21:34.309 INFO:teuthology.orchestra.run.smithi036.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2022-01-10T01:21:34.309 INFO:teuthology.orchestra.run.smithi036.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2022-01-10T01:21:34.309 INFO:teuthology.orchestra.run.smithi036.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2022-01-10T01:21:34.310 INFO:teuthology.orchestra.run.smithi036.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2022-01-10T01:21:34.310 INFO:teuthology.orchestra.run.smithi036.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2022-01-10T01:21:34.310 INFO:teuthology.orchestra.run.smithi036.stdout:Recommended packages: 2022-01-10T01:21:34.310 INFO:teuthology.orchestra.run.smithi036.stdout: btrfs-tools 2022-01-10T01:21:34.367 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2022-01-10T01:21:34.370 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2022-01-10T01:21:34.370 INFO:teuthology.orchestra.run.smithi139.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2022-01-10T01:21:34.370 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2022-01-10T01:21:34.371 INFO:teuthology.orchestra.run.smithi139.stdout: linux-modules-extra-5.4.0-66-generic 2022-01-10T01:21:34.371 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2022-01-10T01:21:34.371 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2022-01-10T01:21:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2022-01-10T01:21:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2022-01-10T01:21:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2022-01-10T01:21:34.372 INFO:teuthology.orchestra.run.smithi139.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2022-01-10T01:21:34.373 INFO:teuthology.orchestra.run.smithi139.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2022-01-10T01:21:34.373 INFO:teuthology.orchestra.run.smithi139.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2022-01-10T01:21:34.373 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2022-01-10T01:21:34.373 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2022-01-10T01:21:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2022-01-10T01:21:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2022-01-10T01:21:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2022-01-10T01:21:34.374 INFO:teuthology.orchestra.run.smithi139.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2022-01-10T01:21:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2022-01-10T01:21:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2022-01-10T01:21:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2022-01-10T01:21:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2022-01-10T01:21:34.375 INFO:teuthology.orchestra.run.smithi139.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2022-01-10T01:21:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2022-01-10T01:21:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2022-01-10T01:21:34.376 INFO:teuthology.orchestra.run.smithi139.stdout: xmlstarlet 2022-01-10T01:21:34.376 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2022-01-10T01:21:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2022-01-10T01:21:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2022-01-10T01:21:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2022-01-10T01:21:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2022-01-10T01:21:34.377 INFO:teuthology.orchestra.run.smithi139.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2022-01-10T01:21:34.378 INFO:teuthology.orchestra.run.smithi139.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2022-01-10T01:21:34.378 INFO:teuthology.orchestra.run.smithi139.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2022-01-10T01:21:34.378 INFO:teuthology.orchestra.run.smithi139.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2022-01-10T01:21:34.378 INFO:teuthology.orchestra.run.smithi139.stdout:Recommended packages: 2022-01-10T01:21:34.379 INFO:teuthology.orchestra.run.smithi139.stdout: btrfs-tools 2022-01-10T01:21:34.396 INFO:teuthology.orchestra.run.smithi059.stdout:The following NEW packages will be installed: 2022-01-10T01:21:34.397 INFO:teuthology.orchestra.run.smithi059.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2022-01-10T01:21:34.397 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2022-01-10T01:21:34.397 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2022-01-10T01:21:34.399 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2022-01-10T01:21:34.399 INFO:teuthology.orchestra.run.smithi059.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2022-01-10T01:21:34.400 INFO:teuthology.orchestra.run.smithi059.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2022-01-10T01:21:34.400 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2022-01-10T01:21:34.400 INFO:teuthology.orchestra.run.smithi059.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2022-01-10T01:21:34.400 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2022-01-10T01:21:34.400 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2022-01-10T01:21:34.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2022-01-10T01:21:34.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2022-01-10T01:21:34.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2022-01-10T01:21:34.401 INFO:teuthology.orchestra.run.smithi059.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2022-01-10T01:21:34.402 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2022-01-10T01:21:34.402 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2022-01-10T01:21:34.402 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2022-01-10T01:21:34.402 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2022-01-10T01:21:34.403 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplejson python3-singledispatch python3-sklearn 2022-01-10T01:21:34.403 INFO:teuthology.orchestra.run.smithi059.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2022-01-10T01:21:34.403 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2022-01-10T01:21:34.403 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2022-01-10T01:21:34.403 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages will be upgraded: 2022-01-10T01:21:34.404 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 librbd1 2022-01-10T01:21:34.405 INFO:teuthology.orchestra.run.smithi036.stdout:The following NEW packages will be installed: 2022-01-10T01:21:34.405 INFO:teuthology.orchestra.run.smithi036.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2022-01-10T01:21:34.406 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2022-01-10T01:21:34.406 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2022-01-10T01:21:34.406 INFO:teuthology.orchestra.run.smithi036.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2022-01-10T01:21:34.406 INFO:teuthology.orchestra.run.smithi036.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2022-01-10T01:21:34.406 INFO:teuthology.orchestra.run.smithi036.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2022-01-10T01:21:34.407 INFO:teuthology.orchestra.run.smithi036.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2022-01-10T01:21:34.407 INFO:teuthology.orchestra.run.smithi036.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2022-01-10T01:21:34.407 INFO:teuthology.orchestra.run.smithi036.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2022-01-10T01:21:34.407 INFO:teuthology.orchestra.run.smithi036.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2022-01-10T01:21:34.408 INFO:teuthology.orchestra.run.smithi036.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2022-01-10T01:21:34.408 INFO:teuthology.orchestra.run.smithi036.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2022-01-10T01:21:34.408 INFO:teuthology.orchestra.run.smithi036.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2022-01-10T01:21:34.408 INFO:teuthology.orchestra.run.smithi036.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2022-01-10T01:21:34.408 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2022-01-10T01:21:34.409 INFO:teuthology.orchestra.run.smithi036.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2022-01-10T01:21:34.409 INFO:teuthology.orchestra.run.smithi036.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2022-01-10T01:21:34.409 INFO:teuthology.orchestra.run.smithi036.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2022-01-10T01:21:34.409 INFO:teuthology.orchestra.run.smithi036.stdout: python3-simplejson python3-singledispatch python3-sklearn 2022-01-10T01:21:34.410 INFO:teuthology.orchestra.run.smithi036.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2022-01-10T01:21:34.410 INFO:teuthology.orchestra.run.smithi036.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2022-01-10T01:21:34.410 INFO:teuthology.orchestra.run.smithi036.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2022-01-10T01:21:34.410 INFO:teuthology.orchestra.run.smithi036.stdout:The following packages will be upgraded: 2022-01-10T01:21:34.410 INFO:teuthology.orchestra.run.smithi036.stdout: librados2 librbd1 2022-01-10T01:21:34.412 INFO:teuthology.orchestra.run.smithi166.stdout:The following packages were automatically installed and are no longer required: 2022-01-10T01:21:34.412 INFO:teuthology.orchestra.run.smithi166.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2022-01-10T01:21:34.413 INFO:teuthology.orchestra.run.smithi166.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2022-01-10T01:21:34.413 INFO:teuthology.orchestra.run.smithi166.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2022-01-10T01:21:34.413 INFO:teuthology.orchestra.run.smithi166.stdout: linux-modules-extra-5.4.0-66-generic 2022-01-10T01:21:34.413 INFO:teuthology.orchestra.run.smithi166.stdout:Use 'sudo apt autoremove' to remove them. 2022-01-10T01:21:34.413 INFO:teuthology.orchestra.run.smithi166.stdout:The following additional packages will be installed: 2022-01-10T01:21:34.414 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2022-01-10T01:21:34.414 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2022-01-10T01:21:34.414 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2022-01-10T01:21:34.414 INFO:teuthology.orchestra.run.smithi166.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2022-01-10T01:21:34.415 INFO:teuthology.orchestra.run.smithi166.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2022-01-10T01:21:34.415 INFO:teuthology.orchestra.run.smithi166.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2022-01-10T01:21:34.415 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2022-01-10T01:21:34.415 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2022-01-10T01:21:34.416 INFO:teuthology.orchestra.run.smithi166.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2022-01-10T01:21:34.416 INFO:teuthology.orchestra.run.smithi166.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2022-01-10T01:21:34.416 INFO:teuthology.orchestra.run.smithi166.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2022-01-10T01:21:34.416 INFO:teuthology.orchestra.run.smithi166.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2022-01-10T01:21:34.416 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2022-01-10T01:21:34.417 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2022-01-10T01:21:34.417 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2022-01-10T01:21:34.417 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2022-01-10T01:21:34.417 INFO:teuthology.orchestra.run.smithi166.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2022-01-10T01:21:34.417 INFO:teuthology.orchestra.run.smithi166.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2022-01-10T01:21:34.418 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2022-01-10T01:21:34.418 INFO:teuthology.orchestra.run.smithi166.stdout: xmlstarlet 2022-01-10T01:21:34.418 INFO:teuthology.orchestra.run.smithi166.stdout:Suggested packages: 2022-01-10T01:21:34.419 INFO:teuthology.orchestra.run.smithi166.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2022-01-10T01:21:34.419 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2022-01-10T01:21:34.419 INFO:teuthology.orchestra.run.smithi166.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2022-01-10T01:21:34.419 INFO:teuthology.orchestra.run.smithi166.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2022-01-10T01:21:34.420 INFO:teuthology.orchestra.run.smithi166.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2022-01-10T01:21:34.420 INFO:teuthology.orchestra.run.smithi166.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2022-01-10T01:21:34.420 INFO:teuthology.orchestra.run.smithi166.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2022-01-10T01:21:34.420 INFO:teuthology.orchestra.run.smithi166.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2022-01-10T01:21:34.420 INFO:teuthology.orchestra.run.smithi166.stdout:Recommended packages: 2022-01-10T01:21:34.421 INFO:teuthology.orchestra.run.smithi166.stdout: btrfs-tools 2022-01-10T01:21:34.440 INFO:teuthology.orchestra.run.smithi059.stdout:2 upgraded, 101 newly installed, 0 to remove and 83 not upgraded. 2022-01-10T01:21:34.440 INFO:teuthology.orchestra.run.smithi059.stdout:Need to get 153 MB of archives. 2022-01-10T01:21:34.440 INFO:teuthology.orchestra.run.smithi059.stdout:After this operation, 698 MB of additional disk space will be used. 2022-01-10T01:21:34.440 INFO:teuthology.orchestra.run.smithi059.stdout:Get:1 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-1focal [1,694 kB] 2022-01-10T01:21:34.448 INFO:teuthology.orchestra.run.smithi036.stdout:2 upgraded, 101 newly installed, 0 to remove and 83 not upgraded. 2022-01-10T01:21:34.448 INFO:teuthology.orchestra.run.smithi036.stdout:Need to get 153 MB of archives. 2022-01-10T01:21:34.449 INFO:teuthology.orchestra.run.smithi036.stdout:After this operation, 698 MB of additional disk space will be used. 2022-01-10T01:21:34.449 INFO:teuthology.orchestra.run.smithi036.stdout:Get:1 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-1focal [1,694 kB] 2022-01-10T01:21:34.458 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-1focal [3,245 kB] 2022-01-10T01:21:34.471 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2022-01-10T01:21:34.471 INFO:teuthology.orchestra.run.smithi139.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2022-01-10T01:21:34.471 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2022-01-10T01:21:34.472 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2022-01-10T01:21:34.474 INFO:teuthology.orchestra.run.smithi139.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2022-01-10T01:21:34.474 INFO:teuthology.orchestra.run.smithi139.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2022-01-10T01:21:34.474 INFO:teuthology.orchestra.run.smithi139.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2022-01-10T01:21:34.475 INFO:teuthology.orchestra.run.smithi139.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2022-01-10T01:21:34.475 INFO:teuthology.orchestra.run.smithi139.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2022-01-10T01:21:34.475 INFO:teuthology.orchestra.run.smithi139.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2022-01-10T01:21:34.476 INFO:teuthology.orchestra.run.smithi139.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2022-01-10T01:21:34.476 INFO:teuthology.orchestra.run.smithi139.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2022-01-10T01:21:34.476 INFO:teuthology.orchestra.run.smithi139.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2022-01-10T01:21:34.476 INFO:teuthology.orchestra.run.smithi139.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2022-01-10T01:21:34.476 INFO:teuthology.orchestra.run.smithi139.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2022-01-10T01:21:34.477 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2022-01-10T01:21:34.477 INFO:teuthology.orchestra.run.smithi139.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2022-01-10T01:21:34.477 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2022-01-10T01:21:34.477 INFO:teuthology.orchestra.run.smithi139.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2022-01-10T01:21:34.478 INFO:teuthology.orchestra.run.smithi139.stdout: python3-simplejson python3-singledispatch python3-sklearn 2022-01-10T01:21:34.478 INFO:teuthology.orchestra.run.smithi139.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2022-01-10T01:21:34.478 INFO:teuthology.orchestra.run.smithi139.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2022-01-10T01:21:34.478 INFO:teuthology.orchestra.run.smithi139.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2022-01-10T01:21:34.479 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages will be upgraded: 2022-01-10T01:21:34.479 INFO:teuthology.orchestra.run.smithi139.stdout: librados2 librbd1 2022-01-10T01:21:34.496 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-1focal [463 kB] 2022-01-10T01:21:34.501 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-1focal [365 kB] 2022-01-10T01:21:34.501 INFO:teuthology.orchestra.run.smithi036.stdout:Get:2 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-1focal [3,245 kB] 2022-01-10T01:21:34.506 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-1focal [20.8 kB] 2022-01-10T01:21:34.506 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-1focal [156 kB] 2022-01-10T01:21:34.507 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-1focal [29.3 kB] 2022-01-10T01:21:34.508 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-1focal [363 kB] 2022-01-10T01:21:34.511 INFO:teuthology.orchestra.run.smithi166.stdout:The following NEW packages will be installed: 2022-01-10T01:21:34.511 INFO:teuthology.orchestra.run.smithi166.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2022-01-10T01:21:34.511 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2022-01-10T01:21:34.511 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2022-01-10T01:21:34.513 INFO:teuthology.orchestra.run.smithi166.stdout: ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq libcephfs-dev libcephfs2 2022-01-10T01:21:34.513 INFO:teuthology.orchestra.run.smithi166.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2022-01-10T01:21:34.513 INFO:teuthology.orchestra.run.smithi166.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2022-01-10T01:21:34.514 INFO:teuthology.orchestra.run.smithi166.stdout: librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites 2022-01-10T01:21:34.514 INFO:teuthology.orchestra.run.smithi166.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2022-01-10T01:21:34.514 INFO:teuthology.orchestra.run.smithi166.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2022-01-10T01:21:34.514 INFO:teuthology.orchestra.run.smithi166.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2022-01-10T01:21:34.515 INFO:teuthology.orchestra.run.smithi166.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2022-01-10T01:21:34.515 INFO:teuthology.orchestra.run.smithi166.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2022-01-10T01:21:34.515 INFO:teuthology.orchestra.run.smithi166.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2022-01-10T01:21:34.515 INFO:teuthology.orchestra.run.smithi166.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2022-01-10T01:21:34.516 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2022-01-10T01:21:34.516 INFO:teuthology.orchestra.run.smithi166.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2022-01-10T01:21:34.516 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2022-01-10T01:21:34.516 INFO:teuthology.orchestra.run.smithi166.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2022-01-10T01:21:34.516 INFO:teuthology.orchestra.run.smithi166.stdout: python3-simplejson python3-singledispatch python3-sklearn 2022-01-10T01:21:34.517 INFO:teuthology.orchestra.run.smithi166.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2022-01-10T01:21:34.517 INFO:teuthology.orchestra.run.smithi166.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2022-01-10T01:21:34.517 INFO:teuthology.orchestra.run.smithi166.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2022-01-10T01:21:34.517 INFO:teuthology.orchestra.run.smithi166.stdout:The following packages will be upgraded: 2022-01-10T01:21:34.518 INFO:teuthology.orchestra.run.smithi166.stdout: librados2 librbd1 2022-01-10T01:21:34.518 INFO:teuthology.orchestra.run.smithi059.stdout:Get:9 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-1focal [3,138 kB] 2022-01-10T01:21:34.520 INFO:teuthology.orchestra.run.smithi139.stdout:2 upgraded, 101 newly installed, 0 to remove and 83 not upgraded. 2022-01-10T01:21:34.521 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 153 MB of archives. 2022-01-10T01:21:34.521 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 698 MB of additional disk space will be used. 2022-01-10T01:21:34.521 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-1focal [1,694 kB] 2022-01-10T01:21:34.559 INFO:teuthology.orchestra.run.smithi166.stdout:2 upgraded, 101 newly installed, 0 to remove and 83 not upgraded. 2022-01-10T01:21:34.559 INFO:teuthology.orchestra.run.smithi166.stdout:Need to get 153 MB of archives. 2022-01-10T01:21:34.559 INFO:teuthology.orchestra.run.smithi166.stdout:After this operation, 698 MB of additional disk space will be used. 2022-01-10T01:21:34.559 INFO:teuthology.orchestra.run.smithi166.stdout:Get:1 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.14-1focal [1,694 kB] 2022-01-10T01:21:34.560 INFO:teuthology.orchestra.run.smithi059.stdout:Get:10 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-1focal [115 kB] 2022-01-10T01:21:34.562 INFO:teuthology.orchestra.run.smithi059.stdout:Get:11 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-1focal [360 kB] 2022-01-10T01:21:34.569 INFO:teuthology.orchestra.run.smithi059.stdout:Get:12 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-1focal [20.0 MB] 2022-01-10T01:21:34.607 INFO:teuthology.orchestra.run.smithi036.stdout:Get:3 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-1focal [463 kB] 2022-01-10T01:21:34.624 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-1focal [3,245 kB] 2022-01-10T01:21:34.625 INFO:teuthology.orchestra.run.smithi036.stdout:Get:4 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-1focal [365 kB] 2022-01-10T01:21:34.629 INFO:teuthology.orchestra.run.smithi166.stdout:Get:2 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.14-1focal [3,245 kB] 2022-01-10T01:21:34.639 INFO:teuthology.orchestra.run.smithi059.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2022-01-10T01:21:34.640 INFO:teuthology.orchestra.run.smithi036.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2022-01-10T01:21:34.641 INFO:teuthology.orchestra.run.smithi036.stdout:Get:6 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-1focal [20.8 kB] 2022-01-10T01:21:34.641 INFO:teuthology.orchestra.run.smithi036.stdout:Get:7 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-1focal [156 kB] 2022-01-10T01:21:34.646 INFO:teuthology.orchestra.run.smithi036.stdout:Get:8 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-1focal [29.3 kB] 2022-01-10T01:21:34.650 INFO:teuthology.orchestra.run.smithi036.stdout:Get:9 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-1focal [363 kB] 2022-01-10T01:21:34.666 INFO:teuthology.orchestra.run.smithi036.stdout:Get:10 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-1focal [3,138 kB] 2022-01-10T01:21:34.672 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2022-01-10T01:21:34.713 INFO:teuthology.orchestra.run.smithi166.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2022-01-10T01:21:34.716 INFO:teuthology.orchestra.run.smithi166.stdout:Get:4 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-1focal [463 kB] 2022-01-10T01:21:34.726 INFO:teuthology.orchestra.run.smithi059.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2022-01-10T01:21:34.728 INFO:teuthology.orchestra.run.smithi036.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2022-01-10T01:21:34.728 INFO:teuthology.orchestra.run.smithi059.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2022-01-10T01:21:34.729 INFO:teuthology.orchestra.run.smithi166.stdout:Get:5 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-1focal [365 kB] 2022-01-10T01:21:34.734 INFO:teuthology.orchestra.run.smithi036.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2022-01-10T01:21:34.738 INFO:teuthology.orchestra.run.smithi166.stdout:Get:6 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-1focal [20.8 kB] 2022-01-10T01:21:34.739 INFO:teuthology.orchestra.run.smithi166.stdout:Get:7 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-1focal [156 kB] 2022-01-10T01:21:34.742 INFO:teuthology.orchestra.run.smithi166.stdout:Get:8 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-1focal [29.3 kB] 2022-01-10T01:21:34.743 INFO:teuthology.orchestra.run.smithi166.stdout:Get:9 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-1focal [363 kB] 2022-01-10T01:21:34.752 INFO:teuthology.orchestra.run.smithi166.stdout:Get:10 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-1focal [3,138 kB] 2022-01-10T01:21:34.800 INFO:teuthology.orchestra.run.smithi166.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2022-01-10T01:21:34.812 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.14-1focal [463 kB] 2022-01-10T01:21:34.813 INFO:teuthology.orchestra.run.smithi036.stdout:Get:13 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-1focal [115 kB] 2022-01-10T01:21:34.818 INFO:teuthology.orchestra.run.smithi036.stdout:Get:14 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-1focal [360 kB] 2022-01-10T01:21:34.831 INFO:teuthology.orchestra.run.smithi166.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2022-01-10T01:21:34.832 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2022-01-10T01:21:34.832 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2022-01-10T01:21:34.835 INFO:teuthology.orchestra.run.smithi036.stdout:Get:15 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-1focal [20.0 MB] 2022-01-10T01:21:34.837 INFO:teuthology.orchestra.run.smithi166.stdout:Get:13 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-1focal [115 kB] 2022-01-10T01:21:34.838 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.14-1focal [365 kB] 2022-01-10T01:21:34.840 INFO:teuthology.orchestra.run.smithi166.stdout:Get:14 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-1focal [360 kB] 2022-01-10T01:21:34.844 INFO:teuthology.orchestra.run.smithi059.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2022-01-10T01:21:34.848 INFO:teuthology.orchestra.run.smithi036.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2022-01-10T01:21:34.850 INFO:teuthology.orchestra.run.smithi166.stdout:Get:15 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-1focal [20.0 MB] 2022-01-10T01:21:34.858 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.14-1focal [20.8 kB] 2022-01-10T01:21:34.859 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.14-1focal [156 kB] 2022-01-10T01:21:34.869 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.14-1focal [29.3 kB] 2022-01-10T01:21:34.869 INFO:teuthology.orchestra.run.smithi139.stdout:Get:11 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.14-1focal [363 kB] 2022-01-10T01:21:34.888 INFO:teuthology.orchestra.run.smithi139.stdout:Get:12 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.14-1focal [3,138 kB] 2022-01-10T01:21:34.935 INFO:teuthology.orchestra.run.smithi139.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2022-01-10T01:21:34.953 INFO:teuthology.orchestra.run.smithi166.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2022-01-10T01:21:35.001 INFO:teuthology.orchestra.run.smithi036.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2022-01-10T01:21:35.009 INFO:teuthology.orchestra.run.smithi059.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2022-01-10T01:21:35.011 INFO:teuthology.orchestra.run.smithi036.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2022-01-10T01:21:35.015 INFO:teuthology.orchestra.run.smithi059.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2022-01-10T01:21:35.024 INFO:teuthology.orchestra.run.smithi036.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2022-01-10T01:21:35.031 INFO:teuthology.orchestra.run.smithi059.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2022-01-10T01:21:35.056 INFO:teuthology.orchestra.run.smithi139.stdout:Get:14 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.14-1focal [115 kB] 2022-01-10T01:21:35.060 INFO:teuthology.orchestra.run.smithi139.stdout:Get:15 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.14-1focal [360 kB] 2022-01-10T01:21:35.074 INFO:teuthology.orchestra.run.smithi139.stdout:Get:16 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.14-1focal [20.0 MB] 2022-01-10T01:21:35.091 INFO:teuthology.orchestra.run.smithi166.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2022-01-10T01:21:35.100 INFO:teuthology.orchestra.run.smithi166.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2022-01-10T01:21:35.110 INFO:teuthology.orchestra.run.smithi139.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2022-01-10T01:21:35.118 INFO:teuthology.orchestra.run.smithi139.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2022-01-10T01:21:35.120 INFO:teuthology.orchestra.run.smithi166.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2022-01-10T01:21:35.133 INFO:teuthology.orchestra.run.smithi139.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2022-01-10T01:21:35.135 INFO:teuthology.orchestra.run.smithi036.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2022-01-10T01:21:35.137 INFO:teuthology.orchestra.run.smithi059.stdout:Get:20 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-1focal [5,299 kB] 2022-01-10T01:21:35.163 INFO:teuthology.orchestra.run.smithi036.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2022-01-10T01:21:35.169 INFO:teuthology.orchestra.run.smithi036.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2022-01-10T01:21:35.174 INFO:teuthology.orchestra.run.smithi059.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2022-01-10T01:21:35.193 INFO:teuthology.orchestra.run.smithi059.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2022-01-10T01:21:35.194 INFO:teuthology.orchestra.run.smithi036.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2022-01-10T01:21:35.195 INFO:teuthology.orchestra.run.smithi059.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2022-01-10T01:21:35.198 INFO:teuthology.orchestra.run.smithi036.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2022-01-10T01:21:35.202 INFO:teuthology.orchestra.run.smithi036.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2022-01-10T01:21:35.215 INFO:teuthology.orchestra.run.smithi036.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2022-01-10T01:21:35.217 INFO:teuthology.orchestra.run.smithi036.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2022-01-10T01:21:35.219 INFO:teuthology.orchestra.run.smithi036.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2022-01-10T01:21:35.235 INFO:teuthology.orchestra.run.smithi166.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2022-01-10T01:21:35.236 INFO:teuthology.orchestra.run.smithi059.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2022-01-10T01:21:35.240 INFO:teuthology.orchestra.run.smithi059.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2022-01-10T01:21:35.244 INFO:teuthology.orchestra.run.smithi059.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2022-01-10T01:21:35.249 INFO:teuthology.orchestra.run.smithi139.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2022-01-10T01:21:35.261 INFO:teuthology.orchestra.run.smithi059.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2022-01-10T01:21:35.263 INFO:teuthology.orchestra.run.smithi059.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2022-01-10T01:21:35.263 INFO:teuthology.orchestra.run.smithi036.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2022-01-10T01:21:35.264 INFO:teuthology.orchestra.run.smithi166.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2022-01-10T01:21:35.264 INFO:teuthology.orchestra.run.smithi059.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2022-01-10T01:21:35.265 INFO:teuthology.orchestra.run.smithi036.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2022-01-10T01:21:35.266 INFO:teuthology.orchestra.run.smithi036.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2022-01-10T01:21:35.269 INFO:teuthology.orchestra.run.smithi059.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2022-01-10T01:21:35.270 INFO:teuthology.orchestra.run.smithi166.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2022-01-10T01:21:35.271 INFO:teuthology.orchestra.run.smithi139.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2022-01-10T01:21:35.277 INFO:teuthology.orchestra.run.smithi139.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2022-01-10T01:21:35.284 INFO:teuthology.orchestra.run.smithi059.stdout:Get:31 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-1focal [162 kB] 2022-01-10T01:21:35.288 INFO:teuthology.orchestra.run.smithi059.stdout:Get:32 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-1focal [1,401 kB] 2022-01-10T01:21:35.296 INFO:teuthology.orchestra.run.smithi166.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2022-01-10T01:21:35.301 INFO:teuthology.orchestra.run.smithi166.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2022-01-10T01:21:35.304 INFO:teuthology.orchestra.run.smithi166.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2022-01-10T01:21:35.304 INFO:teuthology.orchestra.run.smithi139.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2022-01-10T01:21:35.308 INFO:teuthology.orchestra.run.smithi139.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2022-01-10T01:21:35.312 INFO:teuthology.orchestra.run.smithi139.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2022-01-10T01:21:35.318 INFO:teuthology.orchestra.run.smithi166.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2022-01-10T01:21:35.319 INFO:teuthology.orchestra.run.smithi166.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2022-01-10T01:21:35.319 INFO:teuthology.orchestra.run.smithi166.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2022-01-10T01:21:35.330 INFO:teuthology.orchestra.run.smithi139.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2022-01-10T01:21:35.331 INFO:teuthology.orchestra.run.smithi139.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2022-01-10T01:21:35.332 INFO:teuthology.orchestra.run.smithi139.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2022-01-10T01:21:35.336 INFO:teuthology.orchestra.run.smithi059.stdout:Get:33 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-1focal [6,172 kB] 2022-01-10T01:21:35.351 INFO:teuthology.orchestra.run.smithi036.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2022-01-10T01:21:35.352 INFO:teuthology.orchestra.run.smithi059.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2022-01-10T01:21:35.352 INFO:teuthology.orchestra.run.smithi166.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2022-01-10T01:21:35.353 INFO:teuthology.orchestra.run.smithi059.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2022-01-10T01:21:35.353 INFO:teuthology.orchestra.run.smithi036.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2022-01-10T01:21:35.354 INFO:teuthology.orchestra.run.smithi059.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2022-01-10T01:21:35.354 INFO:teuthology.orchestra.run.smithi036.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2022-01-10T01:21:35.356 INFO:teuthology.orchestra.run.smithi166.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2022-01-10T01:21:35.356 INFO:teuthology.orchestra.run.smithi036.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2022-01-10T01:21:35.357 INFO:teuthology.orchestra.run.smithi059.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2022-01-10T01:21:35.357 INFO:teuthology.orchestra.run.smithi059.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2022-01-10T01:21:35.359 INFO:teuthology.orchestra.run.smithi036.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2022-01-10T01:21:35.359 INFO:teuthology.orchestra.run.smithi059.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2022-01-10T01:21:35.360 INFO:teuthology.orchestra.run.smithi036.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2022-01-10T01:21:35.361 INFO:teuthology.orchestra.run.smithi059.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2022-01-10T01:21:35.362 INFO:teuthology.orchestra.run.smithi059.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2022-01-10T01:21:35.370 INFO:teuthology.orchestra.run.smithi139.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2022-01-10T01:21:35.373 INFO:teuthology.orchestra.run.smithi139.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2022-01-10T01:21:35.374 INFO:teuthology.orchestra.run.smithi059.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2022-01-10T01:21:35.374 INFO:teuthology.orchestra.run.smithi139.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2022-01-10T01:21:35.379 INFO:teuthology.orchestra.run.smithi036.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2022-01-10T01:21:35.437 INFO:teuthology.orchestra.run.smithi036.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2022-01-10T01:21:35.438 INFO:teuthology.orchestra.run.smithi166.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2022-01-10T01:21:35.438 INFO:teuthology.orchestra.run.smithi166.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2022-01-10T01:21:35.439 INFO:teuthology.orchestra.run.smithi036.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2022-01-10T01:21:35.440 INFO:teuthology.orchestra.run.smithi036.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2022-01-10T01:21:35.441 INFO:teuthology.orchestra.run.smithi166.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2022-01-10T01:21:35.442 INFO:teuthology.orchestra.run.smithi059.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2022-01-10T01:21:35.443 INFO:teuthology.orchestra.run.smithi059.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2022-01-10T01:21:35.443 INFO:teuthology.orchestra.run.smithi166.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2022-01-10T01:21:35.444 INFO:teuthology.orchestra.run.smithi059.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2022-01-10T01:21:35.447 INFO:teuthology.orchestra.run.smithi166.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2022-01-10T01:21:35.456 INFO:teuthology.orchestra.run.smithi139.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2022-01-10T01:21:35.459 INFO:teuthology.orchestra.run.smithi139.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2022-01-10T01:21:35.461 INFO:teuthology.orchestra.run.smithi139.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2022-01-10T01:21:35.463 INFO:teuthology.orchestra.run.smithi139.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2022-01-10T01:21:35.467 INFO:teuthology.orchestra.run.smithi139.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2022-01-10T01:21:35.468 INFO:teuthology.orchestra.run.smithi139.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2022-01-10T01:21:35.488 INFO:teuthology.orchestra.run.smithi139.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2022-01-10T01:21:35.520 INFO:teuthology.orchestra.run.smithi059.stdout:Get:46 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-1focal [23.9 MB] 2022-01-10T01:21:35.522 INFO:teuthology.orchestra.run.smithi036.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2022-01-10T01:21:35.527 INFO:teuthology.orchestra.run.smithi059.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2022-01-10T01:21:35.535 INFO:teuthology.orchestra.run.smithi059.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2022-01-10T01:21:35.537 INFO:teuthology.orchestra.run.smithi166.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2022-01-10T01:21:35.538 INFO:teuthology.orchestra.run.smithi166.stdout:Get:37 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-1focal [5,299 kB] 2022-01-10T01:21:35.539 INFO:teuthology.orchestra.run.smithi166.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2022-01-10T01:21:35.539 INFO:teuthology.orchestra.run.smithi059.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2022-01-10T01:21:35.540 INFO:teuthology.orchestra.run.smithi059.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2022-01-10T01:21:35.542 INFO:teuthology.orchestra.run.smithi139.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2022-01-10T01:21:35.543 INFO:teuthology.orchestra.run.smithi139.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2022-01-10T01:21:35.544 INFO:teuthology.orchestra.run.smithi139.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2022-01-10T01:21:35.545 INFO:teuthology.orchestra.run.smithi059.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2022-01-10T01:21:35.547 INFO:teuthology.orchestra.run.smithi166.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2022-01-10T01:21:35.548 INFO:teuthology.orchestra.run.smithi166.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2022-01-10T01:21:35.548 INFO:teuthology.orchestra.run.smithi059.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2022-01-10T01:21:35.549 INFO:teuthology.orchestra.run.smithi166.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2022-01-10T01:21:35.551 INFO:teuthology.orchestra.run.smithi059.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2022-01-10T01:21:35.591 INFO:teuthology.orchestra.run.smithi036.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2022-01-10T01:21:35.591 INFO:teuthology.orchestra.run.smithi036.stdout:Get:44 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-1focal [5,299 kB] 2022-01-10T01:21:35.593 INFO:teuthology.orchestra.run.smithi036.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2022-01-10T01:21:35.594 INFO:teuthology.orchestra.run.smithi036.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2022-01-10T01:21:35.597 INFO:teuthology.orchestra.run.smithi036.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2022-01-10T01:21:35.599 INFO:teuthology.orchestra.run.smithi036.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2022-01-10T01:21:35.602 INFO:teuthology.orchestra.run.smithi036.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2022-01-10T01:21:35.607 INFO:teuthology.orchestra.run.smithi036.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2022-01-10T01:21:35.608 INFO:teuthology.orchestra.run.smithi036.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2022-01-10T01:21:35.609 INFO:teuthology.orchestra.run.smithi166.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2022-01-10T01:21:35.612 INFO:teuthology.orchestra.run.smithi166.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2022-01-10T01:21:35.613 INFO:teuthology.orchestra.run.smithi059.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2022-01-10T01:21:35.614 INFO:teuthology.orchestra.run.smithi059.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2022-01-10T01:21:35.620 INFO:teuthology.orchestra.run.smithi166.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2022-01-10T01:21:35.623 INFO:teuthology.orchestra.run.smithi166.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2022-01-10T01:21:35.628 INFO:teuthology.orchestra.run.smithi139.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2022-01-10T01:21:35.635 INFO:teuthology.orchestra.run.smithi139.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2022-01-10T01:21:35.638 INFO:teuthology.orchestra.run.smithi139.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2022-01-10T01:21:35.638 INFO:teuthology.orchestra.run.smithi139.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2022-01-10T01:21:35.642 INFO:teuthology.orchestra.run.smithi139.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2022-01-10T01:21:35.646 INFO:teuthology.orchestra.run.smithi139.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2022-01-10T01:21:35.649 INFO:teuthology.orchestra.run.smithi139.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2022-01-10T01:21:35.682 INFO:teuthology.orchestra.run.smithi166.stdout:Get:46 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-1focal [162 kB] 2022-01-10T01:21:35.686 INFO:teuthology.orchestra.run.smithi166.stdout:Get:47 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-1focal [1,401 kB] 2022-01-10T01:21:35.695 INFO:teuthology.orchestra.run.smithi166.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2022-01-10T01:21:35.699 INFO:teuthology.orchestra.run.smithi166.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2022-01-10T01:21:35.703 INFO:teuthology.orchestra.run.smithi166.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2022-01-10T01:21:35.706 INFO:teuthology.orchestra.run.smithi166.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2022-01-10T01:21:35.706 INFO:teuthology.orchestra.run.smithi166.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2022-01-10T01:21:35.707 INFO:teuthology.orchestra.run.smithi166.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2022-01-10T01:21:35.714 INFO:teuthology.orchestra.run.smithi139.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2022-01-10T01:21:35.715 INFO:teuthology.orchestra.run.smithi139.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2022-01-10T01:21:35.733 INFO:teuthology.orchestra.run.smithi166.stdout:Get:54 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-1focal [6,172 kB] 2022-01-10T01:21:35.759 INFO:teuthology.orchestra.run.smithi036.stdout:Get:52 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-1focal [162 kB] 2022-01-10T01:21:35.764 INFO:teuthology.orchestra.run.smithi036.stdout:Get:53 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-1focal [1,401 kB] 2022-01-10T01:21:35.812 INFO:teuthology.orchestra.run.smithi036.stdout:Get:54 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-1focal [6,172 kB] 2022-01-10T01:21:35.893 INFO:teuthology.orchestra.run.smithi139.stdout:Get:51 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.14-1focal [5,299 kB] 2022-01-10T01:21:35.929 INFO:teuthology.orchestra.run.smithi166.stdout:Get:55 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-1focal [23.9 MB] 2022-01-10T01:21:35.970 INFO:teuthology.orchestra.run.smithi036.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2022-01-10T01:21:35.997 INFO:teuthology.orchestra.run.smithi059.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2022-01-10T01:21:36.006 INFO:teuthology.orchestra.run.smithi036.stdout:Get:56 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-1focal [23.9 MB] 2022-01-10T01:21:36.020 INFO:teuthology.orchestra.run.smithi036.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2022-01-10T01:21:36.047 INFO:teuthology.orchestra.run.smithi059.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2022-01-10T01:21:36.049 INFO:teuthology.orchestra.run.smithi036.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2022-01-10T01:21:36.050 INFO:teuthology.orchestra.run.smithi059.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2022-01-10T01:21:36.063 INFO:teuthology.orchestra.run.smithi166.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2022-01-10T01:21:36.066 INFO:teuthology.orchestra.run.smithi139.stdout:Get:52 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.14-1focal [162 kB] 2022-01-10T01:21:36.098 INFO:teuthology.orchestra.run.smithi036.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2022-01-10T01:21:36.099 INFO:teuthology.orchestra.run.smithi036.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2022-01-10T01:21:36.100 INFO:teuthology.orchestra.run.smithi036.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2022-01-10T01:21:36.100 INFO:teuthology.orchestra.run.smithi036.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2022-01-10T01:21:36.101 INFO:teuthology.orchestra.run.smithi036.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2022-01-10T01:21:36.102 INFO:teuthology.orchestra.run.smithi036.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2022-01-10T01:21:36.102 INFO:teuthology.orchestra.run.smithi036.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2022-01-10T01:21:36.104 INFO:teuthology.orchestra.run.smithi059.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2022-01-10T01:21:36.104 INFO:teuthology.orchestra.run.smithi059.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2022-01-10T01:21:36.105 INFO:teuthology.orchestra.run.smithi059.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2022-01-10T01:21:36.106 INFO:teuthology.orchestra.run.smithi059.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2022-01-10T01:21:36.106 INFO:teuthology.orchestra.run.smithi059.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2022-01-10T01:21:36.107 INFO:teuthology.orchestra.run.smithi059.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2022-01-10T01:21:36.107 INFO:teuthology.orchestra.run.smithi059.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2022-01-10T01:21:36.123 INFO:teuthology.orchestra.run.smithi166.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2022-01-10T01:21:36.127 INFO:teuthology.orchestra.run.smithi166.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2022-01-10T01:21:36.142 INFO:teuthology.orchestra.run.smithi036.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2022-01-10T01:21:36.142 INFO:teuthology.orchestra.run.smithi036.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2022-01-10T01:21:36.144 INFO:teuthology.orchestra.run.smithi139.stdout:Get:53 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.14-1focal [1,401 kB] 2022-01-10T01:21:36.144 INFO:teuthology.orchestra.run.smithi139.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2022-01-10T01:21:36.169 INFO:teuthology.orchestra.run.smithi139.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2022-01-10T01:21:36.175 INFO:teuthology.orchestra.run.smithi139.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2022-01-10T01:21:36.176 INFO:teuthology.orchestra.run.smithi059.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2022-01-10T01:21:36.177 INFO:teuthology.orchestra.run.smithi059.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2022-01-10T01:21:36.182 INFO:teuthology.orchestra.run.smithi139.stdout:Get:57 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.14-1focal [6,172 kB] 2022-01-10T01:21:36.193 INFO:teuthology.orchestra.run.smithi166.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2022-01-10T01:21:36.194 INFO:teuthology.orchestra.run.smithi166.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2022-01-10T01:21:36.195 INFO:teuthology.orchestra.run.smithi166.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2022-01-10T01:21:36.196 INFO:teuthology.orchestra.run.smithi166.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2022-01-10T01:21:36.196 INFO:teuthology.orchestra.run.smithi166.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2022-01-10T01:21:36.197 INFO:teuthology.orchestra.run.smithi166.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2022-01-10T01:21:36.198 INFO:teuthology.orchestra.run.smithi166.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2022-01-10T01:21:36.227 INFO:teuthology.orchestra.run.smithi036.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2022-01-10T01:21:36.236 INFO:teuthology.orchestra.run.smithi036.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2022-01-10T01:21:36.237 INFO:teuthology.orchestra.run.smithi166.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2022-01-10T01:21:36.239 INFO:teuthology.orchestra.run.smithi166.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2022-01-10T01:21:36.239 INFO:teuthology.orchestra.run.smithi036.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2022-01-10T01:21:36.242 INFO:teuthology.orchestra.run.smithi036.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2022-01-10T01:21:36.243 INFO:teuthology.orchestra.run.smithi036.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2022-01-10T01:21:36.246 INFO:teuthology.orchestra.run.smithi036.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2022-01-10T01:21:36.247 INFO:teuthology.orchestra.run.smithi036.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2022-01-10T01:21:36.250 INFO:teuthology.orchestra.run.smithi036.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2022-01-10T01:21:36.257 INFO:teuthology.orchestra.run.smithi139.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2022-01-10T01:21:36.257 INFO:teuthology.orchestra.run.smithi139.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2022-01-10T01:21:36.258 INFO:teuthology.orchestra.run.smithi139.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2022-01-10T01:21:36.259 INFO:teuthology.orchestra.run.smithi139.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2022-01-10T01:21:36.259 INFO:teuthology.orchestra.run.smithi139.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2022-01-10T01:21:36.260 INFO:teuthology.orchestra.run.smithi059.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2022-01-10T01:21:36.261 INFO:teuthology.orchestra.run.smithi139.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2022-01-10T01:21:36.261 INFO:teuthology.orchestra.run.smithi139.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2022-01-10T01:21:36.287 INFO:teuthology.orchestra.run.smithi059.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2022-01-10T01:21:36.288 INFO:teuthology.orchestra.run.smithi059.stdout:Get:70 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-1focal [3,968 B] 2022-01-10T01:21:36.289 INFO:teuthology.orchestra.run.smithi059.stdout:Get:71 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-1focal [538 kB] 2022-01-10T01:21:36.290 INFO:teuthology.orchestra.run.smithi059.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2022-01-10T01:21:36.292 INFO:teuthology.orchestra.run.smithi059.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2022-01-10T01:21:36.293 INFO:teuthology.orchestra.run.smithi059.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2022-01-10T01:21:36.298 INFO:teuthology.orchestra.run.smithi059.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2022-01-10T01:21:36.312 INFO:teuthology.orchestra.run.smithi036.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2022-01-10T01:21:36.318 INFO:teuthology.orchestra.run.smithi139.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2022-01-10T01:21:36.319 INFO:teuthology.orchestra.run.smithi036.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2022-01-10T01:21:36.319 INFO:teuthology.orchestra.run.smithi139.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2022-01-10T01:21:36.323 INFO:teuthology.orchestra.run.smithi166.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2022-01-10T01:21:36.329 INFO:teuthology.orchestra.run.smithi166.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2022-01-10T01:21:36.332 INFO:teuthology.orchestra.run.smithi166.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2022-01-10T01:21:36.334 INFO:teuthology.orchestra.run.smithi059.stdout:Get:76 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-1focal [2,007 kB] 2022-01-10T01:21:36.335 INFO:teuthology.orchestra.run.smithi059.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2022-01-10T01:21:36.336 INFO:teuthology.orchestra.run.smithi166.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2022-01-10T01:21:36.336 INFO:teuthology.orchestra.run.smithi166.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2022-01-10T01:21:36.339 INFO:teuthology.orchestra.run.smithi059.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2022-01-10T01:21:36.340 INFO:teuthology.orchestra.run.smithi166.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2022-01-10T01:21:36.341 INFO:teuthology.orchestra.run.smithi166.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2022-01-10T01:21:36.342 INFO:teuthology.orchestra.run.smithi166.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2022-01-10T01:21:36.345 INFO:teuthology.orchestra.run.smithi059.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2022-01-10T01:21:36.351 INFO:teuthology.orchestra.run.smithi059.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2022-01-10T01:21:36.375 INFO:teuthology.orchestra.run.smithi139.stdout:Get:67 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.14-1focal [23.9 MB] 2022-01-10T01:21:36.387 INFO:teuthology.orchestra.run.smithi059.stdout:Get:81 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-1focal [53.1 kB] 2022-01-10T01:21:36.392 INFO:teuthology.orchestra.run.smithi059.stdout:Get:82 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-1focal [58.1 kB] 2022-01-10T01:21:36.392 INFO:teuthology.orchestra.run.smithi059.stdout:Get:83 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-1focal [3,208 kB] 2022-01-10T01:21:36.398 INFO:teuthology.orchestra.run.smithi036.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2022-01-10T01:21:36.399 INFO:teuthology.orchestra.run.smithi036.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2022-01-10T01:21:36.400 INFO:teuthology.orchestra.run.smithi036.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2022-01-10T01:21:36.402 INFO:teuthology.orchestra.run.smithi036.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2022-01-10T01:21:36.404 INFO:teuthology.orchestra.run.smithi139.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2022-01-10T01:21:36.409 INFO:teuthology.orchestra.run.smithi139.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2022-01-10T01:21:36.410 INFO:teuthology.orchestra.run.smithi166.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2022-01-10T01:21:36.412 INFO:teuthology.orchestra.run.smithi139.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2022-01-10T01:21:36.414 INFO:teuthology.orchestra.run.smithi166.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2022-01-10T01:21:36.415 INFO:teuthology.orchestra.run.smithi139.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2022-01-10T01:21:36.415 INFO:teuthology.orchestra.run.smithi139.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2022-01-10T01:21:36.418 INFO:teuthology.orchestra.run.smithi139.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2022-01-10T01:21:36.419 INFO:teuthology.orchestra.run.smithi036.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2022-01-10T01:21:36.420 INFO:teuthology.orchestra.run.smithi036.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2022-01-10T01:21:36.421 INFO:teuthology.orchestra.run.smithi139.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2022-01-10T01:21:36.421 INFO:teuthology.orchestra.run.smithi036.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2022-01-10T01:21:36.421 INFO:teuthology.orchestra.run.smithi036.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2022-01-10T01:21:36.422 INFO:teuthology.orchestra.run.smithi139.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2022-01-10T01:21:36.431 INFO:teuthology.orchestra.run.smithi059.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2022-01-10T01:21:36.432 INFO:teuthology.orchestra.run.smithi059.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2022-01-10T01:21:36.433 INFO:teuthology.orchestra.run.smithi059.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2022-01-10T01:21:36.435 INFO:teuthology.orchestra.run.smithi059.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2022-01-10T01:21:36.453 INFO:teuthology.orchestra.run.smithi059.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2022-01-10T01:21:36.454 INFO:teuthology.orchestra.run.smithi059.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2022-01-10T01:21:36.454 INFO:teuthology.orchestra.run.smithi059.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2022-01-10T01:21:36.454 INFO:teuthology.orchestra.run.smithi059.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2022-01-10T01:21:36.483 INFO:teuthology.orchestra.run.smithi036.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2022-01-10T01:21:36.485 INFO:teuthology.orchestra.run.smithi036.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2022-01-10T01:21:36.490 INFO:teuthology.orchestra.run.smithi139.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2022-01-10T01:21:36.495 INFO:teuthology.orchestra.run.smithi166.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2022-01-10T01:21:36.496 INFO:teuthology.orchestra.run.smithi139.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2022-01-10T01:21:36.496 INFO:teuthology.orchestra.run.smithi166.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2022-01-10T01:21:36.497 INFO:teuthology.orchestra.run.smithi166.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2022-01-10T01:21:36.499 INFO:teuthology.orchestra.run.smithi166.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2022-01-10T01:21:36.502 INFO:teuthology.orchestra.run.smithi059.stdout:Get:92 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-1focal [34.3 kB] 2022-01-10T01:21:36.504 INFO:teuthology.orchestra.run.smithi059.stdout:Get:93 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-1focal [7,895 kB] 2022-01-10T01:21:36.516 INFO:teuthology.orchestra.run.smithi059.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2022-01-10T01:21:36.518 INFO:teuthology.orchestra.run.smithi166.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2022-01-10T01:21:36.518 INFO:teuthology.orchestra.run.smithi166.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2022-01-10T01:21:36.518 INFO:teuthology.orchestra.run.smithi166.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2022-01-10T01:21:36.519 INFO:teuthology.orchestra.run.smithi166.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2022-01-10T01:21:36.519 INFO:teuthology.orchestra.run.smithi059.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2022-01-10T01:21:36.568 INFO:teuthology.orchestra.run.smithi036.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2022-01-10T01:21:36.572 INFO:teuthology.orchestra.run.smithi036.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2022-01-10T01:21:36.576 INFO:teuthology.orchestra.run.smithi139.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2022-01-10T01:21:36.577 INFO:teuthology.orchestra.run.smithi139.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2022-01-10T01:21:36.578 INFO:teuthology.orchestra.run.smithi139.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2022-01-10T01:21:36.580 INFO:teuthology.orchestra.run.smithi139.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2022-01-10T01:21:36.581 INFO:teuthology.orchestra.run.smithi166.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2022-01-10T01:21:36.582 INFO:teuthology.orchestra.run.smithi166.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2022-01-10T01:21:36.600 INFO:teuthology.orchestra.run.smithi139.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2022-01-10T01:21:36.600 INFO:teuthology.orchestra.run.smithi139.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2022-01-10T01:21:36.601 INFO:teuthology.orchestra.run.smithi139.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2022-01-10T01:21:36.601 INFO:teuthology.orchestra.run.smithi139.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2022-01-10T01:21:36.602 INFO:teuthology.orchestra.run.smithi059.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2022-01-10T01:21:36.605 INFO:teuthology.orchestra.run.smithi059.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2022-01-10T01:21:36.663 INFO:teuthology.orchestra.run.smithi139.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2022-01-10T01:21:36.664 INFO:teuthology.orchestra.run.smithi139.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2022-01-10T01:21:36.667 INFO:teuthology.orchestra.run.smithi166.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2022-01-10T01:21:36.670 INFO:teuthology.orchestra.run.smithi166.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2022-01-10T01:21:36.749 INFO:teuthology.orchestra.run.smithi139.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2022-01-10T01:21:36.752 INFO:teuthology.orchestra.run.smithi139.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2022-01-10T01:21:36.756 INFO:teuthology.orchestra.run.smithi059.stdout:Get:98 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-1focal [4,088 B] 2022-01-10T01:21:36.757 INFO:teuthology.orchestra.run.smithi059.stdout:Get:99 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-1focal [39.9 MB] 2022-01-10T01:21:36.759 INFO:teuthology.orchestra.run.smithi166.stdout:Get:90 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-1focal [3,968 B] 2022-01-10T01:21:36.760 INFO:teuthology.orchestra.run.smithi166.stdout:Get:91 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-1focal [538 kB] 2022-01-10T01:21:36.767 INFO:teuthology.orchestra.run.smithi166.stdout:Get:92 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-1focal [2,007 kB] 2022-01-10T01:21:36.814 INFO:teuthology.orchestra.run.smithi166.stdout:Get:93 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-1focal [53.1 kB] 2022-01-10T01:21:36.815 INFO:teuthology.orchestra.run.smithi166.stdout:Get:94 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-1focal [58.1 kB] 2022-01-10T01:21:36.817 INFO:teuthology.orchestra.run.smithi166.stdout:Get:95 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-1focal [3,208 kB] 2022-01-10T01:21:36.827 INFO:teuthology.orchestra.run.smithi036.stdout:Get:90 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-1focal [3,968 B] 2022-01-10T01:21:36.827 INFO:teuthology.orchestra.run.smithi036.stdout:Get:91 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-1focal [538 kB] 2022-01-10T01:21:36.837 INFO:teuthology.orchestra.run.smithi036.stdout:Get:92 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-1focal [2,007 kB] 2022-01-10T01:21:36.894 INFO:teuthology.orchestra.run.smithi036.stdout:Get:93 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-1focal [53.1 kB] 2022-01-10T01:21:36.895 INFO:teuthology.orchestra.run.smithi036.stdout:Get:94 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-1focal [58.1 kB] 2022-01-10T01:21:36.901 INFO:teuthology.orchestra.run.smithi036.stdout:Get:95 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-1focal [3,208 kB] 2022-01-10T01:21:36.918 INFO:teuthology.orchestra.run.smithi166.stdout:Get:96 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-1focal [34.3 kB] 2022-01-10T01:21:36.919 INFO:teuthology.orchestra.run.smithi166.stdout:Get:97 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-1focal [7,895 kB] 2022-01-10T01:21:37.005 INFO:teuthology.orchestra.run.smithi036.stdout:Get:96 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-1focal [34.3 kB] 2022-01-10T01:21:37.010 INFO:teuthology.orchestra.run.smithi036.stdout:Get:97 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-1focal [7,895 kB] 2022-01-10T01:21:37.183 INFO:teuthology.orchestra.run.smithi166.stdout:Get:98 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-1focal [4,088 B] 2022-01-10T01:21:37.186 INFO:teuthology.orchestra.run.smithi166.stdout:Get:99 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-1focal [39.9 MB] 2022-01-10T01:21:37.257 INFO:teuthology.orchestra.run.smithi036.stdout:Get:98 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-1focal [4,088 B] 2022-01-10T01:21:37.258 INFO:teuthology.orchestra.run.smithi036.stdout:Get:99 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-1focal [39.9 MB] 2022-01-10T01:21:37.260 INFO:teuthology.orchestra.run.smithi139.stdout:Get:90 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.14-1focal [3,968 B] 2022-01-10T01:21:37.261 INFO:teuthology.orchestra.run.smithi139.stdout:Get:91 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.14-1focal [538 kB] 2022-01-10T01:21:37.271 INFO:teuthology.orchestra.run.smithi139.stdout:Get:92 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.14-1focal [2,007 kB] 2022-01-10T01:21:37.335 INFO:teuthology.orchestra.run.smithi139.stdout:Get:93 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.14-1focal [53.1 kB] 2022-01-10T01:21:37.336 INFO:teuthology.orchestra.run.smithi139.stdout:Get:94 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.14-1focal [58.1 kB] 2022-01-10T01:21:37.337 INFO:teuthology.orchestra.run.smithi139.stdout:Get:95 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.14-1focal [3,208 kB] 2022-01-10T01:21:37.449 INFO:teuthology.orchestra.run.smithi139.stdout:Get:96 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.14-1focal [34.3 kB] 2022-01-10T01:21:37.450 INFO:teuthology.orchestra.run.smithi139.stdout:Get:97 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.14-1focal [7,895 kB] 2022-01-10T01:21:37.738 INFO:teuthology.orchestra.run.smithi139.stdout:Get:98 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.14-1focal [4,088 B] 2022-01-10T01:21:37.739 INFO:teuthology.orchestra.run.smithi139.stdout:Get:99 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.14-1focal [39.9 MB] 2022-01-10T01:21:38.240 INFO:teuthology.orchestra.run.smithi059.stdout:Get:100 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.14-1focal [15.8 kB] 2022-01-10T01:21:38.241 INFO:teuthology.orchestra.run.smithi059.stdout:Get:101 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-1focal [18.1 kB] 2022-01-10T01:21:38.242 INFO:teuthology.orchestra.run.smithi059.stdout:Get:102 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-1focal [9,717 kB] 2022-01-10T01:21:38.504 INFO:teuthology.orchestra.run.smithi059.stdout:Get:103 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-1focal [60.8 kB] 2022-01-10T01:21:38.677 INFO:teuthology.orchestra.run.smithi166.stdout:Get:100 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.14-1focal [15.8 kB] 2022-01-10T01:21:38.678 INFO:teuthology.orchestra.run.smithi166.stdout:Get:101 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-1focal [18.1 kB] 2022-01-10T01:21:38.679 INFO:teuthology.orchestra.run.smithi036.stdout:Get:100 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.14-1focal [15.8 kB] 2022-01-10T01:21:38.679 INFO:teuthology.orchestra.run.smithi036.stdout:Get:101 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-1focal [18.1 kB] 2022-01-10T01:21:38.680 INFO:teuthology.orchestra.run.smithi036.stdout:Get:102 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-1focal [9,717 kB] 2022-01-10T01:21:38.749 INFO:teuthology.orchestra.run.smithi166.stdout:Get:102 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-1focal [9,717 kB] 2022-01-10T01:21:38.782 INFO:teuthology.orchestra.run.smithi036.stdout:Get:103 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-1focal [60.8 kB] 2022-01-10T01:21:38.846 INFO:teuthology.orchestra.run.smithi166.stdout:Get:103 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-1focal [60.8 kB] 2022-01-10T01:21:38.854 INFO:teuthology.orchestra.run.smithi139.stdout:Get:100 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 15.2.14-1focal [15.8 kB] 2022-01-10T01:21:38.854 INFO:teuthology.orchestra.run.smithi139.stdout:Get:101 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.14-1focal [18.1 kB] 2022-01-10T01:21:38.855 INFO:teuthology.orchestra.run.smithi139.stdout:Get:102 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.14-1focal [9,717 kB] 2022-01-10T01:21:38.929 INFO:teuthology.orchestra.run.smithi139.stdout:Get:103 https://chacra.ceph.com/r/ceph/octopus/cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.14-1focal [60.8 kB] 2022-01-10T01:21:39.112 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 153 MB in 4s (37.3 MB/s) 2022-01-10T01:21:39.271 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyperclip. 2022-01-10T01:21:39.339 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174688 files and directories currently installed.) 2022-01-10T01:21:39.345 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2022-01-10T01:21:39.374 INFO:teuthology.orchestra.run.smithi036.stdout:Fetched 153 MB in 4s (34.9 MB/s) 2022-01-10T01:21:39.386 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2022-01-10T01:21:39.427 INFO:teuthology.orchestra.run.smithi166.stdout:Fetched 153 MB in 4s (35.3 MB/s) 2022-01-10T01:21:39.511 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 153 MB in 4s (34.4 MB/s) 2022-01-10T01:21:39.529 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pyperclip. 2022-01-10T01:21:39.595 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-pyperclip. 2022-01-10T01:21:39.599 INFO:teuthology.orchestra.run.smithi036.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174688 files and directories currently installed.) 2022-01-10T01:21:39.604 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2022-01-10T01:21:39.638 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2022-01-10T01:21:39.662 INFO:teuthology.orchestra.run.smithi166.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174688 files and directories currently installed.) 2022-01-10T01:21:39.668 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2022-01-10T01:21:39.674 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyperclip. 2022-01-10T01:21:39.712 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2022-01-10T01:21:39.720 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-wcwidth. 2022-01-10T01:21:39.739 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2022-01-10T01:21:39.741 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174688 files and directories currently installed.) 2022-01-10T01:21:39.747 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2022-01-10T01:21:39.779 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2022-01-10T01:21:39.782 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2022-01-10T01:21:39.960 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-wcwidth. 2022-01-10T01:21:39.979 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2022-01-10T01:21:40.018 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2022-01-10T01:21:40.034 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cmd2. 2022-01-10T01:21:40.054 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2022-01-10T01:21:40.056 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-wcwidth. 2022-01-10T01:21:40.075 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2022-01-10T01:21:40.092 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2022-01-10T01:21:40.119 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2022-01-10T01:21:40.136 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-wcwidth. 2022-01-10T01:21:40.155 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2022-01-10T01:21:40.191 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2022-01-10T01:21:40.308 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cmd2. 2022-01-10T01:21:40.330 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2022-01-10T01:21:40.375 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2022-01-10T01:21:40.427 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2022-01-10T01:21:40.434 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-cmd2. 2022-01-10T01:21:40.445 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2022-01-10T01:21:40.453 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2022-01-10T01:21:40.482 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cmd2. 2022-01-10T01:21:40.492 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2022-01-10T01:21:40.503 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2022-01-10T01:21:40.529 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2022-01-10T01:21:40.573 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2022-01-10T01:21:40.734 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2022-01-10T01:21:40.755 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2022-01-10T01:21:40.835 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2022-01-10T01:21:40.852 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2022-01-10T01:21:40.873 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2022-01-10T01:21:40.899 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../004-librbd1_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:40.901 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2022-01-10T01:21:40.921 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2022-01-10T01:21:40.936 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2022-01-10T01:21:41.024 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librbd1 (15.2.14-1focal) over (15.2.14-0ubuntu0.20.04.2) ... 2022-01-10T01:21:41.027 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2022-01-10T01:21:41.167 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../004-librbd1_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:41.281 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librbd1 (15.2.14-1focal) over (15.2.14-0ubuntu0.20.04.2) ... 2022-01-10T01:21:41.305 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../004-librbd1_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:41.362 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../004-librbd1_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:41.412 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking librbd1 (15.2.14-1focal) over (15.2.14-0ubuntu0.20.04.2) ... 2022-01-10T01:21:41.513 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librbd1 (15.2.14-1focal) over (15.2.14-0ubuntu0.20.04.2) ... 2022-01-10T01:21:41.548 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../005-librados2_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:41.652 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librados2 (15.2.14-1focal) over (15.2.14-0ubuntu0.20.04.2) ... 2022-01-10T01:21:41.827 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../005-librados2_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:41.945 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../005-librados2_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:41.952 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librados2 (15.2.14-1focal) over (15.2.14-0ubuntu0.20.04.2) ... 2022-01-10T01:21:42.092 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking librados2 (15.2.14-1focal) over (15.2.14-0ubuntu0.20.04.2) ... 2022-01-10T01:21:42.101 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../005-librados2_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:42.209 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librados2 (15.2.14-1focal) over (15.2.14-0ubuntu0.20.04.2) ... 2022-01-10T01:21:42.283 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libcephfs2. 2022-01-10T01:21:42.303 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../006-libcephfs2_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:42.341 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libcephfs2 (15.2.14-1focal) ... 2022-01-10T01:21:42.591 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libcephfs2. 2022-01-10T01:21:42.611 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../006-libcephfs2_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:42.744 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libcephfs2 (15.2.14-1focal) ... 2022-01-10T01:21:42.744 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rados. 2022-01-10T01:21:42.745 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../007-python3-rados_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:42.745 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rados (15.2.14-1focal) ... 2022-01-10T01:21:42.778 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package libcephfs2. 2022-01-10T01:21:42.797 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../006-libcephfs2_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:42.836 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libcephfs2 (15.2.14-1focal) ... 2022-01-10T01:21:42.862 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libcephfs2. 2022-01-10T01:21:42.883 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../006-libcephfs2_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:42.920 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libcephfs2 (15.2.14-1focal) ... 2022-01-10T01:21:42.983 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-rados. 2022-01-10T01:21:43.002 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../007-python3-rados_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:43.050 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-rados (15.2.14-1focal) ... 2022-01-10T01:21:43.077 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-ceph-argparse. 2022-01-10T01:21:43.097 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.14-1focal_all.deb ... 2022-01-10T01:21:43.136 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-ceph-argparse (15.2.14-1focal) ... 2022-01-10T01:21:43.138 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-rados. 2022-01-10T01:21:43.160 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../007-python3-rados_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:43.198 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-rados (15.2.14-1focal) ... 2022-01-10T01:21:43.231 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rados. 2022-01-10T01:21:43.250 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../007-python3-rados_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:43.291 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rados (15.2.14-1focal) ... 2022-01-10T01:21:43.376 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-ceph-argparse. 2022-01-10T01:21:43.398 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.14-1focal_all.deb ... 2022-01-10T01:21:43.444 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-ceph-argparse (15.2.14-1focal) ... 2022-01-10T01:21:43.454 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cephfs. 2022-01-10T01:21:43.476 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../009-python3-cephfs_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:43.520 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cephfs (15.2.14-1focal) ... 2022-01-10T01:21:43.522 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-ceph-argparse. 2022-01-10T01:21:43.541 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.14-1focal_all.deb ... 2022-01-10T01:21:43.602 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-ceph-argparse (15.2.14-1focal) ... 2022-01-10T01:21:43.605 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-ceph-argparse. 2022-01-10T01:21:43.624 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../008-python3-ceph-argparse_15.2.14-1focal_all.deb ... 2022-01-10T01:21:43.658 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-ceph-argparse (15.2.14-1focal) ... 2022-01-10T01:21:43.754 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cephfs. 2022-01-10T01:21:43.773 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../009-python3-cephfs_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:43.804 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cephfs (15.2.14-1focal) ... 2022-01-10T01:21:43.823 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-ceph-common. 2022-01-10T01:21:43.845 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.14-1focal_all.deb ... 2022-01-10T01:21:43.881 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-ceph-common (15.2.14-1focal) ... 2022-01-10T01:21:43.883 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-cephfs. 2022-01-10T01:21:43.902 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../009-python3-cephfs_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:43.950 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-cephfs (15.2.14-1focal) ... 2022-01-10T01:21:43.957 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cephfs. 2022-01-10T01:21:43.979 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../009-python3-cephfs_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:44.018 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cephfs (15.2.14-1focal) ... 2022-01-10T01:21:44.133 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-ceph-common. 2022-01-10T01:21:44.134 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-prettytable. 2022-01-10T01:21:44.152 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.14-1focal_all.deb ... 2022-01-10T01:21:44.157 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2022-01-10T01:21:44.191 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-ceph-common (15.2.14-1focal) ... 2022-01-10T01:21:44.192 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2022-01-10T01:21:44.275 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-ceph-common. 2022-01-10T01:21:44.296 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.14-1focal_all.deb ... 2022-01-10T01:21:44.343 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-ceph-common (15.2.14-1focal) ... 2022-01-10T01:21:44.351 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-ceph-common. 2022-01-10T01:21:44.372 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../010-python3-ceph-common_15.2.14-1focal_all.deb ... 2022-01-10T01:21:44.402 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-ceph-common (15.2.14-1focal) ... 2022-01-10T01:21:44.470 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rbd. 2022-01-10T01:21:44.492 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../012-python3-rbd_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:44.528 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-prettytable. 2022-01-10T01:21:44.536 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rbd (15.2.14-1focal) ... 2022-01-10T01:21:44.547 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2022-01-10T01:21:44.586 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2022-01-10T01:21:44.628 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-prettytable. 2022-01-10T01:21:44.648 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2022-01-10T01:21:44.683 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2022-01-10T01:21:44.743 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-prettytable. 2022-01-10T01:21:44.764 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2022-01-10T01:21:44.801 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2022-01-10T01:21:44.830 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-rbd. 2022-01-10T01:21:44.852 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../012-python3-rbd_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:44.897 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-rbd (15.2.14-1focal) ... 2022-01-10T01:21:44.906 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librabbitmq4:amd64. 2022-01-10T01:21:44.918 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-rbd. 2022-01-10T01:21:44.926 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2022-01-10T01:21:44.937 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../012-python3-rbd_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:44.964 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2022-01-10T01:21:44.977 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-rbd (15.2.14-1focal) ... 2022-01-10T01:21:45.020 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rbd. 2022-01-10T01:21:45.040 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../012-python3-rbd_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:45.070 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rbd (15.2.14-1focal) ... 2022-01-10T01:21:45.199 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package librabbitmq4:amd64. 2022-01-10T01:21:45.222 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2022-01-10T01:21:45.258 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2022-01-10T01:21:45.266 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librdkafka1:amd64. 2022-01-10T01:21:45.289 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2022-01-10T01:21:45.325 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2022-01-10T01:21:45.371 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package librabbitmq4:amd64. 2022-01-10T01:21:45.390 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2022-01-10T01:21:45.429 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2022-01-10T01:21:45.439 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librabbitmq4:amd64. 2022-01-10T01:21:45.460 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../013-librabbitmq4_0.10.0-1_amd64.deb ... 2022-01-10T01:21:45.498 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2022-01-10T01:21:45.627 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package librdkafka1:amd64. 2022-01-10T01:21:45.628 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librgw2. 2022-01-10T01:21:45.647 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2022-01-10T01:21:45.648 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../015-librgw2_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:45.677 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librgw2 (15.2.14-1focal) ... 2022-01-10T01:21:45.685 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2022-01-10T01:21:45.782 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package librdkafka1:amd64. 2022-01-10T01:21:45.802 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2022-01-10T01:21:45.840 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2022-01-10T01:21:45.867 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librdkafka1:amd64. 2022-01-10T01:21:45.888 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../014-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2022-01-10T01:21:45.926 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2022-01-10T01:21:46.030 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package librgw2. 2022-01-10T01:21:46.049 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../015-librgw2_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:46.105 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking librgw2 (15.2.14-1focal) ... 2022-01-10T01:21:46.210 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package librgw2. 2022-01-10T01:21:46.221 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rgw. 2022-01-10T01:21:46.230 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../015-librgw2_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:46.240 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../016-python3-rgw_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:46.268 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking librgw2 (15.2.14-1focal) ... 2022-01-10T01:21:46.270 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package librgw2. 2022-01-10T01:21:46.279 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rgw (15.2.14-1focal) ... 2022-01-10T01:21:46.290 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../015-librgw2_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:46.328 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking librgw2 (15.2.14-1focal) ... 2022-01-10T01:21:46.582 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libleveldb1d:amd64. 2022-01-10T01:21:46.605 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2022-01-10T01:21:46.615 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-rgw. 2022-01-10T01:21:46.635 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../016-python3-rgw_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:46.665 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-rgw (15.2.14-1focal) ... 2022-01-10T01:21:46.666 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2022-01-10T01:21:46.829 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-rgw. 2022-01-10T01:21:46.849 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../016-python3-rgw_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:46.872 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rgw. 2022-01-10T01:21:46.879 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-rgw (15.2.14-1focal) ... 2022-01-10T01:21:46.891 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../016-python3-rgw_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:46.922 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rgw (15.2.14-1focal) ... 2022-01-10T01:21:46.960 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liboath0. 2022-01-10T01:21:46.979 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2022-01-10T01:21:46.985 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libleveldb1d:amd64. 2022-01-10T01:21:47.004 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2022-01-10T01:21:47.010 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2022-01-10T01:21:47.043 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2022-01-10T01:21:47.223 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package libleveldb1d:amd64. 2022-01-10T01:21:47.243 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2022-01-10T01:21:47.281 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2022-01-10T01:21:47.283 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libleveldb1d:amd64. 2022-01-10T01:21:47.296 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libradosstriper1. 2022-01-10T01:21:47.304 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../017-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2022-01-10T01:21:47.315 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../019-libradosstriper1_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:47.341 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2022-01-10T01:21:47.354 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libradosstriper1 (15.2.14-1focal) ... 2022-01-10T01:21:47.396 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package liboath0. 2022-01-10T01:21:47.415 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2022-01-10T01:21:47.454 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2022-01-10T01:21:47.634 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package liboath0. 2022-01-10T01:21:47.654 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2022-01-10T01:21:47.719 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liboath0. 2022-01-10T01:21:47.720 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2022-01-10T01:21:47.740 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../018-liboath0_2.6.1-1.3_amd64.deb ... 2022-01-10T01:21:47.773 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libradosstriper1. 2022-01-10T01:21:47.778 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2022-01-10T01:21:47.795 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../019-libradosstriper1_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:47.826 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-common. 2022-01-10T01:21:47.831 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libradosstriper1 (15.2.14-1focal) ... 2022-01-10T01:21:47.841 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../020-ceph-common_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:47.890 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-common (15.2.14-1focal) ... 2022-01-10T01:21:47.972 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package libradosstriper1. 2022-01-10T01:21:47.993 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../019-libradosstriper1_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:48.030 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libradosstriper1 (15.2.14-1focal) ... 2022-01-10T01:21:48.072 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libradosstriper1. 2022-01-10T01:21:48.095 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../019-libradosstriper1_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:48.130 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libradosstriper1 (15.2.14-1focal) ... 2022-01-10T01:21:48.185 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-common. 2022-01-10T01:21:48.206 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../020-ceph-common_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:48.243 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-common (15.2.14-1focal) ... 2022-01-10T01:21:48.509 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph-common. 2022-01-10T01:21:48.529 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../020-ceph-common_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:48.567 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph-common (15.2.14-1focal) ... 2022-01-10T01:21:48.592 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-common. 2022-01-10T01:21:48.612 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../020-ceph-common_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:48.650 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-common (15.2.14-1focal) ... 2022-01-10T01:21:49.880 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-base. 2022-01-10T01:21:49.902 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../021-ceph-base_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:49.948 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-base (15.2.14-1focal) ... 2022-01-10T01:21:50.299 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-base. 2022-01-10T01:21:50.319 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../021-ceph-base_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:50.360 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-base (15.2.14-1focal) ... 2022-01-10T01:21:50.698 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph-base. 2022-01-10T01:21:50.717 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../021-ceph-base_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:50.785 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph-base (15.2.14-1focal) ... 2022-01-10T01:21:50.805 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-base. 2022-01-10T01:21:50.827 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../021-ceph-base_15.2.14-1focal_amd64.deb ... 2022-01-10T01:21:50.944 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-base (15.2.14-1focal) ... 2022-01-10T01:21:51.134 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cryptography. 2022-01-10T01:21:51.157 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2022-01-10T01:21:51.192 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2022-01-10T01:21:51.413 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cryptography. 2022-01-10T01:21:51.432 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2022-01-10T01:21:51.471 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2022-01-10T01:21:51.739 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-openssl. 2022-01-10T01:21:51.762 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2022-01-10T01:21:51.805 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2022-01-10T01:21:51.961 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-cryptography. 2022-01-10T01:21:51.969 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cryptography. 2022-01-10T01:21:51.975 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-openssl. 2022-01-10T01:21:51.983 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2022-01-10T01:21:51.988 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../022-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2022-01-10T01:21:51.998 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2022-01-10T01:21:52.027 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2022-01-10T01:21:52.028 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2022-01-10T01:21:52.033 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2022-01-10T01:21:52.074 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2022-01-10T01:21:52.094 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.14-1focal_all.deb ... 2022-01-10T01:21:52.132 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-modules-core (15.2.14-1focal) ... 2022-01-10T01:21:52.244 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2022-01-10T01:21:52.263 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.14-1focal_all.deb ... 2022-01-10T01:21:52.295 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-modules-core (15.2.14-1focal) ... 2022-01-10T01:21:52.470 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-bcrypt. 2022-01-10T01:21:52.493 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2022-01-10T01:21:52.523 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-openssl. 2022-01-10T01:21:52.524 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-openssl. 2022-01-10T01:21:52.541 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2022-01-10T01:21:52.545 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../023-python3-openssl_19.0.0-1build1_all.deb ... 2022-01-10T01:21:52.561 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2022-01-10T01:21:52.582 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2022-01-10T01:21:52.606 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2022-01-10T01:21:52.665 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-bcrypt. 2022-01-10T01:21:52.684 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2022-01-10T01:21:52.723 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2022-01-10T01:21:52.869 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2022-01-10T01:21:52.873 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cherrypy3. 2022-01-10T01:21:52.875 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2022-01-10T01:21:52.889 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.14-1focal_all.deb ... 2022-01-10T01:21:52.892 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2022-01-10T01:21:52.898 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../024-ceph-mgr-modules-core_15.2.14-1focal_all.deb ... 2022-01-10T01:21:52.926 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph-mgr-modules-core (15.2.14-1focal) ... 2022-01-10T01:21:52.931 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2022-01-10T01:21:52.933 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-modules-core (15.2.14-1focal) ... 2022-01-10T01:21:53.042 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cherrypy3. 2022-01-10T01:21:53.065 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2022-01-10T01:21:53.125 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2022-01-10T01:21:53.251 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jwt. 2022-01-10T01:21:53.273 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2022-01-10T01:21:53.279 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-bcrypt. 2022-01-10T01:21:53.297 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-bcrypt. 2022-01-10T01:21:53.298 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2022-01-10T01:21:53.316 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../025-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2022-01-10T01:21:53.317 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2022-01-10T01:21:53.346 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2022-01-10T01:21:53.388 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2022-01-10T01:21:53.471 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-jwt. 2022-01-10T01:21:53.490 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2022-01-10T01:21:53.529 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2022-01-10T01:21:53.599 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cherrypy3. 2022-01-10T01:21:53.620 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2022-01-10T01:21:53.645 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-logutils. 2022-01-10T01:21:53.649 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2022-01-10T01:21:53.664 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2022-01-10T01:21:53.691 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-cherrypy3. 2022-01-10T01:21:53.710 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../026-python3-cherrypy3_8.9.1-6_all.deb ... 2022-01-10T01:21:53.712 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-logutils (0.3.3-7) ... 2022-01-10T01:21:53.750 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2022-01-10T01:21:53.915 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-logutils. 2022-01-10T01:21:53.938 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2022-01-10T01:21:53.990 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-logutils (0.3.3-7) ... 2022-01-10T01:21:54.010 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jwt. 2022-01-10T01:21:54.029 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2022-01-10T01:21:54.065 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-markupsafe. 2022-01-10T01:21:54.068 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2022-01-10T01:21:54.084 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2022-01-10T01:21:54.128 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-jwt. 2022-01-10T01:21:54.131 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2022-01-10T01:21:54.146 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../027-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2022-01-10T01:21:54.194 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2022-01-10T01:21:54.309 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-markupsafe. 2022-01-10T01:21:54.328 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2022-01-10T01:21:54.376 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2022-01-10T01:21:54.413 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-logutils. 2022-01-10T01:21:54.433 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2022-01-10T01:21:54.451 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-mako. 2022-01-10T01:21:54.471 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-logutils (0.3.3-7) ... 2022-01-10T01:21:54.473 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2022-01-10T01:21:54.517 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2022-01-10T01:21:54.531 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-logutils. 2022-01-10T01:21:54.550 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-7_all.deb ... 2022-01-10T01:21:54.589 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-logutils (0.3.3-7) ... 2022-01-10T01:21:54.712 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-mako. 2022-01-10T01:21:54.734 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2022-01-10T01:21:54.779 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2022-01-10T01:21:54.808 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-markupsafe. 2022-01-10T01:21:54.827 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2022-01-10T01:21:54.845 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-simplegeneric. 2022-01-10T01:21:54.864 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2022-01-10T01:21:54.866 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2022-01-10T01:21:54.917 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-markupsafe. 2022-01-10T01:21:54.924 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2022-01-10T01:21:54.940 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../029-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2022-01-10T01:21:54.983 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2022-01-10T01:21:55.098 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-simplegeneric. 2022-01-10T01:21:55.118 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2022-01-10T01:21:55.152 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-mako. 2022-01-10T01:21:55.156 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2022-01-10T01:21:55.175 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2022-01-10T01:21:55.231 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-singledispatch. 2022-01-10T01:21:55.235 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2022-01-10T01:21:55.250 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2022-01-10T01:21:55.286 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-mako. 2022-01-10T01:21:55.289 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2022-01-10T01:21:55.308 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../030-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2022-01-10T01:21:55.361 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2022-01-10T01:21:55.492 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-singledispatch. 2022-01-10T01:21:55.514 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2022-01-10T01:21:55.550 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2022-01-10T01:21:55.563 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-simplegeneric. 2022-01-10T01:21:55.584 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2022-01-10T01:21:55.600 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-webob. 2022-01-10T01:21:55.621 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2022-01-10T01:21:55.622 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2022-01-10T01:21:55.667 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2022-01-10T01:21:55.723 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-simplegeneric. 2022-01-10T01:21:55.745 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-3_all.deb ... 2022-01-10T01:21:55.789 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2022-01-10T01:21:55.878 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-webob. 2022-01-10T01:21:55.897 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2022-01-10T01:21:55.936 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2022-01-10T01:21:55.957 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-singledispatch. 2022-01-10T01:21:55.979 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2022-01-10T01:21:56.024 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2022-01-10T01:21:56.027 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-soupsieve. 2022-01-10T01:21:56.047 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2022-01-10T01:21:56.119 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2022-01-10T01:21:56.125 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-singledispatch. 2022-01-10T01:21:56.144 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2022-01-10T01:21:56.183 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2022-01-10T01:21:56.281 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-soupsieve. 2022-01-10T01:21:56.302 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2022-01-10T01:21:56.339 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2022-01-10T01:21:56.360 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-webob. 2022-01-10T01:21:56.378 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2022-01-10T01:21:56.418 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2022-01-10T01:21:56.480 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-bs4. 2022-01-10T01:21:56.500 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2022-01-10T01:21:56.511 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-webob. 2022-01-10T01:21:56.530 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../033-python3-webob_1%3a1.8.5-2_all.deb ... 2022-01-10T01:21:56.538 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2022-01-10T01:21:56.594 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2022-01-10T01:21:56.658 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-bs4. 2022-01-10T01:21:56.677 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2022-01-10T01:21:56.716 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2022-01-10T01:21:56.770 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-soupsieve. 2022-01-10T01:21:56.789 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2022-01-10T01:21:56.829 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2022-01-10T01:21:56.905 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-soupsieve. 2022-01-10T01:21:56.907 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-waitress. 2022-01-10T01:21:56.928 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2022-01-10T01:21:56.929 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../034-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2022-01-10T01:21:56.969 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-waitress (1.4.1-1) ... 2022-01-10T01:21:56.997 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2022-01-10T01:21:57.111 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-waitress. 2022-01-10T01:21:57.131 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2022-01-10T01:21:57.156 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-bs4. 2022-01-10T01:21:57.174 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-waitress (1.4.1-1) ... 2022-01-10T01:21:57.176 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2022-01-10T01:21:57.215 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2022-01-10T01:21:57.308 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-bs4. 2022-01-10T01:21:57.327 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../035-python3-bs4_4.8.2-1_all.deb ... 2022-01-10T01:21:57.370 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-tempita. 2022-01-10T01:21:57.374 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2022-01-10T01:21:57.388 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2022-01-10T01:21:57.435 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-tempita (0.5.2-6) ... 2022-01-10T01:21:57.506 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-tempita. 2022-01-10T01:21:57.525 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2022-01-10T01:21:57.564 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-tempita (0.5.2-6) ... 2022-01-10T01:21:57.593 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-waitress. 2022-01-10T01:21:57.612 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2022-01-10T01:21:57.654 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-waitress (1.4.1-1) ... 2022-01-10T01:21:57.746 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-paste. 2022-01-10T01:21:57.770 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2022-01-10T01:21:57.777 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-waitress. 2022-01-10T01:21:57.797 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../036-python3-waitress_1.4.1-1_all.deb ... 2022-01-10T01:21:57.821 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2022-01-10T01:21:57.838 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-waitress (1.4.1-1) ... 2022-01-10T01:21:57.891 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-paste. 2022-01-10T01:21:57.911 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2022-01-10T01:21:57.949 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2022-01-10T01:21:57.979 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-tempita. 2022-01-10T01:21:57.998 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2022-01-10T01:21:58.062 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-tempita (0.5.2-6) ... 2022-01-10T01:21:58.166 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2022-01-10T01:21:58.187 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2022-01-10T01:21:58.232 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2022-01-10T01:21:58.238 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-tempita. 2022-01-10T01:21:58.258 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../037-python3-tempita_0.5.2-6_all.deb ... 2022-01-10T01:21:58.294 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2022-01-10T01:21:58.296 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-tempita (0.5.2-6) ... 2022-01-10T01:21:58.315 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2022-01-10T01:21:58.323 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-paste. 2022-01-10T01:21:58.344 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2022-01-10T01:21:58.354 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2022-01-10T01:21:58.373 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2022-01-10T01:21:58.577 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pastedeploy. 2022-01-10T01:21:58.596 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2022-01-10T01:21:58.633 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-paste. 2022-01-10T01:21:58.635 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2022-01-10T01:21:58.652 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../038-python3-paste_3.4.0+dfsg1-1_all.deb ... 2022-01-10T01:21:58.680 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pastedeploy. 2022-01-10T01:21:58.691 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2022-01-10T01:21:58.702 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2022-01-10T01:21:58.726 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2022-01-10T01:21:58.746 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2022-01-10T01:21:58.746 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2022-01-10T01:21:58.784 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2022-01-10T01:21:58.937 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-webtest. 2022-01-10T01:21:58.957 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2022-01-10T01:21:59.004 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-webtest (2.0.32-2) ... 2022-01-10T01:21:59.060 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2022-01-10T01:21:59.079 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../039-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2022-01-10T01:21:59.091 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-webtest. 2022-01-10T01:21:59.112 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pastedeploy. 2022-01-10T01:21:59.112 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2022-01-10T01:21:59.126 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2022-01-10T01:21:59.135 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2022-01-10T01:21:59.157 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-webtest (2.0.32-2) ... 2022-01-10T01:21:59.179 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2022-01-10T01:21:59.315 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pecan. 2022-01-10T01:21:59.336 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2022-01-10T01:21:59.373 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2022-01-10T01:21:59.430 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-pastedeploy. 2022-01-10T01:21:59.452 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../040-python3-pastedeploy_2.1.0-1_all.deb ... 2022-01-10T01:21:59.489 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-webtest. 2022-01-10T01:21:59.511 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2022-01-10T01:21:59.521 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2022-01-10T01:21:59.527 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pecan. 2022-01-10T01:21:59.548 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2022-01-10T01:21:59.556 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-webtest (2.0.32-2) ... 2022-01-10T01:21:59.585 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2022-01-10T01:21:59.779 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-werkzeug. 2022-01-10T01:21:59.800 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2022-01-10T01:21:59.824 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-webtest. 2022-01-10T01:21:59.843 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../041-python3-webtest_2.0.32-2_all.deb ... 2022-01-10T01:21:59.846 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2022-01-10T01:21:59.867 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pecan. 2022-01-10T01:21:59.882 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-webtest (2.0.32-2) ... 2022-01-10T01:21:59.885 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2022-01-10T01:21:59.942 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2022-01-10T01:21:59.948 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-werkzeug. 2022-01-10T01:21:59.968 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2022-01-10T01:22:00.006 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2022-01-10T01:22:00.201 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-pecan. 2022-01-10T01:22:00.224 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../042-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2022-01-10T01:22:00.249 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr. 2022-01-10T01:22:00.267 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2022-01-10T01:22:00.269 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../044-ceph-mgr_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:00.288 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-werkzeug. 2022-01-10T01:22:00.309 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr (15.2.14-1focal) ... 2022-01-10T01:22:00.310 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2022-01-10T01:22:00.374 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2022-01-10T01:22:00.426 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr. 2022-01-10T01:22:00.445 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../044-ceph-mgr_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:00.484 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr (15.2.14-1focal) ... 2022-01-10T01:22:00.631 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-werkzeug. 2022-01-10T01:22:00.654 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../043-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2022-01-10T01:22:00.697 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2022-01-10T01:22:00.816 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr. 2022-01-10T01:22:00.834 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mon. 2022-01-10T01:22:00.835 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../044-ceph-mgr_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:00.857 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../045-ceph-mon_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:00.899 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr (15.2.14-1focal) ... 2022-01-10T01:22:00.901 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mon (15.2.14-1focal) ... 2022-01-10T01:22:00.954 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mon. 2022-01-10T01:22:00.973 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../045-ceph-mon_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:01.054 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mon (15.2.14-1focal) ... 2022-01-10T01:22:01.125 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph-mgr. 2022-01-10T01:22:01.144 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../044-ceph-mgr_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:01.185 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph-mgr (15.2.14-1focal) ... 2022-01-10T01:22:01.469 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mon. 2022-01-10T01:22:01.488 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../045-ceph-mon_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:01.527 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mon (15.2.14-1focal) ... 2022-01-10T01:22:01.661 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph-mon. 2022-01-10T01:22:01.680 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../045-ceph-mon_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:01.719 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph-mon (15.2.14-1focal) ... 2022-01-10T01:22:01.930 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-osd. 2022-01-10T01:22:01.950 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../046-ceph-osd_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:01.988 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-osd (15.2.14-1focal) ... 2022-01-10T01:22:02.091 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-osd. 2022-01-10T01:22:02.114 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../046-ceph-osd_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:02.157 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-osd (15.2.14-1focal) ... 2022-01-10T01:22:02.531 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-osd. 2022-01-10T01:22:02.549 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../046-ceph-osd_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:02.588 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-osd (15.2.14-1focal) ... 2022-01-10T01:22:02.723 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph-osd. 2022-01-10T01:22:02.742 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../046-ceph-osd_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:02.781 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph-osd (15.2.14-1focal) ... 2022-01-10T01:22:04.335 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph. 2022-01-10T01:22:04.355 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../047-ceph_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:04.393 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph (15.2.14-1focal) ... 2022-01-10T01:22:04.554 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph. 2022-01-10T01:22:04.578 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../047-ceph_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:04.629 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph (15.2.14-1focal) ... 2022-01-10T01:22:04.804 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-fuse. 2022-01-10T01:22:04.824 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../048-ceph-fuse_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:04.871 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-fuse (15.2.14-1focal) ... 2022-01-10T01:22:04.986 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph. 2022-01-10T01:22:05.005 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../047-ceph_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:05.009 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-fuse. 2022-01-10T01:22:05.031 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../048-ceph-fuse_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:05.044 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph (15.2.14-1focal) ... 2022-01-10T01:22:05.053 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph. 2022-01-10T01:22:05.073 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-fuse (15.2.14-1focal) ... 2022-01-10T01:22:05.074 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../047-ceph_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:05.103 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph (15.2.14-1focal) ... 2022-01-10T01:22:05.257 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mds. 2022-01-10T01:22:05.277 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../049-ceph-mds_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:05.315 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mds (15.2.14-1focal) ... 2022-01-10T01:22:05.388 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-fuse. 2022-01-10T01:22:05.406 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph-fuse. 2022-01-10T01:22:05.407 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../048-ceph-fuse_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:05.426 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../048-ceph-fuse_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:05.446 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-fuse (15.2.14-1focal) ... 2022-01-10T01:22:05.464 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph-fuse (15.2.14-1focal) ... 2022-01-10T01:22:05.484 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mds. 2022-01-10T01:22:05.505 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../049-ceph-mds_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:05.542 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mds (15.2.14-1focal) ... 2022-01-10T01:22:05.826 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package cephadm. 2022-01-10T01:22:05.846 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../050-cephadm_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:05.849 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mds. 2022-01-10T01:22:05.872 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../049-ceph-mds_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:05.876 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph-mds. 2022-01-10T01:22:05.884 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking cephadm (15.2.14-1focal) ... 2022-01-10T01:22:05.894 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../049-ceph-mds_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:05.916 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mds (15.2.14-1focal) ... 2022-01-10T01:22:05.933 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph-mds (15.2.14-1focal) ... 2022-01-10T01:22:06.171 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jinja2. 2022-01-10T01:22:06.172 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package cephadm. 2022-01-10T01:22:06.192 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../050-cephadm_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:06.194 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2022-01-10T01:22:06.230 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking cephadm (15.2.14-1focal) ... 2022-01-10T01:22:06.444 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package cephadm. 2022-01-10T01:22:06.453 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package cephadm. 2022-01-10T01:22:06.467 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../050-cephadm_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:06.472 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../050-cephadm_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:06.511 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking cephadm (15.2.14-1focal) ... 2022-01-10T01:22:06.638 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2022-01-10T01:22:06.977 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking cephadm (15.2.14-1focal) ... 2022-01-10T01:22:07.066 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2022-01-10T01:22:07.087 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.14-1focal_all.deb ... 2022-01-10T01:22:07.116 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-cephadm (15.2.14-1focal) ... 2022-01-10T01:22:07.184 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-jinja2. 2022-01-10T01:22:07.204 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2022-01-10T01:22:07.242 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2022-01-10T01:22:07.373 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-jinja2. 2022-01-10T01:22:07.394 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-repoze.lru. 2022-01-10T01:22:07.396 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2022-01-10T01:22:07.413 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2022-01-10T01:22:07.452 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2022-01-10T01:22:07.497 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2022-01-10T01:22:07.587 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2022-01-10T01:22:07.606 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.14-1focal_all.deb ... 2022-01-10T01:22:07.653 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-cephadm (15.2.14-1focal) ... 2022-01-10T01:22:07.713 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libjs-underscore. 2022-01-10T01:22:07.734 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2022-01-10T01:22:07.771 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2022-01-10T01:22:07.817 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2022-01-10T01:22:07.836 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.14-1focal_all.deb ... 2022-01-10T01:22:07.855 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-jinja2. 2022-01-10T01:22:07.873 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../051-python3-jinja2_2.10.1-2_all.deb ... 2022-01-10T01:22:07.875 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph-mgr-cephadm (15.2.14-1focal) ... 2022-01-10T01:22:07.913 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2022-01-10T01:22:07.973 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-repoze.lru. 2022-01-10T01:22:07.993 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2022-01-10T01:22:08.031 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2022-01-10T01:22:08.090 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libjs-sphinxdoc. 2022-01-10T01:22:08.109 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2022-01-10T01:22:08.148 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2022-01-10T01:22:08.237 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-repoze.lru. 2022-01-10T01:22:08.258 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2022-01-10T01:22:08.260 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2022-01-10T01:22:08.277 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../052-ceph-mgr-cephadm_15.2.14-1focal_all.deb ... 2022-01-10T01:22:08.303 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2022-01-10T01:22:08.308 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libjs-underscore. 2022-01-10T01:22:08.316 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-cephadm (15.2.14-1focal) ... 2022-01-10T01:22:08.328 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2022-01-10T01:22:08.366 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2022-01-10T01:22:08.451 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-routes. 2022-01-10T01:22:08.474 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2022-01-10T01:22:08.509 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-routes (2.4.1-2) ... 2022-01-10T01:22:08.581 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package libjs-underscore. 2022-01-10T01:22:08.604 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2022-01-10T01:22:08.648 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2022-01-10T01:22:08.652 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-repoze.lru. 2022-01-10T01:22:08.672 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../053-python3-repoze.lru_0.7-2_all.deb ... 2022-01-10T01:22:08.677 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libjs-sphinxdoc. 2022-01-10T01:22:08.697 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2022-01-10T01:22:08.710 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2022-01-10T01:22:08.744 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2022-01-10T01:22:08.917 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package libjs-sphinxdoc. 2022-01-10T01:22:08.921 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libjs-underscore. 2022-01-10T01:22:08.938 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2022-01-10T01:22:08.940 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../054-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2022-01-10T01:22:08.971 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2022-01-10T01:22:08.971 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2022-01-10T01:22:08.989 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.14-1focal_all.deb ... 2022-01-10T01:22:08.991 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2022-01-10T01:22:09.028 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-dashboard (15.2.14-1focal) ... 2022-01-10T01:22:09.130 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-routes. 2022-01-10T01:22:09.150 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2022-01-10T01:22:09.188 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-routes (2.4.1-2) ... 2022-01-10T01:22:09.232 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libjs-sphinxdoc. 2022-01-10T01:22:09.251 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../055-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2022-01-10T01:22:09.282 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2022-01-10T01:22:09.327 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-routes. 2022-01-10T01:22:09.346 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2022-01-10T01:22:09.385 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-routes (2.4.1-2) ... 2022-01-10T01:22:09.567 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2022-01-10T01:22:09.586 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.14-1focal_all.deb ... 2022-01-10T01:22:09.618 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-routes. 2022-01-10T01:22:09.624 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-dashboard (15.2.14-1focal) ... 2022-01-10T01:22:09.637 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../056-python3-routes_2.4.1-2_all.deb ... 2022-01-10T01:22:09.676 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-routes (2.4.1-2) ... 2022-01-10T01:22:09.755 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2022-01-10T01:22:09.774 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.14-1focal_all.deb ... 2022-01-10T01:22:09.822 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph-mgr-dashboard (15.2.14-1focal) ... 2022-01-10T01:22:09.969 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2022-01-10T01:22:09.988 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.14-1focal_all.deb ... 2022-01-10T01:22:10.027 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-1focal) ... 2022-01-10T01:22:10.038 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2022-01-10T01:22:10.060 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../057-ceph-mgr-dashboard_15.2.14-1focal_all.deb ... 2022-01-10T01:22:10.104 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-dashboard (15.2.14-1focal) ... 2022-01-10T01:22:10.364 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-decorator. 2022-01-10T01:22:10.384 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2022-01-10T01:22:10.421 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2022-01-10T01:22:10.607 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2022-01-10T01:22:10.627 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.14-1focal_all.deb ... 2022-01-10T01:22:10.665 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-1focal) ... 2022-01-10T01:22:10.691 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2022-01-10T01:22:10.714 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2022-01-10T01:22:10.749 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2022-01-10T01:22:10.804 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2022-01-10T01:22:10.824 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.14-1focal_all.deb ... 2022-01-10T01:22:10.862 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-1focal) ... 2022-01-10T01:22:11.026 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-decorator. 2022-01-10T01:22:11.035 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-scipy. 2022-01-10T01:22:11.045 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2022-01-10T01:22:11.055 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2022-01-10T01:22:11.092 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2022-01-10T01:22:11.093 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2022-01-10T01:22:11.095 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2022-01-10T01:22:11.114 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../058-ceph-mgr-diskprediction-cloud_15.2.14-1focal_all.deb ... 2022-01-10T01:22:11.140 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-decorator. 2022-01-10T01:22:11.153 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.14-1focal) ... 2022-01-10T01:22:11.159 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2022-01-10T01:22:11.190 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2022-01-10T01:22:11.428 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2022-01-10T01:22:11.449 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2022-01-10T01:22:11.486 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2022-01-10T01:22:11.489 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-decorator. 2022-01-10T01:22:11.509 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../059-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2022-01-10T01:22:11.517 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2022-01-10T01:22:11.540 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2022-01-10T01:22:11.547 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2022-01-10T01:22:11.584 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2022-01-10T01:22:11.814 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-scipy. 2022-01-10T01:22:11.834 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2022-01-10T01:22:11.872 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2022-01-10T01:22:11.879 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-scipy. 2022-01-10T01:22:11.898 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2022-01-10T01:22:11.925 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2022-01-10T01:22:11.937 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2022-01-10T01:22:11.947 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../060-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2022-01-10T01:22:11.992 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2022-01-10T01:22:12.328 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-scipy. 2022-01-10T01:22:12.351 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../061-python3-scipy_1.3.3-3build1_amd64.deb ... 2022-01-10T01:22:12.386 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2022-01-10T01:22:12.694 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-sklearn-lib. 2022-01-10T01:22:12.715 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2022-01-10T01:22:12.760 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:13.246 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-sklearn-lib. 2022-01-10T01:22:13.267 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2022-01-10T01:22:13.296 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:13.314 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-joblib. 2022-01-10T01:22:13.333 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2022-01-10T01:22:13.451 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-joblib (0.14.0-3) ... 2022-01-10T01:22:13.648 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-sklearn-lib. 2022-01-10T01:22:13.671 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2022-01-10T01:22:13.713 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-sklearn-lib. 2022-01-10T01:22:13.714 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:13.736 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../062-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2022-01-10T01:22:13.750 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-sklearn. 2022-01-10T01:22:13.769 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2022-01-10T01:22:13.779 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:13.808 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:13.841 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-joblib. 2022-01-10T01:22:13.864 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2022-01-10T01:22:13.907 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-joblib (0.14.0-3) ... 2022-01-10T01:22:14.235 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-joblib. 2022-01-10T01:22:14.255 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2022-01-10T01:22:14.292 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-joblib (0.14.0-3) ... 2022-01-10T01:22:14.302 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-sklearn. 2022-01-10T01:22:14.322 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2022-01-10T01:22:14.349 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-joblib. 2022-01-10T01:22:14.360 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:14.369 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../063-python3-joblib_0.14.0-3_all.deb ... 2022-01-10T01:22:14.407 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-joblib (0.14.0-3) ... 2022-01-10T01:22:14.466 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2022-01-10T01:22:14.487 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.14-1focal_all.deb ... 2022-01-10T01:22:14.524 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-1focal) ... 2022-01-10T01:22:14.705 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-sklearn. 2022-01-10T01:22:14.725 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2022-01-10T01:22:14.763 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:14.803 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-sklearn. 2022-01-10T01:22:14.825 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../064-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2022-01-10T01:22:14.869 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:15.069 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2022-01-10T01:22:15.090 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.14-1focal_all.deb ... 2022-01-10T01:22:15.143 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-1focal) ... 2022-01-10T01:22:15.446 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2022-01-10T01:22:15.465 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.14-1focal_all.deb ... 2022-01-10T01:22:15.503 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-1focal) ... 2022-01-10T01:22:15.586 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2022-01-10T01:22:15.608 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../065-ceph-mgr-diskprediction-local_15.2.14-1focal_all.deb ... 2022-01-10T01:22:15.652 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.14-1focal) ... 2022-01-10T01:22:15.694 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cachetools. 2022-01-10T01:22:15.713 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2022-01-10T01:22:15.752 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2022-01-10T01:22:16.063 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyasn1. 2022-01-10T01:22:16.084 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2022-01-10T01:22:16.121 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2022-01-10T01:22:16.297 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-cachetools. 2022-01-10T01:22:16.317 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2022-01-10T01:22:16.355 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2022-01-10T01:22:16.516 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyasn1-modules. 2022-01-10T01:22:16.539 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2022-01-10T01:22:16.591 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2022-01-10T01:22:16.673 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-cachetools. 2022-01-10T01:22:16.682 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-pyasn1. 2022-01-10T01:22:16.693 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2022-01-10T01:22:16.702 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2022-01-10T01:22:16.731 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2022-01-10T01:22:16.740 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2022-01-10T01:22:16.772 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-cachetools. 2022-01-10T01:22:16.791 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../066-python3-cachetools_4.0.0-1_all.deb ... 2022-01-10T01:22:16.830 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2022-01-10T01:22:16.952 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rsa. 2022-01-10T01:22:16.972 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2022-01-10T01:22:17.018 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rsa (4.0-3) ... 2022-01-10T01:22:17.051 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pyasn1. 2022-01-10T01:22:17.069 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-pyasn1-modules. 2022-01-10T01:22:17.072 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2022-01-10T01:22:17.088 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2022-01-10T01:22:17.109 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2022-01-10T01:22:17.149 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyasn1. 2022-01-10T01:22:17.152 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2022-01-10T01:22:17.172 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../067-python3-pyasn1_0.4.2-3build1_all.deb ... 2022-01-10T01:22:17.216 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2022-01-10T01:22:17.347 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-google-auth. 2022-01-10T01:22:17.370 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2022-01-10T01:22:17.413 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2022-01-10T01:22:17.463 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-rsa. 2022-01-10T01:22:17.483 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2022-01-10T01:22:17.504 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pyasn1-modules. 2022-01-10T01:22:17.521 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-rsa (4.0-3) ... 2022-01-10T01:22:17.524 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2022-01-10T01:22:17.571 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2022-01-10T01:22:17.586 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyasn1-modules. 2022-01-10T01:22:17.606 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../068-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2022-01-10T01:22:17.644 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2022-01-10T01:22:17.758 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-blinker. 2022-01-10T01:22:17.779 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2022-01-10T01:22:17.816 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2022-01-10T01:22:17.841 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-google-auth. 2022-01-10T01:22:17.864 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2022-01-10T01:22:17.891 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-rsa. 2022-01-10T01:22:17.908 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2022-01-10T01:22:17.911 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2022-01-10T01:22:17.955 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-rsa. 2022-01-10T01:22:17.967 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-rsa (4.0-3) ... 2022-01-10T01:22:17.974 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../069-python3-rsa_4.0-3_all.deb ... 2022-01-10T01:22:18.046 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-rsa (4.0-3) ... 2022-01-10T01:22:18.119 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-oauthlib. 2022-01-10T01:22:18.141 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2022-01-10T01:22:18.185 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2022-01-10T01:22:18.252 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-blinker. 2022-01-10T01:22:18.273 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2022-01-10T01:22:18.285 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-google-auth. 2022-01-10T01:22:18.304 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2022-01-10T01:22:18.310 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2022-01-10T01:22:18.342 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2022-01-10T01:22:18.358 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-google-auth. 2022-01-10T01:22:18.378 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../070-python3-google-auth_1.5.1-2_all.deb ... 2022-01-10T01:22:18.416 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2022-01-10T01:22:18.522 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-requests-oauthlib. 2022-01-10T01:22:18.542 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2022-01-10T01:22:18.580 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2022-01-10T01:22:18.622 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-oauthlib. 2022-01-10T01:22:18.645 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2022-01-10T01:22:18.704 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-blinker. 2022-01-10T01:22:18.713 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2022-01-10T01:22:18.724 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2022-01-10T01:22:18.744 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-blinker. 2022-01-10T01:22:18.764 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../071-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2022-01-10T01:22:18.796 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2022-01-10T01:22:18.802 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2022-01-10T01:22:18.916 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-websocket. 2022-01-10T01:22:18.939 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2022-01-10T01:22:18.982 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2022-01-10T01:22:19.058 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-requests-oauthlib. 2022-01-10T01:22:19.079 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2022-01-10T01:22:19.115 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-oauthlib. 2022-01-10T01:22:19.116 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2022-01-10T01:22:19.135 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2022-01-10T01:22:19.163 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-oauthlib. 2022-01-10T01:22:19.173 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2022-01-10T01:22:19.184 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../072-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2022-01-10T01:22:19.221 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2022-01-10T01:22:19.352 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-kubernetes. 2022-01-10T01:22:19.372 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2022-01-10T01:22:19.419 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2022-01-10T01:22:19.469 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-websocket. 2022-01-10T01:22:19.488 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2022-01-10T01:22:19.518 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-requests-oauthlib. 2022-01-10T01:22:19.527 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2022-01-10T01:22:19.538 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2022-01-10T01:22:19.575 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-requests-oauthlib. 2022-01-10T01:22:19.594 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../073-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2022-01-10T01:22:19.610 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2022-01-10T01:22:19.633 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2022-01-10T01:22:19.880 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-kubernetes. 2022-01-10T01:22:19.902 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2022-01-10T01:22:19.921 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-websocket. 2022-01-10T01:22:19.939 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2022-01-10T01:22:19.941 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2022-01-10T01:22:19.948 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2022-01-10T01:22:19.969 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-websocket. 2022-01-10T01:22:19.971 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.14-1focal_all.deb ... 2022-01-10T01:22:19.979 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2022-01-10T01:22:19.989 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../074-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2022-01-10T01:22:20.014 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-1focal) ... 2022-01-10T01:22:20.027 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2022-01-10T01:22:20.299 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-kubernetes. 2022-01-10T01:22:20.320 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2022-01-10T01:22:20.347 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-kubernetes. 2022-01-10T01:22:20.350 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libonig5:amd64. 2022-01-10T01:22:20.369 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../075-python3-kubernetes_7.0.0~a1-2_all.deb ... 2022-01-10T01:22:20.374 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2022-01-10T01:22:20.382 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2022-01-10T01:22:20.413 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2022-01-10T01:22:20.417 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2022-01-10T01:22:20.510 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2022-01-10T01:22:20.531 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.14-1focal_all.deb ... 2022-01-10T01:22:20.568 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-1focal) ... 2022-01-10T01:22:20.770 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libjq1:amd64. 2022-01-10T01:22:20.790 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2022-01-10T01:22:20.836 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:20.912 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package libonig5:amd64. 2022-01-10T01:22:20.932 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2022-01-10T01:22:20.936 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2022-01-10T01:22:20.957 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.14-1focal_all.deb ... 2022-01-10T01:22:20.960 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2022-01-10T01:22:20.971 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2022-01-10T01:22:20.980 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../076-ceph-mgr-k8sevents_15.2.14-1focal_all.deb ... 2022-01-10T01:22:20.994 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-1focal) ... 2022-01-10T01:22:21.018 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-mgr-k8sevents (15.2.14-1focal) ... 2022-01-10T01:22:21.164 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package jq. 2022-01-10T01:22:21.184 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2022-01-10T01:22:21.230 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:21.349 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package libjq1:amd64. 2022-01-10T01:22:21.356 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libonig5:amd64. 2022-01-10T01:22:21.362 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libonig5:amd64. 2022-01-10T01:22:21.368 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2022-01-10T01:22:21.377 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2022-01-10T01:22:21.388 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../077-libonig5_6.9.4-1_amd64.deb ... 2022-01-10T01:22:21.407 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:21.414 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2022-01-10T01:22:21.437 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2022-01-10T01:22:21.491 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package socat. 2022-01-10T01:22:21.512 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2022-01-10T01:22:21.549 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking socat (1.7.3.3-2) ... 2022-01-10T01:22:21.693 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package jq. 2022-01-10T01:22:21.715 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2022-01-10T01:22:21.767 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libjq1:amd64. 2022-01-10T01:22:21.790 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2022-01-10T01:22:21.792 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:21.833 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:21.840 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libjq1:amd64. 2022-01-10T01:22:21.859 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../078-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2022-01-10T01:22:21.898 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:22.045 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package socat. 2022-01-10T01:22:22.046 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libxslt1.1:amd64. 2022-01-10T01:22:22.067 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2022-01-10T01:22:22.067 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2022-01-10T01:22:22.104 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2022-01-10T01:22:22.111 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking socat (1.7.3.3-2) ... 2022-01-10T01:22:22.127 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package jq. 2022-01-10T01:22:22.149 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2022-01-10T01:22:22.159 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package jq. 2022-01-10T01:22:22.179 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../079-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2022-01-10T01:22:22.185 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:22.217 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:22.489 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package socat. 2022-01-10T01:22:22.509 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2022-01-10T01:22:22.541 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package xmlstarlet. 2022-01-10T01:22:22.547 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking socat (1.7.3.3-2) ... 2022-01-10T01:22:22.561 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2022-01-10T01:22:22.562 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package socat. 2022-01-10T01:22:22.581 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../080-socat_1.7.3.3-2_amd64.deb ... 2022-01-10T01:22:22.608 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2022-01-10T01:22:22.609 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package libxslt1.1:amd64. 2022-01-10T01:22:22.620 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking socat (1.7.3.3-2) ... 2022-01-10T01:22:22.631 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2022-01-10T01:22:22.784 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2022-01-10T01:22:22.928 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-test. 2022-01-10T01:22:22.951 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../083-ceph-test_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:22.994 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-test (15.2.14-1focal) ... 2022-01-10T01:22:23.100 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libxslt1.1:amd64. 2022-01-10T01:22:23.123 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2022-01-10T01:22:23.127 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libxslt1.1:amd64. 2022-01-10T01:22:23.147 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../081-libxslt1.1_1.1.34-4_amd64.deb ... 2022-01-10T01:22:23.185 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2022-01-10T01:22:23.195 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2022-01-10T01:22:23.395 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package xmlstarlet. 2022-01-10T01:22:23.415 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2022-01-10T01:22:23.453 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2022-01-10T01:22:23.470 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package xmlstarlet. 2022-01-10T01:22:23.489 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package xmlstarlet. 2022-01-10T01:22:23.491 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2022-01-10T01:22:23.509 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../082-xmlstarlet_1.6.1-2build1_amd64.deb ... 2022-01-10T01:22:23.528 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2022-01-10T01:22:23.546 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2022-01-10T01:22:23.791 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package ceph-test. 2022-01-10T01:22:23.811 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../083-ceph-test_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:23.865 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking ceph-test (15.2.14-1focal) ... 2022-01-10T01:22:23.892 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package ceph-test. 2022-01-10T01:22:23.907 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package ceph-test. 2022-01-10T01:22:23.915 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../083-ceph-test_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:23.929 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../083-ceph-test_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:23.959 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking ceph-test (15.2.14-1focal) ... 2022-01-10T01:22:23.974 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking ceph-test (15.2.14-1focal) ... 2022-01-10T01:22:26.599 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-colorama. 2022-01-10T01:22:26.623 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2022-01-10T01:22:26.665 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2022-01-10T01:22:26.943 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package cephfs-shell. 2022-01-10T01:22:26.963 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../085-cephfs-shell_15.2.14-1focal_all.deb ... 2022-01-10T01:22:27.024 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking cephfs-shell (15.2.14-1focal) ... 2022-01-10T01:22:27.279 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libcephfs-dev. 2022-01-10T01:22:27.300 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:27.320 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-colorama. 2022-01-10T01:22:27.337 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libcephfs-dev (15.2.14-1focal) ... 2022-01-10T01:22:27.338 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2022-01-10T01:22:27.378 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2022-01-10T01:22:27.446 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-colorama. 2022-01-10T01:22:27.469 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2022-01-10T01:22:27.504 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2022-01-10T01:22:27.586 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-colorama. 2022-01-10T01:22:27.606 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../084-python3-colorama_0.4.3-1build1_all.deb ... 2022-01-10T01:22:27.644 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2022-01-10T01:22:27.681 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package cephfs-shell. 2022-01-10T01:22:27.703 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../085-cephfs-shell_15.2.14-1focal_all.deb ... 2022-01-10T01:22:27.723 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package nvme-cli. 2022-01-10T01:22:27.744 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2022-01-10T01:22:27.747 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking cephfs-shell (15.2.14-1focal) ... 2022-01-10T01:22:27.749 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package cephfs-shell. 2022-01-10T01:22:27.769 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../085-cephfs-shell_15.2.14-1focal_all.deb ... 2022-01-10T01:22:27.799 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2022-01-10T01:22:27.807 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking cephfs-shell (15.2.14-1focal) ... 2022-01-10T01:22:27.914 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package cephfs-shell. 2022-01-10T01:22:27.934 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../085-cephfs-shell_15.2.14-1focal_all.deb ... 2022-01-10T01:22:27.972 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking cephfs-shell (15.2.14-1focal) ... 2022-01-10T01:22:28.008 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package libcephfs-dev. 2022-01-10T01:22:28.029 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:28.076 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libcephfs-dev. 2022-01-10T01:22:28.096 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:28.149 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libcephfs-dev (15.2.14-1focal) ... 2022-01-10T01:22:28.159 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libcephfs-dev (15.2.14-1focal) ... 2022-01-10T01:22:28.174 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libcephfs-dev. 2022-01-10T01:22:28.194 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../086-libcephfs-dev_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:28.224 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libcephfs-dev (15.2.14-1focal) ... 2022-01-10T01:22:28.228 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-atomicwrites. 2022-01-10T01:22:28.251 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2022-01-10T01:22:28.295 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2022-01-10T01:22:28.554 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package nvme-cli. 2022-01-10T01:22:28.574 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2022-01-10T01:22:28.577 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package nvme-cli. 2022-01-10T01:22:28.598 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2022-01-10T01:22:28.623 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-attr. 2022-01-10T01:22:28.639 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2022-01-10T01:22:28.643 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2022-01-10T01:22:28.652 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package nvme-cli. 2022-01-10T01:22:28.661 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2022-01-10T01:22:28.673 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../087-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2022-01-10T01:22:28.681 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-attr (19.3.0-2) ... 2022-01-10T01:22:28.729 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2022-01-10T01:22:28.985 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-atomicwrites. 2022-01-10T01:22:29.007 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2022-01-10T01:22:29.009 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-webencodings. 2022-01-10T01:22:29.029 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2022-01-10T01:22:29.051 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2022-01-10T01:22:29.066 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-atomicwrites. 2022-01-10T01:22:29.067 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2022-01-10T01:22:29.089 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2022-01-10T01:22:29.124 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-atomicwrites. 2022-01-10T01:22:29.132 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2022-01-10T01:22:29.144 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../088-python3-atomicwrites_1.1.5-2build1_all.deb ... 2022-01-10T01:22:29.182 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2022-01-10T01:22:29.345 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-attr. 2022-01-10T01:22:29.365 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2022-01-10T01:22:29.403 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-html5lib. 2022-01-10T01:22:29.404 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-attr (19.3.0-2) ... 2022-01-10T01:22:29.427 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2022-01-10T01:22:29.435 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-attr. 2022-01-10T01:22:29.455 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2022-01-10T01:22:29.477 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-attr. 2022-01-10T01:22:29.478 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2022-01-10T01:22:29.500 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../089-python3-attr_19.3.0-2_all.deb ... 2022-01-10T01:22:29.518 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-attr (19.3.0-2) ... 2022-01-10T01:22:29.535 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-attr (19.3.0-2) ... 2022-01-10T01:22:29.749 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-webencodings. 2022-01-10T01:22:29.771 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2022-01-10T01:22:29.815 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2022-01-10T01:22:29.829 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-webencodings. 2022-01-10T01:22:29.831 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-lxml:amd64. 2022-01-10T01:22:29.852 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2022-01-10T01:22:29.855 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2022-01-10T01:22:29.880 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-webencodings. 2022-01-10T01:22:29.897 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2022-01-10T01:22:29.899 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../090-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2022-01-10T01:22:29.905 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2022-01-10T01:22:29.938 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2022-01-10T01:22:30.093 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-html5lib. 2022-01-10T01:22:30.113 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2022-01-10T01:22:30.150 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2022-01-10T01:22:30.225 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-html5lib. 2022-01-10T01:22:30.243 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2022-01-10T01:22:30.257 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-html5lib. 2022-01-10T01:22:30.280 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../091-python3-html5lib_1.0.1-2_all.deb ... 2022-01-10T01:22:30.282 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2022-01-10T01:22:30.324 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2022-01-10T01:22:30.351 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-packaging. 2022-01-10T01:22:30.375 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2022-01-10T01:22:30.417 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-packaging (20.3-1) ... 2022-01-10T01:22:30.445 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-lxml:amd64. 2022-01-10T01:22:30.468 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2022-01-10T01:22:30.537 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2022-01-10T01:22:30.644 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-lxml:amd64. 2022-01-10T01:22:30.652 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-lxml:amd64. 2022-01-10T01:22:30.667 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2022-01-10T01:22:30.674 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../092-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2022-01-10T01:22:30.718 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2022-01-10T01:22:30.727 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2022-01-10T01:22:30.761 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pastescript. 2022-01-10T01:22:30.781 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2022-01-10T01:22:30.828 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2022-01-10T01:22:30.982 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-packaging. 2022-01-10T01:22:31.004 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2022-01-10T01:22:31.049 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-packaging (20.3-1) ... 2022-01-10T01:22:31.149 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pluggy. 2022-01-10T01:22:31.164 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-packaging. 2022-01-10T01:22:31.169 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2022-01-10T01:22:31.185 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2022-01-10T01:22:31.197 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-packaging. 2022-01-10T01:22:31.207 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2022-01-10T01:22:31.213 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-packaging (20.3-1) ... 2022-01-10T01:22:31.218 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../093-python3-packaging_20.3-1_all.deb ... 2022-01-10T01:22:31.255 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-packaging (20.3-1) ... 2022-01-10T01:22:31.378 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pastescript. 2022-01-10T01:22:31.397 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2022-01-10T01:22:31.434 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2022-01-10T01:22:31.516 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pastescript. 2022-01-10T01:22:31.518 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-psutil. 2022-01-10T01:22:31.538 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2022-01-10T01:22:31.539 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2022-01-10T01:22:31.577 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2022-01-10T01:22:31.591 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-pastescript. 2022-01-10T01:22:31.611 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../094-python3-pastescript_2.0.2-4_all.deb ... 2022-01-10T01:22:31.616 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2022-01-10T01:22:31.649 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2022-01-10T01:22:31.797 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pluggy. 2022-01-10T01:22:31.817 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2022-01-10T01:22:31.863 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2022-01-10T01:22:31.928 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pluggy. 2022-01-10T01:22:31.937 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-py. 2022-01-10T01:22:31.948 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2022-01-10T01:22:31.959 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2022-01-10T01:22:31.970 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-pluggy. 2022-01-10T01:22:31.986 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2022-01-10T01:22:31.993 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../095-python3-pluggy_0.13.0-2_all.deb ... 2022-01-10T01:22:31.995 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2022-01-10T01:22:32.069 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2022-01-10T01:22:32.225 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-psutil. 2022-01-10T01:22:32.247 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2022-01-10T01:22:32.291 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyinotify. 2022-01-10T01:22:32.291 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2022-01-10T01:22:32.313 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2022-01-10T01:22:32.331 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-psutil. 2022-01-10T01:22:32.348 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2022-01-10T01:22:32.350 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2022-01-10T01:22:32.389 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2022-01-10T01:22:32.391 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-psutil. 2022-01-10T01:22:32.411 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../096-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2022-01-10T01:22:32.449 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2022-01-10T01:22:32.635 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pytest. 2022-01-10T01:22:32.659 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2022-01-10T01:22:32.661 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-py. 2022-01-10T01:22:32.681 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2022-01-10T01:22:32.702 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pytest (4.6.9-1) ... 2022-01-10T01:22:32.719 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2022-01-10T01:22:32.751 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-py. 2022-01-10T01:22:32.773 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2022-01-10T01:22:32.811 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-py. 2022-01-10T01:22:32.817 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2022-01-10T01:22:32.830 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../097-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2022-01-10T01:22:32.869 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2022-01-10T01:22:33.070 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-simplejson. 2022-01-10T01:22:33.089 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pyinotify. 2022-01-10T01:22:33.090 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2022-01-10T01:22:33.112 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2022-01-10T01:22:33.128 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2022-01-10T01:22:33.164 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2022-01-10T01:22:33.205 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-pyinotify. 2022-01-10T01:22:33.226 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2022-01-10T01:22:33.263 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2022-01-10T01:22:33.296 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pyinotify. 2022-01-10T01:22:33.315 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../098-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2022-01-10T01:22:33.353 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2022-01-10T01:22:33.484 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-pytest. 2022-01-10T01:22:33.507 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2022-01-10T01:22:33.550 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-pytest (4.6.9-1) ... 2022-01-10T01:22:33.590 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package radosgw. 2022-01-10T01:22:33.600 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-pytest. 2022-01-10T01:22:33.612 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../101-radosgw_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:33.621 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2022-01-10T01:22:33.657 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking radosgw (15.2.14-1focal) ... 2022-01-10T01:22:33.666 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-pytest (4.6.9-1) ... 2022-01-10T01:22:33.715 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-pytest. 2022-01-10T01:22:33.734 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../099-python3-pytest_4.6.9-1_all.deb ... 2022-01-10T01:22:33.773 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-pytest (4.6.9-1) ... 2022-01-10T01:22:33.932 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package python3-simplejson. 2022-01-10T01:22:33.956 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2022-01-10T01:22:34.010 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2022-01-10T01:22:34.020 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package python3-simplejson. 2022-01-10T01:22:34.042 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2022-01-10T01:22:34.100 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2022-01-10T01:22:34.169 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package python3-simplejson. 2022-01-10T01:22:34.189 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../100-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2022-01-10T01:22:34.227 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2022-01-10T01:22:34.498 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package radosgw. 2022-01-10T01:22:34.518 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../101-radosgw_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:34.538 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package radosgw. 2022-01-10T01:22:34.559 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../101-radosgw_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:34.564 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking radosgw (15.2.14-1focal) ... 2022-01-10T01:22:34.622 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking radosgw (15.2.14-1focal) ... 2022-01-10T01:22:34.687 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package radosgw. 2022-01-10T01:22:34.706 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../101-radosgw_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:34.753 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking radosgw (15.2.14-1focal) ... 2022-01-10T01:22:34.852 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package rbd-fuse. 2022-01-10T01:22:34.872 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../102-rbd-fuse_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:34.910 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking rbd-fuse (15.2.14-1focal) ... 2022-01-10T01:22:35.221 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-attr (19.3.0-2) ... 2022-01-10T01:22:35.557 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2022-01-10T01:22:35.682 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2022-01-10T01:22:35.701 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package rbd-fuse. 2022-01-10T01:22:35.709 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package rbd-fuse. 2022-01-10T01:22:35.724 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../102-rbd-fuse_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:35.729 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../102-rbd-fuse_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:35.767 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking rbd-fuse (15.2.14-1focal) ... 2022-01-10T01:22:35.768 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking rbd-fuse (15.2.14-1focal) ... 2022-01-10T01:22:35.817 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2022-01-10T01:22:35.841 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package rbd-fuse. 2022-01-10T01:22:35.860 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../102-rbd-fuse_15.2.14-1focal_amd64.deb ... 2022-01-10T01:22:35.932 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking rbd-fuse (15.2.14-1focal) ... 2022-01-10T01:22:36.051 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up cephadm (15.2.14-1focal) ... 2022-01-10T01:22:36.074 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-attr (19.3.0-2) ... 2022-01-10T01:22:36.113 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-attr (19.3.0-2) ... 2022-01-10T01:22:36.243 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-attr (19.3.0-2) ... 2022-01-10T01:22:36.405 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2022-01-10T01:22:36.447 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2022-01-10T01:22:36.523 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2022-01-10T01:22:36.573 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2022-01-10T01:22:36.578 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2022-01-10T01:22:36.674 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2022-01-10T01:22:36.699 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2022-01-10T01:22:36.704 INFO:teuthology.orchestra.run.smithi059.stdout:Adding system user cephadm....done 2022-01-10T01:22:36.713 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2022-01-10T01:22:36.866 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-waitress (1.4.1-1) ... 2022-01-10T01:22:36.867 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up cephadm (15.2.14-1focal) ... 2022-01-10T01:22:36.889 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2022-01-10T01:22:36.917 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up cephadm (15.2.14-1focal) ... 2022-01-10T01:22:37.090 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up cephadm (15.2.14-1focal) ... 2022-01-10T01:22:37.226 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-repoze.lru (0.7-2) ... 2022-01-10T01:22:37.496 INFO:teuthology.orchestra.run.smithi166.stdout:Adding system user cephadm....done 2022-01-10T01:22:37.503 INFO:teuthology.orchestra.run.smithi036.stdout:Adding system user cephadm....done 2022-01-10T01:22:37.560 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liboath0 (2.6.1-1.3) ... 2022-01-10T01:22:37.640 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-waitress (1.4.1-1) ... 2022-01-10T01:22:37.686 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2022-01-10T01:22:37.732 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-waitress (1.4.1-1) ... 2022-01-10T01:22:37.777 INFO:teuthology.orchestra.run.smithi139.stdout:Adding system user cephadm....done 2022-01-10T01:22:37.938 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-waitress (1.4.1-1) ... 2022-01-10T01:22:38.004 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-joblib (0.14.0-3) ... 2022-01-10T01:22:38.025 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-repoze.lru (0.7-2) ... 2022-01-10T01:22:38.075 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-repoze.lru (0.7-2) ... 2022-01-10T01:22:38.301 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up liboath0 (2.6.1-1.3) ... 2022-01-10T01:22:38.306 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-repoze.lru (0.7-2) ... 2022-01-10T01:22:38.401 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up liboath0 (2.6.1-1.3) ... 2022-01-10T01:22:38.423 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2022-01-10T01:22:38.427 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2022-01-10T01:22:38.502 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2022-01-10T01:22:38.724 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cachetools (4.0.0-1) ... 2022-01-10T01:22:38.754 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-joblib (0.14.0-3) ... 2022-01-10T01:22:38.812 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-joblib (0.14.0-3) ... 2022-01-10T01:22:38.866 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liboath0 (2.6.1-1.3) ... 2022-01-10T01:22:38.992 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2022-01-10T01:22:39.051 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2022-01-10T01:22:39.189 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2022-01-10T01:22:39.221 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2022-01-10T01:22:39.344 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-joblib (0.14.0-3) ... 2022-01-10T01:22:39.368 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2022-01-10T01:22:39.506 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cachetools (4.0.0-1) ... 2022-01-10T01:22:39.523 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-cachetools (4.0.0-1) ... 2022-01-10T01:22:39.686 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2022-01-10T01:22:39.737 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2022-01-10T01:22:39.807 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2022-01-10T01:22:39.825 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2022-01-10T01:22:39.970 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-ceph-argparse (15.2.14-1focal) ... 2022-01-10T01:22:40.063 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cachetools (4.0.0-1) ... 2022-01-10T01:22:40.109 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2022-01-10T01:22:40.117 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2022-01-10T01:22:40.271 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:40.356 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2022-01-10T01:22:40.385 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2022-01-10T01:22:40.401 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2022-01-10T01:22:40.414 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2022-01-10T01:22:40.649 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2022-01-10T01:22:40.669 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-ceph-argparse (15.2.14-1focal) ... 2022-01-10T01:22:40.678 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-ceph-argparse (15.2.14-1focal) ... 2022-01-10T01:22:40.715 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2022-01-10T01:22:40.950 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2022-01-10T01:22:40.970 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:41.020 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:41.024 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2022-01-10T01:22:41.071 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2022-01-10T01:22:41.147 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2022-01-10T01:22:41.235 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-ceph-argparse (15.2.14-1focal) ... 2022-01-10T01:22:41.309 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2022-01-10T01:22:41.364 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2022-01-10T01:22:41.448 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2022-01-10T01:22:41.527 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:41.653 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2022-01-10T01:22:41.657 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2022-01-10T01:22:41.727 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2022-01-10T01:22:41.740 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2022-01-10T01:22:41.963 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2022-01-10T01:22:41.966 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2022-01-10T01:22:42.003 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2022-01-10T01:22:42.058 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2022-01-10T01:22:42.255 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2022-01-10T01:22:42.346 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2022-01-10T01:22:42.359 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2022-01-10T01:22:42.435 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2022-01-10T01:22:42.540 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2022-01-10T01:22:42.627 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2022-01-10T01:22:42.647 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2022-01-10T01:22:42.719 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2022-01-10T01:22:42.924 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2022-01-10T01:22:42.953 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2022-01-10T01:22:43.095 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2022-01-10T01:22:43.131 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-tempita (0.5.2-6) ... 2022-01-10T01:22:43.213 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2022-01-10T01:22:43.217 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2022-01-10T01:22:43.380 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2022-01-10T01:22:43.433 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-packaging (20.3-1) ... 2022-01-10T01:22:43.577 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2022-01-10T01:22:43.681 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-tempita (0.5.2-6) ... 2022-01-10T01:22:43.731 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-tempita (0.5.2-6) ... 2022-01-10T01:22:43.751 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2022-01-10T01:22:43.895 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2022-01-10T01:22:43.901 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2022-01-10T01:22:43.990 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-packaging (20.3-1) ... 2022-01-10T01:22:44.049 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-packaging (20.3-1) ... 2022-01-10T01:22:44.219 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2022-01-10T01:22:44.254 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-tempita (0.5.2-6) ... 2022-01-10T01:22:44.300 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2022-01-10T01:22:44.375 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2022-01-10T01:22:44.409 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2022-01-10T01:22:44.501 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2022-01-10T01:22:44.547 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-packaging (20.3-1) ... 2022-01-10T01:22:44.629 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2022-01-10T01:22:44.702 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2022-01-10T01:22:44.786 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2022-01-10T01:22:44.856 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2022-01-10T01:22:44.982 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2022-01-10T01:22:44.999 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2022-01-10T01:22:45.111 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2022-01-10T01:22:45.212 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2022-01-10T01:22:45.301 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2022-01-10T01:22:45.350 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2022-01-10T01:22:45.446 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2022-01-10T01:22:45.530 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2022-01-10T01:22:45.719 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2022-01-10T01:22:45.727 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up socat (1.7.3.3-2) ... 2022-01-10T01:22:45.831 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2022-01-10T01:22:45.853 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-ceph-common (15.2.14-1focal) ... 2022-01-10T01:22:45.915 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2022-01-10T01:22:46.045 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2022-01-10T01:22:46.171 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-html5lib (1.0.1-2) ... 2022-01-10T01:22:46.233 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up socat (1.7.3.3-2) ... 2022-01-10T01:22:46.300 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up socat (1.7.3.3-2) ... 2022-01-10T01:22:46.342 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-ceph-common (15.2.14-1focal) ... 2022-01-10T01:22:46.413 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2022-01-10T01:22:46.460 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-ceph-common (15.2.14-1focal) ... 2022-01-10T01:22:46.506 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2022-01-10T01:22:46.632 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pluggy (0.13.0-2) ... 2022-01-10T01:22:46.652 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-html5lib (1.0.1-2) ... 2022-01-10T01:22:46.770 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-html5lib (1.0.1-2) ... 2022-01-10T01:22:46.782 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up socat (1.7.3.3-2) ... 2022-01-10T01:22:46.908 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-ceph-common (15.2.14-1focal) ... 2022-01-10T01:22:46.926 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2022-01-10T01:22:47.020 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2022-01-10T01:22:47.061 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2022-01-10T01:22:47.121 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2022-01-10T01:22:47.154 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pluggy (0.13.0-2) ... 2022-01-10T01:22:47.218 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-html5lib (1.0.1-2) ... 2022-01-10T01:22:47.247 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-pluggy (0.13.0-2) ... 2022-01-10T01:22:47.380 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2022-01-10T01:22:47.464 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2022-01-10T01:22:47.548 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2022-01-10T01:22:47.577 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2022-01-10T01:22:47.589 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2022-01-10T01:22:47.664 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-logutils (0.3.3-7) ... 2022-01-10T01:22:47.708 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2022-01-10T01:22:47.720 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pluggy (0.13.0-2) ... 2022-01-10T01:22:47.933 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2022-01-10T01:22:47.965 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2022-01-10T01:22:48.021 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2022-01-10T01:22:48.034 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2022-01-10T01:22:48.100 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2022-01-10T01:22:48.172 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2022-01-10T01:22:48.229 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-logutils (0.3.3-7) ... 2022-01-10T01:22:48.319 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-logutils (0.3.3-7) ... 2022-01-10T01:22:48.392 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-prettytable (0.7.2-5) ... 2022-01-10T01:22:48.490 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2022-01-10T01:22:48.522 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2022-01-10T01:22:48.613 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2022-01-10T01:22:48.673 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2022-01-10T01:22:48.739 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2022-01-10T01:22:48.743 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2022-01-10T01:22:48.799 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-logutils (0.3.3-7) ... 2022-01-10T01:22:48.957 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-prettytable (0.7.2-5) ... 2022-01-10T01:22:49.032 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-prettytable (0.7.2-5) ... 2022-01-10T01:22:49.044 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2022-01-10T01:22:49.103 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2022-01-10T01:22:49.229 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2022-01-10T01:22:49.267 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2022-01-10T01:22:49.350 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2022-01-10T01:22:49.467 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2022-01-10T01:22:49.532 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-prettytable (0.7.2-5) ... 2022-01-10T01:22:49.584 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2022-01-10T01:22:49.643 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2022-01-10T01:22:49.734 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2022-01-10T01:22:49.831 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2022-01-10T01:22:49.887 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2022-01-10T01:22:49.948 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2022-01-10T01:22:50.104 INFO:teuthology.orchestra.run.smithi166.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2022-01-10T01:22:50.132 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2022-01-10T01:22:50.187 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2022-01-10T01:22:50.217 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2022-01-10T01:22:50.314 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2022-01-10T01:22:50.353 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2022-01-10T01:22:50.499 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2022-01-10T01:22:50.504 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2022-01-10T01:22:50.565 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2022-01-10T01:22:50.676 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2022-01-10T01:22:50.692 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2022-01-10T01:22:50.777 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2022-01-10T01:22:50.814 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-webob (1:1.8.5-2) ... 2022-01-10T01:22:50.857 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2022-01-10T01:22:50.944 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2022-01-10T01:22:51.064 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2022-01-10T01:22:51.165 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2022-01-10T01:22:51.195 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2022-01-10T01:22:51.228 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2022-01-10T01:22:51.272 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2022-01-10T01:22:51.330 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-webob (1:1.8.5-2) ... 2022-01-10T01:22:51.357 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2022-01-10T01:22:51.450 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librados2 (15.2.14-1focal) ... 2022-01-10T01:22:51.480 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-webob (1:1.8.5-2) ... 2022-01-10T01:22:51.584 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2022-01-10T01:22:51.626 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2022-01-10T01:22:51.684 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2022-01-10T01:22:51.755 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2022-01-10T01:22:51.832 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2022-01-10T01:22:51.911 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-webob (1:1.8.5-2) ... 2022-01-10T01:22:52.014 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librados2 (15.2.14-1focal) ... 2022-01-10T01:22:52.130 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up librados2 (15.2.14-1focal) ... 2022-01-10T01:22:52.140 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2022-01-10T01:22:52.246 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2022-01-10T01:22:52.257 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2022-01-10T01:22:52.563 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librados2 (15.2.14-1focal) ... 2022-01-10T01:22:52.690 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2022-01-10T01:22:53.181 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librgw2 (15.2.14-1focal) ... 2022-01-10T01:22:53.335 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:53.486 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pytest (4.6.9-1) ... 2022-01-10T01:22:53.654 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librgw2 (15.2.14-1focal) ... 2022-01-10T01:22:53.780 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:53.862 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2022-01-10T01:22:53.906 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pytest (4.6.9-1) ... 2022-01-10T01:22:54.165 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up librgw2 (15.2.14-1focal) ... 2022-01-10T01:22:54.172 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2022-01-10T01:22:54.179 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librgw2 (15.2.14-1focal) ... 2022-01-10T01:22:54.293 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2022-01-10T01:22:54.305 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:54.339 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:54.431 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pytest (4.6.9-1) ... 2022-01-10T01:22:54.456 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-bs4 (4.8.2-1) ... 2022-01-10T01:22:54.481 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-pytest (4.6.9-1) ... 2022-01-10T01:22:54.611 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2022-01-10T01:22:54.791 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libcephfs2 (15.2.14-1focal) ... 2022-01-10T01:22:54.815 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2022-01-10T01:22:54.857 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2022-01-10T01:22:54.912 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-bs4 (4.8.2-1) ... 2022-01-10T01:22:54.926 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2022-01-10T01:22:55.119 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2022-01-10T01:22:55.170 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2022-01-10T01:22:55.244 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libradosstriper1 (15.2.14-1focal) ... 2022-01-10T01:22:55.281 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libcephfs2 (15.2.14-1focal) ... 2022-01-10T01:22:55.379 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2022-01-10T01:22:55.406 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2022-01-10T01:22:55.421 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-bs4 (4.8.2-1) ... 2022-01-10T01:22:55.504 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-bs4 (4.8.2-1) ... 2022-01-10T01:22:55.705 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:55.758 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libradosstriper1 (15.2.14-1focal) ... 2022-01-10T01:22:55.763 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libcephfs2 (15.2.14-1focal) ... 2022-01-10T01:22:55.856 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libcephfs2 (15.2.14-1focal) ... 2022-01-10T01:22:55.890 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2022-01-10T01:22:55.901 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2022-01-10T01:22:55.982 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2022-01-10T01:22:56.250 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libradosstriper1 (15.2.14-1focal) ... 2022-01-10T01:22:56.269 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:56.309 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libradosstriper1 (15.2.14-1focal) ... 2022-01-10T01:22:56.376 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2022-01-10T01:22:56.435 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2022-01-10T01:22:56.727 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:56.794 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2022-01-10T01:22:56.803 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librbd1 (15.2.14-1focal) ... 2022-01-10T01:22:56.929 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2022-01-10T01:22:57.055 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2022-01-10T01:22:57.181 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2022-01-10T01:22:57.368 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up librbd1 (15.2.14-1focal) ... 2022-01-10T01:22:57.508 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:57.527 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2022-01-10T01:22:57.642 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rsa (4.0-3) ... 2022-01-10T01:22:57.661 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2022-01-10T01:22:57.758 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up librbd1 (15.2.14-1focal) ... 2022-01-10T01:22:57.787 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2022-01-10T01:22:57.827 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up librbd1 (15.2.14-1focal) ... 2022-01-10T01:22:57.902 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2022-01-10T01:22:57.935 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-webtest (2.0.32-2) ... 2022-01-10T01:22:57.952 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2022-01-10T01:22:58.028 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2022-01-10T01:22:58.070 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2022-01-10T01:22:58.114 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:58.162 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2022-01-10T01:22:58.171 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2022-01-10T01:22:58.240 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-rsa (4.0-3) ... 2022-01-10T01:22:58.253 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-modules-core (15.2.14-1focal) ... 2022-01-10T01:22:58.388 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-fuse (15.2.14-1focal) ... 2022-01-10T01:22:58.473 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:58.489 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2022-01-10T01:22:58.541 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-webtest (2.0.32-2) ... 2022-01-10T01:22:58.598 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-rsa (4.0-3) ... 2022-01-10T01:22:58.613 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2022-01-10T01:22:58.613 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2022-01-10T01:22:58.614 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rsa (4.0-3) ... 2022-01-10T01:22:58.859 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-modules-core (15.2.14-1focal) ... 2022-01-10T01:22:58.900 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-webtest (2.0.32-2) ... 2022-01-10T01:22:58.907 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-webtest (2.0.32-2) ... 2022-01-10T01:22:59.018 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-fuse (15.2.14-1focal) ... 2022-01-10T01:22:59.048 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libcephfs-dev (15.2.14-1focal) ... 2022-01-10T01:22:59.209 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph-mgr-modules-core (15.2.14-1focal) ... 2022-01-10T01:22:59.216 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2022-01-10T01:22:59.225 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-modules-core (15.2.14-1focal) ... 2022-01-10T01:22:59.254 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2022-01-10T01:22:59.254 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2022-01-10T01:22:59.351 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-fuse (15.2.14-1focal) ... 2022-01-10T01:22:59.360 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph-fuse (15.2.14-1focal) ... 2022-01-10T01:22:59.573 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2022-01-10T01:22:59.573 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2022-01-10T01:22:59.587 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2022-01-10T01:22:59.588 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2022-01-10T01:22:59.703 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libcephfs-dev (15.2.14-1focal) ... 2022-01-10T01:22:59.818 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pastescript (2.0.2-4) ... 2022-01-10T01:22:59.830 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2022-01-10T01:23:00.036 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libcephfs-dev (15.2.14-1focal) ... 2022-01-10T01:23:00.053 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libcephfs-dev (15.2.14-1focal) ... 2022-01-10T01:23:00.106 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pastescript (2.0.2-4) ... 2022-01-10T01:23:00.144 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2022-01-10T01:23:00.154 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2022-01-10T01:23:00.246 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2022-01-10T01:23:00.391 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2022-01-10T01:23:00.440 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-pastescript (2.0.2-4) ... 2022-01-10T01:23:00.515 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rados (15.2.14-1focal) ... 2022-01-10T01:23:00.523 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pastescript (2.0.2-4) ... 2022-01-10T01:23:00.659 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rbd (15.2.14-1focal) ... 2022-01-10T01:23:00.718 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-rados (15.2.14-1focal) ... 2022-01-10T01:23:00.750 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2022-01-10T01:23:00.785 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up rbd-fuse (15.2.14-1focal) ... 2022-01-10T01:23:00.847 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-rbd (15.2.14-1focal) ... 2022-01-10T01:23:00.920 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-routes (2.4.1-2) ... 2022-01-10T01:23:00.959 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2022-01-10T01:23:00.970 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up rbd-fuse (15.2.14-1focal) ... 2022-01-10T01:23:01.123 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-routes (2.4.1-2) ... 2022-01-10T01:23:01.127 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-rados (15.2.14-1focal) ... 2022-01-10T01:23:01.253 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-rbd (15.2.14-1focal) ... 2022-01-10T01:23:01.305 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-google-auth (1.5.1-2) ... 2022-01-10T01:23:01.311 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rados (15.2.14-1focal) ... 2022-01-10T01:23:01.379 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up rbd-fuse (15.2.14-1focal) ... 2022-01-10T01:23:01.446 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rbd (15.2.14-1focal) ... 2022-01-10T01:23:01.480 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-routes (2.4.1-2) ... 2022-01-10T01:23:01.510 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-google-auth (1.5.1-2) ... 2022-01-10T01:23:01.571 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up rbd-fuse (15.2.14-1focal) ... 2022-01-10T01:23:01.615 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rgw (15.2.14-1focal) ... 2022-01-10T01:23:01.722 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-routes (2.4.1-2) ... 2022-01-10T01:23:01.749 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cephfs (15.2.14-1focal) ... 2022-01-10T01:23:01.812 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-rgw (15.2.14-1focal) ... 2022-01-10T01:23:01.853 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-google-auth (1.5.1-2) ... 2022-01-10T01:23:01.963 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-cephfs (15.2.14-1focal) ... 2022-01-10T01:23:02.084 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up cephfs-shell (15.2.14-1focal) ... 2022-01-10T01:23:02.136 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-google-auth (1.5.1-2) ... 2022-01-10T01:23:02.187 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-rgw (15.2.14-1focal) ... 2022-01-10T01:23:02.210 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2022-01-10T01:23:02.264 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up cephfs-shell (15.2.14-1focal) ... 2022-01-10T01:23:02.313 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-cephfs (15.2.14-1focal) ... 2022-01-10T01:23:02.381 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2022-01-10T01:23:02.455 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-rgw (15.2.14-1focal) ... 2022-01-10T01:23:02.598 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-cephfs (15.2.14-1focal) ... 2022-01-10T01:23:02.623 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up cephfs-shell (15.2.14-1focal) ... 2022-01-10T01:23:02.749 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2022-01-10T01:23:02.890 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up cephfs-shell (15.2.14-1focal) ... 2022-01-10T01:23:03.016 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2022-01-10T01:23:03.155 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-common (15.2.14-1focal) ... 2022-01-10T01:23:03.318 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-common (15.2.14-1focal) ... 2022-01-10T01:23:03.660 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph-common (15.2.14-1focal) ... 2022-01-10T01:23:03.783 INFO:teuthology.orchestra.run.smithi059.stdout:Adding group ceph....done 2022-01-10T01:23:03.896 INFO:teuthology.orchestra.run.smithi036.stdout:Adding group ceph....done 2022-01-10T01:23:03.944 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-common (15.2.14-1focal) ... 2022-01-10T01:23:04.212 INFO:teuthology.orchestra.run.smithi166.stdout:Adding group ceph....done 2022-01-10T01:23:04.226 INFO:teuthology.orchestra.run.smithi059.stdout:Adding system user ceph....done 2022-01-10T01:23:04.272 INFO:teuthology.orchestra.run.smithi036.stdout:Adding system user ceph....done 2022-01-10T01:23:04.419 INFO:teuthology.orchestra.run.smithi059.stdout:Setting system user ceph properties....done 2022-01-10T01:23:04.443 INFO:teuthology.orchestra.run.smithi059.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2022-01-10T01:23:04.449 INFO:teuthology.orchestra.run.smithi036.stdout:Setting system user ceph properties....done 2022-01-10T01:23:04.473 INFO:teuthology.orchestra.run.smithi036.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2022-01-10T01:23:04.556 INFO:teuthology.orchestra.run.smithi139.stdout:Adding group ceph....done 2022-01-10T01:23:04.588 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2022-01-10T01:23:04.625 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2022-01-10T01:23:04.631 INFO:teuthology.orchestra.run.smithi166.stdout:Adding system user ceph....done 2022-01-10T01:23:04.808 INFO:teuthology.orchestra.run.smithi166.stdout:Setting system user ceph properties....done 2022-01-10T01:23:04.832 INFO:teuthology.orchestra.run.smithi166.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2022-01-10T01:23:04.892 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2022-01-10T01:23:04.949 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2022-01-10T01:23:04.957 INFO:teuthology.orchestra.run.smithi139.stdout:Adding system user ceph....done 2022-01-10T01:23:04.972 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2022-01-10T01:23:05.151 INFO:teuthology.orchestra.run.smithi139.stdout:Setting system user ceph properties....done 2022-01-10T01:23:05.171 INFO:teuthology.orchestra.run.smithi139.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2022-01-10T01:23:05.287 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2022-01-10T01:23:05.315 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2022-01-10T01:23:05.373 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-test (15.2.14-1focal) ... 2022-01-10T01:23:05.411 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-test (15.2.14-1focal) ... 2022-01-10T01:23:05.474 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up radosgw (15.2.14-1focal) ... 2022-01-10T01:23:05.537 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up radosgw (15.2.14-1focal) ... 2022-01-10T01:23:05.630 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2022-01-10T01:23:05.723 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2022-01-10T01:23:05.724 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2022-01-10T01:23:05.763 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph-test (15.2.14-1focal) ... 2022-01-10T01:23:05.808 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2022-01-10T01:23:05.809 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2022-01-10T01:23:05.897 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up radosgw (15.2.14-1focal) ... 2022-01-10T01:23:06.089 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-test (15.2.14-1focal) ... 2022-01-10T01:23:06.200 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2022-01-10T01:23:06.200 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2022-01-10T01:23:06.214 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up radosgw (15.2.14-1focal) ... 2022-01-10T01:23:06.393 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-base (15.2.14-1focal) ... 2022-01-10T01:23:06.473 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-base (15.2.14-1focal) ... 2022-01-10T01:23:06.485 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2022-01-10T01:23:06.485 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2022-01-10T01:23:06.763 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2022-01-10T01:23:06.843 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2022-01-10T01:23:06.857 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph-base (15.2.14-1focal) ... 2022-01-10T01:23:07.133 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-base (15.2.14-1focal) ... 2022-01-10T01:23:07.210 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2022-01-10T01:23:07.211 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mds (15.2.14-1focal) ... 2022-01-10T01:23:07.299 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mds (15.2.14-1focal) ... 2022-01-10T01:23:07.440 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2022-01-10T01:23:07.441 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2022-01-10T01:23:07.471 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2022-01-10T01:23:07.546 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2022-01-10T01:23:07.546 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2022-01-10T01:23:07.675 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph-mds (15.2.14-1focal) ... 2022-01-10T01:23:07.838 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr (15.2.14-1focal) ... 2022-01-10T01:23:07.898 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2022-01-10T01:23:07.898 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2022-01-10T01:23:07.943 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mds (15.2.14-1focal) ... 2022-01-10T01:23:07.984 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr (15.2.14-1focal) ... 2022-01-10T01:23:08.070 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2022-01-10T01:23:08.071 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2022-01-10T01:23:08.168 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2022-01-10T01:23:08.169 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2022-01-10T01:23:08.212 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2022-01-10T01:23:08.212 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2022-01-10T01:23:08.327 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph-mgr (15.2.14-1focal) ... 2022-01-10T01:23:08.532 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-1focal) ... 2022-01-10T01:23:08.565 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2022-01-10T01:23:08.565 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2022-01-10T01:23:08.612 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr (15.2.14-1focal) ... 2022-01-10T01:23:08.660 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-1focal) ... 2022-01-10T01:23:08.691 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-osd (15.2.14-1focal) ... 2022-01-10T01:23:08.803 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-osd (15.2.14-1focal) ... 2022-01-10T01:23:08.871 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2022-01-10T01:23:08.871 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2022-01-10T01:23:09.003 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-1focal) ... 2022-01-10T01:23:09.171 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph-osd (15.2.14-1focal) ... 2022-01-10T01:23:09.270 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2022-01-10T01:23:09.271 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2022-01-10T01:23:09.605 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2022-01-10T01:23:09.606 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2022-01-10T01:23:09.677 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-k8sevents (15.2.14-1focal) ... 2022-01-10T01:23:09.707 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2022-01-10T01:23:09.707 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2022-01-10T01:23:09.803 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-1focal) ... 2022-01-10T01:23:09.821 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.14-1focal) ... 2022-01-10T01:23:09.971 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mon (15.2.14-1focal) ... 2022-01-10T01:23:10.048 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-osd (15.2.14-1focal) ... 2022-01-10T01:23:10.065 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-k8sevents (15.2.14-1focal) ... 2022-01-10T01:23:10.183 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph-mgr-k8sevents (15.2.14-1focal) ... 2022-01-10T01:23:10.191 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-1focal) ... 2022-01-10T01:23:10.200 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2022-01-10T01:23:10.200 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2022-01-10T01:23:10.325 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-1focal) ... 2022-01-10T01:23:10.333 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mon (15.2.14-1focal) ... 2022-01-10T01:23:10.468 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph-mon (15.2.14-1focal) ... 2022-01-10T01:23:10.603 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2022-01-10T01:23:10.603 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2022-01-10T01:23:10.606 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2022-01-10T01:23:10.606 INFO:teuthology.orchestra.run.smithi036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2022-01-10T01:23:10.630 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-cephadm (15.2.14-1focal) ... 2022-01-10T01:23:10.697 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2022-01-10T01:23:10.698 INFO:teuthology.orchestra.run.smithi166.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2022-01-10T01:23:10.774 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph (15.2.14-1focal) ... 2022-01-10T01:23:10.906 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-dashboard (15.2.14-1focal) ... 2022-01-10T01:23:11.059 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-k8sevents (15.2.14-1focal) ... 2022-01-10T01:23:11.060 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-cephadm (15.2.14-1focal) ... 2022-01-10T01:23:11.081 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2022-01-10T01:23:11.161 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph-mgr-cephadm (15.2.14-1focal) ... 2022-01-10T01:23:11.210 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-diskprediction-local (15.2.14-1focal) ... 2022-01-10T01:23:11.215 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph (15.2.14-1focal) ... 2022-01-10T01:23:11.304 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph (15.2.14-1focal) ... 2022-01-10T01:23:11.340 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for man-db (2.9.1-1) ... 2022-01-10T01:23:11.345 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up ceph-mgr-dashboard (15.2.14-1focal) ... 2022-01-10T01:23:11.353 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mon (15.2.14-1focal) ... 2022-01-10T01:23:11.446 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up ceph-mgr-dashboard (15.2.14-1focal) ... 2022-01-10T01:23:11.489 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2022-01-10T01:23:11.565 INFO:teuthology.orchestra.run.smithi166.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2022-01-10T01:23:11.576 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2022-01-10T01:23:11.577 INFO:teuthology.orchestra.run.smithi139.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2022-01-10T01:23:11.773 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for man-db (2.9.1-1) ... 2022-01-10T01:23:11.841 INFO:teuthology.orchestra.run.smithi166.stdout:Processing triggers for man-db (2.9.1-1) ... 2022-01-10T01:23:12.029 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-cephadm (15.2.14-1focal) ... 2022-01-10T01:23:12.197 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph (15.2.14-1focal) ... 2022-01-10T01:23:12.323 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up ceph-mgr-dashboard (15.2.14-1focal) ... 2022-01-10T01:23:12.467 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for systemd (245.4-4ubuntu3.13) ... 2022-01-10T01:23:12.759 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for man-db (2.9.1-1) ... 2022-01-10T01:23:14.242 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2022-01-10T01:23:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2022-01-10T01:23:14.679 DEBUG:teuthology.orchestra.run.smithi059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2022-01-10T01:23:14.748 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2022-01-10T01:23:14.864 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2022-01-10T01:23:14.900 INFO:teuthology.orchestra.run.smithi166.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2022-01-10T01:23:14.928 INFO:teuthology.orchestra.run.smithi059.stdout:Building dependency tree... 2022-01-10T01:23:14.928 INFO:teuthology.orchestra.run.smithi059.stdout:Reading state information... 2022-01-10T01:23:15.082 INFO:teuthology.orchestra.run.smithi059.stdout:libtool-bin is already the newest version (2.4.6-14). 2022-01-10T01:23:15.083 INFO:teuthology.orchestra.run.smithi059.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2022-01-10T01:23:15.083 INFO:teuthology.orchestra.run.smithi059.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2022-01-10T01:23:15.083 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages were automatically installed and are no longer required: 2022-01-10T01:23:15.084 INFO:teuthology.orchestra.run.smithi059.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2022-01-10T01:23:15.084 INFO:teuthology.orchestra.run.smithi059.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2022-01-10T01:23:15.084 INFO:teuthology.orchestra.run.smithi059.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2022-01-10T01:23:15.085 INFO:teuthology.orchestra.run.smithi059.stdout: linux-modules-extra-5.4.0-66-generic 2022-01-10T01:23:15.085 INFO:teuthology.orchestra.run.smithi059.stdout:Use 'sudo apt autoremove' to remove them. 2022-01-10T01:23:15.085 INFO:teuthology.orchestra.run.smithi059.stdout:The following additional packages will be installed: 2022-01-10T01:23:15.086 INFO:teuthology.orchestra.run.smithi059.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2022-01-10T01:23:15.086 INFO:teuthology.orchestra.run.smithi059.stdout:Suggested packages: 2022-01-10T01:23:15.086 INFO:teuthology.orchestra.run.smithi059.stdout: bison-doc flex-doc indent-doc libssl-doc 2022-01-10T01:23:15.119 INFO:teuthology.orchestra.run.smithi059.stdout:The following NEW packages will be installed: 2022-01-10T01:23:15.119 INFO:teuthology.orchestra.run.smithi059.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2022-01-10T01:23:15.120 INFO:teuthology.orchestra.run.smithi059.stdout: libssl-dev 2022-01-10T01:23:15.120 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages will be upgraded: 2022-01-10T01:23:15.121 INFO:teuthology.orchestra.run.smithi059.stdout: libssl1.1 2022-01-10T01:23:15.289 INFO:teuthology.orchestra.run.smithi036.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2022-01-10T01:23:15.292 DEBUG:teuthology.orchestra.run.smithi036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2022-01-10T01:23:15.312 INFO:teuthology.orchestra.run.smithi059.stdout:1 upgraded, 10 newly installed, 0 to remove and 82 not upgraded. 2022-01-10T01:23:15.312 INFO:teuthology.orchestra.run.smithi059.stdout:Need to get 4,235 kB of archives. 2022-01-10T01:23:15.312 INFO:teuthology.orchestra.run.smithi059.stdout:After this operation, 12.4 MB of additional disk space will be used. 2022-01-10T01:23:15.313 INFO:teuthology.orchestra.run.smithi059.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2022-01-10T01:23:15.314 INFO:teuthology.orchestra.run.smithi166.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2022-01-10T01:23:15.318 DEBUG:teuthology.orchestra.run.smithi166:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2022-01-10T01:23:15.365 INFO:teuthology.orchestra.run.smithi036.stdout:Reading package lists... 2022-01-10T01:23:15.385 INFO:teuthology.orchestra.run.smithi166.stdout:Reading package lists... 2022-01-10T01:23:15.541 INFO:teuthology.orchestra.run.smithi036.stdout:Building dependency tree... 2022-01-10T01:23:15.541 INFO:teuthology.orchestra.run.smithi036.stdout:Reading state information... 2022-01-10T01:23:15.556 INFO:teuthology.orchestra.run.smithi166.stdout:Building dependency tree... 2022-01-10T01:23:15.556 INFO:teuthology.orchestra.run.smithi166.stdout:Reading state information... 2022-01-10T01:23:15.634 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2022-01-10T01:23:15.695 INFO:teuthology.orchestra.run.smithi036.stdout:libtool-bin is already the newest version (2.4.6-14). 2022-01-10T01:23:15.695 INFO:teuthology.orchestra.run.smithi036.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2022-01-10T01:23:15.695 INFO:teuthology.orchestra.run.smithi036.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2022-01-10T01:23:15.696 INFO:teuthology.orchestra.run.smithi036.stdout:The following packages were automatically installed and are no longer required: 2022-01-10T01:23:15.697 INFO:teuthology.orchestra.run.smithi036.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2022-01-10T01:23:15.697 INFO:teuthology.orchestra.run.smithi036.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2022-01-10T01:23:15.697 INFO:teuthology.orchestra.run.smithi036.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2022-01-10T01:23:15.698 INFO:teuthology.orchestra.run.smithi036.stdout: linux-modules-extra-5.4.0-66-generic 2022-01-10T01:23:15.698 INFO:teuthology.orchestra.run.smithi036.stdout:Use 'sudo apt autoremove' to remove them. 2022-01-10T01:23:15.698 INFO:teuthology.orchestra.run.smithi036.stdout:The following additional packages will be installed: 2022-01-10T01:23:15.698 INFO:teuthology.orchestra.run.smithi036.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2022-01-10T01:23:15.699 INFO:teuthology.orchestra.run.smithi036.stdout:Suggested packages: 2022-01-10T01:23:15.699 INFO:teuthology.orchestra.run.smithi036.stdout: bison-doc flex-doc indent-doc libssl-doc 2022-01-10T01:23:15.703 INFO:teuthology.orchestra.run.smithi166.stdout:libtool-bin is already the newest version (2.4.6-14). 2022-01-10T01:23:15.703 INFO:teuthology.orchestra.run.smithi166.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2022-01-10T01:23:15.703 INFO:teuthology.orchestra.run.smithi166.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2022-01-10T01:23:15.703 INFO:teuthology.orchestra.run.smithi166.stdout:The following packages were automatically installed and are no longer required: 2022-01-10T01:23:15.704 INFO:teuthology.orchestra.run.smithi166.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2022-01-10T01:23:15.704 INFO:teuthology.orchestra.run.smithi166.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2022-01-10T01:23:15.705 INFO:teuthology.orchestra.run.smithi166.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2022-01-10T01:23:15.705 INFO:teuthology.orchestra.run.smithi166.stdout: linux-modules-extra-5.4.0-66-generic 2022-01-10T01:23:15.705 INFO:teuthology.orchestra.run.smithi166.stdout:Use 'sudo apt autoremove' to remove them. 2022-01-10T01:23:15.705 INFO:teuthology.orchestra.run.smithi166.stdout:The following additional packages will be installed: 2022-01-10T01:23:15.706 INFO:teuthology.orchestra.run.smithi166.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2022-01-10T01:23:15.706 INFO:teuthology.orchestra.run.smithi166.stdout:Suggested packages: 2022-01-10T01:23:15.706 INFO:teuthology.orchestra.run.smithi166.stdout: bison-doc flex-doc indent-doc libssl-doc 2022-01-10T01:23:15.731 INFO:teuthology.orchestra.run.smithi036.stdout:The following NEW packages will be installed: 2022-01-10T01:23:15.732 INFO:teuthology.orchestra.run.smithi036.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2022-01-10T01:23:15.732 INFO:teuthology.orchestra.run.smithi036.stdout: libssl-dev 2022-01-10T01:23:15.733 INFO:teuthology.orchestra.run.smithi036.stdout:The following packages will be upgraded: 2022-01-10T01:23:15.734 INFO:teuthology.orchestra.run.smithi036.stdout: libssl1.1 2022-01-10T01:23:15.737 INFO:teuthology.orchestra.run.smithi166.stdout:The following NEW packages will be installed: 2022-01-10T01:23:15.738 INFO:teuthology.orchestra.run.smithi166.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2022-01-10T01:23:15.739 INFO:teuthology.orchestra.run.smithi166.stdout: libssl-dev 2022-01-10T01:23:15.740 INFO:teuthology.orchestra.run.smithi166.stdout:The following packages will be upgraded: 2022-01-10T01:23:15.740 INFO:teuthology.orchestra.run.smithi166.stdout: libssl1.1 2022-01-10T01:23:15.779 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.10 [1,322 kB] 2022-01-10T01:23:15.925 INFO:teuthology.orchestra.run.smithi036.stdout:1 upgraded, 10 newly installed, 0 to remove and 82 not upgraded. 2022-01-10T01:23:15.925 INFO:teuthology.orchestra.run.smithi036.stdout:Need to get 4,235 kB of archives. 2022-01-10T01:23:15.925 INFO:teuthology.orchestra.run.smithi036.stdout:After this operation, 12.4 MB of additional disk space will be used. 2022-01-10T01:23:15.925 INFO:teuthology.orchestra.run.smithi036.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2022-01-10T01:23:15.931 INFO:teuthology.orchestra.run.smithi166.stdout:1 upgraded, 10 newly installed, 0 to remove and 82 not upgraded. 2022-01-10T01:23:15.932 INFO:teuthology.orchestra.run.smithi166.stdout:Need to get 4,235 kB of archives. 2022-01-10T01:23:15.932 INFO:teuthology.orchestra.run.smithi166.stdout:After this operation, 12.4 MB of additional disk space will be used. 2022-01-10T01:23:15.932 INFO:teuthology.orchestra.run.smithi166.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2022-01-10T01:23:16.001 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2022-01-10T01:23:16.052 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2022-01-10T01:23:16.054 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2022-01-10T01:23:16.060 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2022-01-10T01:23:16.061 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2022-01-10T01:23:16.062 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2022-01-10T01:23:16.064 INFO:teuthology.orchestra.run.smithi059.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2022-01-10T01:23:16.064 INFO:teuthology.orchestra.run.smithi059.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2022-01-10T01:23:16.065 INFO:teuthology.orchestra.run.smithi059.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.10 [1,584 kB] 2022-01-10T01:23:16.080 INFO:teuthology.orchestra.run.smithi139.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2022-01-10T01:23:16.083 DEBUG:teuthology.orchestra.run.smithi139:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2022-01-10T01:23:16.156 INFO:teuthology.orchestra.run.smithi139.stdout:Reading package lists... 2022-01-10T01:23:16.328 INFO:teuthology.orchestra.run.smithi139.stdout:Building dependency tree... 2022-01-10T01:23:16.329 INFO:teuthology.orchestra.run.smithi139.stdout:Reading state information... 2022-01-10T01:23:16.409 INFO:teuthology.orchestra.run.smithi166.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.10 [1,322 kB] 2022-01-10T01:23:16.428 INFO:teuthology.orchestra.run.smithi036.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.10 [1,322 kB] 2022-01-10T01:23:16.439 INFO:teuthology.orchestra.run.smithi059.stdout:Preconfiguring packages ... 2022-01-10T01:23:16.474 INFO:teuthology.orchestra.run.smithi139.stdout:libtool-bin is already the newest version (2.4.6-14). 2022-01-10T01:23:16.475 INFO:teuthology.orchestra.run.smithi139.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2022-01-10T01:23:16.475 INFO:teuthology.orchestra.run.smithi139.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.1). 2022-01-10T01:23:16.475 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages were automatically installed and are no longer required: 2022-01-10T01:23:16.476 INFO:teuthology.orchestra.run.smithi139.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 libllvm11 2022-01-10T01:23:16.476 INFO:teuthology.orchestra.run.smithi139.stdout: linux-headers-5.4.0-66 linux-headers-5.4.0-66-generic 2022-01-10T01:23:16.476 INFO:teuthology.orchestra.run.smithi139.stdout: linux-image-5.4.0-66-generic linux-modules-5.4.0-66-generic 2022-01-10T01:23:16.477 INFO:teuthology.orchestra.run.smithi139.stdout: linux-modules-extra-5.4.0-66-generic 2022-01-10T01:23:16.477 INFO:teuthology.orchestra.run.smithi139.stdout:Use 'sudo apt autoremove' to remove them. 2022-01-10T01:23:16.477 INFO:teuthology.orchestra.run.smithi139.stdout:The following additional packages will be installed: 2022-01-10T01:23:16.477 INFO:teuthology.orchestra.run.smithi139.stdout: libfl-dev libfl2 liblzo2-2 libssl1.1 2022-01-10T01:23:16.478 INFO:teuthology.orchestra.run.smithi139.stdout:Suggested packages: 2022-01-10T01:23:16.478 INFO:teuthology.orchestra.run.smithi139.stdout: bison-doc flex-doc indent-doc libssl-doc 2022-01-10T01:23:16.509 INFO:teuthology.orchestra.run.smithi139.stdout:The following NEW packages will be installed: 2022-01-10T01:23:16.510 INFO:teuthology.orchestra.run.smithi139.stdout: bison dump flex indent libaio-dev libelf-dev libfl-dev libfl2 liblzo2-2 2022-01-10T01:23:16.510 INFO:teuthology.orchestra.run.smithi139.stdout: libssl-dev 2022-01-10T01:23:16.512 INFO:teuthology.orchestra.run.smithi139.stdout:The following packages will be upgraded: 2022-01-10T01:23:16.512 INFO:teuthology.orchestra.run.smithi139.stdout: libssl1.1 2022-01-10T01:23:16.567 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 4,235 kB in 1s (4,216 kB/s) 2022-01-10T01:23:16.626 INFO:teuthology.orchestra.run.smithi166.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2022-01-10T01:23:16.649 INFO:teuthology.orchestra.run.smithi036.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2022-01-10T01:23:16.676 INFO:teuthology.orchestra.run.smithi166.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2022-01-10T01:23:16.679 INFO:teuthology.orchestra.run.smithi166.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2022-01-10T01:23:16.686 INFO:teuthology.orchestra.run.smithi166.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2022-01-10T01:23:16.691 INFO:teuthology.orchestra.run.smithi166.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2022-01-10T01:23:16.691 INFO:teuthology.orchestra.run.smithi166.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2022-01-10T01:23:16.694 INFO:teuthology.orchestra.run.smithi166.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2022-01-10T01:23:16.694 INFO:teuthology.orchestra.run.smithi166.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2022-01-10T01:23:16.695 INFO:teuthology.orchestra.run.smithi166.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.10 [1,584 kB] 2022-01-10T01:23:16.701 INFO:teuthology.orchestra.run.smithi139.stdout:1 upgraded, 10 newly installed, 0 to remove and 82 not upgraded. 2022-01-10T01:23:16.701 INFO:teuthology.orchestra.run.smithi139.stdout:Need to get 4,235 kB of archives. 2022-01-10T01:23:16.702 INFO:teuthology.orchestra.run.smithi139.stdout:After this operation, 12.4 MB of additional disk space will be used. 2022-01-10T01:23:16.702 INFO:teuthology.orchestra.run.smithi139.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 flex amd64 2.6.4-6.2 [317 kB] 2022-01-10T01:23:16.707 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package flex. 2022-01-10T01:23:16.714 INFO:teuthology.orchestra.run.smithi036.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2022-01-10T01:23:16.716 INFO:teuthology.orchestra.run.smithi036.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2022-01-10T01:23:16.721 INFO:teuthology.orchestra.run.smithi036.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2022-01-10T01:23:16.725 INFO:teuthology.orchestra.run.smithi036.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2022-01-10T01:23:16.726 INFO:teuthology.orchestra.run.smithi036.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2022-01-10T01:23:16.729 INFO:teuthology.orchestra.run.smithi036.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2022-01-10T01:23:16.729 INFO:teuthology.orchestra.run.smithi036.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2022-01-10T01:23:16.730 INFO:teuthology.orchestra.run.smithi036.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.10 [1,584 kB] 2022-01-10T01:23:16.778 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182109 files and directories currently installed.) 2022-01-10T01:23:16.784 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2022-01-10T01:23:16.821 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking flex (2.6.4-6.2) ... 2022-01-10T01:23:17.058 INFO:teuthology.orchestra.run.smithi166.stdout:Preconfiguring packages ... 2022-01-10T01:23:17.110 INFO:teuthology.orchestra.run.smithi036.stdout:Preconfiguring packages ... 2022-01-10T01:23:17.180 INFO:teuthology.orchestra.run.smithi139.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.10 [1,322 kB] 2022-01-10T01:23:17.184 INFO:teuthology.orchestra.run.smithi166.stdout:Fetched 4,235 kB in 1s (4,192 kB/s) 2022-01-10T01:23:17.237 INFO:teuthology.orchestra.run.smithi036.stdout:Fetched 4,235 kB in 1s (3,980 kB/s) 2022-01-10T01:23:17.351 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package flex. 2022-01-10T01:23:17.363 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package flex. 2022-01-10T01:23:17.414 INFO:teuthology.orchestra.run.smithi139.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 bison amd64 2:3.5.1+dfsg-1 [657 kB] 2022-01-10T01:23:17.415 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.10_amd64.deb ... 2022-01-10T01:23:17.424 INFO:teuthology.orchestra.run.smithi036.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182109 files and directories currently installed.) 2022-01-10T01:23:17.430 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2022-01-10T01:23:17.437 INFO:teuthology.orchestra.run.smithi166.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182109 files and directories currently installed.) 2022-01-10T01:23:17.443 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2022-01-10T01:23:17.461 INFO:teuthology.orchestra.run.smithi139.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2022-01-10T01:23:17.462 INFO:teuthology.orchestra.run.smithi139.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2022-01-10T01:23:17.467 INFO:teuthology.orchestra.run.smithi139.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2022-01-10T01:23:17.471 INFO:teuthology.orchestra.run.smithi139.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2022-01-10T01:23:17.471 INFO:teuthology.orchestra.run.smithi139.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2022-01-10T01:23:17.473 INFO:teuthology.orchestra.run.smithi139.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl2 amd64 2.6.4-6.2 [11.5 kB] 2022-01-10T01:23:17.473 INFO:teuthology.orchestra.run.smithi139.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libfl-dev amd64 2.6.4-6.2 [6,316 B] 2022-01-10T01:23:17.474 INFO:teuthology.orchestra.run.smithi139.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.10 [1,584 kB] 2022-01-10T01:23:17.486 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking flex (2.6.4-6.2) ... 2022-01-10T01:23:17.487 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking flex (2.6.4-6.2) ... 2022-01-10T01:23:17.586 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.10) over (1.1.1f-1ubuntu2.8) ... 2022-01-10T01:23:17.841 INFO:teuthology.orchestra.run.smithi139.stdout:Preconfiguring packages ... 2022-01-10T01:23:17.969 INFO:teuthology.orchestra.run.smithi139.stdout:Fetched 4,235 kB in 1s (4,136 kB/s) 2022-01-10T01:23:18.046 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.10_amd64.deb ... 2022-01-10T01:23:18.064 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package bison. 2022-01-10T01:23:18.087 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2022-01-10T01:23:18.131 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package flex. 2022-01-10T01:23:18.135 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2022-01-10T01:23:18.158 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.10_amd64.deb ... 2022-01-10T01:23:18.192 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.10) over (1.1.1f-1ubuntu2.8) ... 2022-01-10T01:23:18.202 INFO:teuthology.orchestra.run.smithi139.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 182109 files and directories currently installed.) 2022-01-10T01:23:18.207 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../00-flex_2.6.4-6.2_amd64.deb ... 2022-01-10T01:23:18.246 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking flex (2.6.4-6.2) ... 2022-01-10T01:23:18.356 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.10) over (1.1.1f-1ubuntu2.8) ... 2022-01-10T01:23:18.568 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liblzo2-2:amd64. 2022-01-10T01:23:18.589 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2022-01-10T01:23:18.627 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2022-01-10T01:23:18.688 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package bison. 2022-01-10T01:23:18.707 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2022-01-10T01:23:18.750 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2022-01-10T01:23:18.868 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package bison. 2022-01-10T01:23:18.881 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../01-libssl1.1_1.1.1f-1ubuntu2.10_amd64.deb ... 2022-01-10T01:23:18.889 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2022-01-10T01:23:18.940 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2022-01-10T01:23:19.103 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.10) over (1.1.1f-1ubuntu2.8) ... 2022-01-10T01:23:19.122 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package dump. 2022-01-10T01:23:19.143 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2022-01-10T01:23:19.166 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package liblzo2-2:amd64. 2022-01-10T01:23:19.180 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking dump (0.4b46-6) ... 2022-01-10T01:23:19.189 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2022-01-10T01:23:19.233 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2022-01-10T01:23:19.372 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package liblzo2-2:amd64. 2022-01-10T01:23:19.394 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2022-01-10T01:23:19.430 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2022-01-10T01:23:19.484 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package indent. 2022-01-10T01:23:19.505 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2022-01-10T01:23:19.542 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking indent (2.2.12-1) ... 2022-01-10T01:23:19.611 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package dump. 2022-01-10T01:23:19.631 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2022-01-10T01:23:19.632 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package bison. 2022-01-10T01:23:19.651 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../02-bison_2%3a3.5.1+dfsg-1_amd64.deb ... 2022-01-10T01:23:19.669 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking dump (0.4b46-6) ... 2022-01-10T01:23:19.694 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking bison (2:3.5.1+dfsg-1) ... 2022-01-10T01:23:19.828 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libaio-dev:amd64. 2022-01-10T01:23:19.851 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2022-01-10T01:23:19.895 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2022-01-10T01:23:19.956 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package indent. 2022-01-10T01:23:19.968 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package dump. 2022-01-10T01:23:19.976 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2022-01-10T01:23:19.988 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2022-01-10T01:23:20.026 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking dump (0.4b46-6) ... 2022-01-10T01:23:20.039 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking indent (2.2.12-1) ... 2022-01-10T01:23:20.152 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package liblzo2-2:amd64. 2022-01-10T01:23:20.176 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2022-01-10T01:23:20.190 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libelf-dev:amd64. 2022-01-10T01:23:20.211 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2022-01-10T01:23:20.248 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2022-01-10T01:23:20.286 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2022-01-10T01:23:20.322 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package indent. 2022-01-10T01:23:20.342 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2022-01-10T01:23:20.380 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking indent (2.2.12-1) ... 2022-01-10T01:23:20.401 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package libaio-dev:amd64. 2022-01-10T01:23:20.423 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2022-01-10T01:23:20.459 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2022-01-10T01:23:20.626 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libfl2:amd64. 2022-01-10T01:23:20.646 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2022-01-10T01:23:20.685 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libaio-dev:amd64. 2022-01-10T01:23:20.688 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:20.708 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2022-01-10T01:23:20.740 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package dump. 2022-01-10T01:23:20.757 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2022-01-10T01:23:20.764 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2022-01-10T01:23:20.771 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package libelf-dev:amd64. 2022-01-10T01:23:20.791 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2022-01-10T01:23:20.814 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking dump (0.4b46-6) ... 2022-01-10T01:23:20.848 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2022-01-10T01:23:20.942 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libfl-dev:amd64. 2022-01-10T01:23:20.962 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2022-01-10T01:23:21.000 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:21.044 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libelf-dev:amd64. 2022-01-10T01:23:21.068 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2022-01-10T01:23:21.119 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2022-01-10T01:23:21.160 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package indent. 2022-01-10T01:23:21.182 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../05-indent_2.2.12-1_amd64.deb ... 2022-01-10T01:23:21.199 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package libfl2:amd64. 2022-01-10T01:23:21.221 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2022-01-10T01:23:21.226 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking indent (2.2.12-1) ... 2022-01-10T01:23:21.261 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libssl-dev:amd64. 2022-01-10T01:23:21.265 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:21.281 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.10_amd64.deb ... 2022-01-10T01:23:21.319 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2022-01-10T01:23:21.505 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libfl2:amd64. 2022-01-10T01:23:21.526 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2022-01-10T01:23:21.529 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libaio-dev:amd64. 2022-01-10T01:23:21.543 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package libfl-dev:amd64. 2022-01-10T01:23:21.550 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2022-01-10T01:23:21.563 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2022-01-10T01:23:21.564 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:21.587 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2022-01-10T01:23:21.609 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:21.801 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up flex (2.6.4-6.2) ... 2022-01-10T01:23:21.832 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libfl-dev:amd64. 2022-01-10T01:23:21.853 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2022-01-10T01:23:21.892 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:21.894 INFO:teuthology.orchestra.run.smithi166.stdout:Selecting previously unselected package libssl-dev:amd64. 2022-01-10T01:23:21.899 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libelf-dev:amd64. 2022-01-10T01:23:21.917 INFO:teuthology.orchestra.run.smithi166.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.10_amd64.deb ... 2022-01-10T01:23:21.918 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../07-libelf-dev_0.176-1.1build1_amd64.deb ... 2022-01-10T01:23:21.943 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.10) ... 2022-01-10T01:23:21.957 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2022-01-10T01:23:21.969 INFO:teuthology.orchestra.run.smithi166.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2022-01-10T01:23:22.140 INFO:teuthology.orchestra.run.smithi036.stdout:Selecting previously unselected package libssl-dev:amd64. 2022-01-10T01:23:22.162 INFO:teuthology.orchestra.run.smithi036.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.10_amd64.deb ... 2022-01-10T01:23:22.207 INFO:teuthology.orchestra.run.smithi036.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2022-01-10T01:23:22.253 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2022-01-10T01:23:22.379 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2022-01-10T01:23:22.394 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libfl2:amd64. 2022-01-10T01:23:22.414 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../08-libfl2_2.6.4-6.2_amd64.deb ... 2022-01-10T01:23:22.447 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up flex (2.6.4-6.2) ... 2022-01-10T01:23:22.452 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libfl2:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:22.505 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2022-01-10T01:23:22.575 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.10) ... 2022-01-10T01:23:22.639 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2022-01-10T01:23:22.711 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up flex (2.6.4-6.2) ... 2022-01-10T01:23:22.713 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libfl-dev:amd64. 2022-01-10T01:23:22.733 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6.2_amd64.deb ... 2022-01-10T01:23:22.765 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:22.771 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libfl-dev:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:22.838 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.10) ... 2022-01-10T01:23:22.902 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2022-01-10T01:23:22.916 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up dump (0.4b46-6) ... 2022-01-10T01:23:23.012 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2022-01-10T01:23:23.012 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2022-01-10T01:23:23.042 INFO:teuthology.orchestra.run.smithi139.stdout:Selecting previously unselected package libssl-dev:amd64. 2022-01-10T01:23:23.062 INFO:teuthology.orchestra.run.smithi139.stdout:Preparing to unpack .../10-libssl-dev_1.1.1f-1ubuntu2.10_amd64.deb ... 2022-01-10T01:23:23.084 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2022-01-10T01:23:23.101 INFO:teuthology.orchestra.run.smithi139.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2022-01-10T01:23:23.122 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2022-01-10T01:23:23.175 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2022-01-10T01:23:23.199 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2022-01-10T01:23:23.248 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2022-01-10T01:23:23.278 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up indent (2.2.12-1) ... 2022-01-10T01:23:23.301 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2022-01-10T01:23:23.374 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:23.404 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:23.452 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2022-01-10T01:23:23.531 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2022-01-10T01:23:23.533 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up dump (0.4b46-6) ... 2022-01-10T01:23:23.578 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up flex (2.6.4-6.2) ... 2022-01-10T01:23:23.586 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2022-01-10T01:23:23.628 INFO:teuthology.orchestra.run.smithi166.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2022-01-10T01:23:23.682 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for man-db (2.9.1-1) ... 2022-01-10T01:23:23.684 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2022-01-10T01:23:23.706 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.10) ... 2022-01-10T01:23:23.721 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:23.766 INFO:teuthology.orchestra.run.smithi166.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2022-01-10T01:23:23.828 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up indent (2.2.12-1) ... 2022-01-10T01:23:23.872 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up dump (0.4b46-6) ... 2022-01-10T01:23:23.962 INFO:teuthology.orchestra.run.smithi166.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:23.976 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2022-01-10T01:23:24.026 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2022-01-10T01:23:24.041 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2022-01-10T01:23:24.064 INFO:teuthology.orchestra.run.smithi166.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2022-01-10T01:23:24.130 INFO:teuthology.orchestra.run.smithi036.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2022-01-10T01:23:24.152 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2022-01-10T01:23:24.209 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up indent (2.2.12-1) ... 2022-01-10T01:23:24.232 INFO:teuthology.orchestra.run.smithi166.stdout:Processing triggers for man-db (2.9.1-1) ... 2022-01-10T01:23:24.278 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.10) ... 2022-01-10T01:23:24.352 INFO:teuthology.orchestra.run.smithi036.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:24.404 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2022-01-10T01:23:24.504 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2022-01-10T01:23:24.530 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libfl2:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:24.680 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for man-db (2.9.1-1) ... 2022-01-10T01:23:24.698 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up dump (0.4b46-6) ... 2022-01-10T01:23:24.794 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2022-01-10T01:23:24.858 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up bison (2:3.5.1+dfsg-1) ... 2022-01-10T01:23:24.947 INFO:teuthology.orchestra.run.smithi139.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2022-01-10T01:23:25.018 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up indent (2.2.12-1) ... 2022-01-10T01:23:25.169 INFO:teuthology.orchestra.run.smithi139.stdout:Setting up libfl-dev:amd64 (2.6.4-6.2) ... 2022-01-10T01:23:25.279 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2022-01-10T01:23:25.559 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for man-db (2.9.1-1) ... 2022-01-10T01:23:25.786 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2022-01-10T01:23:26.490 INFO:teuthology.orchestra.run.smithi166.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2022-01-10T01:23:26.498 INFO:teuthology.orchestra.run.smithi059.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2022-01-10T01:23:26.502 DEBUG:teuthology.parallel:result is None 2022-01-10T01:23:26.776 INFO:teuthology.orchestra.run.smithi036.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2022-01-10T01:23:27.219 INFO:teuthology.orchestra.run.smithi166.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2022-01-10T01:23:27.222 DEBUG:teuthology.parallel:result is None 2022-01-10T01:23:27.466 INFO:teuthology.orchestra.run.smithi036.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2022-01-10T01:23:27.468 DEBUG:teuthology.parallel:result is None 2022-01-10T01:23:27.586 INFO:teuthology.orchestra.run.smithi139.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2022-01-10T01:23:28.324 INFO:teuthology.orchestra.run.smithi139.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2022-01-10T01:23:28.326 DEBUG:teuthology.parallel:result is None 2022-01-10T01:23:28.327 DEBUG:teuthology.orchestra.run.smithi036:> sudo lsb_release -is 2022-01-10T01:23:28.380 INFO:teuthology.orchestra.run.smithi036.stdout:Ubuntu 2022-01-10T01:23:28.385 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-01-10T01:23:28.386 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be 2022-01-10T01:23:28.596 DEBUG:teuthology.orchestra.run.smithi036:> dpkg-query -W -f '${Version}' ceph 2022-01-10T01:23:28.619 INFO:teuthology.orchestra.run.smithi036.stdout:15.2.14-1focal 2022-01-10T01:23:28.620 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-1focal 2022-01-10T01:23:28.620 INFO:teuthology.task.install:The correct ceph version 15.2.14-1focal is installed. 2022-01-10T01:23:28.621 DEBUG:teuthology.orchestra.run.smithi059:> sudo lsb_release -is 2022-01-10T01:23:28.672 INFO:teuthology.orchestra.run.smithi059.stdout:Ubuntu 2022-01-10T01:23:28.678 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-01-10T01:23:28.679 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be 2022-01-10T01:23:28.898 DEBUG:teuthology.orchestra.run.smithi059:> dpkg-query -W -f '${Version}' ceph 2022-01-10T01:23:28.923 INFO:teuthology.orchestra.run.smithi059.stdout:15.2.14-1focal 2022-01-10T01:23:28.923 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-1focal 2022-01-10T01:23:28.923 INFO:teuthology.task.install:The correct ceph version 15.2.14-1focal is installed. 2022-01-10T01:23:28.924 DEBUG:teuthology.orchestra.run.smithi139:> sudo lsb_release -is 2022-01-10T01:23:28.976 INFO:teuthology.orchestra.run.smithi139.stdout:Ubuntu 2022-01-10T01:23:28.981 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-01-10T01:23:28.982 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be 2022-01-10T01:23:29.184 DEBUG:teuthology.orchestra.run.smithi139:> dpkg-query -W -f '${Version}' ceph 2022-01-10T01:23:29.207 INFO:teuthology.orchestra.run.smithi139.stdout:15.2.14-1focal 2022-01-10T01:23:29.208 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-1focal 2022-01-10T01:23:29.208 INFO:teuthology.task.install:The correct ceph version 15.2.14-1focal is installed. 2022-01-10T01:23:29.208 DEBUG:teuthology.orchestra.run.smithi166:> sudo lsb_release -is 2022-01-10T01:23:29.261 INFO:teuthology.orchestra.run.smithi166.stdout:Ubuntu 2022-01-10T01:23:29.270 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-01-10T01:23:29.271 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be 2022-01-10T01:23:29.476 DEBUG:teuthology.orchestra.run.smithi166:> dpkg-query -W -f '${Version}' ceph 2022-01-10T01:23:29.496 INFO:teuthology.orchestra.run.smithi166.stdout:15.2.14-1focal 2022-01-10T01:23:29.496 INFO:teuthology.packaging:The installed version of ceph is 15.2.14-1focal 2022-01-10T01:23:29.497 INFO:teuthology.task.install:The correct ceph version 15.2.14-1focal is installed. 2022-01-10T01:23:29.497 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-01-10T01:23:29.498 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2022-01-10T01:23:29.498 DEBUG:teuthology.orchestra.run.smithi036:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-01-10T01:23:29.515 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2022-01-10T01:23:29.515 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-01-10T01:23:29.533 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2022-01-10T01:23:29.534 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-01-10T01:23:29.550 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-01-10T01:23:29.551 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-01-10T01:23:29.567 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-01-10T01:23:29.568 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2022-01-10T01:23:29.568 DEBUG:teuthology.orchestra.run.smithi036:> sudo dd of=/usr/bin/daemon-helper 2022-01-10T01:23:29.585 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-01-10T01:23:29.643 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2022-01-10T01:23:29.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2022-01-10T01:23:29.659 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-01-10T01:23:29.716 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2022-01-10T01:23:29.717 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/daemon-helper 2022-01-10T01:23:29.733 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-01-10T01:23:29.743 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-01-10T01:23:29.743 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd of=/usr/bin/daemon-helper 2022-01-10T01:23:29.760 DEBUG:teuthology.orchestra.run.smithi166:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-01-10T01:23:29.769 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-01-10T01:23:29.770 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2022-01-10T01:23:29.770 DEBUG:teuthology.orchestra.run.smithi036:> sudo dd of=/usr/bin/adjust-ulimits 2022-01-10T01:23:29.786 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-01-10T01:23:29.796 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2022-01-10T01:23:29.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2022-01-10T01:23:29.813 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-01-10T01:23:29.828 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2022-01-10T01:23:29.829 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/usr/bin/adjust-ulimits 2022-01-10T01:23:29.843 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-01-10T01:23:29.902 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-01-10T01:23:29.902 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd of=/usr/bin/adjust-ulimits 2022-01-10T01:23:29.918 DEBUG:teuthology.orchestra.run.smithi166:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-01-10T01:23:29.976 INFO:teuthology.run_tasks:Running task ceph... 2022-01-10T01:23:30.034 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-01-10T01:23:30.035 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 777 /var/log/ceph 2022-01-10T01:23:30.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2022-01-10T01:23:30.040 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 777 /var/log/ceph 2022-01-10T01:23:30.043 DEBUG:teuthology.orchestra.run.smithi166:> sudo chmod 777 /var/log/ceph 2022-01-10T01:23:30.059 INFO:tasks.ceph:Disabling ceph logrotate... 2022-01-10T01:23:30.060 DEBUG:teuthology.orchestra.run.smithi036:> sudo rm -f -- /etc/logrotate.d/ceph 2022-01-10T01:23:30.062 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/logrotate.d/ceph 2022-01-10T01:23:30.065 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/logrotate.d/ceph 2022-01-10T01:23:30.100 DEBUG:teuthology.orchestra.run.smithi166:> sudo rm -f -- /etc/logrotate.d/ceph 2022-01-10T01:23:30.116 INFO:tasks.ceph:Creating extra log directories... 2022-01-10T01:23:30.116 DEBUG:teuthology.orchestra.run.smithi036:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-01-10T01:23:30.119 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-01-10T01:23:30.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-01-10T01:23:30.124 DEBUG:teuthology.orchestra.run.smithi166:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-01-10T01:23:30.140 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2022-01-10T01:23:30.141 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2022-01-10T01:23:30.141 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2022-01-10T01:23:30.142 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2022-01-10T01:23:30.142 DEBUG:teuthology.orchestra.run.smithi036:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-01-10T01:23:30.150 DEBUG:teuthology.orchestra.run.smithi036:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-01-10T01:23:30.229 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2022-01-10T01:23:30.229 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-01-10T01:23:30.237 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-01-10T01:23:30.276 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2022-01-10T01:23:30.276 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-01-10T01:23:30.283 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-01-10T01:23:30.319 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-01-10T01:23:30.319 DEBUG:teuthology.orchestra.run.smithi166:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-01-10T01:23:30.327 DEBUG:teuthology.orchestra.run.smithi166:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-01-10T01:23:30.406 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-01-10T01:23:30.407 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-01-10T01:23:30.407 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546', 'branch': 'octopus', 'description': 'fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6600546', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'octopus', 'sha1': 'f6d564868a58503a158361f4a4d03aeb91ddeca2'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 1000, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1']], 'sha1': 'cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'octopus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': 'f6d564868a58503a158361f4a4d03aeb91ddeca2', 'targets': {'smithi036.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt8kBw/PvnRw9qnS5uKJoG1PhFhoPhyoj8v/xyDGkaGIJVe67+lsjto/VCfBVEIvAAysI31UIVom//9I7YMiQOBZcFVLoVUyPYGK/cgewwFbJ/4eweNBlZyS59mAYaETseG5gv7e44rz1G8PrVY+loecNLR16BMheDR/E9HeUy5Fw+B8zlZVY3ALwkOs61mCcQs8G46j64rg8t/7zb1Pcze2FIWGQmR3UB0x00HsHWNru2Av7s/s43ipsvDez5YSmk2Qc7u8iLQLWPukmEZ3hzXAQJRKMDYdBy9cManx8bG8uyN6+pWqnGCQtVmTGTzafzL8XoCvcX1DTNwErFX2oJbaXq7eFS4xw4Of3JYZpJhfIJ/C4H2J11uCr7FhPs69J0lBEP25GiDgG8+jzrXiPHOWdUuAeXqCOKt8ttqH5DiungohOI/PyTO34EcEt/osREbd9v7Fgy3psqDpG0xYaxxgK7SNo03xrix8VWLoQMRpcIu0EuAf69ZrYYDhBDde8=', 'smithi059.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDL/SXtmTozlyt69LHVZEmf6Y+qjLMVhpB+dam1Jof58t3EJp34mtrHPFnnkJ5g72STeq4+oGJLPgiMY6uenqrtq35usK9ZOGbPmnYg+dViyk6sEci6C52+3+pCbKrZIGXjSfGbBSBUaAn1/7l+99vY2cMdyYkf1ZbykEdIsjh+4drYyv6w9u2nPnkwduw6KDOMRRhN1eCxucZoVVMl864yBt7Hs52iMutGJUSgAetWcHbnWM9XkM8/R6FDV+HeR5e3ooHTCLczGtZFlFYo2siUit3Sb6GRfuw5I1PMN5+1TzZe7EJg+Ow+AkUTbRsTq6nOOZJ6zFc6uloMz82euZg/dao+JnaStbdfkhQ+H4piuCo+j6Z72Lcz7NVFDCVdAYOe/Gak6xOYseUCsE9aEjLLc3vPLWS4q0QbP6ataGCEW+NDxWGw6rQ+jq1LBEsLSY6IfAUJOQPOLG3YINVxRz6FwOt80mM5Tsb5wkrRl1gWfy9s2gdOk5pLvdvjao5qt1E=', 'smithi139.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCnd0MtsGTQ8NJXDA8VzgSH5sNriccarBEC+hUv0qufI5af6aIYWp76wWJN4rC3RRMAUwfH5rS4N3uLZt+FNd0QzBgnfWulyXgtgNmO9KUEwW/rhyI73hf4+n5kMbJlQ4B8RExUOCTlVhGMvscoyzoM19m81XiO9vh2zhxfIGOQqm+49owUuOvyHFxuwWVlge0q8mdxNdHcX1IYI14gTF3UsWhnJvC7FnIvqSeb8JlYDJ5og3hAL3AECQxgrMvFBYUq/lCfK53OkvXxziLmcDU7qyk3GXhPwLPGaK+5IBke49ZnlbHcWmLbW9u/j14sHZ6G7FpOKqrIP6JJ6Oow6mst83kUKgBXPVWDDIN3tRfCOxS299xFRBKrotEy9vbgqMm9VxS2249t1bk+NyEoQOmhBlqkeQUAztRfvZJtSr12XsddBdu3Ik52WpI4mCM3Nvu+owuhbjUogLqdFdRYhqM4UBbUBouFgz8gwfAE/aNp4x1vGLsDczwmnKRgbsMMoWs=', 'smithi166.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwxtrrTVh7S3IBsvwF8F+QDOVUKUei0CsbK+Of0ohQ+3Pv3QATs/7jVgd8bSEy6JirmZNjIHO3p/uZTB22rdoyBV0nC/hNURA5rfQ1Mu+a2U/1LtOjrLcmUDyWDeXcAJmZNch/zHrZRIJTbxvrdZqJ8JN0VHfwzYiEH32p8lVqlbOfYGJTvMqmgXL994eLVVaPEYp2Uf0MFrj1z/Nh3OwzOa9J/Nj7xlTTWa0ES5Hks/4/7xI8moWXDF4R8s0JtSY5N6rH1Mofze0RVCwGAF/RUmi3H1oDsk0PmM0mFwPn3hQ+ZqcB7hlmf1Wp3k7XsRguYgdOgJ9AaXPD4p/ROqTOmtOpy1InCXxerqEoeq2I+/n0mZoypdRQorZ5gdnseDRdgSMJKnJ0YkU8Wl8Bd4hbp0KEP1H3aTrz12NKMeOfJZGlDHBn+0VD8c8LEye06pUKpgKAh5EYfbpdpVgjppqC1fFfvhtBgeWb3qQxcSD3wOZ/asy1xRCz4cIbs2hv/4E='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_misc']}}], 'teuthology_branch': 'master', 'teuthology_sha1': '95a7d4799b562f3bbb5ec66107094963abd62fa1', 'timestamp': '2022-01-07_04:10:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.20261'} 2022-01-10T01:23:30.408 DEBUG:teuthology.orchestra.run.smithi036:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-01-10T01:23:30.411 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-01-10T01:23:30.413 DEBUG:teuthology.orchestra.run.smithi139:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-01-10T01:23:30.416 DEBUG:teuthology.orchestra.run.smithi166:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-01-10T01:23:30.423 DEBUG:teuthology.orchestra.run.smithi036:> sudo install -d -m0777 -- /var/run/ceph 2022-01-10T01:23:30.461 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/run/ceph 2022-01-10T01:23:30.464 DEBUG:teuthology.orchestra.run.smithi139:> sudo install -d -m0777 -- /var/run/ceph 2022-01-10T01:23:30.467 DEBUG:teuthology.orchestra.run.smithi166:> sudo install -d -m0777 -- /var/run/ceph 2022-01-10T01:23:30.483 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2022-01-10T01:23:30.484 DEBUG:teuthology.orchestra.run.smithi036:> dd if=/scratch_devs of=/dev/stdout 2022-01-10T01:23:30.491 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-01-10T01:23:30.491 DEBUG:teuthology.orchestra.run.smithi036:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-01-10T01:23:30.499 INFO:teuthology.orchestra.run.smithi036.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-01-10T01:23:30.499 INFO:teuthology.orchestra.run.smithi036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-10T01:23:30.499 INFO:teuthology.orchestra.run.smithi036.stdout:Device: 6h/6d Inode: 346 Links: 1 2022-01-10T01:23:30.499 INFO:teuthology.orchestra.run.smithi036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-10T01:23:30.500 INFO:teuthology.orchestra.run.smithi036.stdout:Access: 2022-01-10 01:20:34.722326846 +0000 2022-01-10T01:23:30.500 INFO:teuthology.orchestra.run.smithi036.stdout:Modify: 2022-01-10 01:20:34.542331793 +0000 2022-01-10T01:23:30.500 INFO:teuthology.orchestra.run.smithi036.stdout:Change: 2022-01-10 01:20:34.542331793 +0000 2022-01-10T01:23:30.500 INFO:teuthology.orchestra.run.smithi036.stdout: Birth: - 2022-01-10T01:23:30.509 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records in 2022-01-10T01:23:30.509 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records out 2022-01-10T01:23:30.509 INFO:teuthology.orchestra.run.smithi036.stderr:512 bytes copied, 0.000312892 s, 1.6 MB/s 2022-01-10T01:23:30.513 DEBUG:teuthology.orchestra.run.smithi036:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-01-10T01:23:30.562 INFO:teuthology.orchestra.run.smithi036.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-01-10T01:23:30.562 INFO:teuthology.orchestra.run.smithi036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-10T01:23:30.562 INFO:teuthology.orchestra.run.smithi036.stdout:Device: 6h/6d Inode: 354 Links: 1 2022-01-10T01:23:30.563 INFO:teuthology.orchestra.run.smithi036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-10T01:23:30.563 INFO:teuthology.orchestra.run.smithi036.stdout:Access: 2022-01-10 01:20:35.098316512 +0000 2022-01-10T01:23:30.563 INFO:teuthology.orchestra.run.smithi036.stdout:Modify: 2022-01-10 01:20:34.938320909 +0000 2022-01-10T01:23:30.563 INFO:teuthology.orchestra.run.smithi036.stdout:Change: 2022-01-10 01:20:34.938320909 +0000 2022-01-10T01:23:30.563 INFO:teuthology.orchestra.run.smithi036.stdout: Birth: - 2022-01-10T01:23:30.572 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records in 2022-01-10T01:23:30.572 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records out 2022-01-10T01:23:30.573 INFO:teuthology.orchestra.run.smithi036.stderr:512 bytes copied, 0.000409487 s, 1.3 MB/s 2022-01-10T01:23:30.577 DEBUG:teuthology.orchestra.run.smithi036:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-01-10T01:23:30.584 INFO:teuthology.orchestra.run.smithi036.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-01-10T01:23:30.584 INFO:teuthology.orchestra.run.smithi036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-10T01:23:30.585 INFO:teuthology.orchestra.run.smithi036.stdout:Device: 6h/6d Inode: 360 Links: 1 2022-01-10T01:23:30.585 INFO:teuthology.orchestra.run.smithi036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-10T01:23:30.585 INFO:teuthology.orchestra.run.smithi036.stdout:Access: 2022-01-10 01:20:35.510305187 +0000 2022-01-10T01:23:30.585 INFO:teuthology.orchestra.run.smithi036.stdout:Modify: 2022-01-10 01:20:35.350309585 +0000 2022-01-10T01:23:30.586 INFO:teuthology.orchestra.run.smithi036.stdout:Change: 2022-01-10 01:20:35.350309585 +0000 2022-01-10T01:23:30.586 INFO:teuthology.orchestra.run.smithi036.stdout: Birth: - 2022-01-10T01:23:30.592 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records in 2022-01-10T01:23:30.592 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records out 2022-01-10T01:23:30.592 INFO:teuthology.orchestra.run.smithi036.stderr:512 bytes copied, 0.000394247 s, 1.3 MB/s 2022-01-10T01:23:30.596 DEBUG:teuthology.orchestra.run.smithi036:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-01-10T01:23:30.603 INFO:teuthology.orchestra.run.smithi036.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-01-10T01:23:30.603 INFO:teuthology.orchestra.run.smithi036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-10T01:23:30.603 INFO:teuthology.orchestra.run.smithi036.stdout:Device: 6h/6d Inode: 365 Links: 1 2022-01-10T01:23:30.603 INFO:teuthology.orchestra.run.smithi036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-10T01:23:30.604 INFO:teuthology.orchestra.run.smithi036.stdout:Access: 2022-01-10 01:20:35.902294412 +0000 2022-01-10T01:23:30.604 INFO:teuthology.orchestra.run.smithi036.stdout:Modify: 2022-01-10 01:20:35.742298810 +0000 2022-01-10T01:23:30.604 INFO:teuthology.orchestra.run.smithi036.stdout:Change: 2022-01-10 01:20:35.742298810 +0000 2022-01-10T01:23:30.604 INFO:teuthology.orchestra.run.smithi036.stdout: Birth: - 2022-01-10T01:23:30.612 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records in 2022-01-10T01:23:30.612 INFO:teuthology.orchestra.run.smithi036.stderr:1+0 records out 2022-01-10T01:23:30.613 INFO:teuthology.orchestra.run.smithi036.stderr:512 bytes copied, 0.000411656 s, 1.2 MB/s 2022-01-10T01:23:30.617 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-01-10T01:23:30.617 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2022-01-10T01:23:30.618 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2022-01-10T01:23:30.625 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-01-10T01:23:30.626 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-01-10T01:23:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-01-10T01:23:30.633 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-10T01:23:30.634 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 348 Links: 1 2022-01-10T01:23:30.634 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-10T01:23:30.634 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2022-01-10 01:20:35.036791849 +0000 2022-01-10T01:23:30.634 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2022-01-10 01:20:34.860796697 +0000 2022-01-10T01:23:30.635 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2022-01-10 01:20:34.860796697 +0000 2022-01-10T01:23:30.635 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2022-01-10T01:23:30.644 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2022-01-10T01:23:30.644 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2022-01-10T01:23:30.644 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000407056 s, 1.3 MB/s 2022-01-10T01:23:30.650 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-01-10T01:23:30.697 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-01-10T01:23:30.697 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-10T01:23:30.697 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 356 Links: 1 2022-01-10T01:23:30.697 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-10T01:23:30.698 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2022-01-10 01:20:35.264785570 +0000 2022-01-10T01:23:30.698 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2022-01-10 01:20:35.260785680 +0000 2022-01-10T01:23:30.698 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2022-01-10 01:20:35.260785680 +0000 2022-01-10T01:23:30.698 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2022-01-10T01:23:30.707 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2022-01-10T01:23:30.708 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2022-01-10T01:23:30.708 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.00037785 s, 1.4 MB/s 2022-01-10T01:23:30.712 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-01-10T01:23:30.720 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-01-10T01:23:30.720 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-10T01:23:30.720 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 359 Links: 1 2022-01-10T01:23:30.721 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-10T01:23:30.721 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2022-01-10 01:20:35.832769927 +0000 2022-01-10T01:23:30.721 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2022-01-10 01:20:35.676774222 +0000 2022-01-10T01:23:30.721 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2022-01-10 01:20:35.676774222 +0000 2022-01-10T01:23:30.722 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2022-01-10T01:23:30.727 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2022-01-10T01:23:30.727 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2022-01-10T01:23:30.727 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.00037016 s, 1.4 MB/s 2022-01-10T01:23:30.731 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-01-10T01:23:30.738 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-01-10T01:23:30.738 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-01-10T01:23:30.739 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 367 Links: 1 2022-01-10T01:23:30.739 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-01-10T01:23:30.739 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2022-01-10 01:20:36.248758469 +0000 2022-01-10T01:23:30.739 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2022-01-10 01:20:36.052763868 +0000 2022-01-10T01:23:30.739 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2022-01-10 01:20:36.052763868 +0000 2022-01-10T01:23:30.740 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2022-01-10T01:23:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2022-01-10T01:23:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2022-01-10T01:23:30.748 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000366235 s, 1.4 MB/s 2022-01-10T01:23:30.752 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-01-10T01:23:30.753 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi036.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-01-10T01:23:30.753 INFO:tasks.ceph:Generating config... 2022-01-10T01:23:30.755 INFO:tasks.ceph:[client] client mount timeout = 600 2022-01-10T01:23:30.755 INFO:tasks.ceph:[client] debug client = 20 2022-01-10T01:23:30.755 INFO:tasks.ceph:[client] debug ms = 1 2022-01-10T01:23:30.756 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2022-01-10T01:23:30.756 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2022-01-10T01:23:30.756 INFO:tasks.ceph:[mds] debug mds = 20 2022-01-10T01:23:30.756 INFO:tasks.ceph:[mds] debug ms = 1 2022-01-10T01:23:30.757 INFO:tasks.ceph:[mds] mds bal frag = True 2022-01-10T01:23:30.757 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2022-01-10T01:23:30.757 INFO:tasks.ceph:[mds] mds bal merge size = 5 2022-01-10T01:23:30.758 INFO:tasks.ceph:[mds] mds bal split bits = 3 2022-01-10T01:23:30.758 INFO:tasks.ceph:[mds] mds bal split size = 100 2022-01-10T01:23:30.758 INFO:tasks.ceph:[mds] mds debug frag = True 2022-01-10T01:23:30.759 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-01-10T01:23:30.759 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-01-10T01:23:30.759 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-01-10T01:23:30.760 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-01-10T01:23:30.760 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2022-01-10T01:23:30.760 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2022-01-10T01:23:30.761 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-01-10T01:23:30.761 INFO:tasks.ceph:[mgr] debug ms = 1 2022-01-10T01:23:30.761 INFO:tasks.ceph:[mon] debug mon = 20 2022-01-10T01:23:30.761 INFO:tasks.ceph:[mon] debug ms = 1 2022-01-10T01:23:30.762 INFO:tasks.ceph:[mon] debug paxos = 20 2022-01-10T01:23:30.762 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-01-10T01:23:30.762 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-01-10T01:23:30.763 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2022-01-10T01:23:30.763 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-01-10T01:23:30.763 INFO:tasks.ceph:[osd] debug bluefs = 20 2022-01-10T01:23:30.764 INFO:tasks.ceph:[osd] debug bluestore = 20 2022-01-10T01:23:30.764 INFO:tasks.ceph:[osd] debug ms = 1 2022-01-10T01:23:30.764 INFO:tasks.ceph:[osd] debug osd = 20 2022-01-10T01:23:30.765 INFO:tasks.ceph:[osd] debug rocksdb = 10 2022-01-10T01:23:30.765 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-01-10T01:23:30.765 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-01-10T01:23:30.766 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-01-10T01:23:30.766 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-01-10T01:23:30.766 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-01-10T01:23:30.766 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-01-10T01:23:30.767 INFO:tasks.ceph:Setting up mon.a... 2022-01-10T01:23:30.767 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-01-10T01:23:30.819 INFO:teuthology.orchestra.run.smithi036.stdout:creating /etc/ceph/ceph.keyring 2022-01-10T01:23:30.822 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-01-10T01:23:30.853 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-01-10T01:23:30.909 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.36'), ('mon.b', '172.21.15.59'), ('mon.c', '[v2:172.21.15.59:3301,v1:172.21.15.59:6790]')] 2022-01-10T01:23:30.909 DEBUG:teuthology.orchestra.run.smithi036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.36 --add b 172.21.15.59 --addv c '[v2:172.21.15.59:3301,v1:172.21.15.59:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:23:30.945 INFO:teuthology.orchestra.run.smithi036.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:23:30.946 INFO:teuthology.orchestra.run.smithi036.stdout:monmaptool: generated fsid 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762 2022-01-10T01:23:30.946 INFO:teuthology.orchestra.run.smithi036.stdout:epoch 0 2022-01-10T01:23:30.946 INFO:teuthology.orchestra.run.smithi036.stdout:fsid 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762 2022-01-10T01:23:30.946 INFO:teuthology.orchestra.run.smithi036.stdout:last_changed 2022-01-10T01:23:30.942925+0000 2022-01-10T01:23:30.947 INFO:teuthology.orchestra.run.smithi036.stdout:created 2022-01-10T01:23:30.942925+0000 2022-01-10T01:23:30.947 INFO:teuthology.orchestra.run.smithi036.stdout:min_mon_release 0 (unknown) 2022-01-10T01:23:30.947 INFO:teuthology.orchestra.run.smithi036.stdout:0: [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] mon.a 2022-01-10T01:23:30.947 INFO:teuthology.orchestra.run.smithi036.stdout:1: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.b 2022-01-10T01:23:30.948 INFO:teuthology.orchestra.run.smithi036.stdout:2: [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] mon.c 2022-01-10T01:23:30.948 INFO:teuthology.orchestra.run.smithi036.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-01-10T01:23:30.949 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762... 2022-01-10T01:23:30.950 DEBUG:teuthology.orchestra.run.smithi036:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-10T01:23:30.953 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-10T01:23:30.955 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-10T01:23:30.958 DEBUG:teuthology.orchestra.run.smithi166:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-10T01:23:30.986 INFO:teuthology.orchestra.run.smithi036.stdout:[global] 2022-01-10T01:23:30.987 INFO:teuthology.orchestra.run.smithi036.stdout: chdir = "" 2022-01-10T01:23:30.987 INFO:teuthology.orchestra.run.smithi036.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-10T01:23:30.987 INFO:teuthology.orchestra.run.smithi036.stdout: auth supported = cephx 2022-01-10T01:23:30.988 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.988 INFO:teuthology.orchestra.run.smithi036.stdout: filestore xattr use omap = true 2022-01-10T01:23:30.988 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.989 INFO:teuthology.orchestra.run.smithi036.stdout: mon clock drift allowed = 1.000 2022-01-10T01:23:30.989 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.989 INFO:teuthology.orchestra.run.smithi036.stdout: osd crush chooseleaf type = 0 2022-01-10T01:23:30.989 INFO:teuthology.orchestra.run.smithi036.stdout: auth debug = true 2022-01-10T01:23:30.989 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.990 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on old message = true 2022-01-10T01:23:30.990 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on bug = true 2022-01-10T01:23:30.990 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.990 INFO:teuthology.orchestra.run.smithi036.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-10T01:23:30.991 INFO:teuthology.orchestra.run.smithi036.stdout: mon pg warn max object skew = 0 2022-01-10T01:23:30.991 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.991 INFO:teuthology.orchestra.run.smithi036.stdout: # disable pg_autoscaler by default for new pools 2022-01-10T01:23:30.992 INFO:teuthology.orchestra.run.smithi036.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-10T01:23:30.992 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.992 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default size = 2 2022-01-10T01:23:30.992 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.993 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow primary affinity = true 2022-01-10T01:23:30.993 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow pg remap = true 2022-01-10T01:23:30.993 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on legacy crush tunables = false 2022-01-10T01:23:30.993 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on crush straw calc version zero = false 2022-01-10T01:23:30.993 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on no sortbitwise = false 2022-01-10T01:23:30.994 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on osd down out interval zero = false 2022-01-10T01:23:30.994 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on too few osds = false 2022-01-10T01:23:30.994 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-10T01:23:30.994 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-10T01:23:30.995 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.995 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-10T01:23:30.995 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.995 INFO:teuthology.orchestra.run.smithi036.stdout: osd default data pool replay window = 5 2022-01-10T01:23:30.995 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.996 INFO:teuthology.orchestra.run.smithi036.stdout: mon allow pool delete = true 2022-01-10T01:23:30.996 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.996 INFO:teuthology.orchestra.run.smithi036.stdout: mon cluster log file level = debug 2022-01-10T01:23:30.996 INFO:teuthology.orchestra.run.smithi036.stdout: debug asserts on shutdown = true 2022-01-10T01:23:30.997 INFO:teuthology.orchestra.run.smithi036.stdout: mon health detail to clog = false 2022-01-10T01:23:30.997 INFO:teuthology.orchestra.run.smithi036.stdout: mon host = "172.21.15.36,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2022-01-10T01:23:30.997 INFO:teuthology.orchestra.run.smithi036.stdout: fsid = 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762 2022-01-10T01:23:30.997 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.997 INFO:teuthology.orchestra.run.smithi036.stdout:[osd] 2022-01-10T01:23:30.998 INFO:teuthology.orchestra.run.smithi036.stdout: osd journal size = 100 2022-01-10T01:23:30.998 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.998 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub load threshold = 5.0 2022-01-10T01:23:30.998 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub max interval = 600 2022-01-10T01:23:30.999 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.999 INFO:teuthology.orchestra.run.smithi036.stdout: osd recover clone overlap = true 2022-01-10T01:23:30.999 INFO:teuthology.orchestra.run.smithi036.stdout: osd recovery max chunk = 1048576 2022-01-10T01:23:30.999 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:30.999 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug shutdown = true 2022-01-10T01:23:31.000 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug op order = true 2022-01-10T01:23:31.000 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug verify stray on activate = true 2022-01-10T01:23:31.000 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:31.000 INFO:teuthology.orchestra.run.smithi036.stdout: osd open classes on start = true 2022-01-10T01:23:31.001 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug pg log writeout = true 2022-01-10T01:23:31.001 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:31.001 INFO:teuthology.orchestra.run.smithi036.stdout: osd deep scrub update digest min age = 30 2022-01-10T01:23:31.001 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:31.001 INFO:teuthology.orchestra.run.smithi036.stdout: osd map max advance = 10 2022-01-10T01:23:31.002 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:31.002 INFO:teuthology.orchestra.run.smithi036.stdout: journal zero on create = true 2022-01-10T01:23:31.002 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:31.002 INFO:teuthology.orchestra.run.smithi036.stdout: filestore ondisk finisher threads = 3 2022-01-10T01:23:31.002 INFO:teuthology.orchestra.run.smithi036.stdout: filestore apply finisher threads = 3 2022-01-10T01:23:31.003 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:31.003 INFO:teuthology.orchestra.run.smithi036.stdout: bdev debug aio = true 2022-01-10T01:23:31.003 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug misdirected ops = true 2022-01-10T01:23:31.003 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore block size = 96636764160 2022-01-10T01:23:31.004 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore compression mode = aggressive 2022-01-10T01:23:31.004 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore fsck on mount = True 2022-01-10T01:23:31.004 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluefs = 20 2022-01-10T01:23:31.004 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluestore = 20 2022-01-10T01:23:31.004 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:23:31.005 INFO:teuthology.orchestra.run.smithi036.stdout: debug osd = 20 2022-01-10T01:23:31.005 INFO:teuthology.orchestra.run.smithi036.stdout: debug rocksdb = 10 2022-01-10T01:23:31.005 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd backfillfull_ratio = 0.85 2022-01-10T01:23:31.005 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd full ratio = 0.9 2022-01-10T01:23:31.005 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd nearfull ratio = 0.8 2022-01-10T01:23:31.006 INFO:teuthology.orchestra.run.smithi036.stdout: osd failsafe full ratio = 0.95 2022-01-10T01:23:31.006 INFO:teuthology.orchestra.run.smithi036.stdout: osd objectstore = bluestore 2022-01-10T01:23:31.006 INFO:teuthology.orchestra.run.smithi036.stdout: osd op complaint time = 180 2022-01-10T01:23:31.006 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:31.007 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr] 2022-01-10T01:23:31.007 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:23:31.007 INFO:teuthology.orchestra.run.smithi036.stdout: debug mgr = 20 2022-01-10T01:23:31.007 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2022-01-10T01:23:31.007 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2022-01-10T01:23:31.008 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:23:31.008 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:23:31.008 INFO:teuthology.orchestra.run.smithi036.stdout: mgr/telemetry/nag = false 2022-01-10T01:23:31.008 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:31.009 INFO:teuthology.orchestra.run.smithi036.stdout:[mon] 2022-01-10T01:23:31.009 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:23:31.009 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2022-01-10T01:23:31.009 INFO:teuthology.orchestra.run.smithi036.stdout: debug paxos = 20 2022-01-10T01:23:31.009 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2022-01-10T01:23:31.010 INFO:teuthology.orchestra.run.smithi036.stdout: mon data avail warn = 5 2022-01-10T01:23:31.010 INFO:teuthology.orchestra.run.smithi036.stdout: mon mgr mkfs grace = 240 2022-01-10T01:23:31.010 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:23:31.010 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd reporter subtree level = osd 2022-01-10T01:23:31.011 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd prime pg temp = true 2022-01-10T01:23:31.011 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:23:31.011 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:31.011 INFO:teuthology.orchestra.run.smithi036.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-10T01:23:31.011 INFO:teuthology.orchestra.run.smithi036.stdout: auth mon ticket ttl = 660 # 11m 2022-01-10T01:23:31.012 INFO:teuthology.orchestra.run.smithi036.stdout: auth service ticket ttl = 240 # 4m 2022-01-10T01:23:31.012 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:31.012 INFO:teuthology.orchestra.run.smithi036.stdout: # don't complain about insecure global_id in the test suite 2022-01-10T01:23:31.012 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-10T01:23:31.013 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-10T01:23:31.013 INFO:teuthology.orchestra.run.smithi036.stdout: mon op complaint time = 120 2022-01-10T01:23:31.013 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:23:31.013 INFO:teuthology.orchestra.run.smithi036.stdout:[client] 2022-01-10T01:23:31.013 INFO:teuthology.orchestra.run.smithi036.stdout: rgw cache enabled = true 2022-01-10T01:23:31.014 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable ops log = true 2022-01-10T01:23:31.014 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable usage log = true 2022-01-10T01:23:31.014 INFO:teuthology.orchestra.run.smithi036.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-10T01:23:31.014 INFO:teuthology.orchestra.run.smithi036.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-10T01:23:31.015 INFO:teuthology.orchestra.run.smithi036.stdout: client mount timeout = 600 2022-01-10T01:23:31.015 INFO:teuthology.orchestra.run.smithi036.stdout: debug client = 20 2022-01-10T01:23:31.015 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:23:31.015 INFO:teuthology.orchestra.run.smithi036.stdout: rados mon op timeout = 15m 2022-01-10T01:23:31.015 INFO:teuthology.orchestra.run.smithi036.stdout: rados osd op timeout = 15m 2022-01-10T01:23:31.016 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.a] 2022-01-10T01:23:31.016 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.b] 2022-01-10T01:23:31.016 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.c] 2022-01-10T01:23:31.016 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.a] 2022-01-10T01:23:31.017 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.c] 2022-01-10T01:23:31.017 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.b] 2022-01-10T01:23:31.017 INFO:teuthology.orchestra.run.smithi036.stdout:[mds] 2022-01-10T01:23:31.017 INFO:teuthology.orchestra.run.smithi036.stdout: debug mds = 20 2022-01-10T01:23:31.017 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:23:31.018 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal frag = True 2022-01-10T01:23:31.018 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal fragment size max = 10000 2022-01-10T01:23:31.018 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal merge size = 5 2022-01-10T01:23:31.018 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal split bits = 3 2022-01-10T01:23:31.019 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal split size = 100 2022-01-10T01:23:31.019 INFO:teuthology.orchestra.run.smithi036.stdout: mds debug frag = True 2022-01-10T01:23:31.019 INFO:teuthology.orchestra.run.smithi036.stdout: mds debug scatterstat = True 2022-01-10T01:23:31.019 INFO:teuthology.orchestra.run.smithi036.stdout: mds op complaint time = 180 2022-01-10T01:23:31.019 INFO:teuthology.orchestra.run.smithi036.stdout: mds verify scatter = True 2022-01-10T01:23:31.020 INFO:teuthology.orchestra.run.smithi036.stdout: osd op complaint time = 180 2022-01-10T01:23:31.020 INFO:teuthology.orchestra.run.smithi036.stdout: rados mon op timeout = 15m 2022-01-10T01:23:31.020 INFO:teuthology.orchestra.run.smithi036.stdout: rados osd op timeout = 15m 2022-01-10T01:23:31.023 INFO:teuthology.orchestra.run.smithi166.stdout:[global] 2022-01-10T01:23:31.023 INFO:teuthology.orchestra.run.smithi166.stdout: chdir = "" 2022-01-10T01:23:31.024 INFO:teuthology.orchestra.run.smithi166.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-10T01:23:31.024 INFO:teuthology.orchestra.run.smithi166.stdout: auth supported = cephx 2022-01-10T01:23:31.024 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.024 INFO:teuthology.orchestra.run.smithi166.stdout: filestore xattr use omap = true 2022-01-10T01:23:31.025 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.025 INFO:teuthology.orchestra.run.smithi166.stdout: mon clock drift allowed = 1.000 2022-01-10T01:23:31.025 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.025 INFO:teuthology.orchestra.run.smithi166.stdout: osd crush chooseleaf type = 0 2022-01-10T01:23:31.025 INFO:teuthology.orchestra.run.smithi166.stdout: auth debug = true 2022-01-10T01:23:31.026 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.026 INFO:teuthology.orchestra.run.smithi166.stdout: ms die on old message = true 2022-01-10T01:23:31.026 INFO:teuthology.orchestra.run.smithi166.stdout: ms die on bug = true 2022-01-10T01:23:31.026 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.027 INFO:teuthology.orchestra.run.smithi166.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-10T01:23:31.027 INFO:teuthology.orchestra.run.smithi166.stdout: mon pg warn max object skew = 0 2022-01-10T01:23:31.027 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.027 INFO:teuthology.orchestra.run.smithi166.stdout: # disable pg_autoscaler by default for new pools 2022-01-10T01:23:31.027 INFO:teuthology.orchestra.run.smithi166.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-10T01:23:31.028 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.028 INFO:teuthology.orchestra.run.smithi166.stdout: osd pool default size = 2 2022-01-10T01:23:31.028 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.028 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd allow primary affinity = true 2022-01-10T01:23:31.029 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd allow pg remap = true 2022-01-10T01:23:31.029 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on legacy crush tunables = false 2022-01-10T01:23:31.029 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on crush straw calc version zero = false 2022-01-10T01:23:31.029 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on no sortbitwise = false 2022-01-10T01:23:31.029 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on osd down out interval zero = false 2022-01-10T01:23:31.030 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on too few osds = false 2022-01-10T01:23:31.030 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-10T01:23:31.030 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-10T01:23:31.030 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.031 INFO:teuthology.orchestra.run.smithi166.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-10T01:23:31.031 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.031 INFO:teuthology.orchestra.run.smithi166.stdout: osd default data pool replay window = 5 2022-01-10T01:23:31.031 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.031 INFO:teuthology.orchestra.run.smithi166.stdout: mon allow pool delete = true 2022-01-10T01:23:31.032 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.032 INFO:teuthology.orchestra.run.smithi166.stdout: mon cluster log file level = debug 2022-01-10T01:23:31.032 INFO:teuthology.orchestra.run.smithi166.stdout: debug asserts on shutdown = true 2022-01-10T01:23:31.032 INFO:teuthology.orchestra.run.smithi166.stdout: mon health detail to clog = false 2022-01-10T01:23:31.033 INFO:teuthology.orchestra.run.smithi166.stdout: mon host = "172.21.15.36,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2022-01-10T01:23:31.033 INFO:teuthology.orchestra.run.smithi166.stdout: fsid = 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762 2022-01-10T01:23:31.033 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.033 INFO:teuthology.orchestra.run.smithi166.stdout:[osd] 2022-01-10T01:23:31.034 INFO:teuthology.orchestra.run.smithi166.stdout: osd journal size = 100 2022-01-10T01:23:31.034 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.034 INFO:teuthology.orchestra.run.smithi166.stdout: osd scrub load threshold = 5.0 2022-01-10T01:23:31.034 INFO:teuthology.orchestra.run.smithi166.stdout: osd scrub max interval = 600 2022-01-10T01:23:31.034 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.035 INFO:teuthology.orchestra.run.smithi166.stdout: osd recover clone overlap = true 2022-01-10T01:23:31.035 INFO:teuthology.orchestra.run.smithi166.stdout: osd recovery max chunk = 1048576 2022-01-10T01:23:31.035 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.035 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug shutdown = true 2022-01-10T01:23:31.036 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug op order = true 2022-01-10T01:23:31.036 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug verify stray on activate = true 2022-01-10T01:23:31.036 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.036 INFO:teuthology.orchestra.run.smithi166.stdout: osd open classes on start = true 2022-01-10T01:23:31.036 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug pg log writeout = true 2022-01-10T01:23:31.037 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.037 INFO:teuthology.orchestra.run.smithi166.stdout: osd deep scrub update digest min age = 30 2022-01-10T01:23:31.037 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.037 INFO:teuthology.orchestra.run.smithi166.stdout: osd map max advance = 10 2022-01-10T01:23:31.038 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.038 INFO:teuthology.orchestra.run.smithi166.stdout: journal zero on create = true 2022-01-10T01:23:31.038 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.038 INFO:teuthology.orchestra.run.smithi166.stdout: filestore ondisk finisher threads = 3 2022-01-10T01:23:31.038 INFO:teuthology.orchestra.run.smithi166.stdout: filestore apply finisher threads = 3 2022-01-10T01:23:31.039 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.039 INFO:teuthology.orchestra.run.smithi166.stdout: bdev debug aio = true 2022-01-10T01:23:31.039 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug misdirected ops = true 2022-01-10T01:23:31.039 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore block size = 96636764160 2022-01-10T01:23:31.040 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore compression mode = aggressive 2022-01-10T01:23:31.040 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore fsck on mount = True 2022-01-10T01:23:31.040 INFO:teuthology.orchestra.run.smithi166.stdout: debug bluefs = 20 2022-01-10T01:23:31.040 INFO:teuthology.orchestra.run.smithi166.stdout: debug bluestore = 20 2022-01-10T01:23:31.040 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:23:31.041 INFO:teuthology.orchestra.run.smithi166.stdout: debug osd = 20 2022-01-10T01:23:31.041 INFO:teuthology.orchestra.run.smithi166.stdout: debug rocksdb = 10 2022-01-10T01:23:31.041 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd backfillfull_ratio = 0.85 2022-01-10T01:23:31.041 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd full ratio = 0.9 2022-01-10T01:23:31.042 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd nearfull ratio = 0.8 2022-01-10T01:23:31.042 INFO:teuthology.orchestra.run.smithi166.stdout: osd failsafe full ratio = 0.95 2022-01-10T01:23:31.042 INFO:teuthology.orchestra.run.smithi166.stdout: osd objectstore = bluestore 2022-01-10T01:23:31.042 INFO:teuthology.orchestra.run.smithi166.stdout: osd op complaint time = 180 2022-01-10T01:23:31.043 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.043 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr] 2022-01-10T01:23:31.043 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:23:31.043 INFO:teuthology.orchestra.run.smithi166.stdout: debug mgr = 20 2022-01-10T01:23:31.043 INFO:teuthology.orchestra.run.smithi166.stdout: debug mon = 20 2022-01-10T01:23:31.044 INFO:teuthology.orchestra.run.smithi166.stdout: debug auth = 20 2022-01-10T01:23:31.044 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:23:31.044 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:23:31.044 INFO:teuthology.orchestra.run.smithi166.stdout: mgr/telemetry/nag = false 2022-01-10T01:23:31.045 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.045 INFO:teuthology.orchestra.run.smithi166.stdout:[mon] 2022-01-10T01:23:31.045 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:23:31.045 INFO:teuthology.orchestra.run.smithi166.stdout: debug mon = 20 2022-01-10T01:23:31.045 INFO:teuthology.orchestra.run.smithi166.stdout: debug paxos = 20 2022-01-10T01:23:31.046 INFO:teuthology.orchestra.run.smithi166.stdout: debug auth = 20 2022-01-10T01:23:31.046 INFO:teuthology.orchestra.run.smithi166.stdout: mon data avail warn = 5 2022-01-10T01:23:31.046 INFO:teuthology.orchestra.run.smithi166.stdout: mon mgr mkfs grace = 240 2022-01-10T01:23:31.046 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:23:31.047 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd reporter subtree level = osd 2022-01-10T01:23:31.047 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd prime pg temp = true 2022-01-10T01:23:31.047 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:23:31.047 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.047 INFO:teuthology.orchestra.run.smithi166.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-10T01:23:31.048 INFO:teuthology.orchestra.run.smithi166.stdout: auth mon ticket ttl = 660 # 11m 2022-01-10T01:23:31.048 INFO:teuthology.orchestra.run.smithi166.stdout: auth service ticket ttl = 240 # 4m 2022-01-10T01:23:31.048 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.048 INFO:teuthology.orchestra.run.smithi166.stdout: # don't complain about insecure global_id in the test suite 2022-01-10T01:23:31.048 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-10T01:23:31.049 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-10T01:23:31.049 INFO:teuthology.orchestra.run.smithi166.stdout: mon op complaint time = 120 2022-01-10T01:23:31.049 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:23:31.049 INFO:teuthology.orchestra.run.smithi166.stdout:[client] 2022-01-10T01:23:31.050 INFO:teuthology.orchestra.run.smithi166.stdout: rgw cache enabled = true 2022-01-10T01:23:31.050 INFO:teuthology.orchestra.run.smithi166.stdout: rgw enable ops log = true 2022-01-10T01:23:31.050 INFO:teuthology.orchestra.run.smithi166.stdout: rgw enable usage log = true 2022-01-10T01:23:31.050 INFO:teuthology.orchestra.run.smithi166.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-10T01:23:31.050 INFO:teuthology.orchestra.run.smithi166.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-10T01:23:31.051 INFO:teuthology.orchestra.run.smithi166.stdout: client mount timeout = 600 2022-01-10T01:23:31.051 INFO:teuthology.orchestra.run.smithi166.stdout: debug client = 20 2022-01-10T01:23:31.051 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:23:31.051 INFO:teuthology.orchestra.run.smithi166.stdout: rados mon op timeout = 15m 2022-01-10T01:23:31.052 INFO:teuthology.orchestra.run.smithi166.stdout: rados osd op timeout = 15m 2022-01-10T01:23:31.052 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.a] 2022-01-10T01:23:31.052 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.b] 2022-01-10T01:23:31.052 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.c] 2022-01-10T01:23:31.052 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.a] 2022-01-10T01:23:31.053 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.c] 2022-01-10T01:23:31.053 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.b] 2022-01-10T01:23:31.053 INFO:teuthology.orchestra.run.smithi166.stdout:[mds] 2022-01-10T01:23:31.053 INFO:teuthology.orchestra.run.smithi166.stdout: debug mds = 20 2022-01-10T01:23:31.054 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:23:31.054 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal frag = True 2022-01-10T01:23:31.054 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal fragment size max = 10000 2022-01-10T01:23:31.054 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal merge size = 5 2022-01-10T01:23:31.054 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal split bits = 3 2022-01-10T01:23:31.055 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal split size = 100 2022-01-10T01:23:31.055 INFO:teuthology.orchestra.run.smithi166.stdout: mds debug frag = True 2022-01-10T01:23:31.055 INFO:teuthology.orchestra.run.smithi166.stdout: mds debug scatterstat = True 2022-01-10T01:23:31.055 INFO:teuthology.orchestra.run.smithi166.stdout: mds op complaint time = 180 2022-01-10T01:23:31.056 INFO:teuthology.orchestra.run.smithi166.stdout: mds verify scatter = True 2022-01-10T01:23:31.056 INFO:teuthology.orchestra.run.smithi166.stdout: osd op complaint time = 180 2022-01-10T01:23:31.056 INFO:teuthology.orchestra.run.smithi166.stdout: rados mon op timeout = 15m 2022-01-10T01:23:31.056 INFO:teuthology.orchestra.run.smithi166.stdout: rados osd op timeout = 15m 2022-01-10T01:23:31.056 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2022-01-10T01:23:31.057 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2022-01-10T01:23:31.057 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-10T01:23:31.057 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2022-01-10T01:23:31.057 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.058 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2022-01-10T01:23:31.058 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.058 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2022-01-10T01:23:31.058 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.059 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2022-01-10T01:23:31.059 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2022-01-10T01:23:31.059 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.059 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2022-01-10T01:23:31.059 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2022-01-10T01:23:31.060 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.060 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-10T01:23:31.060 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2022-01-10T01:23:31.060 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.061 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2022-01-10T01:23:31.061 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-10T01:23:31.061 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.061 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2022-01-10T01:23:31.061 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.062 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2022-01-10T01:23:31.062 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2022-01-10T01:23:31.062 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2022-01-10T01:23:31.063 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2022-01-10T01:23:31.063 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2022-01-10T01:23:31.063 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2022-01-10T01:23:31.063 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2022-01-10T01:23:31.064 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-10T01:23:31.064 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-10T01:23:31.064 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.064 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-10T01:23:31.064 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.065 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2022-01-10T01:23:31.065 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.065 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2022-01-10T01:23:31.065 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.066 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2022-01-10T01:23:31.066 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2022-01-10T01:23:31.066 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2022-01-10T01:23:31.066 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = "172.21.15.36,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2022-01-10T01:23:31.066 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762 2022-01-10T01:23:31.067 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.067 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2022-01-10T01:23:31.067 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2022-01-10T01:23:31.067 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.068 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2022-01-10T01:23:31.068 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2022-01-10T01:23:31.068 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.068 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2022-01-10T01:23:31.069 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2022-01-10T01:23:31.069 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.069 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2022-01-10T01:23:31.069 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2022-01-10T01:23:31.069 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2022-01-10T01:23:31.070 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.070 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2022-01-10T01:23:31.070 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2022-01-10T01:23:31.070 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.071 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2022-01-10T01:23:31.071 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.071 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2022-01-10T01:23:31.071 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.071 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2022-01-10T01:23:31.072 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.072 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2022-01-10T01:23:31.072 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2022-01-10T01:23:31.072 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.073 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2022-01-10T01:23:31.073 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2022-01-10T01:23:31.073 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore block size = 96636764160 2022-01-10T01:23:31.073 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore compression mode = aggressive 2022-01-10T01:23:31.073 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore fsck on mount = True 2022-01-10T01:23:31.074 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluefs = 20 2022-01-10T01:23:31.074 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluestore = 20 2022-01-10T01:23:31.074 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:23:31.074 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2022-01-10T01:23:31.075 INFO:teuthology.orchestra.run.smithi139.stdout: debug rocksdb = 10 2022-01-10T01:23:31.075 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd backfillfull_ratio = 0.85 2022-01-10T01:23:31.075 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd full ratio = 0.9 2022-01-10T01:23:31.075 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd nearfull ratio = 0.8 2022-01-10T01:23:31.075 INFO:teuthology.orchestra.run.smithi139.stdout: osd failsafe full ratio = 0.95 2022-01-10T01:23:31.076 INFO:teuthology.orchestra.run.smithi139.stdout: osd objectstore = bluestore 2022-01-10T01:23:31.076 INFO:teuthology.orchestra.run.smithi139.stdout: osd op complaint time = 180 2022-01-10T01:23:31.076 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.076 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2022-01-10T01:23:31.077 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:23:31.077 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2022-01-10T01:23:31.077 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2022-01-10T01:23:31.077 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2022-01-10T01:23:31.077 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:23:31.078 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:23:31.078 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2022-01-10T01:23:31.078 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.078 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2022-01-10T01:23:31.079 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:23:31.079 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2022-01-10T01:23:31.079 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2022-01-10T01:23:31.079 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2022-01-10T01:23:31.079 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2022-01-10T01:23:31.080 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2022-01-10T01:23:31.080 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:23:31.080 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2022-01-10T01:23:31.080 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2022-01-10T01:23:31.081 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:23:31.081 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.081 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-10T01:23:31.081 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2022-01-10T01:23:31.081 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2022-01-10T01:23:31.082 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.082 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2022-01-10T01:23:31.082 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-10T01:23:31.082 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-10T01:23:31.087 INFO:teuthology.orchestra.run.smithi139.stdout: mon op complaint time = 120 2022-01-10T01:23:31.087 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:23:31.087 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2022-01-10T01:23:31.088 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2022-01-10T01:23:31.088 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2022-01-10T01:23:31.088 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2022-01-10T01:23:31.088 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-10T01:23:31.089 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-10T01:23:31.089 INFO:teuthology.orchestra.run.smithi139.stdout: client mount timeout = 600 2022-01-10T01:23:31.089 INFO:teuthology.orchestra.run.smithi139.stdout: debug client = 20 2022-01-10T01:23:31.089 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:23:31.089 INFO:teuthology.orchestra.run.smithi139.stdout: rados mon op timeout = 15m 2022-01-10T01:23:31.090 INFO:teuthology.orchestra.run.smithi139.stdout: rados osd op timeout = 15m 2022-01-10T01:23:31.090 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2022-01-10T01:23:31.090 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.b] 2022-01-10T01:23:31.090 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.c] 2022-01-10T01:23:31.091 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2022-01-10T01:23:31.091 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.c] 2022-01-10T01:23:31.091 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2022-01-10T01:23:31.091 INFO:teuthology.orchestra.run.smithi139.stdout:[mds] 2022-01-10T01:23:31.091 INFO:teuthology.orchestra.run.smithi139.stdout: debug mds = 20 2022-01-10T01:23:31.092 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:23:31.092 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal frag = True 2022-01-10T01:23:31.092 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal fragment size max = 10000 2022-01-10T01:23:31.092 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal merge size = 5 2022-01-10T01:23:31.093 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal split bits = 3 2022-01-10T01:23:31.093 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal split size = 100 2022-01-10T01:23:31.093 INFO:teuthology.orchestra.run.smithi139.stdout: mds debug frag = True 2022-01-10T01:23:31.093 INFO:teuthology.orchestra.run.smithi139.stdout: mds debug scatterstat = True 2022-01-10T01:23:31.093 INFO:teuthology.orchestra.run.smithi139.stdout: mds op complaint time = 180 2022-01-10T01:23:31.094 INFO:teuthology.orchestra.run.smithi139.stdout: mds verify scatter = True 2022-01-10T01:23:31.094 INFO:teuthology.orchestra.run.smithi139.stdout: osd op complaint time = 180 2022-01-10T01:23:31.094 INFO:teuthology.orchestra.run.smithi139.stdout: rados mon op timeout = 15m 2022-01-10T01:23:31.094 INFO:teuthology.orchestra.run.smithi139.stdout: rados osd op timeout = 15m 2022-01-10T01:23:31.095 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2022-01-10T01:23:31.095 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2022-01-10T01:23:31.095 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-10T01:23:31.095 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2022-01-10T01:23:31.095 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.096 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2022-01-10T01:23:31.096 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.096 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2022-01-10T01:23:31.096 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.097 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2022-01-10T01:23:31.097 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2022-01-10T01:23:31.097 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.097 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2022-01-10T01:23:31.097 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2022-01-10T01:23:31.098 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.098 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-10T01:23:31.098 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2022-01-10T01:23:31.098 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.099 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2022-01-10T01:23:31.099 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-10T01:23:31.099 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.099 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2022-01-10T01:23:31.099 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.100 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2022-01-10T01:23:31.100 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2022-01-10T01:23:31.100 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2022-01-10T01:23:31.100 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2022-01-10T01:23:31.100 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2022-01-10T01:23:31.101 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2022-01-10T01:23:31.101 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2022-01-10T01:23:31.101 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-10T01:23:31.101 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-10T01:23:31.102 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.102 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-10T01:23:31.102 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.102 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2022-01-10T01:23:31.103 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.103 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2022-01-10T01:23:31.103 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.103 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2022-01-10T01:23:31.103 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2022-01-10T01:23:31.104 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2022-01-10T01:23:31.104 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.36,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2022-01-10T01:23:31.104 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762 2022-01-10T01:23:31.104 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.104 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2022-01-10T01:23:31.105 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2022-01-10T01:23:31.105 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.105 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2022-01-10T01:23:31.105 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2022-01-10T01:23:31.106 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.106 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2022-01-10T01:23:31.106 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2022-01-10T01:23:31.106 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.106 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2022-01-10T01:23:31.107 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2022-01-10T01:23:31.107 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2022-01-10T01:23:31.107 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.107 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2022-01-10T01:23:31.108 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2022-01-10T01:23:31.108 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.108 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2022-01-10T01:23:31.108 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.108 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2022-01-10T01:23:31.109 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.109 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2022-01-10T01:23:31.109 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.109 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2022-01-10T01:23:31.109 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2022-01-10T01:23:31.110 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.110 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2022-01-10T01:23:31.110 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2022-01-10T01:23:31.110 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2022-01-10T01:23:31.111 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore compression mode = aggressive 2022-01-10T01:23:31.111 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2022-01-10T01:23:31.111 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 20 2022-01-10T01:23:31.111 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 20 2022-01-10T01:23:31.111 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:23:31.112 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2022-01-10T01:23:31.112 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 10 2022-01-10T01:23:31.112 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2022-01-10T01:23:31.112 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2022-01-10T01:23:31.113 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2022-01-10T01:23:31.113 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2022-01-10T01:23:31.113 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2022-01-10T01:23:31.113 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2022-01-10T01:23:31.113 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.114 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2022-01-10T01:23:31.114 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:23:31.114 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2022-01-10T01:23:31.114 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2022-01-10T01:23:31.115 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2022-01-10T01:23:31.115 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:23:31.115 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:23:31.115 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2022-01-10T01:23:31.115 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.116 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2022-01-10T01:23:31.116 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:23:31.116 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2022-01-10T01:23:31.116 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2022-01-10T01:23:31.116 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2022-01-10T01:23:31.117 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2022-01-10T01:23:31.117 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2022-01-10T01:23:31.117 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:23:31.117 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2022-01-10T01:23:31.118 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2022-01-10T01:23:31.118 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:23:31.118 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.118 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-10T01:23:31.118 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2022-01-10T01:23:31.119 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2022-01-10T01:23:31.119 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.119 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2022-01-10T01:23:31.119 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-10T01:23:31.120 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-10T01:23:31.120 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2022-01-10T01:23:31.120 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:23:31.120 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2022-01-10T01:23:31.120 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2022-01-10T01:23:31.121 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2022-01-10T01:23:31.121 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2022-01-10T01:23:31.121 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-10T01:23:31.121 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-10T01:23:31.121 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2022-01-10T01:23:31.122 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2022-01-10T01:23:31.122 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:23:31.122 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 15m 2022-01-10T01:23:31.122 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 15m 2022-01-10T01:23:31.123 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2022-01-10T01:23:31.123 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2022-01-10T01:23:31.123 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2022-01-10T01:23:31.123 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2022-01-10T01:23:31.123 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2022-01-10T01:23:31.124 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2022-01-10T01:23:31.124 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2022-01-10T01:23:31.124 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2022-01-10T01:23:31.124 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:23:31.124 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal frag = True 2022-01-10T01:23:31.125 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal fragment size max = 10000 2022-01-10T01:23:31.125 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal merge size = 5 2022-01-10T01:23:31.125 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal split bits = 3 2022-01-10T01:23:31.125 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal split size = 100 2022-01-10T01:23:31.126 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2022-01-10T01:23:31.126 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = True 2022-01-10T01:23:31.126 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2022-01-10T01:23:31.126 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = True 2022-01-10T01:23:31.126 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2022-01-10T01:23:31.127 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 15m 2022-01-10T01:23:31.127 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 15m 2022-01-10T01:23:31.127 INFO:tasks.ceph:Creating admin key on mon.a... 2022-01-10T01:23:31.128 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-01-10T01:23:31.176 INFO:tasks.ceph:Copying monmap to all nodes... 2022-01-10T01:23:31.185 DEBUG:teuthology.orchestra.remote:smithi036:/etc/ceph/ceph.keyring is 206B 2022-01-10T01:23:31.208 DEBUG:teuthology.orchestra.remote:smithi036:/home/ubuntu/cephtest/ceph.monmap is 379B 2022-01-10T01:23:31.221 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi036.front.sepia.ceph.com 2022-01-10T01:23:31.222 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2022-01-10T01:23:31.222 DEBUG:teuthology.orchestra.run.smithi036:> sudo dd of=/etc/ceph/ceph.keyring 2022-01-10T01:23:31.223 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-01-10T01:23:31.249 DEBUG:teuthology.orchestra.run.smithi036:> set -ex 2022-01-10T01:23:31.249 DEBUG:teuthology.orchestra.run.smithi036:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:23:31.297 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi059.front.sepia.ceph.com 2022-01-10T01:23:31.298 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2022-01-10T01:23:31.299 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.keyring 2022-01-10T01:23:31.299 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-01-10T01:23:31.327 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2022-01-10T01:23:31.327 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:23:31.333 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi139.front.sepia.ceph.com 2022-01-10T01:23:31.334 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2022-01-10T01:23:31.334 DEBUG:teuthology.orchestra.run.smithi139:> sudo dd of=/etc/ceph/ceph.keyring 2022-01-10T01:23:31.334 DEBUG:teuthology.orchestra.run.smithi139:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-01-10T01:23:31.360 DEBUG:teuthology.orchestra.run.smithi139:> set -ex 2022-01-10T01:23:31.360 DEBUG:teuthology.orchestra.run.smithi139:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:23:31.409 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi166.front.sepia.ceph.com 2022-01-10T01:23:31.409 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-01-10T01:23:31.410 DEBUG:teuthology.orchestra.run.smithi166:> sudo dd of=/etc/ceph/ceph.keyring 2022-01-10T01:23:31.410 DEBUG:teuthology.orchestra.run.smithi166:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-01-10T01:23:31.436 DEBUG:teuthology.orchestra.run.smithi166:> set -ex 2022-01-10T01:23:31.437 DEBUG:teuthology.orchestra.run.smithi166:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:23:31.442 INFO:tasks.ceph:Setting up mon nodes... 2022-01-10T01:23:31.442 INFO:tasks.ceph:Setting up mgr nodes... 2022-01-10T01:23:31.443 DEBUG:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-01-10T01:23:31.488 INFO:teuthology.orchestra.run.smithi036.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-01-10T01:23:31.491 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-01-10T01:23:31.556 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-01-10T01:23:31.559 INFO:tasks.ceph:Setting up mds nodes... 2022-01-10T01:23:31.559 DEBUG:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-01-10T01:23:31.602 INFO:teuthology.orchestra.run.smithi036.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-01-10T01:23:31.605 DEBUG:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-01-10T01:23:31.663 DEBUG:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-01-10T01:23:31.706 INFO:teuthology.orchestra.run.smithi036.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-01-10T01:23:31.708 DEBUG:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-01-10T01:23:31.725 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-01-10T01:23:31.769 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-01-10T01:23:31.772 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-01-10T01:23:31.830 INFO:tasks.ceph_client:Setting up client nodes... 2022-01-10T01:23:31.831 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-01-10T01:23:31.882 INFO:teuthology.orchestra.run.smithi139.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-01-10T01:23:31.896 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2022-01-10T01:23:31.956 INFO:teuthology.orchestra.run.smithi166.stdout:creating /etc/ceph/ceph.client.1.keyring 2022-01-10T01:23:31.971 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-01-10T01:23:31.971 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi036.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-01-10T01:23:31.971 DEBUG:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-01-10T01:23:31.988 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-01-10T01:23:31.989 INFO:tasks.ceph:role: osd.0 2022-01-10T01:23:31.989 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi036.front.sepia.ceph.com 2022-01-10T01:23:31.989 DEBUG:teuthology.orchestra.run.smithi036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-01-10T01:23:32.530 INFO:teuthology.orchestra.run.smithi036.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-01-10T01:23:32.530 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-10T01:23:32.530 INFO:teuthology.orchestra.run.smithi036.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-10T01:23:32.531 INFO:teuthology.orchestra.run.smithi036.stdout: = reflink=1 2022-01-10T01:23:32.531 INFO:teuthology.orchestra.run.smithi036.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-10T01:23:32.531 INFO:teuthology.orchestra.run.smithi036.stdout: = sunit=0 swidth=0 blks 2022-01-10T01:23:32.531 INFO:teuthology.orchestra.run.smithi036.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-10T01:23:32.532 INFO:teuthology.orchestra.run.smithi036.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-10T01:23:32.532 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-10T01:23:32.532 INFO:teuthology.orchestra.run.smithi036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-10T01:23:32.533 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi036.front.sepia.ceph.com -o noatime 2022-01-10T01:23:32.534 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-01-10T01:23:32.637 DEBUG:teuthology.orchestra.run.smithi036:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-01-10T01:23:32.648 INFO:teuthology.orchestra.run.smithi036.stderr:sudo: /sbin/restorecon: command not found 2022-01-10T01:23:32.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:23:32.650 DEBUG:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-01-10T01:23:32.662 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-01-10T01:23:32.662 INFO:tasks.ceph:role: osd.1 2022-01-10T01:23:32.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi036.front.sepia.ceph.com 2022-01-10T01:23:32.663 DEBUG:teuthology.orchestra.run.smithi036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-01-10T01:23:33.188 INFO:teuthology.orchestra.run.smithi036.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-01-10T01:23:33.190 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-10T01:23:33.190 INFO:teuthology.orchestra.run.smithi036.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-10T01:23:33.191 INFO:teuthology.orchestra.run.smithi036.stdout: = reflink=1 2022-01-10T01:23:33.191 INFO:teuthology.orchestra.run.smithi036.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-10T01:23:33.191 INFO:teuthology.orchestra.run.smithi036.stdout: = sunit=0 swidth=0 blks 2022-01-10T01:23:33.191 INFO:teuthology.orchestra.run.smithi036.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-10T01:23:33.192 INFO:teuthology.orchestra.run.smithi036.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-10T01:23:33.192 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-10T01:23:33.192 INFO:teuthology.orchestra.run.smithi036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-10T01:23:33.193 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi036.front.sepia.ceph.com -o noatime 2022-01-10T01:23:33.194 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-01-10T01:23:33.230 DEBUG:teuthology.orchestra.run.smithi036:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-01-10T01:23:33.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:23:33.242 INFO:teuthology.orchestra.run.smithi036.stderr:sudo: /sbin/restorecon: command not found 2022-01-10T01:23:33.242 DEBUG:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-01-10T01:23:33.299 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-01-10T01:23:33.300 INFO:tasks.ceph:role: osd.2 2022-01-10T01:23:33.300 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi036.front.sepia.ceph.com 2022-01-10T01:23:33.300 DEBUG:teuthology.orchestra.run.smithi036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-01-10T01:23:33.774 INFO:teuthology.orchestra.run.smithi036.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-01-10T01:23:33.775 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-10T01:23:33.775 INFO:teuthology.orchestra.run.smithi036.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-10T01:23:33.775 INFO:teuthology.orchestra.run.smithi036.stdout: = reflink=1 2022-01-10T01:23:33.776 INFO:teuthology.orchestra.run.smithi036.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-10T01:23:33.776 INFO:teuthology.orchestra.run.smithi036.stdout: = sunit=0 swidth=0 blks 2022-01-10T01:23:33.776 INFO:teuthology.orchestra.run.smithi036.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-10T01:23:33.776 INFO:teuthology.orchestra.run.smithi036.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-10T01:23:33.777 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-10T01:23:33.777 INFO:teuthology.orchestra.run.smithi036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-10T01:23:33.778 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi036.front.sepia.ceph.com -o noatime 2022-01-10T01:23:33.778 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-01-10T01:23:33.833 DEBUG:teuthology.orchestra.run.smithi036:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-01-10T01:23:33.845 INFO:teuthology.orchestra.run.smithi036.stderr:sudo: /sbin/restorecon: command not found 2022-01-10T01:23:33.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:23:33.847 DEBUG:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-01-10T01:23:33.857 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-01-10T01:23:33.858 INFO:tasks.ceph:role: osd.3 2022-01-10T01:23:33.858 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi036.front.sepia.ceph.com 2022-01-10T01:23:33.858 DEBUG:teuthology.orchestra.run.smithi036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-01-10T01:23:34.356 INFO:teuthology.orchestra.run.smithi036.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-01-10T01:23:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-10T01:23:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-10T01:23:34.357 INFO:teuthology.orchestra.run.smithi036.stdout: = reflink=1 2022-01-10T01:23:34.357 INFO:teuthology.orchestra.run.smithi036.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-10T01:23:34.358 INFO:teuthology.orchestra.run.smithi036.stdout: = sunit=0 swidth=0 blks 2022-01-10T01:23:34.358 INFO:teuthology.orchestra.run.smithi036.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-10T01:23:34.358 INFO:teuthology.orchestra.run.smithi036.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-10T01:23:34.358 INFO:teuthology.orchestra.run.smithi036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-10T01:23:34.359 INFO:teuthology.orchestra.run.smithi036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-10T01:23:34.360 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi036.front.sepia.ceph.com -o noatime 2022-01-10T01:23:34.360 DEBUG:teuthology.orchestra.run.smithi036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-01-10T01:23:34.417 DEBUG:teuthology.orchestra.run.smithi036:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-01-10T01:23:34.427 INFO:teuthology.orchestra.run.smithi036.stderr:sudo: /sbin/restorecon: command not found 2022-01-10T01:23:34.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:23:34.429 DEBUG:teuthology.orchestra.run.smithi036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:23:34.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:34.490+0000 7f212bb2bd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-01-10T01:23:34.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:34.494+0000 7f212bb2bd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-01-10T01:23:34.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:34.494+0000 7f212bb2bd80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-01-10T01:23:34.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:34.494+0000 7f212bb2bd80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-01-10T01:23:34.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:34.494+0000 7f212bb2bd80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-01-10T01:23:34.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:34.498+0000 7f212bb2bd80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-01-10T01:23:34.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:34.522+0000 7f212bb2bd80 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-10T01:23:36.958 DEBUG:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-01-10T01:23:36.975 DEBUG:teuthology.orchestra.run.smithi036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:23:37.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:37.006+0000 7f5d592b5d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-01-10T01:23:37.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:37.006+0000 7f5d592b5d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-01-10T01:23:37.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:37.006+0000 7f5d592b5d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-01-10T01:23:37.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:37.006+0000 7f5d592b5d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-01-10T01:23:37.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:37.006+0000 7f5d592b5d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-01-10T01:23:37.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:37.006+0000 7f5d592b5d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-01-10T01:23:37.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:37.022+0000 7f5d592b5d80 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-10T01:23:39.450 DEBUG:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-01-10T01:23:39.467 DEBUG:teuthology.orchestra.run.smithi036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:23:39.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:39.546+0000 7fdc64a11d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-01-10T01:23:39.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:39.546+0000 7fdc64a11d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-01-10T01:23:39.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:39.546+0000 7fdc64a11d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-01-10T01:23:39.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:39.546+0000 7fdc64a11d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-01-10T01:23:39.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:39.546+0000 7fdc64a11d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-01-10T01:23:39.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:39.550+0000 7fdc64a11d80 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-01-10T01:23:39.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:39.570+0000 7fdc64a11d80 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-10T01:23:42.009 DEBUG:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-01-10T01:23:42.026 DEBUG:teuthology.orchestra.run.smithi036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:23:42.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:42.058+0000 7f6f06d1cd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-01-10T01:23:42.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:42.058+0000 7f6f06d1cd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-01-10T01:23:42.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:42.058+0000 7f6f06d1cd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-01-10T01:23:42.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:42.058+0000 7f6f06d1cd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-01-10T01:23:42.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:42.058+0000 7f6f06d1cd80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-01-10T01:23:42.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:42.062+0000 7f6f06d1cd80 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-01-10T01:23:42.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:23:42.078+0000 7f6f06d1cd80 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-10T01:23:44.533 DEBUG:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-01-10T01:23:44.591 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-01-10T01:23:44.607 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-01-10T01:23:44.607 INFO:tasks.ceph:role: osd.4 2022-01-10T01:23:44.608 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com 2022-01-10T01:23:44.608 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-01-10T01:23:45.129 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-01-10T01:23:45.130 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-10T01:23:45.130 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-10T01:23:45.130 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 2022-01-10T01:23:45.131 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-10T01:23:45.131 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2022-01-10T01:23:45.131 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-10T01:23:45.131 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-10T01:23:45.132 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-10T01:23:45.132 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-10T01:23:45.133 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2022-01-10T01:23:45.133 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2022-01-10T01:23:45.234 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-01-10T01:23:45.246 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2022-01-10T01:23:45.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:23:45.248 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-01-10T01:23:45.259 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-01-10T01:23:45.260 INFO:tasks.ceph:role: osd.5 2022-01-10T01:23:45.260 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com 2022-01-10T01:23:45.261 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-01-10T01:23:45.795 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-01-10T01:23:45.795 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-10T01:23:45.795 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-10T01:23:45.796 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 2022-01-10T01:23:45.796 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-10T01:23:45.796 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2022-01-10T01:23:45.796 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-10T01:23:45.797 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-10T01:23:45.797 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-10T01:23:45.797 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-10T01:23:45.798 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2022-01-10T01:23:45.799 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-01-10T01:23:45.832 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-01-10T01:23:45.886 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2022-01-10T01:23:45.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:23:45.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-01-10T01:23:45.899 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-01-10T01:23:45.899 INFO:tasks.ceph:role: osd.6 2022-01-10T01:23:45.899 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com 2022-01-10T01:23:45.900 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-01-10T01:23:46.377 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-01-10T01:23:46.378 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-10T01:23:46.378 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-10T01:23:46.378 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 2022-01-10T01:23:46.378 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-10T01:23:46.379 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2022-01-10T01:23:46.379 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-10T01:23:46.379 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-10T01:23:46.379 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-10T01:23:46.379 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-10T01:23:46.380 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2022-01-10T01:23:46.381 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-01-10T01:23:46.437 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-01-10T01:23:46.447 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2022-01-10T01:23:46.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:23:46.449 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-01-10T01:23:46.460 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-01-10T01:23:46.461 INFO:tasks.ceph:role: osd.7 2022-01-10T01:23:46.461 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com 2022-01-10T01:23:46.461 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-01-10T01:23:46.963 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-01-10T01:23:46.964 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2022-01-10T01:23:46.964 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-01-10T01:23:46.964 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 2022-01-10T01:23:46.964 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-01-10T01:23:46.965 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2022-01-10T01:23:46.965 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-01-10T01:23:46.965 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-01-10T01:23:46.965 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-01-10T01:23:46.966 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-01-10T01:23:46.967 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2022-01-10T01:23:46.967 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2022-01-10T01:23:47.034 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-01-10T01:23:47.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:23:47.048 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2022-01-10T01:23:47.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:23:47.122 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:47.116+0000 7f3beb4c1d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-01-10T01:23:47.124 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:47.120+0000 7f3beb4c1d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-01-10T01:23:47.124 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:47.120+0000 7f3beb4c1d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-01-10T01:23:47.124 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:47.120+0000 7f3beb4c1d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-01-10T01:23:47.124 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:47.120+0000 7f3beb4c1d80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-01-10T01:23:47.133 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:47.128+0000 7f3beb4c1d80 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-01-10T01:23:47.165 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:47.160+0000 7f3beb4c1d80 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-10T01:23:49.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-01-10T01:23:49.600 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:23:49.641 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:49.636+0000 7f05bd987d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-01-10T01:23:49.641 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:49.636+0000 7f05bd987d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-01-10T01:23:49.641 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:49.636+0000 7f05bd987d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-01-10T01:23:49.642 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:49.636+0000 7f05bd987d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-01-10T01:23:49.642 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:49.636+0000 7f05bd987d80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-01-10T01:23:49.642 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:49.636+0000 7f05bd987d80 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-01-10T01:23:49.659 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:49.656+0000 7f05bd987d80 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-10T01:23:52.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-01-10T01:23:52.107 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:23:52.191 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:52.184+0000 7f4b586a9d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-01-10T01:23:52.191 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:52.184+0000 7f4b586a9d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-01-10T01:23:52.191 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:52.184+0000 7f4b586a9d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-01-10T01:23:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:52.184+0000 7f4b586a9d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-01-10T01:23:52.192 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:52.184+0000 7f4b586a9d80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-01-10T01:23:52.193 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:52.188+0000 7f4b586a9d80 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-01-10T01:23:52.208 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:52.204+0000 7f4b586a9d80 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-10T01:23:54.649 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-01-10T01:23:54.667 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:23:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:54.696+0000 7ffa79a58d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-01-10T01:23:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:54.696+0000 7ffa79a58d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-01-10T01:23:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:54.696+0000 7ffa79a58d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-01-10T01:23:54.703 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:54.696+0000 7ffa79a58d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-01-10T01:23:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:54.696+0000 7ffa79a58d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-01-10T01:23:54.704 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:54.700+0000 7ffa79a58d80 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-01-10T01:23:54.722 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:23:54.716+0000 7ffa79a58d80 -1 freelist read_size_meta_from_db missing size meta in DB 2022-01-10T01:23:57.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-01-10T01:23:57.197 INFO:tasks.ceph:Reading keys from all nodes... 2022-01-10T01:23:57.198 DEBUG:teuthology.orchestra.run.smithi036:> mktemp 2022-01-10T01:23:57.205 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.Mwfy2bN4MW 2022-01-10T01:23:57.205 DEBUG:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.Mwfy2bN4MW 2022-01-10T01:23:57.222 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.Mwfy2bN4MW 2022-01-10T01:23:57.301 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.Mwfy2bN4MW is 56B 2022-01-10T01:23:57.317 DEBUG:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.Mwfy2bN4MW 2022-01-10T01:23:57.324 DEBUG:teuthology.orchestra.run.smithi036:> mktemp 2022-01-10T01:23:57.377 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.t4jxPtkFPF 2022-01-10T01:23:57.378 DEBUG:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.t4jxPtkFPF 2022-01-10T01:23:57.394 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.t4jxPtkFPF 2022-01-10T01:23:57.414 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.t4jxPtkFPF is 56B 2022-01-10T01:23:57.428 DEBUG:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.t4jxPtkFPF 2022-01-10T01:23:57.435 DEBUG:teuthology.orchestra.run.smithi036:> mktemp 2022-01-10T01:23:57.481 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.o67wIQkjsb 2022-01-10T01:23:57.482 DEBUG:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/mds/ceph-c/keyring /tmp/tmp.o67wIQkjsb 2022-01-10T01:23:57.497 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.o67wIQkjsb 2022-01-10T01:23:57.520 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.o67wIQkjsb is 56B 2022-01-10T01:23:57.535 DEBUG:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.o67wIQkjsb 2022-01-10T01:23:57.541 DEBUG:teuthology.orchestra.run.smithi036:> mktemp 2022-01-10T01:23:57.593 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.WSeTl6QcGF 2022-01-10T01:23:57.593 DEBUG:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.WSeTl6QcGF 2022-01-10T01:23:57.610 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.WSeTl6QcGF 2022-01-10T01:23:57.630 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.WSeTl6QcGF is 56B 2022-01-10T01:23:57.644 DEBUG:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.WSeTl6QcGF 2022-01-10T01:23:57.650 DEBUG:teuthology.orchestra.run.smithi036:> mktemp 2022-01-10T01:23:57.697 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.bGtB5R94ta 2022-01-10T01:23:57.698 DEBUG:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.bGtB5R94ta 2022-01-10T01:23:57.713 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.bGtB5R94ta 2022-01-10T01:23:57.738 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.bGtB5R94ta is 56B 2022-01-10T01:23:57.751 DEBUG:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.bGtB5R94ta 2022-01-10T01:23:57.757 DEBUG:teuthology.orchestra.run.smithi036:> mktemp 2022-01-10T01:23:57.805 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.lDQi9DNp47 2022-01-10T01:23:57.806 DEBUG:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.lDQi9DNp47 2022-01-10T01:23:57.820 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.lDQi9DNp47 2022-01-10T01:23:57.889 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.lDQi9DNp47 is 56B 2022-01-10T01:23:57.905 DEBUG:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.lDQi9DNp47 2022-01-10T01:23:57.912 DEBUG:teuthology.orchestra.run.smithi036:> mktemp 2022-01-10T01:23:57.961 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.MQSdQCKhT6 2022-01-10T01:23:57.962 DEBUG:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.MQSdQCKhT6 2022-01-10T01:23:57.978 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.MQSdQCKhT6 2022-01-10T01:23:58.042 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.MQSdQCKhT6 is 56B 2022-01-10T01:23:58.056 DEBUG:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.MQSdQCKhT6 2022-01-10T01:23:58.063 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2022-01-10T01:23:58.069 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.6dKtGVye0W 2022-01-10T01:23:58.070 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.6dKtGVye0W 2022-01-10T01:23:58.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.6dKtGVye0W 2022-01-10T01:23:58.155 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.6dKtGVye0W is 56B 2022-01-10T01:23:58.168 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.6dKtGVye0W 2022-01-10T01:23:58.175 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2022-01-10T01:23:58.181 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.ulWhiJVCf2 2022-01-10T01:23:58.181 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.ulWhiJVCf2 2022-01-10T01:23:58.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.ulWhiJVCf2 2022-01-10T01:23:58.259 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.ulWhiJVCf2 is 56B 2022-01-10T01:23:58.271 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.ulWhiJVCf2 2022-01-10T01:23:58.278 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2022-01-10T01:23:58.325 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.EeVpfkBn1Y 2022-01-10T01:23:58.325 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.EeVpfkBn1Y 2022-01-10T01:23:58.340 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.EeVpfkBn1Y 2022-01-10T01:23:58.410 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.EeVpfkBn1Y is 56B 2022-01-10T01:23:58.425 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.EeVpfkBn1Y 2022-01-10T01:23:58.432 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2022-01-10T01:23:58.481 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.nG52w91ELy 2022-01-10T01:23:58.481 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.nG52w91ELy 2022-01-10T01:23:58.494 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.nG52w91ELy 2022-01-10T01:23:58.558 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.nG52w91ELy is 56B 2022-01-10T01:23:58.574 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.nG52w91ELy 2022-01-10T01:23:58.582 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2022-01-10T01:23:58.630 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.BONDndgfBt 2022-01-10T01:23:58.631 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.BONDndgfBt 2022-01-10T01:23:58.646 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.BONDndgfBt 2022-01-10T01:23:58.711 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.BONDndgfBt is 56B 2022-01-10T01:23:58.726 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.BONDndgfBt 2022-01-10T01:23:58.732 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2022-01-10T01:23:58.781 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.MPAuulGnK7 2022-01-10T01:23:58.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.MPAuulGnK7 2022-01-10T01:23:58.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.MPAuulGnK7 2022-01-10T01:23:58.862 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.MPAuulGnK7 is 56B 2022-01-10T01:23:58.877 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.MPAuulGnK7 2022-01-10T01:23:58.896 DEBUG:teuthology.orchestra.remote:smithi139:/etc/ceph/ceph.client.0.keyring is 59B 2022-01-10T01:23:58.923 DEBUG:teuthology.orchestra.remote:smithi166:/etc/ceph/ceph.client.1.keyring is 59B 2022-01-10T01:23:58.938 INFO:tasks.ceph:Adding keys to all mons... 2022-01-10T01:23:58.939 DEBUG:teuthology.orchestra.run.smithi036:> sudo tee -a /etc/ceph/ceph.keyring 2022-01-10T01:23:58.941 DEBUG:teuthology.orchestra.run.smithi059:> sudo tee -a /etc/ceph/ceph.keyring 2022-01-10T01:23:58.953 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr.y] 2022-01-10T01:23:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQCTitth4novHRAACVMjo72kOB/T7Ti/CiN27w== 2022-01-10T01:23:58.954 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.a] 2022-01-10T01:23:58.954 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQCTitthuGT4IxAA5DyijS4tPjdOLn5uiLXEPg== 2022-01-10T01:23:58.954 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.c] 2022-01-10T01:23:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQCTitthbvUmKhAA0pVpDJO1AfsAzIHU1cAHiw== 2022-01-10T01:23:58.955 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.0] 2022-01-10T01:23:58.955 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQCWitthk4iKHRAAF7aFP+i24xFvXXm8j5GzVg== 2022-01-10T01:23:58.955 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.1] 2022-01-10T01:23:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQCZitthsKSXABAAb3IkNvlyLub89HwaPWZ1Bg== 2022-01-10T01:23:58.956 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.2] 2022-01-10T01:23:58.956 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQCbitthvNzhIBAAXkZ6FslnMl1gS/rOa7G+Vg== 2022-01-10T01:23:58.956 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.3] 2022-01-10T01:23:58.957 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQCeitth9P7EAxAA7KOCP7Rh5oN1yqCz9I6v3A== 2022-01-10T01:23:58.957 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr.x] 2022-01-10T01:23:58.957 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQCTitth39syIRAA6pOvLWw2ADy72TWZ65MIkA== 2022-01-10T01:23:58.957 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.b] 2022-01-10T01:23:58.957 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQCTitthkvX0LRAAtz19usFvoObvouQeLFwicg== 2022-01-10T01:23:58.958 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.4] 2022-01-10T01:23:58.958 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQCjitth/L1UBxAAskxmSV0aE6CSvDFR8O/+SQ== 2022-01-10T01:23:58.958 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.5] 2022-01-10T01:23:58.958 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQClitthMoY6JhAAeeIrCmMcm3MpDPtdLUf+2g== 2022-01-10T01:23:58.959 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.6] 2022-01-10T01:23:58.959 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQCoitthrUhlCxAAsYhU7Kj6HMo/kD0DezvITg== 2022-01-10T01:23:58.959 INFO:teuthology.orchestra.run.smithi036.stdout:[osd.7] 2022-01-10T01:23:58.959 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQCqitthFaLrKRAAC2g1OlcV2KTtaOXsyCrIrQ== 2022-01-10T01:23:58.959 INFO:teuthology.orchestra.run.smithi036.stdout:[client.0] 2022-01-10T01:23:58.960 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQCTitthKoa/NBAADjvHh99F8YOktGID9uyttg== 2022-01-10T01:23:58.960 INFO:teuthology.orchestra.run.smithi036.stdout:[client.1] 2022-01-10T01:23:58.960 INFO:teuthology.orchestra.run.smithi036.stdout: key = AQCTitth3x76OBAAPTrw8OUmnpEflWuB7zzaHg== 2022-01-10T01:23:58.962 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.y] 2022-01-10T01:23:58.962 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCTitth4novHRAACVMjo72kOB/T7Ti/CiN27w== 2022-01-10T01:23:58.962 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2022-01-10T01:23:58.963 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCTitthuGT4IxAA5DyijS4tPjdOLn5uiLXEPg== 2022-01-10T01:23:58.963 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2022-01-10T01:23:58.963 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCTitthbvUmKhAA0pVpDJO1AfsAzIHU1cAHiw== 2022-01-10T01:23:58.963 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2022-01-10T01:23:58.964 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCWitthk4iKHRAAF7aFP+i24xFvXXm8j5GzVg== 2022-01-10T01:23:58.964 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2022-01-10T01:23:58.964 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCZitthsKSXABAAb3IkNvlyLub89HwaPWZ1Bg== 2022-01-10T01:23:58.964 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2022-01-10T01:23:58.964 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCbitthvNzhIBAAXkZ6FslnMl1gS/rOa7G+Vg== 2022-01-10T01:23:58.965 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2022-01-10T01:23:58.965 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCeitth9P7EAxAA7KOCP7Rh5oN1yqCz9I6v3A== 2022-01-10T01:23:58.965 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2022-01-10T01:23:58.965 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCTitth39syIRAA6pOvLWw2ADy72TWZ65MIkA== 2022-01-10T01:23:58.966 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2022-01-10T01:23:58.966 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCTitthkvX0LRAAtz19usFvoObvouQeLFwicg== 2022-01-10T01:23:58.966 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.4] 2022-01-10T01:23:58.966 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCjitth/L1UBxAAskxmSV0aE6CSvDFR8O/+SQ== 2022-01-10T01:23:58.966 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.5] 2022-01-10T01:23:58.967 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQClitthMoY6JhAAeeIrCmMcm3MpDPtdLUf+2g== 2022-01-10T01:23:58.967 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.6] 2022-01-10T01:23:58.967 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCoitthrUhlCxAAsYhU7Kj6HMo/kD0DezvITg== 2022-01-10T01:23:58.967 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.7] 2022-01-10T01:23:58.968 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCqitthFaLrKRAAC2g1OlcV2KTtaOXsyCrIrQ== 2022-01-10T01:23:58.968 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2022-01-10T01:23:58.968 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCTitthKoa/NBAADjvHh99F8YOktGID9uyttg== 2022-01-10T01:23:58.968 INFO:teuthology.orchestra.run.smithi059.stdout:[client.1] 2022-01-10T01:23:58.969 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCTitth3x76OBAAPTrw8OUmnpEflWuB7zzaHg== 2022-01-10T01:23:58.969 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-01-10T01:23:59.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-01-10T01:23:59.048 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-10T01:23:59.051 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-10T01:23:59.135 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-10T01:23:59.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-10T01:23:59.184 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.187 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.230 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.232 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.314 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.317 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.360 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.363 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.446 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-01-10T01:23:59.449 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-01-10T01:23:59.490 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-10T01:23:59.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-01-10T01:23:59.537 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.622 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.625 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.669 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.672 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.754 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.757 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2022-01-10T01:23:59.801 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-01-10T01:23:59.803 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-01-10T01:23:59.848 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-01-10T01:23:59.851 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-01-10T01:23:59.896 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-01-10T01:23:59.897 DEBUG:teuthology.orchestra.run.smithi036:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-01-10T01:23:59.911 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-01-10T01:24:00.030 DEBUG:teuthology.orchestra.run.smithi036:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-01-10T01:24:00.044 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-01-10T01:24:00.061 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-01-10T01:24:00.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-01-10T01:24:00.195 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-01-10T01:24:00.205 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-01-10T01:24:00.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-01-10T01:24:00.321 DEBUG:teuthology.orchestra.run.smithi036:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:24:00.323 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-01-10T01:24:00.329 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-01-10T01:24:00.329 INFO:tasks.ceph.mon.a:Restarting daemon 2022-01-10T01:24:00.330 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-01-10T01:24:00.373 INFO:tasks.ceph.mon.a:Started 2022-01-10T01:24:00.374 INFO:tasks.ceph.mon.b:Restarting daemon 2022-01-10T01:24:00.374 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-01-10T01:24:00.377 INFO:tasks.ceph.mon.b:Started 2022-01-10T01:24:00.377 INFO:tasks.ceph.mon.c:Restarting daemon 2022-01-10T01:24:00.378 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-01-10T01:24:00.380 INFO:tasks.ceph.mon.c:Started 2022-01-10T01:24:00.380 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-01-10T01:24:00.381 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-01-10T01:24:00.381 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-01-10T01:24:00.384 INFO:tasks.ceph.mgr.y:Started 2022-01-10T01:24:00.385 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-01-10T01:24:00.385 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-01-10T01:24:00.387 INFO:tasks.ceph.mgr.x:Started 2022-01-10T01:24:00.388 INFO:tasks.ceph:Setting crush tunables to default 2022-01-10T01:24:00.388 DEBUG:teuthology.orchestra.run.smithi036:> sudo ceph --cluster ceph osd crush tunables default 2022-01-10T01:24:00.410 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:24:00.441 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:24:00.444 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:24:00.447 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:24:00.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.501+0000 7fd97c8ee700 1 Processor -- start 2022-01-10T01:24:00.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.501+0000 7fd97c8ee700 1 -- start start 2022-01-10T01:24:00.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.501+0000 7fd97c8ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 0x7fd9780a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:00.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.501+0000 7fd97c8ee700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd978139bc0 con 0x7fd9780aca50 2022-01-10T01:24:00.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.501+0000 7fd97c8ee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd978140500 con 0x7fd9780b2c00 2022-01-10T01:24:00.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.501+0000 7fd97c8ee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9780b0130 con 0x7fd9780a95d0 2022-01-10T01:24:00.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.501+0000 7fd975d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd9780aca50 0x7fd9780a8a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59074/0 (socket says 172.21.15.36:59074) 2022-01-10T01:24:00.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.501+0000 7fd975d9b700 1 -- 172.21.15.36:0/1819212289 learned_addr learned my addr 172.21.15.36:0/1819212289 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:00.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.505+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 0x7fd9780a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:00.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.505+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 msgr2=0x7fd9780a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-01-10T01:24:00.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.505+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 msgr2=0x7fd9780a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:00.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.505+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 0x7fd9780a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:00.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.505+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 0x7fd9780a99b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:00.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.709+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 0x7fd9780a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:00.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.709+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 msgr2=0x7fd9780a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-01-10T01:24:00.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.709+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 msgr2=0x7fd9780a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:00.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.709+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 0x7fd9780a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:00.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:00.709+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 0x7fd9780a99b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-01-10T01:24:01.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:01.113+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 0x7fd9780a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:01.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:01.113+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 msgr2=0x7fd9780a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-01-10T01:24:01.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:01.113+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 msgr2=0x7fd9780a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:01.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:01.113+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 0x7fd9780a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:01.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:01.113+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 0x7fd9780a99b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-01-10T01:24:01.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:01.917+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 0x7fd9780a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:01.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:01.917+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 msgr2=0x7fd9780a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-01-10T01:24:01.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:01.917+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 msgr2=0x7fd9780a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:01.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:01.917+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 0x7fd9780a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:01.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:01.917+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 0x7fd9780a99b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-01-10T01:24:03.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.501+0000 7fd96ffff700 1 -- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 msgr2=0x7fd9780a99b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-01-10T01:24:03.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.501+0000 7fd96ffff700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9780a95d0 0x7fd9780a99b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:03.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.501+0000 7fd96ffff700 1 -- 172.21.15.36:0/1819212289 >> v1:172.21.15.59:6789/0 conn(0x7fd9780b2c00 legacy=0x7fd9780b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:03.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.501+0000 7fd96ffff700 1 -- 172.21.15.36:0/1819212289 >> v1:172.21.15.36:6789/0 conn(0x7fd9780aca50 legacy=0x7fd9780a8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:03.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.501+0000 7fd96ffff700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:03.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.501+0000 7fd96ffff700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 0x7fd95c008300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:03.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.501+0000 7fd96ffff700 1 -- 172.21.15.36:0/1819212289 --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9780b0130 con 0x7fd95c005e80 2022-01-10T01:24:03.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.501+0000 7fd96ffff700 1 -- 172.21.15.36:0/1819212289 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c008960 con 0x7fd95c003400 2022-01-10T01:24:03.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.505+0000 7fd975d9b700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 0x7fd95c008300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:03.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.505+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:03.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.505+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 msgr2=0x7fd95c005880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-01-10T01:24:03.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.505+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 msgr2=0x7fd95c005880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:03.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.505+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:03.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.505+0000 7fd975d9b700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 msgr2=0x7fd95c008300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-01-10T01:24:03.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.505+0000 7fd975d9b700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 msgr2=0x7fd95c008300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:03.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.505+0000 7fd975d9b700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 0x7fd95c008300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:03.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.505+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:03.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.505+0000 7fd975d9b700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 0x7fd95c008300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:03.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.709+0000 7fd975d9b700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 0x7fd95c008300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:03.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.709+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:03.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.709+0000 7fd975d9b700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 msgr2=0x7fd95c008300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-01-10T01:24:03.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.709+0000 7fd975d9b700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 msgr2=0x7fd95c008300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:03.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.709+0000 7fd975d9b700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 0x7fd95c008300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:03.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.709+0000 7fd975d9b700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 0x7fd95c008300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-01-10T01:24:03.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.709+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 msgr2=0x7fd95c005880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-01-10T01:24:03.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.709+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 msgr2=0x7fd95c005880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:03.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.709+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:03.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:03.709+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2022-01-10T01:24:04.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.113+0000 7fd975d9b700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 0x7fd95c008300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:04.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.113+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:04.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.113+0000 7fd975d9b700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 msgr2=0x7fd95c008300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-01-10T01:24:04.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.113+0000 7fd975d9b700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 msgr2=0x7fd95c008300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:04.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.113+0000 7fd975d9b700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 0x7fd95c008300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:04.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.113+0000 7fd975d9b700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 0x7fd95c008300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-01-10T01:24:04.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.113+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 msgr2=0x7fd95c005880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-01-10T01:24:04.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.113+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 msgr2=0x7fd95c005880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:04.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.113+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:04.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.113+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2022-01-10T01:24:04.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.917+0000 7fd975d9b700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 0x7fd95c008300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:04.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.917+0000 7fd975d9b700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 msgr2=0x7fd95c008300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-01-10T01:24:04.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.917+0000 7fd975d9b700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 msgr2=0x7fd95c008300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:04.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.917+0000 7fd975d9b700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 0x7fd95c008300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:04.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.917+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:04.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.917+0000 7fd975d9b700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 0x7fd95c008300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-01-10T01:24:04.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.917+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 msgr2=0x7fd95c005880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-01-10T01:24:04.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.917+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 msgr2=0x7fd95c005880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:04.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.917+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:04.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:04.917+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2022-01-10T01:24:06.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd96ffff700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 msgr2=0x7fd95c005880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-01-10T01:24:06.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd96ffff700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:06.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd96ffff700 1 -- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 msgr2=0x7fd95c008300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-01-10T01:24:06.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd96ffff700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.36:3300/0 conn(0x7fd95c005e80 0x7fd95c008300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:06.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd96ffff700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:06.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd976d9d700 1 -- 172.21.15.36:0/1819212289 reap_dead start 2022-01-10T01:24:06.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd96ffff700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c0062f0 0x7fd95c00c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:06.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd96ffff700 1 -- 172.21.15.36:0/1819212289 --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9780b03d0 con 0x7fd9780b2c00 2022-01-10T01:24:06.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd96ffff700 1 -- 172.21.15.36:0/1819212289 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9780b0130 con 0x7fd95c003400 2022-01-10T01:24:06.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd96ffff700 1 -- 172.21.15.36:0/1819212289 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c008960 con 0x7fd95c0062f0 2022-01-10T01:24:06.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> v2:172.21.15.59:3300/0 conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:06.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd976d9d700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c0062f0 0x7fd95c00c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:06.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd976d9d700 1 -- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c0062f0 msgr2=0x7fd95c00c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-01-10T01:24:06.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd976d9d700 1 -- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c0062f0 msgr2=0x7fd95c00c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:06.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd976d9d700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c0062f0 0x7fd95c00c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:06.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd976d9d700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c0062f0 0x7fd95c00c520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:06.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c0062f0 msgr2=0x7fd95c00c520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-01-10T01:24:06.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c0062f0 0x7fd95c00c520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:06.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 >> v1:172.21.15.59:6789/0 conn(0x7fd9780b2c00 legacy=0x7fd95c00ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:06.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97659c700 1 -- 172.21.15.36:0/1819212289 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c00db60 con 0x7fd95c003400 2022-01-10T01:24:06.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97659c700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95c003400 0x7fd95c005880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fd97000b000 tx=0x7fd970013730).ready entity=mon.1 client_cookie=9b6170a2c6d0630b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:06.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97559a700 1 -- 172.21.15.36:0/1819212289 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd970014c40 con 0x7fd95c003400 2022-01-10T01:24:06.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97559a700 1 -- 172.21.15.36:0/1819212289 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97001a030 con 0x7fd95c003400 2022-01-10T01:24:06.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97559a700 1 -- 172.21.15.36:0/1819212289 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd970020420 con 0x7fd95c003400 2022-01-10T01:24:06.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97c8ee700 1 -- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95c003400 msgr2=0x7fd95c005880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:06.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97c8ee700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95c003400 0x7fd95c005880 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fd97000b000 tx=0x7fd970013730).stop 2022-01-10T01:24:06.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97c8ee700 1 -- 172.21.15.36:0/1819212289 shutdown_connections 2022-01-10T01:24:06.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97c8ee700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c0062f0 0x7fd95c00c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:06.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97c8ee700 1 --2- 172.21.15.36:0/1819212289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95c003400 0x7fd95c005880 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:06.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97c8ee700 1 -- 172.21.15.36:0/1819212289 >> 172.21.15.36:0/1819212289 conn(0x7fd97805f6b0 msgr2=0x7fd97805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:06.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97c8ee700 1 -- 172.21.15.36:0/1819212289 shutdown_connections 2022-01-10T01:24:06.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.505+0000 7fd97c8ee700 1 -- 172.21.15.36:0/1819212289 wait complete. 2022-01-10T01:24:06.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97c8ee700 1 Processor -- start 2022-01-10T01:24:06.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97c8ee700 1 -- start start 2022-01-10T01:24:06.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97c8ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c003400 0x7fd97813a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:06.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97c8ee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95c0062f0 0x7fd97814e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:06.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97c8ee700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd9780b2c00 0x7fd97814e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:06.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97c8ee700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97813b360 con 0x7fd9780b2c00 2022-01-10T01:24:06.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97c8ee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97813c210 con 0x7fd95c0062f0 2022-01-10T01:24:06.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97c8ee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97813b590 con 0x7fd95c003400 2022-01-10T01:24:06.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd976d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd9780b2c00 0x7fd97814e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:06.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd975d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95c0062f0 0x7fd97814e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:06.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c003400 0x7fd97813a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:06.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd975d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95c0062f0 0x7fd97814e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:57982/0 (socket says 172.21.15.36:57982) 2022-01-10T01:24:06.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd975d9b700 1 -- 172.21.15.36:0/2036114543 learned_addr learned my addr 172.21.15.36:0/2036114543 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:06.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97659c700 1 -- 172.21.15.36:0/2036114543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c003400 msgr2=0x7fd97813a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-01-10T01:24:06.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97659c700 1 -- 172.21.15.36:0/2036114543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c003400 msgr2=0x7fd97813a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-01-10T01:24:06.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97659c700 1 --2- 172.21.15.36:0/2036114543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c003400 0x7fd97813a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:06.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97659c700 1 --2- 172.21.15.36:0/2036114543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c003400 0x7fd97813a0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:06.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd975d9b700 1 -- 172.21.15.36:0/2036114543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c003400 msgr2=0x7fd97813a0e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-01-10T01:24:06.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd975d9b700 1 --2- 172.21.15.36:0/2036114543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c003400 0x7fd97813a0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:06.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd975d9b700 1 -- 172.21.15.36:0/2036114543 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd9780b2c00 msgr2=0x7fd97814e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:06.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd975d9b700 1 --2- 172.21.15.36:0/2036114543 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd9780b2c00 0x7fd97814e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:06.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd975d9b700 1 -- 172.21.15.36:0/2036114543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9700139f0 con 0x7fd95c0062f0 2022-01-10T01:24:06.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd975d9b700 1 --2- 172.21.15.36:0/2036114543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95c0062f0 0x7fd97814e2e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fd9780afa40 tx=0x7fd968009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:06.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd96f7fe700 1 -- 172.21.15.36:0/2036114543 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd968001a20 con 0x7fd95c0062f0 2022-01-10T01:24:06.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97c8ee700 1 -- 172.21.15.36:0/2036114543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97813b830 con 0x7fd95c0062f0 2022-01-10T01:24:06.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd96f7fe700 1 -- 172.21.15.36:0/2036114543 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd968001b80 con 0x7fd95c0062f0 2022-01-10T01:24:06.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd96f7fe700 1 -- 172.21.15.36:0/2036114543 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd968017650 con 0x7fd95c0062f0 2022-01-10T01:24:06.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.509+0000 7fd97c8ee700 1 -- 172.21.15.36:0/2036114543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97813bd70 con 0x7fd95c0062f0 2022-01-10T01:24:06.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.513+0000 7fd96f7fe700 1 -- 172.21.15.36:0/2036114543 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fd968013040 con 0x7fd95c0062f0 2022-01-10T01:24:06.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.513+0000 7fd96f7fe700 1 -- 172.21.15.36:0/2036114543 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fd968020400 con 0x7fd95c0062f0 2022-01-10T01:24:06.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.513+0000 7fd97c8ee700 1 -- 172.21.15.36:0/2036114543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd978140190 con 0x7fd95c0062f0 2022-01-10T01:24:06.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.517+0000 7fd96f7fe700 1 -- 172.21.15.36:0/2036114543 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fd968020690 con 0x7fd95c0062f0 2022-01-10T01:24:06.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.585+0000 7fd97c8ee700 1 -- 172.21.15.36:0/2036114543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd978140190 con 0x7fd95c0062f0 2022-01-10T01:24:06.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.597+0000 7fd96f7fe700 1 -- 172.21.15.36:0/2036114543 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd968020830 con 0x7fd95c0062f0 2022-01-10T01:24:06.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.597+0000 7fd97c8ee700 1 -- 172.21.15.36:0/2036114543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95c0062f0 msgr2=0x7fd97814e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:06.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.597+0000 7fd97c8ee700 1 --2- 172.21.15.36:0/2036114543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95c0062f0 0x7fd97814e2e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fd9780afa40 tx=0x7fd968009040).stop 2022-01-10T01:24:06.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.597+0000 7fd97c8ee700 1 -- 172.21.15.36:0/2036114543 shutdown_connections 2022-01-10T01:24:06.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.597+0000 7fd97c8ee700 1 --2- 172.21.15.36:0/2036114543 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd9780b2c00 0x7fd97814e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:06.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.597+0000 7fd97c8ee700 1 --2- 172.21.15.36:0/2036114543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd95c0062f0 0x7fd97814e2e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:06.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.597+0000 7fd97c8ee700 1 --2- 172.21.15.36:0/2036114543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd95c003400 0x7fd97813a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:06.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.597+0000 7fd97c8ee700 1 -- 172.21.15.36:0/2036114543 >> 172.21.15.36:0/2036114543 conn(0x7fd97805f6b0 msgr2=0x7fd9780a8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:06.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.597+0000 7fd97c8ee700 1 -- 172.21.15.36:0/2036114543 shutdown_connections 2022-01-10T01:24:06.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:06.597+0000 7fd97c8ee700 1 -- 172.21.15.36:0/2036114543 wait complete. 2022-01-10T01:24:06.605 INFO:teuthology.orchestra.run.smithi036.stderr:adjusted tunables profile to default 2022-01-10T01:24:06.615 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-01-10T01:24:06.616 DEBUG:teuthology.orchestra.run.smithi036:> mktemp 2022-01-10T01:24:06.622 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.9ENdvc5Qi4 2022-01-10T01:24:06.623 DEBUG:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.9ENdvc5Qi4 2022-01-10T01:24:06.636 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.9ENdvc5Qi4 2022-01-10T01:24:06.704 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.9ENdvc5Qi4 is 37B 2022-01-10T01:24:06.714 DEBUG:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.9ENdvc5Qi4 2022-01-10T01:24:06.719 DEBUG:teuthology.orchestra.run.smithi036:> mktemp 2022-01-10T01:24:06.765 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.dxslskJBAy 2022-01-10T01:24:06.766 DEBUG:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.dxslskJBAy 2022-01-10T01:24:06.783 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.dxslskJBAy 2022-01-10T01:24:06.805 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.dxslskJBAy is 37B 2022-01-10T01:24:06.817 DEBUG:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.dxslskJBAy 2022-01-10T01:24:06.824 DEBUG:teuthology.orchestra.run.smithi036:> mktemp 2022-01-10T01:24:06.873 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.AFSdEiEisu 2022-01-10T01:24:06.873 DEBUG:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.AFSdEiEisu 2022-01-10T01:24:06.886 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.AFSdEiEisu 2022-01-10T01:24:06.907 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.AFSdEiEisu is 37B 2022-01-10T01:24:06.919 DEBUG:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.AFSdEiEisu 2022-01-10T01:24:06.925 DEBUG:teuthology.orchestra.run.smithi036:> mktemp 2022-01-10T01:24:06.973 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.xkgQVi4vbc 2022-01-10T01:24:06.974 DEBUG:teuthology.orchestra.run.smithi036:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.xkgQVi4vbc 2022-01-10T01:24:06.986 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.xkgQVi4vbc 2022-01-10T01:24:07.050 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.xkgQVi4vbc is 37B 2022-01-10T01:24:07.064 DEBUG:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.xkgQVi4vbc 2022-01-10T01:24:07.070 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2022-01-10T01:24:07.077 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.oU7x5oDz28 2022-01-10T01:24:07.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.oU7x5oDz28 2022-01-10T01:24:07.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.oU7x5oDz28 2022-01-10T01:24:07.152 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.oU7x5oDz28 is 37B 2022-01-10T01:24:07.166 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.oU7x5oDz28 2022-01-10T01:24:07.172 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2022-01-10T01:24:07.221 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.jcFyij5EiD 2022-01-10T01:24:07.222 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.jcFyij5EiD 2022-01-10T01:24:07.237 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.jcFyij5EiD 2022-01-10T01:24:07.297 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.jcFyij5EiD is 37B 2022-01-10T01:24:07.310 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.jcFyij5EiD 2022-01-10T01:24:07.316 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2022-01-10T01:24:07.365 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.JEjUE1TLSK 2022-01-10T01:24:07.366 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.JEjUE1TLSK 2022-01-10T01:24:07.381 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.JEjUE1TLSK 2022-01-10T01:24:07.398 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.JEjUE1TLSK is 37B 2022-01-10T01:24:07.413 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.JEjUE1TLSK 2022-01-10T01:24:07.418 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2022-01-10T01:24:07.465 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.xoKWTNtMo7 2022-01-10T01:24:07.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.xoKWTNtMo7 2022-01-10T01:24:07.480 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.xoKWTNtMo7 2022-01-10T01:24:07.545 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.xoKWTNtMo7 is 37B 2022-01-10T01:24:07.557 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.xoKWTNtMo7 2022-01-10T01:24:07.563 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new a2c54e57-d684-47f3-9881-521ca63b1599 0 2022-01-10T01:24:07.659 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.656+0000 7f338ce3f700 1 Processor -- start 2022-01-10T01:24:07.659 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.656+0000 7f338ce3f700 1 -- start start 2022-01-10T01:24:07.662 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338ce3f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f33880a9ec0 0x7f33880aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:07.663 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338ce3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338813f790 0x7f338813fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:07.663 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338ce3f700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3388061990 con 0x7f33880603d0 2022-01-10T01:24:07.663 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338ce3f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33881400f0 con 0x7f33880a9ec0 2022-01-10T01:24:07.663 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338ce3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3388061c30 con 0x7f338813f790 2022-01-10T01:24:07.664 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f33880a9ec0 0x7f33880aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:07.664 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f3386d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338813f790 0x7f338813fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:07.664 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f33880a9ec0 0x7f33880aa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54844/0 (socket says 172.21.15.59:54844) 2022-01-10T01:24:07.664 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338659c700 1 -- 172.21.15.59:0/69260453 learned_addr learned my addr 172.21.15.59:0/69260453 (peer_addr_for_me v2:172.21.15.59:0/0) 2022-01-10T01:24:07.664 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f3386d9d700 1 -- 172.21.15.59:0/69260453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338813f790 msgr2=0x7f338813fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-01-10T01:24:07.665 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f3386d9d700 1 -- 172.21.15.59:0/69260453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338813f790 msgr2=0x7f338813fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:07.665 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f3386d9d700 1 --2- 172.21.15.59:0/69260453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338813f790 0x7f338813fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:07.665 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f3386d9d700 1 --2- 172.21.15.59:0/69260453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338813f790 0x7f338813fc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:07.665 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338659c700 1 -- 172.21.15.59:0/69260453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338813f790 msgr2=0x7f338813fc00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-01-10T01:24:07.666 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338659c700 1 --2- 172.21.15.59:0/69260453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338813f790 0x7f338813fc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.666 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338659c700 1 -- 172.21.15.59:0/69260453 >> v1:172.21.15.36:6789/0 conn(0x7f33880603d0 legacy=0x7f338813ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:07.666 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338659c700 1 -- 172.21.15.59:0/69260453 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3388060b90 con 0x7f33880a9ec0 2022-01-10T01:24:07.666 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338659c700 1 --2- 172.21.15.59:0/69260453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33880a9ec0 0x7f33880aa2a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f3378002f70 tx=0x7f3378006eb0).ready entity=mon.1 client_cookie=cf3c3f443bcd7ab7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:07.667 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338559a700 1 -- 172.21.15.59:0/69260453 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f337800d5c0 con 0x7f33880a9ec0 2022-01-10T01:24:07.667 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338559a700 1 -- 172.21.15.59:0/69260453 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378000e90 con 0x7f33880a9ec0 2022-01-10T01:24:07.667 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338559a700 1 -- 172.21.15.59:0/69260453 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f337800d950 con 0x7f33880a9ec0 2022-01-10T01:24:07.667 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338ce3f700 1 -- 172.21.15.59:0/69260453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33880a9ec0 msgr2=0x7f33880aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:07.667 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338ce3f700 1 --2- 172.21.15.59:0/69260453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33880a9ec0 0x7f33880aa2a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f3378002f70 tx=0x7f3378006eb0).stop 2022-01-10T01:24:07.668 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338ce3f700 1 -- 172.21.15.59:0/69260453 shutdown_connections 2022-01-10T01:24:07.668 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338ce3f700 1 --2- 172.21.15.59:0/69260453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f338813f790 0x7f338813fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.668 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338ce3f700 1 --2- 172.21.15.59:0/69260453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33880a9ec0 0x7f33880aa2a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.668 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338ce3f700 1 -- 172.21.15.59:0/69260453 >> 172.21.15.59:0/69260453 conn(0x7f33880b2970 msgr2=0x7f33880b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:07.669 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338ce3f700 1 -- 172.21.15.59:0/69260453 shutdown_connections 2022-01-10T01:24:07.669 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.660+0000 7f338ce3f700 1 -- 172.21.15.59:0/69260453 wait complete. 2022-01-10T01:24:07.672 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338ce3f700 1 Processor -- start 2022-01-10T01:24:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338ce3f700 1 -- start start 2022-01-10T01:24:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338ce3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33880603d0 0x7f33881534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338ce3f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33880a9ec0 0x7f33880ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338ce3f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f338813f790 0x7f33881484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:07.673 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338ce3f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338813b3e0 con 0x7f338813f790 2022-01-10T01:24:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338ce3f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33880afb90 con 0x7f33880a9ec0 2022-01-10T01:24:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338ce3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3388152ad0 con 0x7f33880603d0 2022-01-10T01:24:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33880603d0 0x7f33881534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:07.674 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33880603d0 0x7f33881534b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54312/0 (socket says 172.21.15.59:54312) 2022-01-10T01:24:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338659c700 1 -- 172.21.15.59:0/2322653402 learned_addr learned my addr 172.21.15.59:0/2322653402 (peer_addr_for_me v2:172.21.15.59:0/0) 2022-01-10T01:24:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f3385d9b700 1 --2- 172.21.15.59:0/2322653402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33880a9ec0 0x7f33880ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338659c700 1 -- 172.21.15.59:0/2322653402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33880603d0 msgr2=0x7f33881534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-01-10T01:24:07.675 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338659c700 1 -- 172.21.15.59:0/2322653402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33880603d0 msgr2=0x7f33881534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-01-10T01:24:07.676 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338659c700 1 --2- 172.21.15.59:0/2322653402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33880603d0 0x7f33881534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:07.676 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f3386d9d700 1 --2- 172.21.15.59:0/2322653402 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f338813f790 0x7f33881484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:07.676 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338659c700 1 --2- 172.21.15.59:0/2322653402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33880603d0 0x7f33881534b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:07.676 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f3385d9b700 1 -- 172.21.15.59:0/2322653402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33880603d0 msgr2=0x7f33881534b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-01-10T01:24:07.677 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f3385d9b700 1 --2- 172.21.15.59:0/2322653402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33880603d0 0x7f33881534b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.677 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f3385d9b700 1 -- 172.21.15.59:0/2322653402 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f338813f790 msgr2=0x7f33881484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:07.677 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f3385d9b700 1 --2- 172.21.15.59:0/2322653402 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f338813f790 0x7f33881484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.677 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f3385d9b700 1 -- 172.21.15.59:0/2322653402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337800b1e0 con 0x7f33880a9ec0 2022-01-10T01:24:07.677 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f3385d9b700 1 --2- 172.21.15.59:0/2322653402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33880a9ec0 0x7f33880ae340 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f338813f100 tx=0x7f337c007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f33777fe700 1 -- 172.21.15.59:0/2322653402 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f337c007d30 con 0x7f33880a9ec0 2022-01-10T01:24:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f33777fe700 1 -- 172.21.15.59:0/2322653402 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f337c007e90 con 0x7f33880a9ec0 2022-01-10T01:24:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f33777fe700 1 -- 172.21.15.59:0/2322653402 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f337c0125f0 con 0x7f33880a9ec0 2022-01-10T01:24:07.678 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338ce3f700 1 -- 172.21.15.59:0/2322653402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3388152d70 con 0x7f33880a9ec0 2022-01-10T01:24:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338ce3f700 1 -- 172.21.15.59:0/2322653402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33880ae830 con 0x7f33880a9ec0 2022-01-10T01:24:07.679 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f33777fe700 1 -- 172.21.15.59:0/2322653402 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f337c019030 con 0x7f33880a9ec0 2022-01-10T01:24:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f33777fe700 1 -- 172.21.15.59:0/2322653402 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f337c01c7b0 con 0x7f33880a9ec0 2022-01-10T01:24:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.664+0000 7f338ce3f700 1 -- 172.21.15.59:0/2322653402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3388060e30 con 0x7f33880a9ec0 2022-01-10T01:24:07.680 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.668+0000 7f33777fe700 1 -- 172.21.15.59:0/2322653402 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f337c012e60 con 0x7f33880a9ec0 2022-01-10T01:24:07.752 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.752+0000 7f338ce3f700 1 -- 172.21.15.59:0/2322653402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", "id": 0} v 0) v1 -- 0x7f3388057350 con 0x7f33880a9ec0 2022-01-10T01:24:07.767 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.764+0000 7f33777fe700 1 -- 172.21.15.59:0/2322653402 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f337c017070 con 0x7f33880a9ec0 2022-01-10T01:24:07.767 INFO:teuthology.orchestra.run.smithi059.stdout:0 2022-01-10T01:24:07.768 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.768+0000 7f338ce3f700 1 -- 172.21.15.59:0/2322653402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33880a9ec0 msgr2=0x7f33880ae340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:07.769 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.768+0000 7f338ce3f700 1 --2- 172.21.15.59:0/2322653402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33880a9ec0 0x7f33880ae340 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f338813f100 tx=0x7f337c007b90).stop 2022-01-10T01:24:07.769 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.768+0000 7f338ce3f700 1 -- 172.21.15.59:0/2322653402 shutdown_connections 2022-01-10T01:24:07.769 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.768+0000 7f338ce3f700 1 --2- 172.21.15.59:0/2322653402 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f338813f790 0x7f33881484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.769 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.768+0000 7f338ce3f700 1 --2- 172.21.15.59:0/2322653402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33880a9ec0 0x7f33880ae340 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.770 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.768+0000 7f338ce3f700 1 --2- 172.21.15.59:0/2322653402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33880603d0 0x7f33881534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.770 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.768+0000 7f338ce3f700 1 -- 172.21.15.59:0/2322653402 >> 172.21.15.59:0/2322653402 conn(0x7f33880b2970 msgr2=0x7f338813d630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:07.770 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.768+0000 7f338ce3f700 1 -- 172.21.15.59:0/2322653402 shutdown_connections 2022-01-10T01:24:07.770 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.768+0000 7f338ce3f700 1 -- 172.21.15.59:0/2322653402 wait complete. 2022-01-10T01:24:07.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 0cfbf9a2-d507-48e2-b6e5-dfec71376624 1 2022-01-10T01:24:07.880 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4e00f51700 1 Processor -- start 2022-01-10T01:24:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4e00f51700 1 -- start start 2022-01-10T01:24:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4e00f51700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4dfc0b2ee0 0x7f4dfc065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4e00f51700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4dfc14aeb0 0x7f4dfc14b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:07.882 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4e00f51700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc0b2a90 con 0x7f4dfc0b76b0 2022-01-10T01:24:07.882 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4e00f51700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc0616a0 con 0x7f4dfc14aeb0 2022-01-10T01:24:07.882 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4e00f51700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc065a80 con 0x7f4dfc0b2ee0 2022-01-10T01:24:07.882 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4dfaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4dfc0b2ee0 0x7f4dfc065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:07.882 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4dfaffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4dfc0b2ee0 0x7f4dfc065590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54858/0 (socket says 172.21.15.59:54858) 2022-01-10T01:24:07.883 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4dfaffd700 1 -- 172.21.15.59:0/677562765 learned_addr learned my addr 172.21.15.59:0/677562765 (peer_addr_for_me v2:172.21.15.59:0/0) 2022-01-10T01:24:07.883 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4dfbfff700 1 --2- 172.21.15.59:0/677562765 >> v2:172.21.15.36:3300/0 conn(0x7f4dfc14aeb0 0x7f4dfc14b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:07.883 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4dfaffd700 1 -- 172.21.15.59:0/677562765 >> v2:172.21.15.36:3300/0 conn(0x7f4dfc14aeb0 msgr2=0x7f4dfc14b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:07.883 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4dfaffd700 1 --2- 172.21.15.59:0/677562765 >> v2:172.21.15.36:3300/0 conn(0x7f4dfc14aeb0 0x7f4dfc14b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.884 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4dfaffd700 1 -- 172.21.15.59:0/677562765 >> v1:172.21.15.59:6789/0 conn(0x7f4dfc0b76b0 legacy=0x7f4dfc060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:07.884 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4dfaffd700 1 -- 172.21.15.59:0/677562765 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc0b7a90 con 0x7f4dfc0b2ee0 2022-01-10T01:24:07.884 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4dfbfff700 1 --2- 172.21.15.59:0/677562765 >> v2:172.21.15.36:3300/0 conn(0x7f4dfc14aeb0 0x7f4dfc14b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:24:07.884 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.876+0000 7f4dfaffd700 1 --2- 172.21.15.59:0/677562765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dfc0b2ee0 0x7f4dfc065590 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f4df0002f70 tx=0x7f4df0006eb0).ready entity=mon.1 client_cookie=d9aaa82a3f65cb8c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:07.885 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4dfa7fc700 1 -- 172.21.15.59:0/677562765 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4df000d610 con 0x7f4dfc0b2ee0 2022-01-10T01:24:07.885 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4dfa7fc700 1 -- 172.21.15.59:0/677562765 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df0000e90 con 0x7f4dfc0b2ee0 2022-01-10T01:24:07.885 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4dfa7fc700 1 -- 172.21.15.59:0/677562765 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4df000d9a0 con 0x7f4dfc0b2ee0 2022-01-10T01:24:07.885 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 -- 172.21.15.59:0/677562765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dfc0b2ee0 msgr2=0x7f4dfc065590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:07.885 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 --2- 172.21.15.59:0/677562765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dfc0b2ee0 0x7f4dfc065590 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f4df0002f70 tx=0x7f4df0006eb0).stop 2022-01-10T01:24:07.886 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 -- 172.21.15.59:0/677562765 shutdown_connections 2022-01-10T01:24:07.886 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 --2- 172.21.15.59:0/677562765 >> v2:172.21.15.36:3300/0 conn(0x7f4dfc14aeb0 0x7f4dfc14b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.886 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 --2- 172.21.15.59:0/677562765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dfc0b2ee0 0x7f4dfc065590 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.886 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 -- 172.21.15.59:0/677562765 >> 172.21.15.59:0/677562765 conn(0x7f4dfc05f6b0 msgr2=0x7f4dfc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:07.887 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 -- 172.21.15.59:0/677562765 shutdown_connections 2022-01-10T01:24:07.887 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 -- 172.21.15.59:0/677562765 wait complete. 2022-01-10T01:24:07.891 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 Processor -- start 2022-01-10T01:24:07.891 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 -- start start 2022-01-10T01:24:07.891 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dfc0b2ee0 0x7f4dfc0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:07.892 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dfc0b76b0 0x7f4dfc09ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:07.892 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dfc14aeb0 0x7f4dfc09e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:07.892 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0a4820 con 0x7f4dfc0b2ee0 2022-01-10T01:24:07.892 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc156bd0 con 0x7f4dfc0b76b0 2022-01-10T01:24:07.892 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4e00f51700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc156e70 con 0x7f4dfc14aeb0 2022-01-10T01:24:07.893 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4dfaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dfc0b76b0 0x7f4dfc09ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:07.893 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4dfbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dfc14aeb0 0x7f4dfc09e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:07.893 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4dfaffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dfc0b76b0 0x7f4dfc09ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54862/0 (socket says 172.21.15.59:54862) 2022-01-10T01:24:07.893 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4dfaffd700 1 -- 172.21.15.59:0/2240950814 learned_addr learned my addr 172.21.15.59:0/2240950814 (peer_addr_for_me v2:172.21.15.59:0/0) 2022-01-10T01:24:07.894 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4dfb7fe700 1 --2- 172.21.15.59:0/2240950814 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dfc0b2ee0 0x7f4dfc0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:07.894 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4dfbfff700 1 -- 172.21.15.59:0/2240950814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dfc14aeb0 msgr2=0x7f4dfc09e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2022-01-10T01:24:07.894 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4dfbfff700 1 -- 172.21.15.59:0/2240950814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dfc14aeb0 msgr2=0x7f4dfc09e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-01-10T01:24:07.894 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4dfbfff700 1 --2- 172.21.15.59:0/2240950814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dfc14aeb0 0x7f4dfc09e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:07.895 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.880+0000 7f4dfbfff700 1 --2- 172.21.15.59:0/2240950814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dfc14aeb0 0x7f4dfc09e8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:07.895 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4dfaffd700 1 -- 172.21.15.59:0/2240950814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dfc14aeb0 msgr2=0x7f4dfc09e8b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-01-10T01:24:07.895 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4dfaffd700 1 --2- 172.21.15.59:0/2240950814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dfc14aeb0 0x7f4dfc09e8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.895 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4dfaffd700 1 -- 172.21.15.59:0/2240950814 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dfc0b2ee0 msgr2=0x7f4dfc0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:07.896 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4dfaffd700 1 --2- 172.21.15.59:0/2240950814 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dfc0b2ee0 0x7f4dfc0b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.896 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4dfaffd700 1 -- 172.21.15.59:0/2240950814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df000b1e0 con 0x7f4dfc0b76b0 2022-01-10T01:24:07.896 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4dfb7fe700 1 --2- 172.21.15.59:0/2240950814 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dfc0b2ee0 0x7f4dfc0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:07.896 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4dfaffd700 1 --2- 172.21.15.59:0/2240950814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dfc0b76b0 0x7f4dfc09ffe0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f4df0002f70 tx=0x7f4df0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:07.896 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4df8ff9700 1 -- 172.21.15.59:0/2240950814 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4df0011a80 con 0x7f4dfc0b76b0 2022-01-10T01:24:07.897 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4df8ff9700 1 -- 172.21.15.59:0/2240950814 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df0011be0 con 0x7f4dfc0b76b0 2022-01-10T01:24:07.897 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4e00f51700 1 -- 172.21.15.59:0/2240950814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc157110 con 0x7f4dfc0b76b0 2022-01-10T01:24:07.897 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4df8ff9700 1 -- 172.21.15.59:0/2240950814 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4df001e460 con 0x7f4dfc0b76b0 2022-01-10T01:24:07.897 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4e00f51700 1 -- 172.21.15.59:0/2240950814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc0a04d0 con 0x7f4dfc0b76b0 2022-01-10T01:24:07.898 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4df8ff9700 1 -- 172.21.15.59:0/2240950814 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f4df0025030 con 0x7f4dfc0b76b0 2022-01-10T01:24:07.898 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4df8ff9700 1 -- 172.21.15.59:0/2240950814 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f4df001ec70 con 0x7f4dfc0b76b0 2022-01-10T01:24:07.898 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.884+0000 7f4e00f51700 1 -- 172.21.15.59:0/2240950814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc1572a0 con 0x7f4dfc0b76b0 2022-01-10T01:24:07.898 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.888+0000 7f4df8ff9700 1 -- 172.21.15.59:0/2240950814 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f4df0023070 con 0x7f4dfc0b76b0 2022-01-10T01:24:07.954 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.952+0000 7f4e00f51700 1 -- 172.21.15.59:0/2240950814 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", "id": 1} v 0) v1 -- 0x7f4dfc0b27f0 con 0x7f4dfc0b76b0 2022-01-10T01:24:07.966 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.964+0000 7f4df8ff9700 1 -- 172.21.15.59:0/2240950814 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4df0006020 con 0x7f4dfc0b76b0 2022-01-10T01:24:07.966 INFO:teuthology.orchestra.run.smithi059.stdout:1 2022-01-10T01:24:07.968 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.968+0000 7f4e00f51700 1 -- 172.21.15.59:0/2240950814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dfc0b76b0 msgr2=0x7f4dfc09ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.968+0000 7f4e00f51700 1 --2- 172.21.15.59:0/2240950814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dfc0b76b0 0x7f4dfc09ffe0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f4df0002f70 tx=0x7f4df0015000).stop 2022-01-10T01:24:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.968+0000 7f4e00f51700 1 -- 172.21.15.59:0/2240950814 shutdown_connections 2022-01-10T01:24:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.968+0000 7f4e00f51700 1 --2- 172.21.15.59:0/2240950814 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dfc14aeb0 0x7f4dfc09e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.969 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.968+0000 7f4e00f51700 1 --2- 172.21.15.59:0/2240950814 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dfc0b76b0 0x7f4dfc09ffe0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.970 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.968+0000 7f4e00f51700 1 --2- 172.21.15.59:0/2240950814 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dfc0b2ee0 0x7f4dfc0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:07.970 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.968+0000 7f4e00f51700 1 -- 172.21.15.59:0/2240950814 >> 172.21.15.59:0/2240950814 conn(0x7f4dfc05f6b0 msgr2=0x7f4dfc0ad0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:07.970 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.968+0000 7f4e00f51700 1 -- 172.21.15.59:0/2240950814 shutdown_connections 2022-01-10T01:24:07.970 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:07.968+0000 7f4e00f51700 1 -- 172.21.15.59:0/2240950814 wait complete. 2022-01-10T01:24:07.981 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 7143a0cb-c0a4-4546-9c0a-98466a260cbe 2 2022-01-10T01:24:08.077 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.076+0000 7fe30b133700 1 Processor -- start 2022-01-10T01:24:08.078 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.076+0000 7fe30b133700 1 -- start start 2022-01-10T01:24:08.082 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.076+0000 7fe30b133700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe304144940 0x7fe3040abd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.082 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.076+0000 7fe30b133700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe304144d20 con 0x7fe3040a9ec0 2022-01-10T01:24:08.082 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.076+0000 7fe30b133700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe304144f80 con 0x7fe3040b0f80 2022-01-10T01:24:08.083 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.076+0000 7fe30b133700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3040ac200 con 0x7fe304144940 2022-01-10T01:24:08.083 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.076+0000 7fe3096d0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe3040b0f80 0x7fe30413e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37470/0 (socket says 172.21.15.59:37470) 2022-01-10T01:24:08.083 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.076+0000 7fe3096d0700 1 -- 172.21.15.59:0/805665691 learned_addr learned my addr 172.21.15.59:0/805665691 (peer_addr_for_me v1:172.21.15.59:0/0) 2022-01-10T01:24:08.083 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.076+0000 7fe308ecf700 1 --2- 172.21.15.59:0/805665691 >> v2:172.21.15.36:3300/0 conn(0x7fe304144940 0x7fe3040abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.083 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 -- 172.21.15.59:0/805665691 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338824062 0 0) 0x7fe304144f80 con 0x7fe3040b0f80 2022-01-10T01:24:08.084 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 -- 172.21.15.59:0/805665691 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e8003260 con 0x7fe3040b0f80 2022-01-10T01:24:08.084 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 -- 172.21.15.59:0/805665691 <== mon.1 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 679661459 0 0) 0x7fe2e8003260 con 0x7fe3040b0f80 2022-01-10T01:24:08.084 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 -- 172.21.15.59:0/805665691 >> v2:172.21.15.36:3300/0 conn(0x7fe304144940 msgr2=0x7fe3040abd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:08.084 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 --2- 172.21.15.59:0/805665691 >> v2:172.21.15.36:3300/0 conn(0x7fe304144940 0x7fe3040abd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.085 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 -- 172.21.15.59:0/805665691 >> v1:172.21.15.36:6789/0 conn(0x7fe3040a9ec0 legacy=0x7fe3040b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.085 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 -- 172.21.15.59:0/805665691 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe304145220 con 0x7fe3040b0f80 2022-01-10T01:24:08.085 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 -- 172.21.15.59:0/805665691 <== mon.1 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fe2fc0019e0 con 0x7fe3040b0f80 2022-01-10T01:24:08.085 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 -- 172.21.15.59:0/805665691 >> v1:172.21.15.59:6789/0 conn(0x7fe3040b0f80 legacy=0x7fe30413e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.086 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 --2- 172.21.15.59:0/805665691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e8003750 0x7fe2e8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.086 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 --2- 172.21.15.59:0/805665691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e8004500 0x7fe2e8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.086 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 --2- 172.21.15.59:0/805665691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e8004e70 0x7fe2e800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.086 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 -- 172.21.15.59:0/805665691 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3040ac200 con 0x7fe2e8004500 2022-01-10T01:24:08.087 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 -- 172.21.15.59:0/805665691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e8010130 con 0x7fe2e8004e70 2022-01-10T01:24:08.087 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 -- 172.21.15.59:0/805665691 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e80102f0 con 0x7fe2e8003750 2022-01-10T01:24:08.087 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe308ecf700 1 --2- 172.21.15.59:0/805665691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e8003750 0x7fe2e8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.087 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3096d0700 1 --2- 172.21.15.59:0/805665691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e8004e70 0x7fe2e800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.087 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe303fff700 1 --2- 172.21.15.59:0/805665691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e8004500 0x7fe2e8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.088 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3096d0700 1 -- 172.21.15.59:0/805665691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e8003750 msgr2=0x7fe2e8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:08.088 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3096d0700 1 --2- 172.21.15.59:0/805665691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e8003750 0x7fe2e8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.088 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3096d0700 1 -- 172.21.15.59:0/805665691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e8004500 msgr2=0x7fe2e8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:08.088 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3096d0700 1 --2- 172.21.15.59:0/805665691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e8004500 0x7fe2e8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3096d0700 1 -- 172.21.15.59:0/805665691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e8003260 con 0x7fe2e8004e70 2022-01-10T01:24:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3096d0700 1 -- 172.21.15.59:0/805665691 reap_dead start 2022-01-10T01:24:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3096d0700 1 --2- 172.21.15.59:0/805665691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e8004e70 0x7fe2e800b750 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fe2fc0016f0 tx=0x7fe3040aa330).ready entity=mon.1 client_cookie=ae69a90cfc0f44da server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 -- 172.21.15.59:0/805665691 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2fc00cc70 con 0x7fe2e8004e70 2022-01-10T01:24:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 -- 172.21.15.59:0/805665691 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc00cdd0 con 0x7fe2e8004e70 2022-01-10T01:24:08.090 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe3037fe700 1 -- 172.21.15.59:0/805665691 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2fc005b80 con 0x7fe2e8004e70 2022-01-10T01:24:08.090 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe30b133700 1 -- 172.21.15.59:0/805665691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e8004e70 msgr2=0x7fe2e800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.090 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe30b133700 1 --2- 172.21.15.59:0/805665691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e8004e70 0x7fe2e800b750 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fe2fc0016f0 tx=0x7fe3040aa330).stop 2022-01-10T01:24:08.090 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe30b133700 1 -- 172.21.15.59:0/805665691 shutdown_connections 2022-01-10T01:24:08.091 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe30b133700 1 --2- 172.21.15.59:0/805665691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e8004e70 0x7fe2e800b750 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.091 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe30b133700 1 -- 172.21.15.59:0/805665691 >> 172.21.15.59:0/805665691 conn(0x7fe3040b2970 msgr2=0x7fe3040b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:08.091 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe30b133700 1 -- 172.21.15.59:0/805665691 shutdown_connections 2022-01-10T01:24:08.091 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe30b133700 1 -- 172.21.15.59:0/805665691 wait complete. 2022-01-10T01:24:08.095 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe30b133700 1 Processor -- start 2022-01-10T01:24:08.095 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.080+0000 7fe30b133700 1 -- start start 2022-01-10T01:24:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe30b133700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e8004e70 0x7fe30405f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe30b133700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30413f7e0 0x7fe304140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe30b133700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe30413fff0 0x7fe304140fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe30b133700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30414efa0 con 0x7fe2e8004e70 2022-01-10T01:24:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe30b133700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30413e2c0 con 0x7fe30413f7e0 2022-01-10T01:24:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe30b133700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30414ea90 con 0x7fe30413fff0 2022-01-10T01:24:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe3096d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe30413fff0 0x7fe304140fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe3096d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe30413fff0 0x7fe304140fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54346/0 (socket says 172.21.15.59:54346) 2022-01-10T01:24:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe3096d0700 1 -- 172.21.15.59:0/2016635606 learned_addr learned my addr 172.21.15.59:0/2016635606 (peer_addr_for_me v2:172.21.15.59:0/0) 2022-01-10T01:24:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe303fff700 1 --2- 172.21.15.59:0/2016635606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30413f7e0 0x7fe304140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe308ecf700 1 --2- 172.21.15.59:0/2016635606 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e8004e70 0x7fe30405f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe3096d0700 1 -- 172.21.15.59:0/2016635606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe30413fff0 msgr2=0x7fe304140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2022-01-10T01:24:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe3096d0700 1 -- 172.21.15.59:0/2016635606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe30413fff0 msgr2=0x7fe304140fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-01-10T01:24:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe3096d0700 1 --2- 172.21.15.59:0/2016635606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe30413fff0 0x7fe304140fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe3096d0700 1 --2- 172.21.15.59:0/2016635606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe30413fff0 0x7fe304140fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe303fff700 1 -- 172.21.15.59:0/2016635606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe30413fff0 msgr2=0x7fe304140fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-01-10T01:24:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe303fff700 1 --2- 172.21.15.59:0/2016635606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe30413fff0 0x7fe304140fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe303fff700 1 -- 172.21.15.59:0/2016635606 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e8004e70 msgr2=0x7fe30405f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe303fff700 1 --2- 172.21.15.59:0/2016635606 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e8004e70 0x7fe30405f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe303fff700 1 -- 172.21.15.59:0/2016635606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3040602e0 con 0x7fe30413f7e0 2022-01-10T01:24:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe308ecf700 1 --2- 172.21.15.59:0/2016635606 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e8004e70 0x7fe30405f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe303fff700 1 --2- 172.21.15.59:0/2016635606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30413f7e0 0x7fe304140ac0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fe304063840 tx=0x7fe2f0009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe301ffb700 1 -- 172.21.15.59:0/2016635606 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2f0015400 con 0x7fe30413f7e0 2022-01-10T01:24:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe301ffb700 1 -- 172.21.15.59:0/2016635606 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f0010040 con 0x7fe30413f7e0 2022-01-10T01:24:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe301ffb700 1 -- 172.21.15.59:0/2016635606 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2f0015750 con 0x7fe30413f7e0 2022-01-10T01:24:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe30b133700 1 -- 172.21.15.59:0/2016635606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30414ed00 con 0x7fe30413f7e0 2022-01-10T01:24:08.101 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe30b133700 1 -- 172.21.15.59:0/2016635606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3041414a0 con 0x7fe30413f7e0 2022-01-10T01:24:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe301ffb700 1 -- 172.21.15.59:0/2016635606 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fe2f0015a80 con 0x7fe30413f7e0 2022-01-10T01:24:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe301ffb700 1 -- 172.21.15.59:0/2016635606 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7fe2f001e830 con 0x7fe30413f7e0 2022-01-10T01:24:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.084+0000 7fe30b133700 1 -- 172.21.15.59:0/2016635606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3041454c0 con 0x7fe30413f7e0 2022-01-10T01:24:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.088+0000 7fe301ffb700 1 -- 172.21.15.59:0/2016635606 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fe2f001e3e0 con 0x7fe30413f7e0 2022-01-10T01:24:08.157 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.156+0000 7fe30b133700 1 -- 172.21.15.59:0/2016635606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", "id": 2} v 0) v1 -- 0x7fe304057350 con 0x7fe30413f7e0 2022-01-10T01:24:08.167 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.164+0000 7fe301ffb700 1 -- 172.21.15.59:0/2016635606 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe2f001e640 con 0x7fe30413f7e0 2022-01-10T01:24:08.167 INFO:teuthology.orchestra.run.smithi059.stdout:2 2022-01-10T01:24:08.169 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.168+0000 7fe30b133700 1 -- 172.21.15.59:0/2016635606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30413f7e0 msgr2=0x7fe304140ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.169 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.168+0000 7fe30b133700 1 --2- 172.21.15.59:0/2016635606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30413f7e0 0x7fe304140ac0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fe304063840 tx=0x7fe2f0009040).stop 2022-01-10T01:24:08.169 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.168+0000 7fe30b133700 1 -- 172.21.15.59:0/2016635606 shutdown_connections 2022-01-10T01:24:08.169 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.168+0000 7fe30b133700 1 --2- 172.21.15.59:0/2016635606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe30413fff0 0x7fe304140fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.170 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.168+0000 7fe30b133700 1 --2- 172.21.15.59:0/2016635606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30413f7e0 0x7fe304140ac0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.170 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.168+0000 7fe30b133700 1 --2- 172.21.15.59:0/2016635606 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e8004e70 0x7fe30405f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.170 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.168+0000 7fe30b133700 1 -- 172.21.15.59:0/2016635606 >> 172.21.15.59:0/2016635606 conn(0x7fe3040b2970 msgr2=0x7fe3040b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:08.170 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.168+0000 7fe30b133700 1 -- 172.21.15.59:0/2016635606 shutdown_connections 2022-01-10T01:24:08.171 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.168+0000 7fe30b133700 1 -- 172.21.15.59:0/2016635606 wait complete. 2022-01-10T01:24:08.180 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658 3 2022-01-10T01:24:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9aae49700 1 Processor -- start 2022-01-10T01:24:08.270 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9aae49700 1 -- start start 2022-01-10T01:24:08.276 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9aae49700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa9a40b3550 0x7fa9a4067110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.276 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9aae49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9a4144ce0 0x7fa9a4141130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.276 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9aae49700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a4066500 con 0x7fa9a4064980 2022-01-10T01:24:08.276 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9aae49700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a40b3ea0 con 0x7fa9a40b3550 2022-01-10T01:24:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9aae49700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a4140d40 con 0x7fa9a4144ce0 2022-01-10T01:24:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9aa648700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9a4144ce0 0x7fa9a4141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.277 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9a9e47700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa9a4064980 0x7fa9a4066a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37484/0 (socket says 172.21.15.59:37484) 2022-01-10T01:24:08.278 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9a9e47700 1 -- 172.21.15.59:0/3802716042 learned_addr learned my addr 172.21.15.59:0/3802716042 (peer_addr_for_me v1:172.21.15.59:0/0) 2022-01-10T01:24:08.278 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9aa648700 1 -- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9a4144ce0 msgr2=0x7fa9a4141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-01-10T01:24:08.278 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9aa648700 1 -- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9a4144ce0 msgr2=0x7fa9a4141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:08.279 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9aa648700 1 --2- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9a4144ce0 0x7fa9a4141130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:08.279 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9aa648700 1 --2- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9a4144ce0 0x7fa9a4141130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:08.279 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9a9646700 1 --2- 172.21.15.59:0/3802716042 >> v2:172.21.15.36:3300/0 conn(0x7fa9a40b3550 0x7fa9a4067110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.279 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9a8e45700 1 -- 172.21.15.59:0/3802716042 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699004956 0 0) 0x7fa9a4066500 con 0x7fa9a4064980 2022-01-10T01:24:08.280 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.268+0000 7fa9a8e45700 1 -- 172.21.15.59:0/3802716042 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa98c003260 con 0x7fa9a4064980 2022-01-10T01:24:08.280 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 -- 172.21.15.59:0/3802716042 <== mon.1 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2555321369 0 0) 0x7fa98c003260 con 0x7fa9a4064980 2022-01-10T01:24:08.280 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 -- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9a4144ce0 msgr2=0x7fa9a4141130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-01-10T01:24:08.280 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 --2- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9a4144ce0 0x7fa9a4141130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.281 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 -- 172.21.15.59:0/3802716042 >> v2:172.21.15.36:3300/0 conn(0x7fa9a40b3550 msgr2=0x7fa9a4067110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:08.281 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 --2- 172.21.15.59:0/3802716042 >> v2:172.21.15.36:3300/0 conn(0x7fa9a40b3550 0x7fa9a4067110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.281 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 -- 172.21.15.59:0/3802716042 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a40b46c0 con 0x7fa9a4064980 2022-01-10T01:24:08.281 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 -- 172.21.15.59:0/3802716042 <== mon.1 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fa9a0001a00 con 0x7fa9a4064980 2022-01-10T01:24:08.281 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 -- 172.21.15.59:0/3802716042 >> v1:172.21.15.59:6789/0 conn(0x7fa9a4064980 legacy=0x7fa9a4066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 --2- 172.21.15.59:0/3802716042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa98c003780 0x7fa98c003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 --2- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9a4144ce0 0x7fa98c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 --2- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa98c0049f0 0x7fa98c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.282 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 -- 172.21.15.59:0/3802716042 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c00b750 con 0x7fa98c003780 2022-01-10T01:24:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 -- 172.21.15.59:0/3802716042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c00b890 con 0x7fa98c0049f0 2022-01-10T01:24:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 -- 172.21.15.59:0/3802716042 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c00b9d0 con 0x7fa9a4144ce0 2022-01-10T01:24:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a9646700 1 --2- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9a4144ce0 0x7fa98c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.283 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aa648700 1 --2- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa98c0049f0 0x7fa98c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a9e47700 1 --2- 172.21.15.59:0/3802716042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa98c003780 0x7fa98c003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aa648700 1 -- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9a4144ce0 msgr2=0x7fa98c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aa648700 1 --2- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9a4144ce0 0x7fa98c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aa648700 1 -- 172.21.15.59:0/3802716042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa98c003780 msgr2=0x7fa98c003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:08.284 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aa648700 1 --2- 172.21.15.59:0/3802716042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa98c003780 0x7fa98c003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aa648700 1 -- 172.21.15.59:0/3802716042 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c003260 con 0x7fa98c0049f0 2022-01-10T01:24:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a9646700 1 --2- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9a4144ce0 0x7fa98c004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aa648700 1 --2- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa98c0049f0 0x7fa98c004e70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fa99c000e90 tx=0x7fa99c008040).ready entity=mon.1 client_cookie=7f14bbbb5811014c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:08.285 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 -- 172.21.15.59:0/3802716042 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa99c013620 con 0x7fa98c0049f0 2022-01-10T01:24:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 -- 172.21.15.59:0/3802716042 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99c013780 con 0x7fa98c0049f0 2022-01-10T01:24:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9a8e45700 1 -- 172.21.15.59:0/3802716042 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa99c013ae0 con 0x7fa98c0049f0 2022-01-10T01:24:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aae49700 1 -- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa98c0049f0 msgr2=0x7fa98c004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.286 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aae49700 1 --2- 172.21.15.59:0/3802716042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa98c0049f0 0x7fa98c004e70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fa99c000e90 tx=0x7fa99c008040).stop 2022-01-10T01:24:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aa648700 1 -- 172.21.15.59:0/3802716042 reap_dead start 2022-01-10T01:24:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aae49700 1 -- 172.21.15.59:0/3802716042 shutdown_connections 2022-01-10T01:24:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aae49700 1 -- 172.21.15.59:0/3802716042 >> 172.21.15.59:0/3802716042 conn(0x7fa9a405f6b0 msgr2=0x7fa9a405fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:08.287 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aae49700 1 -- 172.21.15.59:0/3802716042 shutdown_connections 2022-01-10T01:24:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aae49700 1 -- 172.21.15.59:0/3802716042 wait complete. 2022-01-10T01:24:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.272+0000 7fa9aae49700 1 Processor -- start 2022-01-10T01:24:08.288 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9aae49700 1 -- start start 2022-01-10T01:24:08.291 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9aae49700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa98c0049f0 0x7fa9a4143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9aae49700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9a40ae0f0 0x7fa9a4134880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9aae49700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9a4138330 0x7fa9a4134d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9aae49700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a4134450 con 0x7fa9a4138330 2022-01-10T01:24:08.292 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9aae49700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a40b04c0 con 0x7fa9a40ae0f0 2022-01-10T01:24:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9aae49700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a40b0760 con 0x7fa98c0049f0 2022-01-10T01:24:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9a9e47700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa98c0049f0 0x7fa9a4143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.293 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9a9e47700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa98c0049f0 0x7fa9a4143910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54360/0 (socket says 172.21.15.59:54360) 2022-01-10T01:24:08.294 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9a9646700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9a40ae0f0 0x7fa9a4134880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.294 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9a9e47700 1 -- 172.21.15.59:0/1857177234 learned_addr learned my addr 172.21.15.59:0/1857177234 (peer_addr_for_me v2:172.21.15.59:0/0) 2022-01-10T01:24:08.294 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9aa648700 1 --2- 172.21.15.59:0/1857177234 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9a4138330 0x7fa9a4134d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9a9e47700 1 -- 172.21.15.59:0/1857177234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa98c0049f0 msgr2=0x7fa9a4143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-01-10T01:24:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9a9e47700 1 -- 172.21.15.59:0/1857177234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa98c0049f0 msgr2=0x7fa9a4143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-01-10T01:24:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9a9e47700 1 --2- 172.21.15.59:0/1857177234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa98c0049f0 0x7fa9a4143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:08.295 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9a9e47700 1 --2- 172.21.15.59:0/1857177234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa98c0049f0 0x7fa9a4143910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9a9646700 1 -- 172.21.15.59:0/1857177234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa98c0049f0 msgr2=0x7fa9a4143910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-01-10T01:24:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9a9646700 1 --2- 172.21.15.59:0/1857177234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa98c0049f0 0x7fa9a4143910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9a9646700 1 -- 172.21.15.59:0/1857177234 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9a4138330 msgr2=0x7fa9a4134d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.296 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9a9646700 1 --2- 172.21.15.59:0/1857177234 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9a4138330 0x7fa9a4134d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9a9646700 1 -- 172.21.15.59:0/1857177234 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a40b0a00 con 0x7fa9a40ae0f0 2022-01-10T01:24:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9a9646700 1 --2- 172.21.15.59:0/1857177234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9a40ae0f0 0x7fa9a4134880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa9a40b0de0 tx=0x7fa994006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa992ffd700 1 -- 172.21.15.59:0/1857177234 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa99400f860 con 0x7fa9a40ae0f0 2022-01-10T01:24:08.297 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa992ffd700 1 -- 172.21.15.59:0/1857177234 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99400f9c0 con 0x7fa9a40ae0f0 2022-01-10T01:24:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa992ffd700 1 -- 172.21.15.59:0/1857177234 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa99400fd20 con 0x7fa9a40ae0f0 2022-01-10T01:24:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9aae49700 1 -- 172.21.15.59:0/1857177234 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a4144190 con 0x7fa9a40ae0f0 2022-01-10T01:24:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9aae49700 1 -- 172.21.15.59:0/1857177234 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a4135400 con 0x7fa9a40ae0f0 2022-01-10T01:24:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa992ffd700 1 -- 172.21.15.59:0/1857177234 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fa99401e630 con 0x7fa9a40ae0f0 2022-01-10T01:24:08.298 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa992ffd700 1 -- 172.21.15.59:0/1857177234 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7fa99400fe80 con 0x7fa9a40ae0f0 2022-01-10T01:24:08.299 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.276+0000 7fa9aae49700 1 -- 172.21.15.59:0/1857177234 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a4134590 con 0x7fa9a40ae0f0 2022-01-10T01:24:08.299 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.280+0000 7fa992ffd700 1 -- 172.21.15.59:0/1857177234 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fa99401e8c0 con 0x7fa9a40ae0f0 2022-01-10T01:24:08.347 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.344+0000 7fa9aae49700 1 -- 172.21.15.59:0/1857177234 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", "id": 3} v 0) v1 -- 0x7fa9a4069c00 con 0x7fa9a40ae0f0 2022-01-10T01:24:08.358 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.356+0000 7fa992ffd700 1 -- 172.21.15.59:0/1857177234 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa99401ed70 con 0x7fa9a40ae0f0 2022-01-10T01:24:08.359 INFO:teuthology.orchestra.run.smithi059.stdout:3 2022-01-10T01:24:08.360 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.360+0000 7fa9aae49700 1 -- 172.21.15.59:0/1857177234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9a40ae0f0 msgr2=0x7fa9a4134880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.361 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.360+0000 7fa9aae49700 1 --2- 172.21.15.59:0/1857177234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9a40ae0f0 0x7fa9a4134880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fa9a40b0de0 tx=0x7fa994006df0).stop 2022-01-10T01:24:08.361 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.360+0000 7fa9aae49700 1 -- 172.21.15.59:0/1857177234 shutdown_connections 2022-01-10T01:24:08.361 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.360+0000 7fa9aae49700 1 --2- 172.21.15.59:0/1857177234 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9a4138330 0x7fa9a4134d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.361 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.360+0000 7fa9aae49700 1 --2- 172.21.15.59:0/1857177234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9a40ae0f0 0x7fa9a4134880 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.362 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.360+0000 7fa9aae49700 1 --2- 172.21.15.59:0/1857177234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa98c0049f0 0x7fa9a4143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.362 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.360+0000 7fa9aae49700 1 -- 172.21.15.59:0/1857177234 >> 172.21.15.59:0/1857177234 conn(0x7fa9a405f6b0 msgr2=0x7fa9a4140480 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:08.362 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.360+0000 7fa9aae49700 1 -- 172.21.15.59:0/1857177234 shutdown_connections 2022-01-10T01:24:08.362 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.360+0000 7fa9aae49700 1 -- 172.21.15.59:0/1857177234 wait complete. 2022-01-10T01:24:08.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 350c419b-492c-49e8-aaff-2aeae92df740 4 2022-01-10T01:24:08.463 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.460+0000 7efc31cf9700 1 Processor -- start 2022-01-10T01:24:08.463 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.460+0000 7efc31cf9700 1 -- start start 2022-01-10T01:24:08.466 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc31cf9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc2c0b6380 0x7efc2c140370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.466 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc31cf9700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c146660 con 0x7efc2c0612f0 2022-01-10T01:24:08.466 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc31cf9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c147510 con 0x7efc2c0b2910 2022-01-10T01:24:08.467 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc31cf9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c061fb0 con 0x7efc2c0b6380 2022-01-10T01:24:08.467 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc30cf7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc2c0b6380 0x7efc2c140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.467 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc30cf7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc2c0b6380 0x7efc2c140370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54904/0 (socket says 172.21.15.59:54904) 2022-01-10T01:24:08.467 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc30cf7700 1 -- 172.21.15.59:0/2911144143 learned_addr learned my addr 172.21.15.59:0/2911144143 (peer_addr_for_me v2:172.21.15.59:0/0) 2022-01-10T01:24:08.468 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc30cf7700 1 -- 172.21.15.59:0/2911144143 >> v1:172.21.15.59:6789/0 conn(0x7efc2c0b2910 legacy=0x7efc2c0b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.468 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc30cf7700 1 -- 172.21.15.59:0/2911144143 >> v1:172.21.15.36:6789/0 conn(0x7efc2c0612f0 legacy=0x7efc2c0666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.468 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc30cf7700 1 -- 172.21.15.59:0/2911144143 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c146890 con 0x7efc2c0b6380 2022-01-10T01:24:08.468 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc30cf7700 1 --2- 172.21.15.59:0/2911144143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2c0b6380 0x7efc2c140370 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efc1c002f70 tx=0x7efc1c006eb0).ready entity=mon.1 client_cookie=ad0035529d5b5ffe server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:08.468 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc2b7fe700 1 -- 172.21.15.59:0/2911144143 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc1c00d660 con 0x7efc2c0b6380 2022-01-10T01:24:08.469 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc2b7fe700 1 -- 172.21.15.59:0/2911144143 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c000e90 con 0x7efc2c0b6380 2022-01-10T01:24:08.469 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc2b7fe700 1 -- 172.21.15.59:0/2911144143 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc1c00d9f0 con 0x7efc2c0b6380 2022-01-10T01:24:08.469 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc31cf9700 1 -- 172.21.15.59:0/2911144143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2c0b6380 msgr2=0x7efc2c140370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.469 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc31cf9700 1 --2- 172.21.15.59:0/2911144143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2c0b6380 0x7efc2c140370 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7efc1c002f70 tx=0x7efc1c006eb0).stop 2022-01-10T01:24:08.470 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc31cf9700 1 -- 172.21.15.59:0/2911144143 shutdown_connections 2022-01-10T01:24:08.470 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc31cf9700 1 --2- 172.21.15.59:0/2911144143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2c0b6380 0x7efc2c140370 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.470 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc31cf9700 1 -- 172.21.15.59:0/2911144143 >> 172.21.15.59:0/2911144143 conn(0x7efc2c063670 msgr2=0x7efc2c063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:08.470 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc31cf9700 1 -- 172.21.15.59:0/2911144143 shutdown_connections 2022-01-10T01:24:08.470 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc31cf9700 1 -- 172.21.15.59:0/2911144143 wait complete. 2022-01-10T01:24:08.474 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.464+0000 7efc31cf9700 1 Processor -- start 2022-01-10T01:24:08.474 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc31cf9700 1 -- start start 2022-01-10T01:24:08.474 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc31cf9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc2c0612f0 0x7efc2c0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.475 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc31cf9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc2c0b2910 0x7efc2c0b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.475 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc31cf9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2c0b6380 0x7efc2c1525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.475 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc31cf9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0afe90 con 0x7efc2c0b2910 2022-01-10T01:24:08.475 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc31cf9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0ad720 con 0x7efc2c0b6380 2022-01-10T01:24:08.475 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc31cf9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c0b1d20 con 0x7efc2c0612f0 2022-01-10T01:24:08.476 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc30cf7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc2c0612f0 0x7efc2c0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.476 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc314f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2c0b6380 0x7efc2c1525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.476 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc30cf7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc2c0612f0 0x7efc2c0b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54372/0 (socket says 172.21.15.59:54372) 2022-01-10T01:24:08.476 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc314f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2c0b6380 0x7efc2c1525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54914/0 (socket says 172.21.15.59:54914) 2022-01-10T01:24:08.477 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc30cf7700 1 -- 172.21.15.59:0/2277266871 learned_addr learned my addr 172.21.15.59:0/2277266871 (peer_addr_for_me v2:172.21.15.59:0/0) 2022-01-10T01:24:08.477 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc2bfff700 1 --2- 172.21.15.59:0/2277266871 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc2c0b2910 0x7efc2c0b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.477 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc30cf7700 1 -- 172.21.15.59:0/2277266871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc2c0612f0 msgr2=0x7efc2c0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-01-10T01:24:08.477 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc30cf7700 1 -- 172.21.15.59:0/2277266871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc2c0612f0 msgr2=0x7efc2c0b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-01-10T01:24:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc30cf7700 1 --2- 172.21.15.59:0/2277266871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc2c0612f0 0x7efc2c0b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc30cf7700 1 --2- 172.21.15.59:0/2277266871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc2c0612f0 0x7efc2c0b1340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc314f8700 1 -- 172.21.15.59:0/2277266871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc2c0612f0 msgr2=0x7efc2c0b1340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-01-10T01:24:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc314f8700 1 --2- 172.21.15.59:0/2277266871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc2c0612f0 0x7efc2c0b1340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.478 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc314f8700 1 -- 172.21.15.59:0/2277266871 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc2c0b2910 msgr2=0x7efc2c0b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.479 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc314f8700 1 --2- 172.21.15.59:0/2277266871 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc2c0b2910 0x7efc2c0b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.479 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc314f8700 1 -- 172.21.15.59:0/2277266871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c00b1e0 con 0x7efc2c0b6380 2022-01-10T01:24:08.479 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc2bfff700 1 --2- 172.21.15.59:0/2277266871 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc2c0b2910 0x7efc2c0b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:08.479 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc314f8700 1 --2- 172.21.15.59:0/2277266871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2c0b6380 0x7efc2c1525d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7efc2c0b1e60 tx=0x7efc24007eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:08.480 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc29ffb700 1 -- 172.21.15.59:0/2277266871 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2400f470 con 0x7efc2c0b6380 2022-01-10T01:24:08.480 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc29ffb700 1 -- 172.21.15.59:0/2277266871 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2400f5d0 con 0x7efc2c0b6380 2022-01-10T01:24:08.480 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc29ffb700 1 -- 172.21.15.59:0/2277266871 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2400f930 con 0x7efc2c0b6380 2022-01-10T01:24:08.480 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc31cf9700 1 -- 172.21.15.59:0/2277266871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c0afbf0 con 0x7efc2c0b6380 2022-01-10T01:24:08.480 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.468+0000 7efc31cf9700 1 -- 172.21.15.59:0/2277266871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c153480 con 0x7efc2c0b6380 2022-01-10T01:24:08.481 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.472+0000 7efc29ffb700 1 -- 172.21.15.59:0/2277266871 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 2) v1 ==== 32734+0+0 (secure 0 0 0) 0x7efc24010070 con 0x7efc2c0b6380 2022-01-10T01:24:08.481 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.472+0000 7efc31cf9700 1 -- 172.21.15.59:0/2277266871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c143f50 con 0x7efc2c0b6380 2022-01-10T01:24:08.481 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.472+0000 7efc29ffb700 1 -- 172.21.15.59:0/2277266871 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7efc24039530 con 0x7efc2c0b6380 2022-01-10T01:24:08.482 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.472+0000 7efc29ffb700 1 -- 172.21.15.59:0/2277266871 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7efc2400fa90 con 0x7efc2c0b6380 2022-01-10T01:24:08.542 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.540+0000 7efc31cf9700 1 -- 172.21.15.59:0/2277266871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", "id": 4} v 0) v1 -- 0x7efc2c146b30 con 0x7efc2c0b6380 2022-01-10T01:24:08.552 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.552+0000 7efc29ffb700 1 -- 172.21.15.59:0/2277266871 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7efc2400fa90 con 0x7efc2c0b6380 2022-01-10T01:24:08.552 INFO:teuthology.orchestra.run.smithi059.stdout:4 2022-01-10T01:24:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.552+0000 7efc31cf9700 1 -- 172.21.15.59:0/2277266871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2c0b6380 msgr2=0x7efc2c1525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.554 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.552+0000 7efc31cf9700 1 --2- 172.21.15.59:0/2277266871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2c0b6380 0x7efc2c1525d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7efc2c0b1e60 tx=0x7efc24007eb0).stop 2022-01-10T01:24:08.555 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.552+0000 7efc31cf9700 1 -- 172.21.15.59:0/2277266871 shutdown_connections 2022-01-10T01:24:08.555 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.552+0000 7efc31cf9700 1 --2- 172.21.15.59:0/2277266871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc2c0b6380 0x7efc2c1525d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.555 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.552+0000 7efc31cf9700 1 --2- 172.21.15.59:0/2277266871 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc2c0b2910 0x7efc2c0b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.555 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.552+0000 7efc31cf9700 1 --2- 172.21.15.59:0/2277266871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc2c0612f0 0x7efc2c0b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.555 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.552+0000 7efc31cf9700 1 -- 172.21.15.59:0/2277266871 >> 172.21.15.59:0/2277266871 conn(0x7efc2c063670 msgr2=0x7efc2c0b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:08.556 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.552+0000 7efc31cf9700 1 -- 172.21.15.59:0/2277266871 shutdown_connections 2022-01-10T01:24:08.556 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.552+0000 7efc31cf9700 1 -- 172.21.15.59:0/2277266871 wait complete. 2022-01-10T01:24:08.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new cf1bcd16-ec47-48e8-a02d-4584906a733c 5 2022-01-10T01:24:08.669 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.668+0000 7f18fc423700 1 Processor -- start 2022-01-10T01:24:08.670 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.668+0000 7f18fc423700 1 -- start start 2022-01-10T01:24:08.672 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.668+0000 7f18fc423700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18f4146950 0x7f18f4140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.673 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.668+0000 7f18fc423700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f18f40b4180 0x7f18f4140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.673 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.668+0000 7f18fc423700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f4143b60 con 0x7f18f40b4690 2022-01-10T01:24:08.673 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.668+0000 7f18fc423700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f4147510 con 0x7f18f40b4180 2022-01-10T01:24:08.673 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.668+0000 7f18fc423700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f4143e00 con 0x7f18f4146950 2022-01-10T01:24:08.674 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.668+0000 7f18fa1bf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18f4146950 0x7f18f4140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.674 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.668+0000 7f18fa1bf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18f4146950 0x7f18f4140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54918/0 (socket says 172.21.15.59:54918) 2022-01-10T01:24:08.674 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.668+0000 7f18fa1bf700 1 -- 172.21.15.59:0/597666565 learned_addr learned my addr 172.21.15.59:0/597666565 (peer_addr_for_me v2:172.21.15.59:0/0) 2022-01-10T01:24:08.674 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.668+0000 7f18f99be700 1 --2- 172.21.15.59:0/597666565 >> v2:172.21.15.36:3300/0 conn(0x7f18f40b4180 0x7f18f4140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.675 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18fa1bf700 1 -- 172.21.15.59:0/597666565 >> v2:172.21.15.36:3300/0 conn(0x7f18f40b4180 msgr2=0x7f18f4140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:08.675 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18fa1bf700 1 --2- 172.21.15.59:0/597666565 >> v2:172.21.15.36:3300/0 conn(0x7f18f40b4180 0x7f18f4140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.675 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18fa1bf700 1 -- 172.21.15.59:0/597666565 >> v1:172.21.15.36:6789/0 conn(0x7f18f40b4690 legacy=0x7f18f40b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.675 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18f91bd700 1 -- 172.21.15.59:0/597666565 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990105188 0 0) 0x7f18f4143b60 con 0x7f18f40b4690 2022-01-10T01:24:08.675 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18fa1bf700 1 -- 172.21.15.59:0/597666565 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f40b0c90 con 0x7f18f4146950 2022-01-10T01:24:08.676 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18f99be700 1 --2- 172.21.15.59:0/597666565 >> v2:172.21.15.36:3300/0 conn(0x7f18f40b4180 0x7f18f4140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:08.676 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18fa1bf700 1 --2- 172.21.15.59:0/597666565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f4146950 0x7f18f4140230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f18e8002f70 tx=0x7f18e8006eb0).ready entity=mon.1 client_cookie=d8b60f23ce62b7f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:08.676 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18f91bd700 1 -- 172.21.15.59:0/597666565 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18e800d5c0 con 0x7f18f4146950 2022-01-10T01:24:08.676 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18f91bd700 1 -- 172.21.15.59:0/597666565 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e8000e90 con 0x7f18f4146950 2022-01-10T01:24:08.677 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18f91bd700 1 -- 172.21.15.59:0/597666565 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18e800d910 con 0x7f18f4146950 2022-01-10T01:24:08.680 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18fc423700 1 -- 172.21.15.59:0/597666565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f4146950 msgr2=0x7f18f4140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18fc423700 1 --2- 172.21.15.59:0/597666565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f4146950 0x7f18f4140230 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f18e8002f70 tx=0x7f18e8006eb0).stop 2022-01-10T01:24:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18fc423700 1 -- 172.21.15.59:0/597666565 shutdown_connections 2022-01-10T01:24:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18fc423700 1 --2- 172.21.15.59:0/597666565 >> v2:172.21.15.36:3300/0 conn(0x7f18f40b4180 0x7f18f4140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18fc423700 1 --2- 172.21.15.59:0/597666565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f4146950 0x7f18f4140230 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18fc423700 1 -- 172.21.15.59:0/597666565 >> 172.21.15.59:0/597666565 conn(0x7f18f405c490 msgr2=0x7f18f405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18fc423700 1 -- 172.21.15.59:0/597666565 shutdown_connections 2022-01-10T01:24:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.672+0000 7f18fc423700 1 -- 172.21.15.59:0/597666565 wait complete. 2022-01-10T01:24:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fc423700 1 Processor -- start 2022-01-10T01:24:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fc423700 1 -- start start 2022-01-10T01:24:08.683 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fc423700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18f40b4180 0x7f18f40b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.683 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fc423700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f40b4690 0x7f18f40b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.683 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fc423700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f4146950 0x7f18f40aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fc423700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f40b7fe0 con 0x7f18f40b4180 2022-01-10T01:24:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fc423700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f41523a0 con 0x7f18f4146950 2022-01-10T01:24:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fc423700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4152640 con 0x7f18f40b4690 2022-01-10T01:24:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18f99be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f40b4690 0x7f18f40b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fa9c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f4146950 0x7f18f40aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18f99be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f40b4690 0x7f18f40b77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54386/0 (socket says 172.21.15.59:54386) 2022-01-10T01:24:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fa9c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f4146950 0x7f18f40aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54926/0 (socket says 172.21.15.59:54926) 2022-01-10T01:24:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18f99be700 1 -- 172.21.15.59:0/3937517064 learned_addr learned my addr 172.21.15.59:0/3937517064 (peer_addr_for_me v2:172.21.15.59:0/0) 2022-01-10T01:24:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fa1bf700 1 --2- 172.21.15.59:0/3937517064 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18f40b4180 0x7f18f40b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.686 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18f99be700 1 -- 172.21.15.59:0/3937517064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f40b4690 msgr2=0x7f18f40b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2022-01-10T01:24:08.686 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18f99be700 1 -- 172.21.15.59:0/3937517064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f40b4690 msgr2=0x7f18f40b77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-01-10T01:24:08.686 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18f99be700 1 --2- 172.21.15.59:0/3937517064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f40b4690 0x7f18f40b77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:08.686 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18f99be700 1 --2- 172.21.15.59:0/3937517064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f40b4690 0x7f18f40b77c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fa9c0700 1 -- 172.21.15.59:0/3937517064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f40b4690 msgr2=0x7f18f40b77c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-01-10T01:24:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fa9c0700 1 --2- 172.21.15.59:0/3937517064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f40b4690 0x7f18f40b77c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fa9c0700 1 -- 172.21.15.59:0/3937517064 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18f40b4180 msgr2=0x7f18f40b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fa9c0700 1 --2- 172.21.15.59:0/3937517064 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18f40b4180 0x7f18f40b03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fa9c0700 1 -- 172.21.15.59:0/3937517064 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f000b180 con 0x7f18f4146950 2022-01-10T01:24:08.688 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fa9c0700 1 --2- 172.21.15.59:0/3937517064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f4146950 0x7f18f40aeff0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f18ec001250 tx=0x7f18ec007d30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:08.688 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18e77fe700 1 -- 172.21.15.59:0/3937517064 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18ec00f470 con 0x7f18f4146950 2022-01-10T01:24:08.688 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18e77fe700 1 -- 172.21.15.59:0/3937517064 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec00f5d0 con 0x7f18f4146950 2022-01-10T01:24:08.688 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fc423700 1 -- 172.21.15.59:0/3937517064 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e800b1e0 con 0x7f18f4146950 2022-01-10T01:24:08.689 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18e77fe700 1 -- 172.21.15.59:0/3937517064 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18ec00f930 con 0x7f18f4146950 2022-01-10T01:24:08.689 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.676+0000 7f18fc423700 1 -- 172.21.15.59:0/3937517064 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f4152b80 con 0x7f18f4146950 2022-01-10T01:24:08.689 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.680+0000 7f18e77fe700 1 -- 172.21.15.59:0/3937517064 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 2) v1 ==== 32734+0+0 (secure 0 0 0) 0x7f18ec019030 con 0x7f18f4146950 2022-01-10T01:24:08.689 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.680+0000 7f18fc423700 1 -- 172.21.15.59:0/3937517064 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f4057350 con 0x7f18f4146950 2022-01-10T01:24:08.689 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.680+0000 7f18e77fe700 1 -- 172.21.15.59:0/3937517064 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1705+0+0 (secure 0 0 0) 0x7f18ec039990 con 0x7f18f4146950 2022-01-10T01:24:08.690 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.680+0000 7f18e77fe700 1 -- 172.21.15.59:0/3937517064 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f18ec01b3b0 con 0x7f18f4146950 2022-01-10T01:24:08.747 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.743+0000 7f18fc423700 1 -- 172.21.15.59:0/3937517064 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", "id": 5} v 0) v1 -- 0x7f18f40698e0 con 0x7f18f4146950 2022-01-10T01:24:08.757 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.755+0000 7f18e77fe700 1 -- 172.21.15.59:0/3937517064 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f18ec0192c0 con 0x7f18f4146950 2022-01-10T01:24:08.758 INFO:teuthology.orchestra.run.smithi059.stdout:5 2022-01-10T01:24:08.759 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.755+0000 7f18fc423700 1 -- 172.21.15.59:0/3937517064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f4146950 msgr2=0x7f18f40aeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.759 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.755+0000 7f18fc423700 1 --2- 172.21.15.59:0/3937517064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f4146950 0x7f18f40aeff0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f18ec001250 tx=0x7f18ec007d30).stop 2022-01-10T01:24:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.755+0000 7f18fc423700 1 -- 172.21.15.59:0/3937517064 shutdown_connections 2022-01-10T01:24:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.755+0000 7f18fc423700 1 --2- 172.21.15.59:0/3937517064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f4146950 0x7f18f40aeff0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.755+0000 7f18fc423700 1 --2- 172.21.15.59:0/3937517064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f40b4690 0x7f18f40b77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.755+0000 7f18fc423700 1 --2- 172.21.15.59:0/3937517064 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18f40b4180 0x7f18f40b03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.761 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.755+0000 7f18fc423700 1 -- 172.21.15.59:0/3937517064 >> 172.21.15.59:0/3937517064 conn(0x7f18f405c490 msgr2=0x7f18f40b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:08.761 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.755+0000 7f18fc423700 1 -- 172.21.15.59:0/3937517064 shutdown_connections 2022-01-10T01:24:08.761 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.755+0000 7f18fc423700 1 -- 172.21.15.59:0/3937517064 wait complete. 2022-01-10T01:24:08.770 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 422dfc5a-d338-4a98-aaea-9bfccaaa81bb 6 2022-01-10T01:24:08.873 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.871+0000 7f63acea9700 1 Processor -- start 2022-01-10T01:24:08.873 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.871+0000 7f63acea9700 1 -- start start 2022-01-10T01:24:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.871+0000 7f63acea9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a80b25a0 0x7f63a8066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.871+0000 7f63acea9700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a8065330 con 0x7f63a80b3000 2022-01-10T01:24:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.871+0000 7f63acea9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a80b33e0 con 0x7f63a8066a10 2022-01-10T01:24:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.871+0000 7f63acea9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a8062000 con 0x7f63a80b25a0 2022-01-10T01:24:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.871+0000 7f63a6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a80b25a0 0x7f63a8066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.871+0000 7f63a7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f63a8066a10 0x7f63a814d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37530/0 (socket says 172.21.15.59:37530) 2022-01-10T01:24:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.871+0000 7f63a7fff700 1 -- 172.21.15.59:0/3114279190 learned_addr learned my addr 172.21.15.59:0/3114279190 (peer_addr_for_me v1:172.21.15.59:0/0) 2022-01-10T01:24:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a6ffd700 1 -- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a80b25a0 msgr2=0x7f63a8066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-01-10T01:24:08.880 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a6ffd700 1 -- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a80b25a0 msgr2=0x7f63a8066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-01-10T01:24:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a6ffd700 1 --2- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a80b25a0 0x7f63a8066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a6ffd700 1 --2- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a80b25a0 0x7f63a8066520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 -- 172.21.15.59:0/3114279190 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213039446 0 0) 0x7f63a80b33e0 con 0x7f63a8066a10 2022-01-10T01:24:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 -- 172.21.15.59:0/3114279190 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6388003260 con 0x7f63a8066a10 2022-01-10T01:24:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 -- 172.21.15.59:0/3114279190 <== mon.1 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4223610305 0 0) 0x7f6388003260 con 0x7f63a8066a10 2022-01-10T01:24:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 -- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a80b25a0 msgr2=0x7f63a8066520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-01-10T01:24:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 --2- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a80b25a0 0x7f63a8066520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 -- 172.21.15.59:0/3114279190 >> v1:172.21.15.36:6789/0 conn(0x7f63a80b3000 legacy=0x7f63a8060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 -- 172.21.15.59:0/3114279190 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a805fa60 con 0x7f63a8066a10 2022-01-10T01:24:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 -- 172.21.15.59:0/3114279190 <== mon.1 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f63a00019e0 con 0x7f63a8066a10 2022-01-10T01:24:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 -- 172.21.15.59:0/3114279190 >> v1:172.21.15.59:6789/0 conn(0x7f63a8066a10 legacy=0x7f63a814d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 --2- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a80b25a0 0x7f6388003770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 --2- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6388003d50 0x7f6388004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 --2- 172.21.15.59:0/3114279190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63880049f0 0x7f6388004e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 -- 172.21.15.59:0/3114279190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a8062000 con 0x7f63880049f0 2022-01-10T01:24:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 -- 172.21.15.59:0/3114279190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638800b880 con 0x7f6388003d50 2022-01-10T01:24:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 -- 172.21.15.59:0/3114279190 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638800ba40 con 0x7f63a80b25a0 2022-01-10T01:24:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a77fe700 1 --2- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a80b25a0 0x7f6388003770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a6ffd700 1 --2- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6388003d50 0x7f6388004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a77fe700 1 -- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6388003d50 msgr2=0x7f6388004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:08.886 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a77fe700 1 --2- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6388003d50 0x7f6388004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.886 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a77fe700 1 -- 172.21.15.59:0/3114279190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63880049f0 msgr2=0x7f6388004e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:08.886 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a77fe700 1 --2- 172.21.15.59:0/3114279190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63880049f0 0x7f6388004e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-01-10T01:24:08.886 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a77fe700 1 -- 172.21.15.59:0/3114279190 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6388003260 con 0x7f63a80b25a0 2022-01-10T01:24:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a77fe700 1 --2- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a80b25a0 0x7f6388003770 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f63a8063350 tx=0x7f6398007a00).ready entity=mon.2 client_cookie=a9408660716cf432 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 -- 172.21.15.59:0/3114279190 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6398007d10 con 0x7f63a80b25a0 2022-01-10T01:24:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 -- 172.21.15.59:0/3114279190 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6398007030 con 0x7f63a80b25a0 2022-01-10T01:24:08.887 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a67fc700 1 -- 172.21.15.59:0/3114279190 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6398007390 con 0x7f63a80b25a0 2022-01-10T01:24:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63acea9700 1 -- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a80b25a0 msgr2=0x7f6388003770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63acea9700 1 --2- 172.21.15.59:0/3114279190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a80b25a0 0x7f6388003770 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f63a8063350 tx=0x7f6398007a00).stop 2022-01-10T01:24:08.892 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63a7fff700 1 -- 172.21.15.59:0/3114279190 reap_dead start 2022-01-10T01:24:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63acea9700 1 -- 172.21.15.59:0/3114279190 shutdown_connections 2022-01-10T01:24:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63acea9700 1 -- 172.21.15.59:0/3114279190 >> 172.21.15.59:0/3114279190 conn(0x7f63a80636e0 msgr2=0x7f63a8063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63acea9700 1 -- 172.21.15.59:0/3114279190 shutdown_connections 2022-01-10T01:24:08.893 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.875+0000 7f63acea9700 1 -- 172.21.15.59:0/3114279190 wait complete. 2022-01-10T01:24:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63acea9700 1 Processor -- start 2022-01-10T01:24:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63acea9700 1 -- start start 2022-01-10T01:24:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63acea9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a80b25a0 0x7f63a8146330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.894 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63acea9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63a80adce0 0x7f63a8152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.895 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63acea9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a81559b0 0x7f63a8155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:08.895 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63acea9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a81523e0 con 0x7f63a80adce0 2022-01-10T01:24:08.895 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63acea9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a80ae1f0 con 0x7f63a80b25a0 2022-01-10T01:24:08.895 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63acea9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a81525d0 con 0x7f63a81559b0 2022-01-10T01:24:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63a77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a80b25a0 0x7f63a8146330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63a7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a81559b0 0x7f63a8155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63a77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a80b25a0 0x7f63a8146330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54940/0 (socket says 172.21.15.59:54940) 2022-01-10T01:24:08.896 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63a7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a81559b0 0x7f63a8155e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54406/0 (socket says 172.21.15.59:54406) 2022-01-10T01:24:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63a77fe700 1 -- 172.21.15.59:0/133642766 learned_addr learned my addr 172.21.15.59:0/133642766 (peer_addr_for_me v2:172.21.15.59:0/0) 2022-01-10T01:24:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63a6ffd700 1 --2- 172.21.15.59:0/133642766 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63a80adce0 0x7f63a8152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63a7fff700 1 -- 172.21.15.59:0/133642766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a81559b0 msgr2=0x7f63a8155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2022-01-10T01:24:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63a7fff700 1 -- 172.21.15.59:0/133642766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a81559b0 msgr2=0x7f63a8155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-01-10T01:24:08.897 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.879+0000 7f63a7fff700 1 --2- 172.21.15.59:0/133642766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a81559b0 0x7f63a8155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:08.898 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63a7fff700 1 --2- 172.21.15.59:0/133642766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a81559b0 0x7f63a8155e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:08.898 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63a77fe700 1 -- 172.21.15.59:0/133642766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a81559b0 msgr2=0x7f63a8155e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-01-10T01:24:08.898 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63a77fe700 1 --2- 172.21.15.59:0/133642766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a81559b0 0x7f63a8155e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.898 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63a77fe700 1 -- 172.21.15.59:0/133642766 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63a80adce0 msgr2=0x7f63a8152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63a77fe700 1 --2- 172.21.15.59:0/133642766 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63a80adce0 0x7f63a8152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63a77fe700 1 -- 172.21.15.59:0/133642766 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a8152870 con 0x7f63a80b25a0 2022-01-10T01:24:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63a6ffd700 1 --2- 172.21.15.59:0/133642766 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63a80adce0 0x7f63a8152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:08.899 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63a77fe700 1 --2- 172.21.15.59:0/133642766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a80b25a0 0x7f63a8146330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f63a8063350 tx=0x7f6398015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63a4ff9700 1 -- 172.21.15.59:0/133642766 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6398020640 con 0x7f63a80b25a0 2022-01-10T01:24:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63a4ff9700 1 -- 172.21.15.59:0/133642766 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63980207a0 con 0x7f63a80b25a0 2022-01-10T01:24:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63a4ff9700 1 -- 172.21.15.59:0/133642766 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6398020b00 con 0x7f63a80b25a0 2022-01-10T01:24:08.900 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63acea9700 1 -- 172.21.15.59:0/133642766 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a80ad6e0 con 0x7f63a80b25a0 2022-01-10T01:24:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63acea9700 1 -- 172.21.15.59:0/133642766 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a8153200 con 0x7f63a80b25a0 2022-01-10T01:24:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63a4ff9700 1 -- 172.21.15.59:0/133642766 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 2) v1 ==== 32734+0+0 (secure 0 0 0) 0x7f639801d070 con 0x7f63a80b25a0 2022-01-10T01:24:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63a4ff9700 1 -- 172.21.15.59:0/133642766 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1844+0+0 (secure 0 0 0) 0x7f639803b160 con 0x7f63a80b25a0 2022-01-10T01:24:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.883+0000 7f63acea9700 1 -- 172.21.15.59:0/133642766 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a8152a00 con 0x7f63a80b25a0 2022-01-10T01:24:08.902 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.887+0000 7f63a4ff9700 1 -- 172.21.15.59:0/133642766 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f639801e920 con 0x7f63a80b25a0 2022-01-10T01:24:08.957 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.955+0000 7f63acea9700 1 -- 172.21.15.59:0/133642766 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", "id": 6} v 0) v1 -- 0x7f63a805fd00 con 0x7f63a80b25a0 2022-01-10T01:24:08.966 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.963+0000 7f63a4ff9700 1 -- 172.21.15.59:0/133642766 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f639801e350 con 0x7f63a80b25a0 2022-01-10T01:24:08.967 INFO:teuthology.orchestra.run.smithi059.stdout:6 2022-01-10T01:24:08.968 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.963+0000 7f63acea9700 1 -- 172.21.15.59:0/133642766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a80b25a0 msgr2=0x7f63a8146330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:08.968 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.963+0000 7f63acea9700 1 --2- 172.21.15.59:0/133642766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a80b25a0 0x7f63a8146330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f63a8063350 tx=0x7f6398015000).stop 2022-01-10T01:24:08.968 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.963+0000 7f63acea9700 1 -- 172.21.15.59:0/133642766 shutdown_connections 2022-01-10T01:24:08.969 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.963+0000 7f63acea9700 1 --2- 172.21.15.59:0/133642766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63a81559b0 0x7f63a8155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.969 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.963+0000 7f63acea9700 1 --2- 172.21.15.59:0/133642766 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63a80adce0 0x7f63a8152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.969 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.963+0000 7f63acea9700 1 --2- 172.21.15.59:0/133642766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a80b25a0 0x7f63a8146330 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:08.969 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.963+0000 7f63acea9700 1 -- 172.21.15.59:0/133642766 >> 172.21.15.59:0/133642766 conn(0x7f63a80636e0 msgr2=0x7f63a81455d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.967+0000 7f63acea9700 1 -- 172.21.15.59:0/133642766 shutdown_connections 2022-01-10T01:24:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:08.967+0000 7f63acea9700 1 -- 172.21.15.59:0/133642766 wait complete. 2022-01-10T01:24:08.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 192022a0-7ba3-469e-a84e-f9ec7c31ac51 7 2022-01-10T01:24:09.081 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.079+0000 7fcea359e700 1 Processor -- start 2022-01-10T01:24:09.082 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.079+0000 7fcea359e700 1 -- start start 2022-01-10T01:24:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.079+0000 7fcea359e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fcea40b0710 0x7fcea4142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.079+0000 7fcea359e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea4143920 con 0x7fcea40b30d0 2022-01-10T01:24:09.085 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.079+0000 7fcea359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea40b0af0 con 0x7fcea40ace70 2022-01-10T01:24:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.079+0000 7fcea359e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea40ae680 con 0x7fcea40b0710 2022-01-10T01:24:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.079+0000 7fcea2d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcea40ace70 0x7fcea413f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37544/0 (socket says 172.21.15.59:37544) 2022-01-10T01:24:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.079+0000 7fcea2d9d700 1 -- 172.21.15.59:0/2810047178 learned_addr learned my addr 172.21.15.59:0/2810047178 (peer_addr_for_me v1:172.21.15.59:0/0) 2022-01-10T01:24:09.086 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.079+0000 7fcea259c700 1 --2- 172.21.15.59:0/2810047178 >> v2:172.21.15.36:3300/0 conn(0x7fcea40b0710 0x7fcea4142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.079+0000 7fcea159a700 1 -- 172.21.15.59:0/2810047178 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285932934 0 0) 0x7fcea40b0af0 con 0x7fcea40ace70 2022-01-10T01:24:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea159a700 1 -- 172.21.15.59:0/2810047178 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce88003260 con 0x7fcea40ace70 2022-01-10T01:24:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea259c700 1 -- 172.21.15.59:0/2810047178 >> v1:172.21.15.59:6789/0 conn(0x7fcea40ace70 legacy=0x7fcea413f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:09.087 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea259c700 1 -- 172.21.15.59:0/2810047178 >> v1:172.21.15.36:6789/0 conn(0x7fcea40b30d0 legacy=0x7fcea4143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:09.088 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea259c700 1 -- 172.21.15.59:0/2810047178 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea40ae920 con 0x7fcea40b0710 2022-01-10T01:24:09.088 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea259c700 1 --2- 172.21.15.59:0/2810047178 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcea40b0710 0x7fcea4142d20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fce98002f70 tx=0x7fce98006df0).ready entity=mon.0 client_cookie=3c0ba7bc5234b2e1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:09.088 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea159a700 1 -- 172.21.15.59:0/2810047178 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce9800d5c0 con 0x7fcea40b0710 2022-01-10T01:24:09.088 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea159a700 1 -- 172.21.15.59:0/2810047178 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce98000e90 con 0x7fcea40b0710 2022-01-10T01:24:09.089 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea159a700 1 -- 172.21.15.59:0/2810047178 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce9800d910 con 0x7fcea40b0710 2022-01-10T01:24:09.089 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea359e700 1 -- 172.21.15.59:0/2810047178 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcea40b0710 msgr2=0x7fcea4142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:09.089 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea359e700 1 --2- 172.21.15.59:0/2810047178 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcea40b0710 0x7fcea4142d20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fce98002f70 tx=0x7fce98006df0).stop 2022-01-10T01:24:09.089 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea359e700 1 -- 172.21.15.59:0/2810047178 shutdown_connections 2022-01-10T01:24:09.089 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea359e700 1 --2- 172.21.15.59:0/2810047178 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcea40b0710 0x7fcea4142d20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:09.090 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea359e700 1 -- 172.21.15.59:0/2810047178 >> 172.21.15.59:0/2810047178 conn(0x7fcea4061140 msgr2=0x7fcea4062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:09.093 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea359e700 1 -- 172.21.15.59:0/2810047178 shutdown_connections 2022-01-10T01:24:09.094 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea359e700 1 -- 172.21.15.59:0/2810047178 wait complete. 2022-01-10T01:24:09.097 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea359e700 1 Processor -- start 2022-01-10T01:24:09.098 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.083+0000 7fcea359e700 1 -- start start 2022-01-10T01:24:09.098 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcea40ace70 0x7fcea4064e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:09.098 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcea40b0710 0x7fcea4064260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:09.099 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcea40b30d0 0x7fcea4153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:09.099 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea40ab310 con 0x7fcea40b30d0 2022-01-10T01:24:09.100 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4063f90 con 0x7fcea40b0710 2022-01-10T01:24:09.100 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea40ac3e0 con 0x7fcea40ace70 2022-01-10T01:24:09.100 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcea40ace70 0x7fcea4064e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:09.101 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea1d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcea40b0710 0x7fcea4064260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:09.101 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea1d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcea40b0710 0x7fcea4064260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54952/0 (socket says 172.21.15.59:54952) 2022-01-10T01:24:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcea40ace70 0x7fcea4064e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:54412/0 (socket says 172.21.15.59:54412) 2022-01-10T01:24:09.102 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea1d9b700 1 -- 172.21.15.59:0/3636226196 learned_addr learned my addr 172.21.15.59:0/3636226196 (peer_addr_for_me v2:172.21.15.59:0/0) 2022-01-10T01:24:09.103 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea2d9d700 1 --2- 172.21.15.59:0/3636226196 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcea40b30d0 0x7fcea4153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:09.103 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea259c700 1 -- 172.21.15.59:0/3636226196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcea40ace70 msgr2=0x7fcea4064e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-01-10T01:24:09.104 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea259c700 1 -- 172.21.15.59:0/3636226196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcea40ace70 msgr2=0x7fcea4064e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-01-10T01:24:09.104 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea259c700 1 --2- 172.21.15.59:0/3636226196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcea40ace70 0x7fcea4064e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:09.105 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea259c700 1 --2- 172.21.15.59:0/3636226196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcea40ace70 0x7fcea4064e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:09.105 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea1d9b700 1 -- 172.21.15.59:0/3636226196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcea40ace70 msgr2=0x7fcea4064e00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-01-10T01:24:09.105 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea1d9b700 1 --2- 172.21.15.59:0/3636226196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcea40ace70 0x7fcea4064e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:09.106 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea1d9b700 1 -- 172.21.15.59:0/3636226196 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcea40b30d0 msgr2=0x7fcea4153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:09.106 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea1d9b700 1 --2- 172.21.15.59:0/3636226196 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcea40b30d0 0x7fcea4153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:09.107 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea1d9b700 1 -- 172.21.15.59:0/3636226196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9800b180 con 0x7fcea40b0710 2022-01-10T01:24:09.107 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea1d9b700 1 --2- 172.21.15.59:0/3636226196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcea40b0710 0x7fcea4064260 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcea40640d0 tx=0x7fce9400c7f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:09.108 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fce937fe700 1 -- 172.21.15.59:0/3636226196 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce94006aa0 con 0x7fcea40b0710 2022-01-10T01:24:09.108 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fce937fe700 1 -- 172.21.15.59:0/3636226196 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce94006c00 con 0x7fcea40b0710 2022-01-10T01:24:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea359e700 1 -- 172.21.15.59:0/3636226196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea4067c00 con 0x7fcea40b0710 2022-01-10T01:24:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fce937fe700 1 -- 172.21.15.59:0/3636226196 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce94007030 con 0x7fcea40b0710 2022-01-10T01:24:09.110 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fcea359e700 1 -- 172.21.15.59:0/3636226196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea4067940 con 0x7fcea40b0710 2022-01-10T01:24:09.110 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fce937fe700 1 -- 172.21.15.59:0/3636226196 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 2) v1 ==== 32734+0+0 (secure 0 0 0) 0x7fce94010030 con 0x7fcea40b0710 2022-01-10T01:24:09.110 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.087+0000 7fce937fe700 1 -- 172.21.15.59:0/3636226196 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1959+0+0 (secure 0 0 0) 0x7fce9403a1c0 con 0x7fcea40b0710 2022-01-10T01:24:09.111 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.091+0000 7fcea359e700 1 -- 172.21.15.59:0/3636226196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea4063c80 con 0x7fcea40b0710 2022-01-10T01:24:09.111 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.091+0000 7fce937fe700 1 -- 172.21.15.59:0/3636226196 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fce9401c3e0 con 0x7fcea40b0710 2022-01-10T01:24:09.167 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.163+0000 7fcea359e700 1 -- 172.21.15.59:0/3636226196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", "id": 7} v 0) v1 -- 0x7fcea4057350 con 0x7fcea40b0710 2022-01-10T01:24:09.176 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.175+0000 7fce937fe700 1 -- 172.21.15.59:0/3636226196 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fce940390b0 con 0x7fcea40b0710 2022-01-10T01:24:09.176 INFO:teuthology.orchestra.run.smithi059.stdout:7 2022-01-10T01:24:09.178 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.175+0000 7fcea359e700 1 -- 172.21.15.59:0/3636226196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcea40b0710 msgr2=0x7fcea4064260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:09.179 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.175+0000 7fcea359e700 1 --2- 172.21.15.59:0/3636226196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcea40b0710 0x7fcea4064260 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcea40640d0 tx=0x7fce9400c7f0).stop 2022-01-10T01:24:09.179 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.175+0000 7fcea359e700 1 -- 172.21.15.59:0/3636226196 shutdown_connections 2022-01-10T01:24:09.180 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.175+0000 7fcea359e700 1 --2- 172.21.15.59:0/3636226196 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcea40b30d0 0x7fcea4153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:09.180 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.175+0000 7fcea359e700 1 --2- 172.21.15.59:0/3636226196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcea40b0710 0x7fcea4064260 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:09.181 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.175+0000 7fcea359e700 1 --2- 172.21.15.59:0/3636226196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcea40ace70 0x7fcea4064e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:09.181 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.175+0000 7fcea359e700 1 -- 172.21.15.59:0/3636226196 >> 172.21.15.59:0/3636226196 conn(0x7fcea4061140 msgr2=0x7fcea4140ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:09.181 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.175+0000 7fcea359e700 1 -- 172.21.15.59:0/3636226196 shutdown_connections 2022-01-10T01:24:09.182 INFO:teuthology.orchestra.run.smithi059.stderr:2022-01-10T01:24:09.175+0000 7fcea359e700 1 -- 172.21.15.59:0/3636226196 wait complete. 2022-01-10T01:24:09.190 INFO:tasks.ceph.osd.0:Restarting daemon 2022-01-10T01:24:09.190 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-01-10T01:24:09.194 INFO:tasks.ceph.osd.0:Started 2022-01-10T01:24:09.194 INFO:tasks.ceph.osd.1:Restarting daemon 2022-01-10T01:24:09.195 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-01-10T01:24:09.198 INFO:tasks.ceph.osd.1:Started 2022-01-10T01:24:09.199 INFO:tasks.ceph.osd.2:Restarting daemon 2022-01-10T01:24:09.200 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-01-10T01:24:09.203 INFO:tasks.ceph.osd.2:Started 2022-01-10T01:24:09.204 INFO:tasks.ceph.osd.3:Restarting daemon 2022-01-10T01:24:09.204 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-01-10T01:24:09.207 INFO:tasks.ceph.osd.3:Started 2022-01-10T01:24:09.207 INFO:tasks.ceph.osd.4:Restarting daemon 2022-01-10T01:24:09.208 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-01-10T01:24:09.210 INFO:tasks.ceph.osd.4:Started 2022-01-10T01:24:09.211 INFO:tasks.ceph.osd.5:Restarting daemon 2022-01-10T01:24:09.211 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-01-10T01:24:09.214 INFO:tasks.ceph.osd.5:Started 2022-01-10T01:24:09.214 INFO:tasks.ceph.osd.6:Restarting daemon 2022-01-10T01:24:09.215 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-01-10T01:24:09.217 INFO:tasks.ceph.osd.6:Started 2022-01-10T01:24:09.217 INFO:tasks.ceph.osd.7:Restarting daemon 2022-01-10T01:24:09.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-01-10T01:24:09.220 INFO:tasks.ceph.osd.7:Started 2022-01-10T01:24:09.221 INFO:tasks.ceph:Waiting for OSDs to come up 2022-01-10T01:24:09.562 INFO:tasks.ceph.osd.0.smithi036.stderr:2022-01-10T01:24:09.557+0000 7f634589dd80 -1 Falling back to public interface 2022-01-10T01:24:09.577 INFO:tasks.ceph.osd.4.smithi059.stderr:2022-01-10T01:24:09.575+0000 7fe420888d80 -1 Falling back to public interface 2022-01-10T01:24:09.814 INFO:tasks.ceph.osd.6.smithi059.stderr:2022-01-10T01:24:09.811+0000 7f9882af9d80 -1 Falling back to public interface 2022-01-10T01:24:09.817 INFO:tasks.ceph.osd.5.smithi059.stderr:2022-01-10T01:24:09.815+0000 7f5a0a6a1d80 -1 Falling back to public interface 2022-01-10T01:24:09.818 INFO:tasks.ceph.osd.2.smithi036.stderr:2022-01-10T01:24:09.813+0000 7f9c29e16d80 -1 Falling back to public interface 2022-01-10T01:24:09.819 INFO:tasks.ceph.osd.3.smithi036.stderr:2022-01-10T01:24:09.813+0000 7fa0f3c99d80 -1 Falling back to public interface 2022-01-10T01:24:09.830 INFO:tasks.ceph.osd.1.smithi036.stderr:2022-01-10T01:24:09.825+0000 7f3e39714d80 -1 Falling back to public interface 2022-01-10T01:24:09.849 INFO:tasks.ceph.osd.7.smithi059.stderr:2022-01-10T01:24:09.847+0000 7f3238378d80 -1 Falling back to public interface 2022-01-10T01:24:10.027 DEBUG:teuthology.orchestra.run.smithi036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:10.126 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.121+0000 7fae9a87a700 1 Processor -- start 2022-01-10T01:24:10.126 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.121+0000 7fae9a87a700 1 -- start start 2022-01-10T01:24:10.128 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.121+0000 7fae9a87a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fae940b0370 0x7fae94066910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:10.129 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.121+0000 7fae9a87a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae940b3ae0 con 0x7fae940b3700 2022-01-10T01:24:10.129 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.121+0000 7fae9a87a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae94143300 con 0x7fae94140420 2022-01-10T01:24:10.129 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.121+0000 7fae9a87a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae941435a0 con 0x7fae940b0370 2022-01-10T01:24:10.129 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.121+0000 7fae99077700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fae940b0370 0x7fae94066910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:10.130 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.121+0000 7fae99077700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fae940b0370 0x7fae94066910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33198/0 (socket says 172.21.15.36:33198) 2022-01-10T01:24:10.130 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.121+0000 7fae99077700 1 -- 172.21.15.36:0/106894585 learned_addr learned my addr 172.21.15.36:0/106894585 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:10.130 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.121+0000 7fae99077700 1 -- 172.21.15.36:0/106894585 >> v1:172.21.15.59:6789/0 conn(0x7fae94140420 legacy=0x7fae94066e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:10.130 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.121+0000 7fae99077700 1 -- 172.21.15.36:0/106894585 >> v1:172.21.15.36:6789/0 conn(0x7fae940b3700 legacy=0x7fae9413fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:10.131 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.121+0000 7fae99077700 1 -- 172.21.15.36:0/106894585 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae94143840 con 0x7fae940b0370 2022-01-10T01:24:10.131 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.121+0000 7fae99077700 1 --2- 172.21.15.36:0/106894585 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae940b0370 0x7fae94066910 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fae940b3fa0 tx=0x7fae84006eb0).ready entity=mon.0 client_cookie=ed6708c2d9481705 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:10.131 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.125+0000 7fae98876700 1 -- 172.21.15.36:0/106894585 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8400d610 con 0x7fae940b0370 2022-01-10T01:24:10.131 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.125+0000 7fae98876700 1 -- 172.21.15.36:0/106894585 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae84000e90 con 0x7fae940b0370 2022-01-10T01:24:10.132 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.125+0000 7fae98876700 1 -- 172.21.15.36:0/106894585 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8400d960 con 0x7fae940b0370 2022-01-10T01:24:10.133 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.125+0000 7fae9a87a700 1 -- 172.21.15.36:0/106894585 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae940b0370 msgr2=0x7fae94066910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:10.133 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.125+0000 7fae9a87a700 1 --2- 172.21.15.36:0/106894585 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae940b0370 0x7fae94066910 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fae940b3fa0 tx=0x7fae84006eb0).stop 2022-01-10T01:24:10.134 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.125+0000 7fae9a87a700 1 -- 172.21.15.36:0/106894585 shutdown_connections 2022-01-10T01:24:10.134 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.125+0000 7fae9a87a700 1 --2- 172.21.15.36:0/106894585 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae940b0370 0x7fae94066910 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:10.134 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.125+0000 7fae9a87a700 1 -- 172.21.15.36:0/106894585 >> 172.21.15.36:0/106894585 conn(0x7fae9405c830 msgr2=0x7fae9405cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:10.134 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.125+0000 7fae9a87a700 1 -- 172.21.15.36:0/106894585 shutdown_connections 2022-01-10T01:24:10.135 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.125+0000 7fae9a87a700 1 -- 172.21.15.36:0/106894585 wait complete. 2022-01-10T01:24:10.135 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a87a700 1 Processor -- start 2022-01-10T01:24:10.135 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a87a700 1 -- start start 2022-01-10T01:24:10.138 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a87a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae940b0370 0x7fae9413f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:10.138 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a87a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae940b3700 0x7fae94065340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:10.139 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a87a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae94140420 0x7fae94065830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:10.139 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a87a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae940636f0 con 0x7fae94140420 2022-01-10T01:24:10.139 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a87a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae94063990 con 0x7fae940b3700 2022-01-10T01:24:10.139 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a87a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae94063c30 con 0x7fae940b0370 2022-01-10T01:24:10.140 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a079700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae94140420 0x7fae94065830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:10.140 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae99077700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae940b3700 0x7fae94065340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:10.140 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a079700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae94140420 0x7fae94065830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33208/0 (socket says 172.21.15.36:33208) 2022-01-10T01:24:10.140 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a079700 1 -- 172.21.15.36:0/2321288344 learned_addr learned my addr 172.21.15.36:0/2321288344 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:10.141 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae99878700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae940b0370 0x7fae9413f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:10.141 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae99878700 1 -- 172.21.15.36:0/2321288344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae940b0370 msgr2=0x7fae9413f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-01-10T01:24:10.141 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae99878700 1 -- 172.21.15.36:0/2321288344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae940b0370 msgr2=0x7fae9413f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-01-10T01:24:10.141 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae99878700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae940b0370 0x7fae9413f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-01-10T01:24:10.142 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae99878700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae940b0370 0x7fae9413f8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-01-10T01:24:10.142 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a079700 1 -- 172.21.15.36:0/2321288344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae940b0370 msgr2=0x7fae9413f8c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-01-10T01:24:10.142 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a079700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae940b0370 0x7fae9413f8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:10.142 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a079700 1 -- 172.21.15.36:0/2321288344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae940b3700 msgr2=0x7fae94065340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:10.143 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a079700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae940b3700 0x7fae94065340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:10.143 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a079700 1 -- 172.21.15.36:0/2321288344 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8400b1e0 con 0x7fae94140420 2022-01-10T01:24:10.143 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae99077700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae940b3700 0x7fae94065340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:10.143 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.129+0000 7fae9a079700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae94140420 0x7fae94065830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fae8c0032b0 tx=0x7fae8c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:10.144 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.133+0000 7fae82ffd700 1 -- 172.21.15.36:0/2321288344 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c00e540 con 0x7fae94140420 2022-01-10T01:24:10.144 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.133+0000 7fae82ffd700 1 -- 172.21.15.36:0/2321288344 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c00e6a0 con 0x7fae94140420 2022-01-10T01:24:10.144 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.133+0000 7fae82ffd700 1 -- 172.21.15.36:0/2321288344 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c00ea00 con 0x7fae94140420 2022-01-10T01:24:10.144 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.133+0000 7fae9a87a700 1 -- 172.21.15.36:0/2321288344 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae94063ed0 con 0x7fae94140420 2022-01-10T01:24:10.144 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.133+0000 7fae9a87a700 1 -- 172.21.15.36:0/2321288344 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae940b7100 con 0x7fae94140420 2022-01-10T01:24:10.146 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.133+0000 7fae9a87a700 1 -- 172.21.15.36:0/2321288344 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae94064060 con 0x7fae94140420 2022-01-10T01:24:10.146 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.137+0000 7fae82ffd700 1 -- 172.21.15.36:0/2321288344 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 3) v1 ==== 65564+0+0 (secure 0 0 0) 0x7fae8c018030 con 0x7fae94140420 2022-01-10T01:24:10.146 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.137+0000 7fae82ffd700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae740535b0 0x7fae74055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:10.146 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.137+0000 7fae99878700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae740535b0 0x7fae74055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:10.146 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.137+0000 7fae82ffd700 1 -- 172.21.15.36:0/2321288344 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2074+0+0 (secure 0 0 0) 0x7fae8c06a960 con 0x7fae94140420 2022-01-10T01:24:10.147 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.137+0000 7fae99878700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae740535b0 0x7fae74055a70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fae90000e90 tx=0x7fae90009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:10.149 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.145+0000 7fae82ffd700 1 -- 172.21.15.36:0/2321288344 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fae8c042c00 con 0x7fae94140420 2022-01-10T01:24:10.330 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.325+0000 7fae9a87a700 1 -- 172.21.15.36:0/2321288344 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae94143ae0 con 0x7fae94140420 2022-01-10T01:24:10.331 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.325+0000 7fae82ffd700 1 -- 172.21.15.36:0/2321288344 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+8274 (secure 0 0 0) 0x7fae8c020020 con 0x7fae94140420 2022-01-10T01:24:10.332 INFO:teuthology.misc.health.smithi036.stdout: 2022-01-10T01:24:10.332 INFO:teuthology.misc.health.smithi036.stdout:{"epoch":10,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:09.169126+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"8","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:10.334 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.329+0000 7fae9a87a700 1 -- 172.21.15.36:0/2321288344 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae740535b0 msgr2=0x7fae74055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:10.335 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.329+0000 7fae9a87a700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae740535b0 0x7fae74055a70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fae90000e90 tx=0x7fae90009040).stop 2022-01-10T01:24:10.335 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.329+0000 7fae9a87a700 1 -- 172.21.15.36:0/2321288344 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae94140420 msgr2=0x7fae94065830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:10.336 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.329+0000 7fae9a87a700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae94140420 0x7fae94065830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fae8c0032b0 tx=0x7fae8c0090f0).stop 2022-01-10T01:24:10.336 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.329+0000 7fae9a87a700 1 -- 172.21.15.36:0/2321288344 shutdown_connections 2022-01-10T01:24:10.336 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.329+0000 7fae9a87a700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae740535b0 0x7fae74055a70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:10.337 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.329+0000 7fae9a87a700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae94140420 0x7fae94065830 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:10.338 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.329+0000 7fae9a87a700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae940b3700 0x7fae94065340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:10.339 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.329+0000 7fae9a87a700 1 --2- 172.21.15.36:0/2321288344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae940b0370 0x7fae9413f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:10.339 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.329+0000 7fae9a87a700 1 -- 172.21.15.36:0/2321288344 >> 172.21.15.36:0/2321288344 conn(0x7fae9405c830 msgr2=0x7fae94138c80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:10.339 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.329+0000 7fae9a87a700 1 -- 172.21.15.36:0/2321288344 shutdown_connections 2022-01-10T01:24:10.339 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:10.329+0000 7fae9a87a700 1 -- 172.21.15.36:0/2321288344 wait complete. 2022-01-10T01:24:10.342 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-01-10T01:24:10.755 INFO:tasks.ceph.osd.0.smithi036.stderr:2022-01-10T01:24:10.749+0000 7f634589dd80 -1 osd.0 0 log_to_monitors {default=true} 2022-01-10T01:24:10.755 INFO:tasks.ceph.osd.4.smithi059.stderr:2022-01-10T01:24:10.755+0000 7fe420888d80 -1 osd.4 0 log_to_monitors {default=true} 2022-01-10T01:24:10.974 INFO:tasks.ceph.osd.5.smithi059.stderr:2022-01-10T01:24:10.971+0000 7f5a0a6a1d80 -1 osd.5 0 log_to_monitors {default=true} 2022-01-10T01:24:10.975 INFO:tasks.ceph.osd.3.smithi036.stderr:2022-01-10T01:24:10.969+0000 7fa0f3c99d80 -1 osd.3 0 log_to_monitors {default=true} 2022-01-10T01:24:10.975 INFO:tasks.ceph.osd.2.smithi036.stderr:2022-01-10T01:24:10.969+0000 7f9c29e16d80 -1 osd.2 0 log_to_monitors {default=true} 2022-01-10T01:24:10.988 INFO:tasks.ceph.osd.1.smithi036.stderr:2022-01-10T01:24:10.985+0000 7f3e39714d80 -1 osd.1 0 log_to_monitors {default=true} 2022-01-10T01:24:10.993 INFO:tasks.ceph.osd.6.smithi059.stderr:2022-01-10T01:24:10.991+0000 7f9882af9d80 -1 osd.6 0 log_to_monitors {default=true} 2022-01-10T01:24:11.081 INFO:tasks.ceph.osd.7.smithi059.stderr:2022-01-10T01:24:11.079+0000 7f3238378d80 -1 osd.7 0 log_to_monitors {default=true} 2022-01-10T01:24:12.650 INFO:tasks.ceph.osd.4.smithi059.stderr:2022-01-10T01:24:12.647+0000 7fe412943700 -1 osd.4 0 waiting for initial osdmap 2022-01-10T01:24:12.651 INFO:tasks.ceph.osd.3.smithi036.stderr:2022-01-10T01:24:12.645+0000 7fa0e5d54700 -1 osd.3 0 waiting for initial osdmap 2022-01-10T01:24:12.652 INFO:tasks.ceph.osd.7.smithi059.stderr:2022-01-10T01:24:12.651+0000 7f322a433700 -1 osd.7 0 waiting for initial osdmap 2022-01-10T01:24:12.652 INFO:tasks.ceph.osd.1.smithi036.stderr:2022-01-10T01:24:12.649+0000 7f3e2b7cf700 -1 osd.1 0 waiting for initial osdmap 2022-01-10T01:24:12.653 INFO:tasks.ceph.osd.2.smithi036.stderr:2022-01-10T01:24:12.649+0000 7f9c1bed1700 -1 osd.2 0 waiting for initial osdmap 2022-01-10T01:24:12.653 INFO:tasks.ceph.osd.0.smithi036.stderr:2022-01-10T01:24:12.645+0000 7f6337958700 -1 osd.0 0 waiting for initial osdmap 2022-01-10T01:24:12.654 INFO:tasks.ceph.osd.5.smithi059.stderr:2022-01-10T01:24:12.651+0000 7f59fc75c700 -1 osd.5 0 waiting for initial osdmap 2022-01-10T01:24:12.654 INFO:tasks.ceph.osd.6.smithi059.stderr:2022-01-10T01:24:12.651+0000 7f9874bb4700 -1 osd.6 0 waiting for initial osdmap 2022-01-10T01:24:12.658 INFO:tasks.ceph.osd.4.smithi059.stderr:2022-01-10T01:24:12.655+0000 7fe419dab700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-10T01:24:12.659 INFO:tasks.ceph.osd.3.smithi036.stderr:2022-01-10T01:24:12.653+0000 7fa0ed1bc700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-10T01:24:12.660 INFO:tasks.ceph.osd.7.smithi059.stderr:2022-01-10T01:24:12.659+0000 7f323189b700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-10T01:24:12.660 INFO:tasks.ceph.osd.0.smithi036.stderr:2022-01-10T01:24:12.657+0000 7f633edc0700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-10T01:24:12.661 INFO:tasks.ceph.osd.5.smithi059.stderr:2022-01-10T01:24:12.659+0000 7f5a03bc4700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-10T01:24:12.661 INFO:tasks.ceph.osd.2.smithi036.stderr:2022-01-10T01:24:12.657+0000 7f9c23339700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-10T01:24:12.662 INFO:tasks.ceph.osd.6.smithi059.stderr:2022-01-10T01:24:12.659+0000 7f987c01c700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-10T01:24:12.663 INFO:tasks.ceph.osd.1.smithi036.stderr:2022-01-10T01:24:12.657+0000 7f3e32c37700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-01-10T01:24:17.151 DEBUG:teuthology.orchestra.run.smithi036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:17.251 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.245+0000 7fe7b3fff700 1 Processor -- start 2022-01-10T01:24:17.252 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.245+0000 7fe7b3fff700 1 -- start start 2022-01-10T01:24:17.254 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe7b40b4070 0x7fe7b4061600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.254 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b3fff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b4143d50 con 0x7fe7b4061220 2022-01-10T01:24:17.254 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b3fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b4142f40 con 0x7fe7b40ba050 2022-01-10T01:24:17.255 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b3fff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b4142d50 con 0x7fe7b40b4070 2022-01-10T01:24:17.255 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b27fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe7b40b4070 0x7fe7b4061600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.255 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b2ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe7b4061220 0x7fe7b4143640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59456/0 (socket says 172.21.15.36:59456) 2022-01-10T01:24:17.255 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b2ffd700 1 -- 172.21.15.36:0/2545975682 learned_addr learned my addr 172.21.15.36:0/2545975682 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:17.256 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b27fc700 1 -- 172.21.15.36:0/2545975682 >> v1:172.21.15.59:6789/0 conn(0x7fe7b40ba050 legacy=0x7fe7b413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.256 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b27fc700 1 -- 172.21.15.36:0/2545975682 >> v1:172.21.15.36:6789/0 conn(0x7fe7b4061220 legacy=0x7fe7b4143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.256 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b1ffb700 1 -- 172.21.15.36:0/2545975682 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813948444 0 0) 0x7fe7b4143d50 con 0x7fe7b4061220 2022-01-10T01:24:17.256 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b27fc700 1 -- 172.21.15.36:0/2545975682 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b40b6210 con 0x7fe7b40b4070 2022-01-10T01:24:17.256 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b27fc700 1 --2- 172.21.15.36:0/2545975682 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7b40b4070 0x7fe7b4061600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe79c002f70 tx=0x7fe79c006df0).ready entity=mon.0 client_cookie=b1f86cd111812b28 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:17.257 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b1ffb700 1 -- 172.21.15.36:0/2545975682 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe79c00d610 con 0x7fe7b40b4070 2022-01-10T01:24:17.257 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b1ffb700 1 -- 172.21.15.36:0/2545975682 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c000e90 con 0x7fe7b40b4070 2022-01-10T01:24:17.257 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b1ffb700 1 -- 172.21.15.36:0/2545975682 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe79c00d960 con 0x7fe7b40b4070 2022-01-10T01:24:17.261 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2545975682 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7b40b4070 msgr2=0x7fe7b4061600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.261 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b3fff700 1 --2- 172.21.15.36:0/2545975682 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7b40b4070 0x7fe7b4061600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe79c002f70 tx=0x7fe79c006df0).stop 2022-01-10T01:24:17.261 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2545975682 shutdown_connections 2022-01-10T01:24:17.262 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b3fff700 1 --2- 172.21.15.36:0/2545975682 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7b40b4070 0x7fe7b4061600 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.262 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2545975682 >> 172.21.15.36:0/2545975682 conn(0x7fe7b405f800 msgr2=0x7fe7b405c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:17.262 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2545975682 shutdown_connections 2022-01-10T01:24:17.262 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.249+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2545975682 wait complete. 2022-01-10T01:24:17.262 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b3fff700 1 Processor -- start 2022-01-10T01:24:17.263 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b3fff700 1 -- start start 2022-01-10T01:24:17.263 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b4061220 0x7fe7b4135f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.263 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7b40b4070 0x7fe7b40b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.264 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b3fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7b40ba050 0x7fe7b4155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.264 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b3fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40ad390 con 0x7fe7b40ba050 2022-01-10T01:24:17.264 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b3fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40ad860 con 0x7fe7b4061220 2022-01-10T01:24:17.264 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b3fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40ad5c0 con 0x7fe7b40b4070 2022-01-10T01:24:17.265 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b37fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7b40ba050 0x7fe7b4155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.265 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b37fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7b40ba050 0x7fe7b4155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33438/0 (socket says 172.21.15.36:33438) 2022-01-10T01:24:17.265 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b37fe700 1 -- 172.21.15.36:0/2071672169 learned_addr learned my addr 172.21.15.36:0/2071672169 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:17.265 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b2ffd700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b4061220 0x7fe7b4135f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.265 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b27fc700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7b40b4070 0x7fe7b40b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.266 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b37fe700 1 -- 172.21.15.36:0/2071672169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7b40b4070 msgr2=0x7fe7b40b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.266 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b37fe700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7b40b4070 0x7fe7b40b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.266 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b37fe700 1 -- 172.21.15.36:0/2071672169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b4061220 msgr2=0x7fe7b4135f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.266 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b37fe700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b4061220 0x7fe7b4135f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.267 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b37fe700 1 -- 172.21.15.36:0/2071672169 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c00b180 con 0x7fe7b40ba050 2022-01-10T01:24:17.267 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b27fc700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7b40b4070 0x7fe7b40b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:17.267 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7b37fe700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7b40ba050 0x7fe7b4155ca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe7b405fbe0 tx=0x7fe7a4007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:17.267 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7abfff700 1 -- 172.21.15.36:0/2071672169 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7a4007030 con 0x7fe7b40ba050 2022-01-10T01:24:17.268 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.253+0000 7fe7abfff700 1 -- 172.21.15.36:0/2071672169 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a4007190 con 0x7fe7b40ba050 2022-01-10T01:24:17.268 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.257+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2071672169 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b4155800 con 0x7fe7b40ba050 2022-01-10T01:24:17.268 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.257+0000 7fe7abfff700 1 -- 172.21.15.36:0/2071672169 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7a4006510 con 0x7fe7b40ba050 2022-01-10T01:24:17.269 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.257+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2071672169 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b40b8f80 con 0x7fe7b40ba050 2022-01-10T01:24:17.270 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.257+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2071672169 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b40b9260 con 0x7fe7b40ba050 2022-01-10T01:24:17.270 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.257+0000 7fe7abfff700 1 -- 172.21.15.36:0/2071672169 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe7a4010030 con 0x7fe7b40ba050 2022-01-10T01:24:17.270 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.257+0000 7fe7abfff700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7980536b0 0x7fe798055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.271 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.257+0000 7fe7abfff700 1 -- 172.21.15.36:0/2071672169 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7fe7a406b020 con 0x7fe7b40ba050 2022-01-10T01:24:17.271 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.257+0000 7fe7b2ffd700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7980536b0 0x7fe798055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.271 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.257+0000 7fe7b2ffd700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7980536b0 0x7fe798055b70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe7ac00d000 tx=0x7fe7ac001520).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:17.271 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.265+0000 7fe7abfff700 1 -- 172.21.15.36:0/2071672169 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe7a4042620 con 0x7fe7b40ba050 2022-01-10T01:24:17.397 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.393+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2071672169 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7b4155990 con 0x7fe7b40ba050 2022-01-10T01:24:17.399 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.393+0000 7fe7abfff700 1 -- 172.21.15.36:0/2071672169 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11805 (secure 0 0 0) 0x7fe7a4045c40 con 0x7fe7b40ba050 2022-01-10T01:24:17.400 INFO:teuthology.misc.health.smithi036.stdout: 2022-01-10T01:24:17.400 INFO:teuthology.misc.health.smithi036.stdout:{"epoch":15,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:15.668341+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:17.403 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.397+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2071672169 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7980536b0 msgr2=0x7fe798055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.404 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.397+0000 7fe7b3fff700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7980536b0 0x7fe798055b70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe7ac00d000 tx=0x7fe7ac001520).stop 2022-01-10T01:24:17.404 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.397+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2071672169 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7b40ba050 msgr2=0x7fe7b4155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.405 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.397+0000 7fe7b3fff700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7b40ba050 0x7fe7b4155ca0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe7b405fbe0 tx=0x7fe7a4007c20).stop 2022-01-10T01:24:17.405 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.397+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2071672169 shutdown_connections 2022-01-10T01:24:17.406 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.397+0000 7fe7b3fff700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7980536b0 0x7fe798055b70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.406 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.397+0000 7fe7b3fff700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7b40ba050 0x7fe7b4155ca0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.406 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.397+0000 7fe7b3fff700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7b40b4070 0x7fe7b40b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.407 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.397+0000 7fe7b3fff700 1 --2- 172.21.15.36:0/2071672169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7b4061220 0x7fe7b4135f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.407 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.397+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2071672169 >> 172.21.15.36:0/2071672169 conn(0x7fe7b405f800 msgr2=0x7fe7b413c880 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:17.407 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.397+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2071672169 shutdown_connections 2022-01-10T01:24:17.408 INFO:teuthology.misc.health.smithi036.stderr:2022-01-10T01:24:17.397+0000 7fe7b3fff700 1 -- 172.21.15.36:0/2071672169 wait complete. 2022-01-10T01:24:17.416 DEBUG:teuthology.misc:8 of 8 OSDs are up 2022-01-10T01:24:17.417 INFO:tasks.ceph:Creating RBD pool 2022-01-10T01:24:17.417 DEBUG:teuthology.orchestra.run.smithi036:> sudo ceph --cluster ceph osd pool create rbd 8 2022-01-10T01:24:17.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9eae12700 1 Processor -- start 2022-01-10T01:24:17.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9eae12700 1 -- start start 2022-01-10T01:24:17.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9eae12700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa9e405fc00 0x7fa9e40b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9eae12700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40b6560 0x7fa9e40b9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9eae12700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e4143f60 con 0x7fa9e40b5990 2022-01-10T01:24:17.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9eae12700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e405ffe0 con 0x7fa9e405fc00 2022-01-10T01:24:17.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9eae12700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e4143a50 con 0x7fa9e40b6560 2022-01-10T01:24:17.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9e8bae700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa9e405fc00 0x7fa9e40b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9e93af700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa9e40b5990 0x7fa9e40b4a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59472/0 (socket says 172.21.15.36:59472) 2022-01-10T01:24:17.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9e93af700 1 -- 172.21.15.36:0/1299763338 learned_addr learned my addr 172.21.15.36:0/1299763338 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:17.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9e3fff700 1 --2- 172.21.15.36:0/1299763338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40b6560 0x7fa9e40b9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9e37fe700 1 -- 172.21.15.36:0/1299763338 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621817043 0 0) 0x7fa9e4143f60 con 0x7fa9e40b5990 2022-01-10T01:24:17.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9e37fe700 1 -- 172.21.15.36:0/1299763338 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9c8003260 con 0x7fa9e40b5990 2022-01-10T01:24:17.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9e8bae700 1 -- 172.21.15.36:0/1299763338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40b6560 msgr2=0x7fa9e40b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:17.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9e8bae700 1 --2- 172.21.15.36:0/1299763338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40b6560 0x7fa9e40b9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9e8bae700 1 -- 172.21.15.36:0/1299763338 >> v1:172.21.15.36:6789/0 conn(0x7fa9e40b5990 legacy=0x7fa9e40b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9e8bae700 1 -- 172.21.15.36:0/1299763338 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e4143cc0 con 0x7fa9e405fc00 2022-01-10T01:24:17.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9e8bae700 1 --2- 172.21.15.36:0/1299763338 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9e405fc00 0x7fa9e40b41b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fa9d8002f70 tx=0x7fa9d8006df0).ready entity=mon.0 client_cookie=e1afe99a41670e26 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:17.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9e37fe700 1 -- 172.21.15.36:0/1299763338 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d800d4a0 con 0x7fa9e405fc00 2022-01-10T01:24:17.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9e37fe700 1 -- 172.21.15.36:0/1299763338 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d8000e90 con 0x7fa9e405fc00 2022-01-10T01:24:17.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9e37fe700 1 -- 172.21.15.36:0/1299763338 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9d800d7f0 con 0x7fa9e405fc00 2022-01-10T01:24:17.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9eae12700 1 -- 172.21.15.36:0/1299763338 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9e405fc00 msgr2=0x7fa9e40b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9eae12700 1 --2- 172.21.15.36:0/1299763338 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9e405fc00 0x7fa9e40b41b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fa9d8002f70 tx=0x7fa9d8006df0).stop 2022-01-10T01:24:17.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9eae12700 1 -- 172.21.15.36:0/1299763338 shutdown_connections 2022-01-10T01:24:17.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9eae12700 1 --2- 172.21.15.36:0/1299763338 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40b6560 0x7fa9e40b9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9eae12700 1 --2- 172.21.15.36:0/1299763338 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9e405fc00 0x7fa9e40b41b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.513+0000 7fa9eae12700 1 -- 172.21.15.36:0/1299763338 >> 172.21.15.36:0/1299763338 conn(0x7fa9e40623a0 msgr2=0x7fa9e4066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:17.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9eae12700 1 -- 172.21.15.36:0/1299763338 shutdown_connections 2022-01-10T01:24:17.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9eae12700 1 -- 172.21.15.36:0/1299763338 wait complete. 2022-01-10T01:24:17.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9eae12700 1 Processor -- start 2022-01-10T01:24:17.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9eae12700 1 -- start start 2022-01-10T01:24:17.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9eae12700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e405fc00 0x7fa9e40af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9eae12700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40b5990 0x7fa9e4129cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9eae12700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9e40b6560 0x7fa9e4141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9eae12700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e40b0440 con 0x7fa9e40b6560 2022-01-10T01:24:17.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9eae12700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e4144410 con 0x7fa9e405fc00 2022-01-10T01:24:17.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9eae12700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e40ae3f0 con 0x7fa9e40b5990 2022-01-10T01:24:17.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9e93af700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9e40b6560 0x7fa9e4141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9e93af700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9e40b6560 0x7fa9e4141e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33452/0 (socket says 172.21.15.36:33452) 2022-01-10T01:24:17.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9e93af700 1 -- 172.21.15.36:0/2691119018 learned_addr learned my addr 172.21.15.36:0/2691119018 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:17.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9e8bae700 1 --2- 172.21.15.36:0/2691119018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e405fc00 0x7fa9e40af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9e3fff700 1 --2- 172.21.15.36:0/2691119018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40b5990 0x7fa9e4129cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9e93af700 1 -- 172.21.15.36:0/2691119018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40b5990 msgr2=0x7fa9e4129cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9e93af700 1 --2- 172.21.15.36:0/2691119018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40b5990 0x7fa9e4129cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9e93af700 1 -- 172.21.15.36:0/2691119018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e405fc00 msgr2=0x7fa9e40af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9e93af700 1 --2- 172.21.15.36:0/2691119018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e405fc00 0x7fa9e40af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9e93af700 1 -- 172.21.15.36:0/2691119018 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d800b180 con 0x7fa9e40b6560 2022-01-10T01:24:17.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9e93af700 1 --2- 172.21.15.36:0/2691119018 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9e40b6560 0x7fa9e4141e40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa9dc001490 tx=0x7fa9dc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:17.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9e1ffb700 1 -- 172.21.15.36:0/2691119018 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9dc005ba0 con 0x7fa9e40b6560 2022-01-10T01:24:17.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9e1ffb700 1 -- 172.21.15.36:0/2691119018 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc005d00 con 0x7fa9e40b6560 2022-01-10T01:24:17.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9e1ffb700 1 -- 172.21.15.36:0/2691119018 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9dc0072c0 con 0x7fa9e40b6560 2022-01-10T01:24:17.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9eae12700 1 -- 172.21.15.36:0/2691119018 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e40b01a0 con 0x7fa9e40b6560 2022-01-10T01:24:17.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.517+0000 7fa9eae12700 1 -- 172.21.15.36:0/2691119018 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e40ad830 con 0x7fa9e40b6560 2022-01-10T01:24:17.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.521+0000 7fa9eae12700 1 -- 172.21.15.36:0/2691119018 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e4144de0 con 0x7fa9e40b6560 2022-01-10T01:24:17.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.521+0000 7fa9e1ffb700 1 -- 172.21.15.36:0/2691119018 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa9dc010070 con 0x7fa9e40b6560 2022-01-10T01:24:17.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.521+0000 7fa9e1ffb700 1 --2- 172.21.15.36:0/2691119018 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa9c4053680 0x7fa9c4055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.521+0000 7fa9e1ffb700 1 -- 172.21.15.36:0/2691119018 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7fa9dc06ae20 con 0x7fa9e40b6560 2022-01-10T01:24:17.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.521+0000 7fa9e8bae700 1 --2- 172.21.15.36:0/2691119018 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa9c4053680 0x7fa9c4055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.521+0000 7fa9e8bae700 1 --2- 172.21.15.36:0/2691119018 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa9c4053680 0x7fa9c4055b40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa9d801a000 tx=0x7fa9d8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:17.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.529+0000 7fa9e1ffb700 1 -- 172.21.15.36:0/2691119018 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa9dc042420 con 0x7fa9e40b6560 2022-01-10T01:24:17.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.657+0000 7fa9eae12700 1 -- 172.21.15.36:0/2691119018 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fa9e40b9860 con 0x7fa9e40b6560 2022-01-10T01:24:17.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.765+0000 7fa9e1ffb700 1 -- 172.21.15.36:0/2691119018 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7fa9dc045a40 con 0x7fa9e40b6560 2022-01-10T01:24:17.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.769+0000 7fa9eae12700 1 -- 172.21.15.36:0/2691119018 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa9c4053680 msgr2=0x7fa9c4055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.769+0000 7fa9eae12700 1 --2- 172.21.15.36:0/2691119018 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa9c4053680 0x7fa9c4055b40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa9d801a000 tx=0x7fa9d8014000).stop 2022-01-10T01:24:17.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.769+0000 7fa9eae12700 1 -- 172.21.15.36:0/2691119018 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9e40b6560 msgr2=0x7fa9e4141e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.769+0000 7fa9eae12700 1 --2- 172.21.15.36:0/2691119018 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9e40b6560 0x7fa9e4141e40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fa9dc001490 tx=0x7fa9dc007e00).stop 2022-01-10T01:24:17.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.769+0000 7fa9eae12700 1 -- 172.21.15.36:0/2691119018 shutdown_connections 2022-01-10T01:24:17.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.769+0000 7fa9eae12700 1 --2- 172.21.15.36:0/2691119018 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa9c4053680 0x7fa9c4055b40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.769+0000 7fa9eae12700 1 --2- 172.21.15.36:0/2691119018 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9e40b6560 0x7fa9e4141e40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.769+0000 7fa9eae12700 1 --2- 172.21.15.36:0/2691119018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9e40b5990 0x7fa9e4129cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.769+0000 7fa9eae12700 1 --2- 172.21.15.36:0/2691119018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9e405fc00 0x7fa9e40af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.769+0000 7fa9eae12700 1 -- 172.21.15.36:0/2691119018 >> 172.21.15.36:0/2691119018 conn(0x7fa9e40623a0 msgr2=0x7fa9e4127ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:17.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.773+0000 7fa9eae12700 1 -- 172.21.15.36:0/2691119018 shutdown_connections 2022-01-10T01:24:17.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.773+0000 7fa9eae12700 1 -- 172.21.15.36:0/2691119018 wait complete. 2022-01-10T01:24:17.779 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'rbd' created 2022-01-10T01:24:17.787 DEBUG:teuthology.orchestra.run.smithi036:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-01-10T01:24:17.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.881+0000 7f1cebfff700 1 Processor -- start 2022-01-10T01:24:17.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.881+0000 7f1cebfff700 1 -- start start 2022-01-10T01:24:17.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.881+0000 7f1cebfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cec0b4060 0x7f1cec061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.881+0000 7f1cebfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cec142e60 0x7f1cec143310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.881+0000 7f1cebfff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cec0b5f50 con 0x7f1cec0b6290 2022-01-10T01:24:17.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.881+0000 7f1cebfff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cec0b1f70 con 0x7f1cec142e60 2022-01-10T01:24:17.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.881+0000 7f1cebfff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0b2210 con 0x7f1cec0b4060 2022-01-10T01:24:17.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1ceaffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f1cec0b6290 0x7f1cec061470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59482/0 (socket says 172.21.15.36:59482) 2022-01-10T01:24:17.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1ceaffd700 1 -- 172.21.15.36:0/4047033914 learned_addr learned my addr 172.21.15.36:0/4047033914 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:17.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1ceb7fe700 1 --2- 172.21.15.36:0/4047033914 >> v2:172.21.15.59:3300/0 conn(0x7f1cec142e60 0x7f1cec143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1cea7fc700 1 --2- 172.21.15.36:0/4047033914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cec0b4060 0x7f1cec061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1ce9ffb700 1 -- 172.21.15.36:0/4047033914 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127902833 0 0) 0x7f1cdc001110 con 0x7f1cec0b6290 2022-01-10T01:24:17.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1ce9ffb700 1 -- 172.21.15.36:0/4047033914 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd0003260 con 0x7f1cec0b6290 2022-01-10T01:24:17.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1ceb7fe700 1 -- 172.21.15.36:0/4047033914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cec0b4060 msgr2=0x7f1cec061b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:17.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1ceb7fe700 1 --2- 172.21.15.36:0/4047033914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cec0b4060 0x7f1cec061b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1ceb7fe700 1 -- 172.21.15.36:0/4047033914 >> v1:172.21.15.36:6789/0 conn(0x7f1cec0b6290 legacy=0x7f1cec061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1ceb7fe700 1 -- 172.21.15.36:0/4047033914 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec0b24b0 con 0x7f1cec142e60 2022-01-10T01:24:17.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1ceb7fe700 1 --2- 172.21.15.36:0/4047033914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cec142e60 0x7f1cec143310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1ce40032f0 tx=0x7f1ce40091d0).ready entity=mon.1 client_cookie=cae0359c6041f554 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:17.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1ce9ffb700 1 -- 172.21.15.36:0/4047033914 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce400b600 con 0x7f1cec142e60 2022-01-10T01:24:17.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1ce9ffb700 1 -- 172.21.15.36:0/4047033914 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce400b760 con 0x7f1cec142e60 2022-01-10T01:24:17.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1ce9ffb700 1 -- 172.21.15.36:0/4047033914 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce400b8d0 con 0x7f1cec142e60 2022-01-10T01:24:17.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1cebfff700 1 -- 172.21.15.36:0/4047033914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cec142e60 msgr2=0x7f1cec143310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1cebfff700 1 --2- 172.21.15.36:0/4047033914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cec142e60 0x7f1cec143310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f1ce40032f0 tx=0x7f1ce40091d0).stop 2022-01-10T01:24:17.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1cebfff700 1 -- 172.21.15.36:0/4047033914 shutdown_connections 2022-01-10T01:24:17.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1cebfff700 1 --2- 172.21.15.36:0/4047033914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cec142e60 0x7f1cec143310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1cebfff700 1 --2- 172.21.15.36:0/4047033914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cec0b4060 0x7f1cec061b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1cebfff700 1 -- 172.21.15.36:0/4047033914 >> 172.21.15.36:0/4047033914 conn(0x7f1cec05c490 msgr2=0x7f1cec05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:17.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1cebfff700 1 -- 172.21.15.36:0/4047033914 shutdown_connections 2022-01-10T01:24:17.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.885+0000 7f1cebfff700 1 -- 172.21.15.36:0/4047033914 wait complete. 2022-01-10T01:24:17.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cebfff700 1 Processor -- start 2022-01-10T01:24:17.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cebfff700 1 -- start start 2022-01-10T01:24:17.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cebfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cec0b4060 0x7f1cec0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cebfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1cec0b6290 0x7f1cec1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cebfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cec142e60 0x7f1cec1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cebfff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0b0670 con 0x7f1cec0b6290 2022-01-10T01:24:17.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cebfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0afc90 con 0x7f1cec142e60 2022-01-10T01:24:17.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cebfff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0aff30 con 0x7f1cec0b4060 2022-01-10T01:24:17.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cea7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1cec0b6290 0x7f1cec1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1ceb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cec142e60 0x7f1cec1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1ceaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cec0b4060 0x7f1cec0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1ceb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cec142e60 0x7f1cec1529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:58332/0 (socket says 172.21.15.36:58332) 2022-01-10T01:24:17.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cea7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1cec0b6290 0x7f1cec1524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33464/0 (socket says 172.21.15.36:33464) 2022-01-10T01:24:17.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1ceb7fe700 1 -- 172.21.15.36:0/976960167 learned_addr learned my addr 172.21.15.36:0/976960167 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:17.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1ceb7fe700 1 -- 172.21.15.36:0/976960167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cec0b4060 msgr2=0x7f1cec0b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1ceb7fe700 1 --2- 172.21.15.36:0/976960167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cec0b4060 0x7f1cec0b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1ceb7fe700 1 -- 172.21.15.36:0/976960167 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1cec0b6290 msgr2=0x7f1cec1524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:17.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1ceb7fe700 1 --2- 172.21.15.36:0/976960167 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1cec0b6290 0x7f1cec1524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:17.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1ceb7fe700 1 -- 172.21.15.36:0/976960167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4009470 con 0x7f1cec142e60 2022-01-10T01:24:17.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cea7fc700 1 --2- 172.21.15.36:0/976960167 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1cec0b6290 0x7f1cec1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:17.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1ceb7fe700 1 --2- 172.21.15.36:0/976960167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cec142e60 0x7f1cec1529d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1ce40032f0 tx=0x7f1ce4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:17.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cdbfff700 1 -- 172.21.15.36:0/976960167 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce400b8d0 con 0x7f1cec142e60 2022-01-10T01:24:17.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cdbfff700 1 -- 172.21.15.36:0/976960167 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce4021630 con 0x7f1cec142e60 2022-01-10T01:24:17.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cebfff700 1 -- 172.21.15.36:0/976960167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cec0b01d0 con 0x7f1cec142e60 2022-01-10T01:24:17.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cdbfff700 1 -- 172.21.15.36:0/976960167 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ce400b600 con 0x7f1cec142e60 2022-01-10T01:24:17.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.889+0000 7f1cebfff700 1 -- 172.21.15.36:0/976960167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cec13e7d0 con 0x7f1cec142e60 2022-01-10T01:24:17.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.893+0000 7f1cebfff700 1 -- 172.21.15.36:0/976960167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cec140270 con 0x7f1cec142e60 2022-01-10T01:24:17.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.893+0000 7f1cdbfff700 1 -- 172.21.15.36:0/976960167 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1ce4027020 con 0x7f1cec142e60 2022-01-10T01:24:17.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.893+0000 7f1cdbfff700 1 --2- 172.21.15.36:0/976960167 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1cc8053680 0x7f1cc8055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:17.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.893+0000 7f1ceaffd700 1 --2- 172.21.15.36:0/976960167 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1cc8053680 0x7f1cc8055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:17.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.893+0000 7f1cdbfff700 1 -- 172.21.15.36:0/976960167 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f1ce406cb90 con 0x7f1cec142e60 2022-01-10T01:24:17.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.893+0000 7f1ceaffd700 1 --2- 172.21.15.36:0/976960167 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1cc8053680 0x7f1cc8055b40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f1cdc00d000 tx=0x7f1cdc000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:17.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:17.905+0000 7f1cdbfff700 1 -- 172.21.15.36:0/976960167 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1ce4043f30 con 0x7f1cec142e60 2022-01-10T01:24:18.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.033+0000 7f1cebfff700 1 -- 172.21.15.36:0/976960167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1cec0b2750 con 0x7f1cec142e60 2022-01-10T01:24:18.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.777+0000 7f1cdbfff700 1 -- 172.21.15.36:0/976960167 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1ce4047550 con 0x7f1cec142e60 2022-01-10T01:24:18.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.781+0000 7f1cebfff700 1 -- 172.21.15.36:0/976960167 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1cc8053680 msgr2=0x7f1cc8055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:18.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.781+0000 7f1cebfff700 1 --2- 172.21.15.36:0/976960167 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1cc8053680 0x7f1cc8055b40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f1cdc00d000 tx=0x7f1cdc000bc0).stop 2022-01-10T01:24:18.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.781+0000 7f1cebfff700 1 -- 172.21.15.36:0/976960167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cec142e60 msgr2=0x7f1cec1529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:18.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.781+0000 7f1cebfff700 1 --2- 172.21.15.36:0/976960167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cec142e60 0x7f1cec1529d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1ce40032f0 tx=0x7f1ce4016000).stop 2022-01-10T01:24:18.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.781+0000 7f1cebfff700 1 -- 172.21.15.36:0/976960167 shutdown_connections 2022-01-10T01:24:18.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.781+0000 7f1cebfff700 1 --2- 172.21.15.36:0/976960167 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1cc8053680 0x7f1cc8055b40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:18.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.781+0000 7f1cebfff700 1 --2- 172.21.15.36:0/976960167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cec142e60 0x7f1cec1529d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:18.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.781+0000 7f1cebfff700 1 --2- 172.21.15.36:0/976960167 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1cec0b6290 0x7f1cec1524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:18.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.781+0000 7f1cebfff700 1 --2- 172.21.15.36:0/976960167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cec0b4060 0x7f1cec0b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:18.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.781+0000 7f1cebfff700 1 -- 172.21.15.36:0/976960167 >> 172.21.15.36:0/976960167 conn(0x7f1cec05c490 msgr2=0x7f1cec0b89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:18.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.781+0000 7f1cebfff700 1 -- 172.21.15.36:0/976960167 shutdown_connections 2022-01-10T01:24:18.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.781+0000 7f1cebfff700 1 -- 172.21.15.36:0/976960167 wait complete. 2022-01-10T01:24:18.790 INFO:teuthology.orchestra.run.smithi036.stderr:enabled application 'rbd' on pool 'rbd' 2022-01-10T01:24:18.800 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-01-10T01:24:18.800 INFO:tasks.ceph.mds.a:Restarting daemon 2022-01-10T01:24:18.801 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-01-10T01:24:18.803 INFO:tasks.ceph.mds.a:Started 2022-01-10T01:24:18.804 INFO:tasks.ceph.mds.c:Restarting daemon 2022-01-10T01:24:18.804 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-01-10T01:24:18.806 INFO:tasks.ceph.mds.c:Started 2022-01-10T01:24:18.806 INFO:tasks.ceph.mds.b:Restarting daemon 2022-01-10T01:24:18.807 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-01-10T01:24:18.809 INFO:tasks.ceph.mds.b:Started 2022-01-10T01:24:18.810 INFO:tasks.ceph:Setting up CephFS filesystem... 2022-01-10T01:24:18.810 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:18.871 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:24:18.872 INFO:tasks.ceph.mds.c.smithi036.stdout:starting mds.c at 2022-01-10T01:24:18.891 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:24:18.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa145dd1700 1 Processor -- start 2022-01-10T01:24:18.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa145dd1700 1 -- start start 2022-01-10T01:24:18.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa145dd1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa1400afbd0 0x7fa1400b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:18.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa145dd1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1400a8b60 0x7fa1400aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:18.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa145dd1700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1400b5880 con 0x7fa1400b54a0 2022-01-10T01:24:18.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa145dd1700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa14013d410 con 0x7fa1400afbd0 2022-01-10T01:24:18.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa145dd1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1400ac9d0 con 0x7fa1400a8b60 2022-01-10T01:24:18.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa144dcf700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa1400b54a0 0x7fa1401436b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59522/0 (socket says 172.21.15.36:59522) 2022-01-10T01:24:18.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa144dcf700 1 -- 172.21.15.36:0/4173850776 learned_addr learned my addr 172.21.15.36:0/4173850776 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:18.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa13ffff700 1 --2- 172.21.15.36:0/4173850776 >> v2:172.21.15.36:3300/0 conn(0x7fa1400afbd0 0x7fa1400b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:18.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa1455d0700 1 --2- 172.21.15.36:0/4173850776 >> v2:172.21.15.59:3300/0 conn(0x7fa1400a8b60 0x7fa1400aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:18.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa13f7fe700 1 -- 172.21.15.36:0/4173850776 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975912500 0 0) 0x7fa1400b5880 con 0x7fa1400b54a0 2022-01-10T01:24:18.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa13f7fe700 1 -- 172.21.15.36:0/4173850776 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa124003260 con 0x7fa1400b54a0 2022-01-10T01:24:18.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa13ffff700 1 -- 172.21.15.36:0/4173850776 >> v2:172.21.15.59:3300/0 conn(0x7fa1400a8b60 msgr2=0x7fa1400aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:18.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa13ffff700 1 --2- 172.21.15.36:0/4173850776 >> v2:172.21.15.59:3300/0 conn(0x7fa1400a8b60 0x7fa1400aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:18.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa13ffff700 1 -- 172.21.15.36:0/4173850776 >> v1:172.21.15.36:6789/0 conn(0x7fa1400b54a0 legacy=0x7fa1401436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:18.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa13ffff700 1 -- 172.21.15.36:0/4173850776 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa140146fc0 con 0x7fa1400afbd0 2022-01-10T01:24:18.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa13ffff700 1 --2- 172.21.15.36:0/4173850776 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1400afbd0 0x7fa1400b00e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa12c002f70 tx=0x7fa12c006df0).ready entity=mon.0 client_cookie=b5cb1cb27c686ac3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:18.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa13f7fe700 1 -- 172.21.15.36:0/4173850776 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa12c00d4f0 con 0x7fa1400afbd0 2022-01-10T01:24:18.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa13f7fe700 1 -- 172.21.15.36:0/4173850776 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c000e90 con 0x7fa1400afbd0 2022-01-10T01:24:18.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.921+0000 7fa13f7fe700 1 -- 172.21.15.36:0/4173850776 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa12c00d840 con 0x7fa1400afbd0 2022-01-10T01:24:18.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 -- 172.21.15.36:0/4173850776 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1400afbd0 msgr2=0x7fa1400b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:18.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 --2- 172.21.15.36:0/4173850776 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1400afbd0 0x7fa1400b00e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa12c002f70 tx=0x7fa12c006df0).stop 2022-01-10T01:24:18.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 -- 172.21.15.36:0/4173850776 shutdown_connections 2022-01-10T01:24:18.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 --2- 172.21.15.36:0/4173850776 >> v2:172.21.15.59:3300/0 conn(0x7fa1400a8b60 0x7fa1400aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:18.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 --2- 172.21.15.36:0/4173850776 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1400afbd0 0x7fa1400b00e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:18.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 -- 172.21.15.36:0/4173850776 >> 172.21.15.36:0/4173850776 conn(0x7fa14005f6b0 msgr2=0x7fa14005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:18.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 -- 172.21.15.36:0/4173850776 shutdown_connections 2022-01-10T01:24:18.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 -- 172.21.15.36:0/4173850776 wait complete. 2022-01-10T01:24:18.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 Processor -- start 2022-01-10T01:24:18.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 -- start start 2022-01-10T01:24:18.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1400a8b60 0x7fa1400b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:18.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1400afbd0 0x7fa1401526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:18.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1400b54a0 0x7fa140152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:18.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa140144220 con 0x7fa1400afbd0 2022-01-10T01:24:18.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1400a92c0 con 0x7fa1400b54a0 2022-01-10T01:24:18.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa145dd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1400a9560 con 0x7fa1400a8b60 2022-01-10T01:24:18.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa13ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1400afbd0 0x7fa1401526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:18.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa13ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1400afbd0 0x7fa1401526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33504/0 (socket says 172.21.15.36:33504) 2022-01-10T01:24:18.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa144dcf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1400a8b60 0x7fa1400b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:18.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa13ffff700 1 -- 172.21.15.36:0/127538256 learned_addr learned my addr 172.21.15.36:0/127538256 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:18.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.925+0000 7fa1455d0700 1 --2- 172.21.15.36:0/127538256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1400b54a0 0x7fa140152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:18.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa13ffff700 1 -- 172.21.15.36:0/127538256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1400a8b60 msgr2=0x7fa1400b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:18.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa13ffff700 1 --2- 172.21.15.36:0/127538256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1400a8b60 0x7fa1400b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:18.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa13ffff700 1 -- 172.21.15.36:0/127538256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1400b54a0 msgr2=0x7fa140152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:18.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa13ffff700 1 --2- 172.21.15.36:0/127538256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1400b54a0 0x7fa140152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:18.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa13ffff700 1 -- 172.21.15.36:0/127538256 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c00b180 con 0x7fa1400afbd0 2022-01-10T01:24:18.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa13ffff700 1 --2- 172.21.15.36:0/127538256 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1400afbd0 0x7fa1401526c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa12c002f70 tx=0x7fa12c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:18.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa13dffb700 1 -- 172.21.15.36:0/127538256 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa12c016070 con 0x7fa1400afbd0 2022-01-10T01:24:18.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa13dffb700 1 -- 172.21.15.36:0/127538256 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12c0138d0 con 0x7fa1400afbd0 2022-01-10T01:24:18.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa145dd1700 1 -- 172.21.15.36:0/127538256 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1400a9800 con 0x7fa1400afbd0 2022-01-10T01:24:18.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa13dffb700 1 -- 172.21.15.36:0/127538256 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa12c013c30 con 0x7fa1400afbd0 2022-01-10T01:24:18.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa145dd1700 1 -- 172.21.15.36:0/127538256 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1400b2570 con 0x7fa1400afbd0 2022-01-10T01:24:18.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa145dd1700 1 -- 172.21.15.36:0/127538256 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14013d710 con 0x7fa1400afbd0 2022-01-10T01:24:18.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa13dffb700 1 -- 172.21.15.36:0/127538256 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa12c025030 con 0x7fa1400afbd0 2022-01-10T01:24:18.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa13dffb700 1 --2- 172.21.15.36:0/127538256 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa120053560 0x7fa120055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:18.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa13dffb700 1 -- 172.21.15.36:0/127538256 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa12c06c310 con 0x7fa1400afbd0 2022-01-10T01:24:18.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.929+0000 7fa144dcf700 1 --2- 172.21.15.36:0/127538256 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa120053560 0x7fa120055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:18.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.933+0000 7fa144dcf700 1 --2- 172.21.15.36:0/127538256 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa120053560 0x7fa120055a20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa13400d000 tx=0x7fa134009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:18.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:18.937+0000 7fa13dffb700 1 -- 172.21.15.36:0/127538256 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa12c0437b0 con 0x7fa1400afbd0 2022-01-10T01:24:19.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.065+0000 7fa145dd1700 1 -- 172.21.15.36:0/127538256 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1400ad4c0 con 0x7fa1400afbd0 2022-01-10T01:24:19.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.069+0000 7fa13dffb700 1 -- 172.21.15.36:0/127538256 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13191 (secure 0 0 0) 0x7fa12c023090 con 0x7fa1400afbd0 2022-01-10T01:24:19.074 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:19.075 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":17,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:18.764816+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:19.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.069+0000 7fa145dd1700 1 -- 172.21.15.36:0/127538256 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa120053560 msgr2=0x7fa120055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.069+0000 7fa145dd1700 1 --2- 172.21.15.36:0/127538256 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa120053560 0x7fa120055a20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fa13400d000 tx=0x7fa134009040).stop 2022-01-10T01:24:19.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.069+0000 7fa145dd1700 1 -- 172.21.15.36:0/127538256 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1400afbd0 msgr2=0x7fa1401526c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.069+0000 7fa145dd1700 1 --2- 172.21.15.36:0/127538256 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1400afbd0 0x7fa1401526c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa12c002f70 tx=0x7fa12c014000).stop 2022-01-10T01:24:19.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.069+0000 7fa145dd1700 1 -- 172.21.15.36:0/127538256 shutdown_connections 2022-01-10T01:24:19.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.069+0000 7fa145dd1700 1 --2- 172.21.15.36:0/127538256 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa120053560 0x7fa120055a20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.069+0000 7fa145dd1700 1 --2- 172.21.15.36:0/127538256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1400b54a0 0x7fa140152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.069+0000 7fa145dd1700 1 --2- 172.21.15.36:0/127538256 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1400afbd0 0x7fa1401526c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.069+0000 7fa145dd1700 1 --2- 172.21.15.36:0/127538256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1400a8b60 0x7fa1400b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.069+0000 7fa145dd1700 1 -- 172.21.15.36:0/127538256 >> 172.21.15.36:0/127538256 conn(0x7fa14005f6b0 msgr2=0x7fa140141880 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:19.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.069+0000 7fa145dd1700 1 -- 172.21.15.36:0/127538256 shutdown_connections 2022-01-10T01:24:19.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.069+0000 7fa145dd1700 1 -- 172.21.15.36:0/127538256 wait complete. 2022-01-10T01:24:19.087 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-01-10T01:24:19.088 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:24:19.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.193+0000 7f155186c700 1 Processor -- start 2022-01-10T01:24:19.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.193+0000 7f155186c700 1 -- start start 2022-01-10T01:24:19.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155186c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f154c0b0b80 0x7f154c146c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155186c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f154c0b03d0 0x7f154c1401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155186c700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154c0b1140 con 0x7f154c0a9190 2022-01-10T01:24:19.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155186c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154c0a9570 con 0x7f154c0b0b80 2022-01-10T01:24:19.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155186c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154c0b1370 con 0x7f154c0b03d0 2022-01-10T01:24:19.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f154bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f154c0b0b80 0x7f154c146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155086a700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f154c0a9190 0x7f154c146550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59536/0 (socket says 172.21.15.36:59536) 2022-01-10T01:24:19.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f154bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f154c0b0b80 0x7f154c146c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33512/0 (socket says 172.21.15.36:33512) 2022-01-10T01:24:19.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155086a700 1 -- 172.21.15.36:0/2973384972 learned_addr learned my addr 172.21.15.36:0/2973384972 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:19.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155106b700 1 --2- 172.21.15.36:0/2973384972 >> v2:172.21.15.59:3300/0 conn(0x7f154c0b03d0 0x7f154c1401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f154bfff700 1 -- 172.21.15.36:0/2973384972 >> v2:172.21.15.59:3300/0 conn(0x7f154c0b03d0 msgr2=0x7f154c1401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:19.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f154bfff700 1 --2- 172.21.15.36:0/2973384972 >> v2:172.21.15.59:3300/0 conn(0x7f154c0b03d0 0x7f154c1401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f154b7fe700 1 -- 172.21.15.36:0/2973384972 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944077151 0 0) 0x7f154c0b1140 con 0x7f154c0a9190 2022-01-10T01:24:19.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f154bfff700 1 -- 172.21.15.36:0/2973384972 >> v1:172.21.15.36:6789/0 conn(0x7f154c0a9190 legacy=0x7f154c146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f154bfff700 1 -- 172.21.15.36:0/2973384972 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c0b1610 con 0x7f154c0b0b80 2022-01-10T01:24:19.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f154bfff700 1 --2- 172.21.15.36:0/2973384972 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f154c0b0b80 0x7f154c146c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1534002f70 tx=0x7f1534006df0).ready entity=mon.0 client_cookie=5634030b0898e133 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:19.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f154b7fe700 1 -- 172.21.15.36:0/2973384972 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f153400d570 con 0x7f154c0b0b80 2022-01-10T01:24:19.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f154b7fe700 1 -- 172.21.15.36:0/2973384972 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1534000e90 con 0x7f154c0b0b80 2022-01-10T01:24:19.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f154b7fe700 1 -- 172.21.15.36:0/2973384972 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f153400d8c0 con 0x7f154c0b0b80 2022-01-10T01:24:19.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155186c700 1 -- 172.21.15.36:0/2973384972 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f154c0b0b80 msgr2=0x7f154c146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155186c700 1 --2- 172.21.15.36:0/2973384972 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f154c0b0b80 0x7f154c146c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1534002f70 tx=0x7f1534006df0).stop 2022-01-10T01:24:19.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155186c700 1 -- 172.21.15.36:0/2973384972 shutdown_connections 2022-01-10T01:24:19.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155186c700 1 --2- 172.21.15.36:0/2973384972 >> v2:172.21.15.59:3300/0 conn(0x7f154c0b03d0 0x7f154c1401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155186c700 1 --2- 172.21.15.36:0/2973384972 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f154c0b0b80 0x7f154c146c60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155186c700 1 -- 172.21.15.36:0/2973384972 >> 172.21.15.36:0/2973384972 conn(0x7f154c061140 msgr2=0x7f154c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:19.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155186c700 1 -- 172.21.15.36:0/2973384972 shutdown_connections 2022-01-10T01:24:19.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.197+0000 7f155186c700 1 -- 172.21.15.36:0/2973384972 wait complete. 2022-01-10T01:24:19.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155186c700 1 Processor -- start 2022-01-10T01:24:19.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155186c700 1 -- start start 2022-01-10T01:24:19.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155186c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c0a9190 0x7f154c0aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155186c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c0b03d0 0x7f154c152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155186c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f154c0b0b80 0x7f154c148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155186c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c1453f0 con 0x7f154c0b0b80 2022-01-10T01:24:19.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155186c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154c145620 con 0x7f154c0a9190 2022-01-10T01:24:19.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155186c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154c1458c0 con 0x7f154c0b03d0 2022-01-10T01:24:19.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155106b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f154c0b0b80 0x7f154c148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155106b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f154c0b0b80 0x7f154c148e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33520/0 (socket says 172.21.15.36:33520) 2022-01-10T01:24:19.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155106b700 1 -- 172.21.15.36:0/476476446 learned_addr learned my addr 172.21.15.36:0/476476446 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:19.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f154bfff700 1 --2- 172.21.15.36:0/476476446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c0b03d0 0x7f154c152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155086a700 1 --2- 172.21.15.36:0/476476446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c0a9190 0x7f154c0aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155106b700 1 -- 172.21.15.36:0/476476446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c0b03d0 msgr2=0x7f154c152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155106b700 1 --2- 172.21.15.36:0/476476446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c0b03d0 0x7f154c152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155106b700 1 -- 172.21.15.36:0/476476446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c0a9190 msgr2=0x7f154c0aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155106b700 1 --2- 172.21.15.36:0/476476446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c0a9190 0x7f154c0aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.201+0000 7f155106b700 1 -- 172.21.15.36:0/476476446 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153400b180 con 0x7f154c0b0b80 2022-01-10T01:24:19.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.205+0000 7f155106b700 1 --2- 172.21.15.36:0/476476446 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f154c0b0b80 0x7f154c148e00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f1544006e00 tx=0x7f15440091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:19.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.205+0000 7f1549ffb700 1 -- 172.21.15.36:0/476476446 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f154400c640 con 0x7f154c0b0b80 2022-01-10T01:24:19.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.205+0000 7f1549ffb700 1 -- 172.21.15.36:0/476476446 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154400c7a0 con 0x7f154c0b0b80 2022-01-10T01:24:19.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.205+0000 7f155186c700 1 -- 172.21.15.36:0/476476446 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154c145b60 con 0x7f154c0b0b80 2022-01-10T01:24:19.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.205+0000 7f1549ffb700 1 -- 172.21.15.36:0/476476446 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f154400cb00 con 0x7f154c0b0b80 2022-01-10T01:24:19.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.205+0000 7f155186c700 1 -- 172.21.15.36:0/476476446 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154c1532f0 con 0x7f154c0b0b80 2022-01-10T01:24:19.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.205+0000 7f1549ffb700 1 -- 172.21.15.36:0/476476446 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1544022070 con 0x7f154c0b0b80 2022-01-10T01:24:19.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.205+0000 7f155186c700 1 -- 172.21.15.36:0/476476446 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154c0b17f0 con 0x7f154c0b0b80 2022-01-10T01:24:19.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.205+0000 7f1549ffb700 1 --2- 172.21.15.36:0/476476446 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15240534d0 0x7f1524055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.205+0000 7f1549ffb700 1 -- 172.21.15.36:0/476476446 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f154406bc50 con 0x7f154c0b0b80 2022-01-10T01:24:19.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.205+0000 7f155086a700 1 --2- 172.21.15.36:0/476476446 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15240534d0 0x7f1524055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.205+0000 7f155086a700 1 --2- 172.21.15.36:0/476476446 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15240534d0 0x7f1524055990 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f153c00d000 tx=0x7f153c007c20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:19.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.213+0000 7f1549ffb700 1 -- 172.21.15.36:0/476476446 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1544043090 con 0x7f154c0b0b80 2022-01-10T01:24:19.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.337+0000 7f155186c700 1 -- 172.21.15.36:0/476476446 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f154c057350 con 0x7f154c0b0b80 2022-01-10T01:24:19.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.337+0000 7f1549ffb700 1 -- 172.21.15.36:0/476476446 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f15440466b0 con 0x7f154c0b0b80 2022-01-10T01:24:19.343 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:24:19.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.337+0000 7f155186c700 1 -- 172.21.15.36:0/476476446 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15240534d0 msgr2=0x7f1524055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.337+0000 7f155186c700 1 --2- 172.21.15.36:0/476476446 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15240534d0 0x7f1524055990 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f153c00d000 tx=0x7f153c007c20).stop 2022-01-10T01:24:19.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.337+0000 7f155186c700 1 -- 172.21.15.36:0/476476446 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f154c0b0b80 msgr2=0x7f154c148e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.337+0000 7f155186c700 1 --2- 172.21.15.36:0/476476446 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f154c0b0b80 0x7f154c148e00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f1544006e00 tx=0x7f15440091d0).stop 2022-01-10T01:24:19.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.337+0000 7f155186c700 1 -- 172.21.15.36:0/476476446 shutdown_connections 2022-01-10T01:24:19.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.337+0000 7f155186c700 1 --2- 172.21.15.36:0/476476446 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15240534d0 0x7f1524055990 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.337+0000 7f155186c700 1 --2- 172.21.15.36:0/476476446 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f154c0b0b80 0x7f154c148e00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.337+0000 7f155186c700 1 --2- 172.21.15.36:0/476476446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f154c0b03d0 0x7f154c152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.337+0000 7f155186c700 1 --2- 172.21.15.36:0/476476446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f154c0a9190 0x7f154c0aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.337+0000 7f155186c700 1 -- 172.21.15.36:0/476476446 >> 172.21.15.36:0/476476446 conn(0x7f154c061140 msgr2=0x7f154c1433b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:19.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.341+0000 7f155186c700 1 -- 172.21.15.36:0/476476446 shutdown_connections 2022-01-10T01:24:19.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.341+0000 7f155186c700 1 -- 172.21.15.36:0/476476446 wait complete. 2022-01-10T01:24:19.356 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:24:19.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.461+0000 7f9c7eb5f700 1 Processor -- start 2022-01-10T01:24:19.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.461+0000 7f9c7eb5f700 1 -- start start 2022-01-10T01:24:19.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7eb5f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c780b4710 0x7f9c7813fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7eb5f700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c780b6910 con 0x7f9c781439a0 2022-01-10T01:24:19.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7eb5f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c780b6bb0 con 0x7f9c78061680 2022-01-10T01:24:19.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7eb5f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780b9680 con 0x7f9c780b4710 2022-01-10T01:24:19.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7e35e700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9c781439a0 0x7f9c78140290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59552/0 (socket says 172.21.15.36:59552) 2022-01-10T01:24:19.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7e35e700 1 -- 172.21.15.36:0/2198486534 learned_addr learned my addr 172.21.15.36:0/2198486534 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:19.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7d35c700 1 --2- 172.21.15.36:0/2198486534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c780b4710 0x7f9c7813fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7cb5b700 1 -- 172.21.15.36:0/2198486534 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652337014 0 0) 0x7f9c780b6910 con 0x7f9c781439a0 2022-01-10T01:24:19.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7cb5b700 1 -- 172.21.15.36:0/2198486534 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c60003260 con 0x7f9c781439a0 2022-01-10T01:24:19.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7cb5b700 1 -- 172.21.15.36:0/2198486534 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2041827450 0 0) 0x7f9c60003260 con 0x7f9c781439a0 2022-01-10T01:24:19.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7d35c700 1 -- 172.21.15.36:0/2198486534 >> v1:172.21.15.59:6789/0 conn(0x7f9c78061680 legacy=0x7f9c780b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7d35c700 1 -- 172.21.15.36:0/2198486534 >> v1:172.21.15.36:6789/0 conn(0x7f9c781439a0 legacy=0x7f9c78140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7d35c700 1 -- 172.21.15.36:0/2198486534 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c780b6e50 con 0x7f9c780b4710 2022-01-10T01:24:19.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7d35c700 1 --2- 172.21.15.36:0/2198486534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c780b4710 0x7f9c7813fda0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9c70001b80 tx=0x7f9c74006df0).ready entity=mon.2 client_cookie=e7abcc37612cecab server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:19.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7cb5b700 1 -- 172.21.15.36:0/2198486534 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c700019e0 con 0x7f9c780b4710 2022-01-10T01:24:19.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7cb5b700 1 -- 172.21.15.36:0/2198486534 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c74000e90 con 0x7f9c780b4710 2022-01-10T01:24:19.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7cb5b700 1 -- 172.21.15.36:0/2198486534 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c7400d4a0 con 0x7f9c780b4710 2022-01-10T01:24:19.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/2198486534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c780b4710 msgr2=0x7f9c7813fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7eb5f700 1 --2- 172.21.15.36:0/2198486534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c780b4710 0x7f9c7813fda0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9c70001b80 tx=0x7f9c74006df0).stop 2022-01-10T01:24:19.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/2198486534 shutdown_connections 2022-01-10T01:24:19.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7eb5f700 1 --2- 172.21.15.36:0/2198486534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c780b4710 0x7f9c7813fda0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/2198486534 >> 172.21.15.36:0/2198486534 conn(0x7f9c7806adf0 msgr2=0x7f9c7805f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:19.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/2198486534 shutdown_connections 2022-01-10T01:24:19.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.465+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/2198486534 wait complete. 2022-01-10T01:24:19.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7eb5f700 1 Processor -- start 2022-01-10T01:24:19.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7eb5f700 1 -- start start 2022-01-10T01:24:19.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7eb5f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9c78061680 0x7f9c780b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7eb5f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c781439a0 0x7f9c781525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7eb5f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c780ada40 0x7f9c78152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7eb5f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c78145c40 con 0x7f9c78061680 2022-01-10T01:24:19.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7eb5f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c781464c0 con 0x7f9c780ada40 2022-01-10T01:24:19.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7eb5f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7805ef30 con 0x7f9c781439a0 2022-01-10T01:24:19.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7db5d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9c78061680 0x7f9c780b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7db5d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9c78061680 0x7f9c780b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33530/0 (socket says 172.21.15.36:33530) 2022-01-10T01:24:19.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7db5d700 1 -- 172.21.15.36:0/758708618 learned_addr learned my addr 172.21.15.36:0/758708618 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:19.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7d35c700 1 --2- 172.21.15.36:0/758708618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c781439a0 0x7f9c781525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7e35e700 1 --2- 172.21.15.36:0/758708618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c780ada40 0x7f9c78152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7db5d700 1 -- 172.21.15.36:0/758708618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c781439a0 msgr2=0x7f9c781525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7db5d700 1 --2- 172.21.15.36:0/758708618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c781439a0 0x7f9c781525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7db5d700 1 -- 172.21.15.36:0/758708618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c780ada40 msgr2=0x7f9c78152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7db5d700 1 --2- 172.21.15.36:0/758708618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c780ada40 0x7f9c78152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7db5d700 1 -- 172.21.15.36:0/758708618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7400b180 con 0x7f9c78061680 2022-01-10T01:24:19.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7db5d700 1 --2- 172.21.15.36:0/758708618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9c78061680 0x7f9c780b0760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9c68001150 tx=0x7f9c68007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:19.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c66ffd700 1 -- 172.21.15.36:0/758708618 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c68007030 con 0x7f9c78061680 2022-01-10T01:24:19.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c66ffd700 1 -- 172.21.15.36:0/758708618 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c68007190 con 0x7f9c78061680 2022-01-10T01:24:19.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/758708618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c780674f0 con 0x7f9c78061680 2022-01-10T01:24:19.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c66ffd700 1 -- 172.21.15.36:0/758708618 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c68006510 con 0x7f9c78061680 2022-01-10T01:24:19.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.469+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/758708618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c78146990 con 0x7f9c78061680 2022-01-10T01:24:19.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.473+0000 7f9c66ffd700 1 -- 172.21.15.36:0/758708618 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9c68010030 con 0x7f9c78061680 2022-01-10T01:24:19.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.473+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/758708618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c78146800 con 0x7f9c78061680 2022-01-10T01:24:19.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.473+0000 7f9c66ffd700 1 --2- 172.21.15.36:0/758708618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9c580535f0 0x7f9c58055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.473+0000 7f9c66ffd700 1 -- 172.21.15.36:0/758708618 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9c6806b350 con 0x7f9c78061680 2022-01-10T01:24:19.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.473+0000 7f9c7d35c700 1 --2- 172.21.15.36:0/758708618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9c580535f0 0x7f9c58055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.473+0000 7f9c7d35c700 1 --2- 172.21.15.36:0/758708618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9c580535f0 0x7f9c58055ab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9c74019000 tx=0x7f9c780b1eb0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:19.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.481+0000 7f9c66ffd700 1 -- 172.21.15.36:0/758708618 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9c680426e0 con 0x7f9c78061680 2022-01-10T01:24:19.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.613+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/758708618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9c78146b20 con 0x7f9c78061680 2022-01-10T01:24:19.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.613+0000 7f9c66ffd700 1 -- 172.21.15.36:0/758708618 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9c68045d00 con 0x7f9c78061680 2022-01-10T01:24:19.619 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:19.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.617+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/758708618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9c580535f0 msgr2=0x7f9c58055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.617+0000 7f9c7eb5f700 1 --2- 172.21.15.36:0/758708618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9c580535f0 0x7f9c58055ab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9c74019000 tx=0x7f9c780b1eb0).stop 2022-01-10T01:24:19.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.617+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/758708618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9c78061680 msgr2=0x7f9c780b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.617+0000 7f9c7eb5f700 1 --2- 172.21.15.36:0/758708618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9c78061680 0x7f9c780b0760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9c68001150 tx=0x7f9c68007c00).stop 2022-01-10T01:24:19.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.617+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/758708618 shutdown_connections 2022-01-10T01:24:19.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.617+0000 7f9c7eb5f700 1 --2- 172.21.15.36:0/758708618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9c580535f0 0x7f9c58055ab0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.617+0000 7f9c7eb5f700 1 --2- 172.21.15.36:0/758708618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c780ada40 0x7f9c78152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.617+0000 7f9c7eb5f700 1 --2- 172.21.15.36:0/758708618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c781439a0 0x7f9c781525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.617+0000 7f9c7eb5f700 1 --2- 172.21.15.36:0/758708618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9c78061680 0x7f9c780b0760 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.617+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/758708618 >> 172.21.15.36:0/758708618 conn(0x7f9c7806adf0 msgr2=0x7f9c7813fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:19.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.617+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/758708618 shutdown_connections 2022-01-10T01:24:19.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.617+0000 7f9c7eb5f700 1 -- 172.21.15.36:0/758708618 wait complete. 2022-01-10T01:24:19.633 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-01-10T01:24:19.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 Processor -- start 2022-01-10T01:24:19.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 -- start start 2022-01-10T01:24:19.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8c9c0b0010 0x7f8c9c0a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8c9c0afbd0 0x7f8c9c0a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9c0a70c0 con 0x7f8c9c0b2580 2022-01-10T01:24:19.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c0a72f0 con 0x7f8c9c0b0010 2022-01-10T01:24:19.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c0a7590 con 0x7f8c9c0afbd0 2022-01-10T01:24:19.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8c937fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8c9c0b0010 0x7f8c9c0a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8c937fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8c9c0b0010 0x7f8c9c0a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33540/0 (socket says 172.21.15.36:33540) 2022-01-10T01:24:19.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8c937fe700 1 -- 172.21.15.36:0/1939006629 learned_addr learned my addr 172.21.15.36:0/1939006629 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:19.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca09a4700 1 --2- 172.21.15.36:0/1939006629 >> v2:172.21.15.59:3300/0 conn(0x7f8c9c0afbd0 0x7f8c9c0a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8c937fe700 1 -- 172.21.15.36:0/1939006629 >> v2:172.21.15.59:3300/0 conn(0x7f8c9c0afbd0 msgr2=0x7f8c9c0a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:19.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8c937fe700 1 --2- 172.21.15.36:0/1939006629 >> v2:172.21.15.59:3300/0 conn(0x7f8c9c0afbd0 0x7f8c9c0a88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8c937fe700 1 -- 172.21.15.36:0/1939006629 >> v1:172.21.15.59:6789/0 conn(0x7f8c9c0b2580 legacy=0x7f8c9c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8c937fe700 1 -- 172.21.15.36:0/1939006629 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c0a7830 con 0x7f8c9c0b0010 2022-01-10T01:24:19.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8c937fe700 1 --2- 172.21.15.36:0/1939006629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8c9c0b0010 0x7f8c9c0a83b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8c84002f70 tx=0x7f8c84006eb0).ready entity=mon.0 client_cookie=526fec131a2951a6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:19.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8c9b7fe700 1 -- 172.21.15.36:0/1939006629 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c8400d610 con 0x7f8c9c0b0010 2022-01-10T01:24:19.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8c9b7fe700 1 -- 172.21.15.36:0/1939006629 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c84000e90 con 0x7f8c9c0b0010 2022-01-10T01:24:19.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8c9b7fe700 1 -- 172.21.15.36:0/1939006629 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c8400d9a0 con 0x7f8c9c0b0010 2022-01-10T01:24:19.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 -- 172.21.15.36:0/1939006629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8c9c0b0010 msgr2=0x7f8c9c0a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 --2- 172.21.15.36:0/1939006629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8c9c0b0010 0x7f8c9c0a83b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8c84002f70 tx=0x7f8c84006eb0).stop 2022-01-10T01:24:19.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 -- 172.21.15.36:0/1939006629 shutdown_connections 2022-01-10T01:24:19.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 --2- 172.21.15.36:0/1939006629 >> v2:172.21.15.59:3300/0 conn(0x7f8c9c0afbd0 0x7f8c9c0a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 --2- 172.21.15.36:0/1939006629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8c9c0b0010 0x7f8c9c0a83b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 -- 172.21.15.36:0/1939006629 >> 172.21.15.36:0/1939006629 conn(0x7f8c9c060180 msgr2=0x7f8c9c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:19.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 -- 172.21.15.36:0/1939006629 shutdown_connections 2022-01-10T01:24:19.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.733+0000 7f8ca11a5700 1 -- 172.21.15.36:0/1939006629 wait complete. 2022-01-10T01:24:19.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.737+0000 7f8ca11a5700 1 Processor -- start 2022-01-10T01:24:19.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.737+0000 7f8ca11a5700 1 -- start start 2022-01-10T01:24:19.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.737+0000 7f8ca11a5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8c9c0afbd0 0x7f8c9c063b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.737+0000 7f8ca11a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c9c0b0010 0x7f8c9c063070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.737+0000 7f8ca11a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c9c0b2580 0x7f8c9c066760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.737+0000 7f8ca11a5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c0b5ba0 con 0x7f8c9c0afbd0 2022-01-10T01:24:19.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.737+0000 7f8ca11a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c064010 con 0x7f8c9c0b2580 2022-01-10T01:24:19.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.737+0000 7f8ca11a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c0b5dd0 con 0x7f8c9c0b0010 2022-01-10T01:24:19.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.737+0000 7f8c9bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8c9c0afbd0 0x7f8c9c063b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.737+0000 7f8c9bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8c9c0afbd0 0x7f8c9c063b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33544/0 (socket says 172.21.15.36:33544) 2022-01-10T01:24:19.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.737+0000 7f8c9bfff700 1 -- 172.21.15.36:0/2287876998 learned_addr learned my addr 172.21.15.36:0/2287876998 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:19.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.737+0000 7f8c937fe700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c9c0b0010 0x7f8c9c063070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.737+0000 7f8ca09a4700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c9c0b2580 0x7f8c9c066760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8c9bfff700 1 -- 172.21.15.36:0/2287876998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c9c0b0010 msgr2=0x7f8c9c063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8c9bfff700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c9c0b0010 0x7f8c9c063070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8c9bfff700 1 -- 172.21.15.36:0/2287876998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c9c0b2580 msgr2=0x7f8c9c066760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8c9bfff700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c9c0b2580 0x7f8c9c066760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8c9bfff700 1 -- 172.21.15.36:0/2287876998 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8400b1e0 con 0x7f8c9c0afbd0 2022-01-10T01:24:19.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8ca09a4700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c9c0b2580 0x7f8c9c066760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:19.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8c9bfff700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8c9c0afbd0 0x7f8c9c063b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f8c9c06b7c0 tx=0x7f8c8c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:19.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8c99ffb700 1 -- 172.21.15.36:0/2287876998 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c8c012400 con 0x7f8c9c0afbd0 2022-01-10T01:24:19.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8c99ffb700 1 -- 172.21.15.36:0/2287876998 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c012560 con 0x7f8c9c0afbd0 2022-01-10T01:24:19.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8c99ffb700 1 -- 172.21.15.36:0/2287876998 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c8c0128c0 con 0x7f8c9c0afbd0 2022-01-10T01:24:19.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8ca11a5700 1 -- 172.21.15.36:0/2287876998 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9c156f50 con 0x7f8c9c0afbd0 2022-01-10T01:24:19.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8ca11a5700 1 -- 172.21.15.36:0/2287876998 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9c063560 con 0x7f8c9c0afbd0 2022-01-10T01:24:19.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8ca11a5700 1 -- 172.21.15.36:0/2287876998 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9c057350 con 0x7f8c9c0afbd0 2022-01-10T01:24:19.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8c99ffb700 1 -- 172.21.15.36:0/2287876998 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8c8c019030 con 0x7f8c9c0afbd0 2022-01-10T01:24:19.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.741+0000 7f8c99ffb700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8c80053680 0x7f8c80055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:19.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.745+0000 7f8c937fe700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8c80053680 0x7f8c80055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:19.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.745+0000 7f8c99ffb700 1 -- 172.21.15.36:0/2287876998 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f8c8c06a910 con 0x7f8c9c0afbd0 2022-01-10T01:24:19.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.745+0000 7f8c937fe700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8c80053680 0x7f8c80055b40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8c8401c000 tx=0x7f8c84015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:19.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.749+0000 7f8c99ffb700 1 -- 172.21.15.36:0/2287876998 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8c8c041db0 con 0x7f8c9c0afbd0 2022-01-10T01:24:19.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.881+0000 7f8ca11a5700 1 -- 172.21.15.36:0/2287876998 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8c9c1573f0 con 0x7f8c9c0afbd0 2022-01-10T01:24:19.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.881+0000 7f8c99ffb700 1 -- 172.21.15.36:0/2287876998 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f8c8c0453d0 con 0x7f8c9c0afbd0 2022-01-10T01:24:19.889 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:19.889 INFO:teuthology.orchestra.run.smithi036.stdout:[ 2022-01-10T01:24:19.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:19.889 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 1, 2022-01-10T01:24:19.889 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "device_health_metrics" 2022-01-10T01:24:19.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:19.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:19.890 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 2, 2022-01-10T01:24:19.890 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "rbd" 2022-01-10T01:24:19.891 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:19.891 INFO:teuthology.orchestra.run.smithi036.stdout:] 2022-01-10T01:24:19.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.885+0000 7f8ca11a5700 1 -- 172.21.15.36:0/2287876998 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8c80053680 msgr2=0x7f8c80055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.885+0000 7f8ca11a5700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8c80053680 0x7f8c80055b40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8c8401c000 tx=0x7f8c84015000).stop 2022-01-10T01:24:19.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.885+0000 7f8ca11a5700 1 -- 172.21.15.36:0/2287876998 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8c9c0afbd0 msgr2=0x7f8c9c063b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:19.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.885+0000 7f8ca11a5700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8c9c0afbd0 0x7f8c9c063b20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f8c9c06b7c0 tx=0x7f8c8c007c50).stop 2022-01-10T01:24:19.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.885+0000 7f8ca11a5700 1 -- 172.21.15.36:0/2287876998 shutdown_connections 2022-01-10T01:24:19.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.885+0000 7f8ca11a5700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8c80053680 0x7f8c80055b40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.885+0000 7f8ca11a5700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c9c0b2580 0x7f8c9c066760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.885+0000 7f8ca11a5700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8c9c0b0010 0x7f8c9c063070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.885+0000 7f8ca11a5700 1 --2- 172.21.15.36:0/2287876998 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8c9c0afbd0 0x7f8c9c063b20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:19.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.885+0000 7f8ca11a5700 1 -- 172.21.15.36:0/2287876998 >> 172.21.15.36:0/2287876998 conn(0x7f8c9c060180 msgr2=0x7f8c9c0aea20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:19.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.885+0000 7f8ca11a5700 1 -- 172.21.15.36:0/2287876998 shutdown_connections 2022-01-10T01:24:19.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:19.885+0000 7f8ca11a5700 1 -- 172.21.15.36:0/2287876998 wait complete. 2022-01-10T01:24:19.902 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-01-10T01:24:19.902 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:24:20.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b74b6d700 1 Processor -- start 2022-01-10T01:24:20.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b74b6d700 1 -- start start 2022-01-10T01:24:20.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b74b6d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b70144940 0x7f6b700abd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:20.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b74b6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b700a9ec0 0x7f6b700b0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:20.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b74b6d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b70144d20 con 0x7f6b700b0d60 2022-01-10T01:24:20.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b74b6d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b700ac200 con 0x7f6b70144940 2022-01-10T01:24:20.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b74b6d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b70144f80 con 0x7f6b700a9ec0 2022-01-10T01:24:20.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b6e59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b70144940 0x7f6b700abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:20.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b6dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b700a9ec0 0x7f6b700b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:20.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b6ed9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6b700b0d60 0x7f6b7013e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:49026/0 (socket says 172.21.15.36:49026) 2022-01-10T01:24:20.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b6ed9d700 1 -- 172.21.15.36:0/885270301 learned_addr learned my addr 172.21.15.36:0/885270301 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:20.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b6d59a700 1 -- 172.21.15.36:0/885270301 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861783507 0 0) 0x7f6b70144d20 con 0x7f6b700b0d60 2022-01-10T01:24:20.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b6d59a700 1 -- 172.21.15.36:0/885270301 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b50003260 con 0x7f6b700b0d60 2022-01-10T01:24:20.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b6dd9b700 1 -- 172.21.15.36:0/885270301 >> v2:172.21.15.59:3300/0 conn(0x7f6b70144940 msgr2=0x7f6b700abd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:20.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b6dd9b700 1 --2- 172.21.15.36:0/885270301 >> v2:172.21.15.59:3300/0 conn(0x7f6b70144940 0x7f6b700abd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:20.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b6dd9b700 1 -- 172.21.15.36:0/885270301 >> v1:172.21.15.59:6789/0 conn(0x7f6b700b0d60 legacy=0x7f6b7013e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:20.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b6dd9b700 1 -- 172.21.15.36:0/885270301 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b70145220 con 0x7f6b700a9ec0 2022-01-10T01:24:20.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.009+0000 7f6b6e59c700 1 --2- 172.21.15.36:0/885270301 >> v2:172.21.15.59:3300/0 conn(0x7f6b70144940 0x7f6b700abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:20.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.013+0000 7f6b6dd9b700 1 --2- 172.21.15.36:0/885270301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b700a9ec0 0x7f6b700b0870 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f6b58002f70 tx=0x7f6b58006df0).ready entity=mon.2 client_cookie=32363974c31431a0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:20.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.013+0000 7f6b6d59a700 1 -- 172.21.15.36:0/885270301 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b5800d4a0 con 0x7f6b700a9ec0 2022-01-10T01:24:20.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.013+0000 7f6b6d59a700 1 -- 172.21.15.36:0/885270301 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b58000e90 con 0x7f6b700a9ec0 2022-01-10T01:24:20.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.013+0000 7f6b6d59a700 1 -- 172.21.15.36:0/885270301 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b5800d7f0 con 0x7f6b700a9ec0 2022-01-10T01:24:20.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.013+0000 7f6b74b6d700 1 -- 172.21.15.36:0/885270301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b700a9ec0 msgr2=0x7f6b700b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:20.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.013+0000 7f6b74b6d700 1 --2- 172.21.15.36:0/885270301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b700a9ec0 0x7f6b700b0870 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f6b58002f70 tx=0x7f6b58006df0).stop 2022-01-10T01:24:20.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.013+0000 7f6b74b6d700 1 -- 172.21.15.36:0/885270301 shutdown_connections 2022-01-10T01:24:20.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.013+0000 7f6b74b6d700 1 --2- 172.21.15.36:0/885270301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b700a9ec0 0x7f6b700b0870 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:20.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.013+0000 7f6b74b6d700 1 --2- 172.21.15.36:0/885270301 >> v2:172.21.15.59:3300/0 conn(0x7f6b70144940 0x7f6b700abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:20.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.013+0000 7f6b74b6d700 1 -- 172.21.15.36:0/885270301 >> 172.21.15.36:0/885270301 conn(0x7f6b700b2970 msgr2=0x7f6b700b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:20.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.013+0000 7f6b74b6d700 1 -- 172.21.15.36:0/885270301 shutdown_connections 2022-01-10T01:24:20.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.013+0000 7f6b74b6d700 1 -- 172.21.15.36:0/885270301 wait complete. 2022-01-10T01:24:20.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.013+0000 7f6b74b6d700 1 Processor -- start 2022-01-10T01:24:20.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.013+0000 7f6b74b6d700 1 -- start start 2022-01-10T01:24:20.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b74b6d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6b700a9ec0 0x7f6b7013d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:20.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b74b6d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b700b0d60 0x7f6b701392e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:20.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b74b6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b70144940 0x7f6b701397d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:20.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b74b6d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7013a570 con 0x7f6b700a9ec0 2022-01-10T01:24:20.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b74b6d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700b4b00 con 0x7f6b700b0d60 2022-01-10T01:24:20.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b74b6d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b70150ef0 con 0x7f6b70144940 2022-01-10T01:24:20.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b6e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6b700a9ec0 0x7f6b7013d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:20.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b6e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6b700a9ec0 0x7f6b7013d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33558/0 (socket says 172.21.15.36:33558) 2022-01-10T01:24:20.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b6e59c700 1 -- 172.21.15.36:0/3793250468 learned_addr learned my addr 172.21.15.36:0/3793250468 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:20.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b6ed9d700 1 --2- 172.21.15.36:0/3793250468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b70144940 0x7f6b701397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:20.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b6dd9b700 1 --2- 172.21.15.36:0/3793250468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b700b0d60 0x7f6b701392e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:20.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b6e59c700 1 -- 172.21.15.36:0/3793250468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b70144940 msgr2=0x7f6b701397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:20.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b6e59c700 1 --2- 172.21.15.36:0/3793250468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b70144940 0x7f6b701397d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:20.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b6e59c700 1 -- 172.21.15.36:0/3793250468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b700b0d60 msgr2=0x7f6b701392e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:20.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b6e59c700 1 --2- 172.21.15.36:0/3793250468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b700b0d60 0x7f6b701392e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:20.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b6e59c700 1 -- 172.21.15.36:0/3793250468 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b60009470 con 0x7f6b700a9ec0 2022-01-10T01:24:20.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b6e59c700 1 --2- 172.21.15.36:0/3793250468 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6b700a9ec0 0x7f6b7013d090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6b70150160 tx=0x7f6b600091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:20.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b677fe700 1 -- 172.21.15.36:0/3793250468 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b6000c850 con 0x7f6b700a9ec0 2022-01-10T01:24:20.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b677fe700 1 -- 172.21.15.36:0/3793250468 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6000c9b0 con 0x7f6b700a9ec0 2022-01-10T01:24:20.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b74b6d700 1 -- 172.21.15.36:0/3793250468 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5800b180 con 0x7f6b700a9ec0 2022-01-10T01:24:20.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b677fe700 1 -- 172.21.15.36:0/3793250468 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b6000cd10 con 0x7f6b700a9ec0 2022-01-10T01:24:20.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b74b6d700 1 -- 172.21.15.36:0/3793250468 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b700b3eb0 con 0x7f6b700a9ec0 2022-01-10T01:24:20.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b74b6d700 1 -- 172.21.15.36:0/3793250468 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b70057350 con 0x7f6b700a9ec0 2022-01-10T01:24:20.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b677fe700 1 -- 172.21.15.36:0/3793250468 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6b6001b400 con 0x7f6b700a9ec0 2022-01-10T01:24:20.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.017+0000 7f6b677fe700 1 --2- 172.21.15.36:0/3793250468 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6b54053680 0x7f6b54055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:20.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.021+0000 7f6b677fe700 1 -- 172.21.15.36:0/3793250468 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6b6006c000 con 0x7f6b700a9ec0 2022-01-10T01:24:20.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.021+0000 7f6b6dd9b700 1 --2- 172.21.15.36:0/3793250468 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6b54053680 0x7f6b54055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:20.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.021+0000 7f6b6dd9b700 1 --2- 172.21.15.36:0/3793250468 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6b54053680 0x7f6b54055b40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6b5801a000 tx=0x7f6b58014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:20.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.025+0000 7f6b677fe700 1 -- 172.21.15.36:0/3793250468 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6b60043440 con 0x7f6b700a9ec0 2022-01-10T01:24:20.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.145+0000 7f6b74b6d700 1 -- 172.21.15.36:0/3793250468 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f6b70044650 con 0x7f6b700a9ec0 2022-01-10T01:24:20.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.905+0000 7f6b677fe700 1 -- 172.21.15.36:0/3793250468 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6b60046a60 con 0x7f6b700a9ec0 2022-01-10T01:24:20.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.909+0000 7f6b74b6d700 1 -- 172.21.15.36:0/3793250468 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6b54053680 msgr2=0x7f6b54055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:20.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.909+0000 7f6b74b6d700 1 --2- 172.21.15.36:0/3793250468 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6b54053680 0x7f6b54055b40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6b5801a000 tx=0x7f6b58014000).stop 2022-01-10T01:24:20.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.909+0000 7f6b74b6d700 1 -- 172.21.15.36:0/3793250468 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6b700a9ec0 msgr2=0x7f6b7013d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:20.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.909+0000 7f6b74b6d700 1 --2- 172.21.15.36:0/3793250468 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6b700a9ec0 0x7f6b7013d090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f6b70150160 tx=0x7f6b600091d0).stop 2022-01-10T01:24:20.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.909+0000 7f6b74b6d700 1 -- 172.21.15.36:0/3793250468 shutdown_connections 2022-01-10T01:24:20.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.909+0000 7f6b74b6d700 1 --2- 172.21.15.36:0/3793250468 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6b54053680 0x7f6b54055b40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:20.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.909+0000 7f6b74b6d700 1 --2- 172.21.15.36:0/3793250468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b70144940 0x7f6b701397d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:20.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.909+0000 7f6b74b6d700 1 --2- 172.21.15.36:0/3793250468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b700b0d60 0x7f6b701392e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:20.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.909+0000 7f6b74b6d700 1 --2- 172.21.15.36:0/3793250468 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6b700a9ec0 0x7f6b7013d090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:20.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.909+0000 7f6b74b6d700 1 -- 172.21.15.36:0/3793250468 >> 172.21.15.36:0/3793250468 conn(0x7f6b700b2970 msgr2=0x7f6b700b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:20.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.909+0000 7f6b74b6d700 1 -- 172.21.15.36:0/3793250468 shutdown_connections 2022-01-10T01:24:20.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:20.909+0000 7f6b74b6d700 1 -- 172.21.15.36:0/3793250468 wait complete. 2022-01-10T01:24:20.917 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:24:20.928 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2022-01-10T01:24:20.928 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2022-01-10T01:24:21.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea4afc0700 1 Processor -- start 2022-01-10T01:24:21.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea4afc0700 1 -- start start 2022-01-10T01:24:21.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea4afc0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440a9c10 0x7fea441483b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:21.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea4afc0700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea440b33e0 con 0x7fea440b18f0 2022-01-10T01:24:21.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea4afc0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea440b0c70 con 0x7fea440b3000 2022-01-10T01:24:21.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea4afc0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea440b0f10 con 0x7fea440a9c10 2022-01-10T01:24:21.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea497bd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fea440b18f0 0x7fea44147ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59594/0 (socket says 172.21.15.36:59594) 2022-01-10T01:24:21.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea497bd700 1 -- 172.21.15.36:0/3079770576 learned_addr learned my addr 172.21.15.36:0/3079770576 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:21.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea4a7bf700 1 --2- 172.21.15.36:0/3079770576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440a9c10 0x7fea441483b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:21.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea48fbc700 1 -- 172.21.15.36:0/3079770576 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072937452 0 0) 0x7fea440b33e0 con 0x7fea440b18f0 2022-01-10T01:24:21.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea48fbc700 1 -- 172.21.15.36:0/3079770576 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea2c003260 con 0x7fea440b18f0 2022-01-10T01:24:21.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea48fbc700 1 -- 172.21.15.36:0/3079770576 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3778491808 0 0) 0x7fea440b0c70 con 0x7fea440b3000 2022-01-10T01:24:21.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea48fbc700 1 -- 172.21.15.36:0/3079770576 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea440b33e0 con 0x7fea440b3000 2022-01-10T01:24:21.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea4a7bf700 1 -- 172.21.15.36:0/3079770576 >> v1:172.21.15.59:6789/0 conn(0x7fea440b3000 legacy=0x7fea44065510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:21.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea4a7bf700 1 -- 172.21.15.36:0/3079770576 >> v1:172.21.15.36:6789/0 conn(0x7fea440b18f0 legacy=0x7fea44147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:21.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.041+0000 7fea4a7bf700 1 -- 172.21.15.36:0/3079770576 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea440b11b0 con 0x7fea440a9c10 2022-01-10T01:24:21.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4a7bf700 1 --2- 172.21.15.36:0/3079770576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440a9c10 0x7fea441483b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fea3c0032f0 tx=0x7fea3c0091d0).ready entity=mon.2 client_cookie=d2306e358a68a40e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:21.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea48fbc700 1 -- 172.21.15.36:0/3079770576 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea3c00b640 con 0x7fea440a9c10 2022-01-10T01:24:21.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea48fbc700 1 -- 172.21.15.36:0/3079770576 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c00b7a0 con 0x7fea440a9c10 2022-01-10T01:24:21.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea48fbc700 1 -- 172.21.15.36:0/3079770576 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea3c00b910 con 0x7fea440a9c10 2022-01-10T01:24:21.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 -- 172.21.15.36:0/3079770576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440a9c10 msgr2=0x7fea441483b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:21.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 --2- 172.21.15.36:0/3079770576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440a9c10 0x7fea441483b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fea3c0032f0 tx=0x7fea3c0091d0).stop 2022-01-10T01:24:21.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 -- 172.21.15.36:0/3079770576 shutdown_connections 2022-01-10T01:24:21.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 --2- 172.21.15.36:0/3079770576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440a9c10 0x7fea441483b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:21.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 -- 172.21.15.36:0/3079770576 >> 172.21.15.36:0/3079770576 conn(0x7fea440636e0 msgr2=0x7fea44063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:21.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 -- 172.21.15.36:0/3079770576 shutdown_connections 2022-01-10T01:24:21.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 -- 172.21.15.36:0/3079770576 wait complete. 2022-01-10T01:24:21.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 Processor -- start 2022-01-10T01:24:21.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 -- start start 2022-01-10T01:24:21.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fea440a9c10 0x7fea44144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:21.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea440b18f0 0x7fea44141600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:21.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440b3000 0x7fea44141af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:21.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea441565a0 con 0x7fea440a9c10 2022-01-10T01:24:21.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea441427a0 con 0x7fea440b18f0 2022-01-10T01:24:21.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4afc0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea44141fe0 con 0x7fea440b3000 2022-01-10T01:24:21.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea49fbe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fea440a9c10 0x7fea44144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:21.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea49fbe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fea440a9c10 0x7fea44144660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33572/0 (socket says 172.21.15.36:33572) 2022-01-10T01:24:21.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea49fbe700 1 -- 172.21.15.36:0/2262598492 learned_addr learned my addr 172.21.15.36:0/2262598492 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:21.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea4a7bf700 1 --2- 172.21.15.36:0/2262598492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440b3000 0x7fea44141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:21.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea497bd700 1 --2- 172.21.15.36:0/2262598492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea440b18f0 0x7fea44141600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:21.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea49fbe700 1 -- 172.21.15.36:0/2262598492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440b3000 msgr2=0x7fea44141af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:21.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea49fbe700 1 --2- 172.21.15.36:0/2262598492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440b3000 0x7fea44141af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:21.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea49fbe700 1 -- 172.21.15.36:0/2262598492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea440b18f0 msgr2=0x7fea44141600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:21.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea49fbe700 1 --2- 172.21.15.36:0/2262598492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea440b18f0 0x7fea44141600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:21.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.045+0000 7fea49fbe700 1 -- 172.21.15.36:0/2262598492 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3c009470 con 0x7fea440a9c10 2022-01-10T01:24:21.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.049+0000 7fea49fbe700 1 --2- 172.21.15.36:0/2262598492 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fea440a9c10 0x7fea44144660 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fea44147750 tx=0x7fea40007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:21.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.049+0000 7fea32ffd700 1 -- 172.21.15.36:0/2262598492 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea40012400 con 0x7fea440a9c10 2022-01-10T01:24:21.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.049+0000 7fea32ffd700 1 -- 172.21.15.36:0/2262598492 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea40012560 con 0x7fea440a9c10 2022-01-10T01:24:21.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.049+0000 7fea4afc0700 1 -- 172.21.15.36:0/2262598492 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea44142410 con 0x7fea440a9c10 2022-01-10T01:24:21.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.049+0000 7fea32ffd700 1 -- 172.21.15.36:0/2262598492 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea400128c0 con 0x7fea440a9c10 2022-01-10T01:24:21.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.049+0000 7fea4afc0700 1 -- 172.21.15.36:0/2262598492 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea44142c70 con 0x7fea440a9c10 2022-01-10T01:24:21.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.049+0000 7fea4afc0700 1 -- 172.21.15.36:0/2262598492 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea44146be0 con 0x7fea440a9c10 2022-01-10T01:24:21.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.049+0000 7fea32ffd700 1 -- 172.21.15.36:0/2262598492 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fea40019030 con 0x7fea440a9c10 2022-01-10T01:24:21.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.053+0000 7fea32ffd700 1 --2- 172.21.15.36:0/2262598492 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fea24053620 0x7fea24055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:21.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.053+0000 7fea32ffd700 1 -- 172.21.15.36:0/2262598492 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fea4006aa70 con 0x7fea440a9c10 2022-01-10T01:24:21.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.053+0000 7fea497bd700 1 --2- 172.21.15.36:0/2262598492 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fea24053620 0x7fea24055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:21.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.053+0000 7fea497bd700 1 --2- 172.21.15.36:0/2262598492 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fea24053620 0x7fea24055ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fea3400d000 tx=0x7fea34009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:21.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.057+0000 7fea32ffd700 1 -- 172.21.15.36:0/2262598492 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fea40041db0 con 0x7fea440a9c10 2022-01-10T01:24:21.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.189+0000 7fea4afc0700 1 -- 172.21.15.36:0/2262598492 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fea44057350 con 0x7fea440a9c10 2022-01-10T01:24:21.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.905+0000 7fea32ffd700 1 -- 172.21.15.36:0/2262598492 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 154+0+0 (secure 0 0 0) 0x7fea4006ae60 con 0x7fea440a9c10 2022-01-10T01:24:21.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.909+0000 7fea4afc0700 1 -- 172.21.15.36:0/2262598492 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fea24053620 msgr2=0x7fea24055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:21.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.909+0000 7fea4afc0700 1 --2- 172.21.15.36:0/2262598492 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fea24053620 0x7fea24055ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fea3400d000 tx=0x7fea34009040).stop 2022-01-10T01:24:21.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.913+0000 7fea4afc0700 1 -- 172.21.15.36:0/2262598492 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fea440a9c10 msgr2=0x7fea44144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:21.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.913+0000 7fea4afc0700 1 --2- 172.21.15.36:0/2262598492 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fea440a9c10 0x7fea44144660 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fea44147750 tx=0x7fea40007ae0).stop 2022-01-10T01:24:21.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.913+0000 7fea4afc0700 1 -- 172.21.15.36:0/2262598492 shutdown_connections 2022-01-10T01:24:21.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.913+0000 7fea4afc0700 1 --2- 172.21.15.36:0/2262598492 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fea24053620 0x7fea24055ae0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:21.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.913+0000 7fea4afc0700 1 --2- 172.21.15.36:0/2262598492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea440b3000 0x7fea44141af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:21.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.913+0000 7fea4afc0700 1 --2- 172.21.15.36:0/2262598492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea440b18f0 0x7fea44141600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:21.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.913+0000 7fea4afc0700 1 --2- 172.21.15.36:0/2262598492 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fea440a9c10 0x7fea44144660 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:21.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.913+0000 7fea4afc0700 1 -- 172.21.15.36:0/2262598492 >> 172.21.15.36:0/2262598492 conn(0x7fea440636e0 msgr2=0x7fea4405fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:21.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.913+0000 7fea4afc0700 1 -- 172.21.15.36:0/2262598492 shutdown_connections 2022-01-10T01:24:21.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:21.913+0000 7fea4afc0700 1 -- 172.21.15.36:0/2262598492 wait complete. 2022-01-10T01:24:21.933 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2022-01-10T01:24:22.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f370b59e700 1 Processor -- start 2022-01-10T01:24:22.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f370b59e700 1 -- start start 2022-01-10T01:24:22.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f370b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f370c0a93c0 0x7f370c0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:22.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f370b59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c0afda0 con 0x7f370c0af2c0 2022-01-10T01:24:22.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f370b59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370c05c610 con 0x7f370c0ad320 2022-01-10T01:24:22.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f370b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c140800 con 0x7f370c0a93c0 2022-01-10T01:24:22.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f370a59c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f370c0af2c0 0x7f370c143150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59606/0 (socket says 172.21.15.36:59606) 2022-01-10T01:24:22.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f370a59c700 1 -- 172.21.15.36:0/699535505 learned_addr learned my addr 172.21.15.36:0/699535505 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:22.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f370ad9d700 1 --2- 172.21.15.36:0/699535505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f370c0a93c0 0x7f370c0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:22.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f3709d9b700 1 -- 172.21.15.36:0/699535505 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852132796 0 0) 0x7f370c0afda0 con 0x7f370c0af2c0 2022-01-10T01:24:22.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f3709d9b700 1 -- 172.21.15.36:0/699535505 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36ec003260 con 0x7f370c0af2c0 2022-01-10T01:24:22.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f3709d9b700 1 -- 172.21.15.36:0/699535505 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 833027916 0 0) 0x7f370c05c610 con 0x7f370c0ad320 2022-01-10T01:24:22.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f3709d9b700 1 -- 172.21.15.36:0/699535505 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f370c0afda0 con 0x7f370c0ad320 2022-01-10T01:24:22.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f3709d9b700 1 -- 172.21.15.36:0/699535505 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3613506248 0 0) 0x7f36ec003260 con 0x7f370c0af2c0 2022-01-10T01:24:22.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f370ad9d700 1 -- 172.21.15.36:0/699535505 >> v1:172.21.15.59:6789/0 conn(0x7f370c0ad320 legacy=0x7f370c0a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:22.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f370ad9d700 1 -- 172.21.15.36:0/699535505 >> v1:172.21.15.36:6789/0 conn(0x7f370c0af2c0 legacy=0x7f370c143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:22.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f370ad9d700 1 -- 172.21.15.36:0/699535505 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c143860 con 0x7f370c0a93c0 2022-01-10T01:24:22.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.037+0000 7f370ad9d700 1 --2- 172.21.15.36:0/699535505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f370c0a93c0 0x7f370c0af6a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f36fc001800 tx=0x7f37040091d0).ready entity=mon.2 client_cookie=a69ba1294c7748f0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:22.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.041+0000 7f3709d9b700 1 -- 172.21.15.36:0/699535505 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36fc001660 con 0x7f370c0a93c0 2022-01-10T01:24:22.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.041+0000 7f3709d9b700 1 -- 172.21.15.36:0/699535505 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370400f510 con 0x7f370c0a93c0 2022-01-10T01:24:22.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.041+0000 7f3709d9b700 1 -- 172.21.15.36:0/699535505 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f370400f680 con 0x7f370c0a93c0 2022-01-10T01:24:22.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.041+0000 7f370b59e700 1 -- 172.21.15.36:0/699535505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f370c0a93c0 msgr2=0x7f370c0af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:22.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.041+0000 7f370b59e700 1 --2- 172.21.15.36:0/699535505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f370c0a93c0 0x7f370c0af6a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f36fc001800 tx=0x7f37040091d0).stop 2022-01-10T01:24:22.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.041+0000 7f370b59e700 1 -- 172.21.15.36:0/699535505 shutdown_connections 2022-01-10T01:24:22.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.041+0000 7f370b59e700 1 --2- 172.21.15.36:0/699535505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f370c0a93c0 0x7f370c0af6a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:22.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.041+0000 7f370b59e700 1 -- 172.21.15.36:0/699535505 >> 172.21.15.36:0/699535505 conn(0x7f370c061140 msgr2=0x7f370c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:22.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.041+0000 7f370b59e700 1 -- 172.21.15.36:0/699535505 shutdown_connections 2022-01-10T01:24:22.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.041+0000 7f370b59e700 1 -- 172.21.15.36:0/699535505 wait complete. 2022-01-10T01:24:22.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.041+0000 7f370b59e700 1 Processor -- start 2022-01-10T01:24:22.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.041+0000 7f370b59e700 1 -- start start 2022-01-10T01:24:22.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f370c0a93c0 0x7f370c0b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:22.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370b59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f370c0ad320 0x7f370c153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:22.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f370c0af2c0 0x7f370c0ab320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:22.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370b59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c154590 con 0x7f370c0af2c0 2022-01-10T01:24:22.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370b59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c0a9b50 con 0x7f370c0ad320 2022-01-10T01:24:22.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c154050 con 0x7f370c0a93c0 2022-01-10T01:24:22.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370ad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f370c0af2c0 0x7f370c0ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:22.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370ad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f370c0af2c0 0x7f370c0ab320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33590/0 (socket says 172.21.15.36:33590) 2022-01-10T01:24:22.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370ad9d700 1 -- 172.21.15.36:0/1912732725 learned_addr learned my addr 172.21.15.36:0/1912732725 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:22.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370a59c700 1 --2- 172.21.15.36:0/1912732725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f370c0a93c0 0x7f370c0b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:22.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f3701d9b700 1 --2- 172.21.15.36:0/1912732725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f370c0ad320 0x7f370c153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:22.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370ad9d700 1 -- 172.21.15.36:0/1912732725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f370c0a93c0 msgr2=0x7f370c0b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:22.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370ad9d700 1 --2- 172.21.15.36:0/1912732725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f370c0a93c0 0x7f370c0b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:22.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370ad9d700 1 -- 172.21.15.36:0/1912732725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f370c0ad320 msgr2=0x7f370c153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:22.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370ad9d700 1 --2- 172.21.15.36:0/1912732725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f370c0ad320 0x7f370c153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:22.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370ad9d700 1 -- 172.21.15.36:0/1912732725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3704009470 con 0x7f370c0af2c0 2022-01-10T01:24:22.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370ad9d700 1 --2- 172.21.15.36:0/1912732725 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f370c0af2c0 0x7f370c0ab320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f36fc001800 tx=0x7f3704016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:22.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f3703fff700 1 -- 172.21.15.36:0/1912732725 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37040032d0 con 0x7f370c0af2c0 2022-01-10T01:24:22.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f3703fff700 1 -- 172.21.15.36:0/1912732725 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3704011b80 con 0x7f370c0af2c0 2022-01-10T01:24:22.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370b59e700 1 -- 172.21.15.36:0/1912732725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c1542f0 con 0x7f370c0af2c0 2022-01-10T01:24:22.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f3703fff700 1 -- 172.21.15.36:0/1912732725 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37040203f0 con 0x7f370c0af2c0 2022-01-10T01:24:22.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.045+0000 7f370b59e700 1 -- 172.21.15.36:0/1912732725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c153d60 con 0x7f370c0af2c0 2022-01-10T01:24:22.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.049+0000 7f370b59e700 1 -- 172.21.15.36:0/1912732725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c0ab060 con 0x7f370c0af2c0 2022-01-10T01:24:22.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.049+0000 7f3703fff700 1 -- 172.21.15.36:0/1912732725 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f370401e070 con 0x7f370c0af2c0 2022-01-10T01:24:22.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.049+0000 7f3703fff700 1 --2- 172.21.15.36:0/1912732725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f36f0053680 0x7f36f0055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:22.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.049+0000 7f3703fff700 1 -- 172.21.15.36:0/1912732725 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5863+0+0 (secure 0 0 0) 0x7f370406c420 con 0x7f370c0af2c0 2022-01-10T01:24:22.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.049+0000 7f370a59c700 1 --2- 172.21.15.36:0/1912732725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f36f0053680 0x7f36f0055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:22.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.049+0000 7f370a59c700 1 --2- 172.21.15.36:0/1912732725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f36f0053680 0x7f36f0055b40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f36fc00d000 tx=0x7f36fc001a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:22.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.057+0000 7f3703fff700 1 -- 172.21.15.36:0/1912732725 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3704043660 con 0x7f370c0af2c0 2022-01-10T01:24:22.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:22.185+0000 7f370b59e700 1 -- 172.21.15.36:0/1912732725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7f370c057350 con 0x7f370c0af2c0 2022-01-10T01:24:23.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:23.913+0000 7f3703fff700 1 -- 172.21.15.36:0/1912732725 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v22) v1 ==== 188+0+0 (secure 0 0 0) 0x7f37040150e0 con 0x7f370c0af2c0 2022-01-10T01:24:23.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:23.921+0000 7f370b59e700 1 -- 172.21.15.36:0/1912732725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f36f0053680 msgr2=0x7f36f0055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:23.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:23.921+0000 7f370b59e700 1 --2- 172.21.15.36:0/1912732725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f36f0053680 0x7f36f0055b40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f36fc00d000 tx=0x7f36fc001a00).stop 2022-01-10T01:24:23.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:23.921+0000 7f370b59e700 1 -- 172.21.15.36:0/1912732725 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f370c0af2c0 msgr2=0x7f370c0ab320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:23.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:23.921+0000 7f370b59e700 1 --2- 172.21.15.36:0/1912732725 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f370c0af2c0 0x7f370c0ab320 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f36fc001800 tx=0x7f3704016000).stop 2022-01-10T01:24:23.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:23.921+0000 7f370b59e700 1 -- 172.21.15.36:0/1912732725 shutdown_connections 2022-01-10T01:24:23.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:23.921+0000 7f370b59e700 1 --2- 172.21.15.36:0/1912732725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f36f0053680 0x7f36f0055b40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:23.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:23.921+0000 7f370b59e700 1 --2- 172.21.15.36:0/1912732725 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f370c0af2c0 0x7f370c0ab320 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:23.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:23.921+0000 7f370b59e700 1 --2- 172.21.15.36:0/1912732725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f370c0ad320 0x7f370c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:23.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:23.921+0000 7f370b59e700 1 --2- 172.21.15.36:0/1912732725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f370c0a93c0 0x7f370c0b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:23.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:23.921+0000 7f370b59e700 1 -- 172.21.15.36:0/1912732725 >> 172.21.15.36:0/1912732725 conn(0x7f370c061140 msgr2=0x7f370c13f150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:23.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:23.921+0000 7f370b59e700 1 -- 172.21.15.36:0/1912732725 shutdown_connections 2022-01-10T01:24:23.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:23.921+0000 7f370b59e700 1 -- 172.21.15.36:0/1912732725 wait complete. 2022-01-10T01:24:23.928 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' created 2022-01-10T01:24:23.939 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2022-01-10T01:24:24.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.045+0000 7f406f3d7700 1 Processor -- start 2022-01-10T01:24:24.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.045+0000 7f406f3d7700 1 -- start start 2022-01-10T01:24:24.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406f3d7700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f40680b65c0 0x7f40680b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:24.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406f3d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4068060d70 0x7f40681450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:24.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406f3d7700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40680acc90 con 0x7f40680ac5f0 2022-01-10T01:24:24.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406f3d7700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40680aca80 con 0x7f40680b65c0 2022-01-10T01:24:24.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406f3d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40680ae560 con 0x7f4068060d70 2022-01-10T01:24:24.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406d173700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f40680b65c0 0x7f40680b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:24.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406d974700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f40680ac5f0 0x7f4068141000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59626/0 (socket says 172.21.15.36:59626) 2022-01-10T01:24:24.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406d173700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f40680b65c0 0x7f40680b69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33596/0 (socket says 172.21.15.36:33596) 2022-01-10T01:24:24.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406d974700 1 -- 172.21.15.36:0/1603133505 learned_addr learned my addr 172.21.15.36:0/1603133505 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:24.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406c972700 1 --2- 172.21.15.36:0/1603133505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4068060d70 0x7f40681450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:24.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406d173700 1 -- 172.21.15.36:0/1603133505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4068060d70 msgr2=0x7f40681450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:24.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406d173700 1 --2- 172.21.15.36:0/1603133505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4068060d70 0x7f40681450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:24.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406d173700 1 -- 172.21.15.36:0/1603133505 >> v1:172.21.15.36:6789/0 conn(0x7f40680ac5f0 legacy=0x7f4068141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:24.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f4057fff700 1 -- 172.21.15.36:0/1603133505 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465081486 0 0) 0x7f40680acc90 con 0x7f40680ac5f0 2022-01-10T01:24:24.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406d173700 1 -- 172.21.15.36:0/1603133505 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40681446e0 con 0x7f40680b65c0 2022-01-10T01:24:24.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406c972700 1 --2- 172.21.15.36:0/1603133505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4068060d70 0x7f40681450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:24.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406d173700 1 --2- 172.21.15.36:0/1603133505 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f40680b65c0 0x7f40680b69a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f40680ad9e0 tx=0x7f4064006df0).ready entity=mon.0 client_cookie=7dc7db1420e29ab1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:24.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f4057fff700 1 -- 172.21.15.36:0/1603133505 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f406400d570 con 0x7f40680b65c0 2022-01-10T01:24:24.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f4057fff700 1 -- 172.21.15.36:0/1603133505 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4064000e90 con 0x7f40680b65c0 2022-01-10T01:24:24.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f4057fff700 1 -- 172.21.15.36:0/1603133505 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f406400d8c0 con 0x7f40680b65c0 2022-01-10T01:24:24.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406f3d7700 1 -- 172.21.15.36:0/1603133505 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f40680b65c0 msgr2=0x7f40680b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:24.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406f3d7700 1 --2- 172.21.15.36:0/1603133505 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f40680b65c0 0x7f40680b69a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f40680ad9e0 tx=0x7f4064006df0).stop 2022-01-10T01:24:24.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406f3d7700 1 -- 172.21.15.36:0/1603133505 shutdown_connections 2022-01-10T01:24:24.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406f3d7700 1 --2- 172.21.15.36:0/1603133505 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4068060d70 0x7f40681450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:24.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406f3d7700 1 --2- 172.21.15.36:0/1603133505 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f40680b65c0 0x7f40680b69a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:24.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.049+0000 7f406f3d7700 1 -- 172.21.15.36:0/1603133505 >> 172.21.15.36:0/1603133505 conn(0x7f40680b3480 msgr2=0x7f40680b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:24.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406f3d7700 1 -- 172.21.15.36:0/1603133505 shutdown_connections 2022-01-10T01:24:24.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406f3d7700 1 -- 172.21.15.36:0/1603133505 wait complete. 2022-01-10T01:24:24.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406f3d7700 1 Processor -- start 2022-01-10T01:24:24.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406f3d7700 1 -- start start 2022-01-10T01:24:24.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406f3d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4068060d70 0x7f406813c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:24.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406f3d7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40680ac5f0 0x7f40680ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:24.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406f3d7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f40680b65c0 0x7f40681537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:24.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406f3d7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406813c6f0 con 0x7f40680b65c0 2022-01-10T01:24:24.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406f3d7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406813c990 con 0x7f40680ac5f0 2022-01-10T01:24:24.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406f3d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4068150f70 con 0x7f4068060d70 2022-01-10T01:24:24.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406d974700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f40680b65c0 0x7f40681537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:24.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406d974700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f40680b65c0 0x7f40681537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33606/0 (socket says 172.21.15.36:33606) 2022-01-10T01:24:24.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406d974700 1 -- 172.21.15.36:0/2267672439 learned_addr learned my addr 172.21.15.36:0/2267672439 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:24.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406d173700 1 --2- 172.21.15.36:0/2267672439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4068060d70 0x7f406813c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:24.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.053+0000 7f406c972700 1 --2- 172.21.15.36:0/2267672439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40680ac5f0 0x7f40680ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:24.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f406d974700 1 -- 172.21.15.36:0/2267672439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4068060d70 msgr2=0x7f406813c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:24.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f406d974700 1 --2- 172.21.15.36:0/2267672439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4068060d70 0x7f406813c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:24.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f406d974700 1 -- 172.21.15.36:0/2267672439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40680ac5f0 msgr2=0x7f40680ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:24.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f406d974700 1 --2- 172.21.15.36:0/2267672439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40680ac5f0 0x7f40680ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:24.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f406d974700 1 -- 172.21.15.36:0/2267672439 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406400b180 con 0x7f40680b65c0 2022-01-10T01:24:24.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f406d974700 1 --2- 172.21.15.36:0/2267672439 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f40680b65c0 0x7f40681537c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f4060001250 tx=0x7f4060001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:24.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f40567fc700 1 -- 172.21.15.36:0/2267672439 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4060005ba0 con 0x7f40680b65c0 2022-01-10T01:24:24.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f40567fc700 1 -- 172.21.15.36:0/2267672439 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4060005d00 con 0x7f40680b65c0 2022-01-10T01:24:24.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f406f3d7700 1 -- 172.21.15.36:0/2267672439 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4068150c90 con 0x7f40680b65c0 2022-01-10T01:24:24.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f40567fc700 1 -- 172.21.15.36:0/2267672439 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4060004a90 con 0x7f40680b65c0 2022-01-10T01:24:24.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f406f3d7700 1 -- 172.21.15.36:0/2267672439 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406813f160 con 0x7f40680b65c0 2022-01-10T01:24:24.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f406f3d7700 1 -- 172.21.15.36:0/2267672439 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4068144980 con 0x7f40680b65c0 2022-01-10T01:24:24.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f40567fc700 1 -- 172.21.15.36:0/2267672439 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4060004bf0 con 0x7f40680b65c0 2022-01-10T01:24:24.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f40567fc700 1 --2- 172.21.15.36:0/2267672439 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f40480535f0 0x7f4048055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:24.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f40567fc700 1 -- 172.21.15.36:0/2267672439 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6315+0+0 (secure 0 0 0) 0x7f406006b510 con 0x7f40680b65c0 2022-01-10T01:24:24.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.057+0000 7f406d173700 1 --2- 172.21.15.36:0/2267672439 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f40480535f0 0x7f4048055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:24.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.061+0000 7f406d173700 1 --2- 172.21.15.36:0/2267672439 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f40480535f0 0x7f4048055ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f406401c000 tx=0x7f4064015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:24.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.065+0000 7f40567fc700 1 -- 172.21.15.36:0/2267672439 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4060042590 con 0x7f40680b65c0 2022-01-10T01:24:24.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.193+0000 7f406f3d7700 1 -- 172.21.15.36:0/2267672439 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f4068057350 con 0x7f40680b65c0 2022-01-10T01:24:24.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.917+0000 7f40567fc700 1 -- 172.21.15.36:0/2267672439 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 166+0+0 (secure 0 0 0) 0x7f4060045bb0 con 0x7f40680b65c0 2022-01-10T01:24:24.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.921+0000 7f406f3d7700 1 -- 172.21.15.36:0/2267672439 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f40480535f0 msgr2=0x7f4048055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:24.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.921+0000 7f406f3d7700 1 --2- 172.21.15.36:0/2267672439 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f40480535f0 0x7f4048055ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f406401c000 tx=0x7f4064015000).stop 2022-01-10T01:24:24.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.921+0000 7f406f3d7700 1 -- 172.21.15.36:0/2267672439 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f40680b65c0 msgr2=0x7f40681537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:24.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.921+0000 7f406f3d7700 1 --2- 172.21.15.36:0/2267672439 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f40680b65c0 0x7f40681537c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f4060001250 tx=0x7f4060001360).stop 2022-01-10T01:24:24.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.921+0000 7f406f3d7700 1 -- 172.21.15.36:0/2267672439 shutdown_connections 2022-01-10T01:24:24.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.921+0000 7f406f3d7700 1 --2- 172.21.15.36:0/2267672439 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f40480535f0 0x7f4048055ab0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:24.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.921+0000 7f406f3d7700 1 --2- 172.21.15.36:0/2267672439 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f40680b65c0 0x7f40681537c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:24.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.921+0000 7f406f3d7700 1 --2- 172.21.15.36:0/2267672439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40680ac5f0 0x7f40680ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:24.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.921+0000 7f406f3d7700 1 --2- 172.21.15.36:0/2267672439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4068060d70 0x7f406813c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:24.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.921+0000 7f406f3d7700 1 -- 172.21.15.36:0/2267672439 >> 172.21.15.36:0/2267672439 conn(0x7f40680b3480 msgr2=0x7f4068145710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:24.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.921+0000 7f406f3d7700 1 -- 172.21.15.36:0/2267672439 shutdown_connections 2022-01-10T01:24:24.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:24.921+0000 7f406f3d7700 1 -- 172.21.15.36:0/2267672439 wait complete. 2022-01-10T01:24:24.931 INFO:teuthology.orchestra.run.smithi036.stderr:set pool 4 allow_ec_overwrites to true 2022-01-10T01:24:24.940 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-10T01:24:25.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 Processor -- start 2022-01-10T01:24:25.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 -- start start 2022-01-10T01:24:25.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d80b30d0 0x7fd4d8143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd4d80ace70 0x7fd4d813f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d8143920 con 0x7fd4d80b0710 2022-01-10T01:24:25.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4d80b0af0 con 0x7fd4d80ace70 2022-01-10T01:24:25.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d80ae680 con 0x7fd4d80b30d0 2022-01-10T01:24:25.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4d7fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd4d80b0710 0x7fd4d8142d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59636/0 (socket says 172.21.15.36:59636) 2022-01-10T01:24:25.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4d7fff700 1 -- 172.21.15.36:0/1645960903 learned_addr learned my addr 172.21.15.36:0/1645960903 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:25.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dca22700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd4d80ace70 0x7fd4d813f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4d77fe700 1 --2- 172.21.15.36:0/1645960903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d80b30d0 0x7fd4d8143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4d6ffd700 1 -- 172.21.15.36:0/1645960903 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447084669 0 0) 0x7fd4d8143920 con 0x7fd4d80b0710 2022-01-10T01:24:25.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4d6ffd700 1 -- 172.21.15.36:0/1645960903 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4c4003260 con 0x7fd4d80b0710 2022-01-10T01:24:25.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dca22700 1 -- 172.21.15.36:0/1645960903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d80b30d0 msgr2=0x7fd4d8143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:25.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dca22700 1 --2- 172.21.15.36:0/1645960903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d80b30d0 0x7fd4d8143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dca22700 1 -- 172.21.15.36:0/1645960903 >> v1:172.21.15.36:6789/0 conn(0x7fd4d80b0710 legacy=0x7fd4d8142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dca22700 1 -- 172.21.15.36:0/1645960903 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d80ae920 con 0x7fd4d80ace70 2022-01-10T01:24:25.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4d77fe700 1 --2- 172.21.15.36:0/1645960903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d80b30d0 0x7fd4d8143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:25.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dca22700 1 --2- 172.21.15.36:0/1645960903 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4d80ace70 0x7fd4d813f8a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd4d00032f0 tx=0x7fd4d00091d0).ready entity=mon.0 client_cookie=ed1b23ee6d3f33ca server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:25.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4d6ffd700 1 -- 172.21.15.36:0/1645960903 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d000b6c0 con 0x7fd4d80ace70 2022-01-10T01:24:25.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4d6ffd700 1 -- 172.21.15.36:0/1645960903 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d000b820 con 0x7fd4d80ace70 2022-01-10T01:24:25.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4d6ffd700 1 -- 172.21.15.36:0/1645960903 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d000b990 con 0x7fd4d80ace70 2022-01-10T01:24:25.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 -- 172.21.15.36:0/1645960903 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4d80ace70 msgr2=0x7fd4d813f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 --2- 172.21.15.36:0/1645960903 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4d80ace70 0x7fd4d813f8a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd4d00032f0 tx=0x7fd4d00091d0).stop 2022-01-10T01:24:25.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 -- 172.21.15.36:0/1645960903 shutdown_connections 2022-01-10T01:24:25.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 --2- 172.21.15.36:0/1645960903 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4d80ace70 0x7fd4d813f8a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 --2- 172.21.15.36:0/1645960903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d80b30d0 0x7fd4d8143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 -- 172.21.15.36:0/1645960903 >> 172.21.15.36:0/1645960903 conn(0x7fd4d8061140 msgr2=0x7fd4d8062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:25.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 -- 172.21.15.36:0/1645960903 shutdown_connections 2022-01-10T01:24:25.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.041+0000 7fd4dd223700 1 -- 172.21.15.36:0/1645960903 wait complete. 2022-01-10T01:24:25.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4dd223700 1 Processor -- start 2022-01-10T01:24:25.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4dd223700 1 -- start start 2022-01-10T01:24:25.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4dd223700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d80ace70 0x7fd4d8149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4dd223700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4d80b0710 0x7fd4d8145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4dd223700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d80b30d0 0x7fd4d8145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4dd223700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d8145b10 con 0x7fd4d80b0710 2022-01-10T01:24:25.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4dd223700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d8067440 con 0x7fd4d80b30d0 2022-01-10T01:24:25.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4dd223700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d8067670 con 0x7fd4d80ace70 2022-01-10T01:24:25.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4d77fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4d80b0710 0x7fd4d8145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4d77fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4d80b0710 0x7fd4d8145130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33618/0 (socket says 172.21.15.36:33618) 2022-01-10T01:24:25.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4d77fe700 1 -- 172.21.15.36:0/2748810824 learned_addr learned my addr 172.21.15.36:0/2748810824 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:25.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4d7fff700 1 --2- 172.21.15.36:0/2748810824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d80ace70 0x7fd4d8149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4dca22700 1 --2- 172.21.15.36:0/2748810824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d80b30d0 0x7fd4d8145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4d77fe700 1 -- 172.21.15.36:0/2748810824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d80ace70 msgr2=0x7fd4d8149490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4d77fe700 1 --2- 172.21.15.36:0/2748810824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d80ace70 0x7fd4d8149490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4d77fe700 1 -- 172.21.15.36:0/2748810824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d80b30d0 msgr2=0x7fd4d8145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4d77fe700 1 --2- 172.21.15.36:0/2748810824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d80b30d0 0x7fd4d8145620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4d77fe700 1 -- 172.21.15.36:0/2748810824 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d0009470 con 0x7fd4d80b0710 2022-01-10T01:24:25.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.045+0000 7fd4d77fe700 1 --2- 172.21.15.36:0/2748810824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4d80b0710 0x7fd4d8145130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd4cc00a000 tx=0x7fd4cc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:25.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.049+0000 7fd4d57fa700 1 -- 172.21.15.36:0/2748810824 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4cc0097e0 con 0x7fd4d80b0710 2022-01-10T01:24:25.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.049+0000 7fd4d57fa700 1 -- 172.21.15.36:0/2748810824 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc009940 con 0x7fd4d80b0710 2022-01-10T01:24:25.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.049+0000 7fd4d57fa700 1 -- 172.21.15.36:0/2748810824 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4cc009ca0 con 0x7fd4d80b0710 2022-01-10T01:24:25.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.049+0000 7fd4dd223700 1 -- 172.21.15.36:0/2748810824 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d8067910 con 0x7fd4d80b0710 2022-01-10T01:24:25.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.049+0000 7fd4dd223700 1 -- 172.21.15.36:0/2748810824 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d8144c90 con 0x7fd4d80b0710 2022-01-10T01:24:25.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.049+0000 7fd4d57fa700 1 -- 172.21.15.36:0/2748810824 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd4cc011450 con 0x7fd4d80b0710 2022-01-10T01:24:25.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.049+0000 7fd4dd223700 1 -- 172.21.15.36:0/2748810824 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d8144e50 con 0x7fd4d80b0710 2022-01-10T01:24:25.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.049+0000 7fd4d57fa700 1 --2- 172.21.15.36:0/2748810824 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4b8053560 0x7fd4b8055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.049+0000 7fd4d57fa700 1 -- 172.21.15.36:0/2748810824 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6315+0+0 (secure 0 0 0) 0x7fd4cc06ddd0 con 0x7fd4d80b0710 2022-01-10T01:24:25.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.049+0000 7fd4d7fff700 1 --2- 172.21.15.36:0/2748810824 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4b8053560 0x7fd4b8055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.049+0000 7fd4d7fff700 1 --2- 172.21.15.36:0/2748810824 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4b8053560 0x7fd4b8055a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd4c800d000 tx=0x7fd4c8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:25.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.057+0000 7fd4d57fa700 1 -- 172.21.15.36:0/2748810824 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd4cc044ce0 con 0x7fd4d80b0710 2022-01-10T01:24:25.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.217+0000 7fd4dd223700 1 -- 172.21.15.36:0/2748810824 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fd4d8057350 con 0x7fd4d80b0710 2022-01-10T01:24:25.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.229+0000 7fd4d57fa700 1 -- 172.21.15.36:0/2748810824 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v5) v1 ==== 187+0+0 (secure 0 0 0) 0x7fd4cc01f070 con 0x7fd4d80b0710 2022-01-10T01:24:25.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.233+0000 7fd4dd223700 1 -- 172.21.15.36:0/2748810824 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4b8053560 msgr2=0x7fd4b8055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.233+0000 7fd4dd223700 1 --2- 172.21.15.36:0/2748810824 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4b8053560 0x7fd4b8055a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd4c800d000 tx=0x7fd4c8009040).stop 2022-01-10T01:24:25.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.233+0000 7fd4dd223700 1 -- 172.21.15.36:0/2748810824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4d80b0710 msgr2=0x7fd4d8145130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.233+0000 7fd4dd223700 1 --2- 172.21.15.36:0/2748810824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4d80b0710 0x7fd4d8145130 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fd4cc00a000 tx=0x7fd4cc008040).stop 2022-01-10T01:24:25.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.233+0000 7fd4dd223700 1 -- 172.21.15.36:0/2748810824 shutdown_connections 2022-01-10T01:24:25.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.233+0000 7fd4dd223700 1 --2- 172.21.15.36:0/2748810824 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4b8053560 0x7fd4b8055a20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.233+0000 7fd4dd223700 1 --2- 172.21.15.36:0/2748810824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4d80b30d0 0x7fd4d8145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.233+0000 7fd4dd223700 1 --2- 172.21.15.36:0/2748810824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4d80b0710 0x7fd4d8145130 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.233+0000 7fd4dd223700 1 --2- 172.21.15.36:0/2748810824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4d80ace70 0x7fd4d8149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.233+0000 7fd4dd223700 1 -- 172.21.15.36:0/2748810824 >> 172.21.15.36:0/2748810824 conn(0x7fd4d8061140 msgr2=0x7fd4d80b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:25.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.233+0000 7fd4dd223700 1 -- 172.21.15.36:0/2748810824 shutdown_connections 2022-01-10T01:24:25.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.233+0000 7fd4dd223700 1 -- 172.21.15.36:0/2748810824 wait complete. 2022-01-10T01:24:25.245 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 3 and data pool 4 2022-01-10T01:24:25.251 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:25.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ffa049c1700 1 Processor -- start 2022-01-10T01:24:25.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ffa049c1700 1 -- start start 2022-01-10T01:24:25.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ffa049c1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ffa000a9c10 0x7ffa000607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ffa049c1700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa00066ea0 con 0x7ffa00140140 2022-01-10T01:24:25.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ffa049c1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa000b3420 con 0x7ffa000b3040 2022-01-10T01:24:25.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ffa049c1700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa000648e0 con 0x7ffa000a9c10 2022-01-10T01:24:25.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ff9feffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ffa000a9c10 0x7ffa000607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ff9feffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ffa000a9c10 0x7ffa000607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33636/0 (socket says 172.21.15.36:33636) 2022-01-10T01:24:25.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ff9feffd700 1 -- 172.21.15.36:0/2474794359 learned_addr learned my addr 172.21.15.36:0/2474794359 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:25.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ff9fffff700 1 --1- 172.21.15.36:0/2474794359 >> v1:172.21.15.36:6789/0 conn(0x7ffa00140140 0x7ffa00140590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59664/0 (socket says 172.21.15.36:59664) 2022-01-10T01:24:25.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ff9feffd700 1 -- 172.21.15.36:0/2474794359 >> v1:172.21.15.59:6789/0 conn(0x7ffa000b3040 legacy=0x7ffa00065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ff9feffd700 1 -- 172.21.15.36:0/2474794359 >> v1:172.21.15.36:6789/0 conn(0x7ffa00140140 legacy=0x7ffa00140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ff9feffd700 1 -- 172.21.15.36:0/2474794359 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa00066960 con 0x7ffa000a9c10 2022-01-10T01:24:25.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ff9feffd700 1 --2- 172.21.15.36:0/2474794359 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa000a9c10 0x7ffa000607c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff9f4002f70 tx=0x7ff9f4006eb0).ready entity=mon.0 client_cookie=42453c99160719cd server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:25.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ff9fe7fc700 1 -- 172.21.15.36:0/2474794359 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f400d660 con 0x7ffa000a9c10 2022-01-10T01:24:25.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ff9fe7fc700 1 -- 172.21.15.36:0/2474794359 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f4000e90 con 0x7ffa000a9c10 2022-01-10T01:24:25.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ff9fe7fc700 1 -- 172.21.15.36:0/2474794359 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f400d9f0 con 0x7ffa000a9c10 2022-01-10T01:24:25.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ffa049c1700 1 -- 172.21.15.36:0/2474794359 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa000a9c10 msgr2=0x7ffa000607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.345+0000 7ffa049c1700 1 --2- 172.21.15.36:0/2474794359 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa000a9c10 0x7ffa000607c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff9f4002f70 tx=0x7ff9f4006eb0).stop 2022-01-10T01:24:25.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.349+0000 7ffa049c1700 1 -- 172.21.15.36:0/2474794359 shutdown_connections 2022-01-10T01:24:25.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.349+0000 7ffa049c1700 1 --2- 172.21.15.36:0/2474794359 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa000a9c10 0x7ffa000607c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.349+0000 7ffa049c1700 1 -- 172.21.15.36:0/2474794359 >> 172.21.15.36:0/2474794359 conn(0x7ffa000636e0 msgr2=0x7ffa00063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:25.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.349+0000 7ffa049c1700 1 -- 172.21.15.36:0/2474794359 shutdown_connections 2022-01-10T01:24:25.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.349+0000 7ffa049c1700 1 -- 172.21.15.36:0/2474794359 wait complete. 2022-01-10T01:24:25.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.349+0000 7ffa049c1700 1 Processor -- start 2022-01-10T01:24:25.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.349+0000 7ffa049c1700 1 -- start start 2022-01-10T01:24:25.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.349+0000 7ffa049c1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa000a9c10 0x7ffa000ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.349+0000 7ffa049c1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa000b3040 0x7ffa000abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.349+0000 7ffa049c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa00140140 0x7ffa0014f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.349+0000 7ffa049c1700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa001434a0 con 0x7ffa000b3040 2022-01-10T01:24:25.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.349+0000 7ffa049c1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa000aced0 con 0x7ffa000a9c10 2022-01-10T01:24:25.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ffa049c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0014f1a0 con 0x7ffa00140140 2022-01-10T01:24:25.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9feffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa000b3040 0x7ffa000abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9feffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa000b3040 0x7ffa000abf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33642/0 (socket says 172.21.15.36:33642) 2022-01-10T01:24:25.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9feffd700 1 -- 172.21.15.36:0/3178228075 learned_addr learned my addr 172.21.15.36:0/3178228075 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:25.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9ff7fe700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa000a9c10 0x7ffa000ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9fffff700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa00140140 0x7ffa0014f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9feffd700 1 -- 172.21.15.36:0/3178228075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa00140140 msgr2=0x7ffa0014f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9feffd700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa00140140 0x7ffa0014f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9feffd700 1 -- 172.21.15.36:0/3178228075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa000a9c10 msgr2=0x7ffa000ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9feffd700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa000a9c10 0x7ffa000ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9feffd700 1 -- 172.21.15.36:0/3178228075 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f400b1e0 con 0x7ffa000b3040 2022-01-10T01:24:25.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9ff7fe700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa000a9c10 0x7ffa000ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:25.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9feffd700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa000b3040 0x7ffa000abf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ff9f4002f70 tx=0x7ff9f4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:25.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9fcff9700 1 -- 172.21.15.36:0/3178228075 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f400d9e0 con 0x7ffa000b3040 2022-01-10T01:24:25.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9fcff9700 1 -- 172.21.15.36:0/3178228075 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f4011ca0 con 0x7ffa000b3040 2022-01-10T01:24:25.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ffa049c1700 1 -- 172.21.15.36:0/3178228075 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0014f440 con 0x7ffa000b3040 2022-01-10T01:24:25.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9fcff9700 1 -- 172.21.15.36:0/3178228075 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f401e460 con 0x7ffa000b3040 2022-01-10T01:24:25.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ffa049c1700 1 -- 172.21.15.36:0/3178228075 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0014fdd0 con 0x7ffa000b3040 2022-01-10T01:24:25.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9fcff9700 1 -- 172.21.15.36:0/3178228075 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff9f4025030 con 0x7ffa000b3040 2022-01-10T01:24:25.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ffa049c1700 1 -- 172.21.15.36:0/3178228075 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa000acc90 con 0x7ffa000b3040 2022-01-10T01:24:25.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9fcff9700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e00534d0 0x7ff9e0055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9fcff9700 1 -- 172.21.15.36:0/3178228075 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff9f406ce80 con 0x7ffa000b3040 2022-01-10T01:24:25.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.353+0000 7ff9ff7fe700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e00534d0 0x7ff9e0055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.357+0000 7ff9ff7fe700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e00534d0 0x7ff9e0055990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff9f000b000 tx=0x7ff9f0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:25.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.357+0000 7ff9fcff9700 1 -- 172.21.15.36:0/3178228075 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffa000acc90 con 0x7ffa000b3040 2022-01-10T01:24:25.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.481+0000 7ffa049c1700 1 -- 172.21.15.36:0/3178228075 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa000acc90 con 0x7ffa000b3040 2022-01-10T01:24:25.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.485+0000 7ff9fcff9700 1 -- 172.21.15.36:0/3178228075 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16299 (secure 0 0 0) 0x7ffa000acc90 con 0x7ffa000b3040 2022-01-10T01:24:25.490 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:25.491 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:25.224959+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:24:20.202898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-10T01:24:22.952870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:25.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.485+0000 7ffa049c1700 1 -- 172.21.15.36:0/3178228075 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e00534d0 msgr2=0x7ff9e0055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.485+0000 7ffa049c1700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e00534d0 0x7ff9e0055990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff9f000b000 tx=0x7ff9f0009040).stop 2022-01-10T01:24:25.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.485+0000 7ffa049c1700 1 -- 172.21.15.36:0/3178228075 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa000b3040 msgr2=0x7ffa000abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.485+0000 7ffa049c1700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa000b3040 0x7ffa000abf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ff9f4002f70 tx=0x7ff9f4015000).stop 2022-01-10T01:24:25.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.485+0000 7ffa049c1700 1 -- 172.21.15.36:0/3178228075 shutdown_connections 2022-01-10T01:24:25.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.485+0000 7ffa049c1700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e00534d0 0x7ff9e0055990 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.485+0000 7ffa049c1700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa00140140 0x7ffa0014f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.485+0000 7ffa049c1700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa000b3040 0x7ffa000abf30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.485+0000 7ffa049c1700 1 --2- 172.21.15.36:0/3178228075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa000a9c10 0x7ffa000ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.485+0000 7ffa049c1700 1 -- 172.21.15.36:0/3178228075 >> 172.21.15.36:0/3178228075 conn(0x7ffa000636e0 msgr2=0x7ffa000b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:25.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.489+0000 7ffa049c1700 1 -- 172.21.15.36:0/3178228075 shutdown_connections 2022-01-10T01:24:25.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.489+0000 7ffa049c1700 1 -- 172.21.15.36:0/3178228075 wait complete. 2022-01-10T01:24:25.509 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:25.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.601+0000 7fd7fe6af700 1 Processor -- start 2022-01-10T01:24:25.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.601+0000 7fd7fe6af700 1 -- start start 2022-01-10T01:24:25.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.601+0000 7fd7fe6af700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd7f80b1260 0x7fd7f80afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.601+0000 7fd7fe6af700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f80add80 con 0x7fd7f80b1790 2022-01-10T01:24:25.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.601+0000 7fd7fe6af700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f80ae020 con 0x7fd7f80b2580 2022-01-10T01:24:25.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.601+0000 7fd7fe6af700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f80a9390 con 0x7fd7f80b1260 2022-01-10T01:24:25.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.601+0000 7fd7fdeae700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd7f80b1790 0x7fd7f814a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59678/0 (socket says 172.21.15.36:59678) 2022-01-10T01:24:25.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.601+0000 7fd7fdeae700 1 -- 172.21.15.36:0/4273816606 learned_addr learned my addr 172.21.15.36:0/4273816606 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:25.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.601+0000 7fd7fceac700 1 --2- 172.21.15.36:0/4273816606 >> v2:172.21.15.59:3300/0 conn(0x7fd7f80b1260 0x7fd7f80afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.601+0000 7fd7e7fff700 1 -- 172.21.15.36:0/4273816606 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361204656 0 0) 0x7fd7f80add80 con 0x7fd7f80b1790 2022-01-10T01:24:25.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.601+0000 7fd7e7fff700 1 -- 172.21.15.36:0/4273816606 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7e0003260 con 0x7fd7f80b1790 2022-01-10T01:24:25.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.601+0000 7fd7e7fff700 1 -- 172.21.15.36:0/4273816606 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427505371 0 0) 0x7fd7f80ae020 con 0x7fd7f80b2580 2022-01-10T01:24:25.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.601+0000 7fd7e7fff700 1 -- 172.21.15.36:0/4273816606 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f80add80 con 0x7fd7f80b2580 2022-01-10T01:24:25.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7fceac700 1 -- 172.21.15.36:0/4273816606 >> v1:172.21.15.59:6789/0 conn(0x7fd7f80b2580 legacy=0x7fd7f80abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7fceac700 1 -- 172.21.15.36:0/4273816606 >> v1:172.21.15.36:6789/0 conn(0x7fd7f80b1790 legacy=0x7fd7f814a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7fceac700 1 -- 172.21.15.36:0/4273816606 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80a9830 con 0x7fd7f80b1260 2022-01-10T01:24:25.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7fceac700 1 --2- 172.21.15.36:0/4273816606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f80b1260 0x7fd7f80afbd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd7e8002f70 tx=0x7fd7e8006df0).ready entity=mon.1 client_cookie=abcfd6c784fee998 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:25.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7e7fff700 1 -- 172.21.15.36:0/4273816606 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e800d540 con 0x7fd7f80b1260 2022-01-10T01:24:25.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7e7fff700 1 -- 172.21.15.36:0/4273816606 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e8000e90 con 0x7fd7f80b1260 2022-01-10T01:24:25.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7e7fff700 1 -- 172.21.15.36:0/4273816606 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e800d890 con 0x7fd7f80b1260 2022-01-10T01:24:25.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7fe6af700 1 -- 172.21.15.36:0/4273816606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f80b1260 msgr2=0x7fd7f80afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7fe6af700 1 --2- 172.21.15.36:0/4273816606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f80b1260 0x7fd7f80afbd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fd7e8002f70 tx=0x7fd7e8006df0).stop 2022-01-10T01:24:25.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7fe6af700 1 -- 172.21.15.36:0/4273816606 shutdown_connections 2022-01-10T01:24:25.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7fe6af700 1 --2- 172.21.15.36:0/4273816606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f80b1260 0x7fd7f80afbd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7fe6af700 1 -- 172.21.15.36:0/4273816606 >> 172.21.15.36:0/4273816606 conn(0x7fd7f8060180 msgr2=0x7fd7f80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:25.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7fe6af700 1 -- 172.21.15.36:0/4273816606 shutdown_connections 2022-01-10T01:24:25.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7fe6af700 1 -- 172.21.15.36:0/4273816606 wait complete. 2022-01-10T01:24:25.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.605+0000 7fd7fe6af700 1 Processor -- start 2022-01-10T01:24:25.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fe6af700 1 -- start start 2022-01-10T01:24:25.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fe6af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7f80b1260 0x7fd7f8138940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fe6af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f80b1790 0x7fd7f81354b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fe6af700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7f80b2580 0x7fd7f81359a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fe6af700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f813c000 con 0x7fd7f80b2580 2022-01-10T01:24:25.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fe6af700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80667e0 con 0x7fd7f80b1790 2022-01-10T01:24:25.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fe6af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80655e0 con 0x7fd7f80b1260 2022-01-10T01:24:25.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fdeae700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7f80b2580 0x7fd7f81359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fdeae700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7f80b2580 0x7fd7f81359a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33658/0 (socket says 172.21.15.36:33658) 2022-01-10T01:24:25.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fdeae700 1 -- 172.21.15.36:0/1099188464 learned_addr learned my addr 172.21.15.36:0/1099188464 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:25.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fceac700 1 --2- 172.21.15.36:0/1099188464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f80b1790 0x7fd7f81354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fd6ad700 1 --2- 172.21.15.36:0/1099188464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7f80b1260 0x7fd7f8138940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fdeae700 1 -- 172.21.15.36:0/1099188464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7f80b1260 msgr2=0x7fd7f8138940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fdeae700 1 --2- 172.21.15.36:0/1099188464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7f80b1260 0x7fd7f8138940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fdeae700 1 -- 172.21.15.36:0/1099188464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f80b1790 msgr2=0x7fd7f81354b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fdeae700 1 --2- 172.21.15.36:0/1099188464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f80b1790 0x7fd7f81354b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fdeae700 1 -- 172.21.15.36:0/1099188464 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e800b180 con 0x7fd7f80b2580 2022-01-10T01:24:25.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fdeae700 1 --2- 172.21.15.36:0/1099188464 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7f80b2580 0x7fd7f81359a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd7f0001490 tx=0x7fd7f0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:25.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7e67fc700 1 -- 172.21.15.36:0/1099188464 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f0005c70 con 0x7fd7f80b2580 2022-01-10T01:24:25.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7e67fc700 1 -- 172.21.15.36:0/1099188464 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f0005dd0 con 0x7fd7f80b2580 2022-01-10T01:24:25.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fe6af700 1 -- 172.21.15.36:0/1099188464 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f8066cd0 con 0x7fd7f80b2580 2022-01-10T01:24:25.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7e67fc700 1 -- 172.21.15.36:0/1099188464 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f00072c0 con 0x7fd7f80b2580 2022-01-10T01:24:25.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.609+0000 7fd7fe6af700 1 -- 172.21.15.36:0/1099188464 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f813d810 con 0x7fd7f80b2580 2022-01-10T01:24:25.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.613+0000 7fd7fe6af700 1 -- 172.21.15.36:0/1099188464 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f8057350 con 0x7fd7f80b2580 2022-01-10T01:24:25.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.613+0000 7fd7e67fc700 1 -- 172.21.15.36:0/1099188464 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd7f0010070 con 0x7fd7f80b2580 2022-01-10T01:24:25.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.613+0000 7fd7e67fc700 1 --2- 172.21.15.36:0/1099188464 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd7d80535f0 0x7fd7d8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.613+0000 7fd7e67fc700 1 -- 172.21.15.36:0/1099188464 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd7f006b560 con 0x7fd7f80b2580 2022-01-10T01:24:25.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.613+0000 7fd7fd6ad700 1 --2- 172.21.15.36:0/1099188464 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd7d80535f0 0x7fd7d8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.613+0000 7fd7fd6ad700 1 --2- 172.21.15.36:0/1099188464 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd7d80535f0 0x7fd7d8055ab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd7f400d000 tx=0x7fd7f4007a20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:25.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.617+0000 7fd7e67fc700 1 -- 172.21.15.36:0/1099188464 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd7f0042570 con 0x7fd7f80b2580 2022-01-10T01:24:25.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.749+0000 7fd7fe6af700 1 -- 172.21.15.36:0/1099188464 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7f80698e0 con 0x7fd7f80b2580 2022-01-10T01:24:25.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.753+0000 7fd7e67fc700 1 -- 172.21.15.36:0/1099188464 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fd7f0045b90 con 0x7fd7f80b2580 2022-01-10T01:24:25.758 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:25.759 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:25.224959+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:24:20.202898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-10T01:24:22.952870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:25.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.753+0000 7fd7fe6af700 1 -- 172.21.15.36:0/1099188464 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd7d80535f0 msgr2=0x7fd7d8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.753+0000 7fd7fe6af700 1 --2- 172.21.15.36:0/1099188464 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd7d80535f0 0x7fd7d8055ab0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd7f400d000 tx=0x7fd7f4007a20).stop 2022-01-10T01:24:25.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.753+0000 7fd7fe6af700 1 -- 172.21.15.36:0/1099188464 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7f80b2580 msgr2=0x7fd7f81359a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.753+0000 7fd7fe6af700 1 --2- 172.21.15.36:0/1099188464 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7f80b2580 0x7fd7f81359a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd7f0001490 tx=0x7fd7f0007e00).stop 2022-01-10T01:24:25.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.753+0000 7fd7fe6af700 1 -- 172.21.15.36:0/1099188464 shutdown_connections 2022-01-10T01:24:25.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.753+0000 7fd7fe6af700 1 --2- 172.21.15.36:0/1099188464 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd7d80535f0 0x7fd7d8055ab0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.753+0000 7fd7fe6af700 1 --2- 172.21.15.36:0/1099188464 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7f80b2580 0x7fd7f81359a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.753+0000 7fd7fe6af700 1 --2- 172.21.15.36:0/1099188464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7f80b1790 0x7fd7f81354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.753+0000 7fd7fe6af700 1 --2- 172.21.15.36:0/1099188464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7f80b1260 0x7fd7f8138940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.753+0000 7fd7fe6af700 1 -- 172.21.15.36:0/1099188464 >> 172.21.15.36:0/1099188464 conn(0x7fd7f8060180 msgr2=0x7fd7f80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:25.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.757+0000 7fd7fe6af700 1 -- 172.21.15.36:0/1099188464 shutdown_connections 2022-01-10T01:24:25.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.757+0000 7fd7fe6af700 1 -- 172.21.15.36:0/1099188464 wait complete. 2022-01-10T01:24:25.771 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-01-10T01:24:25.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.877+0000 7ff2dd88c700 1 Processor -- start 2022-01-10T01:24:25.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.877+0000 7ff2dd88c700 1 -- start start 2022-01-10T01:24:25.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.877+0000 7ff2dd88c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d80b03e0 0x7ff2d80aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.877+0000 7ff2dd88c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff2d813f8b0 0x7ff2d813fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.877+0000 7ff2dd88c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d80af480 con 0x7ff2d80ad4e0 2022-01-10T01:24:25.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.877+0000 7ff2dd88c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d80b0ab0 con 0x7ff2d813f8b0 2022-01-10T01:24:25.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.877+0000 7ff2dd88c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80b0d50 con 0x7ff2d80b03e0 2022-01-10T01:24:25.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.877+0000 7ff2dd08b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff2d813f8b0 0x7ff2d813fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.877+0000 7ff2dd08b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff2d813f8b0 0x7ff2d813fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33666/0 (socket says 172.21.15.36:33666) 2022-01-10T01:24:25.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.877+0000 7ff2dd08b700 1 -- 172.21.15.36:0/666150917 learned_addr learned my addr 172.21.15.36:0/666150917 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:25.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.877+0000 7ff2d7fff700 1 --2- 172.21.15.36:0/666150917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d80b03e0 0x7ff2d80aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2d77fe700 1 -- 172.21.15.36:0/666150917 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 538689733 0 0) 0x7ff2c0001110 con 0x7ff2d80ad4e0 2022-01-10T01:24:25.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd08b700 1 -- 172.21.15.36:0/666150917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d80b03e0 msgr2=0x7ff2d80aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:25.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd08b700 1 --2- 172.21.15.36:0/666150917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d80b03e0 0x7ff2d80aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd08b700 1 -- 172.21.15.36:0/666150917 >> v1:172.21.15.59:6789/0 conn(0x7ff2d80ad4e0 legacy=0x7ff2d80b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd08b700 1 -- 172.21.15.36:0/666150917 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80ae850 con 0x7ff2d813f8b0 2022-01-10T01:24:25.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd08b700 1 --2- 172.21.15.36:0/666150917 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2d813f8b0 0x7ff2d813fd40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff2d00032f0 tx=0x7ff2d000b530).ready entity=mon.0 client_cookie=f4a34f3448c08fc0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:25.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2d77fe700 1 -- 172.21.15.36:0/666150917 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2d000de20 con 0x7ff2d813f8b0 2022-01-10T01:24:25.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2d77fe700 1 -- 172.21.15.36:0/666150917 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d0010470 con 0x7ff2d813f8b0 2022-01-10T01:24:25.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2d77fe700 1 -- 172.21.15.36:0/666150917 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2d00107d0 con 0x7ff2d813f8b0 2022-01-10T01:24:25.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd88c700 1 -- 172.21.15.36:0/666150917 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2d813f8b0 msgr2=0x7ff2d813fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd88c700 1 --2- 172.21.15.36:0/666150917 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2d813f8b0 0x7ff2d813fd40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff2d00032f0 tx=0x7ff2d000b530).stop 2022-01-10T01:24:25.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd88c700 1 -- 172.21.15.36:0/666150917 shutdown_connections 2022-01-10T01:24:25.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd88c700 1 --2- 172.21.15.36:0/666150917 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2d813f8b0 0x7ff2d813fd40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd88c700 1 --2- 172.21.15.36:0/666150917 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d80b03e0 0x7ff2d80aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd88c700 1 -- 172.21.15.36:0/666150917 >> 172.21.15.36:0/666150917 conn(0x7ff2d80611d0 msgr2=0x7ff2d8062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:25.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd88c700 1 -- 172.21.15.36:0/666150917 shutdown_connections 2022-01-10T01:24:25.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd88c700 1 -- 172.21.15.36:0/666150917 wait complete. 2022-01-10T01:24:25.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd88c700 1 Processor -- start 2022-01-10T01:24:25.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.881+0000 7ff2dd88c700 1 -- start start 2022-01-10T01:24:25.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2dd88c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d80ad4e0 0x7ff2d813e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2dd88c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2d80b03e0 0x7ff2d8151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2dd88c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d813f8b0 0x7ff2d8151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2dd88c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80ac880 con 0x7ff2d80b03e0 2022-01-10T01:24:25.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2dd88c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80abe00 con 0x7ff2d813f8b0 2022-01-10T01:24:25.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2dd88c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80ac0a0 con 0x7ff2d80ad4e0 2022-01-10T01:24:25.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2d7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2d80b03e0 0x7ff2d8151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2d7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2d80b03e0 0x7ff2d8151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33670/0 (socket says 172.21.15.36:33670) 2022-01-10T01:24:25.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2d7fff700 1 -- 172.21.15.36:0/4197832536 learned_addr learned my addr 172.21.15.36:0/4197832536 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:25.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2dc88a700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d80ad4e0 0x7ff2d813e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2dd08b700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d813f8b0 0x7ff2d8151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2d7fff700 1 -- 172.21.15.36:0/4197832536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d80ad4e0 msgr2=0x7ff2d813e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2d7fff700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d80ad4e0 0x7ff2d813e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2d7fff700 1 -- 172.21.15.36:0/4197832536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d813f8b0 msgr2=0x7ff2d8151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:25.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2d7fff700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d813f8b0 0x7ff2d8151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:25.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2d7fff700 1 -- 172.21.15.36:0/4197832536 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d000b7d0 con 0x7ff2d80b03e0 2022-01-10T01:24:25.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2dd08b700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d813f8b0 0x7ff2d8151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:25.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2d7fff700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2d80b03e0 0x7ff2d8151720 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff2c800c000 tx=0x7ff2c8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:25.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2d5ffb700 1 -- 172.21.15.36:0/4197832536 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2c8010780 con 0x7ff2d80b03e0 2022-01-10T01:24:25.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2d5ffb700 1 -- 172.21.15.36:0/4197832536 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c80108e0 con 0x7ff2d80b03e0 2022-01-10T01:24:25.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2dd88c700 1 -- 172.21.15.36:0/4197832536 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d80ac340 con 0x7ff2d80b03e0 2022-01-10T01:24:25.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2d5ffb700 1 -- 172.21.15.36:0/4197832536 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2c8010c40 con 0x7ff2d80b03e0 2022-01-10T01:24:25.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2dd88c700 1 -- 172.21.15.36:0/4197832536 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d8152100 con 0x7ff2d80b03e0 2022-01-10T01:24:25.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.885+0000 7ff2dd88c700 1 -- 172.21.15.36:0/4197832536 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d80aeaf0 con 0x7ff2d80b03e0 2022-01-10T01:24:25.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.889+0000 7ff2d5ffb700 1 -- 172.21.15.36:0/4197832536 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff2c8026430 con 0x7ff2d80b03e0 2022-01-10T01:24:25.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.889+0000 7ff2d5ffb700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2bc053680 0x7ff2bc055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:25.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.889+0000 7ff2d5ffb700 1 -- 172.21.15.36:0/4197832536 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff2c806c980 con 0x7ff2d80b03e0 2022-01-10T01:24:25.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.889+0000 7ff2dc88a700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2bc053680 0x7ff2bc055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:25.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.889+0000 7ff2dc88a700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2bc053680 0x7ff2bc055b40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff2c000d000 tx=0x7ff2c0001790).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:25.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:25.893+0000 7ff2d5ffb700 1 -- 172.21.15.36:0/4197832536 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2c8043930 con 0x7ff2d80b03e0 2022-01-10T01:24:26.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:26.057+0000 7ff2dd88c700 1 -- 172.21.15.36:0/4197832536 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff2d8057350 con 0x7ff2d80b03e0 2022-01-10T01:24:26.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:26.989+0000 7ff2d5ffb700 1 -- 172.21.15.36:0/4197832536 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff2c8046f50 con 0x7ff2d80b03e0 2022-01-10T01:24:26.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:26.989+0000 7ff2dd88c700 1 -- 172.21.15.36:0/4197832536 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2bc053680 msgr2=0x7ff2bc055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:26.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:26.989+0000 7ff2dd88c700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2bc053680 0x7ff2bc055b40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff2c000d000 tx=0x7ff2c0001790).stop 2022-01-10T01:24:26.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:26.989+0000 7ff2dd88c700 1 -- 172.21.15.36:0/4197832536 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2d80b03e0 msgr2=0x7ff2d8151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:26.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:26.989+0000 7ff2dd88c700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2d80b03e0 0x7ff2d8151720 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7ff2c800c000 tx=0x7ff2c8006df0).stop 2022-01-10T01:24:26.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:26.989+0000 7ff2dd88c700 1 -- 172.21.15.36:0/4197832536 shutdown_connections 2022-01-10T01:24:26.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:26.993+0000 7ff2dd88c700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2bc053680 0x7ff2bc055b40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:26.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:26.993+0000 7ff2dd88c700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d813f8b0 0x7ff2d8151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:26.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:26.993+0000 7ff2dd88c700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2d80b03e0 0x7ff2d8151720 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:26.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:26.993+0000 7ff2dd88c700 1 --2- 172.21.15.36:0/4197832536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2d80ad4e0 0x7ff2d813e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:26.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:26.993+0000 7ff2dd88c700 1 -- 172.21.15.36:0/4197832536 >> 172.21.15.36:0/4197832536 conn(0x7ff2d80611d0 msgr2=0x7ff2d813fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:26.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:26.993+0000 7ff2dd88c700 1 -- 172.21.15.36:0/4197832536 shutdown_connections 2022-01-10T01:24:26.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:26.993+0000 7ff2dd88c700 1 -- 172.21.15.36:0/4197832536 wait complete. 2022-01-10T01:24:27.013 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:24:27.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.113+0000 7f76a7fff700 1 Processor -- start 2022-01-10T01:24:27.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.113+0000 7f76a7fff700 1 -- start start 2022-01-10T01:24:27.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f76a80665f0 0x7f76a80669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a7fff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a805f750 con 0x7f76a8140cb0 2022-01-10T01:24:27.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a7fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a80b14a0 con 0x7f76a80b1a30 2022-01-10T01:24:27.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a7fff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a805f980 con 0x7f76a80665f0 2022-01-10T01:24:27.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a77fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f76a8140cb0 0x7f76a813e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59706/0 (socket says 172.21.15.36:59706) 2022-01-10T01:24:27.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a77fe700 1 -- 172.21.15.36:0/2020107254 learned_addr learned my addr 172.21.15.36:0/2020107254 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:27.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a6ffd700 1 --2- 172.21.15.36:0/2020107254 >> v2:172.21.15.59:3300/0 conn(0x7f76a80665f0 0x7f76a80669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a5ffb700 1 -- 172.21.15.36:0/2020107254 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108168376 0 0) 0x7f76a805f750 con 0x7f76a8140cb0 2022-01-10T01:24:27.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a5ffb700 1 -- 172.21.15.36:0/2020107254 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f768c003260 con 0x7f76a8140cb0 2022-01-10T01:24:27.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a5ffb700 1 -- 172.21.15.36:0/2020107254 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474811439 0 0) 0x7f76a80b14a0 con 0x7f76a80b1a30 2022-01-10T01:24:27.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a5ffb700 1 -- 172.21.15.36:0/2020107254 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76a805f750 con 0x7f76a80b1a30 2022-01-10T01:24:27.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a5ffb700 1 -- 172.21.15.36:0/2020107254 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1149104583 0 0) 0x7f768c003260 con 0x7f76a8140cb0 2022-01-10T01:24:27.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a6ffd700 1 -- 172.21.15.36:0/2020107254 >> v1:172.21.15.59:6789/0 conn(0x7f76a80b1a30 legacy=0x7f76a805fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a6ffd700 1 -- 172.21.15.36:0/2020107254 >> v1:172.21.15.36:6789/0 conn(0x7f76a8140cb0 legacy=0x7f76a813e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a6ffd700 1 -- 172.21.15.36:0/2020107254 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a80b1740 con 0x7f76a80665f0 2022-01-10T01:24:27.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a6ffd700 1 --2- 172.21.15.36:0/2020107254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76a80665f0 0x7f76a80669d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f76a0001490 tx=0x7f769c006df0).ready entity=mon.1 client_cookie=e8b8ead1e5a1178e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:27.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a5ffb700 1 -- 172.21.15.36:0/2020107254 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76a00019e0 con 0x7f76a80665f0 2022-01-10T01:24:27.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a5ffb700 1 -- 172.21.15.36:0/2020107254 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c000e90 con 0x7f76a80665f0 2022-01-10T01:24:27.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a5ffb700 1 -- 172.21.15.36:0/2020107254 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f769c012460 con 0x7f76a80665f0 2022-01-10T01:24:27.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a7fff700 1 -- 172.21.15.36:0/2020107254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76a80665f0 msgr2=0x7f76a80669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a7fff700 1 --2- 172.21.15.36:0/2020107254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76a80665f0 0x7f76a80669d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f76a0001490 tx=0x7f769c006df0).stop 2022-01-10T01:24:27.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a7fff700 1 -- 172.21.15.36:0/2020107254 shutdown_connections 2022-01-10T01:24:27.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a7fff700 1 --2- 172.21.15.36:0/2020107254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76a80665f0 0x7f76a80669d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a7fff700 1 -- 172.21.15.36:0/2020107254 >> 172.21.15.36:0/2020107254 conn(0x7f76a80636e0 msgr2=0x7f76a8063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:27.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a7fff700 1 -- 172.21.15.36:0/2020107254 shutdown_connections 2022-01-10T01:24:27.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.117+0000 7f76a7fff700 1 -- 172.21.15.36:0/2020107254 wait complete. 2022-01-10T01:24:27.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a7fff700 1 Processor -- start 2022-01-10T01:24:27.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a7fff700 1 -- start start 2022-01-10T01:24:27.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76a80665f0 0x7f76a813c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76a80b1a30 0x7f76a8152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76a8140cb0 0x7f76a8144830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a7fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8142600 con 0x7f76a80b1a30 2022-01-10T01:24:27.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a7fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8141e20 con 0x7f76a8140cb0 2022-01-10T01:24:27.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a7fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a81420c0 con 0x7f76a80665f0 2022-01-10T01:24:27.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a67fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76a80b1a30 0x7f76a8152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a67fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76a80b1a30 0x7f76a8152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33684/0 (socket says 172.21.15.36:33684) 2022-01-10T01:24:27.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a67fc700 1 -- 172.21.15.36:0/34323629 learned_addr learned my addr 172.21.15.36:0/34323629 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:27.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a77fe700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76a8140cb0 0x7f76a8144830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a6ffd700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76a80665f0 0x7f76a813c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a67fc700 1 -- 172.21.15.36:0/34323629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76a80665f0 msgr2=0x7f76a813c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a67fc700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76a80665f0 0x7f76a813c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a67fc700 1 -- 172.21.15.36:0/34323629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76a8140cb0 msgr2=0x7f76a8144830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a67fc700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76a8140cb0 0x7f76a8144830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a67fc700 1 -- 172.21.15.36:0/34323629 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c00b180 con 0x7f76a80b1a30 2022-01-10T01:24:27.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a77fe700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76a8140cb0 0x7f76a8144830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:27.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a67fc700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76a80b1a30 0x7f76a8152a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f7698001110 tx=0x7f7698007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:27.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f7697fff700 1 -- 172.21.15.36:0/34323629 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f769800f470 con 0x7f76a80b1a30 2022-01-10T01:24:27.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f7697fff700 1 -- 172.21.15.36:0/34323629 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769800f5d0 con 0x7f76a80b1a30 2022-01-10T01:24:27.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f7697fff700 1 -- 172.21.15.36:0/34323629 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f769800f930 con 0x7f76a80b1a30 2022-01-10T01:24:27.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a7fff700 1 -- 172.21.15.36:0/34323629 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a8142360 con 0x7f76a80b1a30 2022-01-10T01:24:27.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.121+0000 7f76a7fff700 1 -- 172.21.15.36:0/34323629 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a8141b10 con 0x7f76a80b1a30 2022-01-10T01:24:27.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.125+0000 7f7697fff700 1 -- 172.21.15.36:0/34323629 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7698019030 con 0x7f76a80b1a30 2022-01-10T01:24:27.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.125+0000 7f76a7fff700 1 -- 172.21.15.36:0/34323629 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a80b1120 con 0x7f76a80b1a30 2022-01-10T01:24:27.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.125+0000 7f7697fff700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f76840535f0 0x7f7684055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.125+0000 7f7697fff700 1 -- 172.21.15.36:0/34323629 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f769806b100 con 0x7f76a80b1a30 2022-01-10T01:24:27.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.125+0000 7f76a6ffd700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f76840535f0 0x7f7684055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.125+0000 7f76a6ffd700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f76840535f0 0x7f7684055ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f769c018000 tx=0x7f769c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:27.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.129+0000 7f7697fff700 1 -- 172.21.15.36:0/34323629 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7698042000 con 0x7f76a80b1a30 2022-01-10T01:24:27.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.289+0000 7f76a7fff700 1 -- 172.21.15.36:0/34323629 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76a8057350 con 0x7f76a80b1a30 2022-01-10T01:24:27.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.289+0000 7f7697fff700 1 -- 172.21.15.36:0/34323629 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7f7698045620 con 0x7f76a80b1a30 2022-01-10T01:24:27.296 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:27.297 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3870348387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3870348387},{"type":"v1","addr":"172.21.15.59:6833","nonce":3870348387}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2808909651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2808909651},{"type":"v1","addr":"172.21.15.36:6835","nonce":2808909651}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:24:25.225258+0000","modified":"2022-01-10T01:24:26.981594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/1089668836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1089668836},{"type":"v1","addr":"172.21.15.36:6837","nonce":1089668836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-01-10T01:24:27.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.293+0000 7f76a7fff700 1 -- 172.21.15.36:0/34323629 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f76840535f0 msgr2=0x7f7684055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.293+0000 7f76a7fff700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f76840535f0 0x7f7684055ab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f769c018000 tx=0x7f769c014000).stop 2022-01-10T01:24:27.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.293+0000 7f76a7fff700 1 -- 172.21.15.36:0/34323629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76a80b1a30 msgr2=0x7f76a8152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.293+0000 7f76a7fff700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76a80b1a30 0x7f76a8152a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f7698001110 tx=0x7f7698007ae0).stop 2022-01-10T01:24:27.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.293+0000 7f76a7fff700 1 -- 172.21.15.36:0/34323629 shutdown_connections 2022-01-10T01:24:27.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.293+0000 7f76a7fff700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f76840535f0 0x7f7684055ab0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.293+0000 7f76a7fff700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76a8140cb0 0x7f76a8144830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.293+0000 7f76a7fff700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76a80b1a30 0x7f76a8152a10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.293+0000 7f76a7fff700 1 --2- 172.21.15.36:0/34323629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76a80665f0 0x7f76a813c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.293+0000 7f76a7fff700 1 -- 172.21.15.36:0/34323629 >> 172.21.15.36:0/34323629 conn(0x7f76a80636e0 msgr2=0x7f76a80b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:27.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.293+0000 7f76a7fff700 1 -- 172.21.15.36:0/34323629 shutdown_connections 2022-01-10T01:24:27.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.293+0000 7f76a7fff700 1 -- 172.21.15.36:0/34323629 wait complete. 2022-01-10T01:24:27.301 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 7 2022-01-10T01:24:27.309 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:27.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.409+0000 7f43a6808700 1 Processor -- start 2022-01-10T01:24:27.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.409+0000 7f43a6808700 1 -- start start 2022-01-10T01:24:27.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6808700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a00b2580 0x7f43a014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6808700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f43a00a8ac0 0x7f43a014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6808700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a00a70c0 con 0x7f43a00b0010 2022-01-10T01:24:27.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6808700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a00a72f0 con 0x7f43a00a8ac0 2022-01-10T01:24:27.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6808700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a00a7590 con 0x7f43a00b2580 2022-01-10T01:24:27.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a5005700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f43a00b0010 0x7f43a00a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59716/0 (socket says 172.21.15.36:59716) 2022-01-10T01:24:27.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a5005700 1 -- 172.21.15.36:0/1461895933 learned_addr learned my addr 172.21.15.36:0/1461895933 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:27.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6007700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f43a00a8ac0 0x7f43a014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a5806700 1 --2- 172.21.15.36:0/1461895933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a00b2580 0x7f43a014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a4804700 1 -- 172.21.15.36:0/1461895933 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205184014 0 0) 0x7f43a00a70c0 con 0x7f43a00b0010 2022-01-10T01:24:27.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a4804700 1 -- 172.21.15.36:0/1461895933 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4388003260 con 0x7f43a00b0010 2022-01-10T01:24:27.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a5806700 1 -- 172.21.15.36:0/1461895933 >> v2:172.21.15.36:3300/0 conn(0x7f43a00a8ac0 msgr2=0x7f43a014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:27.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a5806700 1 --2- 172.21.15.36:0/1461895933 >> v2:172.21.15.36:3300/0 conn(0x7f43a00a8ac0 0x7f43a014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a5806700 1 -- 172.21.15.36:0/1461895933 >> v1:172.21.15.36:6789/0 conn(0x7f43a00b0010 legacy=0x7f43a00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a5806700 1 -- 172.21.15.36:0/1461895933 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a00a7830 con 0x7f43a00b2580 2022-01-10T01:24:27.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6007700 1 --2- 172.21.15.36:0/1461895933 >> v2:172.21.15.36:3300/0 conn(0x7f43a00a8ac0 0x7f43a014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:27.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a5806700 1 --2- 172.21.15.36:0/1461895933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a00b2580 0x7f43a014ae40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f439c002f70 tx=0x7f439c006df0).ready entity=mon.2 client_cookie=1293606648eea5d6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:27.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a4804700 1 -- 172.21.15.36:0/1461895933 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f439c00d4a0 con 0x7f43a00b2580 2022-01-10T01:24:27.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a4804700 1 -- 172.21.15.36:0/1461895933 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c000e90 con 0x7f43a00b2580 2022-01-10T01:24:27.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a4804700 1 -- 172.21.15.36:0/1461895933 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f439c00d7f0 con 0x7f43a00b2580 2022-01-10T01:24:27.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6808700 1 -- 172.21.15.36:0/1461895933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a00b2580 msgr2=0x7f43a014ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6808700 1 --2- 172.21.15.36:0/1461895933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a00b2580 0x7f43a014ae40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f439c002f70 tx=0x7f439c006df0).stop 2022-01-10T01:24:27.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6808700 1 -- 172.21.15.36:0/1461895933 shutdown_connections 2022-01-10T01:24:27.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6808700 1 --2- 172.21.15.36:0/1461895933 >> v2:172.21.15.36:3300/0 conn(0x7f43a00a8ac0 0x7f43a014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6808700 1 --2- 172.21.15.36:0/1461895933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a00b2580 0x7f43a014ae40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6808700 1 -- 172.21.15.36:0/1461895933 >> 172.21.15.36:0/1461895933 conn(0x7f43a0060180 msgr2=0x7f43a00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:27.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6808700 1 -- 172.21.15.36:0/1461895933 shutdown_connections 2022-01-10T01:24:27.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.413+0000 7f43a6808700 1 -- 172.21.15.36:0/1461895933 wait complete. 2022-01-10T01:24:27.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a6808700 1 Processor -- start 2022-01-10T01:24:27.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a6808700 1 -- start start 2022-01-10T01:24:27.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a6808700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a00a8ac0 0x7f43a0149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a6808700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43a00b0010 0x7f43a00ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a6808700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a00b2580 0x7f43a00abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a6808700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a014ba10 con 0x7f43a00b0010 2022-01-10T01:24:27.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a6808700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a014bcb0 con 0x7f43a00b2580 2022-01-10T01:24:27.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a6808700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a014bf50 con 0x7f43a00a8ac0 2022-01-10T01:24:27.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a5005700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43a00b0010 0x7f43a00ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a5005700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43a00b0010 0x7f43a00ab9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33698/0 (socket says 172.21.15.36:33698) 2022-01-10T01:24:27.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a5005700 1 -- 172.21.15.36:0/1389861127 learned_addr learned my addr 172.21.15.36:0/1389861127 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:27.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a6007700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a00b2580 0x7f43a00abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a5806700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a00a8ac0 0x7f43a0149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a5005700 1 -- 172.21.15.36:0/1389861127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a00a8ac0 msgr2=0x7f43a0149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a5005700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a00a8ac0 0x7f43a0149d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a5005700 1 -- 172.21.15.36:0/1389861127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a00b2580 msgr2=0x7f43a00abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a5005700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a00b2580 0x7f43a00abee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a5005700 1 -- 172.21.15.36:0/1389861127 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4398009470 con 0x7f43a00b0010 2022-01-10T01:24:27.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a6007700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a00b2580 0x7f43a00abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:27.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.417+0000 7f43a5005700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43a00b0010 0x7f43a00ab9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f4390001110 tx=0x7f4390007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:27.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.421+0000 7f438effd700 1 -- 172.21.15.36:0/1389861127 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43900070d0 con 0x7f43a00b0010 2022-01-10T01:24:27.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.421+0000 7f438effd700 1 -- 172.21.15.36:0/1389861127 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4390007230 con 0x7f43a00b0010 2022-01-10T01:24:27.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.421+0000 7f43a6808700 1 -- 172.21.15.36:0/1389861127 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c00b180 con 0x7f43a00b0010 2022-01-10T01:24:27.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.421+0000 7f438effd700 1 -- 172.21.15.36:0/1389861127 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4390005610 con 0x7f43a00b0010 2022-01-10T01:24:27.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.421+0000 7f43a6808700 1 -- 172.21.15.36:0/1389861127 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a00ac3d0 con 0x7f43a00b0010 2022-01-10T01:24:27.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.421+0000 7f43a6808700 1 -- 172.21.15.36:0/1389861127 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a00b2fb0 con 0x7f43a00b0010 2022-01-10T01:24:27.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.421+0000 7f438effd700 1 -- 172.21.15.36:0/1389861127 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4390010070 con 0x7f43a00b0010 2022-01-10T01:24:27.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.421+0000 7f438effd700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4380053620 0x7f4380055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.421+0000 7f438effd700 1 -- 172.21.15.36:0/1389861127 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f439006b0b0 con 0x7f43a00b0010 2022-01-10T01:24:27.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.421+0000 7f43a5806700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4380053620 0x7f4380055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.425+0000 7f43a5806700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4380053620 0x7f4380055ae0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f439c01a000 tx=0x7f439c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:27.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.429+0000 7f438effd700 1 -- 172.21.15.36:0/1389861127 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f43900420c0 con 0x7f43a00b0010 2022-01-10T01:24:27.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.557+0000 7f43a6808700 1 -- 172.21.15.36:0/1389861127 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43a0057350 con 0x7f43a00b0010 2022-01-10T01:24:27.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.561+0000 7f438effd700 1 -- 172.21.15.36:0/1389861127 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f43900456e0 con 0x7f43a00b0010 2022-01-10T01:24:27.567 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:27.567 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:25.224959+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:24:20.202898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-10T01:24:22.952870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:27.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.565+0000 7f43a6808700 1 -- 172.21.15.36:0/1389861127 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4380053620 msgr2=0x7f4380055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.565+0000 7f43a6808700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4380053620 0x7f4380055ae0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f439c01a000 tx=0x7f439c014000).stop 2022-01-10T01:24:27.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.565+0000 7f43a6808700 1 -- 172.21.15.36:0/1389861127 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43a00b0010 msgr2=0x7f43a00ab9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.565+0000 7f43a6808700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43a00b0010 0x7f43a00ab9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f4390001110 tx=0x7f4390007aa0).stop 2022-01-10T01:24:27.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.565+0000 7f43a6808700 1 -- 172.21.15.36:0/1389861127 shutdown_connections 2022-01-10T01:24:27.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.565+0000 7f43a6808700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4380053620 0x7f4380055ae0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.565+0000 7f43a6808700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43a00b2580 0x7f43a00abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.565+0000 7f43a6808700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43a00b0010 0x7f43a00ab9f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.565+0000 7f43a6808700 1 --2- 172.21.15.36:0/1389861127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43a00a8ac0 0x7f43a0149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.565+0000 7f43a6808700 1 -- 172.21.15.36:0/1389861127 >> 172.21.15.36:0/1389861127 conn(0x7f43a0060180 msgr2=0x7f43a0145ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:27.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.565+0000 7f43a6808700 1 -- 172.21.15.36:0/1389861127 shutdown_connections 2022-01-10T01:24:27.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.565+0000 7f43a6808700 1 -- 172.21.15.36:0/1389861127 wait complete. 2022-01-10T01:24:27.584 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:27.584 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2022-01-10T01:24:27.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06eb075700 1 Processor -- start 2022-01-10T01:24:27.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06eb075700 1 -- start start 2022-01-10T01:24:27.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06eb075700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4060100 0x7f06e40b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06eb075700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f06e4067300 0x7f06e41438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06eb075700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e40aabb0 con 0x7f06e40b4c40 2022-01-10T01:24:27.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06eb075700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e40604e0 con 0x7f06e4067300 2022-01-10T01:24:27.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06eb075700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e4066ea0 con 0x7f06e4060100 2022-01-10T01:24:27.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06e3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f06e4067300 0x7f06e41438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06e3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f06e4067300 0x7f06e41438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33708/0 (socket says 172.21.15.36:33708) 2022-01-10T01:24:27.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06e8e11700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4060100 0x7f06e40b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06e3fff700 1 -- 172.21.15.36:0/2378326877 learned_addr learned my addr 172.21.15.36:0/2378326877 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:27.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06e9612700 1 --1- 172.21.15.36:0/2378326877 >> v1:172.21.15.59:6789/0 conn(0x7f06e40b4c40 0x7f06e4144510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:49176/0 (socket says 172.21.15.36:49176) 2022-01-10T01:24:27.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06e3fff700 1 -- 172.21.15.36:0/2378326877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4060100 msgr2=0x7f06e40b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:27.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06e3fff700 1 --2- 172.21.15.36:0/2378326877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4060100 0x7f06e40b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06e3fff700 1 -- 172.21.15.36:0/2378326877 >> v1:172.21.15.59:6789/0 conn(0x7f06e40b4c40 legacy=0x7f06e4144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06e3fff700 1 -- 172.21.15.36:0/2378326877 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e40b33b0 con 0x7f06e4067300 2022-01-10T01:24:27.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06e3fff700 1 --2- 172.21.15.36:0/2378326877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f06e4067300 0x7f06e41438f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f06cc002f70 tx=0x7f06cc006eb0).ready entity=mon.0 client_cookie=63d5360ff64d7f46 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:27.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06e37fe700 1 -- 172.21.15.36:0/2378326877 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06cc00d570 con 0x7f06e4067300 2022-01-10T01:24:27.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06e37fe700 1 -- 172.21.15.36:0/2378326877 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc000e90 con 0x7f06e4067300 2022-01-10T01:24:27.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06e37fe700 1 -- 172.21.15.36:0/2378326877 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06cc00d900 con 0x7f06e4067300 2022-01-10T01:24:27.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06eb075700 1 -- 172.21.15.36:0/2378326877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f06e4067300 msgr2=0x7f06e41438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.681+0000 7f06eb075700 1 --2- 172.21.15.36:0/2378326877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f06e4067300 0x7f06e41438f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f06cc002f70 tx=0x7f06cc006eb0).stop 2022-01-10T01:24:27.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 -- 172.21.15.36:0/2378326877 shutdown_connections 2022-01-10T01:24:27.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 --2- 172.21.15.36:0/2378326877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f06e4067300 0x7f06e41438f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 --2- 172.21.15.36:0/2378326877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4060100 0x7f06e40b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 -- 172.21.15.36:0/2378326877 >> 172.21.15.36:0/2378326877 conn(0x7f06e405cf30 msgr2=0x7f06e405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:27.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 -- 172.21.15.36:0/2378326877 shutdown_connections 2022-01-10T01:24:27.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 -- 172.21.15.36:0/2378326877 wait complete. 2022-01-10T01:24:27.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 Processor -- start 2022-01-10T01:24:27.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 -- start start 2022-01-10T01:24:27.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4060100 0x7f06e40ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e4067300 0x7f06e414d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f06e40b4c40 0x7f06e414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e414e270 con 0x7f06e40b4c40 2022-01-10T01:24:27.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e413f4f0 con 0x7f06e4067300 2022-01-10T01:24:27.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e409ea30 con 0x7f06e4060100 2022-01-10T01:24:27.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e9612700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f06e40b4c40 0x7f06e414dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e9612700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f06e40b4c40 0x7f06e414dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33714/0 (socket says 172.21.15.36:33714) 2022-01-10T01:24:27.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e9612700 1 -- 172.21.15.36:0/2291307329 learned_addr learned my addr 172.21.15.36:0/2291307329 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:27.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e8e11700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4060100 0x7f06e40ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e3fff700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e4067300 0x7f06e414d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e9612700 1 -- 172.21.15.36:0/2291307329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4060100 msgr2=0x7f06e40ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e9612700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4060100 0x7f06e40ad3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e9612700 1 -- 172.21.15.36:0/2291307329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e4067300 msgr2=0x7f06e414d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e9612700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e4067300 0x7f06e414d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e9612700 1 -- 172.21.15.36:0/2291307329 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc00b1e0 con 0x7f06e40b4c40 2022-01-10T01:24:27.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e3fff700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e4067300 0x7f06e414d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:27.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e9612700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f06e40b4c40 0x7f06e414dd80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f06e40671e0 tx=0x7f06d4007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:27.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e1ffb700 1 -- 172.21.15.36:0/2291307329 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06d400ce50 con 0x7f06e40b4c40 2022-01-10T01:24:27.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e1ffb700 1 -- 172.21.15.36:0/2291307329 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d40070d0 con 0x7f06e40b4c40 2022-01-10T01:24:27.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 -- 172.21.15.36:0/2291307329 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e409ecd0 con 0x7f06e40b4c40 2022-01-10T01:24:27.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06e1ffb700 1 -- 172.21.15.36:0/2291307329 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06d4005550 con 0x7f06e40b4c40 2022-01-10T01:24:27.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.685+0000 7f06eb075700 1 -- 172.21.15.36:0/2291307329 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e40a1320 con 0x7f06e40b4c40 2022-01-10T01:24:27.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.689+0000 7f06eb075700 1 -- 172.21.15.36:0/2291307329 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e4057350 con 0x7f06e40b4c40 2022-01-10T01:24:27.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.689+0000 7f06e1ffb700 1 -- 172.21.15.36:0/2291307329 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f06d401a070 con 0x7f06e40b4c40 2022-01-10T01:24:27.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.689+0000 7f06e1ffb700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06bc0535f0 0x7f06bc055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.689+0000 7f06e8e11700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06bc0535f0 0x7f06bc055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.689+0000 7f06e1ffb700 1 -- 172.21.15.36:0/2291307329 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f06d406ac80 con 0x7f06e40b4c40 2022-01-10T01:24:27.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.689+0000 7f06e8e11700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06bc0535f0 0x7f06bc055ab0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f06dc00b000 tx=0x7f06dc0091d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:27.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.693+0000 7f06e1ffb700 1 -- 172.21.15.36:0/2291307329 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f06d4041b80 con 0x7f06e40b4c40 2022-01-10T01:24:27.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.821+0000 7f06eb075700 1 -- 172.21.15.36:0/2291307329 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06e40b4a20 con 0x7f06e40b4c40 2022-01-10T01:24:27.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.821+0000 7f06e1ffb700 1 -- 172.21.15.36:0/2291307329 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f06d40451a0 con 0x7f06e40b4c40 2022-01-10T01:24:27.827 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:27.827 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:25.224959+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:24:20.202898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-10T01:24:22.952870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:27.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.825+0000 7f06eb075700 1 -- 172.21.15.36:0/2291307329 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06bc0535f0 msgr2=0x7f06bc055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.825+0000 7f06eb075700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06bc0535f0 0x7f06bc055ab0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f06dc00b000 tx=0x7f06dc0091d0).stop 2022-01-10T01:24:27.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.825+0000 7f06eb075700 1 -- 172.21.15.36:0/2291307329 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f06e40b4c40 msgr2=0x7f06e414dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.825+0000 7f06eb075700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f06e40b4c40 0x7f06e414dd80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f06e40671e0 tx=0x7f06d4007b80).stop 2022-01-10T01:24:27.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.825+0000 7f06eb075700 1 -- 172.21.15.36:0/2291307329 shutdown_connections 2022-01-10T01:24:27.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.825+0000 7f06eb075700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06bc0535f0 0x7f06bc055ab0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.825+0000 7f06eb075700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f06e40b4c40 0x7f06e414dd80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.825+0000 7f06eb075700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06e4067300 0x7f06e414d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.825+0000 7f06eb075700 1 --2- 172.21.15.36:0/2291307329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06e4060100 0x7f06e40ad3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.825+0000 7f06eb075700 1 -- 172.21.15.36:0/2291307329 >> 172.21.15.36:0/2291307329 conn(0x7f06e405cf30 msgr2=0x7f06e4144800 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:27.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.825+0000 7f06eb075700 1 -- 172.21.15.36:0/2291307329 shutdown_connections 2022-01-10T01:24:27.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.825+0000 7f06eb075700 1 -- 172.21.15.36:0/2291307329 wait complete. 2022-01-10T01:24:27.840 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:24:20.202898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:24:22.952870+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:24:27.841 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:24:27.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.945+0000 7f883bbae700 1 Processor -- start 2022-01-10T01:24:27.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f883bbae700 1 -- start start 2022-01-10T01:24:27.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f883bbae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340b3590 0x7f8834141400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f883bbae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8834145090 0x7f88341418f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f883bbae700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88340ad8f0 con 0x7f88340b31b0 2022-01-10T01:24:27.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f883bbae700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88340aff00 con 0x7f8834145090 2022-01-10T01:24:27.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f883bbae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8834145560 con 0x7f88340b3590 2022-01-10T01:24:27.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f883994a700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f88340b31b0 0x7f883413e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59744/0 (socket says 172.21.15.36:59744) 2022-01-10T01:24:27.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f883994a700 1 -- 172.21.15.36:0/619782951 learned_addr learned my addr 172.21.15.36:0/619782951 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:27.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f883a14b700 1 --2- 172.21.15.36:0/619782951 >> v2:172.21.15.59:3300/0 conn(0x7f8834145090 0x7f88341418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f8839149700 1 --2- 172.21.15.36:0/619782951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340b3590 0x7f8834141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f8838948700 1 -- 172.21.15.36:0/619782951 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540497669 0 0) 0x7f88340ad8f0 con 0x7f88340b31b0 2022-01-10T01:24:27.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f8838948700 1 -- 172.21.15.36:0/619782951 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f881c003260 con 0x7f88340b31b0 2022-01-10T01:24:27.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f883a14b700 1 -- 172.21.15.36:0/619782951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340b3590 msgr2=0x7f8834141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:27.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f883a14b700 1 --2- 172.21.15.36:0/619782951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340b3590 0x7f8834141400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f883a14b700 1 -- 172.21.15.36:0/619782951 >> v1:172.21.15.36:6789/0 conn(0x7f88340b31b0 legacy=0x7f883413e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f8838948700 1 -- 172.21.15.36:0/619782951 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 320252163 0 0) 0x7f881c003260 con 0x7f88340b31b0 2022-01-10T01:24:27.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f883a14b700 1 -- 172.21.15.36:0/619782951 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88340b0160 con 0x7f8834145090 2022-01-10T01:24:27.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f883a14b700 1 --2- 172.21.15.36:0/619782951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8834145090 0x7f88341418f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8824001800 tx=0x7f882c0091d0).ready entity=mon.1 client_cookie=a235ee2cfc7a9396 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:27.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f8838948700 1 -- 172.21.15.36:0/619782951 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8824001660 con 0x7f8834145090 2022-01-10T01:24:27.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f8838948700 1 -- 172.21.15.36:0/619782951 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c00f510 con 0x7f8834145090 2022-01-10T01:24:27.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.949+0000 7f8838948700 1 -- 172.21.15.36:0/619782951 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f882c00f680 con 0x7f8834145090 2022-01-10T01:24:27.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 -- 172.21.15.36:0/619782951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8834145090 msgr2=0x7f88341418f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 --2- 172.21.15.36:0/619782951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8834145090 0x7f88341418f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f8824001800 tx=0x7f882c0091d0).stop 2022-01-10T01:24:27.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 -- 172.21.15.36:0/619782951 shutdown_connections 2022-01-10T01:24:27.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 --2- 172.21.15.36:0/619782951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8834145090 0x7f88341418f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 --2- 172.21.15.36:0/619782951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340b3590 0x7f8834141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 -- 172.21.15.36:0/619782951 >> 172.21.15.36:0/619782951 conn(0x7f88340607c0 msgr2=0x7f8834060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:27.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 -- 172.21.15.36:0/619782951 shutdown_connections 2022-01-10T01:24:27.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 -- 172.21.15.36:0/619782951 wait complete. 2022-01-10T01:24:27.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 Processor -- start 2022-01-10T01:24:27.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 -- start start 2022-01-10T01:24:27.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88340b31b0 0x7f88340ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340b3590 0x7f8834143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8834145090 0x7f88340ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834143630 con 0x7f88340b31b0 2022-01-10T01:24:27.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834134350 con 0x7f8834145090 2022-01-10T01:24:27.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883bbae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88341345f0 con 0x7f88340b3590 2022-01-10T01:24:27.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883994a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88340b31b0 0x7f88340ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883a14b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8834145090 0x7f88340ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883994a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88340b31b0 0x7f88340ae2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33728/0 (socket says 172.21.15.36:33728) 2022-01-10T01:24:27.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883a14b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8834145090 0x7f88340ae910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:58592/0 (socket says 172.21.15.36:58592) 2022-01-10T01:24:27.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f883994a700 1 -- 172.21.15.36:0/3346798090 learned_addr learned my addr 172.21.15.36:0/3346798090 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:27.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.953+0000 7f8839149700 1 --2- 172.21.15.36:0/3346798090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340b3590 0x7f8834143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.957+0000 7f883994a700 1 -- 172.21.15.36:0/3346798090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340b3590 msgr2=0x7f8834143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.957+0000 7f883994a700 1 --2- 172.21.15.36:0/3346798090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340b3590 0x7f8834143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.957+0000 7f883994a700 1 -- 172.21.15.36:0/3346798090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8834145090 msgr2=0x7f88340ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:27.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.957+0000 7f883994a700 1 --2- 172.21.15.36:0/3346798090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8834145090 0x7f88340ae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:27.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.957+0000 7f883994a700 1 -- 172.21.15.36:0/3346798090 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c009470 con 0x7f88340b31b0 2022-01-10T01:24:27.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.957+0000 7f883994a700 1 --2- 172.21.15.36:0/3346798090 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88340b31b0 0x7f88340ae2a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f88240018c0 tx=0x7f88240011a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:27.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.957+0000 7f8822ffd700 1 -- 172.21.15.36:0/3346798090 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8824007170 con 0x7f88340b31b0 2022-01-10T01:24:27.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.957+0000 7f8822ffd700 1 -- 172.21.15.36:0/3346798090 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88240072d0 con 0x7f88340b31b0 2022-01-10T01:24:27.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.957+0000 7f883bbae700 1 -- 172.21.15.36:0/3346798090 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8834143860 con 0x7f88340b31b0 2022-01-10T01:24:27.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.957+0000 7f8822ffd700 1 -- 172.21.15.36:0/3346798090 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8824004920 con 0x7f88340b31b0 2022-01-10T01:24:27.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.957+0000 7f883bbae700 1 -- 172.21.15.36:0/3346798090 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8834134080 con 0x7f88340b31b0 2022-01-10T01:24:27.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.957+0000 7f883bbae700 1 -- 172.21.15.36:0/3346798090 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8834143a20 con 0x7f88340b31b0 2022-01-10T01:24:27.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.957+0000 7f8822ffd700 1 -- 172.21.15.36:0/3346798090 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8824004a80 con 0x7f88340b31b0 2022-01-10T01:24:27.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.957+0000 7f8822ffd700 1 --2- 172.21.15.36:0/3346798090 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8814053500 0x7f88140559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:27.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.961+0000 7f8822ffd700 1 -- 172.21.15.36:0/3346798090 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f882406b7a0 con 0x7f88340b31b0 2022-01-10T01:24:27.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.961+0000 7f8839149700 1 --2- 172.21.15.36:0/3346798090 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8814053500 0x7f88140559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:27.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.961+0000 7f8839149700 1 --2- 172.21.15.36:0/3346798090 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8814053500 0x7f88140559c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f883000b000 tx=0x7f8830006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:27.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:27.965+0000 7f8822ffd700 1 -- 172.21.15.36:0/3346798090 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f88240426b0 con 0x7f88340b31b0 2022-01-10T01:24:28.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.093+0000 7f883bbae700 1 -- 172.21.15.36:0/3346798090 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f88340b0400 con 0x7f88340b31b0 2022-01-10T01:24:28.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.093+0000 7f8822ffd700 1 -- 172.21.15.36:0/3346798090 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8824045cd0 con 0x7f88340b31b0 2022-01-10T01:24:28.099 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:24:28.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.097+0000 7f883bbae700 1 -- 172.21.15.36:0/3346798090 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8814053500 msgr2=0x7f88140559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.097+0000 7f883bbae700 1 --2- 172.21.15.36:0/3346798090 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8814053500 0x7f88140559c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f883000b000 tx=0x7f8830006df0).stop 2022-01-10T01:24:28.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.097+0000 7f883bbae700 1 -- 172.21.15.36:0/3346798090 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88340b31b0 msgr2=0x7f88340ae2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.097+0000 7f883bbae700 1 --2- 172.21.15.36:0/3346798090 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88340b31b0 0x7f88340ae2a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f88240018c0 tx=0x7f88240011a0).stop 2022-01-10T01:24:28.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.097+0000 7f883bbae700 1 -- 172.21.15.36:0/3346798090 shutdown_connections 2022-01-10T01:24:28.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.097+0000 7f883bbae700 1 --2- 172.21.15.36:0/3346798090 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8814053500 0x7f88140559c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.097+0000 7f883bbae700 1 --2- 172.21.15.36:0/3346798090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8834145090 0x7f88340ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.097+0000 7f883bbae700 1 --2- 172.21.15.36:0/3346798090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340b3590 0x7f8834143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.097+0000 7f883bbae700 1 --2- 172.21.15.36:0/3346798090 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88340b31b0 0x7f88340ae2a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.097+0000 7f883bbae700 1 -- 172.21.15.36:0/3346798090 >> 172.21.15.36:0/3346798090 conn(0x7f88340607c0 msgr2=0x7f883405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:28.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.097+0000 7f883bbae700 1 -- 172.21.15.36:0/3346798090 shutdown_connections 2022-01-10T01:24:28.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.097+0000 7f883bbae700 1 -- 172.21.15.36:0/3346798090 wait complete. 2022-01-10T01:24:28.112 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:24:28.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f048359e700 1 Processor -- start 2022-01-10T01:24:28.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f048359e700 1 -- start start 2022-01-10T01:24:28.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f048359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04841439a0 0x7f04841404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f048359e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04840b6910 con 0x7f0484061680 2022-01-10T01:24:28.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f048359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04840b6bb0 con 0x7f04840b4710 2022-01-10T01:24:28.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f048359e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04840b9680 con 0x7f04841439a0 2022-01-10T01:24:28.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f048259c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f0484061680 0x7f04840b9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59758/0 (socket says 172.21.15.36:59758) 2022-01-10T01:24:28.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f048259c700 1 -- 172.21.15.36:0/1395016076 learned_addr learned my addr 172.21.15.36:0/1395016076 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:28.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f0482d9d700 1 --2- 172.21.15.36:0/1395016076 >> v2:172.21.15.59:3300/0 conn(0x7f04841439a0 0x7f04841404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f048159a700 1 -- 172.21.15.36:0/1395016076 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89370722 0 0) 0x7f04840b6910 con 0x7f0484061680 2022-01-10T01:24:28.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f048159a700 1 -- 172.21.15.36:0/1395016076 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0464003260 con 0x7f0484061680 2022-01-10T01:24:28.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f0482d9d700 1 -- 172.21.15.36:0/1395016076 >> v1:172.21.15.59:6789/0 conn(0x7f04840b4710 legacy=0x7f048413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f0482d9d700 1 -- 172.21.15.36:0/1395016076 >> v1:172.21.15.36:6789/0 conn(0x7f0484061680 legacy=0x7f04840b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f0482d9d700 1 -- 172.21.15.36:0/1395016076 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04840b6e50 con 0x7f04841439a0 2022-01-10T01:24:28.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f0482d9d700 1 --2- 172.21.15.36:0/1395016076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04841439a0 0x7f04841404b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f047c0032f0 tx=0x7f047c0091d0).ready entity=mon.1 client_cookie=450c03a11b55bcf6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:28.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f048159a700 1 -- 172.21.15.36:0/1395016076 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f047c00b6c0 con 0x7f04841439a0 2022-01-10T01:24:28.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f048159a700 1 -- 172.21.15.36:0/1395016076 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047c00b820 con 0x7f04841439a0 2022-01-10T01:24:28.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.221+0000 7f048159a700 1 -- 172.21.15.36:0/1395016076 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f047c00b990 con 0x7f04841439a0 2022-01-10T01:24:28.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 -- 172.21.15.36:0/1395016076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04841439a0 msgr2=0x7f04841404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 --2- 172.21.15.36:0/1395016076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04841439a0 0x7f04841404b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f047c0032f0 tx=0x7f047c0091d0).stop 2022-01-10T01:24:28.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 -- 172.21.15.36:0/1395016076 shutdown_connections 2022-01-10T01:24:28.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 --2- 172.21.15.36:0/1395016076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04841439a0 0x7f04841404b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 -- 172.21.15.36:0/1395016076 >> 172.21.15.36:0/1395016076 conn(0x7f048406adf0 msgr2=0x7f048405f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:28.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 -- 172.21.15.36:0/1395016076 shutdown_connections 2022-01-10T01:24:28.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 -- 172.21.15.36:0/1395016076 wait complete. 2022-01-10T01:24:28.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 Processor -- start 2022-01-10T01:24:28.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 -- start start 2022-01-10T01:24:28.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0484061680 0x7f04840ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04841439a0 0x7f0484146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04840aeb10 0x7f048413eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04840af6e0 con 0x7f04841439a0 2022-01-10T01:24:28.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04840af010 con 0x7f0484061680 2022-01-10T01:24:28.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0484145ec0 con 0x7f04840aeb10 2022-01-10T01:24:28.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f0481d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04841439a0 0x7f0484146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f0481d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04841439a0 0x7f0484146800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33740/0 (socket says 172.21.15.36:33740) 2022-01-10T01:24:28.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f0481d9b700 1 -- 172.21.15.36:0/3758873294 learned_addr learned my addr 172.21.15.36:0/3758873294 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:28.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.225+0000 7f048259c700 1 --2- 172.21.15.36:0/3758873294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0484061680 0x7f04840ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.229+0000 7f0482d9d700 1 --2- 172.21.15.36:0/3758873294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04840aeb10 0x7f048413eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.229+0000 7f0481d9b700 1 -- 172.21.15.36:0/3758873294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04840aeb10 msgr2=0x7f048413eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.229+0000 7f0481d9b700 1 --2- 172.21.15.36:0/3758873294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04840aeb10 0x7f048413eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.229+0000 7f0481d9b700 1 -- 172.21.15.36:0/3758873294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0484061680 msgr2=0x7f04840ada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.229+0000 7f0481d9b700 1 --2- 172.21.15.36:0/3758873294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0484061680 0x7f04840ada40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.229+0000 7f0481d9b700 1 -- 172.21.15.36:0/3758873294 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c009470 con 0x7f04841439a0 2022-01-10T01:24:28.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.229+0000 7f0481d9b700 1 --2- 172.21.15.36:0/3758873294 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04841439a0 0x7f0484146800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f0484062100 tx=0x7f046c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:28.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.229+0000 7f047b7fe700 1 -- 172.21.15.36:0/3758873294 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f046c012400 con 0x7f04841439a0 2022-01-10T01:24:28.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.229+0000 7f047b7fe700 1 -- 172.21.15.36:0/3758873294 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c012560 con 0x7f04841439a0 2022-01-10T01:24:28.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.229+0000 7f048359e700 1 -- 172.21.15.36:0/3758873294 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04840b0560 con 0x7f04841439a0 2022-01-10T01:24:28.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.229+0000 7f047b7fe700 1 -- 172.21.15.36:0/3758873294 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f046c0128c0 con 0x7f04841439a0 2022-01-10T01:24:28.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.229+0000 7f048359e700 1 -- 172.21.15.36:0/3758873294 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f048413f3b0 con 0x7f04841439a0 2022-01-10T01:24:28.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.229+0000 7f048359e700 1 -- 172.21.15.36:0/3758873294 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04840b0b80 con 0x7f04841439a0 2022-01-10T01:24:28.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.229+0000 7f047b7fe700 1 -- 172.21.15.36:0/3758873294 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f046c019030 con 0x7f04841439a0 2022-01-10T01:24:28.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.233+0000 7f047b7fe700 1 --2- 172.21.15.36:0/3758873294 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0468053560 0x7f0468055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.233+0000 7f047b7fe700 1 -- 172.21.15.36:0/3758873294 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f046c06ae40 con 0x7f04841439a0 2022-01-10T01:24:28.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.233+0000 7f048259c700 1 --2- 172.21.15.36:0/3758873294 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0468053560 0x7f0468055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.233+0000 7f048259c700 1 --2- 172.21.15.36:0/3758873294 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0468053560 0x7f0468055a20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f047400d000 tx=0x7f0474009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:28.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.237+0000 7f047b7fe700 1 -- 172.21.15.36:0/3758873294 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f046c041d40 con 0x7f04841439a0 2022-01-10T01:24:28.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.365+0000 7f048359e700 1 -- 172.21.15.36:0/3758873294 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f04840b9870 con 0x7f04841439a0 2022-01-10T01:24:28.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.365+0000 7f047b7fe700 1 -- 172.21.15.36:0/3758873294 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f046c045360 con 0x7f04841439a0 2022-01-10T01:24:28.370 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:28.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.365+0000 7f048359e700 1 -- 172.21.15.36:0/3758873294 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0468053560 msgr2=0x7f0468055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.365+0000 7f048359e700 1 --2- 172.21.15.36:0/3758873294 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0468053560 0x7f0468055a20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f047400d000 tx=0x7f0474009040).stop 2022-01-10T01:24:28.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.365+0000 7f048359e700 1 -- 172.21.15.36:0/3758873294 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04841439a0 msgr2=0x7f0484146800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.365+0000 7f048359e700 1 --2- 172.21.15.36:0/3758873294 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04841439a0 0x7f0484146800 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f0484062100 tx=0x7f046c007c50).stop 2022-01-10T01:24:28.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.365+0000 7f048359e700 1 -- 172.21.15.36:0/3758873294 shutdown_connections 2022-01-10T01:24:28.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.365+0000 7f048359e700 1 --2- 172.21.15.36:0/3758873294 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0468053560 0x7f0468055a20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.365+0000 7f048359e700 1 --2- 172.21.15.36:0/3758873294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04840aeb10 0x7f048413eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.365+0000 7f048359e700 1 --2- 172.21.15.36:0/3758873294 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04841439a0 0x7f0484146800 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.365+0000 7f048359e700 1 --2- 172.21.15.36:0/3758873294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0484061680 0x7f04840ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.365+0000 7f048359e700 1 -- 172.21.15.36:0/3758873294 >> 172.21.15.36:0/3758873294 conn(0x7f048406adf0 msgr2=0x7f048413ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:28.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.365+0000 7f048359e700 1 -- 172.21.15.36:0/3758873294 shutdown_connections 2022-01-10T01:24:28.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.365+0000 7f048359e700 1 -- 172.21.15.36:0/3758873294 wait complete. 2022-01-10T01:24:28.383 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:24:28.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.489+0000 7f37e7612700 1 Processor -- start 2022-01-10T01:24:28.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.489+0000 7f37e7612700 1 -- start start 2022-01-10T01:24:28.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.489+0000 7f37e7612700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37e0146950 0x7f37e0140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.489+0000 7f37e7612700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37e00b4180 0x7f37e0140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.489+0000 7f37e7612700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e0143b60 con 0x7f37e00b4690 2022-01-10T01:24:28.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.489+0000 7f37e7612700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e0147510 con 0x7f37e00b4180 2022-01-10T01:24:28.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.489+0000 7f37e7612700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e0143e00 con 0x7f37e0146950 2022-01-10T01:24:28.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e4bad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37e00b4180 0x7f37e0140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e5baf700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f37e00b4690 0x7f37e00b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:49220/0 (socket says 172.21.15.36:49220) 2022-01-10T01:24:28.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e53ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37e0146950 0x7f37e0140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e5baf700 1 -- 172.21.15.36:0/667970128 learned_addr learned my addr 172.21.15.36:0/667970128 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:28.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e4bad700 1 -- 172.21.15.36:0/667970128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37e0146950 msgr2=0x7f37e0140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:28.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e4bad700 1 --2- 172.21.15.36:0/667970128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37e0146950 0x7f37e0140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e4bad700 1 -- 172.21.15.36:0/667970128 >> v1:172.21.15.59:6789/0 conn(0x7f37e00b4690 legacy=0x7f37e00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e4bad700 1 -- 172.21.15.36:0/667970128 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e00b0c90 con 0x7f37e00b4180 2022-01-10T01:24:28.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e4bad700 1 --2- 172.21.15.36:0/667970128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e00b4180 0x7f37e0140720 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f37dc002f70 tx=0x7f37dc006df0).ready entity=mon.1 client_cookie=2326dfdb8dcaaf4e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:28.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37d7fff700 1 -- 172.21.15.36:0/667970128 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37dc00d570 con 0x7f37e00b4180 2022-01-10T01:24:28.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37d7fff700 1 -- 172.21.15.36:0/667970128 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc000e90 con 0x7f37e00b4180 2022-01-10T01:24:28.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37d7fff700 1 -- 172.21.15.36:0/667970128 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37dc00d8c0 con 0x7f37e00b4180 2022-01-10T01:24:28.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e7612700 1 -- 172.21.15.36:0/667970128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e00b4180 msgr2=0x7f37e0140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e7612700 1 --2- 172.21.15.36:0/667970128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e00b4180 0x7f37e0140720 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f37dc002f70 tx=0x7f37dc006df0).stop 2022-01-10T01:24:28.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e7612700 1 -- 172.21.15.36:0/667970128 shutdown_connections 2022-01-10T01:24:28.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e7612700 1 --2- 172.21.15.36:0/667970128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e00b4180 0x7f37e0140720 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e7612700 1 --2- 172.21.15.36:0/667970128 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37e0146950 0x7f37e0140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e7612700 1 -- 172.21.15.36:0/667970128 >> 172.21.15.36:0/667970128 conn(0x7f37e005c490 msgr2=0x7f37e005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:28.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e7612700 1 -- 172.21.15.36:0/667970128 shutdown_connections 2022-01-10T01:24:28.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.493+0000 7f37e7612700 1 -- 172.21.15.36:0/667970128 wait complete. 2022-01-10T01:24:28.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.497+0000 7f37e7612700 1 Processor -- start 2022-01-10T01:24:28.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.497+0000 7f37e7612700 1 -- start start 2022-01-10T01:24:28.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.497+0000 7f37e7612700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f37e00b4180 0x7f37e00b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.497+0000 7f37e7612700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37e00b4690 0x7f37e00b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.497+0000 7f37e7612700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e0146950 0x7f37e0155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.497+0000 7f37e7612700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e0142960 con 0x7f37e00b4180 2022-01-10T01:24:28.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.497+0000 7f37e7612700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00af9c0 con 0x7f37e0146950 2022-01-10T01:24:28.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.497+0000 7f37e7612700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e0142b90 con 0x7f37e00b4690 2022-01-10T01:24:28.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.497+0000 7f37e53ae700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f37e00b4180 0x7f37e00b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.497+0000 7f37e53ae700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f37e00b4180 0x7f37e00b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33752/0 (socket says 172.21.15.36:33752) 2022-01-10T01:24:28.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.497+0000 7f37e4bad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37e00b4690 0x7f37e00b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.497+0000 7f37e53ae700 1 -- 172.21.15.36:0/13037329 learned_addr learned my addr 172.21.15.36:0/13037329 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:28.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.497+0000 7f37e5baf700 1 --2- 172.21.15.36:0/13037329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e0146950 0x7f37e0155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37e53ae700 1 -- 172.21.15.36:0/13037329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37e00b4690 msgr2=0x7f37e00b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37e53ae700 1 --2- 172.21.15.36:0/13037329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37e00b4690 0x7f37e00b7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37e53ae700 1 -- 172.21.15.36:0/13037329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e0146950 msgr2=0x7f37e0155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37e53ae700 1 --2- 172.21.15.36:0/13037329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e0146950 0x7f37e0155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37e53ae700 1 -- 172.21.15.36:0/13037329 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc00b180 con 0x7f37e00b4180 2022-01-10T01:24:28.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37e5baf700 1 --2- 172.21.15.36:0/13037329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e0146950 0x7f37e0155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:28.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37e53ae700 1 --2- 172.21.15.36:0/13037329 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f37e00b4180 0x7f37e00b00c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f37d000c000 tx=0x7f37d0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:28.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37d67fc700 1 -- 172.21.15.36:0/13037329 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37d0011750 con 0x7f37e00b4180 2022-01-10T01:24:28.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37d67fc700 1 -- 172.21.15.36:0/13037329 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d00118b0 con 0x7f37e00b4180 2022-01-10T01:24:28.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37e7612700 1 -- 172.21.15.36:0/13037329 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e00afc20 con 0x7f37e00b4180 2022-01-10T01:24:28.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37d67fc700 1 -- 172.21.15.36:0/13037329 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37d0011c10 con 0x7f37e00b4180 2022-01-10T01:24:28.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37e7612700 1 -- 172.21.15.36:0/13037329 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e00b8a50 con 0x7f37e00b4180 2022-01-10T01:24:28.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37e7612700 1 -- 172.21.15.36:0/13037329 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e00afdb0 con 0x7f37e00b4180 2022-01-10T01:24:28.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37d67fc700 1 -- 172.21.15.36:0/13037329 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f37d0011d70 con 0x7f37e00b4180 2022-01-10T01:24:28.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37d67fc700 1 --2- 172.21.15.36:0/13037329 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f37c80535f0 0x7f37c8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37d67fc700 1 -- 172.21.15.36:0/13037329 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f37d006bf90 con 0x7f37e00b4180 2022-01-10T01:24:28.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.501+0000 7f37e4bad700 1 --2- 172.21.15.36:0/13037329 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f37c80535f0 0x7f37c8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.505+0000 7f37e4bad700 1 --2- 172.21.15.36:0/13037329 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f37c80535f0 0x7f37c8055ab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f37dc01a000 tx=0x7f37dc014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:28.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.509+0000 7f37d67fc700 1 -- 172.21.15.36:0/13037329 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f37d0042e30 con 0x7f37e00b4180 2022-01-10T01:24:28.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.637+0000 7f37e7612700 1 -- 172.21.15.36:0/13037329 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37e0057350 con 0x7f37e00b4180 2022-01-10T01:24:28.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.637+0000 7f37d67fc700 1 -- 172.21.15.36:0/13037329 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f37d0046450 con 0x7f37e00b4180 2022-01-10T01:24:28.643 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:28.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.637+0000 7f37e7612700 1 -- 172.21.15.36:0/13037329 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f37c80535f0 msgr2=0x7f37c8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.637+0000 7f37e7612700 1 --2- 172.21.15.36:0/13037329 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f37c80535f0 0x7f37c8055ab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f37dc01a000 tx=0x7f37dc014000).stop 2022-01-10T01:24:28.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.637+0000 7f37e7612700 1 -- 172.21.15.36:0/13037329 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f37e00b4180 msgr2=0x7f37e00b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.637+0000 7f37e7612700 1 --2- 172.21.15.36:0/13037329 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f37e00b4180 0x7f37e00b00c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f37d000c000 tx=0x7f37d0006df0).stop 2022-01-10T01:24:28.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.641+0000 7f37e7612700 1 -- 172.21.15.36:0/13037329 shutdown_connections 2022-01-10T01:24:28.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.641+0000 7f37e7612700 1 --2- 172.21.15.36:0/13037329 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f37c80535f0 0x7f37c8055ab0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.641+0000 7f37e7612700 1 --2- 172.21.15.36:0/13037329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e0146950 0x7f37e0155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.641+0000 7f37e7612700 1 --2- 172.21.15.36:0/13037329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37e00b4690 0x7f37e00b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.641+0000 7f37e7612700 1 --2- 172.21.15.36:0/13037329 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f37e00b4180 0x7f37e00b00c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.641+0000 7f37e7612700 1 -- 172.21.15.36:0/13037329 >> 172.21.15.36:0/13037329 conn(0x7f37e005c490 msgr2=0x7f37e00b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:28.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.641+0000 7f37e7612700 1 -- 172.21.15.36:0/13037329 shutdown_connections 2022-01-10T01:24:28.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.641+0000 7f37e7612700 1 -- 172.21.15.36:0/13037329 wait complete. 2022-01-10T01:24:28.656 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:24:28.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.765+0000 7fb022820700 1 Processor -- start 2022-01-10T01:24:28.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb022820700 1 -- start start 2022-01-10T01:24:28.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb022820700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01c0ad320 0x7fb01c0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb022820700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01c0afda0 con 0x7fb01c0af2c0 2022-01-10T01:24:28.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb022820700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01c05c610 con 0x7fb01c0ad850 2022-01-10T01:24:28.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb022820700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c140800 con 0x7fb01c0ad320 2022-01-10T01:24:28.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb02181e700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fb01c0af2c0 0x7fb01c143150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59786/0 (socket says 172.21.15.36:59786) 2022-01-10T01:24:28.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb02181e700 1 -- 172.21.15.36:0/911252339 learned_addr learned my addr 172.21.15.36:0/911252339 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:28.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb02101d700 1 --2- 172.21.15.36:0/911252339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01c0ad320 0x7fb01c0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb02081c700 1 -- 172.21.15.36:0/911252339 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660184423 0 0) 0x7fb01c0afda0 con 0x7fb01c0af2c0 2022-01-10T01:24:28.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb02081c700 1 -- 172.21.15.36:0/911252339 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb004003260 con 0x7fb01c0af2c0 2022-01-10T01:24:28.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb02081c700 1 -- 172.21.15.36:0/911252339 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294078446 0 0) 0x7fb01c05c610 con 0x7fb01c0ad850 2022-01-10T01:24:28.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb02081c700 1 -- 172.21.15.36:0/911252339 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb01c0afda0 con 0x7fb01c0ad850 2022-01-10T01:24:28.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb02101d700 1 -- 172.21.15.36:0/911252339 >> v1:172.21.15.59:6789/0 conn(0x7fb01c0ad850 legacy=0x7fb01c0a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb02101d700 1 -- 172.21.15.36:0/911252339 >> v1:172.21.15.36:6789/0 conn(0x7fb01c0af2c0 legacy=0x7fb01c143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb02101d700 1 -- 172.21.15.36:0/911252339 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c143860 con 0x7fb01c0ad320 2022-01-10T01:24:28.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb02101d700 1 --2- 172.21.15.36:0/911252339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01c0ad320 0x7fb01c0af6a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb00c002f70 tx=0x7fb00c006df0).ready entity=mon.2 client_cookie=bf65d5646fa4ee11 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:28.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.769+0000 7fb02081c700 1 -- 172.21.15.36:0/911252339 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb00c00d5c0 con 0x7fb01c0ad320 2022-01-10T01:24:28.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.773+0000 7fb02081c700 1 -- 172.21.15.36:0/911252339 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c000e90 con 0x7fb01c0ad320 2022-01-10T01:24:28.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.773+0000 7fb02081c700 1 -- 172.21.15.36:0/911252339 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb00c00d910 con 0x7fb01c0ad320 2022-01-10T01:24:28.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.773+0000 7fb022820700 1 -- 172.21.15.36:0/911252339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01c0ad320 msgr2=0x7fb01c0af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.773+0000 7fb022820700 1 --2- 172.21.15.36:0/911252339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01c0ad320 0x7fb01c0af6a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb00c002f70 tx=0x7fb00c006df0).stop 2022-01-10T01:24:28.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.773+0000 7fb022820700 1 -- 172.21.15.36:0/911252339 shutdown_connections 2022-01-10T01:24:28.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.773+0000 7fb022820700 1 --2- 172.21.15.36:0/911252339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01c0ad320 0x7fb01c0af6a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.773+0000 7fb022820700 1 -- 172.21.15.36:0/911252339 >> 172.21.15.36:0/911252339 conn(0x7fb01c061140 msgr2=0x7fb01c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:28.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.773+0000 7fb022820700 1 -- 172.21.15.36:0/911252339 shutdown_connections 2022-01-10T01:24:28.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.773+0000 7fb022820700 1 -- 172.21.15.36:0/911252339 wait complete. 2022-01-10T01:24:28.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.773+0000 7fb022820700 1 Processor -- start 2022-01-10T01:24:28.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.773+0000 7fb022820700 1 -- start start 2022-01-10T01:24:28.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb022820700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb01c0ad320 0x7fb01c14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb022820700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb01c0ad850 0x7fb01c0aa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb022820700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01c0af2c0 0x7fb01c0aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb022820700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0a96b0 con 0x7fb01c0ad320 2022-01-10T01:24:28.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb022820700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0ac730 con 0x7fb01c0ad850 2022-01-10T01:24:28.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb022820700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c14fb00 con 0x7fb01c0af2c0 2022-01-10T01:24:28.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb02181e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb01c0ad320 0x7fb01c14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb02181e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb01c0ad320 0x7fb01c14f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33766/0 (socket says 172.21.15.36:33766) 2022-01-10T01:24:28.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb02181e700 1 -- 172.21.15.36:0/3077442929 learned_addr learned my addr 172.21.15.36:0/3077442929 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:28.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb02101d700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb01c0ad850 0x7fb01c0aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb02201f700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01c0af2c0 0x7fb01c0aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb02181e700 1 -- 172.21.15.36:0/3077442929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01c0af2c0 msgr2=0x7fb01c0aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb02181e700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01c0af2c0 0x7fb01c0aab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb02181e700 1 -- 172.21.15.36:0/3077442929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb01c0ad850 msgr2=0x7fb01c0aa620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb02181e700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb01c0ad850 0x7fb01c0aa620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb02181e700 1 -- 172.21.15.36:0/3077442929 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c00b180 con 0x7fb01c0ad320 2022-01-10T01:24:28.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb02101d700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb01c0ad850 0x7fb01c0aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:28.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb02181e700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb01c0ad320 0x7fb01c14f330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fb0180011d0 tx=0x7fb018007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:28.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb00affd700 1 -- 172.21.15.36:0/3077442929 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0180070d0 con 0x7fb01c0ad320 2022-01-10T01:24:28.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb00affd700 1 -- 172.21.15.36:0/3077442929 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb018007230 con 0x7fb01c0ad320 2022-01-10T01:24:28.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb022820700 1 -- 172.21.15.36:0/3077442929 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c14fda0 con 0x7fb01c0ad320 2022-01-10T01:24:28.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb00affd700 1 -- 172.21.15.36:0/3077442929 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb018005610 con 0x7fb01c0ad320 2022-01-10T01:24:28.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb022820700 1 -- 172.21.15.36:0/3077442929 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c0ab000 con 0x7fb01c0ad320 2022-01-10T01:24:28.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb022820700 1 -- 172.21.15.36:0/3077442929 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c057350 con 0x7fb01c0ad320 2022-01-10T01:24:28.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.777+0000 7fb00affd700 1 -- 172.21.15.36:0/3077442929 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb01801a060 con 0x7fb01c0ad320 2022-01-10T01:24:28.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.781+0000 7fb00affd700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faffc053680 0x7faffc055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:28.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.781+0000 7fb00affd700 1 -- 172.21.15.36:0/3077442929 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb01806b1a0 con 0x7fb01c0ad320 2022-01-10T01:24:28.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.781+0000 7fb02101d700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faffc053680 0x7faffc055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:28.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.781+0000 7fb02101d700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faffc053680 0x7faffc055b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb00c018000 tx=0x7fb00c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:28.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.785+0000 7fb00affd700 1 -- 172.21.15.36:0/3077442929 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb0180421b0 con 0x7fb01c0ad320 2022-01-10T01:24:28.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.909+0000 7fb022820700 1 -- 172.21.15.36:0/3077442929 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb01c061990 con 0x7fb01c0ad320 2022-01-10T01:24:28.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.909+0000 7fb00affd700 1 -- 172.21.15.36:0/3077442929 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb018018020 con 0x7fb01c0ad320 2022-01-10T01:24:28.914 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:28.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.909+0000 7fb022820700 1 -- 172.21.15.36:0/3077442929 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faffc053680 msgr2=0x7faffc055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.909+0000 7fb022820700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faffc053680 0x7faffc055b40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fb00c018000 tx=0x7fb00c014000).stop 2022-01-10T01:24:28.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.909+0000 7fb022820700 1 -- 172.21.15.36:0/3077442929 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb01c0ad320 msgr2=0x7fb01c14f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:28.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.909+0000 7fb022820700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb01c0ad320 0x7fb01c14f330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fb0180011d0 tx=0x7fb018007b50).stop 2022-01-10T01:24:28.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.909+0000 7fb022820700 1 -- 172.21.15.36:0/3077442929 shutdown_connections 2022-01-10T01:24:28.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.909+0000 7fb022820700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faffc053680 0x7faffc055b40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.909+0000 7fb022820700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb01c0af2c0 0x7fb01c0aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.909+0000 7fb022820700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb01c0ad850 0x7fb01c0aa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.909+0000 7fb022820700 1 --2- 172.21.15.36:0/3077442929 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb01c0ad320 0x7fb01c14f330 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:28.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.909+0000 7fb022820700 1 -- 172.21.15.36:0/3077442929 >> 172.21.15.36:0/3077442929 conn(0x7fb01c061140 msgr2=0x7fb01c13cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:28.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.913+0000 7fb022820700 1 -- 172.21.15.36:0/3077442929 shutdown_connections 2022-01-10T01:24:28.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:28.913+0000 7fb022820700 1 -- 172.21.15.36:0/3077442929 wait complete. 2022-01-10T01:24:28.927 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-01-10T01:24:28.928 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2022-01-10T01:24:28.928 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2022-01-10T01:24:29.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17ee160700 1 Processor -- start 2022-01-10T01:24:29.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17ee160700 1 -- start start 2022-01-10T01:24:29.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17ee160700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f17e80b43c0 0x7f17e80b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17ee160700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17e80b6960 0x7f17e812ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17ee160700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e81440b0 con 0x7f17e80b6580 2022-01-10T01:24:29.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17ee160700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e8143b70 con 0x7f17e80b43c0 2022-01-10T01:24:29.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17ee160700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e8143e10 con 0x7f17e80b6960 2022-01-10T01:24:29.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17e77fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f17e80b6580 0x7f17e8061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59800/0 (socket says 172.21.15.36:59800) 2022-01-10T01:24:29.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17e6ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f17e80b43c0 0x7f17e80b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17e77fe700 1 -- 172.21.15.36:0/1847824191 learned_addr learned my addr 172.21.15.36:0/1847824191 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:29.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17e7fff700 1 --2- 172.21.15.36:0/1847824191 >> v2:172.21.15.59:3300/0 conn(0x7f17e80b6960 0x7f17e812ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17e6ffd700 1 -- 172.21.15.36:0/1847824191 >> v2:172.21.15.59:3300/0 conn(0x7f17e80b6960 msgr2=0x7f17e812ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:29.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17e6ffd700 1 --2- 172.21.15.36:0/1847824191 >> v2:172.21.15.59:3300/0 conn(0x7f17e80b6960 0x7f17e812ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17e6ffd700 1 -- 172.21.15.36:0/1847824191 >> v1:172.21.15.36:6789/0 conn(0x7f17e80b6580 legacy=0x7f17e8061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17e6ffd700 1 -- 172.21.15.36:0/1847824191 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e80615f0 con 0x7f17e80b43c0 2022-01-10T01:24:29.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.025+0000 7f17e67fc700 1 -- 172.21.15.36:0/1847824191 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21512477 0 0) 0x7f17e81440b0 con 0x7f17e80b6580 2022-01-10T01:24:29.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17e6ffd700 1 --2- 172.21.15.36:0/1847824191 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17e80b43c0 0x7f17e80b5bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f17e8143120 tx=0x7f17d0006df0).ready entity=mon.0 client_cookie=bb151e4b629e316a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:29.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17e67fc700 1 -- 172.21.15.36:0/1847824191 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17d000d5c0 con 0x7f17e80b43c0 2022-01-10T01:24:29.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17e67fc700 1 -- 172.21.15.36:0/1847824191 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d0000e90 con 0x7f17e80b43c0 2022-01-10T01:24:29.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17e67fc700 1 -- 172.21.15.36:0/1847824191 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17d000d910 con 0x7f17e80b43c0 2022-01-10T01:24:29.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17ee160700 1 -- 172.21.15.36:0/1847824191 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17e80b43c0 msgr2=0x7f17e80b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17ee160700 1 --2- 172.21.15.36:0/1847824191 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17e80b43c0 0x7f17e80b5bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f17e8143120 tx=0x7f17d0006df0).stop 2022-01-10T01:24:29.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17ee160700 1 -- 172.21.15.36:0/1847824191 shutdown_connections 2022-01-10T01:24:29.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17ee160700 1 --2- 172.21.15.36:0/1847824191 >> v2:172.21.15.59:3300/0 conn(0x7f17e80b6960 0x7f17e812ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17ee160700 1 --2- 172.21.15.36:0/1847824191 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17e80b43c0 0x7f17e80b5bf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17ee160700 1 -- 172.21.15.36:0/1847824191 >> 172.21.15.36:0/1847824191 conn(0x7f17e805c490 msgr2=0x7f17e805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:29.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17ee160700 1 -- 172.21.15.36:0/1847824191 shutdown_connections 2022-01-10T01:24:29.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17ee160700 1 -- 172.21.15.36:0/1847824191 wait complete. 2022-01-10T01:24:29.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17ee160700 1 Processor -- start 2022-01-10T01:24:29.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17ee160700 1 -- start start 2022-01-10T01:24:29.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.029+0000 7f17ee160700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e80b6580 0x7f17e80b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17ee160700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e80b6960 0x7f17e8140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17ee160700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17e8140810 0x7f17e8144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17ee160700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8146520 con 0x7f17e8140810 2022-01-10T01:24:29.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17ee160700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8146220 con 0x7f17e80b6580 2022-01-10T01:24:29.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17ee160700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8152f40 con 0x7f17e80b6960 2022-01-10T01:24:29.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17e8140810 0x7f17e8144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17e8140810 0x7f17e8144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33784/0 (socket says 172.21.15.36:33784) 2022-01-10T01:24:29.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e7fff700 1 -- 172.21.15.36:0/4003220510 learned_addr learned my addr 172.21.15.36:0/4003220510 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:29.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e6ffd700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e80b6960 0x7f17e8140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e77fe700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e80b6580 0x7f17e80b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e7fff700 1 -- 172.21.15.36:0/4003220510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e80b6960 msgr2=0x7f17e8140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e7fff700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e80b6960 0x7f17e8140320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e7fff700 1 -- 172.21.15.36:0/4003220510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e80b6580 msgr2=0x7f17e80b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e7fff700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e80b6580 0x7f17e80b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e7fff700 1 -- 172.21.15.36:0/4003220510 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d000b180 con 0x7f17e8140810 2022-01-10T01:24:29.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e77fe700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e80b6580 0x7f17e80b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:29.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e7fff700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17e8140810 0x7f17e8144790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f17e8152370 tx=0x7f17e0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:29.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e4ff9700 1 -- 172.21.15.36:0/4003220510 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17e0011750 con 0x7f17e8140810 2022-01-10T01:24:29.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e4ff9700 1 -- 172.21.15.36:0/4003220510 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e00118b0 con 0x7f17e8140810 2022-01-10T01:24:29.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17ee160700 1 -- 172.21.15.36:0/4003220510 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e8145f80 con 0x7f17e8140810 2022-01-10T01:24:29.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e4ff9700 1 -- 172.21.15.36:0/4003220510 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17e0011c10 con 0x7f17e8140810 2022-01-10T01:24:29.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17ee160700 1 -- 172.21.15.36:0/4003220510 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e8140cc0 con 0x7f17e8140810 2022-01-10T01:24:29.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17ee160700 1 -- 172.21.15.36:0/4003220510 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e8061890 con 0x7f17e8140810 2022-01-10T01:24:29.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.033+0000 7f17e4ff9700 1 -- 172.21.15.36:0/4003220510 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f17e0011d70 con 0x7f17e8140810 2022-01-10T01:24:29.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.037+0000 7f17e4ff9700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f17cc053680 0x7f17cc055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.037+0000 7f17e4ff9700 1 -- 172.21.15.36:0/4003220510 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f17e006be10 con 0x7f17e8140810 2022-01-10T01:24:29.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.037+0000 7f17e77fe700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f17cc053680 0x7f17cc055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.037+0000 7f17e77fe700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f17cc053680 0x7f17cc055b40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f17d800b000 tx=0x7f17d8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:29.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.041+0000 7f17e4ff9700 1 -- 172.21.15.36:0/4003220510 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f17e0042e20 con 0x7f17e8140810 2022-01-10T01:24:29.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.197+0000 7f17ee160700 1 -- 172.21.15.36:0/4003220510 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f17e81444c0 con 0x7f17e8140810 2022-01-10T01:24:29.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.201+0000 7f17e4ff9700 1 -- 172.21.15.36:0/4003220510 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+131236 (secure 0 0 0) 0x7f17e0046440 con 0x7f17e8140810 2022-01-10T01:24:29.209 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:29.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.205+0000 7f17ee160700 1 -- 172.21.15.36:0/4003220510 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f17cc053680 msgr2=0x7f17cc055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.205+0000 7f17ee160700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f17cc053680 0x7f17cc055b40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f17d800b000 tx=0x7f17d8009040).stop 2022-01-10T01:24:29.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.205+0000 7f17ee160700 1 -- 172.21.15.36:0/4003220510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17e8140810 msgr2=0x7f17e8144790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.205+0000 7f17ee160700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17e8140810 0x7f17e8144790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f17e8152370 tx=0x7f17e0006df0).stop 2022-01-10T01:24:29.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.205+0000 7f17ee160700 1 -- 172.21.15.36:0/4003220510 shutdown_connections 2022-01-10T01:24:29.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.205+0000 7f17ee160700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f17cc053680 0x7f17cc055b40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.205+0000 7f17ee160700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17e8140810 0x7f17e8144790 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.205+0000 7f17ee160700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17e80b6960 0x7f17e8140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.205+0000 7f17ee160700 1 --2- 172.21.15.36:0/4003220510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17e80b6580 0x7f17e80b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.205+0000 7f17ee160700 1 -- 172.21.15.36:0/4003220510 >> 172.21.15.36:0/4003220510 conn(0x7f17e805c490 msgr2=0x7f17e8143160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:29.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.205+0000 7f17ee160700 1 -- 172.21.15.36:0/4003220510 shutdown_connections 2022-01-10T01:24:29.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.205+0000 7f17ee160700 1 -- 172.21.15.36:0/4003220510 wait complete. 2022-01-10T01:24:29.223 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":4,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6800","nonce":14596},{"type":"v1","addr":"172.21.15.36:6801","nonce":14596}]},"active_addr":"172.21.15.36:6801/14596","active_change":"2022-01-10T01:24:08.350131+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4104,"name":"x","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.36:0","nonce":4090520422}]},{"addrvec":[{"type":"v2","addr":"172.21.15.36:0","nonce":821512363}]},{"addrvec":[{"type":"v2","addr":"172.21.15.36:0","nonce":797478645}]}]}} 2022-01-10T01:24:29.228 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2022-01-10T01:24:29.228 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-01-10T01:24:29.229 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:29.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa46571a700 1 Processor -- start 2022-01-10T01:24:29.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa46571a700 1 -- start start 2022-01-10T01:24:29.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa46571a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa46014b5c0 0x7fa460065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa46571a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4600b2a90 con 0x7fa4600b76b0 2022-01-10T01:24:29.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa46571a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4600b7a90 con 0x7fa4600b2ee0 2022-01-10T01:24:29.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa46571a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4600616a0 con 0x7fa46014b5c0 2022-01-10T01:24:29.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa45ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa4600b76b0 0x7fa460060f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59814/0 (socket says 172.21.15.36:59814) 2022-01-10T01:24:29.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa45ffff700 1 -- 172.21.15.36:0/2262838906 learned_addr learned my addr 172.21.15.36:0/2262838906 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:29.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa464f19700 1 --2- 172.21.15.36:0/2262838906 >> v2:172.21.15.59:3300/0 conn(0x7fa46014b5c0 0x7fa460065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa45effd700 1 -- 172.21.15.36:0/2262838906 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331423940 0 0) 0x7fa4600b2a90 con 0x7fa4600b76b0 2022-01-10T01:24:29.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa45effd700 1 -- 172.21.15.36:0/2262838906 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa440003260 con 0x7fa4600b76b0 2022-01-10T01:24:29.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa45effd700 1 -- 172.21.15.36:0/2262838906 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160788873 0 0) 0x7fa4600b7a90 con 0x7fa4600b2ee0 2022-01-10T01:24:29.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa45effd700 1 -- 172.21.15.36:0/2262838906 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4600b2a90 con 0x7fa4600b2ee0 2022-01-10T01:24:29.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa464f19700 1 -- 172.21.15.36:0/2262838906 >> v1:172.21.15.59:6789/0 conn(0x7fa4600b2ee0 legacy=0x7fa46014aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa45effd700 1 -- 172.21.15.36:0/2262838906 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3320133710 0 0) 0x7fa440003260 con 0x7fa4600b76b0 2022-01-10T01:24:29.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa464f19700 1 -- 172.21.15.36:0/2262838906 >> v1:172.21.15.36:6789/0 conn(0x7fa4600b76b0 legacy=0x7fa460060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa464f19700 1 -- 172.21.15.36:0/2262838906 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4600b27f0 con 0x7fa46014b5c0 2022-01-10T01:24:29.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa464f19700 1 --2- 172.21.15.36:0/2262838906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46014b5c0 0x7fa460065590 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fa448001290 tx=0x7fa450006df0).ready entity=mon.1 client_cookie=666113784507b9f2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:29.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa45effd700 1 -- 172.21.15.36:0/2262838906 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4480017e0 con 0x7fa46014b5c0 2022-01-10T01:24:29.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa45effd700 1 -- 172.21.15.36:0/2262838906 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa450000e90 con 0x7fa46014b5c0 2022-01-10T01:24:29.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.333+0000 7fa45effd700 1 -- 172.21.15.36:0/2262838906 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa450012460 con 0x7fa46014b5c0 2022-01-10T01:24:29.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.337+0000 7fa46571a700 1 -- 172.21.15.36:0/2262838906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46014b5c0 msgr2=0x7fa460065590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.337+0000 7fa46571a700 1 --2- 172.21.15.36:0/2262838906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46014b5c0 0x7fa460065590 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fa448001290 tx=0x7fa450006df0).stop 2022-01-10T01:24:29.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.337+0000 7fa46571a700 1 -- 172.21.15.36:0/2262838906 shutdown_connections 2022-01-10T01:24:29.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.337+0000 7fa46571a700 1 --2- 172.21.15.36:0/2262838906 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46014b5c0 0x7fa460065590 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.337+0000 7fa46571a700 1 -- 172.21.15.36:0/2262838906 >> 172.21.15.36:0/2262838906 conn(0x7fa46005f6b0 msgr2=0x7fa46005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:29.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.337+0000 7fa46571a700 1 -- 172.21.15.36:0/2262838906 shutdown_connections 2022-01-10T01:24:29.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.337+0000 7fa46571a700 1 -- 172.21.15.36:0/2262838906 wait complete. 2022-01-10T01:24:29.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.337+0000 7fa46571a700 1 Processor -- start 2022-01-10T01:24:29.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.337+0000 7fa46571a700 1 -- start start 2022-01-10T01:24:29.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa46571a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4600b2ee0 0x7fa460144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa46571a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4600b76b0 0x7fa460159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa46571a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46014b5c0 0x7fa46015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa46571a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46015a5d0 con 0x7fa4600b2ee0 2022-01-10T01:24:29.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa46571a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa460147fa0 con 0x7fa4600b76b0 2022-01-10T01:24:29.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa46571a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4600b1590 con 0x7fa46014b5c0 2022-01-10T01:24:29.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa45ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4600b2ee0 0x7fa460144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa45ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4600b2ee0 0x7fa460144250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33794/0 (socket says 172.21.15.36:33794) 2022-01-10T01:24:29.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa45ffff700 1 -- 172.21.15.36:0/3420642522 learned_addr learned my addr 172.21.15.36:0/3420642522 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:29.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa464f19700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46014b5c0 0x7fa46015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa45f7fe700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4600b76b0 0x7fa460159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa45ffff700 1 -- 172.21.15.36:0/3420642522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46014b5c0 msgr2=0x7fa46015a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa45ffff700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46014b5c0 0x7fa46015a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa45ffff700 1 -- 172.21.15.36:0/3420642522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4600b76b0 msgr2=0x7fa460159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa45ffff700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4600b76b0 0x7fa460159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa45ffff700 1 -- 172.21.15.36:0/3420642522 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45000b180 con 0x7fa4600b2ee0 2022-01-10T01:24:29.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa464f19700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46014b5c0 0x7fa46015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:29.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa45ffff700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4600b2ee0 0x7fa460144250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa4480019c0 tx=0x7fa44800c820).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:29.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa45d7fa700 1 -- 172.21.15.36:0/3420642522 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4480072e0 con 0x7fa4600b2ee0 2022-01-10T01:24:29.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa45d7fa700 1 -- 172.21.15.36:0/3420642522 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4480054e0 con 0x7fa4600b2ee0 2022-01-10T01:24:29.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa46571a700 1 -- 172.21.15.36:0/3420642522 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4600b5bd0 con 0x7fa4600b2ee0 2022-01-10T01:24:29.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa45d7fa700 1 -- 172.21.15.36:0/3420642522 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa448005840 con 0x7fa4600b2ee0 2022-01-10T01:24:29.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.341+0000 7fa46571a700 1 -- 172.21.15.36:0/3420642522 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4600adbb0 con 0x7fa4600b2ee0 2022-01-10T01:24:29.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.345+0000 7fa46571a700 1 -- 172.21.15.36:0/3420642522 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa460144a80 con 0x7fa4600b2ee0 2022-01-10T01:24:29.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.345+0000 7fa45d7fa700 1 -- 172.21.15.36:0/3420642522 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa44801a060 con 0x7fa4600b2ee0 2022-01-10T01:24:29.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.345+0000 7fa45d7fa700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa444053560 0x7fa444055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.345+0000 7fa45d7fa700 1 -- 172.21.15.36:0/3420642522 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa44806b490 con 0x7fa4600b2ee0 2022-01-10T01:24:29.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.345+0000 7fa45f7fe700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa444053560 0x7fa444055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.345+0000 7fa45f7fe700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa444053560 0x7fa444055a20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa45800b000 tx=0x7fa458009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:29.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.353+0000 7fa45d7fa700 1 -- 172.21.15.36:0/3420642522 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa448042390 con 0x7fa4600b2ee0 2022-01-10T01:24:29.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.481+0000 7fa46571a700 1 -- 172.21.15.36:0/3420642522 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa460148170 con 0x7fa4600b2ee0 2022-01-10T01:24:29.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.485+0000 7fa45d7fa700 1 -- 172.21.15.36:0/3420642522 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fa448018020 con 0x7fa4600b2ee0 2022-01-10T01:24:29.489 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:29.490 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:25.224959+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:24:20.202898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-10T01:24:22.952870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:29.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.485+0000 7fa46571a700 1 -- 172.21.15.36:0/3420642522 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa444053560 msgr2=0x7fa444055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.485+0000 7fa46571a700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa444053560 0x7fa444055a20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa45800b000 tx=0x7fa458009040).stop 2022-01-10T01:24:29.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.485+0000 7fa46571a700 1 -- 172.21.15.36:0/3420642522 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4600b2ee0 msgr2=0x7fa460144250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.485+0000 7fa46571a700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4600b2ee0 0x7fa460144250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa4480019c0 tx=0x7fa44800c820).stop 2022-01-10T01:24:29.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.485+0000 7fa46571a700 1 -- 172.21.15.36:0/3420642522 shutdown_connections 2022-01-10T01:24:29.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.485+0000 7fa46571a700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa444053560 0x7fa444055a20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.485+0000 7fa46571a700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46014b5c0 0x7fa46015a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.485+0000 7fa46571a700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4600b76b0 0x7fa460159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.485+0000 7fa46571a700 1 --2- 172.21.15.36:0/3420642522 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4600b2ee0 0x7fa460144250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.485+0000 7fa46571a700 1 -- 172.21.15.36:0/3420642522 >> 172.21.15.36:0/3420642522 conn(0x7fa46005f6b0 msgr2=0x7fa46014a080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:29.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.485+0000 7fa46571a700 1 -- 172.21.15.36:0/3420642522 shutdown_connections 2022-01-10T01:24:29.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.485+0000 7fa46571a700 1 -- 172.21.15.36:0/3420642522 wait complete. 2022-01-10T01:24:29.502 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-01-10T01:24:29.503 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:29.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcb5b2a700 1 Processor -- start 2022-01-10T01:24:29.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcb5b2a700 1 -- start start 2022-01-10T01:24:29.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcb5b2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcb00b1db0 0x7efcb00b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcb5b2a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efcb00a70c0 0x7efcb0144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcb5b2a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb00b0350 con 0x7efcb01483a0 2022-01-10T01:24:29.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcb5b2a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb00a90c0 con 0x7efcb00a70c0 2022-01-10T01:24:29.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcb5b2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb00b05f0 con 0x7efcb00b1db0 2022-01-10T01:24:29.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcaeffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efcb01483a0 0x7efcb00b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:49272/0 (socket says 172.21.15.36:49272) 2022-01-10T01:24:29.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcaeffd700 1 -- 172.21.15.36:0/2327852084 learned_addr learned my addr 172.21.15.36:0/2327852084 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:29.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcaf7fe700 1 --2- 172.21.15.36:0/2327852084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcb00b1db0 0x7efcb00b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcaffff700 1 --2- 172.21.15.36:0/2327852084 >> v2:172.21.15.59:3300/0 conn(0x7efcb00a70c0 0x7efcb0144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcae7fc700 1 -- 172.21.15.36:0/2327852084 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623616468 0 0) 0x7efcb00b0350 con 0x7efcb01483a0 2022-01-10T01:24:29.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcae7fc700 1 -- 172.21.15.36:0/2327852084 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc90003260 con 0x7efcb01483a0 2022-01-10T01:24:29.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcaf7fe700 1 -- 172.21.15.36:0/2327852084 >> v2:172.21.15.59:3300/0 conn(0x7efcb00a70c0 msgr2=0x7efcb0144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:29.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcaf7fe700 1 --2- 172.21.15.36:0/2327852084 >> v2:172.21.15.59:3300/0 conn(0x7efcb00a70c0 0x7efcb0144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcaf7fe700 1 -- 172.21.15.36:0/2327852084 >> v1:172.21.15.59:6789/0 conn(0x7efcb01483a0 legacy=0x7efcb00b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcaf7fe700 1 -- 172.21.15.36:0/2327852084 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb00b0890 con 0x7efcb00b1db0 2022-01-10T01:24:29.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcaf7fe700 1 --2- 172.21.15.36:0/2327852084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcb00b1db0 0x7efcb00b0fd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7efc98002f70 tx=0x7efc98006df0).ready entity=mon.2 client_cookie=ef42d9ca5ec95b98 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:29.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcae7fc700 1 -- 172.21.15.36:0/2327852084 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc9800d4a0 con 0x7efcb00b1db0 2022-01-10T01:24:29.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcae7fc700 1 -- 172.21.15.36:0/2327852084 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc98000e90 con 0x7efcb00b1db0 2022-01-10T01:24:29.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.601+0000 7efcae7fc700 1 -- 172.21.15.36:0/2327852084 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc9800d7f0 con 0x7efcb00b1db0 2022-01-10T01:24:29.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 -- 172.21.15.36:0/2327852084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcb00b1db0 msgr2=0x7efcb00b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 --2- 172.21.15.36:0/2327852084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcb00b1db0 0x7efcb00b0fd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7efc98002f70 tx=0x7efc98006df0).stop 2022-01-10T01:24:29.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 -- 172.21.15.36:0/2327852084 shutdown_connections 2022-01-10T01:24:29.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 --2- 172.21.15.36:0/2327852084 >> v2:172.21.15.59:3300/0 conn(0x7efcb00a70c0 0x7efcb0144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 --2- 172.21.15.36:0/2327852084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcb00b1db0 0x7efcb00b0fd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 -- 172.21.15.36:0/2327852084 >> 172.21.15.36:0/2327852084 conn(0x7efcb005f6b0 msgr2=0x7efcb005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:29.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 -- 172.21.15.36:0/2327852084 shutdown_connections 2022-01-10T01:24:29.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 -- 172.21.15.36:0/2327852084 wait complete. 2022-01-10T01:24:29.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 Processor -- start 2022-01-10T01:24:29.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 -- start start 2022-01-10T01:24:29.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcb00a70c0 0x7efcb00abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efcb00b1db0 0x7efcb00ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcb01483a0 0x7efcb014a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb014ab90 con 0x7efcb00b1db0 2022-01-10T01:24:29.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb014b240 con 0x7efcb01483a0 2022-01-10T01:24:29.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcb5b2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb014b4e0 con 0x7efcb00a70c0 2022-01-10T01:24:29.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcaeffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efcb00b1db0 0x7efcb00ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcaeffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efcb00b1db0 0x7efcb00ae170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33810/0 (socket says 172.21.15.36:33810) 2022-01-10T01:24:29.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcaeffd700 1 -- 172.21.15.36:0/359639579 learned_addr learned my addr 172.21.15.36:0/359639579 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:29.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcaf7fe700 1 --2- 172.21.15.36:0/359639579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcb00a70c0 0x7efcb00abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.605+0000 7efcaffff700 1 --2- 172.21.15.36:0/359639579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcb01483a0 0x7efcb014a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.609+0000 7efcaeffd700 1 -- 172.21.15.36:0/359639579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcb00a70c0 msgr2=0x7efcb00abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.609+0000 7efcaeffd700 1 --2- 172.21.15.36:0/359639579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcb00a70c0 0x7efcb00abb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.609+0000 7efcaeffd700 1 -- 172.21.15.36:0/359639579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcb01483a0 msgr2=0x7efcb014a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.609+0000 7efcaeffd700 1 --2- 172.21.15.36:0/359639579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcb01483a0 0x7efcb014a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.609+0000 7efcaeffd700 1 -- 172.21.15.36:0/359639579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9800b180 con 0x7efcb00b1db0 2022-01-10T01:24:29.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.609+0000 7efcaeffd700 1 --2- 172.21.15.36:0/359639579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efcb00b1db0 0x7efcb00ae170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7efca8001490 tx=0x7efca8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:29.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.609+0000 7efcacff9700 1 -- 172.21.15.36:0/359639579 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efca8005ba0 con 0x7efcb00b1db0 2022-01-10T01:24:29.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.609+0000 7efcacff9700 1 -- 172.21.15.36:0/359639579 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca8005d00 con 0x7efcb00b1db0 2022-01-10T01:24:29.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.609+0000 7efcb5b2a700 1 -- 172.21.15.36:0/359639579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb014b780 con 0x7efcb00b1db0 2022-01-10T01:24:29.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.609+0000 7efcacff9700 1 -- 172.21.15.36:0/359639579 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efca80072c0 con 0x7efcb00b1db0 2022-01-10T01:24:29.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.609+0000 7efcb5b2a700 1 -- 172.21.15.36:0/359639579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb014a0c0 con 0x7efcb00b1db0 2022-01-10T01:24:29.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.609+0000 7efcb5b2a700 1 -- 172.21.15.36:0/359639579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb00b0a70 con 0x7efcb00b1db0 2022-01-10T01:24:29.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.609+0000 7efcacff9700 1 -- 172.21.15.36:0/359639579 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7efca801a060 con 0x7efcb00b1db0 2022-01-10T01:24:29.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.613+0000 7efcacff9700 1 --2- 172.21.15.36:0/359639579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efc940535f0 0x7efc94055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.613+0000 7efcacff9700 1 -- 172.21.15.36:0/359639579 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7efca806b470 con 0x7efcb00b1db0 2022-01-10T01:24:29.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.613+0000 7efcaf7fe700 1 --2- 172.21.15.36:0/359639579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efc940535f0 0x7efc94055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.613+0000 7efcaf7fe700 1 --2- 172.21.15.36:0/359639579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efc940535f0 0x7efc94055ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7efc9801a000 tx=0x7efc98014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:29.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.617+0000 7efcacff9700 1 -- 172.21.15.36:0/359639579 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efca8042480 con 0x7efcb00b1db0 2022-01-10T01:24:29.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.745+0000 7efcb5b2a700 1 -- 172.21.15.36:0/359639579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcb014b910 con 0x7efcb00b1db0 2022-01-10T01:24:29.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.749+0000 7efcacff9700 1 -- 172.21.15.36:0/359639579 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16299 (secure 0 0 0) 0x7efca8018070 con 0x7efcb00b1db0 2022-01-10T01:24:29.753 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:29.753 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:25.224959+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:24:20.202898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-10T01:24:22.952870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:29.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.749+0000 7efcb5b2a700 1 -- 172.21.15.36:0/359639579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efc940535f0 msgr2=0x7efc94055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.749+0000 7efcb5b2a700 1 --2- 172.21.15.36:0/359639579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efc940535f0 0x7efc94055ab0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7efc9801a000 tx=0x7efc98014000).stop 2022-01-10T01:24:29.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.749+0000 7efcb5b2a700 1 -- 172.21.15.36:0/359639579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efcb00b1db0 msgr2=0x7efcb00ae170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.749+0000 7efcb5b2a700 1 --2- 172.21.15.36:0/359639579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efcb00b1db0 0x7efcb00ae170 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7efca8001490 tx=0x7efca8007e20).stop 2022-01-10T01:24:29.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.749+0000 7efcb5b2a700 1 -- 172.21.15.36:0/359639579 shutdown_connections 2022-01-10T01:24:29.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.749+0000 7efcb5b2a700 1 --2- 172.21.15.36:0/359639579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efc940535f0 0x7efc94055ab0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.749+0000 7efcb5b2a700 1 --2- 172.21.15.36:0/359639579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efcb01483a0 0x7efcb014a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.749+0000 7efcb5b2a700 1 --2- 172.21.15.36:0/359639579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efcb00b1db0 0x7efcb00ae170 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.749+0000 7efcb5b2a700 1 --2- 172.21.15.36:0/359639579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efcb00a70c0 0x7efcb00abb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.749+0000 7efcb5b2a700 1 -- 172.21.15.36:0/359639579 >> 172.21.15.36:0/359639579 conn(0x7efcb005f6b0 msgr2=0x7efcb0147030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:29.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.749+0000 7efcb5b2a700 1 -- 172.21.15.36:0/359639579 shutdown_connections 2022-01-10T01:24:29.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.749+0000 7efcb5b2a700 1 -- 172.21.15.36:0/359639579 wait complete. 2022-01-10T01:24:29.766 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2022-01-10T01:24:29.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427f3b5700 1 Processor -- start 2022-01-10T01:24:29.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427f3b5700 1 -- start start 2022-01-10T01:24:29.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427f3b5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42780b0010 0x7f42780a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427f3b5700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42780a70c0 con 0x7f42780afbd0 2022-01-10T01:24:29.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427f3b5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42780a72f0 con 0x7f42780b2580 2022-01-10T01:24:29.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427f3b5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42780a7590 con 0x7f42780b0010 2022-01-10T01:24:29.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427ebb4700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f42780afbd0 0x7f4278151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59846/0 (socket says 172.21.15.36:59846) 2022-01-10T01:24:29.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427ebb4700 1 -- 172.21.15.36:0/1970064165 learned_addr learned my addr 172.21.15.36:0/1970064165 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:29.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427dbb2700 1 --2- 172.21.15.36:0/1970064165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42780b0010 0x7f42780a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107218760 0 0) 0x7f42780a70c0 con 0x7f42780afbd0 2022-01-10T01:24:29.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4260003260 con 0x7f42780afbd0 2022-01-10T01:24:29.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766764732 0 0) 0x7f42780a72f0 con 0x7f42780b2580 2022-01-10T01:24:29.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42780a70c0 con 0x7f42780b2580 2022-01-10T01:24:29.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4088185120 0 0) 0x7f4260003260 con 0x7f42780afbd0 2022-01-10T01:24:29.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42780b0010 msgr2=0x7f42780a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:29.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 --2- 172.21.15.36:0/1970064165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42780b0010 0x7f42780a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 >> v1:172.21.15.59:6789/0 conn(0x7f42780b2580 legacy=0x7f427814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780a7830 con 0x7f42780afbd0 2022-01-10T01:24:29.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f42700019e0 con 0x7f42780afbd0 2022-01-10T01:24:29.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427dbb2700 1 --2- 172.21.15.36:0/1970064165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42780b0010 0x7f42780a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:29.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 >> v1:172.21.15.36:6789/0 conn(0x7f42780afbd0 legacy=0x7f4278151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 --2- 172.21.15.36:0/1970064165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42780b0010 0x7f4260003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 --2- 172.21.15.36:0/1970064165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4260003e50 0x7f4260004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 --2- 172.21.15.36:0/1970064165 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f42600049f0 0x7f4260004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780a7590 con 0x7f42600049f0 2022-01-10T01:24:29.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426000b800 con 0x7f4260003e50 2022-01-10T01:24:29.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426000b9c0 con 0x7f42780b0010 2022-01-10T01:24:29.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427ebb4700 1 --2- 172.21.15.36:0/1970064165 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f42600049f0 0x7f4260004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427e3b3700 1 --2- 172.21.15.36:0/1970064165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42780b0010 0x7f4260003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427dbb2700 1 --2- 172.21.15.36:0/1970064165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4260003e50 0x7f4260004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427ebb4700 1 -- 172.21.15.36:0/1970064165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42780b0010 msgr2=0x7f4260003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:29.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427ebb4700 1 --2- 172.21.15.36:0/1970064165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42780b0010 0x7f4260003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427ebb4700 1 -- 172.21.15.36:0/1970064165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4260003e50 msgr2=0x7f4260004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:29.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427ebb4700 1 --2- 172.21.15.36:0/1970064165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4260003e50 0x7f4260004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427ebb4700 1 -- 172.21.15.36:0/1970064165 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427400b180 con 0x7f42600049f0 2022-01-10T01:24:29.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427ebb4700 1 --2- 172.21.15.36:0/1970064165 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f42600049f0 0x7f4260004e70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f42700017b0 tx=0x7f427806a460).ready entity=mon.0 client_cookie=5cc2868adb156aed server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:29.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f427000cbb0 con 0x7f42600049f0 2022-01-10T01:24:29.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427000cd10 con 0x7f42600049f0 2022-01-10T01:24:29.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.873+0000 7f427d3b1700 1 -- 172.21.15.36:0/1970064165 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4270005b80 con 0x7f42600049f0 2022-01-10T01:24:29.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427f3b5700 1 -- 172.21.15.36:0/1970064165 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f42600049f0 msgr2=0x7f4260004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427f3b5700 1 --2- 172.21.15.36:0/1970064165 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f42600049f0 0x7f4260004e70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f42700017b0 tx=0x7f427806a460).stop 2022-01-10T01:24:29.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427ebb4700 1 -- 172.21.15.36:0/1970064165 reap_dead start 2022-01-10T01:24:29.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427f3b5700 1 -- 172.21.15.36:0/1970064165 shutdown_connections 2022-01-10T01:24:29.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427f3b5700 1 -- 172.21.15.36:0/1970064165 >> 172.21.15.36:0/1970064165 conn(0x7f4278060180 msgr2=0x7f42780b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:29.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427f3b5700 1 -- 172.21.15.36:0/1970064165 shutdown_connections 2022-01-10T01:24:29.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427f3b5700 1 -- 172.21.15.36:0/1970064165 wait complete. 2022-01-10T01:24:29.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427f3b5700 1 Processor -- start 2022-01-10T01:24:29.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427f3b5700 1 -- start start 2022-01-10T01:24:29.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427f3b5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f42600049f0 0x7f427805c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427f3b5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42780b2dd0 0x7f4278149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427f3b5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42781567b0 0x7f4278156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427f3b5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780b32e0 con 0x7f42600049f0 2022-01-10T01:24:29.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427f3b5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42781563c0 con 0x7f42781567b0 2022-01-10T01:24:29.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427f3b5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427815a440 con 0x7f42780b2dd0 2022-01-10T01:24:29.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427e3b3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f42600049f0 0x7f427805c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427e3b3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f42600049f0 0x7f427805c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33828/0 (socket says 172.21.15.36:33828) 2022-01-10T01:24:29.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427e3b3700 1 -- 172.21.15.36:0/1826385126 learned_addr learned my addr 172.21.15.36:0/1826385126 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:29.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427dbb2700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42780b2dd0 0x7f4278149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427e3b3700 1 -- 172.21.15.36:0/1826385126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42780b2dd0 msgr2=0x7f4278149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427ebb4700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42781567b0 0x7f4278156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427e3b3700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42780b2dd0 0x7f4278149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427e3b3700 1 -- 172.21.15.36:0/1826385126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42781567b0 msgr2=0x7f4278156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427e3b3700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42781567b0 0x7f4278156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427e3b3700 1 -- 172.21.15.36:0/1826385126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780af3a0 con 0x7f42600049f0 2022-01-10T01:24:29.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427dbb2700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42780b2dd0 0x7f4278149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:24:29.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427ebb4700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42781567b0 0x7f4278156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:24:29.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.877+0000 7f427e3b3700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f42600049f0 0x7f427805c260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f42780b5a40 tx=0x7f4268007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:29.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f42677fe700 1 -- 172.21.15.36:0/1826385126 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f426800f8d0 con 0x7f42600049f0 2022-01-10T01:24:29.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f42677fe700 1 -- 172.21.15.36:0/1826385126 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426800fa30 con 0x7f42600049f0 2022-01-10T01:24:29.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f427f3b5700 1 -- 172.21.15.36:0/1826385126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427815a670 con 0x7f42600049f0 2022-01-10T01:24:29.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f42677fe700 1 -- 172.21.15.36:0/1826385126 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f426800fd90 con 0x7f42600049f0 2022-01-10T01:24:29.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f427f3b5700 1 -- 172.21.15.36:0/1826385126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4278157150 con 0x7f42600049f0 2022-01-10T01:24:29.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f427f3b5700 1 -- 172.21.15.36:0/1826385126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4278156510 con 0x7f42600049f0 2022-01-10T01:24:29.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f42677fe700 1 -- 172.21.15.36:0/1826385126 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f426801b030 con 0x7f42600049f0 2022-01-10T01:24:29.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f42677fe700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f42580536b0 0x7f4258055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f42677fe700 1 -- 172.21.15.36:0/1826385126 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f426806bc50 con 0x7f42600049f0 2022-01-10T01:24:29.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f427dbb2700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f42580536b0 0x7f4258055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f42677fe700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.36:6802/14818,v1:172.21.15.36:6803/14818] conn(0x7f425805b0b0 0x7f425805d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:29.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f42677fe700 1 -- 172.21.15.36:0/1826385126 --> [v2:172.21.15.36:6802/14818,v1:172.21.15.36:6803/14818] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f425805da90 con 0x7f425805b0b0 2022-01-10T01:24:29.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f42677fe700 1 -- 172.21.15.36:0/1826385126 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4268042c60 con 0x7f42600049f0 2022-01-10T01:24:29.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f427ebb4700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.36:6802/14818,v1:172.21.15.36:6803/14818] conn(0x7f425805b0b0 0x7f425805d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:29.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.881+0000 7f427dbb2700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f42580536b0 0x7f4258055b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f427400b000 tx=0x7f4274008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:29.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.885+0000 7f427ebb4700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.36:6802/14818,v1:172.21.15.36:6803/14818] conn(0x7f425805b0b0 0x7f425805d4d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:29.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.885+0000 7f42677fe700 1 -- 172.21.15.36:0/1826385126 <== osd.0 v2:172.21.15.36:6802/14818 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f425805da90 con 0x7f425805b0b0 2022-01-10T01:24:29.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.905+0000 7f427f3b5700 1 -- 172.21.15.36:0/1826385126 --> [v2:172.21.15.36:6802/14818,v1:172.21.15.36:6803/14818] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f42781489e0 con 0x7f425805b0b0 2022-01-10T01:24:29.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.905+0000 7f42677fe700 1 -- 172.21.15.36:0/1826385126 <== osd.0 v2:172.21.15.36:6802/14818 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f42781489e0 con 0x7f425805b0b0 2022-01-10T01:24:29.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.905+0000 7f427f3b5700 1 -- 172.21.15.36:0/1826385126 >> [v2:172.21.15.36:6802/14818,v1:172.21.15.36:6803/14818] conn(0x7f425805b0b0 msgr2=0x7f425805d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.905+0000 7f427f3b5700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.36:6802/14818,v1:172.21.15.36:6803/14818] conn(0x7f425805b0b0 0x7f425805d4d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:29.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.905+0000 7f427f3b5700 1 -- 172.21.15.36:0/1826385126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f42580536b0 msgr2=0x7f4258055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.905+0000 7f427f3b5700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f42580536b0 0x7f4258055b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f427400b000 tx=0x7f4274008040).stop 2022-01-10T01:24:29.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.905+0000 7f427f3b5700 1 -- 172.21.15.36:0/1826385126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f42600049f0 msgr2=0x7f427805c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:29.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.905+0000 7f427f3b5700 1 --2- 172.21.15.36:0/1826385126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f42600049f0 0x7f427805c260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f42780b5a40 tx=0x7f4268007a00).stop 2022-01-10T01:24:29.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.905+0000 7f427ebb4700 1 -- 172.21.15.36:0/1826385126 reap_dead start 2022-01-10T01:24:29.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.905+0000 7f427f3b5700 1 -- 172.21.15.36:0/1826385126 shutdown_connections 2022-01-10T01:24:29.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.905+0000 7f427f3b5700 1 -- 172.21.15.36:0/1826385126 >> 172.21.15.36:0/1826385126 conn(0x7f4278060180 msgr2=0x7f4278145f40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:29.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.905+0000 7f427f3b5700 1 -- 172.21.15.36:0/1826385126 shutdown_connections 2022-01-10T01:24:29.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:29.905+0000 7f427f3b5700 1 -- 172.21.15.36:0/1826385126 wait complete. 2022-01-10T01:24:29.922 INFO:teuthology.orchestra.run.smithi036.stdout:55834574853 2022-01-10T01:24:29.923 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2022-01-10T01:24:30.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab02749700 1 Processor -- start 2022-01-10T01:24:30.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab02749700 1 -- start start 2022-01-10T01:24:30.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab02749700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faafc0b6580 0x7faafc0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab02749700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faafc0b6960 0x7faafc12ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab02749700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faafc1440b0 con 0x7faafc0b43c0 2022-01-10T01:24:30.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab02749700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faafc143b70 con 0x7faafc0b6960 2022-01-10T01:24:30.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab02749700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc143e10 con 0x7faafc0b6580 2022-01-10T01:24:30.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab00ce6700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faafc0b6960 0x7faafc12ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab00ce6700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faafc0b6960 0x7faafc12ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33842/0 (socket says 172.21.15.36:33842) 2022-01-10T01:24:30.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab00ce6700 1 -- 172.21.15.36:0/1987816530 learned_addr learned my addr 172.21.15.36:0/1987816530 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:30.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7faafbfff700 1 --2- 172.21.15.36:0/1987816530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faafc0b6580 0x7faafc0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab00ce6700 1 -- 172.21.15.36:0/1987816530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faafc0b6580 msgr2=0x7faafc0b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:30.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab00ce6700 1 --2- 172.21.15.36:0/1987816530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faafc0b6580 0x7faafc0b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab00ce6700 1 -- 172.21.15.36:0/1987816530 >> v1:172.21.15.59:6789/0 conn(0x7faafc0b43c0 legacy=0x7faafc061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab00ce6700 1 -- 172.21.15.36:0/1987816530 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faafc0615f0 con 0x7faafc0b6960 2022-01-10T01:24:30.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7fab00ce6700 1 --2- 172.21.15.36:0/1987816530 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faafc0b6960 0x7faafc12ba00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7faaec002f70 tx=0x7faaec006eb0).ready entity=mon.0 client_cookie=5f78dd64f23c16b9 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.029+0000 7faafaffd700 1 -- 172.21.15.36:0/1987816530 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaec00d5c0 con 0x7faafc0b6960 2022-01-10T01:24:30.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7faafaffd700 1 -- 172.21.15.36:0/1987816530 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec000e90 con 0x7faafc0b6960 2022-01-10T01:24:30.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7faafaffd700 1 -- 172.21.15.36:0/1987816530 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaec00d950 con 0x7faafc0b6960 2022-01-10T01:24:30.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 -- 172.21.15.36:0/1987816530 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faafc0b6960 msgr2=0x7faafc12ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 --2- 172.21.15.36:0/1987816530 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faafc0b6960 0x7faafc12ba00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7faaec002f70 tx=0x7faaec006eb0).stop 2022-01-10T01:24:30.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 -- 172.21.15.36:0/1987816530 shutdown_connections 2022-01-10T01:24:30.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 --2- 172.21.15.36:0/1987816530 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faafc0b6960 0x7faafc12ba00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 --2- 172.21.15.36:0/1987816530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faafc0b6580 0x7faafc0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 -- 172.21.15.36:0/1987816530 >> 172.21.15.36:0/1987816530 conn(0x7faafc05c490 msgr2=0x7faafc05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:30.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 -- 172.21.15.36:0/1987816530 shutdown_connections 2022-01-10T01:24:30.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 -- 172.21.15.36:0/1987816530 wait complete. 2022-01-10T01:24:30.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 Processor -- start 2022-01-10T01:24:30.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 -- start start 2022-01-10T01:24:30.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faafc0b43c0 0x7faafc148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faafc0b6580 0x7faafc0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faafc0b6960 0x7faafc1520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc144f50 con 0x7faafc0b43c0 2022-01-10T01:24:30.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faafc145780 con 0x7faafc0b6580 2022-01-10T01:24:30.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.033+0000 7fab02749700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faafc0b3bd0 con 0x7faafc0b6960 2022-01-10T01:24:30.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faafbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faafc0b43c0 0x7faafc148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faafbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faafc0b43c0 0x7faafc148d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33844/0 (socket says 172.21.15.36:33844) 2022-01-10T01:24:30.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faafbfff700 1 -- 172.21.15.36:0/2895767824 learned_addr learned my addr 172.21.15.36:0/2895767824 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:30.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7fab00ce6700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faafc0b6960 0x7faafc1520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faafb7fe700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faafc0b6580 0x7faafc0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faafbfff700 1 -- 172.21.15.36:0/2895767824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faafc0b6960 msgr2=0x7faafc1520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faafbfff700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faafc0b6960 0x7faafc1520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faafbfff700 1 -- 172.21.15.36:0/2895767824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faafc0b6580 msgr2=0x7faafc0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faafbfff700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faafc0b6580 0x7faafc0b3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faafbfff700 1 -- 172.21.15.36:0/2895767824 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec00b1e0 con 0x7faafc0b43c0 2022-01-10T01:24:30.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faafb7fe700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faafc0b6580 0x7faafc0b3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:30.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faafbfff700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faafc0b43c0 0x7faafc148d00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7faafc0b22a0 tx=0x7faaf4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faaf97fa700 1 -- 172.21.15.36:0/2895767824 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaf4013620 con 0x7faafc0b43c0 2022-01-10T01:24:30.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faaf97fa700 1 -- 172.21.15.36:0/2895767824 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf4013780 con 0x7faafc0b43c0 2022-01-10T01:24:30.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7fab02749700 1 -- 172.21.15.36:0/2895767824 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faafc0b2380 con 0x7faafc0b43c0 2022-01-10T01:24:30.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faaf97fa700 1 -- 172.21.15.36:0/2895767824 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faaf4013ae0 con 0x7faafc0b43c0 2022-01-10T01:24:30.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7fab02749700 1 -- 172.21.15.36:0/2895767824 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faafc0b2d60 con 0x7faafc0b43c0 2022-01-10T01:24:30.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7fab02749700 1 -- 172.21.15.36:0/2895767824 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faafc146540 con 0x7faafc0b43c0 2022-01-10T01:24:30.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faaf97fa700 1 -- 172.21.15.36:0/2895767824 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7faaf4013c40 con 0x7faafc0b43c0 2022-01-10T01:24:30.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faaf97fa700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faadc053560 0x7faadc055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faaf97fa700 1 -- 172.21.15.36:0/2895767824 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7faaf406b8f0 con 0x7faafc0b43c0 2022-01-10T01:24:30.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.037+0000 7faafb7fe700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faadc053560 0x7faadc055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.041+0000 7faaf97fa700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.36:6826/14819,v1:172.21.15.36:6827/14819] conn(0x7faadc05afe0 0x7faadc05d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.041+0000 7faaf97fa700 1 -- 172.21.15.36:0/2895767824 --> [v2:172.21.15.36:6826/14819,v1:172.21.15.36:6827/14819] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faadc05da60 con 0x7faadc05afe0 2022-01-10T01:24:30.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.041+0000 7faaf97fa700 1 -- 172.21.15.36:0/2895767824 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7faaf4070240 con 0x7faafc0b43c0 2022-01-10T01:24:30.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.041+0000 7fab00ce6700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.36:6826/14819,v1:172.21.15.36:6827/14819] conn(0x7faadc05afe0 0x7faadc05d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.041+0000 7faafb7fe700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faadc053560 0x7faadc055a20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7faaf000b000 tx=0x7faaf0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.041+0000 7fab00ce6700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.36:6826/14819,v1:172.21.15.36:6827/14819] conn(0x7faadc05afe0 0x7faadc05d400 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.041+0000 7faaf97fa700 1 -- 172.21.15.36:0/2895767824 <== osd.1 v2:172.21.15.36:6826/14819 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7faadc05da60 con 0x7faadc05afe0 2022-01-10T01:24:30.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.057+0000 7fab02749700 1 -- 172.21.15.36:0/2895767824 --> [v2:172.21.15.36:6826/14819,v1:172.21.15.36:6827/14819] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faafc1528b0 con 0x7faadc05afe0 2022-01-10T01:24:30.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.057+0000 7faaf97fa700 1 -- 172.21.15.36:0/2895767824 <== osd.1 v2:172.21.15.36:6826/14819 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faafc1528b0 con 0x7faadc05afe0 2022-01-10T01:24:30.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.061+0000 7fab02749700 1 -- 172.21.15.36:0/2895767824 >> [v2:172.21.15.36:6826/14819,v1:172.21.15.36:6827/14819] conn(0x7faadc05afe0 msgr2=0x7faadc05d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.061+0000 7fab02749700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.36:6826/14819,v1:172.21.15.36:6827/14819] conn(0x7faadc05afe0 0x7faadc05d400 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.061+0000 7fab02749700 1 -- 172.21.15.36:0/2895767824 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faadc053560 msgr2=0x7faadc055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.061+0000 7fab02749700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faadc053560 0x7faadc055a20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7faaf000b000 tx=0x7faaf0009040).stop 2022-01-10T01:24:30.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.061+0000 7fab02749700 1 -- 172.21.15.36:0/2895767824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faafc0b43c0 msgr2=0x7faafc148d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.061+0000 7fab02749700 1 --2- 172.21.15.36:0/2895767824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faafc0b43c0 0x7faafc148d00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7faafc0b22a0 tx=0x7faaf4008040).stop 2022-01-10T01:24:30.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.061+0000 7fab00ce6700 1 -- 172.21.15.36:0/2895767824 reap_dead start 2022-01-10T01:24:30.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.061+0000 7fab02749700 1 -- 172.21.15.36:0/2895767824 shutdown_connections 2022-01-10T01:24:30.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.061+0000 7fab02749700 1 -- 172.21.15.36:0/2895767824 >> 172.21.15.36:0/2895767824 conn(0x7faafc05c490 msgr2=0x7faafc061c50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:30.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.061+0000 7fab02749700 1 -- 172.21.15.36:0/2895767824 shutdown_connections 2022-01-10T01:24:30.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.061+0000 7fab02749700 1 -- 172.21.15.36:0/2895767824 wait complete. 2022-01-10T01:24:30.079 INFO:teuthology.orchestra.run.smithi036.stdout:55834574854 2022-01-10T01:24:30.079 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2022-01-10T01:24:30.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.181+0000 7f3c56c81700 1 Processor -- start 2022-01-10T01:24:30.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.181+0000 7f3c56c81700 1 -- start start 2022-01-10T01:24:30.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3c500b04a0 0x7f3c500add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c500aa120 0x7f3c500ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c500b0880 0x7f3c50143710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c500b2af0 con 0x7f3c500b04a0 2022-01-10T01:24:30.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c500b2770 con 0x7f3c500b0880 2022-01-10T01:24:30.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c500b2d20 con 0x7f3c500aa120 2022-01-10T01:24:30.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c54a1d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3c500b04a0 0x7f3c500add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c4ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c500aa120 0x7f3c500ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c4ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c500aa120 0x7f3c500ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:40136/0 (socket says 172.21.15.36:40136) 2022-01-10T01:24:30.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c4ffff700 1 -- 172.21.15.36:0/1535950699 learned_addr learned my addr 172.21.15.36:0/1535950699 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:30.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c54a1d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3c500b04a0 0x7f3c500add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33856/0 (socket says 172.21.15.36:33856) 2022-01-10T01:24:30.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c5521e700 1 --2- 172.21.15.36:0/1535950699 >> v2:172.21.15.59:3300/0 conn(0x7f3c500b0880 0x7f3c50143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c4ffff700 1 -- 172.21.15.36:0/1535950699 >> v2:172.21.15.59:3300/0 conn(0x7f3c500b0880 msgr2=0x7f3c50143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:30.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c4ffff700 1 --2- 172.21.15.36:0/1535950699 >> v2:172.21.15.59:3300/0 conn(0x7f3c500b0880 0x7f3c50143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c4ffff700 1 -- 172.21.15.36:0/1535950699 >> v2:172.21.15.36:3300/0 conn(0x7f3c500b04a0 msgr2=0x7f3c500add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:30.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c4ffff700 1 --2- 172.21.15.36:0/1535950699 >> v2:172.21.15.36:3300/0 conn(0x7f3c500b04a0 0x7f3c500add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c4ffff700 1 -- 172.21.15.36:0/1535950699 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c500a9b70 con 0x7f3c500aa120 2022-01-10T01:24:30.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c4ffff700 1 --2- 172.21.15.36:0/1535950699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c500aa120 0x7f3c500ae220 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3c500b2a40 tx=0x7f3c40006eb0).ready entity=mon.2 client_cookie=d65abe29658da0dc server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c4f7fe700 1 -- 172.21.15.36:0/1535950699 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c4000e610 con 0x7f3c500aa120 2022-01-10T01:24:30.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c4f7fe700 1 -- 172.21.15.36:0/1535950699 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c40000e90 con 0x7f3c500aa120 2022-01-10T01:24:30.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c4f7fe700 1 -- 172.21.15.36:0/1535950699 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c4000e9a0 con 0x7f3c500aa120 2022-01-10T01:24:30.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 -- 172.21.15.36:0/1535950699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c500aa120 msgr2=0x7f3c500ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 --2- 172.21.15.36:0/1535950699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c500aa120 0x7f3c500ae220 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3c500b2a40 tx=0x7f3c40006eb0).stop 2022-01-10T01:24:30.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 -- 172.21.15.36:0/1535950699 shutdown_connections 2022-01-10T01:24:30.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 --2- 172.21.15.36:0/1535950699 >> v2:172.21.15.59:3300/0 conn(0x7f3c500b0880 0x7f3c50143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 --2- 172.21.15.36:0/1535950699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c500aa120 0x7f3c500ae220 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 --2- 172.21.15.36:0/1535950699 >> v2:172.21.15.36:3300/0 conn(0x7f3c500b04a0 0x7f3c500add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 -- 172.21.15.36:0/1535950699 >> 172.21.15.36:0/1535950699 conn(0x7f3c500607c0 msgr2=0x7f3c50060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:30.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 -- 172.21.15.36:0/1535950699 shutdown_connections 2022-01-10T01:24:30.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.185+0000 7f3c56c81700 1 -- 172.21.15.36:0/1535950699 wait complete. 2022-01-10T01:24:30.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c56c81700 1 Processor -- start 2022-01-10T01:24:30.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c56c81700 1 -- start start 2022-01-10T01:24:30.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c56c81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c500aa120 0x7f3c5013e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c56c81700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c500b04a0 0x7f3c5013ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c56c81700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c500b0880 0x7f3c5013b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c56c81700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5013b660 con 0x7f3c500b0880 2022-01-10T01:24:30.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c56c81700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5013a0f0 con 0x7f3c500b04a0 2022-01-10T01:24:30.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c56c81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c501395d0 con 0x7f3c500aa120 2022-01-10T01:24:30.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c5521e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c500b0880 0x7f3c5013b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c5521e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c500b0880 0x7f3c5013b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33862/0 (socket says 172.21.15.36:33862) 2022-01-10T01:24:30.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c5521e700 1 -- 172.21.15.36:0/2657571746 learned_addr learned my addr 172.21.15.36:0/2657571746 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:30.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c54a1d700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c500aa120 0x7f3c5013e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c4ffff700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c500b04a0 0x7f3c5013ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c5521e700 1 -- 172.21.15.36:0/2657571746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c500aa120 msgr2=0x7f3c5013e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c5521e700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c500aa120 0x7f3c5013e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c5521e700 1 -- 172.21.15.36:0/2657571746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c500b04a0 msgr2=0x7f3c5013ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c5521e700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c500b04a0 0x7f3c5013ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c5521e700 1 -- 172.21.15.36:0/2657571746 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4000b1e0 con 0x7f3c500b0880 2022-01-10T01:24:30.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c54a1d700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c500aa120 0x7f3c5013e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:30.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c5521e700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c500b0880 0x7f3c5013b170 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f3c48006e00 tx=0x7f3c480091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c4dffb700 1 -- 172.21.15.36:0/2657571746 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c48012600 con 0x7f3c500b0880 2022-01-10T01:24:30.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c4dffb700 1 -- 172.21.15.36:0/2657571746 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c48012760 con 0x7f3c500b0880 2022-01-10T01:24:30.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c56c81700 1 -- 172.21.15.36:0/2657571746 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c50139ad0 con 0x7f3c500b0880 2022-01-10T01:24:30.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c4dffb700 1 -- 172.21.15.36:0/2657571746 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c48012ac0 con 0x7f3c500b0880 2022-01-10T01:24:30.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.189+0000 7f3c56c81700 1 -- 172.21.15.36:0/2657571746 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c501515e0 con 0x7f3c500b0880 2022-01-10T01:24:30.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.193+0000 7f3c56c81700 1 -- 172.21.15.36:0/2657571746 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c50057350 con 0x7f3c500b0880 2022-01-10T01:24:30.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.193+0000 7f3c4dffb700 1 -- 172.21.15.36:0/2657571746 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3c48022070 con 0x7f3c500b0880 2022-01-10T01:24:30.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.193+0000 7f3c4dffb700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c34053560 0x7f3c34055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.193+0000 7f3c4dffb700 1 -- 172.21.15.36:0/2657571746 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3c4806c020 con 0x7f3c500b0880 2022-01-10T01:24:30.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.193+0000 7f3c54a1d700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c34053560 0x7f3c34055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.193+0000 7f3c4dffb700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.36:6810/14817,v1:172.21.15.36:6812/14817] conn(0x7f3c3405afe0 0x7f3c3405d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.193+0000 7f3c4dffb700 1 -- 172.21.15.36:0/2657571746 --> [v2:172.21.15.36:6810/14817,v1:172.21.15.36:6812/14817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c3405da60 con 0x7f3c3405afe0 2022-01-10T01:24:30.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.193+0000 7f3c4dffb700 1 -- 172.21.15.36:0/2657571746 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c4806e690 con 0x7f3c500b0880 2022-01-10T01:24:30.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.193+0000 7f3c4ffff700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.36:6810/14817,v1:172.21.15.36:6812/14817] conn(0x7f3c3405afe0 0x7f3c3405d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.193+0000 7f3c4ffff700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.36:6810/14817,v1:172.21.15.36:6812/14817] conn(0x7f3c3405afe0 0x7f3c3405d400 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.193+0000 7f3c54a1d700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c34053560 0x7f3c34055a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3c3800f000 tx=0x7f3c3800f040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.193+0000 7f3c4dffb700 1 -- 172.21.15.36:0/2657571746 <== osd.2 v2:172.21.15.36:6810/14817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f3c3405da60 con 0x7f3c3405afe0 2022-01-10T01:24:30.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.213+0000 7f3c56c81700 1 -- 172.21.15.36:0/2657571746 --> [v2:172.21.15.36:6810/14817,v1:172.21.15.36:6812/14817] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3c50139ed0 con 0x7f3c3405afe0 2022-01-10T01:24:30.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.213+0000 7f3c4dffb700 1 -- 172.21.15.36:0/2657571746 <== osd.2 v2:172.21.15.36:6810/14817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3c50139ed0 con 0x7f3c3405afe0 2022-01-10T01:24:30.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.213+0000 7f3c56c81700 1 -- 172.21.15.36:0/2657571746 >> [v2:172.21.15.36:6810/14817,v1:172.21.15.36:6812/14817] conn(0x7f3c3405afe0 msgr2=0x7f3c3405d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.213+0000 7f3c56c81700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.36:6810/14817,v1:172.21.15.36:6812/14817] conn(0x7f3c3405afe0 0x7f3c3405d400 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.213+0000 7f3c56c81700 1 -- 172.21.15.36:0/2657571746 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c34053560 msgr2=0x7f3c34055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.213+0000 7f3c56c81700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c34053560 0x7f3c34055a20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3c3800f000 tx=0x7f3c3800f040).stop 2022-01-10T01:24:30.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.213+0000 7f3c56c81700 1 -- 172.21.15.36:0/2657571746 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c500b0880 msgr2=0x7f3c5013b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.213+0000 7f3c56c81700 1 --2- 172.21.15.36:0/2657571746 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c500b0880 0x7f3c5013b170 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f3c48006e00 tx=0x7f3c480091d0).stop 2022-01-10T01:24:30.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.213+0000 7f3c5521e700 1 -- 172.21.15.36:0/2657571746 reap_dead start 2022-01-10T01:24:30.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.213+0000 7f3c56c81700 1 -- 172.21.15.36:0/2657571746 shutdown_connections 2022-01-10T01:24:30.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.213+0000 7f3c56c81700 1 -- 172.21.15.36:0/2657571746 >> 172.21.15.36:0/2657571746 conn(0x7f3c500607c0 msgr2=0x7f3c500b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:30.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.213+0000 7f3c56c81700 1 -- 172.21.15.36:0/2657571746 shutdown_connections 2022-01-10T01:24:30.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.213+0000 7f3c56c81700 1 -- 172.21.15.36:0/2657571746 wait complete. 2022-01-10T01:24:30.233 INFO:teuthology.orchestra.run.smithi036.stdout:55834574853 2022-01-10T01:24:30.234 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2022-01-10T01:24:30.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc6139c700 1 Processor -- start 2022-01-10T01:24:30.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc6139c700 1 -- start start 2022-01-10T01:24:30.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc6139c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc5c0b2580 0x7fdc5c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc6139c700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5c0a70c0 con 0x7fdc5c0b0010 2022-01-10T01:24:30.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc6139c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5c0a72f0 con 0x7fdc5c0a8ac0 2022-01-10T01:24:30.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc6139c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc5c0a7590 con 0x7fdc5c0b2580 2022-01-10T01:24:30.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5b7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fdc5c0b0010 0x7fdc5c0a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59896/0 (socket says 172.21.15.36:59896) 2022-01-10T01:24:30.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5b7fe700 1 -- 172.21.15.36:0/2575460148 learned_addr learned my addr 172.21.15.36:0/2575460148 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:30.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5bfff700 1 --2- 172.21.15.36:0/2575460148 >> v2:172.21.15.59:3300/0 conn(0x7fdc5c0b2580 0x7fdc5c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 -- 172.21.15.36:0/2575460148 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425644522 0 0) 0x7fdc5c0a70c0 con 0x7fdc5c0b0010 2022-01-10T01:24:30.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 -- 172.21.15.36:0/2575460148 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc48003260 con 0x7fdc5c0b0010 2022-01-10T01:24:30.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 -- 172.21.15.36:0/2575460148 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 410846841 0 0) 0x7fdc48003260 con 0x7fdc5c0b0010 2022-01-10T01:24:30.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 -- 172.21.15.36:0/2575460148 >> v2:172.21.15.59:3300/0 conn(0x7fdc5c0b2580 msgr2=0x7fdc5c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:30.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 --2- 172.21.15.36:0/2575460148 >> v2:172.21.15.59:3300/0 conn(0x7fdc5c0b2580 0x7fdc5c14ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 -- 172.21.15.36:0/2575460148 >> v1:172.21.15.59:6789/0 conn(0x7fdc5c0a8ac0 legacy=0x7fdc5c151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 -- 172.21.15.36:0/2575460148 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c0a7830 con 0x7fdc5c0b0010 2022-01-10T01:24:30.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 -- 172.21.15.36:0/2575460148 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fdc4c0019e0 con 0x7fdc5c0b0010 2022-01-10T01:24:30.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 -- 172.21.15.36:0/2575460148 >> v1:172.21.15.36:6789/0 conn(0x7fdc5c0b0010 legacy=0x7fdc5c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 --2- 172.21.15.36:0/2575460148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc48003750 0x7fdc48003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 --2- 172.21.15.36:0/2575460148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc48004500 0x7fdc48004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 --2- 172.21.15.36:0/2575460148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc48004e70 0x7fdc4800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 -- 172.21.15.36:0/2575460148 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c0a7590 con 0x7fdc48004e70 2022-01-10T01:24:30.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 -- 172.21.15.36:0/2575460148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4800bc70 con 0x7fdc48004500 2022-01-10T01:24:30.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc5affd700 1 -- 172.21.15.36:0/2575460148 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4800be30 con 0x7fdc48003750 2022-01-10T01:24:30.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.337+0000 7fdc60b9b700 1 --2- 172.21.15.36:0/2575460148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc48004e70 0x7fdc4800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc5b7fe700 1 --2- 172.21.15.36:0/2575460148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc48004500 0x7fdc48004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc5bfff700 1 --2- 172.21.15.36:0/2575460148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc48003750 0x7fdc48003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc60b9b700 1 -- 172.21.15.36:0/2575460148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc48003750 msgr2=0x7fdc48003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:30.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc60b9b700 1 --2- 172.21.15.36:0/2575460148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc48003750 0x7fdc48003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc60b9b700 1 -- 172.21.15.36:0/2575460148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc48004500 msgr2=0x7fdc48004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:30.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc60b9b700 1 --2- 172.21.15.36:0/2575460148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc48004500 0x7fdc48004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc60b9b700 1 -- 172.21.15.36:0/2575460148 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc48003260 con 0x7fdc48004e70 2022-01-10T01:24:30.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc60b9b700 1 -- 172.21.15.36:0/2575460148 reap_dead start 2022-01-10T01:24:30.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc60b9b700 1 --2- 172.21.15.36:0/2575460148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc48004e70 0x7fdc4800b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fdc54001020 tx=0x7fdc540079e0).ready entity=mon.0 client_cookie=5e1feaca0a60e52f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc5affd700 1 -- 172.21.15.36:0/2575460148 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc54007cf0 con 0x7fdc48004e70 2022-01-10T01:24:30.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc5affd700 1 -- 172.21.15.36:0/2575460148 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc54013400 con 0x7fdc48004e70 2022-01-10T01:24:30.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc5affd700 1 -- 172.21.15.36:0/2575460148 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc54013760 con 0x7fdc48004e70 2022-01-10T01:24:30.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc6139c700 1 -- 172.21.15.36:0/2575460148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc48004e70 msgr2=0x7fdc4800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc6139c700 1 --2- 172.21.15.36:0/2575460148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc48004e70 0x7fdc4800b750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fdc54001020 tx=0x7fdc540079e0).stop 2022-01-10T01:24:30.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc6139c700 1 -- 172.21.15.36:0/2575460148 shutdown_connections 2022-01-10T01:24:30.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc6139c700 1 --2- 172.21.15.36:0/2575460148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc48004e70 0x7fdc4800b750 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc6139c700 1 -- 172.21.15.36:0/2575460148 >> 172.21.15.36:0/2575460148 conn(0x7fdc5c060180 msgr2=0x7fdc5c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:30.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc6139c700 1 -- 172.21.15.36:0/2575460148 shutdown_connections 2022-01-10T01:24:30.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc6139c700 1 -- 172.21.15.36:0/2575460148 wait complete. 2022-01-10T01:24:30.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc6139c700 1 Processor -- start 2022-01-10T01:24:30.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.341+0000 7fdc6139c700 1 -- start start 2022-01-10T01:24:30.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc6139c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc48004e70 0x7fdc5c0ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc6139c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc5c063c50 0x7fdc5c065460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc6139c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc5c0b5240 0x7fdc5c065950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc6139c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c0b4690 con 0x7fdc5c063c50 2022-01-10T01:24:30.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc6139c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c065e40 con 0x7fdc5c0b5240 2022-01-10T01:24:30.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc6139c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c0b57c0 con 0x7fdc48004e70 2022-01-10T01:24:30.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc5b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc5c063c50 0x7fdc5c065460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc5b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc5c063c50 0x7fdc5c065460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33884/0 (socket says 172.21.15.36:33884) 2022-01-10T01:24:30.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc5b7fe700 1 -- 172.21.15.36:0/899360388 learned_addr learned my addr 172.21.15.36:0/899360388 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:30.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc5bfff700 1 --2- 172.21.15.36:0/899360388 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc48004e70 0x7fdc5c0ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc60b9b700 1 --2- 172.21.15.36:0/899360388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc5c0b5240 0x7fdc5c065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc5b7fe700 1 -- 172.21.15.36:0/899360388 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc48004e70 msgr2=0x7fdc5c0ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc5b7fe700 1 --2- 172.21.15.36:0/899360388 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc48004e70 0x7fdc5c0ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc5b7fe700 1 -- 172.21.15.36:0/899360388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc5c0b5240 msgr2=0x7fdc5c065950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc5b7fe700 1 --2- 172.21.15.36:0/899360388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc5c0b5240 0x7fdc5c065950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc5b7fe700 1 -- 172.21.15.36:0/899360388 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5c0b48c0 con 0x7fdc5c063c50 2022-01-10T01:24:30.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc5b7fe700 1 --2- 172.21.15.36:0/899360388 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc5c063c50 0x7fdc5c065460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fdc4c00d000 tx=0x7fdc5c0a79c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc597fa700 1 -- 172.21.15.36:0/899360388 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc4c00f7e0 con 0x7fdc5c063c50 2022-01-10T01:24:30.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc597fa700 1 -- 172.21.15.36:0/899360388 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c00f940 con 0x7fdc5c063c50 2022-01-10T01:24:30.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc6139c700 1 -- 172.21.15.36:0/899360388 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5c0af0b0 con 0x7fdc5c063c50 2022-01-10T01:24:30.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc597fa700 1 -- 172.21.15.36:0/899360388 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc4c00fca0 con 0x7fdc5c063c50 2022-01-10T01:24:30.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc6139c700 1 -- 172.21.15.36:0/899360388 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5c159b70 con 0x7fdc5c063c50 2022-01-10T01:24:30.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc6139c700 1 -- 172.21.15.36:0/899360388 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdc5c0b4a50 con 0x7fdc5c063c50 2022-01-10T01:24:30.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.345+0000 7fdc597fa700 1 -- 172.21.15.36:0/899360388 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fdc4c01b030 con 0x7fdc5c063c50 2022-01-10T01:24:30.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.349+0000 7fdc597fa700 1 --2- 172.21.15.36:0/899360388 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdc3c0535f0 0x7fdc3c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.349+0000 7fdc597fa700 1 -- 172.21.15.36:0/899360388 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fdc4c06b730 con 0x7fdc5c063c50 2022-01-10T01:24:30.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.349+0000 7fdc5bfff700 1 --2- 172.21.15.36:0/899360388 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdc3c0535f0 0x7fdc3c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.349+0000 7fdc597fa700 1 --2- 172.21.15.36:0/899360388 >> [v2:172.21.15.36:6811/14836,v1:172.21.15.36:6813/14836] conn(0x7fdc3c05b070 0x7fdc3c05d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.349+0000 7fdc597fa700 1 -- 172.21.15.36:0/899360388 --> [v2:172.21.15.36:6811/14836,v1:172.21.15.36:6813/14836] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc3c05da50 con 0x7fdc3c05b070 2022-01-10T01:24:30.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.349+0000 7fdc597fa700 1 -- 172.21.15.36:0/899360388 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc4c06dda0 con 0x7fdc5c063c50 2022-01-10T01:24:30.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.349+0000 7fdc60b9b700 1 --2- 172.21.15.36:0/899360388 >> [v2:172.21.15.36:6811/14836,v1:172.21.15.36:6813/14836] conn(0x7fdc3c05b070 0x7fdc3c05d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.349+0000 7fdc5bfff700 1 --2- 172.21.15.36:0/899360388 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdc3c0535f0 0x7fdc3c055ab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fdc5000b000 tx=0x7fdc50008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.349+0000 7fdc60b9b700 1 --2- 172.21.15.36:0/899360388 >> [v2:172.21.15.36:6811/14836,v1:172.21.15.36:6813/14836] conn(0x7fdc3c05b070 0x7fdc3c05d490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.349+0000 7fdc597fa700 1 -- 172.21.15.36:0/899360388 <== osd.3 v2:172.21.15.36:6811/14836 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fdc3c05da50 con 0x7fdc3c05b070 2022-01-10T01:24:30.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.369+0000 7fdc6139c700 1 -- 172.21.15.36:0/899360388 --> [v2:172.21.15.36:6811/14836,v1:172.21.15.36:6813/14836] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdc5c057350 con 0x7fdc3c05b070 2022-01-10T01:24:30.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.369+0000 7fdc597fa700 1 -- 172.21.15.36:0/899360388 <== osd.3 v2:172.21.15.36:6811/14836 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdc5c057350 con 0x7fdc3c05b070 2022-01-10T01:24:30.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.369+0000 7fdc6139c700 1 -- 172.21.15.36:0/899360388 >> [v2:172.21.15.36:6811/14836,v1:172.21.15.36:6813/14836] conn(0x7fdc3c05b070 msgr2=0x7fdc3c05d490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.369+0000 7fdc6139c700 1 --2- 172.21.15.36:0/899360388 >> [v2:172.21.15.36:6811/14836,v1:172.21.15.36:6813/14836] conn(0x7fdc3c05b070 0x7fdc3c05d490 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.369+0000 7fdc6139c700 1 -- 172.21.15.36:0/899360388 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdc3c0535f0 msgr2=0x7fdc3c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.369+0000 7fdc6139c700 1 --2- 172.21.15.36:0/899360388 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdc3c0535f0 0x7fdc3c055ab0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fdc5000b000 tx=0x7fdc50008040).stop 2022-01-10T01:24:30.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.369+0000 7fdc6139c700 1 -- 172.21.15.36:0/899360388 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc5c063c50 msgr2=0x7fdc5c065460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.369+0000 7fdc6139c700 1 --2- 172.21.15.36:0/899360388 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc5c063c50 0x7fdc5c065460 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fdc4c00d000 tx=0x7fdc5c0a79c0).stop 2022-01-10T01:24:30.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.369+0000 7fdc60b9b700 1 -- 172.21.15.36:0/899360388 reap_dead start 2022-01-10T01:24:30.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.369+0000 7fdc6139c700 1 -- 172.21.15.36:0/899360388 shutdown_connections 2022-01-10T01:24:30.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.369+0000 7fdc6139c700 1 -- 172.21.15.36:0/899360388 >> 172.21.15.36:0/899360388 conn(0x7fdc5c060180 msgr2=0x7fdc5c1486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:30.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.369+0000 7fdc6139c700 1 -- 172.21.15.36:0/899360388 shutdown_connections 2022-01-10T01:24:30.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.369+0000 7fdc6139c700 1 -- 172.21.15.36:0/899360388 wait complete. 2022-01-10T01:24:30.386 INFO:teuthology.orchestra.run.smithi036.stdout:55834574853 2022-01-10T01:24:30.386 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2022-01-10T01:24:30.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.493+0000 7f702bfff700 1 Processor -- start 2022-01-10T01:24:30.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.493+0000 7f702bfff700 1 -- start start 2022-01-10T01:24:30.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.493+0000 7f702bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f702c13d820 0x7f702c060830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.493+0000 7f702bfff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702c066960 con 0x7f702c0b6380 2022-01-10T01:24:30.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.493+0000 7f702bfff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702c066c00 con 0x7f702c0b0cd0 2022-01-10T01:24:30.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.493+0000 7f702bfff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702c066ea0 con 0x7f702c13d820 2022-01-10T01:24:30.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.493+0000 7f702affd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f702c0b6380 0x7f702c13d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59918/0 (socket says 172.21.15.36:59918) 2022-01-10T01:24:30.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.493+0000 7f702affd700 1 -- 172.21.15.36:0/270001195 learned_addr learned my addr 172.21.15.36:0/270001195 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:30.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.493+0000 7f70227fc700 1 --2- 172.21.15.36:0/270001195 >> v2:172.21.15.59:3300/0 conn(0x7f702c13d820 0x7f702c060830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702a7fc700 1 -- 172.21.15.36:0/270001195 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201446539 0 0) 0x7f702c066960 con 0x7f702c0b6380 2022-01-10T01:24:30.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702a7fc700 1 -- 172.21.15.36:0/270001195 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f700c003260 con 0x7f702c0b6380 2022-01-10T01:24:30.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f70227fc700 1 -- 172.21.15.36:0/270001195 >> v1:172.21.15.59:6789/0 conn(0x7f702c0b0cd0 legacy=0x7f702c060d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f70227fc700 1 -- 172.21.15.36:0/270001195 >> v1:172.21.15.36:6789/0 conn(0x7f702c0b6380 legacy=0x7f702c13d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702a7fc700 1 -- 172.21.15.36:0/270001195 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3977854415 0 0) 0x7f700c003260 con 0x7f702c0b6380 2022-01-10T01:24:30.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f70227fc700 1 -- 172.21.15.36:0/270001195 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c067140 con 0x7f702c13d820 2022-01-10T01:24:30.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f70227fc700 1 --2- 172.21.15.36:0/270001195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f702c13d820 0x7f702c060830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7014002f70 tx=0x7f7014006df0).ready entity=mon.1 client_cookie=e4c46d40a4b352f0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702a7fc700 1 -- 172.21.15.36:0/270001195 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f701400d610 con 0x7f702c13d820 2022-01-10T01:24:30.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702a7fc700 1 -- 172.21.15.36:0/270001195 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7014000e90 con 0x7f702c13d820 2022-01-10T01:24:30.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702a7fc700 1 -- 172.21.15.36:0/270001195 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f701400d960 con 0x7f702c13d820 2022-01-10T01:24:30.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 -- 172.21.15.36:0/270001195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f702c13d820 msgr2=0x7f702c060830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 --2- 172.21.15.36:0/270001195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f702c13d820 0x7f702c060830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7014002f70 tx=0x7f7014006df0).stop 2022-01-10T01:24:30.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 -- 172.21.15.36:0/270001195 shutdown_connections 2022-01-10T01:24:30.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 --2- 172.21.15.36:0/270001195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f702c13d820 0x7f702c060830 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 -- 172.21.15.36:0/270001195 >> 172.21.15.36:0/270001195 conn(0x7f702c063670 msgr2=0x7f702c063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:30.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 -- 172.21.15.36:0/270001195 shutdown_connections 2022-01-10T01:24:30.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 -- 172.21.15.36:0/270001195 wait complete. 2022-01-10T01:24:30.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 Processor -- start 2022-01-10T01:24:30.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 -- start start 2022-01-10T01:24:30.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f702c0b0cd0 0x7f702c0af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f702c0b6380 0x7f702c152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f702c13d820 0x7f702c0ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c142060 con 0x7f702c0b6380 2022-01-10T01:24:30.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c141b50 con 0x7f702c13d820 2022-01-10T01:24:30.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.497+0000 7f702bfff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702c141dc0 con 0x7f702c0b0cd0 2022-01-10T01:24:30.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f70227fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f702c0b6380 0x7f702c152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f702b7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f702c13d820 0x7f702c0ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f70227fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f702c0b6380 0x7f702c152d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33900/0 (socket says 172.21.15.36:33900) 2022-01-10T01:24:30.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f70227fc700 1 -- 172.21.15.36:0/3022340701 learned_addr learned my addr 172.21.15.36:0/3022340701 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:30.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f702affd700 1 --2- 172.21.15.36:0/3022340701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f702c0b0cd0 0x7f702c0af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f70227fc700 1 -- 172.21.15.36:0/3022340701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f702c0b0cd0 msgr2=0x7f702c0af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f70227fc700 1 --2- 172.21.15.36:0/3022340701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f702c0b0cd0 0x7f702c0af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f70227fc700 1 -- 172.21.15.36:0/3022340701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f702c13d820 msgr2=0x7f702c0ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f70227fc700 1 --2- 172.21.15.36:0/3022340701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f702c13d820 0x7f702c0ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f70227fc700 1 -- 172.21.15.36:0/3022340701 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701400b180 con 0x7f702c0b6380 2022-01-10T01:24:30.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f70227fc700 1 --2- 172.21.15.36:0/3022340701 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f702c0b6380 0x7f702c152d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f7014002f70 tx=0x7f7014014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f7028ff9700 1 -- 172.21.15.36:0/3022340701 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7014016070 con 0x7f702c0b6380 2022-01-10T01:24:30.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f7028ff9700 1 -- 172.21.15.36:0/3022340701 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701400de90 con 0x7f702c0b6380 2022-01-10T01:24:30.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f702bfff700 1 -- 172.21.15.36:0/3022340701 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c1525c0 con 0x7f702c0b6380 2022-01-10T01:24:30.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f7028ff9700 1 -- 172.21.15.36:0/3022340701 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7014013d20 con 0x7f702c0b6380 2022-01-10T01:24:30.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f702bfff700 1 -- 172.21.15.36:0/3022340701 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702c152310 con 0x7f702c0b6380 2022-01-10T01:24:30.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f702bfff700 1 -- 172.21.15.36:0/3022340701 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f702c152a60 con 0x7f702c0b6380 2022-01-10T01:24:30.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f7028ff9700 1 -- 172.21.15.36:0/3022340701 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7014025030 con 0x7f702c0b6380 2022-01-10T01:24:30.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f7028ff9700 1 --2- 172.21.15.36:0/3022340701 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f70100536b0 0x7f7010055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f7028ff9700 1 -- 172.21.15.36:0/3022340701 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f701406c820 con 0x7f702c0b6380 2022-01-10T01:24:30.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f702affd700 1 --2- 172.21.15.36:0/3022340701 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f70100536b0 0x7f7010055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f7028ff9700 1 --2- 172.21.15.36:0/3022340701 >> [v2:172.21.15.59:6800/15004,v1:172.21.15.59:6801/15004] conn(0x7f701005b130 0x7f701005d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f7028ff9700 1 -- 172.21.15.36:0/3022340701 --> [v2:172.21.15.59:6800/15004,v1:172.21.15.59:6801/15004] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f701005db10 con 0x7f701005b130 2022-01-10T01:24:30.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f7028ff9700 1 -- 172.21.15.36:0/3022340701 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7014071240 con 0x7f702c0b6380 2022-01-10T01:24:30.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f702b7fe700 1 --2- 172.21.15.36:0/3022340701 >> [v2:172.21.15.59:6800/15004,v1:172.21.15.59:6801/15004] conn(0x7f701005b130 0x7f701005d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.501+0000 7f702affd700 1 --2- 172.21.15.36:0/3022340701 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f70100536b0 0x7f7010055b70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f701c00d000 tx=0x7f701c0079c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.505+0000 7f702b7fe700 1 --2- 172.21.15.36:0/3022340701 >> [v2:172.21.15.59:6800/15004,v1:172.21.15.59:6801/15004] conn(0x7f701005b130 0x7f701005d550 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.505+0000 7f7028ff9700 1 -- 172.21.15.36:0/3022340701 <== osd.4 v2:172.21.15.59:6800/15004 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f701005db10 con 0x7f701005b130 2022-01-10T01:24:30.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.525+0000 7f702bfff700 1 -- 172.21.15.36:0/3022340701 --> [v2:172.21.15.59:6800/15004,v1:172.21.15.59:6801/15004] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f702c057350 con 0x7f701005b130 2022-01-10T01:24:30.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.525+0000 7f7028ff9700 1 -- 172.21.15.36:0/3022340701 <== osd.4 v2:172.21.15.59:6800/15004 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f702c057350 con 0x7f701005b130 2022-01-10T01:24:30.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.525+0000 7f702bfff700 1 -- 172.21.15.36:0/3022340701 >> [v2:172.21.15.59:6800/15004,v1:172.21.15.59:6801/15004] conn(0x7f701005b130 msgr2=0x7f701005d550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.525+0000 7f702bfff700 1 --2- 172.21.15.36:0/3022340701 >> [v2:172.21.15.59:6800/15004,v1:172.21.15.59:6801/15004] conn(0x7f701005b130 0x7f701005d550 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.525+0000 7f702bfff700 1 -- 172.21.15.36:0/3022340701 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f70100536b0 msgr2=0x7f7010055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.525+0000 7f702bfff700 1 --2- 172.21.15.36:0/3022340701 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f70100536b0 0x7f7010055b70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f701c00d000 tx=0x7f701c0079c0).stop 2022-01-10T01:24:30.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.525+0000 7f702bfff700 1 -- 172.21.15.36:0/3022340701 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f702c0b6380 msgr2=0x7f702c152d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.525+0000 7f702bfff700 1 --2- 172.21.15.36:0/3022340701 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f702c0b6380 0x7f702c152d00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f7014002f70 tx=0x7f7014014000).stop 2022-01-10T01:24:30.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.525+0000 7f702b7fe700 1 -- 172.21.15.36:0/3022340701 reap_dead start 2022-01-10T01:24:30.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.529+0000 7f702bfff700 1 -- 172.21.15.36:0/3022340701 shutdown_connections 2022-01-10T01:24:30.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.529+0000 7f702bfff700 1 -- 172.21.15.36:0/3022340701 >> 172.21.15.36:0/3022340701 conn(0x7f702c063670 msgr2=0x7f702c0b3ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:30.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.529+0000 7f702bfff700 1 -- 172.21.15.36:0/3022340701 shutdown_connections 2022-01-10T01:24:30.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.529+0000 7f702bfff700 1 -- 172.21.15.36:0/3022340701 wait complete. 2022-01-10T01:24:30.549 INFO:teuthology.orchestra.run.smithi036.stdout:55834574854 2022-01-10T01:24:30.549 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2022-01-10T01:24:30.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.657+0000 7fcc3f1c3700 1 Processor -- start 2022-01-10T01:24:30.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.657+0000 7fcc3f1c3700 1 -- start start 2022-01-10T01:24:30.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3f1c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc380ac510 0x7fcc3814ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3f1c3700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc38145250 con 0x7fcc380b2200 2022-01-10T01:24:30.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3f1c3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc381454f0 con 0x7fcc380affd0 2022-01-10T01:24:30.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3f1c3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc38141200 con 0x7fcc380ac510 2022-01-10T01:24:30.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3cf5f700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fcc380b2200 0x7fcc380abe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59932/0 (socket says 172.21.15.36:59932) 2022-01-10T01:24:30.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3cf5f700 1 -- 172.21.15.36:0/1516011159 learned_addr learned my addr 172.21.15.36:0/1516011159 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:30.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3d760700 1 --2- 172.21.15.36:0/1516011159 >> v2:172.21.15.59:3300/0 conn(0x7fcc380ac510 0x7fcc3814ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc377fe700 1 -- 172.21.15.36:0/1516011159 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162566223 0 0) 0x7fcc38145250 con 0x7fcc380b2200 2022-01-10T01:24:30.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc377fe700 1 -- 172.21.15.36:0/1516011159 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc24003260 con 0x7fcc380b2200 2022-01-10T01:24:30.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc377fe700 1 -- 172.21.15.36:0/1516011159 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761055517 0 0) 0x7fcc381454f0 con 0x7fcc380affd0 2022-01-10T01:24:30.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3d760700 1 -- 172.21.15.36:0/1516011159 >> v1:172.21.15.59:6789/0 conn(0x7fcc380affd0 legacy=0x7fcc381416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3d760700 1 -- 172.21.15.36:0/1516011159 >> v1:172.21.15.36:6789/0 conn(0x7fcc380b2200 legacy=0x7fcc380abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3d760700 1 -- 172.21.15.36:0/1516011159 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc380b04e0 con 0x7fcc380ac510 2022-01-10T01:24:30.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3d760700 1 --2- 172.21.15.36:0/1516011159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc380ac510 0x7fcc3814ca70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fcc300032f0 tx=0x7fcc300091d0).ready entity=mon.1 client_cookie=c4c47698e97dabe7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc377fe700 1 -- 172.21.15.36:0/1516011159 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc3000b6c0 con 0x7fcc380ac510 2022-01-10T01:24:30.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc377fe700 1 -- 172.21.15.36:0/1516011159 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3000b820 con 0x7fcc380ac510 2022-01-10T01:24:30.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc377fe700 1 -- 172.21.15.36:0/1516011159 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc3000b990 con 0x7fcc380ac510 2022-01-10T01:24:30.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1516011159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc380ac510 msgr2=0x7fcc3814ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3f1c3700 1 --2- 172.21.15.36:0/1516011159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc380ac510 0x7fcc3814ca70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fcc300032f0 tx=0x7fcc300091d0).stop 2022-01-10T01:24:30.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1516011159 shutdown_connections 2022-01-10T01:24:30.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3f1c3700 1 --2- 172.21.15.36:0/1516011159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc380ac510 0x7fcc3814ca70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1516011159 >> 172.21.15.36:0/1516011159 conn(0x7fcc3805f6b0 msgr2=0x7fcc3805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:30.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1516011159 shutdown_connections 2022-01-10T01:24:30.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.661+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1516011159 wait complete. 2022-01-10T01:24:30.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc3f1c3700 1 Processor -- start 2022-01-10T01:24:30.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc3f1c3700 1 -- start start 2022-01-10T01:24:30.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc3f1c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc380ac510 0x7fcc38140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc3f1c3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcc380affd0 0x7fcc381502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc3f1c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc380b2200 0x7fcc381484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc3f1c3700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc381507c0 con 0x7fcc380affd0 2022-01-10T01:24:30.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc3f1c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc380b5070 con 0x7fcc380ac510 2022-01-10T01:24:30.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc3f1c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc38147d80 con 0x7fcc380b2200 2022-01-10T01:24:30.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc37fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcc380affd0 0x7fcc381502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc37fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcc380affd0 0x7fcc381502d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33914/0 (socket says 172.21.15.36:33914) 2022-01-10T01:24:30.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc37fff700 1 -- 172.21.15.36:0/1532935718 learned_addr learned my addr 172.21.15.36:0/1532935718 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:30.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc3d760700 1 --2- 172.21.15.36:0/1532935718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc380b2200 0x7fcc381484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc3cf5f700 1 --2- 172.21.15.36:0/1532935718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc380ac510 0x7fcc38140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc37fff700 1 -- 172.21.15.36:0/1532935718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc380b2200 msgr2=0x7fcc381484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc37fff700 1 --2- 172.21.15.36:0/1532935718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc380b2200 0x7fcc381484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc37fff700 1 -- 172.21.15.36:0/1532935718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc380ac510 msgr2=0x7fcc38140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc37fff700 1 --2- 172.21.15.36:0/1532935718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc380ac510 0x7fcc38140960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc37fff700 1 -- 172.21.15.36:0/1532935718 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc30009470 con 0x7fcc380affd0 2022-01-10T01:24:30.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc37fff700 1 --2- 172.21.15.36:0/1532935718 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcc380affd0 0x7fcc381502d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fcc28000ed0 tx=0x7fcc28007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.665+0000 7fcc35ffb700 1 -- 172.21.15.36:0/1532935718 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc28012400 con 0x7fcc380affd0 2022-01-10T01:24:30.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc35ffb700 1 -- 172.21.15.36:0/1532935718 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc28012560 con 0x7fcc380affd0 2022-01-10T01:24:30.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1532935718 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc38148020 con 0x7fcc380affd0 2022-01-10T01:24:30.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc35ffb700 1 -- 172.21.15.36:0/1532935718 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc280128c0 con 0x7fcc380affd0 2022-01-10T01:24:30.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1532935718 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc381489b0 con 0x7fcc380affd0 2022-01-10T01:24:30.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc35ffb700 1 -- 172.21.15.36:0/1532935718 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fcc28019030 con 0x7fcc380affd0 2022-01-10T01:24:30.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1532935718 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcc38147c00 con 0x7fcc380affd0 2022-01-10T01:24:30.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc35ffb700 1 --2- 172.21.15.36:0/1532935718 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcc180536b0 0x7fcc18055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc35ffb700 1 -- 172.21.15.36:0/1532935718 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fcc2806ac30 con 0x7fcc380affd0 2022-01-10T01:24:30.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc3cf5f700 1 --2- 172.21.15.36:0/1532935718 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcc180536b0 0x7fcc18055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc35ffb700 1 --2- 172.21.15.36:0/1532935718 >> [v2:172.21.15.59:6816/15003,v1:172.21.15.59:6817/15003] conn(0x7fcc1805b0b0 0x7fcc1805d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc35ffb700 1 -- 172.21.15.36:0/1532935718 --> [v2:172.21.15.59:6816/15003,v1:172.21.15.59:6817/15003] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc1805da90 con 0x7fcc1805b0b0 2022-01-10T01:24:30.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc35ffb700 1 -- 172.21.15.36:0/1532935718 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc28041c90 con 0x7fcc380affd0 2022-01-10T01:24:30.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc3d760700 1 --2- 172.21.15.36:0/1532935718 >> [v2:172.21.15.59:6816/15003,v1:172.21.15.59:6817/15003] conn(0x7fcc1805b0b0 0x7fcc1805d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc3cf5f700 1 --2- 172.21.15.36:0/1532935718 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcc180536b0 0x7fcc18055b70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fcc2c00d000 tx=0x7fcc2c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.669+0000 7fcc3d760700 1 --2- 172.21.15.36:0/1532935718 >> [v2:172.21.15.59:6816/15003,v1:172.21.15.59:6817/15003] conn(0x7fcc1805b0b0 0x7fcc1805d4d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.673+0000 7fcc35ffb700 1 -- 172.21.15.36:0/1532935718 <== osd.5 v2:172.21.15.59:6816/15003 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fcc1805da90 con 0x7fcc1805b0b0 2022-01-10T01:24:30.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.689+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1532935718 --> [v2:172.21.15.59:6816/15003,v1:172.21.15.59:6817/15003] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcc380b46f0 con 0x7fcc1805b0b0 2022-01-10T01:24:30.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.689+0000 7fcc35ffb700 1 -- 172.21.15.36:0/1532935718 <== osd.5 v2:172.21.15.59:6816/15003 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcc380b46f0 con 0x7fcc1805b0b0 2022-01-10T01:24:30.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.689+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1532935718 >> [v2:172.21.15.59:6816/15003,v1:172.21.15.59:6817/15003] conn(0x7fcc1805b0b0 msgr2=0x7fcc1805d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.689+0000 7fcc3f1c3700 1 --2- 172.21.15.36:0/1532935718 >> [v2:172.21.15.59:6816/15003,v1:172.21.15.59:6817/15003] conn(0x7fcc1805b0b0 0x7fcc1805d4d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.689+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1532935718 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcc180536b0 msgr2=0x7fcc18055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.689+0000 7fcc3f1c3700 1 --2- 172.21.15.36:0/1532935718 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcc180536b0 0x7fcc18055b70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fcc2c00d000 tx=0x7fcc2c009040).stop 2022-01-10T01:24:30.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.689+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1532935718 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcc380affd0 msgr2=0x7fcc381502d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.689+0000 7fcc3f1c3700 1 --2- 172.21.15.36:0/1532935718 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcc380affd0 0x7fcc381502d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fcc28000ed0 tx=0x7fcc28007ac0).stop 2022-01-10T01:24:30.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.689+0000 7fcc3d760700 1 -- 172.21.15.36:0/1532935718 reap_dead start 2022-01-10T01:24:30.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.689+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1532935718 shutdown_connections 2022-01-10T01:24:30.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.689+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1532935718 >> 172.21.15.36:0/1532935718 conn(0x7fcc3805f6b0 msgr2=0x7fcc381460c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:30.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.689+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1532935718 shutdown_connections 2022-01-10T01:24:30.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.689+0000 7fcc3f1c3700 1 -- 172.21.15.36:0/1532935718 wait complete. 2022-01-10T01:24:30.708 INFO:teuthology.orchestra.run.smithi036.stdout:55834574853 2022-01-10T01:24:30.708 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2022-01-10T01:24:30.724 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:24:30.727 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:24:30.729 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:24:30.732 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:24:30.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 Processor -- start 2022-01-10T01:24:30.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 -- start start 2022-01-10T01:24:30.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f71cc0b1db0 0x7f71cc0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc1483a0 0x7f71cc0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f71cc0a70c0 0x7f71cc144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71cc0a90c0 con 0x7f71cc0a70c0 2022-01-10T01:24:30.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71cc0b0350 con 0x7f71cc0b1db0 2022-01-10T01:24:30.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc0b05f0 con 0x7f71cc1483a0 2022-01-10T01:24:30.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71cad9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f71cc0a70c0 0x7f71cc144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71cad9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f71cc0a70c0 0x7f71cc144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33924/0 (socket says 172.21.15.36:33924) 2022-01-10T01:24:30.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71cad9d700 1 -- 172.21.15.36:0/1965590384 learned_addr learned my addr 172.21.15.36:0/1965590384 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:30.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71ca59c700 1 --2- 172.21.15.36:0/1965590384 >> v2:172.21.15.59:3300/0 conn(0x7f71cc0b1db0 0x7f71cc0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71c9d9b700 1 --2- 172.21.15.36:0/1965590384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc1483a0 0x7f71cc0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71cad9d700 1 -- 172.21.15.36:0/1965590384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc1483a0 msgr2=0x7f71cc0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:30.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71cad9d700 1 --2- 172.21.15.36:0/1965590384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc1483a0 0x7f71cc0b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71cad9d700 1 -- 172.21.15.36:0/1965590384 >> v2:172.21.15.59:3300/0 conn(0x7f71cc0b1db0 msgr2=0x7f71cc0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:30.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71cad9d700 1 --2- 172.21.15.36:0/1965590384 >> v2:172.21.15.59:3300/0 conn(0x7f71cc0b1db0 0x7f71cc0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71cad9d700 1 -- 172.21.15.36:0/1965590384 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc0b0890 con 0x7f71cc0a70c0 2022-01-10T01:24:30.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71ca59c700 1 --2- 172.21.15.36:0/1965590384 >> v2:172.21.15.59:3300/0 conn(0x7f71cc0b1db0 0x7f71cc0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:30.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71cad9d700 1 --2- 172.21.15.36:0/1965590384 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71cc0a70c0 0x7f71cc144720 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f71c40032f0 tx=0x7f71c4009290).ready entity=mon.0 client_cookie=3180d5123c46c4ed server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71c959a700 1 -- 172.21.15.36:0/1965590384 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c400b870 con 0x7f71cc0a70c0 2022-01-10T01:24:30.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71c959a700 1 -- 172.21.15.36:0/1965590384 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c400b9d0 con 0x7f71cc0a70c0 2022-01-10T01:24:30.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71c959a700 1 -- 172.21.15.36:0/1965590384 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c400bb40 con 0x7f71cc0a70c0 2022-01-10T01:24:30.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 -- 172.21.15.36:0/1965590384 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71cc0a70c0 msgr2=0x7f71cc144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 --2- 172.21.15.36:0/1965590384 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71cc0a70c0 0x7f71cc144720 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f71c40032f0 tx=0x7f71c4009290).stop 2022-01-10T01:24:30.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 -- 172.21.15.36:0/1965590384 shutdown_connections 2022-01-10T01:24:30.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 --2- 172.21.15.36:0/1965590384 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71cc0a70c0 0x7f71cc144720 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 --2- 172.21.15.36:0/1965590384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc1483a0 0x7f71cc0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 --2- 172.21.15.36:0/1965590384 >> v2:172.21.15.59:3300/0 conn(0x7f71cc0b1db0 0x7f71cc0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 -- 172.21.15.36:0/1965590384 >> 172.21.15.36:0/1965590384 conn(0x7f71cc05f6b0 msgr2=0x7f71cc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:30.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 -- 172.21.15.36:0/1965590384 shutdown_connections 2022-01-10T01:24:30.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.813+0000 7f71d0818700 1 -- 172.21.15.36:0/1965590384 wait complete. 2022-01-10T01:24:30.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71d0818700 1 Processor -- start 2022-01-10T01:24:30.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71d0818700 1 -- start start 2022-01-10T01:24:30.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71d0818700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc0a70c0 0x7f71cc14b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71d0818700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc0b1db0 0x7f71cc0ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71d0818700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71cc1483a0 0x7f71cc0abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71d0818700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc14a100 con 0x7f71cc1483a0 2022-01-10T01:24:30.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71d0818700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc149b10 con 0x7f71cc0b1db0 2022-01-10T01:24:30.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71d0818700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc149110 con 0x7f71cc0a70c0 2022-01-10T01:24:30.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71cad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71cc1483a0 0x7f71cc0abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71cad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71cc1483a0 0x7f71cc0abd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33932/0 (socket says 172.21.15.36:33932) 2022-01-10T01:24:30.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71cad9d700 1 -- 172.21.15.36:0/1824772395 learned_addr learned my addr 172.21.15.36:0/1824772395 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:30.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71ca59c700 1 --2- 172.21.15.36:0/1824772395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc0a70c0 0x7f71cc14b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71c9d9b700 1 --2- 172.21.15.36:0/1824772395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc0b1db0 0x7f71cc0ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71cad9d700 1 -- 172.21.15.36:0/1824772395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc0a70c0 msgr2=0x7f71cc14b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71cad9d700 1 --2- 172.21.15.36:0/1824772395 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71cc0a70c0 0x7f71cc14b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71cad9d700 1 -- 172.21.15.36:0/1824772395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc0b1db0 msgr2=0x7f71cc0ab820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71cad9d700 1 --2- 172.21.15.36:0/1824772395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc0b1db0 0x7f71cc0ab820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71cad9d700 1 -- 172.21.15.36:0/1824772395 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4009530 con 0x7f71cc1483a0 2022-01-10T01:24:30.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.817+0000 7f71cad9d700 1 --2- 172.21.15.36:0/1824772395 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71cc1483a0 0x7f71cc0abd10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f71c40032f0 tx=0x7f71c4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71bb7fe700 1 -- 172.21.15.36:0/1824772395 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c400b870 con 0x7f71cc1483a0 2022-01-10T01:24:30.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71bb7fe700 1 -- 172.21.15.36:0/1824772395 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c4006b00 con 0x7f71cc1483a0 2022-01-10T01:24:30.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71d0818700 1 -- 172.21.15.36:0/1824772395 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71cc1497b0 con 0x7f71cc1483a0 2022-01-10T01:24:30.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71bb7fe700 1 -- 172.21.15.36:0/1824772395 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71c401f610 con 0x7f71cc1483a0 2022-01-10T01:24:30.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71d0818700 1 -- 172.21.15.36:0/1824772395 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc0a94e0 con 0x7f71cc1483a0 2022-01-10T01:24:30.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71d0818700 1 -- 172.21.15.36:0/1824772395 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71cc0a96a0 con 0x7f71cc1483a0 2022-01-10T01:24:30.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71bb7fe700 1 -- 172.21.15.36:0/1824772395 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f71c400f070 con 0x7f71cc1483a0 2022-01-10T01:24:30.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71bb7fe700 1 --2- 172.21.15.36:0/1824772395 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71a80535f0 0x7f71a8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71bb7fe700 1 -- 172.21.15.36:0/1824772395 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f71c406cea0 con 0x7f71cc1483a0 2022-01-10T01:24:30.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71bb7fe700 1 --2- 172.21.15.36:0/1824772395 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x7f71a805b0c0 0x7f71a805d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71ca59c700 1 --2- 172.21.15.36:0/1824772395 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71a80535f0 0x7f71a8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71bb7fe700 1 -- 172.21.15.36:0/1824772395 --> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71a805daa0 con 0x7f71a805b0c0 2022-01-10T01:24:30.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71bb7fe700 1 -- 172.21.15.36:0/1824772395 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71c406d170 con 0x7f71cc1483a0 2022-01-10T01:24:30.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71c9d9b700 1 --2- 172.21.15.36:0/1824772395 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x7f71a805b0c0 0x7f71a805d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.821+0000 7f71ca59c700 1 --2- 172.21.15.36:0/1824772395 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71a80535f0 0x7f71a8055ab0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f71bc00c000 tx=0x7f71bc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.825+0000 7f71c9d9b700 1 --2- 172.21.15.36:0/1824772395 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x7f71a805b0c0 0x7f71a805d4e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.825+0000 7f71bb7fe700 1 -- 172.21.15.36:0/1824772395 <== osd.6 v2:172.21.15.59:6808/15005 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f71a805daa0 con 0x7f71a805b0c0 2022-01-10T01:24:30.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.845+0000 7f71d0818700 1 -- 172.21.15.36:0/1824772395 --> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f71cc0b0b30 con 0x7f71a805b0c0 2022-01-10T01:24:30.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.845+0000 7f71bb7fe700 1 -- 172.21.15.36:0/1824772395 <== osd.6 v2:172.21.15.59:6808/15005 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f71cc0b0b30 con 0x7f71a805b0c0 2022-01-10T01:24:30.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.845+0000 7f71d0818700 1 -- 172.21.15.36:0/1824772395 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x7f71a805b0c0 msgr2=0x7f71a805d4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.845+0000 7f71d0818700 1 --2- 172.21.15.36:0/1824772395 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x7f71a805b0c0 0x7f71a805d4e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.845+0000 7f71d0818700 1 -- 172.21.15.36:0/1824772395 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71a80535f0 msgr2=0x7f71a8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.845+0000 7f71d0818700 1 --2- 172.21.15.36:0/1824772395 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71a80535f0 0x7f71a8055ab0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f71bc00c000 tx=0x7f71bc008040).stop 2022-01-10T01:24:30.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.845+0000 7f71d0818700 1 -- 172.21.15.36:0/1824772395 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71cc1483a0 msgr2=0x7f71cc0abd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.845+0000 7f71d0818700 1 --2- 172.21.15.36:0/1824772395 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71cc1483a0 0x7f71cc0abd10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f71c40032f0 tx=0x7f71c4016000).stop 2022-01-10T01:24:30.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.845+0000 7f71cad9d700 1 -- 172.21.15.36:0/1824772395 reap_dead start 2022-01-10T01:24:30.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.845+0000 7f71d0818700 1 -- 172.21.15.36:0/1824772395 shutdown_connections 2022-01-10T01:24:30.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.845+0000 7f71d0818700 1 -- 172.21.15.36:0/1824772395 >> 172.21.15.36:0/1824772395 conn(0x7f71cc05f6b0 msgr2=0x7f71cc0b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:30.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.845+0000 7f71d0818700 1 -- 172.21.15.36:0/1824772395 shutdown_connections 2022-01-10T01:24:30.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.845+0000 7f71d0818700 1 -- 172.21.15.36:0/1824772395 wait complete. 2022-01-10T01:24:30.864 INFO:teuthology.orchestra.run.smithi036.stdout:55834574853 2022-01-10T01:24:30.864 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2022-01-10T01:24:30.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.965+0000 7f564d9d4700 1 Processor -- start 2022-01-10T01:24:30.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f564d9d4700 1 -- start start 2022-01-10T01:24:30.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f564d9d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56480b00c0 0x7f56480b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f564d9d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56480b1f10 0x7f56480aab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f564d9d4700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56480aa390 con 0x7f56480a9b70 2022-01-10T01:24:30.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f564d9d4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56480b04a0 con 0x7f56480b00c0 2022-01-10T01:24:30.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f564d9d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56480aa0f0 con 0x7f56480b1f10 2022-01-10T01:24:30.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f56477fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f56480a9b70 0x7f56481415b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59968/0 (socket says 172.21.15.36:59968) 2022-01-10T01:24:30.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f56477fe700 1 -- 172.21.15.36:0/1830235606 learned_addr learned my addr 172.21.15.36:0/1830235606 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:30.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f5646ffd700 1 --2- 172.21.15.36:0/1830235606 >> v2:172.21.15.59:3300/0 conn(0x7f56480b00c0 0x7f56480b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f563ffff700 1 --2- 172.21.15.36:0/1830235606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56480b1f10 0x7f56480aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f56467fc700 1 -- 172.21.15.36:0/1830235606 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350548740 0 0) 0x7f56480aa390 con 0x7f56480a9b70 2022-01-10T01:24:30.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f56467fc700 1 -- 172.21.15.36:0/1830235606 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5628003260 con 0x7f56480a9b70 2022-01-10T01:24:30.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f5646ffd700 1 -- 172.21.15.36:0/1830235606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56480b1f10 msgr2=0x7f56480aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:30.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f5646ffd700 1 --2- 172.21.15.36:0/1830235606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56480b1f10 0x7f56480aab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f5646ffd700 1 -- 172.21.15.36:0/1830235606 >> v1:172.21.15.36:6789/0 conn(0x7f56480a9b70 legacy=0x7f56481415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f5646ffd700 1 -- 172.21.15.36:0/1830235606 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56480b11e0 con 0x7f56480b00c0 2022-01-10T01:24:30.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f5646ffd700 1 --2- 172.21.15.36:0/1830235606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56480b00c0 0x7f56480b1920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5638002f70 tx=0x7f5638006df0).ready entity=mon.1 client_cookie=6973f529d1facee8 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f56467fc700 1 -- 172.21.15.36:0/1830235606 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f563800d4a0 con 0x7f56480b00c0 2022-01-10T01:24:30.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f56467fc700 1 -- 172.21.15.36:0/1830235606 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638000e90 con 0x7f56480b00c0 2022-01-10T01:24:30.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.969+0000 7f56467fc700 1 -- 172.21.15.36:0/1830235606 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f563800d7f0 con 0x7f56480b00c0 2022-01-10T01:24:30.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.973+0000 7f564d9d4700 1 -- 172.21.15.36:0/1830235606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56480b00c0 msgr2=0x7f56480b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.973+0000 7f564d9d4700 1 --2- 172.21.15.36:0/1830235606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56480b00c0 0x7f56480b1920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f5638002f70 tx=0x7f5638006df0).stop 2022-01-10T01:24:30.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.973+0000 7f564d9d4700 1 -- 172.21.15.36:0/1830235606 shutdown_connections 2022-01-10T01:24:30.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.973+0000 7f564d9d4700 1 --2- 172.21.15.36:0/1830235606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56480b1f10 0x7f56480aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.973+0000 7f564d9d4700 1 --2- 172.21.15.36:0/1830235606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56480b00c0 0x7f56480b1920 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.973+0000 7f564d9d4700 1 -- 172.21.15.36:0/1830235606 >> 172.21.15.36:0/1830235606 conn(0x7f56480607c0 msgr2=0x7f5648060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:30.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.973+0000 7f564d9d4700 1 -- 172.21.15.36:0/1830235606 shutdown_connections 2022-01-10T01:24:30.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.973+0000 7f564d9d4700 1 -- 172.21.15.36:0/1830235606 wait complete. 2022-01-10T01:24:30.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.973+0000 7f564d9d4700 1 Processor -- start 2022-01-10T01:24:30.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.973+0000 7f564d9d4700 1 -- start start 2022-01-10T01:24:30.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f564d9d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56480a9b70 0x7f5648143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f564d9d4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56480b00c0 0x7f564813c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f564d9d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56480b1f10 0x7f564813cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f564d9d4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56480ae310 con 0x7f56480b00c0 2022-01-10T01:24:30.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f564d9d4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56480ae540 con 0x7f56480a9b70 2022-01-10T01:24:30.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f564d9d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56480ae7e0 con 0x7f56480b1f10 2022-01-10T01:24:30.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f563ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56480b00c0 0x7f564813c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f563ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56480b00c0 0x7f564813c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33946/0 (socket says 172.21.15.36:33946) 2022-01-10T01:24:30.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f563ffff700 1 -- 172.21.15.36:0/399383392 learned_addr learned my addr 172.21.15.36:0/399383392 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:30.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f56477fe700 1 --2- 172.21.15.36:0/399383392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56480b1f10 0x7f564813cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f5646ffd700 1 --2- 172.21.15.36:0/399383392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56480a9b70 0x7f5648143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f563ffff700 1 -- 172.21.15.36:0/399383392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56480b1f10 msgr2=0x7f564813cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f563ffff700 1 --2- 172.21.15.36:0/399383392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56480b1f10 0x7f564813cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f563ffff700 1 -- 172.21.15.36:0/399383392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56480a9b70 msgr2=0x7f5648143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:30.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f563ffff700 1 --2- 172.21.15.36:0/399383392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56480a9b70 0x7f5648143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:30.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f563ffff700 1 -- 172.21.15.36:0/399383392 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563800b180 con 0x7f56480b00c0 2022-01-10T01:24:30.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f563ffff700 1 --2- 172.21.15.36:0/399383392 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56480b00c0 0x7f564813c8c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f563000c000 tx=0x7f5630006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f5644ff9700 1 -- 172.21.15.36:0/399383392 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5630011750 con 0x7f56480b00c0 2022-01-10T01:24:30.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f5644ff9700 1 -- 172.21.15.36:0/399383392 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56300118b0 con 0x7f56480b00c0 2022-01-10T01:24:30.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f564d9d4700 1 -- 172.21.15.36:0/399383392 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56480aea80 con 0x7f56480b00c0 2022-01-10T01:24:30.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f5644ff9700 1 -- 172.21.15.36:0/399383392 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5630011c10 con 0x7f56480b00c0 2022-01-10T01:24:30.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.977+0000 7f564d9d4700 1 -- 172.21.15.36:0/399383392 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5648140e80 con 0x7f56480b00c0 2022-01-10T01:24:30.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.981+0000 7f564d9d4700 1 -- 172.21.15.36:0/399383392 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56480aec10 con 0x7f56480b00c0 2022-01-10T01:24:30.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.981+0000 7f5644ff9700 1 -- 172.21.15.36:0/399383392 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5630011d70 con 0x7f56480b00c0 2022-01-10T01:24:30.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.981+0000 7f5644ff9700 1 --2- 172.21.15.36:0/399383392 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f562c0534d0 0x7f562c055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.981+0000 7f5644ff9700 1 -- 172.21.15.36:0/399383392 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f563006be70 con 0x7f56480b00c0 2022-01-10T01:24:30.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.981+0000 7f5646ffd700 1 --2- 172.21.15.36:0/399383392 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f562c0534d0 0x7f562c055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.981+0000 7f5644ff9700 1 --2- 172.21.15.36:0/399383392 >> [v2:172.21.15.59:6824/15006,v1:172.21.15.59:6825/15006] conn(0x7f562c05aff0 0x7f562c05d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:30.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.981+0000 7f5644ff9700 1 -- 172.21.15.36:0/399383392 --> [v2:172.21.15.59:6824/15006,v1:172.21.15.59:6825/15006] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f562c05da70 con 0x7f562c05aff0 2022-01-10T01:24:30.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.981+0000 7f5644ff9700 1 -- 172.21.15.36:0/399383392 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f563006e3f0 con 0x7f56480b00c0 2022-01-10T01:24:30.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.981+0000 7f56477fe700 1 --2- 172.21.15.36:0/399383392 >> [v2:172.21.15.59:6824/15006,v1:172.21.15.59:6825/15006] conn(0x7f562c05aff0 0x7f562c05d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:30.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.981+0000 7f5646ffd700 1 --2- 172.21.15.36:0/399383392 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f562c0534d0 0x7f562c055990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f563801a000 tx=0x7f5638014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.981+0000 7f56477fe700 1 --2- 172.21.15.36:0/399383392 >> [v2:172.21.15.59:6824/15006,v1:172.21.15.59:6825/15006] conn(0x7f562c05aff0 0x7f562c05d410 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:30.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:30.985+0000 7f5644ff9700 1 -- 172.21.15.36:0/399383392 <== osd.7 v2:172.21.15.59:6824/15006 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f562c05da70 con 0x7f562c05aff0 2022-01-10T01:24:31.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.001+0000 7f564d9d4700 1 -- 172.21.15.36:0/399383392 --> [v2:172.21.15.59:6824/15006,v1:172.21.15.59:6825/15006] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5648142130 con 0x7f562c05aff0 2022-01-10T01:24:31.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.001+0000 7f5644ff9700 1 -- 172.21.15.36:0/399383392 <== osd.7 v2:172.21.15.59:6824/15006 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5640005970 con 0x7f562c05aff0 2022-01-10T01:24:31.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.005+0000 7f564d9d4700 1 -- 172.21.15.36:0/399383392 >> [v2:172.21.15.59:6824/15006,v1:172.21.15.59:6825/15006] conn(0x7f562c05aff0 msgr2=0x7f562c05d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.005+0000 7f564d9d4700 1 --2- 172.21.15.36:0/399383392 >> [v2:172.21.15.59:6824/15006,v1:172.21.15.59:6825/15006] conn(0x7f562c05aff0 0x7f562c05d410 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.005+0000 7f564d9d4700 1 -- 172.21.15.36:0/399383392 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f562c0534d0 msgr2=0x7f562c055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.005+0000 7f564d9d4700 1 --2- 172.21.15.36:0/399383392 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f562c0534d0 0x7f562c055990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f563801a000 tx=0x7f5638014000).stop 2022-01-10T01:24:31.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.005+0000 7f564d9d4700 1 -- 172.21.15.36:0/399383392 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56480b00c0 msgr2=0x7f564813c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.005+0000 7f564d9d4700 1 --2- 172.21.15.36:0/399383392 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56480b00c0 0x7f564813c8c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f563000c000 tx=0x7f5630006df0).stop 2022-01-10T01:24:31.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.005+0000 7f56477fe700 1 -- 172.21.15.36:0/399383392 reap_dead start 2022-01-10T01:24:31.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.005+0000 7f564d9d4700 1 -- 172.21.15.36:0/399383392 shutdown_connections 2022-01-10T01:24:31.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.005+0000 7f564d9d4700 1 -- 172.21.15.36:0/399383392 >> 172.21.15.36:0/399383392 conn(0x7f56480607c0 msgr2=0x7f56480aaf40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:31.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.005+0000 7f564d9d4700 1 -- 172.21.15.36:0/399383392 shutdown_connections 2022-01-10T01:24:31.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.005+0000 7f564d9d4700 1 -- 172.21.15.36:0/399383392 wait complete. 2022-01-10T01:24:31.025 INFO:teuthology.orchestra.run.smithi036.stdout:55834574853 2022-01-10T01:24:31.026 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-01-10T01:24:31.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.129+0000 7f1f3d440700 1 Processor -- start 2022-01-10T01:24:31.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.129+0000 7f1f3d440700 1 -- start start 2022-01-10T01:24:31.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f3d440700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1f38060910 0x7f1f380acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f3d440700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f380b6ce0 con 0x7f1f380aa5d0 2022-01-10T01:24:31.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f3d440700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f380611e0 con 0x7f1f380b6900 2022-01-10T01:24:31.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f3d440700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f38061480 con 0x7f1f38060910 2022-01-10T01:24:31.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f2e7fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1f38060910 0x7f1f380acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f377fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f1f380aa5d0 0x7f1f3813c470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:59984/0 (socket says 172.21.15.36:59984) 2022-01-10T01:24:31.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f377fe700 1 -- 172.21.15.36:0/1337959372 learned_addr learned my addr 172.21.15.36:0/1337959372 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:31.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f2e7fc700 1 -- 172.21.15.36:0/1337959372 >> v1:172.21.15.59:6789/0 conn(0x7f1f380b6900 legacy=0x7f1f380a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f2e7fc700 1 -- 172.21.15.36:0/1337959372 >> v1:172.21.15.36:6789/0 conn(0x7f1f380aa5d0 legacy=0x7f1f3813c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f2e7fc700 1 -- 172.21.15.36:0/1337959372 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f38061720 con 0x7f1f38060910 2022-01-10T01:24:31.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f2e7fc700 1 --2- 172.21.15.36:0/1337959372 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f38060910 0x7f1f380acd50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f1f20002f70 tx=0x7f1f20006df0).ready entity=mon.0 client_cookie=d262f9e67680986c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:31.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f367fc700 1 -- 172.21.15.36:0/1337959372 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f2000d610 con 0x7f1f38060910 2022-01-10T01:24:31.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f367fc700 1 -- 172.21.15.36:0/1337959372 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f20000e90 con 0x7f1f38060910 2022-01-10T01:24:31.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f367fc700 1 -- 172.21.15.36:0/1337959372 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f2000d960 con 0x7f1f38060910 2022-01-10T01:24:31.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f3d440700 1 -- 172.21.15.36:0/1337959372 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f38060910 msgr2=0x7f1f380acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f3d440700 1 --2- 172.21.15.36:0/1337959372 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f38060910 0x7f1f380acd50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f1f20002f70 tx=0x7f1f20006df0).stop 2022-01-10T01:24:31.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f3d440700 1 -- 172.21.15.36:0/1337959372 shutdown_connections 2022-01-10T01:24:31.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f3d440700 1 --2- 172.21.15.36:0/1337959372 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f38060910 0x7f1f380acd50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.133+0000 7f1f3d440700 1 -- 172.21.15.36:0/1337959372 >> 172.21.15.36:0/1337959372 conn(0x7f1f380b3480 msgr2=0x7f1f380b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:31.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f3d440700 1 -- 172.21.15.36:0/1337959372 shutdown_connections 2022-01-10T01:24:31.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f3d440700 1 -- 172.21.15.36:0/1337959372 wait complete. 2022-01-10T01:24:31.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f3d440700 1 Processor -- start 2022-01-10T01:24:31.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f3d440700 1 -- start start 2022-01-10T01:24:31.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f3d440700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f38060910 0x7f1f38152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f3d440700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f380aa5d0 0x7f1f38142d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f3d440700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f380b6900 0x7f1f38143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f3d440700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f38141000 con 0x7f1f380b6900 2022-01-10T01:24:31.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f3d440700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3813d580 con 0x7f1f380aa5d0 2022-01-10T01:24:31.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f3d440700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3813d820 con 0x7f1f38060910 2022-01-10T01:24:31.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f377fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f380b6900 0x7f1f38143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f377fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f380b6900 0x7f1f38143210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33964/0 (socket says 172.21.15.36:33964) 2022-01-10T01:24:31.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f377fe700 1 -- 172.21.15.36:0/208538598 learned_addr learned my addr 172.21.15.36:0/208538598 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:31.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f2e7fc700 1 --2- 172.21.15.36:0/208538598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f380aa5d0 0x7f1f38142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f36ffd700 1 --2- 172.21.15.36:0/208538598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f38060910 0x7f1f38152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f377fe700 1 -- 172.21.15.36:0/208538598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f38060910 msgr2=0x7f1f38152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f377fe700 1 --2- 172.21.15.36:0/208538598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f38060910 0x7f1f38152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f377fe700 1 -- 172.21.15.36:0/208538598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f380aa5d0 msgr2=0x7f1f38142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.137+0000 7f1f377fe700 1 --2- 172.21.15.36:0/208538598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f380aa5d0 0x7f1f38142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.141+0000 7f1f377fe700 1 -- 172.21.15.36:0/208538598 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2000b180 con 0x7f1f380b6900 2022-01-10T01:24:31.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.141+0000 7f1f377fe700 1 --2- 172.21.15.36:0/208538598 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f380b6900 0x7f1f38143210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f1f38060300 tx=0x7f1f30007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:31.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.141+0000 7f1f34ff9700 1 -- 172.21.15.36:0/208538598 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f30005b80 con 0x7f1f380b6900 2022-01-10T01:24:31.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.141+0000 7f1f34ff9700 1 -- 172.21.15.36:0/208538598 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f30005ce0 con 0x7f1f380b6900 2022-01-10T01:24:31.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.141+0000 7f1f3d440700 1 -- 172.21.15.36:0/208538598 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f38140ac0 con 0x7f1f380b6900 2022-01-10T01:24:31.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.141+0000 7f1f34ff9700 1 -- 172.21.15.36:0/208538598 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f300072c0 con 0x7f1f380b6900 2022-01-10T01:24:31.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.141+0000 7f1f3d440700 1 -- 172.21.15.36:0/208538598 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f38152ff0 con 0x7f1f380b6900 2022-01-10T01:24:31.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.141+0000 7f1f3d440700 1 -- 172.21.15.36:0/208538598 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3812ffc0 con 0x7f1f380b6900 2022-01-10T01:24:31.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.141+0000 7f1f34ff9700 1 -- 172.21.15.36:0/208538598 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1f3001a060 con 0x7f1f380b6900 2022-01-10T01:24:31.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.141+0000 7f1f34ff9700 1 --2- 172.21.15.36:0/208538598 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1f1c053680 0x7f1f1c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.141+0000 7f1f34ff9700 1 -- 172.21.15.36:0/208538598 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1f3006b450 con 0x7f1f380b6900 2022-01-10T01:24:31.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.141+0000 7f1f36ffd700 1 --2- 172.21.15.36:0/208538598 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1f1c053680 0x7f1f1c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.145+0000 7f1f36ffd700 1 --2- 172.21.15.36:0/208538598 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1f1c053680 0x7f1f1c055b40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1f2800d000 tx=0x7f1f28009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:31.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.149+0000 7f1f34ff9700 1 -- 172.21.15.36:0/208538598 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1f30042460 con 0x7f1f380b6900 2022-01-10T01:24:31.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.281+0000 7f1f3d440700 1 -- 172.21.15.36:0/208538598 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1f380619c0 con 0x7f1f380b6900 2022-01-10T01:24:31.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.281+0000 7f1f34ff9700 1 -- 172.21.15.36:0/208538598 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f30018070 con 0x7f1f380b6900 2022-01-10T01:24:31.285 INFO:teuthology.orchestra.run.smithi036.stdout:55834574853 2022-01-10T01:24:31.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.281+0000 7f1f3d440700 1 -- 172.21.15.36:0/208538598 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1f1c053680 msgr2=0x7f1f1c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.281+0000 7f1f3d440700 1 --2- 172.21.15.36:0/208538598 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1f1c053680 0x7f1f1c055b40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1f2800d000 tx=0x7f1f28009040).stop 2022-01-10T01:24:31.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.281+0000 7f1f3d440700 1 -- 172.21.15.36:0/208538598 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f380b6900 msgr2=0x7f1f38143210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.281+0000 7f1f3d440700 1 --2- 172.21.15.36:0/208538598 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f380b6900 0x7f1f38143210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f1f38060300 tx=0x7f1f30007f30).stop 2022-01-10T01:24:31.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.281+0000 7f1f3d440700 1 -- 172.21.15.36:0/208538598 shutdown_connections 2022-01-10T01:24:31.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.281+0000 7f1f3d440700 1 --2- 172.21.15.36:0/208538598 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1f1c053680 0x7f1f1c055b40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.281+0000 7f1f3d440700 1 --2- 172.21.15.36:0/208538598 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f380b6900 0x7f1f38143210 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.281+0000 7f1f3d440700 1 --2- 172.21.15.36:0/208538598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f380aa5d0 0x7f1f38142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.281+0000 7f1f3d440700 1 --2- 172.21.15.36:0/208538598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f38060910 0x7f1f38152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.281+0000 7f1f3d440700 1 -- 172.21.15.36:0/208538598 >> 172.21.15.36:0/208538598 conn(0x7f1f380b3480 msgr2=0x7f1f3812d330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:31.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.281+0000 7f1f3d440700 1 -- 172.21.15.36:0/208538598 shutdown_connections 2022-01-10T01:24:31.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.281+0000 7f1f3d440700 1 -- 172.21.15.36:0/208538598 wait complete. 2022-01-10T01:24:31.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2022-01-10T01:24:31.299 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-01-10T01:24:31.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.393+0000 7f5f6b59e700 1 Processor -- start 2022-01-10T01:24:31.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.393+0000 7f5f6b59e700 1 -- start start 2022-01-10T01:24:31.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6b59e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5f6c0b4060 0x7f5f6c061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6c142e60 0x7f5f6c143310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6b59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6c0b5f50 con 0x7f5f6c0b6290 2022-01-10T01:24:31.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6b59e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6c0b1f70 con 0x7f5f6c0b4060 2022-01-10T01:24:31.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0b2210 con 0x7f5f6c142e60 2022-01-10T01:24:31.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f69d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5f6c0b4060 0x7f5f6c061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6a59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5f6c0b6290 0x7f5f6c061470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:49438/0 (socket says 172.21.15.36:49438) 2022-01-10T01:24:31.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6a59c700 1 -- 172.21.15.36:0/454254599 learned_addr learned my addr 172.21.15.36:0/454254599 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:31.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6ad9d700 1 --2- 172.21.15.36:0/454254599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6c142e60 0x7f5f6c143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6959a700 1 -- 172.21.15.36:0/454254599 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373463188 0 0) 0x7f5f5c001110 con 0x7f5f6c0b6290 2022-01-10T01:24:31.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6959a700 1 -- 172.21.15.36:0/454254599 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f50003260 con 0x7f5f6c0b6290 2022-01-10T01:24:31.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f69d9b700 1 -- 172.21.15.36:0/454254599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6c142e60 msgr2=0x7f5f6c143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:31.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f69d9b700 1 --2- 172.21.15.36:0/454254599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6c142e60 0x7f5f6c143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f69d9b700 1 -- 172.21.15.36:0/454254599 >> v1:172.21.15.59:6789/0 conn(0x7f5f6c0b6290 legacy=0x7f5f6c061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f69d9b700 1 -- 172.21.15.36:0/454254599 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c0b24b0 con 0x7f5f6c0b4060 2022-01-10T01:24:31.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6ad9d700 1 --2- 172.21.15.36:0/454254599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6c142e60 0x7f5f6c143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:31.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f69d9b700 1 --2- 172.21.15.36:0/454254599 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5f6c0b4060 0x7f5f6c061b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5f5c0012a0 tx=0x7f5f60006df0).ready entity=mon.0 client_cookie=bfc7239256c7d6c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:31.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6959a700 1 -- 172.21.15.36:0/454254599 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f6000d4a0 con 0x7f5f6c0b4060 2022-01-10T01:24:31.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6959a700 1 -- 172.21.15.36:0/454254599 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f60000e90 con 0x7f5f6c0b4060 2022-01-10T01:24:31.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6959a700 1 -- 172.21.15.36:0/454254599 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f6000d7f0 con 0x7f5f6c0b4060 2022-01-10T01:24:31.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6b59e700 1 -- 172.21.15.36:0/454254599 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5f6c0b4060 msgr2=0x7f5f6c061b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6b59e700 1 --2- 172.21.15.36:0/454254599 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5f6c0b4060 0x7f5f6c061b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f5f5c0012a0 tx=0x7f5f60006df0).stop 2022-01-10T01:24:31.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6b59e700 1 -- 172.21.15.36:0/454254599 shutdown_connections 2022-01-10T01:24:31.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6b59e700 1 --2- 172.21.15.36:0/454254599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6c142e60 0x7f5f6c143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6b59e700 1 --2- 172.21.15.36:0/454254599 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5f6c0b4060 0x7f5f6c061b80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6b59e700 1 -- 172.21.15.36:0/454254599 >> 172.21.15.36:0/454254599 conn(0x7f5f6c05c490 msgr2=0x7f5f6c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:31.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6b59e700 1 -- 172.21.15.36:0/454254599 shutdown_connections 2022-01-10T01:24:31.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.397+0000 7f5f6b59e700 1 -- 172.21.15.36:0/454254599 wait complete. 2022-01-10T01:24:31.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6b59e700 1 Processor -- start 2022-01-10T01:24:31.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6b59e700 1 -- start start 2022-01-10T01:24:31.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5f6c0b4060 0x7f5f6c0b7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6c0b6290 0x7f5f6c12ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6b59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f6c142e60 0x7f5f6c12b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6b59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c146620 con 0x7f5f6c0b4060 2022-01-10T01:24:31.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6b59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0b0b40 con 0x7f5f6c142e60 2022-01-10T01:24:31.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0b08a0 con 0x7f5f6c0b6290 2022-01-10T01:24:31.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6a59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5f6c0b4060 0x7f5f6c0b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6a59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5f6c0b4060 0x7f5f6c0b7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33974/0 (socket says 172.21.15.36:33974) 2022-01-10T01:24:31.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6a59c700 1 -- 172.21.15.36:0/2319104960 learned_addr learned my addr 172.21.15.36:0/2319104960 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:31.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f69d9b700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6c0b6290 0x7f5f6c12ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6ad9d700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f6c142e60 0x7f5f6c12b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6a59c700 1 -- 172.21.15.36:0/2319104960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6c0b6290 msgr2=0x7f5f6c12ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6a59c700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6c0b6290 0x7f5f6c12ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6a59c700 1 -- 172.21.15.36:0/2319104960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f6c142e60 msgr2=0x7f5f6c12b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6a59c700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f6c142e60 0x7f5f6c12b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6a59c700 1 -- 172.21.15.36:0/2319104960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f64009470 con 0x7f5f6c0b4060 2022-01-10T01:24:31.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6ad9d700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f6c142e60 0x7f5f6c12b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:24:31.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f6a59c700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5f6c0b4060 0x7f5f6c0b7840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f5f5c000ed0 tx=0x7f5f5c007980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:31.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.401+0000 7f5f5b7fe700 1 -- 172.21.15.36:0/2319104960 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f5c0072e0 con 0x7f5f6c0b4060 2022-01-10T01:24:31.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.405+0000 7f5f5b7fe700 1 -- 172.21.15.36:0/2319104960 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c007440 con 0x7f5f6c0b4060 2022-01-10T01:24:31.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.405+0000 7f5f6b59e700 1 -- 172.21.15.36:0/2319104960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6000b180 con 0x7f5f6c0b4060 2022-01-10T01:24:31.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.405+0000 7f5f5b7fe700 1 -- 172.21.15.36:0/2319104960 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f5c005800 con 0x7f5f6c0b4060 2022-01-10T01:24:31.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.405+0000 7f5f6b59e700 1 -- 172.21.15.36:0/2319104960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c12b700 con 0x7f5f6c0b4060 2022-01-10T01:24:31.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.405+0000 7f5f5b7fe700 1 -- 172.21.15.36:0/2319104960 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5f5c01a060 con 0x7f5f6c0b4060 2022-01-10T01:24:31.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.405+0000 7f5f6b59e700 1 -- 172.21.15.36:0/2319104960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6c0b2750 con 0x7f5f6c0b4060 2022-01-10T01:24:31.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.405+0000 7f5f5b7fe700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5f48053560 0x7f5f48055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.405+0000 7f5f69d9b700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5f48053560 0x7f5f48055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.405+0000 7f5f5b7fe700 1 -- 172.21.15.36:0/2319104960 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f5f5c06b300 con 0x7f5f6c0b4060 2022-01-10T01:24:31.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.405+0000 7f5f69d9b700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5f48053560 0x7f5f48055a20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f5f60018000 tx=0x7f5f60014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:31.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.409+0000 7f5f5b7fe700 1 -- 172.21.15.36:0/2319104960 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5f5c042200 con 0x7f5f6c0b4060 2022-01-10T01:24:31.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.537+0000 7f5f6b59e700 1 -- 172.21.15.36:0/2319104960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5f6c0b5f50 con 0x7f5f6c0b4060 2022-01-10T01:24:31.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.537+0000 7f5f5b7fe700 1 -- 172.21.15.36:0/2319104960 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f6c0b5f50 con 0x7f5f6c0b4060 2022-01-10T01:24:31.542 INFO:teuthology.orchestra.run.smithi036.stdout:55834574854 2022-01-10T01:24:31.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.537+0000 7f5f6b59e700 1 -- 172.21.15.36:0/2319104960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5f48053560 msgr2=0x7f5f48055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.537+0000 7f5f6b59e700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5f48053560 0x7f5f48055a20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f5f60018000 tx=0x7f5f60014000).stop 2022-01-10T01:24:31.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.537+0000 7f5f6b59e700 1 -- 172.21.15.36:0/2319104960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5f6c0b4060 msgr2=0x7f5f6c0b7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.537+0000 7f5f6b59e700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5f6c0b4060 0x7f5f6c0b7840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f5f5c000ed0 tx=0x7f5f5c007980).stop 2022-01-10T01:24:31.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.537+0000 7f5f6b59e700 1 -- 172.21.15.36:0/2319104960 shutdown_connections 2022-01-10T01:24:31.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.537+0000 7f5f6b59e700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5f48053560 0x7f5f48055a20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.537+0000 7f5f6b59e700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f6c142e60 0x7f5f6c12b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.537+0000 7f5f6b59e700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f6c0b6290 0x7f5f6c12ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.537+0000 7f5f6b59e700 1 --2- 172.21.15.36:0/2319104960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5f6c0b4060 0x7f5f6c0b7840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.537+0000 7f5f6b59e700 1 -- 172.21.15.36:0/2319104960 >> 172.21.15.36:0/2319104960 conn(0x7f5f6c05c490 msgr2=0x7f5f6c1411e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:31.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.537+0000 7f5f6b59e700 1 -- 172.21.15.36:0/2319104960 shutdown_connections 2022-01-10T01:24:31.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.537+0000 7f5f6b59e700 1 -- 172.21.15.36:0/2319104960 wait complete. 2022-01-10T01:24:31.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2022-01-10T01:24:31.555 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-01-10T01:24:31.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.653+0000 7f69de9f3700 1 Processor -- start 2022-01-10T01:24:31.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.653+0000 7f69de9f3700 1 -- start start 2022-01-10T01:24:31.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.653+0000 7f69de9f3700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f69d80b6900 0x7f69d80acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.653+0000 7f69de9f3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69d80aa5d0 0x7f69d813c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.653+0000 7f69de9f3700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69d80b6ce0 con 0x7f69d8060910 2022-01-10T01:24:31.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.653+0000 7f69de9f3700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d80611e0 con 0x7f69d80b6900 2022-01-10T01:24:31.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.653+0000 7f69de9f3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69d8061480 con 0x7f69d80aa5d0 2022-01-10T01:24:31.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.653+0000 7f69d7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f69d80b6900 0x7f69d80acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69d77fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f69d8060910 0x7f69d80a9ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60010/0 (socket says 172.21.15.36:60010) 2022-01-10T01:24:31.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69d77fe700 1 -- 172.21.15.36:0/788763680 learned_addr learned my addr 172.21.15.36:0/788763680 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:31.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69dcf90700 1 --2- 172.21.15.36:0/788763680 >> v2:172.21.15.59:3300/0 conn(0x7f69d80aa5d0 0x7f69d813c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69d7fff700 1 -- 172.21.15.36:0/788763680 >> v2:172.21.15.59:3300/0 conn(0x7f69d80aa5d0 msgr2=0x7f69d813c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:31.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69d7fff700 1 --2- 172.21.15.36:0/788763680 >> v2:172.21.15.59:3300/0 conn(0x7f69d80aa5d0 0x7f69d813c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69d7fff700 1 -- 172.21.15.36:0/788763680 >> v1:172.21.15.36:6789/0 conn(0x7f69d8060910 legacy=0x7f69d80a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69d7fff700 1 -- 172.21.15.36:0/788763680 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d8061720 con 0x7f69d80b6900 2022-01-10T01:24:31.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69d7fff700 1 --2- 172.21.15.36:0/788763680 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f69d80b6900 0x7f69d80acd50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f69d00032f0 tx=0x7f69d00091d0).ready entity=mon.0 client_cookie=d8da49d462e483da server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:31.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69d6ffd700 1 -- 172.21.15.36:0/788763680 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d000b680 con 0x7f69d80b6900 2022-01-10T01:24:31.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69d6ffd700 1 -- 172.21.15.36:0/788763680 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d000b7e0 con 0x7f69d80b6900 2022-01-10T01:24:31.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69d6ffd700 1 -- 172.21.15.36:0/788763680 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69d000b950 con 0x7f69d80b6900 2022-01-10T01:24:31.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69de9f3700 1 -- 172.21.15.36:0/788763680 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f69d80b6900 msgr2=0x7f69d80acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69de9f3700 1 --2- 172.21.15.36:0/788763680 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f69d80b6900 0x7f69d80acd50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f69d00032f0 tx=0x7f69d00091d0).stop 2022-01-10T01:24:31.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69de9f3700 1 -- 172.21.15.36:0/788763680 shutdown_connections 2022-01-10T01:24:31.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69de9f3700 1 --2- 172.21.15.36:0/788763680 >> v2:172.21.15.59:3300/0 conn(0x7f69d80aa5d0 0x7f69d813c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69de9f3700 1 --2- 172.21.15.36:0/788763680 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f69d80b6900 0x7f69d80acd50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69de9f3700 1 -- 172.21.15.36:0/788763680 >> 172.21.15.36:0/788763680 conn(0x7f69d80b3480 msgr2=0x7f69d80b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:31.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69de9f3700 1 -- 172.21.15.36:0/788763680 shutdown_connections 2022-01-10T01:24:31.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.657+0000 7f69de9f3700 1 -- 172.21.15.36:0/788763680 wait complete. 2022-01-10T01:24:31.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69de9f3700 1 Processor -- start 2022-01-10T01:24:31.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69de9f3700 1 -- start start 2022-01-10T01:24:31.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69de9f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69d8060910 0x7f69d80afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69de9f3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f69d80aa5d0 0x7f69d80ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69de9f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69d80b6900 0x7f69d8156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69de9f3700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d8148c90 con 0x7f69d80aa5d0 2022-01-10T01:24:31.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69de9f3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d8142790 con 0x7f69d80b6900 2022-01-10T01:24:31.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69de9f3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69d8142250 con 0x7f69d8060910 2022-01-10T01:24:31.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69d77fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f69d80aa5d0 0x7f69d80ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69d77fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f69d80aa5d0 0x7f69d80ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:33990/0 (socket says 172.21.15.36:33990) 2022-01-10T01:24:31.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69d77fe700 1 -- 172.21.15.36:0/216509496 learned_addr learned my addr 172.21.15.36:0/216509496 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:31.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69d7fff700 1 --2- 172.21.15.36:0/216509496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69d8060910 0x7f69d80afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69dcf90700 1 --2- 172.21.15.36:0/216509496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69d80b6900 0x7f69d8156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69d77fe700 1 -- 172.21.15.36:0/216509496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69d8060910 msgr2=0x7f69d80afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69d77fe700 1 --2- 172.21.15.36:0/216509496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69d8060910 0x7f69d80afd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69d77fe700 1 -- 172.21.15.36:0/216509496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69d80b6900 msgr2=0x7f69d8156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69d77fe700 1 --2- 172.21.15.36:0/216509496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69d80b6900 0x7f69d8156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69d77fe700 1 -- 172.21.15.36:0/216509496 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d0009470 con 0x7f69d80aa5d0 2022-01-10T01:24:31.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69d77fe700 1 --2- 172.21.15.36:0/216509496 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f69d80aa5d0 0x7f69d80ae2c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f69d8060300 tx=0x7f69cc007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:31.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69d57fa700 1 -- 172.21.15.36:0/216509496 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69cc00ce30 con 0x7f69d80aa5d0 2022-01-10T01:24:31.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69d57fa700 1 -- 172.21.15.36:0/216509496 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69cc0072e0 con 0x7f69d80aa5d0 2022-01-10T01:24:31.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69de9f3700 1 -- 172.21.15.36:0/216509496 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d81424f0 con 0x7f69d80aa5d0 2022-01-10T01:24:31.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69d57fa700 1 -- 172.21.15.36:0/216509496 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69cc005800 con 0x7f69d80aa5d0 2022-01-10T01:24:31.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.661+0000 7f69de9f3700 1 -- 172.21.15.36:0/216509496 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d8143d30 con 0x7f69d80aa5d0 2022-01-10T01:24:31.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.665+0000 7f69de9f3700 1 -- 172.21.15.36:0/216509496 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d80acb20 con 0x7f69d80aa5d0 2022-01-10T01:24:31.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.665+0000 7f69d57fa700 1 -- 172.21.15.36:0/216509496 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f69cc010070 con 0x7f69d80aa5d0 2022-01-10T01:24:31.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.665+0000 7f69d57fa700 1 --2- 172.21.15.36:0/216509496 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f69b80535f0 0x7f69b8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.665+0000 7f69d57fa700 1 -- 172.21.15.36:0/216509496 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f69cc06b0d0 con 0x7f69d80aa5d0 2022-01-10T01:24:31.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.665+0000 7f69d7fff700 1 --2- 172.21.15.36:0/216509496 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f69b80535f0 0x7f69b8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.665+0000 7f69d7fff700 1 --2- 172.21.15.36:0/216509496 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f69b80535f0 0x7f69b8055ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f69d0019000 tx=0x7f69d0016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:31.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.669+0000 7f69d57fa700 1 -- 172.21.15.36:0/216509496 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f69cc0420e0 con 0x7f69d80aa5d0 2022-01-10T01:24:31.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.797+0000 7f69de9f3700 1 -- 172.21.15.36:0/216509496 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f69d8057350 con 0x7f69d80aa5d0 2022-01-10T01:24:31.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.797+0000 7f69d57fa700 1 -- 172.21.15.36:0/216509496 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69cc045700 con 0x7f69d80aa5d0 2022-01-10T01:24:31.805 INFO:teuthology.orchestra.run.smithi036.stdout:55834574853 2022-01-10T01:24:31.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.801+0000 7f69de9f3700 1 -- 172.21.15.36:0/216509496 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f69b80535f0 msgr2=0x7f69b8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.801+0000 7f69de9f3700 1 --2- 172.21.15.36:0/216509496 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f69b80535f0 0x7f69b8055ab0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f69d0019000 tx=0x7f69d0016000).stop 2022-01-10T01:24:31.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.801+0000 7f69de9f3700 1 -- 172.21.15.36:0/216509496 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f69d80aa5d0 msgr2=0x7f69d80ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.801+0000 7f69de9f3700 1 --2- 172.21.15.36:0/216509496 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f69d80aa5d0 0x7f69d80ae2c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f69d8060300 tx=0x7f69cc007c40).stop 2022-01-10T01:24:31.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.801+0000 7f69de9f3700 1 -- 172.21.15.36:0/216509496 shutdown_connections 2022-01-10T01:24:31.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.801+0000 7f69de9f3700 1 --2- 172.21.15.36:0/216509496 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f69b80535f0 0x7f69b8055ab0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.801+0000 7f69de9f3700 1 --2- 172.21.15.36:0/216509496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69d80b6900 0x7f69d8156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.801+0000 7f69de9f3700 1 --2- 172.21.15.36:0/216509496 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f69d80aa5d0 0x7f69d80ae2c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.801+0000 7f69de9f3700 1 --2- 172.21.15.36:0/216509496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69d8060910 0x7f69d80afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.801+0000 7f69de9f3700 1 -- 172.21.15.36:0/216509496 >> 172.21.15.36:0/216509496 conn(0x7f69d80b3480 msgr2=0x7f69d8139950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:31.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.801+0000 7f69de9f3700 1 -- 172.21.15.36:0/216509496 shutdown_connections 2022-01-10T01:24:31.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.801+0000 7f69de9f3700 1 -- 172.21.15.36:0/216509496 wait complete. 2022-01-10T01:24:31.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2022-01-10T01:24:31.818 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-01-10T01:24:31.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.917+0000 7fbbe40f1700 1 Processor -- start 2022-01-10T01:24:31.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.917+0000 7fbbe40f1700 1 -- start start 2022-01-10T01:24:31.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe40f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbdc0b1db0 0x7fbbdc0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe40f1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbbdc0a70c0 0x7fbbdc144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe40f1700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbdc0b0350 con 0x7fbbdc1483a0 2022-01-10T01:24:31.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe40f1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbdc0a90c0 con 0x7fbbdc0a70c0 2022-01-10T01:24:31.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe40f1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0b05f0 con 0x7fbbdc0b1db0 2022-01-10T01:24:31.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe168c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fbbdc1483a0 0x7fbbdc0b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60022/0 (socket says 172.21.15.36:60022) 2022-01-10T01:24:31.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe168c700 1 -- 172.21.15.36:0/2266456679 learned_addr learned my addr 172.21.15.36:0/2266456679 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:31.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe1e8d700 1 --2- 172.21.15.36:0/2266456679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbdc0b1db0 0x7fbbdc0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe268e700 1 --2- 172.21.15.36:0/2266456679 >> v2:172.21.15.59:3300/0 conn(0x7fbbdc0a70c0 0x7fbbdc144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe0e8b700 1 -- 172.21.15.36:0/2266456679 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579279745 0 0) 0x7fbbdc0b0350 con 0x7fbbdc1483a0 2022-01-10T01:24:31.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe0e8b700 1 -- 172.21.15.36:0/2266456679 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbc4003260 con 0x7fbbdc1483a0 2022-01-10T01:24:31.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe1e8d700 1 -- 172.21.15.36:0/2266456679 >> v2:172.21.15.59:3300/0 conn(0x7fbbdc0a70c0 msgr2=0x7fbbdc144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:31.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe1e8d700 1 --2- 172.21.15.36:0/2266456679 >> v2:172.21.15.59:3300/0 conn(0x7fbbdc0a70c0 0x7fbbdc144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe1e8d700 1 -- 172.21.15.36:0/2266456679 >> v1:172.21.15.36:6789/0 conn(0x7fbbdc1483a0 legacy=0x7fbbdc0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe1e8d700 1 -- 172.21.15.36:0/2266456679 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0b0890 con 0x7fbbdc0b1db0 2022-01-10T01:24:31.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe1e8d700 1 --2- 172.21.15.36:0/2266456679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbdc0b1db0 0x7fbbdc0b0fd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fbbcc002f70 tx=0x7fbbcc006df0).ready entity=mon.2 client_cookie=9e685e69b27df6ac server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:31.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe0e8b700 1 -- 172.21.15.36:0/2266456679 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbcc00d4a0 con 0x7fbbdc0b1db0 2022-01-10T01:24:31.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe0e8b700 1 -- 172.21.15.36:0/2266456679 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc000e90 con 0x7fbbdc0b1db0 2022-01-10T01:24:31.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe0e8b700 1 -- 172.21.15.36:0/2266456679 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbcc00d7f0 con 0x7fbbdc0b1db0 2022-01-10T01:24:31.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe40f1700 1 -- 172.21.15.36:0/2266456679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbdc0b1db0 msgr2=0x7fbbdc0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe40f1700 1 --2- 172.21.15.36:0/2266456679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbdc0b1db0 0x7fbbdc0b0fd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fbbcc002f70 tx=0x7fbbcc006df0).stop 2022-01-10T01:24:31.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe40f1700 1 -- 172.21.15.36:0/2266456679 shutdown_connections 2022-01-10T01:24:31.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe40f1700 1 --2- 172.21.15.36:0/2266456679 >> v2:172.21.15.59:3300/0 conn(0x7fbbdc0a70c0 0x7fbbdc144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe40f1700 1 --2- 172.21.15.36:0/2266456679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbdc0b1db0 0x7fbbdc0b0fd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe40f1700 1 -- 172.21.15.36:0/2266456679 >> 172.21.15.36:0/2266456679 conn(0x7fbbdc05f6b0 msgr2=0x7fbbdc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:31.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe40f1700 1 -- 172.21.15.36:0/2266456679 shutdown_connections 2022-01-10T01:24:31.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.921+0000 7fbbe40f1700 1 -- 172.21.15.36:0/2266456679 wait complete. 2022-01-10T01:24:31.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe40f1700 1 Processor -- start 2022-01-10T01:24:31.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe40f1700 1 -- start start 2022-01-10T01:24:31.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe40f1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbdc0a70c0 0x7fbbdc144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe40f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbdc0b1db0 0x7fbbdc148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe40f1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc1483a0 0x7fbbdc148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe40f1700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc1569c0 con 0x7fbbdc0a70c0 2022-01-10T01:24:31.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe40f1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc156c60 con 0x7fbbdc1483a0 2022-01-10T01:24:31.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe40f1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc156f00 con 0x7fbbdc0b1db0 2022-01-10T01:24:31.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe1e8d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbdc0a70c0 0x7fbbdc144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe1e8d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbdc0a70c0 0x7fbbdc144ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34002/0 (socket says 172.21.15.36:34002) 2022-01-10T01:24:31.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe1e8d700 1 -- 172.21.15.36:0/4053681938 learned_addr learned my addr 172.21.15.36:0/4053681938 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:31.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe168c700 1 --2- 172.21.15.36:0/4053681938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbdc0b1db0 0x7fbbdc148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe268e700 1 --2- 172.21.15.36:0/4053681938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc1483a0 0x7fbbdc148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe1e8d700 1 -- 172.21.15.36:0/4053681938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbdc0b1db0 msgr2=0x7fbbdc148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe1e8d700 1 --2- 172.21.15.36:0/4053681938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbdc0b1db0 0x7fbbdc148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe1e8d700 1 -- 172.21.15.36:0/4053681938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc1483a0 msgr2=0x7fbbdc148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:31.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe1e8d700 1 --2- 172.21.15.36:0/4053681938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc1483a0 0x7fbbdc148ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:31.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe1e8d700 1 -- 172.21.15.36:0/4053681938 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc00b180 con 0x7fbbdc0a70c0 2022-01-10T01:24:31.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe1e8d700 1 --2- 172.21.15.36:0/4053681938 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbdc0a70c0 0x7fbbdc144ae0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fbbcc002f70 tx=0x7fbbcc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:31.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbcaffd700 1 -- 172.21.15.36:0/4053681938 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbcc016070 con 0x7fbbdc0a70c0 2022-01-10T01:24:31.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbcaffd700 1 -- 172.21.15.36:0/4053681938 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc013800 con 0x7fbbdc0a70c0 2022-01-10T01:24:31.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbcaffd700 1 -- 172.21.15.36:0/4053681938 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbcc013b60 con 0x7fbbdc0a70c0 2022-01-10T01:24:31.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe40f1700 1 -- 172.21.15.36:0/4053681938 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbdc0aba50 con 0x7fbbdc0a70c0 2022-01-10T01:24:31.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.925+0000 7fbbe40f1700 1 -- 172.21.15.36:0/4053681938 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc0ac030 con 0x7fbbdc0a70c0 2022-01-10T01:24:31.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.929+0000 7fbbe40f1700 1 -- 172.21.15.36:0/4053681938 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbdc057350 con 0x7fbbdc0a70c0 2022-01-10T01:24:31.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.929+0000 7fbbcaffd700 1 -- 172.21.15.36:0/4053681938 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbbcc024030 con 0x7fbbdc0a70c0 2022-01-10T01:24:31.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.929+0000 7fbbcaffd700 1 --2- 172.21.15.36:0/4053681938 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbbc0535f0 0x7fbbbc055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:31.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.929+0000 7fbbe168c700 1 --2- 172.21.15.36:0/4053681938 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbbc0535f0 0x7fbbbc055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:31.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.929+0000 7fbbcaffd700 1 -- 172.21.15.36:0/4053681938 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fbbcc06c8d0 con 0x7fbbdc0a70c0 2022-01-10T01:24:31.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.929+0000 7fbbe168c700 1 --2- 172.21.15.36:0/4053681938 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbbc0535f0 0x7fbbbc055ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fbbd800d000 tx=0x7fbbd8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:31.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:31.937+0000 7fbbcaffd700 1 -- 172.21.15.36:0/4053681938 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbbcc0437d0 con 0x7fbbdc0a70c0 2022-01-10T01:24:32.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.065+0000 7fbbe40f1700 1 -- 172.21.15.36:0/4053681938 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbbdc044650 con 0x7fbbdc0a70c0 2022-01-10T01:24:32.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.065+0000 7fbbcaffd700 1 -- 172.21.15.36:0/4053681938 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbbcc022020 con 0x7fbbdc0a70c0 2022-01-10T01:24:32.071 INFO:teuthology.orchestra.run.smithi036.stdout:55834574853 2022-01-10T01:24:32.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.069+0000 7fbbe40f1700 1 -- 172.21.15.36:0/4053681938 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbbc0535f0 msgr2=0x7fbbbc055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:32.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.069+0000 7fbbe40f1700 1 --2- 172.21.15.36:0/4053681938 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbbc0535f0 0x7fbbbc055ab0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fbbd800d000 tx=0x7fbbd8009040).stop 2022-01-10T01:24:32.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.069+0000 7fbbe40f1700 1 -- 172.21.15.36:0/4053681938 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbdc0a70c0 msgr2=0x7fbbdc144ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:32.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.069+0000 7fbbe40f1700 1 --2- 172.21.15.36:0/4053681938 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbdc0a70c0 0x7fbbdc144ae0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fbbcc002f70 tx=0x7fbbcc014000).stop 2022-01-10T01:24:32.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.069+0000 7fbbe40f1700 1 -- 172.21.15.36:0/4053681938 shutdown_connections 2022-01-10T01:24:32.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.069+0000 7fbbe40f1700 1 --2- 172.21.15.36:0/4053681938 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbbc0535f0 0x7fbbbc055ab0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:32.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.069+0000 7fbbe40f1700 1 --2- 172.21.15.36:0/4053681938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbdc1483a0 0x7fbbdc148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:32.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.069+0000 7fbbe40f1700 1 --2- 172.21.15.36:0/4053681938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbdc0b1db0 0x7fbbdc148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:32.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.069+0000 7fbbe40f1700 1 --2- 172.21.15.36:0/4053681938 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbdc0a70c0 0x7fbbdc144ae0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:32.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.069+0000 7fbbe40f1700 1 -- 172.21.15.36:0/4053681938 >> 172.21.15.36:0/4053681938 conn(0x7fbbdc05f6b0 msgr2=0x7fbbdc0b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:32.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.069+0000 7fbbe40f1700 1 -- 172.21.15.36:0/4053681938 shutdown_connections 2022-01-10T01:24:32.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.069+0000 7fbbe40f1700 1 -- 172.21.15.36:0/4053681938 wait complete. 2022-01-10T01:24:32.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2022-01-10T01:24:32.090 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-01-10T01:24:32.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fffff700 1 Processor -- start 2022-01-10T01:24:32.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fffff700 1 -- start start 2022-01-10T01:24:32.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2000b0010 0x7fe2000a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:32.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2000afbd0 0x7fe2000a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:32.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fffff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2000a70c0 con 0x7fe2000b2580 2022-01-10T01:24:32.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fffff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2000a72f0 con 0x7fe2000afbd0 2022-01-10T01:24:32.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fffff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000a7590 con 0x7fe2000b0010 2022-01-10T01:24:32.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1feffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe2000b2580 0x7fe20014ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:49480/0 (socket says 172.21.15.36:49480) 2022-01-10T01:24:32.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1feffd700 1 -- 172.21.15.36:0/2117030666 learned_addr learned my addr 172.21.15.36:0/2117030666 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:32.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1ff7fe700 1 --2- 172.21.15.36:0/2117030666 >> v2:172.21.15.59:3300/0 conn(0x7fe2000afbd0 0x7fe2000a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:32.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fe7fc700 1 --2- 172.21.15.36:0/2117030666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2000b0010 0x7fe2000a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:32.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fdffb700 1 -- 172.21.15.36:0/2117030666 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1677447296 0 0) 0x7fe2000a70c0 con 0x7fe2000b2580 2022-01-10T01:24:32.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fdffb700 1 -- 172.21.15.36:0/2117030666 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e0003260 con 0x7fe2000b2580 2022-01-10T01:24:32.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1ff7fe700 1 -- 172.21.15.36:0/2117030666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2000b0010 msgr2=0x7fe2000a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:32.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1ff7fe700 1 --2- 172.21.15.36:0/2117030666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2000b0010 0x7fe2000a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:32.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1ff7fe700 1 -- 172.21.15.36:0/2117030666 >> v1:172.21.15.59:6789/0 conn(0x7fe2000b2580 legacy=0x7fe20014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:32.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1ff7fe700 1 -- 172.21.15.36:0/2117030666 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2000a7830 con 0x7fe2000afbd0 2022-01-10T01:24:32.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1ff7fe700 1 --2- 172.21.15.36:0/2117030666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2000afbd0 0x7fe2000a88a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fe1f0002f70 tx=0x7fe1f0006df0).ready entity=mon.1 client_cookie=1a102b8e4ef6df14 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:32.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fdffb700 1 -- 172.21.15.36:0/2117030666 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1f000d4a0 con 0x7fe2000afbd0 2022-01-10T01:24:32.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fdffb700 1 -- 172.21.15.36:0/2117030666 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f0000e90 con 0x7fe2000afbd0 2022-01-10T01:24:32.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fdffb700 1 -- 172.21.15.36:0/2117030666 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1f000d7f0 con 0x7fe2000afbd0 2022-01-10T01:24:32.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fffff700 1 -- 172.21.15.36:0/2117030666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2000afbd0 msgr2=0x7fe2000a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:32.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fffff700 1 --2- 172.21.15.36:0/2117030666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2000afbd0 0x7fe2000a88a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fe1f0002f70 tx=0x7fe1f0006df0).stop 2022-01-10T01:24:32.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fffff700 1 -- 172.21.15.36:0/2117030666 shutdown_connections 2022-01-10T01:24:32.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fffff700 1 --2- 172.21.15.36:0/2117030666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2000afbd0 0x7fe2000a88a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:32.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fffff700 1 --2- 172.21.15.36:0/2117030666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2000b0010 0x7fe2000a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:32.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fffff700 1 -- 172.21.15.36:0/2117030666 >> 172.21.15.36:0/2117030666 conn(0x7fe200060180 msgr2=0x7fe2000b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:32.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.189+0000 7fe1fffff700 1 -- 172.21.15.36:0/2117030666 shutdown_connections 2022-01-10T01:24:32.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fffff700 1 -- 172.21.15.36:0/2117030666 wait complete. 2022-01-10T01:24:32.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fffff700 1 Processor -- start 2022-01-10T01:24:32.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fffff700 1 -- start start 2022-01-10T01:24:32.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2000afbd0 0x7fe2000a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:32.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2000b0010 0x7fe20005c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:32.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2000b2580 0x7fe2001564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:32.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fffff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20015a3f0 con 0x7fe2000afbd0 2022-01-10T01:24:32.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fffff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2000a98d0 con 0x7fe2000b2580 2022-01-10T01:24:32.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fffff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe200144000 con 0x7fe2000b0010 2022-01-10T01:24:32.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1feffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2000afbd0 0x7fe2000a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:32.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fe7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2000b0010 0x7fe20005c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:32.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1ff7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2000b2580 0x7fe2001564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:32.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1ff7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2000b2580 0x7fe2001564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:58884/0 (socket says 172.21.15.36:58884) 2022-01-10T01:24:32.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fe7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2000b0010 0x7fe20005c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:40296/0 (socket says 172.21.15.36:40296) 2022-01-10T01:24:32.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1ff7fe700 1 -- 172.21.15.36:0/966703007 learned_addr learned my addr 172.21.15.36:0/966703007 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:32.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fe7fc700 1 -- 172.21.15.36:0/966703007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2000b2580 msgr2=0x7fe2001564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:32.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fe7fc700 1 --2- 172.21.15.36:0/966703007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2000b2580 0x7fe2001564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:32.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fe7fc700 1 -- 172.21.15.36:0/966703007 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2000afbd0 msgr2=0x7fe2000a93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:32.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fe7fc700 1 --2- 172.21.15.36:0/966703007 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2000afbd0 0x7fe2000a93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:32.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fe7fc700 1 -- 172.21.15.36:0/966703007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f000b180 con 0x7fe2000b0010 2022-01-10T01:24:32.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.193+0000 7fe1fe7fc700 1 --2- 172.21.15.36:0/966703007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2000b0010 0x7fe20005c950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe200144500 tx=0x7fe1e8006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:32.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.197+0000 7fe1f7fff700 1 -- 172.21.15.36:0/966703007 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e8010780 con 0x7fe2000b0010 2022-01-10T01:24:32.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.197+0000 7fe1f7fff700 1 -- 172.21.15.36:0/966703007 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e80108e0 con 0x7fe2000b0010 2022-01-10T01:24:32.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.197+0000 7fe1f7fff700 1 -- 172.21.15.36:0/966703007 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1e8010c40 con 0x7fe2000b0010 2022-01-10T01:24:32.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.197+0000 7fe1fffff700 1 -- 172.21.15.36:0/966703007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2000b5f70 con 0x7fe2000b0010 2022-01-10T01:24:32.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.197+0000 7fe1fffff700 1 -- 172.21.15.36:0/966703007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20015a5e0 con 0x7fe2000b0010 2022-01-10T01:24:32.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.197+0000 7fe1fffff700 1 -- 172.21.15.36:0/966703007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe200057350 con 0x7fe2000b0010 2022-01-10T01:24:32.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.197+0000 7fe1f7fff700 1 -- 172.21.15.36:0/966703007 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe1e801b410 con 0x7fe2000b0010 2022-01-10T01:24:32.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.197+0000 7fe1f7fff700 1 --2- 172.21.15.36:0/966703007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe1e4053680 0x7fe1e4055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:32.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.197+0000 7fe1f7fff700 1 -- 172.21.15.36:0/966703007 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe1e806c230 con 0x7fe2000b0010 2022-01-10T01:24:32.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.197+0000 7fe1feffd700 1 --2- 172.21.15.36:0/966703007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe1e4053680 0x7fe1e4055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:32.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.197+0000 7fe1feffd700 1 --2- 172.21.15.36:0/966703007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe1e4053680 0x7fe1e4055b40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe1f800d000 tx=0x7fe1f8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:32.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.205+0000 7fe1f7fff700 1 -- 172.21.15.36:0/966703007 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe1e8043050 con 0x7fe2000b0010 2022-01-10T01:24:32.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.333+0000 7fe1fffff700 1 -- 172.21.15.36:0/966703007 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fe2000af980 con 0x7fe2000b0010 2022-01-10T01:24:32.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.333+0000 7fe1f7fff700 1 -- 172.21.15.36:0/966703007 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1e8037020 con 0x7fe2000b0010 2022-01-10T01:24:32.340 INFO:teuthology.orchestra.run.smithi036.stdout:55834574853 2022-01-10T01:24:32.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.337+0000 7fe1fffff700 1 -- 172.21.15.36:0/966703007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe1e4053680 msgr2=0x7fe1e4055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:32.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.337+0000 7fe1fffff700 1 --2- 172.21.15.36:0/966703007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe1e4053680 0x7fe1e4055b40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe1f800d000 tx=0x7fe1f8009040).stop 2022-01-10T01:24:32.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.337+0000 7fe1fffff700 1 -- 172.21.15.36:0/966703007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2000b0010 msgr2=0x7fe20005c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:32.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.337+0000 7fe1fffff700 1 --2- 172.21.15.36:0/966703007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2000b0010 0x7fe20005c950 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe200144500 tx=0x7fe1e8006df0).stop 2022-01-10T01:24:32.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.337+0000 7fe1fffff700 1 -- 172.21.15.36:0/966703007 shutdown_connections 2022-01-10T01:24:32.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.337+0000 7fe1fffff700 1 --2- 172.21.15.36:0/966703007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe1e4053680 0x7fe1e4055b40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:32.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.337+0000 7fe1fffff700 1 --2- 172.21.15.36:0/966703007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2000b2580 0x7fe2001564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:32.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.337+0000 7fe1fffff700 1 --2- 172.21.15.36:0/966703007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2000b0010 0x7fe20005c950 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:32.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.337+0000 7fe1fffff700 1 --2- 172.21.15.36:0/966703007 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2000afbd0 0x7fe2000a93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:32.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.337+0000 7fe1fffff700 1 -- 172.21.15.36:0/966703007 >> 172.21.15.36:0/966703007 conn(0x7fe200060180 msgr2=0x7fe2000af260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:32.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.337+0000 7fe1fffff700 1 -- 172.21.15.36:0/966703007 shutdown_connections 2022-01-10T01:24:32.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:32.337+0000 7fe1fffff700 1 -- 172.21.15.36:0/966703007 wait complete. 2022-01-10T01:24:32.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2022-01-10T01:24:33.357 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-01-10T01:24:33.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f920df8c700 1 Processor -- start 2022-01-10T01:24:33.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f920df8c700 1 -- start start 2022-01-10T01:24:33.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f920df8c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f92080b6290 0x7f9208061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:33.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f920df8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92080b4060 0x7f9208061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:33.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f920df8c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92080b5f50 con 0x7f9208061e50 2022-01-10T01:24:33.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f920df8c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92080b1f70 con 0x7f92080b6290 2022-01-10T01:24:33.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f920df8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92080b2210 con 0x7f92080b4060 2022-01-10T01:24:33.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f920cf8a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f92080b6290 0x7f9208061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:33.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f9207fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92080b4060 0x7f9208061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:33.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f920d78b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9208061e50 0x7f9208146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:49496/0 (socket says 172.21.15.36:49496) 2022-01-10T01:24:33.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f920d78b700 1 -- 172.21.15.36:0/3362529503 learned_addr learned my addr 172.21.15.36:0/3362529503 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:33.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f92077fe700 1 -- 172.21.15.36:0/3362529503 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033576671 0 0) 0x7f9200001110 con 0x7f9208061e50 2022-01-10T01:24:33.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f92077fe700 1 -- 172.21.15.36:0/3362529503 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91e8003260 con 0x7f9208061e50 2022-01-10T01:24:33.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f9207fff700 1 -- 172.21.15.36:0/3362529503 >> v2:172.21.15.59:3300/0 conn(0x7f92080b6290 msgr2=0x7f9208061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:33.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f9207fff700 1 --2- 172.21.15.36:0/3362529503 >> v2:172.21.15.59:3300/0 conn(0x7f92080b6290 0x7f9208061470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f9207fff700 1 -- 172.21.15.36:0/3362529503 >> v1:172.21.15.59:6789/0 conn(0x7f9208061e50 legacy=0x7f9208146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:33.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f9207fff700 1 -- 172.21.15.36:0/3362529503 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92080b24b0 con 0x7f92080b4060 2022-01-10T01:24:33.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f920cf8a700 1 --2- 172.21.15.36:0/3362529503 >> v2:172.21.15.59:3300/0 conn(0x7f92080b6290 0x7f9208061470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:33.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f9207fff700 1 --2- 172.21.15.36:0/3362529503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92080b4060 0x7f9208061960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f91f00032f0 tx=0x7f91f00091d0).ready entity=mon.2 client_cookie=cc47f5d85f9e3c1d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:33.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f92077fe700 1 -- 172.21.15.36:0/3362529503 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91f000b600 con 0x7f92080b4060 2022-01-10T01:24:33.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f92077fe700 1 -- 172.21.15.36:0/3362529503 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f000b760 con 0x7f92080b4060 2022-01-10T01:24:33.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.469+0000 7f92077fe700 1 -- 172.21.15.36:0/3362529503 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91f000b8d0 con 0x7f92080b4060 2022-01-10T01:24:33.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 -- 172.21.15.36:0/3362529503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92080b4060 msgr2=0x7f9208061960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:33.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 --2- 172.21.15.36:0/3362529503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92080b4060 0x7f9208061960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f91f00032f0 tx=0x7f91f00091d0).stop 2022-01-10T01:24:33.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 -- 172.21.15.36:0/3362529503 shutdown_connections 2022-01-10T01:24:33.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 --2- 172.21.15.36:0/3362529503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92080b4060 0x7f9208061960 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 --2- 172.21.15.36:0/3362529503 >> v2:172.21.15.59:3300/0 conn(0x7f92080b6290 0x7f9208061470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 -- 172.21.15.36:0/3362529503 >> 172.21.15.36:0/3362529503 conn(0x7f920805c490 msgr2=0x7f920805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:33.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 -- 172.21.15.36:0/3362529503 shutdown_connections 2022-01-10T01:24:33.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 -- 172.21.15.36:0/3362529503 wait complete. 2022-01-10T01:24:33.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 Processor -- start 2022-01-10T01:24:33.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 -- start start 2022-01-10T01:24:33.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9208061e50 0x7f92080b8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:33.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92080b4060 0x7f9208155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:33.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92080b6290 0x7f9208156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:33.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9208142260 con 0x7f9208061e50 2022-01-10T01:24:33.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9208141fc0 con 0x7f92080b6290 2022-01-10T01:24:33.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920df8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92081425e0 con 0x7f92080b4060 2022-01-10T01:24:33.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920cf8a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9208061e50 0x7f92080b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:33.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f9207fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92080b4060 0x7f9208155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:33.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920cf8a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9208061e50 0x7f92080b8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34030/0 (socket says 172.21.15.36:34030) 2022-01-10T01:24:33.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920cf8a700 1 -- 172.21.15.36:0/2513715758 learned_addr learned my addr 172.21.15.36:0/2513715758 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:33.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.473+0000 7f920d78b700 1 --2- 172.21.15.36:0/2513715758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92080b6290 0x7f9208156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:33.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f920d78b700 1 -- 172.21.15.36:0/2513715758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92080b4060 msgr2=0x7f9208155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:33.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f920d78b700 1 --2- 172.21.15.36:0/2513715758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92080b4060 0x7f9208155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f920d78b700 1 -- 172.21.15.36:0/2513715758 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9208061e50 msgr2=0x7f92080b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:33.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f920d78b700 1 --2- 172.21.15.36:0/2513715758 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9208061e50 0x7f92080b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f920d78b700 1 -- 172.21.15.36:0/2513715758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f800b180 con 0x7f92080b6290 2022-01-10T01:24:33.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f920d78b700 1 --2- 172.21.15.36:0/2513715758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92080b6290 0x7f9208156130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f92000012a0 tx=0x7f9200007820).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:33.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f9205ffb700 1 -- 172.21.15.36:0/2513715758 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f920000cdb0 con 0x7f92080b6290 2022-01-10T01:24:33.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f9205ffb700 1 -- 172.21.15.36:0/2513715758 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92000070d0 con 0x7f92080b6290 2022-01-10T01:24:33.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f920df8c700 1 -- 172.21.15.36:0/2513715758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f0009470 con 0x7f92080b6290 2022-01-10T01:24:33.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f9205ffb700 1 -- 172.21.15.36:0/2513715758 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9200007430 con 0x7f92080b6290 2022-01-10T01:24:33.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f920df8c700 1 -- 172.21.15.36:0/2513715758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9208142b20 con 0x7f92080b6290 2022-01-10T01:24:33.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f920df8c700 1 -- 172.21.15.36:0/2513715758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9208142cb0 con 0x7f92080b6290 2022-01-10T01:24:33.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f9205ffb700 1 -- 172.21.15.36:0/2513715758 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9200010070 con 0x7f92080b6290 2022-01-10T01:24:33.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f9205ffb700 1 --2- 172.21.15.36:0/2513715758 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91ec053560 0x7f91ec055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:33.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f9205ffb700 1 -- 172.21.15.36:0/2513715758 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f920006af90 con 0x7f92080b6290 2022-01-10T01:24:33.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.477+0000 7f920cf8a700 1 --2- 172.21.15.36:0/2513715758 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91ec053560 0x7f91ec055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:33.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.481+0000 7f920cf8a700 1 --2- 172.21.15.36:0/2513715758 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91ec053560 0x7f91ec055a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f91f800b000 tx=0x7f91f8006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:33.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.485+0000 7f9205ffb700 1 -- 172.21.15.36:0/2513715758 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9200041e10 con 0x7f92080b6290 2022-01-10T01:24:33.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.617+0000 7f920df8c700 1 -- 172.21.15.36:0/2513715758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f92080b5f50 con 0x7f92080b6290 2022-01-10T01:24:33.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.621+0000 7f9205ffb700 1 -- 172.21.15.36:0/2513715758 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92080b5f50 con 0x7f92080b6290 2022-01-10T01:24:33.624 INFO:teuthology.orchestra.run.smithi036.stdout:55834574854 2022-01-10T01:24:33.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.621+0000 7f920df8c700 1 -- 172.21.15.36:0/2513715758 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91ec053560 msgr2=0x7f91ec055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:33.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.621+0000 7f920df8c700 1 --2- 172.21.15.36:0/2513715758 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91ec053560 0x7f91ec055a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f91f800b000 tx=0x7f91f8006df0).stop 2022-01-10T01:24:33.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.621+0000 7f920df8c700 1 -- 172.21.15.36:0/2513715758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92080b6290 msgr2=0x7f9208156130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:33.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.621+0000 7f920df8c700 1 --2- 172.21.15.36:0/2513715758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92080b6290 0x7f9208156130 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f92000012a0 tx=0x7f9200007820).stop 2022-01-10T01:24:33.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.621+0000 7f920df8c700 1 -- 172.21.15.36:0/2513715758 shutdown_connections 2022-01-10T01:24:33.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.621+0000 7f920df8c700 1 --2- 172.21.15.36:0/2513715758 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91ec053560 0x7f91ec055a20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.621+0000 7f920df8c700 1 --2- 172.21.15.36:0/2513715758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92080b6290 0x7f9208156130 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.621+0000 7f920df8c700 1 --2- 172.21.15.36:0/2513715758 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92080b4060 0x7f9208155c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.621+0000 7f920df8c700 1 --2- 172.21.15.36:0/2513715758 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9208061e50 0x7f92080b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.621+0000 7f920df8c700 1 -- 172.21.15.36:0/2513715758 >> 172.21.15.36:0/2513715758 conn(0x7f920805c490 msgr2=0x7f920812b230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:33.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.621+0000 7f920df8c700 1 -- 172.21.15.36:0/2513715758 shutdown_connections 2022-01-10T01:24:33.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.621+0000 7f920df8c700 1 -- 172.21.15.36:0/2513715758 wait complete. 2022-01-10T01:24:33.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2022-01-10T01:24:33.644 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2022-01-10T01:24:33.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0e4a5d700 1 Processor -- start 2022-01-10T01:24:33.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0e4a5d700 1 -- start start 2022-01-10T01:24:33.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0e4a5d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0e00b0010 0x7fd0e00a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:33.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0e4a5d700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e00a70c0 con 0x7fd0e00afbd0 2022-01-10T01:24:33.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0e4a5d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e00a72f0 con 0x7fd0e00b2580 2022-01-10T01:24:33.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0e4a5d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e00a7590 con 0x7fd0e00b0010 2022-01-10T01:24:33.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0dffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd0e00afbd0 0x7fd0e0151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60066/0 (socket says 172.21.15.36:60066) 2022-01-10T01:24:33.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0dffff700 1 -- 172.21.15.36:0/932662191 learned_addr learned my addr 172.21.15.36:0/932662191 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:33.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0deffd700 1 --2- 172.21.15.36:0/932662191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0e00b0010 0x7fd0e00a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:33.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0de7fc700 1 -- 172.21.15.36:0/932662191 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821168992 0 0) 0x7fd0e00a70c0 con 0x7fd0e00afbd0 2022-01-10T01:24:33.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0de7fc700 1 -- 172.21.15.36:0/932662191 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0c0003260 con 0x7fd0e00afbd0 2022-01-10T01:24:33.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0de7fc700 1 -- 172.21.15.36:0/932662191 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747603914 0 0) 0x7fd0e00a72f0 con 0x7fd0e00b2580 2022-01-10T01:24:33.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0de7fc700 1 -- 172.21.15.36:0/932662191 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0e00a70c0 con 0x7fd0e00b2580 2022-01-10T01:24:33.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0deffd700 1 -- 172.21.15.36:0/932662191 >> v1:172.21.15.59:6789/0 conn(0x7fd0e00b2580 legacy=0x7fd0e014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:33.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0deffd700 1 -- 172.21.15.36:0/932662191 >> v1:172.21.15.36:6789/0 conn(0x7fd0e00afbd0 legacy=0x7fd0e0151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:33.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0deffd700 1 -- 172.21.15.36:0/932662191 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e00a7830 con 0x7fd0e00b0010 2022-01-10T01:24:33.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0deffd700 1 --2- 172.21.15.36:0/932662191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0e00b0010 0x7fd0e00a83b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd0d80032f0 tx=0x7fd0d80091d0).ready entity=mon.2 client_cookie=3a19a21c695e30a2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:33.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0de7fc700 1 -- 172.21.15.36:0/932662191 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0d800b640 con 0x7fd0e00b0010 2022-01-10T01:24:33.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0de7fc700 1 -- 172.21.15.36:0/932662191 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d800b7a0 con 0x7fd0e00b0010 2022-01-10T01:24:33.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0de7fc700 1 -- 172.21.15.36:0/932662191 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0d800b910 con 0x7fd0e00b0010 2022-01-10T01:24:33.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/932662191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0e00b0010 msgr2=0x7fd0e00a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:33.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0e4a5d700 1 --2- 172.21.15.36:0/932662191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0e00b0010 0x7fd0e00a83b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd0d80032f0 tx=0x7fd0d80091d0).stop 2022-01-10T01:24:33.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/932662191 shutdown_connections 2022-01-10T01:24:33.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0e4a5d700 1 --2- 172.21.15.36:0/932662191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0e00b0010 0x7fd0e00a83b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/932662191 >> 172.21.15.36:0/932662191 conn(0x7fd0e0060180 msgr2=0x7fd0e00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:33.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.745+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/932662191 shutdown_connections 2022-01-10T01:24:33.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/932662191 wait complete. 2022-01-10T01:24:33.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0e4a5d700 1 Processor -- start 2022-01-10T01:24:33.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0e4a5d700 1 -- start start 2022-01-10T01:24:33.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0e4a5d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0e00afbd0 0x7fd0e00af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:33.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0e4a5d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd0e00b0010 0x7fd0e00b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:33.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0e4a5d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e00b2580 0x7fd0e00b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:33.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0e4a5d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e00b3840 con 0x7fd0e00b0010 2022-01-10T01:24:33.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0e4a5d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e00b3350 con 0x7fd0e00b2580 2022-01-10T01:24:33.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0e4a5d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e00b3aa0 con 0x7fd0e00afbd0 2022-01-10T01:24:33.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0deffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd0e00b0010 0x7fd0e00b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:33.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0deffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd0e00b0010 0x7fd0e00b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34042/0 (socket says 172.21.15.36:34042) 2022-01-10T01:24:33.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0deffd700 1 -- 172.21.15.36:0/2138036413 learned_addr learned my addr 172.21.15.36:0/2138036413 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:33.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0df7fe700 1 --2- 172.21.15.36:0/2138036413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0e00afbd0 0x7fd0e00af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:33.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0dffff700 1 --2- 172.21.15.36:0/2138036413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e00b2580 0x7fd0e00b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:33.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0deffd700 1 -- 172.21.15.36:0/2138036413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0e00afbd0 msgr2=0x7fd0e00af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:33.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0deffd700 1 --2- 172.21.15.36:0/2138036413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0e00afbd0 0x7fd0e00af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0deffd700 1 -- 172.21.15.36:0/2138036413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e00b2580 msgr2=0x7fd0e00b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:33.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0deffd700 1 --2- 172.21.15.36:0/2138036413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e00b2580 0x7fd0e00b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0deffd700 1 -- 172.21.15.36:0/2138036413 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d8009470 con 0x7fd0e00b0010 2022-01-10T01:24:33.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0deffd700 1 --2- 172.21.15.36:0/2138036413 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd0e00b0010 0x7fd0e00b47c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fd0d80032f0 tx=0x7fd0d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:33.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0dcff9700 1 -- 172.21.15.36:0/2138036413 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0d800b910 con 0x7fd0e00b0010 2022-01-10T01:24:33.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0dcff9700 1 -- 172.21.15.36:0/2138036413 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d801f5e0 con 0x7fd0e00b0010 2022-01-10T01:24:33.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/2138036413 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e00b3d40 con 0x7fd0e00b0010 2022-01-10T01:24:33.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0dcff9700 1 -- 172.21.15.36:0/2138036413 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0d800b640 con 0x7fd0e00b0010 2022-01-10T01:24:33.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.749+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/2138036413 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e014cca0 con 0x7fd0e00b0010 2022-01-10T01:24:33.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.753+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/2138036413 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e0057350 con 0x7fd0e00b0010 2022-01-10T01:24:33.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.753+0000 7fd0dcff9700 1 -- 172.21.15.36:0/2138036413 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd0d800f070 con 0x7fd0e00b0010 2022-01-10T01:24:33.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.753+0000 7fd0dcff9700 1 --2- 172.21.15.36:0/2138036413 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd0c4053560 0x7fd0c4055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:33.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.753+0000 7fd0dcff9700 1 -- 172.21.15.36:0/2138036413 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd0d806c670 con 0x7fd0e00b0010 2022-01-10T01:24:33.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.753+0000 7fd0df7fe700 1 --2- 172.21.15.36:0/2138036413 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd0c4053560 0x7fd0c4055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:33.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.753+0000 7fd0df7fe700 1 --2- 172.21.15.36:0/2138036413 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd0c4053560 0x7fd0c4055a20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd0c800b000 tx=0x7fd0c8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:33.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.757+0000 7fd0dcff9700 1 -- 172.21.15.36:0/2138036413 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd0d8043680 con 0x7fd0e00b0010 2022-01-10T01:24:33.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.880+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/2138036413 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd0e00698e0 con 0x7fd0e00b0010 2022-01-10T01:24:33.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.880+0000 7fd0dcff9700 1 -- 172.21.15.36:0/2138036413 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd0d8015090 con 0x7fd0e00b0010 2022-01-10T01:24:33.888 INFO:teuthology.orchestra.run.smithi036.stdout:55834574853 2022-01-10T01:24:33.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.884+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/2138036413 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd0c4053560 msgr2=0x7fd0c4055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:33.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.884+0000 7fd0e4a5d700 1 --2- 172.21.15.36:0/2138036413 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd0c4053560 0x7fd0c4055a20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd0c800b000 tx=0x7fd0c8009040).stop 2022-01-10T01:24:33.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.884+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/2138036413 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd0e00b0010 msgr2=0x7fd0e00b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:33.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.884+0000 7fd0e4a5d700 1 --2- 172.21.15.36:0/2138036413 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd0e00b0010 0x7fd0e00b47c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fd0d80032f0 tx=0x7fd0d8016000).stop 2022-01-10T01:24:33.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.884+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/2138036413 shutdown_connections 2022-01-10T01:24:33.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.884+0000 7fd0e4a5d700 1 --2- 172.21.15.36:0/2138036413 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd0c4053560 0x7fd0c4055a20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.884+0000 7fd0e4a5d700 1 --2- 172.21.15.36:0/2138036413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0e00b2580 0x7fd0e00b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.884+0000 7fd0e4a5d700 1 --2- 172.21.15.36:0/2138036413 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd0e00b0010 0x7fd0e00b47c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.884+0000 7fd0e4a5d700 1 --2- 172.21.15.36:0/2138036413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0e00afbd0 0x7fd0e00af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:33.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.884+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/2138036413 >> 172.21.15.36:0/2138036413 conn(0x7fd0e0060180 msgr2=0x7fd0e0149690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:33.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.884+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/2138036413 shutdown_connections 2022-01-10T01:24:33.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.884+0000 7fd0e4a5d700 1 -- 172.21.15.36:0/2138036413 wait complete. 2022-01-10T01:24:33.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2022-01-10T01:24:33.901 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2022-01-10T01:24:34.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.996+0000 7f87ebd5b700 1 Processor -- start 2022-01-10T01:24:34.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:33.996+0000 7f87ebd5b700 1 -- start start 2022-01-10T01:24:34.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87ebd5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87e40b1db0 0x7f87e40b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87ebd5b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87e41483a0 0x7f87e40b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87ebd5b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e40b0350 con 0x7f87e40a70c0 2022-01-10T01:24:34.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87ebd5b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e40a90c0 con 0x7f87e41483a0 2022-01-10T01:24:34.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87ebd5b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e40b05f0 con 0x7f87e40b1db0 2022-01-10T01:24:34.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87e92f6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87e41483a0 0x7f87e40b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87e92f6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87e41483a0 0x7f87e40b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:58916/0 (socket says 172.21.15.36:58916) 2022-01-10T01:24:34.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87e92f6700 1 -- 172.21.15.36:0/89123011 learned_addr learned my addr 172.21.15.36:0/89123011 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:34.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87e9af7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87e40b1db0 0x7f87e40b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87e92f6700 1 -- 172.21.15.36:0/89123011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87e40b1db0 msgr2=0x7f87e40b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:34.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87e92f6700 1 --2- 172.21.15.36:0/89123011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87e40b1db0 0x7f87e40b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87e92f6700 1 -- 172.21.15.36:0/89123011 >> v1:172.21.15.59:6789/0 conn(0x7f87e40a70c0 legacy=0x7f87e4144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87e92f6700 1 -- 172.21.15.36:0/89123011 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e40b0890 con 0x7f87e41483a0 2022-01-10T01:24:34.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87e92f6700 1 --2- 172.21.15.36:0/89123011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e41483a0 0x7f87e40b2190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f87e0002f70 tx=0x7f87e0006eb0).ready entity=mon.1 client_cookie=72455b3e05bed761 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:34.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87e8af5700 1 -- 172.21.15.36:0/89123011 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87e000d570 con 0x7f87e41483a0 2022-01-10T01:24:34.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87e8af5700 1 -- 172.21.15.36:0/89123011 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0000e90 con 0x7f87e41483a0 2022-01-10T01:24:34.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87e8af5700 1 -- 172.21.15.36:0/89123011 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87e000d900 con 0x7f87e41483a0 2022-01-10T01:24:34.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87ebd5b700 1 -- 172.21.15.36:0/89123011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e41483a0 msgr2=0x7f87e40b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87ebd5b700 1 --2- 172.21.15.36:0/89123011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e41483a0 0x7f87e40b2190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f87e0002f70 tx=0x7f87e0006eb0).stop 2022-01-10T01:24:34.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87ebd5b700 1 -- 172.21.15.36:0/89123011 shutdown_connections 2022-01-10T01:24:34.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87ebd5b700 1 --2- 172.21.15.36:0/89123011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e41483a0 0x7f87e40b2190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87ebd5b700 1 --2- 172.21.15.36:0/89123011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87e40b1db0 0x7f87e40b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87ebd5b700 1 -- 172.21.15.36:0/89123011 >> 172.21.15.36:0/89123011 conn(0x7f87e405f6b0 msgr2=0x7f87e405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:34.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87ebd5b700 1 -- 172.21.15.36:0/89123011 shutdown_connections 2022-01-10T01:24:34.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.000+0000 7f87ebd5b700 1 -- 172.21.15.36:0/89123011 wait complete. 2022-01-10T01:24:34.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ebd5b700 1 Processor -- start 2022-01-10T01:24:34.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ebd5b700 1 -- start start 2022-01-10T01:24:34.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ebd5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87e40a70c0 0x7f87e4063b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ebd5b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e40b1db0 0x7f87e41574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ebd5b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87e41483a0 0x7f87e4066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ebd5b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4156920 con 0x7f87e41483a0 2022-01-10T01:24:34.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ebd5b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4062f40 con 0x7f87e40b1db0 2022-01-10T01:24:34.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ebd5b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e4156b10 con 0x7f87e40a70c0 2022-01-10T01:24:34.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ea2f8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87e41483a0 0x7f87e4066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87e9af7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87e40a70c0 0x7f87e4063b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87e9af7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87e40a70c0 0x7f87e4063b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:40338/0 (socket says 172.21.15.36:40338) 2022-01-10T01:24:34.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87e9af7700 1 -- 172.21.15.36:0/1853647725 learned_addr learned my addr 172.21.15.36:0/1853647725 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:34.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87e92f6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e40b1db0 0x7f87e41574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ea2f8700 1 -- 172.21.15.36:0/1853647725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87e40a70c0 msgr2=0x7f87e4063b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ea2f8700 1 --2- 172.21.15.36:0/1853647725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87e40a70c0 0x7f87e4063b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ea2f8700 1 -- 172.21.15.36:0/1853647725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e40b1db0 msgr2=0x7f87e41574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ea2f8700 1 --2- 172.21.15.36:0/1853647725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e40b1db0 0x7f87e41574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ea2f8700 1 -- 172.21.15.36:0/1853647725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e000b1e0 con 0x7f87e41483a0 2022-01-10T01:24:34.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87e9af7700 1 --2- 172.21.15.36:0/1853647725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87e40a70c0 0x7f87e4063b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:34.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ea2f8700 1 --2- 172.21.15.36:0/1853647725 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87e41483a0 0x7f87e4066550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f87e40613a0 tx=0x7f87dc007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:34.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87d2ffd700 1 -- 172.21.15.36:0/1853647725 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87dc00f470 con 0x7f87e41483a0 2022-01-10T01:24:34.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87d2ffd700 1 -- 172.21.15.36:0/1853647725 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc00f5d0 con 0x7f87e41483a0 2022-01-10T01:24:34.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ebd5b700 1 -- 172.21.15.36:0/1853647725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e4156db0 con 0x7f87e41483a0 2022-01-10T01:24:34.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87d2ffd700 1 -- 172.21.15.36:0/1853647725 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87dc00f930 con 0x7f87e41483a0 2022-01-10T01:24:34.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.004+0000 7f87ebd5b700 1 -- 172.21.15.36:0/1853647725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e4066a40 con 0x7f87e41483a0 2022-01-10T01:24:34.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.008+0000 7f87ebd5b700 1 -- 172.21.15.36:0/1853647725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e40b0b30 con 0x7f87e41483a0 2022-01-10T01:24:34.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.008+0000 7f87d2ffd700 1 -- 172.21.15.36:0/1853647725 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f87dc010070 con 0x7f87e41483a0 2022-01-10T01:24:34.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.008+0000 7f87d2ffd700 1 --2- 172.21.15.36:0/1853647725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f87c40535f0 0x7f87c4055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.008+0000 7f87d2ffd700 1 -- 172.21.15.36:0/1853647725 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f87dc06afc0 con 0x7f87e41483a0 2022-01-10T01:24:34.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.008+0000 7f87e9af7700 1 --2- 172.21.15.36:0/1853647725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f87c40535f0 0x7f87c4055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.008+0000 7f87e9af7700 1 --2- 172.21.15.36:0/1853647725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f87c40535f0 0x7f87c4055ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f87d400b000 tx=0x7f87d4006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:34.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.016+0000 7f87d2ffd700 1 -- 172.21.15.36:0/1853647725 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f87dc041f50 con 0x7f87e41483a0 2022-01-10T01:24:34.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.140+0000 7f87ebd5b700 1 -- 172.21.15.36:0/1853647725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f87e4057350 con 0x7f87e41483a0 2022-01-10T01:24:34.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.140+0000 7f87d2ffd700 1 -- 172.21.15.36:0/1853647725 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f87dc045570 con 0x7f87e41483a0 2022-01-10T01:24:34.147 INFO:teuthology.orchestra.run.smithi036.stdout:55834574853 2022-01-10T01:24:34.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.144+0000 7f87ebd5b700 1 -- 172.21.15.36:0/1853647725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f87c40535f0 msgr2=0x7f87c4055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.144+0000 7f87ebd5b700 1 --2- 172.21.15.36:0/1853647725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f87c40535f0 0x7f87c4055ab0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f87d400b000 tx=0x7f87d4006df0).stop 2022-01-10T01:24:34.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.144+0000 7f87ebd5b700 1 -- 172.21.15.36:0/1853647725 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87e41483a0 msgr2=0x7f87e4066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.144+0000 7f87ebd5b700 1 --2- 172.21.15.36:0/1853647725 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87e41483a0 0x7f87e4066550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f87e40613a0 tx=0x7f87dc007eb0).stop 2022-01-10T01:24:34.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.144+0000 7f87ebd5b700 1 -- 172.21.15.36:0/1853647725 shutdown_connections 2022-01-10T01:24:34.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.144+0000 7f87ebd5b700 1 --2- 172.21.15.36:0/1853647725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f87c40535f0 0x7f87c4055ab0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.144+0000 7f87ebd5b700 1 --2- 172.21.15.36:0/1853647725 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87e41483a0 0x7f87e4066550 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.144+0000 7f87ebd5b700 1 --2- 172.21.15.36:0/1853647725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87e40b1db0 0x7f87e41574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.144+0000 7f87ebd5b700 1 --2- 172.21.15.36:0/1853647725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87e40a70c0 0x7f87e4063b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.144+0000 7f87ebd5b700 1 -- 172.21.15.36:0/1853647725 >> 172.21.15.36:0/1853647725 conn(0x7f87e405f6b0 msgr2=0x7f87e4143d70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:34.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.144+0000 7f87ebd5b700 1 -- 172.21.15.36:0/1853647725 shutdown_connections 2022-01-10T01:24:34.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.144+0000 7f87ebd5b700 1 -- 172.21.15.36:0/1853647725 wait complete. 2022-01-10T01:24:34.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2022-01-10T01:24:34.166 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2022-01-10T01:24:34.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa196596700 1 Processor -- start 2022-01-10T01:24:34.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa196596700 1 -- start start 2022-01-10T01:24:34.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa196596700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1900b0fd0 0x7fa190144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa196596700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1900b0350 con 0x7fa1901483a0 2022-01-10T01:24:34.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa196596700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1900b05f0 con 0x7fa1900b1db0 2022-01-10T01:24:34.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa196596700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900a90c0 con 0x7fa1900b0fd0 2022-01-10T01:24:34.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa18f7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa1901483a0 0x7fa1900a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60090/0 (socket says 172.21.15.36:60090) 2022-01-10T01:24:34.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa18f7fe700 1 -- 172.21.15.36:0/2487542660 learned_addr learned my addr 172.21.15.36:0/2487542660 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:34.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa194b33700 1 --2- 172.21.15.36:0/2487542660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1900b0fd0 0x7fa190144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa18effd700 1 -- 172.21.15.36:0/2487542660 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880859459 0 0) 0x7fa1900b0350 con 0x7fa1901483a0 2022-01-10T01:24:34.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa18effd700 1 -- 172.21.15.36:0/2487542660 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa17c003260 con 0x7fa1901483a0 2022-01-10T01:24:34.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa18effd700 1 -- 172.21.15.36:0/2487542660 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4195648350 0 0) 0x7fa17c003260 con 0x7fa1901483a0 2022-01-10T01:24:34.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa194b33700 1 -- 172.21.15.36:0/2487542660 >> v1:172.21.15.59:6789/0 conn(0x7fa1900b1db0 legacy=0x7fa1900b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa194b33700 1 -- 172.21.15.36:0/2487542660 >> v1:172.21.15.36:6789/0 conn(0x7fa1901483a0 legacy=0x7fa1900a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.264+0000 7fa194b33700 1 -- 172.21.15.36:0/2487542660 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900b0890 con 0x7fa1900b0fd0 2022-01-10T01:24:34.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.268+0000 7fa194b33700 1 --2- 172.21.15.36:0/2487542660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1900b0fd0 0x7fa190144720 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa180001800 tx=0x7fa1880091d0).ready entity=mon.2 client_cookie=b7acb80ffa202e38 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:34.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.268+0000 7fa18effd700 1 -- 172.21.15.36:0/2487542660 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa180001660 con 0x7fa1900b0fd0 2022-01-10T01:24:34.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.268+0000 7fa18effd700 1 -- 172.21.15.36:0/2487542660 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18800b5b0 con 0x7fa1900b0fd0 2022-01-10T01:24:34.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.268+0000 7fa18effd700 1 -- 172.21.15.36:0/2487542660 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa18800b720 con 0x7fa1900b0fd0 2022-01-10T01:24:34.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.268+0000 7fa196596700 1 -- 172.21.15.36:0/2487542660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1900b0fd0 msgr2=0x7fa190144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.268+0000 7fa196596700 1 --2- 172.21.15.36:0/2487542660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1900b0fd0 0x7fa190144720 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa180001800 tx=0x7fa1880091d0).stop 2022-01-10T01:24:34.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.268+0000 7fa196596700 1 -- 172.21.15.36:0/2487542660 shutdown_connections 2022-01-10T01:24:34.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.268+0000 7fa196596700 1 --2- 172.21.15.36:0/2487542660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1900b0fd0 0x7fa190144720 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.268+0000 7fa196596700 1 -- 172.21.15.36:0/2487542660 >> 172.21.15.36:0/2487542660 conn(0x7fa19005f6b0 msgr2=0x7fa19005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:34.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.268+0000 7fa196596700 1 -- 172.21.15.36:0/2487542660 shutdown_connections 2022-01-10T01:24:34.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.268+0000 7fa196596700 1 -- 172.21.15.36:0/2487542660 wait complete. 2022-01-10T01:24:34.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa196596700 1 Processor -- start 2022-01-10T01:24:34.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa196596700 1 -- start start 2022-01-10T01:24:34.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa196596700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1900b0fd0 0x7fa1900aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa196596700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1900b1db0 0x7fa1901468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa196596700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1901483a0 0x7fa190159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa196596700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900abd90 con 0x7fa1900b0fd0 2022-01-10T01:24:34.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa196596700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900ac030 con 0x7fa1901483a0 2022-01-10T01:24:34.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa196596700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900aa590 con 0x7fa1900b1db0 2022-01-10T01:24:34.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa18ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1900b0fd0 0x7fa1900aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa18ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1900b0fd0 0x7fa1900aacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34070/0 (socket says 172.21.15.36:34070) 2022-01-10T01:24:34.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa18ffff700 1 -- 172.21.15.36:0/1705000523 learned_addr learned my addr 172.21.15.36:0/1705000523 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:34.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa18f7fe700 1 --2- 172.21.15.36:0/1705000523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1900b1db0 0x7fa1901468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa194b33700 1 --2- 172.21.15.36:0/1705000523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1901483a0 0x7fa190159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa18ffff700 1 -- 172.21.15.36:0/1705000523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1900b1db0 msgr2=0x7fa1901468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa18ffff700 1 --2- 172.21.15.36:0/1705000523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1900b1db0 0x7fa1901468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa18ffff700 1 -- 172.21.15.36:0/1705000523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1901483a0 msgr2=0x7fa190159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa18ffff700 1 --2- 172.21.15.36:0/1705000523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1901483a0 0x7fa190159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa18ffff700 1 -- 172.21.15.36:0/1705000523 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188009470 con 0x7fa1900b0fd0 2022-01-10T01:24:34.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa18ffff700 1 --2- 172.21.15.36:0/1705000523 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1900b0fd0 0x7fa1900aacd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fa184001150 tx=0x7fa184007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:34.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa18d7fa700 1 -- 172.21.15.36:0/1705000523 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa184007030 con 0x7fa1900b0fd0 2022-01-10T01:24:34.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa18d7fa700 1 -- 172.21.15.36:0/1705000523 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa184007190 con 0x7fa1900b0fd0 2022-01-10T01:24:34.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa18d7fa700 1 -- 172.21.15.36:0/1705000523 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa184006510 con 0x7fa1900b0fd0 2022-01-10T01:24:34.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa196596700 1 -- 172.21.15.36:0/1705000523 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1900aa830 con 0x7fa1900b0fd0 2022-01-10T01:24:34.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.272+0000 7fa196596700 1 -- 172.21.15.36:0/1705000523 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1900a9880 con 0x7fa1900b0fd0 2022-01-10T01:24:34.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.276+0000 7fa196596700 1 -- 172.21.15.36:0/1705000523 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa190057350 con 0x7fa1900b0fd0 2022-01-10T01:24:34.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.276+0000 7fa18d7fa700 1 -- 172.21.15.36:0/1705000523 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa184010030 con 0x7fa1900b0fd0 2022-01-10T01:24:34.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.276+0000 7fa18d7fa700 1 --2- 172.21.15.36:0/1705000523 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa170053680 0x7fa170055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.276+0000 7fa18d7fa700 1 -- 172.21.15.36:0/1705000523 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa18406b6c0 con 0x7fa1900b0fd0 2022-01-10T01:24:34.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.276+0000 7fa18f7fe700 1 --2- 172.21.15.36:0/1705000523 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa170053680 0x7fa170055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.276+0000 7fa18f7fe700 1 --2- 172.21.15.36:0/1705000523 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa170053680 0x7fa170055b40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa18000d000 tx=0x7fa180000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:34.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.280+0000 7fa18d7fa700 1 -- 172.21.15.36:0/1705000523 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa184042670 con 0x7fa1900b0fd0 2022-01-10T01:24:34.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.408+0000 7fa196596700 1 -- 172.21.15.36:0/1705000523 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa190044650 con 0x7fa1900b0fd0 2022-01-10T01:24:34.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.408+0000 7fa18d7fa700 1 -- 172.21.15.36:0/1705000523 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa184045c90 con 0x7fa1900b0fd0 2022-01-10T01:24:34.416 INFO:teuthology.orchestra.run.smithi036.stdout:55834574853 2022-01-10T01:24:34.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.412+0000 7fa196596700 1 -- 172.21.15.36:0/1705000523 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa170053680 msgr2=0x7fa170055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.412+0000 7fa196596700 1 --2- 172.21.15.36:0/1705000523 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa170053680 0x7fa170055b40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa18000d000 tx=0x7fa180000bc0).stop 2022-01-10T01:24:34.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.412+0000 7fa196596700 1 -- 172.21.15.36:0/1705000523 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1900b0fd0 msgr2=0x7fa1900aacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.412+0000 7fa196596700 1 --2- 172.21.15.36:0/1705000523 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1900b0fd0 0x7fa1900aacd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fa184001150 tx=0x7fa184007c00).stop 2022-01-10T01:24:34.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.412+0000 7fa196596700 1 -- 172.21.15.36:0/1705000523 shutdown_connections 2022-01-10T01:24:34.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.412+0000 7fa196596700 1 --2- 172.21.15.36:0/1705000523 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa170053680 0x7fa170055b40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.412+0000 7fa196596700 1 --2- 172.21.15.36:0/1705000523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1901483a0 0x7fa190159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.412+0000 7fa196596700 1 --2- 172.21.15.36:0/1705000523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1900b1db0 0x7fa1901468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.412+0000 7fa196596700 1 --2- 172.21.15.36:0/1705000523 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1900b0fd0 0x7fa1900aacd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.412+0000 7fa196596700 1 -- 172.21.15.36:0/1705000523 >> 172.21.15.36:0/1705000523 conn(0x7fa19005f6b0 msgr2=0x7fa190144830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:34.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.412+0000 7fa196596700 1 -- 172.21.15.36:0/1705000523 shutdown_connections 2022-01-10T01:24:34.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.412+0000 7fa196596700 1 -- 172.21.15.36:0/1705000523 wait complete. 2022-01-10T01:24:34.429 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2022-01-10T01:24:34.430 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-01-10T01:24:34.430 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-01-10T01:24:34.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.528+0000 7fedf759e700 1 Processor -- start 2022-01-10T01:24:34.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.528+0000 7fedf759e700 1 -- start start 2022-01-10T01:24:34.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.528+0000 7fedf759e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fedf80a8ac0 0x7fedf8152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.528+0000 7fedf759e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf80a70c0 con 0x7fedf80b2580 2022-01-10T01:24:34.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.528+0000 7fedf759e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf80a72f0 con 0x7fedf80b0010 2022-01-10T01:24:34.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.528+0000 7fedf759e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf80a7590 con 0x7fedf80a8ac0 2022-01-10T01:24:34.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.528+0000 7fedf659c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fedf80b2580 0x7fedf814ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60104/0 (socket says 172.21.15.36:60104) 2022-01-10T01:24:34.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.528+0000 7fedf659c700 1 -- 172.21.15.36:0/54846390 learned_addr learned my addr 172.21.15.36:0/54846390 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:34.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.528+0000 7fedf6d9d700 1 --2- 172.21.15.36:0/54846390 >> v2:172.21.15.36:3300/0 conn(0x7fedf80a8ac0 0x7fedf8152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.528+0000 7fedf559a700 1 -- 172.21.15.36:0/54846390 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216138528 0 0) 0x7fedf80a70c0 con 0x7fedf80b2580 2022-01-10T01:24:34.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.528+0000 7fedf559a700 1 -- 172.21.15.36:0/54846390 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feddc003260 con 0x7fedf80b2580 2022-01-10T01:24:34.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf559a700 1 -- 172.21.15.36:0/54846390 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893023048 0 0) 0x7fedf80a72f0 con 0x7fedf80b0010 2022-01-10T01:24:34.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf6d9d700 1 -- 172.21.15.36:0/54846390 >> v1:172.21.15.59:6789/0 conn(0x7fedf80b0010 legacy=0x7fedf80a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf6d9d700 1 -- 172.21.15.36:0/54846390 >> v1:172.21.15.36:6789/0 conn(0x7fedf80b2580 legacy=0x7fedf814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf6d9d700 1 -- 172.21.15.36:0/54846390 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf80a7830 con 0x7fedf80a8ac0 2022-01-10T01:24:34.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf6d9d700 1 --2- 172.21.15.36:0/54846390 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedf80a8ac0 0x7fedf8152be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fedf0002f70 tx=0x7fedf0006df0).ready entity=mon.0 client_cookie=c9c34993411cdcf0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:34.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf559a700 1 -- 172.21.15.36:0/54846390 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedf000d610 con 0x7fedf80a8ac0 2022-01-10T01:24:34.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf559a700 1 -- 172.21.15.36:0/54846390 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf0000e90 con 0x7fedf80a8ac0 2022-01-10T01:24:34.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf559a700 1 -- 172.21.15.36:0/54846390 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedf000d960 con 0x7fedf80a8ac0 2022-01-10T01:24:34.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf759e700 1 -- 172.21.15.36:0/54846390 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedf80a8ac0 msgr2=0x7fedf8152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf759e700 1 --2- 172.21.15.36:0/54846390 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedf80a8ac0 0x7fedf8152be0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fedf0002f70 tx=0x7fedf0006df0).stop 2022-01-10T01:24:34.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf759e700 1 -- 172.21.15.36:0/54846390 shutdown_connections 2022-01-10T01:24:34.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf759e700 1 --2- 172.21.15.36:0/54846390 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedf80a8ac0 0x7fedf8152be0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf759e700 1 -- 172.21.15.36:0/54846390 >> 172.21.15.36:0/54846390 conn(0x7fedf8060180 msgr2=0x7fedf80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:34.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf759e700 1 -- 172.21.15.36:0/54846390 shutdown_connections 2022-01-10T01:24:34.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf759e700 1 -- 172.21.15.36:0/54846390 wait complete. 2022-01-10T01:24:34.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf759e700 1 Processor -- start 2022-01-10T01:24:34.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.532+0000 7fedf759e700 1 -- start start 2022-01-10T01:24:34.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf80a8ac0 0x7fedf8063000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedf80b0010 0x7fedf8066a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedf80b2580 0x7fedf8063840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8156dd0 con 0x7fedf80b2580 2022-01-10T01:24:34.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8157070 con 0x7fedf80a8ac0 2022-01-10T01:24:34.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf811cfa0 con 0x7fedf80b0010 2022-01-10T01:24:34.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf6d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedf80b2580 0x7fedf8063840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf6d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedf80b2580 0x7fedf8063840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34088/0 (socket says 172.21.15.36:34088) 2022-01-10T01:24:34.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf6d9d700 1 -- 172.21.15.36:0/3190574438 learned_addr learned my addr 172.21.15.36:0/3190574438 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:34.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf659c700 1 --2- 172.21.15.36:0/3190574438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf80a8ac0 0x7fedf8063000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf5d9b700 1 --2- 172.21.15.36:0/3190574438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedf80b0010 0x7fedf8066a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf6d9d700 1 -- 172.21.15.36:0/3190574438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedf80b0010 msgr2=0x7fedf8066a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf6d9d700 1 --2- 172.21.15.36:0/3190574438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedf80b0010 0x7fedf8066a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf6d9d700 1 -- 172.21.15.36:0/3190574438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf80a8ac0 msgr2=0x7fedf8063000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf6d9d700 1 --2- 172.21.15.36:0/3190574438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf80a8ac0 0x7fedf8063000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf6d9d700 1 -- 172.21.15.36:0/3190574438 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf000b180 con 0x7fedf80b2580 2022-01-10T01:24:34.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf6d9d700 1 --2- 172.21.15.36:0/3190574438 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedf80b2580 0x7fedf8063840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fedf0002f70 tx=0x7fedf0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:34.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fede77fe700 1 -- 172.21.15.36:0/3190574438 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedf0013de0 con 0x7fedf80b2580 2022-01-10T01:24:34.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fede77fe700 1 -- 172.21.15.36:0/3190574438 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf000d290 con 0x7fedf80b2580 2022-01-10T01:24:34.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf759e700 1 -- 172.21.15.36:0/3190574438 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf8063d30 con 0x7fedf80b2580 2022-01-10T01:24:34.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fede77fe700 1 -- 172.21.15.36:0/3190574438 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fedf001e5f0 con 0x7fedf80b2580 2022-01-10T01:24:34.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf759e700 1 -- 172.21.15.36:0/3190574438 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf8146a20 con 0x7fedf80b2580 2022-01-10T01:24:34.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fedf759e700 1 -- 172.21.15.36:0/3190574438 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf8157230 con 0x7fedf80b2580 2022-01-10T01:24:34.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.536+0000 7fede77fe700 1 -- 172.21.15.36:0/3190574438 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fedf0025030 con 0x7fedf80b2580 2022-01-10T01:24:34.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.540+0000 7fede77fe700 1 --2- 172.21.15.36:0/3190574438 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fedd40535f0 0x7fedd4055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.540+0000 7fedf659c700 1 --2- 172.21.15.36:0/3190574438 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fedd40535f0 0x7fedd4055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.540+0000 7fede77fe700 1 -- 172.21.15.36:0/3190574438 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fedf006c810 con 0x7fedf80b2580 2022-01-10T01:24:34.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.540+0000 7fedf659c700 1 --2- 172.21.15.36:0/3190574438 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fedd40535f0 0x7fedd4055ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fede800d000 tx=0x7fede8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:34.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.544+0000 7fede77fe700 1 -- 172.21.15.36:0/3190574438 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fedf0043820 con 0x7fedf80b2580 2022-01-10T01:24:34.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.672+0000 7fedf759e700 1 -- 172.21.15.36:0/3190574438 --> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fedf811ce20 con 0x7fedd40535f0 2022-01-10T01:24:34.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.680+0000 7fede77fe700 1 -- 172.21.15.36:0/3190574438 <== mgr.4101 v2:172.21.15.36:6800/14596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82327 (secure 0 0 0) 0x7fede8001a10 con 0x7fedd40535f0 2022-01-10T01:24:34.689 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:34.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.684+0000 7fedf759e700 1 -- 172.21.15.36:0/3190574438 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fedd40535f0 msgr2=0x7fedd4055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.684+0000 7fedf759e700 1 --2- 172.21.15.36:0/3190574438 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fedd40535f0 0x7fedd4055ab0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fede800d000 tx=0x7fede8009040).stop 2022-01-10T01:24:34.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.684+0000 7fedf759e700 1 -- 172.21.15.36:0/3190574438 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedf80b2580 msgr2=0x7fedf8063840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.684+0000 7fedf759e700 1 --2- 172.21.15.36:0/3190574438 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedf80b2580 0x7fedf8063840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fedf0002f70 tx=0x7fedf0014000).stop 2022-01-10T01:24:34.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.684+0000 7fedf759e700 1 -- 172.21.15.36:0/3190574438 shutdown_connections 2022-01-10T01:24:34.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.684+0000 7fedf759e700 1 --2- 172.21.15.36:0/3190574438 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fedd40535f0 0x7fedd4055ab0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.684+0000 7fedf759e700 1 --2- 172.21.15.36:0/3190574438 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedf80b2580 0x7fedf8063840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.684+0000 7fedf759e700 1 --2- 172.21.15.36:0/3190574438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fedf80b0010 0x7fedf8066a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.684+0000 7fedf759e700 1 --2- 172.21.15.36:0/3190574438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf80a8ac0 0x7fedf8063000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.684+0000 7fedf759e700 1 -- 172.21.15.36:0/3190574438 >> 172.21.15.36:0/3190574438 conn(0x7fedf8060180 msgr2=0x7fedf814add0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:34.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.684+0000 7fedf759e700 1 -- 172.21.15.36:0/3190574438 shutdown_connections 2022-01-10T01:24:34.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.684+0000 7fedf759e700 1 -- 172.21.15.36:0/3190574438 wait complete. 2022-01-10T01:24:34.694 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2022-01-10T01:24:34.705 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2022-01-10T01:24:34.374905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390712,"kb_used_data":2040,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584008,"statfs":{"total":773094113280,"available":764502024192,"internally_reserved":8589934592,"allocated":2088960,"data_stored":822308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.457922"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.999388+0000","last_change":"2022-01-10T01:24:24.998501+0000","last_active":"2022-01-10T01:24:24.999388+0000","last_peered":"2022-01-10T01:24:24.999388+0000","last_clean":"2022-01-10T01:24:24.999388+0000","last_became_active":"2022-01-10T01:24:24.997941+0000","last_became_peered":"2022-01-10T01:24:24.997941+0000","last_unstale":"2022-01-10T01:24:24.999388+0000","last_undegraded":"2022-01-10T01:24:24.999388+0000","last_fullsized":"2022-01-10T01:24:24.999388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.982113+0000","last_change":"2022-01-10T01:24:14.937125+0000","last_active":"2022-01-10T01:24:24.982113+0000","last_peered":"2022-01-10T01:24:24.982113+0000","last_clean":"2022-01-10T01:24:24.982113+0000","last_became_active":"2022-01-10T01:24:14.935715+0000","last_became_peered":"2022-01-10T01:24:14.935715+0000","last_unstale":"2022-01-10T01:24:24.982113+0000","last_undegraded":"2022-01-10T01:24:24.982113+0000","last_fullsized":"2022-01-10T01:24:24.982113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:08.543721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:08.543721+0000","last_clean_scrub_stamp":"2022-01-10T01:24:08.543721+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.922328+0000","last_change":"2022-01-10T01:24:19.114295+0000","last_active":"2022-01-10T01:24:24.922328+0000","last_peered":"2022-01-10T01:24:24.922328+0000","last_clean":"2022-01-10T01:24:24.922328+0000","last_became_active":"2022-01-10T01:24:19.113327+0000","last_became_peered":"2022-01-10T01:24:19.113327+0000","last_unstale":"2022-01-10T01:24:24.922328+0000","last_undegraded":"2022-01-10T01:24:24.922328+0000","last_fullsized":"2022-01-10T01:24:24.922328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.236716+0000","last_change":"2022-01-10T01:24:21.921342+0000","last_active":"2022-01-10T01:24:25.236716+0000","last_peered":"2022-01-10T01:24:25.236716+0000","last_clean":"2022-01-10T01:24:25.236716+0000","last_became_active":"2022-01-10T01:24:21.920668+0000","last_became_peered":"2022-01-10T01:24:21.920668+0000","last_unstale":"2022-01-10T01:24:25.236716+0000","last_undegraded":"2022-01-10T01:24:25.236716+0000","last_fullsized":"2022-01-10T01:24:25.236716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.005204+0000","last_change":"2022-01-10T01:24:25.002616+0000","last_active":"2022-01-10T01:24:25.005204+0000","last_peered":"2022-01-10T01:24:25.005204+0000","last_clean":"2022-01-10T01:24:25.005204+0000","last_became_active":"2022-01-10T01:24:25.001354+0000","last_became_peered":"2022-01-10T01:24:25.001354+0000","last_unstale":"2022-01-10T01:24:25.005204+0000","last_undegraded":"2022-01-10T01:24:25.005204+0000","last_fullsized":"2022-01-10T01:24:25.005204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.922254+0000","last_change":"2022-01-10T01:24:18.787713+0000","last_active":"2022-01-10T01:24:24.922254+0000","last_peered":"2022-01-10T01:24:24.922254+0000","last_clean":"2022-01-10T01:24:24.922254+0000","last_became_active":"2022-01-10T01:24:18.787183+0000","last_became_peered":"2022-01-10T01:24:18.787183+0000","last_unstale":"2022-01-10T01:24:24.922254+0000","last_undegraded":"2022-01-10T01:24:24.922254+0000","last_fullsized":"2022-01-10T01:24:24.922254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.926372+0000","last_change":"2022-01-10T01:24:21.922352+0000","last_active":"2022-01-10T01:24:24.926372+0000","last_peered":"2022-01-10T01:24:24.926372+0000","last_clean":"2022-01-10T01:24:24.926372+0000","last_became_active":"2022-01-10T01:24:21.921954+0000","last_became_peered":"2022-01-10T01:24:21.921954+0000","last_unstale":"2022-01-10T01:24:24.926372+0000","last_undegraded":"2022-01-10T01:24:24.926372+0000","last_fullsized":"2022-01-10T01:24:24.926372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.006486+0000","last_change":"2022-01-10T01:24:25.005059+0000","last_active":"2022-01-10T01:24:25.006486+0000","last_peered":"2022-01-10T01:24:25.006486+0000","last_clean":"2022-01-10T01:24:25.006486+0000","last_became_active":"2022-01-10T01:24:25.003763+0000","last_became_peered":"2022-01-10T01:24:25.003763+0000","last_unstale":"2022-01-10T01:24:25.006486+0000","last_undegraded":"2022-01-10T01:24:25.006486+0000","last_fullsized":"2022-01-10T01:24:25.006486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.998055+0000","last_change":"2022-01-10T01:24:18.786166+0000","last_active":"2022-01-10T01:24:24.998055+0000","last_peered":"2022-01-10T01:24:24.998055+0000","last_clean":"2022-01-10T01:24:24.998055+0000","last_became_active":"2022-01-10T01:24:18.785296+0000","last_became_peered":"2022-01-10T01:24:18.785296+0000","last_unstale":"2022-01-10T01:24:24.998055+0000","last_undegraded":"2022-01-10T01:24:24.998055+0000","last_fullsized":"2022-01-10T01:24:24.998055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.252145+0000","last_change":"2022-01-10T01:24:22.090468+0000","last_active":"2022-01-10T01:24:25.252145+0000","last_peered":"2022-01-10T01:24:25.252145+0000","last_clean":"2022-01-10T01:24:25.252145+0000","last_became_active":"2022-01-10T01:24:22.089699+0000","last_became_peered":"2022-01-10T01:24:22.089699+0000","last_unstale":"2022-01-10T01:24:25.252145+0000","last_undegraded":"2022-01-10T01:24:25.252145+0000","last_fullsized":"2022-01-10T01:24:25.252145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.006569+0000","last_change":"2022-01-10T01:24:25.004830+0000","last_active":"2022-01-10T01:24:25.006569+0000","last_peered":"2022-01-10T01:24:25.006569+0000","last_clean":"2022-01-10T01:24:25.006569+0000","last_became_active":"2022-01-10T01:24:25.001016+0000","last_became_peered":"2022-01-10T01:24:25.001016+0000","last_unstale":"2022-01-10T01:24:25.006569+0000","last_undegraded":"2022-01-10T01:24:25.006569+0000","last_fullsized":"2022-01-10T01:24:25.006569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.922433+0000","last_change":"2022-01-10T01:24:19.115873+0000","last_active":"2022-01-10T01:24:24.922433+0000","last_peered":"2022-01-10T01:24:24.922433+0000","last_clean":"2022-01-10T01:24:24.922433+0000","last_became_active":"2022-01-10T01:24:19.114993+0000","last_became_peered":"2022-01-10T01:24:19.114993+0000","last_unstale":"2022-01-10T01:24:24.922433+0000","last_undegraded":"2022-01-10T01:24:24.922433+0000","last_fullsized":"2022-01-10T01:24:24.922433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.247344+0000","last_change":"2022-01-10T01:24:21.919320+0000","last_active":"2022-01-10T01:24:25.247344+0000","last_peered":"2022-01-10T01:24:25.247344+0000","last_clean":"2022-01-10T01:24:25.247344+0000","last_became_active":"2022-01-10T01:24:21.918801+0000","last_became_peered":"2022-01-10T01:24:21.918801+0000","last_unstale":"2022-01-10T01:24:25.247344+0000","last_undegraded":"2022-01-10T01:24:25.247344+0000","last_fullsized":"2022-01-10T01:24:25.247344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.004490+0000","last_change":"2022-01-10T01:24:25.001974+0000","last_active":"2022-01-10T01:24:25.004490+0000","last_peered":"2022-01-10T01:24:25.004490+0000","last_clean":"2022-01-10T01:24:25.004490+0000","last_became_active":"2022-01-10T01:24:25.001170+0000","last_became_peered":"2022-01-10T01:24:25.001170+0000","last_unstale":"2022-01-10T01:24:25.004490+0000","last_undegraded":"2022-01-10T01:24:25.004490+0000","last_fullsized":"2022-01-10T01:24:25.004490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.249955+0000","last_change":"2022-01-10T01:24:21.920058+0000","last_active":"2022-01-10T01:24:25.249955+0000","last_peered":"2022-01-10T01:24:25.249955+0000","last_clean":"2022-01-10T01:24:25.249955+0000","last_became_active":"2022-01-10T01:24:21.919419+0000","last_became_peered":"2022-01-10T01:24:21.919419+0000","last_unstale":"2022-01-10T01:24:25.249955+0000","last_undegraded":"2022-01-10T01:24:25.249955+0000","last_fullsized":"2022-01-10T01:24:25.249955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.921492+0000","last_change":"2022-01-10T01:24:19.116632+0000","last_active":"2022-01-10T01:24:24.921492+0000","last_peered":"2022-01-10T01:24:24.921492+0000","last_clean":"2022-01-10T01:24:24.921492+0000","last_became_active":"2022-01-10T01:24:19.115547+0000","last_became_peered":"2022-01-10T01:24:19.115547+0000","last_unstale":"2022-01-10T01:24:24.921492+0000","last_undegraded":"2022-01-10T01:24:24.921492+0000","last_fullsized":"2022-01-10T01:24:24.921492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.005095+0000","last_change":"2022-01-10T01:24:25.003297+0000","last_active":"2022-01-10T01:24:25.005095+0000","last_peered":"2022-01-10T01:24:25.005095+0000","last_clean":"2022-01-10T01:24:25.005095+0000","last_became_active":"2022-01-10T01:24:25.001546+0000","last_became_peered":"2022-01-10T01:24:25.001546+0000","last_unstale":"2022-01-10T01:24:25.005095+0000","last_undegraded":"2022-01-10T01:24:25.005095+0000","last_fullsized":"2022-01-10T01:24:25.005095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.249783+0000","last_change":"2022-01-10T01:24:21.924082+0000","last_active":"2022-01-10T01:24:25.249783+0000","last_peered":"2022-01-10T01:24:25.249783+0000","last_clean":"2022-01-10T01:24:25.249783+0000","last_became_active":"2022-01-10T01:24:21.923508+0000","last_became_peered":"2022-01-10T01:24:21.923508+0000","last_unstale":"2022-01-10T01:24:25.249783+0000","last_undegraded":"2022-01-10T01:24:25.249783+0000","last_fullsized":"2022-01-10T01:24:25.249783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.923801+0000","last_change":"2022-01-10T01:24:18.790281+0000","last_active":"2022-01-10T01:24:24.923801+0000","last_peered":"2022-01-10T01:24:24.923801+0000","last_clean":"2022-01-10T01:24:24.923801+0000","last_became_active":"2022-01-10T01:24:18.789645+0000","last_became_peered":"2022-01-10T01:24:18.789645+0000","last_unstale":"2022-01-10T01:24:24.923801+0000","last_undegraded":"2022-01-10T01:24:24.923801+0000","last_fullsized":"2022-01-10T01:24:24.923801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.988306+0000","last_change":"2022-01-10T01:24:24.987523+0000","last_active":"2022-01-10T01:24:24.988306+0000","last_peered":"2022-01-10T01:24:24.988306+0000","last_clean":"2022-01-10T01:24:24.988306+0000","last_became_active":"2022-01-10T01:24:24.986125+0000","last_became_peered":"2022-01-10T01:24:24.986125+0000","last_unstale":"2022-01-10T01:24:24.988306+0000","last_undegraded":"2022-01-10T01:24:24.988306+0000","last_fullsized":"2022-01-10T01:24:24.988306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.247979+0000","last_change":"2022-01-10T01:24:21.921860+0000","last_active":"2022-01-10T01:24:25.247979+0000","last_peered":"2022-01-10T01:24:25.247979+0000","last_clean":"2022-01-10T01:24:25.247979+0000","last_became_active":"2022-01-10T01:24:21.921364+0000","last_became_peered":"2022-01-10T01:24:21.921364+0000","last_unstale":"2022-01-10T01:24:25.247979+0000","last_undegraded":"2022-01-10T01:24:25.247979+0000","last_fullsized":"2022-01-10T01:24:25.247979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.923472+0000","last_change":"2022-01-10T01:24:19.666159+0000","last_active":"2022-01-10T01:24:24.923472+0000","last_peered":"2022-01-10T01:24:24.923472+0000","last_clean":"2022-01-10T01:24:24.923472+0000","last_became_active":"2022-01-10T01:24:19.665292+0000","last_became_peered":"2022-01-10T01:24:19.665292+0000","last_unstale":"2022-01-10T01:24:24.923472+0000","last_undegraded":"2022-01-10T01:24:24.923472+0000","last_fullsized":"2022-01-10T01:24:24.923472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.987005+0000","last_change":"2022-01-10T01:24:24.986101+0000","last_active":"2022-01-10T01:24:24.987005+0000","last_peered":"2022-01-10T01:24:24.987005+0000","last_clean":"2022-01-10T01:24:24.987005+0000","last_became_active":"2022-01-10T01:24:24.985506+0000","last_became_peered":"2022-01-10T01:24:24.985506+0000","last_unstale":"2022-01-10T01:24:24.987005+0000","last_undegraded":"2022-01-10T01:24:24.987005+0000","last_fullsized":"2022-01-10T01:24:24.987005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'4","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.247092+0000","last_change":"2022-01-10T01:24:22.090645+0000","last_active":"2022-01-10T01:24:25.247092+0000","last_peered":"2022-01-10T01:24:25.247092+0000","last_clean":"2022-01-10T01:24:25.247092+0000","last_became_active":"2022-01-10T01:24:22.089713+0000","last_became_peered":"2022-01-10T01:24:22.089713+0000","last_unstale":"2022-01-10T01:24:25.247092+0000","last_undegraded":"2022-01-10T01:24:25.247092+0000","last_fullsized":"2022-01-10T01:24:25.247092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.922747+0000","last_change":"2022-01-10T01:24:19.664491+0000","last_active":"2022-01-10T01:24:24.922747+0000","last_peered":"2022-01-10T01:24:24.922747+0000","last_clean":"2022-01-10T01:24:24.922747+0000","last_became_active":"2022-01-10T01:24:19.663966+0000","last_became_peered":"2022-01-10T01:24:19.663966+0000","last_unstale":"2022-01-10T01:24:24.922747+0000","last_undegraded":"2022-01-10T01:24:24.922747+0000","last_fullsized":"2022-01-10T01:24:24.922747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":102357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":104627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":103314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":102932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":102357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":101973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":102357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":102391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]}]}]}} 2022-01-10T01:24:34.708 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-01-10T01:24:34.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.804+0000 7fe37a5ea700 1 Processor -- start 2022-01-10T01:24:34.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.804+0000 7fe37a5ea700 1 -- start start 2022-01-10T01:24:34.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe37a5ea700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe3740b1db0 0x7fe3740b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe37a5ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3740a70c0 0x7fe374144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe37a5ea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3740b0350 con 0x7fe3741483a0 2022-01-10T01:24:34.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe37a5ea700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3740a90c0 con 0x7fe3740b1db0 2022-01-10T01:24:34.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe37a5ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740b05f0 con 0x7fe3740a70c0 2022-01-10T01:24:34.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe373fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe3740b1db0 0x7fe3740b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe378b87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3740a70c0 0x7fe374144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe373fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe3740b1db0 0x7fe3740b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34096/0 (socket says 172.21.15.36:34096) 2022-01-10T01:24:34.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe373fff700 1 -- 172.21.15.36:0/1798004671 learned_addr learned my addr 172.21.15.36:0/1798004671 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:34.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe372ffd700 1 -- 172.21.15.36:0/1798004671 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2117964608 0 0) 0x7fe3740b0350 con 0x7fe3741483a0 2022-01-10T01:24:34.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe372ffd700 1 -- 172.21.15.36:0/1798004671 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe360003260 con 0x7fe3741483a0 2022-01-10T01:24:34.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe373fff700 1 -- 172.21.15.36:0/1798004671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3740a70c0 msgr2=0x7fe374144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:34.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe373fff700 1 --2- 172.21.15.36:0/1798004671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3740a70c0 0x7fe374144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe373fff700 1 -- 172.21.15.36:0/1798004671 >> v1:172.21.15.59:6789/0 conn(0x7fe3741483a0 legacy=0x7fe3740b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe373fff700 1 -- 172.21.15.36:0/1798004671 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3740b0890 con 0x7fe3740b1db0 2022-01-10T01:24:34.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe378b87700 1 --2- 172.21.15.36:0/1798004671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3740a70c0 0x7fe374144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:34.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe373fff700 1 --2- 172.21.15.36:0/1798004671 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3740b1db0 0x7fe3740b0fd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fe374147730 tx=0x7fe368006eb0).ready entity=mon.0 client_cookie=2c1289c239dac895 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:34.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe372ffd700 1 -- 172.21.15.36:0/1798004671 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe36800d5c0 con 0x7fe3740b1db0 2022-01-10T01:24:34.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe372ffd700 1 -- 172.21.15.36:0/1798004671 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe368000e90 con 0x7fe3740b1db0 2022-01-10T01:24:34.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe372ffd700 1 -- 172.21.15.36:0/1798004671 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe36800d950 con 0x7fe3740b1db0 2022-01-10T01:24:34.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe37a5ea700 1 -- 172.21.15.36:0/1798004671 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3740b1db0 msgr2=0x7fe3740b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe37a5ea700 1 --2- 172.21.15.36:0/1798004671 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3740b1db0 0x7fe3740b0fd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fe374147730 tx=0x7fe368006eb0).stop 2022-01-10T01:24:34.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe37a5ea700 1 -- 172.21.15.36:0/1798004671 shutdown_connections 2022-01-10T01:24:34.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe37a5ea700 1 --2- 172.21.15.36:0/1798004671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3740a70c0 0x7fe374144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe37a5ea700 1 --2- 172.21.15.36:0/1798004671 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3740b1db0 0x7fe3740b0fd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe37a5ea700 1 -- 172.21.15.36:0/1798004671 >> 172.21.15.36:0/1798004671 conn(0x7fe37405f6b0 msgr2=0x7fe37405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:34.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe37a5ea700 1 -- 172.21.15.36:0/1798004671 shutdown_connections 2022-01-10T01:24:34.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.808+0000 7fe37a5ea700 1 -- 172.21.15.36:0/1798004671 wait complete. 2022-01-10T01:24:34.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe37a5ea700 1 Processor -- start 2022-01-10T01:24:34.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe37a5ea700 1 -- start start 2022-01-10T01:24:34.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe37a5ea700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3740a70c0 0x7fe374067170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe37a5ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3740b1db0 0x7fe374066130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe37a5ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3741483a0 0x7fe374156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe37a5ea700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe374156890 con 0x7fe3740a70c0 2022-01-10T01:24:34.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe37a5ea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740667d0 con 0x7fe3741483a0 2022-01-10T01:24:34.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe37a5ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe374066a70 con 0x7fe3740b1db0 2022-01-10T01:24:34.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe373fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3740a70c0 0x7fe374067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe373fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3740a70c0 0x7fe374067170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34098/0 (socket says 172.21.15.36:34098) 2022-01-10T01:24:34.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe373fff700 1 -- 172.21.15.36:0/2540637433 learned_addr learned my addr 172.21.15.36:0/2540637433 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:34.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe3737fe700 1 --2- 172.21.15.36:0/2540637433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3740b1db0 0x7fe374066130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe378b87700 1 --2- 172.21.15.36:0/2540637433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3741483a0 0x7fe374156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe373fff700 1 -- 172.21.15.36:0/2540637433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3740b1db0 msgr2=0x7fe374066130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe373fff700 1 --2- 172.21.15.36:0/2540637433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3740b1db0 0x7fe374066130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe373fff700 1 -- 172.21.15.36:0/2540637433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3741483a0 msgr2=0x7fe374156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe373fff700 1 --2- 172.21.15.36:0/2540637433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3741483a0 0x7fe374156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe373fff700 1 -- 172.21.15.36:0/2540637433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c00b180 con 0x7fe3740a70c0 2022-01-10T01:24:34.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe373fff700 1 --2- 172.21.15.36:0/2540637433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3740a70c0 0x7fe374067170 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fe374147730 tx=0x7fe368015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:34.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe3717fa700 1 -- 172.21.15.36:0/2540637433 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe36800de00 con 0x7fe3740a70c0 2022-01-10T01:24:34.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe3717fa700 1 -- 172.21.15.36:0/2540637433 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe368011b80 con 0x7fe3740a70c0 2022-01-10T01:24:34.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe37a5ea700 1 -- 172.21.15.36:0/2540637433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36800b1e0 con 0x7fe3740a70c0 2022-01-10T01:24:34.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe3717fa700 1 -- 172.21.15.36:0/2540637433 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe36801e460 con 0x7fe3740a70c0 2022-01-10T01:24:34.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe37a5ea700 1 -- 172.21.15.36:0/2540637433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3740ac840 con 0x7fe3740a70c0 2022-01-10T01:24:34.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.812+0000 7fe37a5ea700 1 -- 172.21.15.36:0/2540637433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe374066c30 con 0x7fe3740a70c0 2022-01-10T01:24:34.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.816+0000 7fe3717fa700 1 -- 172.21.15.36:0/2540637433 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe36801a040 con 0x7fe3740a70c0 2022-01-10T01:24:34.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.816+0000 7fe3717fa700 1 --2- 172.21.15.36:0/2540637433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe354053620 0x7fe354055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:34.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.816+0000 7fe3717fa700 1 -- 172.21.15.36:0/2540637433 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe36806c9c0 con 0x7fe3740a70c0 2022-01-10T01:24:34.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.816+0000 7fe3737fe700 1 --2- 172.21.15.36:0/2540637433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe354053620 0x7fe354055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:34.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.816+0000 7fe3737fe700 1 --2- 172.21.15.36:0/2540637433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe354053620 0x7fe354055ae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fe36400d000 tx=0x7fe364007d80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:34.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.820+0000 7fe3717fa700 1 -- 172.21.15.36:0/2540637433 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe3680439d0 con 0x7fe3740a70c0 2022-01-10T01:24:34.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.944+0000 7fe37a5ea700 1 -- 172.21.15.36:0/2540637433 --> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe374063330 con 0x7fe354053620 2022-01-10T01:24:34.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.952+0000 7fe3717fa700 1 -- 172.21.15.36:0/2540637433 <== mgr.4101 v2:172.21.15.36:6800/14596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82327 (secure 0 0 0) 0x7fe364003030 con 0x7fe354053620 2022-01-10T01:24:34.960 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:34.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.956+0000 7fe37a5ea700 1 -- 172.21.15.36:0/2540637433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe354053620 msgr2=0x7fe354055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.956+0000 7fe37a5ea700 1 --2- 172.21.15.36:0/2540637433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe354053620 0x7fe354055ae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fe36400d000 tx=0x7fe364007d80).stop 2022-01-10T01:24:34.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.956+0000 7fe37a5ea700 1 -- 172.21.15.36:0/2540637433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3740a70c0 msgr2=0x7fe374067170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:34.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.956+0000 7fe37a5ea700 1 --2- 172.21.15.36:0/2540637433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3740a70c0 0x7fe374067170 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fe374147730 tx=0x7fe368015000).stop 2022-01-10T01:24:34.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.956+0000 7fe37a5ea700 1 -- 172.21.15.36:0/2540637433 shutdown_connections 2022-01-10T01:24:34.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.956+0000 7fe37a5ea700 1 --2- 172.21.15.36:0/2540637433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe354053620 0x7fe354055ae0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.956+0000 7fe37a5ea700 1 --2- 172.21.15.36:0/2540637433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3741483a0 0x7fe374156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.956+0000 7fe37a5ea700 1 --2- 172.21.15.36:0/2540637433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3740b1db0 0x7fe374066130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.956+0000 7fe37a5ea700 1 --2- 172.21.15.36:0/2540637433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3740a70c0 0x7fe374067170 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:34.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.956+0000 7fe37a5ea700 1 -- 172.21.15.36:0/2540637433 >> 172.21.15.36:0/2540637433 conn(0x7fe37405f6b0 msgr2=0x7fe3740b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:34.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.956+0000 7fe37a5ea700 1 -- 172.21.15.36:0/2540637433 shutdown_connections 2022-01-10T01:24:34.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:34.956+0000 7fe37a5ea700 1 -- 172.21.15.36:0/2540637433 wait complete. 2022-01-10T01:24:34.964 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2022-01-10T01:24:34.978 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2022-01-10T01:24:34.374905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390712,"kb_used_data":2040,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584008,"statfs":{"total":773094113280,"available":764502024192,"internally_reserved":8589934592,"allocated":2088960,"data_stored":822308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.457922"},"pg_stats":[{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.999388+0000","last_change":"2022-01-10T01:24:24.998501+0000","last_active":"2022-01-10T01:24:24.999388+0000","last_peered":"2022-01-10T01:24:24.999388+0000","last_clean":"2022-01-10T01:24:24.999388+0000","last_became_active":"2022-01-10T01:24:24.997941+0000","last_became_peered":"2022-01-10T01:24:24.997941+0000","last_unstale":"2022-01-10T01:24:24.999388+0000","last_undegraded":"2022-01-10T01:24:24.999388+0000","last_fullsized":"2022-01-10T01:24:24.999388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'2","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.982113+0000","last_change":"2022-01-10T01:24:14.937125+0000","last_active":"2022-01-10T01:24:24.982113+0000","last_peered":"2022-01-10T01:24:24.982113+0000","last_clean":"2022-01-10T01:24:24.982113+0000","last_became_active":"2022-01-10T01:24:14.935715+0000","last_became_peered":"2022-01-10T01:24:14.935715+0000","last_unstale":"2022-01-10T01:24:24.982113+0000","last_undegraded":"2022-01-10T01:24:24.982113+0000","last_fullsized":"2022-01-10T01:24:24.982113+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:08.543721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:08.543721+0000","last_clean_scrub_stamp":"2022-01-10T01:24:08.543721+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.922328+0000","last_change":"2022-01-10T01:24:19.114295+0000","last_active":"2022-01-10T01:24:24.922328+0000","last_peered":"2022-01-10T01:24:24.922328+0000","last_clean":"2022-01-10T01:24:24.922328+0000","last_became_active":"2022-01-10T01:24:19.113327+0000","last_became_peered":"2022-01-10T01:24:19.113327+0000","last_unstale":"2022-01-10T01:24:24.922328+0000","last_undegraded":"2022-01-10T01:24:24.922328+0000","last_fullsized":"2022-01-10T01:24:24.922328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"24'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.236716+0000","last_change":"2022-01-10T01:24:21.921342+0000","last_active":"2022-01-10T01:24:25.236716+0000","last_peered":"2022-01-10T01:24:25.236716+0000","last_clean":"2022-01-10T01:24:25.236716+0000","last_became_active":"2022-01-10T01:24:21.920668+0000","last_became_peered":"2022-01-10T01:24:21.920668+0000","last_unstale":"2022-01-10T01:24:25.236716+0000","last_undegraded":"2022-01-10T01:24:25.236716+0000","last_fullsized":"2022-01-10T01:24:25.236716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.005204+0000","last_change":"2022-01-10T01:24:25.002616+0000","last_active":"2022-01-10T01:24:25.005204+0000","last_peered":"2022-01-10T01:24:25.005204+0000","last_clean":"2022-01-10T01:24:25.005204+0000","last_became_active":"2022-01-10T01:24:25.001354+0000","last_became_peered":"2022-01-10T01:24:25.001354+0000","last_unstale":"2022-01-10T01:24:25.005204+0000","last_undegraded":"2022-01-10T01:24:25.005204+0000","last_fullsized":"2022-01-10T01:24:25.005204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.922254+0000","last_change":"2022-01-10T01:24:18.787713+0000","last_active":"2022-01-10T01:24:24.922254+0000","last_peered":"2022-01-10T01:24:24.922254+0000","last_clean":"2022-01-10T01:24:24.922254+0000","last_became_active":"2022-01-10T01:24:18.787183+0000","last_became_peered":"2022-01-10T01:24:18.787183+0000","last_unstale":"2022-01-10T01:24:24.922254+0000","last_undegraded":"2022-01-10T01:24:24.922254+0000","last_fullsized":"2022-01-10T01:24:24.922254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.926372+0000","last_change":"2022-01-10T01:24:21.922352+0000","last_active":"2022-01-10T01:24:24.926372+0000","last_peered":"2022-01-10T01:24:24.926372+0000","last_clean":"2022-01-10T01:24:24.926372+0000","last_became_active":"2022-01-10T01:24:21.921954+0000","last_became_peered":"2022-01-10T01:24:21.921954+0000","last_unstale":"2022-01-10T01:24:24.926372+0000","last_undegraded":"2022-01-10T01:24:24.926372+0000","last_fullsized":"2022-01-10T01:24:24.926372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.006486+0000","last_change":"2022-01-10T01:24:25.005059+0000","last_active":"2022-01-10T01:24:25.006486+0000","last_peered":"2022-01-10T01:24:25.006486+0000","last_clean":"2022-01-10T01:24:25.006486+0000","last_became_active":"2022-01-10T01:24:25.003763+0000","last_became_peered":"2022-01-10T01:24:25.003763+0000","last_unstale":"2022-01-10T01:24:25.006486+0000","last_undegraded":"2022-01-10T01:24:25.006486+0000","last_fullsized":"2022-01-10T01:24:25.006486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.998055+0000","last_change":"2022-01-10T01:24:18.786166+0000","last_active":"2022-01-10T01:24:24.998055+0000","last_peered":"2022-01-10T01:24:24.998055+0000","last_clean":"2022-01-10T01:24:24.998055+0000","last_became_active":"2022-01-10T01:24:18.785296+0000","last_became_peered":"2022-01-10T01:24:18.785296+0000","last_unstale":"2022-01-10T01:24:24.998055+0000","last_undegraded":"2022-01-10T01:24:24.998055+0000","last_fullsized":"2022-01-10T01:24:24.998055+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"24'8","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.252145+0000","last_change":"2022-01-10T01:24:22.090468+0000","last_active":"2022-01-10T01:24:25.252145+0000","last_peered":"2022-01-10T01:24:25.252145+0000","last_clean":"2022-01-10T01:24:25.252145+0000","last_became_active":"2022-01-10T01:24:22.089699+0000","last_became_peered":"2022-01-10T01:24:22.089699+0000","last_unstale":"2022-01-10T01:24:25.252145+0000","last_undegraded":"2022-01-10T01:24:25.252145+0000","last_fullsized":"2022-01-10T01:24:25.252145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.006569+0000","last_change":"2022-01-10T01:24:25.004830+0000","last_active":"2022-01-10T01:24:25.006569+0000","last_peered":"2022-01-10T01:24:25.006569+0000","last_clean":"2022-01-10T01:24:25.006569+0000","last_became_active":"2022-01-10T01:24:25.001016+0000","last_became_peered":"2022-01-10T01:24:25.001016+0000","last_unstale":"2022-01-10T01:24:25.006569+0000","last_undegraded":"2022-01-10T01:24:25.006569+0000","last_fullsized":"2022-01-10T01:24:25.006569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.922433+0000","last_change":"2022-01-10T01:24:19.115873+0000","last_active":"2022-01-10T01:24:24.922433+0000","last_peered":"2022-01-10T01:24:24.922433+0000","last_clean":"2022-01-10T01:24:24.922433+0000","last_became_active":"2022-01-10T01:24:19.114993+0000","last_became_peered":"2022-01-10T01:24:19.114993+0000","last_unstale":"2022-01-10T01:24:24.922433+0000","last_undegraded":"2022-01-10T01:24:24.922433+0000","last_fullsized":"2022-01-10T01:24:24.922433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"24'5","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.247344+0000","last_change":"2022-01-10T01:24:21.919320+0000","last_active":"2022-01-10T01:24:25.247344+0000","last_peered":"2022-01-10T01:24:25.247344+0000","last_clean":"2022-01-10T01:24:25.247344+0000","last_became_active":"2022-01-10T01:24:21.918801+0000","last_became_peered":"2022-01-10T01:24:21.918801+0000","last_unstale":"2022-01-10T01:24:25.247344+0000","last_undegraded":"2022-01-10T01:24:25.247344+0000","last_fullsized":"2022-01-10T01:24:25.247344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.004490+0000","last_change":"2022-01-10T01:24:25.001974+0000","last_active":"2022-01-10T01:24:25.004490+0000","last_peered":"2022-01-10T01:24:25.004490+0000","last_clean":"2022-01-10T01:24:25.004490+0000","last_became_active":"2022-01-10T01:24:25.001170+0000","last_became_peered":"2022-01-10T01:24:25.001170+0000","last_unstale":"2022-01-10T01:24:25.004490+0000","last_undegraded":"2022-01-10T01:24:25.004490+0000","last_fullsized":"2022-01-10T01:24:25.004490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"24'6","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.249955+0000","last_change":"2022-01-10T01:24:21.920058+0000","last_active":"2022-01-10T01:24:25.249955+0000","last_peered":"2022-01-10T01:24:25.249955+0000","last_clean":"2022-01-10T01:24:25.249955+0000","last_became_active":"2022-01-10T01:24:21.919419+0000","last_became_peered":"2022-01-10T01:24:21.919419+0000","last_unstale":"2022-01-10T01:24:25.249955+0000","last_undegraded":"2022-01-10T01:24:25.249955+0000","last_fullsized":"2022-01-10T01:24:25.249955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.921492+0000","last_change":"2022-01-10T01:24:19.116632+0000","last_active":"2022-01-10T01:24:24.921492+0000","last_peered":"2022-01-10T01:24:24.921492+0000","last_clean":"2022-01-10T01:24:24.921492+0000","last_became_active":"2022-01-10T01:24:19.115547+0000","last_became_peered":"2022-01-10T01:24:19.115547+0000","last_unstale":"2022-01-10T01:24:24.921492+0000","last_undegraded":"2022-01-10T01:24:24.921492+0000","last_fullsized":"2022-01-10T01:24:24.921492+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.005095+0000","last_change":"2022-01-10T01:24:25.003297+0000","last_active":"2022-01-10T01:24:25.005095+0000","last_peered":"2022-01-10T01:24:25.005095+0000","last_clean":"2022-01-10T01:24:25.005095+0000","last_became_active":"2022-01-10T01:24:25.001546+0000","last_became_peered":"2022-01-10T01:24:25.001546+0000","last_unstale":"2022-01-10T01:24:25.005095+0000","last_undegraded":"2022-01-10T01:24:25.005095+0000","last_fullsized":"2022-01-10T01:24:25.005095+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"24'8","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.249783+0000","last_change":"2022-01-10T01:24:21.924082+0000","last_active":"2022-01-10T01:24:25.249783+0000","last_peered":"2022-01-10T01:24:25.249783+0000","last_clean":"2022-01-10T01:24:25.249783+0000","last_became_active":"2022-01-10T01:24:21.923508+0000","last_became_peered":"2022-01-10T01:24:21.923508+0000","last_unstale":"2022-01-10T01:24:25.249783+0000","last_undegraded":"2022-01-10T01:24:25.249783+0000","last_fullsized":"2022-01-10T01:24:25.249783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.923801+0000","last_change":"2022-01-10T01:24:18.790281+0000","last_active":"2022-01-10T01:24:24.923801+0000","last_peered":"2022-01-10T01:24:24.923801+0000","last_clean":"2022-01-10T01:24:24.923801+0000","last_became_active":"2022-01-10T01:24:18.789645+0000","last_became_peered":"2022-01-10T01:24:18.789645+0000","last_unstale":"2022-01-10T01:24:24.923801+0000","last_undegraded":"2022-01-10T01:24:24.923801+0000","last_fullsized":"2022-01-10T01:24:24.923801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.988306+0000","last_change":"2022-01-10T01:24:24.987523+0000","last_active":"2022-01-10T01:24:24.988306+0000","last_peered":"2022-01-10T01:24:24.988306+0000","last_clean":"2022-01-10T01:24:24.988306+0000","last_became_active":"2022-01-10T01:24:24.986125+0000","last_became_peered":"2022-01-10T01:24:24.986125+0000","last_unstale":"2022-01-10T01:24:24.988306+0000","last_undegraded":"2022-01-10T01:24:24.988306+0000","last_fullsized":"2022-01-10T01:24:24.988306+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"24'7","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.247979+0000","last_change":"2022-01-10T01:24:21.921860+0000","last_active":"2022-01-10T01:24:25.247979+0000","last_peered":"2022-01-10T01:24:25.247979+0000","last_clean":"2022-01-10T01:24:25.247979+0000","last_became_active":"2022-01-10T01:24:21.921364+0000","last_became_peered":"2022-01-10T01:24:21.921364+0000","last_unstale":"2022-01-10T01:24:25.247979+0000","last_undegraded":"2022-01-10T01:24:25.247979+0000","last_fullsized":"2022-01-10T01:24:25.247979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.923472+0000","last_change":"2022-01-10T01:24:19.666159+0000","last_active":"2022-01-10T01:24:24.923472+0000","last_peered":"2022-01-10T01:24:24.923472+0000","last_clean":"2022-01-10T01:24:24.923472+0000","last_became_active":"2022-01-10T01:24:19.665292+0000","last_became_peered":"2022-01-10T01:24:19.665292+0000","last_unstale":"2022-01-10T01:24:24.923472+0000","last_undegraded":"2022-01-10T01:24:24.923472+0000","last_fullsized":"2022-01-10T01:24:24.923472+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.987005+0000","last_change":"2022-01-10T01:24:24.986101+0000","last_active":"2022-01-10T01:24:24.987005+0000","last_peered":"2022-01-10T01:24:24.987005+0000","last_clean":"2022-01-10T01:24:24.987005+0000","last_became_active":"2022-01-10T01:24:24.985506+0000","last_became_peered":"2022-01-10T01:24:24.985506+0000","last_unstale":"2022-01-10T01:24:24.987005+0000","last_undegraded":"2022-01-10T01:24:24.987005+0000","last_fullsized":"2022-01-10T01:24:24.987005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:23.909410+0000","last_clean_scrub_stamp":"2022-01-10T01:24:23.909410+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"24'4","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-01-10T01:24:25.247092+0000","last_change":"2022-01-10T01:24:22.090645+0000","last_active":"2022-01-10T01:24:25.247092+0000","last_peered":"2022-01-10T01:24:25.247092+0000","last_clean":"2022-01-10T01:24:25.247092+0000","last_became_active":"2022-01-10T01:24:22.089713+0000","last_became_peered":"2022-01-10T01:24:22.089713+0000","last_unstale":"2022-01-10T01:24:25.247092+0000","last_undegraded":"2022-01-10T01:24:25.247092+0000","last_fullsized":"2022-01-10T01:24:25.247092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:20.892742+0000","last_clean_scrub_stamp":"2022-01-10T01:24:20.892742+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-01-10T01:24:24.922747+0000","last_change":"2022-01-10T01:24:19.664491+0000","last_active":"2022-01-10T01:24:24.922747+0000","last_peered":"2022-01-10T01:24:24.922747+0000","last_clean":"2022-01-10T01:24:24.922747+0000","last_became_active":"2022-01-10T01:24:19.663966+0000","last_became_peered":"2022-01-10T01:24:19.663966+0000","last_unstale":"2022-01-10T01:24:24.922747+0000","last_undegraded":"2022-01-10T01:24:24.922747+0000","last_fullsized":"2022-01-10T01:24:24.922747+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":102357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048860,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322980,"statfs":{"total":96636764160,"available":95562731520,"internally_reserved":1073741824,"allocated":282624,"data_stored":104627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":103314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":102932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":102357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":101973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":102357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":102391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.482}]}]}]}} 2022-01-10T01:24:34.981 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-01-10T01:24:34.981 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-01-10T01:24:34.981 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2022-01-10T01:24:34.982 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-01-10T01:24:35.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.076+0000 7ffa0b338700 1 Processor -- start 2022-01-10T01:24:35.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.076+0000 7ffa0b338700 1 -- start start 2022-01-10T01:24:35.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.076+0000 7ffa0b338700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa040ad320 0x7ffa040af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0b338700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa040ad850 0x7ffa040a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0b338700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa040afda0 con 0x7ffa040af2c0 2022-01-10T01:24:35.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0b338700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0405c610 con 0x7ffa040ad850 2022-01-10T01:24:35.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0b338700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa04140800 con 0x7ffa040ad320 2022-01-10T01:24:35.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0a336700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffa040af2c0 0x7ffa04143150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:49576/0 (socket says 172.21.15.36:49576) 2022-01-10T01:24:35.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0ab37700 1 --2- 172.21.15.36:0/385887634 >> v2:172.21.15.59:3300/0 conn(0x7ffa040ad850 0x7ffa040a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0a336700 1 -- 172.21.15.36:0/385887634 learned_addr learned my addr 172.21.15.36:0/385887634 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:35.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa09b35700 1 --2- 172.21.15.36:0/385887634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa040ad320 0x7ffa040af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa09334700 1 -- 172.21.15.36:0/385887634 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92443301 0 0) 0x7ffa040afda0 con 0x7ffa040af2c0 2022-01-10T01:24:35.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa09334700 1 -- 172.21.15.36:0/385887634 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9ec003260 con 0x7ffa040af2c0 2022-01-10T01:24:35.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0ab37700 1 -- 172.21.15.36:0/385887634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa040ad320 msgr2=0x7ffa040af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:35.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0ab37700 1 --2- 172.21.15.36:0/385887634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa040ad320 0x7ffa040af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0ab37700 1 -- 172.21.15.36:0/385887634 >> v1:172.21.15.59:6789/0 conn(0x7ffa040af2c0 legacy=0x7ffa04143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0ab37700 1 -- 172.21.15.36:0/385887634 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa04143860 con 0x7ffa040ad850 2022-01-10T01:24:35.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa09b35700 1 --2- 172.21.15.36:0/385887634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa040ad320 0x7ffa040af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:35.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0ab37700 1 --2- 172.21.15.36:0/385887634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa040ad850 0x7ffa040a8cb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff9fc0032f0 tx=0x7ff9fc0091d0).ready entity=mon.1 client_cookie=d66b3213d5a02236 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:35.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa09334700 1 -- 172.21.15.36:0/385887634 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9fc00b600 con 0x7ffa040ad850 2022-01-10T01:24:35.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa09334700 1 -- 172.21.15.36:0/385887634 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9fc00b760 con 0x7ffa040ad850 2022-01-10T01:24:35.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa09334700 1 -- 172.21.15.36:0/385887634 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9fc00b8d0 con 0x7ffa040ad850 2022-01-10T01:24:35.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0b338700 1 -- 172.21.15.36:0/385887634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa040ad850 msgr2=0x7ffa040a8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0b338700 1 --2- 172.21.15.36:0/385887634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa040ad850 0x7ffa040a8cb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7ff9fc0032f0 tx=0x7ff9fc0091d0).stop 2022-01-10T01:24:35.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0b338700 1 -- 172.21.15.36:0/385887634 shutdown_connections 2022-01-10T01:24:35.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0b338700 1 --2- 172.21.15.36:0/385887634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa040ad850 0x7ffa040a8cb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0b338700 1 --2- 172.21.15.36:0/385887634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa040ad320 0x7ffa040af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0b338700 1 -- 172.21.15.36:0/385887634 >> 172.21.15.36:0/385887634 conn(0x7ffa04061140 msgr2=0x7ffa04062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:35.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0b338700 1 -- 172.21.15.36:0/385887634 shutdown_connections 2022-01-10T01:24:35.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.080+0000 7ffa0b338700 1 -- 172.21.15.36:0/385887634 wait complete. 2022-01-10T01:24:35.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.084+0000 7ffa0b338700 1 Processor -- start 2022-01-10T01:24:35.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.084+0000 7ffa0b338700 1 -- start start 2022-01-10T01:24:35.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.084+0000 7ffa0b338700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa040ad320 0x7ffa04065260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.084+0000 7ffa0b338700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa040ad850 0x7ffa04066c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.084+0000 7ffa0b338700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa040af2c0 0x7ffa04067120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.084+0000 7ffa0b338700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040b4cf0 con 0x7ffa040ad850 2022-01-10T01:24:35.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.084+0000 7ffa0b338700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040b67e0 con 0x7ffa040ad320 2022-01-10T01:24:35.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.084+0000 7ffa0b338700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa040b45b0 con 0x7ffa040af2c0 2022-01-10T01:24:35.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.084+0000 7ffa09b35700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa040ad850 0x7ffa04066c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.084+0000 7ffa09b35700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa040ad850 0x7ffa04066c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34116/0 (socket says 172.21.15.36:34116) 2022-01-10T01:24:35.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.084+0000 7ffa09b35700 1 -- 172.21.15.36:0/995564480 learned_addr learned my addr 172.21.15.36:0/995564480 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:35.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.084+0000 7ffa0a336700 1 --2- 172.21.15.36:0/995564480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa040ad320 0x7ffa04065260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.084+0000 7ffa0ab37700 1 --2- 172.21.15.36:0/995564480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa040af2c0 0x7ffa04067120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ffa09b35700 1 -- 172.21.15.36:0/995564480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa040af2c0 msgr2=0x7ffa04067120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ffa09b35700 1 --2- 172.21.15.36:0/995564480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa040af2c0 0x7ffa04067120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ffa09b35700 1 -- 172.21.15.36:0/995564480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa040ad320 msgr2=0x7ffa04065260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ffa09b35700 1 --2- 172.21.15.36:0/995564480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa040ad320 0x7ffa04065260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ffa09b35700 1 -- 172.21.15.36:0/995564480 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f400b180 con 0x7ffa040ad850 2022-01-10T01:24:35.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ffa09b35700 1 --2- 172.21.15.36:0/995564480 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa040ad850 0x7ffa04066c30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7ff9f400c000 tx=0x7ff9f4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:35.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ff9f37fe700 1 -- 172.21.15.36:0/995564480 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f4010780 con 0x7ffa040ad850 2022-01-10T01:24:35.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ffa0b338700 1 -- 172.21.15.36:0/995564480 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9fc009470 con 0x7ffa040ad850 2022-01-10T01:24:35.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ff9f37fe700 1 -- 172.21.15.36:0/995564480 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f40108e0 con 0x7ffa040ad850 2022-01-10T01:24:35.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ff9f37fe700 1 -- 172.21.15.36:0/995564480 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f4010c40 con 0x7ffa040ad850 2022-01-10T01:24:35.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ffa0b338700 1 -- 172.21.15.36:0/995564480 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa040b6500 con 0x7ffa040ad850 2022-01-10T01:24:35.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ffa0b338700 1 -- 172.21.15.36:0/995564480 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa04057350 con 0x7ffa040ad850 2022-01-10T01:24:35.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ff9f37fe700 1 -- 172.21.15.36:0/995564480 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff9f401c460 con 0x7ffa040ad850 2022-01-10T01:24:35.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ff9f37fe700 1 --2- 172.21.15.36:0/995564480 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e4053500 0x7ff9e40559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ff9f37fe700 1 -- 172.21.15.36:0/995564480 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff9f406c0d0 con 0x7ffa040ad850 2022-01-10T01:24:35.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.088+0000 7ffa0a336700 1 --2- 172.21.15.36:0/995564480 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e4053500 0x7ff9e40559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.092+0000 7ffa0a336700 1 --2- 172.21.15.36:0/995564480 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e4053500 0x7ff9e40559c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ffa0000d000 tx=0x7ffa00009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:35.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.092+0000 7ff9f37fe700 1 -- 172.21.15.36:0/995564480 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff9f4042fe0 con 0x7ffa040ad850 2022-01-10T01:24:35.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.260+0000 7ffa0b338700 1 -- 172.21.15.36:0/995564480 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffa040ac820 con 0x7ffa040ad850 2022-01-10T01:24:35.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.260+0000 7ff9f37fe700 1 -- 172.21.15.36:0/995564480 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7ff9f4046600 con 0x7ffa040ad850 2022-01-10T01:24:35.268 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:35.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.264+0000 7ffa0b338700 1 -- 172.21.15.36:0/995564480 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e4053500 msgr2=0x7ff9e40559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.264+0000 7ffa0b338700 1 --2- 172.21.15.36:0/995564480 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e4053500 0x7ff9e40559c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ffa0000d000 tx=0x7ffa00009040).stop 2022-01-10T01:24:35.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.264+0000 7ffa0b338700 1 -- 172.21.15.36:0/995564480 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa040ad850 msgr2=0x7ffa04066c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.264+0000 7ffa0b338700 1 --2- 172.21.15.36:0/995564480 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa040ad850 0x7ffa04066c30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7ff9f400c000 tx=0x7ff9f4006df0).stop 2022-01-10T01:24:35.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.264+0000 7ffa0b338700 1 -- 172.21.15.36:0/995564480 shutdown_connections 2022-01-10T01:24:35.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.264+0000 7ffa0b338700 1 --2- 172.21.15.36:0/995564480 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e4053500 0x7ff9e40559c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.264+0000 7ffa0b338700 1 --2- 172.21.15.36:0/995564480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa040af2c0 0x7ffa04067120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.264+0000 7ffa0b338700 1 --2- 172.21.15.36:0/995564480 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffa040ad850 0x7ffa04066c30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.264+0000 7ffa0b338700 1 --2- 172.21.15.36:0/995564480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa040ad320 0x7ffa04065260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.264+0000 7ffa0b338700 1 -- 172.21.15.36:0/995564480 >> 172.21.15.36:0/995564480 conn(0x7ffa04061140 msgr2=0x7ffa04143140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:35.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.264+0000 7ffa0b338700 1 -- 172.21.15.36:0/995564480 shutdown_connections 2022-01-10T01:24:35.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.264+0000 7ffa0b338700 1 -- 172.21.15.36:0/995564480 wait complete. 2022-01-10T01:24:35.281 INFO:teuthology.orchestra.run.smithi036.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-01-10T01:24:35.282 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2022-01-10T01:24:35.282 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:35.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.380+0000 7fa3c33f0700 1 Processor -- start 2022-01-10T01:24:35.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.380+0000 7fa3c33f0700 1 -- start start 2022-01-10T01:24:35.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c33f0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa3bc0ad5c0 0x7fa3bc061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c33f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3bc140440 0x7fa3bc1408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c33f0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3bc0aecf0 con 0x7fa3bc061320 2022-01-10T01:24:35.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c33f0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3bc0b6f20 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c33f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc0aef20 con 0x7fa3bc140440 2022-01-10T01:24:35.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c1bed700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa3bc0ad5c0 0x7fa3bc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c1bed700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa3bc0ad5c0 0x7fa3bc061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34122/0 (socket says 172.21.15.36:34122) 2022-01-10T01:24:35.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c1bed700 1 -- 172.21.15.36:0/1989852269 learned_addr learned my addr 172.21.15.36:0/1989852269 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:35.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c2bef700 1 --2- 172.21.15.36:0/1989852269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3bc140440 0x7fa3bc1408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c1bed700 1 -- 172.21.15.36:0/1989852269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3bc140440 msgr2=0x7fa3bc1408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:35.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c1bed700 1 --2- 172.21.15.36:0/1989852269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3bc140440 0x7fa3bc1408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c1bed700 1 -- 172.21.15.36:0/1989852269 >> v1:172.21.15.59:6789/0 conn(0x7fa3bc061320 legacy=0x7fa3bc0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c1bed700 1 -- 172.21.15.36:0/1989852269 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc0af1c0 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c1bed700 1 --2- 172.21.15.36:0/1989852269 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3bc0ad5c0 0x7fa3bc061700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fa3b8002f70 tx=0x7fa3b8006eb0).ready entity=mon.0 client_cookie=9e56511e70787c46 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:35.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c13ec700 1 -- 172.21.15.36:0/1989852269 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3b800d570 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c13ec700 1 -- 172.21.15.36:0/1989852269 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b8000e90 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c13ec700 1 -- 172.21.15.36:0/1989852269 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3b800d900 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c33f0700 1 -- 172.21.15.36:0/1989852269 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3bc0ad5c0 msgr2=0x7fa3bc061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c33f0700 1 --2- 172.21.15.36:0/1989852269 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3bc0ad5c0 0x7fa3bc061700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fa3b8002f70 tx=0x7fa3b8006eb0).stop 2022-01-10T01:24:35.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c33f0700 1 -- 172.21.15.36:0/1989852269 shutdown_connections 2022-01-10T01:24:35.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c33f0700 1 --2- 172.21.15.36:0/1989852269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3bc140440 0x7fa3bc1408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c33f0700 1 --2- 172.21.15.36:0/1989852269 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3bc0ad5c0 0x7fa3bc061700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.384+0000 7fa3c33f0700 1 -- 172.21.15.36:0/1989852269 >> 172.21.15.36:0/1989852269 conn(0x7fa3bc066de0 msgr2=0x7fa3bc0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:35.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.388+0000 7fa3c33f0700 1 -- 172.21.15.36:0/1989852269 shutdown_connections 2022-01-10T01:24:35.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.388+0000 7fa3c33f0700 1 -- 172.21.15.36:0/1989852269 wait complete. 2022-01-10T01:24:35.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.388+0000 7fa3c33f0700 1 Processor -- start 2022-01-10T01:24:35.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.388+0000 7fa3c33f0700 1 -- start start 2022-01-10T01:24:35.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c33f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3bc061320 0x7fa3bc1531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c33f0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3bc0ad5c0 0x7fa3bc0b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c33f0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3bc140440 0x7fa3bc0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c33f0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc152600 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c33f0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc09f610 con 0x7fa3bc140440 2022-01-10T01:24:35.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c33f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc1527f0 con 0x7fa3bc061320 2022-01-10T01:24:35.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c1bed700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3bc0ad5c0 0x7fa3bc0b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c1bed700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3bc0ad5c0 0x7fa3bc0b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34128/0 (socket says 172.21.15.36:34128) 2022-01-10T01:24:35.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c1bed700 1 -- 172.21.15.36:0/2753524377 learned_addr learned my addr 172.21.15.36:0/2753524377 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:35.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c23ee700 1 --2- 172.21.15.36:0/2753524377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3bc061320 0x7fa3bc1531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c2bef700 1 --2- 172.21.15.36:0/2753524377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3bc140440 0x7fa3bc0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c1bed700 1 -- 172.21.15.36:0/2753524377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3bc061320 msgr2=0x7fa3bc1531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c1bed700 1 --2- 172.21.15.36:0/2753524377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3bc061320 0x7fa3bc1531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c1bed700 1 -- 172.21.15.36:0/2753524377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3bc140440 msgr2=0x7fa3bc0b77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c1bed700 1 --2- 172.21.15.36:0/2753524377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3bc140440 0x7fa3bc0b77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c1bed700 1 -- 172.21.15.36:0/2753524377 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b800b1e0 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c1bed700 1 --2- 172.21.15.36:0/2753524377 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3bc0ad5c0 0x7fa3bc0b10d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fa3b8002f70 tx=0x7fa3b8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:35.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3af7fe700 1 -- 172.21.15.36:0/2753524377 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3b8011760 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3af7fe700 1 -- 172.21.15.36:0/2753524377 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b80118c0 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c33f0700 1 -- 172.21.15.36:0/2753524377 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3bc152a90 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3af7fe700 1 -- 172.21.15.36:0/2753524377 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3b8011c20 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c33f0700 1 -- 172.21.15.36:0/2753524377 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3bc0b7ce0 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3c33f0700 1 -- 172.21.15.36:0/2753524377 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3bc0acfe0 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.392+0000 7fa3af7fe700 1 -- 172.21.15.36:0/2753524377 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa3b8025030 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.396+0000 7fa3af7fe700 1 --2- 172.21.15.36:0/2753524377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa39c053560 0x7fa39c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.396+0000 7fa3af7fe700 1 -- 172.21.15.36:0/2753524377 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa3b806caa0 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.396+0000 7fa3c23ee700 1 --2- 172.21.15.36:0/2753524377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa39c053560 0x7fa39c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.396+0000 7fa3c23ee700 1 --2- 172.21.15.36:0/2753524377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa39c053560 0x7fa39c055a20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fa3b000d000 tx=0x7fa3b0007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:35.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.400+0000 7fa3af7fe700 1 -- 172.21.15.36:0/2753524377 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa3bc0acfe0 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.528+0000 7fa3c33f0700 1 -- 172.21.15.36:0/2753524377 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3bc0acfe0 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.532+0000 7fa3af7fe700 1 -- 172.21.15.36:0/2753524377 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fa3bc0acfe0 con 0x7fa3bc0ad5c0 2022-01-10T01:24:35.538 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:35.539 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:25.224959+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:24:20.202898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-10T01:24:22.952870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:35.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.536+0000 7fa3c33f0700 1 -- 172.21.15.36:0/2753524377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa39c053560 msgr2=0x7fa39c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.536+0000 7fa3c33f0700 1 --2- 172.21.15.36:0/2753524377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa39c053560 0x7fa39c055a20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fa3b000d000 tx=0x7fa3b0007b90).stop 2022-01-10T01:24:35.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.536+0000 7fa3c33f0700 1 -- 172.21.15.36:0/2753524377 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3bc0ad5c0 msgr2=0x7fa3bc0b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.536+0000 7fa3c33f0700 1 --2- 172.21.15.36:0/2753524377 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3bc0ad5c0 0x7fa3bc0b10d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fa3b8002f70 tx=0x7fa3b8015000).stop 2022-01-10T01:24:35.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.536+0000 7fa3c33f0700 1 -- 172.21.15.36:0/2753524377 shutdown_connections 2022-01-10T01:24:35.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.536+0000 7fa3c33f0700 1 --2- 172.21.15.36:0/2753524377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa39c053560 0x7fa39c055a20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.536+0000 7fa3c33f0700 1 --2- 172.21.15.36:0/2753524377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3bc140440 0x7fa3bc0b77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.536+0000 7fa3c33f0700 1 --2- 172.21.15.36:0/2753524377 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3bc0ad5c0 0x7fa3bc0b10d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.536+0000 7fa3c33f0700 1 --2- 172.21.15.36:0/2753524377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3bc061320 0x7fa3bc1531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.536+0000 7fa3c33f0700 1 -- 172.21.15.36:0/2753524377 >> 172.21.15.36:0/2753524377 conn(0x7fa3bc066de0 msgr2=0x7fa3bc05ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:35.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.536+0000 7fa3c33f0700 1 -- 172.21.15.36:0/2753524377 shutdown_connections 2022-01-10T01:24:35.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.536+0000 7fa3c33f0700 1 -- 172.21.15.36:0/2753524377 wait complete. 2022-01-10T01:24:35.559 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:24:20.202898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:24:22.952870+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:24:35.560 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:24:35.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7dbfff700 1 Processor -- start 2022-01-10T01:24:35.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7dbfff700 1 -- start start 2022-01-10T01:24:35.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7dbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7dc0b76b0 0x7fb7dc060a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7dbfff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc067050 con 0x7fb7dc0b27a0 2022-01-10T01:24:35.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7dbfff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc061650 con 0x7fb7dc143270 2022-01-10T01:24:35.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7dbfff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc0653b0 con 0x7fb7dc0b76b0 2022-01-10T01:24:35.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7d27fc700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fb7dc0b27a0 0x7fb7dc060f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60164/0 (socket says 172.21.15.36:60164) 2022-01-10T01:24:35.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7d27fc700 1 -- 172.21.15.36:0/417713227 learned_addr learned my addr 172.21.15.36:0/417713227 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:35.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7daffd700 1 --2- 172.21.15.36:0/417713227 >> v2:172.21.15.59:3300/0 conn(0x7fb7dc0b76b0 0x7fb7dc060a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 -- 172.21.15.36:0/417713227 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942154714 0 0) 0x7fb7dc067050 con 0x7fb7dc0b27a0 2022-01-10T01:24:35.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 -- 172.21.15.36:0/417713227 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7bc003260 con 0x7fb7dc0b27a0 2022-01-10T01:24:35.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 -- 172.21.15.36:0/417713227 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 446746507 0 0) 0x7fb7bc003260 con 0x7fb7dc0b27a0 2022-01-10T01:24:35.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 -- 172.21.15.36:0/417713227 >> v2:172.21.15.59:3300/0 conn(0x7fb7dc0b76b0 msgr2=0x7fb7dc060a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:35.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 --2- 172.21.15.36:0/417713227 >> v2:172.21.15.59:3300/0 conn(0x7fb7dc0b76b0 0x7fb7dc060a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 -- 172.21.15.36:0/417713227 >> v1:172.21.15.59:6789/0 conn(0x7fb7dc143270 legacy=0x7fb7dc143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 -- 172.21.15.36:0/417713227 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc0b7a90 con 0x7fb7dc0b27a0 2022-01-10T01:24:35.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 -- 172.21.15.36:0/417713227 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fb7c4001660 con 0x7fb7dc0b27a0 2022-01-10T01:24:35.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 -- 172.21.15.36:0/417713227 >> v1:172.21.15.36:6789/0 conn(0x7fb7dc0b27a0 legacy=0x7fb7dc060f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 --2- 172.21.15.36:0/417713227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7bc003750 0x7fb7bc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 --2- 172.21.15.36:0/417713227 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7bc004500 0x7fb7bc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 --2- 172.21.15.36:0/417713227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7bc004e70 0x7fb7bc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 -- 172.21.15.36:0/417713227 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0653b0 con 0x7fb7bc004500 2022-01-10T01:24:35.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 -- 172.21.15.36:0/417713227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc00bd20 con 0x7fb7bc004e70 2022-01-10T01:24:35.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7da7fc700 1 -- 172.21.15.36:0/417713227 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc00bee0 con 0x7fb7bc003750 2022-01-10T01:24:35.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7d27fc700 1 --2- 172.21.15.36:0/417713227 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7bc004500 0x7fb7bc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7daffd700 1 --2- 172.21.15.36:0/417713227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7bc003750 0x7fb7bc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7db7fe700 1 --2- 172.21.15.36:0/417713227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7bc004e70 0x7fb7bc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7d27fc700 1 -- 172.21.15.36:0/417713227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7bc003750 msgr2=0x7fb7bc003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:35.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7d27fc700 1 --2- 172.21.15.36:0/417713227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7bc003750 0x7fb7bc003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7d27fc700 1 -- 172.21.15.36:0/417713227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7bc004e70 msgr2=0x7fb7bc00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:35.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7d27fc700 1 --2- 172.21.15.36:0/417713227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7bc004e70 0x7fb7bc00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7d27fc700 1 -- 172.21.15.36:0/417713227 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc003260 con 0x7fb7bc004500 2022-01-10T01:24:35.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.668+0000 7fb7db7fe700 1 -- 172.21.15.36:0/417713227 reap_dead start 2022-01-10T01:24:35.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.672+0000 7fb7d27fc700 1 --2- 172.21.15.36:0/417713227 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7bc004500 0x7fb7bc004980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fb7c4001370 tx=0x7fb7dc067370).ready entity=mon.0 client_cookie=d20bccaec12a1f88 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:35.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.672+0000 7fb7da7fc700 1 -- 172.21.15.36:0/417713227 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7c40070d0 con 0x7fb7bc004500 2022-01-10T01:24:35.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.672+0000 7fb7da7fc700 1 -- 172.21.15.36:0/417713227 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c4007230 con 0x7fb7bc004500 2022-01-10T01:24:35.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.672+0000 7fb7da7fc700 1 -- 172.21.15.36:0/417713227 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7c400c8f0 con 0x7fb7bc004500 2022-01-10T01:24:35.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.672+0000 7fb7dbfff700 1 -- 172.21.15.36:0/417713227 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7bc004500 msgr2=0x7fb7bc004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.672+0000 7fb7dbfff700 1 --2- 172.21.15.36:0/417713227 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7bc004500 0x7fb7bc004980 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fb7c4001370 tx=0x7fb7dc067370).stop 2022-01-10T01:24:35.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.672+0000 7fb7dbfff700 1 -- 172.21.15.36:0/417713227 shutdown_connections 2022-01-10T01:24:35.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.672+0000 7fb7dbfff700 1 --2- 172.21.15.36:0/417713227 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7bc004500 0x7fb7bc004980 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.672+0000 7fb7dbfff700 1 -- 172.21.15.36:0/417713227 >> 172.21.15.36:0/417713227 conn(0x7fb7dc05f6b0 msgr2=0x7fb7dc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:35.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.672+0000 7fb7dbfff700 1 -- 172.21.15.36:0/417713227 shutdown_connections 2022-01-10T01:24:35.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.672+0000 7fb7dbfff700 1 -- 172.21.15.36:0/417713227 wait complete. 2022-01-10T01:24:35.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7dbfff700 1 Processor -- start 2022-01-10T01:24:35.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7dbfff700 1 -- start start 2022-01-10T01:24:35.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7dbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7bc004500 0x7fb7dc0b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7dbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7dc0ae740 0x7fb7dc0ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7dbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7dc05c0f0 0x7fb7dc155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7dbfff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0ac670 con 0x7fb7dc0ae740 2022-01-10T01:24:35.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7dbfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0ac890 con 0x7fb7dc05c0f0 2022-01-10T01:24:35.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7dbfff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0b0c10 con 0x7fb7bc004500 2022-01-10T01:24:35.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7d27fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7dc0ae740 0x7fb7dc0ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7d27fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7dc0ae740 0x7fb7dc0ac180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34148/0 (socket says 172.21.15.36:34148) 2022-01-10T01:24:35.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7d27fc700 1 -- 172.21.15.36:0/3638772405 learned_addr learned my addr 172.21.15.36:0/3638772405 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:35.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7daffd700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7bc004500 0x7fb7dc0b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7db7fe700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7dc05c0f0 0x7fb7dc155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7d27fc700 1 -- 172.21.15.36:0/3638772405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7bc004500 msgr2=0x7fb7dc0b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7d27fc700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7bc004500 0x7fb7dc0b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7d27fc700 1 -- 172.21.15.36:0/3638772405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7dc05c0f0 msgr2=0x7fb7dc155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7d27fc700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7dc05c0f0 0x7fb7dc155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7d27fc700 1 -- 172.21.15.36:0/3638772405 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc0b0eb0 con 0x7fb7dc0ae740 2022-01-10T01:24:35.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7daffd700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7bc004500 0x7fb7dc0b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:35.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7d27fc700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7dc0ae740 0x7fb7dc0ac180 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fb7c4001370 tx=0x7fb7c4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:35.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7d8ff9700 1 -- 172.21.15.36:0/3638772405 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7c400ce90 con 0x7fb7dc0ae740 2022-01-10T01:24:35.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7d8ff9700 1 -- 172.21.15.36:0/3638772405 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c400c6d0 con 0x7fb7dc0ae740 2022-01-10T01:24:35.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7dbfff700 1 -- 172.21.15.36:0/3638772405 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc0b1150 con 0x7fb7dc0ae740 2022-01-10T01:24:35.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.676+0000 7fb7d8ff9700 1 -- 172.21.15.36:0/3638772405 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7c4004710 con 0x7fb7dc0ae740 2022-01-10T01:24:35.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.680+0000 7fb7dbfff700 1 -- 172.21.15.36:0/3638772405 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc155d50 con 0x7fb7dc0ae740 2022-01-10T01:24:35.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.680+0000 7fb7dbfff700 1 -- 172.21.15.36:0/3638772405 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc0b12e0 con 0x7fb7dc0ae740 2022-01-10T01:24:35.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.680+0000 7fb7d8ff9700 1 -- 172.21.15.36:0/3638772405 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb7c4010070 con 0x7fb7dc0ae740 2022-01-10T01:24:35.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.680+0000 7fb7d8ff9700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7c00536b0 0x7fb7c0055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.680+0000 7fb7daffd700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7c00536b0 0x7fb7c0055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.680+0000 7fb7d8ff9700 1 -- 172.21.15.36:0/3638772405 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb7c406c450 con 0x7fb7dc0ae740 2022-01-10T01:24:35.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.684+0000 7fb7daffd700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7c00536b0 0x7fb7c0055b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb7cc006000 tx=0x7fb7cc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:35.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.692+0000 7fb7d8ff9700 1 -- 172.21.15.36:0/3638772405 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb7c4043350 con 0x7fb7dc0ae740 2022-01-10T01:24:35.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.816+0000 7fb7dbfff700 1 -- 172.21.15.36:0/3638772405 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb7dc057350 con 0x7fb7dc0ae740 2022-01-10T01:24:35.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.816+0000 7fb7d8ff9700 1 -- 172.21.15.36:0/3638772405 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb7c401a070 con 0x7fb7dc0ae740 2022-01-10T01:24:35.824 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:24:35.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.820+0000 7fb7dbfff700 1 -- 172.21.15.36:0/3638772405 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7c00536b0 msgr2=0x7fb7c0055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.820+0000 7fb7dbfff700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7c00536b0 0x7fb7c0055b70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fb7cc006000 tx=0x7fb7cc008040).stop 2022-01-10T01:24:35.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.820+0000 7fb7dbfff700 1 -- 172.21.15.36:0/3638772405 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7dc0ae740 msgr2=0x7fb7dc0ac180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.820+0000 7fb7dbfff700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7dc0ae740 0x7fb7dc0ac180 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fb7c4001370 tx=0x7fb7c4015000).stop 2022-01-10T01:24:35.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.820+0000 7fb7dbfff700 1 -- 172.21.15.36:0/3638772405 shutdown_connections 2022-01-10T01:24:35.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.820+0000 7fb7dbfff700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7c00536b0 0x7fb7c0055b70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.820+0000 7fb7dbfff700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7dc05c0f0 0x7fb7dc155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.820+0000 7fb7dbfff700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7dc0ae740 0x7fb7dc0ac180 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.820+0000 7fb7dbfff700 1 --2- 172.21.15.36:0/3638772405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7bc004500 0x7fb7dc0b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.820+0000 7fb7dbfff700 1 -- 172.21.15.36:0/3638772405 >> 172.21.15.36:0/3638772405 conn(0x7fb7dc05f6b0 msgr2=0x7fb7dc05cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:35.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.820+0000 7fb7dbfff700 1 -- 172.21.15.36:0/3638772405 shutdown_connections 2022-01-10T01:24:35.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.820+0000 7fb7dbfff700 1 -- 172.21.15.36:0/3638772405 wait complete. 2022-01-10T01:24:35.837 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:24:35.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.940+0000 7f52c18fb700 1 Processor -- start 2022-01-10T01:24:35.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.940+0000 7f52c18fb700 1 -- start start 2022-01-10T01:24:35.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c18fb700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f52bc0b54a0 0x7f52bc0af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c18fb700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc1479f0 con 0x7f52bc0b0610 2022-01-10T01:24:35.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c18fb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52bc0b5880 con 0x7f52bc1475a0 2022-01-10T01:24:35.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c18fb700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52bc1452e0 con 0x7f52bc0b54a0 2022-01-10T01:24:35.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c08f9700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f52bc0b54a0 0x7f52bc0af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52bbfff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f52bc0b0610 0x7f52bc0675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60182/0 (socket says 172.21.15.36:60182) 2022-01-10T01:24:35.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52bbfff700 1 -- 172.21.15.36:0/1306640604 learned_addr learned my addr 172.21.15.36:0/1306640604 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:35.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52bb7fe700 1 -- 172.21.15.36:0/1306640604 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756758848 0 0) 0x7f52bc1479f0 con 0x7f52bc0b0610 2022-01-10T01:24:35.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52bb7fe700 1 -- 172.21.15.36:0/1306640604 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52a8003260 con 0x7f52bc0b0610 2022-01-10T01:24:35.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c08f9700 1 -- 172.21.15.36:0/1306640604 >> v1:172.21.15.59:6789/0 conn(0x7f52bc1475a0 legacy=0x7f52bc0acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c08f9700 1 -- 172.21.15.36:0/1306640604 >> v1:172.21.15.36:6789/0 conn(0x7f52bc0b0610 legacy=0x7f52bc0675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c08f9700 1 -- 172.21.15.36:0/1306640604 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc0ac800 con 0x7f52bc0b54a0 2022-01-10T01:24:35.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c08f9700 1 --2- 172.21.15.36:0/1306640604 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52bc0b54a0 0x7f52bc0af550 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f52b0002f70 tx=0x7f52b0006df0).ready entity=mon.0 client_cookie=7ca045de0a169440 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:35.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52bb7fe700 1 -- 172.21.15.36:0/1306640604 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52b000d5c0 con 0x7f52bc0b54a0 2022-01-10T01:24:35.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52bb7fe700 1 -- 172.21.15.36:0/1306640604 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b0000e90 con 0x7f52bc0b54a0 2022-01-10T01:24:35.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52bb7fe700 1 -- 172.21.15.36:0/1306640604 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52b000d910 con 0x7f52bc0b54a0 2022-01-10T01:24:35.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c18fb700 1 -- 172.21.15.36:0/1306640604 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52bc0b54a0 msgr2=0x7f52bc0af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c18fb700 1 --2- 172.21.15.36:0/1306640604 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52bc0b54a0 0x7f52bc0af550 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f52b0002f70 tx=0x7f52b0006df0).stop 2022-01-10T01:24:35.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c18fb700 1 -- 172.21.15.36:0/1306640604 shutdown_connections 2022-01-10T01:24:35.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c18fb700 1 --2- 172.21.15.36:0/1306640604 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52bc0b54a0 0x7f52bc0af550 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c18fb700 1 -- 172.21.15.36:0/1306640604 >> 172.21.15.36:0/1306640604 conn(0x7f52bc062560 msgr2=0x7f52bc062940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:35.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c18fb700 1 -- 172.21.15.36:0/1306640604 shutdown_connections 2022-01-10T01:24:35.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.944+0000 7f52c18fb700 1 -- 172.21.15.36:0/1306640604 wait complete. 2022-01-10T01:24:35.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c18fb700 1 Processor -- start 2022-01-10T01:24:35.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c18fb700 1 -- start start 2022-01-10T01:24:35.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c18fb700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52bc0b0610 0x7f52bc063e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c18fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52bc0b54a0 0x7f52bc145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c18fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52bc1475a0 0x7f52bc065c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c18fb700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0adff0 con 0x7f52bc0b0610 2022-01-10T01:24:35.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c18fb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc065590 con 0x7f52bc1475a0 2022-01-10T01:24:35.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c18fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc0b4ad0 con 0x7f52bc0b54a0 2022-01-10T01:24:35.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c08f9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52bc0b0610 0x7f52bc063e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c08f9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52bc0b0610 0x7f52bc063e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34162/0 (socket says 172.21.15.36:34162) 2022-01-10T01:24:35.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52bbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52bc0b54a0 0x7f52bc145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c08f9700 1 -- 172.21.15.36:0/3341432618 learned_addr learned my addr 172.21.15.36:0/3341432618 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:35.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c10fa700 1 --2- 172.21.15.36:0/3341432618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52bc1475a0 0x7f52bc065c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c08f9700 1 -- 172.21.15.36:0/3341432618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52bc0b54a0 msgr2=0x7f52bc145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c08f9700 1 --2- 172.21.15.36:0/3341432618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52bc0b54a0 0x7f52bc145760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c08f9700 1 -- 172.21.15.36:0/3341432618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52bc1475a0 msgr2=0x7f52bc065c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:35.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c08f9700 1 --2- 172.21.15.36:0/3341432618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52bc1475a0 0x7f52bc065c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:35.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c08f9700 1 -- 172.21.15.36:0/3341432618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b000b180 con 0x7f52bc0b0610 2022-01-10T01:24:35.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c08f9700 1 --2- 172.21.15.36:0/3341432618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52bc0b0610 0x7f52bc063e00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f52b0002f70 tx=0x7f52b0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:35.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52b9ffb700 1 -- 172.21.15.36:0/3341432618 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52b0016070 con 0x7f52bc0b0610 2022-01-10T01:24:35.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52b9ffb700 1 -- 172.21.15.36:0/3341432618 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b000de40 con 0x7f52bc0b0610 2022-01-10T01:24:35.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c18fb700 1 -- 172.21.15.36:0/3341432618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52bc0b4d70 con 0x7f52bc0b0610 2022-01-10T01:24:35.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52b9ffb700 1 -- 172.21.15.36:0/3341432618 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52b0013da0 con 0x7f52bc0b0610 2022-01-10T01:24:35.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.948+0000 7f52c18fb700 1 -- 172.21.15.36:0/3341432618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52bc1462a0 con 0x7f52bc0b0610 2022-01-10T01:24:35.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.952+0000 7f52c18fb700 1 -- 172.21.15.36:0/3341432618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52bc0b14f0 con 0x7f52bc0b0610 2022-01-10T01:24:35.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.952+0000 7f52b9ffb700 1 -- 172.21.15.36:0/3341432618 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f52b0024030 con 0x7f52bc0b0610 2022-01-10T01:24:35.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.952+0000 7f52b9ffb700 1 --2- 172.21.15.36:0/3341432618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f529c053620 0x7f529c055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:35.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.952+0000 7f52b9ffb700 1 -- 172.21.15.36:0/3341432618 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f52b006c590 con 0x7f52bc0b0610 2022-01-10T01:24:35.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.952+0000 7f52bbfff700 1 --2- 172.21.15.36:0/3341432618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f529c053620 0x7f529c055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:35.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.952+0000 7f52bbfff700 1 --2- 172.21.15.36:0/3341432618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f529c053620 0x7f529c055ae0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f52ac00d000 tx=0x7f52ac009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:35.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:35.960+0000 7f52b9ffb700 1 -- 172.21.15.36:0/3341432618 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f52b00435a0 con 0x7f52bc0b0610 2022-01-10T01:24:36.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.088+0000 7f52c18fb700 1 -- 172.21.15.36:0/3341432618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f52bc060e90 con 0x7f52bc0b0610 2022-01-10T01:24:36.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.088+0000 7f52b9ffb700 1 -- 172.21.15.36:0/3341432618 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f52b0022020 con 0x7f52bc0b0610 2022-01-10T01:24:36.094 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:36.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.088+0000 7f52c18fb700 1 -- 172.21.15.36:0/3341432618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f529c053620 msgr2=0x7f529c055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.088+0000 7f52c18fb700 1 --2- 172.21.15.36:0/3341432618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f529c053620 0x7f529c055ae0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f52ac00d000 tx=0x7f52ac009040).stop 2022-01-10T01:24:36.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.088+0000 7f52c18fb700 1 -- 172.21.15.36:0/3341432618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52bc0b0610 msgr2=0x7f52bc063e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.088+0000 7f52c18fb700 1 --2- 172.21.15.36:0/3341432618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52bc0b0610 0x7f52bc063e00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f52b0002f70 tx=0x7f52b0014000).stop 2022-01-10T01:24:36.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.088+0000 7f52c18fb700 1 -- 172.21.15.36:0/3341432618 shutdown_connections 2022-01-10T01:24:36.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.088+0000 7f52c18fb700 1 --2- 172.21.15.36:0/3341432618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f529c053620 0x7f529c055ae0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.088+0000 7f52c18fb700 1 --2- 172.21.15.36:0/3341432618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52bc1475a0 0x7f52bc065c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.088+0000 7f52c18fb700 1 --2- 172.21.15.36:0/3341432618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52bc0b54a0 0x7f52bc145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.088+0000 7f52c18fb700 1 --2- 172.21.15.36:0/3341432618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52bc0b0610 0x7f52bc063e00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.088+0000 7f52c18fb700 1 -- 172.21.15.36:0/3341432618 >> 172.21.15.36:0/3341432618 conn(0x7f52bc062560 msgr2=0x7f52bc0ae670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:36.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.088+0000 7f52c18fb700 1 -- 172.21.15.36:0/3341432618 shutdown_connections 2022-01-10T01:24:36.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.088+0000 7f52c18fb700 1 -- 172.21.15.36:0/3341432618 wait complete. 2022-01-10T01:24:36.107 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:24:36.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754359e700 1 Processor -- start 2022-01-10T01:24:36.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754359e700 1 -- start start 2022-01-10T01:24:36.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75440b2580 0x7f75440abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754359e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75440add80 con 0x7f75440b02e0 2022-01-10T01:24:36.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75440ae020 con 0x7f75440b1260 2022-01-10T01:24:36.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75440a9390 con 0x7f75440b2580 2022-01-10T01:24:36.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f7542d9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f75440b02e0 0x7f754414a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60196/0 (socket says 172.21.15.36:60196) 2022-01-10T01:24:36.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f7542d9d700 1 -- 172.21.15.36:0/2249373109 learned_addr learned my addr 172.21.15.36:0/2249373109 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:36.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754259c700 1 --2- 172.21.15.36:0/2249373109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75440b2580 0x7f75440abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318058920 0 0) 0x7f75440add80 con 0x7f75440b02e0 2022-01-10T01:24:36.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7524003260 con 0x7f75440b02e0 2022-01-10T01:24:36.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414687214 0 0) 0x7f75440ae020 con 0x7f75440b1260 2022-01-10T01:24:36.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75440add80 con 0x7f75440b1260 2022-01-10T01:24:36.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1793326206 0 0) 0x7f7524003260 con 0x7f75440b02e0 2022-01-10T01:24:36.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75440b2580 msgr2=0x7f75440abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:36.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 --2- 172.21.15.36:0/2249373109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75440b2580 0x7f75440abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 >> v1:172.21.15.59:6789/0 conn(0x7f75440b1260 legacy=0x7f75440afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75440a9830 con 0x7f75440b02e0 2022-01-10T01:24:36.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f75340019e0 con 0x7f75440b02e0 2022-01-10T01:24:36.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 >> v1:172.21.15.36:6789/0 conn(0x7f75440b02e0 legacy=0x7f754414a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 --2- 172.21.15.36:0/2249373109 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7524003910 0x7f7524003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 --2- 172.21.15.36:0/2249373109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75440b2580 0x7f7524004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 --2- 172.21.15.36:0/2249373109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75240049f0 0x7f7524004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75440a9390 con 0x7f7524003910 2022-01-10T01:24:36.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752400b780 con 0x7f75240049f0 2022-01-10T01:24:36.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.212+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752400b940 con 0x7f75440b2580 2022-01-10T01:24:36.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754259c700 1 --2- 172.21.15.36:0/2249373109 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7524003910 0x7f7524003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f7542d9d700 1 --2- 172.21.15.36:0/2249373109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75240049f0 0x7f7524004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f7541d9b700 1 --2- 172.21.15.36:0/2249373109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75440b2580 0x7f7524004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754259c700 1 -- 172.21.15.36:0/2249373109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75440b2580 msgr2=0x7f7524004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:36.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754259c700 1 --2- 172.21.15.36:0/2249373109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75440b2580 0x7f7524004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754259c700 1 -- 172.21.15.36:0/2249373109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75240049f0 msgr2=0x7f7524004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:36.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754259c700 1 --2- 172.21.15.36:0/2249373109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75240049f0 0x7f7524004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754259c700 1 -- 172.21.15.36:0/2249373109 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7524003260 con 0x7f7524003910 2022-01-10T01:24:36.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754259c700 1 --2- 172.21.15.36:0/2249373109 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7524003910 0x7f7524003d10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f753c00c000 tx=0x7f753c006df0).ready entity=mon.0 client_cookie=212d19cbab3f084 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:36.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f753c00e830 con 0x7f7524003910 2022-01-10T01:24:36.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c00e990 con 0x7f7524003910 2022-01-10T01:24:36.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754159a700 1 -- 172.21.15.36:0/2249373109 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f753c00ecf0 con 0x7f7524003910 2022-01-10T01:24:36.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754359e700 1 -- 172.21.15.36:0/2249373109 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7524003910 msgr2=0x7f7524003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754359e700 1 --2- 172.21.15.36:0/2249373109 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7524003910 0x7f7524003d10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f753c00c000 tx=0x7f753c006df0).stop 2022-01-10T01:24:36.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f7542d9d700 1 -- 172.21.15.36:0/2249373109 reap_dead start 2022-01-10T01:24:36.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754359e700 1 -- 172.21.15.36:0/2249373109 shutdown_connections 2022-01-10T01:24:36.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754359e700 1 -- 172.21.15.36:0/2249373109 >> 172.21.15.36:0/2249373109 conn(0x7f7544060180 msgr2=0x7f75440b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:36.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754359e700 1 -- 172.21.15.36:0/2249373109 shutdown_connections 2022-01-10T01:24:36.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754359e700 1 -- 172.21.15.36:0/2249373109 wait complete. 2022-01-10T01:24:36.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754359e700 1 Processor -- start 2022-01-10T01:24:36.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.216+0000 7f754359e700 1 -- start start 2022-01-10T01:24:36.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7544063580 0x7f75440653c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f754414e060 0x7f754414e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f754414e9d0 0x7f75441514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754409f3a0 con 0x7f7544063580 2022-01-10T01:24:36.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7544063960 con 0x7f754414e9d0 2022-01-10T01:24:36.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75440a07c0 con 0x7f754414e060 2022-01-10T01:24:36.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7544063580 0x7f75440653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7544063580 0x7f75440653c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34180/0 (socket says 172.21.15.36:34180) 2022-01-10T01:24:36.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754259c700 1 -- 172.21.15.36:0/3068128705 learned_addr learned my addr 172.21.15.36:0/3068128705 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:36.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f7542d9d700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f754414e9d0 0x7f75441514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f7541d9b700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f754414e060 0x7f754414e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754259c700 1 -- 172.21.15.36:0/3068128705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f754414e060 msgr2=0x7f754414e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754259c700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f754414e060 0x7f754414e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754259c700 1 -- 172.21.15.36:0/3068128705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f754414e9d0 msgr2=0x7f75441514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754259c700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f754414e9d0 0x7f75441514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754259c700 1 -- 172.21.15.36:0/3068128705 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75440a0a60 con 0x7f7544063580 2022-01-10T01:24:36.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f7542d9d700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f754414e9d0 0x7f75441514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:36.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754259c700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7544063580 0x7f75440653c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f753c00c000 tx=0x7f753c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:36.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f753b7fe700 1 -- 172.21.15.36:0/3068128705 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f753c01f070 con 0x7f7544063580 2022-01-10T01:24:36.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f753b7fe700 1 -- 172.21.15.36:0/3068128705 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753c000e90 con 0x7f7544063580 2022-01-10T01:24:36.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754359e700 1 -- 172.21.15.36:0/3068128705 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75440a0d00 con 0x7f7544063580 2022-01-10T01:24:36.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f753b7fe700 1 -- 172.21.15.36:0/3068128705 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f753c011a40 con 0x7f7544063580 2022-01-10T01:24:36.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754359e700 1 -- 172.21.15.36:0/3068128705 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7544064dc0 con 0x7f7544063580 2022-01-10T01:24:36.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f754359e700 1 -- 172.21.15.36:0/3068128705 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7544057350 con 0x7f7544063580 2022-01-10T01:24:36.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f753b7fe700 1 -- 172.21.15.36:0/3068128705 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f753c011ba0 con 0x7f7544063580 2022-01-10T01:24:36.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f753b7fe700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7528053590 0x7f7528055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f753b7fe700 1 -- 172.21.15.36:0/3068128705 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f753c06e850 con 0x7f7544063580 2022-01-10T01:24:36.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.220+0000 7f7541d9b700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7528053590 0x7f7528055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.224+0000 7f7541d9b700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7528053590 0x7f7528055a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f752c003000 tx=0x7f752c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:36.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.232+0000 7f753b7fe700 1 -- 172.21.15.36:0/3068128705 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f753c045860 con 0x7f7544063580 2022-01-10T01:24:36.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.356+0000 7f754359e700 1 -- 172.21.15.36:0/3068128705 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f754405bca0 con 0x7f7544063580 2022-01-10T01:24:36.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.360+0000 7f753b7fe700 1 -- 172.21.15.36:0/3068128705 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f753c048e80 con 0x7f7544063580 2022-01-10T01:24:36.365 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:36.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.360+0000 7f754359e700 1 -- 172.21.15.36:0/3068128705 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7528053590 msgr2=0x7f7528055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.360+0000 7f754359e700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7528053590 0x7f7528055a50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f752c003000 tx=0x7f752c009040).stop 2022-01-10T01:24:36.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.360+0000 7f754359e700 1 -- 172.21.15.36:0/3068128705 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7544063580 msgr2=0x7f75440653c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.360+0000 7f754359e700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7544063580 0x7f75440653c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f753c00c000 tx=0x7f753c019000).stop 2022-01-10T01:24:36.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.360+0000 7f754359e700 1 -- 172.21.15.36:0/3068128705 shutdown_connections 2022-01-10T01:24:36.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.360+0000 7f754359e700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7528053590 0x7f7528055a50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.360+0000 7f754359e700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f754414e9d0 0x7f75441514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.360+0000 7f754359e700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f754414e060 0x7f754414e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.360+0000 7f754359e700 1 --2- 172.21.15.36:0/3068128705 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7544063580 0x7f75440653c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.360+0000 7f754359e700 1 -- 172.21.15.36:0/3068128705 >> 172.21.15.36:0/3068128705 conn(0x7f7544060180 msgr2=0x7f7544140830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:36.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.360+0000 7f754359e700 1 -- 172.21.15.36:0/3068128705 shutdown_connections 2022-01-10T01:24:36.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.360+0000 7f754359e700 1 -- 172.21.15.36:0/3068128705 wait complete. 2022-01-10T01:24:36.378 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:24:36.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.484+0000 7f1ebf59e700 1 Processor -- start 2022-01-10T01:24:36.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.484+0000 7f1ebf59e700 1 -- start start 2022-01-10T01:24:36.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.484+0000 7f1ebf59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ec00b2ee0 0x7f1ec0065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.484+0000 7f1ebf59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec00b2a90 con 0x7f1ec014aeb0 2022-01-10T01:24:36.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.484+0000 7f1ebf59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ec00b7a90 con 0x7f1ec00b76b0 2022-01-10T01:24:36.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.484+0000 7f1ebf59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ec00616a0 con 0x7f1ec00b2ee0 2022-01-10T01:24:36.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.484+0000 7f1ebed9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f1ec014aeb0 0x7f1ec014b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60218/0 (socket says 172.21.15.36:60218) 2022-01-10T01:24:36.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.484+0000 7f1ebed9d700 1 -- 172.21.15.36:0/624698295 learned_addr learned my addr 172.21.15.36:0/624698295 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:36.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.484+0000 7f1ebdd9b700 1 --2- 172.21.15.36:0/624698295 >> v2:172.21.15.59:3300/0 conn(0x7f1ec00b2ee0 0x7f1ec0065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebd59a700 1 -- 172.21.15.36:0/624698295 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120922898 0 0) 0x7f1ec00b2a90 con 0x7f1ec014aeb0 2022-01-10T01:24:36.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebd59a700 1 -- 172.21.15.36:0/624698295 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ea0003260 con 0x7f1ec014aeb0 2022-01-10T01:24:36.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebdd9b700 1 -- 172.21.15.36:0/624698295 >> v1:172.21.15.59:6789/0 conn(0x7f1ec00b76b0 legacy=0x7f1ec0060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebdd9b700 1 -- 172.21.15.36:0/624698295 >> v1:172.21.15.36:6789/0 conn(0x7f1ec014aeb0 legacy=0x7f1ec014b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebdd9b700 1 -- 172.21.15.36:0/624698295 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00b27f0 con 0x7f1ec00b2ee0 2022-01-10T01:24:36.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebdd9b700 1 --2- 172.21.15.36:0/624698295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec00b2ee0 0x7f1ec0065590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1eb0002f70 tx=0x7f1eb0006df0).ready entity=mon.1 client_cookie=41cd591499f28785 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:36.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebd59a700 1 -- 172.21.15.36:0/624698295 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eb000d5c0 con 0x7f1ec00b2ee0 2022-01-10T01:24:36.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebd59a700 1 -- 172.21.15.36:0/624698295 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb0000e90 con 0x7f1ec00b2ee0 2022-01-10T01:24:36.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebd59a700 1 -- 172.21.15.36:0/624698295 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eb000d910 con 0x7f1ec00b2ee0 2022-01-10T01:24:36.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebf59e700 1 -- 172.21.15.36:0/624698295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec00b2ee0 msgr2=0x7f1ec0065590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebf59e700 1 --2- 172.21.15.36:0/624698295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec00b2ee0 0x7f1ec0065590 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1eb0002f70 tx=0x7f1eb0006df0).stop 2022-01-10T01:24:36.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebf59e700 1 -- 172.21.15.36:0/624698295 shutdown_connections 2022-01-10T01:24:36.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebf59e700 1 --2- 172.21.15.36:0/624698295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec00b2ee0 0x7f1ec0065590 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebf59e700 1 -- 172.21.15.36:0/624698295 >> 172.21.15.36:0/624698295 conn(0x7f1ec005f6b0 msgr2=0x7f1ec005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:36.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebf59e700 1 -- 172.21.15.36:0/624698295 shutdown_connections 2022-01-10T01:24:36.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.488+0000 7f1ebf59e700 1 -- 172.21.15.36:0/624698295 wait complete. 2022-01-10T01:24:36.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebf59e700 1 Processor -- start 2022-01-10T01:24:36.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebf59e700 1 -- start start 2022-01-10T01:24:36.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebf59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec00b2ee0 0x7f1ec00a4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebf59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ec00b76b0 0x7f1ec00ad590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebf59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ec014aeb0 0x7f1ec00ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebf59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec01566f0 con 0x7f1ec014aeb0 2022-01-10T01:24:36.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebf59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00a11e0 con 0x7f1ec00b2ee0 2022-01-10T01:24:36.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebf59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec00a13d0 con 0x7f1ec00b76b0 2022-01-10T01:24:36.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebed9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ec014aeb0 0x7f1ec00ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebed9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ec014aeb0 0x7f1ec00ada80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34198/0 (socket says 172.21.15.36:34198) 2022-01-10T01:24:36.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebed9d700 1 -- 172.21.15.36:0/432389288 learned_addr learned my addr 172.21.15.36:0/432389288 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:36.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebdd9b700 1 --2- 172.21.15.36:0/432389288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ec00b76b0 0x7f1ec00ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebe59c700 1 --2- 172.21.15.36:0/432389288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec00b2ee0 0x7f1ec00a4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebed9d700 1 -- 172.21.15.36:0/432389288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ec00b76b0 msgr2=0x7f1ec00ad590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebed9d700 1 --2- 172.21.15.36:0/432389288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ec00b76b0 0x7f1ec00ad590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebed9d700 1 -- 172.21.15.36:0/432389288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec00b2ee0 msgr2=0x7f1ec00a4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebed9d700 1 --2- 172.21.15.36:0/432389288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec00b2ee0 0x7f1ec00a4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebed9d700 1 -- 172.21.15.36:0/432389288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb000b180 con 0x7f1ec014aeb0 2022-01-10T01:24:36.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.492+0000 7f1ebed9d700 1 --2- 172.21.15.36:0/432389288 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ec014aeb0 0x7f1ec00ada80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f1eb8001490 tx=0x7f1eb8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:36.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.496+0000 7f1eb77fe700 1 -- 172.21.15.36:0/432389288 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eb8005ba0 con 0x7f1ec014aeb0 2022-01-10T01:24:36.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.496+0000 7f1eb77fe700 1 -- 172.21.15.36:0/432389288 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb8005d00 con 0x7f1ec014aeb0 2022-01-10T01:24:36.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.496+0000 7f1ebf59e700 1 -- 172.21.15.36:0/432389288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec00a1600 con 0x7f1ec014aeb0 2022-01-10T01:24:36.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.496+0000 7f1eb77fe700 1 -- 172.21.15.36:0/432389288 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eb80072c0 con 0x7f1ec014aeb0 2022-01-10T01:24:36.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.496+0000 7f1ebf59e700 1 -- 172.21.15.36:0/432389288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec00b1550 con 0x7f1ec014aeb0 2022-01-10T01:24:36.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.496+0000 7f1ebf59e700 1 -- 172.21.15.36:0/432389288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec0060850 con 0x7f1ec014aeb0 2022-01-10T01:24:36.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.496+0000 7f1eb77fe700 1 -- 172.21.15.36:0/432389288 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1eb8010070 con 0x7f1ec014aeb0 2022-01-10T01:24:36.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.496+0000 7f1eb77fe700 1 --2- 172.21.15.36:0/432389288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ea4053590 0x7f1ea4055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.496+0000 7f1eb77fe700 1 -- 172.21.15.36:0/432389288 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1eb806b390 con 0x7f1ec014aeb0 2022-01-10T01:24:36.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.496+0000 7f1ebe59c700 1 --2- 172.21.15.36:0/432389288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ea4053590 0x7f1ea4055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.496+0000 7f1ebe59c700 1 --2- 172.21.15.36:0/432389288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ea4053590 0x7f1ea4055a50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1ea800d000 tx=0x7f1ea8007b60).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:36.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.504+0000 7f1eb77fe700 1 -- 172.21.15.36:0/432389288 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1eb8042300 con 0x7f1ec014aeb0 2022-01-10T01:24:36.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.628+0000 7f1ebf59e700 1 -- 172.21.15.36:0/432389288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ec0057350 con 0x7f1ec014aeb0 2022-01-10T01:24:36.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.632+0000 7f1eb77fe700 1 -- 172.21.15.36:0/432389288 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1eb8045920 con 0x7f1ec014aeb0 2022-01-10T01:24:36.637 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:36.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.632+0000 7f1ebf59e700 1 -- 172.21.15.36:0/432389288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ea4053590 msgr2=0x7f1ea4055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.632+0000 7f1ebf59e700 1 --2- 172.21.15.36:0/432389288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ea4053590 0x7f1ea4055a50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f1ea800d000 tx=0x7f1ea8007b60).stop 2022-01-10T01:24:36.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.632+0000 7f1ebf59e700 1 -- 172.21.15.36:0/432389288 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ec014aeb0 msgr2=0x7f1ec00ada80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.632+0000 7f1ebf59e700 1 --2- 172.21.15.36:0/432389288 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ec014aeb0 0x7f1ec00ada80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f1eb8001490 tx=0x7f1eb8007e00).stop 2022-01-10T01:24:36.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.632+0000 7f1ebf59e700 1 -- 172.21.15.36:0/432389288 shutdown_connections 2022-01-10T01:24:36.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.632+0000 7f1ebf59e700 1 --2- 172.21.15.36:0/432389288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ea4053590 0x7f1ea4055a50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.632+0000 7f1ebf59e700 1 --2- 172.21.15.36:0/432389288 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ec014aeb0 0x7f1ec00ada80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.632+0000 7f1ebf59e700 1 --2- 172.21.15.36:0/432389288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ec00b76b0 0x7f1ec00ad590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.632+0000 7f1ebf59e700 1 --2- 172.21.15.36:0/432389288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ec00b2ee0 0x7f1ec00a4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.632+0000 7f1ebf59e700 1 -- 172.21.15.36:0/432389288 >> 172.21.15.36:0/432389288 conn(0x7f1ec005f6b0 msgr2=0x7f1ec005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:36.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.632+0000 7f1ebf59e700 1 -- 172.21.15.36:0/432389288 shutdown_connections 2022-01-10T01:24:36.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.636+0000 7f1ebf59e700 1 -- 172.21.15.36:0/432389288 wait complete. 2022-01-10T01:24:36.655 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:24:36.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32c493d700 1 Processor -- start 2022-01-10T01:24:36.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32c493d700 1 -- start start 2022-01-10T01:24:36.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32c493d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f32c01483a0 0x7f32c00b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32c493d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c00a70c0 0x7f32c0144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32c493d700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c00b0350 con 0x7f32c00b1db0 2022-01-10T01:24:36.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32c493d700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32c00a90c0 con 0x7f32c01483a0 2022-01-10T01:24:36.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32c493d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00b05f0 con 0x7f32c00a70c0 2022-01-10T01:24:36.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32bdd9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f32c01483a0 0x7f32c00b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32bdd9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f32c01483a0 0x7f32c00b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34204/0 (socket says 172.21.15.36:34204) 2022-01-10T01:24:36.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32bdd9b700 1 -- 172.21.15.36:0/1658483638 learned_addr learned my addr 172.21.15.36:0/1658483638 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:36.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32bdd9b700 1 -- 172.21.15.36:0/1658483638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c00a70c0 msgr2=0x7f32c0144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:36.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32bed9d700 1 --2- 172.21.15.36:0/1658483638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c00a70c0 0x7f32c0144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32bdd9b700 1 --2- 172.21.15.36:0/1658483638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c00a70c0 0x7f32c0144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32bdd9b700 1 -- 172.21.15.36:0/1658483638 >> v1:172.21.15.36:6789/0 conn(0x7f32c00b1db0 legacy=0x7f32c00b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32bdd9b700 1 -- 172.21.15.36:0/1658483638 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c00b0890 con 0x7f32c01483a0 2022-01-10T01:24:36.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32bed9d700 1 --2- 172.21.15.36:0/1658483638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c00a70c0 0x7f32c0144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:24:36.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32bdd9b700 1 --2- 172.21.15.36:0/1658483638 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32c01483a0 0x7f32c00b0fd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f32c0147730 tx=0x7f32b0006eb0).ready entity=mon.0 client_cookie=5b88403b2e426830 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:36.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32bd59a700 1 -- 172.21.15.36:0/1658483638 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32b000d5c0 con 0x7f32c01483a0 2022-01-10T01:24:36.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32bd59a700 1 -- 172.21.15.36:0/1658483638 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b0000e90 con 0x7f32c01483a0 2022-01-10T01:24:36.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32bd59a700 1 -- 172.21.15.36:0/1658483638 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32b000d950 con 0x7f32c01483a0 2022-01-10T01:24:36.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32c493d700 1 -- 172.21.15.36:0/1658483638 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32c01483a0 msgr2=0x7f32c00b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32c493d700 1 --2- 172.21.15.36:0/1658483638 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32c01483a0 0x7f32c00b0fd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f32c0147730 tx=0x7f32b0006eb0).stop 2022-01-10T01:24:36.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32c493d700 1 -- 172.21.15.36:0/1658483638 shutdown_connections 2022-01-10T01:24:36.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32c493d700 1 --2- 172.21.15.36:0/1658483638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c00a70c0 0x7f32c0144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32c493d700 1 --2- 172.21.15.36:0/1658483638 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32c01483a0 0x7f32c00b0fd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.752+0000 7f32c493d700 1 -- 172.21.15.36:0/1658483638 >> 172.21.15.36:0/1658483638 conn(0x7f32c005f6b0 msgr2=0x7f32c005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:36.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32c493d700 1 -- 172.21.15.36:0/1658483638 shutdown_connections 2022-01-10T01:24:36.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32c493d700 1 -- 172.21.15.36:0/1658483638 wait complete. 2022-01-10T01:24:36.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32c493d700 1 Processor -- start 2022-01-10T01:24:36.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32c493d700 1 -- start start 2022-01-10T01:24:36.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32c493d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32c00a70c0 0x7f32c0141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32c493d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c00b1db0 0x7f32c00ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32c493d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c01483a0 0x7f32c014b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32c493d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00a7fa0 con 0x7f32c00a70c0 2022-01-10T01:24:36.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32c493d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c0148ac0 con 0x7f32c01483a0 2022-01-10T01:24:36.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32c493d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c00ad910 con 0x7f32c00b1db0 2022-01-10T01:24:36.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32be59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32c00a70c0 0x7f32c0141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32be59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32c00a70c0 0x7f32c0141230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34208/0 (socket says 172.21.15.36:34208) 2022-01-10T01:24:36.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32be59c700 1 -- 172.21.15.36:0/241696965 learned_addr learned my addr 172.21.15.36:0/241696965 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:36.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32bdd9b700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c00b1db0 0x7f32c00ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32bed9d700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c01483a0 0x7f32c014b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32be59c700 1 -- 172.21.15.36:0/241696965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c00b1db0 msgr2=0x7f32c00ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32be59c700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c00b1db0 0x7f32c00ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32be59c700 1 -- 172.21.15.36:0/241696965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c01483a0 msgr2=0x7f32c014b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32be59c700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c01483a0 0x7f32c014b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32be59c700 1 -- 172.21.15.36:0/241696965 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b000b1e0 con 0x7f32c00a70c0 2022-01-10T01:24:36.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32bdd9b700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c00b1db0 0x7f32c00ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:24:36.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32bed9d700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c01483a0 0x7f32c014b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:24:36.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32be59c700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32c00a70c0 0x7f32c0141230 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f32c00b3170 tx=0x7f32a8007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:36.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32b77fe700 1 -- 172.21.15.36:0/241696965 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32a800ce30 con 0x7f32c00a70c0 2022-01-10T01:24:36.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32b77fe700 1 -- 172.21.15.36:0/241696965 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a800f470 con 0x7f32c00a70c0 2022-01-10T01:24:36.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32b77fe700 1 -- 172.21.15.36:0/241696965 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32a800f7d0 con 0x7f32c00a70c0 2022-01-10T01:24:36.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32c493d700 1 -- 172.21.15.36:0/241696965 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c0141720 con 0x7f32c00a70c0 2022-01-10T01:24:36.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.756+0000 7f32c493d700 1 -- 172.21.15.36:0/241696965 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c00adb70 con 0x7f32c00a70c0 2022-01-10T01:24:36.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.760+0000 7f32c493d700 1 -- 172.21.15.36:0/241696965 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c00ae010 con 0x7f32c00a70c0 2022-01-10T01:24:36.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.760+0000 7f32b77fe700 1 -- 172.21.15.36:0/241696965 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f32a8019030 con 0x7f32c00a70c0 2022-01-10T01:24:36.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.760+0000 7f32b77fe700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3298053560 0x7f3298055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:36.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.760+0000 7f32bdd9b700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3298053560 0x7f3298055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:36.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.760+0000 7f32b77fe700 1 -- 172.21.15.36:0/241696965 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f32a806aee0 con 0x7f32c00a70c0 2022-01-10T01:24:36.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.760+0000 7f32bdd9b700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3298053560 0x7f3298055a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f32b0016000 tx=0x7f32b0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:36.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.768+0000 7f32b77fe700 1 -- 172.21.15.36:0/241696965 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f32a8041e90 con 0x7f32c00a70c0 2022-01-10T01:24:36.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.928+0000 7f32c493d700 1 -- 172.21.15.36:0/241696965 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32c0057350 con 0x7f32c00a70c0 2022-01-10T01:24:36.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.928+0000 7f32b77fe700 1 -- 172.21.15.36:0/241696965 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7f32a80454b0 con 0x7f32c00a70c0 2022-01-10T01:24:36.934 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:36.934 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3870348387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3870348387},{"type":"v1","addr":"172.21.15.59:6833","nonce":3870348387}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2808909651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2808909651},{"type":"v1","addr":"172.21.15.36:6835","nonce":2808909651}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:24:25.225258+0000","modified":"2022-01-10T01:24:26.981594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/1089668836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1089668836},{"type":"v1","addr":"172.21.15.36:6837","nonce":1089668836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-01-10T01:24:36.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.928+0000 7f32c493d700 1 -- 172.21.15.36:0/241696965 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3298053560 msgr2=0x7f3298055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.928+0000 7f32c493d700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3298053560 0x7f3298055a20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f32b0016000 tx=0x7f32b0015000).stop 2022-01-10T01:24:36.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.928+0000 7f32c493d700 1 -- 172.21.15.36:0/241696965 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32c00a70c0 msgr2=0x7f32c0141230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:36.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.928+0000 7f32c493d700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32c00a70c0 0x7f32c0141230 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f32c00b3170 tx=0x7f32a8007c50).stop 2022-01-10T01:24:36.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.928+0000 7f32c493d700 1 -- 172.21.15.36:0/241696965 shutdown_connections 2022-01-10T01:24:36.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.928+0000 7f32c493d700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3298053560 0x7f3298055a20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.928+0000 7f32c493d700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32c01483a0 0x7f32c014b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.928+0000 7f32c493d700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32c00b1db0 0x7f32c00ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.928+0000 7f32c493d700 1 --2- 172.21.15.36:0/241696965 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32c00a70c0 0x7f32c0141230 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:36.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.928+0000 7f32c493d700 1 -- 172.21.15.36:0/241696965 >> 172.21.15.36:0/241696965 conn(0x7f32c005f6b0 msgr2=0x7f32c00b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:36.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.928+0000 7f32c493d700 1 -- 172.21.15.36:0/241696965 shutdown_connections 2022-01-10T01:24:36.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:36.928+0000 7f32c493d700 1 -- 172.21.15.36:0/241696965 wait complete. 2022-01-10T01:24:36.939 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 7 2022-01-10T01:24:37.249 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:24:25.225258+0000', 'modified': '2022-01-10T01:24:26.981594+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'c', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6837/1089668836', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6836', 'nonce': 1089668836}, {'type': 'v1', 'addr': '172.21.15.36:6837', 'nonce': 1089668836}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:24:37.250 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:24:37.250 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2022-01-10T01:24:37.367 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":4284,"want_state":"up:active","state":"up:active","rank_uptime":12.129484616999999,"mdsmap_epoch":7,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":18.483332880999999} 2022-01-10T01:24:37.368 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 4284, "mdsmap_epoch": 7, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 12.129484617, "state": "up:active", "uptime": 18.483332881, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:24:37.369 INFO:teuthology.run_tasks:Running task ceph-fuse... 2022-01-10T01:24:37.386 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2022-01-10T01:24:37.386 INFO:tasks.ceph_fuse:config is None 2022-01-10T01:24:37.387 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None} 2022-01-10T01:24:37.387 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2022-01-10T01:24:37.388 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:37.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 Processor -- start 2022-01-10T01:24:37.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 -- start start 2022-01-10T01:24:37.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbfac0b6580 0x7fbfac0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbfac0b43c0 0x7fbfac0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfac1440b0 con 0x7fbfac061d30 2022-01-10T01:24:37.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac0b6e50 con 0x7fbfac0b6580 2022-01-10T01:24:37.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac143b70 con 0x7fbfac0b43c0 2022-01-10T01:24:37.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfaa59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbfac0b6580 0x7fbfac0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfaa59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbfac0b6580 0x7fbfac0b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34216/0 (socket says 172.21.15.36:34216) 2022-01-10T01:24:37.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfaa59c700 1 -- 172.21.15.36:0/3966972552 learned_addr learned my addr 172.21.15.36:0/3966972552 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:37.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfa9d9b700 1 --2- 172.21.15.36:0/3966972552 >> v2:172.21.15.59:3300/0 conn(0x7fbfac0b43c0 0x7fbfac0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfaa59c700 1 -- 172.21.15.36:0/3966972552 >> v2:172.21.15.59:3300/0 conn(0x7fbfac0b43c0 msgr2=0x7fbfac0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:37.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfaa59c700 1 --2- 172.21.15.36:0/3966972552 >> v2:172.21.15.59:3300/0 conn(0x7fbfac0b43c0 0x7fbfac0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfaa59c700 1 -- 172.21.15.36:0/3966972552 >> v1:172.21.15.36:6789/0 conn(0x7fbfac061d30 legacy=0x7fbfac1466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:37.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfaa59c700 1 -- 172.21.15.36:0/3966972552 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac143e10 con 0x7fbfac0b6580 2022-01-10T01:24:37.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfaa59c700 1 --2- 172.21.15.36:0/3966972552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfac0b6580 0x7fbfac0b5bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fbfac143120 tx=0x7fbf94009290).ready entity=mon.0 client_cookie=b1b8cb85ef932a39 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:37.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfa959a700 1 -- 172.21.15.36:0/3966972552 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf9400b860 con 0x7fbfac0b6580 2022-01-10T01:24:37.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfa959a700 1 -- 172.21.15.36:0/3966972552 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9400b9c0 con 0x7fbfac0b6580 2022-01-10T01:24:37.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfa959a700 1 -- 172.21.15.36:0/3966972552 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf9400bb30 con 0x7fbfac0b6580 2022-01-10T01:24:37.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/3966972552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfac0b6580 msgr2=0x7fbfac0b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:37.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 --2- 172.21.15.36:0/3966972552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfac0b6580 0x7fbfac0b5bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fbfac143120 tx=0x7fbf94009290).stop 2022-01-10T01:24:37.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/3966972552 shutdown_connections 2022-01-10T01:24:37.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 --2- 172.21.15.36:0/3966972552 >> v2:172.21.15.59:3300/0 conn(0x7fbfac0b43c0 0x7fbfac0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 --2- 172.21.15.36:0/3966972552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfac0b6580 0x7fbfac0b5bf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/3966972552 >> 172.21.15.36:0/3966972552 conn(0x7fbfac05c490 msgr2=0x7fbfac05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:37.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/3966972552 shutdown_connections 2022-01-10T01:24:37.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.488+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/3966972552 wait complete. 2022-01-10T01:24:37.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfb0fd9700 1 Processor -- start 2022-01-10T01:24:37.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfb0fd9700 1 -- start start 2022-01-10T01:24:37.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfb0fd9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac061d30 0x7fbfac0b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfb0fd9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfac0b43c0 0x7fbfac126740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfb0fd9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfac0b6580 0x7fbfac0b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfb0fd9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0ae110 con 0x7fbfac0b43c0 2022-01-10T01:24:37.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfb0fd9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0b1e80 con 0x7fbfac0b6580 2022-01-10T01:24:37.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfb0fd9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0b2ea0 con 0x7fbfac061d30 2022-01-10T01:24:37.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfa9d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfac0b43c0 0x7fbfac126740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfa9d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfac0b43c0 0x7fbfac126740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34224/0 (socket says 172.21.15.36:34224) 2022-01-10T01:24:37.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfa9d9b700 1 -- 172.21.15.36:0/2583697818 learned_addr learned my addr 172.21.15.36:0/2583697818 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:37.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfaa59c700 1 --2- 172.21.15.36:0/2583697818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac061d30 0x7fbfac0b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfaad9d700 1 --2- 172.21.15.36:0/2583697818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfac0b6580 0x7fbfac0b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfa9d9b700 1 -- 172.21.15.36:0/2583697818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac061d30 msgr2=0x7fbfac0b0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:37.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfa9d9b700 1 --2- 172.21.15.36:0/2583697818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac061d30 0x7fbfac0b0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfa9d9b700 1 -- 172.21.15.36:0/2583697818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfac0b6580 msgr2=0x7fbfac0b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:37.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfa9d9b700 1 --2- 172.21.15.36:0/2583697818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfac0b6580 0x7fbfac0b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfa9d9b700 1 -- 172.21.15.36:0/2583697818 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf94009530 con 0x7fbfac0b43c0 2022-01-10T01:24:37.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfa9d9b700 1 --2- 172.21.15.36:0/2583697818 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfac0b43c0 0x7fbfac126740 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fbf9c00a000 tx=0x7fbf9c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:37.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfa37fe700 1 -- 172.21.15.36:0/2583697818 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf9c011780 con 0x7fbfac0b43c0 2022-01-10T01:24:37.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfa37fe700 1 -- 172.21.15.36:0/2583697818 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c0118e0 con 0x7fbfac0b43c0 2022-01-10T01:24:37.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/2583697818 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac0af220 con 0x7fbfac0b43c0 2022-01-10T01:24:37.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfa37fe700 1 -- 172.21.15.36:0/2583697818 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf9c011c40 con 0x7fbfac0b43c0 2022-01-10T01:24:37.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.492+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/2583697818 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac147b80 con 0x7fbfac0b43c0 2022-01-10T01:24:37.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.496+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/2583697818 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac0615f0 con 0x7fbfac0b43c0 2022-01-10T01:24:37.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.496+0000 7fbfa37fe700 1 -- 172.21.15.36:0/2583697818 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbf9c01c460 con 0x7fbfac0b43c0 2022-01-10T01:24:37.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.496+0000 7fbfa37fe700 1 --2- 172.21.15.36:0/2583697818 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf84053680 0x7fbf84055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.496+0000 7fbfa37fe700 1 -- 172.21.15.36:0/2583697818 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fbf9c06be50 con 0x7fbfac0b43c0 2022-01-10T01:24:37.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.496+0000 7fbfaa59c700 1 --2- 172.21.15.36:0/2583697818 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf84053680 0x7fbf84055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.496+0000 7fbfaa59c700 1 --2- 172.21.15.36:0/2583697818 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf84053680 0x7fbf84055b40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fbf9401b000 tx=0x7fbf94016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:37.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.504+0000 7fbfa37fe700 1 -- 172.21.15.36:0/2583697818 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbf9c042cf0 con 0x7fbfac0b43c0 2022-01-10T01:24:37.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.632+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/2583697818 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfac0af3b0 con 0x7fbfac0b43c0 2022-01-10T01:24:37.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.636+0000 7fbfa37fe700 1 -- 172.21.15.36:0/2583697818 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fbf9c046310 con 0x7fbfac0b43c0 2022-01-10T01:24:37.643 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:37.643 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:25.224959+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:24:20.202898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-10T01:24:22.952870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:37.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.640+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/2583697818 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf84053680 msgr2=0x7fbf84055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:37.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.640+0000 7fbfb0fd9700 1 --2- 172.21.15.36:0/2583697818 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf84053680 0x7fbf84055b40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fbf9401b000 tx=0x7fbf94016000).stop 2022-01-10T01:24:37.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.640+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/2583697818 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfac0b43c0 msgr2=0x7fbfac126740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:37.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.640+0000 7fbfb0fd9700 1 --2- 172.21.15.36:0/2583697818 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfac0b43c0 0x7fbfac126740 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fbf9c00a000 tx=0x7fbf9c008040).stop 2022-01-10T01:24:37.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.640+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/2583697818 shutdown_connections 2022-01-10T01:24:37.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.640+0000 7fbfb0fd9700 1 --2- 172.21.15.36:0/2583697818 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf84053680 0x7fbf84055b40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.640+0000 7fbfb0fd9700 1 --2- 172.21.15.36:0/2583697818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfac0b6580 0x7fbfac0b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.640+0000 7fbfb0fd9700 1 --2- 172.21.15.36:0/2583697818 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfac0b43c0 0x7fbfac126740 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.640+0000 7fbfb0fd9700 1 --2- 172.21.15.36:0/2583697818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfac061d30 0x7fbfac0b0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.640+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/2583697818 >> 172.21.15.36:0/2583697818 conn(0x7fbfac05c490 msgr2=0x7fbfac126f20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:37.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.640+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/2583697818 shutdown_connections 2022-01-10T01:24:37.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.640+0000 7fbfb0fd9700 1 -- 172.21.15.36:0/2583697818 wait complete. 2022-01-10T01:24:37.661 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:24:20.202898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:24:22.952870+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:24:37.662 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:24:37.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.764+0000 7fcf92c62700 1 Processor -- start 2022-01-10T01:24:37.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.764+0000 7fcf92c62700 1 -- start start 2022-01-10T01:24:37.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.764+0000 7fcf92c62700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf8c0b4180 0x7fcf8c140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.764+0000 7fcf92c62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf8c0b4690 0x7fcf8c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.764+0000 7fcf92c62700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf8c143b60 con 0x7fcf8c146950 2022-01-10T01:24:37.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.764+0000 7fcf92c62700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8c147510 con 0x7fcf8c0b4180 2022-01-10T01:24:37.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.764+0000 7fcf92c62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c143e00 con 0x7fcf8c0b4690 2022-01-10T01:24:37.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.764+0000 7fcf909fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fcf8c146950 0x7fcf8c140230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60256/0 (socket says 172.21.15.36:60256) 2022-01-10T01:24:37.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.764+0000 7fcf909fe700 1 -- 172.21.15.36:0/4206741017 learned_addr learned my addr 172.21.15.36:0/4206741017 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:37.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.764+0000 7fcf8bfff700 1 --2- 172.21.15.36:0/4206741017 >> v2:172.21.15.59:3300/0 conn(0x7fcf8c0b4180 0x7fcf8c140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.764+0000 7fcf911ff700 1 --2- 172.21.15.36:0/4206741017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf8c0b4690 0x7fcf8c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.764+0000 7fcf8b7fe700 1 -- 172.21.15.36:0/4206741017 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1479588256 0 0) 0x7fcf8c143b60 con 0x7fcf8c146950 2022-01-10T01:24:37.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.764+0000 7fcf8b7fe700 1 -- 172.21.15.36:0/4206741017 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf6c003260 con 0x7fcf8c146950 2022-01-10T01:24:37.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 -- 172.21.15.36:0/4206741017 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3724203695 0 0) 0x7fcf6c003260 con 0x7fcf8c146950 2022-01-10T01:24:37.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 -- 172.21.15.36:0/4206741017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf8c0b4690 msgr2=0x7fcf8c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:37.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 --2- 172.21.15.36:0/4206741017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf8c0b4690 0x7fcf8c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 -- 172.21.15.36:0/4206741017 >> v2:172.21.15.59:3300/0 conn(0x7fcf8c0b4180 msgr2=0x7fcf8c140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:37.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 --2- 172.21.15.36:0/4206741017 >> v2:172.21.15.59:3300/0 conn(0x7fcf8c0b4180 0x7fcf8c140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 -- 172.21.15.36:0/4206741017 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c0b0c90 con 0x7fcf8c146950 2022-01-10T01:24:37.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 -- 172.21.15.36:0/4206741017 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fcf7c0019e0 con 0x7fcf8c146950 2022-01-10T01:24:37.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 -- 172.21.15.36:0/4206741017 >> v1:172.21.15.36:6789/0 conn(0x7fcf8c146950 legacy=0x7fcf8c140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:37.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 --2- 172.21.15.36:0/4206741017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf8c0b4690 0x7fcf6c003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 --2- 172.21.15.36:0/4206741017 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf6c003c40 0x7fcf6c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 --2- 172.21.15.36:0/4206741017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6c0049f0 0x7fcf6c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 -- 172.21.15.36:0/4206741017 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c147510 con 0x7fcf6c003c40 2022-01-10T01:24:37.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 -- 172.21.15.36:0/4206741017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c143e00 con 0x7fcf6c0049f0 2022-01-10T01:24:37.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 -- 172.21.15.36:0/4206741017 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c00b750 con 0x7fcf8c0b4690 2022-01-10T01:24:37.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8bfff700 1 --2- 172.21.15.36:0/4206741017 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf6c003c40 0x7fcf6c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf909fe700 1 --2- 172.21.15.36:0/4206741017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf8c0b4690 0x7fcf6c003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf911ff700 1 --2- 172.21.15.36:0/4206741017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6c0049f0 0x7fcf6c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8bfff700 1 -- 172.21.15.36:0/4206741017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf8c0b4690 msgr2=0x7fcf6c003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:37.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8bfff700 1 --2- 172.21.15.36:0/4206741017 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf8c0b4690 0x7fcf6c003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8bfff700 1 -- 172.21.15.36:0/4206741017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6c0049f0 msgr2=0x7fcf6c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:37.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8bfff700 1 --2- 172.21.15.36:0/4206741017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf6c0049f0 0x7fcf6c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8bfff700 1 -- 172.21.15.36:0/4206741017 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c003260 con 0x7fcf6c003c40 2022-01-10T01:24:37.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8bfff700 1 --2- 172.21.15.36:0/4206741017 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf6c003c40 0x7fcf6c004500 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fcf7400c000 tx=0x7fcf74006df0).ready entity=mon.0 client_cookie=89bd62ac3a3ee28c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:37.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 -- 172.21.15.36:0/4206741017 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf7400e800 con 0x7fcf6c003c40 2022-01-10T01:24:37.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 -- 172.21.15.36:0/4206741017 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7400e960 con 0x7fcf6c003c40 2022-01-10T01:24:37.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf8b7fe700 1 -- 172.21.15.36:0/4206741017 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf7400ecc0 con 0x7fcf6c003c40 2022-01-10T01:24:37.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf92c62700 1 -- 172.21.15.36:0/4206741017 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf6c003c40 msgr2=0x7fcf6c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:37.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf92c62700 1 --2- 172.21.15.36:0/4206741017 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf6c003c40 0x7fcf6c004500 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fcf7400c000 tx=0x7fcf74006df0).stop 2022-01-10T01:24:37.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf911ff700 1 -- 172.21.15.36:0/4206741017 reap_dead start 2022-01-10T01:24:37.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf92c62700 1 -- 172.21.15.36:0/4206741017 shutdown_connections 2022-01-10T01:24:37.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf92c62700 1 -- 172.21.15.36:0/4206741017 >> 172.21.15.36:0/4206741017 conn(0x7fcf8c05c490 msgr2=0x7fcf8c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:37.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf92c62700 1 -- 172.21.15.36:0/4206741017 shutdown_connections 2022-01-10T01:24:37.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.768+0000 7fcf92c62700 1 -- 172.21.15.36:0/4206741017 wait complete. 2022-01-10T01:24:37.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf92c62700 1 Processor -- start 2022-01-10T01:24:37.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf92c62700 1 -- start start 2022-01-10T01:24:37.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf92c62700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf6c003c40 0x7fcf8c13c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf92c62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c13d080 0x7fcf8c0b79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf92c62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf8c0b7ed0 0x7fcf8c140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf92c62700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c1495d0 con 0x7fcf6c003c40 2022-01-10T01:24:37.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf92c62700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c0b77e0 con 0x7fcf8c13d080 2022-01-10T01:24:37.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf92c62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c13bec0 con 0x7fcf8c0b7ed0 2022-01-10T01:24:37.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf909fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf6c003c40 0x7fcf8c13c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf909fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf6c003c40 0x7fcf8c13c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34242/0 (socket says 172.21.15.36:34242) 2022-01-10T01:24:37.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf909fe700 1 -- 172.21.15.36:0/589550371 learned_addr learned my addr 172.21.15.36:0/589550371 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:37.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf8bfff700 1 --2- 172.21.15.36:0/589550371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c13d080 0x7fcf8c0b79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf911ff700 1 --2- 172.21.15.36:0/589550371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf8c0b7ed0 0x7fcf8c140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf909fe700 1 -- 172.21.15.36:0/589550371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf8c0b7ed0 msgr2=0x7fcf8c140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:37.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf909fe700 1 --2- 172.21.15.36:0/589550371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf8c0b7ed0 0x7fcf8c140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf909fe700 1 -- 172.21.15.36:0/589550371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c13d080 msgr2=0x7fcf8c0b79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:37.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf909fe700 1 --2- 172.21.15.36:0/589550371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c13d080 0x7fcf8c0b79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf909fe700 1 -- 172.21.15.36:0/589550371 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c0b7540 con 0x7fcf6c003c40 2022-01-10T01:24:37.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf909fe700 1 --2- 172.21.15.36:0/589550371 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf6c003c40 0x7fcf8c13c800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fcf8c149710 tx=0x7fcf7c008e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:37.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf89ffb700 1 -- 172.21.15.36:0/589550371 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf7c00fda0 con 0x7fcf6c003c40 2022-01-10T01:24:37.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf89ffb700 1 -- 172.21.15.36:0/589550371 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c015430 con 0x7fcf6c003c40 2022-01-10T01:24:37.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf92c62700 1 -- 172.21.15.36:0/589550371 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8c148e90 con 0x7fcf6c003c40 2022-01-10T01:24:37.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf89ffb700 1 -- 172.21.15.36:0/589550371 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf7c015790 con 0x7fcf6c003c40 2022-01-10T01:24:37.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.772+0000 7fcf92c62700 1 -- 172.21.15.36:0/589550371 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8c0b8380 con 0x7fcf6c003c40 2022-01-10T01:24:37.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.776+0000 7fcf92c62700 1 -- 172.21.15.36:0/589550371 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8c057350 con 0x7fcf6c003c40 2022-01-10T01:24:37.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.776+0000 7fcf89ffb700 1 -- 172.21.15.36:0/589550371 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fcf7c0158f0 con 0x7fcf6c003c40 2022-01-10T01:24:37.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.776+0000 7fcf89ffb700 1 --2- 172.21.15.36:0/589550371 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf700535f0 0x7fcf70055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:37.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.776+0000 7fcf89ffb700 1 -- 172.21.15.36:0/589550371 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fcf7c06c920 con 0x7fcf6c003c40 2022-01-10T01:24:37.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.776+0000 7fcf8bfff700 1 --2- 172.21.15.36:0/589550371 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf700535f0 0x7fcf70055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:37.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.776+0000 7fcf8bfff700 1 --2- 172.21.15.36:0/589550371 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf700535f0 0x7fcf70055ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fcf7401e000 tx=0x7fcf74019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:37.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.784+0000 7fcf89ffb700 1 -- 172.21.15.36:0/589550371 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf7c043820 con 0x7fcf6c003c40 2022-01-10T01:24:37.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.908+0000 7fcf92c62700 1 -- 172.21.15.36:0/589550371 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcf8c0698e0 con 0x7fcf6c003c40 2022-01-10T01:24:37.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.908+0000 7fcf89ffb700 1 -- 172.21.15.36:0/589550371 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcf7c046e40 con 0x7fcf6c003c40 2022-01-10T01:24:37.915 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:24:37.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.908+0000 7fcf92c62700 1 -- 172.21.15.36:0/589550371 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf700535f0 msgr2=0x7fcf70055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:37.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.908+0000 7fcf92c62700 1 --2- 172.21.15.36:0/589550371 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf700535f0 0x7fcf70055ab0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fcf7401e000 tx=0x7fcf74019000).stop 2022-01-10T01:24:37.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.908+0000 7fcf92c62700 1 -- 172.21.15.36:0/589550371 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf6c003c40 msgr2=0x7fcf8c13c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:37.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.908+0000 7fcf92c62700 1 --2- 172.21.15.36:0/589550371 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf6c003c40 0x7fcf8c13c800 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fcf8c149710 tx=0x7fcf7c008e20).stop 2022-01-10T01:24:37.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.912+0000 7fcf92c62700 1 -- 172.21.15.36:0/589550371 shutdown_connections 2022-01-10T01:24:37.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.912+0000 7fcf92c62700 1 --2- 172.21.15.36:0/589550371 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf700535f0 0x7fcf70055ab0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.912+0000 7fcf92c62700 1 --2- 172.21.15.36:0/589550371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf8c0b7ed0 0x7fcf8c140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.912+0000 7fcf92c62700 1 --2- 172.21.15.36:0/589550371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c13d080 0x7fcf8c0b79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.912+0000 7fcf92c62700 1 --2- 172.21.15.36:0/589550371 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf6c003c40 0x7fcf8c13c800 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:37.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.912+0000 7fcf92c62700 1 -- 172.21.15.36:0/589550371 >> 172.21.15.36:0/589550371 conn(0x7fcf8c05c490 msgr2=0x7fcf8c0b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:37.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.912+0000 7fcf92c62700 1 -- 172.21.15.36:0/589550371 shutdown_connections 2022-01-10T01:24:37.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:37.912+0000 7fcf92c62700 1 -- 172.21.15.36:0/589550371 wait complete. 2022-01-10T01:24:37.927 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:24:38.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.028+0000 7ff2bfdb0700 1 Processor -- start 2022-01-10T01:24:38.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.028+0000 7ff2bfdb0700 1 -- start start 2022-01-10T01:24:38.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.028+0000 7ff2bfdb0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2b80aff10 0x7ff2b805f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.028+0000 7ff2bfdb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2b80ac9b0 0x7ff2b814af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.028+0000 7ff2bfdb0700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b8061360 con 0x7ff2b814ab80 2022-01-10T01:24:38.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.028+0000 7ff2bfdb0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b814b5e0 con 0x7ff2b80aff10 2022-01-10T01:24:38.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.028+0000 7ff2bfdb0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b814b880 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.028+0000 7ff2bdb4c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff2b814ab80 0x7ff2b80af1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60276/0 (socket says 172.21.15.36:60276) 2022-01-10T01:24:38.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.028+0000 7ff2bdb4c700 1 -- 172.21.15.36:0/2881889449 learned_addr learned my addr 172.21.15.36:0/2881889449 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:38.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.028+0000 7ff2be34d700 1 --2- 172.21.15.36:0/2881889449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2b80ac9b0 0x7ff2b814af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.028+0000 7ff2bd34b700 1 --2- 172.21.15.36:0/2881889449 >> v2:172.21.15.59:3300/0 conn(0x7ff2b80aff10 0x7ff2b805f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.028+0000 7ff2bcb4a700 1 -- 172.21.15.36:0/2881889449 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518785269 0 0) 0x7ff2b8061360 con 0x7ff2b814ab80 2022-01-10T01:24:38.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.028+0000 7ff2bcb4a700 1 -- 172.21.15.36:0/2881889449 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2a4003260 con 0x7ff2b814ab80 2022-01-10T01:24:38.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2be34d700 1 -- 172.21.15.36:0/2881889449 >> v2:172.21.15.59:3300/0 conn(0x7ff2b80aff10 msgr2=0x7ff2b805f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:38.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2be34d700 1 --2- 172.21.15.36:0/2881889449 >> v2:172.21.15.59:3300/0 conn(0x7ff2b80aff10 0x7ff2b805f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2be34d700 1 -- 172.21.15.36:0/2881889449 >> v1:172.21.15.36:6789/0 conn(0x7ff2b814ab80 legacy=0x7ff2b80af1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2be34d700 1 -- 172.21.15.36:0/2881889449 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b80aed20 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2bd34b700 1 --2- 172.21.15.36:0/2881889449 >> v2:172.21.15.59:3300/0 conn(0x7ff2b80aff10 0x7ff2b805f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:38.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2be34d700 1 --2- 172.21.15.36:0/2881889449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2b80ac9b0 0x7ff2b814af60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff2b00032f0 tx=0x7ff2b00091d0).ready entity=mon.2 client_cookie=bf9d90f184ba8db2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:38.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2bcb4a700 1 -- 172.21.15.36:0/2881889449 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2b000b600 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2bcb4a700 1 -- 172.21.15.36:0/2881889449 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b000b760 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2bcb4a700 1 -- 172.21.15.36:0/2881889449 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2b000b8d0 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/2881889449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2b80ac9b0 msgr2=0x7ff2b814af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2bfdb0700 1 --2- 172.21.15.36:0/2881889449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2b80ac9b0 0x7ff2b814af60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff2b00032f0 tx=0x7ff2b00091d0).stop 2022-01-10T01:24:38.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/2881889449 shutdown_connections 2022-01-10T01:24:38.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2bfdb0700 1 --2- 172.21.15.36:0/2881889449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2b80ac9b0 0x7ff2b814af60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2bfdb0700 1 --2- 172.21.15.36:0/2881889449 >> v2:172.21.15.59:3300/0 conn(0x7ff2b80aff10 0x7ff2b805f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/2881889449 >> 172.21.15.36:0/2881889449 conn(0x7ff2b80b5570 msgr2=0x7ff2b80b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:38.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/2881889449 shutdown_connections 2022-01-10T01:24:38.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/2881889449 wait complete. 2022-01-10T01:24:38.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2bfdb0700 1 Processor -- start 2022-01-10T01:24:38.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.032+0000 7ff2bfdb0700 1 -- start start 2022-01-10T01:24:38.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bfdb0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2b80ac9b0 0x7ff2b8141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bfdb0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2b80aff10 0x7ff2b813df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bfdb0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2b814ab80 0x7ff2b8146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bfdb0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b80b4bd0 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bfdb0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b8145800 con 0x7ff2b814ab80 2022-01-10T01:24:38.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bfdb0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b813eab0 con 0x7ff2b80aff10 2022-01-10T01:24:38.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bdb4c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2b80ac9b0 0x7ff2b8141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bdb4c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2b80ac9b0 0x7ff2b8141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34258/0 (socket says 172.21.15.36:34258) 2022-01-10T01:24:38.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bdb4c700 1 -- 172.21.15.36:0/3430109493 learned_addr learned my addr 172.21.15.36:0/3430109493 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:38.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bd34b700 1 --2- 172.21.15.36:0/3430109493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2b80aff10 0x7ff2b813df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2be34d700 1 --2- 172.21.15.36:0/3430109493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2b814ab80 0x7ff2b8146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bdb4c700 1 -- 172.21.15.36:0/3430109493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2b80aff10 msgr2=0x7ff2b813df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bdb4c700 1 --2- 172.21.15.36:0/3430109493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2b80aff10 0x7ff2b813df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bdb4c700 1 -- 172.21.15.36:0/3430109493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2b814ab80 msgr2=0x7ff2b8146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bdb4c700 1 --2- 172.21.15.36:0/3430109493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2b814ab80 0x7ff2b8146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bdb4c700 1 -- 172.21.15.36:0/3430109493 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a800b180 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bdb4c700 1 --2- 172.21.15.36:0/3430109493 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2b80ac9b0 0x7ff2b8141e20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff2ac001110 tx=0x7ff2ac007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:38.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2b6ffd700 1 -- 172.21.15.36:0/3430109493 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2ac00cdd0 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/3430109493 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b0009470 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2b6ffd700 1 -- 172.21.15.36:0/3430109493 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac0070d0 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2b6ffd700 1 -- 172.21.15.36:0/3430109493 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2ac007430 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/3430109493 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b8145560 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.036+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/3430109493 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b80b46d0 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.040+0000 7ff2b6ffd700 1 -- 172.21.15.36:0/3430109493 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff2ac01a070 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.040+0000 7ff2b6ffd700 1 --2- 172.21.15.36:0/3430109493 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff298053560 0x7ff298055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.040+0000 7ff2b6ffd700 1 -- 172.21.15.36:0/3430109493 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff2ac06ac50 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.040+0000 7ff2bd34b700 1 --2- 172.21.15.36:0/3430109493 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff298053560 0x7ff298055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.040+0000 7ff2bd34b700 1 --2- 172.21.15.36:0/3430109493 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff298053560 0x7ff298055a20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff2a800b000 tx=0x7ff2a8006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:38.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.044+0000 7ff2b6ffd700 1 -- 172.21.15.36:0/3430109493 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2ac041bc0 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.168+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/3430109493 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff2b80af8d0 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.168+0000 7ff2b6ffd700 1 -- 172.21.15.36:0/3430109493 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff2ac0451e0 con 0x7ff2b80ac9b0 2022-01-10T01:24:38.175 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:38.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.172+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/3430109493 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff298053560 msgr2=0x7ff298055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.172+0000 7ff2bfdb0700 1 --2- 172.21.15.36:0/3430109493 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff298053560 0x7ff298055a20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff2a800b000 tx=0x7ff2a8006df0).stop 2022-01-10T01:24:38.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.172+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/3430109493 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2b80ac9b0 msgr2=0x7ff2b8141e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.172+0000 7ff2bfdb0700 1 --2- 172.21.15.36:0/3430109493 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2b80ac9b0 0x7ff2b8141e20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff2ac001110 tx=0x7ff2ac007aa0).stop 2022-01-10T01:24:38.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.172+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/3430109493 shutdown_connections 2022-01-10T01:24:38.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.172+0000 7ff2bfdb0700 1 --2- 172.21.15.36:0/3430109493 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff298053560 0x7ff298055a20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.172+0000 7ff2bfdb0700 1 --2- 172.21.15.36:0/3430109493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2b814ab80 0x7ff2b8146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.172+0000 7ff2bfdb0700 1 --2- 172.21.15.36:0/3430109493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2b80aff10 0x7ff2b813df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.172+0000 7ff2bfdb0700 1 --2- 172.21.15.36:0/3430109493 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2b80ac9b0 0x7ff2b8141e20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.172+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/3430109493 >> 172.21.15.36:0/3430109493 conn(0x7ff2b80b5570 msgr2=0x7ff2b81401e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:38.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.172+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/3430109493 shutdown_connections 2022-01-10T01:24:38.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.172+0000 7ff2bfdb0700 1 -- 172.21.15.36:0/3430109493 wait complete. 2022-01-10T01:24:38.188 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:24:38.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.288+0000 7f020f980700 1 Processor -- start 2022-01-10T01:24:38.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.288+0000 7f020f980700 1 -- start start 2022-01-10T01:24:38.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020f980700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0208146950 0x7f0208140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020f980700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02080b4180 0x7f0208140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020f980700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0208143b60 con 0x7f02080b4690 2022-01-10T01:24:38.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020f980700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0208147510 con 0x7f02080b4180 2022-01-10T01:24:38.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020f980700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0208143e00 con 0x7f0208146950 2022-01-10T01:24:38.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020d71c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0208146950 0x7f0208140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020cf1b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02080b4180 0x7f0208140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020df1d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f02080b4690 0x7f02080b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:49736/0 (socket says 172.21.15.36:49736) 2022-01-10T01:24:38.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020df1d700 1 -- 172.21.15.36:0/1659168432 learned_addr learned my addr 172.21.15.36:0/1659168432 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:38.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020cf1b700 1 --2- 172.21.15.36:0/1659168432 >> v2:172.21.15.59:3300/0 conn(0x7f02080b4180 0x7f0208140720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:59134/0 (socket says 172.21.15.36:59134) 2022-01-10T01:24:38.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020d71c700 1 --2- 172.21.15.36:0/1659168432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0208146950 0x7f0208140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:40546/0 (socket says 172.21.15.36:40546) 2022-01-10T01:24:38.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020cf1b700 1 -- 172.21.15.36:0/1659168432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0208146950 msgr2=0x7f0208140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:38.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020cf1b700 1 --2- 172.21.15.36:0/1659168432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0208146950 0x7f0208140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020cf1b700 1 -- 172.21.15.36:0/1659168432 >> v1:172.21.15.59:6789/0 conn(0x7f02080b4690 legacy=0x7f02080b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f01fffff700 1 -- 172.21.15.36:0/1659168432 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302024216 0 0) 0x7f0208143b60 con 0x7f02080b4690 2022-01-10T01:24:38.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020cf1b700 1 -- 172.21.15.36:0/1659168432 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02080b0c90 con 0x7f02080b4180 2022-01-10T01:24:38.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020d71c700 1 --2- 172.21.15.36:0/1659168432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0208146950 0x7f0208140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:38.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020cf1b700 1 --2- 172.21.15.36:0/1659168432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02080b4180 0x7f0208140720 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f01f8002f70 tx=0x7f01f8006df0).ready entity=mon.1 client_cookie=5c68bb964e45a264 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:38.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f01fffff700 1 -- 172.21.15.36:0/1659168432 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01f800d570 con 0x7f02080b4180 2022-01-10T01:24:38.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f01fffff700 1 -- 172.21.15.36:0/1659168432 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f8000e90 con 0x7f02080b4180 2022-01-10T01:24:38.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f01fffff700 1 -- 172.21.15.36:0/1659168432 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01f800d8c0 con 0x7f02080b4180 2022-01-10T01:24:38.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020f980700 1 -- 172.21.15.36:0/1659168432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02080b4180 msgr2=0x7f0208140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020f980700 1 --2- 172.21.15.36:0/1659168432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02080b4180 0x7f0208140720 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f01f8002f70 tx=0x7f01f8006df0).stop 2022-01-10T01:24:38.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020f980700 1 -- 172.21.15.36:0/1659168432 shutdown_connections 2022-01-10T01:24:38.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020f980700 1 --2- 172.21.15.36:0/1659168432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02080b4180 0x7f0208140720 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020f980700 1 --2- 172.21.15.36:0/1659168432 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0208146950 0x7f0208140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020f980700 1 -- 172.21.15.36:0/1659168432 >> 172.21.15.36:0/1659168432 conn(0x7f020805c490 msgr2=0x7f020805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:38.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020f980700 1 -- 172.21.15.36:0/1659168432 shutdown_connections 2022-01-10T01:24:38.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.292+0000 7f020f980700 1 -- 172.21.15.36:0/1659168432 wait complete. 2022-01-10T01:24:38.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020f980700 1 Processor -- start 2022-01-10T01:24:38.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020f980700 1 -- start start 2022-01-10T01:24:38.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020f980700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02080b4180 0x7f02080b8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020f980700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02080b4690 0x7f02081521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020f980700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0208146950 0x7f0208155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020f980700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02080b06a0 con 0x7f02080b4180 2022-01-10T01:24:38.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020f980700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02081557c0 con 0x7f0208146950 2022-01-10T01:24:38.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020f980700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02081425c0 con 0x7f02080b4690 2022-01-10T01:24:38.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020d71c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02080b4180 0x7f02080b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020d71c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02080b4180 0x7f02080b8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34270/0 (socket says 172.21.15.36:34270) 2022-01-10T01:24:38.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020d71c700 1 -- 172.21.15.36:0/2798403657 learned_addr learned my addr 172.21.15.36:0/2798403657 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:38.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020df1d700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0208146950 0x7f0208155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020cf1b700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02080b4690 0x7f02081521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020d71c700 1 -- 172.21.15.36:0/2798403657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02080b4690 msgr2=0x7f02081521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020d71c700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02080b4690 0x7f02081521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020d71c700 1 -- 172.21.15.36:0/2798403657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0208146950 msgr2=0x7f0208155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020d71c700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0208146950 0x7f0208155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020d71c700 1 -- 172.21.15.36:0/2798403657 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020400b180 con 0x7f02080b4180 2022-01-10T01:24:38.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020df1d700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0208146950 0x7f0208155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:38.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020d71c700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02080b4180 0x7f02080b8880 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f02080b07e0 tx=0x7f0204006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:38.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f01fe7fc700 1 -- 172.21.15.36:0/2798403657 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0204010780 con 0x7f02080b4180 2022-01-10T01:24:38.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f01fe7fc700 1 -- 172.21.15.36:0/2798403657 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02040108e0 con 0x7f02080b4180 2022-01-10T01:24:38.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020f980700 1 -- 172.21.15.36:0/2798403657 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f800b180 con 0x7f02080b4180 2022-01-10T01:24:38.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f01fe7fc700 1 -- 172.21.15.36:0/2798403657 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0204010c40 con 0x7f02080b4180 2022-01-10T01:24:38.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.296+0000 7f020f980700 1 -- 172.21.15.36:0/2798403657 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0208142860 con 0x7f02080b4180 2022-01-10T01:24:38.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.300+0000 7f020f980700 1 -- 172.21.15.36:0/2798403657 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0208057350 con 0x7f02080b4180 2022-01-10T01:24:38.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.300+0000 7f01fe7fc700 1 -- 172.21.15.36:0/2798403657 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f020401c460 con 0x7f02080b4180 2022-01-10T01:24:38.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.300+0000 7f01fe7fc700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f01f0053560 0x7f01f0055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.300+0000 7f01fe7fc700 1 -- 172.21.15.36:0/2798403657 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f020406c000 con 0x7f02080b4180 2022-01-10T01:24:38.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.300+0000 7f020cf1b700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f01f0053560 0x7f01f0055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.300+0000 7f020cf1b700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f01f0053560 0x7f01f0055a20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f01f801a000 tx=0x7f01f8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:38.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.308+0000 7f01fe7fc700 1 -- 172.21.15.36:0/2798403657 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0204042fb0 con 0x7f02080b4180 2022-01-10T01:24:38.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.436+0000 7f020f980700 1 -- 172.21.15.36:0/2798403657 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0208155bf0 con 0x7f02080b4180 2022-01-10T01:24:38.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.436+0000 7f01fe7fc700 1 -- 172.21.15.36:0/2798403657 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f02040465d0 con 0x7f02080b4180 2022-01-10T01:24:38.442 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:38.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.436+0000 7f020f980700 1 -- 172.21.15.36:0/2798403657 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f01f0053560 msgr2=0x7f01f0055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.436+0000 7f020f980700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f01f0053560 0x7f01f0055a20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f01f801a000 tx=0x7f01f8014000).stop 2022-01-10T01:24:38.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.436+0000 7f020f980700 1 -- 172.21.15.36:0/2798403657 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02080b4180 msgr2=0x7f02080b8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.436+0000 7f020f980700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02080b4180 0x7f02080b8880 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f02080b07e0 tx=0x7f0204006df0).stop 2022-01-10T01:24:38.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.436+0000 7f020f980700 1 -- 172.21.15.36:0/2798403657 shutdown_connections 2022-01-10T01:24:38.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.436+0000 7f020f980700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f01f0053560 0x7f01f0055a20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.436+0000 7f020f980700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0208146950 0x7f0208155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.436+0000 7f020f980700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02080b4690 0x7f02081521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.436+0000 7f020f980700 1 --2- 172.21.15.36:0/2798403657 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02080b4180 0x7f02080b8880 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.436+0000 7f020f980700 1 -- 172.21.15.36:0/2798403657 >> 172.21.15.36:0/2798403657 conn(0x7f020805c490 msgr2=0x7f02081449b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:38.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.436+0000 7f020f980700 1 -- 172.21.15.36:0/2798403657 shutdown_connections 2022-01-10T01:24:38.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.436+0000 7f020f980700 1 -- 172.21.15.36:0/2798403657 wait complete. 2022-01-10T01:24:38.455 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:24:38.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc155aee700 1 Processor -- start 2022-01-10T01:24:38.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc155aee700 1 -- start start 2022-01-10T01:24:38.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc155aee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc150146950 0x7fc150140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc155aee700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc1500b4180 0x7fc150140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc155aee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1500b4690 0x7fc1500b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc155aee700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc150147510 con 0x7fc1500b4180 2022-01-10T01:24:38.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc155aee700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc150143b60 con 0x7fc1500b4690 2022-01-10T01:24:38.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc155aee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc150143e00 con 0x7fc150146950 2022-01-10T01:24:38.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc14effd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc1500b4180 0x7fc150140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc14effd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc1500b4180 0x7fc150140720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34280/0 (socket says 172.21.15.36:34280) 2022-01-10T01:24:38.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc14effd700 1 -- 172.21.15.36:0/3073219824 learned_addr learned my addr 172.21.15.36:0/3073219824 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:38.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc14ffff700 1 --2- 172.21.15.36:0/3073219824 >> v2:172.21.15.59:3300/0 conn(0x7fc1500b4690 0x7fc1500b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc14f7fe700 1 --2- 172.21.15.36:0/3073219824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc150146950 0x7fc150140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc14effd700 1 -- 172.21.15.36:0/3073219824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc150146950 msgr2=0x7fc150140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:38.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc14effd700 1 --2- 172.21.15.36:0/3073219824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc150146950 0x7fc150140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc14effd700 1 -- 172.21.15.36:0/3073219824 >> v2:172.21.15.59:3300/0 conn(0x7fc1500b4690 msgr2=0x7fc1500b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:38.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc14effd700 1 --2- 172.21.15.36:0/3073219824 >> v2:172.21.15.59:3300/0 conn(0x7fc1500b4690 0x7fc1500b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc14effd700 1 -- 172.21.15.36:0/3073219824 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1500b0c90 con 0x7fc1500b4180 2022-01-10T01:24:38.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.556+0000 7fc14effd700 1 --2- 172.21.15.36:0/3073219824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1500b4180 0x7fc150140720 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fc138002f70 tx=0x7fc138006eb0).ready entity=mon.0 client_cookie=17446ad13c706e94 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:38.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.560+0000 7fc14e7fc700 1 -- 172.21.15.36:0/3073219824 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc13800d570 con 0x7fc1500b4180 2022-01-10T01:24:38.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.560+0000 7fc14e7fc700 1 -- 172.21.15.36:0/3073219824 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc138000e90 con 0x7fc1500b4180 2022-01-10T01:24:38.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.560+0000 7fc14e7fc700 1 -- 172.21.15.36:0/3073219824 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc13800d900 con 0x7fc1500b4180 2022-01-10T01:24:38.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.560+0000 7fc155aee700 1 -- 172.21.15.36:0/3073219824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1500b4180 msgr2=0x7fc150140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.560+0000 7fc155aee700 1 --2- 172.21.15.36:0/3073219824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1500b4180 0x7fc150140720 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fc138002f70 tx=0x7fc138006eb0).stop 2022-01-10T01:24:38.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.560+0000 7fc155aee700 1 -- 172.21.15.36:0/3073219824 shutdown_connections 2022-01-10T01:24:38.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.560+0000 7fc155aee700 1 --2- 172.21.15.36:0/3073219824 >> v2:172.21.15.59:3300/0 conn(0x7fc1500b4690 0x7fc1500b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.560+0000 7fc155aee700 1 --2- 172.21.15.36:0/3073219824 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1500b4180 0x7fc150140720 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.560+0000 7fc155aee700 1 --2- 172.21.15.36:0/3073219824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc150146950 0x7fc150140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.560+0000 7fc155aee700 1 -- 172.21.15.36:0/3073219824 >> 172.21.15.36:0/3073219824 conn(0x7fc15005c490 msgr2=0x7fc15005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:38.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.560+0000 7fc155aee700 1 -- 172.21.15.36:0/3073219824 shutdown_connections 2022-01-10T01:24:38.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.560+0000 7fc155aee700 1 -- 172.21.15.36:0/3073219824 wait complete. 2022-01-10T01:24:38.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.560+0000 7fc155aee700 1 Processor -- start 2022-01-10T01:24:38.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.560+0000 7fc155aee700 1 -- start start 2022-01-10T01:24:38.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc155aee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1500b4180 0x7fc1500b88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc155aee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1500b4690 0x7fc150155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc155aee700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc150146950 0x7fc150156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc155aee700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1500af540 con 0x7fc150146950 2022-01-10T01:24:38.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc155aee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc150156850 con 0x7fc1500b4690 2022-01-10T01:24:38.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc155aee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc150142db0 con 0x7fc1500b4180 2022-01-10T01:24:38.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc150146950 0x7fc150156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc150146950 0x7fc150156360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34286/0 (socket says 172.21.15.36:34286) 2022-01-10T01:24:38.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14ffff700 1 -- 172.21.15.36:0/3722942267 learned_addr learned my addr 172.21.15.36:0/3722942267 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:38.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14f7fe700 1 --2- 172.21.15.36:0/3722942267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1500b4180 0x7fc1500b88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14effd700 1 --2- 172.21.15.36:0/3722942267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1500b4690 0x7fc150155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14ffff700 1 -- 172.21.15.36:0/3722942267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1500b4180 msgr2=0x7fc1500b88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14ffff700 1 --2- 172.21.15.36:0/3722942267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1500b4180 0x7fc1500b88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14ffff700 1 -- 172.21.15.36:0/3722942267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1500b4690 msgr2=0x7fc150155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14ffff700 1 --2- 172.21.15.36:0/3722942267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1500b4690 0x7fc150155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14ffff700 1 -- 172.21.15.36:0/3722942267 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13800b1e0 con 0x7fc150146950 2022-01-10T01:24:38.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14ffff700 1 --2- 172.21.15.36:0/3722942267 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc150146950 0x7fc150156360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fc150156990 tx=0x7fc148008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:38.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14cff9700 1 -- 172.21.15.36:0/3722942267 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1480127e0 con 0x7fc150146950 2022-01-10T01:24:38.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc155aee700 1 -- 172.21.15.36:0/3722942267 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1501428c0 con 0x7fc150146950 2022-01-10T01:24:38.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14cff9700 1 -- 172.21.15.36:0/3722942267 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc148012940 con 0x7fc150146950 2022-01-10T01:24:38.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14cff9700 1 -- 172.21.15.36:0/3722942267 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc148012ca0 con 0x7fc150146950 2022-01-10T01:24:38.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc155aee700 1 -- 172.21.15.36:0/3722942267 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1500b8fb0 con 0x7fc150146950 2022-01-10T01:24:38.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc155aee700 1 -- 172.21.15.36:0/3722942267 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc150155bd0 con 0x7fc150146950 2022-01-10T01:24:38.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14cff9700 1 -- 172.21.15.36:0/3722942267 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc148013480 con 0x7fc150146950 2022-01-10T01:24:38.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.564+0000 7fc14cff9700 1 --2- 172.21.15.36:0/3722942267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc1340534d0 0x7fc134055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.568+0000 7fc14cff9700 1 -- 172.21.15.36:0/3722942267 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc14806be30 con 0x7fc150146950 2022-01-10T01:24:38.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.568+0000 7fc14f7fe700 1 --2- 172.21.15.36:0/3722942267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc1340534d0 0x7fc134055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.568+0000 7fc14f7fe700 1 --2- 172.21.15.36:0/3722942267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc1340534d0 0x7fc134055990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc14000c000 tx=0x7fc140008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:38.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.572+0000 7fc14cff9700 1 -- 172.21.15.36:0/3722942267 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc150155bd0 con 0x7fc150146950 2022-01-10T01:24:38.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.712+0000 7fc155aee700 1 -- 172.21.15.36:0/3722942267 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc150155bd0 con 0x7fc150146950 2022-01-10T01:24:38.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.712+0000 7fc14cff9700 1 -- 172.21.15.36:0/3722942267 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7fc150155bd0 con 0x7fc150146950 2022-01-10T01:24:38.718 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:38.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.712+0000 7fc155aee700 1 -- 172.21.15.36:0/3722942267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc1340534d0 msgr2=0x7fc134055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.712+0000 7fc155aee700 1 --2- 172.21.15.36:0/3722942267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc1340534d0 0x7fc134055990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc14000c000 tx=0x7fc140008040).stop 2022-01-10T01:24:38.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.712+0000 7fc155aee700 1 -- 172.21.15.36:0/3722942267 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc150146950 msgr2=0x7fc150156360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.712+0000 7fc155aee700 1 --2- 172.21.15.36:0/3722942267 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc150146950 0x7fc150156360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fc150156990 tx=0x7fc148008040).stop 2022-01-10T01:24:38.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.712+0000 7fc155aee700 1 -- 172.21.15.36:0/3722942267 shutdown_connections 2022-01-10T01:24:38.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.712+0000 7fc155aee700 1 --2- 172.21.15.36:0/3722942267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc1340534d0 0x7fc134055990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.712+0000 7fc155aee700 1 --2- 172.21.15.36:0/3722942267 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc150146950 0x7fc150156360 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.712+0000 7fc155aee700 1 --2- 172.21.15.36:0/3722942267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1500b4690 0x7fc150155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.712+0000 7fc155aee700 1 --2- 172.21.15.36:0/3722942267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1500b4180 0x7fc1500b88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.712+0000 7fc155aee700 1 -- 172.21.15.36:0/3722942267 >> 172.21.15.36:0/3722942267 conn(0x7fc15005c490 msgr2=0x7fc150145b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:38.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.712+0000 7fc155aee700 1 -- 172.21.15.36:0/3722942267 shutdown_connections 2022-01-10T01:24:38.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.712+0000 7fc155aee700 1 -- 172.21.15.36:0/3722942267 wait complete. 2022-01-10T01:24:38.731 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:24:38.731 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:24:38.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.828+0000 7f8690f5d700 1 Processor -- start 2022-01-10T01:24:38.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.828+0000 7f8690f5d700 1 -- start start 2022-01-10T01:24:38.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.828+0000 7f8690f5d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f868c0b2580 0x7f868c140050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.828+0000 7f8690f5d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0b00e0 0x7f868c140540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.828+0000 7f8690f5d700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868c067880 con 0x7f868c0ac6f0 2022-01-10T01:24:38.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.828+0000 7f8690f5d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868c0ad5b0 con 0x7f868c0b2580 2022-01-10T01:24:38.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.828+0000 7f8690f5d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c067b20 con 0x7f868c0b00e0 2022-01-10T01:24:38.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.828+0000 7f868bfff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f868c0ac6f0 0x7f868c142e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60322/0 (socket says 172.21.15.36:60322) 2022-01-10T01:24:38.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.828+0000 7f868bfff700 1 -- 172.21.15.36:0/3446258778 learned_addr learned my addr 172.21.15.36:0/3446258778 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:38.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.828+0000 7f868affd700 1 --2- 172.21.15.36:0/3446258778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0b00e0 0x7f868c140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.828+0000 7f868b7fe700 1 --2- 172.21.15.36:0/3446258778 >> v2:172.21.15.59:3300/0 conn(0x7f868c0b2580 0x7f868c140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.828+0000 7f868a7fc700 1 -- 172.21.15.36:0/3446258778 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883287561 0 0) 0x7f868c067880 con 0x7f868c0ac6f0 2022-01-10T01:24:38.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.828+0000 7f868a7fc700 1 -- 172.21.15.36:0/3446258778 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8678003260 con 0x7f868c0ac6f0 2022-01-10T01:24:38.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f868affd700 1 -- 172.21.15.36:0/3446258778 >> v2:172.21.15.59:3300/0 conn(0x7f868c0b2580 msgr2=0x7f868c140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:38.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f868affd700 1 --2- 172.21.15.36:0/3446258778 >> v2:172.21.15.59:3300/0 conn(0x7f868c0b2580 0x7f868c140050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f868affd700 1 -- 172.21.15.36:0/3446258778 >> v1:172.21.15.36:6789/0 conn(0x7f868c0ac6f0 legacy=0x7f868c142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f868affd700 1 -- 172.21.15.36:0/3446258778 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c146fd0 con 0x7f868c0b00e0 2022-01-10T01:24:38.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f868affd700 1 --2- 172.21.15.36:0/3446258778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0b00e0 0x7f868c140540 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f8680002f70 tx=0x7f8680006df0).ready entity=mon.2 client_cookie=d508db3b9cc23cb5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:38.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f868a7fc700 1 -- 172.21.15.36:0/3446258778 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f868000d4a0 con 0x7f868c0b00e0 2022-01-10T01:24:38.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f868a7fc700 1 -- 172.21.15.36:0/3446258778 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8680000e90 con 0x7f868c0b00e0 2022-01-10T01:24:38.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f868a7fc700 1 -- 172.21.15.36:0/3446258778 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f868000d7f0 con 0x7f868c0b00e0 2022-01-10T01:24:38.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f8690f5d700 1 -- 172.21.15.36:0/3446258778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0b00e0 msgr2=0x7f868c140540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f8690f5d700 1 --2- 172.21.15.36:0/3446258778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0b00e0 0x7f868c140540 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f8680002f70 tx=0x7f8680006df0).stop 2022-01-10T01:24:38.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f8690f5d700 1 -- 172.21.15.36:0/3446258778 shutdown_connections 2022-01-10T01:24:38.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f8690f5d700 1 --2- 172.21.15.36:0/3446258778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0b00e0 0x7f868c140540 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f8690f5d700 1 --2- 172.21.15.36:0/3446258778 >> v2:172.21.15.59:3300/0 conn(0x7f868c0b2580 0x7f868c140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f8690f5d700 1 -- 172.21.15.36:0/3446258778 >> 172.21.15.36:0/3446258778 conn(0x7f868c060180 msgr2=0x7f868c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:38.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f8690f5d700 1 -- 172.21.15.36:0/3446258778 shutdown_connections 2022-01-10T01:24:38.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.832+0000 7f8690f5d700 1 -- 172.21.15.36:0/3446258778 wait complete. 2022-01-10T01:24:38.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f8690f5d700 1 Processor -- start 2022-01-10T01:24:38.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f8690f5d700 1 -- start start 2022-01-10T01:24:38.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f8690f5d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f868c0ac6f0 0x7f868c0b3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f8690f5d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0b00e0 0x7f868c142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f8690f5d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0b2580 0x7f868c155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f8690f5d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c141fa0 con 0x7f868c0ac6f0 2022-01-10T01:24:38.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f8690f5d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c140fb0 con 0x7f868c0b2580 2022-01-10T01:24:38.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f8690f5d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c142170 con 0x7f868c0b00e0 2022-01-10T01:24:38.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f868b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f868c0ac6f0 0x7f868c0b3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f868b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f868c0ac6f0 0x7f868c0b3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34300/0 (socket says 172.21.15.36:34300) 2022-01-10T01:24:38.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f868b7fe700 1 -- 172.21.15.36:0/2257725844 learned_addr learned my addr 172.21.15.36:0/2257725844 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:38.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f868affd700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0b00e0 0x7f868c142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f868bfff700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0b2580 0x7f868c155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f868b7fe700 1 -- 172.21.15.36:0/2257725844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0b00e0 msgr2=0x7f868c142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f868b7fe700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0b00e0 0x7f868c142ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f868b7fe700 1 -- 172.21.15.36:0/2257725844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0b2580 msgr2=0x7f868c155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:38.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f868b7fe700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0b2580 0x7f868c155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:38.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f868b7fe700 1 -- 172.21.15.36:0/2257725844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868000b180 con 0x7f868c0ac6f0 2022-01-10T01:24:38.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f868bfff700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0b2580 0x7f868c155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:38.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f868b7fe700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f868c0ac6f0 0x7f868c0b3d20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f868c09eaa0 tx=0x7f867c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:38.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f8688ff9700 1 -- 172.21.15.36:0/2257725844 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f867c010780 con 0x7f868c0ac6f0 2022-01-10T01:24:38.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f8688ff9700 1 -- 172.21.15.36:0/2257725844 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c0108e0 con 0x7f868c0ac6f0 2022-01-10T01:24:38.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.836+0000 7f8688ff9700 1 -- 172.21.15.36:0/2257725844 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f867c010c40 con 0x7f868c0ac6f0 2022-01-10T01:24:38.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.840+0000 7f8690f5d700 1 -- 172.21.15.36:0/2257725844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868c140d10 con 0x7f868c0ac6f0 2022-01-10T01:24:38.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.840+0000 7f8690f5d700 1 -- 172.21.15.36:0/2257725844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c0ab170 con 0x7f868c0ac6f0 2022-01-10T01:24:38.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.840+0000 7f8690f5d700 1 -- 172.21.15.36:0/2257725844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868c057350 con 0x7f868c0ac6f0 2022-01-10T01:24:38.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.840+0000 7f8688ff9700 1 -- 172.21.15.36:0/2257725844 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f867c01c460 con 0x7f868c0ac6f0 2022-01-10T01:24:38.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.840+0000 7f8688ff9700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f866c053560 0x7f866c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:38.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.840+0000 7f8688ff9700 1 -- 172.21.15.36:0/2257725844 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f867c06bf60 con 0x7f868c0ac6f0 2022-01-10T01:24:38.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.840+0000 7f868affd700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f866c053560 0x7f866c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:38.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.844+0000 7f868affd700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f866c053560 0x7f866c055a20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f868001a000 tx=0x7f8680014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:38.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:38.844+0000 7f8688ff9700 1 -- 172.21.15.36:0/2257725844 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f867c042e00 con 0x7f868c0ac6f0 2022-01-10T01:24:39.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:39.012+0000 7f8690f5d700 1 -- 172.21.15.36:0/2257725844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f868c0b1a20 con 0x7f868c0ac6f0 2022-01-10T01:24:39.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:39.012+0000 7f8688ff9700 1 -- 172.21.15.36:0/2257725844 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7f867c046420 con 0x7f868c0ac6f0 2022-01-10T01:24:39.019 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:39.020 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3870348387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3870348387},{"type":"v1","addr":"172.21.15.59:6833","nonce":3870348387}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2808909651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2808909651},{"type":"v1","addr":"172.21.15.36:6835","nonce":2808909651}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:24:25.225258+0000","modified":"2022-01-10T01:24:26.981594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/1089668836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1089668836},{"type":"v1","addr":"172.21.15.36:6837","nonce":1089668836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-01-10T01:24:39.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:39.016+0000 7f8690f5d700 1 -- 172.21.15.36:0/2257725844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f866c053560 msgr2=0x7f866c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:39.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:39.016+0000 7f8690f5d700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f866c053560 0x7f866c055a20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f868001a000 tx=0x7f8680014000).stop 2022-01-10T01:24:39.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:39.016+0000 7f8690f5d700 1 -- 172.21.15.36:0/2257725844 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f868c0ac6f0 msgr2=0x7f868c0b3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:39.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:39.016+0000 7f8690f5d700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f868c0ac6f0 0x7f868c0b3d20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f868c09eaa0 tx=0x7f867c006df0).stop 2022-01-10T01:24:39.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:39.016+0000 7f8690f5d700 1 -- 172.21.15.36:0/2257725844 shutdown_connections 2022-01-10T01:24:39.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:39.016+0000 7f8690f5d700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f866c053560 0x7f866c055a20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:39.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:39.016+0000 7f8690f5d700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0b2580 0x7f868c155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:39.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:39.016+0000 7f8690f5d700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0b00e0 0x7f868c142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:39.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:39.016+0000 7f8690f5d700 1 --2- 172.21.15.36:0/2257725844 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f868c0ac6f0 0x7f868c0b3d20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:39.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:39.016+0000 7f8690f5d700 1 -- 172.21.15.36:0/2257725844 >> 172.21.15.36:0/2257725844 conn(0x7f868c060180 msgr2=0x7f868c140280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:39.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:39.016+0000 7f8690f5d700 1 -- 172.21.15.36:0/2257725844 shutdown_connections 2022-01-10T01:24:39.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:39.016+0000 7f8690f5d700 1 -- 172.21.15.36:0/2257725844 wait complete. 2022-01-10T01:24:39.024 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 7 2022-01-10T01:24:39.335 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:24:25.225258+0000', 'modified': '2022-01-10T01:24:26.981594+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'c', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6837/1089668836', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6836', 'nonce': 1089668836}, {'type': 'v1', 'addr': '172.21.15.36:6837', 'nonce': 1089668836}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:24:39.335 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:24:39.336 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2022-01-10T01:24:39.454 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":4284,"want_state":"up:active","state":"up:active","rank_uptime":14.216041739,"mdsmap_epoch":7,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":20.569889784000001} 2022-01-10T01:24:39.455 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 4284, "mdsmap_epoch": 7, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 14.216041739, "state": "up:active", "uptime": 20.569889784, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:24:39.455 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:24:39.455 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:24:39.456 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:24:39.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:39.456 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:24:39.465 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:24:39.524 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:24:39.525 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:24:39.540 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:24:39.541 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:24:39.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:39.542 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:24:39.549 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:24:39.549 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:24:39.552 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:24:39.566 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:24:39.566 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:24:39.576 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:24:39.577 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:24:39.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:39.578 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:24:39.648 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:24:39.643+0000 7f7b35beb080 -1 init, newargv = 0x55843e547470 newargc=9ceph-fuse[13970]: starting ceph client 2022-01-10T01:24:39.648 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr: 2022-01-10T01:24:39.658 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[13970]: starting fuse 2022-01-10T01:24:40.685 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:24:40.703 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:24:40.704 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:24:40.763 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:24:40.764 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:24:40.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:40.765 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:24:40.770 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:24:40.770 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:24:40.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:40.771 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:24:40.771 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:24:40.772 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:24:40.772 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:24:40.772 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:24:40.773 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:24:40.773 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:24:40.773 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:24:40.774 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:24:40.774 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:24:40.774 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:24:40.775 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:24:40.775 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:24:40.775 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:24:40.776 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:24:40.776 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:24:40.776 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:24:40.777 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:24:40.777 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:24:40.777 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:24:40.778 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:24:40.778 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:24:40.778 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:24:40.819 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.13970.asok 2022-01-10T01:24:40.824 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13970.asok 2022-01-10T01:24:40.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:40.825 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13970.asok status 2022-01-10T01:24:40.916 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:24:40.916 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:24:40.916 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:24:40.917 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:24:40.917 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:24:40.917 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:24:40.917 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:24:40.918 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "13970", 2022-01-10T01:24:40.918 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:24:40.918 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:24:40.918 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:24:40.919 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:24:40.919 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 4630, 2022-01-10T01:24:40.919 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:24:40.920 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:24:40.920 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:24:40.920 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 4630 2022-01-10T01:24:40.920 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:24:40.920 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:24:40.921 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:24:40.921 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:24:40.921 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2181717914 2022-01-10T01:24:40.921 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:24:40.922 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:24:40.922 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:24:40.922 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:24:40.922 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:24:40.923 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2181717914 2022-01-10T01:24:40.923 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:24:40.923 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.4630 172.21.15.139:0/2181717914", 2022-01-10T01:24:40.923 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/2181717914", 2022-01-10T01:24:40.924 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:24:40.924 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 7, 2022-01-10T01:24:40.925 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 24, 2022-01-10T01:24:40.925 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:24:40.925 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:24:40.926 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:24:40.926 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:24:40.928 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:41.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.036+0000 7ff82600d700 1 Processor -- start 2022-01-10T01:24:41.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.036+0000 7ff82600d700 1 -- start start 2022-01-10T01:24:41.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82600d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff8200b2580 0x7ff820140050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82600d700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff820067880 con 0x7ff8200ac6f0 2022-01-10T01:24:41.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82600d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff820067b20 con 0x7ff8200b00e0 2022-01-10T01:24:41.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82600d700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8200ad5b0 con 0x7ff8200b2580 2022-01-10T01:24:41.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82500b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff8200b2580 0x7ff820140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82500b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff8200b2580 0x7ff820140050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34308/0 (socket says 172.21.15.36:34308) 2022-01-10T01:24:41.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82500b700 1 -- 172.21.15.36:0/1760823422 learned_addr learned my addr 172.21.15.36:0/1760823422 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:41.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82500b700 1 -- 172.21.15.36:0/1760823422 >> v1:172.21.15.59:6789/0 conn(0x7ff8200b00e0 legacy=0x7ff820142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82500b700 1 -- 172.21.15.36:0/1760823422 >> v1:172.21.15.36:6789/0 conn(0x7ff8200ac6f0 legacy=0x7ff820143580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82500b700 1 -- 172.21.15.36:0/1760823422 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff820146fd0 con 0x7ff8200b2580 2022-01-10T01:24:41.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff80ffff700 1 -- 172.21.15.36:0/1760823422 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 472188503 0 0) 0x7ff820067880 con 0x7ff8200ac6f0 2022-01-10T01:24:41.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82500b700 1 --2- 172.21.15.36:0/1760823422 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8200b2580 0x7ff820140050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7ff81c002f70 tx=0x7ff81c006eb0).ready entity=mon.0 client_cookie=fa39ad055839a6e5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:41.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff80ffff700 1 -- 172.21.15.36:0/1760823422 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff81c00d660 con 0x7ff8200b2580 2022-01-10T01:24:41.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff80ffff700 1 -- 172.21.15.36:0/1760823422 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c000e90 con 0x7ff8200b2580 2022-01-10T01:24:41.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff80ffff700 1 -- 172.21.15.36:0/1760823422 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff81c00d9b0 con 0x7ff8200b2580 2022-01-10T01:24:41.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82600d700 1 -- 172.21.15.36:0/1760823422 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8200b2580 msgr2=0x7ff820140050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82600d700 1 --2- 172.21.15.36:0/1760823422 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8200b2580 0x7ff820140050 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7ff81c002f70 tx=0x7ff81c006eb0).stop 2022-01-10T01:24:41.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82600d700 1 -- 172.21.15.36:0/1760823422 shutdown_connections 2022-01-10T01:24:41.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82600d700 1 --2- 172.21.15.36:0/1760823422 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8200b2580 0x7ff820140050 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82600d700 1 -- 172.21.15.36:0/1760823422 >> 172.21.15.36:0/1760823422 conn(0x7ff820060180 msgr2=0x7ff8200b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:41.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82600d700 1 -- 172.21.15.36:0/1760823422 shutdown_connections 2022-01-10T01:24:41.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.040+0000 7ff82600d700 1 -- 172.21.15.36:0/1760823422 wait complete. 2022-01-10T01:24:41.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82600d700 1 Processor -- start 2022-01-10T01:24:41.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82600d700 1 -- start start 2022-01-10T01:24:41.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82600d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8200ac6f0 0x7ff8200ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82600d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8200b00e0 0x7ff8200abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82600d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8200b2580 0x7ff8200a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82600d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200a24d0 con 0x7ff8200b00e0 2022-01-10T01:24:41.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82600d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff820153540 con 0x7ff8200b2580 2022-01-10T01:24:41.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82600d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff820153040 con 0x7ff8200ac6f0 2022-01-10T01:24:41.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82480a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8200b00e0 0x7ff8200abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82480a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8200b00e0 0x7ff8200abdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34314/0 (socket says 172.21.15.36:34314) 2022-01-10T01:24:41.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82480a700 1 -- 172.21.15.36:0/1187167050 learned_addr learned my addr 172.21.15.36:0/1187167050 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:41.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82500b700 1 --2- 172.21.15.36:0/1187167050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8200ac6f0 0x7ff8200ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82580c700 1 --2- 172.21.15.36:0/1187167050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8200b2580 0x7ff8200a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82480a700 1 -- 172.21.15.36:0/1187167050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8200ac6f0 msgr2=0x7ff8200ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82480a700 1 --2- 172.21.15.36:0/1187167050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8200ac6f0 0x7ff8200ab7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82480a700 1 -- 172.21.15.36:0/1187167050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8200b2580 msgr2=0x7ff8200a1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82480a700 1 --2- 172.21.15.36:0/1187167050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8200b2580 0x7ff8200a1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82480a700 1 -- 172.21.15.36:0/1187167050 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff81c00b1e0 con 0x7ff8200b00e0 2022-01-10T01:24:41.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82480a700 1 --2- 172.21.15.36:0/1187167050 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8200b00e0 0x7ff8200abdb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7ff820061eb0 tx=0x7ff810007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:41.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff80e7fc700 1 -- 172.21.15.36:0/1187167050 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff81000ce30 con 0x7ff8200b00e0 2022-01-10T01:24:41.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff80e7fc700 1 -- 172.21.15.36:0/1187167050 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81000f470 con 0x7ff8200b00e0 2022-01-10T01:24:41.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82600d700 1 -- 172.21.15.36:0/1187167050 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8201532a0 con 0x7ff8200b00e0 2022-01-10T01:24:41.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff80e7fc700 1 -- 172.21.15.36:0/1187167050 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff81000f7d0 con 0x7ff8200b00e0 2022-01-10T01:24:41.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.044+0000 7ff82600d700 1 -- 172.21.15.36:0/1187167050 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8200a1fa0 con 0x7ff8200b00e0 2022-01-10T01:24:41.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.048+0000 7ff82600d700 1 -- 172.21.15.36:0/1187167050 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff820057350 con 0x7ff8200b00e0 2022-01-10T01:24:41.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.048+0000 7ff80e7fc700 1 -- 172.21.15.36:0/1187167050 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff810019030 con 0x7ff8200b00e0 2022-01-10T01:24:41.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.048+0000 7ff80e7fc700 1 --2- 172.21.15.36:0/1187167050 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff800053680 0x7ff800055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.048+0000 7ff80e7fc700 1 -- 172.21.15.36:0/1187167050 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff81006aee0 con 0x7ff8200b00e0 2022-01-10T01:24:41.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.048+0000 7ff82500b700 1 --2- 172.21.15.36:0/1187167050 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff800053680 0x7ff800055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.048+0000 7ff82500b700 1 --2- 172.21.15.36:0/1187167050 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff800053680 0x7ff800055b40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7ff81c01a000 tx=0x7ff81c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:41.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.052+0000 7ff80e7fc700 1 -- 172.21.15.36:0/1187167050 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff810041ef0 con 0x7ff8200b00e0 2022-01-10T01:24:41.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.180+0000 7ff82600d700 1 -- 172.21.15.36:0/1187167050 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff82005cf10 con 0x7ff8200b00e0 2022-01-10T01:24:41.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.180+0000 7ff80e7fc700 1 -- 172.21.15.36:0/1187167050 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16299 (secure 0 0 0) 0x7ff810045510 con 0x7ff8200b00e0 2022-01-10T01:24:41.188 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:41.189 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:25.224959+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:24:20.202898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-10T01:24:22.952870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:41.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.184+0000 7ff82600d700 1 -- 172.21.15.36:0/1187167050 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff800053680 msgr2=0x7ff800055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.184+0000 7ff82600d700 1 --2- 172.21.15.36:0/1187167050 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff800053680 0x7ff800055b40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7ff81c01a000 tx=0x7ff81c015000).stop 2022-01-10T01:24:41.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.184+0000 7ff82600d700 1 -- 172.21.15.36:0/1187167050 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8200b00e0 msgr2=0x7ff8200abdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.184+0000 7ff82600d700 1 --2- 172.21.15.36:0/1187167050 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8200b00e0 0x7ff8200abdb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7ff820061eb0 tx=0x7ff810007c50).stop 2022-01-10T01:24:41.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.184+0000 7ff82600d700 1 -- 172.21.15.36:0/1187167050 shutdown_connections 2022-01-10T01:24:41.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.184+0000 7ff82600d700 1 --2- 172.21.15.36:0/1187167050 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff800053680 0x7ff800055b40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.184+0000 7ff82600d700 1 --2- 172.21.15.36:0/1187167050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8200b2580 0x7ff8200a1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.184+0000 7ff82600d700 1 --2- 172.21.15.36:0/1187167050 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8200b00e0 0x7ff8200abdb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.184+0000 7ff82600d700 1 --2- 172.21.15.36:0/1187167050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8200ac6f0 0x7ff8200ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.184+0000 7ff82600d700 1 -- 172.21.15.36:0/1187167050 >> 172.21.15.36:0/1187167050 conn(0x7ff820060180 msgr2=0x7ff820146560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:41.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.184+0000 7ff82600d700 1 -- 172.21.15.36:0/1187167050 shutdown_connections 2022-01-10T01:24:41.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.184+0000 7ff82600d700 1 -- 172.21.15.36:0/1187167050 wait complete. 2022-01-10T01:24:41.207 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:24:20.202898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:24:22.952870+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:24:41.208 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:24:41.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.312+0000 7f0734d4a700 1 Processor -- start 2022-01-10T01:24:41.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.312+0000 7f0734d4a700 1 -- start start 2022-01-10T01:24:41.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f07300a9190 0x7f0730146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f07300b03d0 0x7f07301401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07300b1140 con 0x7f07300b0b80 2022-01-10T01:24:41.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07300a9570 con 0x7f07300a9190 2022-01-10T01:24:41.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07300b1370 con 0x7f07300b03d0 2022-01-10T01:24:41.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f072f7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f07300a9190 0x7f0730146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0726ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f07300b0b80 0x7f0730146a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60350/0 (socket says 172.21.15.36:60350) 2022-01-10T01:24:41.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f072f7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f07300a9190 0x7f0730146550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34322/0 (socket says 172.21.15.36:34322) 2022-01-10T01:24:41.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0726ffd700 1 -- 172.21.15.36:0/1102849519 learned_addr learned my addr 172.21.15.36:0/1102849519 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:41.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f072ffff700 1 --2- 172.21.15.36:0/1102849519 >> v2:172.21.15.59:3300/0 conn(0x7f07300b03d0 0x7f07301401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f072f7fe700 1 -- 172.21.15.36:0/1102849519 >> v2:172.21.15.59:3300/0 conn(0x7f07300b03d0 msgr2=0x7f07301401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:41.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f072f7fe700 1 --2- 172.21.15.36:0/1102849519 >> v2:172.21.15.59:3300/0 conn(0x7f07300b03d0 0x7f07301401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f072f7fe700 1 -- 172.21.15.36:0/1102849519 >> v1:172.21.15.36:6789/0 conn(0x7f07300b0b80 legacy=0x7f0730146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f072f7fe700 1 -- 172.21.15.36:0/1102849519 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07300b1610 con 0x7f07300a9190 2022-01-10T01:24:41.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f072f7fe700 1 --2- 172.21.15.36:0/1102849519 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07300a9190 0x7f0730146550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f0720002f70 tx=0x7f0720006df0).ready entity=mon.0 client_cookie=fa40be4af81b3583 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:41.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f072effd700 1 -- 172.21.15.36:0/1102849519 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072000d570 con 0x7f07300a9190 2022-01-10T01:24:41.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f072effd700 1 -- 172.21.15.36:0/1102849519 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0720000e90 con 0x7f07300a9190 2022-01-10T01:24:41.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f072effd700 1 -- 172.21.15.36:0/1102849519 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072000d8c0 con 0x7f07300a9190 2022-01-10T01:24:41.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 -- 172.21.15.36:0/1102849519 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07300a9190 msgr2=0x7f0730146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 --2- 172.21.15.36:0/1102849519 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07300a9190 0x7f0730146550 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f0720002f70 tx=0x7f0720006df0).stop 2022-01-10T01:24:41.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 -- 172.21.15.36:0/1102849519 shutdown_connections 2022-01-10T01:24:41.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 --2- 172.21.15.36:0/1102849519 >> v2:172.21.15.59:3300/0 conn(0x7f07300b03d0 0x7f07301401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 --2- 172.21.15.36:0/1102849519 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07300a9190 0x7f0730146550 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 -- 172.21.15.36:0/1102849519 >> 172.21.15.36:0/1102849519 conn(0x7f0730061140 msgr2=0x7f0730062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:41.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 -- 172.21.15.36:0/1102849519 shutdown_connections 2022-01-10T01:24:41.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 -- 172.21.15.36:0/1102849519 wait complete. 2022-01-10T01:24:41.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 Processor -- start 2022-01-10T01:24:41.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.316+0000 7f0734d4a700 1 -- start start 2022-01-10T01:24:41.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f0734d4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07300a9190 0x7f0730145840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f0734d4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07300b03d0 0x7f0730155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f0734d4a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07300b0b80 0x7f0730156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f0734d4a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0730152480 con 0x7f07300b0b80 2022-01-10T01:24:41.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f0734d4a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07300b55e0 con 0x7f07300a9190 2022-01-10T01:24:41.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f0734d4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07300b4e00 con 0x7f07300b03d0 2022-01-10T01:24:41.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f072ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07300b0b80 0x7f0730156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f072ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07300b0b80 0x7f0730156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34330/0 (socket says 172.21.15.36:34330) 2022-01-10T01:24:41.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f072ffff700 1 -- 172.21.15.36:0/1723468569 learned_addr learned my addr 172.21.15.36:0/1723468569 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:41.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f072f7fe700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07300a9190 0x7f0730145840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f0726ffd700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07300b03d0 0x7f0730155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f072ffff700 1 -- 172.21.15.36:0/1723468569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07300b03d0 msgr2=0x7f0730155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f072ffff700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07300b03d0 0x7f0730155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f072ffff700 1 -- 172.21.15.36:0/1723468569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07300a9190 msgr2=0x7f0730145840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f072ffff700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07300a9190 0x7f0730145840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f072ffff700 1 -- 172.21.15.36:0/1723468569 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072000b180 con 0x7f07300b0b80 2022-01-10T01:24:41.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f0726ffd700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07300b03d0 0x7f0730155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:41.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f072f7fe700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07300a9190 0x7f0730145840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:41.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f072ffff700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07300b0b80 0x7f0730156250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f0728006e00 tx=0x7f07280091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:41.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f072d7fa700 1 -- 172.21.15.36:0/1723468569 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072800c850 con 0x7f07300b0b80 2022-01-10T01:24:41.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f072d7fa700 1 -- 172.21.15.36:0/1723468569 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072800c9b0 con 0x7f07300b0b80 2022-01-10T01:24:41.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f0734d4a700 1 -- 172.21.15.36:0/1723468569 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07300b50a0 con 0x7f07300b0b80 2022-01-10T01:24:41.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f072d7fa700 1 -- 172.21.15.36:0/1723468569 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072800cd10 con 0x7f07300b0b80 2022-01-10T01:24:41.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f0734d4a700 1 -- 172.21.15.36:0/1723468569 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07301500c0 con 0x7f07300b0b80 2022-01-10T01:24:41.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.320+0000 7f0734d4a700 1 -- 172.21.15.36:0/1723468569 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0730057350 con 0x7f07300b0b80 2022-01-10T01:24:41.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.324+0000 7f072d7fa700 1 -- 172.21.15.36:0/1723468569 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0728022070 con 0x7f07300b0b80 2022-01-10T01:24:41.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.324+0000 7f072d7fa700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07140534d0 0x7f0714055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.324+0000 7f072d7fa700 1 -- 172.21.15.36:0/1723468569 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f072806c1f0 con 0x7f07300b0b80 2022-01-10T01:24:41.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.324+0000 7f072f7fe700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07140534d0 0x7f0714055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.324+0000 7f072f7fe700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07140534d0 0x7f0714055990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f0720018000 tx=0x7f0720014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:41.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.328+0000 7f072d7fa700 1 -- 172.21.15.36:0/1723468569 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0728043160 con 0x7f07300b0b80 2022-01-10T01:24:41.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.456+0000 7f0734d4a700 1 -- 172.21.15.36:0/1723468569 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0730155a80 con 0x7f07300b0b80 2022-01-10T01:24:41.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.456+0000 7f072d7fa700 1 -- 172.21.15.36:0/1723468569 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0728046780 con 0x7f07300b0b80 2022-01-10T01:24:41.463 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:24:41.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.460+0000 7f0734d4a700 1 -- 172.21.15.36:0/1723468569 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07140534d0 msgr2=0x7f0714055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.460+0000 7f0734d4a700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07140534d0 0x7f0714055990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f0720018000 tx=0x7f0720014000).stop 2022-01-10T01:24:41.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.460+0000 7f0734d4a700 1 -- 172.21.15.36:0/1723468569 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07300b0b80 msgr2=0x7f0730156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.460+0000 7f0734d4a700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07300b0b80 0x7f0730156250 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f0728006e00 tx=0x7f07280091d0).stop 2022-01-10T01:24:41.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.460+0000 7f0734d4a700 1 -- 172.21.15.36:0/1723468569 shutdown_connections 2022-01-10T01:24:41.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.460+0000 7f0734d4a700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07140534d0 0x7f0714055990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.460+0000 7f0734d4a700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07300b0b80 0x7f0730156250 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.460+0000 7f0734d4a700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07300b03d0 0x7f0730155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.460+0000 7f0734d4a700 1 --2- 172.21.15.36:0/1723468569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07300a9190 0x7f0730145840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.460+0000 7f0734d4a700 1 -- 172.21.15.36:0/1723468569 >> 172.21.15.36:0/1723468569 conn(0x7f0730061140 msgr2=0x7f073013c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:41.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.460+0000 7f0734d4a700 1 -- 172.21.15.36:0/1723468569 shutdown_connections 2022-01-10T01:24:41.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.460+0000 7f0734d4a700 1 -- 172.21.15.36:0/1723468569 wait complete. 2022-01-10T01:24:41.480 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:24:41.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.584+0000 7faf30e22700 1 Processor -- start 2022-01-10T01:24:41.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.584+0000 7faf30e22700 1 -- start start 2022-01-10T01:24:41.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.584+0000 7faf30e22700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf2c061680 0x7faf2c0b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.584+0000 7faf30e22700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2c0b6910 con 0x7faf2c1439a0 2022-01-10T01:24:41.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.584+0000 7faf30e22700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf2c0b6bb0 con 0x7faf2c0b4710 2022-01-10T01:24:41.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.584+0000 7faf30e22700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2c0b9680 con 0x7faf2c061680 2022-01-10T01:24:41.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.584+0000 7faf2bfff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7faf2c1439a0 0x7faf2c14d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60362/0 (socket says 172.21.15.36:60362) 2022-01-10T01:24:41.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.584+0000 7faf2bfff700 1 -- 172.21.15.36:0/3945293983 learned_addr learned my addr 172.21.15.36:0/3945293983 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:41.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.584+0000 7faf2b7fe700 1 --2- 172.21.15.36:0/3945293983 >> v2:172.21.15.59:3300/0 conn(0x7faf2c061680 0x7faf2c0b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.584+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168688456 0 0) 0x7faf2c0b6910 con 0x7faf2c1439a0 2022-01-10T01:24:41.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.584+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf0c003260 con 0x7faf2c1439a0 2022-01-10T01:24:41.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787121174 0 0) 0x7faf2c0b6bb0 con 0x7faf2c0b4710 2022-01-10T01:24:41.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf2c0b6910 con 0x7faf2c0b4710 2022-01-10T01:24:41.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1442839773 0 0) 0x7faf0c003260 con 0x7faf2c1439a0 2022-01-10T01:24:41.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 >> v2:172.21.15.59:3300/0 conn(0x7faf2c061680 msgr2=0x7faf2c0b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:41.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 --2- 172.21.15.36:0/3945293983 >> v2:172.21.15.59:3300/0 conn(0x7faf2c061680 0x7faf2c0b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 >> v1:172.21.15.59:6789/0 conn(0x7faf2c0b4710 legacy=0x7faf2c13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0b6e50 con 0x7faf2c1439a0 2022-01-10T01:24:41.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7faf240019e0 con 0x7faf2c1439a0 2022-01-10T01:24:41.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 >> v1:172.21.15.36:6789/0 conn(0x7faf2c1439a0 legacy=0x7faf2c14d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 --2- 172.21.15.36:0/3945293983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c003930 0x7faf0c003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 --2- 172.21.15.36:0/3945293983 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf0c004500 0x7faf0c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 --2- 172.21.15.36:0/3945293983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf0c004e70 0x7faf0c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c00bcf0 con 0x7faf0c004500 2022-01-10T01:24:41.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c00be60 con 0x7faf0c003930 2022-01-10T01:24:41.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c00c020 con 0x7faf0c004e70 2022-01-10T01:24:41.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf23fff700 1 --2- 172.21.15.36:0/3945293983 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf0c004500 0x7faf0c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2b7fe700 1 --2- 172.21.15.36:0/3945293983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c003930 0x7faf0c003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2bfff700 1 --2- 172.21.15.36:0/3945293983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf0c004e70 0x7faf0c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf23fff700 1 -- 172.21.15.36:0/3945293983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf0c004e70 msgr2=0x7faf0c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:41.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf23fff700 1 --2- 172.21.15.36:0/3945293983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf0c004e70 0x7faf0c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf23fff700 1 -- 172.21.15.36:0/3945293983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c003930 msgr2=0x7faf0c003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:41.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf23fff700 1 --2- 172.21.15.36:0/3945293983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c003930 0x7faf0c003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf23fff700 1 -- 172.21.15.36:0/3945293983 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c003260 con 0x7faf0c004500 2022-01-10T01:24:41.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2bfff700 1 -- 172.21.15.36:0/3945293983 reap_dead start 2022-01-10T01:24:41.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2b7fe700 1 --2- 172.21.15.36:0/3945293983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c003930 0x7faf0c003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:41.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf23fff700 1 --2- 172.21.15.36:0/3945293983 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf0c004500 0x7faf0c004980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7faf14001110 tx=0x7faf14007a00).ready entity=mon.0 client_cookie=e93dc466076107c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:41.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf14007d10 con 0x7faf0c004500 2022-01-10T01:24:41.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf14007030 con 0x7faf0c004500 2022-01-10T01:24:41.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf2affd700 1 -- 172.21.15.36:0/3945293983 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf14007390 con 0x7faf0c004500 2022-01-10T01:24:41.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf30e22700 1 -- 172.21.15.36:0/3945293983 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf0c004500 msgr2=0x7faf0c004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf30e22700 1 --2- 172.21.15.36:0/3945293983 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf0c004500 0x7faf0c004980 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7faf14001110 tx=0x7faf14007a00).stop 2022-01-10T01:24:41.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf30e22700 1 -- 172.21.15.36:0/3945293983 shutdown_connections 2022-01-10T01:24:41.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf30e22700 1 --2- 172.21.15.36:0/3945293983 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf0c004500 0x7faf0c004980 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf30e22700 1 -- 172.21.15.36:0/3945293983 >> 172.21.15.36:0/3945293983 conn(0x7faf2c06adf0 msgr2=0x7faf2c05f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:41.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf30e22700 1 -- 172.21.15.36:0/3945293983 shutdown_connections 2022-01-10T01:24:41.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.588+0000 7faf30e22700 1 -- 172.21.15.36:0/3945293983 wait complete. 2022-01-10T01:24:41.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf30e22700 1 Processor -- start 2022-01-10T01:24:41.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf30e22700 1 -- start start 2022-01-10T01:24:41.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf30e22700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c004500 0x7faf2c0afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf30e22700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf2c113bd0 0x7faf2c152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf30e22700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf2c155940 0x7faf2c155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf30e22700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c13ea60 con 0x7faf2c155940 2022-01-10T01:24:41.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf30e22700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c114dc0 con 0x7faf0c004500 2022-01-10T01:24:41.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf30e22700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2c114b20 con 0x7faf2c113bd0 2022-01-10T01:24:41.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf2bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf2c155940 0x7faf2c155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf2bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf2c155940 0x7faf2c155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34348/0 (socket says 172.21.15.36:34348) 2022-01-10T01:24:41.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf2bfff700 1 -- 172.21.15.36:0/2435242962 learned_addr learned my addr 172.21.15.36:0/2435242962 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:41.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf23fff700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf2c113bd0 0x7faf2c152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf2b7fe700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c004500 0x7faf2c0afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf2bfff700 1 -- 172.21.15.36:0/2435242962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf2c113bd0 msgr2=0x7faf2c152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf2bfff700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf2c113bd0 0x7faf2c152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf2bfff700 1 -- 172.21.15.36:0/2435242962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c004500 msgr2=0x7faf2c0afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf2bfff700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c004500 0x7faf2c0afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf2bfff700 1 -- 172.21.15.36:0/2435242962 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c1524f0 con 0x7faf2c155940 2022-01-10T01:24:41.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.592+0000 7faf2b7fe700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c004500 0x7faf2c0afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:41.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.596+0000 7faf2bfff700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf2c155940 0x7faf2c155dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7faf24001210 tx=0x7faf2c0b6d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:41.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.596+0000 7faf297fa700 1 -- 172.21.15.36:0/2435242962 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf24010640 con 0x7faf2c155940 2022-01-10T01:24:41.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.596+0000 7faf297fa700 1 -- 172.21.15.36:0/2435242962 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf240107a0 con 0x7faf2c155940 2022-01-10T01:24:41.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.596+0000 7faf30e22700 1 -- 172.21.15.36:0/2435242962 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2c152790 con 0x7faf2c155940 2022-01-10T01:24:41.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.596+0000 7faf297fa700 1 -- 172.21.15.36:0/2435242962 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf24010b00 con 0x7faf2c155940 2022-01-10T01:24:41.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.596+0000 7faf30e22700 1 -- 172.21.15.36:0/2435242962 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2c1146f0 con 0x7faf2c155940 2022-01-10T01:24:41.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.596+0000 7faf297fa700 1 -- 172.21.15.36:0/2435242962 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7faf24010c60 con 0x7faf2c155940 2022-01-10T01:24:41.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.596+0000 7faf30e22700 1 -- 172.21.15.36:0/2435242962 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c152920 con 0x7faf2c155940 2022-01-10T01:24:41.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.596+0000 7faf297fa700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faf100535f0 0x7faf10055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.596+0000 7faf2b7fe700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faf100535f0 0x7faf10055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.596+0000 7faf297fa700 1 -- 172.21.15.36:0/2435242962 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7faf2406b070 con 0x7faf2c155940 2022-01-10T01:24:41.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.600+0000 7faf2b7fe700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faf100535f0 0x7faf10055ab0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7faf1c00b000 tx=0x7faf1c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:41.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.608+0000 7faf297fa700 1 -- 172.21.15.36:0/2435242962 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf24045ab0 con 0x7faf2c155940 2022-01-10T01:24:41.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.736+0000 7faf30e22700 1 -- 172.21.15.36:0/2435242962 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faf2c057350 con 0x7faf2c155940 2022-01-10T01:24:41.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.736+0000 7faf297fa700 1 -- 172.21.15.36:0/2435242962 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7faf240456a0 con 0x7faf2c155940 2022-01-10T01:24:41.744 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:41.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.740+0000 7faf30e22700 1 -- 172.21.15.36:0/2435242962 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faf100535f0 msgr2=0x7faf10055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.740+0000 7faf30e22700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faf100535f0 0x7faf10055ab0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7faf1c00b000 tx=0x7faf1c008040).stop 2022-01-10T01:24:41.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.740+0000 7faf30e22700 1 -- 172.21.15.36:0/2435242962 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf2c155940 msgr2=0x7faf2c155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.740+0000 7faf30e22700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf2c155940 0x7faf2c155dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7faf24001210 tx=0x7faf2c0b6d40).stop 2022-01-10T01:24:41.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.740+0000 7faf30e22700 1 -- 172.21.15.36:0/2435242962 shutdown_connections 2022-01-10T01:24:41.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.740+0000 7faf30e22700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faf100535f0 0x7faf10055ab0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.740+0000 7faf30e22700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf2c155940 0x7faf2c155dc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.740+0000 7faf30e22700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf2c113bd0 0x7faf2c152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.740+0000 7faf30e22700 1 --2- 172.21.15.36:0/2435242962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf0c004500 0x7faf2c0afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.740+0000 7faf30e22700 1 -- 172.21.15.36:0/2435242962 >> 172.21.15.36:0/2435242962 conn(0x7faf2c06adf0 msgr2=0x7faf2c13f460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:41.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.740+0000 7faf30e22700 1 -- 172.21.15.36:0/2435242962 shutdown_connections 2022-01-10T01:24:41.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.740+0000 7faf30e22700 1 -- 172.21.15.36:0/2435242962 wait complete. 2022-01-10T01:24:41.762 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:24:41.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 Processor -- start 2022-01-10T01:24:41.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 -- start start 2022-01-10T01:24:41.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc65c0a9ec0 0x7fc65c0aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc65c0603d0 0x7fc65c13ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65c061990 con 0x7fc65c13d1c0 2022-01-10T01:24:41.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65c05cba0 con 0x7fc65c0a9ec0 2022-01-10T01:24:41.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65c061c30 con 0x7fc65c0603d0 2022-01-10T01:24:41.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc65bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc65c0a9ec0 0x7fc65c0aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc65bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc65c0a9ec0 0x7fc65c0aa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34352/0 (socket says 172.21.15.36:34352) 2022-01-10T01:24:41.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc65bfff700 1 -- 172.21.15.36:0/2799606408 learned_addr learned my addr 172.21.15.36:0/2799606408 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:41.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc65b7fe700 1 --2- 172.21.15.36:0/2799606408 >> v2:172.21.15.59:3300/0 conn(0x7fc65c0603d0 0x7fc65c13ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc65bfff700 1 -- 172.21.15.36:0/2799606408 >> v2:172.21.15.59:3300/0 conn(0x7fc65c0603d0 msgr2=0x7fc65c13ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:41.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc65bfff700 1 --2- 172.21.15.36:0/2799606408 >> v2:172.21.15.59:3300/0 conn(0x7fc65c0603d0 0x7fc65c13ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc65bfff700 1 -- 172.21.15.36:0/2799606408 >> v1:172.21.15.59:6789/0 conn(0x7fc65c13d1c0 legacy=0x7fc65c05c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc65bfff700 1 -- 172.21.15.36:0/2799606408 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c060b90 con 0x7fc65c0a9ec0 2022-01-10T01:24:41.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc65bfff700 1 --2- 172.21.15.36:0/2799606408 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc65c0a9ec0 0x7fc65c0aa2a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fc65c0aaaf0 tx=0x7fc64c006f40).ready entity=mon.0 client_cookie=c278ccd587bfce2f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:41.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc65affd700 1 -- 172.21.15.36:0/2799606408 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc64c00da40 con 0x7fc65c0a9ec0 2022-01-10T01:24:41.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc65affd700 1 -- 172.21.15.36:0/2799606408 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c000e90 con 0x7fc65c0a9ec0 2022-01-10T01:24:41.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc65affd700 1 -- 172.21.15.36:0/2799606408 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc64c00ddd0 con 0x7fc65c0a9ec0 2022-01-10T01:24:41.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 -- 172.21.15.36:0/2799606408 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc65c0a9ec0 msgr2=0x7fc65c0aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 --2- 172.21.15.36:0/2799606408 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc65c0a9ec0 0x7fc65c0aa2a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fc65c0aaaf0 tx=0x7fc64c006f40).stop 2022-01-10T01:24:41.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 -- 172.21.15.36:0/2799606408 shutdown_connections 2022-01-10T01:24:41.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 --2- 172.21.15.36:0/2799606408 >> v2:172.21.15.59:3300/0 conn(0x7fc65c0603d0 0x7fc65c13ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 --2- 172.21.15.36:0/2799606408 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc65c0a9ec0 0x7fc65c0aa2a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 -- 172.21.15.36:0/2799606408 >> 172.21.15.36:0/2799606408 conn(0x7fc65c0b2970 msgr2=0x7fc65c0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:41.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 -- 172.21.15.36:0/2799606408 shutdown_connections 2022-01-10T01:24:41.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.864+0000 7fc662824700 1 -- 172.21.15.36:0/2799606408 wait complete. 2022-01-10T01:24:41.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc662824700 1 Processor -- start 2022-01-10T01:24:41.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc662824700 1 -- start start 2022-01-10T01:24:41.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc662824700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc65c0603d0 0x7fc65c13f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc662824700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc65c0a9ec0 0x7fc65c0ad480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc662824700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc65c13d1c0 0x7fc65c1371a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc662824700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c13ec50 con 0x7fc65c0603d0 2022-01-10T01:24:41.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc662824700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c1404d0 con 0x7fc65c13d1c0 2022-01-10T01:24:41.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc662824700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c13e9b0 con 0x7fc65c0a9ec0 2022-01-10T01:24:41.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc65bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc65c0603d0 0x7fc65c13f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc65bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc65c0603d0 0x7fc65c13f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34358/0 (socket says 172.21.15.36:34358) 2022-01-10T01:24:41.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc65bfff700 1 -- 172.21.15.36:0/1865853591 learned_addr learned my addr 172.21.15.36:0/1865853591 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:41.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc65b7fe700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc65c0a9ec0 0x7fc65c0ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc660dc1700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc65c13d1c0 0x7fc65c1371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc65bfff700 1 -- 172.21.15.36:0/1865853591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc65c0a9ec0 msgr2=0x7fc65c0ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc65bfff700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc65c0a9ec0 0x7fc65c0ad480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc65bfff700 1 -- 172.21.15.36:0/1865853591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc65c13d1c0 msgr2=0x7fc65c1371a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:41.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc65bfff700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc65c13d1c0 0x7fc65c1371a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:41.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc65bfff700 1 -- 172.21.15.36:0/1865853591 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c00b460 con 0x7fc65c0603d0 2022-01-10T01:24:41.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc660dc1700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc65c13d1c0 0x7fc65c1371a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:41.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.868+0000 7fc65bfff700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc65c0603d0 0x7fc65c13f1d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fc65c0aaaf0 tx=0x7fc65c060d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:41.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.872+0000 7fc6597fa700 1 -- 172.21.15.36:0/1865853591 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc64c01d070 con 0x7fc65c0603d0 2022-01-10T01:24:41.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.872+0000 7fc6597fa700 1 -- 172.21.15.36:0/1865853591 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c022410 con 0x7fc65c0603d0 2022-01-10T01:24:41.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.872+0000 7fc662824700 1 -- 172.21.15.36:0/1865853591 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65c13ff90 con 0x7fc65c0603d0 2022-01-10T01:24:41.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.872+0000 7fc6597fa700 1 -- 172.21.15.36:0/1865853591 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc64c022770 con 0x7fc65c0603d0 2022-01-10T01:24:41.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.872+0000 7fc662824700 1 -- 172.21.15.36:0/1865853591 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c0af680 con 0x7fc65c0603d0 2022-01-10T01:24:41.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.872+0000 7fc662824700 1 -- 172.21.15.36:0/1865853591 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65c13eec0 con 0x7fc65c0603d0 2022-01-10T01:24:41.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.872+0000 7fc6597fa700 1 -- 172.21.15.36:0/1865853591 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc64c029070 con 0x7fc65c0603d0 2022-01-10T01:24:41.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.872+0000 7fc6597fa700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc63c0534d0 0x7fc63c055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:41.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.872+0000 7fc6597fa700 1 -- 172.21.15.36:0/1865853591 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fc64c06cff0 con 0x7fc65c0603d0 2022-01-10T01:24:41.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.872+0000 7fc65b7fe700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc63c0534d0 0x7fc63c055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:41.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.876+0000 7fc65b7fe700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc63c0534d0 0x7fc63c055990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fc65000b000 tx=0x7fc650006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:41.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:41.880+0000 7fc6597fa700 1 -- 172.21.15.36:0/1865853591 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc64c043f30 con 0x7fc65c0603d0 2022-01-10T01:24:42.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.008+0000 7fc662824700 1 -- 172.21.15.36:0/1865853591 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc65c060e30 con 0x7fc65c0603d0 2022-01-10T01:24:42.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.008+0000 7fc6597fa700 1 -- 172.21.15.36:0/1865853591 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc64c047550 con 0x7fc65c0603d0 2022-01-10T01:24:42.016 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:42.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.012+0000 7fc662824700 1 -- 172.21.15.36:0/1865853591 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc63c0534d0 msgr2=0x7fc63c055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:42.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.012+0000 7fc662824700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc63c0534d0 0x7fc63c055990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fc65000b000 tx=0x7fc650006df0).stop 2022-01-10T01:24:42.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.012+0000 7fc662824700 1 -- 172.21.15.36:0/1865853591 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc65c0603d0 msgr2=0x7fc65c13f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:42.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.012+0000 7fc662824700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc65c0603d0 0x7fc65c13f1d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fc65c0aaaf0 tx=0x7fc65c060d20).stop 2022-01-10T01:24:42.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.012+0000 7fc662824700 1 -- 172.21.15.36:0/1865853591 shutdown_connections 2022-01-10T01:24:42.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.012+0000 7fc662824700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc63c0534d0 0x7fc63c055990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.012+0000 7fc662824700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc65c13d1c0 0x7fc65c1371a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.012+0000 7fc662824700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc65c0a9ec0 0x7fc65c0ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.012+0000 7fc662824700 1 --2- 172.21.15.36:0/1865853591 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc65c0603d0 0x7fc65c13f1d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.012+0000 7fc662824700 1 -- 172.21.15.36:0/1865853591 >> 172.21.15.36:0/1865853591 conn(0x7fc65c0b2970 msgr2=0x7fc65c13bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:42.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.012+0000 7fc662824700 1 -- 172.21.15.36:0/1865853591 shutdown_connections 2022-01-10T01:24:42.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.012+0000 7fc662824700 1 -- 172.21.15.36:0/1865853591 wait complete. 2022-01-10T01:24:42.036 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:24:42.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 Processor -- start 2022-01-10T01:24:42.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 -- start start 2022-01-10T01:24:42.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63c80b6380 0x7f63c813d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:42.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63c8064370 0x7f63c813d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:42.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c813daf0 con 0x7f63c80b0cd0 2022-01-10T01:24:42.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c8066960 con 0x7f63c80b6380 2022-01-10T01:24:42.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c8066c00 con 0x7f63c8064370 2022-01-10T01:24:42.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c67fc700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f63c80b0cd0 0x7f63c8060830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60392/0 (socket says 172.21.15.36:60392) 2022-01-10T01:24:42.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c67fc700 1 -- 172.21.15.36:0/2109160367 learned_addr learned my addr 172.21.15.36:0/2109160367 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:42.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c77fe700 1 --2- 172.21.15.36:0/2109160367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63c8064370 0x7f63c813d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:42.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c6ffd700 1 --2- 172.21.15.36:0/2109160367 >> v2:172.21.15.59:3300/0 conn(0x7f63c80b6380 0x7f63c813d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:42.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c5ffb700 1 -- 172.21.15.36:0/2109160367 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822825124 0 0) 0x7f63c813daf0 con 0x7f63c80b0cd0 2022-01-10T01:24:42.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c5ffb700 1 -- 172.21.15.36:0/2109160367 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63a8003260 con 0x7f63c80b0cd0 2022-01-10T01:24:42.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c77fe700 1 -- 172.21.15.36:0/2109160367 >> v2:172.21.15.59:3300/0 conn(0x7f63c80b6380 msgr2=0x7f63c813d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:42.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c77fe700 1 --2- 172.21.15.36:0/2109160367 >> v2:172.21.15.59:3300/0 conn(0x7f63c80b6380 0x7f63c813d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c77fe700 1 -- 172.21.15.36:0/2109160367 >> v1:172.21.15.36:6789/0 conn(0x7f63c80b0cd0 legacy=0x7f63c8060830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:42.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c77fe700 1 -- 172.21.15.36:0/2109160367 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c8066ea0 con 0x7f63c8064370 2022-01-10T01:24:42.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c77fe700 1 --2- 172.21.15.36:0/2109160367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63c8064370 0x7f63c813d600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f63b8002f70 tx=0x7f63b8006df0).ready entity=mon.2 client_cookie=ed816b9de17ebb6e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:42.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c5ffb700 1 -- 172.21.15.36:0/2109160367 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63b800d4a0 con 0x7f63c8064370 2022-01-10T01:24:42.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c5ffb700 1 -- 172.21.15.36:0/2109160367 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b8000e90 con 0x7f63c8064370 2022-01-10T01:24:42.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c5ffb700 1 -- 172.21.15.36:0/2109160367 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63b800d7f0 con 0x7f63c8064370 2022-01-10T01:24:42.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 -- 172.21.15.36:0/2109160367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63c8064370 msgr2=0x7f63c813d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:42.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 --2- 172.21.15.36:0/2109160367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63c8064370 0x7f63c813d600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f63b8002f70 tx=0x7f63b8006df0).stop 2022-01-10T01:24:42.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 -- 172.21.15.36:0/2109160367 shutdown_connections 2022-01-10T01:24:42.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 --2- 172.21.15.36:0/2109160367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63c8064370 0x7f63c813d600 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 --2- 172.21.15.36:0/2109160367 >> v2:172.21.15.59:3300/0 conn(0x7f63c80b6380 0x7f63c813d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 -- 172.21.15.36:0/2109160367 >> 172.21.15.36:0/2109160367 conn(0x7f63c8063670 msgr2=0x7f63c8063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:42.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 -- 172.21.15.36:0/2109160367 shutdown_connections 2022-01-10T01:24:42.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.140+0000 7f63c7fff700 1 -- 172.21.15.36:0/2109160367 wait complete. 2022-01-10T01:24:42.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c7fff700 1 Processor -- start 2022-01-10T01:24:42.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c7fff700 1 -- start start 2022-01-10T01:24:42.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63c8064370 0x7f63c80afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:42.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63c80b0cd0 0x7f63c80aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:42.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63c80b6380 0x7f63c80ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:42.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c7fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80ad890 con 0x7f63c8064370 2022-01-10T01:24:42.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c7fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c81404a0 con 0x7f63c80b6380 2022-01-10T01:24:42.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c7fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80af450 con 0x7f63c80b0cd0 2022-01-10T01:24:42.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c6ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63c8064370 0x7f63c80afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:42.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c6ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63c8064370 0x7f63c80afd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34370/0 (socket says 172.21.15.36:34370) 2022-01-10T01:24:42.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c6ffd700 1 -- 172.21.15.36:0/861599574 learned_addr learned my addr 172.21.15.36:0/861599574 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:42.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c77fe700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63c80b6380 0x7f63c80ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:42.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c67fc700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63c80b0cd0 0x7f63c80aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:42.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c6ffd700 1 -- 172.21.15.36:0/861599574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63c80b0cd0 msgr2=0x7f63c80aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:42.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c6ffd700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63c80b0cd0 0x7f63c80aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c6ffd700 1 -- 172.21.15.36:0/861599574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63c80b6380 msgr2=0x7f63c80ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:42.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c6ffd700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63c80b6380 0x7f63c80ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c6ffd700 1 -- 172.21.15.36:0/861599574 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b800b180 con 0x7f63c8064370 2022-01-10T01:24:42.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c77fe700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63c80b6380 0x7f63c80ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:42.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c6ffd700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63c8064370 0x7f63c80afd90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f63b000e000 tx=0x7f63b000a040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:42.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63bffff700 1 -- 172.21.15.36:0/861599574 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63b00070d0 con 0x7f63c8064370 2022-01-10T01:24:42.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63bffff700 1 -- 172.21.15.36:0/861599574 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b0007230 con 0x7f63c8064370 2022-01-10T01:24:42.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63c7fff700 1 -- 172.21.15.36:0/861599574 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c80a9a60 con 0x7f63c8064370 2022-01-10T01:24:42.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.144+0000 7f63bffff700 1 -- 172.21.15.36:0/861599574 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63b0007590 con 0x7f63c8064370 2022-01-10T01:24:42.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.148+0000 7f63c7fff700 1 -- 172.21.15.36:0/861599574 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c8140900 con 0x7f63c8064370 2022-01-10T01:24:42.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.148+0000 7f63c7fff700 1 -- 172.21.15.36:0/861599574 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c8057350 con 0x7f63c8064370 2022-01-10T01:24:42.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.148+0000 7f63bffff700 1 -- 172.21.15.36:0/861599574 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f63b0005900 con 0x7f63c8064370 2022-01-10T01:24:42.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.148+0000 7f63bffff700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f63ac0535f0 0x7f63ac055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:42.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.148+0000 7f63bffff700 1 -- 172.21.15.36:0/861599574 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f63b006bf00 con 0x7f63c8064370 2022-01-10T01:24:42.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.148+0000 7f63c67fc700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f63ac0535f0 0x7f63ac055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:42.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.148+0000 7f63c67fc700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f63ac0535f0 0x7f63ac055ab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f63c000d000 tx=0x7f63c0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:42.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.156+0000 7f63bffff700 1 -- 172.21.15.36:0/861599574 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f63b0042f10 con 0x7f63c8064370 2022-01-10T01:24:42.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.284+0000 7f63c7fff700 1 -- 172.21.15.36:0/861599574 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63c806aaf0 con 0x7f63c8064370 2022-01-10T01:24:42.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.284+0000 7f63bffff700 1 -- 172.21.15.36:0/861599574 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f63b0046530 con 0x7f63c8064370 2022-01-10T01:24:42.292 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:42.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.288+0000 7f63c7fff700 1 -- 172.21.15.36:0/861599574 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f63ac0535f0 msgr2=0x7f63ac055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:42.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.288+0000 7f63c7fff700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f63ac0535f0 0x7f63ac055ab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f63c000d000 tx=0x7f63c0009040).stop 2022-01-10T01:24:42.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.288+0000 7f63c7fff700 1 -- 172.21.15.36:0/861599574 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63c8064370 msgr2=0x7f63c80afd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:42.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.288+0000 7f63c7fff700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63c8064370 0x7f63c80afd90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f63b000e000 tx=0x7f63b000a040).stop 2022-01-10T01:24:42.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.288+0000 7f63c7fff700 1 -- 172.21.15.36:0/861599574 shutdown_connections 2022-01-10T01:24:42.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.288+0000 7f63c7fff700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f63ac0535f0 0x7f63ac055ab0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.288+0000 7f63c7fff700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63c80b6380 0x7f63c80ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.288+0000 7f63c7fff700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63c80b0cd0 0x7f63c80aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.288+0000 7f63c7fff700 1 --2- 172.21.15.36:0/861599574 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f63c8064370 0x7f63c80afd90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.288+0000 7f63c7fff700 1 -- 172.21.15.36:0/861599574 >> 172.21.15.36:0/861599574 conn(0x7f63c8063670 msgr2=0x7f63c805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:42.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.288+0000 7f63c7fff700 1 -- 172.21.15.36:0/861599574 shutdown_connections 2022-01-10T01:24:42.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.288+0000 7f63c7fff700 1 -- 172.21.15.36:0/861599574 wait complete. 2022-01-10T01:24:42.304 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:24:42.305 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:24:42.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cdb03700 1 Processor -- start 2022-01-10T01:24:42.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cdb03700 1 -- start start 2022-01-10T01:24:42.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cdb03700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75c80b30d0 0x7f75c8143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:42.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cdb03700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c80ace70 0x7f75c813f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:42.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cdb03700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c8143920 con 0x7f75c80b0710 2022-01-10T01:24:42.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cdb03700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c80b0af0 con 0x7f75c80b30d0 2022-01-10T01:24:42.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cdb03700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80ae680 con 0x7f75c80ace70 2022-01-10T01:24:42.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cd302700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c80ace70 0x7f75c813f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:42.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cd302700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c80ace70 0x7f75c813f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:40662/0 (socket says 172.21.15.36:40662) 2022-01-10T01:24:42.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cd302700 1 -- 172.21.15.36:0/360398757 learned_addr learned my addr 172.21.15.36:0/360398757 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:42.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75c7fff700 1 --2- 172.21.15.36:0/360398757 >> v2:172.21.15.59:3300/0 conn(0x7f75c80b30d0 0x7f75c8143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:42.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cd302700 1 -- 172.21.15.36:0/360398757 >> v2:172.21.15.59:3300/0 conn(0x7f75c80b30d0 msgr2=0x7f75c8143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:42.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cd302700 1 --2- 172.21.15.36:0/360398757 >> v2:172.21.15.59:3300/0 conn(0x7f75c80b30d0 0x7f75c8143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cd302700 1 -- 172.21.15.36:0/360398757 >> v1:172.21.15.59:6789/0 conn(0x7f75c80b0710 legacy=0x7f75c8142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:42.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cd302700 1 -- 172.21.15.36:0/360398757 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c80ae920 con 0x7f75c80ace70 2022-01-10T01:24:42.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75cd302700 1 --2- 172.21.15.36:0/360398757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c80ace70 0x7f75c813f8a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f75c00032f0 tx=0x7f75c0009290).ready entity=mon.2 client_cookie=cbf460fb82481ce5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:42.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.404+0000 7f75c77fe700 1 -- 172.21.15.36:0/360398757 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75c000b8a0 con 0x7f75c80ace70 2022-01-10T01:24:42.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75c77fe700 1 -- 172.21.15.36:0/360398757 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c000ba00 con 0x7f75c80ace70 2022-01-10T01:24:42.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75c77fe700 1 -- 172.21.15.36:0/360398757 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75c000bb70 con 0x7f75c80ace70 2022-01-10T01:24:42.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 -- 172.21.15.36:0/360398757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c80ace70 msgr2=0x7f75c813f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:42.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 --2- 172.21.15.36:0/360398757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c80ace70 0x7f75c813f8a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f75c00032f0 tx=0x7f75c0009290).stop 2022-01-10T01:24:42.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 -- 172.21.15.36:0/360398757 shutdown_connections 2022-01-10T01:24:42.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 --2- 172.21.15.36:0/360398757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c80ace70 0x7f75c813f8a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 --2- 172.21.15.36:0/360398757 >> v2:172.21.15.59:3300/0 conn(0x7f75c80b30d0 0x7f75c8143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 -- 172.21.15.36:0/360398757 >> 172.21.15.36:0/360398757 conn(0x7f75c8061140 msgr2=0x7f75c8062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:42.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 -- 172.21.15.36:0/360398757 shutdown_connections 2022-01-10T01:24:42.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 -- 172.21.15.36:0/360398757 wait complete. 2022-01-10T01:24:42.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 Processor -- start 2022-01-10T01:24:42.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 -- start start 2022-01-10T01:24:42.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f75c80ace70 0x7f75c80ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:42.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75c80b0710 0x7f75c80a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:42.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c80b30d0 0x7f75c80a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:42.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80abdd0 con 0x7f75c80ace70 2022-01-10T01:24:42.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80aae50 con 0x7f75c80b0710 2022-01-10T01:24:42.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.408+0000 7f75cdb03700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c80a9e90 con 0x7f75c80b30d0 2022-01-10T01:24:42.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75ccb01700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f75c80ace70 0x7f75c80ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:42.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75ccb01700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f75c80ace70 0x7f75c80ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34384/0 (socket says 172.21.15.36:34384) 2022-01-10T01:24:42.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75ccb01700 1 -- 172.21.15.36:0/265531796 learned_addr learned my addr 172.21.15.36:0/265531796 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:42.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75cd302700 1 --2- 172.21.15.36:0/265531796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c80b30d0 0x7f75c80a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:42.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75c7fff700 1 --2- 172.21.15.36:0/265531796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75c80b0710 0x7f75c80a7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:42.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75ccb01700 1 -- 172.21.15.36:0/265531796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c80b30d0 msgr2=0x7f75c80a7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:42.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75ccb01700 1 --2- 172.21.15.36:0/265531796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c80b30d0 0x7f75c80a7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75ccb01700 1 -- 172.21.15.36:0/265531796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75c80b0710 msgr2=0x7f75c80a7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:42.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75ccb01700 1 --2- 172.21.15.36:0/265531796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75c80b0710 0x7f75c80a7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75ccb01700 1 -- 172.21.15.36:0/265531796 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c0009530 con 0x7f75c80ace70 2022-01-10T01:24:42.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75ccb01700 1 --2- 172.21.15.36:0/265531796 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f75c80ace70 0x7f75c80ac310 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f75c80aaf90 tx=0x7f75bc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:42.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75c5ffb700 1 -- 172.21.15.36:0/265531796 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75bc012400 con 0x7f75c80ace70 2022-01-10T01:24:42.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75c5ffb700 1 -- 172.21.15.36:0/265531796 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc012560 con 0x7f75c80ace70 2022-01-10T01:24:42.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75cdb03700 1 -- 172.21.15.36:0/265531796 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c8063a30 con 0x7f75c80ace70 2022-01-10T01:24:42.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75c5ffb700 1 -- 172.21.15.36:0/265531796 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75bc0128c0 con 0x7f75c80ace70 2022-01-10T01:24:42.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75cdb03700 1 -- 172.21.15.36:0/265531796 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c80ab930 con 0x7f75c80ace70 2022-01-10T01:24:42.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75cdb03700 1 -- 172.21.15.36:0/265531796 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c80aab00 con 0x7f75c80ace70 2022-01-10T01:24:42.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.412+0000 7f75c5ffb700 1 -- 172.21.15.36:0/265531796 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f75bc019030 con 0x7f75c80ace70 2022-01-10T01:24:42.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.416+0000 7f75c5ffb700 1 --2- 172.21.15.36:0/265531796 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f75a8053500 0x7f75a80559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:42.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.416+0000 7f75c5ffb700 1 -- 172.21.15.36:0/265531796 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f75bc06ad00 con 0x7f75c80ace70 2022-01-10T01:24:42.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.416+0000 7f75c7fff700 1 --2- 172.21.15.36:0/265531796 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f75a8053500 0x7f75a80559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:42.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.416+0000 7f75c7fff700 1 --2- 172.21.15.36:0/265531796 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f75a8053500 0x7f75a80559c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f75b400c000 tx=0x7f75b4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:42.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.420+0000 7f75c5ffb700 1 -- 172.21.15.36:0/265531796 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f75bc06e030 con 0x7f75c80ace70 2022-01-10T01:24:42.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.584+0000 7f75cdb03700 1 -- 172.21.15.36:0/265531796 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75c8057350 con 0x7f75c80ace70 2022-01-10T01:24:42.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.584+0000 7f75c5ffb700 1 -- 172.21.15.36:0/265531796 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7f75bc041cb0 con 0x7f75c80ace70 2022-01-10T01:24:42.592 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:42.592 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3870348387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3870348387},{"type":"v1","addr":"172.21.15.59:6833","nonce":3870348387}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2808909651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2808909651},{"type":"v1","addr":"172.21.15.36:6835","nonce":2808909651}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:24:25.225258+0000","modified":"2022-01-10T01:24:26.981594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/1089668836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1089668836},{"type":"v1","addr":"172.21.15.36:6837","nonce":1089668836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-01-10T01:24:42.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.588+0000 7f75cdb03700 1 -- 172.21.15.36:0/265531796 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f75a8053500 msgr2=0x7f75a80559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:42.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.588+0000 7f75cdb03700 1 --2- 172.21.15.36:0/265531796 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f75a8053500 0x7f75a80559c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f75b400c000 tx=0x7f75b4008040).stop 2022-01-10T01:24:42.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.588+0000 7f75cdb03700 1 -- 172.21.15.36:0/265531796 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f75c80ace70 msgr2=0x7f75c80ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:42.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.588+0000 7f75cdb03700 1 --2- 172.21.15.36:0/265531796 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f75c80ace70 0x7f75c80ac310 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f75c80aaf90 tx=0x7f75bc007c50).stop 2022-01-10T01:24:42.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.588+0000 7f75cdb03700 1 -- 172.21.15.36:0/265531796 shutdown_connections 2022-01-10T01:24:42.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.588+0000 7f75cdb03700 1 --2- 172.21.15.36:0/265531796 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f75a8053500 0x7f75a80559c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.588+0000 7f75cdb03700 1 --2- 172.21.15.36:0/265531796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c80b30d0 0x7f75c80a7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.588+0000 7f75cdb03700 1 --2- 172.21.15.36:0/265531796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75c80b0710 0x7f75c80a7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.588+0000 7f75cdb03700 1 --2- 172.21.15.36:0/265531796 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f75c80ace70 0x7f75c80ac310 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:42.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.588+0000 7f75cdb03700 1 -- 172.21.15.36:0/265531796 >> 172.21.15.36:0/265531796 conn(0x7f75c8061140 msgr2=0x7f75c8142c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:42.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.588+0000 7f75cdb03700 1 -- 172.21.15.36:0/265531796 shutdown_connections 2022-01-10T01:24:42.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:42.588+0000 7f75cdb03700 1 -- 172.21.15.36:0/265531796 wait complete. 2022-01-10T01:24:42.597 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 7 2022-01-10T01:24:42.912 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:24:25.225258+0000', 'modified': '2022-01-10T01:24:26.981594+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'c', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6837/1089668836', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6836', 'nonce': 1089668836}, {'type': 'v1', 'addr': '172.21.15.36:6837', 'nonce': 1089668836}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:24:42.912 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:24:42.913 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2022-01-10T01:24:43.033 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":4284,"want_state":"up:active","state":"up:active","rank_uptime":17.794789448,"mdsmap_epoch":7,"osdmap_epoch":24,"osdmap_epoch_barrier":24,"uptime":24.148637659999999} 2022-01-10T01:24:43.033 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 4284, "mdsmap_epoch": 7, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "rank_uptime": 17.794789448, "state": "up:active", "uptime": 24.14863766, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:24:43.034 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:24:43.034 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2022-01-10T01:24:43.034 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi166.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2022-01-10T01:24:43.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:43.035 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:24:43.043 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:24:43.061 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:24:43.062 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:24:43.120 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:24:43.122 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:24:43.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:43.123 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:24:43.130 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:24:43.131 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:24:43.133 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:24:43.150 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:24:43.151 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:24:43.160 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:24:43.161 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:24:43.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:43.162 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:24:43.224 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[13906]: starting ceph client2022-01-10T01:24:43.218+0000 7f6523b87080 -1 init, newargv = 0x55584a6fcd70 newargc=9 2022-01-10T01:24:43.224 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr: 2022-01-10T01:24:43.235 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[13906]: starting fuse 2022-01-10T01:24:44.270 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:24:44.288 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:24:44.288 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:24:44.300 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:24:44.301 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:24:44.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:44.302 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:24:44.351 INFO:teuthology.orchestra.run.smithi166.stdout:52 2022-01-10T01:24:44.351 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:24:44.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:44.352 DEBUG:teuthology.orchestra.run.smithi166:> sudo python3 -c ' 2022-01-10T01:24:44.352 DEBUG:teuthology.orchestra.run.smithi166:> import glob 2022-01-10T01:24:44.353 DEBUG:teuthology.orchestra.run.smithi166:> import re 2022-01-10T01:24:44.353 DEBUG:teuthology.orchestra.run.smithi166:> import os 2022-01-10T01:24:44.353 DEBUG:teuthology.orchestra.run.smithi166:> import subprocess 2022-01-10T01:24:44.354 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:24:44.354 DEBUG:teuthology.orchestra.run.smithi166:> def find_socket(client_name): 2022-01-10T01:24:44.354 DEBUG:teuthology.orchestra.run.smithi166:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2022-01-10T01:24:44.355 DEBUG:teuthology.orchestra.run.smithi166:> files = glob.glob(asok_path) 2022-01-10T01:24:44.355 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:24:44.355 DEBUG:teuthology.orchestra.run.smithi166:> # Given a non-glob path, it better be there 2022-01-10T01:24:44.355 DEBUG:teuthology.orchestra.run.smithi166:> if "*" not in asok_path: 2022-01-10T01:24:44.356 DEBUG:teuthology.orchestra.run.smithi166:> assert(len(files) == 1) 2022-01-10T01:24:44.356 DEBUG:teuthology.orchestra.run.smithi166:> return files[0] 2022-01-10T01:24:44.356 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:24:44.357 DEBUG:teuthology.orchestra.run.smithi166:> for f in files: 2022-01-10T01:24:44.357 DEBUG:teuthology.orchestra.run.smithi166:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:24:44.357 DEBUG:teuthology.orchestra.run.smithi166:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:24:44.358 DEBUG:teuthology.orchestra.run.smithi166:> return f 2022-01-10T01:24:44.358 DEBUG:teuthology.orchestra.run.smithi166:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:24:44.358 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:24:44.359 DEBUG:teuthology.orchestra.run.smithi166:> print(find_socket("client.1")) 2022-01-10T01:24:44.359 DEBUG:teuthology.orchestra.run.smithi166:> ' 2022-01-10T01:24:44.403 INFO:teuthology.orchestra.run.smithi166.stdout:/var/run/ceph/ceph-client.1.13906.asok 2022-01-10T01:24:44.408 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13906.asok 2022-01-10T01:24:44.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:44.409 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13906.asok status 2022-01-10T01:24:44.530 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2022-01-10T01:24:44.530 INFO:teuthology.orchestra.run.smithi166.stdout: "metadata": { 2022-01-10T01:24:44.531 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:24:44.531 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:24:44.531 INFO:teuthology.orchestra.run.smithi166.stdout: "entity_id": "1", 2022-01-10T01:24:44.531 INFO:teuthology.orchestra.run.smithi166.stdout: "hostname": "smithi166", 2022-01-10T01:24:44.532 INFO:teuthology.orchestra.run.smithi166.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2022-01-10T01:24:44.532 INFO:teuthology.orchestra.run.smithi166.stdout: "pid": "13906", 2022-01-10T01:24:44.532 INFO:teuthology.orchestra.run.smithi166.stdout: "root": "/" 2022-01-10T01:24:44.532 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:24:44.532 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_count": 0, 2022-01-10T01:24:44.533 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_pinned_count": 0, 2022-01-10T01:24:44.533 INFO:teuthology.orchestra.run.smithi166.stdout: "id": 4677, 2022-01-10T01:24:44.533 INFO:teuthology.orchestra.run.smithi166.stdout: "inst": { 2022-01-10T01:24:44.533 INFO:teuthology.orchestra.run.smithi166.stdout: "name": { 2022-01-10T01:24:44.533 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "client", 2022-01-10T01:24:44.534 INFO:teuthology.orchestra.run.smithi166.stdout: "num": 4677 2022-01-10T01:24:44.534 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:24:44.534 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:24:44.534 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:24:44.534 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:24:44.535 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 2363948586 2022-01-10T01:24:44.535 INFO:teuthology.orchestra.run.smithi166.stdout: } 2022-01-10T01:24:44.535 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:24:44.535 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:24:44.536 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:24:44.536 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:24:44.536 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 2363948586 2022-01-10T01:24:44.536 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:24:44.536 INFO:teuthology.orchestra.run.smithi166.stdout: "inst_str": "client.4677 172.21.15.166:0/2363948586", 2022-01-10T01:24:44.537 INFO:teuthology.orchestra.run.smithi166.stdout: "addr_str": "172.21.15.166:0/2363948586", 2022-01-10T01:24:44.537 INFO:teuthology.orchestra.run.smithi166.stdout: "inode_count": 1, 2022-01-10T01:24:44.537 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_epoch": 7, 2022-01-10T01:24:44.537 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch": 24, 2022-01-10T01:24:44.538 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:24:44.538 INFO:teuthology.orchestra.run.smithi166.stdout: "blacklisted": false, 2022-01-10T01:24:44.538 INFO:teuthology.orchestra.run.smithi166.stdout: "fs_name": "cephfs" 2022-01-10T01:24:44.538 INFO:teuthology.orchestra.run.smithi166.stdout:} 2022-01-10T01:24:44.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:44.541 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:24:44.541 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:24:44.550 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:24:44.551 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:24:44.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:44.551 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:24:44.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:44.612 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:24:44.612 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:24:44.621 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:24:44.622 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:24:44.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:44.623 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:24:44.645 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2022-01-10T01:24:44.665 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:44.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 Processor -- start 2022-01-10T01:24:44.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 -- start start 2022-01-10T01:24:44.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff4a40b6580 0x7ff4a40b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:44.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4a40b43c0 0x7ff4a40b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:44.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a41440b0 con 0x7ff4a4061d30 2022-01-10T01:24:44.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a40b6e50 con 0x7ff4a40b6580 2022-01-10T01:24:44.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a4143b70 con 0x7ff4a40b43c0 2022-01-10T01:24:44.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4a3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff4a40b6580 0x7ff4a40b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:44.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4a8f5e700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff4a4061d30 0x7ff4a41466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60422/0 (socket says 172.21.15.36:60422) 2022-01-10T01:24:44.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4a8f5e700 1 -- 172.21.15.36:0/11496806 learned_addr learned my addr 172.21.15.36:0/11496806 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:44.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4a37fe700 1 --2- 172.21.15.36:0/11496806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4a40b43c0 0x7ff4a40b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:44.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4a3fff700 1 -- 172.21.15.36:0/11496806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4a40b43c0 msgr2=0x7ff4a40b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:44.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4a3fff700 1 --2- 172.21.15.36:0/11496806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4a40b43c0 0x7ff4a40b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:44.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4a3fff700 1 -- 172.21.15.36:0/11496806 >> v1:172.21.15.36:6789/0 conn(0x7ff4a4061d30 legacy=0x7ff4a41466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:44.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4a2ffd700 1 -- 172.21.15.36:0/11496806 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031964382 0 0) 0x7ff4a41440b0 con 0x7ff4a4061d30 2022-01-10T01:24:44.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4a3fff700 1 -- 172.21.15.36:0/11496806 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4143e10 con 0x7ff4a40b6580 2022-01-10T01:24:44.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4a3fff700 1 --2- 172.21.15.36:0/11496806 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff4a40b6580 0x7ff4a40b5bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7ff48c002f70 tx=0x7ff48c006df0).ready entity=mon.0 client_cookie=3291f83f503af807 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:44.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4a2ffd700 1 -- 172.21.15.36:0/11496806 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff48c00d570 con 0x7ff4a40b6580 2022-01-10T01:24:44.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4a2ffd700 1 -- 172.21.15.36:0/11496806 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c000e90 con 0x7ff4a40b6580 2022-01-10T01:24:44.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4a2ffd700 1 -- 172.21.15.36:0/11496806 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff48c00d8c0 con 0x7ff4a40b6580 2022-01-10T01:24:44.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/11496806 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff4a40b6580 msgr2=0x7ff4a40b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:44.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 --2- 172.21.15.36:0/11496806 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff4a40b6580 0x7ff4a40b5bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7ff48c002f70 tx=0x7ff48c006df0).stop 2022-01-10T01:24:44.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/11496806 shutdown_connections 2022-01-10T01:24:44.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 --2- 172.21.15.36:0/11496806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4a40b43c0 0x7ff4a40b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:44.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 --2- 172.21.15.36:0/11496806 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff4a40b6580 0x7ff4a40b5bf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:44.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/11496806 >> 172.21.15.36:0/11496806 conn(0x7ff4a405c490 msgr2=0x7ff4a405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:44.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/11496806 shutdown_connections 2022-01-10T01:24:44.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.772+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/11496806 wait complete. 2022-01-10T01:24:44.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4aa9c1700 1 Processor -- start 2022-01-10T01:24:44.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4aa9c1700 1 -- start start 2022-01-10T01:24:44.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4aa9c1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff4a4061d30 0x7ff4a40afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:44.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4aa9c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4a40b43c0 0x7ff4a4147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:44.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4aa9c1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4a40b6580 0x7ff4a40ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:44.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4aa9c1700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a414a040 con 0x7ff4a4061d30 2022-01-10T01:24:44.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4aa9c1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a40b0320 con 0x7ff4a40b6580 2022-01-10T01:24:44.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4aa9c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a414a270 con 0x7ff4a40b43c0 2022-01-10T01:24:44.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4a3fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff4a4061d30 0x7ff4a40afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:44.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4a3fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff4a4061d30 0x7ff4a40afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34400/0 (socket says 172.21.15.36:34400) 2022-01-10T01:24:44.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4a3fff700 1 -- 172.21.15.36:0/864492864 learned_addr learned my addr 172.21.15.36:0/864492864 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:44.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4a37fe700 1 --2- 172.21.15.36:0/864492864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4a40b43c0 0x7ff4a4147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:44.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4a8f5e700 1 --2- 172.21.15.36:0/864492864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4a40b6580 0x7ff4a40ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:44.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4a3fff700 1 -- 172.21.15.36:0/864492864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4a40b43c0 msgr2=0x7ff4a4147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:44.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4a3fff700 1 --2- 172.21.15.36:0/864492864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4a40b43c0 0x7ff4a4147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:44.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4a3fff700 1 -- 172.21.15.36:0/864492864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4a40b6580 msgr2=0x7ff4a40ad620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:44.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4a3fff700 1 --2- 172.21.15.36:0/864492864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4a40b6580 0x7ff4a40ad620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:44.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.776+0000 7ff4a3fff700 1 -- 172.21.15.36:0/864492864 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c00b180 con 0x7ff4a4061d30 2022-01-10T01:24:44.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.780+0000 7ff4a3fff700 1 --2- 172.21.15.36:0/864492864 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff4a4061d30 0x7ff4a40afcf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7ff48c002f70 tx=0x7ff48c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:44.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.780+0000 7ff4a17fa700 1 -- 172.21.15.36:0/864492864 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff48c00dea0 con 0x7ff4a4061d30 2022-01-10T01:24:44.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.780+0000 7ff4a17fa700 1 -- 172.21.15.36:0/864492864 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c013de0 con 0x7ff4a4061d30 2022-01-10T01:24:44.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.780+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/864492864 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a414a510 con 0x7ff4a4061d30 2022-01-10T01:24:44.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.780+0000 7ff4a17fa700 1 -- 172.21.15.36:0/864492864 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff48c01e5f0 con 0x7ff4a4061d30 2022-01-10T01:24:44.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.780+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/864492864 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a4147400 con 0x7ff4a4061d30 2022-01-10T01:24:44.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.780+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/864492864 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a414a6a0 con 0x7ff4a4061d30 2022-01-10T01:24:44.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.780+0000 7ff4a17fa700 1 -- 172.21.15.36:0/864492864 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff48c01c070 con 0x7ff4a4061d30 2022-01-10T01:24:44.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.780+0000 7ff4a17fa700 1 --2- 172.21.15.36:0/864492864 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff47c053620 0x7ff47c055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:44.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.780+0000 7ff4a17fa700 1 -- 172.21.15.36:0/864492864 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff48c06c3e0 con 0x7ff4a4061d30 2022-01-10T01:24:44.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.780+0000 7ff4a37fe700 1 --2- 172.21.15.36:0/864492864 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff47c053620 0x7ff47c055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:44.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.784+0000 7ff4a37fe700 1 --2- 172.21.15.36:0/864492864 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff47c053620 0x7ff47c055ae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7ff49400b000 tx=0x7ff4940091d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:44.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.788+0000 7ff4a17fa700 1 -- 172.21.15.36:0/864492864 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff48c0433d0 con 0x7ff4a4061d30 2022-01-10T01:24:44.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.908+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/864492864 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4a40615f0 con 0x7ff4a4061d30 2022-01-10T01:24:44.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.908+0000 7ff4a17fa700 1 -- 172.21.15.36:0/864492864 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16299 (secure 0 0 0) 0x7ff48c023090 con 0x7ff4a4061d30 2022-01-10T01:24:44.916 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:44.916 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:25.224959+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:24:20.202898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-10T01:24:22.952870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:44.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.912+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/864492864 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff47c053620 msgr2=0x7ff47c055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:44.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.912+0000 7ff4aa9c1700 1 --2- 172.21.15.36:0/864492864 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff47c053620 0x7ff47c055ae0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7ff49400b000 tx=0x7ff4940091d0).stop 2022-01-10T01:24:44.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.912+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/864492864 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff4a4061d30 msgr2=0x7ff4a40afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:44.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.912+0000 7ff4aa9c1700 1 --2- 172.21.15.36:0/864492864 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff4a4061d30 0x7ff4a40afcf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7ff48c002f70 tx=0x7ff48c014000).stop 2022-01-10T01:24:44.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.912+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/864492864 shutdown_connections 2022-01-10T01:24:44.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.912+0000 7ff4aa9c1700 1 --2- 172.21.15.36:0/864492864 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff47c053620 0x7ff47c055ae0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:44.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.912+0000 7ff4aa9c1700 1 --2- 172.21.15.36:0/864492864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4a40b6580 0x7ff4a40ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:44.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.912+0000 7ff4aa9c1700 1 --2- 172.21.15.36:0/864492864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4a40b43c0 0x7ff4a4147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:44.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.912+0000 7ff4aa9c1700 1 --2- 172.21.15.36:0/864492864 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff4a4061d30 0x7ff4a40afcf0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:44.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.912+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/864492864 >> 172.21.15.36:0/864492864 conn(0x7ff4a405c490 msgr2=0x7ff4a4141f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:44.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.912+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/864492864 shutdown_connections 2022-01-10T01:24:44.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:44.912+0000 7ff4aa9c1700 1 -- 172.21.15.36:0/864492864 wait complete. 2022-01-10T01:24:44.929 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:24:20.202898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:24:22.952870+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:24:44.930 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:24:45.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.036+0000 7fd69555b700 1 Processor -- start 2022-01-10T01:24:45.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.036+0000 7fd69555b700 1 -- start start 2022-01-10T01:24:45.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.036+0000 7fd69555b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6900b2720 0x7fd69013e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.036+0000 7fd69555b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd690141790 0x7fd69013e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.036+0000 7fd69555b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6900aaa90 con 0x7fd6900b0ff0 2022-01-10T01:24:45.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.036+0000 7fd69555b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd690141c20 con 0x7fd690141790 2022-01-10T01:24:45.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.036+0000 7fd69555b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd690140c90 con 0x7fd6900b2720 2022-01-10T01:24:45.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.036+0000 7fd694d5a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd690141790 0x7fd69013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.036+0000 7fd694d5a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd690141790 0x7fd69013e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34406/0 (socket says 172.21.15.36:34406) 2022-01-10T01:24:45.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.036+0000 7fd694d5a700 1 -- 172.21.15.36:0/4271961941 learned_addr learned my addr 172.21.15.36:0/4271961941 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:45.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.036+0000 7fd68ffff700 1 --2- 172.21.15.36:0/4271961941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6900b2720 0x7fd69013e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd694d5a700 1 -- 172.21.15.36:0/4271961941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6900b2720 msgr2=0x7fd69013e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:45.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd694d5a700 1 --2- 172.21.15.36:0/4271961941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6900b2720 0x7fd69013e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd694d5a700 1 -- 172.21.15.36:0/4271961941 >> v1:172.21.15.59:6789/0 conn(0x7fd6900b0ff0 legacy=0x7fd690141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd694d5a700 1 -- 172.21.15.36:0/4271961941 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6900b2b00 con 0x7fd690141790 2022-01-10T01:24:45.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd694d5a700 1 --2- 172.21.15.36:0/4271961941 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd690141790 0x7fd69013e520 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fd6880032f0 tx=0x7fd688009290).ready entity=mon.0 client_cookie=e780afea453b573d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:45.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd68f7fe700 1 -- 172.21.15.36:0/4271961941 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd68800b8a0 con 0x7fd690141790 2022-01-10T01:24:45.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd68f7fe700 1 -- 172.21.15.36:0/4271961941 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68800ba00 con 0x7fd690141790 2022-01-10T01:24:45.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd68f7fe700 1 -- 172.21.15.36:0/4271961941 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd68800bb70 con 0x7fd690141790 2022-01-10T01:24:45.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 -- 172.21.15.36:0/4271961941 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd690141790 msgr2=0x7fd69013e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 --2- 172.21.15.36:0/4271961941 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd690141790 0x7fd69013e520 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fd6880032f0 tx=0x7fd688009290).stop 2022-01-10T01:24:45.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 -- 172.21.15.36:0/4271961941 shutdown_connections 2022-01-10T01:24:45.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 --2- 172.21.15.36:0/4271961941 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd690141790 0x7fd69013e520 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 --2- 172.21.15.36:0/4271961941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6900b2720 0x7fd69013e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 -- 172.21.15.36:0/4271961941 >> 172.21.15.36:0/4271961941 conn(0x7fd690060180 msgr2=0x7fd6900b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:45.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 -- 172.21.15.36:0/4271961941 shutdown_connections 2022-01-10T01:24:45.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 -- 172.21.15.36:0/4271961941 wait complete. 2022-01-10T01:24:45.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 Processor -- start 2022-01-10T01:24:45.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 -- start start 2022-01-10T01:24:45.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6900b0ff0 0x7fd690144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6900b2720 0x7fd690143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd690141790 0x7fd690152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6901556d0 con 0x7fd690141790 2022-01-10T01:24:45.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6900b3e70 con 0x7fd6900b0ff0 2022-01-10T01:24:45.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd69555b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6900b4110 con 0x7fd6900b2720 2022-01-10T01:24:45.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd694d5a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd690141790 0x7fd690152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd68ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6900b0ff0 0x7fd690144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd68ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6900b0ff0 0x7fd690144b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:59276/0 (socket says 172.21.15.36:59276) 2022-01-10T01:24:45.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd68ffff700 1 -- 172.21.15.36:0/3890817839 learned_addr learned my addr 172.21.15.36:0/3890817839 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:45.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd694d5a700 1 --2- 172.21.15.36:0/3890817839 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd690141790 0x7fd690152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34414/0 (socket says 172.21.15.36:34414) 2022-01-10T01:24:45.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.040+0000 7fd6877fe700 1 --2- 172.21.15.36:0/3890817839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6900b2720 0x7fd690143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.044+0000 7fd694d5a700 1 -- 172.21.15.36:0/3890817839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6900b2720 msgr2=0x7fd690143780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.044+0000 7fd694d5a700 1 --2- 172.21.15.36:0/3890817839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6900b2720 0x7fd690143780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.044+0000 7fd694d5a700 1 -- 172.21.15.36:0/3890817839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6900b0ff0 msgr2=0x7fd690144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.044+0000 7fd694d5a700 1 --2- 172.21.15.36:0/3890817839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6900b0ff0 0x7fd690144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.044+0000 7fd694d5a700 1 -- 172.21.15.36:0/3890817839 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd688009530 con 0x7fd690141790 2022-01-10T01:24:45.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.044+0000 7fd694d5a700 1 --2- 172.21.15.36:0/3890817839 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd690141790 0x7fd690152740 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fd6880032f0 tx=0x7fd688016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:45.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.044+0000 7fd68dffb700 1 -- 172.21.15.36:0/3890817839 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd68800b8a0 con 0x7fd690141790 2022-01-10T01:24:45.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.044+0000 7fd68dffb700 1 -- 172.21.15.36:0/3890817839 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd688021480 con 0x7fd690141790 2022-01-10T01:24:45.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.044+0000 7fd69555b700 1 -- 172.21.15.36:0/3890817839 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6900b43b0 con 0x7fd690141790 2022-01-10T01:24:45.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.044+0000 7fd68dffb700 1 -- 172.21.15.36:0/3890817839 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6880217e0 con 0x7fd690141790 2022-01-10T01:24:45.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.044+0000 7fd69555b700 1 -- 172.21.15.36:0/3890817839 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd690152100 con 0x7fd690141790 2022-01-10T01:24:45.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.044+0000 7fd69555b700 1 -- 172.21.15.36:0/3890817839 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd690057350 con 0x7fd690141790 2022-01-10T01:24:45.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.048+0000 7fd68dffb700 1 -- 172.21.15.36:0/3890817839 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd68800f070 con 0x7fd690141790 2022-01-10T01:24:45.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.048+0000 7fd68dffb700 1 --2- 172.21.15.36:0/3890817839 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd674053560 0x7fd674055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.048+0000 7fd68dffb700 1 -- 172.21.15.36:0/3890817839 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd68806caa0 con 0x7fd690141790 2022-01-10T01:24:45.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.048+0000 7fd68ffff700 1 --2- 172.21.15.36:0/3890817839 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd674053560 0x7fd674055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.048+0000 7fd68ffff700 1 --2- 172.21.15.36:0/3890817839 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd674053560 0x7fd674055a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fd68000c000 tx=0x7fd680008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:45.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.052+0000 7fd68dffb700 1 -- 172.21.15.36:0/3890817839 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd688043ab0 con 0x7fd690141790 2022-01-10T01:24:45.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.180+0000 7fd69555b700 1 -- 172.21.15.36:0/3890817839 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd6900698e0 con 0x7fd690141790 2022-01-10T01:24:45.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.180+0000 7fd68dffb700 1 -- 172.21.15.36:0/3890817839 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd688015020 con 0x7fd690141790 2022-01-10T01:24:45.186 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:24:45.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.180+0000 7fd69555b700 1 -- 172.21.15.36:0/3890817839 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd674053560 msgr2=0x7fd674055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.180+0000 7fd69555b700 1 --2- 172.21.15.36:0/3890817839 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd674053560 0x7fd674055a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fd68000c000 tx=0x7fd680008040).stop 2022-01-10T01:24:45.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.180+0000 7fd69555b700 1 -- 172.21.15.36:0/3890817839 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd690141790 msgr2=0x7fd690152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.180+0000 7fd69555b700 1 --2- 172.21.15.36:0/3890817839 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd690141790 0x7fd690152740 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fd6880032f0 tx=0x7fd688016000).stop 2022-01-10T01:24:45.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.180+0000 7fd69555b700 1 -- 172.21.15.36:0/3890817839 shutdown_connections 2022-01-10T01:24:45.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.180+0000 7fd69555b700 1 --2- 172.21.15.36:0/3890817839 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd674053560 0x7fd674055a20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.180+0000 7fd69555b700 1 --2- 172.21.15.36:0/3890817839 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd690141790 0x7fd690152740 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.180+0000 7fd69555b700 1 --2- 172.21.15.36:0/3890817839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6900b2720 0x7fd690143780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.180+0000 7fd69555b700 1 --2- 172.21.15.36:0/3890817839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6900b0ff0 0x7fd690144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.180+0000 7fd69555b700 1 -- 172.21.15.36:0/3890817839 >> 172.21.15.36:0/3890817839 conn(0x7fd690060180 msgr2=0x7fd6900afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:45.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.180+0000 7fd69555b700 1 -- 172.21.15.36:0/3890817839 shutdown_connections 2022-01-10T01:24:45.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.180+0000 7fd69555b700 1 -- 172.21.15.36:0/3890817839 wait complete. 2022-01-10T01:24:45.199 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:24:45.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.300+0000 7f3d3b5ae700 1 Processor -- start 2022-01-10T01:24:45.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.300+0000 7f3d3b5ae700 1 -- start start 2022-01-10T01:24:45.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.300+0000 7f3d3b5ae700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3d340b6560 0x7f3d340b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.300+0000 7f3d3b5ae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d340b5990 0x7f3d340b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.300+0000 7f3d3b5ae700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d34143f60 con 0x7f3d3405fc00 2022-01-10T01:24:45.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.300+0000 7f3d3b5ae700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d340ba6b0 con 0x7f3d340b6560 2022-01-10T01:24:45.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.300+0000 7f3d3b5ae700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3405ffe0 con 0x7f3d340b5990 2022-01-10T01:24:45.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.300+0000 7f3d38b49700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3d340b6560 0x7f3d340b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.300+0000 7f3d3934a700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f3d3405fc00 0x7f3d340b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60444/0 (socket says 172.21.15.36:60444) 2022-01-10T01:24:45.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.300+0000 7f3d3934a700 1 -- 172.21.15.36:0/4124616750 learned_addr learned my addr 172.21.15.36:0/4124616750 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:45.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d39b4b700 1 --2- 172.21.15.36:0/4124616750 >> v2:172.21.15.59:3300/0 conn(0x7f3d340b5990 0x7f3d340b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d38b49700 1 -- 172.21.15.36:0/4124616750 >> v2:172.21.15.59:3300/0 conn(0x7f3d340b5990 msgr2=0x7f3d340b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:45.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d38b49700 1 --2- 172.21.15.36:0/4124616750 >> v2:172.21.15.59:3300/0 conn(0x7f3d340b5990 0x7f3d340b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d38b49700 1 -- 172.21.15.36:0/4124616750 >> v1:172.21.15.36:6789/0 conn(0x7f3d3405fc00 legacy=0x7f3d340b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d38b49700 1 -- 172.21.15.36:0/4124616750 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d34143a50 con 0x7f3d340b6560 2022-01-10T01:24:45.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d33fff700 1 -- 172.21.15.36:0/4124616750 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902873344 0 0) 0x7f3d34143f60 con 0x7f3d3405fc00 2022-01-10T01:24:45.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d38b49700 1 --2- 172.21.15.36:0/4124616750 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d340b6560 0x7f3d340b41b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f3d28002f70 tx=0x7f3d28006df0).ready entity=mon.0 client_cookie=5add4f28837bff02 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:45.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d33fff700 1 -- 172.21.15.36:0/4124616750 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d2800d5c0 con 0x7f3d340b6560 2022-01-10T01:24:45.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d33fff700 1 -- 172.21.15.36:0/4124616750 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d28000e90 con 0x7f3d340b6560 2022-01-10T01:24:45.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d33fff700 1 -- 172.21.15.36:0/4124616750 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d2800d910 con 0x7f3d340b6560 2022-01-10T01:24:45.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/4124616750 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d340b6560 msgr2=0x7f3d340b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d3b5ae700 1 --2- 172.21.15.36:0/4124616750 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d340b6560 0x7f3d340b41b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f3d28002f70 tx=0x7f3d28006df0).stop 2022-01-10T01:24:45.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/4124616750 shutdown_connections 2022-01-10T01:24:45.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d3b5ae700 1 --2- 172.21.15.36:0/4124616750 >> v2:172.21.15.59:3300/0 conn(0x7f3d340b5990 0x7f3d340b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d3b5ae700 1 --2- 172.21.15.36:0/4124616750 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d340b6560 0x7f3d340b41b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/4124616750 >> 172.21.15.36:0/4124616750 conn(0x7f3d340623a0 msgr2=0x7f3d34066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:45.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/4124616750 shutdown_connections 2022-01-10T01:24:45.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/4124616750 wait complete. 2022-01-10T01:24:45.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d3b5ae700 1 Processor -- start 2022-01-10T01:24:45.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.304+0000 7f3d3b5ae700 1 -- start start 2022-01-10T01:24:45.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d3b5ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d3405fc00 0x7f3d3413fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d3b5ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d340b5990 0x7f3d341564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d3b5ae700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d340b6560 0x7f3d34146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d3b5ae700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d340b0720 con 0x7f3d340b6560 2022-01-10T01:24:45.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d3b5ae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d340afce0 con 0x7f3d340b5990 2022-01-10T01:24:45.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d3b5ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d341569b0 con 0x7f3d3405fc00 2022-01-10T01:24:45.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d39b4b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d340b6560 0x7f3d34146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d39b4b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d340b6560 0x7f3d34146270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34428/0 (socket says 172.21.15.36:34428) 2022-01-10T01:24:45.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d39b4b700 1 -- 172.21.15.36:0/2106039333 learned_addr learned my addr 172.21.15.36:0/2106039333 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:45.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d3934a700 1 --2- 172.21.15.36:0/2106039333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d3405fc00 0x7f3d3413fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d38b49700 1 --2- 172.21.15.36:0/2106039333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d340b5990 0x7f3d341564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d39b4b700 1 -- 172.21.15.36:0/2106039333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d3405fc00 msgr2=0x7f3d3413fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d39b4b700 1 --2- 172.21.15.36:0/2106039333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d3405fc00 0x7f3d3413fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d39b4b700 1 -- 172.21.15.36:0/2106039333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d340b5990 msgr2=0x7f3d341564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d39b4b700 1 --2- 172.21.15.36:0/2106039333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d340b5990 0x7f3d341564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d39b4b700 1 -- 172.21.15.36:0/2106039333 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2800b180 con 0x7f3d340b6560 2022-01-10T01:24:45.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d39b4b700 1 --2- 172.21.15.36:0/2106039333 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d340b6560 0x7f3d34146270 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f3d2c00a000 tx=0x7f3d2c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:45.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d327fc700 1 -- 172.21.15.36:0/2106039333 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d2c011780 con 0x7f3d340b6560 2022-01-10T01:24:45.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d327fc700 1 -- 172.21.15.36:0/2106039333 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c0118e0 con 0x7f3d340b6560 2022-01-10T01:24:45.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d327fc700 1 -- 172.21.15.36:0/2106039333 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d2c011c40 con 0x7f3d340b6560 2022-01-10T01:24:45.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/2106039333 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d340aff40 con 0x7f3d340b6560 2022-01-10T01:24:45.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/2106039333 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d340b0480 con 0x7f3d340b6560 2022-01-10T01:24:45.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d327fc700 1 -- 172.21.15.36:0/2106039333 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3d2c012420 con 0x7f3d340b6560 2022-01-10T01:24:45.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/2106039333 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d34145fb0 con 0x7f3d340b6560 2022-01-10T01:24:45.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.308+0000 7f3d327fc700 1 --2- 172.21.15.36:0/2106039333 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d140534d0 0x7f3d14055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.312+0000 7f3d327fc700 1 -- 172.21.15.36:0/2106039333 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f3d2c06b800 con 0x7f3d340b6560 2022-01-10T01:24:45.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.312+0000 7f3d3934a700 1 --2- 172.21.15.36:0/2106039333 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d140534d0 0x7f3d14055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.312+0000 7f3d3934a700 1 --2- 172.21.15.36:0/2106039333 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d140534d0 0x7f3d14055990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f3d2400d000 tx=0x7f3d24007d80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:45.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.316+0000 7f3d327fc700 1 -- 172.21.15.36:0/2106039333 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3d2c0427b0 con 0x7f3d340b6560 2022-01-10T01:24:45.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.440+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/2106039333 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3d34143cc0 con 0x7f3d340b6560 2022-01-10T01:24:45.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.440+0000 7f3d327fc700 1 -- 172.21.15.36:0/2106039333 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3d2c045dd0 con 0x7f3d340b6560 2022-01-10T01:24:45.448 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:45.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.444+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/2106039333 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d140534d0 msgr2=0x7f3d14055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.444+0000 7f3d3b5ae700 1 --2- 172.21.15.36:0/2106039333 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d140534d0 0x7f3d14055990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f3d2400d000 tx=0x7f3d24007d80).stop 2022-01-10T01:24:45.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.444+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/2106039333 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d340b6560 msgr2=0x7f3d34146270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.444+0000 7f3d3b5ae700 1 --2- 172.21.15.36:0/2106039333 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d340b6560 0x7f3d34146270 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f3d2c00a000 tx=0x7f3d2c008040).stop 2022-01-10T01:24:45.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.444+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/2106039333 shutdown_connections 2022-01-10T01:24:45.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.444+0000 7f3d3b5ae700 1 --2- 172.21.15.36:0/2106039333 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d140534d0 0x7f3d14055990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.444+0000 7f3d3b5ae700 1 --2- 172.21.15.36:0/2106039333 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d340b6560 0x7f3d34146270 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.444+0000 7f3d3b5ae700 1 --2- 172.21.15.36:0/2106039333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d340b5990 0x7f3d341564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.444+0000 7f3d3b5ae700 1 --2- 172.21.15.36:0/2106039333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d3405fc00 0x7f3d3413fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.444+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/2106039333 >> 172.21.15.36:0/2106039333 conn(0x7f3d340623a0 msgr2=0x7f3d3412c490 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:45.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.444+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/2106039333 shutdown_connections 2022-01-10T01:24:45.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.444+0000 7f3d3b5ae700 1 -- 172.21.15.36:0/2106039333 wait complete. 2022-01-10T01:24:45.461 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:24:45.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.568+0000 7eff52001700 1 Processor -- start 2022-01-10T01:24:45.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.568+0000 7eff52001700 1 -- start start 2022-01-10T01:24:45.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff52001700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c0b6290 0x7eff4c061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff52001700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff4c142e60 0x7eff4c143310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff52001700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4c0b5f50 con 0x7eff4c0b4060 2022-01-10T01:24:45.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff52001700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4c0b1f70 con 0x7eff4c142e60 2022-01-10T01:24:45.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff52001700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c0b2210 con 0x7eff4c0b6290 2022-01-10T01:24:45.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff51800700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff4c142e60 0x7eff4c143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff50fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c0b6290 0x7eff4c061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff51800700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff4c142e60 0x7eff4c143310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:59302/0 (socket says 172.21.15.36:59302) 2022-01-10T01:24:45.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff51800700 1 -- 172.21.15.36:0/335540723 learned_addr learned my addr 172.21.15.36:0/335540723 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:45.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff4bfff700 1 --1- 172.21.15.36:0/335540723 >> v1:172.21.15.59:6789/0 conn(0x7eff4c0b4060 0x7eff4c061960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:49902/0 (socket says 172.21.15.36:49902) 2022-01-10T01:24:45.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff51800700 1 -- 172.21.15.36:0/335540723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c0b6290 msgr2=0x7eff4c061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:45.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff51800700 1 --2- 172.21.15.36:0/335540723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c0b6290 0x7eff4c061470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff51800700 1 -- 172.21.15.36:0/335540723 >> v1:172.21.15.59:6789/0 conn(0x7eff4c0b4060 legacy=0x7eff4c061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff51800700 1 -- 172.21.15.36:0/335540723 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c0b24b0 con 0x7eff4c142e60 2022-01-10T01:24:45.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff4b7fe700 1 -- 172.21.15.36:0/335540723 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916957191 0 0) 0x7eff3c001110 con 0x7eff4c0b4060 2022-01-10T01:24:45.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff51800700 1 --2- 172.21.15.36:0/335540723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c142e60 0x7eff4c143310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7eff440032f0 tx=0x7eff44009290).ready entity=mon.1 client_cookie=7aad2bde13830e40 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:45.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff4b7fe700 1 -- 172.21.15.36:0/335540723 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff4400b8a0 con 0x7eff4c142e60 2022-01-10T01:24:45.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff4b7fe700 1 -- 172.21.15.36:0/335540723 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4400ba00 con 0x7eff4c142e60 2022-01-10T01:24:45.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff4b7fe700 1 -- 172.21.15.36:0/335540723 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff4400bb70 con 0x7eff4c142e60 2022-01-10T01:24:45.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff52001700 1 -- 172.21.15.36:0/335540723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c142e60 msgr2=0x7eff4c143310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff52001700 1 --2- 172.21.15.36:0/335540723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c142e60 0x7eff4c143310 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7eff440032f0 tx=0x7eff44009290).stop 2022-01-10T01:24:45.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff52001700 1 -- 172.21.15.36:0/335540723 shutdown_connections 2022-01-10T01:24:45.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff52001700 1 --2- 172.21.15.36:0/335540723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c142e60 0x7eff4c143310 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff52001700 1 --2- 172.21.15.36:0/335540723 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c0b6290 0x7eff4c061470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff52001700 1 -- 172.21.15.36:0/335540723 >> 172.21.15.36:0/335540723 conn(0x7eff4c05c490 msgr2=0x7eff4c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:45.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff52001700 1 -- 172.21.15.36:0/335540723 shutdown_connections 2022-01-10T01:24:45.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.572+0000 7eff52001700 1 -- 172.21.15.36:0/335540723 wait complete. 2022-01-10T01:24:45.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff52001700 1 Processor -- start 2022-01-10T01:24:45.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff52001700 1 -- start start 2022-01-10T01:24:45.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff52001700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff4c0b4060 0x7eff4c0b9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff52001700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c0b6290 0x7eff4c12acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff52001700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c142e60 0x7eff4c12b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff52001700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c1468a0 con 0x7eff4c0b4060 2022-01-10T01:24:45.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff52001700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c150140 con 0x7eff4c142e60 2022-01-10T01:24:45.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff52001700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c146510 con 0x7eff4c0b6290 2022-01-10T01:24:45.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff50fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff4c0b4060 0x7eff4c0b9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff50fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff4c0b4060 0x7eff4c0b9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34438/0 (socket says 172.21.15.36:34438) 2022-01-10T01:24:45.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff50fff700 1 -- 172.21.15.36:0/765286023 learned_addr learned my addr 172.21.15.36:0/765286023 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:45.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff51800700 1 --2- 172.21.15.36:0/765286023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c142e60 0x7eff4c12b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff4bfff700 1 --2- 172.21.15.36:0/765286023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c0b6290 0x7eff4c12acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff50fff700 1 -- 172.21.15.36:0/765286023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c0b6290 msgr2=0x7eff4c12acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff50fff700 1 --2- 172.21.15.36:0/765286023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c0b6290 0x7eff4c12acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff50fff700 1 -- 172.21.15.36:0/765286023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c142e60 msgr2=0x7eff4c12b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff50fff700 1 --2- 172.21.15.36:0/765286023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c142e60 0x7eff4c12b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff50fff700 1 -- 172.21.15.36:0/765286023 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff44009530 con 0x7eff4c0b4060 2022-01-10T01:24:45.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff50fff700 1 --2- 172.21.15.36:0/765286023 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff4c0b4060 0x7eff4c0b9be0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7eff3400c000 tx=0x7eff34006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:45.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff49ffb700 1 -- 172.21.15.36:0/765286023 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff34010780 con 0x7eff4c0b4060 2022-01-10T01:24:45.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff49ffb700 1 -- 172.21.15.36:0/765286023 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff340108e0 con 0x7eff4c0b4060 2022-01-10T01:24:45.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.576+0000 7eff52001700 1 -- 172.21.15.36:0/765286023 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff4c146ad0 con 0x7eff4c0b4060 2022-01-10T01:24:45.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.580+0000 7eff49ffb700 1 -- 172.21.15.36:0/765286023 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff34010c40 con 0x7eff4c0b4060 2022-01-10T01:24:45.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.580+0000 7eff52001700 1 -- 172.21.15.36:0/765286023 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c0b07b0 con 0x7eff4c0b4060 2022-01-10T01:24:45.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.580+0000 7eff52001700 1 -- 172.21.15.36:0/765286023 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4c12b830 con 0x7eff4c0b4060 2022-01-10T01:24:45.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.580+0000 7eff49ffb700 1 -- 172.21.15.36:0/765286023 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7eff3401c460 con 0x7eff4c0b4060 2022-01-10T01:24:45.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.580+0000 7eff49ffb700 1 --2- 172.21.15.36:0/765286023 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff30053680 0x7eff30055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.580+0000 7eff49ffb700 1 -- 172.21.15.36:0/765286023 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7eff3406be30 con 0x7eff4c0b4060 2022-01-10T01:24:45.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.580+0000 7eff4bfff700 1 --2- 172.21.15.36:0/765286023 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff30053680 0x7eff30055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.580+0000 7eff4bfff700 1 --2- 172.21.15.36:0/765286023 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff30053680 0x7eff30055b40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7eff3c00d000 tx=0x7eff3c007860).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:45.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.588+0000 7eff49ffb700 1 -- 172.21.15.36:0/765286023 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff4c12b830 con 0x7eff4c0b4060 2022-01-10T01:24:45.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.712+0000 7eff52001700 1 -- 172.21.15.36:0/765286023 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff4c146f70 con 0x7eff4c0b4060 2022-01-10T01:24:45.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.716+0000 7eff49ffb700 1 -- 172.21.15.36:0/765286023 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7eff4c146f70 con 0x7eff4c0b4060 2022-01-10T01:24:45.721 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:45.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.716+0000 7eff52001700 1 -- 172.21.15.36:0/765286023 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff30053680 msgr2=0x7eff30055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.716+0000 7eff52001700 1 --2- 172.21.15.36:0/765286023 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff30053680 0x7eff30055b40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7eff3c00d000 tx=0x7eff3c007860).stop 2022-01-10T01:24:45.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.716+0000 7eff52001700 1 -- 172.21.15.36:0/765286023 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff4c0b4060 msgr2=0x7eff4c0b9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.716+0000 7eff52001700 1 --2- 172.21.15.36:0/765286023 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff4c0b4060 0x7eff4c0b9be0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7eff3400c000 tx=0x7eff34006df0).stop 2022-01-10T01:24:45.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.716+0000 7eff52001700 1 -- 172.21.15.36:0/765286023 shutdown_connections 2022-01-10T01:24:45.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.716+0000 7eff52001700 1 --2- 172.21.15.36:0/765286023 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff30053680 0x7eff30055b40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.716+0000 7eff52001700 1 --2- 172.21.15.36:0/765286023 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff4c142e60 0x7eff4c12b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.716+0000 7eff52001700 1 --2- 172.21.15.36:0/765286023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff4c0b6290 0x7eff4c12acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.716+0000 7eff52001700 1 --2- 172.21.15.36:0/765286023 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff4c0b4060 0x7eff4c0b9be0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.716+0000 7eff52001700 1 -- 172.21.15.36:0/765286023 >> 172.21.15.36:0/765286023 conn(0x7eff4c05c490 msgr2=0x7eff4c0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:45.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.716+0000 7eff52001700 1 -- 172.21.15.36:0/765286023 shutdown_connections 2022-01-10T01:24:45.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.716+0000 7eff52001700 1 -- 172.21.15.36:0/765286023 wait complete. 2022-01-10T01:24:45.735 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:24:45.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.836+0000 7fcb94dca700 1 Processor -- start 2022-01-10T01:24:45.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.836+0000 7fcb94dca700 1 -- start start 2022-01-10T01:24:45.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb94dca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb900b6290 0x7fcb90061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb94dca700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb900b5f50 con 0x7fcb90142e60 2022-01-10T01:24:45.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb94dca700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb900b1f70 con 0x7fcb900b4060 2022-01-10T01:24:45.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb94dca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900b2210 con 0x7fcb900b6290 2022-01-10T01:24:45.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb8ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fcb90142e60 0x7fcb90143310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60476/0 (socket says 172.21.15.36:60476) 2022-01-10T01:24:45.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb8ffff700 1 -- 172.21.15.36:0/2671931356 learned_addr learned my addr 172.21.15.36:0/2671931356 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:45.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb8f7fe700 1 --2- 172.21.15.36:0/2671931356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb900b6290 0x7fcb90061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb8e7fc700 1 -- 172.21.15.36:0/2671931356 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057055352 0 0) 0x7fcb88001490 con 0x7fcb90142e60 2022-01-10T01:24:45.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb8e7fc700 1 -- 172.21.15.36:0/2671931356 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb7c003260 con 0x7fcb90142e60 2022-01-10T01:24:45.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb8e7fc700 1 -- 172.21.15.36:0/2671931356 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364234345 0 0) 0x7fcb900b1f70 con 0x7fcb900b4060 2022-01-10T01:24:45.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb8e7fc700 1 -- 172.21.15.36:0/2671931356 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb88001490 con 0x7fcb900b4060 2022-01-10T01:24:45.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb8f7fe700 1 -- 172.21.15.36:0/2671931356 >> v1:172.21.15.59:6789/0 conn(0x7fcb900b4060 legacy=0x7fcb90061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb8f7fe700 1 -- 172.21.15.36:0/2671931356 >> v1:172.21.15.36:6789/0 conn(0x7fcb90142e60 legacy=0x7fcb90143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb8f7fe700 1 -- 172.21.15.36:0/2671931356 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb900b24b0 con 0x7fcb900b6290 2022-01-10T01:24:45.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb8f7fe700 1 --2- 172.21.15.36:0/2671931356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb900b6290 0x7fcb90061470 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcb84002f70 tx=0x7fcb84006df0).ready entity=mon.2 client_cookie=dfbe8dd72faf886 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:45.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb8e7fc700 1 -- 172.21.15.36:0/2671931356 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb8400d5c0 con 0x7fcb900b6290 2022-01-10T01:24:45.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb8e7fc700 1 -- 172.21.15.36:0/2671931356 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb84000e90 con 0x7fcb900b6290 2022-01-10T01:24:45.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb8e7fc700 1 -- 172.21.15.36:0/2671931356 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb8400d910 con 0x7fcb900b6290 2022-01-10T01:24:45.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb94dca700 1 -- 172.21.15.36:0/2671931356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb900b6290 msgr2=0x7fcb90061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb94dca700 1 --2- 172.21.15.36:0/2671931356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb900b6290 0x7fcb90061470 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcb84002f70 tx=0x7fcb84006df0).stop 2022-01-10T01:24:45.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb94dca700 1 -- 172.21.15.36:0/2671931356 shutdown_connections 2022-01-10T01:24:45.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb94dca700 1 --2- 172.21.15.36:0/2671931356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb900b6290 0x7fcb90061470 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb94dca700 1 -- 172.21.15.36:0/2671931356 >> 172.21.15.36:0/2671931356 conn(0x7fcb9005c490 msgr2=0x7fcb9005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:45.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb94dca700 1 -- 172.21.15.36:0/2671931356 shutdown_connections 2022-01-10T01:24:45.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.840+0000 7fcb94dca700 1 -- 172.21.15.36:0/2671931356 wait complete. 2022-01-10T01:24:45.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.844+0000 7fcb94dca700 1 Processor -- start 2022-01-10T01:24:45.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.844+0000 7fcb94dca700 1 -- start start 2022-01-10T01:24:45.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.844+0000 7fcb94dca700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcb900b4060 0x7fcb900b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.844+0000 7fcb94dca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb900b6290 0x7fcb90155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.844+0000 7fcb94dca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb90142e60 0x7fcb90156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.844+0000 7fcb94dca700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90140890 con 0x7fcb900b4060 2022-01-10T01:24:45.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.844+0000 7fcb94dca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9013f620 con 0x7fcb900b6290 2022-01-10T01:24:45.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.844+0000 7fcb94dca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900b0ad0 con 0x7fcb90142e60 2022-01-10T01:24:45.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.844+0000 7fcb8f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcb900b4060 0x7fcb900b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.844+0000 7fcb8f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcb900b4060 0x7fcb900b78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34452/0 (socket says 172.21.15.36:34452) 2022-01-10T01:24:45.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.844+0000 7fcb8f7fe700 1 -- 172.21.15.36:0/3339159953 learned_addr learned my addr 172.21.15.36:0/3339159953 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:45.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.844+0000 7fcb8ffff700 1 --2- 172.21.15.36:0/3339159953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb90142e60 0x7fcb90156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.844+0000 7fcb8effd700 1 --2- 172.21.15.36:0/3339159953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb900b6290 0x7fcb90155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb8f7fe700 1 -- 172.21.15.36:0/3339159953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb90142e60 msgr2=0x7fcb90156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb8f7fe700 1 --2- 172.21.15.36:0/3339159953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb90142e60 0x7fcb90156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb8f7fe700 1 -- 172.21.15.36:0/3339159953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb900b6290 msgr2=0x7fcb90155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb8f7fe700 1 --2- 172.21.15.36:0/3339159953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb900b6290 0x7fcb90155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:45.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb8f7fe700 1 -- 172.21.15.36:0/3339159953 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8400b180 con 0x7fcb900b4060 2022-01-10T01:24:45.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb8f7fe700 1 --2- 172.21.15.36:0/3339159953 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcb900b4060 0x7fcb900b78a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fcb84002f70 tx=0x7fcb84014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:45.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb8cff9700 1 -- 172.21.15.36:0/3339159953 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb84013de0 con 0x7fcb900b4060 2022-01-10T01:24:45.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb8cff9700 1 -- 172.21.15.36:0/3339159953 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8401e400 con 0x7fcb900b4060 2022-01-10T01:24:45.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb94dca700 1 -- 172.21.15.36:0/3339159953 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb900b0830 con 0x7fcb900b4060 2022-01-10T01:24:45.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb8cff9700 1 -- 172.21.15.36:0/3339159953 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb8401e760 con 0x7fcb900b4060 2022-01-10T01:24:45.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb94dca700 1 -- 172.21.15.36:0/3339159953 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb900b04a0 con 0x7fcb900b4060 2022-01-10T01:24:45.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb8cff9700 1 -- 172.21.15.36:0/3339159953 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fcb84025030 con 0x7fcb900b4060 2022-01-10T01:24:45.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb94dca700 1 -- 172.21.15.36:0/3339159953 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb900b2750 con 0x7fcb900b4060 2022-01-10T01:24:45.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb8cff9700 1 --2- 172.21.15.36:0/3339159953 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcb70053680 0x7fcb70055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:45.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb8cff9700 1 -- 172.21.15.36:0/3339159953 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fcb8406c660 con 0x7fcb900b4060 2022-01-10T01:24:45.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.848+0000 7fcb8effd700 1 --2- 172.21.15.36:0/3339159953 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcb70053680 0x7fcb70055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:45.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.852+0000 7fcb8effd700 1 --2- 172.21.15.36:0/3339159953 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcb70053680 0x7fcb70055b40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fcb8000d000 tx=0x7fcb80007a20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:45.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.856+0000 7fcb8cff9700 1 -- 172.21.15.36:0/3339159953 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcb84043670 con 0x7fcb900b4060 2022-01-10T01:24:45.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.988+0000 7fcb94dca700 1 -- 172.21.15.36:0/3339159953 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb90057350 con 0x7fcb900b4060 2022-01-10T01:24:45.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.988+0000 7fcb8cff9700 1 -- 172.21.15.36:0/3339159953 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7fcb84023020 con 0x7fcb900b4060 2022-01-10T01:24:45.998 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:45.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.988+0000 7fcb94dca700 1 -- 172.21.15.36:0/3339159953 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcb70053680 msgr2=0x7fcb70055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:45.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.988+0000 7fcb94dca700 1 --2- 172.21.15.36:0/3339159953 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcb70053680 0x7fcb70055b40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fcb8000d000 tx=0x7fcb80007a20).stop 2022-01-10T01:24:45.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.988+0000 7fcb94dca700 1 -- 172.21.15.36:0/3339159953 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcb900b4060 msgr2=0x7fcb900b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.988+0000 7fcb94dca700 1 --2- 172.21.15.36:0/3339159953 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcb900b4060 0x7fcb900b78a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fcb84002f70 tx=0x7fcb84014000).stop 2022-01-10T01:24:46.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.988+0000 7fcb94dca700 1 -- 172.21.15.36:0/3339159953 shutdown_connections 2022-01-10T01:24:46.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.988+0000 7fcb94dca700 1 --2- 172.21.15.36:0/3339159953 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcb70053680 0x7fcb70055b40 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.988+0000 7fcb94dca700 1 --2- 172.21.15.36:0/3339159953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb90142e60 0x7fcb90156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.988+0000 7fcb94dca700 1 --2- 172.21.15.36:0/3339159953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb900b6290 0x7fcb90155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.988+0000 7fcb94dca700 1 --2- 172.21.15.36:0/3339159953 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcb900b4060 0x7fcb900b78a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.988+0000 7fcb94dca700 1 -- 172.21.15.36:0/3339159953 >> 172.21.15.36:0/3339159953 conn(0x7fcb9005c490 msgr2=0x7fcb900b8920 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:46.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.988+0000 7fcb94dca700 1 -- 172.21.15.36:0/3339159953 shutdown_connections 2022-01-10T01:24:46.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:45.988+0000 7fcb94dca700 1 -- 172.21.15.36:0/3339159953 wait complete. 2022-01-10T01:24:46.007 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:46.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.108+0000 7ff0cf59e700 1 Processor -- start 2022-01-10T01:24:46.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.108+0000 7ff0cf59e700 1 -- start start 2022-01-10T01:24:46.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.108+0000 7ff0cf59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0d00b2580 0x7ff0d014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.108+0000 7ff0cf59e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff0d00a8ac0 0x7ff0d014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.108+0000 7ff0cf59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d00a70c0 con 0x7ff0d00b0010 2022-01-10T01:24:46.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.108+0000 7ff0cf59e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d00a72f0 con 0x7ff0d00a8ac0 2022-01-10T01:24:46.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.108+0000 7ff0cf59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00a7590 con 0x7ff0d00b2580 2022-01-10T01:24:46.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.108+0000 7ff0cdd9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff0d00b0010 0x7ff0d00a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60486/0 (socket says 172.21.15.36:60486) 2022-01-10T01:24:46.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.108+0000 7ff0cdd9b700 1 -- 172.21.15.36:0/2732846563 learned_addr learned my addr 172.21.15.36:0/2732846563 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:46.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.108+0000 7ff0ced9d700 1 --2- 172.21.15.36:0/2732846563 >> v2:172.21.15.36:3300/0 conn(0x7ff0d00a8ac0 0x7ff0d014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.108+0000 7ff0ce59c700 1 --2- 172.21.15.36:0/2732846563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0d00b2580 0x7ff0d014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.108+0000 7ff0cd59a700 1 -- 172.21.15.36:0/2732846563 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366450102 0 0) 0x7ff0d00a70c0 con 0x7ff0d00b0010 2022-01-10T01:24:46.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.108+0000 7ff0cd59a700 1 -- 172.21.15.36:0/2732846563 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0b4003260 con 0x7ff0d00b0010 2022-01-10T01:24:46.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0ced9d700 1 -- 172.21.15.36:0/2732846563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0d00b2580 msgr2=0x7ff0d014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:46.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0ced9d700 1 --2- 172.21.15.36:0/2732846563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0d00b2580 0x7ff0d014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0ced9d700 1 -- 172.21.15.36:0/2732846563 >> v1:172.21.15.36:6789/0 conn(0x7ff0d00b0010 legacy=0x7ff0d00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0ced9d700 1 -- 172.21.15.36:0/2732846563 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d00a7830 con 0x7ff0d00a8ac0 2022-01-10T01:24:46.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0ced9d700 1 --2- 172.21.15.36:0/2732846563 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff0d00a8ac0 0x7ff0d014b330 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7ff0c8002f70 tx=0x7ff0c8006df0).ready entity=mon.0 client_cookie=230a0a5a4433b341 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:46.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0cd59a700 1 -- 172.21.15.36:0/2732846563 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0c800d4a0 con 0x7ff0d00a8ac0 2022-01-10T01:24:46.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0cd59a700 1 -- 172.21.15.36:0/2732846563 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c8000e90 con 0x7ff0d00a8ac0 2022-01-10T01:24:46.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0cd59a700 1 -- 172.21.15.36:0/2732846563 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0c800d7f0 con 0x7ff0d00a8ac0 2022-01-10T01:24:46.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2732846563 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff0d00a8ac0 msgr2=0x7ff0d014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0cf59e700 1 --2- 172.21.15.36:0/2732846563 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff0d00a8ac0 0x7ff0d014b330 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7ff0c8002f70 tx=0x7ff0c8006df0).stop 2022-01-10T01:24:46.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2732846563 shutdown_connections 2022-01-10T01:24:46.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0cf59e700 1 --2- 172.21.15.36:0/2732846563 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff0d00a8ac0 0x7ff0d014b330 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0cf59e700 1 --2- 172.21.15.36:0/2732846563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0d00b2580 0x7ff0d014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2732846563 >> 172.21.15.36:0/2732846563 conn(0x7ff0d0060180 msgr2=0x7ff0d00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:46.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2732846563 shutdown_connections 2022-01-10T01:24:46.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2732846563 wait complete. 2022-01-10T01:24:46.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0cf59e700 1 Processor -- start 2022-01-10T01:24:46.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.112+0000 7ff0cf59e700 1 -- start start 2022-01-10T01:24:46.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0cf59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0d00a8ac0 0x7ff0d00b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0cf59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0d00b0010 0x7ff0d0064ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0cf59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff0d00b2580 0x7ff0d0064fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0cf59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00aa8e0 con 0x7ff0d00b2580 2022-01-10T01:24:46.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0cf59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d0065490 con 0x7ff0d00a8ac0 2022-01-10T01:24:46.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0cf59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00ac6a0 con 0x7ff0d00b0010 2022-01-10T01:24:46.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0ced9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff0d00b2580 0x7ff0d0064fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0ced9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff0d00b2580 0x7ff0d0064fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34468/0 (socket says 172.21.15.36:34468) 2022-01-10T01:24:46.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0ced9d700 1 -- 172.21.15.36:0/2538562643 learned_addr learned my addr 172.21.15.36:0/2538562643 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:46.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0ce59c700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0d00a8ac0 0x7ff0d00b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0cdd9b700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0d00b0010 0x7ff0d0064ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0ced9d700 1 -- 172.21.15.36:0/2538562643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0d00b0010 msgr2=0x7ff0d0064ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0ced9d700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0d00b0010 0x7ff0d0064ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0ced9d700 1 -- 172.21.15.36:0/2538562643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0d00a8ac0 msgr2=0x7ff0d00b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0ced9d700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0d00a8ac0 0x7ff0d00b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0ced9d700 1 -- 172.21.15.36:0/2538562643 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c800b180 con 0x7ff0d00b2580 2022-01-10T01:24:46.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0cdd9b700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0d00b0010 0x7ff0d0064ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:46.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0ce59c700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0d00a8ac0 0x7ff0d00b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:46.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0ced9d700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff0d00b2580 0x7ff0d0064fa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7ff0c8002f70 tx=0x7ff0c8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:46.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0bf7fe700 1 -- 172.21.15.36:0/2538562643 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0c8016070 con 0x7ff0d00b2580 2022-01-10T01:24:46.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0bf7fe700 1 -- 172.21.15.36:0/2538562643 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c80139c0 con 0x7ff0d00b2580 2022-01-10T01:24:46.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2538562643 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d00aab10 con 0x7ff0d00b2580 2022-01-10T01:24:46.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0bf7fe700 1 -- 172.21.15.36:0/2538562643 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0c8013d20 con 0x7ff0d00b2580 2022-01-10T01:24:46.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.116+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2538562643 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d0159920 con 0x7ff0d00b2580 2022-01-10T01:24:46.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.120+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2538562643 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d0057350 con 0x7ff0d00b2580 2022-01-10T01:24:46.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.120+0000 7ff0bf7fe700 1 -- 172.21.15.36:0/2538562643 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff0c8025030 con 0x7ff0d00b2580 2022-01-10T01:24:46.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.120+0000 7ff0bf7fe700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff0ac0535f0 0x7ff0ac055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.120+0000 7ff0ce59c700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff0ac0535f0 0x7ff0ac055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.120+0000 7ff0bf7fe700 1 -- 172.21.15.36:0/2538562643 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ff0c806cad0 con 0x7ff0d00b2580 2022-01-10T01:24:46.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.120+0000 7ff0ce59c700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff0ac0535f0 0x7ff0ac055ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff0c400b000 tx=0x7ff0c4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:46.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.124+0000 7ff0bf7fe700 1 -- 172.21.15.36:0/2538562643 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff0c80439d0 con 0x7ff0d00b2580 2022-01-10T01:24:46.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.248+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2538562643 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0d00698e0 con 0x7ff0d00b2580 2022-01-10T01:24:46.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.252+0000 7ff0bf7fe700 1 -- 172.21.15.36:0/2538562643 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16299 (secure 0 0 0) 0x7ff0c8023090 con 0x7ff0d00b2580 2022-01-10T01:24:46.259 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:46.259 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:25.224959+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:24:20.202898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-10T01:24:22.952870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:46.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.252+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2538562643 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff0ac0535f0 msgr2=0x7ff0ac055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.252+0000 7ff0cf59e700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff0ac0535f0 0x7ff0ac055ab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff0c400b000 tx=0x7ff0c4008040).stop 2022-01-10T01:24:46.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.252+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2538562643 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff0d00b2580 msgr2=0x7ff0d0064fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.252+0000 7ff0cf59e700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff0d00b2580 0x7ff0d0064fa0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7ff0c8002f70 tx=0x7ff0c8014000).stop 2022-01-10T01:24:46.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.252+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2538562643 shutdown_connections 2022-01-10T01:24:46.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.252+0000 7ff0cf59e700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff0ac0535f0 0x7ff0ac055ab0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.252+0000 7ff0cf59e700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff0d00b2580 0x7ff0d0064fa0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.252+0000 7ff0cf59e700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0d00b0010 0x7ff0d0064ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.252+0000 7ff0cf59e700 1 --2- 172.21.15.36:0/2538562643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0d00a8ac0 0x7ff0d00b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.252+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2538562643 >> 172.21.15.36:0/2538562643 conn(0x7ff0d0060180 msgr2=0x7ff0d01499f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:46.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.252+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2538562643 shutdown_connections 2022-01-10T01:24:46.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.252+0000 7ff0cf59e700 1 -- 172.21.15.36:0/2538562643 wait complete. 2022-01-10T01:24:46.273 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:24:20.202898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:24:22.952870+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:24:46.274 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:24:46.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa4489f8700 1 Processor -- start 2022-01-10T01:24:46.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa4489f8700 1 -- start start 2022-01-10T01:24:46.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa4489f8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa444064980 0x7fa444144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa4489f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4440b3550 0x7fa444066a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa4489f8700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa444066500 con 0x7fa444066ef0 2022-01-10T01:24:46.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa4489f8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4440b3ea0 con 0x7fa444064980 2022-01-10T01:24:46.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa4489f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa444140d40 con 0x7fa4440b3550 2022-01-10T01:24:46.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa44359e700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa444066ef0 0x7fa444141130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60504/0 (socket says 172.21.15.36:60504) 2022-01-10T01:24:46.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa44359e700 1 -- 172.21.15.36:0/3642179274 learned_addr learned my addr 172.21.15.36:0/3642179274 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:46.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa442d9d700 1 --2- 172.21.15.36:0/3642179274 >> v2:172.21.15.59:3300/0 conn(0x7fa444064980 0x7fa444144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa44259c700 1 --2- 172.21.15.36:0/3642179274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4440b3550 0x7fa444066a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa441d9b700 1 -- 172.21.15.36:0/3642179274 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458722478 0 0) 0x7fa444066500 con 0x7fa444066ef0 2022-01-10T01:24:46.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa441d9b700 1 -- 172.21.15.36:0/3642179274 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa428003260 con 0x7fa444066ef0 2022-01-10T01:24:46.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa44259c700 1 -- 172.21.15.36:0/3642179274 >> v2:172.21.15.59:3300/0 conn(0x7fa444064980 msgr2=0x7fa444144ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:46.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa441d9b700 1 -- 172.21.15.36:0/3642179274 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4007979231 0 0) 0x7fa428003260 con 0x7fa444066ef0 2022-01-10T01:24:46.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa44259c700 1 --2- 172.21.15.36:0/3642179274 >> v2:172.21.15.59:3300/0 conn(0x7fa444064980 0x7fa444144ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa44259c700 1 -- 172.21.15.36:0/3642179274 >> v1:172.21.15.36:6789/0 conn(0x7fa444066ef0 legacy=0x7fa444141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa44259c700 1 -- 172.21.15.36:0/3642179274 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4440b46c0 con 0x7fa4440b3550 2022-01-10T01:24:46.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa442d9d700 1 --2- 172.21.15.36:0/3642179274 >> v2:172.21.15.59:3300/0 conn(0x7fa444064980 0x7fa444144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:46.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.380+0000 7fa44259c700 1 --2- 172.21.15.36:0/3642179274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4440b3550 0x7fa444066a00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fa43c001ba0 tx=0x7fa438006df0).ready entity=mon.2 client_cookie=300ebb6d6e2cafc server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:46.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.384+0000 7fa441d9b700 1 -- 172.21.15.36:0/3642179274 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43c001a00 con 0x7fa4440b3550 2022-01-10T01:24:46.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.384+0000 7fa441d9b700 1 -- 172.21.15.36:0/3642179274 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa438000e90 con 0x7fa4440b3550 2022-01-10T01:24:46.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.384+0000 7fa441d9b700 1 -- 172.21.15.36:0/3642179274 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa438012460 con 0x7fa4440b3550 2022-01-10T01:24:46.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.384+0000 7fa4489f8700 1 -- 172.21.15.36:0/3642179274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4440b3550 msgr2=0x7fa444066a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.384+0000 7fa4489f8700 1 --2- 172.21.15.36:0/3642179274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4440b3550 0x7fa444066a00 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fa43c001ba0 tx=0x7fa438006df0).stop 2022-01-10T01:24:46.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.384+0000 7fa4489f8700 1 -- 172.21.15.36:0/3642179274 shutdown_connections 2022-01-10T01:24:46.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.384+0000 7fa4489f8700 1 --2- 172.21.15.36:0/3642179274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4440b3550 0x7fa444066a00 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.384+0000 7fa4489f8700 1 --2- 172.21.15.36:0/3642179274 >> v2:172.21.15.59:3300/0 conn(0x7fa444064980 0x7fa444144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.384+0000 7fa4489f8700 1 -- 172.21.15.36:0/3642179274 >> 172.21.15.36:0/3642179274 conn(0x7fa44405f6b0 msgr2=0x7fa44405fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:46.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.384+0000 7fa4489f8700 1 -- 172.21.15.36:0/3642179274 shutdown_connections 2022-01-10T01:24:46.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.384+0000 7fa4489f8700 1 -- 172.21.15.36:0/3642179274 wait complete. 2022-01-10T01:24:46.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.384+0000 7fa4489f8700 1 Processor -- start 2022-01-10T01:24:46.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.384+0000 7fa4489f8700 1 -- start start 2022-01-10T01:24:46.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa4489f8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa444064980 0x7fa4440b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa4489f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa444066ef0 0x7fa44413c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa4489f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4440b3550 0x7fa44413dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa4489f8700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440af5c0 con 0x7fa444064980 2022-01-10T01:24:46.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa4489f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440aebe0 con 0x7fa4440b3550 2022-01-10T01:24:46.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa4489f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440aee80 con 0x7fa444066ef0 2022-01-10T01:24:46.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa442d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa444064980 0x7fa4440b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa442d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa444064980 0x7fa4440b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34480/0 (socket says 172.21.15.36:34480) 2022-01-10T01:24:46.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa442d9d700 1 -- 172.21.15.36:0/3721926430 learned_addr learned my addr 172.21.15.36:0/3721926430 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:46.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa44259c700 1 --2- 172.21.15.36:0/3721926430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa444066ef0 0x7fa44413c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa44359e700 1 --2- 172.21.15.36:0/3721926430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4440b3550 0x7fa44413dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa442d9d700 1 -- 172.21.15.36:0/3721926430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa444066ef0 msgr2=0x7fa44413c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa442d9d700 1 --2- 172.21.15.36:0/3721926430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa444066ef0 0x7fa44413c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa442d9d700 1 -- 172.21.15.36:0/3721926430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4440b3550 msgr2=0x7fa44413dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa442d9d700 1 --2- 172.21.15.36:0/3721926430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4440b3550 0x7fa44413dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa442d9d700 1 -- 172.21.15.36:0/3721926430 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43400b180 con 0x7fa444064980 2022-01-10T01:24:46.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa442d9d700 1 --2- 172.21.15.36:0/3721926430 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa444064980 0x7fa4440b0730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fa43400c000 tx=0x7fa434006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:46.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa433fff700 1 -- 172.21.15.36:0/3721926430 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43400c7e0 con 0x7fa444064980 2022-01-10T01:24:46.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa433fff700 1 -- 172.21.15.36:0/3721926430 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43400c940 con 0x7fa444064980 2022-01-10T01:24:46.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa4489f8700 1 -- 172.21.15.36:0/3721926430 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43800b180 con 0x7fa444064980 2022-01-10T01:24:46.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa433fff700 1 -- 172.21.15.36:0/3721926430 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa43400cca0 con 0x7fa444064980 2022-01-10T01:24:46.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.388+0000 7fa4489f8700 1 -- 172.21.15.36:0/3721926430 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4440ae6d0 con 0x7fa444064980 2022-01-10T01:24:46.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.392+0000 7fa4489f8700 1 -- 172.21.15.36:0/3721926430 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4440b1910 con 0x7fa444064980 2022-01-10T01:24:46.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.392+0000 7fa433fff700 1 -- 172.21.15.36:0/3721926430 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa43401c460 con 0x7fa444064980 2022-01-10T01:24:46.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.392+0000 7fa433fff700 1 --2- 172.21.15.36:0/3721926430 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4200534d0 0x7fa420055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.392+0000 7fa433fff700 1 -- 172.21.15.36:0/3721926430 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fa43406c0b0 con 0x7fa444064980 2022-01-10T01:24:46.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.392+0000 7fa44259c700 1 --2- 172.21.15.36:0/3721926430 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4200534d0 0x7fa420055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.392+0000 7fa44259c700 1 --2- 172.21.15.36:0/3721926430 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4200534d0 0x7fa420055990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fa43801a000 tx=0x7fa438014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:46.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.396+0000 7fa433fff700 1 -- 172.21.15.36:0/3721926430 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa434042f50 con 0x7fa444064980 2022-01-10T01:24:46.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.524+0000 7fa4489f8700 1 -- 172.21.15.36:0/3721926430 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa4440b48f0 con 0x7fa444064980 2022-01-10T01:24:46.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.524+0000 7fa433fff700 1 -- 172.21.15.36:0/3721926430 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa43400ce00 con 0x7fa444064980 2022-01-10T01:24:46.533 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:24:46.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.528+0000 7fa4489f8700 1 -- 172.21.15.36:0/3721926430 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4200534d0 msgr2=0x7fa420055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.528+0000 7fa4489f8700 1 --2- 172.21.15.36:0/3721926430 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4200534d0 0x7fa420055990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fa43801a000 tx=0x7fa438014000).stop 2022-01-10T01:24:46.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.528+0000 7fa4489f8700 1 -- 172.21.15.36:0/3721926430 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa444064980 msgr2=0x7fa4440b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.528+0000 7fa4489f8700 1 --2- 172.21.15.36:0/3721926430 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa444064980 0x7fa4440b0730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fa43400c000 tx=0x7fa434006df0).stop 2022-01-10T01:24:46.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.528+0000 7fa4489f8700 1 -- 172.21.15.36:0/3721926430 shutdown_connections 2022-01-10T01:24:46.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.528+0000 7fa4489f8700 1 --2- 172.21.15.36:0/3721926430 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4200534d0 0x7fa420055990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.528+0000 7fa4489f8700 1 --2- 172.21.15.36:0/3721926430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4440b3550 0x7fa44413dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.528+0000 7fa4489f8700 1 --2- 172.21.15.36:0/3721926430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa444066ef0 0x7fa44413c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.528+0000 7fa4489f8700 1 --2- 172.21.15.36:0/3721926430 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa444064980 0x7fa4440b0730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.528+0000 7fa4489f8700 1 -- 172.21.15.36:0/3721926430 >> 172.21.15.36:0/3721926430 conn(0x7fa44405f6b0 msgr2=0x7fa4440b5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:46.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.528+0000 7fa4489f8700 1 -- 172.21.15.36:0/3721926430 shutdown_connections 2022-01-10T01:24:46.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.528+0000 7fa4489f8700 1 -- 172.21.15.36:0/3721926430 wait complete. 2022-01-10T01:24:46.551 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:24:46.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.656+0000 7f1ee1893700 1 Processor -- start 2022-01-10T01:24:46.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.656+0000 7f1ee1893700 1 -- start start 2022-01-10T01:24:46.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ee1893700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc0b3cf0 0x7f1edc13e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ee1893700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1edc13e660 0x7f1edc14b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ee1893700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1edc0afb60 con 0x7f1edc0af780 2022-01-10T01:24:46.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ee1893700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1edc0b1610 con 0x7f1edc13e660 2022-01-10T01:24:46.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ee1893700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0b0a90 con 0x7f1edc0b3cf0 2022-01-10T01:24:46.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1edb7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1edc13e660 0x7f1edc14b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1edb7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1edc13e660 0x7f1edc14b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34492/0 (socket says 172.21.15.36:34492) 2022-01-10T01:24:46.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1edb7fe700 1 -- 172.21.15.36:0/2295272517 learned_addr learned my addr 172.21.15.36:0/2295272517 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:46.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1eda7fc700 1 --2- 172.21.15.36:0/2295272517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc0b3cf0 0x7f1edc13e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1edb7fe700 1 -- 172.21.15.36:0/2295272517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc0b3cf0 msgr2=0x7f1edc13e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:46.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1edb7fe700 1 --2- 172.21.15.36:0/2295272517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc0b3cf0 0x7f1edc13e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1edb7fe700 1 -- 172.21.15.36:0/2295272517 >> v1:172.21.15.59:6789/0 conn(0x7f1edc0af780 legacy=0x7f1edc1445b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1edb7fe700 1 -- 172.21.15.36:0/2295272517 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc0b21a0 con 0x7f1edc13e660 2022-01-10T01:24:46.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1eda7fc700 1 --2- 172.21.15.36:0/2295272517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc0b3cf0 0x7f1edc13e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:46.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1edb7fe700 1 --2- 172.21.15.36:0/2295272517 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1edc13e660 0x7f1edc14b950 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f1ed40032f0 tx=0x7f1ed4009290).ready entity=mon.0 client_cookie=98b5d4beb06fa466 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:46.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ed9ffb700 1 -- 172.21.15.36:0/2295272517 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ed400b8a0 con 0x7f1edc13e660 2022-01-10T01:24:46.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ed9ffb700 1 -- 172.21.15.36:0/2295272517 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed400ba00 con 0x7f1edc13e660 2022-01-10T01:24:46.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ed9ffb700 1 -- 172.21.15.36:0/2295272517 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ed400bb70 con 0x7f1edc13e660 2022-01-10T01:24:46.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ee1893700 1 -- 172.21.15.36:0/2295272517 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1edc13e660 msgr2=0x7f1edc14b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ee1893700 1 --2- 172.21.15.36:0/2295272517 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1edc13e660 0x7f1edc14b950 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f1ed40032f0 tx=0x7f1ed4009290).stop 2022-01-10T01:24:46.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ee1893700 1 -- 172.21.15.36:0/2295272517 shutdown_connections 2022-01-10T01:24:46.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ee1893700 1 --2- 172.21.15.36:0/2295272517 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1edc13e660 0x7f1edc14b950 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ee1893700 1 --2- 172.21.15.36:0/2295272517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc0b3cf0 0x7f1edc13e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ee1893700 1 -- 172.21.15.36:0/2295272517 >> 172.21.15.36:0/2295272517 conn(0x7f1edc06a110 msgr2=0x7f1edc05cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:46.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ee1893700 1 -- 172.21.15.36:0/2295272517 shutdown_connections 2022-01-10T01:24:46.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.660+0000 7f1ee1893700 1 -- 172.21.15.36:0/2295272517 wait complete. 2022-01-10T01:24:46.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1ee1893700 1 Processor -- start 2022-01-10T01:24:46.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1ee1893700 1 -- start start 2022-01-10T01:24:46.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1ee1893700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1edc0af780 0x7f1edc139980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1ee1893700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1edc0b3cf0 0x7f1edc134d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1ee1893700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc13e660 0x7f1edc133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1ee1893700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0648a0 con 0x7f1edc0af780 2022-01-10T01:24:46.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1ee1893700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc066640 con 0x7f1edc0b3cf0 2022-01-10T01:24:46.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1ee1893700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc1360f0 con 0x7f1edc13e660 2022-01-10T01:24:46.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1edaffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1edc0af780 0x7f1edc139980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1edaffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1edc0af780 0x7f1edc139980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34494/0 (socket says 172.21.15.36:34494) 2022-01-10T01:24:46.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1edaffd700 1 -- 172.21.15.36:0/476696784 learned_addr learned my addr 172.21.15.36:0/476696784 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:46.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1eda7fc700 1 --2- 172.21.15.36:0/476696784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1edc0b3cf0 0x7f1edc134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1edb7fe700 1 --2- 172.21.15.36:0/476696784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc13e660 0x7f1edc133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1edaffd700 1 -- 172.21.15.36:0/476696784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc13e660 msgr2=0x7f1edc133cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1edaffd700 1 --2- 172.21.15.36:0/476696784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc13e660 0x7f1edc133cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1edaffd700 1 -- 172.21.15.36:0/476696784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1edc0b3cf0 msgr2=0x7f1edc134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1edaffd700 1 --2- 172.21.15.36:0/476696784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1edc0b3cf0 0x7f1edc134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1edaffd700 1 -- 172.21.15.36:0/476696784 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed4009530 con 0x7f1edc0af780 2022-01-10T01:24:46.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.664+0000 7f1edaffd700 1 --2- 172.21.15.36:0/476696784 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1edc0af780 0x7f1edc139980 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f1edc0649e0 tx=0x7f1ecc007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:46.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.668+0000 7f1ecbfff700 1 -- 172.21.15.36:0/476696784 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ecc012400 con 0x7f1edc0af780 2022-01-10T01:24:46.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.668+0000 7f1ecbfff700 1 -- 172.21.15.36:0/476696784 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc012560 con 0x7f1edc0af780 2022-01-10T01:24:46.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.668+0000 7f1ee1893700 1 -- 172.21.15.36:0/476696784 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1edc066870 con 0x7f1edc0af780 2022-01-10T01:24:46.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.668+0000 7f1ecbfff700 1 -- 172.21.15.36:0/476696784 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ecc0128c0 con 0x7f1edc0af780 2022-01-10T01:24:46.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.668+0000 7f1ee1893700 1 -- 172.21.15.36:0/476696784 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1edc13a3e0 con 0x7f1edc0af780 2022-01-10T01:24:46.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.668+0000 7f1ee1893700 1 -- 172.21.15.36:0/476696784 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1edc0b2440 con 0x7f1edc0af780 2022-01-10T01:24:46.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.668+0000 7f1ecbfff700 1 -- 172.21.15.36:0/476696784 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1ecc019030 con 0x7f1edc0af780 2022-01-10T01:24:46.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.668+0000 7f1ecbfff700 1 --2- 172.21.15.36:0/476696784 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1eb8053680 0x7f1eb8055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.668+0000 7f1ecbfff700 1 -- 172.21.15.36:0/476696784 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f1ecc06ae50 con 0x7f1edc0af780 2022-01-10T01:24:46.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.668+0000 7f1eda7fc700 1 --2- 172.21.15.36:0/476696784 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1eb8053680 0x7f1eb8055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.668+0000 7f1eda7fc700 1 --2- 172.21.15.36:0/476696784 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1eb8053680 0x7f1eb8055b40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1ed000c000 tx=0x7f1ed0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:46.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.676+0000 7f1ecbfff700 1 -- 172.21.15.36:0/476696784 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1ecc041e60 con 0x7f1edc0af780 2022-01-10T01:24:46.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.800+0000 7f1ee1893700 1 -- 172.21.15.36:0/476696784 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1edc057350 con 0x7f1edc0af780 2022-01-10T01:24:46.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.800+0000 7f1ecbfff700 1 -- 172.21.15.36:0/476696784 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1ecc045480 con 0x7f1edc0af780 2022-01-10T01:24:46.809 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:46.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.804+0000 7f1ee1893700 1 -- 172.21.15.36:0/476696784 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1eb8053680 msgr2=0x7f1eb8055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.804+0000 7f1ee1893700 1 --2- 172.21.15.36:0/476696784 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1eb8053680 0x7f1eb8055b40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f1ed000c000 tx=0x7f1ed0008040).stop 2022-01-10T01:24:46.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.804+0000 7f1ee1893700 1 -- 172.21.15.36:0/476696784 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1edc0af780 msgr2=0x7f1edc139980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.804+0000 7f1ee1893700 1 --2- 172.21.15.36:0/476696784 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1edc0af780 0x7f1edc139980 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f1edc0649e0 tx=0x7f1ecc007c50).stop 2022-01-10T01:24:46.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.804+0000 7f1ee1893700 1 -- 172.21.15.36:0/476696784 shutdown_connections 2022-01-10T01:24:46.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.804+0000 7f1ee1893700 1 --2- 172.21.15.36:0/476696784 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1eb8053680 0x7f1eb8055b40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.804+0000 7f1ee1893700 1 --2- 172.21.15.36:0/476696784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1edc13e660 0x7f1edc133cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.804+0000 7f1ee1893700 1 --2- 172.21.15.36:0/476696784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1edc0b3cf0 0x7f1edc134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.804+0000 7f1ee1893700 1 --2- 172.21.15.36:0/476696784 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1edc0af780 0x7f1edc139980 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.804+0000 7f1ee1893700 1 -- 172.21.15.36:0/476696784 >> 172.21.15.36:0/476696784 conn(0x7f1edc06a110 msgr2=0x7f1edc13cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:46.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.804+0000 7f1ee1893700 1 -- 172.21.15.36:0/476696784 shutdown_connections 2022-01-10T01:24:46.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.804+0000 7f1ee1893700 1 -- 172.21.15.36:0/476696784 wait complete. 2022-01-10T01:24:46.822 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:24:46.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb1700bc700 1 Processor -- start 2022-01-10T01:24:46.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb1700bc700 1 -- start start 2022-01-10T01:24:46.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb1700bc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb1680b12d0 0x7fb1680affb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb1700bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1680b22a0 0x7fb168141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb1700bc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1680a77d0 con 0x7fb1680b1ec0 2022-01-10T01:24:46.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb1700bc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1680b1740 con 0x7fb1680b12d0 2022-01-10T01:24:46.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb1700bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680b0650 con 0x7fb1680b22a0 2022-01-10T01:24:46.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb16d657700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb1680b12d0 0x7fb1680affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb16e659700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1680b22a0 0x7fb168141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb16d657700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb1680b12d0 0x7fb1680affb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:59370/0 (socket says 172.21.15.36:59370) 2022-01-10T01:24:46.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb16d657700 1 -- 172.21.15.36:0/589925630 learned_addr learned my addr 172.21.15.36:0/589925630 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:46.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb16de58700 1 --1- 172.21.15.36:0/589925630 >> v1:172.21.15.59:6789/0 conn(0x7fb1680b1ec0 0x7fb1680a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:49972/0 (socket says 172.21.15.36:49972) 2022-01-10T01:24:46.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb16d657700 1 -- 172.21.15.36:0/589925630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1680b22a0 msgr2=0x7fb168141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:46.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb16d657700 1 --2- 172.21.15.36:0/589925630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1680b22a0 0x7fb168141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb16d657700 1 -- 172.21.15.36:0/589925630 >> v1:172.21.15.59:6789/0 conn(0x7fb1680b1ec0 legacy=0x7fb1680a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb16d657700 1 -- 172.21.15.36:0/589925630 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1680b08f0 con 0x7fb1680b12d0 2022-01-10T01:24:46.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb16d657700 1 --2- 172.21.15.36:0/589925630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1680b12d0 0x7fb1680affb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fb158002f70 tx=0x7fb158006eb0).ready entity=mon.1 client_cookie=35e3910186fc6982 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:46.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb16ce56700 1 -- 172.21.15.36:0/589925630 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb15800d570 con 0x7fb1680b12d0 2022-01-10T01:24:46.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb16ce56700 1 -- 172.21.15.36:0/589925630 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb158000e90 con 0x7fb1680b12d0 2022-01-10T01:24:46.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb16ce56700 1 -- 172.21.15.36:0/589925630 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb15800d900 con 0x7fb1680b12d0 2022-01-10T01:24:46.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb1700bc700 1 -- 172.21.15.36:0/589925630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1680b12d0 msgr2=0x7fb1680affb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb1700bc700 1 --2- 172.21.15.36:0/589925630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1680b12d0 0x7fb1680affb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fb158002f70 tx=0x7fb158006eb0).stop 2022-01-10T01:24:46.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb1700bc700 1 -- 172.21.15.36:0/589925630 shutdown_connections 2022-01-10T01:24:46.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb1700bc700 1 --2- 172.21.15.36:0/589925630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1680b22a0 0x7fb168141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb1700bc700 1 --2- 172.21.15.36:0/589925630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1680b12d0 0x7fb1680affb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.932+0000 7fb1700bc700 1 -- 172.21.15.36:0/589925630 >> 172.21.15.36:0/589925630 conn(0x7fb16805f6b0 msgr2=0x7fb16805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:46.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb1700bc700 1 -- 172.21.15.36:0/589925630 shutdown_connections 2022-01-10T01:24:46.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb1700bc700 1 -- 172.21.15.36:0/589925630 wait complete. 2022-01-10T01:24:46.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb1700bc700 1 Processor -- start 2022-01-10T01:24:46.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb1700bc700 1 -- start start 2022-01-10T01:24:46.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb1700bc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1680b12d0 0x7fb1680b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb1700bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1680b1ec0 0x7fb16814ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb1700bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1680b22a0 0x7fb16814b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb1700bc700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680b3a90 con 0x7fb1680b12d0 2022-01-10T01:24:46.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb1700bc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16814a6c0 con 0x7fb1680b1ec0 2022-01-10T01:24:46.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb1700bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16814a250 con 0x7fb1680b22a0 2022-01-10T01:24:46.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb16de58700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1680b12d0 0x7fb1680b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb16de58700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1680b12d0 0x7fb1680b46f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34508/0 (socket says 172.21.15.36:34508) 2022-01-10T01:24:46.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb16de58700 1 -- 172.21.15.36:0/813527719 learned_addr learned my addr 172.21.15.36:0/813527719 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:46.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb16d657700 1 --2- 172.21.15.36:0/813527719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1680b1ec0 0x7fb16814ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb16e659700 1 --2- 172.21.15.36:0/813527719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1680b22a0 0x7fb16814b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb16de58700 1 -- 172.21.15.36:0/813527719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1680b22a0 msgr2=0x7fb16814b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb16de58700 1 --2- 172.21.15.36:0/813527719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1680b22a0 0x7fb16814b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb16de58700 1 -- 172.21.15.36:0/813527719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1680b1ec0 msgr2=0x7fb16814ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:46.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb16de58700 1 --2- 172.21.15.36:0/813527719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1680b1ec0 0x7fb16814ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:46.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb16de58700 1 -- 172.21.15.36:0/813527719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15800b1e0 con 0x7fb1680b12d0 2022-01-10T01:24:46.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.936+0000 7fb16de58700 1 --2- 172.21.15.36:0/813527719 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1680b12d0 0x7fb1680b46f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fb1680b2f50 tx=0x7fb164007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:46.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.940+0000 7fb156ffd700 1 -- 172.21.15.36:0/813527719 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1640070d0 con 0x7fb1680b12d0 2022-01-10T01:24:46.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.940+0000 7fb1700bc700 1 -- 172.21.15.36:0/813527719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb168149890 con 0x7fb1680b12d0 2022-01-10T01:24:46.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.940+0000 7fb156ffd700 1 -- 172.21.15.36:0/813527719 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb164007230 con 0x7fb1680b12d0 2022-01-10T01:24:46.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.940+0000 7fb156ffd700 1 -- 172.21.15.36:0/813527719 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb164005550 con 0x7fb1680b12d0 2022-01-10T01:24:46.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.940+0000 7fb1700bc700 1 -- 172.21.15.36:0/813527719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1680affc0 con 0x7fb1680b12d0 2022-01-10T01:24:46.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.940+0000 7fb156ffd700 1 -- 172.21.15.36:0/813527719 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb16401a070 con 0x7fb1680b12d0 2022-01-10T01:24:46.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.940+0000 7fb1700bc700 1 -- 172.21.15.36:0/813527719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1681494d0 con 0x7fb1680b12d0 2022-01-10T01:24:46.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.940+0000 7fb156ffd700 1 --2- 172.21.15.36:0/813527719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb1480535f0 0x7fb148055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:46.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.940+0000 7fb156ffd700 1 -- 172.21.15.36:0/813527719 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fb16406ae10 con 0x7fb1680b12d0 2022-01-10T01:24:46.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.940+0000 7fb16d657700 1 --2- 172.21.15.36:0/813527719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb1480535f0 0x7fb148055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:46.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.940+0000 7fb16d657700 1 --2- 172.21.15.36:0/813527719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb1480535f0 0x7fb148055ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fb15801c000 tx=0x7fb158015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:46.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:46.944+0000 7fb156ffd700 1 -- 172.21.15.36:0/813527719 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb16406e030 con 0x7fb1680b12d0 2022-01-10T01:24:47.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.072+0000 7fb1700bc700 1 -- 172.21.15.36:0/813527719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb168057350 con 0x7fb1680b12d0 2022-01-10T01:24:47.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.072+0000 7fb156ffd700 1 -- 172.21.15.36:0/813527719 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb164018030 con 0x7fb1680b12d0 2022-01-10T01:24:47.080 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:47.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.076+0000 7fb1700bc700 1 -- 172.21.15.36:0/813527719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb1480535f0 msgr2=0x7fb148055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.076+0000 7fb1700bc700 1 --2- 172.21.15.36:0/813527719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb1480535f0 0x7fb148055ab0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fb15801c000 tx=0x7fb158015000).stop 2022-01-10T01:24:47.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.076+0000 7fb1700bc700 1 -- 172.21.15.36:0/813527719 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1680b12d0 msgr2=0x7fb1680b46f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.076+0000 7fb1700bc700 1 --2- 172.21.15.36:0/813527719 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1680b12d0 0x7fb1680b46f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7fb1680b2f50 tx=0x7fb164007c40).stop 2022-01-10T01:24:47.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.076+0000 7fb1700bc700 1 -- 172.21.15.36:0/813527719 shutdown_connections 2022-01-10T01:24:47.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.076+0000 7fb1700bc700 1 --2- 172.21.15.36:0/813527719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb1480535f0 0x7fb148055ab0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.076+0000 7fb1700bc700 1 --2- 172.21.15.36:0/813527719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1680b22a0 0x7fb16814b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.076+0000 7fb1700bc700 1 --2- 172.21.15.36:0/813527719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1680b1ec0 0x7fb16814ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.076+0000 7fb1700bc700 1 --2- 172.21.15.36:0/813527719 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb1680b12d0 0x7fb1680b46f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.076+0000 7fb1700bc700 1 -- 172.21.15.36:0/813527719 >> 172.21.15.36:0/813527719 conn(0x7fb16805f6b0 msgr2=0x7fb1680aa870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:47.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.076+0000 7fb1700bc700 1 -- 172.21.15.36:0/813527719 shutdown_connections 2022-01-10T01:24:47.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.076+0000 7fb1700bc700 1 -- 172.21.15.36:0/813527719 wait complete. 2022-01-10T01:24:47.099 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:24:47.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.208+0000 7ffb55f9c700 1 Processor -- start 2022-01-10T01:24:47.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.208+0000 7ffb55f9c700 1 -- start start 2022-01-10T01:24:47.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.208+0000 7ffb55f9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb500a9190 0x7ffb50146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.208+0000 7ffb55f9c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ffb500b0b80 0x7ffb50146a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.208+0000 7ffb55f9c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb500b1140 con 0x7ffb500b03d0 2022-01-10T01:24:47.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.208+0000 7ffb55f9c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb500a9570 con 0x7ffb500b0b80 2022-01-10T01:24:47.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.208+0000 7ffb55f9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500b1370 con 0x7ffb500a9190 2022-01-10T01:24:47.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb4ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ffb500b0b80 0x7ffb50146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb5579b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffb500b03d0 0x7ffb501401c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:49990/0 (socket says 172.21.15.36:49990) 2022-01-10T01:24:47.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb5579b700 1 -- 172.21.15.36:0/4165448347 learned_addr learned my addr 172.21.15.36:0/4165448347 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:47.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb54f9a700 1 --2- 172.21.15.36:0/4165448347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb500a9190 0x7ffb50146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb4ffff700 1 -- 172.21.15.36:0/4165448347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb500a9190 msgr2=0x7ffb50146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:47.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb4ffff700 1 --2- 172.21.15.36:0/4165448347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb500a9190 0x7ffb50146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb4ffff700 1 -- 172.21.15.36:0/4165448347 >> v1:172.21.15.59:6789/0 conn(0x7ffb500b03d0 legacy=0x7ffb501401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb4ffff700 1 -- 172.21.15.36:0/4165448347 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb500b1610 con 0x7ffb500b0b80 2022-01-10T01:24:47.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb4ffff700 1 --2- 172.21.15.36:0/4165448347 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb500b0b80 0x7ffb50146a40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7ffb40002f70 tx=0x7ffb40006df0).ready entity=mon.0 client_cookie=4d0d59d81ad6d612 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:47.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb4f7fe700 1 -- 172.21.15.36:0/4165448347 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb4000d570 con 0x7ffb500b0b80 2022-01-10T01:24:47.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb4f7fe700 1 -- 172.21.15.36:0/4165448347 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb40000e90 con 0x7ffb500b0b80 2022-01-10T01:24:47.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb4f7fe700 1 -- 172.21.15.36:0/4165448347 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb4000d8c0 con 0x7ffb500b0b80 2022-01-10T01:24:47.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb55f9c700 1 -- 172.21.15.36:0/4165448347 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb500b0b80 msgr2=0x7ffb50146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb55f9c700 1 --2- 172.21.15.36:0/4165448347 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb500b0b80 0x7ffb50146a40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7ffb40002f70 tx=0x7ffb40006df0).stop 2022-01-10T01:24:47.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb55f9c700 1 -- 172.21.15.36:0/4165448347 shutdown_connections 2022-01-10T01:24:47.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb55f9c700 1 --2- 172.21.15.36:0/4165448347 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb500b0b80 0x7ffb50146a40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb55f9c700 1 --2- 172.21.15.36:0/4165448347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb500a9190 0x7ffb50146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb55f9c700 1 -- 172.21.15.36:0/4165448347 >> 172.21.15.36:0/4165448347 conn(0x7ffb50061140 msgr2=0x7ffb50062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:47.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb55f9c700 1 -- 172.21.15.36:0/4165448347 shutdown_connections 2022-01-10T01:24:47.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb55f9c700 1 -- 172.21.15.36:0/4165448347 wait complete. 2022-01-10T01:24:47.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.212+0000 7ffb55f9c700 1 Processor -- start 2022-01-10T01:24:47.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb55f9c700 1 -- start start 2022-01-10T01:24:47.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb55f9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb500a9190 0x7ffb500ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb55f9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb500b03d0 0x7ffb50064050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb55f9c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb500b0b80 0x7ffb500a9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb55f9c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500ab8c0 con 0x7ffb500b0b80 2022-01-10T01:24:47.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb55f9c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500b37b0 con 0x7ffb500b03d0 2022-01-10T01:24:47.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb55f9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500b57b0 con 0x7ffb500a9190 2022-01-10T01:24:47.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb5579b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb500b0b80 0x7ffb500a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb5579b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb500b0b80 0x7ffb500a9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34526/0 (socket says 172.21.15.36:34526) 2022-01-10T01:24:47.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb5579b700 1 -- 172.21.15.36:0/907887974 learned_addr learned my addr 172.21.15.36:0/907887974 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:47.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb54f9a700 1 --2- 172.21.15.36:0/907887974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb500a9190 0x7ffb500ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb4ffff700 1 --2- 172.21.15.36:0/907887974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb500b03d0 0x7ffb50064050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb5579b700 1 -- 172.21.15.36:0/907887974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb500a9190 msgr2=0x7ffb500ac3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb5579b700 1 --2- 172.21.15.36:0/907887974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb500a9190 0x7ffb500ac3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb5579b700 1 -- 172.21.15.36:0/907887974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb500b03d0 msgr2=0x7ffb50064050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb5579b700 1 --2- 172.21.15.36:0/907887974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb500b03d0 0x7ffb50064050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb5579b700 1 -- 172.21.15.36:0/907887974 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4000b180 con 0x7ffb500b0b80 2022-01-10T01:24:47.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb5579b700 1 --2- 172.21.15.36:0/907887974 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb500b0b80 0x7ffb500a9820 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7ffb500b0290 tx=0x7ffb48007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:47.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb4dffb700 1 -- 172.21.15.36:0/907887974 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb48005ba0 con 0x7ffb500b0b80 2022-01-10T01:24:47.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb4dffb700 1 -- 172.21.15.36:0/907887974 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb48005d00 con 0x7ffb500b0b80 2022-01-10T01:24:47.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb4dffb700 1 -- 172.21.15.36:0/907887974 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb480072c0 con 0x7ffb500b0b80 2022-01-10T01:24:47.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb55f9c700 1 -- 172.21.15.36:0/907887974 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb500b4470 con 0x7ffb500b0b80 2022-01-10T01:24:47.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.216+0000 7ffb55f9c700 1 -- 172.21.15.36:0/907887974 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb500b4990 con 0x7ffb500b0b80 2022-01-10T01:24:47.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.220+0000 7ffb55f9c700 1 -- 172.21.15.36:0/907887974 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb50064880 con 0x7ffb500b0b80 2022-01-10T01:24:47.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.220+0000 7ffb4dffb700 1 -- 172.21.15.36:0/907887974 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ffb48010070 con 0x7ffb500b0b80 2022-01-10T01:24:47.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.220+0000 7ffb4dffb700 1 --2- 172.21.15.36:0/907887974 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffb340534d0 0x7ffb34055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.220+0000 7ffb4dffb700 1 -- 172.21.15.36:0/907887974 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7ffb4806b3b0 con 0x7ffb500b0b80 2022-01-10T01:24:47.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.220+0000 7ffb54f9a700 1 --2- 172.21.15.36:0/907887974 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffb340534d0 0x7ffb34055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.220+0000 7ffb54f9a700 1 --2- 172.21.15.36:0/907887974 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffb340534d0 0x7ffb34055990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7ffb3800b000 tx=0x7ffb38006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:47.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.224+0000 7ffb4dffb700 1 -- 172.21.15.36:0/907887974 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffb48042320 con 0x7ffb500b0b80 2022-01-10T01:24:47.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.352+0000 7ffb55f9c700 1 -- 172.21.15.36:0/907887974 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb500ac8c0 con 0x7ffb500b0b80 2022-01-10T01:24:47.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.352+0000 7ffb4dffb700 1 -- 172.21.15.36:0/907887974 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7ffb500ac8c0 con 0x7ffb500b0b80 2022-01-10T01:24:47.360 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:47.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.356+0000 7ffb55f9c700 1 -- 172.21.15.36:0/907887974 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffb340534d0 msgr2=0x7ffb34055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.356+0000 7ffb55f9c700 1 --2- 172.21.15.36:0/907887974 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffb340534d0 0x7ffb34055990 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7ffb3800b000 tx=0x7ffb38006df0).stop 2022-01-10T01:24:47.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.356+0000 7ffb55f9c700 1 -- 172.21.15.36:0/907887974 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb500b0b80 msgr2=0x7ffb500a9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.356+0000 7ffb55f9c700 1 --2- 172.21.15.36:0/907887974 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb500b0b80 0x7ffb500a9820 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7ffb500b0290 tx=0x7ffb48007f40).stop 2022-01-10T01:24:47.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.356+0000 7ffb55f9c700 1 -- 172.21.15.36:0/907887974 shutdown_connections 2022-01-10T01:24:47.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.356+0000 7ffb55f9c700 1 --2- 172.21.15.36:0/907887974 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffb340534d0 0x7ffb34055990 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.356+0000 7ffb55f9c700 1 --2- 172.21.15.36:0/907887974 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb500b0b80 0x7ffb500a9820 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.356+0000 7ffb55f9c700 1 --2- 172.21.15.36:0/907887974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb500b03d0 0x7ffb50064050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.356+0000 7ffb55f9c700 1 --2- 172.21.15.36:0/907887974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb500a9190 0x7ffb500ac3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.356+0000 7ffb55f9c700 1 -- 172.21.15.36:0/907887974 >> 172.21.15.36:0/907887974 conn(0x7ffb50061140 msgr2=0x7ffb5013dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:47.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.356+0000 7ffb55f9c700 1 -- 172.21.15.36:0/907887974 shutdown_connections 2022-01-10T01:24:47.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.356+0000 7ffb55f9c700 1 -- 172.21.15.36:0/907887974 wait complete. 2022-01-10T01:24:47.373 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:47.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.464+0000 7f47a176b700 1 Processor -- start 2022-01-10T01:24:47.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.464+0000 7f47a176b700 1 -- start start 2022-01-10T01:24:47.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.464+0000 7f47a176b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479c0b3000 0x7f479c060b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.464+0000 7f47a176b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f479c061000 0x7f479c066c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.464+0000 7f47a176b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c065330 con 0x7f479c0b25a0 2022-01-10T01:24:47.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.464+0000 7f47a176b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c062000 con 0x7f479c061000 2022-01-10T01:24:47.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.464+0000 7f47a176b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c061470 con 0x7f479c0b3000 2022-01-10T01:24:47.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.464+0000 7f479b7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f479c0b25a0 0x7f479c066520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60556/0 (socket says 172.21.15.36:60556) 2022-01-10T01:24:47.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.464+0000 7f479b7fe700 1 -- 172.21.15.36:0/611137144 learned_addr learned my addr 172.21.15.36:0/611137144 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:47.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f479bfff700 1 --2- 172.21.15.36:0/611137144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479c0b3000 0x7f479c060b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f47a0f6a700 1 --2- 172.21.15.36:0/611137144 >> v2:172.21.15.59:3300/0 conn(0x7f479c061000 0x7f479c066c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f479affd700 1 -- 172.21.15.36:0/611137144 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426745015 0 0) 0x7f479c065330 con 0x7f479c0b25a0 2022-01-10T01:24:47.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f479affd700 1 -- 172.21.15.36:0/611137144 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f477c003260 con 0x7f479c0b25a0 2022-01-10T01:24:47.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f479bfff700 1 -- 172.21.15.36:0/611137144 >> v2:172.21.15.59:3300/0 conn(0x7f479c061000 msgr2=0x7f479c066c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:47.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f479bfff700 1 --2- 172.21.15.36:0/611137144 >> v2:172.21.15.59:3300/0 conn(0x7f479c061000 0x7f479c066c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f479bfff700 1 -- 172.21.15.36:0/611137144 >> v1:172.21.15.36:6789/0 conn(0x7f479c0b25a0 legacy=0x7f479c066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f479bfff700 1 -- 172.21.15.36:0/611137144 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c0b33e0 con 0x7f479c0b3000 2022-01-10T01:24:47.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f479bfff700 1 --2- 172.21.15.36:0/611137144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479c0b3000 0x7f479c060b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f478c002f70 tx=0x7f478c006df0).ready entity=mon.2 client_cookie=bc6ed2652db59051 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:47.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f479affd700 1 -- 172.21.15.36:0/611137144 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f478c00d4a0 con 0x7f479c0b3000 2022-01-10T01:24:47.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f479affd700 1 -- 172.21.15.36:0/611137144 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478c000e90 con 0x7f479c0b3000 2022-01-10T01:24:47.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f479affd700 1 -- 172.21.15.36:0/611137144 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f478c00d7f0 con 0x7f479c0b3000 2022-01-10T01:24:47.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f47a176b700 1 -- 172.21.15.36:0/611137144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479c0b3000 msgr2=0x7f479c060b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f47a176b700 1 --2- 172.21.15.36:0/611137144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479c0b3000 0x7f479c060b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f478c002f70 tx=0x7f478c006df0).stop 2022-01-10T01:24:47.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f47a176b700 1 -- 172.21.15.36:0/611137144 shutdown_connections 2022-01-10T01:24:47.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f47a176b700 1 --2- 172.21.15.36:0/611137144 >> v2:172.21.15.59:3300/0 conn(0x7f479c061000 0x7f479c066c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f47a176b700 1 --2- 172.21.15.36:0/611137144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479c0b3000 0x7f479c060b10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f47a176b700 1 -- 172.21.15.36:0/611137144 >> 172.21.15.36:0/611137144 conn(0x7f479c0636e0 msgr2=0x7f479c063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:47.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f47a176b700 1 -- 172.21.15.36:0/611137144 shutdown_connections 2022-01-10T01:24:47.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f47a176b700 1 -- 172.21.15.36:0/611137144 wait complete. 2022-01-10T01:24:47.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f47a176b700 1 Processor -- start 2022-01-10T01:24:47.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.468+0000 7f47a176b700 1 -- start start 2022-01-10T01:24:47.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a176b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479c061000 0x7f479c148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a176b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479c0b25a0 0x7f479c0ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a176b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f479c0b3000 0x7f479c0afae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a176b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0ad1b0 con 0x7f479c0b3000 2022-01-10T01:24:47.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a176b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0ad450 con 0x7f479c0b25a0 2022-01-10T01:24:47.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a176b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0ad6f0 con 0x7f479c061000 2022-01-10T01:24:47.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a0f6a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f479c0b3000 0x7f479c0afae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a0f6a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f479c0b3000 0x7f479c0afae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34540/0 (socket says 172.21.15.36:34540) 2022-01-10T01:24:47.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a0f6a700 1 -- 172.21.15.36:0/2236430702 learned_addr learned my addr 172.21.15.36:0/2236430702 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:47.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f479b7fe700 1 --2- 172.21.15.36:0/2236430702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479c0b25a0 0x7f479c0ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f479bfff700 1 --2- 172.21.15.36:0/2236430702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479c061000 0x7f479c148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a0f6a700 1 -- 172.21.15.36:0/2236430702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479c061000 msgr2=0x7f479c148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a0f6a700 1 --2- 172.21.15.36:0/2236430702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479c061000 0x7f479c148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a0f6a700 1 -- 172.21.15.36:0/2236430702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479c0b25a0 msgr2=0x7f479c0ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a0f6a700 1 --2- 172.21.15.36:0/2236430702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479c0b25a0 0x7f479c0ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a0f6a700 1 -- 172.21.15.36:0/2236430702 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c00b180 con 0x7f479c0b3000 2022-01-10T01:24:47.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a0f6a700 1 --2- 172.21.15.36:0/2236430702 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f479c0b3000 0x7f479c0afae0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f4794006e00 tx=0x7f47940091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:47.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47997fa700 1 -- 172.21.15.36:0/2236430702 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f479400c640 con 0x7f479c0b3000 2022-01-10T01:24:47.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47997fa700 1 -- 172.21.15.36:0/2236430702 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479400c7a0 con 0x7f479c0b3000 2022-01-10T01:24:47.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47997fa700 1 -- 172.21.15.36:0/2236430702 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f479400cb00 con 0x7f479c0b3000 2022-01-10T01:24:47.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a176b700 1 -- 172.21.15.36:0/2236430702 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c0abd60 con 0x7f479c0b3000 2022-01-10T01:24:47.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a176b700 1 -- 172.21.15.36:0/2236430702 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c152180 con 0x7f479c0b3000 2022-01-10T01:24:47.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47a176b700 1 -- 172.21.15.36:0/2236430702 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c05fa60 con 0x7f479c0b3000 2022-01-10T01:24:47.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47997fa700 1 -- 172.21.15.36:0/2236430702 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f479400cc60 con 0x7f479c0b3000 2022-01-10T01:24:47.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.472+0000 7f47997fa700 1 --2- 172.21.15.36:0/2236430702 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f47800534d0 0x7f4780055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.476+0000 7f47997fa700 1 -- 172.21.15.36:0/2236430702 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f479406bce0 con 0x7f479c0b3000 2022-01-10T01:24:47.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.476+0000 7f479bfff700 1 --2- 172.21.15.36:0/2236430702 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f47800534d0 0x7f4780055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.476+0000 7f479bfff700 1 --2- 172.21.15.36:0/2236430702 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f47800534d0 0x7f4780055990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f478c01a000 tx=0x7f478c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:47.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.480+0000 7f47997fa700 1 -- 172.21.15.36:0/2236430702 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4794042cf0 con 0x7f479c0b3000 2022-01-10T01:24:47.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.608+0000 7f47a176b700 1 -- 172.21.15.36:0/2236430702 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f479c057350 con 0x7f479c0b3000 2022-01-10T01:24:47.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.608+0000 7f47997fa700 1 -- 172.21.15.36:0/2236430702 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16299 (secure 0 0 0) 0x7f4794046310 con 0x7f479c0b3000 2022-01-10T01:24:47.615 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:47.615 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:25.224959+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:24:20.202898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-10T01:24:22.952870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:47.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.612+0000 7f47a176b700 1 -- 172.21.15.36:0/2236430702 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f47800534d0 msgr2=0x7f4780055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.612+0000 7f47a176b700 1 --2- 172.21.15.36:0/2236430702 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f47800534d0 0x7f4780055990 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f478c01a000 tx=0x7f478c014000).stop 2022-01-10T01:24:47.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.612+0000 7f47a176b700 1 -- 172.21.15.36:0/2236430702 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f479c0b3000 msgr2=0x7f479c0afae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.612+0000 7f47a176b700 1 --2- 172.21.15.36:0/2236430702 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f479c0b3000 0x7f479c0afae0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f4794006e00 tx=0x7f47940091d0).stop 2022-01-10T01:24:47.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.612+0000 7f47a176b700 1 -- 172.21.15.36:0/2236430702 shutdown_connections 2022-01-10T01:24:47.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.612+0000 7f47a176b700 1 --2- 172.21.15.36:0/2236430702 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f47800534d0 0x7f4780055990 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.612+0000 7f47a176b700 1 --2- 172.21.15.36:0/2236430702 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f479c0b3000 0x7f479c0afae0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.612+0000 7f47a176b700 1 --2- 172.21.15.36:0/2236430702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479c0b25a0 0x7f479c0ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.612+0000 7f47a176b700 1 --2- 172.21.15.36:0/2236430702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479c061000 0x7f479c148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.612+0000 7f47a176b700 1 -- 172.21.15.36:0/2236430702 >> 172.21.15.36:0/2236430702 conn(0x7f479c0636e0 msgr2=0x7f479c1460c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:47.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.612+0000 7f47a176b700 1 -- 172.21.15.36:0/2236430702 shutdown_connections 2022-01-10T01:24:47.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.612+0000 7f47a176b700 1 -- 172.21.15.36:0/2236430702 wait complete. 2022-01-10T01:24:47.631 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:24:20.202898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:24:22.952870+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:24:47.632 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:24:47.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.732+0000 7fdb6a66a700 1 Processor -- start 2022-01-10T01:24:47.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.732+0000 7fdb6a66a700 1 -- start start 2022-01-10T01:24:47.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb6a66a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb64146950 0x7fdb64140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb6a66a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb640b4180 0x7fdb64140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb6a66a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb64143b60 con 0x7fdb640b4690 2022-01-10T01:24:47.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb6a66a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb64147510 con 0x7fdb64146950 2022-01-10T01:24:47.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb6a66a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64143e00 con 0x7fdb640b4180 2022-01-10T01:24:47.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb637fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb640b4180 0x7fdb64140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb63fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb64146950 0x7fdb64140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb68c07700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdb640b4690 0x7fdb640b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:50018/0 (socket says 172.21.15.36:50018) 2022-01-10T01:24:47.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb68c07700 1 -- 172.21.15.36:0/189358552 learned_addr learned my addr 172.21.15.36:0/189358552 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:47.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb637fe700 1 -- 172.21.15.36:0/189358552 >> v2:172.21.15.59:3300/0 conn(0x7fdb64146950 msgr2=0x7fdb64140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:47.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb637fe700 1 --2- 172.21.15.36:0/189358552 >> v2:172.21.15.59:3300/0 conn(0x7fdb64146950 0x7fdb64140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb637fe700 1 -- 172.21.15.36:0/189358552 >> v1:172.21.15.59:6789/0 conn(0x7fdb640b4690 legacy=0x7fdb640b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb637fe700 1 -- 172.21.15.36:0/189358552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb640b0c90 con 0x7fdb640b4180 2022-01-10T01:24:47.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb637fe700 1 --2- 172.21.15.36:0/189358552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb640b4180 0x7fdb64140720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fdb54002f70 tx=0x7fdb54006df0).ready entity=mon.2 client_cookie=a3eb654cd6e422f1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:47.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb62ffd700 1 -- 172.21.15.36:0/189358552 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb5400d570 con 0x7fdb640b4180 2022-01-10T01:24:47.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb62ffd700 1 -- 172.21.15.36:0/189358552 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb54000e90 con 0x7fdb640b4180 2022-01-10T01:24:47.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb62ffd700 1 -- 172.21.15.36:0/189358552 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb5400d8c0 con 0x7fdb640b4180 2022-01-10T01:24:47.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb6a66a700 1 -- 172.21.15.36:0/189358552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb640b4180 msgr2=0x7fdb64140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.736+0000 7fdb6a66a700 1 --2- 172.21.15.36:0/189358552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb640b4180 0x7fdb64140720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fdb54002f70 tx=0x7fdb54006df0).stop 2022-01-10T01:24:47.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb6a66a700 1 -- 172.21.15.36:0/189358552 shutdown_connections 2022-01-10T01:24:47.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb6a66a700 1 --2- 172.21.15.36:0/189358552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb640b4180 0x7fdb64140720 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb6a66a700 1 --2- 172.21.15.36:0/189358552 >> v2:172.21.15.59:3300/0 conn(0x7fdb64146950 0x7fdb64140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb6a66a700 1 -- 172.21.15.36:0/189358552 >> 172.21.15.36:0/189358552 conn(0x7fdb6405c490 msgr2=0x7fdb6405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:47.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb6a66a700 1 -- 172.21.15.36:0/189358552 shutdown_connections 2022-01-10T01:24:47.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb6a66a700 1 -- 172.21.15.36:0/189358552 wait complete. 2022-01-10T01:24:47.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb6a66a700 1 Processor -- start 2022-01-10T01:24:47.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb6a66a700 1 -- start start 2022-01-10T01:24:47.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb6a66a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb640b4180 0x7fdb641522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb6a66a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb640b4690 0x7fdb641560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb6a66a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb64146950 0x7fdb640b8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb6a66a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb641527b0 con 0x7fdb64146950 2022-01-10T01:24:47.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb6a66a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640b0730 con 0x7fdb640b4180 2022-01-10T01:24:47.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb6a66a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb641559d0 con 0x7fdb640b4690 2022-01-10T01:24:47.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb68c07700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb64146950 0x7fdb640b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb637fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb640b4690 0x7fdb641560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb68c07700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb64146950 0x7fdb640b8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34554/0 (socket says 172.21.15.36:34554) 2022-01-10T01:24:47.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb68c07700 1 -- 172.21.15.36:0/647973597 learned_addr learned my addr 172.21.15.36:0/647973597 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:47.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.740+0000 7fdb63fff700 1 --2- 172.21.15.36:0/647973597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb640b4180 0x7fdb641522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.744+0000 7fdb637fe700 1 -- 172.21.15.36:0/647973597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb640b4180 msgr2=0x7fdb641522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.744+0000 7fdb637fe700 1 --2- 172.21.15.36:0/647973597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb640b4180 0x7fdb641522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.744+0000 7fdb637fe700 1 -- 172.21.15.36:0/647973597 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb64146950 msgr2=0x7fdb640b8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.744+0000 7fdb637fe700 1 --2- 172.21.15.36:0/647973597 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb64146950 0x7fdb640b8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.744+0000 7fdb637fe700 1 -- 172.21.15.36:0/647973597 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5400b180 con 0x7fdb640b4690 2022-01-10T01:24:47.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.744+0000 7fdb68c07700 1 --2- 172.21.15.36:0/647973597 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb64146950 0x7fdb640b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:47.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.744+0000 7fdb637fe700 1 --2- 172.21.15.36:0/647973597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb640b4690 0x7fdb641560d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fdb640af280 tx=0x7fdb54014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:47.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.744+0000 7fdb617fa700 1 -- 172.21.15.36:0/647973597 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb54016070 con 0x7fdb640b4690 2022-01-10T01:24:47.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.744+0000 7fdb617fa700 1 -- 172.21.15.36:0/647973597 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5400d8f0 con 0x7fdb640b4690 2022-01-10T01:24:47.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.744+0000 7fdb6a66a700 1 -- 172.21.15.36:0/647973597 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb64143000 con 0x7fdb640b4690 2022-01-10T01:24:47.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.744+0000 7fdb617fa700 1 -- 172.21.15.36:0/647973597 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb54013e50 con 0x7fdb640b4690 2022-01-10T01:24:47.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.744+0000 7fdb6a66a700 1 -- 172.21.15.36:0/647973597 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb64155c30 con 0x7fdb640b4690 2022-01-10T01:24:47.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.744+0000 7fdb6a66a700 1 -- 172.21.15.36:0/647973597 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb64155df0 con 0x7fdb640b4690 2022-01-10T01:24:47.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.744+0000 7fdb617fa700 1 -- 172.21.15.36:0/647973597 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fdb54025030 con 0x7fdb640b4690 2022-01-10T01:24:47.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.748+0000 7fdb617fa700 1 --2- 172.21.15.36:0/647973597 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdb48053500 0x7fdb480559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:47.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.748+0000 7fdb63fff700 1 --2- 172.21.15.36:0/647973597 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdb48053500 0x7fdb480559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:47.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.748+0000 7fdb617fa700 1 -- 172.21.15.36:0/647973597 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fdb5406c850 con 0x7fdb640b4690 2022-01-10T01:24:47.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.748+0000 7fdb63fff700 1 --2- 172.21.15.36:0/647973597 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdb48053500 0x7fdb480559c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fdb4c00b000 tx=0x7fdb4c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:47.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.756+0000 7fdb617fa700 1 -- 172.21.15.36:0/647973597 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdb54043860 con 0x7fdb640b4690 2022-01-10T01:24:47.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.884+0000 7fdb6a66a700 1 -- 172.21.15.36:0/647973597 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdb64057350 con 0x7fdb640b4690 2022-01-10T01:24:47.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.884+0000 7fdb617fa700 1 -- 172.21.15.36:0/647973597 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdb54023020 con 0x7fdb640b4690 2022-01-10T01:24:47.892 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:24:47.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.888+0000 7fdb6a66a700 1 -- 172.21.15.36:0/647973597 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdb48053500 msgr2=0x7fdb480559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.888+0000 7fdb6a66a700 1 --2- 172.21.15.36:0/647973597 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdb48053500 0x7fdb480559c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fdb4c00b000 tx=0x7fdb4c006df0).stop 2022-01-10T01:24:47.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.888+0000 7fdb6a66a700 1 -- 172.21.15.36:0/647973597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb640b4690 msgr2=0x7fdb641560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:47.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.888+0000 7fdb6a66a700 1 --2- 172.21.15.36:0/647973597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb640b4690 0x7fdb641560d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fdb640af280 tx=0x7fdb54014000).stop 2022-01-10T01:24:47.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.888+0000 7fdb6a66a700 1 -- 172.21.15.36:0/647973597 shutdown_connections 2022-01-10T01:24:47.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.888+0000 7fdb6a66a700 1 --2- 172.21.15.36:0/647973597 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdb48053500 0x7fdb480559c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.888+0000 7fdb6a66a700 1 --2- 172.21.15.36:0/647973597 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb64146950 0x7fdb640b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.888+0000 7fdb6a66a700 1 --2- 172.21.15.36:0/647973597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb640b4690 0x7fdb641560d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.888+0000 7fdb6a66a700 1 --2- 172.21.15.36:0/647973597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb640b4180 0x7fdb641522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:47.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.888+0000 7fdb6a66a700 1 -- 172.21.15.36:0/647973597 >> 172.21.15.36:0/647973597 conn(0x7fdb6405c490 msgr2=0x7fdb641452e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:47.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.888+0000 7fdb6a66a700 1 -- 172.21.15.36:0/647973597 shutdown_connections 2022-01-10T01:24:47.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:47.888+0000 7fdb6a66a700 1 -- 172.21.15.36:0/647973597 wait complete. 2022-01-10T01:24:47.905 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:24:48.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.004+0000 7f4ae359e700 1 Processor -- start 2022-01-10T01:24:48.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.004+0000 7f4ae359e700 1 -- start start 2022-01-10T01:24:48.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.004+0000 7f4ae359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ae4061680 0x7f4ae40b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.004+0000 7f4ae359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ae41439a0 0x7f4ae41404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.004+0000 7f4ae359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae40b6910 con 0x7f4ae40b4710 2022-01-10T01:24:48.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.004+0000 7f4ae359e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae40b9680 con 0x7f4ae41439a0 2022-01-10T01:24:48.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.004+0000 7f4ae359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40b6bb0 con 0x7f4ae4061680 2022-01-10T01:24:48.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.004+0000 7f4ae2d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ae41439a0 0x7f4ae41404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.004+0000 7f4ae259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ae4061680 0x7f4ae40b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.004+0000 7f4ae1d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4ae40b4710 0x7f4ae413fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:50030/0 (socket says 172.21.15.36:50030) 2022-01-10T01:24:48.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.004+0000 7f4ae1d9b700 1 -- 172.21.15.36:0/262836421 learned_addr learned my addr 172.21.15.36:0/262836421 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:48.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae2d9d700 1 -- 172.21.15.36:0/262836421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ae4061680 msgr2=0x7f4ae40b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:48.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae2d9d700 1 --2- 172.21.15.36:0/262836421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ae4061680 0x7f4ae40b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae2d9d700 1 -- 172.21.15.36:0/262836421 >> v1:172.21.15.59:6789/0 conn(0x7f4ae40b4710 legacy=0x7f4ae413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae2d9d700 1 -- 172.21.15.36:0/262836421 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae40b6e50 con 0x7f4ae41439a0 2022-01-10T01:24:48.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae2d9d700 1 --2- 172.21.15.36:0/262836421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae41439a0 0x7f4ae41404b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f4adc0032f0 tx=0x7f4adc0091d0).ready entity=mon.1 client_cookie=778698c3ed163781 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:48.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae159a700 1 -- 172.21.15.36:0/262836421 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4adc00b6c0 con 0x7f4ae41439a0 2022-01-10T01:24:48.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae159a700 1 -- 172.21.15.36:0/262836421 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc00b820 con 0x7f4ae41439a0 2022-01-10T01:24:48.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae159a700 1 -- 172.21.15.36:0/262836421 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4adc00b990 con 0x7f4ae41439a0 2022-01-10T01:24:48.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae359e700 1 -- 172.21.15.36:0/262836421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae41439a0 msgr2=0x7f4ae41404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae359e700 1 --2- 172.21.15.36:0/262836421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae41439a0 0x7f4ae41404b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f4adc0032f0 tx=0x7f4adc0091d0).stop 2022-01-10T01:24:48.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae359e700 1 -- 172.21.15.36:0/262836421 shutdown_connections 2022-01-10T01:24:48.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae359e700 1 --2- 172.21.15.36:0/262836421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae41439a0 0x7f4ae41404b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae359e700 1 --2- 172.21.15.36:0/262836421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ae4061680 0x7f4ae40b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae359e700 1 -- 172.21.15.36:0/262836421 >> 172.21.15.36:0/262836421 conn(0x7f4ae406adf0 msgr2=0x7f4ae405f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:48.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae359e700 1 -- 172.21.15.36:0/262836421 shutdown_connections 2022-01-10T01:24:48.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.008+0000 7f4ae359e700 1 -- 172.21.15.36:0/262836421 wait complete. 2022-01-10T01:24:48.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae359e700 1 Processor -- start 2022-01-10T01:24:48.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae359e700 1 -- start start 2022-01-10T01:24:48.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae4061680 0x7f4ae40b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ae41439a0 0x7f4ae40aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4ae40af2c0 0x7f4ae4152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae41133a0 con 0x7f4ae40af2c0 2022-01-10T01:24:48.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae4152430 con 0x7f4ae4061680 2022-01-10T01:24:48.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40b0270 con 0x7f4ae41439a0 2022-01-10T01:24:48.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae2d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4ae40af2c0 0x7f4ae4152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae2d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4ae40af2c0 0x7f4ae4152990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34568/0 (socket says 172.21.15.36:34568) 2022-01-10T01:24:48.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae2d9d700 1 -- 172.21.15.36:0/3133275012 learned_addr learned my addr 172.21.15.36:0/3133275012 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:48.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae259c700 1 --2- 172.21.15.36:0/3133275012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae4061680 0x7f4ae40b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae1d9b700 1 --2- 172.21.15.36:0/3133275012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ae41439a0 0x7f4ae40aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae2d9d700 1 -- 172.21.15.36:0/3133275012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ae41439a0 msgr2=0x7f4ae40aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae2d9d700 1 --2- 172.21.15.36:0/3133275012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ae41439a0 0x7f4ae40aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae2d9d700 1 -- 172.21.15.36:0/3133275012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae4061680 msgr2=0x7f4ae40b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae2d9d700 1 --2- 172.21.15.36:0/3133275012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae4061680 0x7f4ae40b8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae2d9d700 1 -- 172.21.15.36:0/3133275012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc009470 con 0x7f4ae40af2c0 2022-01-10T01:24:48.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.012+0000 7f4ae2d9d700 1 --2- 172.21.15.36:0/3133275012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4ae40af2c0 0x7f4ae4152990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f4adc0032f0 tx=0x7f4adc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:48.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.016+0000 7f4adb7fe700 1 -- 172.21.15.36:0/3133275012 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4adc011e20 con 0x7f4ae40af2c0 2022-01-10T01:24:48.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.016+0000 7f4adb7fe700 1 -- 172.21.15.36:0/3133275012 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4adc021440 con 0x7f4ae40af2c0 2022-01-10T01:24:48.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.016+0000 7f4ae359e700 1 -- 172.21.15.36:0/3133275012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae40b0510 con 0x7f4ae40af2c0 2022-01-10T01:24:48.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.016+0000 7f4adb7fe700 1 -- 172.21.15.36:0/3133275012 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4adc0217a0 con 0x7f4ae40af2c0 2022-01-10T01:24:48.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.016+0000 7f4ae359e700 1 -- 172.21.15.36:0/3133275012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae40b8950 con 0x7f4ae40af2c0 2022-01-10T01:24:48.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.016+0000 7f4ae359e700 1 -- 172.21.15.36:0/3133275012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae4057350 con 0x7f4ae40af2c0 2022-01-10T01:24:48.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.016+0000 7f4adb7fe700 1 -- 172.21.15.36:0/3133275012 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4adc027020 con 0x7f4ae40af2c0 2022-01-10T01:24:48.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.016+0000 7f4adb7fe700 1 --2- 172.21.15.36:0/3133275012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4ac80535f0 0x7f4ac8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.016+0000 7f4adb7fe700 1 -- 172.21.15.36:0/3133275012 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f4adc06ce10 con 0x7f4ae40af2c0 2022-01-10T01:24:48.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.016+0000 7f4ae259c700 1 --2- 172.21.15.36:0/3133275012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4ac80535f0 0x7f4ac8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.016+0000 7f4ae259c700 1 --2- 172.21.15.36:0/3133275012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4ac80535f0 0x7f4ac8055ab0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f4acc00b000 tx=0x7f4acc006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:48.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.020+0000 7f4adb7fe700 1 -- 172.21.15.36:0/3133275012 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4adc043e60 con 0x7f4ae40af2c0 2022-01-10T01:24:48.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.140+0000 7f4ae359e700 1 -- 172.21.15.36:0/3133275012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4ae405d9d0 con 0x7f4ae40af2c0 2022-01-10T01:24:48.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.144+0000 7f4adb7fe700 1 -- 172.21.15.36:0/3133275012 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4adc0150a0 con 0x7f4ae40af2c0 2022-01-10T01:24:48.150 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:48.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.144+0000 7f4ae359e700 1 -- 172.21.15.36:0/3133275012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4ac80535f0 msgr2=0x7f4ac8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.144+0000 7f4ae359e700 1 --2- 172.21.15.36:0/3133275012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4ac80535f0 0x7f4ac8055ab0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f4acc00b000 tx=0x7f4acc006df0).stop 2022-01-10T01:24:48.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.144+0000 7f4ae359e700 1 -- 172.21.15.36:0/3133275012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4ae40af2c0 msgr2=0x7f4ae4152990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.144+0000 7f4ae359e700 1 --2- 172.21.15.36:0/3133275012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4ae40af2c0 0x7f4ae4152990 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f4adc0032f0 tx=0x7f4adc016000).stop 2022-01-10T01:24:48.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.144+0000 7f4ae359e700 1 -- 172.21.15.36:0/3133275012 shutdown_connections 2022-01-10T01:24:48.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.144+0000 7f4ae359e700 1 --2- 172.21.15.36:0/3133275012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4ac80535f0 0x7f4ac8055ab0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.144+0000 7f4ae359e700 1 --2- 172.21.15.36:0/3133275012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4ae40af2c0 0x7f4ae4152990 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.144+0000 7f4ae359e700 1 --2- 172.21.15.36:0/3133275012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ae41439a0 0x7f4ae40aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.144+0000 7f4ae359e700 1 --2- 172.21.15.36:0/3133275012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ae4061680 0x7f4ae40b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.144+0000 7f4ae359e700 1 -- 172.21.15.36:0/3133275012 >> 172.21.15.36:0/3133275012 conn(0x7f4ae406adf0 msgr2=0x7f4ae413f440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:48.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.144+0000 7f4ae359e700 1 -- 172.21.15.36:0/3133275012 shutdown_connections 2022-01-10T01:24:48.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.144+0000 7f4ae359e700 1 -- 172.21.15.36:0/3133275012 wait complete. 2022-01-10T01:24:48.163 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:24:48.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ff44700 1 Processor -- start 2022-01-10T01:24:48.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ff44700 1 -- start start 2022-01-10T01:24:48.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ff44700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbe880b4180 0x7fbe88140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ff44700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe880b4690 0x7fbe880b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ff44700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe88143b60 con 0x7fbe88146950 2022-01-10T01:24:48.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ff44700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe88147510 con 0x7fbe880b4180 2022-01-10T01:24:48.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ff44700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe88143e00 con 0x7fbe880b4690 2022-01-10T01:24:48.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8d4df700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbe880b4180 0x7fbe88140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8d4df700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbe880b4180 0x7fbe88140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34574/0 (socket says 172.21.15.36:34574) 2022-01-10T01:24:48.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8d4df700 1 -- 172.21.15.36:0/1269876297 learned_addr learned my addr 172.21.15.36:0/1269876297 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:48.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8e4e1700 1 --2- 172.21.15.36:0/1269876297 >> v2:172.21.15.59:3300/0 conn(0x7fbe880b4690 0x7fbe880b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8d4df700 1 -- 172.21.15.36:0/1269876297 >> v2:172.21.15.59:3300/0 conn(0x7fbe880b4690 msgr2=0x7fbe880b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:48.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8d4df700 1 --2- 172.21.15.36:0/1269876297 >> v2:172.21.15.59:3300/0 conn(0x7fbe880b4690 0x7fbe880b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8d4df700 1 -- 172.21.15.36:0/1269876297 >> v1:172.21.15.59:6789/0 conn(0x7fbe88146950 legacy=0x7fbe88140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8d4df700 1 -- 172.21.15.36:0/1269876297 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe880b0c90 con 0x7fbe880b4180 2022-01-10T01:24:48.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8d4df700 1 --2- 172.21.15.36:0/1269876297 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe880b4180 0x7fbe88140940 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fbe78002f70 tx=0x7fbe78006eb0).ready entity=mon.0 client_cookie=88b56ce8db2ecc7a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:48.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ccde700 1 -- 172.21.15.36:0/1269876297 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe7800d610 con 0x7fbe880b4180 2022-01-10T01:24:48.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ccde700 1 -- 172.21.15.36:0/1269876297 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe78000e90 con 0x7fbe880b4180 2022-01-10T01:24:48.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ccde700 1 -- 172.21.15.36:0/1269876297 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe7800d9a0 con 0x7fbe880b4180 2022-01-10T01:24:48.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ff44700 1 -- 172.21.15.36:0/1269876297 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe880b4180 msgr2=0x7fbe88140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ff44700 1 --2- 172.21.15.36:0/1269876297 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe880b4180 0x7fbe88140940 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fbe78002f70 tx=0x7fbe78006eb0).stop 2022-01-10T01:24:48.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ff44700 1 -- 172.21.15.36:0/1269876297 shutdown_connections 2022-01-10T01:24:48.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ff44700 1 --2- 172.21.15.36:0/1269876297 >> v2:172.21.15.59:3300/0 conn(0x7fbe880b4690 0x7fbe880b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ff44700 1 --2- 172.21.15.36:0/1269876297 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe880b4180 0x7fbe88140940 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ff44700 1 -- 172.21.15.36:0/1269876297 >> 172.21.15.36:0/1269876297 conn(0x7fbe8805c490 msgr2=0x7fbe8805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:48.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.268+0000 7fbe8ff44700 1 -- 172.21.15.36:0/1269876297 shutdown_connections 2022-01-10T01:24:48.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8ff44700 1 -- 172.21.15.36:0/1269876297 wait complete. 2022-01-10T01:24:48.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8ff44700 1 Processor -- start 2022-01-10T01:24:48.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8ff44700 1 -- start start 2022-01-10T01:24:48.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8ff44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe880b4180 0x7fbe88141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8ff44700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe880b4690 0x7fbe880aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8ff44700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe88146950 0x7fbe88152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8ff44700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe88152290 con 0x7fbe88146950 2022-01-10T01:24:48.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8ff44700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe880af000 con 0x7fbe880b4690 2022-01-10T01:24:48.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8ff44700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe88156510 con 0x7fbe880b4180 2022-01-10T01:24:48.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8e4e1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe88146950 0x7fbe88152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8e4e1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe88146950 0x7fbe88152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34582/0 (socket says 172.21.15.36:34582) 2022-01-10T01:24:48.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8e4e1700 1 -- 172.21.15.36:0/592071425 learned_addr learned my addr 172.21.15.36:0/592071425 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:48.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8dce0700 1 --2- 172.21.15.36:0/592071425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe880b4180 0x7fbe88141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8d4df700 1 --2- 172.21.15.36:0/592071425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe880b4690 0x7fbe880aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8e4e1700 1 -- 172.21.15.36:0/592071425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe880b4180 msgr2=0x7fbe88141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8e4e1700 1 --2- 172.21.15.36:0/592071425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe880b4180 0x7fbe88141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8e4e1700 1 -- 172.21.15.36:0/592071425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe880b4690 msgr2=0x7fbe880aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8e4e1700 1 --2- 172.21.15.36:0/592071425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe880b4690 0x7fbe880aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.272+0000 7fbe8e4e1700 1 -- 172.21.15.36:0/592071425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7800b1e0 con 0x7fbe88146950 2022-01-10T01:24:48.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.276+0000 7fbe8e4e1700 1 --2- 172.21.15.36:0/592071425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe88146950 0x7fbe88152bc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fbe8000a000 tx=0x7fbe80008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:48.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.276+0000 7fbe7effd700 1 -- 172.21.15.36:0/592071425 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe80013620 con 0x7fbe88146950 2022-01-10T01:24:48.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.276+0000 7fbe7effd700 1 -- 172.21.15.36:0/592071425 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe80013780 con 0x7fbe88146950 2022-01-10T01:24:48.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.276+0000 7fbe8ff44700 1 -- 172.21.15.36:0/592071425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe88152480 con 0x7fbe88146950 2022-01-10T01:24:48.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.276+0000 7fbe7effd700 1 -- 172.21.15.36:0/592071425 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe80013ae0 con 0x7fbe88146950 2022-01-10T01:24:48.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.276+0000 7fbe8ff44700 1 -- 172.21.15.36:0/592071425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe88156230 con 0x7fbe88146950 2022-01-10T01:24:48.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.276+0000 7fbe8ff44700 1 -- 172.21.15.36:0/592071425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe881566d0 con 0x7fbe88146950 2022-01-10T01:24:48.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.276+0000 7fbe7effd700 1 -- 172.21.15.36:0/592071425 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbe80013c40 con 0x7fbe88146950 2022-01-10T01:24:48.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.276+0000 7fbe7effd700 1 --2- 172.21.15.36:0/592071425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe700535f0 0x7fbe70055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.276+0000 7fbe8dce0700 1 --2- 172.21.15.36:0/592071425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe700535f0 0x7fbe70055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.276+0000 7fbe7effd700 1 -- 172.21.15.36:0/592071425 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fbe8006bca0 con 0x7fbe88146950 2022-01-10T01:24:48.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.280+0000 7fbe8dce0700 1 --2- 172.21.15.36:0/592071425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe700535f0 0x7fbe70055ab0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fbe8400d000 tx=0x7fbe84007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:48.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.284+0000 7fbe7effd700 1 -- 172.21.15.36:0/592071425 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbe80042b40 con 0x7fbe88146950 2022-01-10T01:24:48.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.408+0000 7fbe8ff44700 1 -- 172.21.15.36:0/592071425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe88057350 con 0x7fbe88146950 2022-01-10T01:24:48.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.408+0000 7fbe7effd700 1 -- 172.21.15.36:0/592071425 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fbe80046160 con 0x7fbe88146950 2022-01-10T01:24:48.414 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:48.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.408+0000 7fbe8ff44700 1 -- 172.21.15.36:0/592071425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe700535f0 msgr2=0x7fbe70055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.408+0000 7fbe8ff44700 1 --2- 172.21.15.36:0/592071425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe700535f0 0x7fbe70055ab0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fbe8400d000 tx=0x7fbe84007b90).stop 2022-01-10T01:24:48.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.408+0000 7fbe8ff44700 1 -- 172.21.15.36:0/592071425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe88146950 msgr2=0x7fbe88152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.408+0000 7fbe8ff44700 1 --2- 172.21.15.36:0/592071425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe88146950 0x7fbe88152bc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fbe8000a000 tx=0x7fbe80008040).stop 2022-01-10T01:24:48.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.408+0000 7fbe8ff44700 1 -- 172.21.15.36:0/592071425 shutdown_connections 2022-01-10T01:24:48.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.408+0000 7fbe8ff44700 1 --2- 172.21.15.36:0/592071425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe700535f0 0x7fbe70055ab0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.408+0000 7fbe8ff44700 1 --2- 172.21.15.36:0/592071425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe88146950 0x7fbe88152bc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.408+0000 7fbe8ff44700 1 --2- 172.21.15.36:0/592071425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe880b4690 0x7fbe880aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.408+0000 7fbe8ff44700 1 --2- 172.21.15.36:0/592071425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe880b4180 0x7fbe88141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.408+0000 7fbe8ff44700 1 -- 172.21.15.36:0/592071425 >> 172.21.15.36:0/592071425 conn(0x7fbe8805c490 msgr2=0x7fbe8813f690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:48.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.408+0000 7fbe8ff44700 1 -- 172.21.15.36:0/592071425 shutdown_connections 2022-01-10T01:24:48.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.408+0000 7fbe8ff44700 1 -- 172.21.15.36:0/592071425 wait complete. 2022-01-10T01:24:48.428 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:24:48.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593f59e700 1 Processor -- start 2022-01-10T01:24:48.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593f59e700 1 -- start start 2022-01-10T01:24:48.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593f59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59400b30d0 0x7f5940143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59400ace70 0x7f594013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593f59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5940143920 con 0x7f59400b0710 2022-01-10T01:24:48.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593f59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59400b0af0 con 0x7f59400b30d0 2022-01-10T01:24:48.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59400ae680 con 0x7f59400ace70 2022-01-10T01:24:48.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59400b30d0 0x7f5940143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593e59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f59400b0710 0x7f5940142d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:50056/0 (socket says 172.21.15.36:50056) 2022-01-10T01:24:48.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593e59c700 1 -- 172.21.15.36:0/552960744 learned_addr learned my addr 172.21.15.36:0/552960744 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:48.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593ed9d700 1 --2- 172.21.15.36:0/552960744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59400ace70 0x7f594013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593ed9d700 1 -- 172.21.15.36:0/552960744 >> v2:172.21.15.59:3300/0 conn(0x7f59400b30d0 msgr2=0x7f5940143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:48.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593ed9d700 1 --2- 172.21.15.36:0/552960744 >> v2:172.21.15.59:3300/0 conn(0x7f59400b30d0 0x7f5940143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593ed9d700 1 -- 172.21.15.36:0/552960744 >> v1:172.21.15.59:6789/0 conn(0x7f59400b0710 legacy=0x7f5940142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593ed9d700 1 -- 172.21.15.36:0/552960744 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59400ae920 con 0x7f59400ace70 2022-01-10T01:24:48.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593dd9b700 1 --2- 172.21.15.36:0/552960744 >> v2:172.21.15.59:3300/0 conn(0x7f59400b30d0 0x7f5940143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:48.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.532+0000 7f593ed9d700 1 --2- 172.21.15.36:0/552960744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59400ace70 0x7f594013f8a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f59380032f0 tx=0x7f59380091d0).ready entity=mon.2 client_cookie=3eb1d5d71fd9b33 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:48.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.536+0000 7f593d59a700 1 -- 172.21.15.36:0/552960744 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f593800f940 con 0x7f59400ace70 2022-01-10T01:24:48.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.536+0000 7f593d59a700 1 -- 172.21.15.36:0/552960744 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593800faa0 con 0x7f59400ace70 2022-01-10T01:24:48.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.536+0000 7f593d59a700 1 -- 172.21.15.36:0/552960744 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f593800fe00 con 0x7f59400ace70 2022-01-10T01:24:48.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.536+0000 7f593f59e700 1 -- 172.21.15.36:0/552960744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59400ace70 msgr2=0x7f594013f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.536+0000 7f593f59e700 1 --2- 172.21.15.36:0/552960744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59400ace70 0x7f594013f8a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f59380032f0 tx=0x7f59380091d0).stop 2022-01-10T01:24:48.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.536+0000 7f593f59e700 1 -- 172.21.15.36:0/552960744 shutdown_connections 2022-01-10T01:24:48.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.536+0000 7f593f59e700 1 --2- 172.21.15.36:0/552960744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59400ace70 0x7f594013f8a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.536+0000 7f593f59e700 1 --2- 172.21.15.36:0/552960744 >> v2:172.21.15.59:3300/0 conn(0x7f59400b30d0 0x7f5940143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.536+0000 7f593f59e700 1 -- 172.21.15.36:0/552960744 >> 172.21.15.36:0/552960744 conn(0x7f5940061140 msgr2=0x7f5940062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:48.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.536+0000 7f593f59e700 1 -- 172.21.15.36:0/552960744 shutdown_connections 2022-01-10T01:24:48.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.536+0000 7f593f59e700 1 -- 172.21.15.36:0/552960744 wait complete. 2022-01-10T01:24:48.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593f59e700 1 Processor -- start 2022-01-10T01:24:48.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593f59e700 1 -- start start 2022-01-10T01:24:48.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593f59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59400ace70 0x7f59400b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59400b0710 0x7f594009e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59400b30d0 0x7f594009eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593f59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5940067bf0 con 0x7f59400ace70 2022-01-10T01:24:48.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593f59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594014ec20 con 0x7f59400b0710 2022-01-10T01:24:48.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5940063e80 con 0x7f59400b30d0 2022-01-10T01:24:48.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59400ace70 0x7f59400b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59400b0710 0x7f594009e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59400ace70 0x7f59400b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34592/0 (socket says 172.21.15.36:34592) 2022-01-10T01:24:48.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593e59c700 1 -- 172.21.15.36:0/758703138 learned_addr learned my addr 172.21.15.36:0/758703138 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:48.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593ed9d700 1 --2- 172.21.15.36:0/758703138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59400b30d0 0x7f594009eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593e59c700 1 -- 172.21.15.36:0/758703138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59400b30d0 msgr2=0x7f594009eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593e59c700 1 --2- 172.21.15.36:0/758703138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59400b30d0 0x7f594009eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593e59c700 1 -- 172.21.15.36:0/758703138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59400b0710 msgr2=0x7f594009e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593e59c700 1 --2- 172.21.15.36:0/758703138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59400b0710 0x7f594009e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593e59c700 1 -- 172.21.15.36:0/758703138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593400b180 con 0x7f59400ace70 2022-01-10T01:24:48.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593e59c700 1 --2- 172.21.15.36:0/758703138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59400ace70 0x7f59400b4d20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f59400b6a40 tx=0x7f5930007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:48.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f592f7fe700 1 -- 172.21.15.36:0/758703138 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59300070d0 con 0x7f59400ace70 2022-01-10T01:24:48.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f592f7fe700 1 -- 172.21.15.36:0/758703138 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5930007230 con 0x7f59400ace70 2022-01-10T01:24:48.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593f59e700 1 -- 172.21.15.36:0/758703138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5938009470 con 0x7f59400ace70 2022-01-10T01:24:48.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f592f7fe700 1 -- 172.21.15.36:0/758703138 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5930005610 con 0x7f59400ace70 2022-01-10T01:24:48.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.540+0000 7f593f59e700 1 -- 172.21.15.36:0/758703138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594014e950 con 0x7f59400ace70 2022-01-10T01:24:48.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.544+0000 7f593f59e700 1 -- 172.21.15.36:0/758703138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f594014ede0 con 0x7f59400ace70 2022-01-10T01:24:48.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.544+0000 7f592f7fe700 1 -- 172.21.15.36:0/758703138 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5930010070 con 0x7f59400ace70 2022-01-10T01:24:48.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.544+0000 7f592f7fe700 1 --2- 172.21.15.36:0/758703138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f591c053500 0x7f591c0559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.544+0000 7f592f7fe700 1 -- 172.21.15.36:0/758703138 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f593006afe0 con 0x7f59400ace70 2022-01-10T01:24:48.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.544+0000 7f593dd9b700 1 --2- 172.21.15.36:0/758703138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f591c053500 0x7f591c0559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.544+0000 7f593dd9b700 1 --2- 172.21.15.36:0/758703138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f591c053500 0x7f591c0559c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f593400b000 tx=0x7f5934006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:48.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.552+0000 7f592f7fe700 1 -- 172.21.15.36:0/758703138 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5930041f50 con 0x7f59400ace70 2022-01-10T01:24:48.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.680+0000 7f593f59e700 1 -- 172.21.15.36:0/758703138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5940057350 con 0x7f59400ace70 2022-01-10T01:24:48.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.680+0000 7f592f7fe700 1 -- 172.21.15.36:0/758703138 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5930018030 con 0x7f59400ace70 2022-01-10T01:24:48.688 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:48.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.684+0000 7f593f59e700 1 -- 172.21.15.36:0/758703138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f591c053500 msgr2=0x7f591c0559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.684+0000 7f593f59e700 1 --2- 172.21.15.36:0/758703138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f591c053500 0x7f591c0559c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f593400b000 tx=0x7f5934006df0).stop 2022-01-10T01:24:48.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.684+0000 7f593f59e700 1 -- 172.21.15.36:0/758703138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59400ace70 msgr2=0x7f59400b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.684+0000 7f593f59e700 1 --2- 172.21.15.36:0/758703138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59400ace70 0x7f59400b4d20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f59400b6a40 tx=0x7f5930007c40).stop 2022-01-10T01:24:48.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.684+0000 7f593f59e700 1 -- 172.21.15.36:0/758703138 shutdown_connections 2022-01-10T01:24:48.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.684+0000 7f593f59e700 1 --2- 172.21.15.36:0/758703138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f591c053500 0x7f591c0559c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.684+0000 7f593f59e700 1 --2- 172.21.15.36:0/758703138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59400b30d0 0x7f594009eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.684+0000 7f593f59e700 1 --2- 172.21.15.36:0/758703138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59400b0710 0x7f594009e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.684+0000 7f593f59e700 1 --2- 172.21.15.36:0/758703138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59400ace70 0x7f59400b4d20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.684+0000 7f593f59e700 1 -- 172.21.15.36:0/758703138 >> 172.21.15.36:0/758703138 conn(0x7f5940061140 msgr2=0x7f594013f840 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:48.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.684+0000 7f593f59e700 1 -- 172.21.15.36:0/758703138 shutdown_connections 2022-01-10T01:24:48.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.684+0000 7f593f59e700 1 -- 172.21.15.36:0/758703138 wait complete. 2022-01-10T01:24:48.701 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:48.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd613b9a700 1 Processor -- start 2022-01-10T01:24:48.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd613b9a700 1 -- start start 2022-01-10T01:24:48.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd613b9a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd60c0b6900 0x7fd60c0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd613b9a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c0b6ce0 con 0x7fd60c0aa5d0 2022-01-10T01:24:48.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd613b9a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c0611e0 con 0x7fd60c060910 2022-01-10T01:24:48.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd613b9a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c061480 con 0x7fd60c0b6900 2022-01-10T01:24:48.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd611936700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd60c0b6900 0x7fd60c0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd611936700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd60c0b6900 0x7fd60c0acd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34600/0 (socket says 172.21.15.36:34600) 2022-01-10T01:24:48.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd611936700 1 -- 172.21.15.36:0/2091957965 learned_addr learned my addr 172.21.15.36:0/2091957965 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:48.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd611936700 1 -- 172.21.15.36:0/2091957965 >> v1:172.21.15.59:6789/0 conn(0x7fd60c060910 legacy=0x7fd60c0a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:48.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd611936700 1 -- 172.21.15.36:0/2091957965 >> v1:172.21.15.36:6789/0 conn(0x7fd60c0aa5d0 legacy=0x7fd60c13c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:48.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd611936700 1 -- 172.21.15.36:0/2091957965 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c061720 con 0x7fd60c0b6900 2022-01-10T01:24:48.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd611936700 1 --2- 172.21.15.36:0/2091957965 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd60c0b6900 0x7fd60c0acd50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fd60c060300 tx=0x7fd604009290).ready entity=mon.0 client_cookie=5a5313a41f123e4d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:48.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd610934700 1 -- 172.21.15.36:0/2091957965 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd60400b9e0 con 0x7fd60c0b6900 2022-01-10T01:24:48.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd610934700 1 -- 172.21.15.36:0/2091957965 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60400bb40 con 0x7fd60c0b6900 2022-01-10T01:24:48.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.796+0000 7fd610934700 1 -- 172.21.15.36:0/2091957965 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd604010470 con 0x7fd60c0b6900 2022-01-10T01:24:48.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 -- 172.21.15.36:0/2091957965 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd60c0b6900 msgr2=0x7fd60c0acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 --2- 172.21.15.36:0/2091957965 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd60c0b6900 0x7fd60c0acd50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fd60c060300 tx=0x7fd604009290).stop 2022-01-10T01:24:48.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 -- 172.21.15.36:0/2091957965 shutdown_connections 2022-01-10T01:24:48.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 --2- 172.21.15.36:0/2091957965 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd60c0b6900 0x7fd60c0acd50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 -- 172.21.15.36:0/2091957965 >> 172.21.15.36:0/2091957965 conn(0x7fd60c0b3480 msgr2=0x7fd60c0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:48.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 -- 172.21.15.36:0/2091957965 shutdown_connections 2022-01-10T01:24:48.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 -- 172.21.15.36:0/2091957965 wait complete. 2022-01-10T01:24:48.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 Processor -- start 2022-01-10T01:24:48.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 -- start start 2022-01-10T01:24:48.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd60c060910 0x7fd60c14e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c0aa5d0 0x7fd60c13e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd60c0b6900 0x7fd60c1519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c13e030 con 0x7fd60c0b6900 2022-01-10T01:24:48.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c14ee40 con 0x7fd60c0aa5d0 2022-01-10T01:24:48.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd613b9a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c14f0e0 con 0x7fd60c060910 2022-01-10T01:24:48.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.800+0000 7fd612137700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd60c0b6900 0x7fd60c1519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd612137700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd60c0b6900 0x7fd60c1519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34608/0 (socket says 172.21.15.36:34608) 2022-01-10T01:24:48.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd612137700 1 -- 172.21.15.36:0/3545668167 learned_addr learned my addr 172.21.15.36:0/3545668167 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:48.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd611135700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c0aa5d0 0x7fd60c13e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd611936700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd60c060910 0x7fd60c14e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd612137700 1 -- 172.21.15.36:0/3545668167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd60c060910 msgr2=0x7fd60c14e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd612137700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd60c060910 0x7fd60c14e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd612137700 1 -- 172.21.15.36:0/3545668167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c0aa5d0 msgr2=0x7fd60c13e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd612137700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c0aa5d0 0x7fd60c13e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd612137700 1 -- 172.21.15.36:0/3545668167 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd604009530 con 0x7fd60c0b6900 2022-01-10T01:24:48.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd611135700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c0aa5d0 0x7fd60c13e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:48.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd612137700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd60c0b6900 0x7fd60c1519e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fd5f4001fa0 tx=0x7fd5f4007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:48.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd60affd700 1 -- 172.21.15.36:0/3545668167 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f4002da0 con 0x7fd60c0b6900 2022-01-10T01:24:48.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd60affd700 1 -- 172.21.15.36:0/3545668167 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f4007030 con 0x7fd60c0b6900 2022-01-10T01:24:48.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd613b9a700 1 -- 172.21.15.36:0/3545668167 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c14f380 con 0x7fd60c0b6900 2022-01-10T01:24:48.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd60affd700 1 -- 172.21.15.36:0/3545668167 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f4007390 con 0x7fd60c0b6900 2022-01-10T01:24:48.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd613b9a700 1 -- 172.21.15.36:0/3545668167 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c0ad540 con 0x7fd60c0b6900 2022-01-10T01:24:48.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd60affd700 1 -- 172.21.15.36:0/3545668167 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd5f4010030 con 0x7fd60c0b6900 2022-01-10T01:24:48.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd613b9a700 1 -- 172.21.15.36:0/3545668167 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60c0619c0 con 0x7fd60c0b6900 2022-01-10T01:24:48.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.804+0000 7fd60affd700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd5f00536b0 0x7fd5f0055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:48.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.808+0000 7fd611936700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd5f00536b0 0x7fd5f0055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:48.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.808+0000 7fd60affd700 1 -- 172.21.15.36:0/3545668167 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fd5f406b6f0 con 0x7fd60c0b6900 2022-01-10T01:24:48.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.808+0000 7fd611936700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd5f00536b0 0x7fd5f0055b70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd60401d000 tx=0x7fd604018000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:48.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.812+0000 7fd60affd700 1 -- 172.21.15.36:0/3545668167 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd5f40425f0 con 0x7fd60c0b6900 2022-01-10T01:24:48.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.944+0000 7fd613b9a700 1 -- 172.21.15.36:0/3545668167 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd60c057350 con 0x7fd60c0b6900 2022-01-10T01:24:48.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.944+0000 7fd60affd700 1 -- 172.21.15.36:0/3545668167 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16299 (secure 0 0 0) 0x7fd5f4045c10 con 0x7fd60c0b6900 2022-01-10T01:24:48.951 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:48.952 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:25.224959+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:24:20.202898+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-01-10T01:24:22.952870+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:48.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.948+0000 7fd613b9a700 1 -- 172.21.15.36:0/3545668167 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd5f00536b0 msgr2=0x7fd5f0055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.948+0000 7fd613b9a700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd5f00536b0 0x7fd5f0055b70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fd60401d000 tx=0x7fd604018000).stop 2022-01-10T01:24:48.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.948+0000 7fd613b9a700 1 -- 172.21.15.36:0/3545668167 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd60c0b6900 msgr2=0x7fd60c1519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:48.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.948+0000 7fd613b9a700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd60c0b6900 0x7fd60c1519e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fd5f4001fa0 tx=0x7fd5f4007c30).stop 2022-01-10T01:24:48.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.948+0000 7fd613b9a700 1 -- 172.21.15.36:0/3545668167 shutdown_connections 2022-01-10T01:24:48.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.948+0000 7fd613b9a700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd5f00536b0 0x7fd5f0055b70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.948+0000 7fd613b9a700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd60c0b6900 0x7fd60c1519e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.948+0000 7fd613b9a700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd60c0aa5d0 0x7fd60c13e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.948+0000 7fd613b9a700 1 --2- 172.21.15.36:0/3545668167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd60c060910 0x7fd60c14e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:48.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.948+0000 7fd613b9a700 1 -- 172.21.15.36:0/3545668167 >> 172.21.15.36:0/3545668167 conn(0x7fd60c0b3480 msgr2=0x7fd60c0b5180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:48.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.948+0000 7fd613b9a700 1 -- 172.21.15.36:0/3545668167 shutdown_connections 2022-01-10T01:24:48.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:48.948+0000 7fd613b9a700 1 -- 172.21.15.36:0/3545668167 wait complete. 2022-01-10T01:24:48.965 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:24:20.202898+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:24:22.952870+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:24:48.965 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:24:49.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f5985b8e700 1 Processor -- start 2022-01-10T01:24:49.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f5985b8e700 1 -- start start 2022-01-10T01:24:49.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f5985b8e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59800ac260 0x7f59800b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f5985b8e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59800b06c0 0x7f59800aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f5985b8e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59800b1c60 con 0x7f59800a9960 2022-01-10T01:24:49.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f5985b8e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59800a9d40 con 0x7f59800ac260 2022-01-10T01:24:49.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f5985b8e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59800b2940 con 0x7f59800b06c0 2022-01-10T01:24:49.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f597f7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f59800a9960 0x7f59800aec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60640/0 (socket says 172.21.15.36:60640) 2022-01-10T01:24:49.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f597f7fe700 1 -- 172.21.15.36:0/3233323745 learned_addr learned my addr 172.21.15.36:0/3233323745 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:49.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f597effd700 1 --2- 172.21.15.36:0/3233323745 >> v2:172.21.15.59:3300/0 conn(0x7f59800ac260 0x7f59800b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f597ffff700 1 --2- 172.21.15.36:0/3233323745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59800b06c0 0x7f59800aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f597e7fc700 1 -- 172.21.15.36:0/3233323745 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693699325 0 0) 0x7f5970001110 con 0x7f59800a9960 2022-01-10T01:24:49.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f597e7fc700 1 -- 172.21.15.36:0/3233323745 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f596c003260 con 0x7f59800a9960 2022-01-10T01:24:49.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f597ffff700 1 -- 172.21.15.36:0/3233323745 >> v2:172.21.15.59:3300/0 conn(0x7f59800ac260 msgr2=0x7f59800b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:49.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f597ffff700 1 --2- 172.21.15.36:0/3233323745 >> v2:172.21.15.59:3300/0 conn(0x7f59800ac260 0x7f59800b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f597ffff700 1 -- 172.21.15.36:0/3233323745 >> v1:172.21.15.36:6789/0 conn(0x7f59800a9960 legacy=0x7f59800aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f597ffff700 1 -- 172.21.15.36:0/3233323745 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59800b00c0 con 0x7f59800b06c0 2022-01-10T01:24:49.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f597ffff700 1 --2- 172.21.15.36:0/3233323745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59800b06c0 0x7f59800aafa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f59780032f0 tx=0x7f59780091d0).ready entity=mon.2 client_cookie=dad62923d8f8c15e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:49.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f597e7fc700 1 -- 172.21.15.36:0/3233323745 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f597800b600 con 0x7f59800b06c0 2022-01-10T01:24:49.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f597e7fc700 1 -- 172.21.15.36:0/3233323745 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597800b760 con 0x7f59800b06c0 2022-01-10T01:24:49.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.072+0000 7f597e7fc700 1 -- 172.21.15.36:0/3233323745 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f597800b8d0 con 0x7f59800b06c0 2022-01-10T01:24:49.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 -- 172.21.15.36:0/3233323745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59800b06c0 msgr2=0x7f59800aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 --2- 172.21.15.36:0/3233323745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59800b06c0 0x7f59800aafa0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f59780032f0 tx=0x7f59780091d0).stop 2022-01-10T01:24:49.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 -- 172.21.15.36:0/3233323745 shutdown_connections 2022-01-10T01:24:49.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 --2- 172.21.15.36:0/3233323745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59800b06c0 0x7f59800aafa0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 --2- 172.21.15.36:0/3233323745 >> v2:172.21.15.59:3300/0 conn(0x7f59800ac260 0x7f59800b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 -- 172.21.15.36:0/3233323745 >> 172.21.15.36:0/3233323745 conn(0x7f598005f6b0 msgr2=0x7f598005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:49.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 -- 172.21.15.36:0/3233323745 shutdown_connections 2022-01-10T01:24:49.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 -- 172.21.15.36:0/3233323745 wait complete. 2022-01-10T01:24:49.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 Processor -- start 2022-01-10T01:24:49.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 -- start start 2022-01-10T01:24:49.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59800a9960 0x7f59800b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59800ac260 0x7f59801368b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59800b06c0 0x7f5980136da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5980064280 con 0x7f59800a9960 2022-01-10T01:24:49.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5980137290 con 0x7f59800ac260 2022-01-10T01:24:49.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f5985b8e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59800644b0 con 0x7f59800b06c0 2022-01-10T01:24:49.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f597f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59800a9960 0x7f59800b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f597f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59800a9960 0x7f59800b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34620/0 (socket says 172.21.15.36:34620) 2022-01-10T01:24:49.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f597f7fe700 1 -- 172.21.15.36:0/3367135231 learned_addr learned my addr 172.21.15.36:0/3367135231 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:49.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.076+0000 7f597effd700 1 --2- 172.21.15.36:0/3367135231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59800ac260 0x7f59801368b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.080+0000 7f597ffff700 1 --2- 172.21.15.36:0/3367135231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59800b06c0 0x7f5980136da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.080+0000 7f597effd700 1 -- 172.21.15.36:0/3367135231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59800b06c0 msgr2=0x7f5980136da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.080+0000 7f597effd700 1 --2- 172.21.15.36:0/3367135231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59800b06c0 0x7f5980136da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.080+0000 7f597effd700 1 -- 172.21.15.36:0/3367135231 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59800a9960 msgr2=0x7f59800b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.080+0000 7f597effd700 1 --2- 172.21.15.36:0/3367135231 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59800a9960 0x7f59800b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.080+0000 7f597effd700 1 -- 172.21.15.36:0/3367135231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5978009470 con 0x7f59800ac260 2022-01-10T01:24:49.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.080+0000 7f597effd700 1 --2- 172.21.15.36:0/3367135231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59800ac260 0x7f59801368b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f597400c000 tx=0x7f5974006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:49.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.080+0000 7f597cff9700 1 -- 172.21.15.36:0/3367135231 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5974010780 con 0x7f59800ac260 2022-01-10T01:24:49.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.080+0000 7f597cff9700 1 -- 172.21.15.36:0/3367135231 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59740108e0 con 0x7f59800ac260 2022-01-10T01:24:49.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.080+0000 7f5985b8e700 1 -- 172.21.15.36:0/3367135231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5980153fa0 con 0x7f59800ac260 2022-01-10T01:24:49.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.080+0000 7f597cff9700 1 -- 172.21.15.36:0/3367135231 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5974010c40 con 0x7f59800ac260 2022-01-10T01:24:49.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.080+0000 7f5985b8e700 1 -- 172.21.15.36:0/3367135231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59801455a0 con 0x7f59800ac260 2022-01-10T01:24:49.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.080+0000 7f5985b8e700 1 -- 172.21.15.36:0/3367135231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5980065130 con 0x7f59800ac260 2022-01-10T01:24:49.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.080+0000 7f597cff9700 1 -- 172.21.15.36:0/3367135231 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f597401c460 con 0x7f59800ac260 2022-01-10T01:24:49.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.084+0000 7f597cff9700 1 --2- 172.21.15.36:0/3367135231 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59600535f0 0x7f5960055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.084+0000 7f597cff9700 1 -- 172.21.15.36:0/3367135231 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f597406bd60 con 0x7f59800ac260 2022-01-10T01:24:49.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.084+0000 7f597f7fe700 1 --2- 172.21.15.36:0/3367135231 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59600535f0 0x7f5960055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.084+0000 7f597f7fe700 1 --2- 172.21.15.36:0/3367135231 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59600535f0 0x7f5960055ab0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f597000d000 tx=0x7f5970009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:49.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.092+0000 7f597cff9700 1 -- 172.21.15.36:0/3367135231 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5974042c00 con 0x7f59800ac260 2022-01-10T01:24:49.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.216+0000 7f5985b8e700 1 -- 172.21.15.36:0/3367135231 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5980057350 con 0x7f59800ac260 2022-01-10T01:24:49.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.216+0000 7f597cff9700 1 -- 172.21.15.36:0/3367135231 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v24) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5974046220 con 0x7f59800ac260 2022-01-10T01:24:49.225 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:24:49.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.220+0000 7f5985b8e700 1 -- 172.21.15.36:0/3367135231 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59600535f0 msgr2=0x7f5960055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.220+0000 7f5985b8e700 1 --2- 172.21.15.36:0/3367135231 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59600535f0 0x7f5960055ab0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f597000d000 tx=0x7f5970009040).stop 2022-01-10T01:24:49.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.220+0000 7f5985b8e700 1 -- 172.21.15.36:0/3367135231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59800ac260 msgr2=0x7f59801368b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.220+0000 7f5985b8e700 1 --2- 172.21.15.36:0/3367135231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59800ac260 0x7f59801368b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f597400c000 tx=0x7f5974006df0).stop 2022-01-10T01:24:49.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.220+0000 7f5985b8e700 1 -- 172.21.15.36:0/3367135231 shutdown_connections 2022-01-10T01:24:49.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.220+0000 7f5985b8e700 1 --2- 172.21.15.36:0/3367135231 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59600535f0 0x7f5960055ab0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.220+0000 7f5985b8e700 1 --2- 172.21.15.36:0/3367135231 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59800b06c0 0x7f5980136da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.220+0000 7f5985b8e700 1 --2- 172.21.15.36:0/3367135231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59800ac260 0x7f59801368b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.220+0000 7f5985b8e700 1 --2- 172.21.15.36:0/3367135231 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59800a9960 0x7f59800b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.220+0000 7f5985b8e700 1 -- 172.21.15.36:0/3367135231 >> 172.21.15.36:0/3367135231 conn(0x7f598005f6b0 msgr2=0x7f59800b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:49.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.220+0000 7f5985b8e700 1 -- 172.21.15.36:0/3367135231 shutdown_connections 2022-01-10T01:24:49.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.220+0000 7f5985b8e700 1 -- 172.21.15.36:0/3367135231 wait complete. 2022-01-10T01:24:49.244 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:24:49.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.348+0000 7fe577534700 1 Processor -- start 2022-01-10T01:24:49.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.348+0000 7fe577534700 1 -- start start 2022-01-10T01:24:49.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe577534700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe570061680 0x7fe5700b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe577534700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5700b4710 0x7fe5700ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe577534700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5700b6910 con 0x7fe5701439a0 2022-01-10T01:24:49.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe577534700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5700b9680 con 0x7fe570061680 2022-01-10T01:24:49.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe577534700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700b6bb0 con 0x7fe5700b4710 2022-01-10T01:24:49.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe576d33700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe5701439a0 0x7fe57013fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60656/0 (socket says 172.21.15.36:60656) 2022-01-10T01:24:49.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe576d33700 1 -- 172.21.15.36:0/2375483009 learned_addr learned my addr 172.21.15.36:0/2375483009 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:49.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe576532700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe570061680 0x7fe5700b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe575d31700 1 --2- 172.21.15.36:0/2375483009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5700b4710 0x7fe5700ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe575530700 1 -- 172.21.15.36:0/2375483009 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057282661 0 0) 0x7fe5700b6910 con 0x7fe5701439a0 2022-01-10T01:24:49.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe575530700 1 -- 172.21.15.36:0/2375483009 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe558003260 con 0x7fe5701439a0 2022-01-10T01:24:49.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe576532700 1 -- 172.21.15.36:0/2375483009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5700b4710 msgr2=0x7fe5700ba200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:49.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe576532700 1 --2- 172.21.15.36:0/2375483009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5700b4710 0x7fe5700ba200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe576532700 1 -- 172.21.15.36:0/2375483009 >> v1:172.21.15.36:6789/0 conn(0x7fe5701439a0 legacy=0x7fe57013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe576532700 1 -- 172.21.15.36:0/2375483009 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5700b6e50 con 0x7fe570061680 2022-01-10T01:24:49.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe576532700 1 --2- 172.21.15.36:0/2375483009 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe570061680 0x7fe5700b9d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fe560002f70 tx=0x7fe560006df0).ready entity=mon.0 client_cookie=5298ace5009c8484 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:49.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe575530700 1 -- 172.21.15.36:0/2375483009 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe56000d4a0 con 0x7fe570061680 2022-01-10T01:24:49.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe575530700 1 -- 172.21.15.36:0/2375483009 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe560000e90 con 0x7fe570061680 2022-01-10T01:24:49.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe575530700 1 -- 172.21.15.36:0/2375483009 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe56000d7f0 con 0x7fe570061680 2022-01-10T01:24:49.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe577534700 1 -- 172.21.15.36:0/2375483009 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe570061680 msgr2=0x7fe5700b9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe577534700 1 --2- 172.21.15.36:0/2375483009 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe570061680 0x7fe5700b9d10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fe560002f70 tx=0x7fe560006df0).stop 2022-01-10T01:24:49.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe577534700 1 -- 172.21.15.36:0/2375483009 shutdown_connections 2022-01-10T01:24:49.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe577534700 1 --2- 172.21.15.36:0/2375483009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5700b4710 0x7fe5700ba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe577534700 1 --2- 172.21.15.36:0/2375483009 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe570061680 0x7fe5700b9d10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe577534700 1 -- 172.21.15.36:0/2375483009 >> 172.21.15.36:0/2375483009 conn(0x7fe57006adf0 msgr2=0x7fe57005f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:49.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe577534700 1 -- 172.21.15.36:0/2375483009 shutdown_connections 2022-01-10T01:24:49.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.352+0000 7fe577534700 1 -- 172.21.15.36:0/2375483009 wait complete. 2022-01-10T01:24:49.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe577534700 1 Processor -- start 2022-01-10T01:24:49.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe577534700 1 -- start start 2022-01-10T01:24:49.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe577534700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe570061680 0x7fe570152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe577534700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5701439a0 0x7fe570146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe577534700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5701462a0 0x7fe57013ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe577534700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5701531b0 con 0x7fe5701439a0 2022-01-10T01:24:49.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe577534700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700aff80 con 0x7fe570061680 2022-01-10T01:24:49.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe577534700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5700b0220 con 0x7fe5701462a0 2022-01-10T01:24:49.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe575d31700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5701439a0 0x7fe570146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe575d31700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5701439a0 0x7fe570146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34634/0 (socket says 172.21.15.36:34634) 2022-01-10T01:24:49.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe575d31700 1 -- 172.21.15.36:0/3926069973 learned_addr learned my addr 172.21.15.36:0/3926069973 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:49.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe576d33700 1 --2- 172.21.15.36:0/3926069973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5701462a0 0x7fe57013ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe576532700 1 --2- 172.21.15.36:0/3926069973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe570061680 0x7fe570152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe575d31700 1 -- 172.21.15.36:0/3926069973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5701462a0 msgr2=0x7fe57013ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe575d31700 1 --2- 172.21.15.36:0/3926069973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5701462a0 0x7fe57013ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe575d31700 1 -- 172.21.15.36:0/3926069973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe570061680 msgr2=0x7fe570152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe575d31700 1 --2- 172.21.15.36:0/3926069973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe570061680 0x7fe570152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe575d31700 1 -- 172.21.15.36:0/3926069973 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56000b180 con 0x7fe5701439a0 2022-01-10T01:24:49.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe575d31700 1 --2- 172.21.15.36:0/3926069973 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5701439a0 0x7fe570146c00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fe56c00c000 tx=0x7fe56c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:49.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe55f7fe700 1 -- 172.21.15.36:0/3926069973 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe56c010780 con 0x7fe5701439a0 2022-01-10T01:24:49.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe55f7fe700 1 -- 172.21.15.36:0/3926069973 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56c0108e0 con 0x7fe5701439a0 2022-01-10T01:24:49.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe577534700 1 -- 172.21.15.36:0/3926069973 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5700b04c0 con 0x7fe5701439a0 2022-01-10T01:24:49.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe55f7fe700 1 -- 172.21.15.36:0/3926069973 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe56c010c40 con 0x7fe5701439a0 2022-01-10T01:24:49.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe577534700 1 -- 172.21.15.36:0/3926069973 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57013f420 con 0x7fe5701439a0 2022-01-10T01:24:49.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe55f7fe700 1 -- 172.21.15.36:0/3926069973 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe56c01c460 con 0x7fe5701439a0 2022-01-10T01:24:49.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.356+0000 7fe55f7fe700 1 --2- 172.21.15.36:0/3926069973 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe5500535f0 0x7fe550055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.360+0000 7fe55f7fe700 1 -- 172.21.15.36:0/3926069973 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fe56c06bf70 con 0x7fe5701439a0 2022-01-10T01:24:49.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.360+0000 7fe577534700 1 -- 172.21.15.36:0/3926069973 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5700b0840 con 0x7fe5701439a0 2022-01-10T01:24:49.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.360+0000 7fe576532700 1 --2- 172.21.15.36:0/3926069973 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe5500535f0 0x7fe550055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.360+0000 7fe576532700 1 --2- 172.21.15.36:0/3926069973 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe5500535f0 0x7fe550055ab0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fe560018000 tx=0x7fe560014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:49.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.364+0000 7fe55f7fe700 1 -- 172.21.15.36:0/3926069973 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe56c042f20 con 0x7fe5701439a0 2022-01-10T01:24:49.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.492+0000 7fe577534700 1 -- 172.21.15.36:0/3926069973 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe570057350 con 0x7fe5701439a0 2022-01-10T01:24:49.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.492+0000 7fe55f7fe700 1 -- 172.21.15.36:0/3926069973 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe56c046540 con 0x7fe5701439a0 2022-01-10T01:24:49.499 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:49.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.492+0000 7fe577534700 1 -- 172.21.15.36:0/3926069973 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe5500535f0 msgr2=0x7fe550055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.492+0000 7fe577534700 1 --2- 172.21.15.36:0/3926069973 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe5500535f0 0x7fe550055ab0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fe560018000 tx=0x7fe560014000).stop 2022-01-10T01:24:49.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.492+0000 7fe577534700 1 -- 172.21.15.36:0/3926069973 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5701439a0 msgr2=0x7fe570146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.492+0000 7fe577534700 1 --2- 172.21.15.36:0/3926069973 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5701439a0 0x7fe570146c00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fe56c00c000 tx=0x7fe56c006df0).stop 2022-01-10T01:24:49.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.492+0000 7fe577534700 1 -- 172.21.15.36:0/3926069973 shutdown_connections 2022-01-10T01:24:49.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.492+0000 7fe577534700 1 --2- 172.21.15.36:0/3926069973 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe5500535f0 0x7fe550055ab0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.492+0000 7fe577534700 1 --2- 172.21.15.36:0/3926069973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5701462a0 0x7fe57013ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.492+0000 7fe577534700 1 --2- 172.21.15.36:0/3926069973 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5701439a0 0x7fe570146c00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.492+0000 7fe577534700 1 --2- 172.21.15.36:0/3926069973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe570061680 0x7fe570152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.492+0000 7fe577534700 1 -- 172.21.15.36:0/3926069973 >> 172.21.15.36:0/3926069973 conn(0x7fe57006adf0 msgr2=0x7fe5701423d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:49.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.492+0000 7fe577534700 1 -- 172.21.15.36:0/3926069973 shutdown_connections 2022-01-10T01:24:49.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.492+0000 7fe577534700 1 -- 172.21.15.36:0/3926069973 wait complete. 2022-01-10T01:24:49.511 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:24:49.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.616+0000 7f2fb5bdd700 1 Processor -- start 2022-01-10T01:24:49.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.616+0000 7f2fb5bdd700 1 -- start start 2022-01-10T01:24:49.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.616+0000 7f2fb5bdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a8ac0 0x7f2fb0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.616+0000 7f2fb5bdd700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb00a70c0 con 0x7f2fb00b2580 2022-01-10T01:24:49.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.616+0000 7f2fb5bdd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb00a72f0 con 0x7f2fb00b0010 2022-01-10T01:24:49.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.616+0000 7f2fb5bdd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00a7590 con 0x7f2fb00a8ac0 2022-01-10T01:24:49.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.616+0000 7f2fb4bdb700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f2fb00b2580 0x7f2fb014ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60670/0 (socket says 172.21.15.36:60670) 2022-01-10T01:24:49.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.616+0000 7f2fb4bdb700 1 -- 172.21.15.36:0/4227323163 learned_addr learned my addr 172.21.15.36:0/4227323163 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:49.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2fb53dc700 1 --2- 172.21.15.36:0/4227323163 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a8ac0 0x7f2fb0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2faf7fe700 1 -- 172.21.15.36:0/4227323163 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238353232 0 0) 0x7f2fb00a70c0 con 0x7f2fb00b2580 2022-01-10T01:24:49.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2faf7fe700 1 -- 172.21.15.36:0/4227323163 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f9c003260 con 0x7f2fb00b2580 2022-01-10T01:24:49.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2faf7fe700 1 -- 172.21.15.36:0/4227323163 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446774898 0 0) 0x7f2fb00a72f0 con 0x7f2fb00b0010 2022-01-10T01:24:49.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2faf7fe700 1 -- 172.21.15.36:0/4227323163 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb00a70c0 con 0x7f2fb00b0010 2022-01-10T01:24:49.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2fb53dc700 1 -- 172.21.15.36:0/4227323163 >> v1:172.21.15.59:6789/0 conn(0x7f2fb00b0010 legacy=0x7f2fb00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2fb53dc700 1 -- 172.21.15.36:0/4227323163 >> v1:172.21.15.36:6789/0 conn(0x7f2fb00b2580 legacy=0x7f2fb014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2fb53dc700 1 -- 172.21.15.36:0/4227323163 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00a7830 con 0x7f2fb00a8ac0 2022-01-10T01:24:49.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2fb53dc700 1 --2- 172.21.15.36:0/4227323163 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a8ac0 0x7f2fb0152be0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2fa8002f70 tx=0x7f2fa8006df0).ready entity=mon.2 client_cookie=3a02bbcf2ae63749 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:49.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2faf7fe700 1 -- 172.21.15.36:0/4227323163 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fa800d5c0 con 0x7f2fb00a8ac0 2022-01-10T01:24:49.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2faf7fe700 1 -- 172.21.15.36:0/4227323163 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa8000e90 con 0x7f2fb00a8ac0 2022-01-10T01:24:49.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2faf7fe700 1 -- 172.21.15.36:0/4227323163 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fa800d910 con 0x7f2fb00a8ac0 2022-01-10T01:24:49.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/4227323163 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a8ac0 msgr2=0x7f2fb0152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2fb5bdd700 1 --2- 172.21.15.36:0/4227323163 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a8ac0 0x7f2fb0152be0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2fa8002f70 tx=0x7f2fa8006df0).stop 2022-01-10T01:24:49.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/4227323163 shutdown_connections 2022-01-10T01:24:49.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2fb5bdd700 1 --2- 172.21.15.36:0/4227323163 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a8ac0 0x7f2fb0152be0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/4227323163 >> 172.21.15.36:0/4227323163 conn(0x7f2fb0060180 msgr2=0x7f2fb00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:49.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/4227323163 shutdown_connections 2022-01-10T01:24:49.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/4227323163 wait complete. 2022-01-10T01:24:49.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2fb5bdd700 1 Processor -- start 2022-01-10T01:24:49.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.620+0000 7f2fb5bdd700 1 -- start start 2022-01-10T01:24:49.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb5bdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a8ac0 0x7f2fb00b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb5bdd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fb00b0010 0x7f2fb00a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb5bdd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2fb00b2580 0x7f2fb00aa350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb5bdd700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb014d100 con 0x7f2fb00b2580 2022-01-10T01:24:49.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb5bdd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb00b4040 con 0x7f2fb00b0010 2022-01-10T01:24:49.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb5bdd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb014c9c0 con 0x7f2fb00a8ac0 2022-01-10T01:24:49.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb53dc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2fb00b2580 0x7f2fb00aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb53dc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2fb00b2580 0x7f2fb00aa350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34652/0 (socket says 172.21.15.36:34652) 2022-01-10T01:24:49.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb53dc700 1 -- 172.21.15.36:0/1098345148 learned_addr learned my addr 172.21.15.36:0/1098345148 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:49.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb4bdb700 1 --2- 172.21.15.36:0/1098345148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a8ac0 0x7f2fb00b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2faffff700 1 --2- 172.21.15.36:0/1098345148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fb00b0010 0x7f2fb00a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb53dc700 1 -- 172.21.15.36:0/1098345148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a8ac0 msgr2=0x7f2fb00b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb53dc700 1 --2- 172.21.15.36:0/1098345148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a8ac0 0x7f2fb00b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb53dc700 1 -- 172.21.15.36:0/1098345148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fb00b0010 msgr2=0x7f2fb00a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb53dc700 1 --2- 172.21.15.36:0/1098345148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fb00b0010 0x7f2fb00a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb53dc700 1 -- 172.21.15.36:0/1098345148 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa800b180 con 0x7f2fb00b2580 2022-01-10T01:24:49.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb53dc700 1 --2- 172.21.15.36:0/1098345148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2fb00b2580 0x7f2fb00aa350 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f2fa8002f70 tx=0x7f2fa8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:49.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fadffb700 1 -- 172.21.15.36:0/1098345148 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fa8013de0 con 0x7f2fb00b2580 2022-01-10T01:24:49.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fadffb700 1 -- 172.21.15.36:0/1098345148 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa800de70 con 0x7f2fb00b2580 2022-01-10T01:24:49.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/1098345148 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb014cc60 con 0x7f2fb00b2580 2022-01-10T01:24:49.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fadffb700 1 -- 172.21.15.36:0/1098345148 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2fa801e5f0 con 0x7f2fb00b2580 2022-01-10T01:24:49.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/1098345148 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb00b42e0 con 0x7f2fb00b2580 2022-01-10T01:24:49.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.624+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/1098345148 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb014ce20 con 0x7f2fb00b2580 2022-01-10T01:24:49.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.628+0000 7f2fadffb700 1 -- 172.21.15.36:0/1098345148 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2fa8025030 con 0x7f2fb00b2580 2022-01-10T01:24:49.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.628+0000 7f2fadffb700 1 --2- 172.21.15.36:0/1098345148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2f90053590 0x7f2f90055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.628+0000 7f2fb4bdb700 1 --2- 172.21.15.36:0/1098345148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2f90053590 0x7f2f90055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.628+0000 7f2fadffb700 1 -- 172.21.15.36:0/1098345148 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f2fa806c590 con 0x7f2fb00b2580 2022-01-10T01:24:49.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.628+0000 7f2fb4bdb700 1 --2- 172.21.15.36:0/1098345148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2f90053590 0x7f2f90055a50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2fa400d000 tx=0x7f2fa4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:49.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.632+0000 7f2fadffb700 1 -- 172.21.15.36:0/1098345148 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2fa80435a0 con 0x7f2fb00b2580 2022-01-10T01:24:49.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.756+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/1098345148 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2fb0057350 con 0x7f2fb00b2580 2022-01-10T01:24:49.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.756+0000 7f2fadffb700 1 -- 172.21.15.36:0/1098345148 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2fa8046bc0 con 0x7f2fb00b2580 2022-01-10T01:24:49.764 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:49.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.760+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/1098345148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2f90053590 msgr2=0x7f2f90055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.760+0000 7f2fb5bdd700 1 --2- 172.21.15.36:0/1098345148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2f90053590 0x7f2f90055a50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2fa400d000 tx=0x7f2fa4009040).stop 2022-01-10T01:24:49.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.760+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/1098345148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2fb00b2580 msgr2=0x7f2fb00aa350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.760+0000 7f2fb5bdd700 1 --2- 172.21.15.36:0/1098345148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2fb00b2580 0x7f2fb00aa350 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f2fa8002f70 tx=0x7f2fa8014000).stop 2022-01-10T01:24:49.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.760+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/1098345148 shutdown_connections 2022-01-10T01:24:49.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.760+0000 7f2fb5bdd700 1 --2- 172.21.15.36:0/1098345148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2f90053590 0x7f2f90055a50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.760+0000 7f2fb5bdd700 1 --2- 172.21.15.36:0/1098345148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2fb00b2580 0x7f2fb00aa350 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.760+0000 7f2fb5bdd700 1 --2- 172.21.15.36:0/1098345148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fb00b0010 0x7f2fb00a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.760+0000 7f2fb5bdd700 1 --2- 172.21.15.36:0/1098345148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2fb00a8ac0 0x7f2fb00b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.760+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/1098345148 >> 172.21.15.36:0/1098345148 conn(0x7f2fb0060180 msgr2=0x7f2fb0144b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:49.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.760+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/1098345148 shutdown_connections 2022-01-10T01:24:49.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.760+0000 7f2fb5bdd700 1 -- 172.21.15.36:0/1098345148 wait complete. 2022-01-10T01:24:49.783 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:24:49.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 Processor -- start 2022-01-10T01:24:49.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 -- start start 2022-01-10T01:24:49.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23440af3c0 0x7f23440b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f23440601a0 0x7f2344144450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23440aa4a0 con 0x7f2344144940 2022-01-10T01:24:49.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440b1450 con 0x7f23440601a0 2022-01-10T01:24:49.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23440af7a0 con 0x7f23440af3c0 2022-01-10T01:24:49.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f23427fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f23440601a0 0x7f2344144450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f23427fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f23440601a0 0x7f2344144450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34656/0 (socket says 172.21.15.36:34656) 2022-01-10T01:24:49.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f23427fc700 1 -- 172.21.15.36:0/557364303 learned_addr learned my addr 172.21.15.36:0/557364303 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:49.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2342ffd700 1 --2- 172.21.15.36:0/557364303 >> v2:172.21.15.59:3300/0 conn(0x7f23440af3c0 0x7f23440b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f23427fc700 1 -- 172.21.15.36:0/557364303 >> v2:172.21.15.59:3300/0 conn(0x7f23440af3c0 msgr2=0x7f23440b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:49.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f23427fc700 1 --2- 172.21.15.36:0/557364303 >> v2:172.21.15.59:3300/0 conn(0x7f23440af3c0 0x7f23440b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f23427fc700 1 -- 172.21.15.36:0/557364303 >> v1:172.21.15.59:6789/0 conn(0x7f2344144940 legacy=0x7f23440a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:49.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f23427fc700 1 -- 172.21.15.36:0/557364303 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234405fb80 con 0x7f23440601a0 2022-01-10T01:24:49.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f23427fc700 1 --2- 172.21.15.36:0/557364303 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23440601a0 0x7f2344144450 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f232c002f70 tx=0x7f232c006eb0).ready entity=mon.0 client_cookie=6316e64ddc79e8c9 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:49.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2341ffb700 1 -- 172.21.15.36:0/557364303 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f232c00d610 con 0x7f23440601a0 2022-01-10T01:24:49.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2341ffb700 1 -- 172.21.15.36:0/557364303 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c000e90 con 0x7f23440601a0 2022-01-10T01:24:49.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2341ffb700 1 -- 172.21.15.36:0/557364303 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f232c00d9a0 con 0x7f23440601a0 2022-01-10T01:24:49.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 -- 172.21.15.36:0/557364303 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23440601a0 msgr2=0x7f2344144450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 --2- 172.21.15.36:0/557364303 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23440601a0 0x7f2344144450 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f232c002f70 tx=0x7f232c006eb0).stop 2022-01-10T01:24:49.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 -- 172.21.15.36:0/557364303 shutdown_connections 2022-01-10T01:24:49.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 --2- 172.21.15.36:0/557364303 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23440601a0 0x7f2344144450 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 --2- 172.21.15.36:0/557364303 >> v2:172.21.15.59:3300/0 conn(0x7f23440af3c0 0x7f23440b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 -- 172.21.15.36:0/557364303 >> 172.21.15.36:0/557364303 conn(0x7f2344061140 msgr2=0x7f2344062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:49.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 -- 172.21.15.36:0/557364303 shutdown_connections 2022-01-10T01:24:49.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.892+0000 7f2343fff700 1 -- 172.21.15.36:0/557364303 wait complete. 2022-01-10T01:24:49.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.896+0000 7f2343fff700 1 Processor -- start 2022-01-10T01:24:49.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.896+0000 7f2343fff700 1 -- start start 2022-01-10T01:24:49.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.896+0000 7f2343fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23440601a0 0x7f2344143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.896+0000 7f2343fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23440af3c0 0x7f23440ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.896+0000 7f2343fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2344144940 0x7f2344152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.896+0000 7f2343fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234413dc70 con 0x7f23440af3c0 2022-01-10T01:24:49.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.896+0000 7f2343fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2344152220 con 0x7f2344144940 2022-01-10T01:24:49.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.896+0000 7f2343fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2344143420 con 0x7f23440601a0 2022-01-10T01:24:49.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.896+0000 7f23427fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23440af3c0 0x7f23440ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.896+0000 7f23427fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23440af3c0 0x7f23440ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34664/0 (socket says 172.21.15.36:34664) 2022-01-10T01:24:49.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.896+0000 7f23427fc700 1 -- 172.21.15.36:0/4183034495 learned_addr learned my addr 172.21.15.36:0/4183034495 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:49.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.896+0000 7f23437fe700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2344144940 0x7f2344152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.896+0000 7f2342ffd700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23440601a0 0x7f2344143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f23437fe700 1 -- 172.21.15.36:0/4183034495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23440601a0 msgr2=0x7f2344143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f23437fe700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23440601a0 0x7f2344143f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f23437fe700 1 -- 172.21.15.36:0/4183034495 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23440af3c0 msgr2=0x7f23440ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:49.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f23437fe700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23440af3c0 0x7f23440ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:49.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f23437fe700 1 -- 172.21.15.36:0/4183034495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c00b1e0 con 0x7f2344144940 2022-01-10T01:24:49.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f23427fc700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23440af3c0 0x7f23440ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:49.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f23437fe700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2344144940 0x7f2344152920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f23440b02c0 tx=0x7f233c007f10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:49.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f233bfff700 1 -- 172.21.15.36:0/4183034495 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f233c00ce10 con 0x7f2344144940 2022-01-10T01:24:49.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f2343fff700 1 -- 172.21.15.36:0/4183034495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234405f6b0 con 0x7f2344144940 2022-01-10T01:24:49.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f233bfff700 1 -- 172.21.15.36:0/4183034495 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c006aa0 con 0x7f2344144940 2022-01-10T01:24:49.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f233bfff700 1 -- 172.21.15.36:0/4183034495 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f233c006e00 con 0x7f2344144940 2022-01-10T01:24:49.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f2343fff700 1 -- 172.21.15.36:0/4183034495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2344143960 con 0x7f2344144940 2022-01-10T01:24:49.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f2343fff700 1 -- 172.21.15.36:0/4183034495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23441446e0 con 0x7f2344144940 2022-01-10T01:24:49.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f233bfff700 1 -- 172.21.15.36:0/4183034495 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f233c010030 con 0x7f2344144940 2022-01-10T01:24:49.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f233bfff700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f23280534d0 0x7f2328055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:49.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f233bfff700 1 -- 172.21.15.36:0/4183034495 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f233c06c2f0 con 0x7f2344144940 2022-01-10T01:24:49.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f2342ffd700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f23280534d0 0x7f2328055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:49.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.900+0000 7f2342ffd700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f23280534d0 0x7f2328055990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f233400c000 tx=0x7f2334008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:49.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:49.908+0000 7f233bfff700 1 -- 172.21.15.36:0/4183034495 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f233c0432a0 con 0x7f2344144940 2022-01-10T01:24:50.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.032+0000 7f2343fff700 1 -- 172.21.15.36:0/4183034495 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2344143b20 con 0x7f2344144940 2022-01-10T01:24:50.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.036+0000 7f233bfff700 1 -- 172.21.15.36:0/4183034495 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f233c0468c0 con 0x7f2344144940 2022-01-10T01:24:50.041 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:50.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.036+0000 7f2343fff700 1 -- 172.21.15.36:0/4183034495 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f23280534d0 msgr2=0x7f2328055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:50.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.036+0000 7f2343fff700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f23280534d0 0x7f2328055990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f233400c000 tx=0x7f2334008040).stop 2022-01-10T01:24:50.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.036+0000 7f2343fff700 1 -- 172.21.15.36:0/4183034495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2344144940 msgr2=0x7f2344152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:50.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.036+0000 7f2343fff700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2344144940 0x7f2344152920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f23440b02c0 tx=0x7f233c007f10).stop 2022-01-10T01:24:50.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.036+0000 7f2343fff700 1 -- 172.21.15.36:0/4183034495 shutdown_connections 2022-01-10T01:24:50.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.036+0000 7f2343fff700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f23280534d0 0x7f2328055990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.036+0000 7f2343fff700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2344144940 0x7f2344152920 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.036+0000 7f2343fff700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23440af3c0 0x7f23440ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.036+0000 7f2343fff700 1 --2- 172.21.15.36:0/4183034495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23440601a0 0x7f2344143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.036+0000 7f2343fff700 1 -- 172.21.15.36:0/4183034495 >> 172.21.15.36:0/4183034495 conn(0x7f2344061140 msgr2=0x7f2344140f30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:50.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.036+0000 7f2343fff700 1 -- 172.21.15.36:0/4183034495 shutdown_connections 2022-01-10T01:24:50.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.036+0000 7f2343fff700 1 -- 172.21.15.36:0/4183034495 wait complete. 2022-01-10T01:24:50.067 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) 2022-01-10T01:24:50.069 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2022-01-10T01:24:50.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.164+0000 7fae96b6a700 1 Processor -- start 2022-01-10T01:24:50.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.164+0000 7fae96b6a700 1 -- start start 2022-01-10T01:24:50.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.164+0000 7fae96b6a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fae900b2580 0x7fae900abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:50.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.164+0000 7fae96b6a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae900b1260 0x7fae900ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:50.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.164+0000 7fae96b6a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae900add80 con 0x7fae900b1790 2022-01-10T01:24:50.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.164+0000 7fae96b6a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae900ae020 con 0x7fae900b2580 2022-01-10T01:24:50.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.164+0000 7fae96b6a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae900a9390 con 0x7fae900b1260 2022-01-10T01:24:50.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae95b68700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fae900b2580 0x7fae900abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:50.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae95b68700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fae900b2580 0x7fae900abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34672/0 (socket says 172.21.15.36:34672) 2022-01-10T01:24:50.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae95b68700 1 -- 172.21.15.36:0/3987079431 learned_addr learned my addr 172.21.15.36:0/3987079431 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:50.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae95367700 1 --2- 172.21.15.36:0/3987079431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae900b1260 0x7fae900ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:50.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae95b68700 1 -- 172.21.15.36:0/3987079431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae900b1260 msgr2=0x7fae900ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:50.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae95b68700 1 --2- 172.21.15.36:0/3987079431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae900b1260 0x7fae900ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae95b68700 1 -- 172.21.15.36:0/3987079431 >> v1:172.21.15.59:6789/0 conn(0x7fae900b1790 legacy=0x7fae900afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:50.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae95b68700 1 -- 172.21.15.36:0/3987079431 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae900a9830 con 0x7fae900b2580 2022-01-10T01:24:50.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae95b68700 1 --2- 172.21.15.36:0/3987079431 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae900b2580 0x7fae900abb10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fae90067a30 tx=0x7fae8c006eb0).ready entity=mon.0 client_cookie=68c344263452d8b0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:50.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae94b66700 1 -- 172.21.15.36:0/3987079431 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c00d5c0 con 0x7fae900b2580 2022-01-10T01:24:50.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae94b66700 1 -- 172.21.15.36:0/3987079431 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c000e90 con 0x7fae900b2580 2022-01-10T01:24:50.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae94b66700 1 -- 172.21.15.36:0/3987079431 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c00d950 con 0x7fae900b2580 2022-01-10T01:24:50.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae96b6a700 1 -- 172.21.15.36:0/3987079431 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae900b2580 msgr2=0x7fae900abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:50.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae96b6a700 1 --2- 172.21.15.36:0/3987079431 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae900b2580 0x7fae900abb10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fae90067a30 tx=0x7fae8c006eb0).stop 2022-01-10T01:24:50.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae96b6a700 1 -- 172.21.15.36:0/3987079431 shutdown_connections 2022-01-10T01:24:50.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae96b6a700 1 --2- 172.21.15.36:0/3987079431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae900b1260 0x7fae900ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae96b6a700 1 --2- 172.21.15.36:0/3987079431 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae900b2580 0x7fae900abb10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae96b6a700 1 -- 172.21.15.36:0/3987079431 >> 172.21.15.36:0/3987079431 conn(0x7fae90060180 msgr2=0x7fae900b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:50.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae96b6a700 1 -- 172.21.15.36:0/3987079431 shutdown_connections 2022-01-10T01:24:50.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae96b6a700 1 -- 172.21.15.36:0/3987079431 wait complete. 2022-01-10T01:24:50.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae96b6a700 1 Processor -- start 2022-01-10T01:24:50.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.168+0000 7fae96b6a700 1 -- start start 2022-01-10T01:24:50.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae96b6a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae900b1260 0x7fae90064660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:50.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae96b6a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae900b1790 0x7fae90155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:50.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae96b6a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9014ad20 0x7fae90156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:50.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae96b6a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae90145640 con 0x7fae900b1260 2022-01-10T01:24:50.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae96b6a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae90065500 con 0x7fae900b1790 2022-01-10T01:24:50.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae96b6a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae90065260 con 0x7fae9014ad20 2022-01-10T01:24:50.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae95b68700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae900b1260 0x7fae90064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:50.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae95b68700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae900b1260 0x7fae90064660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34676/0 (socket says 172.21.15.36:34676) 2022-01-10T01:24:50.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae95367700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae900b1790 0x7fae90155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:50.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae95b68700 1 -- 172.21.15.36:0/3841220099 learned_addr learned my addr 172.21.15.36:0/3841220099 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:50.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae96369700 1 --2- 172.21.15.36:0/3841220099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9014ad20 0x7fae90156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:50.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae95b68700 1 -- 172.21.15.36:0/3841220099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9014ad20 msgr2=0x7fae90156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:50.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae95b68700 1 --2- 172.21.15.36:0/3841220099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9014ad20 0x7fae90156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae95b68700 1 -- 172.21.15.36:0/3841220099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae900b1790 msgr2=0x7fae90155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:50.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae95b68700 1 --2- 172.21.15.36:0/3841220099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae900b1790 0x7fae90155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae95b68700 1 -- 172.21.15.36:0/3841220099 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c00b1e0 con 0x7fae900b1260 2022-01-10T01:24:50.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae95367700 1 --2- 172.21.15.36:0/3841220099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae900b1790 0x7fae90155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:50.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae95b68700 1 --2- 172.21.15.36:0/3841220099 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae900b1260 0x7fae90064660 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fae90145780 tx=0x7fae8c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:50.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae7effd700 1 -- 172.21.15.36:0/3841220099 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c002f70 con 0x7fae900b1260 2022-01-10T01:24:50.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae7effd700 1 -- 172.21.15.36:0/3841220099 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c00d940 con 0x7fae900b1260 2022-01-10T01:24:50.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae96b6a700 1 -- 172.21.15.36:0/3841220099 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae901419e0 con 0x7fae900b1260 2022-01-10T01:24:50.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae7effd700 1 -- 172.21.15.36:0/3841220099 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c011d30 con 0x7fae900b1260 2022-01-10T01:24:50.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.172+0000 7fae96b6a700 1 -- 172.21.15.36:0/3841220099 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae900659f0 con 0x7fae900b1260 2022-01-10T01:24:50.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.176+0000 7fae96b6a700 1 -- 172.21.15.36:0/3841220099 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae90141e80 con 0x7fae900b1260 2022-01-10T01:24:50.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.176+0000 7fae7effd700 1 -- 172.21.15.36:0/3841220099 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fae8c025030 con 0x7fae900b1260 2022-01-10T01:24:50.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.176+0000 7fae7effd700 1 --2- 172.21.15.36:0/3841220099 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae70053680 0x7fae70055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:50.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.176+0000 7fae7effd700 1 -- 172.21.15.36:0/3841220099 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7fae8c06ca30 con 0x7fae900b1260 2022-01-10T01:24:50.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.176+0000 7fae95367700 1 --2- 172.21.15.36:0/3841220099 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae70053680 0x7fae70055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:50.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.176+0000 7fae95367700 1 --2- 172.21.15.36:0/3841220099 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae70053680 0x7fae70055b40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fae8000b000 tx=0x7fae80006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:50.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.184+0000 7fae7effd700 1 -- 172.21.15.36:0/3841220099 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fae90141e80 con 0x7fae900b1260 2022-01-10T01:24:50.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.352+0000 7fae96b6a700 1 -- 172.21.15.36:0/3841220099 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7fae90141e80 con 0x7fae900b1260 2022-01-10T01:24:50.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.596+0000 7fae7effd700 1 -- 172.21.15.36:0/3841220099 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v44) v1 ==== 142+0+0 (secure 0 0 0) 0x7fae90141e80 con 0x7fae900b1260 2022-01-10T01:24:50.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.600+0000 7fae96b6a700 1 -- 172.21.15.36:0/3841220099 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae70053680 msgr2=0x7fae70055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:50.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.600+0000 7fae96b6a700 1 --2- 172.21.15.36:0/3841220099 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae70053680 0x7fae70055b40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fae8000b000 tx=0x7fae80006df0).stop 2022-01-10T01:24:50.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.600+0000 7fae96b6a700 1 -- 172.21.15.36:0/3841220099 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae900b1260 msgr2=0x7fae90064660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:50.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.600+0000 7fae96b6a700 1 --2- 172.21.15.36:0/3841220099 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae900b1260 0x7fae90064660 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fae90145780 tx=0x7fae8c015000).stop 2022-01-10T01:24:50.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.604+0000 7fae96b6a700 1 -- 172.21.15.36:0/3841220099 shutdown_connections 2022-01-10T01:24:50.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.604+0000 7fae96b6a700 1 --2- 172.21.15.36:0/3841220099 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae70053680 0x7fae70055b40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.604+0000 7fae96b6a700 1 --2- 172.21.15.36:0/3841220099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9014ad20 0x7fae90156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.604+0000 7fae96b6a700 1 --2- 172.21.15.36:0/3841220099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae900b1790 0x7fae90155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.604+0000 7fae96b6a700 1 --2- 172.21.15.36:0/3841220099 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae900b1260 0x7fae90064660 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.604+0000 7fae96b6a700 1 -- 172.21.15.36:0/3841220099 >> 172.21.15.36:0/3841220099 conn(0x7fae90060180 msgr2=0x7fae900ab9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:50.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.604+0000 7fae96b6a700 1 -- 172.21.15.36:0/3841220099 shutdown_connections 2022-01-10T01:24:50.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.604+0000 7fae96b6a700 1 -- 172.21.15.36:0/3841220099 wait complete. 2022-01-10T01:24:50.625 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2022-01-10T01:24:50.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.740+0000 7f91b120d700 1 Processor -- start 2022-01-10T01:24:50.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.740+0000 7f91b120d700 1 -- start start 2022-01-10T01:24:50.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.740+0000 7f91b120d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91ac0b2850 0x7f91ac067150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:50.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.740+0000 7f91b120d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f91ac0af130 0x7f91ac067640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:50.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91b120d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ac144450 con 0x7f91ac0afd60 2022-01-10T01:24:50.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91b120d700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ac0b2c30 con 0x7f91ac0af130 2022-01-10T01:24:50.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91b120d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac145300 con 0x7f91ac0b2850 2022-01-10T01:24:50.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91ab7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f91ac0af130 0x7f91ac067640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:50.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91b0a0c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f91ac0afd60 0x7f91ac140e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:50158/0 (socket says 172.21.15.36:50158) 2022-01-10T01:24:50.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91abfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91ac0b2850 0x7f91ac067150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:50.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91b0a0c700 1 -- 172.21.15.36:0/725683597 learned_addr learned my addr 172.21.15.36:0/725683597 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:50.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91ab7fe700 1 --2- 172.21.15.36:0/725683597 >> v2:172.21.15.36:3300/0 conn(0x7f91ac0af130 0x7f91ac067640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34686/0 (socket says 172.21.15.36:34686) 2022-01-10T01:24:50.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91aaffd700 1 -- 172.21.15.36:0/725683597 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579784902 0 0) 0x7f91ac144450 con 0x7f91ac0afd60 2022-01-10T01:24:50.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91ab7fe700 1 -- 172.21.15.36:0/725683597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91ac0b2850 msgr2=0x7f91ac067150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:50.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91ab7fe700 1 --2- 172.21.15.36:0/725683597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91ac0b2850 0x7f91ac067150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91ab7fe700 1 -- 172.21.15.36:0/725683597 >> v1:172.21.15.59:6789/0 conn(0x7f91ac0afd60 legacy=0x7f91ac140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:50.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91ab7fe700 1 -- 172.21.15.36:0/725683597 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ac144680 con 0x7f91ac0af130 2022-01-10T01:24:50.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91abfff700 1 --2- 172.21.15.36:0/725683597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91ac0b2850 0x7f91ac067150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:50.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91ab7fe700 1 --2- 172.21.15.36:0/725683597 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91ac0af130 0x7f91ac067640 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f91a0002f70 tx=0x7f91a0006df0).ready entity=mon.0 client_cookie=8592056fd4fff548 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:50.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91aaffd700 1 -- 172.21.15.36:0/725683597 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a000d570 con 0x7f91ac0af130 2022-01-10T01:24:50.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91aaffd700 1 -- 172.21.15.36:0/725683597 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a0000e90 con 0x7f91ac0af130 2022-01-10T01:24:50.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91aaffd700 1 -- 172.21.15.36:0/725683597 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a000d8c0 con 0x7f91ac0af130 2022-01-10T01:24:50.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91b120d700 1 -- 172.21.15.36:0/725683597 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91ac0af130 msgr2=0x7f91ac067640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:50.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91b120d700 1 --2- 172.21.15.36:0/725683597 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91ac0af130 0x7f91ac067640 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f91a0002f70 tx=0x7f91a0006df0).stop 2022-01-10T01:24:50.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91b120d700 1 -- 172.21.15.36:0/725683597 shutdown_connections 2022-01-10T01:24:50.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91b120d700 1 --2- 172.21.15.36:0/725683597 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91ac0af130 0x7f91ac067640 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91b120d700 1 --2- 172.21.15.36:0/725683597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91ac0b2850 0x7f91ac067150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91b120d700 1 -- 172.21.15.36:0/725683597 >> 172.21.15.36:0/725683597 conn(0x7f91ac061230 msgr2=0x7f91ac062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:50.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91b120d700 1 -- 172.21.15.36:0/725683597 shutdown_connections 2022-01-10T01:24:50.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.744+0000 7f91b120d700 1 -- 172.21.15.36:0/725683597 wait complete. 2022-01-10T01:24:50.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b120d700 1 Processor -- start 2022-01-10T01:24:50.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b120d700 1 -- start start 2022-01-10T01:24:50.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b120d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91ac0af130 0x7f91ac140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:50.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b120d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91ac0afd60 0x7f91ac13ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:50.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b120d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91ac0b2850 0x7f91ac153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:50.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b120d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac066d30 con 0x7f91ac0b2850 2022-01-10T01:24:50.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b120d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac1404a0 con 0x7f91ac0afd60 2022-01-10T01:24:50.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b120d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac13f790 con 0x7f91ac0af130 2022-01-10T01:24:50.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b0a0c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91ac0b2850 0x7f91ac153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:50.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b0a0c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91ac0b2850 0x7f91ac153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34694/0 (socket says 172.21.15.36:34694) 2022-01-10T01:24:50.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b0a0c700 1 -- 172.21.15.36:0/3316490298 learned_addr learned my addr 172.21.15.36:0/3316490298 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:50.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91ab7fe700 1 --2- 172.21.15.36:0/3316490298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91ac0afd60 0x7f91ac13ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:50.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91abfff700 1 --2- 172.21.15.36:0/3316490298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91ac0af130 0x7f91ac140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:50.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b0a0c700 1 -- 172.21.15.36:0/3316490298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91ac0af130 msgr2=0x7f91ac140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:50.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b0a0c700 1 --2- 172.21.15.36:0/3316490298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91ac0af130 0x7f91ac140fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b0a0c700 1 -- 172.21.15.36:0/3316490298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91ac0afd60 msgr2=0x7f91ac13ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:50.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b0a0c700 1 --2- 172.21.15.36:0/3316490298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91ac0afd60 0x7f91ac13ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b0a0c700 1 -- 172.21.15.36:0/3316490298 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919c00b180 con 0x7f91ac0b2850 2022-01-10T01:24:50.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b0a0c700 1 --2- 172.21.15.36:0/3316490298 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91ac0b2850 0x7f91ac153800 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f91a4001250 tx=0x7f91a4007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:50.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91a97fa700 1 -- 172.21.15.36:0/3316490298 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a4005ba0 con 0x7f91ac0b2850 2022-01-10T01:24:50.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91a97fa700 1 -- 172.21.15.36:0/3316490298 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a4005d00 con 0x7f91ac0b2850 2022-01-10T01:24:50.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b120d700 1 -- 172.21.15.36:0/3316490298 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a000b180 con 0x7f91ac0b2850 2022-01-10T01:24:50.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91a97fa700 1 -- 172.21.15.36:0/3316490298 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91a4004a90 con 0x7f91ac0b2850 2022-01-10T01:24:50.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.748+0000 7f91b120d700 1 -- 172.21.15.36:0/3316490298 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac13fcd0 con 0x7f91ac0b2850 2022-01-10T01:24:50.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.752+0000 7f91b120d700 1 -- 172.21.15.36:0/3316490298 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ac057350 con 0x7f91ac0b2850 2022-01-10T01:24:50.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.752+0000 7f91a97fa700 1 -- 172.21.15.36:0/3316490298 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f91a4004bf0 con 0x7f91ac0b2850 2022-01-10T01:24:50.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.752+0000 7f91a97fa700 1 --2- 172.21.15.36:0/3316490298 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f918c053560 0x7f918c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:50.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.752+0000 7f91a97fa700 1 -- 172.21.15.36:0/3316490298 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f91a406b630 con 0x7f91ac0b2850 2022-01-10T01:24:50.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.752+0000 7f91abfff700 1 --2- 172.21.15.36:0/3316490298 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f918c053560 0x7f918c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:50.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.752+0000 7f91abfff700 1 --2- 172.21.15.36:0/3316490298 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f918c053560 0x7f918c055a20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f919c00b000 tx=0x7f919c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:50.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.760+0000 7f91a97fa700 1 -- 172.21.15.36:0/3316490298 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f91a4042640 con 0x7f91ac0b2850 2022-01-10T01:24:50.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.892+0000 7f91b120d700 1 -- 172.21.15.36:0/3316490298 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f91ac05f240 con 0x7f91ac0b2850 2022-01-10T01:24:50.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.900+0000 7f91a97fa700 1 -- 172.21.15.36:0/3316490298 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f91a4045c60 con 0x7f91ac0b2850 2022-01-10T01:24:50.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.904+0000 7f91b120d700 1 -- 172.21.15.36:0/3316490298 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f918c053560 msgr2=0x7f918c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:50.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.904+0000 7f91b120d700 1 --2- 172.21.15.36:0/3316490298 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f918c053560 0x7f918c055a20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f919c00b000 tx=0x7f919c006df0).stop 2022-01-10T01:24:50.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.904+0000 7f91b120d700 1 -- 172.21.15.36:0/3316490298 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91ac0b2850 msgr2=0x7f91ac153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:50.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.904+0000 7f91b120d700 1 --2- 172.21.15.36:0/3316490298 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91ac0b2850 0x7f91ac153800 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f91a4001250 tx=0x7f91a4007d80).stop 2022-01-10T01:24:50.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.904+0000 7f91b120d700 1 -- 172.21.15.36:0/3316490298 shutdown_connections 2022-01-10T01:24:50.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.904+0000 7f91b120d700 1 --2- 172.21.15.36:0/3316490298 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f918c053560 0x7f918c055a20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.904+0000 7f91b120d700 1 --2- 172.21.15.36:0/3316490298 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91ac0b2850 0x7f91ac153800 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.904+0000 7f91b120d700 1 --2- 172.21.15.36:0/3316490298 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91ac0afd60 0x7f91ac13ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.904+0000 7f91b120d700 1 --2- 172.21.15.36:0/3316490298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91ac0af130 0x7f91ac140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:50.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.904+0000 7f91b120d700 1 -- 172.21.15.36:0/3316490298 >> 172.21.15.36:0/3316490298 conn(0x7f91ac061230 msgr2=0x7f91ac0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:50.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.904+0000 7f91b120d700 1 -- 172.21.15.36:0/3316490298 shutdown_connections 2022-01-10T01:24:50.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:50.904+0000 7f91b120d700 1 -- 172.21.15.36:0/3316490298 wait complete. 2022-01-10T01:24:50.924 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:24:50.925 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:24:50.944 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:24:50.967 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:24:50.988 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:24:51.010 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:24:51.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:51.011 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:24:51.012 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:24:51.020 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:24:51.021 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:24:51.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:51.022 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:24:51.023 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:24:51.071 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:24:51.072 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:24:51.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:51.073 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:24:51.073 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:24:51.080 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2022-01-10T01:24:51.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:24:51.082 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2022-01-10T01:24:51.083 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:24:51.083 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:24:51.083 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:24:51.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:51.110 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:24:51.111 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:24:51.157 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:24:51.159 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:24:51.159 INFO:teuthology.orchestra.run:waiting for 900 2022-01-10T01:24:51.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:24:51.160 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:24:51.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:51.173 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:24:51.173 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:24:51.182 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:24:51.184 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:24:51.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:51.185 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:24:51.185 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:24:51.232 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:24:51.233 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:24:51.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:51.234 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:24:51.235 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:24:51.241 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': Transport endpoint is not connected 2022-01-10T01:24:51.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:24:51.243 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.1 2022-01-10T01:24:51.243 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi166.front.sepia.ceph.com... 2022-01-10T01:24:51.244 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:24:51.244 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:24:51.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:24:51.273 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:24:51.273 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:24:51.319 INFO:teuthology.orchestra.run.smithi166.stdout:ext2/ext3 2022-01-10T01:24:51.320 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:24:51.321 INFO:teuthology.orchestra.run:waiting for 900 2022-01-10T01:24:51.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:24:51.322 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:24:51.339 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:24:51.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 Processor -- start 2022-01-10T01:24:51.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 -- start start 2022-01-10T01:24:51.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f99fc0b1db0 0x7f99fc0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:51.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99fc1483a0 0x7f99fc0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:51.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc0b0350 con 0x7f99fc0a70c0 2022-01-10T01:24:51.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc0a90c0 con 0x7f99fc0b1db0 2022-01-10T01:24:51.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0b05f0 con 0x7f99fc1483a0 2022-01-10T01:24:51.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f99fb7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f99fc0b1db0 0x7f99fc0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:51.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f99fb7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f99fc0b1db0 0x7f99fc0b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34698/0 (socket says 172.21.15.36:34698) 2022-01-10T01:24:51.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f99fb7fe700 1 -- 172.21.15.36:0/800819509 learned_addr learned my addr 172.21.15.36:0/800819509 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:51.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f99faffd700 1 --2- 172.21.15.36:0/800819509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99fc1483a0 0x7f99fc0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:51.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f99fb7fe700 1 -- 172.21.15.36:0/800819509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99fc1483a0 msgr2=0x7f99fc0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:51.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f99fb7fe700 1 --2- 172.21.15.36:0/800819509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99fc1483a0 0x7f99fc0b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:51.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f99fb7fe700 1 -- 172.21.15.36:0/800819509 >> v1:172.21.15.59:6789/0 conn(0x7f99fc0a70c0 legacy=0x7f99fc144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:51.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f99fb7fe700 1 -- 172.21.15.36:0/800819509 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0b0890 con 0x7f99fc0b1db0 2022-01-10T01:24:51.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f99faffd700 1 --2- 172.21.15.36:0/800819509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99fc1483a0 0x7f99fc0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:51.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f99fb7fe700 1 --2- 172.21.15.36:0/800819509 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99fc0b1db0 0x7f99fc0b0fd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f99fc0613a0 tx=0x7f99e4006eb0).ready entity=mon.0 client_cookie=9af9a8148d2f7def server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:51.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f99fa7fc700 1 -- 172.21.15.36:0/800819509 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e400d570 con 0x7f99fc0b1db0 2022-01-10T01:24:51.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f99fa7fc700 1 -- 172.21.15.36:0/800819509 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e4000e90 con 0x7f99fc0b1db0 2022-01-10T01:24:51.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f99fa7fc700 1 -- 172.21.15.36:0/800819509 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e400d8c0 con 0x7f99fc0b1db0 2022-01-10T01:24:51.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 -- 172.21.15.36:0/800819509 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99fc0b1db0 msgr2=0x7f99fc0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:51.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 --2- 172.21.15.36:0/800819509 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99fc0b1db0 0x7f99fc0b0fd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f99fc0613a0 tx=0x7f99e4006eb0).stop 2022-01-10T01:24:51.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 -- 172.21.15.36:0/800819509 shutdown_connections 2022-01-10T01:24:51.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 --2- 172.21.15.36:0/800819509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99fc1483a0 0x7f99fc0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:51.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 --2- 172.21.15.36:0/800819509 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99fc0b1db0 0x7f99fc0b0fd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:51.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 -- 172.21.15.36:0/800819509 >> 172.21.15.36:0/800819509 conn(0x7f99fc05f6b0 msgr2=0x7f99fc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:51.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 -- 172.21.15.36:0/800819509 shutdown_connections 2022-01-10T01:24:51.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.444+0000 7f9a01f7c700 1 -- 172.21.15.36:0/800819509 wait complete. 2022-01-10T01:24:51.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f9a01f7c700 1 Processor -- start 2022-01-10T01:24:51.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f9a01f7c700 1 -- start start 2022-01-10T01:24:51.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f9a01f7c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99fc0a70c0 0x7f99fc149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:51.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f9a01f7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99fc0b1db0 0x7f99fc1427b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:51.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f9a01f7c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99fc1483a0 0x7f99fc1568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:51.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f9a01f7c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc157900 con 0x7f99fc0a70c0 2022-01-10T01:24:51.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f9a01f7c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc141e40 con 0x7f99fc1483a0 2022-01-10T01:24:51.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f9a01f7c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc1416f0 con 0x7f99fc0b1db0 2022-01-10T01:24:51.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99fb7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99fc0a70c0 0x7f99fc149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:51.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99fb7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99fc0a70c0 0x7f99fc149fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34704/0 (socket says 172.21.15.36:34704) 2022-01-10T01:24:51.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99fb7fe700 1 -- 172.21.15.36:0/730115888 learned_addr learned my addr 172.21.15.36:0/730115888 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:51.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99faffd700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99fc0b1db0 0x7f99fc1427b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:51.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99fbfff700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99fc1483a0 0x7f99fc1568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:51.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99fb7fe700 1 -- 172.21.15.36:0/730115888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99fc0b1db0 msgr2=0x7f99fc1427b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:51.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99fb7fe700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99fc0b1db0 0x7f99fc1427b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:51.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99fb7fe700 1 -- 172.21.15.36:0/730115888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99fc1483a0 msgr2=0x7f99fc1568e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:51.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99fb7fe700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99fc1483a0 0x7f99fc1568e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:51.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99fb7fe700 1 -- 172.21.15.36:0/730115888 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e400b1e0 con 0x7f99fc0a70c0 2022-01-10T01:24:51.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99fbfff700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99fc1483a0 0x7f99fc1568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:24:51.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99fb7fe700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99fc0a70c0 0x7f99fc149fc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f99fc0613a0 tx=0x7f99e4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:51.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99f8ff9700 1 -- 172.21.15.36:0/730115888 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e4011690 con 0x7f99fc0a70c0 2022-01-10T01:24:51.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99f8ff9700 1 -- 172.21.15.36:0/730115888 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e40117f0 con 0x7f99fc0a70c0 2022-01-10T01:24:51.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f9a01f7c700 1 -- 172.21.15.36:0/730115888 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc142070 con 0x7f99fc0a70c0 2022-01-10T01:24:51.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f99f8ff9700 1 -- 172.21.15.36:0/730115888 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e4011b50 con 0x7f99fc0a70c0 2022-01-10T01:24:51.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.448+0000 7f9a01f7c700 1 -- 172.21.15.36:0/730115888 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc142ca0 con 0x7f99fc0a70c0 2022-01-10T01:24:51.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.452+0000 7f9a01f7c700 1 -- 172.21.15.36:0/730115888 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc0b0b30 con 0x7f99fc0a70c0 2022-01-10T01:24:51.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.452+0000 7f99f8ff9700 1 -- 172.21.15.36:0/730115888 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f99e4025030 con 0x7f99fc0a70c0 2022-01-10T01:24:51.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.452+0000 7f99f8ff9700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f99e00535f0 0x7f99e0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:51.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.452+0000 7f99faffd700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f99e00535f0 0x7f99e0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:51.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.452+0000 7f99f8ff9700 1 -- 172.21.15.36:0/730115888 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f99e406cd60 con 0x7f99fc0a70c0 2022-01-10T01:24:51.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.452+0000 7f99faffd700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f99e00535f0 0x7f99e0055ab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f99ec00c000 tx=0x7f99ec008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:51.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.460+0000 7f99f8ff9700 1 -- 172.21.15.36:0/730115888 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f99e4043c60 con 0x7f99fc0a70c0 2022-01-10T01:24:51.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.588+0000 7f9a01f7c700 1 -- 172.21.15.36:0/730115888 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f99fc057350 con 0x7f99fc0a70c0 2022-01-10T01:24:51.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.592+0000 7f99f8ff9700 1 -- 172.21.15.36:0/730115888 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v24) v1 ==== 81+0+34065 (secure 0 0 0) 0x7f99e4023020 con 0x7f99fc0a70c0 2022-01-10T01:24:51.599 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:51.599 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:24:51.599 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 24, 2022-01-10T01:24:51.599 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:24:51.600 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:24:51.600 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:24:25.224959+0000", 2022-01-10T01:24:51.600 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:24:51.600 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:24:51.601 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:24:51.601 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:24:51.601 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:24:51.601 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:24:51.602 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:24:51.602 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:24:51.602 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:24:51.602 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:24:51.603 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:24:51.603 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:24:51.603 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:24:51.603 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:24:51.604 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:24:51.604 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 4, 2022-01-10T01:24:51.604 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:24:51.604 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:24:51.605 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:24:51.605 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:24:51.605 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:24:51.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.606 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:24:51.606 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:24:51.606 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:24:51.606 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:24:51.607 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:24:51.607 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:24:51.607 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:24:51.607 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:24:51.608 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:24:51.608 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:24:51.608 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:24:51.608 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:24:51.608 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:24:51.609 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:24:51.609 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:24:51.609 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:24:51.609 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:24:51.610 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:24:51.610 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:24:51.610 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:24:51.610 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:24:51.611 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:24:51.611 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:24:51.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.611 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:24:51.612 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:24:51.612 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:24:51.612 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:24:51.612 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:24:51.612 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:24:51.613 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:24:51.613 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:24:51.613 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:24:51.613 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:24:51.614 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:24:51.614 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:24:51.614 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:24:51.614 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:24:51.614 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:24:51.615 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:24:51.615 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:24:51.615 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:24:51.615 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:24:51.616 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:24:51.616 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:24:51.616 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:24:51.616 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:24:51.617 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:24:51.617 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:24:51.617 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:24:51.617 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:24:51.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.618 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:24:51.618 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:24:51.618 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:24:51.618 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:24:51.618 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:24:51.619 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:24:51.619 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:24:51.619 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:24:51.619 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:24:51.620 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:24:51.620 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:24:51.620 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:24:51.620 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:24:51.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.621 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:24:51.621 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:24:51.621 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.622 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:24:51.622 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:24:51.622 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:24:51.623 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:24:51.623 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:24:51.623 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:24:51.623 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:24:51.623 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:24:51.624 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:24:51.624 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:24:51.624 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:24:51.624 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:24:51.625 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:24:51.625 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:24:51.625 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:24:51.625 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:24:51.625 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:24:51.626 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:24:51.626 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:24:51.626 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:24:51.626 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:24:51.627 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:24:51.627 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:24:51.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.627 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:24:51.628 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:24:51.628 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:24:51.628 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:24:51.628 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:24:51.628 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:24:51.629 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:24:51.629 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:24:51.629 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:24:51.629 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:24:51.629 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:24:51.630 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:24:51.630 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:24:51.630 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:24:51.630 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:24:51.631 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:24:51.631 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:24:51.631 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:24:51.631 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:24:51.632 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:24:51.632 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:24:51.632 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:24:51.632 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:24:51.633 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:24:51.633 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:24:51.633 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:24:51.633 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:24:51.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.634 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:24:51.634 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:24:51.634 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:24:51.634 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:24:51.635 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:24:51.635 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:24:51.635 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:24:51.635 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:24:51.635 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:24:51.636 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:24:51.636 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:24:51.636 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:24:51.636 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:24:51.636 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:24:51.637 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.637 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 3, 2022-01-10T01:24:51.638 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_metadata", 2022-01-10T01:24:51.638 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:20.202898+0000", 2022-01-10T01:24:51.638 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:24:51.638 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:24:51.639 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:24:51.639 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:24:51.639 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:24:51.639 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:24:51.639 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:24:51.640 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:24:51.640 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:24:51.640 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:24:51.640 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:24:51.641 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:24:51.641 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:24:51.641 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:24:51.641 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:24:51.642 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:24:51.642 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:24:51.642 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:24:51.642 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:24:51.642 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:24:51.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.643 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "24", 2022-01-10T01:24:51.643 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:24:51.643 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:24:51.644 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:24:51.644 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:24:51.644 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:24:51.644 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:24:51.644 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:24:51.645 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:24:51.645 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:24:51.645 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:24:51.645 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:24:51.645 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:24:51.646 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:24:51.646 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:24:51.646 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:24:51.646 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:24:51.647 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:24:51.647 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:24:51.647 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:24:51.647 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:24:51.648 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:24:51.648 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:24:51.648 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:24:51.648 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:24:51.648 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:24:51.649 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:24:51.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.649 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:24:51.649 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:24:51.650 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:24:51.650 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:24:51.650 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:24:51.650 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:24:51.650 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:24:51.651 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:24:51.651 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:24:51.651 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:24:51.651 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:24:51.652 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:24:51.652 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_bias": 4, 2022-01-10T01:24:51.652 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 16, 2022-01-10T01:24:51.652 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_priority": 5 2022-01-10T01:24:51.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.653 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:24:51.653 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:24:51.653 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": "cephfs" 2022-01-10T01:24:51.653 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.654 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.654 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 4, 2022-01-10T01:24:51.654 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_data", 2022-01-10T01:24:51.655 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:22.952870+0000", 2022-01-10T01:24:51.655 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 5, 2022-01-10T01:24:51.655 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool,ec_overwrites", 2022-01-10T01:24:51.655 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 3, 2022-01-10T01:24:51.656 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 4, 2022-01-10T01:24:51.656 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 3, 2022-01-10T01:24:51.656 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 1, 2022-01-10T01:24:51.656 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:24:51.656 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:24:51.657 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:24:51.657 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:24:51.657 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:24:51.657 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:24:51.658 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:24:51.658 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:24:51.658 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:24:51.658 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:24:51.658 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:24:51.659 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:24:51.659 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:24:51.659 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:24:51.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.660 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "24", 2022-01-10T01:24:51.660 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:24:51.660 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:24:51.660 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:24:51.661 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:24:51.661 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:24:51.661 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:24:51.661 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:24:51.661 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:24:51.662 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:24:51.662 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:24:51.662 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:24:51.662 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:24:51.662 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:24:51.663 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:24:51.663 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:24:51.663 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:24:51.663 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:24:51.664 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:24:51.664 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:24:51.664 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:24:51.664 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:24:51.664 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:24:51.665 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:24:51.665 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "cephfs_data", 2022-01-10T01:24:51.665 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:24:51.665 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:24:51.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.666 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:24:51.666 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:24:51.666 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:24:51.667 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:24:51.667 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:24:51.667 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:24:51.667 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:24:51.667 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:24:51.668 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 8192, 2022-01-10T01:24:51.668 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:24:51.668 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:24:51.668 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:24:51.669 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:24:51.669 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:24:51.669 INFO:teuthology.orchestra.run.smithi036.stdout: "data": "cephfs" 2022-01-10T01:24:51.669 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.669 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.670 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.670 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:24:51.670 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:24:51.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.671 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:24:51.671 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:24:51.671 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:24:51.671 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:24:51.671 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:24:51.672 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:24:51.672 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:24:51.672 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:24:51.672 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:24:51.673 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 19, 2022-01-10T01:24:51.673 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:24:51.673 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:24:51.673 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:24:51.674 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.674 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.674 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:24:51.675 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:24:51.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.675 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.676 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:24:51.676 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:24:51.676 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.676 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.677 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:24:51.677 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.678 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.678 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:24:51.678 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:24:51.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.679 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.679 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:24:51.679 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:24:51.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.680 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.680 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:24:51.680 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.681 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.681 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:24:51.681 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:24:51.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.682 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.682 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:24:51.682 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:24:51.683 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.683 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.683 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:24:51.684 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.684 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.684 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:24:51.685 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:24:51.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.685 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.686 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:24:51.686 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:24:51.686 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.686 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.687 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:24:51.687 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:24:51.687 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:24:51.688 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:24:51.688 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:24:51.688 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:24:51.688 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:24:51.689 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.689 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:24:51.689 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:24:51.690 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:24:51.690 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:24:51.690 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:24:51.690 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:24:51.691 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:24:51.691 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:24:51.691 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:24:51.691 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 13, 2022-01-10T01:24:51.691 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:24:51.692 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:24:51.692 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:24:51.692 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.693 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.693 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:24:51.693 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:24:51.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.694 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.694 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:24:51.694 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:24:51.694 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.695 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.695 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:24:51.695 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.696 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.696 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:24:51.696 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:24:51.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.697 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.697 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:24:51.697 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:24:51.698 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.698 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.698 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:24:51.699 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.699 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.699 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.699 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:24:51.699 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:24:51.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.700 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.700 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:24:51.701 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:24:51.701 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.701 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.701 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.701 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:24:51.702 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.702 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.702 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:24:51.703 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:24:51.703 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.703 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.703 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:24:51.704 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:24:51.704 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.704 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.705 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:24:51.705 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:24:51.705 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:24:51.705 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:24:51.705 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:24:51.706 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:24:51.706 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:24:51.706 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.707 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:24:51.707 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:24:51.707 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:24:51.707 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:24:51.708 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:24:51.708 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:24:51.708 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:24:51.708 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:24:51.709 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:24:51.709 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 22, 2022-01-10T01:24:51.709 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:24:51.709 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:24:51.710 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:24:51.710 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.710 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.710 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.710 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:24:51.711 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:24:51.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.711 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.711 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.712 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:24:51.712 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:24:51.712 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.712 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.713 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:24:51.713 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.713 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.713 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.714 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:24:51.714 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:24:51.714 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.715 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.715 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:24:51.715 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:24:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:24:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:24:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:24:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:24:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:24:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:24:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:24:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:24:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:24:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:24:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.723 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:24:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:24:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:24:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:24:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:24:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:24:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:24:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:24:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:24:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:24:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:24:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:24:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:24:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:24:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:24:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:24:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 22, 2022-01-10T01:24:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:24:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:24:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:24:51.734 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.734 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.734 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.734 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:24:51.735 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:24:51.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.735 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.735 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:24:51.736 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:24:51.736 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.736 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.736 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.737 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:24:51.737 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.737 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:24:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:24:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:24:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:24:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:24:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:24:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:24:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:24:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:24:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:24:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.744 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:24:51.744 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:24:51.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.745 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.745 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:24:51.745 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:24:51.745 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.745 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:24:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:24:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:24:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:24:51.747 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:24:51.747 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:24:51.747 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:24:51.747 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.748 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.748 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:24:51.748 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:24:51.748 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:24:51.749 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:24:51.749 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:24:51.749 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:24:51.749 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:24:51.750 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:24:51.750 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:24:51.750 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 22, 2022-01-10T01:24:51.750 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:24:51.751 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:24:51.751 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:24:51.751 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.752 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.752 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:24:51.752 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:24:51.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.753 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.753 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:24:51.753 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:24:51.753 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.754 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.754 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:24:51.754 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.755 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.755 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.755 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:24:51.755 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:24:51.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.756 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.756 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:24:51.756 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:24:51.757 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.757 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.757 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.757 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:24:51.757 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.758 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.758 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:24:51.758 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:24:51.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.759 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.759 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:24:51.759 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:24:51.760 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.760 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.760 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:24:51.761 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.761 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.761 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:24:51.761 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:24:51.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.762 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.762 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:24:51.763 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:24:51.763 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.763 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.763 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.764 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:24:51.764 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:24:51.764 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:24:51.764 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:24:51.764 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:24:51.765 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:24:51.765 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:24:51.765 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.766 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:24:51.766 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:24:51.766 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:24:51.766 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:24:51.767 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:24:51.767 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:24:51.767 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:24:51.767 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:24:51.767 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:24:51.768 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 22, 2022-01-10T01:24:51.768 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:24:51.768 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:24:51.768 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:24:51.768 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.769 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.769 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:24:51.769 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:24:51.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.770 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.770 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:24:51.770 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:24:51.771 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.771 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.771 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:24:51.771 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.772 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.772 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:24:51.772 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:24:51.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.773 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.773 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:24:51.773 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:24:51.773 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.774 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.774 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:24:51.774 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.775 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.775 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:24:51.775 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:24:51.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.776 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.776 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:24:51.776 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:24:51.777 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.777 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.777 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:24:51.777 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.777 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.778 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.778 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:24:51.778 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:24:51.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.779 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.779 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:24:51.779 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:24:51.779 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.780 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.780 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:24:51.781 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:24:51.781 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:24:51.781 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:24:51.781 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:24:51.781 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:24:51.782 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:24:51.782 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.783 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:24:51.783 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:24:51.783 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:24:51.783 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:24:51.783 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:24:51.784 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:24:51.784 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:24:51.784 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:24:51.784 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:24:51.784 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 22, 2022-01-10T01:24:51.785 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:24:51.785 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:24:51.785 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:24:51.785 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.785 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.786 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:24:51.786 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:24:51.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.787 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.787 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:24:51.787 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:24:51.787 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.788 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.788 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.788 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:24:51.788 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.789 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.789 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.789 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:24:51.789 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:24:51.790 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.790 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.790 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:24:51.791 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:24:51.791 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.791 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.792 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:24:51.792 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.792 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.792 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.793 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:24:51.793 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:24:51.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.794 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.794 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:24:51.794 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:24:51.794 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.795 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.795 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.795 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:24:51.795 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.796 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.796 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.796 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:24:51.796 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:24:51.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.797 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.797 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:24:51.798 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:24:51.798 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.798 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.798 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.798 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:24:51.799 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:24:51.799 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:24:51.799 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:24:51.799 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:24:51.800 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:24:51.800 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:24:51.800 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.800 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.801 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:24:51.801 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:24:51.801 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:24:51.801 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:24:51.802 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:24:51.802 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:24:51.802 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:24:51.802 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:24:51.803 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:24:51.803 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 16, 2022-01-10T01:24:51.803 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:24:51.803 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:24:51.803 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:24:51.804 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.804 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.804 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:24:51.804 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:24:51.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.805 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.805 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:24:51.806 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:24:51.806 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.806 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.806 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.806 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:24:51.807 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.807 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.807 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:24:51.808 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:24:51.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.808 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.808 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:24:51.809 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:24:51.809 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.809 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.810 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:24:51.810 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.810 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.810 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:24:51.811 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:24:51.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.811 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.811 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.812 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:24:51.812 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:24:51.812 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.812 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.813 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:24:51.813 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:24:51.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.813 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:24:51.814 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:24:51.814 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:24:51.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.814 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.814 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:24:51.815 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:24:51.815 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:24:51.815 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.815 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.816 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:24:51.816 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:24:51.816 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:24:51.817 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:24:51.817 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:24:51.817 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:24:51.817 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:24:51.817 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:51.818 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.818 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:24:51.818 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:24:51.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.819 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:24:51.819 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:24:51.819 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:24:51.819 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:24:51.819 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:24:51.820 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:24:51.820 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:24:51.820 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:24:51.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.820 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.821 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:24:51.821 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:24:51.821 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:24:51.821 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:24:51.822 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:24:51.822 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:24:51.822 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:24:51.822 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:24:51.823 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.823 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:24:51.823 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:24:51.823 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:24:51.824 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:24:51.824 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:24:51.824 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:24:51.824 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:24:51.824 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:24:51.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.825 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:24:51.825 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:24:51.826 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:24:51.826 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:24:51.826 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:24:51.826 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:24:51.827 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:24:51.827 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:24:51.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.827 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:24:51.828 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:24:51.828 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:24:51.828 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:24:51.828 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:24:51.828 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:24:51.829 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:24:51.829 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:24:51.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.830 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:24:51.830 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:24:51.830 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:24:51.830 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:24:51.831 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:24:51.831 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:24:51.831 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:24:51.831 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:24:51.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.832 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:24:51.832 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:24:51.833 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:24:51.833 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:24:51.833 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:24:51.833 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:24:51.834 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:24:51.834 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:24:51.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:51.835 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:24:51.835 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:24:51.835 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:24:51.835 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:24:51.836 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:24:51.836 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:24:51.836 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:24:51.836 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:24:51.836 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.837 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:24:51.837 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:24:51.837 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:24:51.837 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:24:51.838 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:24:51.838 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2022-01-10T01:24:51.838 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:24:51.838 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:24:51.839 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:24:51.839 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:24:51.839 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:24:51.839 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:24:51.839 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:24:51.840 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:24:51.840 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:24:51.840 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:24:51.840 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:24:51.841 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:24:51.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.841 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:24:51.841 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:24:51.841 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:24:51.842 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:24:51.842 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:24:51.842 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:24:51.842 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:24:51.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:51.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:51.843 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:24:51.843 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:24:51.843 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:24:51.844 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:24:51.844 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:24:51.844 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:24:51.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.592+0000 7f9a01f7c700 1 -- 172.21.15.36:0/730115888 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f99e00535f0 msgr2=0x7f99e0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:51.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.592+0000 7f9a01f7c700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f99e00535f0 0x7f99e0055ab0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f99ec00c000 tx=0x7f99ec008040).stop 2022-01-10T01:24:51.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.592+0000 7f9a01f7c700 1 -- 172.21.15.36:0/730115888 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99fc0a70c0 msgr2=0x7f99fc149fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:51.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.592+0000 7f9a01f7c700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99fc0a70c0 0x7f99fc149fc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f99fc0613a0 tx=0x7f99e4015000).stop 2022-01-10T01:24:51.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.592+0000 7f9a01f7c700 1 -- 172.21.15.36:0/730115888 shutdown_connections 2022-01-10T01:24:51.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.592+0000 7f9a01f7c700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f99e00535f0 0x7f99e0055ab0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:51.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.592+0000 7f9a01f7c700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99fc1483a0 0x7f99fc1568e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:51.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.592+0000 7f9a01f7c700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99fc0b1db0 0x7f99fc1427b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:51.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.592+0000 7f9a01f7c700 1 --2- 172.21.15.36:0/730115888 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99fc0a70c0 0x7f99fc149fc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:51.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.592+0000 7f9a01f7c700 1 -- 172.21.15.36:0/730115888 >> 172.21.15.36:0/730115888 conn(0x7f99fc05f6b0 msgr2=0x7f99fc143f40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:51.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.592+0000 7f9a01f7c700 1 -- 172.21.15.36:0/730115888 shutdown_connections 2022-01-10T01:24:51.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.592+0000 7f9a01f7c700 1 -- 172.21.15.36:0/730115888 wait complete. 2022-01-10T01:24:51.850 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:24:51.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.956+0000 7facd236a700 1 Processor -- start 2022-01-10T01:24:51.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.956+0000 7facd236a700 1 -- start start 2022-01-10T01:24:51.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd236a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faccc0ad320 0x7faccc0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:51.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd236a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faccc0ad850 0x7faccc0a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:51.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd236a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faccc0afda0 con 0x7faccc0af2c0 2022-01-10T01:24:51.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd236a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faccc05c610 con 0x7faccc0ad320 2022-01-10T01:24:51.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd236a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faccc140800 con 0x7faccc0ad850 2022-01-10T01:24:51.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd0b67700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faccc0ad320 0x7faccc0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:51.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd1b69700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faccc0ad850 0x7faccc0a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:51.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd0b67700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faccc0ad320 0x7faccc0af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34714/0 (socket says 172.21.15.36:34714) 2022-01-10T01:24:51.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd1b69700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faccc0ad850 0x7faccc0a8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:59580/0 (socket says 172.21.15.36:59580) 2022-01-10T01:24:51.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd1b69700 1 -- 172.21.15.36:0/497573464 learned_addr learned my addr 172.21.15.36:0/497573464 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:51.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd1368700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faccc0af2c0 0x7faccc143150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:50182/0 (socket says 172.21.15.36:50182) 2022-01-10T01:24:51.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd0b67700 1 -- 172.21.15.36:0/497573464 >> v2:172.21.15.59:3300/0 conn(0x7faccc0ad850 msgr2=0x7faccc0a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:51.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd0b67700 1 --2- 172.21.15.36:0/497573464 >> v2:172.21.15.59:3300/0 conn(0x7faccc0ad850 0x7faccc0a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:51.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd0b67700 1 -- 172.21.15.36:0/497573464 >> v1:172.21.15.59:6789/0 conn(0x7faccc0af2c0 legacy=0x7faccc143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:51.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd0b67700 1 -- 172.21.15.36:0/497573464 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc143860 con 0x7faccc0ad320 2022-01-10T01:24:51.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facd0b67700 1 --2- 172.21.15.36:0/497573464 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faccc0ad320 0x7faccc0af6a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7faccc0ad770 tx=0x7facbc006df0).ready entity=mon.0 client_cookie=27b14d4d33cf6b45 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:51.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facbbfff700 1 -- 172.21.15.36:0/497573464 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facbc00d5c0 con 0x7faccc0ad320 2022-01-10T01:24:51.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facbbfff700 1 -- 172.21.15.36:0/497573464 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc000e90 con 0x7faccc0ad320 2022-01-10T01:24:51.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.960+0000 7facbbfff700 1 -- 172.21.15.36:0/497573464 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facbc00d910 con 0x7faccc0ad320 2022-01-10T01:24:51.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.964+0000 7facd236a700 1 -- 172.21.15.36:0/497573464 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faccc0ad320 msgr2=0x7faccc0af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:51.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.964+0000 7facd236a700 1 --2- 172.21.15.36:0/497573464 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faccc0ad320 0x7faccc0af6a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7faccc0ad770 tx=0x7facbc006df0).stop 2022-01-10T01:24:51.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.964+0000 7facd236a700 1 -- 172.21.15.36:0/497573464 shutdown_connections 2022-01-10T01:24:51.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.964+0000 7facd236a700 1 --2- 172.21.15.36:0/497573464 >> v2:172.21.15.59:3300/0 conn(0x7faccc0ad850 0x7faccc0a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:51.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.964+0000 7facd236a700 1 --2- 172.21.15.36:0/497573464 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faccc0ad320 0x7faccc0af6a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:51.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.964+0000 7facd236a700 1 -- 172.21.15.36:0/497573464 >> 172.21.15.36:0/497573464 conn(0x7faccc061140 msgr2=0x7faccc062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:51.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.964+0000 7facd236a700 1 -- 172.21.15.36:0/497573464 shutdown_connections 2022-01-10T01:24:51.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.964+0000 7facd236a700 1 -- 172.21.15.36:0/497573464 wait complete. 2022-01-10T01:24:51.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.964+0000 7facd236a700 1 Processor -- start 2022-01-10T01:24:51.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.964+0000 7facd236a700 1 -- start start 2022-01-10T01:24:51.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd236a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faccc0ad320 0x7faccc141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:51.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd236a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faccc0ad850 0x7faccc0aa560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:51.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd236a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faccc0af2c0 0x7faccc0aaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:51.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd236a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0a9aa0 con 0x7faccc0ad320 2022-01-10T01:24:51.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd236a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0b4820 con 0x7faccc0ad850 2022-01-10T01:24:51.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd236a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0b4cf0 con 0x7faccc0af2c0 2022-01-10T01:24:51.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd1368700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faccc0ad320 0x7faccc141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:51.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd1368700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faccc0ad320 0x7faccc141230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34718/0 (socket says 172.21.15.36:34718) 2022-01-10T01:24:51.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd1368700 1 -- 172.21.15.36:0/3872755179 learned_addr learned my addr 172.21.15.36:0/3872755179 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:51.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd0b67700 1 --2- 172.21.15.36:0/3872755179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faccc0ad850 0x7faccc0aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:51.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd1b69700 1 --2- 172.21.15.36:0/3872755179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faccc0af2c0 0x7faccc0aaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:51.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd1368700 1 -- 172.21.15.36:0/3872755179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faccc0af2c0 msgr2=0x7faccc0aaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:51.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd1368700 1 --2- 172.21.15.36:0/3872755179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faccc0af2c0 0x7faccc0aaa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:51.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd1368700 1 -- 172.21.15.36:0/3872755179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faccc0ad850 msgr2=0x7faccc0aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:51.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd1368700 1 --2- 172.21.15.36:0/3872755179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faccc0ad850 0x7faccc0aa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:51.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd1368700 1 -- 172.21.15.36:0/3872755179 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc00b180 con 0x7faccc0ad320 2022-01-10T01:24:51.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd1368700 1 --2- 172.21.15.36:0/3872755179 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faccc0ad320 0x7faccc141230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7faccc141fd0 tx=0x7facc8007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:51.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facba7fc700 1 -- 172.21.15.36:0/3872755179 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facc80070d0 con 0x7faccc0ad320 2022-01-10T01:24:51.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facba7fc700 1 -- 172.21.15.36:0/3872755179 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc8007230 con 0x7faccc0ad320 2022-01-10T01:24:51.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd236a700 1 -- 172.21.15.36:0/3872755179 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faccc0aaf40 con 0x7faccc0ad320 2022-01-10T01:24:51.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facba7fc700 1 -- 172.21.15.36:0/3872755179 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facc8005550 con 0x7faccc0ad320 2022-01-10T01:24:51.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.968+0000 7facd236a700 1 -- 172.21.15.36:0/3872755179 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faccc0b4020 con 0x7faccc0ad320 2022-01-10T01:24:51.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.972+0000 7facd236a700 1 -- 172.21.15.36:0/3872755179 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faccc057350 con 0x7faccc0ad320 2022-01-10T01:24:51.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.972+0000 7facba7fc700 1 -- 172.21.15.36:0/3872755179 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7facc8010070 con 0x7faccc0ad320 2022-01-10T01:24:51.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.972+0000 7facba7fc700 1 --2- 172.21.15.36:0/3872755179 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7facac0535f0 0x7facac055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:51.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.972+0000 7facba7fc700 1 -- 172.21.15.36:0/3872755179 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7facc806aff0 con 0x7faccc0ad320 2022-01-10T01:24:51.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.972+0000 7facd0b67700 1 --2- 172.21.15.36:0/3872755179 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7facac0535f0 0x7facac055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:51.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.972+0000 7facd0b67700 1 --2- 172.21.15.36:0/3872755179 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7facac0535f0 0x7facac055ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7facbc01a000 tx=0x7facbc014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:51.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:51.976+0000 7facba7fc700 1 -- 172.21.15.36:0/3872755179 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7facc8041f30 con 0x7faccc0ad320 2022-01-10T01:24:52.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.144+0000 7facd236a700 1 -- 172.21.15.36:0/3872755179 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faccc061990 con 0x7faccc0ad320 2022-01-10T01:24:52.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.144+0000 7facba7fc700 1 -- 172.21.15.36:0/3872755179 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2486 (secure 0 0 0) 0x7facc8045550 con 0x7faccc0ad320 2022-01-10T01:24:52.201 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:52.201 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3870348387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3870348387},{"type":"v1","addr":"172.21.15.59:6833","nonce":3870348387}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2808909651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2808909651},{"type":"v1","addr":"172.21.15.36:6835","nonce":2808909651}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:24:25.225258+0000","modified":"2022-01-10T01:24:26.981594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":5,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/1089668836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1089668836},{"type":"v1","addr":"172.21.15.36:6837","nonce":1089668836}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-01-10T01:24:52.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.144+0000 7facd236a700 1 -- 172.21.15.36:0/3872755179 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7facac0535f0 msgr2=0x7facac055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:52.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.144+0000 7facd236a700 1 --2- 172.21.15.36:0/3872755179 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7facac0535f0 0x7facac055ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7facbc01a000 tx=0x7facbc014000).stop 2022-01-10T01:24:52.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.144+0000 7facd236a700 1 -- 172.21.15.36:0/3872755179 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faccc0ad320 msgr2=0x7faccc141230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:52.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.144+0000 7facd236a700 1 --2- 172.21.15.36:0/3872755179 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faccc0ad320 0x7faccc141230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7faccc141fd0 tx=0x7facc8007c40).stop 2022-01-10T01:24:52.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.148+0000 7facd236a700 1 -- 172.21.15.36:0/3872755179 shutdown_connections 2022-01-10T01:24:52.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.148+0000 7facd236a700 1 --2- 172.21.15.36:0/3872755179 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7facac0535f0 0x7facac055ab0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.148+0000 7facd236a700 1 --2- 172.21.15.36:0/3872755179 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faccc0af2c0 0x7faccc0aaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.148+0000 7facd236a700 1 --2- 172.21.15.36:0/3872755179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faccc0ad850 0x7faccc0aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.148+0000 7facd236a700 1 --2- 172.21.15.36:0/3872755179 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faccc0ad320 0x7faccc141230 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.148+0000 7facd236a700 1 -- 172.21.15.36:0/3872755179 >> 172.21.15.36:0/3872755179 conn(0x7faccc061140 msgr2=0x7faccc13bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:52.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.148+0000 7facd236a700 1 -- 172.21.15.36:0/3872755179 shutdown_connections 2022-01-10T01:24:52.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.148+0000 7facd236a700 1 -- 172.21.15.36:0/3872755179 wait complete. 2022-01-10T01:24:52.206 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 7 2022-01-10T01:24:52.206 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2022-01-10T01:24:52.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.308+0000 7f04e23ae700 1 Processor -- start 2022-01-10T01:24:52.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.308+0000 7f04e23ae700 1 -- start start 2022-01-10T01:24:52.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.308+0000 7f04e23ae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04dc0b1db0 0x7f04dc0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:52.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.308+0000 7f04e23ae700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f04dc0a70c0 0x7f04dc144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:52.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.308+0000 7f04e23ae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04dc0b0350 con 0x7f04dc1483a0 2022-01-10T01:24:52.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.308+0000 7f04e23ae700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc0a90c0 con 0x7f04dc0a70c0 2022-01-10T01:24:52.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.308+0000 7f04e23ae700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04dc0b05f0 con 0x7f04dc0b1db0 2022-01-10T01:24:52.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.308+0000 7f04e094b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f04dc0a70c0 0x7f04dc144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:52.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.308+0000 7f04e094b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f04dc0a70c0 0x7f04dc144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34730/0 (socket says 172.21.15.36:34730) 2022-01-10T01:24:52.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.308+0000 7f04e094b700 1 -- 172.21.15.36:0/1791816153 learned_addr learned my addr 172.21.15.36:0/1791816153 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:52.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.308+0000 7f04dbfff700 1 --2- 172.21.15.36:0/1791816153 >> v2:172.21.15.59:3300/0 conn(0x7f04dc0b1db0 0x7f04dc0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:52.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e094b700 1 -- 172.21.15.36:0/1791816153 >> v2:172.21.15.59:3300/0 conn(0x7f04dc0b1db0 msgr2=0x7f04dc0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:52.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e094b700 1 --2- 172.21.15.36:0/1791816153 >> v2:172.21.15.59:3300/0 conn(0x7f04dc0b1db0 0x7f04dc0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e094b700 1 -- 172.21.15.36:0/1791816153 >> v1:172.21.15.59:6789/0 conn(0x7f04dc1483a0 legacy=0x7f04dc0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:52.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e094b700 1 -- 172.21.15.36:0/1791816153 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc0b0890 con 0x7f04dc0a70c0 2022-01-10T01:24:52.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e094b700 1 --2- 172.21.15.36:0/1791816153 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04dc0a70c0 0x7f04dc144720 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f04dc147730 tx=0x7f04d4009290).ready entity=mon.0 client_cookie=686b3d3e0f582146 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:52.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04daffd700 1 -- 172.21.15.36:0/1791816153 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d400b860 con 0x7f04dc0a70c0 2022-01-10T01:24:52.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04daffd700 1 -- 172.21.15.36:0/1791816153 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d400b9c0 con 0x7f04dc0a70c0 2022-01-10T01:24:52.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04daffd700 1 -- 172.21.15.36:0/1791816153 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d400bb30 con 0x7f04dc0a70c0 2022-01-10T01:24:52.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e23ae700 1 -- 172.21.15.36:0/1791816153 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04dc0a70c0 msgr2=0x7f04dc144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:52.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e23ae700 1 --2- 172.21.15.36:0/1791816153 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04dc0a70c0 0x7f04dc144720 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f04dc147730 tx=0x7f04d4009290).stop 2022-01-10T01:24:52.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e23ae700 1 -- 172.21.15.36:0/1791816153 shutdown_connections 2022-01-10T01:24:52.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e23ae700 1 --2- 172.21.15.36:0/1791816153 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04dc0a70c0 0x7f04dc144720 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e23ae700 1 --2- 172.21.15.36:0/1791816153 >> v2:172.21.15.59:3300/0 conn(0x7f04dc0b1db0 0x7f04dc0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e23ae700 1 -- 172.21.15.36:0/1791816153 >> 172.21.15.36:0/1791816153 conn(0x7f04dc05f6b0 msgr2=0x7f04dc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:52.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e23ae700 1 -- 172.21.15.36:0/1791816153 shutdown_connections 2022-01-10T01:24:52.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e23ae700 1 -- 172.21.15.36:0/1791816153 wait complete. 2022-01-10T01:24:52.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e23ae700 1 Processor -- start 2022-01-10T01:24:52.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.312+0000 7f04e23ae700 1 -- start start 2022-01-10T01:24:52.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04e23ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04dc0a70c0 0x7f04dc149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:52.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04e23ae700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04dc0b1db0 0x7f04dc14ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:52.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04e23ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04dc1483a0 0x7f04dc14b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:52.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04e23ae700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0abf40 con 0x7f04dc0b1db0 2022-01-10T01:24:52.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04e23ae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0ac1e0 con 0x7f04dc1483a0 2022-01-10T01:24:52.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04e23ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc0ac480 con 0x7f04dc0a70c0 2022-01-10T01:24:52.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04db7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04dc0b1db0 0x7f04dc14ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:52.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04db7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04dc0b1db0 0x7f04dc14ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34734/0 (socket says 172.21.15.36:34734) 2022-01-10T01:24:52.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04db7fe700 1 -- 172.21.15.36:0/2722472667 learned_addr learned my addr 172.21.15.36:0/2722472667 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:52.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04e094b700 1 --2- 172.21.15.36:0/2722472667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04dc1483a0 0x7f04dc14b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:52.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04dbfff700 1 --2- 172.21.15.36:0/2722472667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04dc0a70c0 0x7f04dc149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:52.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04db7fe700 1 -- 172.21.15.36:0/2722472667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04dc0a70c0 msgr2=0x7f04dc149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:52.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04db7fe700 1 --2- 172.21.15.36:0/2722472667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04dc0a70c0 0x7f04dc149ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04db7fe700 1 -- 172.21.15.36:0/2722472667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04dc1483a0 msgr2=0x7f04dc14b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:52.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04db7fe700 1 --2- 172.21.15.36:0/2722472667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04dc1483a0 0x7f04dc14b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04db7fe700 1 -- 172.21.15.36:0/2722472667 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d4009530 con 0x7f04dc0b1db0 2022-01-10T01:24:52.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04db7fe700 1 --2- 172.21.15.36:0/2722472667 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04dc0b1db0 0x7f04dc14ac30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f04dc0ace60 tx=0x7f04cc007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:52.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04d97fa700 1 -- 172.21.15.36:0/2722472667 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04cc00cd80 con 0x7f04dc0b1db0 2022-01-10T01:24:52.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04d97fa700 1 -- 172.21.15.36:0/2722472667 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc012400 con 0x7f04dc0b1db0 2022-01-10T01:24:52.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04e23ae700 1 -- 172.21.15.36:0/2722472667 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc0ac720 con 0x7f04dc0b1db0 2022-01-10T01:24:52.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04d97fa700 1 -- 172.21.15.36:0/2722472667 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04cc012760 con 0x7f04dc0b1db0 2022-01-10T01:24:52.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.316+0000 7f04e23ae700 1 -- 172.21.15.36:0/2722472667 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc14a3e0 con 0x7f04dc0b1db0 2022-01-10T01:24:52.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.320+0000 7f04e23ae700 1 -- 172.21.15.36:0/2722472667 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc0ac8b0 con 0x7f04dc0b1db0 2022-01-10T01:24:52.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.320+0000 7f04d97fa700 1 -- 172.21.15.36:0/2722472667 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f04cc019030 con 0x7f04dc0b1db0 2022-01-10T01:24:52.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.320+0000 7f04d97fa700 1 --2- 172.21.15.36:0/2722472667 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04bc053590 0x7f04bc055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:52.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.320+0000 7f04d97fa700 1 -- 172.21.15.36:0/2722472667 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f04cc06ad20 con 0x7f04dc0b1db0 2022-01-10T01:24:52.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.320+0000 7f04dbfff700 1 --2- 172.21.15.36:0/2722472667 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04bc053590 0x7f04bc055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:52.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.320+0000 7f04dbfff700 1 --2- 172.21.15.36:0/2722472667 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04bc053590 0x7f04bc055a50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f04d000b000 tx=0x7f04d0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:52.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.324+0000 7f04d97fa700 1 -- 172.21.15.36:0/2722472667 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f04cc041d30 con 0x7f04dc0b1db0 2022-01-10T01:24:52.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.488+0000 7f04e23ae700 1 -- 172.21.15.36:0/2722472667 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f04dc0b0b30 con 0x7f04dc0b1db0 2022-01-10T01:24:52.604 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:24:52.600+0000 7f0b5376f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:24:52.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.612+0000 7f04d97fa700 1 -- 172.21.15.36:0/2722472667 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f04cc045350 con 0x7f04dc0b1db0 2022-01-10T01:24:52.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.616+0000 7f04e23ae700 1 -- 172.21.15.36:0/2722472667 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04bc053590 msgr2=0x7f04bc055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:52.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.616+0000 7f04e23ae700 1 --2- 172.21.15.36:0/2722472667 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04bc053590 0x7f04bc055a50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f04d000b000 tx=0x7f04d0008040).stop 2022-01-10T01:24:52.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.616+0000 7f04e23ae700 1 -- 172.21.15.36:0/2722472667 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04dc0b1db0 msgr2=0x7f04dc14ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:52.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.616+0000 7f04e23ae700 1 --2- 172.21.15.36:0/2722472667 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04dc0b1db0 0x7f04dc14ac30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f04dc0ace60 tx=0x7f04cc007c20).stop 2022-01-10T01:24:52.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.616+0000 7f04e23ae700 1 -- 172.21.15.36:0/2722472667 shutdown_connections 2022-01-10T01:24:52.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.616+0000 7f04e23ae700 1 --2- 172.21.15.36:0/2722472667 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04bc053590 0x7f04bc055a50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.616+0000 7f04e23ae700 1 --2- 172.21.15.36:0/2722472667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04dc1483a0 0x7f04dc14b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.616+0000 7f04e23ae700 1 --2- 172.21.15.36:0/2722472667 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04dc0b1db0 0x7f04dc14ac30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.616+0000 7f04e23ae700 1 --2- 172.21.15.36:0/2722472667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04dc0a70c0 0x7f04dc149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.616+0000 7f04e23ae700 1 -- 172.21.15.36:0/2722472667 >> 172.21.15.36:0/2722472667 conn(0x7f04dc05f6b0 msgr2=0x7f04dc0b3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:52.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.616+0000 7f04e23ae700 1 -- 172.21.15.36:0/2722472667 shutdown_connections 2022-01-10T01:24:52.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.616+0000 7f04e23ae700 1 -- 172.21.15.36:0/2722472667 wait complete. 2022-01-10T01:24:52.625 INFO:teuthology.orchestra.run.smithi036.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2022-01-10T01:24:52.639 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:24:52.642 INFO:tasks.ceph.mds.c.smithi036.stdout:starting mds.c at 2022-01-10T01:24:52.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.728+0000 7f522359e700 1 Processor -- start 2022-01-10T01:24:52.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522359e700 1 -- start start 2022-01-10T01:24:52.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52240b2720 0x7f522413e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:52.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522359e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5224141790 0x7f522413e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:52.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522359e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52240aaa90 con 0x7f52240b0ff0 2022-01-10T01:24:52.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522359e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5224141c20 con 0x7f5224141790 2022-01-10T01:24:52.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5224140c90 con 0x7f52240b2720 2022-01-10T01:24:52.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f5222d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5224141790 0x7f522413e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:52.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f5221d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f52240b0ff0 0x7f5224141080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60780/0 (socket says 172.21.15.36:60780) 2022-01-10T01:24:52.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f5221d9b700 1 -- 172.21.15.36:0/3932068935 learned_addr learned my addr 172.21.15.36:0/3932068935 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:52.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522259c700 1 --2- 172.21.15.36:0/3932068935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52240b2720 0x7f522413e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:52.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522259c700 1 -- 172.21.15.36:0/3932068935 >> v2:172.21.15.36:3300/0 conn(0x7f5224141790 msgr2=0x7f522413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:52.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522259c700 1 --2- 172.21.15.36:0/3932068935 >> v2:172.21.15.36:3300/0 conn(0x7f5224141790 0x7f522413e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522259c700 1 -- 172.21.15.36:0/3932068935 >> v1:172.21.15.36:6789/0 conn(0x7f52240b0ff0 legacy=0x7f5224141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:52.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522259c700 1 -- 172.21.15.36:0/3932068935 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52240b2b00 con 0x7f52240b2720 2022-01-10T01:24:52.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f5222d9d700 1 --2- 172.21.15.36:0/3932068935 >> v2:172.21.15.36:3300/0 conn(0x7f5224141790 0x7f522413e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:52.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522259c700 1 --2- 172.21.15.36:0/3932068935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52240b2720 0x7f522413e030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f521c0032f0 tx=0x7f521c0091d0).ready entity=mon.2 client_cookie=48784fb4039176f7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:52.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522159a700 1 -- 172.21.15.36:0/3932068935 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f521c00b6c0 con 0x7f52240b2720 2022-01-10T01:24:52.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522159a700 1 -- 172.21.15.36:0/3932068935 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521c00b820 con 0x7f52240b2720 2022-01-10T01:24:52.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522159a700 1 -- 172.21.15.36:0/3932068935 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f521c00b990 con 0x7f52240b2720 2022-01-10T01:24:52.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522359e700 1 -- 172.21.15.36:0/3932068935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52240b2720 msgr2=0x7f522413e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:52.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522359e700 1 --2- 172.21.15.36:0/3932068935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52240b2720 0x7f522413e030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f521c0032f0 tx=0x7f521c0091d0).stop 2022-01-10T01:24:52.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522359e700 1 -- 172.21.15.36:0/3932068935 shutdown_connections 2022-01-10T01:24:52.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522359e700 1 --2- 172.21.15.36:0/3932068935 >> v2:172.21.15.36:3300/0 conn(0x7f5224141790 0x7f522413e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522359e700 1 --2- 172.21.15.36:0/3932068935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52240b2720 0x7f522413e030 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522359e700 1 -- 172.21.15.36:0/3932068935 >> 172.21.15.36:0/3932068935 conn(0x7f5224060180 msgr2=0x7f52240b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:52.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522359e700 1 -- 172.21.15.36:0/3932068935 shutdown_connections 2022-01-10T01:24:52.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.732+0000 7f522359e700 1 -- 172.21.15.36:0/3932068935 wait complete. 2022-01-10T01:24:52.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.736+0000 7f522359e700 1 Processor -- start 2022-01-10T01:24:52.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.736+0000 7f522359e700 1 -- start start 2022-01-10T01:24:52.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.736+0000 7f522359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52240b0ff0 0x7f5224142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:52.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.736+0000 7f522359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52240b2720 0x7f5224146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:52.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.736+0000 7f522359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5224141790 0x7f52240b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:52.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.736+0000 7f522359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52240b3550 con 0x7f52240b2720 2022-01-10T01:24:52.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.736+0000 7f522359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52240b37f0 con 0x7f52240b0ff0 2022-01-10T01:24:52.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.736+0000 7f522359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52240b3a90 con 0x7f5224141790 2022-01-10T01:24:52.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.736+0000 7f5221d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52240b2720 0x7f5224146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:52.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.736+0000 7f5221d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52240b2720 0x7f5224146740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34762/0 (socket says 172.21.15.36:34762) 2022-01-10T01:24:52.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.736+0000 7f5221d9b700 1 -- 172.21.15.36:0/3127793393 learned_addr learned my addr 172.21.15.36:0/3127793393 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:52.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.736+0000 7f522259c700 1 --2- 172.21.15.36:0/3127793393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52240b0ff0 0x7f5224142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:52.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.736+0000 7f5222d9d700 1 --2- 172.21.15.36:0/3127793393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5224141790 0x7f52240b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:52.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.740+0000 7f5221d9b700 1 -- 172.21.15.36:0/3127793393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5224141790 msgr2=0x7f52240b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:52.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.740+0000 7f5221d9b700 1 --2- 172.21.15.36:0/3127793393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5224141790 0x7f52240b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.740+0000 7f5221d9b700 1 -- 172.21.15.36:0/3127793393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52240b0ff0 msgr2=0x7f5224142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:52.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.740+0000 7f5221d9b700 1 --2- 172.21.15.36:0/3127793393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52240b0ff0 0x7f5224142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.740+0000 7f5221d9b700 1 -- 172.21.15.36:0/3127793393 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521400b180 con 0x7f52240b2720 2022-01-10T01:24:52.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.740+0000 7f5221d9b700 1 --2- 172.21.15.36:0/3127793393 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52240b2720 0x7f5224146740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f522406acd0 tx=0x7f520c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:52.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.740+0000 7f521b7fe700 1 -- 172.21.15.36:0/3127793393 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f520c0070d0 con 0x7f52240b2720 2022-01-10T01:24:52.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.740+0000 7f521b7fe700 1 -- 172.21.15.36:0/3127793393 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c007230 con 0x7f52240b2720 2022-01-10T01:24:52.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.740+0000 7f522359e700 1 -- 172.21.15.36:0/3127793393 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521c009470 con 0x7f52240b2720 2022-01-10T01:24:52.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.740+0000 7f521b7fe700 1 -- 172.21.15.36:0/3127793393 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f520c005610 con 0x7f52240b2720 2022-01-10T01:24:52.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.740+0000 7f522359e700 1 -- 172.21.15.36:0/3127793393 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52241449e0 con 0x7f52240b2720 2022-01-10T01:24:52.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.740+0000 7f522359e700 1 -- 172.21.15.36:0/3127793393 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5224057350 con 0x7f52240b2720 2022-01-10T01:24:52.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.740+0000 7f521b7fe700 1 -- 172.21.15.36:0/3127793393 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f520c010070 con 0x7f52240b2720 2022-01-10T01:24:52.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.740+0000 7f521b7fe700 1 --2- 172.21.15.36:0/3127793393 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5208053560 0x7f5208055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:52.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.744+0000 7f521b7fe700 1 -- 172.21.15.36:0/3127793393 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f520c06aee0 con 0x7f52240b2720 2022-01-10T01:24:52.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.744+0000 7f522259c700 1 --2- 172.21.15.36:0/3127793393 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5208053560 0x7f5208055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:52.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.744+0000 7f522259c700 1 --2- 172.21.15.36:0/3127793393 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5208053560 0x7f5208055a20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f521c01b000 tx=0x7f521c016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:52.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.744+0000 7f521b7fe700 1 -- 172.21.15.36:0/3127793393 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f520c041d80 con 0x7f52240b2720 2022-01-10T01:24:52.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.908+0000 7f522359e700 1 -- 172.21.15.36:0/3127793393 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52240ab760 con 0x7f52240b2720 2022-01-10T01:24:52.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.908+0000 7f521b7fe700 1 -- 172.21.15.36:0/3127793393 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2126 (secure 0 0 0) 0x7f520c0453a0 con 0x7f52240b2720 2022-01-10T01:24:52.916 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:52.916 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3870348387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3870348387},{"type":"v1","addr":"172.21.15.59:6833","nonce":3870348387}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2808909651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2808909651},{"type":"v1","addr":"172.21.15.36:6835","nonce":2808909651}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":8,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:24:25.225258+0000","modified":"2022-01-10T01:24:52.604036+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":25,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-01-10T01:24:52.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.912+0000 7f522359e700 1 -- 172.21.15.36:0/3127793393 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5208053560 msgr2=0x7f5208055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:52.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.912+0000 7f522359e700 1 --2- 172.21.15.36:0/3127793393 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5208053560 0x7f5208055a20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f521c01b000 tx=0x7f521c016000).stop 2022-01-10T01:24:52.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.912+0000 7f522359e700 1 -- 172.21.15.36:0/3127793393 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52240b2720 msgr2=0x7f5224146740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:52.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.912+0000 7f522359e700 1 --2- 172.21.15.36:0/3127793393 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52240b2720 0x7f5224146740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f522406acd0 tx=0x7f520c007c00).stop 2022-01-10T01:24:52.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.912+0000 7f522359e700 1 -- 172.21.15.36:0/3127793393 shutdown_connections 2022-01-10T01:24:52.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.912+0000 7f522359e700 1 --2- 172.21.15.36:0/3127793393 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5208053560 0x7f5208055a20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.912+0000 7f522359e700 1 --2- 172.21.15.36:0/3127793393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5224141790 0x7f52240b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.912+0000 7f522359e700 1 --2- 172.21.15.36:0/3127793393 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52240b2720 0x7f5224146740 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.912+0000 7f522359e700 1 --2- 172.21.15.36:0/3127793393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52240b0ff0 0x7f5224142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:52.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.912+0000 7f522359e700 1 -- 172.21.15.36:0/3127793393 >> 172.21.15.36:0/3127793393 conn(0x7f5224060180 msgr2=0x7f5224140190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:52.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.912+0000 7f522359e700 1 -- 172.21.15.36:0/3127793393 shutdown_connections 2022-01-10T01:24:52.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:52.912+0000 7f522359e700 1 -- 172.21.15.36:0/3127793393 wait complete. 2022-01-10T01:24:52.923 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 8 2022-01-10T01:24:52.934 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:24:53.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7654d700 1 Processor -- start 2022-01-10T01:24:53.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7654d700 1 -- start start 2022-01-10T01:24:53.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7654d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbe700b2580 0x7fbe70140050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:53.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7654d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe700ac6f0 0x7fbe70140540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:53.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7654d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe70067880 con 0x7fbe700b00e0 2022-01-10T01:24:53.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7654d700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe700ad5b0 con 0x7fbe700b2580 2022-01-10T01:24:53.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7654d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe70067b20 con 0x7fbe700ac6f0 2022-01-10T01:24:53.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7554b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbe700b2580 0x7fbe70140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:53.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7554b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbe700b2580 0x7fbe70140050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34770/0 (socket says 172.21.15.36:34770) 2022-01-10T01:24:53.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7554b700 1 -- 172.21.15.36:0/4289583563 learned_addr learned my addr 172.21.15.36:0/4289583563 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:53.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe75d4c700 1 --2- 172.21.15.36:0/4289583563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe700ac6f0 0x7fbe70140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:53.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7554b700 1 -- 172.21.15.36:0/4289583563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe700ac6f0 msgr2=0x7fbe70140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:53.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7554b700 1 --2- 172.21.15.36:0/4289583563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe700ac6f0 0x7fbe70140540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:53.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7554b700 1 -- 172.21.15.36:0/4289583563 >> v1:172.21.15.59:6789/0 conn(0x7fbe700b00e0 legacy=0x7fbe70142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:53.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7554b700 1 -- 172.21.15.36:0/4289583563 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe70146fd0 con 0x7fbe700b2580 2022-01-10T01:24:53.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe7554b700 1 --2- 172.21.15.36:0/4289583563 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe700b2580 0x7fbe70140050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fbe6c002f70 tx=0x7fbe6c006eb0).ready entity=mon.0 client_cookie=83f99f9c62d74a02 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:53.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe5ffff700 1 -- 172.21.15.36:0/4289583563 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe6c00d570 con 0x7fbe700b2580 2022-01-10T01:24:53.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe5ffff700 1 -- 172.21.15.36:0/4289583563 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c000e90 con 0x7fbe700b2580 2022-01-10T01:24:53.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.040+0000 7fbe5ffff700 1 -- 172.21.15.36:0/4289583563 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe6c00d900 con 0x7fbe700b2580 2022-01-10T01:24:53.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 -- 172.21.15.36:0/4289583563 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe700b2580 msgr2=0x7fbe70140050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:53.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 --2- 172.21.15.36:0/4289583563 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe700b2580 0x7fbe70140050 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fbe6c002f70 tx=0x7fbe6c006eb0).stop 2022-01-10T01:24:53.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 -- 172.21.15.36:0/4289583563 shutdown_connections 2022-01-10T01:24:53.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 --2- 172.21.15.36:0/4289583563 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe700ac6f0 0x7fbe70140540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:53.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 --2- 172.21.15.36:0/4289583563 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe700b2580 0x7fbe70140050 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:53.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 -- 172.21.15.36:0/4289583563 >> 172.21.15.36:0/4289583563 conn(0x7fbe70060180 msgr2=0x7fbe700b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:53.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 -- 172.21.15.36:0/4289583563 shutdown_connections 2022-01-10T01:24:53.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 -- 172.21.15.36:0/4289583563 wait complete. 2022-01-10T01:24:53.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 Processor -- start 2022-01-10T01:24:53.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 -- start start 2022-01-10T01:24:53.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe700ac6f0 0x7fbe7009ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:53.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe700b00e0 0x7fbe70152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:53.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe70152f50 0x7fbe700a9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:53.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe701524e0 con 0x7fbe700ac6f0 2022-01-10T01:24:53.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe70141050 con 0x7fbe70152f50 2022-01-10T01:24:53.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe70143090 con 0x7fbe700b00e0 2022-01-10T01:24:53.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7554b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe700ac6f0 0x7fbe7009ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:53.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7554b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe700ac6f0 0x7fbe7009ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34772/0 (socket says 172.21.15.36:34772) 2022-01-10T01:24:53.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7554b700 1 -- 172.21.15.36:0/2010726834 learned_addr learned my addr 172.21.15.36:0/2010726834 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:53.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe75d4c700 1 --2- 172.21.15.36:0/2010726834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe70152f50 0x7fbe700a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:53.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe74d4a700 1 --2- 172.21.15.36:0/2010726834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe700b00e0 0x7fbe70152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:53.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7554b700 1 -- 172.21.15.36:0/2010726834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe700b00e0 msgr2=0x7fbe70152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:53.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7554b700 1 --2- 172.21.15.36:0/2010726834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe700b00e0 0x7fbe70152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:53.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7554b700 1 -- 172.21.15.36:0/2010726834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe70152f50 msgr2=0x7fbe700a9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:53.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7554b700 1 --2- 172.21.15.36:0/2010726834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe70152f50 0x7fbe700a9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:53.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7554b700 1 -- 172.21.15.36:0/2010726834 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c00b1e0 con 0x7fbe700ac6f0 2022-01-10T01:24:53.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7554b700 1 --2- 172.21.15.36:0/2010726834 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe700ac6f0 0x7fbe7009ebf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fbe6c002f70 tx=0x7fbe6c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:53.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe5e7fc700 1 -- 172.21.15.36:0/2010726834 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe6c011690 con 0x7fbe700ac6f0 2022-01-10T01:24:53.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe5e7fc700 1 -- 172.21.15.36:0/2010726834 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c0117f0 con 0x7fbe700ac6f0 2022-01-10T01:24:53.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.044+0000 7fbe7654d700 1 -- 172.21.15.36:0/2010726834 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe70153400 con 0x7fbe700ac6f0 2022-01-10T01:24:53.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.048+0000 7fbe5e7fc700 1 -- 172.21.15.36:0/2010726834 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe6c011b50 con 0x7fbe700ac6f0 2022-01-10T01:24:53.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.048+0000 7fbe7654d700 1 -- 172.21.15.36:0/2010726834 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe701526d0 con 0x7fbe700ac6f0 2022-01-10T01:24:53.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.048+0000 7fbe7654d700 1 -- 172.21.15.36:0/2010726834 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4c003410 con 0x7fbe700ac6f0 2022-01-10T01:24:53.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.048+0000 7fbe5e7fc700 1 -- 172.21.15.36:0/2010726834 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbe6c025030 con 0x7fbe700ac6f0 2022-01-10T01:24:53.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.048+0000 7fbe5e7fc700 1 --2- 172.21.15.36:0/2010726834 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe50053560 0x7fbe50055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:53.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.048+0000 7fbe5e7fc700 1 -- 172.21.15.36:0/2010726834 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6517+0+0 (secure 0 0 0) 0x7fbe6c06c9e0 con 0x7fbe700ac6f0 2022-01-10T01:24:53.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.048+0000 7fbe74d4a700 1 --2- 172.21.15.36:0/2010726834 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe50053560 0x7fbe50055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:53.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.052+0000 7fbe74d4a700 1 --2- 172.21.15.36:0/2010726834 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe50053560 0x7fbe50055a20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fbe6000d000 tx=0x7fbe60009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:53.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.056+0000 7fbe5e7fc700 1 -- 172.21.15.36:0/2010726834 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbe6c043990 con 0x7fbe700ac6f0 2022-01-10T01:24:53.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.216+0000 7fbe7654d700 1 -- 172.21.15.36:0/2010726834 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbe4c003c40 con 0x7fbe700ac6f0 2022-01-10T01:24:53.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.624+0000 7fbe5e7fc700 1 -- 172.21.15.36:0/2010726834 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbe6c0230a0 con 0x7fbe700ac6f0 2022-01-10T01:24:53.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.628+0000 7fbe7654d700 1 -- 172.21.15.36:0/2010726834 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe50053560 msgr2=0x7fbe50055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:53.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.628+0000 7fbe7654d700 1 --2- 172.21.15.36:0/2010726834 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe50053560 0x7fbe50055a20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fbe6000d000 tx=0x7fbe60009040).stop 2022-01-10T01:24:53.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.628+0000 7fbe7654d700 1 -- 172.21.15.36:0/2010726834 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe700ac6f0 msgr2=0x7fbe7009ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:53.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.628+0000 7fbe7654d700 1 --2- 172.21.15.36:0/2010726834 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe700ac6f0 0x7fbe7009ebf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fbe6c002f70 tx=0x7fbe6c015000).stop 2022-01-10T01:24:53.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.628+0000 7fbe7654d700 1 -- 172.21.15.36:0/2010726834 shutdown_connections 2022-01-10T01:24:53.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.628+0000 7fbe7654d700 1 --2- 172.21.15.36:0/2010726834 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe50053560 0x7fbe50055a20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:53.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.628+0000 7fbe7654d700 1 --2- 172.21.15.36:0/2010726834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe70152f50 0x7fbe700a9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:53.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.628+0000 7fbe7654d700 1 --2- 172.21.15.36:0/2010726834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe700b00e0 0x7fbe70152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:53.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.628+0000 7fbe7654d700 1 --2- 172.21.15.36:0/2010726834 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe700ac6f0 0x7fbe7009ebf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:53.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.628+0000 7fbe7654d700 1 -- 172.21.15.36:0/2010726834 >> 172.21.15.36:0/2010726834 conn(0x7fbe70060180 msgr2=0x7fbe700add40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:53.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.628+0000 7fbe7654d700 1 -- 172.21.15.36:0/2010726834 shutdown_connections 2022-01-10T01:24:53.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.628+0000 7fbe7654d700 1 -- 172.21.15.36:0/2010726834 wait complete. 2022-01-10T01:24:53.648 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:24:53.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.760+0000 7f0e5d170700 1 Processor -- start 2022-01-10T01:24:53.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.760+0000 7f0e5d170700 1 -- start start 2022-01-10T01:24:53.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.760+0000 7f0e5d170700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580af780 0x7f0e58143d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:53.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.760+0000 7f0e5d170700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0e580a9f40 0x7f0e58140110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:53.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.760+0000 7f0e5d170700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e580b3880 con 0x7f0e580b34a0 2022-01-10T01:24:53.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.760+0000 7f0e5d170700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e58144260 con 0x7f0e580a9f40 2022-01-10T01:24:53.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.760+0000 7f0e5d170700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e581469b0 con 0x7f0e580af780 2022-01-10T01:24:53.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.760+0000 7f0e5759e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0e580a9f40 0x7f0e58140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:53.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580af780 0x7f0e58143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:53.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5759e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0e580a9f40 0x7f0e58140110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34786/0 (socket says 172.21.15.36:34786) 2022-01-10T01:24:53.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5759e700 1 -- 172.21.15.36:0/1139093691 learned_addr learned my addr 172.21.15.36:0/1139093691 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:53.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5759e700 1 -- 172.21.15.36:0/1139093691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580af780 msgr2=0x7f0e58143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:53.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5759e700 1 --2- 172.21.15.36:0/1139093691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580af780 0x7f0e58143d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:53.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5759e700 1 -- 172.21.15.36:0/1139093691 >> v1:172.21.15.59:6789/0 conn(0x7f0e580b34a0 legacy=0x7f0e580af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:53.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5759e700 1 -- 172.21.15.36:0/1139093691 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e58146c50 con 0x7f0e580a9f40 2022-01-10T01:24:53.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e55d9b700 1 -- 172.21.15.36:0/1139093691 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507425229 0 0) 0x7f0e580b3880 con 0x7f0e580b34a0 2022-01-10T01:24:53.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5659c700 1 --2- 172.21.15.36:0/1139093691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580af780 0x7f0e58143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:24:53.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5759e700 1 --2- 172.21.15.36:0/1139093691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e580a9f40 0x7f0e58140110 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0e500032f0 tx=0x7f0e50009290).ready entity=mon.0 client_cookie=27bf66a46eda851f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:53.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e55d9b700 1 -- 172.21.15.36:0/1139093691 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e5000b8a0 con 0x7f0e580a9f40 2022-01-10T01:24:53.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e55d9b700 1 -- 172.21.15.36:0/1139093691 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5000ba00 con 0x7f0e580a9f40 2022-01-10T01:24:53.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e55d9b700 1 -- 172.21.15.36:0/1139093691 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e5000bb70 con 0x7f0e580a9f40 2022-01-10T01:24:53.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5d170700 1 -- 172.21.15.36:0/1139093691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e580a9f40 msgr2=0x7f0e58140110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:53.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5d170700 1 --2- 172.21.15.36:0/1139093691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e580a9f40 0x7f0e58140110 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f0e500032f0 tx=0x7f0e50009290).stop 2022-01-10T01:24:53.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5d170700 1 -- 172.21.15.36:0/1139093691 shutdown_connections 2022-01-10T01:24:53.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5d170700 1 --2- 172.21.15.36:0/1139093691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e580a9f40 0x7f0e58140110 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:53.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5d170700 1 --2- 172.21.15.36:0/1139093691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580af780 0x7f0e58143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:53.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5d170700 1 -- 172.21.15.36:0/1139093691 >> 172.21.15.36:0/1139093691 conn(0x7f0e580607c0 msgr2=0x7f0e58060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:53.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5d170700 1 -- 172.21.15.36:0/1139093691 shutdown_connections 2022-01-10T01:24:53.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5d170700 1 -- 172.21.15.36:0/1139093691 wait complete. 2022-01-10T01:24:53.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5d170700 1 Processor -- start 2022-01-10T01:24:53.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.764+0000 7f0e5d170700 1 -- start start 2022-01-10T01:24:53.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5d170700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e580a9f40 0x7f0e58147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:53.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5d170700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580af780 0x7f0e581524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:53.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5d170700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e580b34a0 0x7f0e581529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:53.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5d170700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58152ec0 con 0x7f0e580b34a0 2022-01-10T01:24:53.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5d170700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58144b20 con 0x7f0e580a9f40 2022-01-10T01:24:53.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5d170700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e58145e10 con 0x7f0e580af780 2022-01-10T01:24:53.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e580b34a0 0x7f0e581529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:53.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580af780 0x7f0e581524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:53.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e580b34a0 0x7f0e581529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34792/0 (socket says 172.21.15.36:34792) 2022-01-10T01:24:53.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5759e700 1 -- 172.21.15.36:0/3479692340 learned_addr learned my addr 172.21.15.36:0/3479692340 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:53.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e56d9d700 1 --2- 172.21.15.36:0/3479692340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e580a9f40 0x7f0e58147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:53.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5659c700 1 -- 172.21.15.36:0/3479692340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e580a9f40 msgr2=0x7f0e58147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:53.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5659c700 1 --2- 172.21.15.36:0/3479692340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e580a9f40 0x7f0e58147f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:53.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5659c700 1 -- 172.21.15.36:0/3479692340 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e580b34a0 msgr2=0x7f0e581529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:53.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5659c700 1 --2- 172.21.15.36:0/3479692340 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e580b34a0 0x7f0e581529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:53.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5659c700 1 -- 172.21.15.36:0/3479692340 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4800b180 con 0x7f0e580af780 2022-01-10T01:24:53.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5659c700 1 --2- 172.21.15.36:0/3479692340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580af780 0x7f0e581524e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0e4800c000 tx=0x7f0e48006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:53.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e4ffff700 1 -- 172.21.15.36:0/3479692340 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e48010780 con 0x7f0e580af780 2022-01-10T01:24:53.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5d170700 1 -- 172.21.15.36:0/3479692340 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e50009530 con 0x7f0e580af780 2022-01-10T01:24:53.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e4ffff700 1 -- 172.21.15.36:0/3479692340 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e480108e0 con 0x7f0e580af780 2022-01-10T01:24:53.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e4ffff700 1 -- 172.21.15.36:0/3479692340 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e48010c40 con 0x7f0e580af780 2022-01-10T01:24:53.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.768+0000 7f0e5d170700 1 -- 172.21.15.36:0/3479692340 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e580b55f0 con 0x7f0e580af780 2022-01-10T01:24:53.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.772+0000 7f0e5d170700 1 -- 172.21.15.36:0/3479692340 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e580b57b0 con 0x7f0e580af780 2022-01-10T01:24:53.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.772+0000 7f0e4ffff700 1 -- 172.21.15.36:0/3479692340 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0e4801c460 con 0x7f0e580af780 2022-01-10T01:24:53.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.772+0000 7f0e4ffff700 1 --2- 172.21.15.36:0/3479692340 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e3c053590 0x7f0e3c055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:53.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.772+0000 7f0e4ffff700 1 -- 172.21.15.36:0/3479692340 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6517+0+0 (secure 0 0 0) 0x7f0e4806bee0 con 0x7f0e580af780 2022-01-10T01:24:53.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.772+0000 7f0e56d9d700 1 --2- 172.21.15.36:0/3479692340 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e3c053590 0x7f0e3c055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:53.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.772+0000 7f0e56d9d700 1 --2- 172.21.15.36:0/3479692340 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e3c053590 0x7f0e3c055a50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f0e4000d000 tx=0x7f0e40009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:53.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.784+0000 7f0e4ffff700 1 -- 172.21.15.36:0/3479692340 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0e48042d90 con 0x7f0e580af780 2022-01-10T01:24:53.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:53.912+0000 7f0e5d170700 1 -- 172.21.15.36:0/3479692340 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0e581461f0 con 0x7f0e580af780 2022-01-10T01:24:54.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.636+0000 7f0e4ffff700 1 -- 172.21.15.36:0/3479692340 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 185+0+0 (secure 0 0 0) 0x7f0e480463b0 con 0x7f0e580af780 2022-01-10T01:24:54.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.640+0000 7f0e5d170700 1 -- 172.21.15.36:0/3479692340 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e3c053590 msgr2=0x7f0e3c055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:54.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.640+0000 7f0e5d170700 1 --2- 172.21.15.36:0/3479692340 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e3c053590 0x7f0e3c055a50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f0e4000d000 tx=0x7f0e40009040).stop 2022-01-10T01:24:54.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.640+0000 7f0e5d170700 1 -- 172.21.15.36:0/3479692340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580af780 msgr2=0x7f0e581524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:54.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.640+0000 7f0e5d170700 1 --2- 172.21.15.36:0/3479692340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580af780 0x7f0e581524e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f0e4800c000 tx=0x7f0e48006df0).stop 2022-01-10T01:24:54.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.640+0000 7f0e5d170700 1 -- 172.21.15.36:0/3479692340 shutdown_connections 2022-01-10T01:24:54.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.640+0000 7f0e5d170700 1 --2- 172.21.15.36:0/3479692340 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e3c053590 0x7f0e3c055a50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:54.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.640+0000 7f0e5d170700 1 --2- 172.21.15.36:0/3479692340 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e580b34a0 0x7f0e581529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:54.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.640+0000 7f0e5d170700 1 --2- 172.21.15.36:0/3479692340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e580af780 0x7f0e581524e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:54.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.640+0000 7f0e5d170700 1 --2- 172.21.15.36:0/3479692340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e580a9f40 0x7f0e58147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:54.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.640+0000 7f0e5d170700 1 -- 172.21.15.36:0/3479692340 >> 172.21.15.36:0/3479692340 conn(0x7f0e580607c0 msgr2=0x7f0e58140080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:54.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.640+0000 7f0e5d170700 1 -- 172.21.15.36:0/3479692340 shutdown_connections 2022-01-10T01:24:54.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.640+0000 7f0e5d170700 1 -- 172.21.15.36:0/3479692340 wait complete. 2022-01-10T01:24:54.650 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:24:54.663 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2022-01-10T01:24:54.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.776+0000 7f6cf514c700 1 Processor -- start 2022-01-10T01:24:54.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.776+0000 7f6cf514c700 1 -- start start 2022-01-10T01:24:54.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.776+0000 7f6cf514c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6cf00b0710 0x7f6cf0142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:54.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.776+0000 7f6cf514c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f6cf00ace70 0x7f6cf013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:54.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf514c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf0143920 con 0x7f6cf00b30d0 2022-01-10T01:24:54.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf514c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf00b0af0 con 0x7f6cf00ace70 2022-01-10T01:24:54.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf514c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf00ae680 con 0x7f6cf00b0710 2022-01-10T01:24:54.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf494b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f6cf00ace70 0x7f6cf013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:54.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf494b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f6cf00ace70 0x7f6cf013f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34800/0 (socket says 172.21.15.36:34800) 2022-01-10T01:24:54.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf494b700 1 -- 172.21.15.36:0/296715291 learned_addr learned my addr 172.21.15.36:0/296715291 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:54.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6ceffff700 1 --2- 172.21.15.36:0/296715291 >> v2:172.21.15.59:3300/0 conn(0x7f6cf00b0710 0x7f6cf0142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:54.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf494b700 1 -- 172.21.15.36:0/296715291 >> v2:172.21.15.59:3300/0 conn(0x7f6cf00b0710 msgr2=0x7f6cf0142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:54.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf494b700 1 --2- 172.21.15.36:0/296715291 >> v2:172.21.15.59:3300/0 conn(0x7f6cf00b0710 0x7f6cf0142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:54.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf494b700 1 -- 172.21.15.36:0/296715291 >> v1:172.21.15.59:6789/0 conn(0x7f6cf00b30d0 legacy=0x7f6cf0143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:54.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf494b700 1 -- 172.21.15.36:0/296715291 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf00ae920 con 0x7f6cf00ace70 2022-01-10T01:24:54.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf494b700 1 --2- 172.21.15.36:0/296715291 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cf00ace70 0x7f6cf013f8a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f6ce80032f0 tx=0x7f6ce8009290).ready entity=mon.0 client_cookie=bd62b60941b24ab3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:54.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6ceeffd700 1 -- 172.21.15.36:0/296715291 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ce800b870 con 0x7f6cf00ace70 2022-01-10T01:24:54.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6ceeffd700 1 -- 172.21.15.36:0/296715291 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce800b9d0 con 0x7f6cf00ace70 2022-01-10T01:24:54.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6ceeffd700 1 -- 172.21.15.36:0/296715291 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ce800bb40 con 0x7f6cf00ace70 2022-01-10T01:24:54.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf514c700 1 -- 172.21.15.36:0/296715291 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cf00ace70 msgr2=0x7f6cf013f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:54.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf514c700 1 --2- 172.21.15.36:0/296715291 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cf00ace70 0x7f6cf013f8a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f6ce80032f0 tx=0x7f6ce8009290).stop 2022-01-10T01:24:54.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf514c700 1 -- 172.21.15.36:0/296715291 shutdown_connections 2022-01-10T01:24:54.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf514c700 1 --2- 172.21.15.36:0/296715291 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cf00ace70 0x7f6cf013f8a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:54.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf514c700 1 --2- 172.21.15.36:0/296715291 >> v2:172.21.15.59:3300/0 conn(0x7f6cf00b0710 0x7f6cf0142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:54.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf514c700 1 -- 172.21.15.36:0/296715291 >> 172.21.15.36:0/296715291 conn(0x7f6cf0061140 msgr2=0x7f6cf0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:54.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf514c700 1 -- 172.21.15.36:0/296715291 shutdown_connections 2022-01-10T01:24:54.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.780+0000 7f6cf514c700 1 -- 172.21.15.36:0/296715291 wait complete. 2022-01-10T01:24:54.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.784+0000 7f6cf514c700 1 Processor -- start 2022-01-10T01:24:54.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.784+0000 7f6cf514c700 1 -- start start 2022-01-10T01:24:54.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.784+0000 7f6cf514c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf00ace70 0x7f6cf01395d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:54.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cf514c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cf00b0710 0x7f6cf01563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:54.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cf514c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cf00b30d0 0x7f6cf0152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:54.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cf514c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf00a9ef0 con 0x7f6cf00b0710 2022-01-10T01:24:54.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cf514c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf0155a10 con 0x7f6cf00ace70 2022-01-10T01:24:54.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cf514c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf0155cb0 con 0x7f6cf00b30d0 2022-01-10T01:24:54.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cef7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cf00b0710 0x7f6cf01563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:54.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cef7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cf00b0710 0x7f6cf01563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34804/0 (socket says 172.21.15.36:34804) 2022-01-10T01:24:54.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cef7fe700 1 -- 172.21.15.36:0/1598993778 learned_addr learned my addr 172.21.15.36:0/1598993778 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:54.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6ceffff700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf00ace70 0x7f6cf01395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:54.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cf494b700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cf00b30d0 0x7f6cf0152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:54.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cef7fe700 1 -- 172.21.15.36:0/1598993778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cf00b30d0 msgr2=0x7f6cf0152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:54.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cef7fe700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cf00b30d0 0x7f6cf0152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:54.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cef7fe700 1 -- 172.21.15.36:0/1598993778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf00ace70 msgr2=0x7f6cf01395d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:54.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cef7fe700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf00ace70 0x7f6cf01395d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:54.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cef7fe700 1 -- 172.21.15.36:0/1598993778 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce8009530 con 0x7f6cf00b0710 2022-01-10T01:24:54.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cf494b700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cf00b30d0 0x7f6cf0152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:24:54.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6ceffff700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf00ace70 0x7f6cf01395d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:54.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cef7fe700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cf00b0710 0x7f6cf01563f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f6cf00b6a40 tx=0x7f6ce4007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:54.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6ced7fa700 1 -- 172.21.15.36:0/1598993778 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ce4007030 con 0x7f6cf00b0710 2022-01-10T01:24:54.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6ced7fa700 1 -- 172.21.15.36:0/1598993778 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4007190 con 0x7f6cf00b0710 2022-01-10T01:24:54.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6ced7fa700 1 -- 172.21.15.36:0/1598993778 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ce4006510 con 0x7f6cf00b0710 2022-01-10T01:24:54.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cf514c700 1 -- 172.21.15.36:0/1598993778 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf0155f50 con 0x7f6cf00b0710 2022-01-10T01:24:54.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cf514c700 1 -- 172.21.15.36:0/1598993778 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf0064f60 con 0x7f6cf00b0710 2022-01-10T01:24:54.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6ced7fa700 1 -- 172.21.15.36:0/1598993778 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6ce4010030 con 0x7f6cf00b0710 2022-01-10T01:24:54.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6cf514c700 1 -- 172.21.15.36:0/1598993778 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf01560e0 con 0x7f6cf00b0710 2022-01-10T01:24:54.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6ced7fa700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6cd00535f0 0x7f6cd0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:54.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6ced7fa700 1 -- 172.21.15.36:0/1598993778 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6079+0+0 (secure 0 0 0) 0x7f6ce406b520 con 0x7f6cf00b0710 2022-01-10T01:24:54.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.788+0000 7f6ceffff700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6cd00535f0 0x7f6cd0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:54.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.792+0000 7f6ceffff700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6cd00535f0 0x7f6cd0055ab0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f6ce000c000 tx=0x7f6ce0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:54.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.796+0000 7f6ced7fa700 1 -- 172.21.15.36:0/1598993778 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ce4042690 con 0x7f6cf00b0710 2022-01-10T01:24:54.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:54.928+0000 7f6cf514c700 1 -- 172.21.15.36:0/1598993778 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6cf0057350 con 0x7f6cf00b0710 2022-01-10T01:24:55.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.644+0000 7f6ced7fa700 1 -- 172.21.15.36:0/1598993778 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6ce4045cb0 con 0x7f6cf00b0710 2022-01-10T01:24:55.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.648+0000 7f6cf514c700 1 -- 172.21.15.36:0/1598993778 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6cd00535f0 msgr2=0x7f6cd0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:55.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.648+0000 7f6cf514c700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6cd00535f0 0x7f6cd0055ab0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f6ce000c000 tx=0x7f6ce0008040).stop 2022-01-10T01:24:55.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.648+0000 7f6cf514c700 1 -- 172.21.15.36:0/1598993778 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cf00b0710 msgr2=0x7f6cf01563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:55.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.648+0000 7f6cf514c700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cf00b0710 0x7f6cf01563f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f6cf00b6a40 tx=0x7f6ce4007c00).stop 2022-01-10T01:24:55.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.648+0000 7f6cf514c700 1 -- 172.21.15.36:0/1598993778 shutdown_connections 2022-01-10T01:24:55.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.648+0000 7f6cf514c700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6cd00535f0 0x7f6cd0055ab0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:55.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.648+0000 7f6cf514c700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cf00b30d0 0x7f6cf0152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:55.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.648+0000 7f6cf514c700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cf00b0710 0x7f6cf01563f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:55.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.648+0000 7f6cf514c700 1 --2- 172.21.15.36:0/1598993778 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cf00ace70 0x7f6cf01395d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:55.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.648+0000 7f6cf514c700 1 -- 172.21.15.36:0/1598993778 >> 172.21.15.36:0/1598993778 conn(0x7f6cf0061140 msgr2=0x7f6cf0142c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:55.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.648+0000 7f6cf514c700 1 -- 172.21.15.36:0/1598993778 shutdown_connections 2022-01-10T01:24:55.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.648+0000 7f6cf514c700 1 -- 172.21.15.36:0/1598993778 wait complete. 2022-01-10T01:24:55.657 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' removed 2022-01-10T01:24:55.667 INFO:tasks.ceph.mds.a:Restarting daemon 2022-01-10T01:24:55.668 INFO:tasks.ceph.mds.a:Stopping old one... 2022-01-10T01:24:55.668 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-01-10T01:24:55.668 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:24:55.669 INFO:tasks.ceph.mds.c:Restarting daemon 2022-01-10T01:24:55.669 INFO:tasks.ceph.mds.c:Stopping old one... 2022-01-10T01:24:55.669 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-01-10T01:24:55.670 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:24:55.670 INFO:tasks.ceph.mds.b:Restarting daemon 2022-01-10T01:24:55.670 INFO:tasks.ceph.mds.b:Stopping old one... 2022-01-10T01:24:55.670 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-01-10T01:24:55.671 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:24:55.678 INFO:tasks.ceph.mds.a:Stopped 2022-01-10T01:24:55.679 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-01-10T01:24:55.681 INFO:tasks.ceph.mds.a:Started 2022-01-10T01:24:55.682 DEBUG:teuthology.parallel:result is None 2022-01-10T01:24:55.683 INFO:tasks.ceph.mds.c:Stopped 2022-01-10T01:24:55.683 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-01-10T01:24:55.685 INFO:tasks.ceph.mds.b:Stopped 2022-01-10T01:24:55.685 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-01-10T01:24:55.688 INFO:tasks.ceph.mds.c:Started 2022-01-10T01:24:55.688 DEBUG:teuthology.parallel:result is None 2022-01-10T01:24:55.689 INFO:tasks.ceph.mds.b:Started 2022-01-10T01:24:55.689 DEBUG:teuthology.parallel:result is None 2022-01-10T01:24:55.690 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2022-01-10T01:24:55.748 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:24:55.764 INFO:tasks.ceph.mds.c.smithi036.stdout:starting mds.c at 2022-01-10T01:24:55.765 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:24:55.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a6bae700 1 Processor -- start 2022-01-10T01:24:55.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a6bae700 1 -- start start 2022-01-10T01:24:55.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a6bae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72a005c7d0 0x7f72a00b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:55.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a6bae700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f72a005d0b0 0x7f72a013f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:55.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a6bae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a013f880 con 0x7f72a00ace30 2022-01-10T01:24:55.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a6bae700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a0067d70 con 0x7f72a005d0b0 2022-01-10T01:24:55.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a6bae700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a005cbb0 con 0x7f72a005c7d0 2022-01-10T01:24:55.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a53ab700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f72a005d0b0 0x7f72a013f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:55.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a53ab700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f72a005d0b0 0x7f72a013f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34836/0 (socket says 172.21.15.36:34836) 2022-01-10T01:24:55.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a53ab700 1 -- 172.21.15.36:0/1778286546 learned_addr learned my addr 172.21.15.36:0/1778286546 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:55.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a5bac700 1 --2- 172.21.15.36:0/1778286546 >> v2:172.21.15.59:3300/0 conn(0x7f72a005c7d0 0x7f72a00b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:55.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a53ab700 1 -- 172.21.15.36:0/1778286546 >> v2:172.21.15.59:3300/0 conn(0x7f72a005c7d0 msgr2=0x7f72a00b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:55.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a53ab700 1 --2- 172.21.15.36:0/1778286546 >> v2:172.21.15.59:3300/0 conn(0x7f72a005c7d0 0x7f72a00b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:55.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a53ab700 1 -- 172.21.15.36:0/1778286546 >> v1:172.21.15.59:6789/0 conn(0x7f72a00ace30 legacy=0x7f72a00aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:55.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.788+0000 7f72a53ab700 1 -- 172.21.15.36:0/1778286546 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a00b1790 con 0x7f72a005d0b0 2022-01-10T01:24:55.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a53ab700 1 --2- 172.21.15.36:0/1778286546 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72a005d0b0 0x7f72a013f390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f7290002f70 tx=0x7f7290006eb0).ready entity=mon.0 client_cookie=616b30e68303c24d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:55.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a4baa700 1 -- 172.21.15.36:0/1778286546 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f729000d5c0 con 0x7f72a005d0b0 2022-01-10T01:24:55.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a4baa700 1 -- 172.21.15.36:0/1778286546 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7290000e90 con 0x7f72a005d0b0 2022-01-10T01:24:55.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a4baa700 1 -- 172.21.15.36:0/1778286546 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f729000d950 con 0x7f72a005d0b0 2022-01-10T01:24:55.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 -- 172.21.15.36:0/1778286546 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72a005d0b0 msgr2=0x7f72a013f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:55.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 --2- 172.21.15.36:0/1778286546 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72a005d0b0 0x7f72a013f390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f7290002f70 tx=0x7f7290006eb0).stop 2022-01-10T01:24:55.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 -- 172.21.15.36:0/1778286546 shutdown_connections 2022-01-10T01:24:55.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 --2- 172.21.15.36:0/1778286546 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72a005d0b0 0x7f72a013f390 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:55.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 --2- 172.21.15.36:0/1778286546 >> v2:172.21.15.59:3300/0 conn(0x7f72a005c7d0 0x7f72a00b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:55.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 -- 172.21.15.36:0/1778286546 >> 172.21.15.36:0/1778286546 conn(0x7f72a0060180 msgr2=0x7f72a00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:55.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 -- 172.21.15.36:0/1778286546 shutdown_connections 2022-01-10T01:24:55.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 -- 172.21.15.36:0/1778286546 wait complete. 2022-01-10T01:24:55.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 Processor -- start 2022-01-10T01:24:55.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 -- start start 2022-01-10T01:24:55.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72a005c7d0 0x7f72a0141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:55.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a005d0b0 0x7f72a0063a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:55.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a00ace30 0x7f72a0153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:55.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a00630a0 con 0x7f72a005c7d0 2022-01-10T01:24:55.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a0063340 con 0x7f72a005d0b0 2022-01-10T01:24:55.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a6bae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a00635e0 con 0x7f72a00ace30 2022-01-10T01:24:55.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a5bac700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72a005c7d0 0x7f72a0141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:55.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a5bac700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72a005c7d0 0x7f72a0141070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34840/0 (socket says 172.21.15.36:34840) 2022-01-10T01:24:55.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a5bac700 1 -- 172.21.15.36:0/2124654944 learned_addr learned my addr 172.21.15.36:0/2124654944 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:55.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a53ab700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a005d0b0 0x7f72a0063a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:55.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a63ad700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a00ace30 0x7f72a0153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:55.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a5bac700 1 -- 172.21.15.36:0/2124654944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a00ace30 msgr2=0x7f72a0153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:55.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a5bac700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a00ace30 0x7f72a0153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:55.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a5bac700 1 -- 172.21.15.36:0/2124654944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a005d0b0 msgr2=0x7f72a0063a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:55.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a5bac700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a005d0b0 0x7f72a0063a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:55.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a5bac700 1 -- 172.21.15.36:0/2124654944 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729000b1e0 con 0x7f72a005c7d0 2022-01-10T01:24:55.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a63ad700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a00ace30 0x7f72a0153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:55.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.792+0000 7f72a5bac700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72a005c7d0 0x7f72a0141070 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f729c00c000 tx=0x7f729c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:55.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.796+0000 7f728effd700 1 -- 172.21.15.36:0/2124654944 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f729c010780 con 0x7f72a005c7d0 2022-01-10T01:24:55.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.796+0000 7f728effd700 1 -- 172.21.15.36:0/2124654944 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c0108e0 con 0x7f72a005c7d0 2022-01-10T01:24:55.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.796+0000 7f72a6bae700 1 -- 172.21.15.36:0/2124654944 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a0153830 con 0x7f72a005c7d0 2022-01-10T01:24:55.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.796+0000 7f728effd700 1 -- 172.21.15.36:0/2124654944 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f729c010c40 con 0x7f72a005c7d0 2022-01-10T01:24:55.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.796+0000 7f72a6bae700 1 -- 172.21.15.36:0/2124654944 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a0141c00 con 0x7f72a005c7d0 2022-01-10T01:24:55.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.796+0000 7f72a6bae700 1 -- 172.21.15.36:0/2124654944 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a01539c0 con 0x7f72a005c7d0 2022-01-10T01:24:55.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.796+0000 7f728effd700 1 -- 172.21.15.36:0/2124654944 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f729c01c460 con 0x7f72a005c7d0 2022-01-10T01:24:55.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.796+0000 7f728effd700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7280053560 0x7f7280055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:55.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.796+0000 7f72a53ab700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7280053560 0x7f7280055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:55.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.796+0000 7f728effd700 1 -- 172.21.15.36:0/2124654944 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f729c06bc40 con 0x7f72a005c7d0 2022-01-10T01:24:55.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.796+0000 7f72a53ab700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7280053560 0x7f7280055a20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f729001c000 tx=0x7f7290015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:55.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.800+0000 7f728effd700 1 -- 172.21.15.36:0/2124654944 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f729c042e30 con 0x7f72a005c7d0 2022-01-10T01:24:55.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:55.936+0000 7f72a6bae700 1 -- 172.21.15.36:0/2124654944 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f72a0057350 con 0x7f72a005c7d0 2022-01-10T01:24:56.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.788+0000 7f728effd700 1 -- 172.21.15.36:0/2124654944 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f729c046450 con 0x7f72a005c7d0 2022-01-10T01:24:56.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.792+0000 7f72a6bae700 1 -- 172.21.15.36:0/2124654944 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7280053560 msgr2=0x7f7280055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:56.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.792+0000 7f72a6bae700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7280053560 0x7f7280055a20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f729001c000 tx=0x7f7290015000).stop 2022-01-10T01:24:56.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.792+0000 7f72a6bae700 1 -- 172.21.15.36:0/2124654944 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72a005c7d0 msgr2=0x7f72a0141070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:56.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.792+0000 7f72a6bae700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72a005c7d0 0x7f72a0141070 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f729c00c000 tx=0x7f729c006df0).stop 2022-01-10T01:24:56.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.792+0000 7f72a6bae700 1 -- 172.21.15.36:0/2124654944 shutdown_connections 2022-01-10T01:24:56.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.792+0000 7f72a6bae700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7280053560 0x7f7280055a20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:56.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.792+0000 7f72a6bae700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72a00ace30 0x7f72a0153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:56.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.792+0000 7f72a6bae700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72a005d0b0 0x7f72a0063a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:56.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.792+0000 7f72a6bae700 1 --2- 172.21.15.36:0/2124654944 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72a005c7d0 0x7f72a0141070 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:56.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.792+0000 7f72a6bae700 1 -- 172.21.15.36:0/2124654944 >> 172.21.15.36:0/2124654944 conn(0x7f72a0060180 msgr2=0x7f72a00aece0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:56.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.792+0000 7f72a6bae700 1 -- 172.21.15.36:0/2124654944 shutdown_connections 2022-01-10T01:24:56.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.792+0000 7f72a6bae700 1 -- 172.21.15.36:0/2124654944 wait complete. 2022-01-10T01:24:56.800 INFO:teuthology.orchestra.run.smithi036.stderr: removed all blacklist entries 2022-01-10T01:24:56.812 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2022-01-10T01:24:56.813 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2022-01-10T01:24:56.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.913+0000 7f48f0a60700 1 Processor -- start 2022-01-10T01:24:56.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.913+0000 7f48f0a60700 1 -- start start 2022-01-10T01:24:56.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.913+0000 7f48f0a60700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48ec05c7d0 0x7f48ec0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:56.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.913+0000 7f48f0a60700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48ec05d0b0 0x7f48ec13f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:56.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.913+0000 7f48f0a60700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ec13f880 con 0x7f48ec0ace30 2022-01-10T01:24:56.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.913+0000 7f48f0a60700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ec067d70 con 0x7f48ec05d0b0 2022-01-10T01:24:56.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.913+0000 7f48f0a60700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec05cbb0 con 0x7f48ec05c7d0 2022-01-10T01:24:56.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48e3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48ec05d0b0 0x7f48ec13f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:56.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48ebfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f48ec0ace30 0x7f48ec0aece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:50324/0 (socket says 172.21.15.36:50324) 2022-01-10T01:24:56.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48ebfff700 1 -- 172.21.15.36:0/483219014 learned_addr learned my addr 172.21.15.36:0/483219014 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:56.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48eb7fe700 1 --2- 172.21.15.36:0/483219014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48ec05c7d0 0x7f48ec0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:56.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48e3fff700 1 -- 172.21.15.36:0/483219014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48ec05c7d0 msgr2=0x7f48ec0b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:56.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48e3fff700 1 --2- 172.21.15.36:0/483219014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48ec05c7d0 0x7f48ec0b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:56.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48e3fff700 1 -- 172.21.15.36:0/483219014 >> v1:172.21.15.59:6789/0 conn(0x7f48ec0ace30 legacy=0x7f48ec0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:56.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48e3fff700 1 -- 172.21.15.36:0/483219014 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec0b1790 con 0x7f48ec05d0b0 2022-01-10T01:24:56.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48e3fff700 1 --2- 172.21.15.36:0/483219014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48ec05d0b0 0x7f48ec13f390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f48d4002f70 tx=0x7f48d4006e80).ready entity=mon.1 client_cookie=7b08254abb71ef20 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:56.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48eaffd700 1 -- 172.21.15.36:0/483219014 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d400b7d0 con 0x7f48ec05d0b0 2022-01-10T01:24:56.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48eaffd700 1 -- 172.21.15.36:0/483219014 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d400b930 con 0x7f48ec05d0b0 2022-01-10T01:24:56.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48eaffd700 1 -- 172.21.15.36:0/483219014 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48d400bc90 con 0x7f48ec05d0b0 2022-01-10T01:24:56.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48f0a60700 1 -- 172.21.15.36:0/483219014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48ec05d0b0 msgr2=0x7f48ec13f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:56.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48f0a60700 1 --2- 172.21.15.36:0/483219014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48ec05d0b0 0x7f48ec13f390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f48d4002f70 tx=0x7f48d4006e80).stop 2022-01-10T01:24:56.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48f0a60700 1 -- 172.21.15.36:0/483219014 shutdown_connections 2022-01-10T01:24:56.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48f0a60700 1 --2- 172.21.15.36:0/483219014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48ec05d0b0 0x7f48ec13f390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:56.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48f0a60700 1 --2- 172.21.15.36:0/483219014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48ec05c7d0 0x7f48ec0b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:56.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48f0a60700 1 -- 172.21.15.36:0/483219014 >> 172.21.15.36:0/483219014 conn(0x7f48ec060180 msgr2=0x7f48ec0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:56.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48f0a60700 1 -- 172.21.15.36:0/483219014 shutdown_connections 2022-01-10T01:24:56.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48f0a60700 1 -- 172.21.15.36:0/483219014 wait complete. 2022-01-10T01:24:56.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48f0a60700 1 Processor -- start 2022-01-10T01:24:56.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.917+0000 7f48f0a60700 1 -- start start 2022-01-10T01:24:56.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48f0a60700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48ec05c7d0 0x7f48ec0631a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:56.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48f0a60700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48ec05d0b0 0x7f48ec151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:56.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48f0a60700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48ec0ace30 0x7f48ec151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:56.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48f0a60700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec1391a0 con 0x7f48ec05c7d0 2022-01-10T01:24:56.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48f0a60700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec142b20 con 0x7f48ec05d0b0 2022-01-10T01:24:56.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48f0a60700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0ab8a0 con 0x7f48ec0ace30 2022-01-10T01:24:56.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48eb7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48ec05c7d0 0x7f48ec0631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:56.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48e3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48ec05d0b0 0x7f48ec151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:56.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48eb7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48ec05c7d0 0x7f48ec0631a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34858/0 (socket says 172.21.15.36:34858) 2022-01-10T01:24:56.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48eb7fe700 1 -- 172.21.15.36:0/398920353 learned_addr learned my addr 172.21.15.36:0/398920353 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:56.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48ebfff700 1 --2- 172.21.15.36:0/398920353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48ec0ace30 0x7f48ec151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:56.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48eb7fe700 1 -- 172.21.15.36:0/398920353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48ec0ace30 msgr2=0x7f48ec151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:56.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48eb7fe700 1 --2- 172.21.15.36:0/398920353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48ec0ace30 0x7f48ec151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:56.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48eb7fe700 1 -- 172.21.15.36:0/398920353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48ec05d0b0 msgr2=0x7f48ec151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:56.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48eb7fe700 1 --2- 172.21.15.36:0/398920353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48ec05d0b0 0x7f48ec151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:56.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48eb7fe700 1 -- 172.21.15.36:0/398920353 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d400d410 con 0x7f48ec05c7d0 2022-01-10T01:24:56.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48eb7fe700 1 --2- 172.21.15.36:0/398920353 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48ec05c7d0 0x7f48ec0631a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f48ec0ab520 tx=0x7f48dc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:56.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48e97fa700 1 -- 172.21.15.36:0/398920353 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48dc010780 con 0x7f48ec05c7d0 2022-01-10T01:24:56.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48e97fa700 1 -- 172.21.15.36:0/398920353 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48dc0108e0 con 0x7f48ec05c7d0 2022-01-10T01:24:56.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48f0a60700 1 -- 172.21.15.36:0/398920353 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ec1421c0 con 0x7f48ec05c7d0 2022-01-10T01:24:56.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48e97fa700 1 -- 172.21.15.36:0/398920353 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48dc010c40 con 0x7f48ec05c7d0 2022-01-10T01:24:56.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.921+0000 7f48f0a60700 1 -- 172.21.15.36:0/398920353 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ec066fe0 con 0x7f48ec05c7d0 2022-01-10T01:24:56.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.925+0000 7f48f0a60700 1 -- 172.21.15.36:0/398920353 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ec152130 con 0x7f48ec05c7d0 2022-01-10T01:24:56.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.925+0000 7f48e97fa700 1 -- 172.21.15.36:0/398920353 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f48dc01c460 con 0x7f48ec05c7d0 2022-01-10T01:24:56.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.925+0000 7f48e97fa700 1 --2- 172.21.15.36:0/398920353 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f48d0053620 0x7f48d0055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:56.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.925+0000 7f48e97fa700 1 -- 172.21.15.36:0/398920353 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f48dc06bb00 con 0x7f48ec05c7d0 2022-01-10T01:24:56.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.925+0000 7f48e3fff700 1 --2- 172.21.15.36:0/398920353 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f48d0053620 0x7f48d0055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:56.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.925+0000 7f48e3fff700 1 --2- 172.21.15.36:0/398920353 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f48d0053620 0x7f48d0055ae0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f48d401e000 tx=0x7f48ec0b1920).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:56.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:56.929+0000 7f48e97fa700 1 -- 172.21.15.36:0/398920353 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f48dc042d50 con 0x7f48ec05c7d0 2022-01-10T01:24:57.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.097+0000 7f48f0a60700 1 -- 172.21.15.36:0/398920353 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f48ec0b1a30 con 0x7f48ec05c7d0 2022-01-10T01:24:57.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.097+0000 7f48e97fa700 1 -- 172.21.15.36:0/398920353 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v5) v1 ==== 80+0+5621 (secure 0 0 0) 0x7f48dc046370 con 0x7f48ec05c7d0 2022-01-10T01:24:57.101 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:57.102 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:24:57.102 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_dump": [ 2022-01-10T01:24:57.102 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.102 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.a", 2022-01-10T01:24:57.103 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthuGT4IxAA5DyijS4tPjdOLn5uiLXEPg==", 2022-01-10T01:24:57.103 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.103 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:24:57.103 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:24:57.104 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:24:57.104 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:24:57.104 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.104 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.105 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.b", 2022-01-10T01:24:57.105 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthkvX0LRAAtz19usFvoObvouQeLFwicg==", 2022-01-10T01:24:57.105 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.105 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:24:57.106 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:24:57.106 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:24:57.106 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:24:57.106 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.106 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.107 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.c", 2022-01-10T01:24:57.107 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthbvUmKhAA0pVpDJO1AfsAzIHU1cAHiw==", 2022-01-10T01:24:57.108 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.108 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:24:57.108 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:24:57.108 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:24:57.108 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:24:57.109 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.109 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.109 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.109 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.0", 2022-01-10T01:24:57.110 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCWitthk4iKHRAAF7aFP+i24xFvXXm8j5GzVg==", 2022-01-10T01:24:57.110 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.110 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:24:57.110 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:24:57.110 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:24:57.111 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.111 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.111 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.1", 2022-01-10T01:24:57.112 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCZitthsKSXABAAb3IkNvlyLub89HwaPWZ1Bg==", 2022-01-10T01:24:57.112 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.112 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:24:57.112 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:24:57.113 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:24:57.113 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.113 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.2", 2022-01-10T01:24:57.114 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCbitthvNzhIBAAXkZ6FslnMl1gS/rOa7G+Vg==", 2022-01-10T01:24:57.114 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.114 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:24:57.114 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:24:57.115 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:24:57.115 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.115 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.115 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.115 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.3", 2022-01-10T01:24:57.116 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCeitth9P7EAxAA7KOCP7Rh5oN1yqCz9I6v3A==", 2022-01-10T01:24:57.116 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.116 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:24:57.116 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:24:57.116 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:24:57.117 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.117 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.117 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.4", 2022-01-10T01:24:57.118 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCjitth/L1UBxAAskxmSV0aE6CSvDFR8O/+SQ==", 2022-01-10T01:24:57.118 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.118 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:24:57.118 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:24:57.119 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:24:57.119 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.119 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.119 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.5", 2022-01-10T01:24:57.120 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQClitthMoY6JhAAeeIrCmMcm3MpDPtdLUf+2g==", 2022-01-10T01:24:57.120 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.120 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:24:57.120 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:24:57.120 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:24:57.121 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.121 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.6", 2022-01-10T01:24:57.121 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCoitthrUhlCxAAsYhU7Kj6HMo/kD0DezvITg==", 2022-01-10T01:24:57.122 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.122 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:24:57.122 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:24:57.122 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:24:57.123 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.123 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.123 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.7", 2022-01-10T01:24:57.124 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCqitthFaLrKRAAC2g1OlcV2KTtaOXsyCrIrQ==", 2022-01-10T01:24:57.124 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.124 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:24:57.124 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:24:57.125 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:24:57.125 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.125 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.125 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.126 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.0", 2022-01-10T01:24:57.126 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthKoa/NBAADjvHh99F8YOktGID9uyttg==", 2022-01-10T01:24:57.126 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.126 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:24:57.127 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow r", 2022-01-10T01:24:57.127 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow rw", 2022-01-10T01:24:57.127 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rwx" 2022-01-10T01:24:57.127 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.128 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.128 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.1", 2022-01-10T01:24:57.128 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth3x76OBAAPTrw8OUmnpEflWuB7zzaHg==", 2022-01-10T01:24:57.129 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.129 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:24:57.129 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow r", 2022-01-10T01:24:57.129 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow rw", 2022-01-10T01:24:57.129 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rwx" 2022-01-10T01:24:57.130 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.130 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.130 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.130 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.admin", 2022-01-10T01:24:57.130 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthf9dqChAADHRsoZKuozdsqb41ztuR7w==", 2022-01-10T01:24:57.131 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.131 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:24:57.131 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:24:57.131 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:24:57.132 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:24:57.132 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.132 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.132 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.133 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.bootstrap-mds", 2022-01-10T01:24:57.133 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQC1itthuj7wHxAAF1+x9zshpjQppI2+t22+xQ==", 2022-01-10T01:24:57.133 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.133 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile bootstrap-mds" 2022-01-10T01:24:57.134 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.134 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.134 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.bootstrap-mgr", 2022-01-10T01:24:57.135 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQC1itthYFvwHxAAyyGGyokEL0ZTHIeDrLtpYQ==", 2022-01-10T01:24:57.135 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.135 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile bootstrap-mgr" 2022-01-10T01:24:57.135 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.136 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.bootstrap-osd", 2022-01-10T01:24:57.136 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQC1itthCHPwHxAAlxgAzObKDCDHLngz3a8RMA==", 2022-01-10T01:24:57.137 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.137 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile bootstrap-osd" 2022-01-10T01:24:57.137 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.137 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.138 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.138 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.bootstrap-rbd", 2022-01-10T01:24:57.138 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQC1itthFIrwHxAAzGhrQ5GHuo7hp+yMD/2kyQ==", 2022-01-10T01:24:57.138 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.138 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile bootstrap-rbd" 2022-01-10T01:24:57.139 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.139 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.bootstrap-rbd-mirror", 2022-01-10T01:24:57.140 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQC1itthqafwHxAAoyRoekqeg6EwZtpk44smbQ==", 2022-01-10T01:24:57.140 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.140 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2022-01-10T01:24:57.140 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.141 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.bootstrap-rgw", 2022-01-10T01:24:57.141 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQC1itthOMDwHxAA7RUa3bKE1kH7vdMIWDt3Zg==", 2022-01-10T01:24:57.141 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.141 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile bootstrap-rgw" 2022-01-10T01:24:57.142 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.142 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.142 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.x", 2022-01-10T01:24:57.143 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth39syIRAA6pOvLWw2ADy72TWZ65MIkA==", 2022-01-10T01:24:57.143 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.143 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:24:57.143 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:24:57.144 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:24:57.144 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:24:57.144 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:24:57.144 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.y", 2022-01-10T01:24:57.145 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth4novHRAACVMjo72kOB/T7Ti/CiN27w==", 2022-01-10T01:24:57.145 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:24:57.145 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:24:57.145 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:24:57.145 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:24:57.146 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.146 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:24:57.146 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:24:57.146 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:24:57.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.097+0000 7f48f0a60700 1 -- 172.21.15.36:0/398920353 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f48d0053620 msgr2=0x7f48d0055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.097+0000 7f48f0a60700 1 --2- 172.21.15.36:0/398920353 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f48d0053620 0x7f48d0055ae0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f48d401e000 tx=0x7f48ec0b1920).stop 2022-01-10T01:24:57.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.097+0000 7f48f0a60700 1 -- 172.21.15.36:0/398920353 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48ec05c7d0 msgr2=0x7f48ec0631a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.097+0000 7f48f0a60700 1 --2- 172.21.15.36:0/398920353 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48ec05c7d0 0x7f48ec0631a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f48ec0ab520 tx=0x7f48dc006df0).stop 2022-01-10T01:24:57.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.097+0000 7f48f0a60700 1 -- 172.21.15.36:0/398920353 shutdown_connections 2022-01-10T01:24:57.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.097+0000 7f48f0a60700 1 --2- 172.21.15.36:0/398920353 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f48d0053620 0x7f48d0055ae0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.097+0000 7f48f0a60700 1 --2- 172.21.15.36:0/398920353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48ec0ace30 0x7f48ec151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.097+0000 7f48f0a60700 1 --2- 172.21.15.36:0/398920353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48ec05d0b0 0x7f48ec151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.097+0000 7f48f0a60700 1 --2- 172.21.15.36:0/398920353 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48ec05c7d0 0x7f48ec0631a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.097+0000 7f48f0a60700 1 -- 172.21.15.36:0/398920353 >> 172.21.15.36:0/398920353 conn(0x7f48ec060180 msgr2=0x7f48ec0b47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:57.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.097+0000 7f48f0a60700 1 -- 172.21.15.36:0/398920353 shutdown_connections 2022-01-10T01:24:57.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.097+0000 7f48f0a60700 1 -- 172.21.15.36:0/398920353 wait complete. 2022-01-10T01:24:57.151 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2022-01-10T01:24:57.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.257+0000 7fdb87023700 1 Processor -- start 2022-01-10T01:24:57.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.257+0000 7fdb87023700 1 -- start start 2022-01-10T01:24:57.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.257+0000 7fdb87023700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb800a8ac0 0x7fdb80152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.257+0000 7fdb87023700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb800a70c0 con 0x7fdb800b2580 2022-01-10T01:24:57.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.257+0000 7fdb87023700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb800a72f0 con 0x7fdb800b0010 2022-01-10T01:24:57.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.257+0000 7fdb87023700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800a7590 con 0x7fdb800a8ac0 2022-01-10T01:24:57.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.257+0000 7fdb86021700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fdb800b2580 0x7fdb8014ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60892/0 (socket says 172.21.15.36:60892) 2022-01-10T01:24:57.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.257+0000 7fdb86021700 1 -- 172.21.15.36:0/1880328203 learned_addr learned my addr 172.21.15.36:0/1880328203 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:57.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.257+0000 7fdb86822700 1 --2- 172.21.15.36:0/1880328203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb800a8ac0 0x7fdb80152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.257+0000 7fdb8501f700 1 -- 172.21.15.36:0/1880328203 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055368112 0 0) 0x7fdb800a70c0 con 0x7fdb800b2580 2022-01-10T01:24:57.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.257+0000 7fdb8501f700 1 -- 172.21.15.36:0/1880328203 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb68003260 con 0x7fdb800b2580 2022-01-10T01:24:57.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.257+0000 7fdb8501f700 1 -- 172.21.15.36:0/1880328203 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865284333 0 0) 0x7fdb800a72f0 con 0x7fdb800b0010 2022-01-10T01:24:57.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.257+0000 7fdb8501f700 1 -- 172.21.15.36:0/1880328203 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb800a70c0 con 0x7fdb800b0010 2022-01-10T01:24:57.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb86822700 1 -- 172.21.15.36:0/1880328203 >> v1:172.21.15.59:6789/0 conn(0x7fdb800b0010 legacy=0x7fdb800a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb86822700 1 -- 172.21.15.36:0/1880328203 >> v1:172.21.15.36:6789/0 conn(0x7fdb800b2580 legacy=0x7fdb8014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb86822700 1 -- 172.21.15.36:0/1880328203 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb800a7830 con 0x7fdb800a8ac0 2022-01-10T01:24:57.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb86822700 1 --2- 172.21.15.36:0/1880328203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb800a8ac0 0x7fdb80152be0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdb780032f0 tx=0x7fdb780091d0).ready entity=mon.2 client_cookie=83fde0481129ffbf server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:57.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb8501f700 1 -- 172.21.15.36:0/1880328203 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb7800b640 con 0x7fdb800a8ac0 2022-01-10T01:24:57.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb8501f700 1 -- 172.21.15.36:0/1880328203 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7800b7a0 con 0x7fdb800a8ac0 2022-01-10T01:24:57.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb8501f700 1 -- 172.21.15.36:0/1880328203 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb7800b910 con 0x7fdb800a8ac0 2022-01-10T01:24:57.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb87023700 1 -- 172.21.15.36:0/1880328203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb800a8ac0 msgr2=0x7fdb80152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb87023700 1 --2- 172.21.15.36:0/1880328203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb800a8ac0 0x7fdb80152be0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fdb780032f0 tx=0x7fdb780091d0).stop 2022-01-10T01:24:57.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb87023700 1 -- 172.21.15.36:0/1880328203 shutdown_connections 2022-01-10T01:24:57.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb87023700 1 --2- 172.21.15.36:0/1880328203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb800a8ac0 0x7fdb80152be0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb87023700 1 -- 172.21.15.36:0/1880328203 >> 172.21.15.36:0/1880328203 conn(0x7fdb80060180 msgr2=0x7fdb800b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:57.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb87023700 1 -- 172.21.15.36:0/1880328203 shutdown_connections 2022-01-10T01:24:57.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb87023700 1 -- 172.21.15.36:0/1880328203 wait complete. 2022-01-10T01:24:57.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb87023700 1 Processor -- start 2022-01-10T01:24:57.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.261+0000 7fdb87023700 1 -- start start 2022-01-10T01:24:57.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb87023700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb800a8ac0 0x7fdb801464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb87023700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb800b0010 0x7fdb800adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb87023700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb800b2580 0x7fdb800ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb87023700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb80156a00 con 0x7fdb800a8ac0 2022-01-10T01:24:57.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb87023700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800b4d40 con 0x7fdb800b2580 2022-01-10T01:24:57.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb87023700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800b3380 con 0x7fdb800b0010 2022-01-10T01:24:57.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb86021700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb800a8ac0 0x7fdb801464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb86021700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb800a8ac0 0x7fdb801464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34870/0 (socket says 172.21.15.36:34870) 2022-01-10T01:24:57.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb86021700 1 -- 172.21.15.36:0/271851924 learned_addr learned my addr 172.21.15.36:0/271851924 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:57.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb86822700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb800b2580 0x7fdb800ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb85820700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb800b0010 0x7fdb800adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb86021700 1 -- 172.21.15.36:0/271851924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb800b0010 msgr2=0x7fdb800adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb86021700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb800b0010 0x7fdb800adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb86021700 1 -- 172.21.15.36:0/271851924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb800b2580 msgr2=0x7fdb800ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb86021700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb800b2580 0x7fdb800ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb86021700 1 -- 172.21.15.36:0/271851924 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb78009470 con 0x7fdb800a8ac0 2022-01-10T01:24:57.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb85820700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb800b0010 0x7fdb800adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:57.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb86021700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb800a8ac0 0x7fdb801464e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fdb700011d0 tx=0x7fdb70007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:57.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb6f7fe700 1 -- 172.21.15.36:0/271851924 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb700070d0 con 0x7fdb800a8ac0 2022-01-10T01:24:57.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb6f7fe700 1 -- 172.21.15.36:0/271851924 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70007230 con 0x7fdb800a8ac0 2022-01-10T01:24:57.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb87023700 1 -- 172.21.15.36:0/271851924 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb80154640 con 0x7fdb800a8ac0 2022-01-10T01:24:57.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb6f7fe700 1 -- 172.21.15.36:0/271851924 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb70005610 con 0x7fdb800a8ac0 2022-01-10T01:24:57.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb87023700 1 -- 172.21.15.36:0/271851924 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb80146d10 con 0x7fdb800a8ac0 2022-01-10T01:24:57.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.265+0000 7fdb87023700 1 -- 172.21.15.36:0/271851924 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb800b3540 con 0x7fdb800a8ac0 2022-01-10T01:24:57.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.269+0000 7fdb6f7fe700 1 -- 172.21.15.36:0/271851924 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fdb70010070 con 0x7fdb800a8ac0 2022-01-10T01:24:57.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.269+0000 7fdb6f7fe700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdb60053620 0x7fdb60055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.269+0000 7fdb6f7fe700 1 -- 172.21.15.36:0/271851924 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fdb7006ae90 con 0x7fdb800a8ac0 2022-01-10T01:24:57.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.269+0000 7fdb85820700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdb60053620 0x7fdb60055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.269+0000 7fdb85820700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdb60053620 0x7fdb60055ae0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fdb7c00b000 tx=0x7fdb7c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:57.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.273+0000 7fdb6f7fe700 1 -- 172.21.15.36:0/271851924 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdb800b3540 con 0x7fdb800a8ac0 2022-01-10T01:24:57.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.437+0000 7fdb87023700 1 -- 172.21.15.36:0/271851924 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fdb800b3540 con 0x7fdb800a8ac0 2022-01-10T01:24:57.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.445+0000 7fdb6f7fe700 1 -- 172.21.15.36:0/271851924 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdb800b3540 con 0x7fdb800a8ac0 2022-01-10T01:24:57.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.445+0000 7fdb87023700 1 -- 172.21.15.36:0/271851924 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdb60053620 msgr2=0x7fdb60055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.445+0000 7fdb87023700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdb60053620 0x7fdb60055ae0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fdb7c00b000 tx=0x7fdb7c009040).stop 2022-01-10T01:24:57.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.445+0000 7fdb87023700 1 -- 172.21.15.36:0/271851924 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb800a8ac0 msgr2=0x7fdb801464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.445+0000 7fdb87023700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb800a8ac0 0x7fdb801464e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fdb700011d0 tx=0x7fdb70007b50).stop 2022-01-10T01:24:57.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.445+0000 7fdb87023700 1 -- 172.21.15.36:0/271851924 shutdown_connections 2022-01-10T01:24:57.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.445+0000 7fdb87023700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdb60053620 0x7fdb60055ae0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.445+0000 7fdb87023700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb800b2580 0x7fdb800ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.445+0000 7fdb87023700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb800b0010 0x7fdb800adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.445+0000 7fdb87023700 1 --2- 172.21.15.36:0/271851924 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb800a8ac0 0x7fdb801464e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.445+0000 7fdb87023700 1 -- 172.21.15.36:0/271851924 >> 172.21.15.36:0/271851924 conn(0x7fdb80060180 msgr2=0x7fdb8014b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:57.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.445+0000 7fdb87023700 1 -- 172.21.15.36:0/271851924 shutdown_connections 2022-01-10T01:24:57.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.445+0000 7fdb87023700 1 -- 172.21.15.36:0/271851924 wait complete. 2022-01-10T01:24:57.454 INFO:teuthology.orchestra.run.smithi036.stderr:updated 2022-01-10T01:24:57.462 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2022-01-10T01:24:57.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e6f6e700 1 Processor -- start 2022-01-10T01:24:57.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e6f6e700 1 -- start start 2022-01-10T01:24:57.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e6f6e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc0e00b1db0 0x7fc0e00b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e6f6e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc0e00a70c0 0x7fc0e0144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e6f6e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e00b0350 con 0x7fc0e01483a0 2022-01-10T01:24:57.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e6f6e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e00a90c0 con 0x7fc0e00a70c0 2022-01-10T01:24:57.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e6f6e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e00b05f0 con 0x7fc0e00b1db0 2022-01-10T01:24:57.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e550b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc0e00a70c0 0x7fc0e0144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e550b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc0e00a70c0 0x7fc0e0144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34882/0 (socket says 172.21.15.36:34882) 2022-01-10T01:24:57.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e550b700 1 -- 172.21.15.36:0/1902259882 learned_addr learned my addr 172.21.15.36:0/1902259882 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:57.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e4d0a700 1 --2- 172.21.15.36:0/1902259882 >> v2:172.21.15.59:3300/0 conn(0x7fc0e00b1db0 0x7fc0e00b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e550b700 1 -- 172.21.15.36:0/1902259882 >> v2:172.21.15.59:3300/0 conn(0x7fc0e00b1db0 msgr2=0x7fc0e00b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:57.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e550b700 1 --2- 172.21.15.36:0/1902259882 >> v2:172.21.15.59:3300/0 conn(0x7fc0e00b1db0 0x7fc0e00b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e550b700 1 -- 172.21.15.36:0/1902259882 >> v1:172.21.15.59:6789/0 conn(0x7fc0e01483a0 legacy=0x7fc0e00b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.561+0000 7fc0e550b700 1 -- 172.21.15.36:0/1902259882 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e00b0890 con 0x7fc0e00a70c0 2022-01-10T01:24:57.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.565+0000 7fc0e550b700 1 --2- 172.21.15.36:0/1902259882 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc0e00a70c0 0x7fc0e0144720 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fc0e0147730 tx=0x7fc0d8006eb0).ready entity=mon.0 client_cookie=129cc8911bf481a8 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:57.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.565+0000 7fc0df7fe700 1 -- 172.21.15.36:0/1902259882 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d800d610 con 0x7fc0e00a70c0 2022-01-10T01:24:57.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.565+0000 7fc0df7fe700 1 -- 172.21.15.36:0/1902259882 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d8000e90 con 0x7fc0e00a70c0 2022-01-10T01:24:57.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.565+0000 7fc0df7fe700 1 -- 172.21.15.36:0/1902259882 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d800d960 con 0x7fc0e00a70c0 2022-01-10T01:24:57.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.565+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/1902259882 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc0e00a70c0 msgr2=0x7fc0e0144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.565+0000 7fc0e6f6e700 1 --2- 172.21.15.36:0/1902259882 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc0e00a70c0 0x7fc0e0144720 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fc0e0147730 tx=0x7fc0d8006eb0).stop 2022-01-10T01:24:57.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.565+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/1902259882 shutdown_connections 2022-01-10T01:24:57.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.565+0000 7fc0e6f6e700 1 --2- 172.21.15.36:0/1902259882 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc0e00a70c0 0x7fc0e0144720 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.565+0000 7fc0e6f6e700 1 --2- 172.21.15.36:0/1902259882 >> v2:172.21.15.59:3300/0 conn(0x7fc0e00b1db0 0x7fc0e00b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.565+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/1902259882 >> 172.21.15.36:0/1902259882 conn(0x7fc0e005f6b0 msgr2=0x7fc0e005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:57.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.565+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/1902259882 shutdown_connections 2022-01-10T01:24:57.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.565+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/1902259882 wait complete. 2022-01-10T01:24:57.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e6f6e700 1 Processor -- start 2022-01-10T01:24:57.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e6f6e700 1 -- start start 2022-01-10T01:24:57.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e6f6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e00a70c0 0x7fc0e00af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e6f6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e00b1db0 0x7fc0e01571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e6f6e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc0e01483a0 0x7fc0e0157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e6f6e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e00aa0d0 con 0x7fc0e01483a0 2022-01-10T01:24:57.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e6f6e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e00a98f0 con 0x7fc0e00a70c0 2022-01-10T01:24:57.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e6f6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e00a9b90 con 0x7fc0e00b1db0 2022-01-10T01:24:57.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e550b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc0e01483a0 0x7fc0e0157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e4d0a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e00a70c0 0x7fc0e00af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e550b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc0e01483a0 0x7fc0e0157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34888/0 (socket says 172.21.15.36:34888) 2022-01-10T01:24:57.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e550b700 1 -- 172.21.15.36:0/924017208 learned_addr learned my addr 172.21.15.36:0/924017208 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:57.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0dffff700 1 --2- 172.21.15.36:0/924017208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e00b1db0 0x7fc0e01571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e550b700 1 -- 172.21.15.36:0/924017208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e00b1db0 msgr2=0x7fc0e01571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e550b700 1 --2- 172.21.15.36:0/924017208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e00b1db0 0x7fc0e01571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e550b700 1 -- 172.21.15.36:0/924017208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e00a70c0 msgr2=0x7fc0e00af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e550b700 1 --2- 172.21.15.36:0/924017208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e00a70c0 0x7fc0e00af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e550b700 1 -- 172.21.15.36:0/924017208 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d800b1e0 con 0x7fc0e01483a0 2022-01-10T01:24:57.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0dffff700 1 --2- 172.21.15.36:0/924017208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e00b1db0 0x7fc0e01571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:57.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e550b700 1 --2- 172.21.15.36:0/924017208 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc0e01483a0 0x7fc0e0157690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fc0e0147730 tx=0x7fc0d8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:57.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0ddffb700 1 -- 172.21.15.36:0/924017208 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d800d990 con 0x7fc0e01483a0 2022-01-10T01:24:57.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0ddffb700 1 -- 172.21.15.36:0/924017208 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d8002f70 con 0x7fc0e01483a0 2022-01-10T01:24:57.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/924017208 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e00a9e30 con 0x7fc0e01483a0 2022-01-10T01:24:57.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0ddffb700 1 -- 172.21.15.36:0/924017208 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d8011e20 con 0x7fc0e01483a0 2022-01-10T01:24:57.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.569+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/924017208 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e00aa540 con 0x7fc0e01483a0 2022-01-10T01:24:57.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.573+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/924017208 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e015aff0 con 0x7fc0e01483a0 2022-01-10T01:24:57.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.573+0000 7fc0ddffb700 1 -- 172.21.15.36:0/924017208 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc0d8025030 con 0x7fc0e01483a0 2022-01-10T01:24:57.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.573+0000 7fc0ddffb700 1 --2- 172.21.15.36:0/924017208 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc0c00535f0 0x7fc0c0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.573+0000 7fc0ddffb700 1 -- 172.21.15.36:0/924017208 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fc0d806ca10 con 0x7fc0e01483a0 2022-01-10T01:24:57.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.573+0000 7fc0e4d0a700 1 --2- 172.21.15.36:0/924017208 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc0c00535f0 0x7fc0c0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.573+0000 7fc0e4d0a700 1 --2- 172.21.15.36:0/924017208 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc0c00535f0 0x7fc0c0055ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc0d400c000 tx=0x7fc0d4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:57.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.581+0000 7fc0ddffb700 1 -- 172.21.15.36:0/924017208 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc0e015aff0 con 0x7fc0e01483a0 2022-01-10T01:24:57.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.753+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/924017208 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc0e015aff0 con 0x7fc0e01483a0 2022-01-10T01:24:57.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.761+0000 7fc0ddffb700 1 -- 172.21.15.36:0/924017208 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc0e015aff0 con 0x7fc0e01483a0 2022-01-10T01:24:57.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.761+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/924017208 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc0c00535f0 msgr2=0x7fc0c0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.761+0000 7fc0e6f6e700 1 --2- 172.21.15.36:0/924017208 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc0c00535f0 0x7fc0c0055ab0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc0d400c000 tx=0x7fc0d4008040).stop 2022-01-10T01:24:57.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.761+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/924017208 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc0e01483a0 msgr2=0x7fc0e0157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.761+0000 7fc0e6f6e700 1 --2- 172.21.15.36:0/924017208 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc0e01483a0 0x7fc0e0157690 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fc0e0147730 tx=0x7fc0d8015000).stop 2022-01-10T01:24:57.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.761+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/924017208 shutdown_connections 2022-01-10T01:24:57.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.761+0000 7fc0e6f6e700 1 --2- 172.21.15.36:0/924017208 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc0c00535f0 0x7fc0c0055ab0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.761+0000 7fc0e6f6e700 1 --2- 172.21.15.36:0/924017208 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc0e01483a0 0x7fc0e0157690 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.761+0000 7fc0e6f6e700 1 --2- 172.21.15.36:0/924017208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0e00b1db0 0x7fc0e01571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.761+0000 7fc0e6f6e700 1 --2- 172.21.15.36:0/924017208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0e00a70c0 0x7fc0e00af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.761+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/924017208 >> 172.21.15.36:0/924017208 conn(0x7fc0e005f6b0 msgr2=0x7fc0e0143d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:57.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.761+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/924017208 shutdown_connections 2022-01-10T01:24:57.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.761+0000 7fc0e6f6e700 1 -- 172.21.15.36:0/924017208 wait complete. 2022-01-10T01:24:57.775 INFO:teuthology.orchestra.run.smithi036.stderr:updated 2022-01-10T01:24:57.783 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2022-01-10T01:24:57.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 Processor -- start 2022-01-10T01:24:57.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 -- start start 2022-01-10T01:24:57.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85ec0a9c10 0x7f85ec0607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f85ec140140 0x7f85ec1405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ec066ea0 con 0x7f85ec0b3040 2022-01-10T01:24:57.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ec0648e0 con 0x7f85ec140140 2022-01-10T01:24:57.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec061dd0 con 0x7f85ec0a9c10 2022-01-10T01:24:57.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f229b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f85ec0b3040 0x7f85ec065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60918/0 (socket says 172.21.15.36:60918) 2022-01-10T01:24:57.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f229b700 1 -- 172.21.15.36:0/3733218024 learned_addr learned my addr 172.21.15.36:0/3733218024 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:57.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f2a9c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f85ec140140 0x7f85ec1405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f1a9a700 1 --2- 172.21.15.36:0/3733218024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85ec0a9c10 0x7f85ec0607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f1299700 1 -- 172.21.15.36:0/3733218024 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367910262 0 0) 0x7f85ec066ea0 con 0x7f85ec0b3040 2022-01-10T01:24:57.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f1299700 1 -- 172.21.15.36:0/3733218024 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d8003260 con 0x7f85ec0b3040 2022-01-10T01:24:57.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f2a9c700 1 -- 172.21.15.36:0/3733218024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85ec0a9c10 msgr2=0x7f85ec0607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:57.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f2a9c700 1 --2- 172.21.15.36:0/3733218024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85ec0a9c10 0x7f85ec0607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f2a9c700 1 -- 172.21.15.36:0/3733218024 >> v1:172.21.15.36:6789/0 conn(0x7f85ec0b3040 legacy=0x7f85ec065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f2a9c700 1 -- 172.21.15.36:0/3733218024 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec0b3420 con 0x7f85ec140140 2022-01-10T01:24:57.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f2a9c700 1 --2- 172.21.15.36:0/3733218024 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85ec140140 0x7f85ec1405d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f85e4002f70 tx=0x7f85e4006df0).ready entity=mon.0 client_cookie=fd5f3610f63429f2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:57.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f1299700 1 -- 172.21.15.36:0/3733218024 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85e400d4a0 con 0x7f85ec140140 2022-01-10T01:24:57.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f1299700 1 -- 172.21.15.36:0/3733218024 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e4000e90 con 0x7f85ec140140 2022-01-10T01:24:57.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f1299700 1 -- 172.21.15.36:0/3733218024 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85e400d830 con 0x7f85ec140140 2022-01-10T01:24:57.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 -- 172.21.15.36:0/3733218024 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85ec140140 msgr2=0x7f85ec1405d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 --2- 172.21.15.36:0/3733218024 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85ec140140 0x7f85ec1405d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f85e4002f70 tx=0x7f85e4006df0).stop 2022-01-10T01:24:57.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 -- 172.21.15.36:0/3733218024 shutdown_connections 2022-01-10T01:24:57.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 --2- 172.21.15.36:0/3733218024 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85ec140140 0x7f85ec1405d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 --2- 172.21.15.36:0/3733218024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85ec0a9c10 0x7f85ec0607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 -- 172.21.15.36:0/3733218024 >> 172.21.15.36:0/3733218024 conn(0x7f85ec0636e0 msgr2=0x7f85ec063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:57.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 -- 172.21.15.36:0/3733218024 shutdown_connections 2022-01-10T01:24:57.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.881+0000 7f85f329d700 1 -- 172.21.15.36:0/3733218024 wait complete. 2022-01-10T01:24:57.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f329d700 1 Processor -- start 2022-01-10T01:24:57.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f329d700 1 -- start start 2022-01-10T01:24:57.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f329d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0a9c10 0x7f85ec0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f329d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85ec0b3040 0x7f85ec0af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f329d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85ec140140 0x7f85ec0afb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f329d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec141fe0 con 0x7f85ec0b3040 2022-01-10T01:24:57.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f329d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec142210 con 0x7f85ec0a9c10 2022-01-10T01:24:57.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f329d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec1424b0 con 0x7f85ec140140 2022-01-10T01:24:57.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f1a9a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85ec0b3040 0x7f85ec0af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f1a9a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85ec0b3040 0x7f85ec0af610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34898/0 (socket says 172.21.15.36:34898) 2022-01-10T01:24:57.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f1a9a700 1 -- 172.21.15.36:0/1726539736 learned_addr learned my addr 172.21.15.36:0/1726539736 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:57.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f2a9c700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85ec140140 0x7f85ec0afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f229b700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0a9c10 0x7f85ec0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f1a9a700 1 -- 172.21.15.36:0/1726539736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85ec140140 msgr2=0x7f85ec0afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f1a9a700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85ec140140 0x7f85ec0afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f1a9a700 1 -- 172.21.15.36:0/1726539736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0a9c10 msgr2=0x7f85ec0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:57.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f1a9a700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0a9c10 0x7f85ec0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:57.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f1a9a700 1 -- 172.21.15.36:0/1726539736 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e400b180 con 0x7f85ec0b3040 2022-01-10T01:24:57.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f229b700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0a9c10 0x7f85ec0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:24:57.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f1a9a700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85ec0b3040 0x7f85ec0af610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f85dc00c000 tx=0x7f85dc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:57.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85eb7fe700 1 -- 172.21.15.36:0/1726539736 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85dc00c850 con 0x7f85ec0b3040 2022-01-10T01:24:57.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85eb7fe700 1 -- 172.21.15.36:0/1726539736 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc00c9b0 con 0x7f85ec0b3040 2022-01-10T01:24:57.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f329d700 1 -- 172.21.15.36:0/1726539736 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ec142750 con 0x7f85ec0b3040 2022-01-10T01:24:57.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85eb7fe700 1 -- 172.21.15.36:0/1726539736 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85dc00cd10 con 0x7f85ec0b3040 2022-01-10T01:24:57.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.885+0000 7f85f329d700 1 -- 172.21.15.36:0/1726539736 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ec0ae5c0 con 0x7f85ec0b3040 2022-01-10T01:24:57.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.889+0000 7f85f329d700 1 -- 172.21.15.36:0/1726539736 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ec066960 con 0x7f85ec0b3040 2022-01-10T01:24:57.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.889+0000 7f85eb7fe700 1 -- 172.21.15.36:0/1726539736 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f85dc0123f0 con 0x7f85ec0b3040 2022-01-10T01:24:57.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.889+0000 7f85eb7fe700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f85cc053500 0x7f85cc0559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:57.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.889+0000 7f85eb7fe700 1 -- 172.21.15.36:0/1726539736 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f85dc06bb70 con 0x7f85ec0b3040 2022-01-10T01:24:57.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.889+0000 7f85f229b700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f85cc053500 0x7f85cc0559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:57.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.889+0000 7f85f229b700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f85cc053500 0x7f85cc0559c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f85e0008000 tx=0x7f85e0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:57.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:57.893+0000 7f85eb7fe700 1 -- 172.21.15.36:0/1726539736 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f85dc042dc0 con 0x7f85ec0b3040 2022-01-10T01:24:58.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.077+0000 7f85f329d700 1 -- 172.21.15.36:0/1726539736 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f85ec057350 con 0x7f85ec0b3040 2022-01-10T01:24:58.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.081+0000 7f85eb7fe700 1 -- 172.21.15.36:0/1726539736 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f85dc0463e0 con 0x7f85ec0b3040 2022-01-10T01:24:58.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.085+0000 7f85f329d700 1 -- 172.21.15.36:0/1726539736 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f85cc053500 msgr2=0x7f85cc0559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.085+0000 7f85f329d700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f85cc053500 0x7f85cc0559c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f85e0008000 tx=0x7f85e0009040).stop 2022-01-10T01:24:58.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.085+0000 7f85f329d700 1 -- 172.21.15.36:0/1726539736 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85ec0b3040 msgr2=0x7f85ec0af610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.085+0000 7f85f329d700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85ec0b3040 0x7f85ec0af610 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f85dc00c000 tx=0x7f85dc0091d0).stop 2022-01-10T01:24:58.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.085+0000 7f85f329d700 1 -- 172.21.15.36:0/1726539736 shutdown_connections 2022-01-10T01:24:58.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.085+0000 7f85f329d700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f85cc053500 0x7f85cc0559c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.085+0000 7f85f329d700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85ec140140 0x7f85ec0afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.085+0000 7f85f329d700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85ec0b3040 0x7f85ec0af610 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.085+0000 7f85f329d700 1 --2- 172.21.15.36:0/1726539736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85ec0a9c10 0x7f85ec0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.085+0000 7f85f329d700 1 -- 172.21.15.36:0/1726539736 >> 172.21.15.36:0/1726539736 conn(0x7f85ec0636e0 msgr2=0x7f85ec0b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:58.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.085+0000 7f85f329d700 1 -- 172.21.15.36:0/1726539736 shutdown_connections 2022-01-10T01:24:58.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.085+0000 7f85f329d700 1 -- 172.21.15.36:0/1726539736 wait complete. 2022-01-10T01:24:58.094 INFO:teuthology.orchestra.run.smithi036.stderr:updated 2022-01-10T01:24:58.102 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2022-01-10T01:24:58.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94f9553700 1 Processor -- start 2022-01-10T01:24:58.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94f9553700 1 -- start start 2022-01-10T01:24:58.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94f9553700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94f40b1260 0x7f94f40afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94f9553700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f94f40b1790 0x7f94f40b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94f9553700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f40b05b0 con 0x7f94f40b2580 2022-01-10T01:24:58.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94f9553700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f40add80 con 0x7f94f40b1790 2022-01-10T01:24:58.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94f9553700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40ae020 con 0x7f94f40b1260 2022-01-10T01:24:58.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94f8d52700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f94f40b1790 0x7f94f40b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94f8d52700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f94f40b1790 0x7f94f40b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34910/0 (socket says 172.21.15.36:34910) 2022-01-10T01:24:58.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94f8d52700 1 -- 172.21.15.36:0/2067249738 learned_addr learned my addr 172.21.15.36:0/2067249738 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:58.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94eb7fe700 1 --2- 172.21.15.36:0/2067249738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94f40b1260 0x7f94f40afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94f8d52700 1 -- 172.21.15.36:0/2067249738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94f40b1260 msgr2=0x7f94f40afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:58.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94f8d52700 1 --2- 172.21.15.36:0/2067249738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94f40b1260 0x7f94f40afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94f8d52700 1 -- 172.21.15.36:0/2067249738 >> v1:172.21.15.59:6789/0 conn(0x7f94f40b2580 legacy=0x7f94f40abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.205+0000 7f94f8d52700 1 -- 172.21.15.36:0/2067249738 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f40a9390 con 0x7f94f40b1790 2022-01-10T01:24:58.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.209+0000 7f94f8d52700 1 --2- 172.21.15.36:0/2067249738 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94f40b1790 0x7f94f40b00c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f94f4067a30 tx=0x7f94ec009290).ready entity=mon.0 client_cookie=a86a544f17e385c7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:58.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.209+0000 7f94f37fe700 1 -- 172.21.15.36:0/2067249738 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94ec00b860 con 0x7f94f40b1790 2022-01-10T01:24:58.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.209+0000 7f94f37fe700 1 -- 172.21.15.36:0/2067249738 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec00b9c0 con 0x7f94f40b1790 2022-01-10T01:24:58.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.209+0000 7f94f37fe700 1 -- 172.21.15.36:0/2067249738 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94ec00bb30 con 0x7f94f40b1790 2022-01-10T01:24:58.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.209+0000 7f94f9553700 1 -- 172.21.15.36:0/2067249738 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94f40b1790 msgr2=0x7f94f40b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.209+0000 7f94f9553700 1 --2- 172.21.15.36:0/2067249738 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94f40b1790 0x7f94f40b00c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f94f4067a30 tx=0x7f94ec009290).stop 2022-01-10T01:24:58.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.209+0000 7f94f9553700 1 -- 172.21.15.36:0/2067249738 shutdown_connections 2022-01-10T01:24:58.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.209+0000 7f94f9553700 1 --2- 172.21.15.36:0/2067249738 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94f40b1790 0x7f94f40b00c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.209+0000 7f94f9553700 1 --2- 172.21.15.36:0/2067249738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94f40b1260 0x7f94f40afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.209+0000 7f94f9553700 1 -- 172.21.15.36:0/2067249738 >> 172.21.15.36:0/2067249738 conn(0x7f94f4060180 msgr2=0x7f94f40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:58.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.209+0000 7f94f9553700 1 -- 172.21.15.36:0/2067249738 shutdown_connections 2022-01-10T01:24:58.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.209+0000 7f94f9553700 1 -- 172.21.15.36:0/2067249738 wait complete. 2022-01-10T01:24:58.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.209+0000 7f94f9553700 1 Processor -- start 2022-01-10T01:24:58.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.209+0000 7f94f9553700 1 -- start start 2022-01-10T01:24:58.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f9553700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f40b1260 0x7f94f405c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f9553700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94f40b1790 0x7f94f4153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f9553700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94f40b2580 0x7f94f41541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f9553700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f41546e0 con 0x7f94f40b1790 2022-01-10T01:24:58.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f9553700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f414de70 con 0x7f94f40b1260 2022-01-10T01:24:58.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f9553700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f41538a0 con 0x7f94f40b2580 2022-01-10T01:24:58.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94eb7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94f40b1790 0x7f94f4153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94eb7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94f40b1790 0x7f94f4153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34914/0 (socket says 172.21.15.36:34914) 2022-01-10T01:24:58.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94eb7fe700 1 -- 172.21.15.36:0/2302686719 learned_addr learned my addr 172.21.15.36:0/2302686719 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:58.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f8d52700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94f40b2580 0x7f94f41541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f3fff700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f40b1260 0x7f94f405c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94eb7fe700 1 -- 172.21.15.36:0/2302686719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94f40b2580 msgr2=0x7f94f41541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94eb7fe700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94f40b2580 0x7f94f41541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94eb7fe700 1 -- 172.21.15.36:0/2302686719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f40b1260 msgr2=0x7f94f405c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94eb7fe700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f40b1260 0x7f94f405c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94eb7fe700 1 -- 172.21.15.36:0/2302686719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec009530 con 0x7f94f40b1790 2022-01-10T01:24:58.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f3fff700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f40b1260 0x7f94f405c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:58.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f8d52700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94f40b2580 0x7f94f41541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:58.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94eb7fe700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94f40b1790 0x7f94f4153d00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f94dc00c000 tx=0x7f94dc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:58.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f1ffb700 1 -- 172.21.15.36:0/2302686719 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94dc010780 con 0x7f94f40b1790 2022-01-10T01:24:58.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f1ffb700 1 -- 172.21.15.36:0/2302686719 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc0108e0 con 0x7f94f40b1790 2022-01-10T01:24:58.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f9553700 1 -- 172.21.15.36:0/2302686719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f4067070 con 0x7f94f40b1790 2022-01-10T01:24:58.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f1ffb700 1 -- 172.21.15.36:0/2302686719 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94dc010c40 con 0x7f94f40b1790 2022-01-10T01:24:58.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f9553700 1 -- 172.21.15.36:0/2302686719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f405cb20 con 0x7f94f40b1790 2022-01-10T01:24:58.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.213+0000 7f94f9553700 1 -- 172.21.15.36:0/2302686719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f4066ee0 con 0x7f94f40b1790 2022-01-10T01:24:58.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.217+0000 7f94f1ffb700 1 -- 172.21.15.36:0/2302686719 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f94dc01c460 con 0x7f94f40b1790 2022-01-10T01:24:58.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.217+0000 7f94f1ffb700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94cc0535f0 0x7f94cc055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.217+0000 7f94f1ffb700 1 -- 172.21.15.36:0/2302686719 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f94dc06ba60 con 0x7f94f40b1790 2022-01-10T01:24:58.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.217+0000 7f94f3fff700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94cc0535f0 0x7f94cc055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.217+0000 7f94f3fff700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94cc0535f0 0x7f94cc055ab0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f94e400b000 tx=0x7f94e4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:58.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.221+0000 7f94f1ffb700 1 -- 172.21.15.36:0/2302686719 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f94dc042d50 con 0x7f94f40b1790 2022-01-10T01:24:58.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.389+0000 7f94f9553700 1 -- 172.21.15.36:0/2302686719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f94f4057350 con 0x7f94f40b1790 2022-01-10T01:24:58.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.397+0000 7f94f1ffb700 1 -- 172.21.15.36:0/2302686719 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f94dc046370 con 0x7f94f40b1790 2022-01-10T01:24:58.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.397+0000 7f94f9553700 1 -- 172.21.15.36:0/2302686719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94cc0535f0 msgr2=0x7f94cc055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.397+0000 7f94f9553700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94cc0535f0 0x7f94cc055ab0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f94e400b000 tx=0x7f94e4009040).stop 2022-01-10T01:24:58.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.397+0000 7f94f9553700 1 -- 172.21.15.36:0/2302686719 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94f40b1790 msgr2=0x7f94f4153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.397+0000 7f94f9553700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94f40b1790 0x7f94f4153d00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f94dc00c000 tx=0x7f94dc006df0).stop 2022-01-10T01:24:58.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.397+0000 7f94f9553700 1 -- 172.21.15.36:0/2302686719 shutdown_connections 2022-01-10T01:24:58.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.397+0000 7f94f9553700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94cc0535f0 0x7f94cc055ab0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.397+0000 7f94f9553700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94f40b2580 0x7f94f41541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.397+0000 7f94f9553700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94f40b1790 0x7f94f4153d00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.397+0000 7f94f9553700 1 --2- 172.21.15.36:0/2302686719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94f40b1260 0x7f94f405c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.397+0000 7f94f9553700 1 -- 172.21.15.36:0/2302686719 >> 172.21.15.36:0/2302686719 conn(0x7f94f4060180 msgr2=0x7f94f413e370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:58.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.401+0000 7f94f9553700 1 -- 172.21.15.36:0/2302686719 shutdown_connections 2022-01-10T01:24:58.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.401+0000 7f94f9553700 1 -- 172.21.15.36:0/2302686719 wait complete. 2022-01-10T01:24:58.408 INFO:teuthology.orchestra.run.smithi036.stderr:updated 2022-01-10T01:24:58.416 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2022-01-10T01:24:58.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba27fff700 1 Processor -- start 2022-01-10T01:24:58.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba27fff700 1 -- start start 2022-01-10T01:24:58.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba27fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fba280ad5c0 0x7fba28061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba27fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba28140440 0x7fba281408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba27fff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba280aecf0 con 0x7fba28061320 2022-01-10T01:24:58.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba27fff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba280b6f20 con 0x7fba280ad5c0 2022-01-10T01:24:58.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba27fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba280aef20 con 0x7fba28140440 2022-01-10T01:24:58.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba267fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fba280ad5c0 0x7fba28061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba267fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fba280ad5c0 0x7fba28061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34922/0 (socket says 172.21.15.36:34922) 2022-01-10T01:24:58.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba267fc700 1 -- 172.21.15.36:0/4211740366 learned_addr learned my addr 172.21.15.36:0/4211740366 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:58.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba277fe700 1 --2- 172.21.15.36:0/4211740366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba28140440 0x7fba281408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba267fc700 1 -- 172.21.15.36:0/4211740366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba28140440 msgr2=0x7fba281408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:58.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba267fc700 1 --2- 172.21.15.36:0/4211740366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba28140440 0x7fba281408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba267fc700 1 -- 172.21.15.36:0/4211740366 >> v1:172.21.15.36:6789/0 conn(0x7fba28061320 legacy=0x7fba280b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba267fc700 1 -- 172.21.15.36:0/4211740366 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba280af1c0 con 0x7fba280ad5c0 2022-01-10T01:24:58.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba277fe700 1 --2- 172.21.15.36:0/4211740366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba28140440 0x7fba281408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:24:58.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.517+0000 7fba267fc700 1 --2- 172.21.15.36:0/4211740366 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fba280ad5c0 0x7fba28061700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fba18002f70 tx=0x7fba18006eb0).ready entity=mon.0 client_cookie=393a293c4dea9efd server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:58.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.521+0000 7fba25ffb700 1 -- 172.21.15.36:0/4211740366 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba1800d5c0 con 0x7fba280ad5c0 2022-01-10T01:24:58.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.521+0000 7fba25ffb700 1 -- 172.21.15.36:0/4211740366 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba18000e90 con 0x7fba280ad5c0 2022-01-10T01:24:58.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.521+0000 7fba25ffb700 1 -- 172.21.15.36:0/4211740366 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba1800d950 con 0x7fba280ad5c0 2022-01-10T01:24:58.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.521+0000 7fba27fff700 1 -- 172.21.15.36:0/4211740366 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fba280ad5c0 msgr2=0x7fba28061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.521+0000 7fba27fff700 1 --2- 172.21.15.36:0/4211740366 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fba280ad5c0 0x7fba28061700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fba18002f70 tx=0x7fba18006eb0).stop 2022-01-10T01:24:58.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.521+0000 7fba27fff700 1 -- 172.21.15.36:0/4211740366 shutdown_connections 2022-01-10T01:24:58.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.521+0000 7fba27fff700 1 --2- 172.21.15.36:0/4211740366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba28140440 0x7fba281408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.521+0000 7fba27fff700 1 --2- 172.21.15.36:0/4211740366 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fba280ad5c0 0x7fba28061700 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.521+0000 7fba27fff700 1 -- 172.21.15.36:0/4211740366 >> 172.21.15.36:0/4211740366 conn(0x7fba28066de0 msgr2=0x7fba280671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:58.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.521+0000 7fba27fff700 1 -- 172.21.15.36:0/4211740366 shutdown_connections 2022-01-10T01:24:58.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.521+0000 7fba27fff700 1 -- 172.21.15.36:0/4211740366 wait complete. 2022-01-10T01:24:58.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba27fff700 1 Processor -- start 2022-01-10T01:24:58.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba27fff700 1 -- start start 2022-01-10T01:24:58.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba27fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba28061320 0x7fba280ac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba27fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fba280ad5c0 0x7fba28155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba27fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba28140440 0x7fba281562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba27fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba281524b0 con 0x7fba280ad5c0 2022-01-10T01:24:58.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba27fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2805c2d0 con 0x7fba28140440 2022-01-10T01:24:58.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba27fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2809ea30 con 0x7fba28061320 2022-01-10T01:24:58.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba267fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fba280ad5c0 0x7fba28155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba267fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fba280ad5c0 0x7fba28155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34926/0 (socket says 172.21.15.36:34926) 2022-01-10T01:24:58.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba267fc700 1 -- 172.21.15.36:0/1973918305 learned_addr learned my addr 172.21.15.36:0/1973918305 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:58.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba277fe700 1 --2- 172.21.15.36:0/1973918305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba28140440 0x7fba281562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba26ffd700 1 --2- 172.21.15.36:0/1973918305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba28061320 0x7fba280ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba267fc700 1 -- 172.21.15.36:0/1973918305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba28061320 msgr2=0x7fba280ac460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba267fc700 1 --2- 172.21.15.36:0/1973918305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba28061320 0x7fba280ac460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba267fc700 1 -- 172.21.15.36:0/1973918305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba28140440 msgr2=0x7fba281562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba267fc700 1 --2- 172.21.15.36:0/1973918305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba28140440 0x7fba281562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba267fc700 1 -- 172.21.15.36:0/1973918305 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1800b1e0 con 0x7fba280ad5c0 2022-01-10T01:24:58.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba267fc700 1 --2- 172.21.15.36:0/1973918305 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fba280ad5c0 0x7fba28155e00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fba18002f70 tx=0x7fba18015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:58.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba17fff700 1 -- 172.21.15.36:0/1973918305 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba1800de80 con 0x7fba280ad5c0 2022-01-10T01:24:58.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba17fff700 1 -- 172.21.15.36:0/1973918305 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba18011b80 con 0x7fba280ad5c0 2022-01-10T01:24:58.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba27fff700 1 -- 172.21.15.36:0/1973918305 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2809ecd0 con 0x7fba280ad5c0 2022-01-10T01:24:58.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba17fff700 1 -- 172.21.15.36:0/1973918305 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba1801e460 con 0x7fba280ad5c0 2022-01-10T01:24:58.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.525+0000 7fba27fff700 1 -- 172.21.15.36:0/1973918305 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba280b3e50 con 0x7fba280ad5c0 2022-01-10T01:24:58.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.529+0000 7fba27fff700 1 -- 172.21.15.36:0/1973918305 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2809f170 con 0x7fba280ad5c0 2022-01-10T01:24:58.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.529+0000 7fba17fff700 1 -- 172.21.15.36:0/1973918305 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fba18025030 con 0x7fba280ad5c0 2022-01-10T01:24:58.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.529+0000 7fba17fff700 1 --2- 172.21.15.36:0/1973918305 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fba040534d0 0x7fba04055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.529+0000 7fba26ffd700 1 --2- 172.21.15.36:0/1973918305 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fba040534d0 0x7fba04055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.529+0000 7fba17fff700 1 -- 172.21.15.36:0/1973918305 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fba1806c970 con 0x7fba280ad5c0 2022-01-10T01:24:58.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.529+0000 7fba26ffd700 1 --2- 172.21.15.36:0/1973918305 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fba040534d0 0x7fba04055990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fba1c00d000 tx=0x7fba1c000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:58.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.537+0000 7fba17fff700 1 -- 172.21.15.36:0/1973918305 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fba18043cc0 con 0x7fba280ad5c0 2022-01-10T01:24:58.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.701+0000 7fba27fff700 1 -- 172.21.15.36:0/1973918305 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fba28156980 con 0x7fba280ad5c0 2022-01-10T01:24:58.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.709+0000 7fba17fff700 1 -- 172.21.15.36:0/1973918305 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fba18023070 con 0x7fba280ad5c0 2022-01-10T01:24:58.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.713+0000 7fba27fff700 1 -- 172.21.15.36:0/1973918305 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fba040534d0 msgr2=0x7fba04055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.713+0000 7fba27fff700 1 --2- 172.21.15.36:0/1973918305 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fba040534d0 0x7fba04055990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fba1c00d000 tx=0x7fba1c000bc0).stop 2022-01-10T01:24:58.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.713+0000 7fba27fff700 1 -- 172.21.15.36:0/1973918305 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fba280ad5c0 msgr2=0x7fba28155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.713+0000 7fba27fff700 1 --2- 172.21.15.36:0/1973918305 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fba280ad5c0 0x7fba28155e00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fba18002f70 tx=0x7fba18015000).stop 2022-01-10T01:24:58.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.713+0000 7fba27fff700 1 -- 172.21.15.36:0/1973918305 shutdown_connections 2022-01-10T01:24:58.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.713+0000 7fba27fff700 1 --2- 172.21.15.36:0/1973918305 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fba040534d0 0x7fba04055990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.713+0000 7fba27fff700 1 --2- 172.21.15.36:0/1973918305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba28140440 0x7fba281562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.713+0000 7fba27fff700 1 --2- 172.21.15.36:0/1973918305 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fba280ad5c0 0x7fba28155e00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.713+0000 7fba27fff700 1 --2- 172.21.15.36:0/1973918305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba28061320 0x7fba280ac460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.713+0000 7fba27fff700 1 -- 172.21.15.36:0/1973918305 >> 172.21.15.36:0/1973918305 conn(0x7fba28066de0 msgr2=0x7fba280b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:58.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.713+0000 7fba27fff700 1 -- 172.21.15.36:0/1973918305 shutdown_connections 2022-01-10T01:24:58.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.713+0000 7fba27fff700 1 -- 172.21.15.36:0/1973918305 wait complete. 2022-01-10T01:24:58.720 INFO:teuthology.orchestra.run.smithi036.stderr:updated 2022-01-10T01:24:58.733 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2022-01-10T01:24:58.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df8d9b700 1 Processor -- start 2022-01-10T01:24:58.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df8d9b700 1 -- start start 2022-01-10T01:24:58.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df8d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5df40b6290 0x7f5df4061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df8d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df4142e60 0x7f5df4143310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df8d9b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df40b5f50 con 0x7f5df40b4060 2022-01-10T01:24:58.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df8d9b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df40b1f70 con 0x7f5df40b6290 2022-01-10T01:24:58.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df8d9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40b2210 con 0x7f5df4142e60 2022-01-10T01:24:58.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df37fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5df40b6290 0x7f5df4061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df37fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5df40b6290 0x7f5df4061470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34936/0 (socket says 172.21.15.36:34936) 2022-01-10T01:24:58.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df37fe700 1 -- 172.21.15.36:0/2673589568 learned_addr learned my addr 172.21.15.36:0/2673589568 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:58.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df3fff700 1 --2- 172.21.15.36:0/2673589568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df4142e60 0x7f5df4143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df37fe700 1 -- 172.21.15.36:0/2673589568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df4142e60 msgr2=0x7f5df4143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:58.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df37fe700 1 --2- 172.21.15.36:0/2673589568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df4142e60 0x7f5df4143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df37fe700 1 -- 172.21.15.36:0/2673589568 >> v1:172.21.15.59:6789/0 conn(0x7f5df40b4060 legacy=0x7f5df4061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df27fc700 1 -- 172.21.15.36:0/2673589568 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651436741 0 0) 0x7f5ddc001110 con 0x7f5df40b4060 2022-01-10T01:24:58.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df37fe700 1 -- 172.21.15.36:0/2673589568 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df40b24b0 con 0x7f5df40b6290 2022-01-10T01:24:58.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df37fe700 1 --2- 172.21.15.36:0/2673589568 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5df40b6290 0x7f5df4061470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f5de4002f70 tx=0x7f5de4006eb0).ready entity=mon.0 client_cookie=2dd7e5c63afd6f8e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:58.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df27fc700 1 -- 172.21.15.36:0/2673589568 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5de400d570 con 0x7f5df40b6290 2022-01-10T01:24:58.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df27fc700 1 -- 172.21.15.36:0/2673589568 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de4000e90 con 0x7f5df40b6290 2022-01-10T01:24:58.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df27fc700 1 -- 172.21.15.36:0/2673589568 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5de400d8c0 con 0x7f5df40b6290 2022-01-10T01:24:58.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df8d9b700 1 -- 172.21.15.36:0/2673589568 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5df40b6290 msgr2=0x7f5df4061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.837+0000 7f5df8d9b700 1 --2- 172.21.15.36:0/2673589568 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5df40b6290 0x7f5df4061470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f5de4002f70 tx=0x7f5de4006eb0).stop 2022-01-10T01:24:58.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df8d9b700 1 -- 172.21.15.36:0/2673589568 shutdown_connections 2022-01-10T01:24:58.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df8d9b700 1 --2- 172.21.15.36:0/2673589568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df4142e60 0x7f5df4143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df8d9b700 1 --2- 172.21.15.36:0/2673589568 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5df40b6290 0x7f5df4061470 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df8d9b700 1 -- 172.21.15.36:0/2673589568 >> 172.21.15.36:0/2673589568 conn(0x7f5df405c490 msgr2=0x7f5df405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:58.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df8d9b700 1 -- 172.21.15.36:0/2673589568 shutdown_connections 2022-01-10T01:24:58.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df8d9b700 1 -- 172.21.15.36:0/2673589568 wait complete. 2022-01-10T01:24:58.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df8d9b700 1 Processor -- start 2022-01-10T01:24:58.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df8d9b700 1 -- start start 2022-01-10T01:24:58.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df8d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df40b4060 0x7f5df40b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df8d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5df40b6290 0x7f5df412ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df8d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df4142e60 0x7f5df412b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df8d9b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df413f3d0 con 0x7f5df40b6290 2022-01-10T01:24:58.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df8d9b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df40b6ee0 con 0x7f5df40b4060 2022-01-10T01:24:58.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df8d9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df413fcd0 con 0x7f5df4142e60 2022-01-10T01:24:58.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.841+0000 7f5df2ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5df40b6290 0x7f5df412ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df2ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5df40b6290 0x7f5df412ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34942/0 (socket says 172.21.15.36:34942) 2022-01-10T01:24:58.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df2ffd700 1 -- 172.21.15.36:0/3605847811 learned_addr learned my addr 172.21.15.36:0/3605847811 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:58.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df37fe700 1 --2- 172.21.15.36:0/3605847811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df40b4060 0x7f5df40b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df3fff700 1 --2- 172.21.15.36:0/3605847811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df4142e60 0x7f5df412b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df2ffd700 1 -- 172.21.15.36:0/3605847811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df4142e60 msgr2=0x7f5df412b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df2ffd700 1 --2- 172.21.15.36:0/3605847811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df4142e60 0x7f5df412b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df2ffd700 1 -- 172.21.15.36:0/3605847811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df40b4060 msgr2=0x7f5df40b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:58.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df2ffd700 1 --2- 172.21.15.36:0/3605847811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df40b4060 0x7f5df40b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:58.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df2ffd700 1 -- 172.21.15.36:0/3605847811 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de400b1e0 con 0x7f5df40b6290 2022-01-10T01:24:58.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df2ffd700 1 --2- 172.21.15.36:0/3605847811 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5df40b6290 0x7f5df412ad40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f5ddc000ed0 tx=0x7f5ddc001810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:58.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df0ff9700 1 -- 172.21.15.36:0/3605847811 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ddc012400 con 0x7f5df40b6290 2022-01-10T01:24:58.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df0ff9700 1 -- 172.21.15.36:0/3605847811 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc012560 con 0x7f5df40b6290 2022-01-10T01:24:58.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df8d9b700 1 -- 172.21.15.36:0/3605847811 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df413f600 con 0x7f5df40b6290 2022-01-10T01:24:58.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df0ff9700 1 -- 172.21.15.36:0/3605847811 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ddc0128c0 con 0x7f5df40b6290 2022-01-10T01:24:58.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df8d9b700 1 -- 172.21.15.36:0/3605847811 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df40b02f0 con 0x7f5df40b6290 2022-01-10T01:24:58.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df8d9b700 1 -- 172.21.15.36:0/3605847811 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df413fe10 con 0x7f5df40b6290 2022-01-10T01:24:58.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df0ff9700 1 -- 172.21.15.36:0/3605847811 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5ddc019030 con 0x7f5df40b6290 2022-01-10T01:24:58.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df0ff9700 1 --2- 172.21.15.36:0/3605847811 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5dcc0534d0 0x7f5dcc055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:58.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df37fe700 1 --2- 172.21.15.36:0/3605847811 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5dcc0534d0 0x7f5dcc055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:58.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.845+0000 7f5df0ff9700 1 -- 172.21.15.36:0/3605847811 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f5ddc06ab70 con 0x7f5df40b6290 2022-01-10T01:24:58.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.849+0000 7f5df37fe700 1 --2- 172.21.15.36:0/3605847811 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5dcc0534d0 0x7f5dcc055990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f5de401a000 tx=0x7f5de4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:58.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:58.849+0000 7f5df0ff9700 1 -- 172.21.15.36:0/3605847811 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ddc041db0 con 0x7f5df40b6290 2022-01-10T01:24:59.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.017+0000 7f5df8d9b700 1 -- 172.21.15.36:0/3605847811 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f5df40b5f50 con 0x7f5df40b6290 2022-01-10T01:24:59.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.021+0000 7f5df0ff9700 1 -- 172.21.15.36:0/3605847811 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5df40b5f50 con 0x7f5df40b6290 2022-01-10T01:24:59.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.025+0000 7f5df8d9b700 1 -- 172.21.15.36:0/3605847811 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5dcc0534d0 msgr2=0x7f5dcc055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.025+0000 7f5df8d9b700 1 --2- 172.21.15.36:0/3605847811 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5dcc0534d0 0x7f5dcc055990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f5de401a000 tx=0x7f5de4015000).stop 2022-01-10T01:24:59.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.025+0000 7f5df8d9b700 1 -- 172.21.15.36:0/3605847811 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5df40b6290 msgr2=0x7f5df412ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.025+0000 7f5df8d9b700 1 --2- 172.21.15.36:0/3605847811 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5df40b6290 0x7f5df412ad40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f5ddc000ed0 tx=0x7f5ddc001810).stop 2022-01-10T01:24:59.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.025+0000 7f5df8d9b700 1 -- 172.21.15.36:0/3605847811 shutdown_connections 2022-01-10T01:24:59.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.025+0000 7f5df8d9b700 1 --2- 172.21.15.36:0/3605847811 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5dcc0534d0 0x7f5dcc055990 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.025+0000 7f5df8d9b700 1 --2- 172.21.15.36:0/3605847811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5df4142e60 0x7f5df412b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.025+0000 7f5df8d9b700 1 --2- 172.21.15.36:0/3605847811 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5df40b6290 0x7f5df412ad40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.025+0000 7f5df8d9b700 1 --2- 172.21.15.36:0/3605847811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df40b4060 0x7f5df40b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.025+0000 7f5df8d9b700 1 -- 172.21.15.36:0/3605847811 >> 172.21.15.36:0/3605847811 conn(0x7f5df405c490 msgr2=0x7f5df4142380 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:59.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.025+0000 7f5df8d9b700 1 -- 172.21.15.36:0/3605847811 shutdown_connections 2022-01-10T01:24:59.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.025+0000 7f5df8d9b700 1 -- 172.21.15.36:0/3605847811 wait complete. 2022-01-10T01:24:59.034 INFO:teuthology.orchestra.run.smithi036.stderr:updated 2022-01-10T01:24:59.043 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:24:59.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.141+0000 7fddaac4e700 1 Processor -- start 2022-01-10T01:24:59.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.141+0000 7fddaac4e700 1 -- start start 2022-01-10T01:24:59.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fddaac4e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdda40b0fd0 0x7fdda4144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fddaac4e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda40b0350 con 0x7fdda41483a0 2022-01-10T01:24:59.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fddaac4e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda40b05f0 con 0x7fdda40b1db0 2022-01-10T01:24:59.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fddaac4e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda40a90c0 con 0x7fdda40b0fd0 2022-01-10T01:24:59.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda3fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fdda41483a0 0x7fdda40a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60974/0 (socket says 172.21.15.36:60974) 2022-01-10T01:24:59.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda3fff700 1 -- 172.21.15.36:0/285355955 learned_addr learned my addr 172.21.15.36:0/285355955 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:59.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda91eb700 1 --2- 172.21.15.36:0/285355955 >> v2:172.21.15.59:3300/0 conn(0x7fdda40b0fd0 0x7fdda4144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 -- 172.21.15.36:0/285355955 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73672378 0 0) 0x7fdda40b0350 con 0x7fdda41483a0 2022-01-10T01:24:59.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 -- 172.21.15.36:0/285355955 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd90003260 con 0x7fdda41483a0 2022-01-10T01:24:59.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 -- 172.21.15.36:0/285355955 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2436641563 0 0) 0x7fdd90003260 con 0x7fdda41483a0 2022-01-10T01:24:59.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 -- 172.21.15.36:0/285355955 >> v2:172.21.15.59:3300/0 conn(0x7fdda40b0fd0 msgr2=0x7fdda4144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:59.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 --2- 172.21.15.36:0/285355955 >> v2:172.21.15.59:3300/0 conn(0x7fdda40b0fd0 0x7fdda4144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 -- 172.21.15.36:0/285355955 >> v1:172.21.15.59:6789/0 conn(0x7fdda40b1db0 legacy=0x7fdda40b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 -- 172.21.15.36:0/285355955 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda40b0890 con 0x7fdda41483a0 2022-01-10T01:24:59.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 -- 172.21.15.36:0/285355955 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fdd94001660 con 0x7fdda41483a0 2022-01-10T01:24:59.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 -- 172.21.15.36:0/285355955 >> v1:172.21.15.36:6789/0 conn(0x7fdda41483a0 legacy=0x7fdda40a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 --2- 172.21.15.36:0/285355955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd90003750 0x7fdd90003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 --2- 172.21.15.36:0/285355955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd90004500 0x7fdd90004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 --2- 172.21.15.36:0/285355955 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd90004e70 0x7fdd9000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 -- 172.21.15.36:0/285355955 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9000bcf0 con 0x7fdd90004e70 2022-01-10T01:24:59.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 -- 172.21.15.36:0/285355955 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9000be60 con 0x7fdd90003750 2022-01-10T01:24:59.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 -- 172.21.15.36:0/285355955 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9000c020 con 0x7fdd90004500 2022-01-10T01:24:59.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda91eb700 1 --2- 172.21.15.36:0/285355955 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd90004e70 0x7fdd9000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda89ea700 1 --2- 172.21.15.36:0/285355955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd90003750 0x7fdd90003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda3fff700 1 --2- 172.21.15.36:0/285355955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd90004500 0x7fdd90004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda91eb700 1 -- 172.21.15.36:0/285355955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd90004500 msgr2=0x7fdd90004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:59.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda91eb700 1 --2- 172.21.15.36:0/285355955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd90004500 0x7fdd90004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda91eb700 1 -- 172.21.15.36:0/285355955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd90003750 msgr2=0x7fdd90003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:59.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda91eb700 1 --2- 172.21.15.36:0/285355955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd90003750 0x7fdd90003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda91eb700 1 -- 172.21.15.36:0/285355955 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd90003260 con 0x7fdd90004e70 2022-01-10T01:24:59.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda91eb700 1 -- 172.21.15.36:0/285355955 reap_dead start 2022-01-10T01:24:59.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda91eb700 1 --2- 172.21.15.36:0/285355955 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd90004e70 0x7fdd9000b750 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fdd9c00c000 tx=0x7fdd9c0091d0).ready entity=mon.0 client_cookie=17d0c3d9b6918519 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:59.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 -- 172.21.15.36:0/285355955 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9c00e7e0 con 0x7fdd90004e70 2022-01-10T01:24:59.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 -- 172.21.15.36:0/285355955 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c00e940 con 0x7fdd90004e70 2022-01-10T01:24:59.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fdda37fe700 1 -- 172.21.15.36:0/285355955 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd9c00eca0 con 0x7fdd90004e70 2022-01-10T01:24:59.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fddaac4e700 1 -- 172.21.15.36:0/285355955 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd90004e70 msgr2=0x7fdd9000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fddaac4e700 1 --2- 172.21.15.36:0/285355955 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd90004e70 0x7fdd9000b750 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fdd9c00c000 tx=0x7fdd9c0091d0).stop 2022-01-10T01:24:59.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fddaac4e700 1 -- 172.21.15.36:0/285355955 shutdown_connections 2022-01-10T01:24:59.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fddaac4e700 1 --2- 172.21.15.36:0/285355955 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd90004e70 0x7fdd9000b750 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fddaac4e700 1 -- 172.21.15.36:0/285355955 >> 172.21.15.36:0/285355955 conn(0x7fdda405f6b0 msgr2=0x7fdda405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:59.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fddaac4e700 1 -- 172.21.15.36:0/285355955 shutdown_connections 2022-01-10T01:24:59.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.145+0000 7fddaac4e700 1 -- 172.21.15.36:0/285355955 wait complete. 2022-01-10T01:24:59.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.149+0000 7fddaac4e700 1 Processor -- start 2022-01-10T01:24:59.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.149+0000 7fddaac4e700 1 -- start start 2022-01-10T01:24:59.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.149+0000 7fddaac4e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd90004e70 0x7fdda40ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.149+0000 7fddaac4e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda414b300 0x7fdda4148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.149+0000 7fddaac4e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdda414b780 0x7fdda4148f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.149+0000 7fddaac4e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda414a040 con 0x7fdd90004e70 2022-01-10T01:24:59.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.149+0000 7fddaac4e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda414a2e0 con 0x7fdda414b300 2022-01-10T01:24:59.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.149+0000 7fddaac4e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda414a580 con 0x7fdda414b780 2022-01-10T01:24:59.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.149+0000 7fdda89ea700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd90004e70 0x7fdda40ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.149+0000 7fdda89ea700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd90004e70 0x7fdda40ae130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34960/0 (socket says 172.21.15.36:34960) 2022-01-10T01:24:59.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.149+0000 7fdda89ea700 1 -- 172.21.15.36:0/3880150256 learned_addr learned my addr 172.21.15.36:0/3880150256 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:59.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda3fff700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda414b300 0x7fdda4148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda91eb700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdda414b780 0x7fdda4148f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda89ea700 1 -- 172.21.15.36:0/3880150256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdda414b780 msgr2=0x7fdda4148f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda89ea700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdda414b780 0x7fdda4148f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda89ea700 1 -- 172.21.15.36:0/3880150256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda414b300 msgr2=0x7fdda4148a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda89ea700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda414b300 0x7fdda4148a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda89ea700 1 -- 172.21.15.36:0/3880150256 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda4149ca0 con 0x7fdd90004e70 2022-01-10T01:24:59.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda3fff700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda414b300 0x7fdda4148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:59.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda91eb700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdda414b780 0x7fdda4148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:24:59.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda89ea700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd90004e70 0x7fdda40ae130 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fdd9800d000 tx=0x7fdd98007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:59.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda1ffb700 1 -- 172.21.15.36:0/3880150256 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd980114c0 con 0x7fdd90004e70 2022-01-10T01:24:59.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda1ffb700 1 -- 172.21.15.36:0/3880150256 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd98011620 con 0x7fdd90004e70 2022-01-10T01:24:59.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fddaac4e700 1 -- 172.21.15.36:0/3880150256 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda4149460 con 0x7fdd90004e70 2022-01-10T01:24:59.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda1ffb700 1 -- 172.21.15.36:0/3880150256 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd98011980 con 0x7fdd90004e70 2022-01-10T01:24:59.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fddaac4e700 1 -- 172.21.15.36:0/3880150256 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda415a010 con 0x7fdd90004e70 2022-01-10T01:24:59.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fddaac4e700 1 -- 172.21.15.36:0/3880150256 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda40b0b30 con 0x7fdd90004e70 2022-01-10T01:24:59.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda1ffb700 1 -- 172.21.15.36:0/3880150256 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fdd9801a030 con 0x7fdd90004e70 2022-01-10T01:24:59.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda1ffb700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd840536b0 0x7fdd84055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda3fff700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd840536b0 0x7fdd84055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda1ffb700 1 -- 172.21.15.36:0/3880150256 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fdd9806b000 con 0x7fdd90004e70 2022-01-10T01:24:59.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.153+0000 7fdda3fff700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd840536b0 0x7fdd84055b70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fdd9400d000 tx=0x7fdd94009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:59.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.157+0000 7fdda1ffb700 1 -- 172.21.15.36:0/3880150256 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd98042400 con 0x7fdd90004e70 2022-01-10T01:24:59.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.281+0000 7fddaac4e700 1 -- 172.21.15.36:0/3880150256 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdda4057350 con 0x7fdd90004e70 2022-01-10T01:24:59.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.285+0000 7fdda1ffb700 1 -- 172.21.15.36:0/3880150256 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+13414 (secure 0 0 0) 0x7fdd98025480 con 0x7fdd90004e70 2022-01-10T01:24:59.289 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:24:59.290 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":29,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:24:56.779462+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:24:59.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.285+0000 7fddaac4e700 1 -- 172.21.15.36:0/3880150256 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd840536b0 msgr2=0x7fdd84055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.285+0000 7fddaac4e700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd840536b0 0x7fdd84055b70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fdd9400d000 tx=0x7fdd94009040).stop 2022-01-10T01:24:59.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.285+0000 7fddaac4e700 1 -- 172.21.15.36:0/3880150256 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd90004e70 msgr2=0x7fdda40ae130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.285+0000 7fddaac4e700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd90004e70 0x7fdda40ae130 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fdd9800d000 tx=0x7fdd98007a00).stop 2022-01-10T01:24:59.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.285+0000 7fddaac4e700 1 -- 172.21.15.36:0/3880150256 shutdown_connections 2022-01-10T01:24:59.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.285+0000 7fddaac4e700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd840536b0 0x7fdd84055b70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.285+0000 7fddaac4e700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdda414b780 0x7fdda4148f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.285+0000 7fddaac4e700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda414b300 0x7fdda4148a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.285+0000 7fddaac4e700 1 --2- 172.21.15.36:0/3880150256 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd90004e70 0x7fdda40ae130 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.285+0000 7fddaac4e700 1 -- 172.21.15.36:0/3880150256 >> 172.21.15.36:0/3880150256 conn(0x7fdda405f6b0 msgr2=0x7fdda40b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:59.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.285+0000 7fddaac4e700 1 -- 172.21.15.36:0/3880150256 shutdown_connections 2022-01-10T01:24:59.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.285+0000 7fddaac4e700 1 -- 172.21.15.36:0/3880150256 wait complete. 2022-01-10T01:24:59.303 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-01-10T01:24:59.304 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:24:59.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.409+0000 7fe384bb5700 1 Processor -- start 2022-01-10T01:24:59.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.409+0000 7fe384bb5700 1 -- start start 2022-01-10T01:24:59.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.409+0000 7fe384bb5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe380146950 0x7fe380140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.409+0000 7fe384bb5700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe380143b60 con 0x7fe3800b4180 2022-01-10T01:24:59.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.409+0000 7fe384bb5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe380143e00 con 0x7fe3800b4690 2022-01-10T01:24:59.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.409+0000 7fe384bb5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe380147510 con 0x7fe380146950 2022-01-10T01:24:59.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37dd9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe3800b4180 0x7fe380140720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:60998/0 (socket says 172.21.15.36:60998) 2022-01-10T01:24:59.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37dd9b700 1 -- 172.21.15.36:0/3689194861 learned_addr learned my addr 172.21.15.36:0/3689194861 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:24:59.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37e59c700 1 --2- 172.21.15.36:0/3689194861 >> v2:172.21.15.59:3300/0 conn(0x7fe380146950 0x7fe380140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37d59a700 1 -- 172.21.15.36:0/3689194861 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334077143 0 0) 0x7fe380143b60 con 0x7fe3800b4180 2022-01-10T01:24:59.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37d59a700 1 -- 172.21.15.36:0/3689194861 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe360003260 con 0x7fe3800b4180 2022-01-10T01:24:59.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37d59a700 1 -- 172.21.15.36:0/3689194861 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719289415 0 0) 0x7fe380143e00 con 0x7fe3800b4690 2022-01-10T01:24:59.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37d59a700 1 -- 172.21.15.36:0/3689194861 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe380143b60 con 0x7fe3800b4690 2022-01-10T01:24:59.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37e59c700 1 -- 172.21.15.36:0/3689194861 >> v1:172.21.15.59:6789/0 conn(0x7fe3800b4690 legacy=0x7fe3800b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37d59a700 1 -- 172.21.15.36:0/3689194861 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3052988172 0 0) 0x7fe360003260 con 0x7fe3800b4180 2022-01-10T01:24:59.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37e59c700 1 -- 172.21.15.36:0/3689194861 >> v1:172.21.15.36:6789/0 conn(0x7fe3800b4180 legacy=0x7fe380140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37e59c700 1 -- 172.21.15.36:0/3689194861 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3800b0c90 con 0x7fe380146950 2022-01-10T01:24:59.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37e59c700 1 --2- 172.21.15.36:0/3689194861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe380146950 0x7fe380140230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fe368001110 tx=0x7fe370006df0).ready entity=mon.1 client_cookie=99d4953fbfd54dd6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:59.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37d59a700 1 -- 172.21.15.36:0/3689194861 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe368001660 con 0x7fe380146950 2022-01-10T01:24:59.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37d59a700 1 -- 172.21.15.36:0/3689194861 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe370000e90 con 0x7fe380146950 2022-01-10T01:24:59.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe37d59a700 1 -- 172.21.15.36:0/3689194861 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe370012460 con 0x7fe380146950 2022-01-10T01:24:59.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe384bb5700 1 -- 172.21.15.36:0/3689194861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe380146950 msgr2=0x7fe380140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe384bb5700 1 --2- 172.21.15.36:0/3689194861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe380146950 0x7fe380140230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fe368001110 tx=0x7fe370006df0).stop 2022-01-10T01:24:59.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe384bb5700 1 -- 172.21.15.36:0/3689194861 shutdown_connections 2022-01-10T01:24:59.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe384bb5700 1 --2- 172.21.15.36:0/3689194861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe380146950 0x7fe380140230 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe384bb5700 1 -- 172.21.15.36:0/3689194861 >> 172.21.15.36:0/3689194861 conn(0x7fe38005c490 msgr2=0x7fe38005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:59.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe384bb5700 1 -- 172.21.15.36:0/3689194861 shutdown_connections 2022-01-10T01:24:59.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe384bb5700 1 -- 172.21.15.36:0/3689194861 wait complete. 2022-01-10T01:24:59.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe384bb5700 1 Processor -- start 2022-01-10T01:24:59.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.413+0000 7fe384bb5700 1 -- start start 2022-01-10T01:24:59.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe384bb5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3800b4180 0x7fe380152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe384bb5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3800b4690 0x7fe3800ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe384bb5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe380146950 0x7fe3800ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe384bb5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800adc90 con 0x7fe3800b4180 2022-01-10T01:24:59.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe384bb5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3801524d0 con 0x7fe380146950 2022-01-10T01:24:59.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe384bb5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe380152770 con 0x7fe3800b4690 2022-01-10T01:24:59.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe37e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3800b4180 0x7fe380152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe37e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3800b4180 0x7fe380152eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34974/0 (socket says 172.21.15.36:34974) 2022-01-10T01:24:59.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe37e59c700 1 -- 172.21.15.36:0/589499894 learned_addr learned my addr 172.21.15.36:0/589499894 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:59.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe37ed9d700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe380146950 0x7fe3800ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe37dd9b700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3800b4690 0x7fe3800ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe37e59c700 1 -- 172.21.15.36:0/589499894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3800b4690 msgr2=0x7fe3800ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe37e59c700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3800b4690 0x7fe3800ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe37e59c700 1 -- 172.21.15.36:0/589499894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe380146950 msgr2=0x7fe3800ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe37e59c700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe380146950 0x7fe3800ae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe37e59c700 1 -- 172.21.15.36:0/589499894 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37000b180 con 0x7fe3800b4180 2022-01-10T01:24:59.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe37dd9b700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3800b4690 0x7fe3800ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:59.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe37e59c700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3800b4180 0x7fe380152eb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fe368001110 tx=0x7fe370014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:59.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe3777fe700 1 -- 172.21.15.36:0/589499894 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe370016030 con 0x7fe3800b4180 2022-01-10T01:24:59.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe3777fe700 1 -- 172.21.15.36:0/589499894 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37000bec0 con 0x7fe3800b4180 2022-01-10T01:24:59.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe384bb5700 1 -- 172.21.15.36:0/589499894 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe380152a10 con 0x7fe3800b4180 2022-01-10T01:24:59.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe3777fe700 1 -- 172.21.15.36:0/589499894 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe370012460 con 0x7fe3800b4180 2022-01-10T01:24:59.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe384bb5700 1 -- 172.21.15.36:0/589499894 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38014ff00 con 0x7fe3800b4180 2022-01-10T01:24:59.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe384bb5700 1 -- 172.21.15.36:0/589499894 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe380057350 con 0x7fe3800b4180 2022-01-10T01:24:59.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.417+0000 7fe3777fe700 1 -- 172.21.15.36:0/589499894 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe370024020 con 0x7fe3800b4180 2022-01-10T01:24:59.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.421+0000 7fe3777fe700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe364053680 0x7fe364055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.421+0000 7fe3777fe700 1 -- 172.21.15.36:0/589499894 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fe370017070 con 0x7fe3800b4180 2022-01-10T01:24:59.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.421+0000 7fe37dd9b700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe364053680 0x7fe364055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.421+0000 7fe37dd9b700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe364053680 0x7fe364055b40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fe36800b000 tx=0x7fe368009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:59.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.425+0000 7fe3777fe700 1 -- 172.21.15.36:0/589499894 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe3700438c0 con 0x7fe3800b4180 2022-01-10T01:24:59.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.549+0000 7fe384bb5700 1 -- 172.21.15.36:0/589499894 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe3800698e0 con 0x7fe3800b4180 2022-01-10T01:24:59.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.549+0000 7fe3777fe700 1 -- 172.21.15.36:0/589499894 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v29) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe370046ee0 con 0x7fe3800b4180 2022-01-10T01:24:59.556 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:24:59.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.553+0000 7fe384bb5700 1 -- 172.21.15.36:0/589499894 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe364053680 msgr2=0x7fe364055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.553+0000 7fe384bb5700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe364053680 0x7fe364055b40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fe36800b000 tx=0x7fe368009040).stop 2022-01-10T01:24:59.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.553+0000 7fe384bb5700 1 -- 172.21.15.36:0/589499894 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3800b4180 msgr2=0x7fe380152eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.553+0000 7fe384bb5700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3800b4180 0x7fe380152eb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fe368001110 tx=0x7fe370014000).stop 2022-01-10T01:24:59.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.553+0000 7fe384bb5700 1 -- 172.21.15.36:0/589499894 shutdown_connections 2022-01-10T01:24:59.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.553+0000 7fe384bb5700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe364053680 0x7fe364055b40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.553+0000 7fe384bb5700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe380146950 0x7fe3800ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.553+0000 7fe384bb5700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3800b4690 0x7fe3800ad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.553+0000 7fe384bb5700 1 --2- 172.21.15.36:0/589499894 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3800b4180 0x7fe380152eb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.553+0000 7fe384bb5700 1 -- 172.21.15.36:0/589499894 >> 172.21.15.36:0/589499894 conn(0x7fe38005c490 msgr2=0x7fe3800b6630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:59.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.553+0000 7fe384bb5700 1 -- 172.21.15.36:0/589499894 shutdown_connections 2022-01-10T01:24:59.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.553+0000 7fe384bb5700 1 -- 172.21.15.36:0/589499894 wait complete. 2022-01-10T01:24:59.568 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:24:59.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.673+0000 7f251359e700 1 Processor -- start 2022-01-10T01:24:59.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.673+0000 7f251359e700 1 -- start start 2022-01-10T01:24:59.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.673+0000 7f251359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2514060d20 0x7f251405f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.673+0000 7f251359e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2514143c90 0x7f251412c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.673+0000 7f251359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25140b3c40 con 0x7f25140b21b0 2022-01-10T01:24:59.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.673+0000 7f251359e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2514063df0 con 0x7f2514143c90 2022-01-10T01:24:59.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.673+0000 7f251359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25140b2590 con 0x7f2514060d20 2022-01-10T01:24:59.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f2512d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2514143c90 0x7f251412c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f2512d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2514143c90 0x7f251412c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34986/0 (socket says 172.21.15.36:34986) 2022-01-10T01:24:59.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f2512d9d700 1 -- 172.21.15.36:0/4266522188 learned_addr learned my addr 172.21.15.36:0/4266522188 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:59.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f2511d9b700 1 --2- 172.21.15.36:0/4266522188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2514060d20 0x7f251405f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f2512d9d700 1 -- 172.21.15.36:0/4266522188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2514060d20 msgr2=0x7f251405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:59.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f2512d9d700 1 --2- 172.21.15.36:0/4266522188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2514060d20 0x7f251405f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f2512d9d700 1 -- 172.21.15.36:0/4266522188 >> v1:172.21.15.59:6789/0 conn(0x7f25140b21b0 legacy=0x7f25140b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f2512d9d700 1 -- 172.21.15.36:0/4266522188 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25140b2e30 con 0x7f2514143c90 2022-01-10T01:24:59.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f2512d9d700 1 --2- 172.21.15.36:0/4266522188 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2514143c90 0x7f251412c020 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f24fc002f70 tx=0x7f24fc006eb0).ready entity=mon.0 client_cookie=c7aa257bc860657e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:59.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f251159a700 1 -- 172.21.15.36:0/4266522188 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24fc00d570 con 0x7f2514143c90 2022-01-10T01:24:59.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f251159a700 1 -- 172.21.15.36:0/4266522188 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc000e90 con 0x7f2514143c90 2022-01-10T01:24:59.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f251159a700 1 -- 172.21.15.36:0/4266522188 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24fc00d900 con 0x7f2514143c90 2022-01-10T01:24:59.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f251359e700 1 -- 172.21.15.36:0/4266522188 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2514143c90 msgr2=0x7f251412c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f251359e700 1 --2- 172.21.15.36:0/4266522188 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2514143c90 0x7f251412c020 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f24fc002f70 tx=0x7f24fc006eb0).stop 2022-01-10T01:24:59.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f251359e700 1 -- 172.21.15.36:0/4266522188 shutdown_connections 2022-01-10T01:24:59.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f251359e700 1 --2- 172.21.15.36:0/4266522188 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2514143c90 0x7f251412c020 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f251359e700 1 --2- 172.21.15.36:0/4266522188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2514060d20 0x7f251405f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f251359e700 1 -- 172.21.15.36:0/4266522188 >> 172.21.15.36:0/4266522188 conn(0x7f251405c490 msgr2=0x7f251405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:59.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f251359e700 1 -- 172.21.15.36:0/4266522188 shutdown_connections 2022-01-10T01:24:59.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f251359e700 1 -- 172.21.15.36:0/4266522188 wait complete. 2022-01-10T01:24:59.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.677+0000 7f251359e700 1 Processor -- start 2022-01-10T01:24:59.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f251359e700 1 -- start start 2022-01-10T01:24:59.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f251359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2514060d20 0x7f2514129310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f251359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25140b21b0 0x7f2514155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f251359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2514143c90 0x7f25141562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f251359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251412ab00 con 0x7f25140b21b0 2022-01-10T01:24:59.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f251359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2514129ef0 con 0x7f2514143c90 2022-01-10T01:24:59.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f251359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251412a190 con 0x7f2514060d20 2022-01-10T01:24:59.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f2511d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25140b21b0 0x7f2514155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f2511d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25140b21b0 0x7f2514155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:34990/0 (socket says 172.21.15.36:34990) 2022-01-10T01:24:59.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f2511d9b700 1 -- 172.21.15.36:0/438815914 learned_addr learned my addr 172.21.15.36:0/438815914 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:59.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f2512d9d700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2514143c90 0x7f25141562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f251259c700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2514060d20 0x7f2514129310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f2511d9b700 1 -- 172.21.15.36:0/438815914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2514060d20 msgr2=0x7f2514129310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f2511d9b700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2514060d20 0x7f2514129310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f2511d9b700 1 -- 172.21.15.36:0/438815914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2514143c90 msgr2=0x7f25141562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f2511d9b700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2514143c90 0x7f25141562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f2511d9b700 1 -- 172.21.15.36:0/438815914 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc00b1e0 con 0x7f25140b21b0 2022-01-10T01:24:59.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f2512d9d700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2514143c90 0x7f25141562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:24:59.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f2511d9b700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25140b21b0 0x7f2514155dd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f250400c000 tx=0x7f25040091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:59.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f250b7fe700 1 -- 172.21.15.36:0/438815914 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f250400c850 con 0x7f25140b21b0 2022-01-10T01:24:59.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f250b7fe700 1 -- 172.21.15.36:0/438815914 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250400c9b0 con 0x7f25140b21b0 2022-01-10T01:24:59.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f251359e700 1 -- 172.21.15.36:0/438815914 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251412a430 con 0x7f25140b21b0 2022-01-10T01:24:59.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f250b7fe700 1 -- 172.21.15.36:0/438815914 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f250400cd10 con 0x7f25140b21b0 2022-01-10T01:24:59.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f251359e700 1 -- 172.21.15.36:0/438815914 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25140b0610 con 0x7f25140b21b0 2022-01-10T01:24:59.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.681+0000 7f251359e700 1 -- 172.21.15.36:0/438815914 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2514061bd0 con 0x7f25140b21b0 2022-01-10T01:24:59.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.685+0000 7f250b7fe700 1 -- 172.21.15.36:0/438815914 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2504022070 con 0x7f25140b21b0 2022-01-10T01:24:59.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.685+0000 7f250b7fe700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24f80535f0 0x7f24f8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.685+0000 7f250b7fe700 1 -- 172.21.15.36:0/438815914 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f250406be90 con 0x7f25140b21b0 2022-01-10T01:24:59.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.685+0000 7f251259c700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24f80535f0 0x7f24f8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.685+0000 7f251259c700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24f80535f0 0x7f24f8055ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f250c00b000 tx=0x7f250c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:59.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.689+0000 7f250b7fe700 1 -- 172.21.15.36:0/438815914 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f25040431e0 con 0x7f25140b21b0 2022-01-10T01:24:59.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.821+0000 7f251359e700 1 -- 172.21.15.36:0/438815914 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2514057350 con 0x7f25140b21b0 2022-01-10T01:24:59.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.821+0000 7f250b7fe700 1 -- 172.21.15.36:0/438815914 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2504046800 con 0x7f25140b21b0 2022-01-10T01:24:59.828 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:24:59.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.825+0000 7f251359e700 1 -- 172.21.15.36:0/438815914 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24f80535f0 msgr2=0x7f24f8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.825+0000 7f251359e700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24f80535f0 0x7f24f8055ab0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f250c00b000 tx=0x7f250c009040).stop 2022-01-10T01:24:59.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.825+0000 7f251359e700 1 -- 172.21.15.36:0/438815914 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25140b21b0 msgr2=0x7f2514155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.825+0000 7f251359e700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25140b21b0 0x7f2514155dd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f250400c000 tx=0x7f25040091d0).stop 2022-01-10T01:24:59.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.825+0000 7f251359e700 1 -- 172.21.15.36:0/438815914 shutdown_connections 2022-01-10T01:24:59.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.825+0000 7f251359e700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24f80535f0 0x7f24f8055ab0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.825+0000 7f251359e700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2514143c90 0x7f25141562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.825+0000 7f251359e700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25140b21b0 0x7f2514155dd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.825+0000 7f251359e700 1 --2- 172.21.15.36:0/438815914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2514060d20 0x7f2514129310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.825+0000 7f251359e700 1 -- 172.21.15.36:0/438815914 >> 172.21.15.36:0/438815914 conn(0x7f251405c490 msgr2=0x7f2514142f40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:59.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.825+0000 7f251359e700 1 -- 172.21.15.36:0/438815914 shutdown_connections 2022-01-10T01:24:59.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.825+0000 7f251359e700 1 -- 172.21.15.36:0/438815914 wait complete. 2022-01-10T01:24:59.840 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-01-10T01:24:59.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.933+0000 7f5b1f59e700 1 Processor -- start 2022-01-10T01:24:59.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.933+0000 7f5b1f59e700 1 -- start start 2022-01-10T01:24:59.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b2005c7d0 0x7f5b200b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1f59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b2005d0b0 0x7f5b2013f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1f59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2013f880 con 0x7f5b200ace30 2022-01-10T01:24:59.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1f59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b20067d70 con 0x7f5b2005d0b0 2022-01-10T01:24:59.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2005cbb0 con 0x7f5b2005c7d0 2022-01-10T01:24:59.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b2005d0b0 0x7f5b2013f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b2005c7d0 0x7f5b200b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b2005d0b0 0x7f5b2013f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:59864/0 (socket says 172.21.15.36:59864) 2022-01-10T01:24:59.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1dd9b700 1 -- 172.21.15.36:0/1052952020 learned_addr learned my addr 172.21.15.36:0/1052952020 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:59.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1dd9b700 1 -- 172.21.15.36:0/1052952020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b2005c7d0 msgr2=0x7f5b200b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:24:59.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1dd9b700 1 --2- 172.21.15.36:0/1052952020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b2005c7d0 0x7f5b200b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1dd9b700 1 -- 172.21.15.36:0/1052952020 >> v1:172.21.15.59:6789/0 conn(0x7f5b200ace30 legacy=0x7f5b200aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1dd9b700 1 -- 172.21.15.36:0/1052952020 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b200b1790 con 0x7f5b2005d0b0 2022-01-10T01:24:59.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1dd9b700 1 --2- 172.21.15.36:0/1052952020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b2005d0b0 0x7f5b2013f390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f5b14002f70 tx=0x7f5b14006f40).ready entity=mon.1 client_cookie=b5ce69a7adbe4a3e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:59.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1d59a700 1 -- 172.21.15.36:0/1052952020 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b1400da80 con 0x7f5b2005d0b0 2022-01-10T01:24:59.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1d59a700 1 -- 172.21.15.36:0/1052952020 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b14000e90 con 0x7f5b2005d0b0 2022-01-10T01:24:59.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.937+0000 7f5b1d59a700 1 -- 172.21.15.36:0/1052952020 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b1400de10 con 0x7f5b2005d0b0 2022-01-10T01:24:59.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 -- 172.21.15.36:0/1052952020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b2005d0b0 msgr2=0x7f5b2013f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 --2- 172.21.15.36:0/1052952020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b2005d0b0 0x7f5b2013f390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f5b14002f70 tx=0x7f5b14006f40).stop 2022-01-10T01:24:59.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 -- 172.21.15.36:0/1052952020 shutdown_connections 2022-01-10T01:24:59.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 --2- 172.21.15.36:0/1052952020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b2005d0b0 0x7f5b2013f390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 --2- 172.21.15.36:0/1052952020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b2005c7d0 0x7f5b200b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 -- 172.21.15.36:0/1052952020 >> 172.21.15.36:0/1052952020 conn(0x7f5b20060180 msgr2=0x7f5b200b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:24:59.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 -- 172.21.15.36:0/1052952020 shutdown_connections 2022-01-10T01:24:59.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 -- 172.21.15.36:0/1052952020 wait complete. 2022-01-10T01:24:59.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 Processor -- start 2022-01-10T01:24:59.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 -- start start 2022-01-10T01:24:59.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b2005c7d0 0x7f5b200aa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5b2005d0b0 0x7f5b20152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b200ace30 0x7f5b20152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b200b45f0 con 0x7f5b2005d0b0 2022-01-10T01:24:59.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b200b2dd0 con 0x7f5b200ace30 2022-01-10T01:24:59.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b200b58f0 con 0x7f5b2005c7d0 2022-01-10T01:24:59.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1dd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5b2005d0b0 0x7f5b20152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1dd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5b2005d0b0 0x7f5b20152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35004/0 (socket says 172.21.15.36:35004) 2022-01-10T01:24:59.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1dd9b700 1 -- 172.21.15.36:0/2348471995 learned_addr learned my addr 172.21.15.36:0/2348471995 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:24:59.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1ed9d700 1 --2- 172.21.15.36:0/2348471995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b200ace30 0x7f5b20152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1e59c700 1 --2- 172.21.15.36:0/2348471995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b2005c7d0 0x7f5b200aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1dd9b700 1 -- 172.21.15.36:0/2348471995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b2005c7d0 msgr2=0x7f5b200aa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1dd9b700 1 --2- 172.21.15.36:0/2348471995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b2005c7d0 0x7f5b200aa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1dd9b700 1 -- 172.21.15.36:0/2348471995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b200ace30 msgr2=0x7f5b20152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:24:59.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1dd9b700 1 --2- 172.21.15.36:0/2348471995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b200ace30 0x7f5b20152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:24:59.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1dd9b700 1 -- 172.21.15.36:0/2348471995 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1400b460 con 0x7f5b2005d0b0 2022-01-10T01:24:59.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.941+0000 7f5b1dd9b700 1 --2- 172.21.15.36:0/2348471995 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5b2005d0b0 0x7f5b20152530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f5b14002f70 tx=0x7f5b200b1920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:59.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.945+0000 7f5b0f7fe700 1 -- 172.21.15.36:0/2348471995 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b1401d070 con 0x7f5b2005d0b0 2022-01-10T01:24:59.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.945+0000 7f5b0f7fe700 1 -- 172.21.15.36:0/2348471995 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1400dde0 con 0x7f5b2005d0b0 2022-01-10T01:24:59.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.945+0000 7f5b1f59e700 1 -- 172.21.15.36:0/2348471995 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b200b3000 con 0x7f5b2005d0b0 2022-01-10T01:24:59.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.945+0000 7f5b0f7fe700 1 -- 172.21.15.36:0/2348471995 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b14018800 con 0x7f5b2005d0b0 2022-01-10T01:24:59.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.945+0000 7f5b1f59e700 1 -- 172.21.15.36:0/2348471995 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b200b39e0 con 0x7f5b2005d0b0 2022-01-10T01:24:59.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.945+0000 7f5b1f59e700 1 -- 172.21.15.36:0/2348471995 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b200b1a30 con 0x7f5b2005d0b0 2022-01-10T01:24:59.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.945+0000 7f5b0f7fe700 1 -- 172.21.15.36:0/2348471995 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5b14018960 con 0x7f5b2005d0b0 2022-01-10T01:24:59.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.945+0000 7f5b0f7fe700 1 --2- 172.21.15.36:0/2348471995 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5afc0535f0 0x7f5afc055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:24:59.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.945+0000 7f5b0f7fe700 1 -- 172.21.15.36:0/2348471995 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f5b1406ca90 con 0x7f5b2005d0b0 2022-01-10T01:24:59.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.945+0000 7f5b1e59c700 1 --2- 172.21.15.36:0/2348471995 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5afc0535f0 0x7f5afc055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:24:59.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.949+0000 7f5b1e59c700 1 --2- 172.21.15.36:0/2348471995 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5afc0535f0 0x7f5afc055ab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f5b1000b000 tx=0x7f5b10006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:24:59.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:24:59.953+0000 7f5b0f7fe700 1 -- 172.21.15.36:0/2348471995 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5b14043de0 con 0x7f5b2005d0b0 2022-01-10T01:25:00.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.085+0000 7f5b1f59e700 1 -- 172.21.15.36:0/2348471995 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5b20057350 con 0x7f5b2005d0b0 2022-01-10T01:25:00.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.085+0000 7f5b0f7fe700 1 -- 172.21.15.36:0/2348471995 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+143 (secure 0 0 0) 0x7f5b14047400 con 0x7f5b2005d0b0 2022-01-10T01:25:00.090 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:25:00.091 INFO:teuthology.orchestra.run.smithi036.stdout:[ 2022-01-10T01:25:00.091 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:25:00.091 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 1, 2022-01-10T01:25:00.092 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "device_health_metrics" 2022-01-10T01:25:00.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:25:00.092 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:25:00.093 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 2, 2022-01-10T01:25:00.093 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "rbd" 2022-01-10T01:25:00.093 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:25:00.093 INFO:teuthology.orchestra.run.smithi036.stdout:] 2022-01-10T01:25:00.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.085+0000 7f5b1f59e700 1 -- 172.21.15.36:0/2348471995 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5afc0535f0 msgr2=0x7f5afc055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:00.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.085+0000 7f5b1f59e700 1 --2- 172.21.15.36:0/2348471995 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5afc0535f0 0x7f5afc055ab0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f5b1000b000 tx=0x7f5b10006df0).stop 2022-01-10T01:25:00.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.085+0000 7f5b1f59e700 1 -- 172.21.15.36:0/2348471995 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5b2005d0b0 msgr2=0x7f5b20152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:00.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.085+0000 7f5b1f59e700 1 --2- 172.21.15.36:0/2348471995 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5b2005d0b0 0x7f5b20152530 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f5b14002f70 tx=0x7f5b200b1920).stop 2022-01-10T01:25:00.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.085+0000 7f5b1f59e700 1 -- 172.21.15.36:0/2348471995 shutdown_connections 2022-01-10T01:25:00.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.085+0000 7f5b1f59e700 1 --2- 172.21.15.36:0/2348471995 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5afc0535f0 0x7f5afc055ab0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.085+0000 7f5b1f59e700 1 --2- 172.21.15.36:0/2348471995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b200ace30 0x7f5b20152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.085+0000 7f5b1f59e700 1 --2- 172.21.15.36:0/2348471995 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5b2005d0b0 0x7f5b20152530 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.085+0000 7f5b1f59e700 1 --2- 172.21.15.36:0/2348471995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b2005c7d0 0x7f5b200aa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.085+0000 7f5b1f59e700 1 -- 172.21.15.36:0/2348471995 >> 172.21.15.36:0/2348471995 conn(0x7f5b20060180 msgr2=0x7f5b200b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:00.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.085+0000 7f5b1f59e700 1 -- 172.21.15.36:0/2348471995 shutdown_connections 2022-01-10T01:25:00.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.085+0000 7f5b1f59e700 1 -- 172.21.15.36:0/2348471995 wait complete. 2022-01-10T01:25:00.102 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-01-10T01:25:00.102 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:25:00.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 Processor -- start 2022-01-10T01:25:00.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 -- start start 2022-01-10T01:25:00.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f062c05fdc0 0x7f062c0610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:00.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f062c0b3730 0x7f062c0601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:00.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0aaab0 0x7f062c0aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:00.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062c0b29e0 con 0x7f062c0b3730 2022-01-10T01:25:00.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062c0b2740 con 0x7f062c05fdc0 2022-01-10T01:25:00.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c060970 con 0x7f062c0aaab0 2022-01-10T01:25:00.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f063174f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f062c0b3730 0x7f062c0601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:00.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f063174f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f062c0b3730 0x7f062c0601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35012/0 (socket says 172.21.15.36:35012) 2022-01-10T01:25:00.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f063174f700 1 -- 172.21.15.36:0/663541965 learned_addr learned my addr 172.21.15.36:0/663541965 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:00.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f0631f50700 1 --2- 172.21.15.36:0/663541965 >> v2:172.21.15.59:3300/0 conn(0x7f062c05fdc0 0x7f062c0610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:00.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f0632751700 1 --2- 172.21.15.36:0/663541965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0aaab0 0x7f062c0aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:00.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f063174f700 1 -- 172.21.15.36:0/663541965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0aaab0 msgr2=0x7f062c0aaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:00.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f063174f700 1 --2- 172.21.15.36:0/663541965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0aaab0 0x7f062c0aaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f063174f700 1 -- 172.21.15.36:0/663541965 >> v2:172.21.15.59:3300/0 conn(0x7f062c05fdc0 msgr2=0x7f062c0610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:00.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f063174f700 1 --2- 172.21.15.36:0/663541965 >> v2:172.21.15.59:3300/0 conn(0x7f062c05fdc0 0x7f062c0610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f063174f700 1 -- 172.21.15.36:0/663541965 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c060c10 con 0x7f062c0b3730 2022-01-10T01:25:00.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f0631f50700 1 --2- 172.21.15.36:0/663541965 >> v2:172.21.15.59:3300/0 conn(0x7f062c05fdc0 0x7f062c0610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:25:00.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f063174f700 1 --2- 172.21.15.36:0/663541965 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f062c0b3730 0x7f062c0601a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f061c002f70 tx=0x7f061c006eb0).ready entity=mon.0 client_cookie=f1e37a595360f4a0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:00.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f0630f4e700 1 -- 172.21.15.36:0/663541965 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f061c00d570 con 0x7f062c0b3730 2022-01-10T01:25:00.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f0630f4e700 1 -- 172.21.15.36:0/663541965 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c000e90 con 0x7f062c0b3730 2022-01-10T01:25:00.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f0630f4e700 1 -- 172.21.15.36:0/663541965 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f061c00d900 con 0x7f062c0b3730 2022-01-10T01:25:00.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 -- 172.21.15.36:0/663541965 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f062c0b3730 msgr2=0x7f062c0601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:00.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 --2- 172.21.15.36:0/663541965 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f062c0b3730 0x7f062c0601a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f061c002f70 tx=0x7f061c006eb0).stop 2022-01-10T01:25:00.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 -- 172.21.15.36:0/663541965 shutdown_connections 2022-01-10T01:25:00.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 --2- 172.21.15.36:0/663541965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0aaab0 0x7f062c0aaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 --2- 172.21.15.36:0/663541965 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f062c0b3730 0x7f062c0601a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 --2- 172.21.15.36:0/663541965 >> v2:172.21.15.59:3300/0 conn(0x7f062c05fdc0 0x7f062c0610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 -- 172.21.15.36:0/663541965 >> 172.21.15.36:0/663541965 conn(0x7f062c05cf60 msgr2=0x7f062c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:00.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 -- 172.21.15.36:0/663541965 shutdown_connections 2022-01-10T01:25:00.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.205+0000 7f06341b4700 1 -- 172.21.15.36:0/663541965 wait complete. 2022-01-10T01:25:00.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f06341b4700 1 Processor -- start 2022-01-10T01:25:00.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f06341b4700 1 -- start start 2022-01-10T01:25:00.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f06341b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c05fdc0 0x7f062c147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:00.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f06341b4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f062c0aaab0 0x7f062c143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:00.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f06341b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0b3730 0x7f062c143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:00.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f06341b4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c140640 con 0x7f062c0aaab0 2022-01-10T01:25:00.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f06341b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c1408e0 con 0x7f062c05fdc0 2022-01-10T01:25:00.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f06341b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c140b80 con 0x7f062c0b3730 2022-01-10T01:25:00.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f063174f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f062c0aaab0 0x7f062c143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:00.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f063174f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f062c0aaab0 0x7f062c143640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35018/0 (socket says 172.21.15.36:35018) 2022-01-10T01:25:00.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f063174f700 1 -- 172.21.15.36:0/1729126225 learned_addr learned my addr 172.21.15.36:0/1729126225 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:00.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f0631f50700 1 --2- 172.21.15.36:0/1729126225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c05fdc0 0x7f062c147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:00.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f0632751700 1 --2- 172.21.15.36:0/1729126225 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0b3730 0x7f062c143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:00.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f063174f700 1 -- 172.21.15.36:0/1729126225 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0b3730 msgr2=0x7f062c143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:00.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f063174f700 1 --2- 172.21.15.36:0/1729126225 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0b3730 0x7f062c143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f063174f700 1 -- 172.21.15.36:0/1729126225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c05fdc0 msgr2=0x7f062c147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:00.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f063174f700 1 --2- 172.21.15.36:0/1729126225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c05fdc0 0x7f062c147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f063174f700 1 -- 172.21.15.36:0/1729126225 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c00b1e0 con 0x7f062c0aaab0 2022-01-10T01:25:00.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f063174f700 1 --2- 172.21.15.36:0/1729126225 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f062c0aaab0 0x7f062c143640 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f061c002f70 tx=0x7f061c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:00.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f0622ffd700 1 -- 172.21.15.36:0/1729126225 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f061c0117e0 con 0x7f062c0aaab0 2022-01-10T01:25:00.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f0622ffd700 1 -- 172.21.15.36:0/1729126225 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c011940 con 0x7f062c0aaab0 2022-01-10T01:25:00.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f06341b4700 1 -- 172.21.15.36:0/1729126225 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062c140e20 con 0x7f062c0aaab0 2022-01-10T01:25:00.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f0622ffd700 1 -- 172.21.15.36:0/1729126225 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f061c011ca0 con 0x7f062c0aaab0 2022-01-10T01:25:00.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.209+0000 7f06341b4700 1 -- 172.21.15.36:0/1729126225 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062c148240 con 0x7f062c0aaab0 2022-01-10T01:25:00.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.213+0000 7f06341b4700 1 -- 172.21.15.36:0/1729126225 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062c140fb0 con 0x7f062c0aaab0 2022-01-10T01:25:00.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.213+0000 7f0622ffd700 1 -- 172.21.15.36:0/1729126225 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f061c01a040 con 0x7f062c0aaab0 2022-01-10T01:25:00.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.213+0000 7f0622ffd700 1 --2- 172.21.15.36:0/1729126225 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06140534d0 0x7f0614055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:00.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.213+0000 7f0622ffd700 1 -- 172.21.15.36:0/1729126225 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f061c06ca30 con 0x7f062c0aaab0 2022-01-10T01:25:00.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.213+0000 7f0631f50700 1 --2- 172.21.15.36:0/1729126225 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06140534d0 0x7f0614055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:00.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.213+0000 7f0631f50700 1 --2- 172.21.15.36:0/1729126225 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06140534d0 0x7f0614055990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f062800c000 tx=0x7f0628008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:00.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.217+0000 7f0622ffd700 1 -- 172.21.15.36:0/1729126225 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f061c043d80 con 0x7f062c0aaab0 2022-01-10T01:25:00.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.345+0000 7f06341b4700 1 -- 172.21.15.36:0/1729126225 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f062c057350 con 0x7f062c0aaab0 2022-01-10T01:25:00.782 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:25:00.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:25:00.788 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:25:00.790 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:25:00.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.797+0000 7f0622ffd700 1 -- 172.21.15.36:0/1729126225 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v32) v1 ==== 133+0+0 (secure 0 0 0) 0x7f061c023030 con 0x7f062c0aaab0 2022-01-10T01:25:00.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.801+0000 7f06341b4700 1 -- 172.21.15.36:0/1729126225 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06140534d0 msgr2=0x7f0614055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:00.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.801+0000 7f06341b4700 1 --2- 172.21.15.36:0/1729126225 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06140534d0 0x7f0614055990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f062800c000 tx=0x7f0628008040).stop 2022-01-10T01:25:00.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.801+0000 7f06341b4700 1 -- 172.21.15.36:0/1729126225 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f062c0aaab0 msgr2=0x7f062c143640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:00.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.801+0000 7f06341b4700 1 --2- 172.21.15.36:0/1729126225 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f062c0aaab0 0x7f062c143640 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f061c002f70 tx=0x7f061c015000).stop 2022-01-10T01:25:00.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.801+0000 7f06341b4700 1 -- 172.21.15.36:0/1729126225 shutdown_connections 2022-01-10T01:25:00.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.801+0000 7f06341b4700 1 --2- 172.21.15.36:0/1729126225 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06140534d0 0x7f0614055990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.801+0000 7f06341b4700 1 --2- 172.21.15.36:0/1729126225 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0b3730 0x7f062c143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.801+0000 7f06341b4700 1 --2- 172.21.15.36:0/1729126225 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f062c0aaab0 0x7f062c143640 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.801+0000 7f06341b4700 1 --2- 172.21.15.36:0/1729126225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c05fdc0 0x7f062c147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.801+0000 7f06341b4700 1 -- 172.21.15.36:0/1729126225 >> 172.21.15.36:0/1729126225 conn(0x7f062c05cf60 msgr2=0x7f062c0b6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:00.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.801+0000 7f06341b4700 1 -- 172.21.15.36:0/1729126225 shutdown_connections 2022-01-10T01:25:00.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.801+0000 7f06341b4700 1 -- 172.21.15.36:0/1729126225 wait complete. 2022-01-10T01:25:00.809 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:25:00.819 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2022-01-10T01:25:00.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.921+0000 7f82aa1cd700 1 Processor -- start 2022-01-10T01:25:00.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.921+0000 7f82aa1cd700 1 -- start start 2022-01-10T01:25:00.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.921+0000 7f82aa1cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82a4146950 0x7f82a4140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:00.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.921+0000 7f82aa1cd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f82a40b4690 0x7f82a40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:00.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.921+0000 7f82aa1cd700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a4143b60 con 0x7f82a40b4180 2022-01-10T01:25:00.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.921+0000 7f82aa1cd700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a4147510 con 0x7f82a40b4690 2022-01-10T01:25:00.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.921+0000 7f82aa1cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a4143e00 con 0x7f82a4146950 2022-01-10T01:25:00.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.921+0000 7f82a3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f82a40b4690 0x7f82a40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:00.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82a3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f82a40b4690 0x7f82a40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35030/0 (socket says 172.21.15.36:35030) 2022-01-10T01:25:00.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82a3fff700 1 -- 172.21.15.36:0/2241136263 learned_addr learned my addr 172.21.15.36:0/2241136263 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:00.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82a2ffd700 1 --1- 172.21.15.36:0/2241136263 >> v1:172.21.15.36:6789/0 conn(0x7f82a40b4180 0x7f82a4140720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:32820/0 (socket says 172.21.15.36:32820) 2022-01-10T01:25:00.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82a37fe700 1 --2- 172.21.15.36:0/2241136263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82a4146950 0x7f82a4140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:00.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82a3fff700 1 -- 172.21.15.36:0/2241136263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82a4146950 msgr2=0x7f82a4140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:00.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82a3fff700 1 --2- 172.21.15.36:0/2241136263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82a4146950 0x7f82a4140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82a3fff700 1 -- 172.21.15.36:0/2241136263 >> v1:172.21.15.36:6789/0 conn(0x7f82a40b4180 legacy=0x7f82a4140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:00.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82a27fc700 1 -- 172.21.15.36:0/2241136263 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823798803 0 0) 0x7f82a4143b60 con 0x7f82a40b4180 2022-01-10T01:25:00.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82a3fff700 1 -- 172.21.15.36:0/2241136263 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a40b0c90 con 0x7f82a40b4690 2022-01-10T01:25:00.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82a3fff700 1 --2- 172.21.15.36:0/2241136263 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82a40b4690 0x7f82a40b4ed0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f829c0032f0 tx=0x7f829c009290).ready entity=mon.0 client_cookie=2b860e542e15d039 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:00.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82a27fc700 1 -- 172.21.15.36:0/2241136263 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f829c00b8a0 con 0x7f82a40b4690 2022-01-10T01:25:00.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82a27fc700 1 -- 172.21.15.36:0/2241136263 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829c00ba00 con 0x7f82a40b4690 2022-01-10T01:25:00.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82a27fc700 1 -- 172.21.15.36:0/2241136263 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f829c00bb70 con 0x7f82a40b4690 2022-01-10T01:25:00.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82aa1cd700 1 -- 172.21.15.36:0/2241136263 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82a40b4690 msgr2=0x7f82a40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:00.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82aa1cd700 1 --2- 172.21.15.36:0/2241136263 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82a40b4690 0x7f82a40b4ed0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f829c0032f0 tx=0x7f829c009290).stop 2022-01-10T01:25:00.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82aa1cd700 1 -- 172.21.15.36:0/2241136263 shutdown_connections 2022-01-10T01:25:00.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82aa1cd700 1 --2- 172.21.15.36:0/2241136263 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82a40b4690 0x7f82a40b4ed0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82aa1cd700 1 --2- 172.21.15.36:0/2241136263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82a4146950 0x7f82a4140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82aa1cd700 1 -- 172.21.15.36:0/2241136263 >> 172.21.15.36:0/2241136263 conn(0x7f82a405c490 msgr2=0x7f82a405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:00.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82aa1cd700 1 -- 172.21.15.36:0/2241136263 shutdown_connections 2022-01-10T01:25:00.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.925+0000 7f82aa1cd700 1 -- 172.21.15.36:0/2241136263 wait complete. 2022-01-10T01:25:00.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82aa1cd700 1 Processor -- start 2022-01-10T01:25:00.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82aa1cd700 1 -- start start 2022-01-10T01:25:00.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82aa1cd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82a40b4180 0x7f82a40ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:00.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82aa1cd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82a40b4690 0x7f82a40b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:00.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82aa1cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82a4146950 0x7f82a4148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:00.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82aa1cd700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a4142a70 con 0x7f82a40b4690 2022-01-10T01:25:00.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82aa1cd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a41423c0 con 0x7f82a40b4180 2022-01-10T01:25:00.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82aa1cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40b73c0 con 0x7f82a4146950 2022-01-10T01:25:00.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82a2ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82a40b4690 0x7f82a40b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:00.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82a2ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82a40b4690 0x7f82a40b01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35034/0 (socket says 172.21.15.36:35034) 2022-01-10T01:25:00.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82a2ffd700 1 -- 172.21.15.36:0/3764555786 learned_addr learned my addr 172.21.15.36:0/3764555786 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:00.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82a37fe700 1 --2- 172.21.15.36:0/3764555786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82a40b4180 0x7f82a40ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:00.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82a3fff700 1 --2- 172.21.15.36:0/3764555786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82a4146950 0x7f82a4148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:00.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82a2ffd700 1 -- 172.21.15.36:0/3764555786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82a4146950 msgr2=0x7f82a4148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:00.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82a2ffd700 1 --2- 172.21.15.36:0/3764555786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82a4146950 0x7f82a4148d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82a2ffd700 1 -- 172.21.15.36:0/3764555786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82a40b4180 msgr2=0x7f82a40ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:00.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82a2ffd700 1 --2- 172.21.15.36:0/3764555786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82a40b4180 0x7f82a40ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:00.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82a2ffd700 1 -- 172.21.15.36:0/3764555786 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c009530 con 0x7f82a40b4690 2022-01-10T01:25:00.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.929+0000 7f82a2ffd700 1 --2- 172.21.15.36:0/3764555786 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82a40b4690 0x7f82a40b01e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f828c000ed0 tx=0x7f828c007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:00.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.933+0000 7f82a0ff9700 1 -- 172.21.15.36:0/3764555786 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f828c0070d0 con 0x7f82a40b4690 2022-01-10T01:25:00.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.933+0000 7f82a0ff9700 1 -- 172.21.15.36:0/3764555786 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c007230 con 0x7f82a40b4690 2022-01-10T01:25:00.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.933+0000 7f82aa1cd700 1 -- 172.21.15.36:0/3764555786 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a4141e40 con 0x7f82a40b4690 2022-01-10T01:25:00.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.933+0000 7f82a0ff9700 1 -- 172.21.15.36:0/3764555786 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f828c005740 con 0x7f82a40b4690 2022-01-10T01:25:00.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.933+0000 7f82aa1cd700 1 -- 172.21.15.36:0/3764555786 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a4142fc0 con 0x7f82a40b4690 2022-01-10T01:25:00.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.933+0000 7f82a0ff9700 1 -- 172.21.15.36:0/3764555786 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f828c01a060 con 0x7f82a40b4690 2022-01-10T01:25:00.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.933+0000 7f82aa1cd700 1 -- 172.21.15.36:0/3764555786 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a4142be0 con 0x7f82a40b4690 2022-01-10T01:25:00.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.933+0000 7f82a0ff9700 1 --2- 172.21.15.36:0/3764555786 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8288053680 0x7f8288055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:00.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.933+0000 7f82a0ff9700 1 -- 172.21.15.36:0/3764555786 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f828c06aff0 con 0x7f82a40b4690 2022-01-10T01:25:00.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.933+0000 7f82a37fe700 1 --2- 172.21.15.36:0/3764555786 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8288053680 0x7f8288055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:00.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.933+0000 7f82a37fe700 1 --2- 172.21.15.36:0/3764555786 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8288053680 0x7f8288055b40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f829400b000 tx=0x7f8294006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:00.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:00.941+0000 7f82a0ff9700 1 -- 172.21.15.36:0/3764555786 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f828c0421d0 con 0x7f82a40b4690 2022-01-10T01:25:01.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.065+0000 7f82aa1cd700 1 -- 172.21.15.36:0/3764555786 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f82a4057350 con 0x7f82a40b4690 2022-01-10T01:25:01.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.801+0000 7f82a0ff9700 1 -- 172.21.15.36:0/3764555786 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v33) v1 ==== 125+0+0 (secure 0 0 0) 0x7f828c018030 con 0x7f82a40b4690 2022-01-10T01:25:01.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.805+0000 7f82aa1cd700 1 -- 172.21.15.36:0/3764555786 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8288053680 msgr2=0x7f8288055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:01.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.805+0000 7f82aa1cd700 1 --2- 172.21.15.36:0/3764555786 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8288053680 0x7f8288055b40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f829400b000 tx=0x7f8294006df0).stop 2022-01-10T01:25:01.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.805+0000 7f82aa1cd700 1 -- 172.21.15.36:0/3764555786 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82a40b4690 msgr2=0x7f82a40b01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:01.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.805+0000 7f82aa1cd700 1 --2- 172.21.15.36:0/3764555786 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82a40b4690 0x7f82a40b01e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f828c000ed0 tx=0x7f828c007a90).stop 2022-01-10T01:25:01.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.809+0000 7f82aa1cd700 1 -- 172.21.15.36:0/3764555786 shutdown_connections 2022-01-10T01:25:01.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.809+0000 7f82aa1cd700 1 --2- 172.21.15.36:0/3764555786 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8288053680 0x7f8288055b40 secure :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0x7f829400b000 tx=0x7f8294006df0).stop 2022-01-10T01:25:01.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.809+0000 7f82aa1cd700 1 --2- 172.21.15.36:0/3764555786 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82a4146950 0x7f82a4148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:01.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.809+0000 7f82aa1cd700 1 --2- 172.21.15.36:0/3764555786 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82a40b4690 0x7f82a40b01e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:01.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.809+0000 7f82aa1cd700 1 --2- 172.21.15.36:0/3764555786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82a40b4180 0x7f82a40ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:01.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.809+0000 7f82aa1cd700 1 -- 172.21.15.36:0/3764555786 >> 172.21.15.36:0/3764555786 conn(0x7f82a405c490 msgr2=0x7f82a40b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:01.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.809+0000 7f82aa1cd700 1 -- 172.21.15.36:0/3764555786 shutdown_connections 2022-01-10T01:25:01.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.809+0000 7f82aa1cd700 1 -- 172.21.15.36:0/3764555786 wait complete. 2022-01-10T01:25:01.817 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' created 2022-01-10T01:25:01.828 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-10T01:25:01.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.937+0000 7f05d1215700 1 Processor -- start 2022-01-10T01:25:01.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.937+0000 7f05d1215700 1 -- start start 2022-01-10T01:25:01.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.937+0000 7f05d1215700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05cc0b43c0 0x7f05cc0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:01.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.937+0000 7f05d1215700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05cc1440b0 con 0x7f05cc0b6580 2022-01-10T01:25:01.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.937+0000 7f05d1215700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05cc143b70 con 0x7f05cc0b6960 2022-01-10T01:25:01.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.937+0000 7f05d1215700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05cc143e10 con 0x7f05cc0b43c0 2022-01-10T01:25:01.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.937+0000 7f05cad9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f05cc0b6580 0x7f05cc061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:32832/0 (socket says 172.21.15.36:32832) 2022-01-10T01:25:01.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.937+0000 7f05cad9d700 1 -- 172.21.15.36:0/1233927520 learned_addr learned my addr 172.21.15.36:0/1233927520 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:25:01.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.937+0000 7f05ca59c700 1 --2- 172.21.15.36:0/1233927520 >> v2:172.21.15.59:3300/0 conn(0x7f05cc0b43c0 0x7f05cc0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:01.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05c9d9b700 1 -- 172.21.15.36:0/1233927520 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577032543 0 0) 0x7f05cc1440b0 con 0x7f05cc0b6580 2022-01-10T01:25:01.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05c9d9b700 1 -- 172.21.15.36:0/1233927520 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05ac003260 con 0x7f05cc0b6580 2022-01-10T01:25:01.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05ca59c700 1 -- 172.21.15.36:0/1233927520 >> v1:172.21.15.59:6789/0 conn(0x7f05cc0b6960 legacy=0x7f05cc12ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:01.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05ca59c700 1 -- 172.21.15.36:0/1233927520 >> v1:172.21.15.36:6789/0 conn(0x7f05cc0b6580 legacy=0x7f05cc061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:01.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05ca59c700 1 -- 172.21.15.36:0/1233927520 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc0615f0 con 0x7f05cc0b43c0 2022-01-10T01:25:01.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05ca59c700 1 --2- 172.21.15.36:0/1233927520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05cc0b43c0 0x7f05cc0b5bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f05cc143120 tx=0x7f05bc006df0).ready entity=mon.1 client_cookie=44237111551bae67 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:01.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05c9d9b700 1 -- 172.21.15.36:0/1233927520 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05bc00d610 con 0x7f05cc0b43c0 2022-01-10T01:25:01.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05c9d9b700 1 -- 172.21.15.36:0/1233927520 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc000e90 con 0x7f05cc0b43c0 2022-01-10T01:25:01.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05c9d9b700 1 -- 172.21.15.36:0/1233927520 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05bc00d960 con 0x7f05cc0b43c0 2022-01-10T01:25:01.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05d1215700 1 -- 172.21.15.36:0/1233927520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05cc0b43c0 msgr2=0x7f05cc0b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:01.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05d1215700 1 --2- 172.21.15.36:0/1233927520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05cc0b43c0 0x7f05cc0b5bf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f05cc143120 tx=0x7f05bc006df0).stop 2022-01-10T01:25:01.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05d1215700 1 -- 172.21.15.36:0/1233927520 shutdown_connections 2022-01-10T01:25:01.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05d1215700 1 --2- 172.21.15.36:0/1233927520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05cc0b43c0 0x7f05cc0b5bf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:01.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05d1215700 1 -- 172.21.15.36:0/1233927520 >> 172.21.15.36:0/1233927520 conn(0x7f05cc05c490 msgr2=0x7f05cc05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:01.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05d1215700 1 -- 172.21.15.36:0/1233927520 shutdown_connections 2022-01-10T01:25:01.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05d1215700 1 -- 172.21.15.36:0/1233927520 wait complete. 2022-01-10T01:25:01.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05d1215700 1 Processor -- start 2022-01-10T01:25:01.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.941+0000 7f05d1215700 1 -- start start 2022-01-10T01:25:01.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05d1215700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05cc0b43c0 0x7f05cc12b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:01.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05d1215700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05cc0b6580 0x7f05cc12a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:01.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05d1215700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f05cc0b6960 0x7f05cc148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:01.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05d1215700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc148540 con 0x7f05cc0b6960 2022-01-10T01:25:01.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05d1215700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc1264e0 con 0x7f05cc0b43c0 2022-01-10T01:25:01.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05d1215700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc1276c0 con 0x7f05cc0b6580 2022-01-10T01:25:01.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05cb59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f05cc0b6960 0x7f05cc148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:01.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05cb59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f05cc0b6960 0x7f05cc148970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35048/0 (socket says 172.21.15.36:35048) 2022-01-10T01:25:01.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05cb59e700 1 -- 172.21.15.36:0/3777134012 learned_addr learned my addr 172.21.15.36:0/3777134012 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:01.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05cad9d700 1 --2- 172.21.15.36:0/3777134012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05cc0b43c0 0x7f05cc12b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:01.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05ca59c700 1 --2- 172.21.15.36:0/3777134012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05cc0b6580 0x7f05cc12a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:01.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05cb59e700 1 -- 172.21.15.36:0/3777134012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05cc0b6580 msgr2=0x7f05cc12a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:01.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05cb59e700 1 --2- 172.21.15.36:0/3777134012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05cc0b6580 0x7f05cc12a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:01.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05cb59e700 1 -- 172.21.15.36:0/3777134012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05cc0b43c0 msgr2=0x7f05cc12b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:01.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05cb59e700 1 --2- 172.21.15.36:0/3777134012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05cc0b43c0 0x7f05cc12b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:01.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05cb59e700 1 -- 172.21.15.36:0/3777134012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc00b180 con 0x7f05cc0b6960 2022-01-10T01:25:01.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05cb59e700 1 --2- 172.21.15.36:0/3777134012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f05cc0b6960 0x7f05cc148970 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f05cc0608b0 tx=0x7f05c40013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:01.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05c3fff700 1 -- 172.21.15.36:0/3777134012 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05c4006aa0 con 0x7f05cc0b6960 2022-01-10T01:25:01.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05c3fff700 1 -- 172.21.15.36:0/3777134012 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c4006c00 con 0x7f05cc0b6960 2022-01-10T01:25:01.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05c3fff700 1 -- 172.21.15.36:0/3777134012 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f05c4007030 con 0x7f05cc0b6960 2022-01-10T01:25:01.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05d1215700 1 -- 172.21.15.36:0/3777134012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05cc127960 con 0x7f05cc0b6960 2022-01-10T01:25:01.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.945+0000 7f05d1215700 1 -- 172.21.15.36:0/3777134012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05cc148e60 con 0x7f05cc0b6960 2022-01-10T01:25:01.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.949+0000 7f05d1215700 1 -- 172.21.15.36:0/3777134012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05cc148680 con 0x7f05cc0b6960 2022-01-10T01:25:01.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.949+0000 7f05c3fff700 1 -- 172.21.15.36:0/3777134012 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f05c4010030 con 0x7f05cc0b6960 2022-01-10T01:25:01.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.949+0000 7f05c3fff700 1 --2- 172.21.15.36:0/3777134012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f05b0053560 0x7f05b0055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:01.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.949+0000 7f05c3fff700 1 -- 172.21.15.36:0/3777134012 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f05c406b740 con 0x7f05cc0b6960 2022-01-10T01:25:01.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.949+0000 7f05cad9d700 1 --2- 172.21.15.36:0/3777134012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f05b0053560 0x7f05b0055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:01.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.949+0000 7f05cad9d700 1 --2- 172.21.15.36:0/3777134012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f05b0053560 0x7f05b0055a20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f05b400d000 tx=0x7f05b4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:01.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:01.957+0000 7f05c3fff700 1 -- 172.21.15.36:0/3777134012 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f05c40427d0 con 0x7f05cc0b6960 2022-01-10T01:25:02.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.137+0000 7f05d1215700 1 -- 172.21.15.36:0/3777134012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f05cc061890 con 0x7f05cc0b6960 2022-01-10T01:25:02.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.145+0000 7f05c3fff700 1 -- 172.21.15.36:0/3777134012 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 187+0+0 (secure 0 0 0) 0x7f05c4045df0 con 0x7f05cc0b6960 2022-01-10T01:25:02.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.149+0000 7f05d1215700 1 -- 172.21.15.36:0/3777134012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f05b0053560 msgr2=0x7f05b0055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.149+0000 7f05d1215700 1 --2- 172.21.15.36:0/3777134012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f05b0053560 0x7f05b0055a20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f05b400d000 tx=0x7f05b4009040).stop 2022-01-10T01:25:02.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.149+0000 7f05d1215700 1 -- 172.21.15.36:0/3777134012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f05cc0b6960 msgr2=0x7f05cc148970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.149+0000 7f05d1215700 1 --2- 172.21.15.36:0/3777134012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f05cc0b6960 0x7f05cc148970 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f05cc0608b0 tx=0x7f05c40013a0).stop 2022-01-10T01:25:02.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.153+0000 7f05d1215700 1 -- 172.21.15.36:0/3777134012 shutdown_connections 2022-01-10T01:25:02.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.153+0000 7f05d1215700 1 --2- 172.21.15.36:0/3777134012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f05b0053560 0x7f05b0055a20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.153+0000 7f05d1215700 1 --2- 172.21.15.36:0/3777134012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f05cc0b6960 0x7f05cc148970 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.153+0000 7f05d1215700 1 --2- 172.21.15.36:0/3777134012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05cc0b6580 0x7f05cc12a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.153+0000 7f05d1215700 1 --2- 172.21.15.36:0/3777134012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05cc0b43c0 0x7f05cc12b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.153+0000 7f05d1215700 1 -- 172.21.15.36:0/3777134012 >> 172.21.15.36:0/3777134012 conn(0x7f05cc05c490 msgr2=0x7f05cc061c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:02.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.153+0000 7f05d1215700 1 -- 172.21.15.36:0/3777134012 shutdown_connections 2022-01-10T01:25:02.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.153+0000 7f05d1215700 1 -- 172.21.15.36:0/3777134012 wait complete. 2022-01-10T01:25:02.159 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 5 and data pool 6 2022-01-10T01:25:02.171 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:25:02.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd8eaf700 1 Processor -- start 2022-01-10T01:25:02.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd8eaf700 1 -- start start 2022-01-10T01:25:02.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd8eaf700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbcd40af2c0 0x7fbcd40af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd8eaf700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd40afda0 con 0x7fbcd40ad850 2022-01-10T01:25:02.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd8eaf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd405c610 con 0x7fbcd40ad320 2022-01-10T01:25:02.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd8eaf700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd4140800 con 0x7fbcd40af2c0 2022-01-10T01:25:02.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd37fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbcd40af2c0 0x7fbcd40af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd37fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbcd40af2c0 0x7fbcd40af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35060/0 (socket says 172.21.15.36:35060) 2022-01-10T01:25:02.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd37fe700 1 -- 172.21.15.36:0/3841648038 learned_addr learned my addr 172.21.15.36:0/3841648038 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:02.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd37fe700 1 -- 172.21.15.36:0/3841648038 >> v1:172.21.15.59:6789/0 conn(0x7fbcd40ad320 legacy=0x7fbcd4143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd37fe700 1 -- 172.21.15.36:0/3841648038 >> v1:172.21.15.36:6789/0 conn(0x7fbcd40ad850 legacy=0x7fbcd40a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd37fe700 1 -- 172.21.15.36:0/3841648038 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd4143860 con 0x7fbcd40af2c0 2022-01-10T01:25:02.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd27fc700 1 -- 172.21.15.36:0/3841648038 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134122850 0 0) 0x7fbcd40afda0 con 0x7fbcd40ad850 2022-01-10T01:25:02.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd37fe700 1 --2- 172.21.15.36:0/3841648038 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbcd40af2c0 0x7fbcd40af6a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fbcd40ad770 tx=0x7fbcc4006eb0).ready entity=mon.0 client_cookie=2c06797a8a097d5e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:02.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd27fc700 1 -- 172.21.15.36:0/3841648038 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcc400d660 con 0x7fbcd40af2c0 2022-01-10T01:25:02.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd27fc700 1 -- 172.21.15.36:0/3841648038 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc4000e90 con 0x7fbcd40af2c0 2022-01-10T01:25:02.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.265+0000 7fbcd27fc700 1 -- 172.21.15.36:0/3841648038 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcc400d9b0 con 0x7fbcd40af2c0 2022-01-10T01:25:02.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/3841648038 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbcd40af2c0 msgr2=0x7fbcd40af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 --2- 172.21.15.36:0/3841648038 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbcd40af2c0 0x7fbcd40af6a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fbcd40ad770 tx=0x7fbcc4006eb0).stop 2022-01-10T01:25:02.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/3841648038 shutdown_connections 2022-01-10T01:25:02.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 --2- 172.21.15.36:0/3841648038 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbcd40af2c0 0x7fbcd40af6a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/3841648038 >> 172.21.15.36:0/3841648038 conn(0x7fbcd4061140 msgr2=0x7fbcd4062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:02.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/3841648038 shutdown_connections 2022-01-10T01:25:02.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/3841648038 wait complete. 2022-01-10T01:25:02.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 Processor -- start 2022-01-10T01:25:02.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 -- start start 2022-01-10T01:25:02.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcd40ad320 0x7fbcd4142f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcd40ad850 0x7fbcd40ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbcd40af2c0 0x7fbcd40636d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd40b4560 con 0x7fbcd40af2c0 2022-01-10T01:25:02.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd41535a0 con 0x7fbcd40ad320 2022-01-10T01:25:02.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd8eaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd40aac60 con 0x7fbcd40ad850 2022-01-10T01:25:02.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd3fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbcd40af2c0 0x7fbcd40636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd3fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbcd40af2c0 0x7fbcd40636d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35070/0 (socket says 172.21.15.36:35070) 2022-01-10T01:25:02.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd3fff700 1 -- 172.21.15.36:0/254555552 learned_addr learned my addr 172.21.15.36:0/254555552 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:02.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd2ffd700 1 --2- 172.21.15.36:0/254555552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcd40ad850 0x7fbcd40ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.269+0000 7fbcd37fe700 1 --2- 172.21.15.36:0/254555552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcd40ad320 0x7fbcd4142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd3fff700 1 -- 172.21.15.36:0/254555552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcd40ad850 msgr2=0x7fbcd40ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd3fff700 1 --2- 172.21.15.36:0/254555552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcd40ad850 0x7fbcd40ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd3fff700 1 -- 172.21.15.36:0/254555552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcd40ad320 msgr2=0x7fbcd4142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd3fff700 1 --2- 172.21.15.36:0/254555552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcd40ad320 0x7fbcd4142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd3fff700 1 -- 172.21.15.36:0/254555552 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc400b1e0 con 0x7fbcd40af2c0 2022-01-10T01:25:02.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd3fff700 1 --2- 172.21.15.36:0/254555552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbcd40af2c0 0x7fbcd40636d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fbcd40aaf70 tx=0x7fbccc007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:02.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd0ff9700 1 -- 172.21.15.36:0/254555552 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbccc00f470 con 0x7fbcd40af2c0 2022-01-10T01:25:02.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd0ff9700 1 -- 172.21.15.36:0/254555552 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc00f5d0 con 0x7fbcd40af2c0 2022-01-10T01:25:02.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/254555552 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd4153090 con 0x7fbcd40af2c0 2022-01-10T01:25:02.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd0ff9700 1 -- 172.21.15.36:0/254555552 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbccc00f930 con 0x7fbcd40af2c0 2022-01-10T01:25:02.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/254555552 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd40b40c0 con 0x7fbcd40af2c0 2022-01-10T01:25:02.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/254555552 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd4057350 con 0x7fbcd40af2c0 2022-01-10T01:25:02.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd0ff9700 1 -- 172.21.15.36:0/254555552 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbccc019030 con 0x7fbcd40af2c0 2022-01-10T01:25:02.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd0ff9700 1 --2- 172.21.15.36:0/254555552 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbcb4053620 0x7fbcb4055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd0ff9700 1 -- 172.21.15.36:0/254555552 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbccc06b0a0 con 0x7fbcd40af2c0 2022-01-10T01:25:02.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.273+0000 7fbcd37fe700 1 --2- 172.21.15.36:0/254555552 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbcb4053620 0x7fbcb4055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.277+0000 7fbcd37fe700 1 --2- 172.21.15.36:0/254555552 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbcb4053620 0x7fbcb4055ae0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fbcc401b000 tx=0x7fbcc4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:02.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.281+0000 7fbcd0ff9700 1 -- 172.21.15.36:0/254555552 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbccc0420b0 con 0x7fbcd40af2c0 2022-01-10T01:25:02.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.409+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/254555552 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcd40afd10 con 0x7fbcd40af2c0 2022-01-10T01:25:02.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.409+0000 7fbcd0ff9700 1 -- 172.21.15.36:0/254555552 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16297 (secure 0 0 0) 0x7fbccc0456d0 con 0x7fbcd40af2c0 2022-01-10T01:25:02.415 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:25:02.416 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":34,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:25:02.143287+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:25:00.402523+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2022-01-10T01:25:01.119067+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:25:02.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.413+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/254555552 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbcb4053620 msgr2=0x7fbcb4055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.413+0000 7fbcd8eaf700 1 --2- 172.21.15.36:0/254555552 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbcb4053620 0x7fbcb4055ae0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fbcc401b000 tx=0x7fbcc4015000).stop 2022-01-10T01:25:02.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.413+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/254555552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbcd40af2c0 msgr2=0x7fbcd40636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.413+0000 7fbcd8eaf700 1 --2- 172.21.15.36:0/254555552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbcd40af2c0 0x7fbcd40636d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fbcd40aaf70 tx=0x7fbccc007dc0).stop 2022-01-10T01:25:02.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.413+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/254555552 shutdown_connections 2022-01-10T01:25:02.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.413+0000 7fbcd8eaf700 1 --2- 172.21.15.36:0/254555552 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbcb4053620 0x7fbcb4055ae0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.413+0000 7fbcd8eaf700 1 --2- 172.21.15.36:0/254555552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbcd40af2c0 0x7fbcd40636d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.413+0000 7fbcd8eaf700 1 --2- 172.21.15.36:0/254555552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcd40ad850 0x7fbcd40ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.413+0000 7fbcd8eaf700 1 --2- 172.21.15.36:0/254555552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcd40ad320 0x7fbcd4142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.413+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/254555552 >> 172.21.15.36:0/254555552 conn(0x7fbcd4061140 msgr2=0x7fbcd413cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:02.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.413+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/254555552 shutdown_connections 2022-01-10T01:25:02.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.413+0000 7fbcd8eaf700 1 -- 172.21.15.36:0/254555552 wait complete. 2022-01-10T01:25:02.429 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:25:02.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.529+0000 7fdc9b59e700 1 Processor -- start 2022-01-10T01:25:02.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.529+0000 7fdc9b59e700 1 -- start start 2022-01-10T01:25:02.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.529+0000 7fdc9b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc9c0b0010 0x7fdc9c0a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.529+0000 7fdc9b59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9c0a70c0 con 0x7fdc9c0b2580 2022-01-10T01:25:02.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.529+0000 7fdc9b59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9c0a72f0 con 0x7fdc9c0afbd0 2022-01-10T01:25:02.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.529+0000 7fdc9b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c0a7590 con 0x7fdc9c0b0010 2022-01-10T01:25:02.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.529+0000 7fdc9a59c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fdc9c0b2580 0x7fdc9c14ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:32870/0 (socket says 172.21.15.36:32870) 2022-01-10T01:25:02.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.529+0000 7fdc9a59c700 1 -- 172.21.15.36:0/987674587 learned_addr learned my addr 172.21.15.36:0/987674587 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:25:02.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.529+0000 7fdc99d9b700 1 --2- 172.21.15.36:0/987674587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc9c0b0010 0x7fdc9c0a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9959a700 1 -- 172.21.15.36:0/987674587 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412892664 0 0) 0x7fdc9c0a70c0 con 0x7fdc9c0b2580 2022-01-10T01:25:02.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9959a700 1 -- 172.21.15.36:0/987674587 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc80003260 con 0x7fdc9c0b2580 2022-01-10T01:25:02.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9959a700 1 -- 172.21.15.36:0/987674587 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667206181 0 0) 0x7fdc9c0a72f0 con 0x7fdc9c0afbd0 2022-01-10T01:25:02.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9959a700 1 -- 172.21.15.36:0/987674587 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc9c0a70c0 con 0x7fdc9c0afbd0 2022-01-10T01:25:02.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc99d9b700 1 -- 172.21.15.36:0/987674587 >> v1:172.21.15.59:6789/0 conn(0x7fdc9c0afbd0 legacy=0x7fdc9c151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc99d9b700 1 -- 172.21.15.36:0/987674587 >> v1:172.21.15.36:6789/0 conn(0x7fdc9c0b2580 legacy=0x7fdc9c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9959a700 1 -- 172.21.15.36:0/987674587 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1660540566 0 0) 0x7fdc80003260 con 0x7fdc9c0b2580 2022-01-10T01:25:02.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc99d9b700 1 -- 172.21.15.36:0/987674587 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c0a7830 con 0x7fdc9c0b0010 2022-01-10T01:25:02.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc99d9b700 1 --2- 172.21.15.36:0/987674587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc9c0b0010 0x7fdc9c0a83b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdc8c0032f0 tx=0x7fdc8c0091d0).ready entity=mon.2 client_cookie=9122794a180a4dce server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:02.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9959a700 1 -- 172.21.15.36:0/987674587 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc8c00b640 con 0x7fdc9c0b0010 2022-01-10T01:25:02.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9959a700 1 -- 172.21.15.36:0/987674587 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c00b7a0 con 0x7fdc9c0b0010 2022-01-10T01:25:02.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9959a700 1 -- 172.21.15.36:0/987674587 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc8c00b910 con 0x7fdc9c0b0010 2022-01-10T01:25:02.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9b59e700 1 -- 172.21.15.36:0/987674587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc9c0b0010 msgr2=0x7fdc9c0a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9b59e700 1 --2- 172.21.15.36:0/987674587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc9c0b0010 0x7fdc9c0a83b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fdc8c0032f0 tx=0x7fdc8c0091d0).stop 2022-01-10T01:25:02.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9b59e700 1 -- 172.21.15.36:0/987674587 shutdown_connections 2022-01-10T01:25:02.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9b59e700 1 --2- 172.21.15.36:0/987674587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc9c0b0010 0x7fdc9c0a83b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9b59e700 1 -- 172.21.15.36:0/987674587 >> 172.21.15.36:0/987674587 conn(0x7fdc9c060180 msgr2=0x7fdc9c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:02.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9b59e700 1 -- 172.21.15.36:0/987674587 shutdown_connections 2022-01-10T01:25:02.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9b59e700 1 -- 172.21.15.36:0/987674587 wait complete. 2022-01-10T01:25:02.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9b59e700 1 Processor -- start 2022-01-10T01:25:02.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.533+0000 7fdc9b59e700 1 -- start start 2022-01-10T01:25:02.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc9b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc9c0afbd0 0x7fdc9c156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc9b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc9c0b0010 0x7fdc9c05cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc9b59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc9c0b2580 0x7fdc9c159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc9b59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c0b4220 con 0x7fdc9c0b0010 2022-01-10T01:25:02.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc9b59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c14cd20 con 0x7fdc9c0b2580 2022-01-10T01:25:02.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc9b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c0b3660 con 0x7fdc9c0afbd0 2022-01-10T01:25:02.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc99d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc9c0b0010 0x7fdc9c05cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc99d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc9c0b0010 0x7fdc9c05cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35082/0 (socket says 172.21.15.36:35082) 2022-01-10T01:25:02.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc99d9b700 1 -- 172.21.15.36:0/1104577544 learned_addr learned my addr 172.21.15.36:0/1104577544 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:02.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc9a59c700 1 --2- 172.21.15.36:0/1104577544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc9c0afbd0 0x7fdc9c156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc9ad9d700 1 --2- 172.21.15.36:0/1104577544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc9c0b2580 0x7fdc9c159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc99d9b700 1 -- 172.21.15.36:0/1104577544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc9c0afbd0 msgr2=0x7fdc9c156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc99d9b700 1 --2- 172.21.15.36:0/1104577544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc9c0afbd0 0x7fdc9c156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc99d9b700 1 -- 172.21.15.36:0/1104577544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc9c0b2580 msgr2=0x7fdc9c159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc99d9b700 1 --2- 172.21.15.36:0/1104577544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc9c0b2580 0x7fdc9c159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc99d9b700 1 -- 172.21.15.36:0/1104577544 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c009470 con 0x7fdc9c0b0010 2022-01-10T01:25:02.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc99d9b700 1 --2- 172.21.15.36:0/1104577544 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc9c0b0010 0x7fdc9c05cbd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fdc8c0032f0 tx=0x7fdc8c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:02.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc8b7fe700 1 -- 172.21.15.36:0/1104577544 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc8c00b910 con 0x7fdc9c0b0010 2022-01-10T01:25:02.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc8b7fe700 1 -- 172.21.15.36:0/1104577544 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c011e00 con 0x7fdc9c0b0010 2022-01-10T01:25:02.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc9b59e700 1 -- 172.21.15.36:0/1104577544 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9c0b3900 con 0x7fdc9c0b0010 2022-01-10T01:25:02.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc8b7fe700 1 -- 172.21.15.36:0/1104577544 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc8c00b640 con 0x7fdc9c0b0010 2022-01-10T01:25:02.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc9b59e700 1 -- 172.21.15.36:0/1104577544 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9c0b2f70 con 0x7fdc9c0b0010 2022-01-10T01:25:02.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.537+0000 7fdc9b59e700 1 -- 172.21.15.36:0/1104577544 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9c0b3a90 con 0x7fdc9c0b0010 2022-01-10T01:25:02.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.541+0000 7fdc8b7fe700 1 -- 172.21.15.36:0/1104577544 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fdc8c026030 con 0x7fdc9c0b0010 2022-01-10T01:25:02.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.541+0000 7fdc8b7fe700 1 --2- 172.21.15.36:0/1104577544 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdc780535f0 0x7fdc78055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.541+0000 7fdc8b7fe700 1 -- 172.21.15.36:0/1104577544 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdc8c06c710 con 0x7fdc9c0b0010 2022-01-10T01:25:02.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.541+0000 7fdc9a59c700 1 --2- 172.21.15.36:0/1104577544 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdc780535f0 0x7fdc78055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.541+0000 7fdc9a59c700 1 --2- 172.21.15.36:0/1104577544 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdc780535f0 0x7fdc78055ab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fdc9000d000 tx=0x7fdc900079e0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:02.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.549+0000 7fdc8b7fe700 1 -- 172.21.15.36:0/1104577544 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdc8c043610 con 0x7fdc9c0b0010 2022-01-10T01:25:02.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.677+0000 7fdc9b59e700 1 -- 172.21.15.36:0/1104577544 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc9c057350 con 0x7fdc9c0b0010 2022-01-10T01:25:02.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.677+0000 7fdc8b7fe700 1 -- 172.21.15.36:0/1104577544 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16297 (secure 0 0 0) 0x7fdc8c015090 con 0x7fdc9c0b0010 2022-01-10T01:25:02.683 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:25:02.684 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":34,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:25:02.143287+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:25:00.402523+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2022-01-10T01:25:01.119067+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:25:02.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.681+0000 7fdc9b59e700 1 -- 172.21.15.36:0/1104577544 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdc780535f0 msgr2=0x7fdc78055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.681+0000 7fdc9b59e700 1 --2- 172.21.15.36:0/1104577544 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdc780535f0 0x7fdc78055ab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fdc9000d000 tx=0x7fdc900079e0).stop 2022-01-10T01:25:02.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.681+0000 7fdc9b59e700 1 -- 172.21.15.36:0/1104577544 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc9c0b0010 msgr2=0x7fdc9c05cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.681+0000 7fdc9b59e700 1 --2- 172.21.15.36:0/1104577544 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc9c0b0010 0x7fdc9c05cbd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fdc8c0032f0 tx=0x7fdc8c016000).stop 2022-01-10T01:25:02.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.681+0000 7fdc9b59e700 1 -- 172.21.15.36:0/1104577544 shutdown_connections 2022-01-10T01:25:02.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.681+0000 7fdc9b59e700 1 --2- 172.21.15.36:0/1104577544 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdc780535f0 0x7fdc78055ab0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.681+0000 7fdc9b59e700 1 --2- 172.21.15.36:0/1104577544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc9c0b2580 0x7fdc9c159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.681+0000 7fdc9b59e700 1 --2- 172.21.15.36:0/1104577544 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdc9c0b0010 0x7fdc9c05cbd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.681+0000 7fdc9b59e700 1 --2- 172.21.15.36:0/1104577544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc9c0afbd0 0x7fdc9c156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.681+0000 7fdc9b59e700 1 -- 172.21.15.36:0/1104577544 >> 172.21.15.36:0/1104577544 conn(0x7fdc9c060180 msgr2=0x7fdc9c145340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:02.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.681+0000 7fdc9b59e700 1 -- 172.21.15.36:0/1104577544 shutdown_connections 2022-01-10T01:25:02.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.681+0000 7fdc9b59e700 1 -- 172.21.15.36:0/1104577544 wait complete. 2022-01-10T01:25:02.697 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-01-10T01:25:02.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.801+0000 7f1ad494f700 1 Processor -- start 2022-01-10T01:25:02.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.801+0000 7f1ad494f700 1 -- start start 2022-01-10T01:25:02.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.801+0000 7f1ad494f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad00ad320 0x7f1ad00af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.801+0000 7f1ad494f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ad00ad850 0x7f1ad00a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.801+0000 7f1ad494f700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad00afda0 con 0x7f1ad00af2c0 2022-01-10T01:25:02.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.801+0000 7f1acf7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f1ad00af2c0 0x7f1ad0143150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:32882/0 (socket says 172.21.15.36:32882) 2022-01-10T01:25:02.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.801+0000 7f1ad494f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad005c610 con 0x7f1ad00ad850 2022-01-10T01:25:02.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.801+0000 7f1acf7fe700 1 -- 172.21.15.36:0/3864827059 learned_addr learned my addr 172.21.15.36:0/3864827059 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:25:02.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.801+0000 7f1ad494f700 1 -- 172.21.15.36:0/3864827059 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad0140800 con 0x7f1ad00ad320 2022-01-10T01:25:02.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.801+0000 7f1aceffd700 1 --2- 172.21.15.36:0/3864827059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad00ad320 0x7f1ad00af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.801+0000 7f1acffff700 1 --2- 172.21.15.36:0/3864827059 >> v2:172.21.15.59:3300/0 conn(0x7f1ad00ad850 0x7f1ad00a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.801+0000 7f1ace7fc700 1 -- 172.21.15.36:0/3864827059 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834474154 0 0) 0x7f1ad00afda0 con 0x7f1ad00af2c0 2022-01-10T01:25:02.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.801+0000 7f1ace7fc700 1 -- 172.21.15.36:0/3864827059 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab0003260 con 0x7f1ad00af2c0 2022-01-10T01:25:02.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.801+0000 7f1ace7fc700 1 -- 172.21.15.36:0/3864827059 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 173089849 0 0) 0x7f1ab0003260 con 0x7f1ad00af2c0 2022-01-10T01:25:02.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1aceffd700 1 -- 172.21.15.36:0/3864827059 >> v2:172.21.15.59:3300/0 conn(0x7f1ad00ad850 msgr2=0x7f1ad00a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:02.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1aceffd700 1 --2- 172.21.15.36:0/3864827059 >> v2:172.21.15.59:3300/0 conn(0x7f1ad00ad850 0x7f1ad00a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1aceffd700 1 -- 172.21.15.36:0/3864827059 >> v1:172.21.15.36:6789/0 conn(0x7f1ad00af2c0 legacy=0x7f1ad0143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1aceffd700 1 -- 172.21.15.36:0/3864827059 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad0143860 con 0x7f1ad00ad320 2022-01-10T01:25:02.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1acffff700 1 --2- 172.21.15.36:0/3864827059 >> v2:172.21.15.59:3300/0 conn(0x7f1ad00ad850 0x7f1ad00a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:25:02.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1aceffd700 1 --2- 172.21.15.36:0/3864827059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad00ad320 0x7f1ad00af6a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1ac8001b80 tx=0x7f1ac0006df0).ready entity=mon.2 client_cookie=dab5184763c90bff server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:02.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1ace7fc700 1 -- 172.21.15.36:0/3864827059 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac80019e0 con 0x7f1ad00ad320 2022-01-10T01:25:02.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1ace7fc700 1 -- 172.21.15.36:0/3864827059 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac0000e90 con 0x7f1ad00ad320 2022-01-10T01:25:02.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1ace7fc700 1 -- 172.21.15.36:0/3864827059 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac0012460 con 0x7f1ad00ad320 2022-01-10T01:25:02.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1ad494f700 1 -- 172.21.15.36:0/3864827059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad00ad320 msgr2=0x7f1ad00af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1ad494f700 1 --2- 172.21.15.36:0/3864827059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad00ad320 0x7f1ad00af6a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1ac8001b80 tx=0x7f1ac0006df0).stop 2022-01-10T01:25:02.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1ad494f700 1 -- 172.21.15.36:0/3864827059 shutdown_connections 2022-01-10T01:25:02.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1ad494f700 1 --2- 172.21.15.36:0/3864827059 >> v2:172.21.15.59:3300/0 conn(0x7f1ad00ad850 0x7f1ad00a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1ad494f700 1 --2- 172.21.15.36:0/3864827059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad00ad320 0x7f1ad00af6a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1ad494f700 1 -- 172.21.15.36:0/3864827059 >> 172.21.15.36:0/3864827059 conn(0x7f1ad0061140 msgr2=0x7f1ad0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:02.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1ad494f700 1 -- 172.21.15.36:0/3864827059 shutdown_connections 2022-01-10T01:25:02.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.805+0000 7f1ad494f700 1 -- 172.21.15.36:0/3864827059 wait complete. 2022-01-10T01:25:02.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1ad494f700 1 Processor -- start 2022-01-10T01:25:02.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1ad494f700 1 -- start start 2022-01-10T01:25:02.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1ad494f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad00ad320 0x7f1ad005f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1ad494f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad00ad850 0x7f1ad00abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1ad494f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ad00af2c0 0x7f1ad01557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1ad494f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad00b6690 con 0x7f1ad00af2c0 2022-01-10T01:25:02.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1ad494f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad009e8b0 con 0x7f1ad00ad320 2022-01-10T01:25:02.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1ad494f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad009eae0 con 0x7f1ad00ad850 2022-01-10T01:25:02.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1acffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ad00af2c0 0x7f1ad01557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1acffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ad00af2c0 0x7f1ad01557f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35098/0 (socket says 172.21.15.36:35098) 2022-01-10T01:25:02.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1acffff700 1 -- 172.21.15.36:0/2263646487 learned_addr learned my addr 172.21.15.36:0/2263646487 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:02.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1aceffd700 1 --2- 172.21.15.36:0/2263646487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad00ad850 0x7f1ad00abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1acf7fe700 1 --2- 172.21.15.36:0/2263646487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad00ad320 0x7f1ad005f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1acffff700 1 -- 172.21.15.36:0/2263646487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad00ad850 msgr2=0x7f1ad00abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1acffff700 1 --2- 172.21.15.36:0/2263646487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad00ad850 0x7f1ad00abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1acffff700 1 -- 172.21.15.36:0/2263646487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad00ad320 msgr2=0x7f1ad005f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:02.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1acffff700 1 --2- 172.21.15.36:0/2263646487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad00ad320 0x7f1ad005f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:02.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1acffff700 1 -- 172.21.15.36:0/2263646487 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab800b180 con 0x7f1ad00af2c0 2022-01-10T01:25:02.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1acffff700 1 --2- 172.21.15.36:0/2263646487 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ad00af2c0 0x7f1ad01557f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f1ab800c000 tx=0x7f1ab8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:02.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1accff9700 1 -- 172.21.15.36:0/2263646487 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab8010590 con 0x7f1ad00af2c0 2022-01-10T01:25:02.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1accff9700 1 -- 172.21.15.36:0/2263646487 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab80106f0 con 0x7f1ad00af2c0 2022-01-10T01:25:02.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1ad494f700 1 -- 172.21.15.36:0/2263646487 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac000b180 con 0x7f1ad00af2c0 2022-01-10T01:25:02.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1accff9700 1 -- 172.21.15.36:0/2263646487 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab8010a50 con 0x7f1ad00af2c0 2022-01-10T01:25:02.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.809+0000 7f1ad494f700 1 -- 172.21.15.36:0/2263646487 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad00aabc0 con 0x7f1ad00af2c0 2022-01-10T01:25:02.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.813+0000 7f1ad494f700 1 -- 172.21.15.36:0/2263646487 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad0057350 con 0x7f1ad00af2c0 2022-01-10T01:25:02.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.813+0000 7f1accff9700 1 -- 172.21.15.36:0/2263646487 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1ab8010bb0 con 0x7f1ad00af2c0 2022-01-10T01:25:02.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.813+0000 7f1accff9700 1 --2- 172.21.15.36:0/2263646487 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ab40536b0 0x7f1ab4055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:02.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.813+0000 7f1accff9700 1 -- 172.21.15.36:0/2263646487 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1ab806be70 con 0x7f1ad00af2c0 2022-01-10T01:25:02.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.813+0000 7f1acf7fe700 1 --2- 172.21.15.36:0/2263646487 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ab40536b0 0x7f1ab4055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:02.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.813+0000 7f1acf7fe700 1 --2- 172.21.15.36:0/2263646487 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ab40536b0 0x7f1ab4055b70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f1ac800d000 tx=0x7f1ac80020c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:02.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.821+0000 7f1accff9700 1 -- 172.21.15.36:0/2263646487 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1ab8042e80 con 0x7f1ad00af2c0 2022-01-10T01:25:02.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:02.981+0000 7f1ad494f700 1 -- 172.21.15.36:0/2263646487 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1ad0061990 con 0x7f1ad00af2c0 2022-01-10T01:25:03.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.157+0000 7f1accff9700 1 -- 172.21.15.36:0/2263646487 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1ab80464a0 con 0x7f1ad00af2c0 2022-01-10T01:25:03.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.161+0000 7f1ad494f700 1 -- 172.21.15.36:0/2263646487 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ab40536b0 msgr2=0x7f1ab4055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.161+0000 7f1ad494f700 1 --2- 172.21.15.36:0/2263646487 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ab40536b0 0x7f1ab4055b70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f1ac800d000 tx=0x7f1ac80020c0).stop 2022-01-10T01:25:03.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.161+0000 7f1ad494f700 1 -- 172.21.15.36:0/2263646487 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ad00af2c0 msgr2=0x7f1ad01557f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.161+0000 7f1ad494f700 1 --2- 172.21.15.36:0/2263646487 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ad00af2c0 0x7f1ad01557f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f1ab800c000 tx=0x7f1ab8006df0).stop 2022-01-10T01:25:03.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.161+0000 7f1ad494f700 1 -- 172.21.15.36:0/2263646487 shutdown_connections 2022-01-10T01:25:03.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.161+0000 7f1ad494f700 1 --2- 172.21.15.36:0/2263646487 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ab40536b0 0x7f1ab4055b70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.161+0000 7f1ad494f700 1 --2- 172.21.15.36:0/2263646487 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ad00af2c0 0x7f1ad01557f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.161+0000 7f1ad494f700 1 --2- 172.21.15.36:0/2263646487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad00ad850 0x7f1ad00abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.161+0000 7f1ad494f700 1 --2- 172.21.15.36:0/2263646487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad00ad320 0x7f1ad005f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.161+0000 7f1ad494f700 1 -- 172.21.15.36:0/2263646487 >> 172.21.15.36:0/2263646487 conn(0x7f1ad0061140 msgr2=0x7f1ad00a8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:03.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.161+0000 7f1ad494f700 1 -- 172.21.15.36:0/2263646487 shutdown_connections 2022-01-10T01:25:03.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.161+0000 7f1ad494f700 1 -- 172.21.15.36:0/2263646487 wait complete. 2022-01-10T01:25:03.180 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:25:03.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.285+0000 7f24b525c700 1 Processor -- start 2022-01-10T01:25:03.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.285+0000 7f24b525c700 1 -- start start 2022-01-10T01:25:03.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.285+0000 7f24b525c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f24b00b1db0 0x7f24b00b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.285+0000 7f24b525c700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b00b0350 con 0x7f24b00a70c0 2022-01-10T01:25:03.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.285+0000 7f24b525c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b00b05f0 con 0x7f24b01483a0 2022-01-10T01:25:03.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.285+0000 7f24b525c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b00a90c0 con 0x7f24b00b1db0 2022-01-10T01:25:03.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.285+0000 7f24aed9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f24b00b1db0 0x7f24b00b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.285+0000 7f24aed9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f24b00b1db0 0x7f24b00b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35102/0 (socket says 172.21.15.36:35102) 2022-01-10T01:25:03.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.285+0000 7f24aed9d700 1 -- 172.21.15.36:0/1317274042 learned_addr learned my addr 172.21.15.36:0/1317274042 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:03.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.285+0000 7f24aed9d700 1 -- 172.21.15.36:0/1317274042 >> v1:172.21.15.59:6789/0 conn(0x7f24b01483a0 legacy=0x7f24b00b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.285+0000 7f24aed9d700 1 -- 172.21.15.36:0/1317274042 >> v1:172.21.15.36:6789/0 conn(0x7f24b00a70c0 legacy=0x7f24b0144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:03.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.285+0000 7f24aed9d700 1 -- 172.21.15.36:0/1317274042 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b00b0890 con 0x7f24b00b1db0 2022-01-10T01:25:03.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.285+0000 7f24aed9d700 1 --2- 172.21.15.36:0/1317274042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24b00b1db0 0x7f24b00b0fd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f24b00ace60 tx=0x7f24a0006eb0).ready entity=mon.0 client_cookie=394dc13bda5c4d6c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:03.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.285+0000 7f24add9b700 1 -- 172.21.15.36:0/1317274042 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24a000d5c0 con 0x7f24b00b1db0 2022-01-10T01:25:03.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.289+0000 7f24add9b700 1 -- 172.21.15.36:0/1317274042 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a0000e90 con 0x7f24b00b1db0 2022-01-10T01:25:03.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.289+0000 7f24add9b700 1 -- 172.21.15.36:0/1317274042 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24a000d950 con 0x7f24b00b1db0 2022-01-10T01:25:03.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.289+0000 7f24b525c700 1 -- 172.21.15.36:0/1317274042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24b00b1db0 msgr2=0x7f24b00b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.289+0000 7f24b525c700 1 --2- 172.21.15.36:0/1317274042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24b00b1db0 0x7f24b00b0fd0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f24b00ace60 tx=0x7f24a0006eb0).stop 2022-01-10T01:25:03.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.289+0000 7f24b525c700 1 -- 172.21.15.36:0/1317274042 shutdown_connections 2022-01-10T01:25:03.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.289+0000 7f24b525c700 1 --2- 172.21.15.36:0/1317274042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24b00b1db0 0x7f24b00b0fd0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.289+0000 7f24b525c700 1 -- 172.21.15.36:0/1317274042 >> 172.21.15.36:0/1317274042 conn(0x7f24b005f6b0 msgr2=0x7f24b005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:03.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.289+0000 7f24b525c700 1 -- 172.21.15.36:0/1317274042 shutdown_connections 2022-01-10T01:25:03.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.289+0000 7f24b525c700 1 -- 172.21.15.36:0/1317274042 wait complete. 2022-01-10T01:25:03.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24b525c700 1 Processor -- start 2022-01-10T01:25:03.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24b525c700 1 -- start start 2022-01-10T01:25:03.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24b525c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b00a70c0 0x7f24b00b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24b525c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24b00b1db0 0x7f24b00a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24b525c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24b01483a0 0x7f24b015a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24b525c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b00ab230 con 0x7f24b01483a0 2022-01-10T01:25:03.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24b525c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b00ab4d0 con 0x7f24b00a70c0 2022-01-10T01:25:03.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24b525c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b00ab770 con 0x7f24b00b1db0 2022-01-10T01:25:03.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24af59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24b01483a0 0x7f24b015a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24af59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24b01483a0 0x7f24b015a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35112/0 (socket says 172.21.15.36:35112) 2022-01-10T01:25:03.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24af59e700 1 -- 172.21.15.36:0/2414020369 learned_addr learned my addr 172.21.15.36:0/2414020369 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:03.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24aed9d700 1 --2- 172.21.15.36:0/2414020369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b00a70c0 0x7f24b00b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24ae59c700 1 --2- 172.21.15.36:0/2414020369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24b00b1db0 0x7f24b00a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24af59e700 1 -- 172.21.15.36:0/2414020369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24b00b1db0 msgr2=0x7f24b00a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24af59e700 1 --2- 172.21.15.36:0/2414020369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24b00b1db0 0x7f24b00a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24af59e700 1 -- 172.21.15.36:0/2414020369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b00a70c0 msgr2=0x7f24b00b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24af59e700 1 --2- 172.21.15.36:0/2414020369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b00a70c0 0x7f24b00b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24af59e700 1 -- 172.21.15.36:0/2414020369 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a000b1e0 con 0x7f24b01483a0 2022-01-10T01:25:03.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24af59e700 1 --2- 172.21.15.36:0/2414020369 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24b01483a0 0x7f24b015a040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f24a8002320 tx=0x7f24a80023f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:03.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f249ffff700 1 -- 172.21.15.36:0/2414020369 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24a8006aa0 con 0x7f24b01483a0 2022-01-10T01:25:03.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f249ffff700 1 -- 172.21.15.36:0/2414020369 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a8006c00 con 0x7f24b01483a0 2022-01-10T01:25:03.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24b525c700 1 -- 172.21.15.36:0/2414020369 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b00a9930 con 0x7f24b01483a0 2022-01-10T01:25:03.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f249ffff700 1 -- 172.21.15.36:0/2414020369 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24a8007030 con 0x7f24b01483a0 2022-01-10T01:25:03.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f24b525c700 1 -- 172.21.15.36:0/2414020369 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b00abe30 con 0x7f24b01483a0 2022-01-10T01:25:03.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.293+0000 7f249ffff700 1 -- 172.21.15.36:0/2414020369 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f24a8010030 con 0x7f24b01483a0 2022-01-10T01:25:03.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.297+0000 7f24b525c700 1 -- 172.21.15.36:0/2414020369 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b00b0b30 con 0x7f24b01483a0 2022-01-10T01:25:03.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.297+0000 7f249ffff700 1 --2- 172.21.15.36:0/2414020369 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f248c0535f0 0x7f248c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.297+0000 7f249ffff700 1 -- 172.21.15.36:0/2414020369 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f24a806b970 con 0x7f24b01483a0 2022-01-10T01:25:03.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.297+0000 7f24aed9d700 1 --2- 172.21.15.36:0/2414020369 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f248c0535f0 0x7f248c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.297+0000 7f24aed9d700 1 --2- 172.21.15.36:0/2414020369 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f248c0535f0 0x7f248c055ab0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f24a001b000 tx=0x7f24a0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:03.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.301+0000 7f249ffff700 1 -- 172.21.15.36:0/2414020369 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f24a8042980 con 0x7f24b01483a0 2022-01-10T01:25:03.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.461+0000 7f24b525c700 1 -- 172.21.15.36:0/2414020369 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24b0057350 con 0x7f24b01483a0 2022-01-10T01:25:03.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.465+0000 7f249ffff700 1 -- 172.21.15.36:0/2414020369 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f24a8045fa0 con 0x7f24b01483a0 2022-01-10T01:25:03.468 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:25:03.469 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1410680575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1410680575},{"type":"v1","addr":"172.21.15.36:6837","nonce":1410680575}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/1811767033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1811767033},{"type":"v1","addr":"172.21.15.59:6833","nonce":1811767033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:25:02.143464+0000","modified":"2022-01-10T01:25:03.146833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/2488750467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2488750467},{"type":"v1","addr":"172.21.15.36:6835","nonce":2488750467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2022-01-10T01:25:03.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.465+0000 7f24b525c700 1 -- 172.21.15.36:0/2414020369 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f248c0535f0 msgr2=0x7f248c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.465+0000 7f24b525c700 1 --2- 172.21.15.36:0/2414020369 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f248c0535f0 0x7f248c055ab0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f24a001b000 tx=0x7f24a0015000).stop 2022-01-10T01:25:03.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.465+0000 7f24b525c700 1 -- 172.21.15.36:0/2414020369 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24b01483a0 msgr2=0x7f24b015a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.465+0000 7f24b525c700 1 --2- 172.21.15.36:0/2414020369 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24b01483a0 0x7f24b015a040 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f24a8002320 tx=0x7f24a80023f0).stop 2022-01-10T01:25:03.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.465+0000 7f24b525c700 1 -- 172.21.15.36:0/2414020369 shutdown_connections 2022-01-10T01:25:03.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.465+0000 7f24b525c700 1 --2- 172.21.15.36:0/2414020369 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f248c0535f0 0x7f248c055ab0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.465+0000 7f24b525c700 1 --2- 172.21.15.36:0/2414020369 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24b01483a0 0x7f24b015a040 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.465+0000 7f24b525c700 1 --2- 172.21.15.36:0/2414020369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24b00b1db0 0x7f24b00a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.465+0000 7f24b525c700 1 --2- 172.21.15.36:0/2414020369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24b00a70c0 0x7f24b00b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.465+0000 7f24b525c700 1 -- 172.21.15.36:0/2414020369 >> 172.21.15.36:0/2414020369 conn(0x7f24b005f6b0 msgr2=0x7f24b0144930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:03.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.465+0000 7f24b525c700 1 -- 172.21.15.36:0/2414020369 shutdown_connections 2022-01-10T01:25:03.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.465+0000 7f24b525c700 1 -- 172.21.15.36:0/2414020369 wait complete. 2022-01-10T01:25:03.475 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 13 2022-01-10T01:25:03.485 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:25:03.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.585+0000 7fcc5cfc3700 1 Processor -- start 2022-01-10T01:25:03.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.585+0000 7fcc5cfc3700 1 -- start start 2022-01-10T01:25:03.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.585+0000 7fcc5cfc3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc580b2580 0x7fcc5814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.585+0000 7fcc5cfc3700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc580a70c0 con 0x7fcc580b0010 2022-01-10T01:25:03.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.585+0000 7fcc5cfc3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc580a72f0 con 0x7fcc580a8ac0 2022-01-10T01:25:03.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.585+0000 7fcc5cfc3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc580a7590 con 0x7fcc580b2580 2022-01-10T01:25:03.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.585+0000 7fcc56ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fcc580b0010 0x7fcc580a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:32910/0 (socket says 172.21.15.36:32910) 2022-01-10T01:25:03.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.585+0000 7fcc56ffd700 1 -- 172.21.15.36:0/3143327614 learned_addr learned my addr 172.21.15.36:0/3143327614 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:25:03.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.585+0000 7fcc577fe700 1 --2- 172.21.15.36:0/3143327614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc580b2580 0x7fcc5814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc567fc700 1 -- 172.21.15.36:0/3143327614 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422305837 0 0) 0x7fcc580a70c0 con 0x7fcc580b0010 2022-01-10T01:25:03.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc567fc700 1 -- 172.21.15.36:0/3143327614 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc44003260 con 0x7fcc580b0010 2022-01-10T01:25:03.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc567fc700 1 -- 172.21.15.36:0/3143327614 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847623733 0 0) 0x7fcc580a72f0 con 0x7fcc580a8ac0 2022-01-10T01:25:03.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc567fc700 1 -- 172.21.15.36:0/3143327614 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc580a70c0 con 0x7fcc580a8ac0 2022-01-10T01:25:03.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc577fe700 1 -- 172.21.15.36:0/3143327614 >> v1:172.21.15.59:6789/0 conn(0x7fcc580a8ac0 legacy=0x7fcc58151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc577fe700 1 -- 172.21.15.36:0/3143327614 >> v1:172.21.15.36:6789/0 conn(0x7fcc580b0010 legacy=0x7fcc580a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc577fe700 1 -- 172.21.15.36:0/3143327614 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc580a7830 con 0x7fcc580b2580 2022-01-10T01:25:03.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc577fe700 1 --2- 172.21.15.36:0/3143327614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc580b2580 0x7fcc5814ae40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fcc4c002f70 tx=0x7fcc4c006df0).ready entity=mon.2 client_cookie=13b000b4413ce786 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:03.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc567fc700 1 -- 172.21.15.36:0/3143327614 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc4c00d5c0 con 0x7fcc580b2580 2022-01-10T01:25:03.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc567fc700 1 -- 172.21.15.36:0/3143327614 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c000e90 con 0x7fcc580b2580 2022-01-10T01:25:03.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc567fc700 1 -- 172.21.15.36:0/3143327614 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc4c00d910 con 0x7fcc580b2580 2022-01-10T01:25:03.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/3143327614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc580b2580 msgr2=0x7fcc5814ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc5cfc3700 1 --2- 172.21.15.36:0/3143327614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc580b2580 0x7fcc5814ae40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fcc4c002f70 tx=0x7fcc4c006df0).stop 2022-01-10T01:25:03.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/3143327614 shutdown_connections 2022-01-10T01:25:03.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc5cfc3700 1 --2- 172.21.15.36:0/3143327614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc580b2580 0x7fcc5814ae40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/3143327614 >> 172.21.15.36:0/3143327614 conn(0x7fcc58060180 msgr2=0x7fcc580b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:03.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/3143327614 shutdown_connections 2022-01-10T01:25:03.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.589+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/3143327614 wait complete. 2022-01-10T01:25:03.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.593+0000 7fcc5cfc3700 1 Processor -- start 2022-01-10T01:25:03.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.593+0000 7fcc5cfc3700 1 -- start start 2022-01-10T01:25:03.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.593+0000 7fcc5cfc3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc580a8ac0 0x7fcc580ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.593+0000 7fcc5cfc3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcc580b0010 0x7fcc58156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.593+0000 7fcc5cfc3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc580b2580 0x7fcc58156f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.593+0000 7fcc5cfc3700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc58156380 con 0x7fcc580b0010 2022-01-10T01:25:03.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.593+0000 7fcc5cfc3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc580af740 con 0x7fcc580a8ac0 2022-01-10T01:25:03.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.593+0000 7fcc5cfc3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc580b5af0 con 0x7fcc580b2580 2022-01-10T01:25:03.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.593+0000 7fcc56ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcc580b0010 0x7fcc58156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.593+0000 7fcc56ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcc580b0010 0x7fcc58156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35124/0 (socket says 172.21.15.36:35124) 2022-01-10T01:25:03.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.593+0000 7fcc56ffd700 1 -- 172.21.15.36:0/492539331 learned_addr learned my addr 172.21.15.36:0/492539331 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:03.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.593+0000 7fcc577fe700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc580a8ac0 0x7fcc580ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.593+0000 7fcc57fff700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc580b2580 0x7fcc58156f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc56ffd700 1 -- 172.21.15.36:0/492539331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc580b2580 msgr2=0x7fcc58156f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc56ffd700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc580b2580 0x7fcc58156f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc56ffd700 1 -- 172.21.15.36:0/492539331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc580a8ac0 msgr2=0x7fcc580ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc56ffd700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc580a8ac0 0x7fcc580ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc56ffd700 1 -- 172.21.15.36:0/492539331 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c00b180 con 0x7fcc580b0010 2022-01-10T01:25:03.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc577fe700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc580a8ac0 0x7fcc580ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:25:03.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc57fff700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc580b2580 0x7fcc58156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:25:03.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc56ffd700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcc580b0010 0x7fcc58156a10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fcc48001550 tx=0x7fcc48007ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:03.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc54ff9700 1 -- 172.21.15.36:0/492539331 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc48005ba0 con 0x7fcc580b0010 2022-01-10T01:25:03.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc54ff9700 1 -- 172.21.15.36:0/492539331 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc48005d00 con 0x7fcc580b0010 2022-01-10T01:25:03.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/492539331 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc580b5d90 con 0x7fcc580b0010 2022-01-10T01:25:03.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc54ff9700 1 -- 172.21.15.36:0/492539331 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcc480072c0 con 0x7fcc580b0010 2022-01-10T01:25:03.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/492539331 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5814b8f0 con 0x7fcc580b0010 2022-01-10T01:25:03.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc54ff9700 1 -- 172.21.15.36:0/492539331 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fcc48010070 con 0x7fcc580b0010 2022-01-10T01:25:03.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc54ff9700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcc38053560 0x7fcc38055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/492539331 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc58057350 con 0x7fcc580b0010 2022-01-10T01:25:03.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc577fe700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcc38053560 0x7fcc38055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc577fe700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcc38053560 0x7fcc38055a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fcc4c018000 tx=0x7fcc4c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:03.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.597+0000 7fcc54ff9700 1 -- 172.21.15.36:0/492539331 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcc4806b600 con 0x7fcc580b0010 2022-01-10T01:25:03.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.601+0000 7fcc54ff9700 1 -- 172.21.15.36:0/492539331 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcc48042480 con 0x7fcc580b0010 2022-01-10T01:25:03.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.729+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/492539331 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc58156770 con 0x7fcc580b0010 2022-01-10T01:25:03.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.733+0000 7fcc54ff9700 1 -- 172.21.15.36:0/492539331 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16284 (secure 0 0 0) 0x7fcc48050fb0 con 0x7fcc580b0010 2022-01-10T01:25:03.738 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:25:03.738 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":35,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:25:03.145688+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:25:00.402523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2022-01-10T01:25:01.119067+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:25:03.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.733+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/492539331 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcc38053560 msgr2=0x7fcc38055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.733+0000 7fcc5cfc3700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcc38053560 0x7fcc38055a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fcc4c018000 tx=0x7fcc4c014000).stop 2022-01-10T01:25:03.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.733+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/492539331 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcc580b0010 msgr2=0x7fcc58156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.733+0000 7fcc5cfc3700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcc580b0010 0x7fcc58156a10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7fcc48001550 tx=0x7fcc48007ed0).stop 2022-01-10T01:25:03.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.733+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/492539331 shutdown_connections 2022-01-10T01:25:03.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.733+0000 7fcc5cfc3700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcc38053560 0x7fcc38055a20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.733+0000 7fcc5cfc3700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc580b2580 0x7fcc58156f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.733+0000 7fcc5cfc3700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcc580b0010 0x7fcc58156a10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.733+0000 7fcc5cfc3700 1 --2- 172.21.15.36:0/492539331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc580a8ac0 0x7fcc580ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.733+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/492539331 >> 172.21.15.36:0/492539331 conn(0x7fcc58060180 msgr2=0x7fcc58145fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:03.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.733+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/492539331 shutdown_connections 2022-01-10T01:25:03.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.737+0000 7fcc5cfc3700 1 -- 172.21.15.36:0/492539331 wait complete. 2022-01-10T01:25:03.751 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:25:03.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.861+0000 7f7b15468700 1 Processor -- start 2022-01-10T01:25:03.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.861+0000 7f7b15468700 1 -- start start 2022-01-10T01:25:03.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.861+0000 7f7b15468700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7b100ad320 0x7f7b100af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.861+0000 7f7b15468700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b100ad850 0x7f7b100a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.861+0000 7f7b15468700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b100afda0 con 0x7f7b100af2c0 2022-01-10T01:25:03.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.861+0000 7f7b15468700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b1005c610 con 0x7f7b100ad320 2022-01-10T01:25:03.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.861+0000 7f7b15468700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10140800 con 0x7f7b100ad850 2022-01-10T01:25:03.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.861+0000 7f7b0f7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7b100ad320 0x7f7b100af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.861+0000 7f7b14c67700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b100ad850 0x7f7b100a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.861+0000 7f7b0f7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7b100ad320 0x7f7b100af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35134/0 (socket says 172.21.15.36:35134) 2022-01-10T01:25:03.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.861+0000 7f7b0ffff700 1 --1- 172.21.15.36:0/2049714110 >> v1:172.21.15.59:6789/0 conn(0x7f7b100af2c0 0x7f7b10143150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:50600/0 (socket says 172.21.15.36:50600) 2022-01-10T01:25:03.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.861+0000 7f7b0f7fe700 1 -- 172.21.15.36:0/2049714110 learned_addr learned my addr 172.21.15.36:0/2049714110 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:03.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b14c67700 1 -- 172.21.15.36:0/2049714110 >> v2:172.21.15.36:3300/0 conn(0x7f7b100ad320 msgr2=0x7f7b100af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:03.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b14c67700 1 --2- 172.21.15.36:0/2049714110 >> v2:172.21.15.36:3300/0 conn(0x7f7b100ad320 0x7f7b100af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b14c67700 1 -- 172.21.15.36:0/2049714110 >> v1:172.21.15.59:6789/0 conn(0x7f7b100af2c0 legacy=0x7f7b10143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b14c67700 1 -- 172.21.15.36:0/2049714110 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b10143860 con 0x7f7b100ad850 2022-01-10T01:25:03.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b0f7fe700 1 --2- 172.21.15.36:0/2049714110 >> v2:172.21.15.36:3300/0 conn(0x7f7b100ad320 0x7f7b100af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:25:03.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b14c67700 1 --2- 172.21.15.36:0/2049714110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b100ad850 0x7f7b100a8cb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7b100ad770 tx=0x7f7b080091d0).ready entity=mon.2 client_cookie=29a470eaaf51514c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:03.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b0effd700 1 -- 172.21.15.36:0/2049714110 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b0800b680 con 0x7f7b100ad850 2022-01-10T01:25:03.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b0effd700 1 -- 172.21.15.36:0/2049714110 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0800b7e0 con 0x7f7b100ad850 2022-01-10T01:25:03.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b0effd700 1 -- 172.21.15.36:0/2049714110 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b0800b950 con 0x7f7b100ad850 2022-01-10T01:25:03.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b15468700 1 -- 172.21.15.36:0/2049714110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b100ad850 msgr2=0x7f7b100a8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b15468700 1 --2- 172.21.15.36:0/2049714110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b100ad850 0x7f7b100a8cb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7b100ad770 tx=0x7f7b080091d0).stop 2022-01-10T01:25:03.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b15468700 1 -- 172.21.15.36:0/2049714110 shutdown_connections 2022-01-10T01:25:03.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b15468700 1 --2- 172.21.15.36:0/2049714110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b100ad850 0x7f7b100a8cb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b15468700 1 --2- 172.21.15.36:0/2049714110 >> v2:172.21.15.36:3300/0 conn(0x7f7b100ad320 0x7f7b100af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b15468700 1 -- 172.21.15.36:0/2049714110 >> 172.21.15.36:0/2049714110 conn(0x7f7b10061140 msgr2=0x7f7b10062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:03.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b15468700 1 -- 172.21.15.36:0/2049714110 shutdown_connections 2022-01-10T01:25:03.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b15468700 1 -- 172.21.15.36:0/2049714110 wait complete. 2022-01-10T01:25:03.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b15468700 1 Processor -- start 2022-01-10T01:25:03.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.865+0000 7f7b15468700 1 -- start start 2022-01-10T01:25:03.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b15468700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b100ad320 0x7f7b101426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b15468700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b100ad850 0x7f7b1014eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b15468700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7b100af2c0 0x7f7b1014f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b15468700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1014f9d0 con 0x7f7b100af2c0 2022-01-10T01:25:03.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b15468700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100ac800 con 0x7f7b100ad850 2022-01-10T01:25:03.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b15468700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100b5940 con 0x7f7b100ad320 2022-01-10T01:25:03.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b14c67700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7b100af2c0 0x7f7b1014f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b14c67700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7b100af2c0 0x7f7b1014f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35138/0 (socket says 172.21.15.36:35138) 2022-01-10T01:25:03.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b14c67700 1 -- 172.21.15.36:0/3733723437 learned_addr learned my addr 172.21.15.36:0/3733723437 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:03.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b0ffff700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b100ad320 0x7f7b101426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b0f7fe700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b100ad850 0x7f7b1014eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b14c67700 1 -- 172.21.15.36:0/3733723437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b100ad320 msgr2=0x7f7b101426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b14c67700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b100ad320 0x7f7b101426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b14c67700 1 -- 172.21.15.36:0/3733723437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b100ad850 msgr2=0x7f7b1014eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:03.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b14c67700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b100ad850 0x7f7b1014eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:03.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b14c67700 1 -- 172.21.15.36:0/3733723437 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0400b1e0 con 0x7f7b100af2c0 2022-01-10T01:25:03.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b0f7fe700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b100ad850 0x7f7b1014eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:25:03.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b14c67700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7b100af2c0 0x7f7b1014f4e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f7b100ac940 tx=0x7f7b08016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:03.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b0d7fa700 1 -- 172.21.15.36:0/3733723437 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b08021440 con 0x7f7b100af2c0 2022-01-10T01:25:03.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b0d7fa700 1 -- 172.21.15.36:0/3733723437 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b080215a0 con 0x7f7b100af2c0 2022-01-10T01:25:03.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b15468700 1 -- 172.21.15.36:0/3733723437 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b08009470 con 0x7f7b100af2c0 2022-01-10T01:25:03.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b0d7fa700 1 -- 172.21.15.36:0/3733723437 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b08021900 con 0x7f7b100af2c0 2022-01-10T01:25:03.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b15468700 1 -- 172.21.15.36:0/3733723437 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b100ac1c0 con 0x7f7b100af2c0 2022-01-10T01:25:03.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.869+0000 7f7b15468700 1 -- 172.21.15.36:0/3733723437 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b10153350 con 0x7f7b100af2c0 2022-01-10T01:25:03.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.873+0000 7f7b0d7fa700 1 -- 172.21.15.36:0/3733723437 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7b0800f070 con 0x7f7b100af2c0 2022-01-10T01:25:03.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.873+0000 7f7b0d7fa700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7af00535f0 0x7f7af0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:03.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.873+0000 7f7b0ffff700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7af00535f0 0x7f7af0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:03.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.873+0000 7f7b0d7fa700 1 -- 172.21.15.36:0/3733723437 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7b0806cc60 con 0x7f7b100af2c0 2022-01-10T01:25:03.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.873+0000 7f7b0ffff700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7af00535f0 0x7f7af0055ab0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f7b0000b000 tx=0x7f7b00007160).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:03.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:03.881+0000 7f7b0d7fa700 1 -- 172.21.15.36:0/3733723437 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b08043b60 con 0x7f7b100af2c0 2022-01-10T01:25:04.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.049+0000 7f7b15468700 1 -- 172.21.15.36:0/3733723437 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7b10057350 con 0x7f7b100af2c0 2022-01-10T01:25:04.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.057+0000 7f7b0d7fa700 1 -- 172.21.15.36:0/3733723437 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7b08015070 con 0x7f7b100af2c0 2022-01-10T01:25:04.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.057+0000 7f7b15468700 1 -- 172.21.15.36:0/3733723437 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7af00535f0 msgr2=0x7f7af0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.057+0000 7f7b15468700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7af00535f0 0x7f7af0055ab0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f7b0000b000 tx=0x7f7b00007160).stop 2022-01-10T01:25:04.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.057+0000 7f7b15468700 1 -- 172.21.15.36:0/3733723437 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7b100af2c0 msgr2=0x7f7b1014f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.057+0000 7f7b15468700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7b100af2c0 0x7f7b1014f4e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f7b100ac940 tx=0x7f7b08016000).stop 2022-01-10T01:25:04.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.057+0000 7f7b15468700 1 -- 172.21.15.36:0/3733723437 shutdown_connections 2022-01-10T01:25:04.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.057+0000 7f7b15468700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7af00535f0 0x7f7af0055ab0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.057+0000 7f7b15468700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7b100af2c0 0x7f7b1014f4e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.057+0000 7f7b15468700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b100ad850 0x7f7b1014eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.057+0000 7f7b15468700 1 --2- 172.21.15.36:0/3733723437 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b100ad320 0x7f7b101426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.057+0000 7f7b15468700 1 -- 172.21.15.36:0/3733723437 >> 172.21.15.36:0/3733723437 conn(0x7f7b10061140 msgr2=0x7f7b1013ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:04.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.057+0000 7f7b15468700 1 -- 172.21.15.36:0/3733723437 shutdown_connections 2022-01-10T01:25:04.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.057+0000 7f7b15468700 1 -- 172.21.15.36:0/3733723437 wait complete. 2022-01-10T01:25:04.069 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.0 2022-01-10T01:25:04.077 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:25:04.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.189+0000 7f746f160700 1 Processor -- start 2022-01-10T01:25:04.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.189+0000 7f746f160700 1 -- start start 2022-01-10T01:25:04.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.189+0000 7f746f160700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74680b0710 0x7f7468142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:04.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.189+0000 7f746f160700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7468143920 con 0x7f74680ace70 2022-01-10T01:25:04.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.189+0000 7f746f160700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74680b0af0 con 0x7f74680b30d0 2022-01-10T01:25:04.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.189+0000 7f746f160700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74680ae680 con 0x7f74680b0710 2022-01-10T01:25:04.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.189+0000 7f746e95f700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f74680ace70 0x7f746813f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:32942/0 (socket says 172.21.15.36:32942) 2022-01-10T01:25:04.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.189+0000 7f746e95f700 1 -- 172.21.15.36:0/465600839 learned_addr learned my addr 172.21.15.36:0/465600839 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:25:04.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.189+0000 7f746e15e700 1 --2- 172.21.15.36:0/465600839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74680b0710 0x7f7468142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:04.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.189+0000 7f746d15c700 1 -- 172.21.15.36:0/465600839 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566255327 0 0) 0x7f7468143920 con 0x7f74680ace70 2022-01-10T01:25:04.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.189+0000 7f746d15c700 1 -- 172.21.15.36:0/465600839 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7450003260 con 0x7f74680ace70 2022-01-10T01:25:04.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746d15c700 1 -- 172.21.15.36:0/465600839 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38749997 0 0) 0x7f74680b0af0 con 0x7f74680b30d0 2022-01-10T01:25:04.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746d15c700 1 -- 172.21.15.36:0/465600839 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7468143920 con 0x7f74680b30d0 2022-01-10T01:25:04.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746e15e700 1 -- 172.21.15.36:0/465600839 >> v1:172.21.15.59:6789/0 conn(0x7f74680b30d0 legacy=0x7f7468143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746e15e700 1 -- 172.21.15.36:0/465600839 >> v1:172.21.15.36:6789/0 conn(0x7f74680ace70 legacy=0x7f746813f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746e15e700 1 -- 172.21.15.36:0/465600839 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74680ae920 con 0x7f74680b0710 2022-01-10T01:25:04.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746e15e700 1 --2- 172.21.15.36:0/465600839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74680b0710 0x7f7468142d20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7464002f70 tx=0x7f7464006e80).ready entity=mon.2 client_cookie=59d8bfd662d39a43 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:04.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746d15c700 1 -- 172.21.15.36:0/465600839 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7464014070 con 0x7f74680b0710 2022-01-10T01:25:04.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746d15c700 1 -- 172.21.15.36:0/465600839 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7464000e90 con 0x7f74680b0710 2022-01-10T01:25:04.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746d15c700 1 -- 172.21.15.36:0/465600839 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74640107f0 con 0x7f74680b0710 2022-01-10T01:25:04.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746f160700 1 -- 172.21.15.36:0/465600839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74680b0710 msgr2=0x7f7468142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746f160700 1 --2- 172.21.15.36:0/465600839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74680b0710 0x7f7468142d20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7464002f70 tx=0x7f7464006e80).stop 2022-01-10T01:25:04.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746f160700 1 -- 172.21.15.36:0/465600839 shutdown_connections 2022-01-10T01:25:04.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746f160700 1 --2- 172.21.15.36:0/465600839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74680b0710 0x7f7468142d20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746f160700 1 -- 172.21.15.36:0/465600839 >> 172.21.15.36:0/465600839 conn(0x7f7468061140 msgr2=0x7f7468062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:04.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746f160700 1 -- 172.21.15.36:0/465600839 shutdown_connections 2022-01-10T01:25:04.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746f160700 1 -- 172.21.15.36:0/465600839 wait complete. 2022-01-10T01:25:04.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746f160700 1 Processor -- start 2022-01-10T01:25:04.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.193+0000 7f746f160700 1 -- start start 2022-01-10T01:25:04.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746f160700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74680ace70 0x7f7468141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:04.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746f160700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74680b0710 0x7f7468064f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:04.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746f160700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f74680b30d0 0x7f7468065440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:04.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746f160700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74680ac430 con 0x7f74680b30d0 2022-01-10T01:25:04.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746f160700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74680aa550 con 0x7f74680b0710 2022-01-10T01:25:04.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746f160700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74680aa7f0 con 0x7f74680ace70 2022-01-10T01:25:04.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746e95f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f74680b30d0 0x7f7468065440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:04.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746e95f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f74680b30d0 0x7f7468065440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35154/0 (socket says 172.21.15.36:35154) 2022-01-10T01:25:04.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746d95d700 1 --2- 172.21.15.36:0/2731764254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74680b0710 0x7f7468064f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:04.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746e95f700 1 -- 172.21.15.36:0/2731764254 learned_addr learned my addr 172.21.15.36:0/2731764254 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:04.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746e15e700 1 --2- 172.21.15.36:0/2731764254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74680ace70 0x7f7468141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:04.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746e95f700 1 -- 172.21.15.36:0/2731764254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74680ace70 msgr2=0x7f7468141230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746e95f700 1 --2- 172.21.15.36:0/2731764254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74680ace70 0x7f7468141230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746e95f700 1 -- 172.21.15.36:0/2731764254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74680b0710 msgr2=0x7f7468064f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746e95f700 1 --2- 172.21.15.36:0/2731764254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74680b0710 0x7f7468064f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746e95f700 1 -- 172.21.15.36:0/2731764254 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746400c310 con 0x7f74680b30d0 2022-01-10T01:25:04.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746e95f700 1 --2- 172.21.15.36:0/2731764254 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f74680b30d0 0x7f7468065440 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7460001490 tx=0x7f7460007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:04.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f74577fe700 1 -- 172.21.15.36:0/2731764254 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7460005ba0 con 0x7f74680b30d0 2022-01-10T01:25:04.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f74577fe700 1 -- 172.21.15.36:0/2731764254 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7460005d00 con 0x7f74680b30d0 2022-01-10T01:25:04.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746f160700 1 -- 172.21.15.36:0/2731764254 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74680aaa90 con 0x7f74680b30d0 2022-01-10T01:25:04.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f74577fe700 1 -- 172.21.15.36:0/2731764254 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f74600072c0 con 0x7f74680b30d0 2022-01-10T01:25:04.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.197+0000 7f746f160700 1 -- 172.21.15.36:0/2731764254 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74680a9fd0 con 0x7f74680b30d0 2022-01-10T01:25:04.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.201+0000 7f746f160700 1 -- 172.21.15.36:0/2731764254 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7468057350 con 0x7f74680b30d0 2022-01-10T01:25:04.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.201+0000 7f74577fe700 1 -- 172.21.15.36:0/2731764254 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7460010070 con 0x7f74680b30d0 2022-01-10T01:25:04.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.201+0000 7f74577fe700 1 --2- 172.21.15.36:0/2731764254 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f74480535f0 0x7f7448055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:04.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.201+0000 7f74577fe700 1 -- 172.21.15.36:0/2731764254 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f746006b270 con 0x7f74680b30d0 2022-01-10T01:25:04.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.201+0000 7f746e15e700 1 --2- 172.21.15.36:0/2731764254 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f74480535f0 0x7f7448055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:04.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.201+0000 7f746e15e700 1 --2- 172.21.15.36:0/2731764254 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f74480535f0 0x7f7448055ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f746401e000 tx=0x7f74680a9420).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:04.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.209+0000 7f74577fe700 1 -- 172.21.15.36:0/2731764254 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7460068e90 con 0x7f74680b30d0 2022-01-10T01:25:04.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.373+0000 7f746f160700 1 -- 172.21.15.36:0/2731764254 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f74680b2c70 con 0x7f74680b30d0 2022-01-10T01:25:04.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.377+0000 7f74577fe700 1 -- 172.21.15.36:0/2731764254 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7460018070 con 0x7f74680b30d0 2022-01-10T01:25:04.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.381+0000 7f746f160700 1 -- 172.21.15.36:0/2731764254 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f74480535f0 msgr2=0x7f7448055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.381+0000 7f746f160700 1 --2- 172.21.15.36:0/2731764254 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f74480535f0 0x7f7448055ab0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f746401e000 tx=0x7f74680a9420).stop 2022-01-10T01:25:04.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.381+0000 7f746f160700 1 -- 172.21.15.36:0/2731764254 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f74680b30d0 msgr2=0x7f7468065440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.381+0000 7f746f160700 1 --2- 172.21.15.36:0/2731764254 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f74680b30d0 0x7f7468065440 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f7460001490 tx=0x7f7460007de0).stop 2022-01-10T01:25:04.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.381+0000 7f746f160700 1 -- 172.21.15.36:0/2731764254 shutdown_connections 2022-01-10T01:25:04.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.381+0000 7f746f160700 1 --2- 172.21.15.36:0/2731764254 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f74480535f0 0x7f7448055ab0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.381+0000 7f746f160700 1 --2- 172.21.15.36:0/2731764254 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f74680b30d0 0x7f7468065440 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.381+0000 7f746f160700 1 --2- 172.21.15.36:0/2731764254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74680b0710 0x7f7468064f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.381+0000 7f746f160700 1 --2- 172.21.15.36:0/2731764254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74680ace70 0x7f7468141230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.381+0000 7f746f160700 1 -- 172.21.15.36:0/2731764254 >> 172.21.15.36:0/2731764254 conn(0x7f7468061140 msgr2=0x7f74680a8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:04.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.381+0000 7f746f160700 1 -- 172.21.15.36:0/2731764254 shutdown_connections 2022-01-10T01:25:04.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.381+0000 7f746f160700 1 -- 172.21.15.36:0/2731764254 wait complete. 2022-01-10T01:25:04.389 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.1 2022-01-10T01:25:04.397 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:25:04.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.493+0000 7f3a52702700 1 Processor -- start 2022-01-10T01:25:04.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.493+0000 7f3a52702700 1 -- start start 2022-01-10T01:25:04.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4c1483a0 0x7f3a4c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:04.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3a4c0a70c0 0x7f3a4c144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:04.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4c0b0350 con 0x7f3a4c0b1db0 2022-01-10T01:25:04.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c0a90c0 con 0x7f3a4c0a70c0 2022-01-10T01:25:04.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0b05f0 con 0x7f3a4c1483a0 2022-01-10T01:25:04.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a50c9f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3a4c0a70c0 0x7f3a4c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:04.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a50c9f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3a4c0a70c0 0x7f3a4c144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35162/0 (socket says 172.21.15.36:35162) 2022-01-10T01:25:04.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a50c9f700 1 -- 172.21.15.36:0/3059337322 learned_addr learned my addr 172.21.15.36:0/3059337322 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:04.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a4bfff700 1 --1- 172.21.15.36:0/3059337322 >> v1:172.21.15.36:6789/0 conn(0x7f3a4c0b1db0 0x7f3a4c0b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:32954/0 (socket says 172.21.15.36:32954) 2022-01-10T01:25:04.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a4b7fe700 1 --2- 172.21.15.36:0/3059337322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4c1483a0 0x7f3a4c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:04.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a50c9f700 1 -- 172.21.15.36:0/3059337322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4c1483a0 msgr2=0x7f3a4c0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:04.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a50c9f700 1 --2- 172.21.15.36:0/3059337322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4c1483a0 0x7f3a4c0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a50c9f700 1 -- 172.21.15.36:0/3059337322 >> v1:172.21.15.36:6789/0 conn(0x7f3a4c0b1db0 legacy=0x7f3a4c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a50c9f700 1 -- 172.21.15.36:0/3059337322 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c0b0890 con 0x7f3a4c0a70c0 2022-01-10T01:25:04.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a4b7fe700 1 --2- 172.21.15.36:0/3059337322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4c1483a0 0x7f3a4c0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:25:04.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a50c9f700 1 --2- 172.21.15.36:0/3059337322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a4c0a70c0 0x7f3a4c144720 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f3a440032f0 tx=0x7f3a44009290).ready entity=mon.0 client_cookie=beff9547ff47cfeb server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:04.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a4affd700 1 -- 172.21.15.36:0/3059337322 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a4400b8a0 con 0x7f3a4c0a70c0 2022-01-10T01:25:04.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a4affd700 1 -- 172.21.15.36:0/3059337322 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4400ba00 con 0x7f3a4c0a70c0 2022-01-10T01:25:04.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a4affd700 1 -- 172.21.15.36:0/3059337322 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a4400bb70 con 0x7f3a4c0a70c0 2022-01-10T01:25:04.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 -- 172.21.15.36:0/3059337322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a4c0a70c0 msgr2=0x7f3a4c144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 --2- 172.21.15.36:0/3059337322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a4c0a70c0 0x7f3a4c144720 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f3a440032f0 tx=0x7f3a44009290).stop 2022-01-10T01:25:04.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 -- 172.21.15.36:0/3059337322 shutdown_connections 2022-01-10T01:25:04.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 --2- 172.21.15.36:0/3059337322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a4c0a70c0 0x7f3a4c144720 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 --2- 172.21.15.36:0/3059337322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4c1483a0 0x7f3a4c0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 -- 172.21.15.36:0/3059337322 >> 172.21.15.36:0/3059337322 conn(0x7f3a4c05f6b0 msgr2=0x7f3a4c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:04.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 -- 172.21.15.36:0/3059337322 shutdown_connections 2022-01-10T01:25:04.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 -- 172.21.15.36:0/3059337322 wait complete. 2022-01-10T01:25:04.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 Processor -- start 2022-01-10T01:25:04.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.497+0000 7f3a52702700 1 -- start start 2022-01-10T01:25:04.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a52702700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a4c0a70c0 0x7f3a4c14b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:04.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a52702700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4c0b1db0 0x7f3a4c0a9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:04.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a52702700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c1483a0 0x7f3a4c143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:04.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a52702700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0a9f30 con 0x7f3a4c0a70c0 2022-01-10T01:25:04.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a52702700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c149c40 con 0x7f3a4c1483a0 2022-01-10T01:25:04.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a52702700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c149ee0 con 0x7f3a4c0b1db0 2022-01-10T01:25:04.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a4bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a4c0a70c0 0x7f3a4c14b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:04.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a4bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a4c0a70c0 0x7f3a4c14b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35164/0 (socket says 172.21.15.36:35164) 2022-01-10T01:25:04.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a4bfff700 1 -- 172.21.15.36:0/1248636267 learned_addr learned my addr 172.21.15.36:0/1248636267 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:04.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a4b7fe700 1 --2- 172.21.15.36:0/1248636267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4c0b1db0 0x7f3a4c0a9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:04.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a50c9f700 1 --2- 172.21.15.36:0/1248636267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c1483a0 0x7f3a4c143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:04.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a4b7fe700 1 -- 172.21.15.36:0/1248636267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c1483a0 msgr2=0x7f3a4c143980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a4b7fe700 1 --2- 172.21.15.36:0/1248636267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c1483a0 0x7f3a4c143980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a4b7fe700 1 -- 172.21.15.36:0/1248636267 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a4c0a70c0 msgr2=0x7f3a4c14b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a4b7fe700 1 --2- 172.21.15.36:0/1248636267 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a4c0a70c0 0x7f3a4c14b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a4b7fe700 1 -- 172.21.15.36:0/1248636267 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a44009530 con 0x7f3a4c0b1db0 2022-01-10T01:25:04.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a4b7fe700 1 --2- 172.21.15.36:0/1248636267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4c0b1db0 0x7f3a4c0a9780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3a3c00a000 tx=0x7f3a3c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:04.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a497fa700 1 -- 172.21.15.36:0/1248636267 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a3c013670 con 0x7f3a4c0b1db0 2022-01-10T01:25:04.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a497fa700 1 -- 172.21.15.36:0/1248636267 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c0137d0 con 0x7f3a4c0b1db0 2022-01-10T01:25:04.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a52702700 1 -- 172.21.15.36:0/1248636267 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4c14a180 con 0x7f3a4c0b1db0 2022-01-10T01:25:04.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a497fa700 1 -- 172.21.15.36:0/1248636267 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a3c013b30 con 0x7f3a4c0b1db0 2022-01-10T01:25:04.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.501+0000 7f3a52702700 1 -- 172.21.15.36:0/1248636267 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c0aba30 con 0x7f3a4c0b1db0 2022-01-10T01:25:04.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.505+0000 7f3a52702700 1 -- 172.21.15.36:0/1248636267 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4c057350 con 0x7f3a4c0b1db0 2022-01-10T01:25:04.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.505+0000 7f3a497fa700 1 -- 172.21.15.36:0/1248636267 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3a3c01a030 con 0x7f3a4c0b1db0 2022-01-10T01:25:04.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.505+0000 7f3a497fa700 1 --2- 172.21.15.36:0/1248636267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3a2c0535f0 0x7f3a2c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:04.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.505+0000 7f3a497fa700 1 -- 172.21.15.36:0/1248636267 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3a3c06b7d0 con 0x7f3a4c0b1db0 2022-01-10T01:25:04.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.505+0000 7f3a4bfff700 1 --2- 172.21.15.36:0/1248636267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3a2c0535f0 0x7f3a2c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:04.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.505+0000 7f3a4bfff700 1 --2- 172.21.15.36:0/1248636267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3a2c0535f0 0x7f3a2c055ab0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3a4000d000 tx=0x7f3a40007c00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:04.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.513+0000 7f3a497fa700 1 -- 172.21.15.36:0/1248636267 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a3c042740 con 0x7f3a4c0b1db0 2022-01-10T01:25:04.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.677+0000 7f3a52702700 1 -- 172.21.15.36:0/1248636267 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a4c14b100 con 0x7f3a4c0b1db0 2022-01-10T01:25:04.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.681+0000 7f3a497fa700 1 -- 172.21.15.36:0/1248636267 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f3a3c045d60 con 0x7f3a4c0b1db0 2022-01-10T01:25:04.684 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:25:04.684 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1410680575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1410680575},{"type":"v1","addr":"172.21.15.36:6837","nonce":1410680575}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/1811767033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1811767033},{"type":"v1","addr":"172.21.15.59:6833","nonce":1811767033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:25:02.143464+0000","modified":"2022-01-10T01:25:03.146833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/2488750467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2488750467},{"type":"v1","addr":"172.21.15.36:6835","nonce":2488750467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2022-01-10T01:25:04.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.681+0000 7f3a52702700 1 -- 172.21.15.36:0/1248636267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3a2c0535f0 msgr2=0x7f3a2c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.681+0000 7f3a52702700 1 --2- 172.21.15.36:0/1248636267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3a2c0535f0 0x7f3a2c055ab0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f3a4000d000 tx=0x7f3a40007c00).stop 2022-01-10T01:25:04.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.681+0000 7f3a52702700 1 -- 172.21.15.36:0/1248636267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4c0b1db0 msgr2=0x7f3a4c0a9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:04.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.681+0000 7f3a52702700 1 --2- 172.21.15.36:0/1248636267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4c0b1db0 0x7f3a4c0a9780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f3a3c00a000 tx=0x7f3a3c008040).stop 2022-01-10T01:25:04.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.681+0000 7f3a52702700 1 -- 172.21.15.36:0/1248636267 shutdown_connections 2022-01-10T01:25:04.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.681+0000 7f3a52702700 1 --2- 172.21.15.36:0/1248636267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3a2c0535f0 0x7f3a2c055ab0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.681+0000 7f3a52702700 1 --2- 172.21.15.36:0/1248636267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a4c1483a0 0x7f3a4c143980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.681+0000 7f3a52702700 1 --2- 172.21.15.36:0/1248636267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a4c0b1db0 0x7f3a4c0a9780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.681+0000 7f3a52702700 1 --2- 172.21.15.36:0/1248636267 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a4c0a70c0 0x7f3a4c14b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:04.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.681+0000 7f3a52702700 1 -- 172.21.15.36:0/1248636267 >> 172.21.15.36:0/1248636267 conn(0x7f3a4c05f6b0 msgr2=0x7f3a4c0b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:04.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.681+0000 7f3a52702700 1 -- 172.21.15.36:0/1248636267 shutdown_connections 2022-01-10T01:25:04.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:04.681+0000 7f3a52702700 1 -- 172.21.15.36:0/1248636267 wait complete. 2022-01-10T01:25:04.689 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 13 2022-01-10T01:25:04.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:25:02.143464+0000', 'modified': '2022-01-10T01:25:03.146833+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4882}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4882': {'gid': 4882, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6835/2488750467', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6834', 'nonce': 2488750467}, {'type': 'v1', 'addr': '172.21.15.36:6835', 'nonce': 2488750467}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:25:05.000 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:25:05.000 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-10T01:25:05.118 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":4882,"want_state":"up:active","state":"up:active","rank_uptime":2.9619981709999998,"mdsmap_epoch":13,"osdmap_epoch":36,"osdmap_epoch_barrier":35,"uptime":9.3597557239999993} 2022-01-10T01:25:05.119 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 4882, "mdsmap_epoch": 13, "osdmap_epoch": 36, "osdmap_epoch_barrier": 35, "rank_uptime": 2.961998171, "state": "up:active", "uptime": 9.359755724, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:25:05.119 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:25:05.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95ef59e700 1 Processor -- start 2022-01-10T01:25:05.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95ef59e700 1 -- start start 2022-01-10T01:25:05.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95ef59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f00b2580 0x7f95f014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95ef59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95f00b0010 0x7f95f014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95ef59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f00a70c0 con 0x7f95f00afbd0 2022-01-10T01:25:05.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95ef59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f00a72f0 con 0x7f95f00b0010 2022-01-10T01:25:05.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95ef59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00a7590 con 0x7f95f00b2580 2022-01-10T01:25:05.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95edd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95f00b0010 0x7f95f014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95edd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95f00b0010 0x7f95f014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:60038/0 (socket says 172.21.15.36:60038) 2022-01-10T01:25:05.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95eed9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f95f00afbd0 0x7f95f00a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:50646/0 (socket says 172.21.15.36:50646) 2022-01-10T01:25:05.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95ee59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f00b2580 0x7f95f014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95edd9b700 1 -- 172.21.15.36:0/1898230693 learned_addr learned my addr 172.21.15.36:0/1898230693 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:05.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95edd9b700 1 -- 172.21.15.36:0/1898230693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f00b2580 msgr2=0x7f95f014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:05.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95edd9b700 1 --2- 172.21.15.36:0/1898230693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f00b2580 0x7f95f014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95edd9b700 1 -- 172.21.15.36:0/1898230693 >> v1:172.21.15.59:6789/0 conn(0x7f95f00afbd0 legacy=0x7f95f00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95edd9b700 1 -- 172.21.15.36:0/1898230693 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f00a7830 con 0x7f95f00b0010 2022-01-10T01:25:05.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95edd9b700 1 --2- 172.21.15.36:0/1898230693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f00b0010 0x7f95f014b330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f95e0002f70 tx=0x7f95e0006eb0).ready entity=mon.1 client_cookie=6d69ea20536e075f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:05.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95ed59a700 1 -- 172.21.15.36:0/1898230693 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e000d570 con 0x7f95f00b0010 2022-01-10T01:25:05.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95ed59a700 1 -- 172.21.15.36:0/1898230693 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e0000e90 con 0x7f95f00b0010 2022-01-10T01:25:05.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.217+0000 7f95ed59a700 1 -- 172.21.15.36:0/1898230693 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e000d900 con 0x7f95f00b0010 2022-01-10T01:25:05.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 -- 172.21.15.36:0/1898230693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f00b0010 msgr2=0x7f95f014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 --2- 172.21.15.36:0/1898230693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f00b0010 0x7f95f014b330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f95e0002f70 tx=0x7f95e0006eb0).stop 2022-01-10T01:25:05.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 -- 172.21.15.36:0/1898230693 shutdown_connections 2022-01-10T01:25:05.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 --2- 172.21.15.36:0/1898230693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f00b0010 0x7f95f014b330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 --2- 172.21.15.36:0/1898230693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f00b2580 0x7f95f014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 -- 172.21.15.36:0/1898230693 >> 172.21.15.36:0/1898230693 conn(0x7f95f0060180 msgr2=0x7f95f00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:05.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 -- 172.21.15.36:0/1898230693 shutdown_connections 2022-01-10T01:25:05.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 -- 172.21.15.36:0/1898230693 wait complete. 2022-01-10T01:25:05.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 Processor -- start 2022-01-10T01:25:05.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 -- start start 2022-01-10T01:25:05.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f00afbd0 0x7f95f00b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f95f00b0010 0x7f95f00b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f00b2580 0x7f95f00ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00b3790 con 0x7f95f00b0010 2022-01-10T01:25:05.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00abf10 con 0x7f95f00afbd0 2022-01-10T01:25:05.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ef59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f00ac1b0 con 0x7f95f00b2580 2022-01-10T01:25:05.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95edd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f95f00b0010 0x7f95f00b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95edd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f95f00b0010 0x7f95f00b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35180/0 (socket says 172.21.15.36:35180) 2022-01-10T01:25:05.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95edd9b700 1 -- 172.21.15.36:0/3878981885 learned_addr learned my addr 172.21.15.36:0/3878981885 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:05.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95eed9d700 1 --2- 172.21.15.36:0/3878981885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f00b2580 0x7f95f00ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.221+0000 7f95ee59c700 1 --2- 172.21.15.36:0/3878981885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f00afbd0 0x7f95f00b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.225+0000 7f95edd9b700 1 -- 172.21.15.36:0/3878981885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f00b2580 msgr2=0x7f95f00ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.225+0000 7f95edd9b700 1 --2- 172.21.15.36:0/3878981885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f00b2580 0x7f95f00ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.225+0000 7f95edd9b700 1 -- 172.21.15.36:0/3878981885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f00afbd0 msgr2=0x7f95f00b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.225+0000 7f95edd9b700 1 --2- 172.21.15.36:0/3878981885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f00afbd0 0x7f95f00b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.225+0000 7f95edd9b700 1 -- 172.21.15.36:0/3878981885 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e000b1e0 con 0x7f95f00b0010 2022-01-10T01:25:05.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.225+0000 7f95edd9b700 1 --2- 172.21.15.36:0/3878981885 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f95f00b0010 0x7f95f00b55e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f95e0002f70 tx=0x7f95e0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:05.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.225+0000 7f95df7fe700 1 -- 172.21.15.36:0/3878981885 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e0011760 con 0x7f95f00b0010 2022-01-10T01:25:05.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.225+0000 7f95df7fe700 1 -- 172.21.15.36:0/3878981885 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e00118c0 con 0x7f95f00b0010 2022-01-10T01:25:05.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.225+0000 7f95ef59e700 1 -- 172.21.15.36:0/3878981885 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f00ac450 con 0x7f95f00b0010 2022-01-10T01:25:05.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.225+0000 7f95df7fe700 1 -- 172.21.15.36:0/3878981885 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e0011c20 con 0x7f95f00b0010 2022-01-10T01:25:05.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.225+0000 7f95ef59e700 1 -- 172.21.15.36:0/3878981885 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f00b3a70 con 0x7f95f00b0010 2022-01-10T01:25:05.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.225+0000 7f95ef59e700 1 -- 172.21.15.36:0/3878981885 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f00ac5e0 con 0x7f95f00b0010 2022-01-10T01:25:05.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.225+0000 7f95df7fe700 1 -- 172.21.15.36:0/3878981885 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f95e0025030 con 0x7f95f00b0010 2022-01-10T01:25:05.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.225+0000 7f95df7fe700 1 --2- 172.21.15.36:0/3878981885 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f95cc053620 0x7f95cc055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.229+0000 7f95df7fe700 1 -- 172.21.15.36:0/3878981885 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f95e006ca20 con 0x7f95f00b0010 2022-01-10T01:25:05.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.229+0000 7f95ee59c700 1 --2- 172.21.15.36:0/3878981885 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f95cc053620 0x7f95cc055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.229+0000 7f95ee59c700 1 --2- 172.21.15.36:0/3878981885 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f95cc053620 0x7f95cc055ae0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f95e400b000 tx=0x7f95e4006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:05.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.233+0000 7f95df7fe700 1 -- 172.21.15.36:0/3878981885 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f95e0043a30 con 0x7f95f00b0010 2022-01-10T01:25:05.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.361+0000 7f95ef59e700 1 -- 172.21.15.36:0/3878981885 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95f0057350 con 0x7f95f00b0010 2022-01-10T01:25:05.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.365+0000 7f95df7fe700 1 -- 172.21.15.36:0/3878981885 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f95e0023020 con 0x7f95f00b0010 2022-01-10T01:25:05.369 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:25:05.370 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":36,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:25:04.160517+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:25:00.402523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2022-01-10T01:25:01.119067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:25:05.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.365+0000 7f95ef59e700 1 -- 172.21.15.36:0/3878981885 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f95cc053620 msgr2=0x7f95cc055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.365+0000 7f95ef59e700 1 --2- 172.21.15.36:0/3878981885 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f95cc053620 0x7f95cc055ae0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f95e400b000 tx=0x7f95e4006df0).stop 2022-01-10T01:25:05.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.365+0000 7f95ef59e700 1 -- 172.21.15.36:0/3878981885 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f95f00b0010 msgr2=0x7f95f00b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.365+0000 7f95ef59e700 1 --2- 172.21.15.36:0/3878981885 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f95f00b0010 0x7f95f00b55e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f95e0002f70 tx=0x7f95e0015000).stop 2022-01-10T01:25:05.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.365+0000 7f95ef59e700 1 -- 172.21.15.36:0/3878981885 shutdown_connections 2022-01-10T01:25:05.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.365+0000 7f95ef59e700 1 --2- 172.21.15.36:0/3878981885 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f95cc053620 0x7f95cc055ae0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.365+0000 7f95ef59e700 1 --2- 172.21.15.36:0/3878981885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95f00b2580 0x7f95f00ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.365+0000 7f95ef59e700 1 --2- 172.21.15.36:0/3878981885 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f95f00b0010 0x7f95f00b55e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.365+0000 7f95ef59e700 1 --2- 172.21.15.36:0/3878981885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95f00afbd0 0x7f95f00b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.365+0000 7f95ef59e700 1 -- 172.21.15.36:0/3878981885 >> 172.21.15.36:0/3878981885 conn(0x7f95f0060180 msgr2=0x7f95f0149de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:05.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.365+0000 7f95ef59e700 1 -- 172.21.15.36:0/3878981885 shutdown_connections 2022-01-10T01:25:05.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.365+0000 7f95ef59e700 1 -- 172.21.15.36:0/3878981885 wait complete. 2022-01-10T01:25:05.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:25:00.402523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:25:01.119067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:25:05.387 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:25:05.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.489+0000 7f70e6872700 1 Processor -- start 2022-01-10T01:25:05.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.489+0000 7f70e6872700 1 -- start start 2022-01-10T01:25:05.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e0146950 0x7f70e0140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f70e00b4180 0x7f70e0140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e0143b60 con 0x7f70e00b4690 2022-01-10T01:25:05.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e0147510 con 0x7f70e00b4180 2022-01-10T01:25:05.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e0143e00 con 0x7f70e0146950 2022-01-10T01:25:05.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70df7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f70e00b4180 0x7f70e0140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70df7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f70e00b4180 0x7f70e0140720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35186/0 (socket says 172.21.15.36:35186) 2022-01-10T01:25:05.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70df7fe700 1 -- 172.21.15.36:0/1060006552 learned_addr learned my addr 172.21.15.36:0/1060006552 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:05.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e4e0f700 1 --1- 172.21.15.36:0/1060006552 >> v1:172.21.15.36:6789/0 conn(0x7f70e00b4690 0x7f70e00b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:32984/0 (socket says 172.21.15.36:32984) 2022-01-10T01:25:05.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70dffff700 1 --2- 172.21.15.36:0/1060006552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e0146950 0x7f70e0140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70df7fe700 1 -- 172.21.15.36:0/1060006552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e0146950 msgr2=0x7f70e0140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:05.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70df7fe700 1 --2- 172.21.15.36:0/1060006552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e0146950 0x7f70e0140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70df7fe700 1 -- 172.21.15.36:0/1060006552 >> v1:172.21.15.36:6789/0 conn(0x7f70e00b4690 legacy=0x7f70e00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70df7fe700 1 -- 172.21.15.36:0/1060006552 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00b0c90 con 0x7f70e00b4180 2022-01-10T01:25:05.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70df7fe700 1 --2- 172.21.15.36:0/1060006552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70e00b4180 0x7f70e0140720 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f70d0002f70 tx=0x7f70d0006eb0).ready entity=mon.0 client_cookie=83a5da316c9a77be server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:05.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70deffd700 1 -- 172.21.15.36:0/1060006552 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70d000d5c0 con 0x7f70e00b4180 2022-01-10T01:25:05.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70deffd700 1 -- 172.21.15.36:0/1060006552 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d0000e90 con 0x7f70e00b4180 2022-01-10T01:25:05.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70deffd700 1 -- 172.21.15.36:0/1060006552 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70d000d950 con 0x7f70e00b4180 2022-01-10T01:25:05.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 -- 172.21.15.36:0/1060006552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70e00b4180 msgr2=0x7f70e0140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 --2- 172.21.15.36:0/1060006552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70e00b4180 0x7f70e0140720 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f70d0002f70 tx=0x7f70d0006eb0).stop 2022-01-10T01:25:05.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 -- 172.21.15.36:0/1060006552 shutdown_connections 2022-01-10T01:25:05.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 --2- 172.21.15.36:0/1060006552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70e00b4180 0x7f70e0140720 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 --2- 172.21.15.36:0/1060006552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e0146950 0x7f70e0140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 -- 172.21.15.36:0/1060006552 >> 172.21.15.36:0/1060006552 conn(0x7f70e005c490 msgr2=0x7f70e005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:05.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 -- 172.21.15.36:0/1060006552 shutdown_connections 2022-01-10T01:25:05.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 -- 172.21.15.36:0/1060006552 wait complete. 2022-01-10T01:25:05.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 Processor -- start 2022-01-10T01:25:05.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.493+0000 7f70e6872700 1 -- start start 2022-01-10T01:25:05.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70e6872700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e00b4180 0x7f70e01430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70e6872700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70e00b4690 0x7f70e00b8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70e6872700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e0146950 0x7f70e0152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70e6872700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00b0670 con 0x7f70e00b4690 2022-01-10T01:25:05.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70e6872700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00afe90 con 0x7f70e0146950 2022-01-10T01:25:05.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70e6872700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00b0130 con 0x7f70e00b4180 2022-01-10T01:25:05.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70df7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70e00b4690 0x7f70e00b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70df7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70e00b4690 0x7f70e00b8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35194/0 (socket says 172.21.15.36:35194) 2022-01-10T01:25:05.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70df7fe700 1 -- 172.21.15.36:0/1448116374 learned_addr learned my addr 172.21.15.36:0/1448116374 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:05.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70e4e0f700 1 --2- 172.21.15.36:0/1448116374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e0146950 0x7f70e0152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70dffff700 1 --2- 172.21.15.36:0/1448116374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e00b4180 0x7f70e01430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70df7fe700 1 -- 172.21.15.36:0/1448116374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e00b4180 msgr2=0x7f70e01430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70df7fe700 1 --2- 172.21.15.36:0/1448116374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e00b4180 0x7f70e01430e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70df7fe700 1 -- 172.21.15.36:0/1448116374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e0146950 msgr2=0x7f70e0152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70df7fe700 1 --2- 172.21.15.36:0/1448116374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e0146950 0x7f70e0152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70df7fe700 1 -- 172.21.15.36:0/1448116374 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d000b1e0 con 0x7f70e00b4690 2022-01-10T01:25:05.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70df7fe700 1 --2- 172.21.15.36:0/1448116374 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70e00b4690 0x7f70e00b8450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f70d0002f70 tx=0x7f70d0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:05.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70dd7fa700 1 -- 172.21.15.36:0/1448116374 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70d000d940 con 0x7f70e00b4690 2022-01-10T01:25:05.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70dd7fa700 1 -- 172.21.15.36:0/1448116374 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d0011b80 con 0x7f70e00b4690 2022-01-10T01:25:05.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70e6872700 1 -- 172.21.15.36:0/1448116374 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e00b03d0 con 0x7f70e00b4690 2022-01-10T01:25:05.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70dd7fa700 1 -- 172.21.15.36:0/1448116374 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70d001e460 con 0x7f70e00b4690 2022-01-10T01:25:05.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.497+0000 7f70e6872700 1 -- 172.21.15.36:0/1448116374 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e00b8940 con 0x7f70e00b4690 2022-01-10T01:25:05.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.501+0000 7f70e6872700 1 -- 172.21.15.36:0/1448116374 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e0057350 con 0x7f70e00b4690 2022-01-10T01:25:05.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.501+0000 7f70dd7fa700 1 -- 172.21.15.36:0/1448116374 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f70d0025030 con 0x7f70e00b4690 2022-01-10T01:25:05.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.501+0000 7f70dd7fa700 1 --2- 172.21.15.36:0/1448116374 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f70c40534d0 0x7f70c4055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.501+0000 7f70dd7fa700 1 -- 172.21.15.36:0/1448116374 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f70d006cb20 con 0x7f70e00b4690 2022-01-10T01:25:05.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.501+0000 7f70dffff700 1 --2- 172.21.15.36:0/1448116374 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f70c40534d0 0x7f70c4055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.501+0000 7f70dffff700 1 --2- 172.21.15.36:0/1448116374 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f70c40534d0 0x7f70c4055990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f70c800c000 tx=0x7f70c8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:05.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.513+0000 7f70dd7fa700 1 -- 172.21.15.36:0/1448116374 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f70d0043b30 con 0x7f70e00b4690 2022-01-10T01:25:05.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.637+0000 7f70e6872700 1 -- 172.21.15.36:0/1448116374 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f70e0060ef0 con 0x7f70e00b4690 2022-01-10T01:25:05.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.641+0000 7f70dd7fa700 1 -- 172.21.15.36:0/1448116374 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v36) v1 ==== 110+0+10 (secure 0 0 0) 0x7f70d0023070 con 0x7f70e00b4690 2022-01-10T01:25:05.644 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:25:05.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.641+0000 7f70e6872700 1 -- 172.21.15.36:0/1448116374 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f70c40534d0 msgr2=0x7f70c4055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.641+0000 7f70e6872700 1 --2- 172.21.15.36:0/1448116374 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f70c40534d0 0x7f70c4055990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f70c800c000 tx=0x7f70c8008040).stop 2022-01-10T01:25:05.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.641+0000 7f70e6872700 1 -- 172.21.15.36:0/1448116374 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70e00b4690 msgr2=0x7f70e00b8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.641+0000 7f70e6872700 1 --2- 172.21.15.36:0/1448116374 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70e00b4690 0x7f70e00b8450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f70d0002f70 tx=0x7f70d0015000).stop 2022-01-10T01:25:05.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.641+0000 7f70e6872700 1 -- 172.21.15.36:0/1448116374 shutdown_connections 2022-01-10T01:25:05.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.641+0000 7f70e6872700 1 --2- 172.21.15.36:0/1448116374 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f70c40534d0 0x7f70c4055990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.641+0000 7f70e6872700 1 --2- 172.21.15.36:0/1448116374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e0146950 0x7f70e0152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.641+0000 7f70e6872700 1 --2- 172.21.15.36:0/1448116374 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70e00b4690 0x7f70e00b8450 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.641+0000 7f70e6872700 1 --2- 172.21.15.36:0/1448116374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e00b4180 0x7f70e01430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.641+0000 7f70e6872700 1 -- 172.21.15.36:0/1448116374 >> 172.21.15.36:0/1448116374 conn(0x7f70e005c490 msgr2=0x7f70e00b97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:05.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.641+0000 7f70e6872700 1 -- 172.21.15.36:0/1448116374 shutdown_connections 2022-01-10T01:25:05.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.641+0000 7f70e6872700 1 -- 172.21.15.36:0/1448116374 wait complete. 2022-01-10T01:25:05.663 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:25:05.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea73f69700 1 Processor -- start 2022-01-10T01:25:05.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea73f69700 1 -- start start 2022-01-10T01:25:05.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea73f69700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea6c05fc00 0x7fea6c0b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea73f69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea6c0b5990 0x7fea6c0b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea73f69700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c143f60 con 0x7fea6c0b6560 2022-01-10T01:25:05.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea73f69700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6c0ba6b0 con 0x7fea6c05fc00 2022-01-10T01:25:05.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea73f69700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c05ffe0 con 0x7fea6c0b5990 2022-01-10T01:25:05.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea71504700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fea6c0b6560 0x7fea6c0b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:32996/0 (socket says 172.21.15.36:32996) 2022-01-10T01:25:05.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea71504700 1 -- 172.21.15.36:0/2609214009 learned_addr learned my addr 172.21.15.36:0/2609214009 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:25:05.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea72506700 1 --2- 172.21.15.36:0/2609214009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea6c0b5990 0x7fea6c0b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea71d05700 1 --2- 172.21.15.36:0/2609214009 >> v2:172.21.15.59:3300/0 conn(0x7fea6c05fc00 0x7fea6c0b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea70d03700 1 -- 172.21.15.36:0/2609214009 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030567656 0 0) 0x7fea6c143f60 con 0x7fea6c0b6560 2022-01-10T01:25:05.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea70d03700 1 -- 172.21.15.36:0/2609214009 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea54003260 con 0x7fea6c0b6560 2022-01-10T01:25:05.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea72506700 1 -- 172.21.15.36:0/2609214009 >> v2:172.21.15.59:3300/0 conn(0x7fea6c05fc00 msgr2=0x7fea6c0b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:05.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea72506700 1 --2- 172.21.15.36:0/2609214009 >> v2:172.21.15.59:3300/0 conn(0x7fea6c05fc00 0x7fea6c0b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea72506700 1 -- 172.21.15.36:0/2609214009 >> v1:172.21.15.36:6789/0 conn(0x7fea6c0b6560 legacy=0x7fea6c0b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea72506700 1 -- 172.21.15.36:0/2609214009 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c143a50 con 0x7fea6c0b5990 2022-01-10T01:25:05.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea72506700 1 --2- 172.21.15.36:0/2609214009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea6c0b5990 0x7fea6c0b4a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fea640032f0 tx=0x7fea640091d0).ready entity=mon.2 client_cookie=2584692e1a199b14 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:05.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea70d03700 1 -- 172.21.15.36:0/2609214009 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea6400b600 con 0x7fea6c0b5990 2022-01-10T01:25:05.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea70d03700 1 -- 172.21.15.36:0/2609214009 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6400b760 con 0x7fea6c0b5990 2022-01-10T01:25:05.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.769+0000 7fea70d03700 1 -- 172.21.15.36:0/2609214009 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea6400b8d0 con 0x7fea6c0b5990 2022-01-10T01:25:05.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.773+0000 7fea73f69700 1 -- 172.21.15.36:0/2609214009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea6c0b5990 msgr2=0x7fea6c0b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.773+0000 7fea73f69700 1 --2- 172.21.15.36:0/2609214009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea6c0b5990 0x7fea6c0b4a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fea640032f0 tx=0x7fea640091d0).stop 2022-01-10T01:25:05.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.773+0000 7fea73f69700 1 -- 172.21.15.36:0/2609214009 shutdown_connections 2022-01-10T01:25:05.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.773+0000 7fea73f69700 1 --2- 172.21.15.36:0/2609214009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea6c0b5990 0x7fea6c0b4a00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.773+0000 7fea73f69700 1 --2- 172.21.15.36:0/2609214009 >> v2:172.21.15.59:3300/0 conn(0x7fea6c05fc00 0x7fea6c0b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.773+0000 7fea73f69700 1 -- 172.21.15.36:0/2609214009 >> 172.21.15.36:0/2609214009 conn(0x7fea6c0623a0 msgr2=0x7fea6c066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:05.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.773+0000 7fea73f69700 1 -- 172.21.15.36:0/2609214009 shutdown_connections 2022-01-10T01:25:05.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.773+0000 7fea73f69700 1 -- 172.21.15.36:0/2609214009 wait complete. 2022-01-10T01:25:05.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.773+0000 7fea73f69700 1 Processor -- start 2022-01-10T01:25:05.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.773+0000 7fea73f69700 1 -- start start 2022-01-10T01:25:05.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea73f69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea6c05fc00 0x7fea6c0b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea73f69700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea6c0b5990 0x7fea6c12b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea73f69700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fea6c0b6560 0x7fea6c12b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea73f69700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c1464a0 con 0x7fea6c0b6560 2022-01-10T01:25:05.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea73f69700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c146740 con 0x7fea6c0b5990 2022-01-10T01:25:05.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea73f69700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c145c00 con 0x7fea6c05fc00 2022-01-10T01:25:05.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea72506700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fea6c0b6560 0x7fea6c12b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea72506700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fea6c0b6560 0x7fea6c12b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35208/0 (socket says 172.21.15.36:35208) 2022-01-10T01:25:05.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea72506700 1 -- 172.21.15.36:0/789768943 learned_addr learned my addr 172.21.15.36:0/789768943 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:05.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea71d05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea6c05fc00 0x7fea6c0b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea71504700 1 --2- 172.21.15.36:0/789768943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea6c0b5990 0x7fea6c12b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea72506700 1 -- 172.21.15.36:0/789768943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea6c05fc00 msgr2=0x7fea6c0b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea72506700 1 --2- 172.21.15.36:0/789768943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea6c05fc00 0x7fea6c0b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea72506700 1 -- 172.21.15.36:0/789768943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea6c0b5990 msgr2=0x7fea6c12b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea72506700 1 --2- 172.21.15.36:0/789768943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea6c0b5990 0x7fea6c12b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea72506700 1 -- 172.21.15.36:0/789768943 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea64009470 con 0x7fea6c0b6560 2022-01-10T01:25:05.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea71504700 1 --2- 172.21.15.36:0/789768943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea6c0b5990 0x7fea6c12b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:25:05.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea72506700 1 --2- 172.21.15.36:0/789768943 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fea6c0b6560 0x7fea6c12b690 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fea640032f0 tx=0x7fea64016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:05.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea5affd700 1 -- 172.21.15.36:0/789768943 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea6400b8d0 con 0x7fea6c0b6560 2022-01-10T01:25:05.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea5affd700 1 -- 172.21.15.36:0/789768943 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6401f3f0 con 0x7fea6c0b6560 2022-01-10T01:25:05.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea5affd700 1 -- 172.21.15.36:0/789768943 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea6400b600 con 0x7fea6c0b6560 2022-01-10T01:25:05.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea73f69700 1 -- 172.21.15.36:0/789768943 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c145ea0 con 0x7fea6c0b6560 2022-01-10T01:25:05.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.777+0000 7fea73f69700 1 -- 172.21.15.36:0/789768943 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c0b00d0 con 0x7fea6c0b6560 2022-01-10T01:25:05.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.781+0000 7fea73f69700 1 -- 172.21.15.36:0/789768943 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c143cc0 con 0x7fea6c0b6560 2022-01-10T01:25:05.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.781+0000 7fea5affd700 1 -- 172.21.15.36:0/789768943 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fea64026030 con 0x7fea6c0b6560 2022-01-10T01:25:05.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.781+0000 7fea5affd700 1 --2- 172.21.15.36:0/789768943 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fea4c0535f0 0x7fea4c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:05.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.781+0000 7fea71d05700 1 --2- 172.21.15.36:0/789768943 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fea4c0535f0 0x7fea4c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:05.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.781+0000 7fea5affd700 1 -- 172.21.15.36:0/789768943 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fea6406c750 con 0x7fea6c0b6560 2022-01-10T01:25:05.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.781+0000 7fea71d05700 1 --2- 172.21.15.36:0/789768943 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fea4c0535f0 0x7fea4c055ab0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fea6800b000 tx=0x7fea68006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:05.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.785+0000 7fea5affd700 1 -- 172.21.15.36:0/789768943 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fea640436c0 con 0x7fea6c0b6560 2022-01-10T01:25:05.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.909+0000 7fea73f69700 1 -- 172.21.15.36:0/789768943 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fea6c057350 con 0x7fea6c0b6560 2022-01-10T01:25:05.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.913+0000 7fea5affd700 1 -- 172.21.15.36:0/789768943 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v36) v1 ==== 92+0+10 (secure 0 0 0) 0x7fea640150a0 con 0x7fea6c0b6560 2022-01-10T01:25:05.916 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:25:05.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.913+0000 7fea73f69700 1 -- 172.21.15.36:0/789768943 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fea4c0535f0 msgr2=0x7fea4c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.913+0000 7fea73f69700 1 --2- 172.21.15.36:0/789768943 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fea4c0535f0 0x7fea4c055ab0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fea6800b000 tx=0x7fea68006df0).stop 2022-01-10T01:25:05.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.913+0000 7fea73f69700 1 -- 172.21.15.36:0/789768943 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fea6c0b6560 msgr2=0x7fea6c12b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:05.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.913+0000 7fea73f69700 1 --2- 172.21.15.36:0/789768943 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fea6c0b6560 0x7fea6c12b690 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fea640032f0 tx=0x7fea64016000).stop 2022-01-10T01:25:05.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.913+0000 7fea73f69700 1 -- 172.21.15.36:0/789768943 shutdown_connections 2022-01-10T01:25:05.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.913+0000 7fea73f69700 1 --2- 172.21.15.36:0/789768943 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fea4c0535f0 0x7fea4c055ab0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.913+0000 7fea73f69700 1 --2- 172.21.15.36:0/789768943 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fea6c0b6560 0x7fea6c12b690 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.913+0000 7fea73f69700 1 --2- 172.21.15.36:0/789768943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea6c0b5990 0x7fea6c12b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.913+0000 7fea73f69700 1 --2- 172.21.15.36:0/789768943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea6c05fc00 0x7fea6c0b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:05.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.913+0000 7fea73f69700 1 -- 172.21.15.36:0/789768943 >> 172.21.15.36:0/789768943 conn(0x7fea6c0623a0 msgr2=0x7fea6c12c470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:05.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.913+0000 7fea73f69700 1 -- 172.21.15.36:0/789768943 shutdown_connections 2022-01-10T01:25:05.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:05.913+0000 7fea73f69700 1 -- 172.21.15.36:0/789768943 wait complete. 2022-01-10T01:25:05.929 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:25:06.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.037+0000 7f3722d0e700 1 Processor -- start 2022-01-10T01:25:06.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.037+0000 7f3722d0e700 1 -- start start 2022-01-10T01:25:06.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.037+0000 7f3722d0e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c05ff60 0x7f371c140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.037+0000 7f3722d0e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f371c0611d0 0x7f371c140930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.037+0000 7f3722d0e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371c140e20 con 0x7f371c0b2710 2022-01-10T01:25:06.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.037+0000 7f3722d0e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f371c064910 con 0x7f371c0611d0 2022-01-10T01:25:06.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.037+0000 7f3722d0e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c064bb0 con 0x7f371c05ff60 2022-01-10T01:25:06.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.037+0000 7f37212ab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f371c0611d0 0x7f371c140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.037+0000 7f3720aaa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c05ff60 0x7f371c140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.037+0000 7f37212ab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f371c0611d0 0x7f371c140930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:60084/0 (socket says 172.21.15.36:60084) 2022-01-10T01:25:06.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.037+0000 7f37212ab700 1 -- 172.21.15.36:0/4191102919 learned_addr learned my addr 172.21.15.36:0/4191102919 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:06.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f37212ab700 1 -- 172.21.15.36:0/4191102919 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c05ff60 msgr2=0x7f371c140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:06.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f37212ab700 1 --2- 172.21.15.36:0/4191102919 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c05ff60 0x7f371c140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f37212ab700 1 -- 172.21.15.36:0/4191102919 >> v1:172.21.15.59:6789/0 conn(0x7f371c0b2710 legacy=0x7f371c143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f37212ab700 1 -- 172.21.15.36:0/4191102919 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371c064e50 con 0x7f371c0611d0 2022-01-10T01:25:06.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f37212ab700 1 --2- 172.21.15.36:0/4191102919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f371c0611d0 0x7f371c140930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f37140032f0 tx=0x7f3714009290).ready entity=mon.1 client_cookie=d5868950912b4e48 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:06.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f371b7fe700 1 -- 172.21.15.36:0/4191102919 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f371400b8a0 con 0x7f371c0611d0 2022-01-10T01:25:06.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f371b7fe700 1 -- 172.21.15.36:0/4191102919 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371400ba00 con 0x7f371c0611d0 2022-01-10T01:25:06.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f371b7fe700 1 -- 172.21.15.36:0/4191102919 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f371400bb70 con 0x7f371c0611d0 2022-01-10T01:25:06.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f3722d0e700 1 -- 172.21.15.36:0/4191102919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f371c0611d0 msgr2=0x7f371c140930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f3722d0e700 1 --2- 172.21.15.36:0/4191102919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f371c0611d0 0x7f371c140930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f37140032f0 tx=0x7f3714009290).stop 2022-01-10T01:25:06.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f3722d0e700 1 -- 172.21.15.36:0/4191102919 shutdown_connections 2022-01-10T01:25:06.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f3722d0e700 1 --2- 172.21.15.36:0/4191102919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f371c0611d0 0x7f371c140930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f3722d0e700 1 --2- 172.21.15.36:0/4191102919 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c05ff60 0x7f371c140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f3722d0e700 1 -- 172.21.15.36:0/4191102919 >> 172.21.15.36:0/4191102919 conn(0x7f371c05cf60 msgr2=0x7f371c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:06.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f3722d0e700 1 -- 172.21.15.36:0/4191102919 shutdown_connections 2022-01-10T01:25:06.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f3722d0e700 1 -- 172.21.15.36:0/4191102919 wait complete. 2022-01-10T01:25:06.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f3722d0e700 1 Processor -- start 2022-01-10T01:25:06.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.041+0000 7f3722d0e700 1 -- start start 2022-01-10T01:25:06.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f3722d0e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f371c05ff60 0x7f371c1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f3722d0e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f371c0611d0 0x7f371c13f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f3722d0e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c0b2710 0x7f371c0af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f3722d0e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c0b51e0 con 0x7f371c0611d0 2022-01-10T01:25:06.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f3722d0e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c0b5480 con 0x7f371c05ff60 2022-01-10T01:25:06.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f3722d0e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371c0b5720 con 0x7f371c0b2710 2022-01-10T01:25:06.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f371bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f371c0611d0 0x7f371c13f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f371bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f371c0611d0 0x7f371c13f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35222/0 (socket says 172.21.15.36:35222) 2022-01-10T01:25:06.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f371bfff700 1 -- 172.21.15.36:0/2569943688 learned_addr learned my addr 172.21.15.36:0/2569943688 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:06.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f3720aaa700 1 --2- 172.21.15.36:0/2569943688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f371c05ff60 0x7f371c1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f37212ab700 1 --2- 172.21.15.36:0/2569943688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c0b2710 0x7f371c0af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f371bfff700 1 -- 172.21.15.36:0/2569943688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c0b2710 msgr2=0x7f371c0af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f371bfff700 1 --2- 172.21.15.36:0/2569943688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c0b2710 0x7f371c0af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f371bfff700 1 -- 172.21.15.36:0/2569943688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f371c05ff60 msgr2=0x7f371c1524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f371bfff700 1 --2- 172.21.15.36:0/2569943688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f371c05ff60 0x7f371c1524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f371bfff700 1 -- 172.21.15.36:0/2569943688 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714009530 con 0x7f371c0611d0 2022-01-10T01:25:06.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f371bfff700 1 --2- 172.21.15.36:0/2569943688 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f371c0611d0 0x7f371c13f1d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f371c0b20d0 tx=0x7f370c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:06.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f3719ffb700 1 -- 172.21.15.36:0/2569943688 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f370c012400 con 0x7f371c0611d0 2022-01-10T01:25:06.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f3719ffb700 1 -- 172.21.15.36:0/2569943688 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c012560 con 0x7f371c0611d0 2022-01-10T01:25:06.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f3722d0e700 1 -- 172.21.15.36:0/2569943688 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371c0aefa0 con 0x7f371c0611d0 2022-01-10T01:25:06.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f3719ffb700 1 -- 172.21.15.36:0/2569943688 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f370c0128c0 con 0x7f371c0611d0 2022-01-10T01:25:06.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.045+0000 7f3722d0e700 1 -- 172.21.15.36:0/2569943688 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371c1529a0 con 0x7f371c0611d0 2022-01-10T01:25:06.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.049+0000 7f3722d0e700 1 -- 172.21.15.36:0/2569943688 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371c0af130 con 0x7f371c0611d0 2022-01-10T01:25:06.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.049+0000 7f3719ffb700 1 -- 172.21.15.36:0/2569943688 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f370c019030 con 0x7f371c0611d0 2022-01-10T01:25:06.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.049+0000 7f3719ffb700 1 --2- 172.21.15.36:0/2569943688 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f36fc0535f0 0x7f36fc055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.049+0000 7f3719ffb700 1 -- 172.21.15.36:0/2569943688 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f370c06af90 con 0x7f371c0611d0 2022-01-10T01:25:06.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.049+0000 7f3720aaa700 1 --2- 172.21.15.36:0/2569943688 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f36fc0535f0 0x7f36fc055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.049+0000 7f3720aaa700 1 --2- 172.21.15.36:0/2569943688 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f36fc0535f0 0x7f36fc055ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f371000b000 tx=0x7f3710006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:06.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.057+0000 7f3719ffb700 1 -- 172.21.15.36:0/2569943688 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f370c041e10 con 0x7f371c0611d0 2022-01-10T01:25:06.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.181+0000 7f3722d0e700 1 -- 172.21.15.36:0/2569943688 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f371c0650f0 con 0x7f371c0611d0 2022-01-10T01:25:06.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.185+0000 7f3719ffb700 1 -- 172.21.15.36:0/2569943688 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v36) v1 ==== 104+0+10 (secure 0 0 0) 0x7f370c045430 con 0x7f371c0611d0 2022-01-10T01:25:06.188 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:25:06.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.185+0000 7f3722d0e700 1 -- 172.21.15.36:0/2569943688 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f36fc0535f0 msgr2=0x7f36fc055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.185+0000 7f3722d0e700 1 --2- 172.21.15.36:0/2569943688 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f36fc0535f0 0x7f36fc055ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f371000b000 tx=0x7f3710006df0).stop 2022-01-10T01:25:06.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.185+0000 7f3722d0e700 1 -- 172.21.15.36:0/2569943688 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f371c0611d0 msgr2=0x7f371c13f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.185+0000 7f3722d0e700 1 --2- 172.21.15.36:0/2569943688 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f371c0611d0 0x7f371c13f1d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f371c0b20d0 tx=0x7f370c007c50).stop 2022-01-10T01:25:06.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.185+0000 7f3722d0e700 1 -- 172.21.15.36:0/2569943688 shutdown_connections 2022-01-10T01:25:06.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.185+0000 7f3722d0e700 1 --2- 172.21.15.36:0/2569943688 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f36fc0535f0 0x7f36fc055ab0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.185+0000 7f3722d0e700 1 --2- 172.21.15.36:0/2569943688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f371c0b2710 0x7f371c0af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.185+0000 7f3722d0e700 1 --2- 172.21.15.36:0/2569943688 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f371c0611d0 0x7f371c13f1d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.185+0000 7f3722d0e700 1 --2- 172.21.15.36:0/2569943688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f371c05ff60 0x7f371c1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.185+0000 7f3722d0e700 1 -- 172.21.15.36:0/2569943688 >> 172.21.15.36:0/2569943688 conn(0x7f371c05cf60 msgr2=0x7f371c13fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:06.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.189+0000 7f3722d0e700 1 -- 172.21.15.36:0/2569943688 shutdown_connections 2022-01-10T01:25:06.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.189+0000 7f3722d0e700 1 -- 172.21.15.36:0/2569943688 wait complete. 2022-01-10T01:25:06.206 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:25:06.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.317+0000 7f98f8a74700 1 Processor -- start 2022-01-10T01:25:06.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.317+0000 7f98f8a74700 1 -- start start 2022-01-10T01:25:06.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.317+0000 7f98f8a74700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98f40b27a0 0x7f98f4147470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.317+0000 7f98f8a74700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f98f40b1d10 0x7f98f414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.317+0000 7f98f8a74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f405c490 0x7f98f40a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.317+0000 7f98f8a74700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f41451b0 con 0x7f98f40b1d10 2022-01-10T01:25:06.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.317+0000 7f98f8a74700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f40b2b80 con 0x7f98f40b27a0 2022-01-10T01:25:06.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.317+0000 7f98f8a74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f414aad0 con 0x7f98f405c490 2022-01-10T01:25:06.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.317+0000 7f98f2ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f98f40b1d10 0x7f98f414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.317+0000 7f98f2ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f98f40b1d10 0x7f98f414b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35230/0 (socket says 172.21.15.36:35230) 2022-01-10T01:25:06.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.317+0000 7f98f2ffd700 1 -- 172.21.15.36:0/3201957978 learned_addr learned my addr 172.21.15.36:0/3201957978 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:06.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.317+0000 7f98f3fff700 1 --2- 172.21.15.36:0/3201957978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f405c490 0x7f98f40a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.317+0000 7f98f37fe700 1 --2- 172.21.15.36:0/3201957978 >> v2:172.21.15.59:3300/0 conn(0x7f98f40b27a0 0x7f98f4147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f2ffd700 1 -- 172.21.15.36:0/3201957978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f405c490 msgr2=0x7f98f40a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:06.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f2ffd700 1 --2- 172.21.15.36:0/3201957978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f405c490 0x7f98f40a8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f2ffd700 1 -- 172.21.15.36:0/3201957978 >> v2:172.21.15.59:3300/0 conn(0x7f98f40b27a0 msgr2=0x7f98f4147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:06.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f2ffd700 1 --2- 172.21.15.36:0/3201957978 >> v2:172.21.15.59:3300/0 conn(0x7f98f40b27a0 0x7f98f4147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f2ffd700 1 -- 172.21.15.36:0/3201957978 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f40b0ec0 con 0x7f98f40b1d10 2022-01-10T01:25:06.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f3fff700 1 --2- 172.21.15.36:0/3201957978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f405c490 0x7f98f40a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:25:06.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f2ffd700 1 --2- 172.21.15.36:0/3201957978 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98f40b1d10 0x7f98f414b1d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f98e8002f70 tx=0x7f98e8006eb0).ready entity=mon.0 client_cookie=edb50c05db8051b3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:06.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f27fc700 1 -- 172.21.15.36:0/3201957978 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e800d570 con 0x7f98f40b1d10 2022-01-10T01:25:06.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f27fc700 1 -- 172.21.15.36:0/3201957978 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e8000e90 con 0x7f98f40b1d10 2022-01-10T01:25:06.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f27fc700 1 -- 172.21.15.36:0/3201957978 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e800d900 con 0x7f98f40b1d10 2022-01-10T01:25:06.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f8a74700 1 -- 172.21.15.36:0/3201957978 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98f40b1d10 msgr2=0x7f98f414b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f8a74700 1 --2- 172.21.15.36:0/3201957978 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98f40b1d10 0x7f98f414b1d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f98e8002f70 tx=0x7f98e8006eb0).stop 2022-01-10T01:25:06.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f8a74700 1 -- 172.21.15.36:0/3201957978 shutdown_connections 2022-01-10T01:25:06.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f8a74700 1 --2- 172.21.15.36:0/3201957978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f405c490 0x7f98f40a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f8a74700 1 --2- 172.21.15.36:0/3201957978 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98f40b1d10 0x7f98f414b1d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f8a74700 1 --2- 172.21.15.36:0/3201957978 >> v2:172.21.15.59:3300/0 conn(0x7f98f40b27a0 0x7f98f4147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f8a74700 1 -- 172.21.15.36:0/3201957978 >> 172.21.15.36:0/3201957978 conn(0x7f98f4061140 msgr2=0x7f98f4062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:06.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f8a74700 1 -- 172.21.15.36:0/3201957978 shutdown_connections 2022-01-10T01:25:06.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.321+0000 7f98f8a74700 1 -- 172.21.15.36:0/3201957978 wait complete. 2022-01-10T01:25:06.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f8a74700 1 Processor -- start 2022-01-10T01:25:06.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f8a74700 1 -- start start 2022-01-10T01:25:06.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f8a74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f405c490 0x7f98f40a9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f8a74700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98f40b1d10 0x7f98f40abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f8a74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f40b27a0 0x7f98f4159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f8a74700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f41464d0 con 0x7f98f40b1d10 2022-01-10T01:25:06.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f8a74700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f4146a50 con 0x7f98f405c490 2022-01-10T01:25:06.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f8a74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f4146140 con 0x7f98f40b27a0 2022-01-10T01:25:06.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f2ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98f40b1d10 0x7f98f40abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f2ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98f40b1d10 0x7f98f40abbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35236/0 (socket says 172.21.15.36:35236) 2022-01-10T01:25:06.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f2ffd700 1 -- 172.21.15.36:0/3386161959 learned_addr learned my addr 172.21.15.36:0/3386161959 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:06.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f3fff700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f40b27a0 0x7f98f4159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f37fe700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f405c490 0x7f98f40a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f2ffd700 1 -- 172.21.15.36:0/3386161959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f40b27a0 msgr2=0x7f98f4159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f2ffd700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f40b27a0 0x7f98f4159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f2ffd700 1 -- 172.21.15.36:0/3386161959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f405c490 msgr2=0x7f98f40a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f2ffd700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f405c490 0x7f98f40a9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f2ffd700 1 -- 172.21.15.36:0/3386161959 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec009470 con 0x7f98f40b1d10 2022-01-10T01:25:06.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f3fff700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f40b27a0 0x7f98f4159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:25:06.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f2ffd700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98f40b1d10 0x7f98f40abbd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f98e8002f70 tx=0x7f98e8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:06.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f0ff9700 1 -- 172.21.15.36:0/3386161959 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e80117e0 con 0x7f98f40b1d10 2022-01-10T01:25:06.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f0ff9700 1 -- 172.21.15.36:0/3386161959 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e8011940 con 0x7f98f40b1d10 2022-01-10T01:25:06.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f8a74700 1 -- 172.21.15.36:0/3386161959 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e800b1e0 con 0x7f98f40b1d10 2022-01-10T01:25:06.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f0ff9700 1 -- 172.21.15.36:0/3386161959 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e8011ca0 con 0x7f98f40b1d10 2022-01-10T01:25:06.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.325+0000 7f98f8a74700 1 -- 172.21.15.36:0/3386161959 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f40ab700 con 0x7f98f40b1d10 2022-01-10T01:25:06.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.329+0000 7f98f0ff9700 1 -- 172.21.15.36:0/3386161959 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f98e8025030 con 0x7f98f40b1d10 2022-01-10T01:25:06.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.329+0000 7f98f8a74700 1 -- 172.21.15.36:0/3386161959 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f4147870 con 0x7f98f40b1d10 2022-01-10T01:25:06.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.329+0000 7f98f0ff9700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f98d40534d0 0x7f98d4055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.329+0000 7f98f37fe700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f98d40534d0 0x7f98d4055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.329+0000 7f98f0ff9700 1 -- 172.21.15.36:0/3386161959 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f98e806ccd0 con 0x7f98f40b1d10 2022-01-10T01:25:06.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.329+0000 7f98f37fe700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f98d40534d0 0x7f98d4055990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f98e400b000 tx=0x7f98e4006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:06.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.337+0000 7f98f0ff9700 1 -- 172.21.15.36:0/3386161959 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f98e8043b50 con 0x7f98f40b1d10 2022-01-10T01:25:06.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.465+0000 7f98f8a74700 1 -- 172.21.15.36:0/3386161959 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98f4057350 con 0x7f98f40b1d10 2022-01-10T01:25:06.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.469+0000 7f98f0ff9700 1 -- 172.21.15.36:0/3386161959 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v36) v1 ==== 100+0+10 (secure 0 0 0) 0x7f98e8023020 con 0x7f98f40b1d10 2022-01-10T01:25:06.472 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:25:06.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.469+0000 7f98f8a74700 1 -- 172.21.15.36:0/3386161959 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f98d40534d0 msgr2=0x7f98d4055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.469+0000 7f98f8a74700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f98d40534d0 0x7f98d4055990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f98e400b000 tx=0x7f98e4006df0).stop 2022-01-10T01:25:06.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.469+0000 7f98f8a74700 1 -- 172.21.15.36:0/3386161959 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98f40b1d10 msgr2=0x7f98f40abbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.469+0000 7f98f8a74700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98f40b1d10 0x7f98f40abbd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f98e8002f70 tx=0x7f98e8015000).stop 2022-01-10T01:25:06.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.469+0000 7f98f8a74700 1 -- 172.21.15.36:0/3386161959 shutdown_connections 2022-01-10T01:25:06.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.469+0000 7f98f8a74700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f98d40534d0 0x7f98d4055990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.469+0000 7f98f8a74700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98f40b27a0 0x7f98f4159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.469+0000 7f98f8a74700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98f40b1d10 0x7f98f40abbd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.469+0000 7f98f8a74700 1 --2- 172.21.15.36:0/3386161959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f405c490 0x7f98f40a9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.469+0000 7f98f8a74700 1 -- 172.21.15.36:0/3386161959 >> 172.21.15.36:0/3386161959 conn(0x7f98f4061140 msgr2=0x7f98f414b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:06.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.469+0000 7f98f8a74700 1 -- 172.21.15.36:0/3386161959 shutdown_connections 2022-01-10T01:25:06.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.469+0000 7f98f8a74700 1 -- 172.21.15.36:0/3386161959 wait complete. 2022-01-10T01:25:06.495 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:25:06.496 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:25:06.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9359e700 1 Processor -- start 2022-01-10T01:25:06.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9359e700 1 -- start start 2022-01-10T01:25:06.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f940b2580 0x7f6f9414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9359e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f6f940a8ac0 0x7f6f9414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f940a70c0 con 0x7f6f940b0010 2022-01-10T01:25:06.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9359e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f940a72f0 con 0x7f6f940a8ac0 2022-01-10T01:25:06.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9359e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f940a7590 con 0x7f6f940b2580 2022-01-10T01:25:06.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f92d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f6f940a8ac0 0x7f6f9414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f92d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f6f940a8ac0 0x7f6f9414b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35246/0 (socket says 172.21.15.36:35246) 2022-01-10T01:25:06.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f92d9d700 1 -- 172.21.15.36:0/1955688793 learned_addr learned my addr 172.21.15.36:0/1955688793 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:06.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9259c700 1 --2- 172.21.15.36:0/1955688793 >> v2:172.21.15.59:3300/0 conn(0x7f6f940b2580 0x7f6f9414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9259c700 1 -- 172.21.15.36:0/1955688793 >> v2:172.21.15.36:3300/0 conn(0x7f6f940a8ac0 msgr2=0x7f6f9414b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:06.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9259c700 1 --2- 172.21.15.36:0/1955688793 >> v2:172.21.15.36:3300/0 conn(0x7f6f940a8ac0 0x7f6f9414b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9259c700 1 -- 172.21.15.36:0/1955688793 >> v1:172.21.15.59:6789/0 conn(0x7f6f940b0010 legacy=0x7f6f940a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9259c700 1 -- 172.21.15.36:0/1955688793 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f940a7830 con 0x7f6f940b2580 2022-01-10T01:25:06.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9259c700 1 --2- 172.21.15.36:0/1955688793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f940b2580 0x7f6f9414ae40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f6f7c002f70 tx=0x7f6f7c006df0).ready entity=mon.1 client_cookie=c1b2021b948c059f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:06.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9159a700 1 -- 172.21.15.36:0/1955688793 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f7c00d570 con 0x7f6f940b2580 2022-01-10T01:25:06.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9159a700 1 -- 172.21.15.36:0/1955688793 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c000e90 con 0x7f6f940b2580 2022-01-10T01:25:06.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9159a700 1 -- 172.21.15.36:0/1955688793 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f7c00d8c0 con 0x7f6f940b2580 2022-01-10T01:25:06.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9359e700 1 -- 172.21.15.36:0/1955688793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f940b2580 msgr2=0x7f6f9414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9359e700 1 --2- 172.21.15.36:0/1955688793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f940b2580 0x7f6f9414ae40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f6f7c002f70 tx=0x7f6f7c006df0).stop 2022-01-10T01:25:06.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9359e700 1 -- 172.21.15.36:0/1955688793 shutdown_connections 2022-01-10T01:25:06.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9359e700 1 --2- 172.21.15.36:0/1955688793 >> v2:172.21.15.36:3300/0 conn(0x7f6f940a8ac0 0x7f6f9414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9359e700 1 --2- 172.21.15.36:0/1955688793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f940b2580 0x7f6f9414ae40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.597+0000 7f6f9359e700 1 -- 172.21.15.36:0/1955688793 >> 172.21.15.36:0/1955688793 conn(0x7f6f94060180 msgr2=0x7f6f940b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:06.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9359e700 1 -- 172.21.15.36:0/1955688793 shutdown_connections 2022-01-10T01:25:06.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9359e700 1 -- 172.21.15.36:0/1955688793 wait complete. 2022-01-10T01:25:06.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9359e700 1 Processor -- start 2022-01-10T01:25:06.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9359e700 1 -- start start 2022-01-10T01:25:06.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f940a8ac0 0x7f6f940aa410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f940b0010 0x7f6f9415a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f940b2580 0x7f6f941564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940aab90 con 0x7f6f940a8ac0 2022-01-10T01:25:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9415a940 con 0x7f6f940b2580 2022-01-10T01:25:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94064320 con 0x7f6f940b0010 2022-01-10T01:25:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f940a8ac0 0x7f6f940aa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f940a8ac0 0x7f6f940aa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35248/0 (socket says 172.21.15.36:35248) 2022-01-10T01:25:06.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9259c700 1 -- 172.21.15.36:0/507497844 learned_addr learned my addr 172.21.15.36:0/507497844 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:06.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f91d9b700 1 --2- 172.21.15.36:0/507497844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f940b0010 0x7f6f9415a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f92d9d700 1 --2- 172.21.15.36:0/507497844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f940b2580 0x7f6f941564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9259c700 1 -- 172.21.15.36:0/507497844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f940b0010 msgr2=0x7f6f9415a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9259c700 1 --2- 172.21.15.36:0/507497844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f940b0010 0x7f6f9415a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9259c700 1 -- 172.21.15.36:0/507497844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f940b2580 msgr2=0x7f6f941564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9259c700 1 --2- 172.21.15.36:0/507497844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f940b2580 0x7f6f941564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9259c700 1 -- 172.21.15.36:0/507497844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c00b180 con 0x7f6f940a8ac0 2022-01-10T01:25:06.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9259c700 1 --2- 172.21.15.36:0/507497844 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f940a8ac0 0x7f6f940aa410 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f6f7c002f70 tx=0x7f6f7c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:06.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f8b7fe700 1 -- 172.21.15.36:0/507497844 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f7c00dea0 con 0x7f6f940a8ac0 2022-01-10T01:25:06.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f8b7fe700 1 -- 172.21.15.36:0/507497844 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c013e90 con 0x7f6f940a8ac0 2022-01-10T01:25:06.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9359e700 1 -- 172.21.15.36:0/507497844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f94063550 con 0x7f6f940a8ac0 2022-01-10T01:25:06.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f8b7fe700 1 -- 172.21.15.36:0/507497844 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f7c01e5f0 con 0x7f6f940a8ac0 2022-01-10T01:25:06.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.601+0000 7f6f9359e700 1 -- 172.21.15.36:0/507497844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f94063ef0 con 0x7f6f940a8ac0 2022-01-10T01:25:06.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.605+0000 7f6f9359e700 1 -- 172.21.15.36:0/507497844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f94064520 con 0x7f6f940a8ac0 2022-01-10T01:25:06.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.605+0000 7f6f8b7fe700 1 -- 172.21.15.36:0/507497844 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6f7c01c070 con 0x7f6f940a8ac0 2022-01-10T01:25:06.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.605+0000 7f6f8b7fe700 1 --2- 172.21.15.36:0/507497844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f78053590 0x7f6f78055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:06.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.605+0000 7f6f91d9b700 1 --2- 172.21.15.36:0/507497844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f78053590 0x7f6f78055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:06.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.605+0000 7f6f8b7fe700 1 -- 172.21.15.36:0/507497844 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6f7c06c5c0 con 0x7f6f940a8ac0 2022-01-10T01:25:06.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.605+0000 7f6f91d9b700 1 --2- 172.21.15.36:0/507497844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f78053590 0x7f6f78055a50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f6f8c00d000 tx=0x7f6f8c007f10).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:06.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.613+0000 7f6f8b7fe700 1 -- 172.21.15.36:0/507497844 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f7c043440 con 0x7f6f940a8ac0 2022-01-10T01:25:06.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.777+0000 7f6f9359e700 1 -- 172.21.15.36:0/507497844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f94057350 con 0x7f6f940a8ac0 2022-01-10T01:25:06.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.777+0000 7f6f8b7fe700 1 -- 172.21.15.36:0/507497844 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f6f7c023020 con 0x7f6f940a8ac0 2022-01-10T01:25:06.782 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:25:06.782 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1410680575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1410680575},{"type":"v1","addr":"172.21.15.36:6837","nonce":1410680575}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/1811767033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1811767033},{"type":"v1","addr":"172.21.15.59:6833","nonce":1811767033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:25:02.143464+0000","modified":"2022-01-10T01:25:03.146833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/2488750467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2488750467},{"type":"v1","addr":"172.21.15.36:6835","nonce":2488750467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2022-01-10T01:25:06.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.777+0000 7f6f9359e700 1 -- 172.21.15.36:0/507497844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f78053590 msgr2=0x7f6f78055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.777+0000 7f6f9359e700 1 --2- 172.21.15.36:0/507497844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f78053590 0x7f6f78055a50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f6f8c00d000 tx=0x7f6f8c007f10).stop 2022-01-10T01:25:06.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.777+0000 7f6f9359e700 1 -- 172.21.15.36:0/507497844 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f940a8ac0 msgr2=0x7f6f940aa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:06.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.777+0000 7f6f9359e700 1 --2- 172.21.15.36:0/507497844 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f940a8ac0 0x7f6f940aa410 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f6f7c002f70 tx=0x7f6f7c014000).stop 2022-01-10T01:25:06.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.777+0000 7f6f9359e700 1 -- 172.21.15.36:0/507497844 shutdown_connections 2022-01-10T01:25:06.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.777+0000 7f6f9359e700 1 --2- 172.21.15.36:0/507497844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f78053590 0x7f6f78055a50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.777+0000 7f6f9359e700 1 --2- 172.21.15.36:0/507497844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f940b2580 0x7f6f941564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.777+0000 7f6f9359e700 1 --2- 172.21.15.36:0/507497844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f940b0010 0x7f6f9415a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.777+0000 7f6f9359e700 1 --2- 172.21.15.36:0/507497844 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f940a8ac0 0x7f6f940aa410 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:06.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.777+0000 7f6f9359e700 1 -- 172.21.15.36:0/507497844 >> 172.21.15.36:0/507497844 conn(0x7f6f94060180 msgr2=0x7f6f94067710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:06.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.781+0000 7f6f9359e700 1 -- 172.21.15.36:0/507497844 shutdown_connections 2022-01-10T01:25:06.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:06.781+0000 7f6f9359e700 1 -- 172.21.15.36:0/507497844 wait complete. 2022-01-10T01:25:06.787 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 13 2022-01-10T01:25:07.096 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:25:02.143464+0000', 'modified': '2022-01-10T01:25:03.146833+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4882}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4882': {'gid': 4882, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6835/2488750467', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6834', 'nonce': 2488750467}, {'type': 'v1', 'addr': '172.21.15.36:6835', 'nonce': 2488750467}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:25:07.097 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:25:07.097 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-10T01:25:07.213 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":4882,"want_state":"up:active","state":"up:active","rank_uptime":5.0567339540000003,"mdsmap_epoch":13,"osdmap_epoch":36,"osdmap_epoch_barrier":35,"uptime":11.454491311} 2022-01-10T01:25:07.213 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 4882, "mdsmap_epoch": 13, "osdmap_epoch": 36, "osdmap_epoch_barrier": 35, "rank_uptime": 5.056733954, "state": "up:active", "uptime": 11.454491311, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:25:07.214 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:25:07.214 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:25:07.215 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:25:07.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:25:07.215 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:25:07.224 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:25:07.243 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:25:07.243 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:25:07.257 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:25:07.258 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:25:07.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:25:07.259 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:25:07.306 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:25:07.306 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:25:07.310 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:25:07.329 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:25:07.330 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:25:07.383 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:25:07.378+0000 7f932a2d9080 -1 init, newargv = 0x5613504ecda0 newargc=9ceph-fuse[14060]: starting ceph client 2022-01-10T01:25:07.384 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr: 2022-01-10T01:25:07.386 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:25:07.387 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:25:07.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:25:07.388 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:25:07.394 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14060]: starting fuse 2022-01-10T01:25:08.495 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:25:08.515 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:25:08.516 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:25:08.575 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:25:08.576 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:25:08.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:25:08.578 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:25:08.583 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:25:08.583 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:25:08.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:25:08.584 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:25:08.585 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:25:08.585 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:25:08.585 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:25:08.586 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:25:08.586 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:25:08.587 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:25:08.587 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:25:08.588 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:25:08.588 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:25:08.588 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:25:08.589 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:25:08.589 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:25:08.590 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:25:08.591 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:25:08.592 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:25:08.592 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:25:08.593 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:25:08.593 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:25:08.593 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:25:08.594 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:25:08.595 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:25:08.595 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:25:08.641 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.14060.asok 2022-01-10T01:25:08.646 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14060.asok 2022-01-10T01:25:08.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:25:08.647 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14060.asok status 2022-01-10T01:25:08.733 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:25:08.733 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:25:08.734 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:25:08.734 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:25:08.734 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:25:08.735 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:25:08.735 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:25:08.735 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "14060", 2022-01-10T01:25:08.735 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:25:08.735 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:25:08.736 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:25:08.736 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:25:08.736 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 5055, 2022-01-10T01:25:08.736 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:25:08.737 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:25:08.737 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:25:08.737 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 5055 2022-01-10T01:25:08.737 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:25:08.738 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:25:08.738 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:25:08.738 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:25:08.738 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 3432258625 2022-01-10T01:25:08.739 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:25:08.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:25:08.739 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:25:08.739 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:25:08.739 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:25:08.740 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 3432258625 2022-01-10T01:25:08.740 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:25:08.740 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.5055 172.21.15.139:0/3432258625", 2022-01-10T01:25:08.740 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/3432258625", 2022-01-10T01:25:08.741 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:25:08.741 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 13, 2022-01-10T01:25:08.741 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 36, 2022-01-10T01:25:08.741 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:25:08.741 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:25:08.742 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:25:08.742 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:25:08.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:25:08.744 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:25:08.745 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:25:08.751 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:25:08.753 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:25:08.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:25:08.754 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:25:08.771 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_min_caps_per_client 2022-01-10T01:25:08.880 INFO:teuthology.orchestra.run.smithi036.stdout:{"mds_min_caps_per_client":"100"} 2022-01-10T01:25:08.881 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_min_caps_per_client": "100" } 2022-01-10T01:25:08.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:25:08.883 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:25:08.883 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:25:08.892 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:25:08.894 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:25:08.895 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-01-10T01:25:08.896 DEBUG:teuthology.orchestra.run.smithi139:> import sys 2022-01-10T01:25:08.897 DEBUG:teuthology.orchestra.run.smithi139:> import time 2022-01-10T01:25:08.898 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:25:08.899 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:25:08.899 DEBUG:teuthology.orchestra.run.smithi139:> n = 1000 2022-01-10T01:25:08.900 DEBUG:teuthology.orchestra.run.smithi139:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2022-01-10T01:25:08.901 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:25:08.902 DEBUG:teuthology.orchestra.run.smithi139:> if not os.path.exists(os.path.dirname(abs_path)): 2022-01-10T01:25:08.903 DEBUG:teuthology.orchestra.run.smithi139:> os.makedirs(os.path.dirname(abs_path)) 2022-01-10T01:25:08.903 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:25:08.904 DEBUG:teuthology.orchestra.run.smithi139:> for i in range(0, n): 2022-01-10T01:25:08.904 DEBUG:teuthology.orchestra.run.smithi139:> fname = "{0}_{1}".format(abs_path, i) 2022-01-10T01:25:08.905 DEBUG:teuthology.orchestra.run.smithi139:> with open(fname, '"'"'w'"'"') as f: 2022-01-10T01:25:08.906 DEBUG:teuthology.orchestra.run.smithi139:> f.write('"'"'content'"'"') 2022-01-10T01:25:08.906 DEBUG:teuthology.orchestra.run.smithi139:> if True: 2022-01-10T01:25:08.907 DEBUG:teuthology.orchestra.run.smithi139:> f.flush() 2022-01-10T01:25:08.907 DEBUG:teuthology.orchestra.run.smithi139:> os.fsync(f.fileno()) 2022-01-10T01:25:08.908 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:25:19.993 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:25:20.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f5470e5a700 1 Processor -- start 2022-01-10T01:25:20.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f5470e5a700 1 -- start start 2022-01-10T01:25:20.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f5470e5a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f546c0a8ac0 0x7f546c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f5470e5a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546c0a70c0 con 0x7f546c0b2580 2022-01-10T01:25:20.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f5470e5a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546c0a72f0 con 0x7f546c0b0010 2022-01-10T01:25:20.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f5470e5a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546c0a7590 con 0x7f546c0a8ac0 2022-01-10T01:25:20.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546b7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f546c0b2580 0x7f546c14ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33054/0 (socket says 172.21.15.36:33054) 2022-01-10T01:25:20.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546b7fe700 1 -- 172.21.15.36:0/3479928037 learned_addr learned my addr 172.21.15.36:0/3479928037 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:25:20.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546bfff700 1 --2- 172.21.15.36:0/3479928037 >> v2:172.21.15.36:3300/0 conn(0x7f546c0a8ac0 0x7f546c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 -- 172.21.15.36:0/3479928037 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293834498 0 0) 0x7f546c0a70c0 con 0x7f546c0b2580 2022-01-10T01:25:20.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 -- 172.21.15.36:0/3479928037 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5450003260 con 0x7f546c0b2580 2022-01-10T01:25:20.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 -- 172.21.15.36:0/3479928037 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2436535475 0 0) 0x7f5450003260 con 0x7f546c0b2580 2022-01-10T01:25:20.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 -- 172.21.15.36:0/3479928037 >> v2:172.21.15.36:3300/0 conn(0x7f546c0a8ac0 msgr2=0x7f546c152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:20.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 --2- 172.21.15.36:0/3479928037 >> v2:172.21.15.36:3300/0 conn(0x7f546c0a8ac0 0x7f546c152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 -- 172.21.15.36:0/3479928037 >> v1:172.21.15.59:6789/0 conn(0x7f546c0b0010 legacy=0x7f546c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 -- 172.21.15.36:0/3479928037 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c0a7830 con 0x7f546c0b2580 2022-01-10T01:25:20.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 -- 172.21.15.36:0/3479928037 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f5454001660 con 0x7f546c0b2580 2022-01-10T01:25:20.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 -- 172.21.15.36:0/3479928037 >> v1:172.21.15.36:6789/0 conn(0x7f546c0b2580 legacy=0x7f546c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 --2- 172.21.15.36:0/3479928037 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5450003750 0x7f5450003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 --2- 172.21.15.36:0/3479928037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5450004500 0x7f5450004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 --2- 172.21.15.36:0/3479928037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5450004e70 0x7f545000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 -- 172.21.15.36:0/3479928037 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c0a7590 con 0x7f5450003750 2022-01-10T01:25:20.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 -- 172.21.15.36:0/3479928037 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545000bd20 con 0x7f5450004500 2022-01-10T01:25:20.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 -- 172.21.15.36:0/3479928037 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545000bee0 con 0x7f5450004e70 2022-01-10T01:25:20.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546b7fe700 1 --2- 172.21.15.36:0/3479928037 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5450003750 0x7f5450003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546affd700 1 --2- 172.21.15.36:0/3479928037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5450004500 0x7f5450004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546bfff700 1 --2- 172.21.15.36:0/3479928037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5450004e70 0x7f545000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546b7fe700 1 -- 172.21.15.36:0/3479928037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5450004e70 msgr2=0x7f545000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:20.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546b7fe700 1 --2- 172.21.15.36:0/3479928037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5450004e70 0x7f545000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546b7fe700 1 -- 172.21.15.36:0/3479928037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5450004500 msgr2=0x7f5450004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:20.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546b7fe700 1 --2- 172.21.15.36:0/3479928037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5450004500 0x7f5450004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546b7fe700 1 -- 172.21.15.36:0/3479928037 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5450003260 con 0x7f5450003750 2022-01-10T01:25:20.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546bfff700 1 --2- 172.21.15.36:0/3479928037 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5450004e70 0x7f545000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:25:20.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546bfff700 1 -- 172.21.15.36:0/3479928037 reap_dead start 2022-01-10T01:25:20.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546b7fe700 1 --2- 172.21.15.36:0/3479928037 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5450003750 0x7f5450003b70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f5454001370 tx=0x7f546c0a79c0).ready entity=mon.0 client_cookie=41f1f909e265726 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:20.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.101+0000 7f546a7fc700 1 -- 172.21.15.36:0/3479928037 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54540070d0 con 0x7f5450003750 2022-01-10T01:25:20.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.105+0000 7f546a7fc700 1 -- 172.21.15.36:0/3479928037 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5454007230 con 0x7f5450003750 2022-01-10T01:25:20.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.105+0000 7f546a7fc700 1 -- 172.21.15.36:0/3479928037 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f545400c8f0 con 0x7f5450003750 2022-01-10T01:25:20.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.105+0000 7f5470e5a700 1 -- 172.21.15.36:0/3479928037 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5450003750 msgr2=0x7f5450003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.105+0000 7f5470e5a700 1 --2- 172.21.15.36:0/3479928037 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5450003750 0x7f5450003b70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f5454001370 tx=0x7f546c0a79c0).stop 2022-01-10T01:25:20.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.105+0000 7f5470e5a700 1 -- 172.21.15.36:0/3479928037 shutdown_connections 2022-01-10T01:25:20.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.105+0000 7f5470e5a700 1 --2- 172.21.15.36:0/3479928037 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5450003750 0x7f5450003b70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.105+0000 7f5470e5a700 1 -- 172.21.15.36:0/3479928037 >> 172.21.15.36:0/3479928037 conn(0x7f546c060180 msgr2=0x7f546c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:20.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.105+0000 7f5470e5a700 1 -- 172.21.15.36:0/3479928037 shutdown_connections 2022-01-10T01:25:20.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.105+0000 7f5470e5a700 1 -- 172.21.15.36:0/3479928037 wait complete. 2022-01-10T01:25:20.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.105+0000 7f5470e5a700 1 Processor -- start 2022-01-10T01:25:20.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.105+0000 7f5470e5a700 1 -- start start 2022-01-10T01:25:20.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f5470e5a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5450003750 0x7f546c145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f5470e5a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f546c064020 0x7f546c065480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f5470e5a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f546c145bf0 0x7f546c065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f5470e5a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c065e60 con 0x7f546c145bf0 2022-01-10T01:25:20.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f5470e5a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c157050 con 0x7f5450003750 2022-01-10T01:25:20.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f5470e5a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546c1572f0 con 0x7f546c064020 2022-01-10T01:25:20.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f546bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f546c145bf0 0x7f546c065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f546bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f546c145bf0 0x7f546c065970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35276/0 (socket says 172.21.15.36:35276) 2022-01-10T01:25:20.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f546bfff700 1 -- 172.21.15.36:0/1268074542 learned_addr learned my addr 172.21.15.36:0/1268074542 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:20.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f546affd700 1 --2- 172.21.15.36:0/1268074542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f546c064020 0x7f546c065480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f546b7fe700 1 --2- 172.21.15.36:0/1268074542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5450003750 0x7f546c145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f546bfff700 1 -- 172.21.15.36:0/1268074542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f546c064020 msgr2=0x7f546c065480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f546bfff700 1 --2- 172.21.15.36:0/1268074542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f546c064020 0x7f546c065480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f546bfff700 1 -- 172.21.15.36:0/1268074542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5450003750 msgr2=0x7f546c145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f546bfff700 1 --2- 172.21.15.36:0/1268074542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5450003750 0x7f546c145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f546bfff700 1 -- 172.21.15.36:0/1268074542 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c0647e0 con 0x7f546c145bf0 2022-01-10T01:25:20.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f546bfff700 1 --2- 172.21.15.36:0/1268074542 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f546c145bf0 0x7f546c065970 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f545c00b000 tx=0x7f545c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:20.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f5468ff9700 1 -- 172.21.15.36:0/1268074542 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f545c012540 con 0x7f546c145bf0 2022-01-10T01:25:20.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f5468ff9700 1 -- 172.21.15.36:0/1268074542 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c0126a0 con 0x7f546c145bf0 2022-01-10T01:25:20.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f5470e5a700 1 -- 172.21.15.36:0/1268074542 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546c064c80 con 0x7f546c145bf0 2022-01-10T01:25:20.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f5468ff9700 1 -- 172.21.15.36:0/1268074542 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f545c012a00 con 0x7f546c145bf0 2022-01-10T01:25:20.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.109+0000 7f5470e5a700 1 -- 172.21.15.36:0/1268074542 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546c156c10 con 0x7f546c145bf0 2022-01-10T01:25:20.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.113+0000 7f5470e5a700 1 -- 172.21.15.36:0/1268074542 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546c057350 con 0x7f546c145bf0 2022-01-10T01:25:20.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.113+0000 7f5468ff9700 1 -- 172.21.15.36:0/1268074542 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f545c01c030 con 0x7f546c145bf0 2022-01-10T01:25:20.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.113+0000 7f5468ff9700 1 --2- 172.21.15.36:0/1268074542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f54440535f0 0x7f5444055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.113+0000 7f5468ff9700 1 -- 172.21.15.36:0/1268074542 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f545c06b5e0 con 0x7f546c145bf0 2022-01-10T01:25:20.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.113+0000 7f546b7fe700 1 --2- 172.21.15.36:0/1268074542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f54440535f0 0x7f5444055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.113+0000 7f546b7fe700 1 --2- 172.21.15.36:0/1268074542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f54440535f0 0x7f5444055ab0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f5454019000 tx=0x7f5454013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:20.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.121+0000 7f5468ff9700 1 -- 172.21.15.36:0/1268074542 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f545c0424e0 con 0x7f546c145bf0 2022-01-10T01:25:20.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.285+0000 7f5470e5a700 1 -- 172.21.15.36:0/1268074542 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f546c0698e0 con 0x7f546c145bf0 2022-01-10T01:25:20.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.285+0000 7f5468ff9700 1 -- 172.21.15.36:0/1268074542 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f545c045b00 con 0x7f546c145bf0 2022-01-10T01:25:20.291 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:25:20.292 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1410680575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1410680575},{"type":"v1","addr":"172.21.15.36:6837","nonce":1410680575}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/1811767033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1811767033},{"type":"v1","addr":"172.21.15.59:6833","nonce":1811767033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:25:02.143464+0000","modified":"2022-01-10T01:25:03.146833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/2488750467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2488750467},{"type":"v1","addr":"172.21.15.36:6835","nonce":2488750467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2022-01-10T01:25:20.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.289+0000 7f5470e5a700 1 -- 172.21.15.36:0/1268074542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f54440535f0 msgr2=0x7f5444055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.289+0000 7f5470e5a700 1 --2- 172.21.15.36:0/1268074542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f54440535f0 0x7f5444055ab0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f5454019000 tx=0x7f5454013000).stop 2022-01-10T01:25:20.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.289+0000 7f5470e5a700 1 -- 172.21.15.36:0/1268074542 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f546c145bf0 msgr2=0x7f546c065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.289+0000 7f5470e5a700 1 --2- 172.21.15.36:0/1268074542 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f546c145bf0 0x7f546c065970 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f545c00b000 tx=0x7f545c008040).stop 2022-01-10T01:25:20.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.289+0000 7f5470e5a700 1 -- 172.21.15.36:0/1268074542 shutdown_connections 2022-01-10T01:25:20.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.289+0000 7f5470e5a700 1 --2- 172.21.15.36:0/1268074542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f54440535f0 0x7f5444055ab0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.289+0000 7f5470e5a700 1 --2- 172.21.15.36:0/1268074542 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f546c145bf0 0x7f546c065970 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.289+0000 7f5470e5a700 1 --2- 172.21.15.36:0/1268074542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f546c064020 0x7f546c065480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.289+0000 7f5470e5a700 1 --2- 172.21.15.36:0/1268074542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5450003750 0x7f546c145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.289+0000 7f5470e5a700 1 -- 172.21.15.36:0/1268074542 >> 172.21.15.36:0/1268074542 conn(0x7f546c060180 msgr2=0x7f546c067710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:20.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.289+0000 7f5470e5a700 1 -- 172.21.15.36:0/1268074542 shutdown_connections 2022-01-10T01:25:20.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.289+0000 7f5470e5a700 1 -- 172.21.15.36:0/1268074542 wait complete. 2022-01-10T01:25:20.296 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 13 2022-01-10T01:25:20.304 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2022-01-10T01:25:20.408 INFO:teuthology.orchestra.run.smithi036.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2022-01-10T01:25:20.409 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2022-01-10T01:25:20.410 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:25:20.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c27fff700 1 Processor -- start 2022-01-10T01:25:20.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c27fff700 1 -- start start 2022-01-10T01:25:20.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c27fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7c28062f30 0x7f7c280b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c27fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c28144540 0x7f7c281449f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c27fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c280b2560 con 0x7f7c280b0020 2022-01-10T01:25:20.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c27fff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c28147270 con 0x7f7c28062f30 2022-01-10T01:25:20.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c27fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280a92f0 con 0x7f7c28144540 2022-01-10T01:25:20.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c26ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7c28062f30 0x7f7c280b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c26ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7c28062f30 0x7f7c280b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35280/0 (socket says 172.21.15.36:35280) 2022-01-10T01:25:20.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c26ffd700 1 -- 172.21.15.36:0/43110100 learned_addr learned my addr 172.21.15.36:0/43110100 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:20.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c277fe700 1 --2- 172.21.15.36:0/43110100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c28144540 0x7f7c281449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c26ffd700 1 -- 172.21.15.36:0/43110100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c28144540 msgr2=0x7f7c281449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:20.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c26ffd700 1 --2- 172.21.15.36:0/43110100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c28144540 0x7f7c281449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c26ffd700 1 -- 172.21.15.36:0/43110100 >> v1:172.21.15.59:6789/0 conn(0x7f7c280b0020 legacy=0x7f7c28147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c26ffd700 1 -- 172.21.15.36:0/43110100 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280a7240 con 0x7f7c28062f30 2022-01-10T01:25:20.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c26ffd700 1 --2- 172.21.15.36:0/43110100 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c28062f30 0x7f7c280b2070 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f7c20002f70 tx=0x7f7c20006eb0).ready entity=mon.0 client_cookie=5a7fdab515e13abf server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:20.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c25ffb700 1 -- 172.21.15.36:0/43110100 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c2000d570 con 0x7f7c28062f30 2022-01-10T01:25:20.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c25ffb700 1 -- 172.21.15.36:0/43110100 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c20000e90 con 0x7f7c28062f30 2022-01-10T01:25:20.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.501+0000 7f7c25ffb700 1 -- 172.21.15.36:0/43110100 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c2000d900 con 0x7f7c28062f30 2022-01-10T01:25:20.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 -- 172.21.15.36:0/43110100 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c28062f30 msgr2=0x7f7c280b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 --2- 172.21.15.36:0/43110100 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c28062f30 0x7f7c280b2070 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f7c20002f70 tx=0x7f7c20006eb0).stop 2022-01-10T01:25:20.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 -- 172.21.15.36:0/43110100 shutdown_connections 2022-01-10T01:25:20.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 --2- 172.21.15.36:0/43110100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c28144540 0x7f7c281449f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 --2- 172.21.15.36:0/43110100 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c28062f30 0x7f7c280b2070 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 -- 172.21.15.36:0/43110100 >> 172.21.15.36:0/43110100 conn(0x7f7c2805c490 msgr2=0x7f7c2805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:20.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 -- 172.21.15.36:0/43110100 shutdown_connections 2022-01-10T01:25:20.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 -- 172.21.15.36:0/43110100 wait complete. 2022-01-10T01:25:20.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 Processor -- start 2022-01-10T01:25:20.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 -- start start 2022-01-10T01:25:20.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c28062f30 0x7f7c280b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c280b0020 0x7f7c28141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c28144540 0x7f7c281420d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c28063890 con 0x7f7c28062f30 2022-01-10T01:25:20.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280ac420 con 0x7f7c280b0020 2022-01-10T01:25:20.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c27fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c280ac6c0 con 0x7f7c28144540 2022-01-10T01:25:20.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c26ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c28062f30 0x7f7c280b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c26ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c28062f30 0x7f7c280b4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35286/0 (socket says 172.21.15.36:35286) 2022-01-10T01:25:20.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c26ffd700 1 -- 172.21.15.36:0/3197924115 learned_addr learned my addr 172.21.15.36:0/3197924115 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:20.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c267fc700 1 --2- 172.21.15.36:0/3197924115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c280b0020 0x7f7c28141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c26ffd700 1 -- 172.21.15.36:0/3197924115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c28144540 msgr2=0x7f7c281420d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c26ffd700 1 --2- 172.21.15.36:0/3197924115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c28144540 0x7f7c281420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-01-10T01:25:20.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c26ffd700 1 -- 172.21.15.36:0/3197924115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c280b0020 msgr2=0x7f7c28141be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c26ffd700 1 --2- 172.21.15.36:0/3197924115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c280b0020 0x7f7c28141be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c26ffd700 1 -- 172.21.15.36:0/3197924115 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2000b1e0 con 0x7f7c28062f30 2022-01-10T01:25:20.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.505+0000 7f7c26ffd700 1 --2- 172.21.15.36:0/3197924115 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c28062f30 0x7f7c280b4ea0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f7c20002f70 tx=0x7f7c20015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:20.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.509+0000 7f7c1ffff700 1 -- 172.21.15.36:0/3197924115 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c200068b0 con 0x7f7c28062f30 2022-01-10T01:25:20.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.509+0000 7f7c27fff700 1 -- 172.21.15.36:0/3197924115 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c280ab620 con 0x7f7c28062f30 2022-01-10T01:25:20.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.509+0000 7f7c1ffff700 1 -- 172.21.15.36:0/3197924115 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2000d8f0 con 0x7f7c28062f30 2022-01-10T01:25:20.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.509+0000 7f7c27fff700 1 -- 172.21.15.36:0/3197924115 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c281425c0 con 0x7f7c28062f30 2022-01-10T01:25:20.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.509+0000 7f7c1ffff700 1 -- 172.21.15.36:0/3197924115 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c2001e460 con 0x7f7c28062f30 2022-01-10T01:25:20.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.509+0000 7f7c1ffff700 1 -- 172.21.15.36:0/3197924115 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7c2001a040 con 0x7f7c28062f30 2022-01-10T01:25:20.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.509+0000 7f7c27fff700 1 -- 172.21.15.36:0/3197924115 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c280aba60 con 0x7f7c28062f30 2022-01-10T01:25:20.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.509+0000 7f7c1ffff700 1 --2- 172.21.15.36:0/3197924115 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7c0c0535f0 0x7f7c0c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.509+0000 7f7c267fc700 1 --2- 172.21.15.36:0/3197924115 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7c0c0535f0 0x7f7c0c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.509+0000 7f7c1ffff700 1 -- 172.21.15.36:0/3197924115 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7c2006c9d0 con 0x7f7c28062f30 2022-01-10T01:25:20.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.513+0000 7f7c267fc700 1 --2- 172.21.15.36:0/3197924115 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7c0c0535f0 0x7f7c0c055ab0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f7c1000b000 tx=0x7f7c10009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:20.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.517+0000 7f7c1ffff700 1 -- 172.21.15.36:0/3197924115 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7c20043900 con 0x7f7c28062f30 2022-01-10T01:25:20.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.681+0000 7f7c27fff700 1 -- 172.21.15.36:0/3197924115 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c28147460 con 0x7f7c28062f30 2022-01-10T01:25:20.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.681+0000 7f7c1ffff700 1 -- 172.21.15.36:0/3197924115 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f7c20023020 con 0x7f7c28062f30 2022-01-10T01:25:20.686 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:25:20.686 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1410680575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1410680575},{"type":"v1","addr":"172.21.15.36:6837","nonce":1410680575}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/1811767033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1811767033},{"type":"v1","addr":"172.21.15.59:6833","nonce":1811767033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:25:02.143464+0000","modified":"2022-01-10T01:25:03.146833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/2488750467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2488750467},{"type":"v1","addr":"172.21.15.36:6835","nonce":2488750467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2022-01-10T01:25:20.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.681+0000 7f7c27fff700 1 -- 172.21.15.36:0/3197924115 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7c0c0535f0 msgr2=0x7f7c0c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.681+0000 7f7c27fff700 1 --2- 172.21.15.36:0/3197924115 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7c0c0535f0 0x7f7c0c055ab0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f7c1000b000 tx=0x7f7c10009040).stop 2022-01-10T01:25:20.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.681+0000 7f7c27fff700 1 -- 172.21.15.36:0/3197924115 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c28062f30 msgr2=0x7f7c280b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.681+0000 7f7c27fff700 1 --2- 172.21.15.36:0/3197924115 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c28062f30 0x7f7c280b4ea0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f7c20002f70 tx=0x7f7c20015000).stop 2022-01-10T01:25:20.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.685+0000 7f7c27fff700 1 -- 172.21.15.36:0/3197924115 shutdown_connections 2022-01-10T01:25:20.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.685+0000 7f7c27fff700 1 --2- 172.21.15.36:0/3197924115 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7c0c0535f0 0x7f7c0c055ab0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.685+0000 7f7c27fff700 1 --2- 172.21.15.36:0/3197924115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c28144540 0x7f7c281420d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-01-10T01:25:20.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.685+0000 7f7c27fff700 1 --2- 172.21.15.36:0/3197924115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c280b0020 0x7f7c28141be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.685+0000 7f7c27fff700 1 --2- 172.21.15.36:0/3197924115 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c28062f30 0x7f7c280b4ea0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.685+0000 7f7c27fff700 1 -- 172.21.15.36:0/3197924115 >> 172.21.15.36:0/3197924115 conn(0x7f7c2805c490 msgr2=0x7f7c2805f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:20.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.685+0000 7f7c27fff700 1 -- 172.21.15.36:0/3197924115 shutdown_connections 2022-01-10T01:25:20.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.685+0000 7f7c27fff700 1 -- 172.21.15.36:0/3197924115 wait complete. 2022-01-10T01:25:20.691 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 13 2022-01-10T01:25:20.699 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2022-01-10T01:25:20.804 INFO:teuthology.orchestra.run.smithi036.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2022-01-10T01:25:20.804 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2022-01-10T01:25:20.805 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:25:20.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff67ab2b700 1 Processor -- start 2022-01-10T01:25:20.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff67ab2b700 1 -- start start 2022-01-10T01:25:20.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff67ab2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6740a8ac0 0x7ff674152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff67ab2b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6740a70c0 con 0x7ff6740b2580 2022-01-10T01:25:20.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff67ab2b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6740a72f0 con 0x7ff6740b0010 2022-01-10T01:25:20.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff67ab2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740a7590 con 0x7ff6740a8ac0 2022-01-10T01:25:20.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff679b29700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff6740b2580 0x7ff67414ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33088/0 (socket says 172.21.15.36:33088) 2022-01-10T01:25:20.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff679b29700 1 -- 172.21.15.36:0/2646599369 learned_addr learned my addr 172.21.15.36:0/2646599369 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:25:20.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff67a32a700 1 --2- 172.21.15.36:0/2646599369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6740a8ac0 0x7ff674152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff678b27700 1 -- 172.21.15.36:0/2646599369 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3894151538 0 0) 0x7ff6740a70c0 con 0x7ff6740b2580 2022-01-10T01:25:20.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff678b27700 1 -- 172.21.15.36:0/2646599369 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff65c003260 con 0x7ff6740b2580 2022-01-10T01:25:20.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff678b27700 1 -- 172.21.15.36:0/2646599369 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416813600 0 0) 0x7ff6740a72f0 con 0x7ff6740b0010 2022-01-10T01:25:20.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff678b27700 1 -- 172.21.15.36:0/2646599369 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6740a70c0 con 0x7ff6740b0010 2022-01-10T01:25:20.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff67a32a700 1 -- 172.21.15.36:0/2646599369 >> v1:172.21.15.59:6789/0 conn(0x7ff6740b0010 legacy=0x7ff6740a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff67a32a700 1 -- 172.21.15.36:0/2646599369 >> v1:172.21.15.36:6789/0 conn(0x7ff6740b2580 legacy=0x7ff67414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff678b27700 1 -- 172.21.15.36:0/2646599369 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 895606653 0 0) 0x7ff65c003260 con 0x7ff6740b2580 2022-01-10T01:25:20.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.897+0000 7ff67a32a700 1 -- 172.21.15.36:0/2646599369 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6740a7830 con 0x7ff6740a8ac0 2022-01-10T01:25:20.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67a32a700 1 --2- 172.21.15.36:0/2646599369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6740a8ac0 0x7ff674152be0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff66c002f70 tx=0x7ff66c006df0).ready entity=mon.2 client_cookie=3b797cdedc04f5c4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:20.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff678b27700 1 -- 172.21.15.36:0/2646599369 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff66c00d5c0 con 0x7ff6740a8ac0 2022-01-10T01:25:20.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff678b27700 1 -- 172.21.15.36:0/2646599369 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c000e90 con 0x7ff6740a8ac0 2022-01-10T01:25:20.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff678b27700 1 -- 172.21.15.36:0/2646599369 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff66c00d910 con 0x7ff6740a8ac0 2022-01-10T01:25:20.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 -- 172.21.15.36:0/2646599369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6740a8ac0 msgr2=0x7ff674152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 --2- 172.21.15.36:0/2646599369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6740a8ac0 0x7ff674152be0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff66c002f70 tx=0x7ff66c006df0).stop 2022-01-10T01:25:20.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 -- 172.21.15.36:0/2646599369 shutdown_connections 2022-01-10T01:25:20.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 --2- 172.21.15.36:0/2646599369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6740a8ac0 0x7ff674152be0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 -- 172.21.15.36:0/2646599369 >> 172.21.15.36:0/2646599369 conn(0x7ff674060180 msgr2=0x7ff6740b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:20.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 -- 172.21.15.36:0/2646599369 shutdown_connections 2022-01-10T01:25:20.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 -- 172.21.15.36:0/2646599369 wait complete. 2022-01-10T01:25:20.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 Processor -- start 2022-01-10T01:25:20.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 -- start start 2022-01-10T01:25:20.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6740a8ac0 0x7ff674149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff6740b0010 0x7ff6740b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6740b2580 0x7ff6740ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740aae90 con 0x7ff6740b0010 2022-01-10T01:25:20.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740aa6b0 con 0x7ff6740b2580 2022-01-10T01:25:20.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.901+0000 7ff67ab2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6740aa950 con 0x7ff6740a8ac0 2022-01-10T01:25:20.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff679328700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff6740b0010 0x7ff6740b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff679328700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff6740b0010 0x7ff6740b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35302/0 (socket says 172.21.15.36:35302) 2022-01-10T01:25:20.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff679328700 1 -- 172.21.15.36:0/908827948 learned_addr learned my addr 172.21.15.36:0/908827948 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:20.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff679b29700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6740a8ac0 0x7ff674149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff67a32a700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6740b2580 0x7ff6740ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff67a32a700 1 -- 172.21.15.36:0/908827948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6740a8ac0 msgr2=0x7ff674149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff67a32a700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6740a8ac0 0x7ff674149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff67a32a700 1 -- 172.21.15.36:0/908827948 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff6740b0010 msgr2=0x7ff6740b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:20.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff67a32a700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff6740b0010 0x7ff6740b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:20.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff67a32a700 1 -- 172.21.15.36:0/908827948 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c00b180 con 0x7ff6740b2580 2022-01-10T01:25:20.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff679b29700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6740a8ac0 0x7ff674149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:25:20.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff67a32a700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6740b2580 0x7ff6740ab3b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7ff66c002f70 tx=0x7ff66c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:20.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff662ffd700 1 -- 172.21.15.36:0/908827948 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff66c016070 con 0x7ff6740b2580 2022-01-10T01:25:20.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff662ffd700 1 -- 172.21.15.36:0/908827948 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c00de60 con 0x7ff6740b2580 2022-01-10T01:25:20.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff67ab2b700 1 -- 172.21.15.36:0/908827948 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6740aabf0 con 0x7ff6740b2580 2022-01-10T01:25:20.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff662ffd700 1 -- 172.21.15.36:0/908827948 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff66c013d60 con 0x7ff6740b2580 2022-01-10T01:25:20.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff67ab2b700 1 -- 172.21.15.36:0/908827948 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6740aa3a0 con 0x7ff6740b2580 2022-01-10T01:25:20.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff67ab2b700 1 -- 172.21.15.36:0/908827948 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff674057350 con 0x7ff6740b2580 2022-01-10T01:25:20.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff662ffd700 1 -- 172.21.15.36:0/908827948 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff66c00f030 con 0x7ff6740b2580 2022-01-10T01:25:20.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff662ffd700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff6540535f0 0x7ff654055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:20.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff662ffd700 1 -- 172.21.15.36:0/908827948 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff66c06c590 con 0x7ff6740b2580 2022-01-10T01:25:20.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.905+0000 7ff679b29700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff6540535f0 0x7ff654055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:20.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.909+0000 7ff679b29700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff6540535f0 0x7ff654055ab0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7ff66400d000 tx=0x7ff6640079c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:20.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:20.917+0000 7ff662ffd700 1 -- 172.21.15.36:0/908827948 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff66c0434c0 con 0x7ff6740b2580 2022-01-10T01:25:21.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.081+0000 7ff67ab2b700 1 -- 172.21.15.36:0/908827948 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6740698e0 con 0x7ff6740b2580 2022-01-10T01:25:21.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.081+0000 7ff662ffd700 1 -- 172.21.15.36:0/908827948 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2491 (secure 0 0 0) 0x7ff66c023070 con 0x7ff6740b2580 2022-01-10T01:25:21.086 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:25:21.086 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1410680575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1410680575},{"type":"v1","addr":"172.21.15.36:6837","nonce":1410680575}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/1811767033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1811767033},{"type":"v1","addr":"172.21.15.59:6833","nonce":1811767033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:25:02.143464+0000","modified":"2022-01-10T01:25:03.146833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/2488750467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2488750467},{"type":"v1","addr":"172.21.15.36:6835","nonce":2488750467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2022-01-10T01:25:21.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.085+0000 7ff67ab2b700 1 -- 172.21.15.36:0/908827948 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff6540535f0 msgr2=0x7ff654055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:21.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.085+0000 7ff67ab2b700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff6540535f0 0x7ff654055ab0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7ff66400d000 tx=0x7ff6640079c0).stop 2022-01-10T01:25:21.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.085+0000 7ff67ab2b700 1 -- 172.21.15.36:0/908827948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6740b2580 msgr2=0x7ff6740ab3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:21.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.085+0000 7ff67ab2b700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6740b2580 0x7ff6740ab3b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7ff66c002f70 tx=0x7ff66c014000).stop 2022-01-10T01:25:21.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.085+0000 7ff67ab2b700 1 -- 172.21.15.36:0/908827948 shutdown_connections 2022-01-10T01:25:21.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.085+0000 7ff67ab2b700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff6540535f0 0x7ff654055ab0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.085+0000 7ff67ab2b700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6740b2580 0x7ff6740ab3b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.085+0000 7ff67ab2b700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff6740b0010 0x7ff6740b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.085+0000 7ff67ab2b700 1 --2- 172.21.15.36:0/908827948 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff6740a8ac0 0x7ff674149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.085+0000 7ff67ab2b700 1 -- 172.21.15.36:0/908827948 >> 172.21.15.36:0/908827948 conn(0x7ff674060180 msgr2=0x7ff67405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:21.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.085+0000 7ff67ab2b700 1 -- 172.21.15.36:0/908827948 shutdown_connections 2022-01-10T01:25:21.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.085+0000 7ff67ab2b700 1 -- 172.21.15.36:0/908827948 wait complete. 2022-01-10T01:25:21.092 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 13 2022-01-10T01:25:21.105 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a cache drop 2022-01-10T01:25:21.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.201+0000 7f9069cbf700 1 Processor -- start 2022-01-10T01:25:21.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.201+0000 7f9069cbf700 1 -- start start 2022-01-10T01:25:21.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.201+0000 7f9069cbf700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f906405faa0 0x7f90641438d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.201+0000 7f9069cbf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90640ac500 0x7f9064143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9069cbf700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906405fe80 con 0x7f90640607d0 2022-01-10T01:25:21.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9069cbf700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9064143240 con 0x7f906405faa0 2022-01-10T01:25:21.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9069cbf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90640acc60 con 0x7f90640ac500 2022-01-10T01:25:21.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f90637fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f906405faa0 0x7f90641438d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f905bfff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f90640607d0 0x7f9064146810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33102/0 (socket says 172.21.15.36:33102) 2022-01-10T01:25:21.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f905bfff700 1 -- 172.21.15.36:0/4218249226 learned_addr learned my addr 172.21.15.36:0/4218249226 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:25:21.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9063fff700 1 --2- 172.21.15.36:0/4218249226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90640ac500 0x7f9064143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9062ffd700 1 -- 172.21.15.36:0/4218249226 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478279259 0 0) 0x7f906405fe80 con 0x7f90640607d0 2022-01-10T01:25:21.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9062ffd700 1 -- 172.21.15.36:0/4218249226 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9044003260 con 0x7f90640607d0 2022-01-10T01:25:21.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f90637fe700 1 -- 172.21.15.36:0/4218249226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90640ac500 msgr2=0x7f9064143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:21.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f90637fe700 1 --2- 172.21.15.36:0/4218249226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90640ac500 0x7f9064143dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f90637fe700 1 -- 172.21.15.36:0/4218249226 >> v1:172.21.15.36:6789/0 conn(0x7f90640607d0 legacy=0x7f9064146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:21.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f90637fe700 1 -- 172.21.15.36:0/4218249226 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90640acf00 con 0x7f906405faa0 2022-01-10T01:25:21.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f90637fe700 1 --2- 172.21.15.36:0/4218249226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f906405faa0 0x7f90641438d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f9054002f70 tx=0x7f9054006df0).ready entity=mon.0 client_cookie=412ae92e4bbb3abd server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:21.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9062ffd700 1 -- 172.21.15.36:0/4218249226 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f905400d4a0 con 0x7f906405faa0 2022-01-10T01:25:21.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9062ffd700 1 -- 172.21.15.36:0/4218249226 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9054000e90 con 0x7f906405faa0 2022-01-10T01:25:21.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9062ffd700 1 -- 172.21.15.36:0/4218249226 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f905400d7f0 con 0x7f906405faa0 2022-01-10T01:25:21.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9069cbf700 1 -- 172.21.15.36:0/4218249226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f906405faa0 msgr2=0x7f90641438d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:21.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9069cbf700 1 --2- 172.21.15.36:0/4218249226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f906405faa0 0x7f90641438d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f9054002f70 tx=0x7f9054006df0).stop 2022-01-10T01:25:21.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9069cbf700 1 -- 172.21.15.36:0/4218249226 shutdown_connections 2022-01-10T01:25:21.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9069cbf700 1 --2- 172.21.15.36:0/4218249226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90640ac500 0x7f9064143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9069cbf700 1 --2- 172.21.15.36:0/4218249226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f906405faa0 0x7f90641438d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9069cbf700 1 -- 172.21.15.36:0/4218249226 >> 172.21.15.36:0/4218249226 conn(0x7f90640b2970 msgr2=0x7f90640b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:21.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9069cbf700 1 -- 172.21.15.36:0/4218249226 shutdown_connections 2022-01-10T01:25:21.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.205+0000 7f9069cbf700 1 -- 172.21.15.36:0/4218249226 wait complete. 2022-01-10T01:25:21.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f9069cbf700 1 Processor -- start 2022-01-10T01:25:21.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f9069cbf700 1 -- start start 2022-01-10T01:25:21.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f9069cbf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906405faa0 0x7f9064149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f9069cbf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90640607d0 0x7f9064146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f9069cbf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90640ac500 0x7f90641467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f9069cbf700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9064147250 con 0x7f90640607d0 2022-01-10T01:25:21.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f9069cbf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9064156d50 con 0x7f906405faa0 2022-01-10T01:25:21.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f9069cbf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9064147480 con 0x7f90640ac500 2022-01-10T01:25:21.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f905bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90640607d0 0x7f9064146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f905bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90640607d0 0x7f9064146300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35316/0 (socket says 172.21.15.36:35316) 2022-01-10T01:25:21.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f905bfff700 1 -- 172.21.15.36:0/2526728614 learned_addr learned my addr 172.21.15.36:0/2526728614 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:21.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f9063fff700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90640ac500 0x7f90641467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f90637fe700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906405faa0 0x7f9064149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f905bfff700 1 -- 172.21.15.36:0/2526728614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90640ac500 msgr2=0x7f90641467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:21.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f905bfff700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90640ac500 0x7f90641467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f905bfff700 1 -- 172.21.15.36:0/2526728614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906405faa0 msgr2=0x7f9064149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:21.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f905bfff700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906405faa0 0x7f9064149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f905bfff700 1 -- 172.21.15.36:0/2526728614 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905400b180 con 0x7f90640607d0 2022-01-10T01:25:21.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f90637fe700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906405faa0 0x7f9064149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:25:21.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f905bfff700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90640607d0 0x7f9064146300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f904c001110 tx=0x7f904c007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:21.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f90617fa700 1 -- 172.21.15.36:0/2526728614 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f904c0070d0 con 0x7f90640607d0 2022-01-10T01:25:21.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f90617fa700 1 -- 172.21.15.36:0/2526728614 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c007230 con 0x7f90640607d0 2022-01-10T01:25:21.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f9069cbf700 1 -- 172.21.15.36:0/2526728614 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9064156ab0 con 0x7f90640607d0 2022-01-10T01:25:21.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f90617fa700 1 -- 172.21.15.36:0/2526728614 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f904c005610 con 0x7f90640607d0 2022-01-10T01:25:21.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.209+0000 7f9069cbf700 1 -- 172.21.15.36:0/2526728614 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90640b5010 con 0x7f90640607d0 2022-01-10T01:25:21.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.213+0000 7f90617fa700 1 -- 172.21.15.36:0/2526728614 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f904c01a060 con 0x7f90640607d0 2022-01-10T01:25:21.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.213+0000 7f90617fa700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9048053680 0x7f9048055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.213+0000 7f90617fa700 1 -- 172.21.15.36:0/2526728614 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f904c06af30 con 0x7f90640607d0 2022-01-10T01:25:21.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.213+0000 7f90637fe700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9048053680 0x7f9048055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.213+0000 7f90637fe700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9048053680 0x7f9048055b40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f9054018000 tx=0x7f9054014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:21.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.213+0000 7f9073f02740 1 Processor -- start 2022-01-10T01:25:21.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.213+0000 7f9073f02740 1 -- start start 2022-01-10T01:25:21.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 0xd5ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd5d620 0xd5bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5c3e0 0xd21e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0xc95db0 con 0xd5d620 2022-01-10T01:25:21.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0xc95ef0 con 0xd5c3e0 2022-01-10T01:25:21.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0xc97410 con 0xd5d240 2022-01-10T01:25:21.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f905bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd5d620 0xd5bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f905bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd5d620 0xd5bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35324/0 (socket says 172.21.15.36:35324) 2022-01-10T01:25:21.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f90637fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 0xd5ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f905bfff700 1 -- 172.21.15.36:0/1501598363 learned_addr learned my addr 172.21.15.36:0/1501598363 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:21.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9063fff700 1 --2- 172.21.15.36:0/1501598363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5c3e0 0xd21e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f905bfff700 1 -- 172.21.15.36:0/1501598363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 msgr2=0xd5ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:21.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f905bfff700 1 --2- 172.21.15.36:0/1501598363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 0xd5ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f905bfff700 1 -- 172.21.15.36:0/1501598363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5c3e0 msgr2=0xd21e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:21.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f905bfff700 1 --2- 172.21.15.36:0/1501598363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5c3e0 0xd21e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f905bfff700 1 -- 172.21.15.36:0/1501598363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xccefc0 con 0xd5d620 2022-01-10T01:25:21.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f905bfff700 1 --2- 172.21.15.36:0/1501598363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd5d620 0xd5bef0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0xc98e60 tx=0x7f904c010000).ready entity=mon.0 client_cookie=ce2a67dccb6b80d9 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:21.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9069cbf700 1 -- 172.21.15.36:0/1501598363 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f904c04b070 con 0xd5d620 2022-01-10T01:25:21.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9069cbf700 1 -- 172.21.15.36:0/1501598363 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c045a90 con 0xd5d620 2022-01-10T01:25:21.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9069cbf700 1 -- 172.21.15.36:0/1501598363 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f904c0418e0 con 0xd5d620 2022-01-10T01:25:21.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 -- 172.21.15.36:0/1501598363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd5d620 msgr2=0xd5bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:21.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 --2- 172.21.15.36:0/1501598363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd5d620 0xd5bef0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0xc98e60 tx=0x7f904c010000).stop 2022-01-10T01:25:21.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 -- 172.21.15.36:0/1501598363 shutdown_connections 2022-01-10T01:25:21.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 --2- 172.21.15.36:0/1501598363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5c3e0 0xd21e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 --2- 172.21.15.36:0/1501598363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd5d620 0xd5bef0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 --2- 172.21.15.36:0/1501598363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 0xd5ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 -- 172.21.15.36:0/1501598363 >> 172.21.15.36:0/1501598363 conn(0xd23bc0 msgr2=0xd24bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:21.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 -- 172.21.15.36:0/1501598363 shutdown_connections 2022-01-10T01:25:21.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 -- 172.21.15.36:0/1501598363 wait complete. 2022-01-10T01:25:21.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 -- start start 2022-01-10T01:25:21.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.217+0000 7f9073f02740 1 Processor -- start 2022-01-10T01:25:21.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 0xd55900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 0xd55df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd60810 0xd5f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0xd5ef10 con 0xd60810 2022-01-10T01:25:21.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0xd562e0 con 0xd5d620 2022-01-10T01:25:21.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0xd29da0 con 0xd5d240 2022-01-10T01:25:21.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 10 client.0 ll_register_callbacks cb 0xcde5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-01-10T01:25:21.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9063fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd60810 0xd5f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f90637fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 0xd55900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9063fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd60810 0xd5f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35332/0 (socket says 172.21.15.36:35332) 2022-01-10T01:25:21.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9063fff700 1 -- 172.21.15.36:0/3324454213 learned_addr learned my addr 172.21.15.36:0/3324454213 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:21.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f905bfff700 1 --2- 172.21.15.36:0/3324454213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 0xd55df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f90637fe700 1 -- 172.21.15.36:0/3324454213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 msgr2=0xd55df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:21.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f90637fe700 1 --2- 172.21.15.36:0/3324454213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 0xd55df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f90637fe700 1 -- 172.21.15.36:0/3324454213 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd60810 msgr2=0xd5f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:21.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f90637fe700 1 --2- 172.21.15.36:0/3324454213 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd60810 0xd5f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f90637fe700 1 -- 172.21.15.36:0/3324454213 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90640b5010 con 0xd5d240 2022-01-10T01:25:21.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9063fff700 1 --2- 172.21.15.36:0/3324454213 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd60810 0xd5f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:25:21.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f90637fe700 1 --2- 172.21.15.36:0/3324454213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 0xd55900 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9054023000 tx=0x7f905401e000).ready entity=mon.2 client_cookie=53df7bc09aeea3c6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:21.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f90427fc700 10 client.0 ms_handle_connect on v2:172.21.15.59:3301/0 2022-01-10T01:25:21.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f90427fc700 1 -- 172.21.15.36:0/3324454213 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9054013ae0 con 0xd5d240 2022-01-10T01:25:21.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 1 -- 172.21.15.36:0/3324454213 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xc8d030 con 0xd5d240 2022-01-10T01:25:21.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f90427fc700 1 -- 172.21.15.36:0/3324454213 <== mon.2 v2:172.21.15.59:3301/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f905402cd80 con 0xd5d240 2022-01-10T01:25:21.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f90427fc700 1 -- 172.21.15.36:0/3324454213 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9054013c40 con 0xd5d240 2022-01-10T01:25:21.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 10 client.34793 fetch_fsmap learned FSMap version 13 2022-01-10T01:25:21.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 1 -- 172.21.15.36:0/3324454213 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0xc86910 con 0xd5d240 2022-01-10T01:25:21.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f90427fc700 1 -- 172.21.15.36:0/3324454213 <== mon.2 v2:172.21.15.59:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xc8d030 con 0xd5d240 2022-01-10T01:25:21.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f90427fc700 1 -- 172.21.15.36:0/3324454213 <== mon.2 v2:172.21.15.59:3301/0 5 ==== fsmap(e 13) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f9054034a30 con 0xd5d240 2022-01-10T01:25:21.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 10 client.34793 fetch_fsmap finished waiting for FSMap version 13 2022-01-10T01:25:21.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 10 client.34793 resolve_mds: resolved ID 'a' to GID 4882 2022-01-10T01:25:21.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 20 client.34793 populate_metadata read hostname 'smithi036' 2022-01-10T01:25:21.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 1 --2- 172.21.15.36:0/3324454213 >> [v2:172.21.15.36:6834/2488750467,v1:172.21.15.36:6835/2488750467] conn(0xd6ebb0 0xd6ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 4 client.34793 mds_command: new command op to 4882 tid=0[{"prefix": "get_command_descriptions"}] 2022-01-10T01:25:21.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f9073f02740 1 -- 172.21.15.36:0/3324454213 --> [v2:172.21.15.36:6834/2488750467,v1:172.21.15.36:6835/2488750467] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xc853a0 con 0xd6ebb0 2022-01-10T01:25:21.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f905bfff700 1 --2- 172.21.15.36:0/3324454213 >> [v2:172.21.15.36:6834/2488750467,v1:172.21.15.36:6835/2488750467] conn(0xd6ebb0 0xd6ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f90427fc700 10 client.34793 ms_handle_connect on v2:172.21.15.36:6834/2488750467 2022-01-10T01:25:21.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.221+0000 7f905bfff700 1 --2- 172.21.15.36:0/3324454213 >> [v2:172.21.15.36:6834/2488750467,v1:172.21.15.36:6835/2488750467] conn(0xd6ebb0 0xd6ef90 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8207eda4a4e82ff9 server_cookie=767269ecc948a740 in_seq=0 out_seq=0 2022-01-10T01:25:21.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f90427fc700 1 -- 172.21.15.36:0/3324454213 <== mds.0 v2:172.21.15.36:6834/2488750467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0xc853a0 con 0xd6ebb0 2022-01-10T01:25:21.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f90427fc700 10 client.34793 handle_command_reply: tid=0 2022-01-10T01:25:21.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f9073f02740 1 client.34793 shutdown 2022-01-10T01:25:21.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f9073f02740 1 -- 172.21.15.36:0/3324454213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 msgr2=0xd55900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:21.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f9073f02740 1 --2- 172.21.15.36:0/3324454213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 0xd55900 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9054023000 tx=0x7f905401e000).stop 2022-01-10T01:25:21.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f9073f02740 1 -- 172.21.15.36:0/3324454213 shutdown_connections 2022-01-10T01:25:21.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f9073f02740 1 --2- 172.21.15.36:0/3324454213 >> [v2:172.21.15.36:6834/2488750467,v1:172.21.15.36:6835/2488750467] conn(0xd6ebb0 0xd6ef90 crc :-1 s=READY pgs=10 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f9073f02740 1 --2- 172.21.15.36:0/3324454213 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd60810 0xd5f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f9073f02740 1 --2- 172.21.15.36:0/3324454213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 0xd55df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f9073f02740 1 --2- 172.21.15.36:0/3324454213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 0xd55900 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f9073f02740 1 -- 172.21.15.36:0/3324454213 >> 172.21.15.36:0/3324454213 conn(0xd5c3e0 msgr2=0xd5bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:21.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f90427fc700 0 client.34793 ms_handle_reset on v2:172.21.15.36:6834/2488750467 2022-01-10T01:25:21.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f9073f02740 1 -- 172.21.15.36:0/3324454213 shutdown_connections 2022-01-10T01:25:21.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f9073f02740 1 -- 172.21.15.36:0/3324454213 wait complete. 2022-01-10T01:25:21.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.225+0000 7f9073f02740 20 client.34793 trim_cache size 0 max 16384 2022-01-10T01:25:21.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.233+0000 7f9073f02740 1 Processor -- start 2022-01-10T01:25:21.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.233+0000 7f9073f02740 1 -- start start 2022-01-10T01:25:21.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd5d240 0xd23fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 0xd6f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd60810 0xd554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0xd26460 con 0xd5d240 2022-01-10T01:25:21.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0xcef080 con 0xd5d620 2022-01-10T01:25:21.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0xd25c00 con 0xd60810 2022-01-10T01:25:21.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f90637fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd5d240 0xd23fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f90637fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd5d240 0xd23fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35336/0 (socket says 172.21.15.36:35336) 2022-01-10T01:25:21.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f90637fe700 1 -- 172.21.15.36:0/1008640122 learned_addr learned my addr 172.21.15.36:0/1008640122 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:21.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f905bfff700 1 --2- 172.21.15.36:0/1008640122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 0xd6f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9063fff700 1 --2- 172.21.15.36:0/1008640122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd60810 0xd554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f90637fe700 1 -- 172.21.15.36:0/1008640122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd60810 msgr2=0xd554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:21.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f90637fe700 1 --2- 172.21.15.36:0/1008640122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd60810 0xd554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f90637fe700 1 -- 172.21.15.36:0/1008640122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 msgr2=0xd6f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:21.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f90637fe700 1 --2- 172.21.15.36:0/1008640122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 0xd6f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f90637fe700 1 -- 172.21.15.36:0/1008640122 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc8bc00 con 0xd5d240 2022-01-10T01:25:21.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f90637fe700 1 --2- 172.21.15.36:0/1008640122 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd5d240 0xd23fb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0xd6c260 tx=0x7f905402a000).ready entity=mon.0 client_cookie=38a681b694829fa9 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:21.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9058ff9700 1 -- 172.21.15.36:0/1008640122 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f905400de50 con 0xd5d240 2022-01-10T01:25:21.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9058ff9700 1 -- 172.21.15.36:0/1008640122 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905400d4c0 con 0xd5d240 2022-01-10T01:25:21.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9058ff9700 1 -- 172.21.15.36:0/1008640122 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f905401f420 con 0xd5d240 2022-01-10T01:25:21.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 -- 172.21.15.36:0/1008640122 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd5d240 msgr2=0xd23fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:25:21.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 --2- 172.21.15.36:0/1008640122 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd5d240 0xd23fb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0xd6c260 tx=0x7f905402a000).stop 2022-01-10T01:25:21.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 -- 172.21.15.36:0/1008640122 shutdown_connections 2022-01-10T01:25:21.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 --2- 172.21.15.36:0/1008640122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd60810 0xd554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 --2- 172.21.15.36:0/1008640122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 0xd6f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 --2- 172.21.15.36:0/1008640122 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd5d240 0xd23fb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 -- 172.21.15.36:0/1008640122 >> 172.21.15.36:0/1008640122 conn(0xd5c3e0 msgr2=0xd24bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:25:21.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 -- 172.21.15.36:0/1008640122 shutdown_connections 2022-01-10T01:25:21.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 -- 172.21.15.36:0/1008640122 wait complete. 2022-01-10T01:25:21.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 -- start start 2022-01-10T01:25:21.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.237+0000 7f9073f02740 1 Processor -- start 2022-01-10T01:25:21.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 0xdbcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 0xdbd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd60810 0xdc33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0xd678e0 con 0xd60810 2022-01-10T01:25:21.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0xd67b80 con 0xd5d620 2022-01-10T01:25:21.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0xd67e20 con 0xd5d240 2022-01-10T01:25:21.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 10 client.0 ll_register_callbacks cb 0xd6c340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-01-10T01:25:21.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9063fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd60810 0xdc33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9063fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd60810 0xdc33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35346/0 (socket says 172.21.15.36:35346) 2022-01-10T01:25:21.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9063fff700 1 -- 172.21.15.36:0/1732148291 learned_addr learned my addr 172.21.15.36:0/1732148291 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:25:21.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f90637fe700 1 --2- 172.21.15.36:0/1732148291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 0xdbcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f905bfff700 1 --2- 172.21.15.36:0/1732148291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 0xdbd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f905bfff700 1 -- 172.21.15.36:0/1732148291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 msgr2=0xdbcfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:21.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f905bfff700 1 --2- 172.21.15.36:0/1732148291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 0xdbcfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f905bfff700 1 -- 172.21.15.36:0/1732148291 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd60810 msgr2=0xdc33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:25:21.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f905bfff700 1 --2- 172.21.15.36:0/1732148291 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd60810 0xdc33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:25:21.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f905bfff700 1 -- 172.21.15.36:0/1732148291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xc86910 con 0xd5d620 2022-01-10T01:25:21.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9063fff700 1 --2- 172.21.15.36:0/1732148291 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd60810 0xdc33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:25:21.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f905bfff700 1 --2- 172.21.15.36:0/1732148291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 0xdbd4d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f904c052000 tx=0x7f904c052040).ready entity=mon.1 client_cookie=db8169aeac808b3c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:25:21.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f90437fe700 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2022-01-10T01:25:21.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f90437fe700 1 -- 172.21.15.36:0/1732148291 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f904c057040 con 0xd5d620 2022-01-10T01:25:21.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f90437fe700 1 -- 172.21.15.36:0/1732148291 <== mon.1 v2:172.21.15.59:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f904c0418e0 con 0xd5d620 2022-01-10T01:25:21.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 1 -- 172.21.15.36:0/1732148291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f904c045a90 con 0xd5d620 2022-01-10T01:25:21.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f90437fe700 1 -- 172.21.15.36:0/1732148291 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f904c041aa0 con 0xd5d620 2022-01-10T01:25:21.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 10 client.5122 fetch_fsmap learned FSMap version 13 2022-01-10T01:25:21.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 1 -- 172.21.15.36:0/1732148291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0xc61310 con 0xd5d620 2022-01-10T01:25:21.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f90437fe700 1 -- 172.21.15.36:0/1732148291 <== mon.1 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c045a90 con 0xd5d620 2022-01-10T01:25:21.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f90437fe700 1 -- 172.21.15.36:0/1732148291 <== mon.1 v2:172.21.15.59:3300/0 5 ==== fsmap(e 13) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f904c04e020 con 0xd5d620 2022-01-10T01:25:21.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 10 client.5122 fetch_fsmap finished waiting for FSMap version 13 2022-01-10T01:25:21.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 10 client.5122 resolve_mds: resolved ID 'a' to GID 4882 2022-01-10T01:25:21.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 20 client.5122 populate_metadata read hostname 'smithi036' 2022-01-10T01:25:21.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 1 --2- 172.21.15.36:0/1732148291 >> [v2:172.21.15.36:6834/2488750467,v1:172.21.15.36:6835/2488750467] conn(0xd6f4a0 0xdc38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:25:21.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 4 client.5122 mds_command: new command op to 4882 tid=0[{"prefix": "cache drop"}] 2022-01-10T01:25:21.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f9073f02740 1 -- 172.21.15.36:0/1732148291 --> [v2:172.21.15.36:6834/2488750467,v1:172.21.15.36:6835/2488750467] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0xb7b590 con 0xd6f4a0 2022-01-10T01:25:21.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f90637fe700 1 --2- 172.21.15.36:0/1732148291 >> [v2:172.21.15.36:6834/2488750467,v1:172.21.15.36:6835/2488750467] conn(0xd6f4a0 0xdc38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:25:21.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f90637fe700 1 --2- 172.21.15.36:0/1732148291 >> [v2:172.21.15.36:6834/2488750467,v1:172.21.15.36:6835/2488750467] conn(0xd6f4a0 0xdc38b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=96feeacd17d92caf server_cookie=29dcfcfcaf5704ba in_seq=0 out_seq=0 2022-01-10T01:25:21.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:25:21.241+0000 7f90437fe700 10 client.5122 ms_handle_connect on v2:172.21.15.36:6834/2488750467 2022-01-10T01:25:30.842 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:25:30.845 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:25:30.848 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:25:30.851 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:26:00.910 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:26:00.914 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:26:00.916 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:26:00.919 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:26:05.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.609+0000 7f90437fe700 1 -- 172.21.15.36:0/1732148291 <== mds.0 v2:172.21.15.36:6834/2488750467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+379 (crc 0 0 0) 0xb7b590 con 0xd6f4a0 2022-01-10T01:26:05.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.609+0000 7f90437fe700 10 client.5122 handle_command_reply: tid=0 2022-01-10T01:26:05.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.609+0000 7f9073f02740 1 client.5122 shutdown 2022-01-10T01:26:05.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9073f02740 1 -- 172.21.15.36:0/1732148291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 msgr2=0xdbd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:05.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9073f02740 1 --2- 172.21.15.36:0/1732148291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 0xdbd4d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f904c052000 tx=0x7f904c052040).stop 2022-01-10T01:26:05.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9073f02740 1 -- 172.21.15.36:0/1732148291 shutdown_connections 2022-01-10T01:26:05.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9073f02740 1 --2- 172.21.15.36:0/1732148291 >> [v2:172.21.15.36:6834/2488750467,v1:172.21.15.36:6835/2488750467] conn(0xd6f4a0 0xdc38b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:05.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9073f02740 1 --2- 172.21.15.36:0/1732148291 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0xd60810 0xdc33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:05.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f90437fe700 0 client.5122 ms_handle_reset on v2:172.21.15.36:6834/2488750467 2022-01-10T01:26:05.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9073f02740 1 --2- 172.21.15.36:0/1732148291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0xd5d620 0xdbd4d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:05.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9073f02740 1 --2- 172.21.15.36:0/1732148291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0xd5d240 0xdbcfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:05.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9073f02740 1 -- 172.21.15.36:0/1732148291 >> 172.21.15.36:0/1732148291 conn(0xd5c3e0 msgr2=0xd23fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:05.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9073f02740 1 -- 172.21.15.36:0/1732148291 shutdown_connections 2022-01-10T01:26:05.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9073f02740 1 -- 172.21.15.36:0/1732148291 wait complete. 2022-01-10T01:26:05.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9073f02740 20 client.5122 trim_cache size 0 max 16384 2022-01-10T01:26:05.620 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:26:05.620 INFO:teuthology.orchestra.run.smithi036.stdout: "client_recall": { 2022-01-10T01:26:05.620 INFO:teuthology.orchestra.run.smithi036.stdout: "return_code": 0, 2022-01-10T01:26:05.620 INFO:teuthology.orchestra.run.smithi036.stdout: "message": "(0) Success", 2022-01-10T01:26:05.621 INFO:teuthology.orchestra.run.smithi036.stdout: "recalled": 920 2022-01-10T01:26:05.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:05.621 INFO:teuthology.orchestra.run.smithi036.stdout: "flush_journal": { 2022-01-10T01:26:05.621 INFO:teuthology.orchestra.run.smithi036.stdout: "return_code": 0, 2022-01-10T01:26:05.622 INFO:teuthology.orchestra.run.smithi036.stdout: "message": "" 2022-01-10T01:26:05.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:05.622 INFO:teuthology.orchestra.run.smithi036.stdout: "trim_cache": { 2022-01-10T01:26:05.622 INFO:teuthology.orchestra.run.smithi036.stdout: "trimmed": 900 2022-01-10T01:26:05.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:05.623 INFO:teuthology.orchestra.run.smithi036.stdout: "cache": { 2022-01-10T01:26:05.623 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": { 2022-01-10T01:26:05.623 INFO:teuthology.orchestra.run.smithi036.stdout: "items": 2525, 2022-01-10T01:26:05.623 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes": 431920 2022-01-10T01:26:05.624 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:05.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:05.624 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 44.36752688 2022-01-10T01:26:05.624 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:26:05.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9069cbf700 1 -- 172.21.15.36:0/2526728614 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9048053680 msgr2=0x7f9048055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:05.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9069cbf700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9048053680 0x7f9048055b40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f9054018000 tx=0x7f9054014000).stop 2022-01-10T01:26:05.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9069cbf700 1 -- 172.21.15.36:0/2526728614 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90640607d0 msgr2=0x7f9064146300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:05.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9069cbf700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90640607d0 0x7f9064146300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f904c001110 tx=0x7f904c007aa0).stop 2022-01-10T01:26:05.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9069cbf700 1 -- 172.21.15.36:0/2526728614 shutdown_connections 2022-01-10T01:26:05.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9069cbf700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9048053680 0x7f9048055b40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:05.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9069cbf700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90640ac500 0x7f90641467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:05.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9069cbf700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90640607d0 0x7f9064146300 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:05.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9069cbf700 1 --2- 172.21.15.36:0/2526728614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906405faa0 0x7f9064149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:05.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9069cbf700 1 -- 172.21.15.36:0/2526728614 >> 172.21.15.36:0/2526728614 conn(0x7f90640b2970 msgr2=0x7f90641439f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:05.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9069cbf700 1 -- 172.21.15.36:0/2526728614 shutdown_connections 2022-01-10T01:26:05.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:05.613+0000 7f9069cbf700 1 -- 172.21.15.36:0/2526728614 wait complete. 2022-01-10T01:26:05.629 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:26:05.630 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:26:05.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:26:05.671 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:26:05.692 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:26:05.713 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:26:05.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:05.714 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:26:05.715 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:05.742 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:26:05.744 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:26:05.744 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:26:05.745 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:26:05.745 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:05.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14060]: fuse finished with error 0 and tester_r 0 2022-01-10T01:26:05.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:05.763 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:26:05.764 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:05.769 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:26:05.770 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:26:05.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:26:05.862 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:05.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:05.871 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:26:05.871 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:26:05.878 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:26:05.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:26:05.880 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:26:05.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:26:05.881 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:26:05.927 INFO:teuthology.orchestra.run.smithi166.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:26:05.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:26:05.929 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:26:06.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.037+0000 7fc666071700 1 Processor -- start 2022-01-10T01:26:06.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.037+0000 7fc666071700 1 -- start start 2022-01-10T01:26:06.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.037+0000 7fc666071700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc6600b2580 0x7fc66014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.037+0000 7fc666071700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6600a8ac0 0x7fc66014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.037+0000 7fc666071700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6600a70c0 con 0x7fc6600b0010 2022-01-10T01:26:06.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.037+0000 7fc666071700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6600a72f0 con 0x7fc6600b2580 2022-01-10T01:26:06.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.037+0000 7fc666071700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600a7590 con 0x7fc6600a8ac0 2022-01-10T01:26:06.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc66506f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc6600b2580 0x7fc66014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc66486e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc6600b0010 0x7fc6600a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:50824/0 (socket says 172.21.15.36:50824) 2022-01-10T01:26:06.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc66486e700 1 -- 172.21.15.36:0/2912926496 learned_addr learned my addr 172.21.15.36:0/2912926496 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:06.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc66506f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc6600b2580 0x7fc66014ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35354/0 (socket says 172.21.15.36:35354) 2022-01-10T01:26:06.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc665870700 1 --2- 172.21.15.36:0/2912926496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6600a8ac0 0x7fc66014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc665870700 1 -- 172.21.15.36:0/2912926496 >> v2:172.21.15.36:3300/0 conn(0x7fc6600b2580 msgr2=0x7fc66014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:06.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc65ffff700 1 -- 172.21.15.36:0/2912926496 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714628727 0 0) 0x7fc6600a70c0 con 0x7fc6600b0010 2022-01-10T01:26:06.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc665870700 1 --2- 172.21.15.36:0/2912926496 >> v2:172.21.15.36:3300/0 conn(0x7fc6600b2580 0x7fc66014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc665870700 1 -- 172.21.15.36:0/2912926496 >> v1:172.21.15.59:6789/0 conn(0x7fc6600b0010 legacy=0x7fc6600a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc665870700 1 -- 172.21.15.36:0/2912926496 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6600a7830 con 0x7fc6600a8ac0 2022-01-10T01:26:06.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc665870700 1 --2- 172.21.15.36:0/2912926496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6600a8ac0 0x7fc66014b330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc658002f70 tx=0x7fc658006df0).ready entity=mon.2 client_cookie=f3bfcdf09bd7652e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:06.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc65ffff700 1 -- 172.21.15.36:0/2912926496 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc65800d570 con 0x7fc6600a8ac0 2022-01-10T01:26:06.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc65ffff700 1 -- 172.21.15.36:0/2912926496 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc658000e90 con 0x7fc6600a8ac0 2022-01-10T01:26:06.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc65ffff700 1 -- 172.21.15.36:0/2912926496 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc65800d8c0 con 0x7fc6600a8ac0 2022-01-10T01:26:06.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc666071700 1 -- 172.21.15.36:0/2912926496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6600a8ac0 msgr2=0x7fc66014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc666071700 1 --2- 172.21.15.36:0/2912926496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6600a8ac0 0x7fc66014b330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc658002f70 tx=0x7fc658006df0).stop 2022-01-10T01:26:06.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc666071700 1 -- 172.21.15.36:0/2912926496 shutdown_connections 2022-01-10T01:26:06.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc666071700 1 --2- 172.21.15.36:0/2912926496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6600a8ac0 0x7fc66014b330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc666071700 1 --2- 172.21.15.36:0/2912926496 >> v2:172.21.15.36:3300/0 conn(0x7fc6600b2580 0x7fc66014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc666071700 1 -- 172.21.15.36:0/2912926496 >> 172.21.15.36:0/2912926496 conn(0x7fc660060180 msgr2=0x7fc6600b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc666071700 1 -- 172.21.15.36:0/2912926496 shutdown_connections 2022-01-10T01:26:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc666071700 1 -- 172.21.15.36:0/2912926496 wait complete. 2022-01-10T01:26:06.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc666071700 1 Processor -- start 2022-01-10T01:26:06.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.041+0000 7fc666071700 1 -- start start 2022-01-10T01:26:06.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc666071700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6600a8ac0 0x7fc6600b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc666071700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6600b0010 0x7fc660064ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc666071700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6600b2580 0x7fc660064fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc666071700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600abf30 con 0x7fc6600b0010 2022-01-10T01:26:06.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc666071700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600ac190 con 0x7fc6600a8ac0 2022-01-10T01:26:06.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc666071700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6600ab320 con 0x7fc6600b2580 2022-01-10T01:26:06.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc66486e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6600b0010 0x7fc660064ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc66486e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6600b0010 0x7fc660064ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35362/0 (socket says 172.21.15.36:35362) 2022-01-10T01:26:06.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc66486e700 1 -- 172.21.15.36:0/14811711 learned_addr learned my addr 172.21.15.36:0/14811711 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:06.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc665870700 1 --2- 172.21.15.36:0/14811711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6600b2580 0x7fc660064fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc66506f700 1 --2- 172.21.15.36:0/14811711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6600a8ac0 0x7fc6600b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc66486e700 1 -- 172.21.15.36:0/14811711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6600b2580 msgr2=0x7fc660064fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc66486e700 1 --2- 172.21.15.36:0/14811711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6600b2580 0x7fc660064fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc66486e700 1 -- 172.21.15.36:0/14811711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6600a8ac0 msgr2=0x7fc6600b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc66486e700 1 --2- 172.21.15.36:0/14811711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6600a8ac0 0x7fc6600b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc66486e700 1 -- 172.21.15.36:0/14811711 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65800b180 con 0x7fc6600b0010 2022-01-10T01:26:06.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc66486e700 1 --2- 172.21.15.36:0/14811711 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6600b0010 0x7fc660064ab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fc654001250 tx=0x7fc654007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:06.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc65e7fc700 1 -- 172.21.15.36:0/14811711 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc654005c70 con 0x7fc6600b0010 2022-01-10T01:26:06.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc65e7fc700 1 -- 172.21.15.36:0/14811711 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc654005dd0 con 0x7fc6600b0010 2022-01-10T01:26:06.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc65e7fc700 1 -- 172.21.15.36:0/14811711 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6540072c0 con 0x7fc6600b0010 2022-01-10T01:26:06.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc666071700 1 -- 172.21.15.36:0/14811711 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6600ab5f0 con 0x7fc6600b0010 2022-01-10T01:26:06.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.045+0000 7fc666071700 1 -- 172.21.15.36:0/14811711 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6600aa800 con 0x7fc6600b0010 2022-01-10T01:26:06.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.049+0000 7fc666071700 1 -- 172.21.15.36:0/14811711 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc660057350 con 0x7fc6600b0010 2022-01-10T01:26:06.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.049+0000 7fc65e7fc700 1 -- 172.21.15.36:0/14811711 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc654010070 con 0x7fc6600b0010 2022-01-10T01:26:06.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.049+0000 7fc65e7fc700 1 --2- 172.21.15.36:0/14811711 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc640053560 0x7fc640055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.049+0000 7fc65e7fc700 1 -- 172.21.15.36:0/14811711 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc65406b560 con 0x7fc6600b0010 2022-01-10T01:26:06.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.049+0000 7fc66506f700 1 --2- 172.21.15.36:0/14811711 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc640053560 0x7fc640055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.049+0000 7fc66506f700 1 --2- 172.21.15.36:0/14811711 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc640053560 0x7fc640055a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc65000b000 tx=0x7fc650006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:06.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.053+0000 7fc65e7fc700 1 -- 172.21.15.36:0/14811711 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc654042460 con 0x7fc6600b0010 2022-01-10T01:26:06.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.177+0000 7fc666071700 1 -- 172.21.15.36:0/14811711 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc6600698e0 con 0x7fc6600b0010 2022-01-10T01:26:06.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.181+0000 7fc65e7fc700 1 -- 172.21.15.36:0/14811711 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v36) v1 ==== 81+0+34037 (secure 0 0 0) 0x7fc654045a80 con 0x7fc6600b0010 2022-01-10T01:26:06.185 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:06.185 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:26:06.186 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 36, 2022-01-10T01:26:06.186 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:26:06.186 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:26:06.186 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:25:04.160517+0000", 2022-01-10T01:26:06.186 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:26:06.187 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:26:06.187 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:26:06.187 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:26:06.187 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:26:06.188 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:26:06.188 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:26:06.188 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:26:06.188 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:26:06.189 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:26:06.189 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:26:06.189 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:26:06.189 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:26:06.189 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:26:06.190 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:26:06.190 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 6, 2022-01-10T01:26:06.190 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:26:06.190 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:26:06.191 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:26:06.191 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:26:06.191 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:26:06.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.192 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:26:06.192 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:26:06.192 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:26:06.192 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:26:06.192 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:26:06.193 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:26:06.193 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:26:06.193 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:26:06.193 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:26:06.194 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:26:06.194 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:26:06.194 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:26:06.194 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:26:06.194 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:26:06.195 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:26:06.195 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:26:06.195 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:26:06.195 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:26:06.196 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:26:06.196 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:26:06.196 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:26:06.196 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:26:06.196 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:26:06.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.197 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:26:06.197 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:26:06.197 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:26:06.198 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:26:06.198 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:26:06.198 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:26:06.198 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:26:06.198 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:26:06.199 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:26:06.199 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:26:06.199 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:26:06.199 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:26:06.199 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:26:06.200 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:26:06.200 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:26:06.200 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:26:06.200 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:26:06.201 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:26:06.201 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:26:06.201 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:26:06.201 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:26:06.201 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:26:06.202 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:26:06.202 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:26:06.202 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:26:06.202 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:26:06.202 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:26:06.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.203 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:26:06.203 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:26:06.203 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:26:06.204 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:26:06.204 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:26:06.204 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:26:06.204 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:26:06.204 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:26:06.205 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:26:06.205 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:26:06.205 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:26:06.205 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:26:06.205 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:26:06.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.206 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:26:06.206 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:26:06.206 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.207 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:26:06.207 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:26:06.207 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:26:06.208 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:26:06.208 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:26:06.208 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:26:06.208 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:26:06.209 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:26:06.209 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:26:06.209 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:26:06.209 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:26:06.209 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:26:06.210 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:26:06.210 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:26:06.210 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:26:06.210 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:26:06.211 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:26:06.211 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:26:06.211 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:26:06.211 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:26:06.212 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:26:06.212 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:26:06.212 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:26:06.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.212 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:26:06.213 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:26:06.213 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:26:06.213 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:26:06.213 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:26:06.213 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:26:06.214 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:26:06.214 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:26:06.214 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:26:06.214 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:26:06.215 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:26:06.215 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:26:06.215 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:26:06.215 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:26:06.216 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:26:06.216 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:26:06.216 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:26:06.216 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:26:06.216 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:26:06.217 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:26:06.217 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:26:06.217 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:26:06.217 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:26:06.217 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:26:06.218 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:26:06.218 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:26:06.218 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:26:06.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.219 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:26:06.219 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:26:06.219 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:26:06.219 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:26:06.219 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:26:06.220 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:26:06.220 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:26:06.220 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:26:06.220 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:26:06.220 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:26:06.221 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:26:06.221 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:26:06.221 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:26:06.221 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:26:06.221 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.222 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 5, 2022-01-10T01:26:06.222 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_metadata", 2022-01-10T01:26:06.223 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:25:00.402523+0000", 2022-01-10T01:26:06.223 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:26:06.223 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:26:06.223 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:26:06.223 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:26:06.224 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:26:06.224 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:26:06.224 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:26:06.224 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:26:06.225 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:26:06.225 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:26:06.225 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:26:06.225 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:26:06.225 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:26:06.226 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:26:06.226 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:26:06.226 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:26:06.226 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:26:06.227 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:26:06.227 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:26:06.227 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:26:06.227 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.227 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "35", 2022-01-10T01:26:06.228 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:26:06.228 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:26:06.228 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:26:06.228 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:26:06.229 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:26:06.229 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:26:06.229 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:26:06.229 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:26:06.229 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:26:06.230 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:26:06.230 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:26:06.230 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:26:06.230 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:26:06.231 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:26:06.231 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:26:06.231 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:26:06.231 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:26:06.231 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:26:06.232 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:26:06.232 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:26:06.232 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:26:06.232 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:26:06.233 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:26:06.233 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:26:06.233 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:26:06.233 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:26:06.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.234 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:26:06.234 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:26:06.234 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:26:06.234 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:26:06.235 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:26:06.235 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:26:06.235 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:26:06.235 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:26:06.235 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:26:06.236 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:26:06.236 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:26:06.236 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:26:06.236 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_bias": 4, 2022-01-10T01:26:06.236 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 16, 2022-01-10T01:26:06.237 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_priority": 5 2022-01-10T01:26:06.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.237 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:26:06.237 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:26:06.237 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": "cephfs" 2022-01-10T01:26:06.238 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.238 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.239 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 6, 2022-01-10T01:26:06.239 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_data", 2022-01-10T01:26:06.239 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:25:01.119067+0000", 2022-01-10T01:26:06.239 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:26:06.240 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:26:06.240 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:26:06.240 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:26:06.240 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:26:06.240 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:26:06.241 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:26:06.241 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:26:06.241 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:26:06.241 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:26:06.242 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:26:06.242 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:26:06.242 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:26:06.242 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:26:06.242 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:26:06.243 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:26:06.243 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:26:06.243 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:26:06.243 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:26:06.244 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:26:06.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.244 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "36", 2022-01-10T01:26:06.244 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:26:06.244 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:26:06.245 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:26:06.245 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:26:06.245 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:26:06.245 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:26:06.245 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:26:06.246 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:26:06.246 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:26:06.246 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:26:06.246 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:26:06.247 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:26:06.247 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:26:06.247 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:26:06.247 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:26:06.247 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:26:06.248 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:26:06.248 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:26:06.248 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:26:06.248 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:26:06.248 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:26:06.249 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:26:06.249 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:26:06.249 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:26:06.249 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:26:06.249 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:26:06.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.250 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:26:06.250 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:26:06.250 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:26:06.251 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:26:06.251 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:26:06.251 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:26:06.252 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:26:06.252 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:26:06.252 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:26:06.252 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:26:06.252 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:26:06.253 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:26:06.253 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:26:06.253 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:26:06.253 INFO:teuthology.orchestra.run.smithi036.stdout: "data": "cephfs" 2022-01-10T01:26:06.254 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.254 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.254 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.254 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:26:06.254 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:26:06.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.255 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:26:06.255 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:26:06.255 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:06.256 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:06.256 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:06.256 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:06.256 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:06.256 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:06.257 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:06.257 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 33, 2022-01-10T01:26:06.257 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:06.257 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:06.257 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:06.258 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.258 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.258 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:26:06.259 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:06.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.259 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.259 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:26:06.260 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:06.260 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.260 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.261 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:06.261 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.261 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.261 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:26:06.262 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:06.262 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.262 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.263 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:26:06.263 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:06.263 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.263 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.264 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:06.264 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.264 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.264 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:26:06.265 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:06.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.265 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.265 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:26:06.266 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:06.266 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.266 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.267 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:06.267 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.267 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.267 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:26:06.268 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:06.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.268 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.268 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:26:06.269 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:06.269 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.269 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.270 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:26:06.270 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:26:06.270 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:26:06.270 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:26:06.270 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:06.271 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:06.271 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:06.271 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.272 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:26:06.272 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:26:06.272 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:06.272 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:06.273 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:06.273 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:06.273 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:06.273 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:06.274 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:06.274 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 13, 2022-01-10T01:26:06.274 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:06.274 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:06.274 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:06.275 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.275 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.275 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:26:06.276 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:06.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.276 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.276 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:26:06.277 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:06.277 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.277 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.277 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.278 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:06.278 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.278 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.278 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:26:06.279 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:06.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.279 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.280 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:26:06.280 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:06.280 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.280 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.281 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:06.281 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.281 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.282 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:26:06.282 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:06.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.282 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.283 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:26:06.283 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:06.283 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.283 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.284 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:06.284 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.284 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.285 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:26:06.285 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:06.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.286 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.286 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:26:06.286 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:06.286 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.286 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.287 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:26:06.287 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:26:06.287 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:26:06.288 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:26:06.288 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:06.288 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:06.288 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:06.288 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.289 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:26:06.289 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:26:06.290 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:06.290 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:06.290 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:06.290 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:06.290 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:06.291 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:06.291 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:06.291 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 22, 2022-01-10T01:26:06.291 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:06.292 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:06.292 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:06.292 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.292 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.293 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:26:06.293 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:06.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.293 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.294 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.294 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:26:06.294 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:06.294 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.294 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.295 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:06.295 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.296 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.296 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:26:06.296 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:06.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.297 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.297 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:26:06.297 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:06.297 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.297 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.298 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:06.298 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.298 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.299 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:26:06.299 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:06.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.300 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.300 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:26:06.300 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:06.300 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.300 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.301 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:06.301 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.301 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.302 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:26:06.302 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:06.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.303 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.303 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:26:06.303 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:06.303 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.304 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.304 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:26:06.304 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:26:06.304 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:26:06.305 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:26:06.305 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:06.305 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:06.305 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:06.305 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.306 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:26:06.306 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:26:06.307 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:06.307 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:06.307 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:06.307 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:06.308 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:06.308 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:06.308 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:06.308 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 33, 2022-01-10T01:26:06.308 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:06.309 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:06.309 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:06.309 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.309 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.310 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:26:06.310 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:06.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.311 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.311 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:26:06.311 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:06.311 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.311 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.312 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:06.312 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.312 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.313 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:26:06.313 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:06.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.314 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.314 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:26:06.314 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:06.314 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.315 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.319 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:06.320 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.320 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.320 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:26:06.320 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:06.321 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.321 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.321 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:26:06.322 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:06.322 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.322 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.323 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:06.323 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.323 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.323 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:26:06.324 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:06.324 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.324 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.324 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:26:06.325 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:06.325 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.325 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.325 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:26:06.326 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:26:06.326 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:26:06.326 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:26:06.326 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:06.327 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:06.327 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:06.327 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.328 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:26:06.328 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:26:06.328 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:06.328 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:06.329 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:06.329 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:06.329 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:06.329 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:06.329 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:06.330 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 32, 2022-01-10T01:26:06.330 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:06.330 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:06.330 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:06.331 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.331 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.331 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.331 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:26:06.332 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:06.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.332 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.332 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:26:06.333 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:06.333 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.333 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.334 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:06.334 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.334 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.334 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:26:06.335 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:06.335 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.335 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.336 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:26:06.336 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:06.336 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.336 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.337 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:06.337 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.337 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.337 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:26:06.338 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:06.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.338 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.339 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:26:06.339 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:06.339 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.339 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.340 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:06.340 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.340 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.340 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.341 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:26:06.341 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:06.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.341 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.341 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.342 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:26:06.342 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:06.342 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.342 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.343 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:26:06.343 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:26:06.343 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:26:06.343 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:26:06.344 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:06.344 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:06.344 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:06.344 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.345 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:26:06.345 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:26:06.345 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:06.346 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:06.346 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:06.346 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:06.346 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:06.346 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:06.347 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:06.347 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 33, 2022-01-10T01:26:06.347 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:06.347 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:06.348 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:06.348 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.348 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.348 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:26:06.349 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:06.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.349 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.350 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:26:06.350 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:06.350 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.350 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.351 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:06.351 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.351 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.351 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.352 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:26:06.352 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:06.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.352 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.353 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:26:06.353 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:06.353 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.353 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.354 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:06.354 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.354 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.354 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.355 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:26:06.355 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:06.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.355 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.356 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:26:06.356 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:06.356 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.356 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.357 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:06.357 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.357 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.358 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:26:06.358 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:06.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.358 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.359 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:26:06.359 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:06.359 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.359 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.360 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:26:06.360 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:26:06.360 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:26:06.360 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:26:06.361 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:06.361 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:06.361 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:06.361 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.362 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.362 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.362 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:26:06.362 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:26:06.362 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:06.363 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:06.363 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:06.363 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:06.363 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:06.363 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:06.364 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:06.364 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 34, 2022-01-10T01:26:06.364 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:06.364 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:06.365 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:06.365 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.365 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.365 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:26:06.366 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:06.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.366 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.366 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:26:06.367 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:06.367 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.367 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.368 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:06.368 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.368 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.368 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:26:06.369 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:06.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.369 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.369 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:26:06.370 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:06.370 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.370 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.371 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:06.371 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.371 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.372 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:26:06.372 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:06.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.372 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.373 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:26:06.373 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:06.373 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.373 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.374 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:06.374 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.374 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.375 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:26:06.375 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:06.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.375 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.376 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.376 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:26:06.376 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:06.376 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.376 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.377 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:26:06.377 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:26:06.377 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:26:06.377 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:26:06.378 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:06.378 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:06.378 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:06.378 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.379 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:26:06.379 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:26:06.379 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:06.380 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:06.380 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:06.380 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:06.380 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:06.380 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:06.380 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:06.381 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 33, 2022-01-10T01:26:06.381 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:06.381 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:06.381 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:06.381 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.382 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.382 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:26:06.382 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:06.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.383 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.383 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:26:06.383 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:06.384 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.384 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.384 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:06.384 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.385 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.385 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:26:06.385 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:06.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.386 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.386 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:26:06.386 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:06.387 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.387 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.387 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:06.387 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.388 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.388 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:26:06.388 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:06.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.389 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.389 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:26:06.389 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:06.390 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.390 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.390 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:06.390 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:06.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.391 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:06.391 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:26:06.391 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:06.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.392 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:06.392 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:26:06.393 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:06.393 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.393 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.393 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:26:06.394 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:26:06.394 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:26:06.394 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:26:06.394 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:06.395 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:06.395 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:06.395 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:06.395 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.395 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:26:06.396 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:26:06.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.396 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:26:06.396 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:06.396 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:06.397 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:06.397 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:06.397 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:06.397 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:26:06.397 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:06.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.398 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:26:06.398 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:06.399 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:06.399 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:06.399 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:06.399 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:06.399 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:26:06.400 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:06.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.400 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:26:06.401 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:06.401 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:06.401 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:06.401 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:06.401 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:06.402 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:26:06.402 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:06.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.402 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:26:06.403 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:06.403 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:06.403 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:06.403 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:06.404 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:06.404 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:26:06.404 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:06.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.405 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:26:06.405 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:06.405 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:06.405 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:06.405 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:06.406 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:06.406 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:26:06.406 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:06.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.407 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:26:06.407 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:06.407 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:06.407 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:06.408 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:06.408 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:06.408 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:26:06.408 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:06.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.409 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:26:06.409 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:06.410 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:06.410 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:06.410 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:06.410 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:06.411 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:26:06.411 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:06.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:06.412 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:26:06.412 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:06.412 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:06.412 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:06.412 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:06.413 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:06.413 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:26:06.413 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:06.413 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.414 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:26:06.414 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:26:06.414 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:26:06.414 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:26:06.415 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:26:06.415 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2022-01-10T01:26:06.415 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:26:06.415 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:26:06.416 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:26:06.416 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:26:06.416 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:26:06.416 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:26:06.416 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:26:06.417 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:26:06.417 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:26:06.417 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:26:06.417 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:26:06.418 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:26:06.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.418 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:26:06.418 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:26:06.419 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:26:06.419 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:26:06.419 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:26:06.419 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:26:06.419 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:26:06.420 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:06.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:06.420 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:26:06.420 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:26:06.421 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:26:06.421 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:26:06.421 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:26:06.421 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:26:06.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.181+0000 7fc666071700 1 -- 172.21.15.36:0/14811711 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc640053560 msgr2=0x7fc640055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.181+0000 7fc666071700 1 --2- 172.21.15.36:0/14811711 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc640053560 0x7fc640055a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc65000b000 tx=0x7fc650006df0).stop 2022-01-10T01:26:06.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.181+0000 7fc666071700 1 -- 172.21.15.36:0/14811711 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6600b0010 msgr2=0x7fc660064ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.181+0000 7fc666071700 1 --2- 172.21.15.36:0/14811711 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6600b0010 0x7fc660064ab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fc654001250 tx=0x7fc654007de0).stop 2022-01-10T01:26:06.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.181+0000 7fc666071700 1 -- 172.21.15.36:0/14811711 shutdown_connections 2022-01-10T01:26:06.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.181+0000 7fc666071700 1 --2- 172.21.15.36:0/14811711 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc640053560 0x7fc640055a20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.181+0000 7fc666071700 1 --2- 172.21.15.36:0/14811711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6600b2580 0x7fc660064fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.181+0000 7fc666071700 1 --2- 172.21.15.36:0/14811711 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6600b0010 0x7fc660064ab0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.181+0000 7fc666071700 1 --2- 172.21.15.36:0/14811711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6600a8ac0 0x7fc6600b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.181+0000 7fc666071700 1 -- 172.21.15.36:0/14811711 >> 172.21.15.36:0/14811711 conn(0x7fc660060180 msgr2=0x7fc660148820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:06.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.185+0000 7fc666071700 1 -- 172.21.15.36:0/14811711 shutdown_connections 2022-01-10T01:26:06.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.185+0000 7fc666071700 1 -- 172.21.15.36:0/14811711 wait complete. 2022-01-10T01:26:06.428 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:26:06.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb359e700 1 Processor -- start 2022-01-10T01:26:06.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb359e700 1 -- start start 2022-01-10T01:26:06.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb4067110 0x7fadb4141840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb359e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb4066500 con 0x7fadb40b3550 2022-01-10T01:26:06.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb40b46c0 con 0x7fadb4064980 2022-01-10T01:26:06.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb40b3ea0 con 0x7fadb4067110 2022-01-10T01:26:06.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb1d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fadb40b3550 0x7fadb4141130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33162/0 (socket says 172.21.15.36:33162) 2022-01-10T01:26:06.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb1d9b700 1 -- 172.21.15.36:0/1355774633 learned_addr learned my addr 172.21.15.36:0/1355774633 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:06.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb2d9d700 1 --2- 172.21.15.36:0/1355774633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb4067110 0x7fadb4141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb159a700 1 -- 172.21.15.36:0/1355774633 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577796056 0 0) 0x7fadb4066500 con 0x7fadb40b3550 2022-01-10T01:26:06.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb159a700 1 -- 172.21.15.36:0/1355774633 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad98003260 con 0x7fadb40b3550 2022-01-10T01:26:06.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb2d9d700 1 -- 172.21.15.36:0/1355774633 >> v1:172.21.15.59:6789/0 conn(0x7fadb4064980 legacy=0x7fadb4066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb2d9d700 1 -- 172.21.15.36:0/1355774633 >> v1:172.21.15.36:6789/0 conn(0x7fadb40b3550 legacy=0x7fadb4141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb2d9d700 1 -- 172.21.15.36:0/1355774633 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb4064d60 con 0x7fadb4067110 2022-01-10T01:26:06.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.533+0000 7fadb2d9d700 1 --2- 172.21.15.36:0/1355774633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb4067110 0x7fadb4141840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fadac0032f0 tx=0x7fadac0091d0).ready entity=mon.2 client_cookie=5682566e33e8e6c7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:06.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb159a700 1 -- 172.21.15.36:0/1355774633 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadac00b6c0 con 0x7fadb4067110 2022-01-10T01:26:06.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb159a700 1 -- 172.21.15.36:0/1355774633 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac00b820 con 0x7fadb4067110 2022-01-10T01:26:06.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb159a700 1 -- 172.21.15.36:0/1355774633 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadac00b990 con 0x7fadb4067110 2022-01-10T01:26:06.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 -- 172.21.15.36:0/1355774633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb4067110 msgr2=0x7fadb4141840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 --2- 172.21.15.36:0/1355774633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb4067110 0x7fadb4141840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fadac0032f0 tx=0x7fadac0091d0).stop 2022-01-10T01:26:06.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 -- 172.21.15.36:0/1355774633 shutdown_connections 2022-01-10T01:26:06.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 --2- 172.21.15.36:0/1355774633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb4067110 0x7fadb4141840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 -- 172.21.15.36:0/1355774633 >> 172.21.15.36:0/1355774633 conn(0x7fadb405f6b0 msgr2=0x7fadb405fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:06.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 -- 172.21.15.36:0/1355774633 shutdown_connections 2022-01-10T01:26:06.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 -- 172.21.15.36:0/1355774633 wait complete. 2022-01-10T01:26:06.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 Processor -- start 2022-01-10T01:26:06.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 -- start start 2022-01-10T01:26:06.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadb4064980 0x7fadb413ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb4067110 0x7fadb40b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b3550 0x7fadb413a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb40ae370 con 0x7fadb40b3550 2022-01-10T01:26:06.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb4154120 con 0x7fadb4064980 2022-01-10T01:26:06.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb41543c0 con 0x7fadb4067110 2022-01-10T01:26:06.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb2d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b3550 0x7fadb413a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb2d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b3550 0x7fadb413a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35378/0 (socket says 172.21.15.36:35378) 2022-01-10T01:26:06.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb2d9d700 1 -- 172.21.15.36:0/2415923330 learned_addr learned my addr 172.21.15.36:0/2415923330 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:06.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fadb1d9b700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb4067110 0x7fadb40b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.537+0000 7fadb259c700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadb4064980 0x7fadb413ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fadb2d9d700 1 -- 172.21.15.36:0/2415923330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb4067110 msgr2=0x7fadb40b7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fadb2d9d700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb4067110 0x7fadb40b7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fadb2d9d700 1 -- 172.21.15.36:0/2415923330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadb4064980 msgr2=0x7fadb413ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fadb2d9d700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadb4064980 0x7fadb413ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fadb2d9d700 1 -- 172.21.15.36:0/2415923330 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac009470 con 0x7fadb40b3550 2022-01-10T01:26:06.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fadb259c700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadb4064980 0x7fadb413ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:06.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fadb2d9d700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b3550 0x7fadb413a870 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fadac0032f0 tx=0x7fadac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:06.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fada37fe700 1 -- 172.21.15.36:0/2415923330 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadac00b6c0 con 0x7fadb40b3550 2022-01-10T01:26:06.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fada37fe700 1 -- 172.21.15.36:0/2415923330 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac021630 con 0x7fadb40b3550 2022-01-10T01:26:06.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fadb359e700 1 -- 172.21.15.36:0/2415923330 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb40b7480 con 0x7fadb40b3550 2022-01-10T01:26:06.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fada37fe700 1 -- 172.21.15.36:0/2415923330 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadac021990 con 0x7fadb40b3550 2022-01-10T01:26:06.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fadb359e700 1 -- 172.21.15.36:0/2415923330 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb40b80b0 con 0x7fadb40b3550 2022-01-10T01:26:06.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fadb359e700 1 -- 172.21.15.36:0/2415923330 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb4154580 con 0x7fadb40b3550 2022-01-10T01:26:06.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fada37fe700 1 -- 172.21.15.36:0/2415923330 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fadac027020 con 0x7fadb40b3550 2022-01-10T01:26:06.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fada37fe700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad90053560 0x7fad90055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fadb259c700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad90053560 0x7fad90055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.541+0000 7fada37fe700 1 -- 172.21.15.36:0/2415923330 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fadac06cf10 con 0x7fadb40b3550 2022-01-10T01:26:06.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.545+0000 7fadb259c700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad90053560 0x7fad90055a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fada800b000 tx=0x7fada8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:06.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.549+0000 7fada37fe700 1 -- 172.21.15.36:0/2415923330 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fadac043e10 con 0x7fadb40b3550 2022-01-10T01:26:06.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.709+0000 7fadb359e700 1 -- 172.21.15.36:0/2415923330 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadb4057350 con 0x7fadb40b3550 2022-01-10T01:26:06.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.713+0000 7fada37fe700 1 -- 172.21.15.36:0/2415923330 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+2491 (secure 0 0 0) 0x7fadac015020 con 0x7fadb40b3550 2022-01-10T01:26:06.716 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:06.716 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1410680575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1410680575},{"type":"v1","addr":"172.21.15.36:6837","nonce":1410680575}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/1811767033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1811767033},{"type":"v1","addr":"172.21.15.59:6833","nonce":1811767033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:25:02.143464+0000","modified":"2022-01-10T01:25:03.146833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/2488750467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2488750467},{"type":"v1","addr":"172.21.15.36:6835","nonce":2488750467}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2022-01-10T01:26:06.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.713+0000 7fadb359e700 1 -- 172.21.15.36:0/2415923330 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad90053560 msgr2=0x7fad90055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.713+0000 7fadb359e700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad90053560 0x7fad90055a20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fada800b000 tx=0x7fada8009040).stop 2022-01-10T01:26:06.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.713+0000 7fadb359e700 1 -- 172.21.15.36:0/2415923330 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b3550 msgr2=0x7fadb413a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.713+0000 7fadb359e700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b3550 0x7fadb413a870 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fadac0032f0 tx=0x7fadac016000).stop 2022-01-10T01:26:06.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.713+0000 7fadb359e700 1 -- 172.21.15.36:0/2415923330 shutdown_connections 2022-01-10T01:26:06.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.713+0000 7fadb359e700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad90053560 0x7fad90055a20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.713+0000 7fadb359e700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b3550 0x7fadb413a870 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.713+0000 7fadb359e700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb4067110 0x7fadb40b7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.713+0000 7fadb359e700 1 --2- 172.21.15.36:0/2415923330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadb4064980 0x7fadb413ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.713+0000 7fadb359e700 1 -- 172.21.15.36:0/2415923330 >> 172.21.15.36:0/2415923330 conn(0x7fadb405f6b0 msgr2=0x7fadb40b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:06.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.713+0000 7fadb359e700 1 -- 172.21.15.36:0/2415923330 shutdown_connections 2022-01-10T01:26:06.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.713+0000 7fadb359e700 1 -- 172.21.15.36:0/2415923330 wait complete. 2022-01-10T01:26:06.722 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 13 2022-01-10T01:26:06.732 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2022-01-10T01:26:06.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f57201f8700 1 Processor -- start 2022-01-10T01:26:06.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f57201f8700 1 -- start start 2022-01-10T01:26:06.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f57201f8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57180b1db0 0x7f57180b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f57201f8700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57180b0350 con 0x7f57180a70c0 2022-01-10T01:26:06.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f57201f8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57180b05f0 con 0x7f57181483a0 2022-01-10T01:26:06.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f57201f8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57180a90c0 con 0x7f57180b1db0 2022-01-10T01:26:06.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571e795700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f57180a70c0 0x7f5718144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33180/0 (socket says 172.21.15.36:33180) 2022-01-10T01:26:06.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571e795700 1 -- 172.21.15.36:0/196056419 learned_addr learned my addr 172.21.15.36:0/196056419 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:06.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571df94700 1 --2- 172.21.15.36:0/196056419 >> v2:172.21.15.59:3300/0 conn(0x7f57180b1db0 0x7f57180b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 -- 172.21.15.36:0/196056419 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739997295 0 0) 0x7f57180b0350 con 0x7f57180a70c0 2022-01-10T01:26:06.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 -- 172.21.15.36:0/196056419 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5700003260 con 0x7f57180a70c0 2022-01-10T01:26:06.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 -- 172.21.15.36:0/196056419 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 713070711 0 0) 0x7f5700003260 con 0x7f57180a70c0 2022-01-10T01:26:06.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 -- 172.21.15.36:0/196056419 >> v2:172.21.15.59:3300/0 conn(0x7f57180b1db0 msgr2=0x7f57180b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:06.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 --2- 172.21.15.36:0/196056419 >> v2:172.21.15.59:3300/0 conn(0x7f57180b1db0 0x7f57180b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 -- 172.21.15.36:0/196056419 >> v1:172.21.15.59:6789/0 conn(0x7f57181483a0 legacy=0x7f57180b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 -- 172.21.15.36:0/196056419 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57180b0890 con 0x7f57180a70c0 2022-01-10T01:26:06.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 -- 172.21.15.36:0/196056419 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f5710001660 con 0x7f57180a70c0 2022-01-10T01:26:06.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 -- 172.21.15.36:0/196056419 >> v1:172.21.15.36:6789/0 conn(0x7f57180a70c0 legacy=0x7f5718144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 --2- 172.21.15.36:0/196056419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5700003750 0x7f5700003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 --2- 172.21.15.36:0/196056419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5700004500 0x7f5700004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 --2- 172.21.15.36:0/196056419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5700004ec0 0x7f570000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 -- 172.21.15.36:0/196056419 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570000bd70 con 0x7f5700004ec0 2022-01-10T01:26:06.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 -- 172.21.15.36:0/196056419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570000bee0 con 0x7f5700004500 2022-01-10T01:26:06.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571cf92700 1 -- 172.21.15.36:0/196056419 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570000c0a0 con 0x7f5700003750 2022-01-10T01:26:06.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571e795700 1 --2- 172.21.15.36:0/196056419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5700004ec0 0x7f570000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571d793700 1 --2- 172.21.15.36:0/196056419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5700004500 0x7f5700004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.829+0000 7f571df94700 1 --2- 172.21.15.36:0/196056419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5700003750 0x7f5700003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f571e795700 1 -- 172.21.15.36:0/196056419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5700003750 msgr2=0x7f5700003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:06.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f571e795700 1 --2- 172.21.15.36:0/196056419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5700003750 0x7f5700003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f571e795700 1 -- 172.21.15.36:0/196056419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5700004500 msgr2=0x7f5700004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:06.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f571e795700 1 --2- 172.21.15.36:0/196056419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5700004500 0x7f5700004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f571e795700 1 -- 172.21.15.36:0/196056419 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5700003260 con 0x7f5700004ec0 2022-01-10T01:26:06.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f571d793700 1 --2- 172.21.15.36:0/196056419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5700004500 0x7f5700004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:06.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f571e795700 1 -- 172.21.15.36:0/196056419 reap_dead start 2022-01-10T01:26:06.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f571e795700 1 --2- 172.21.15.36:0/196056419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5700004ec0 0x7f570000b750 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f5710001370 tx=0x7f57180b0a20).ready entity=mon.0 client_cookie=23c24ef34491d338 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:06.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f571cf92700 1 -- 172.21.15.36:0/196056419 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57100070d0 con 0x7f5700004ec0 2022-01-10T01:26:06.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f571cf92700 1 -- 172.21.15.36:0/196056419 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5710007230 con 0x7f5700004ec0 2022-01-10T01:26:06.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f571cf92700 1 -- 172.21.15.36:0/196056419 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f571000c8f0 con 0x7f5700004ec0 2022-01-10T01:26:06.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f57201f8700 1 -- 172.21.15.36:0/196056419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5700004ec0 msgr2=0x7f570000b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f57201f8700 1 --2- 172.21.15.36:0/196056419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5700004ec0 0x7f570000b750 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f5710001370 tx=0x7f57180b0a20).stop 2022-01-10T01:26:06.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f57201f8700 1 -- 172.21.15.36:0/196056419 shutdown_connections 2022-01-10T01:26:06.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f57201f8700 1 --2- 172.21.15.36:0/196056419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5700004ec0 0x7f570000b750 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f57201f8700 1 -- 172.21.15.36:0/196056419 >> 172.21.15.36:0/196056419 conn(0x7f571805f6b0 msgr2=0x7f571805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:06.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f57201f8700 1 -- 172.21.15.36:0/196056419 shutdown_connections 2022-01-10T01:26:06.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f57201f8700 1 -- 172.21.15.36:0/196056419 wait complete. 2022-01-10T01:26:06.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f57201f8700 1 Processor -- start 2022-01-10T01:26:06.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f57201f8700 1 -- start start 2022-01-10T01:26:06.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.833+0000 7f57201f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5700004ec0 0x7f57180a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f57201f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f571814a120 0x7f5718143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f57201f8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5718143d30 0x7f5718159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f57201f8700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57180aea00 con 0x7f5718143d30 2022-01-10T01:26:06.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f57201f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57180addf0 con 0x7f571814a120 2022-01-10T01:26:06.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f57201f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57180ae020 con 0x7f5700004ec0 2022-01-10T01:26:06.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f571e795700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5718143d30 0x7f5718159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f571e795700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5718143d30 0x7f5718159ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35398/0 (socket says 172.21.15.36:35398) 2022-01-10T01:26:06.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f571e795700 1 -- 172.21.15.36:0/2294425058 learned_addr learned my addr 172.21.15.36:0/2294425058 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:06.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f571df94700 1 --2- 172.21.15.36:0/2294425058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5700004ec0 0x7f57180a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f571d793700 1 --2- 172.21.15.36:0/2294425058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f571814a120 0x7f5718143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f571e795700 1 -- 172.21.15.36:0/2294425058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5700004ec0 msgr2=0x7f57180a96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f571e795700 1 --2- 172.21.15.36:0/2294425058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5700004ec0 0x7f57180a96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f571e795700 1 -- 172.21.15.36:0/2294425058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f571814a120 msgr2=0x7f5718143840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:06.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f571e795700 1 --2- 172.21.15.36:0/2294425058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f571814a120 0x7f5718143840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:06.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f571e795700 1 -- 172.21.15.36:0/2294425058 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57180ae2c0 con 0x7f5718143d30 2022-01-10T01:26:06.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f571e795700 1 --2- 172.21.15.36:0/2294425058 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5718143d30 0x7f5718159ea0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f57180ae8e0 tx=0x7f5710013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:06.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f5706ffd700 1 -- 172.21.15.36:0/2294425058 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5710001a50 con 0x7f5718143d30 2022-01-10T01:26:06.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f5706ffd700 1 -- 172.21.15.36:0/2294425058 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5710001640 con 0x7f5718143d30 2022-01-10T01:26:06.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f5706ffd700 1 -- 172.21.15.36:0/2294425058 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5710004520 con 0x7f5718143d30 2022-01-10T01:26:06.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f57201f8700 1 -- 172.21.15.36:0/2294425058 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57180ae560 con 0x7f5718143d30 2022-01-10T01:26:06.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f57201f8700 1 -- 172.21.15.36:0/2294425058 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571814bb60 con 0x7f5718143d30 2022-01-10T01:26:06.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f57201f8700 1 -- 172.21.15.36:0/2294425058 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5718144350 con 0x7f5718143d30 2022-01-10T01:26:06.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f5706ffd700 1 -- 172.21.15.36:0/2294425058 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5710027070 con 0x7f5718143d30 2022-01-10T01:26:06.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f5706ffd700 1 --2- 172.21.15.36:0/2294425058 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f56f80534d0 0x7f56f8055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:06.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f5706ffd700 1 -- 172.21.15.36:0/2294425058 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f571006bd50 con 0x7f5718143d30 2022-01-10T01:26:06.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.837+0000 7f571df94700 1 --2- 172.21.15.36:0/2294425058 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f56f80534d0 0x7f56f8055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:06.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.841+0000 7f571df94700 1 --2- 172.21.15.36:0/2294425058 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f56f80534d0 0x7f56f8055990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f570800c000 tx=0x7f5708008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:06.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:06.845+0000 7f5706ffd700 1 -- 172.21.15.36:0/2294425058 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5718144350 con 0x7f5718143d30 2022-01-10T01:26:07.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.009+0000 7f57201f8700 1 -- 172.21.15.36:0/2294425058 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5718144350 con 0x7f5718143d30 2022-01-10T01:26:07.603 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:26:07.597+0000 7f0b5376f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:26:07.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.605+0000 7f5706ffd700 1 -- 172.21.15.36:0/2294425058 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5718144350 con 0x7f5718143d30 2022-01-10T01:26:07.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.609+0000 7f57201f8700 1 -- 172.21.15.36:0/2294425058 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f56f80534d0 msgr2=0x7f56f8055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:07.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.609+0000 7f57201f8700 1 --2- 172.21.15.36:0/2294425058 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f56f80534d0 0x7f56f8055990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f570800c000 tx=0x7f5708008040).stop 2022-01-10T01:26:07.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.609+0000 7f57201f8700 1 -- 172.21.15.36:0/2294425058 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5718143d30 msgr2=0x7f5718159ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:07.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.609+0000 7f57201f8700 1 --2- 172.21.15.36:0/2294425058 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5718143d30 0x7f5718159ea0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f57180ae8e0 tx=0x7f5710013000).stop 2022-01-10T01:26:07.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.609+0000 7f57201f8700 1 -- 172.21.15.36:0/2294425058 shutdown_connections 2022-01-10T01:26:07.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.609+0000 7f57201f8700 1 --2- 172.21.15.36:0/2294425058 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f56f80534d0 0x7f56f8055990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:07.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.609+0000 7f57201f8700 1 --2- 172.21.15.36:0/2294425058 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5718143d30 0x7f5718159ea0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:07.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.609+0000 7f57201f8700 1 --2- 172.21.15.36:0/2294425058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f571814a120 0x7f5718143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:07.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.609+0000 7f57201f8700 1 --2- 172.21.15.36:0/2294425058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5700004ec0 0x7f57180a96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:07.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.609+0000 7f57201f8700 1 -- 172.21.15.36:0/2294425058 >> 172.21.15.36:0/2294425058 conn(0x7f571805f6b0 msgr2=0x7f57180b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:07.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.609+0000 7f57201f8700 1 -- 172.21.15.36:0/2294425058 shutdown_connections 2022-01-10T01:26:07.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.609+0000 7f57201f8700 1 -- 172.21.15.36:0/2294425058 wait complete. 2022-01-10T01:26:07.617 INFO:teuthology.orchestra.run.smithi036.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2022-01-10T01:26:07.629 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:26:07.653 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:26:07.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa8eb700 1 Processor -- start 2022-01-10T01:26:07.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa8eb700 1 -- start start 2022-01-10T01:26:07.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa8eb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70a40b0710 0x7f70a4142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:07.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa8eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a40ace70 0x7f70a413f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:07.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa8eb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a4143920 con 0x7f70a40b30d0 2022-01-10T01:26:07.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa8eb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a40b0af0 con 0x7f70a40b0710 2022-01-10T01:26:07.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa8eb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a40ae680 con 0x7f70a40ace70 2022-01-10T01:26:07.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa0ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a40ace70 0x7f70a413f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:07.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa0ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a40ace70 0x7f70a413f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:41700/0 (socket says 172.21.15.36:41700) 2022-01-10T01:26:07.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa0ea700 1 -- 172.21.15.36:0/2159587900 learned_addr learned my addr 172.21.15.36:0/2159587900 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:07.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70a98e9700 1 --2- 172.21.15.36:0/2159587900 >> v2:172.21.15.59:3300/0 conn(0x7f70a40b0710 0x7f70a4142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:07.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70a90e8700 1 --1- 172.21.15.36:0/2159587900 >> v1:172.21.15.59:6789/0 conn(0x7f70a40b30d0 0x7f70a4143210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:50886/0 (socket says 172.21.15.36:50886) 2022-01-10T01:26:07.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa0ea700 1 -- 172.21.15.36:0/2159587900 >> v2:172.21.15.59:3300/0 conn(0x7f70a40b0710 msgr2=0x7f70a4142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:07.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa0ea700 1 --2- 172.21.15.36:0/2159587900 >> v2:172.21.15.59:3300/0 conn(0x7f70a40b0710 0x7f70a4142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:07.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa0ea700 1 -- 172.21.15.36:0/2159587900 >> v1:172.21.15.59:6789/0 conn(0x7f70a40b30d0 legacy=0x7f70a4143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:07.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa0ea700 1 -- 172.21.15.36:0/2159587900 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a40ae920 con 0x7f70a40ace70 2022-01-10T01:26:07.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70aa0ea700 1 --2- 172.21.15.36:0/2159587900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a40ace70 0x7f70a413f8a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f709c0032f0 tx=0x7f709c009290).ready entity=mon.2 client_cookie=97c0f7ff1cb193ea server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:07.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.729+0000 7f70a88e7700 1 -- 172.21.15.36:0/2159587900 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f709c00ba90 con 0x7f70a40ace70 2022-01-10T01:26:07.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.733+0000 7f70a88e7700 1 -- 172.21.15.36:0/2159587900 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709c00bbf0 con 0x7f70a40ace70 2022-01-10T01:26:07.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.733+0000 7f70a88e7700 1 -- 172.21.15.36:0/2159587900 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f709c010410 con 0x7f70a40ace70 2022-01-10T01:26:07.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.733+0000 7f70aa8eb700 1 -- 172.21.15.36:0/2159587900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a40ace70 msgr2=0x7f70a413f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:07.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.733+0000 7f70aa8eb700 1 --2- 172.21.15.36:0/2159587900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a40ace70 0x7f70a413f8a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f709c0032f0 tx=0x7f709c009290).stop 2022-01-10T01:26:07.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.733+0000 7f70aa8eb700 1 -- 172.21.15.36:0/2159587900 shutdown_connections 2022-01-10T01:26:07.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.733+0000 7f70aa8eb700 1 --2- 172.21.15.36:0/2159587900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a40ace70 0x7f70a413f8a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:07.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.733+0000 7f70aa8eb700 1 --2- 172.21.15.36:0/2159587900 >> v2:172.21.15.59:3300/0 conn(0x7f70a40b0710 0x7f70a4142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:07.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.733+0000 7f70aa8eb700 1 -- 172.21.15.36:0/2159587900 >> 172.21.15.36:0/2159587900 conn(0x7f70a4061140 msgr2=0x7f70a4062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:07.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.733+0000 7f70aa8eb700 1 -- 172.21.15.36:0/2159587900 shutdown_connections 2022-01-10T01:26:07.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.733+0000 7f70aa8eb700 1 -- 172.21.15.36:0/2159587900 wait complete. 2022-01-10T01:26:07.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.733+0000 7f70aa8eb700 1 Processor -- start 2022-01-10T01:26:07.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70aa8eb700 1 -- start start 2022-01-10T01:26:07.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70aa8eb700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70a40ace70 0x7f70a40a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:07.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70aa8eb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a40b0710 0x7f70a40a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:07.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70aa8eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a40b30d0 0x7f70a414e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:07.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70aa8eb700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a4067a50 con 0x7f70a40ace70 2022-01-10T01:26:07.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70aa8eb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a409f520 con 0x7f70a40b0710 2022-01-10T01:26:07.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70aa8eb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a40a11d0 con 0x7f70a40b30d0 2022-01-10T01:26:07.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70a98e9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70a40ace70 0x7f70a40a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:07.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70a90e8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a40b0710 0x7f70a40a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:07.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70a98e9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70a40ace70 0x7f70a40a0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35420/0 (socket says 172.21.15.36:35420) 2022-01-10T01:26:07.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70a90e8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a40b0710 0x7f70a40a29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:60288/0 (socket says 172.21.15.36:60288) 2022-01-10T01:26:07.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70aa0ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a40b30d0 0x7f70a414e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:07.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70a98e9700 1 -- 172.21.15.36:0/4236999494 learned_addr learned my addr 172.21.15.36:0/4236999494 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:07.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70a98e9700 1 -- 172.21.15.36:0/4236999494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a40b30d0 msgr2=0x7f70a414e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:07.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70a98e9700 1 --2- 172.21.15.36:0/4236999494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a40b30d0 0x7f70a414e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:07.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70a98e9700 1 -- 172.21.15.36:0/4236999494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a40b0710 msgr2=0x7f70a40a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:07.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70a98e9700 1 --2- 172.21.15.36:0/4236999494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a40b0710 0x7f70a40a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:07.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70a98e9700 1 -- 172.21.15.36:0/4236999494 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c009530 con 0x7f70a40ace70 2022-01-10T01:26:07.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70a98e9700 1 --2- 172.21.15.36:0/4236999494 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70a40ace70 0x7f70a40a0ce0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f70a000c000 tx=0x7f70a0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:07.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f7092ffd700 1 -- 172.21.15.36:0/4236999494 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70a0010780 con 0x7f70a40ace70 2022-01-10T01:26:07.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f7092ffd700 1 -- 172.21.15.36:0/4236999494 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a00108e0 con 0x7f70a40ace70 2022-01-10T01:26:07.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70aa8eb700 1 -- 172.21.15.36:0/4236999494 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a409f780 con 0x7f70a40ace70 2022-01-10T01:26:07.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f7092ffd700 1 -- 172.21.15.36:0/4236999494 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70a0010c40 con 0x7f70a40ace70 2022-01-10T01:26:07.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.737+0000 7f70aa8eb700 1 -- 172.21.15.36:0/4236999494 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a409eea0 con 0x7f70a40ace70 2022-01-10T01:26:07.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.741+0000 7f70aa8eb700 1 -- 172.21.15.36:0/4236999494 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a4057350 con 0x7f70a40ace70 2022-01-10T01:26:07.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.741+0000 7f7092ffd700 1 -- 172.21.15.36:0/4236999494 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f70a001c460 con 0x7f70a40ace70 2022-01-10T01:26:07.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.741+0000 7f7092ffd700 1 --2- 172.21.15.36:0/4236999494 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7084053620 0x7f7084055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:07.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.741+0000 7f7092ffd700 1 -- 172.21.15.36:0/4236999494 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f70a006be70 con 0x7f70a40ace70 2022-01-10T01:26:07.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.741+0000 7f70a90e8700 1 --2- 172.21.15.36:0/4236999494 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7084053620 0x7f7084055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:07.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.741+0000 7f70a90e8700 1 --2- 172.21.15.36:0/4236999494 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7084053620 0x7f7084055ae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f709400d000 tx=0x7f7094007b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:07.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.749+0000 7f7092ffd700 1 -- 172.21.15.36:0/4236999494 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f70a0042dd0 con 0x7f70a40ace70 2022-01-10T01:26:07.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.909+0000 7f70aa8eb700 1 -- 172.21.15.36:0/4236999494 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70a40b2c70 con 0x7f70a40ace70 2022-01-10T01:26:07.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.909+0000 7f7092ffd700 1 -- 172.21.15.36:0/4236999494 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2130 (secure 0 0 0) 0x7f70a00463f0 con 0x7f70a40ace70 2022-01-10T01:26:07.915 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:07.915 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1410680575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1410680575},{"type":"v1","addr":"172.21.15.36:6837","nonce":1410680575}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/1811767033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1811767033},{"type":"v1","addr":"172.21.15.59:6833","nonce":1811767033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:25:02.143464+0000","modified":"2022-01-10T01:26:07.604012+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":37,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2022-01-10T01:26:07.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.913+0000 7f70aa8eb700 1 -- 172.21.15.36:0/4236999494 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7084053620 msgr2=0x7f7084055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:07.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.913+0000 7f70aa8eb700 1 --2- 172.21.15.36:0/4236999494 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7084053620 0x7f7084055ae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f709400d000 tx=0x7f7094007b80).stop 2022-01-10T01:26:07.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.913+0000 7f70aa8eb700 1 -- 172.21.15.36:0/4236999494 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70a40ace70 msgr2=0x7f70a40a0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:07.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.913+0000 7f70aa8eb700 1 --2- 172.21.15.36:0/4236999494 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70a40ace70 0x7f70a40a0ce0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f70a000c000 tx=0x7f70a0006df0).stop 2022-01-10T01:26:07.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.913+0000 7f70aa8eb700 1 -- 172.21.15.36:0/4236999494 shutdown_connections 2022-01-10T01:26:07.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.913+0000 7f70aa8eb700 1 --2- 172.21.15.36:0/4236999494 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7084053620 0x7f7084055ae0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:07.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.913+0000 7f70aa8eb700 1 --2- 172.21.15.36:0/4236999494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70a40b30d0 0x7f70a414e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:07.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.913+0000 7f70aa8eb700 1 --2- 172.21.15.36:0/4236999494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70a40b0710 0x7f70a40a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:07.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.913+0000 7f70aa8eb700 1 --2- 172.21.15.36:0/4236999494 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f70a40ace70 0x7f70a40a0ce0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:07.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.913+0000 7f70aa8eb700 1 -- 172.21.15.36:0/4236999494 >> 172.21.15.36:0/4236999494 conn(0x7f70a4061140 msgr2=0x7f70a41424e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:07.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.913+0000 7f70aa8eb700 1 -- 172.21.15.36:0/4236999494 shutdown_connections 2022-01-10T01:26:07.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:07.913+0000 7f70aa8eb700 1 -- 172.21.15.36:0/4236999494 wait complete. 2022-01-10T01:26:07.920 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 14 2022-01-10T01:26:07.928 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:26:08.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760aef6700 1 Processor -- start 2022-01-10T01:26:08.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760aef6700 1 -- start start 2022-01-10T01:26:08.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760aef6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f76040a8ac0 0x7f7604152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:08.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760aef6700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76040a70c0 con 0x7f76040b0010 2022-01-10T01:26:08.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760aef6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76040a72f0 con 0x7f76040b2580 2022-01-10T01:26:08.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760aef6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76040a7590 con 0x7f76040a8ac0 2022-01-10T01:26:08.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f76096f3700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f76040b0010 0x7f76040a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33224/0 (socket says 172.21.15.36:33224) 2022-01-10T01:26:08.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f76096f3700 1 -- 172.21.15.36:0/971973552 learned_addr learned my addr 172.21.15.36:0/971973552 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:08.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760a6f5700 1 --2- 172.21.15.36:0/971973552 >> v2:172.21.15.59:3300/0 conn(0x7f76040a8ac0 0x7f7604152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:08.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 -- 172.21.15.36:0/971973552 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628641422 0 0) 0x7f76040a70c0 con 0x7f76040b0010 2022-01-10T01:26:08.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 -- 172.21.15.36:0/971973552 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e8003260 con 0x7f76040b0010 2022-01-10T01:26:08.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 -- 172.21.15.36:0/971973552 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3458183262 0 0) 0x7f75e8003260 con 0x7f76040b0010 2022-01-10T01:26:08.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 -- 172.21.15.36:0/971973552 >> v2:172.21.15.59:3300/0 conn(0x7f76040a8ac0 msgr2=0x7f7604152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:08.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 --2- 172.21.15.36:0/971973552 >> v2:172.21.15.59:3300/0 conn(0x7f76040a8ac0 0x7f7604152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 -- 172.21.15.36:0/971973552 >> v1:172.21.15.59:6789/0 conn(0x7f76040b2580 legacy=0x7f760414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:08.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 -- 172.21.15.36:0/971973552 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76040a7830 con 0x7f76040b0010 2022-01-10T01:26:08.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 -- 172.21.15.36:0/971973552 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f75fc0019e0 con 0x7f76040b0010 2022-01-10T01:26:08.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 -- 172.21.15.36:0/971973552 >> v1:172.21.15.36:6789/0 conn(0x7f76040b0010 legacy=0x7f76040a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:08.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 --2- 172.21.15.36:0/971973552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e8003750 0x7f75e8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:08.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 --2- 172.21.15.36:0/971973552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75e8004500 0x7f75e8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:08.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 --2- 172.21.15.36:0/971973552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f75e8004e70 0x7f75e800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:08.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 -- 172.21.15.36:0/971973552 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76040a7590 con 0x7f75e8004e70 2022-01-10T01:26:08.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 -- 172.21.15.36:0/971973552 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e800bd20 con 0x7f75e8003750 2022-01-10T01:26:08.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 -- 172.21.15.36:0/971973552 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e800bee0 con 0x7f75e8004500 2022-01-10T01:26:08.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760a6f5700 1 --2- 172.21.15.36:0/971973552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f75e8004e70 0x7f75e800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:08.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7609ef4700 1 --2- 172.21.15.36:0/971973552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e8003750 0x7f75e8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:08.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f76096f3700 1 --2- 172.21.15.36:0/971973552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75e8004500 0x7f75e8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:08.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760a6f5700 1 -- 172.21.15.36:0/971973552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75e8004500 msgr2=0x7f75e8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:08.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760a6f5700 1 --2- 172.21.15.36:0/971973552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75e8004500 0x7f75e8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760a6f5700 1 -- 172.21.15.36:0/971973552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e8003750 msgr2=0x7f75e8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:08.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760a6f5700 1 --2- 172.21.15.36:0/971973552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e8003750 0x7f75e8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760a6f5700 1 -- 172.21.15.36:0/971973552 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e8003260 con 0x7f75e8004e70 2022-01-10T01:26:08.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760a6f5700 1 -- 172.21.15.36:0/971973552 reap_dead start 2022-01-10T01:26:08.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f760a6f5700 1 --2- 172.21.15.36:0/971973552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f75e8004e70 0x7f75e800b750 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f760000c000 tx=0x7f7600006df0).ready entity=mon.0 client_cookie=779a5f669172ca0e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:08.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.033+0000 7f7608ef2700 1 -- 172.21.15.36:0/971973552 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7600016070 con 0x7f75e8004e70 2022-01-10T01:26:08.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f7608ef2700 1 -- 172.21.15.36:0/971973552 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760000e5f0 con 0x7f75e8004e70 2022-01-10T01:26:08.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f7608ef2700 1 -- 172.21.15.36:0/971973552 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f760000e950 con 0x7f75e8004e70 2022-01-10T01:26:08.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 -- 172.21.15.36:0/971973552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f75e8004e70 msgr2=0x7f75e800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:08.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 --2- 172.21.15.36:0/971973552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f75e8004e70 0x7f75e800b750 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f760000c000 tx=0x7f7600006df0).stop 2022-01-10T01:26:08.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 -- 172.21.15.36:0/971973552 shutdown_connections 2022-01-10T01:26:08.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 --2- 172.21.15.36:0/971973552 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f75e8004e70 0x7f75e800b750 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 -- 172.21.15.36:0/971973552 >> 172.21.15.36:0/971973552 conn(0x7f7604060180 msgr2=0x7f76040b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:08.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 -- 172.21.15.36:0/971973552 shutdown_connections 2022-01-10T01:26:08.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 -- 172.21.15.36:0/971973552 wait complete. 2022-01-10T01:26:08.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 Processor -- start 2022-01-10T01:26:08.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 -- start start 2022-01-10T01:26:08.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e8004e70 0x7f760405bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:08.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f760415a050 0x7f760415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:08.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76040a9140 0x7f76040a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:08.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7604065f80 con 0x7f76040a9140 2022-01-10T01:26:08.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76040abaa0 con 0x7f75e8004e70 2022-01-10T01:26:08.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760aef6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76040abd40 con 0x7f760415a050 2022-01-10T01:26:08.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760a6f5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76040a9140 0x7f76040a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:08.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760a6f5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76040a9140 0x7f76040a95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35442/0 (socket says 172.21.15.36:35442) 2022-01-10T01:26:08.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760a6f5700 1 -- 172.21.15.36:0/2364683796 learned_addr learned my addr 172.21.15.36:0/2364683796 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:08.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f7609ef4700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e8004e70 0x7f760405bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:08.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f76096f3700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f760415a050 0x7f760415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:08.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760a6f5700 1 -- 172.21.15.36:0/2364683796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f760415a050 msgr2=0x7f760415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:08.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760a6f5700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f760415a050 0x7f760415a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760a6f5700 1 -- 172.21.15.36:0/2364683796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e8004e70 msgr2=0x7f760405bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:08.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760a6f5700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e8004e70 0x7f760405bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f760a6f5700 1 -- 172.21.15.36:0/2364683796 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76040abfe0 con 0x7f76040a9140 2022-01-10T01:26:08.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.037+0000 7f76096f3700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f760415a050 0x7f760415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:26:08.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.041+0000 7f760a6f5700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76040a9140 0x7f76040a95f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f760000c000 tx=0x7f7600016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:08.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.041+0000 7f75f6ffd700 1 -- 172.21.15.36:0/2364683796 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7600022070 con 0x7f76040a9140 2022-01-10T01:26:08.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.041+0000 7f75f6ffd700 1 -- 172.21.15.36:0/2364683796 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7600000e90 con 0x7f76040a9140 2022-01-10T01:26:08.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.041+0000 7f760aef6700 1 -- 172.21.15.36:0/2364683796 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76040aa350 con 0x7f76040a9140 2022-01-10T01:26:08.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.041+0000 7f75f6ffd700 1 -- 172.21.15.36:0/2364683796 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7600006b20 con 0x7f76040a9140 2022-01-10T01:26:08.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.041+0000 7f760aef6700 1 -- 172.21.15.36:0/2364683796 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760415ab20 con 0x7f76040a9140 2022-01-10T01:26:08.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.041+0000 7f760aef6700 1 -- 172.21.15.36:0/2364683796 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7604057350 con 0x7f76040a9140 2022-01-10T01:26:08.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.041+0000 7f75f6ffd700 1 -- 172.21.15.36:0/2364683796 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f760001d430 con 0x7f76040a9140 2022-01-10T01:26:08.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.041+0000 7f75f6ffd700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f75ec0536b0 0x7f75ec055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:08.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.041+0000 7f75f6ffd700 1 -- 172.21.15.36:0/2364683796 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f760006cff0 con 0x7f76040a9140 2022-01-10T01:26:08.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.041+0000 7f7609ef4700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f75ec0536b0 0x7f75ec055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:08.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.041+0000 7f7609ef4700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f75ec0536b0 0x7f75ec055b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f75f8003000 tx=0x7f75f8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:08.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.049+0000 7f75f6ffd700 1 -- 172.21.15.36:0/2364683796 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7600043e80 con 0x7f76040a9140 2022-01-10T01:26:08.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.217+0000 7f760aef6700 1 -- 172.21.15.36:0/2364683796 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f760415ab20 con 0x7f76040a9140 2022-01-10T01:26:08.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.605+0000 7f75f6ffd700 1 -- 172.21.15.36:0/2364683796 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f760415ab20 con 0x7f76040a9140 2022-01-10T01:26:08.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.609+0000 7f760aef6700 1 -- 172.21.15.36:0/2364683796 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f75ec0536b0 msgr2=0x7f75ec055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:08.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.609+0000 7f760aef6700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f75ec0536b0 0x7f75ec055b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f75f8003000 tx=0x7f75f8009040).stop 2022-01-10T01:26:08.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.609+0000 7f760aef6700 1 -- 172.21.15.36:0/2364683796 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76040a9140 msgr2=0x7f76040a95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:08.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.609+0000 7f760aef6700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76040a9140 0x7f76040a95f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f760000c000 tx=0x7f7600016000).stop 2022-01-10T01:26:08.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.613+0000 7f760aef6700 1 -- 172.21.15.36:0/2364683796 shutdown_connections 2022-01-10T01:26:08.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.613+0000 7f760aef6700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f75ec0536b0 0x7f75ec055b70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.613+0000 7f760aef6700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f76040a9140 0x7f76040a95f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.613+0000 7f760aef6700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f760415a050 0x7f760415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.613+0000 7f760aef6700 1 --2- 172.21.15.36:0/2364683796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75e8004e70 0x7f760405bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.613+0000 7f760aef6700 1 -- 172.21.15.36:0/2364683796 >> 172.21.15.36:0/2364683796 conn(0x7f7604060180 msgr2=0x7f7604149730 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:08.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.613+0000 7f760aef6700 1 -- 172.21.15.36:0/2364683796 shutdown_connections 2022-01-10T01:26:08.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.613+0000 7f760aef6700 1 -- 172.21.15.36:0/2364683796 wait complete. 2022-01-10T01:26:08.631 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:26:08.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.741+0000 7f79af59e700 1 Processor -- start 2022-01-10T01:26:08.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.741+0000 7f79af59e700 1 -- start start 2022-01-10T01:26:08.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.741+0000 7f79af59e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f79b00b30d0 0x7f79b0143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:08.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.741+0000 7f79af59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b00ace70 0x7f79b013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:08.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79af59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79b0143920 con 0x7f79b00b0710 2022-01-10T01:26:08.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79af59e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b00b0af0 con 0x7f79b00b30d0 2022-01-10T01:26:08.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79af59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b00ae680 con 0x7f79b00ace70 2022-01-10T01:26:08.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79a7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f79b00b30d0 0x7f79b0143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:08.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79a7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f79b00b30d0 0x7f79b0143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35452/0 (socket says 172.21.15.36:35452) 2022-01-10T01:26:08.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79a7fff700 1 -- 172.21.15.36:0/2170664047 learned_addr learned my addr 172.21.15.36:0/2170664047 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:08.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79ae59c700 1 --1- 172.21.15.36:0/2170664047 >> v1:172.21.15.59:6789/0 conn(0x7f79b00b0710 0x7f79b0142d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:50920/0 (socket says 172.21.15.36:50920) 2022-01-10T01:26:08.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79aed9d700 1 --2- 172.21.15.36:0/2170664047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b00ace70 0x7f79b013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:08.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79a7fff700 1 -- 172.21.15.36:0/2170664047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b00ace70 msgr2=0x7f79b013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:08.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79a7fff700 1 --2- 172.21.15.36:0/2170664047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b00ace70 0x7f79b013f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79a7fff700 1 -- 172.21.15.36:0/2170664047 >> v1:172.21.15.59:6789/0 conn(0x7f79b00b0710 legacy=0x7f79b0142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:08.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79a7fff700 1 -- 172.21.15.36:0/2170664047 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b00ae920 con 0x7f79b00b30d0 2022-01-10T01:26:08.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79a7fff700 1 --2- 172.21.15.36:0/2170664047 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79b00b30d0 0x7f79b0143430 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f7998002f70 tx=0x7f7998006eb0).ready entity=mon.0 client_cookie=b63e768124b50c6a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:08.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79add9b700 1 -- 172.21.15.36:0/2170664047 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f799800d570 con 0x7f79b00b30d0 2022-01-10T01:26:08.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79add9b700 1 -- 172.21.15.36:0/2170664047 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7998000e90 con 0x7f79b00b30d0 2022-01-10T01:26:08.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79add9b700 1 -- 172.21.15.36:0/2170664047 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f799800d900 con 0x7f79b00b30d0 2022-01-10T01:26:08.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79af59e700 1 -- 172.21.15.36:0/2170664047 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79b00b30d0 msgr2=0x7f79b0143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:08.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79af59e700 1 --2- 172.21.15.36:0/2170664047 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79b00b30d0 0x7f79b0143430 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f7998002f70 tx=0x7f7998006eb0).stop 2022-01-10T01:26:08.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79af59e700 1 -- 172.21.15.36:0/2170664047 shutdown_connections 2022-01-10T01:26:08.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79af59e700 1 --2- 172.21.15.36:0/2170664047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b00ace70 0x7f79b013f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79af59e700 1 --2- 172.21.15.36:0/2170664047 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79b00b30d0 0x7f79b0143430 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79af59e700 1 -- 172.21.15.36:0/2170664047 >> 172.21.15.36:0/2170664047 conn(0x7f79b0061140 msgr2=0x7f79b0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:08.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79af59e700 1 -- 172.21.15.36:0/2170664047 shutdown_connections 2022-01-10T01:26:08.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.745+0000 7f79af59e700 1 -- 172.21.15.36:0/2170664047 wait complete. 2022-01-10T01:26:08.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79af59e700 1 Processor -- start 2022-01-10T01:26:08.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79af59e700 1 -- start start 2022-01-10T01:26:08.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79af59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79b00ace70 0x7f79b00b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:08.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79af59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b00b0710 0x7f79b0067040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:08.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79af59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b00b30d0 0x7f79b0067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:08.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79af59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b00abe00 con 0x7f79b00ace70 2022-01-10T01:26:08.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79af59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b0063d80 con 0x7f79b00b30d0 2022-01-10T01:26:08.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79af59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b0064020 con 0x7f79b00b0710 2022-01-10T01:26:08.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79ae59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79b00ace70 0x7f79b00b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:08.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79ae59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79b00ace70 0x7f79b00b4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35456/0 (socket says 172.21.15.36:35456) 2022-01-10T01:26:08.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79ae59c700 1 -- 172.21.15.36:0/641992828 learned_addr learned my addr 172.21.15.36:0/641992828 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:08.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79aed9d700 1 --2- 172.21.15.36:0/641992828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b00b30d0 0x7f79b0067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:08.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79a7fff700 1 --2- 172.21.15.36:0/641992828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b00b0710 0x7f79b0067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:08.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79ae59c700 1 -- 172.21.15.36:0/641992828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b00b0710 msgr2=0x7f79b0067040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:08.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79ae59c700 1 --2- 172.21.15.36:0/641992828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b00b0710 0x7f79b0067040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79ae59c700 1 -- 172.21.15.36:0/641992828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b00b30d0 msgr2=0x7f79b0067530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:08.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79ae59c700 1 --2- 172.21.15.36:0/641992828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b00b30d0 0x7f79b0067530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:08.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79ae59c700 1 -- 172.21.15.36:0/641992828 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799800b1e0 con 0x7f79b00ace70 2022-01-10T01:26:08.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79ae59c700 1 --2- 172.21.15.36:0/641992828 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79b00ace70 0x7f79b00b4c50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f79b00b6a40 tx=0x7f79a0007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:08.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79a77fe700 1 -- 172.21.15.36:0/641992828 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79a00070d0 con 0x7f79b00ace70 2022-01-10T01:26:08.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79a77fe700 1 -- 172.21.15.36:0/641992828 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a0007230 con 0x7f79b00ace70 2022-01-10T01:26:08.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79af59e700 1 -- 172.21.15.36:0/641992828 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b00642c0 con 0x7f79b00ace70 2022-01-10T01:26:08.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79a77fe700 1 -- 172.21.15.36:0/641992828 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79a0005550 con 0x7f79b00ace70 2022-01-10T01:26:08.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.749+0000 7f79af59e700 1 -- 172.21.15.36:0/641992828 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b00ab740 con 0x7f79b00ace70 2022-01-10T01:26:08.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.753+0000 7f79af59e700 1 -- 172.21.15.36:0/641992828 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b0064450 con 0x7f79b00ace70 2022-01-10T01:26:08.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.753+0000 7f79a77fe700 1 -- 172.21.15.36:0/641992828 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f79a0010070 con 0x7f79b00ace70 2022-01-10T01:26:08.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.753+0000 7f79a77fe700 1 --2- 172.21.15.36:0/641992828 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79940535b0 0x7f7994055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:08.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.753+0000 7f79a77fe700 1 -- 172.21.15.36:0/641992828 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f79a006b0f0 con 0x7f79b00ace70 2022-01-10T01:26:08.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.753+0000 7f79a7fff700 1 --2- 172.21.15.36:0/641992828 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79940535b0 0x7f7994055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:08.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.753+0000 7f79a7fff700 1 --2- 172.21.15.36:0/641992828 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79940535b0 0x7f7994055a70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f799801c000 tx=0x7f7998015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:08.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.761+0000 7f79a77fe700 1 -- 172.21.15.36:0/641992828 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f79a0042050 con 0x7f79b00ace70 2022-01-10T01:26:08.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:08.885+0000 7f79af59e700 1 -- 172.21.15.36:0/641992828 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f79b0057350 con 0x7f79b00ace70 2022-01-10T01:26:09.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.673+0000 7f79a77fe700 1 -- 172.21.15.36:0/641992828 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) v1 ==== 185+0+0 (secure 0 0 0) 0x7f79a0045670 con 0x7f79b00ace70 2022-01-10T01:26:09.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.677+0000 7f79af59e700 1 -- 172.21.15.36:0/641992828 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79940535b0 msgr2=0x7f7994055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:09.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.677+0000 7f79af59e700 1 --2- 172.21.15.36:0/641992828 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79940535b0 0x7f7994055a70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f799801c000 tx=0x7f7998015000).stop 2022-01-10T01:26:09.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.677+0000 7f79af59e700 1 -- 172.21.15.36:0/641992828 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79b00ace70 msgr2=0x7f79b00b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:09.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.677+0000 7f79af59e700 1 --2- 172.21.15.36:0/641992828 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79b00ace70 0x7f79b00b4c50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f79b00b6a40 tx=0x7f79a0007c40).stop 2022-01-10T01:26:09.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.677+0000 7f79af59e700 1 -- 172.21.15.36:0/641992828 shutdown_connections 2022-01-10T01:26:09.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.677+0000 7f79af59e700 1 --2- 172.21.15.36:0/641992828 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79940535b0 0x7f7994055a70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:09.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.677+0000 7f79af59e700 1 --2- 172.21.15.36:0/641992828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b00b30d0 0x7f79b0067530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:09.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.677+0000 7f79af59e700 1 --2- 172.21.15.36:0/641992828 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b00b0710 0x7f79b0067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:09.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.677+0000 7f79af59e700 1 --2- 172.21.15.36:0/641992828 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79b00ace70 0x7f79b00b4c50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:09.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.677+0000 7f79af59e700 1 -- 172.21.15.36:0/641992828 >> 172.21.15.36:0/641992828 conn(0x7f79b0061140 msgr2=0x7f79b0141fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:09.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.677+0000 7f79af59e700 1 -- 172.21.15.36:0/641992828 shutdown_connections 2022-01-10T01:26:09.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.677+0000 7f79af59e700 1 -- 172.21.15.36:0/641992828 wait complete. 2022-01-10T01:26:09.683 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:26:09.695 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2022-01-10T01:26:09.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.805+0000 7f8f22449700 1 Processor -- start 2022-01-10T01:26:09.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.805+0000 7f8f22449700 1 -- start start 2022-01-10T01:26:09.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f22449700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8f1c061320 0x7f8f1c061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:09.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f22449700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f1c0ad5c0 0x7f8f1c0b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:09.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f22449700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f1c140440 0x7f8f1c1408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:09.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f22449700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c0aecf0 con 0x7f8f1c061320 2022-01-10T01:26:09.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f22449700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c0b6f20 con 0x7f8f1c140440 2022-01-10T01:26:09.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f22449700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0aef20 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f21447700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8f1c061320 0x7f8f1c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:09.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f20c46700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f1c0ad5c0 0x7f8f1c0b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:09.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f21447700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8f1c061320 0x7f8f1c061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35468/0 (socket says 172.21.15.36:35468) 2022-01-10T01:26:09.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f21447700 1 -- 172.21.15.36:0/4253855044 learned_addr learned my addr 172.21.15.36:0/4253855044 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:09.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f21c48700 1 --2- 172.21.15.36:0/4253855044 >> v2:172.21.15.59:3300/0 conn(0x7f8f1c140440 0x7f8f1c1408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:09.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f20c46700 1 -- 172.21.15.36:0/4253855044 >> v2:172.21.15.59:3300/0 conn(0x7f8f1c140440 msgr2=0x7f8f1c1408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:09.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f20c46700 1 --2- 172.21.15.36:0/4253855044 >> v2:172.21.15.59:3300/0 conn(0x7f8f1c140440 0x7f8f1c1408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:09.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f20c46700 1 -- 172.21.15.36:0/4253855044 >> v2:172.21.15.36:3300/0 conn(0x7f8f1c061320 msgr2=0x7f8f1c061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:09.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f20c46700 1 --2- 172.21.15.36:0/4253855044 >> v2:172.21.15.36:3300/0 conn(0x7f8f1c061320 0x7f8f1c061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:09.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f20c46700 1 -- 172.21.15.36:0/4253855044 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c0af1c0 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f21447700 1 --2- 172.21.15.36:0/4253855044 >> v2:172.21.15.36:3300/0 conn(0x7f8f1c061320 0x7f8f1c061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:26:09.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.809+0000 7f8f20c46700 1 --2- 172.21.15.36:0/4253855044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f1c0ad5c0 0x7f8f1c0b9e60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8f0c002f70 tx=0x7f8f0c006df0).ready entity=mon.2 client_cookie=9d62d1b98fe53ac0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:09.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.813+0000 7f8f13fff700 1 -- 172.21.15.36:0/4253855044 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0c00d570 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.813+0000 7f8f13fff700 1 -- 172.21.15.36:0/4253855044 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c000e90 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.813+0000 7f8f13fff700 1 -- 172.21.15.36:0/4253855044 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0c00d8c0 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.813+0000 7f8f22449700 1 -- 172.21.15.36:0/4253855044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f1c0ad5c0 msgr2=0x7f8f1c0b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:09.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.813+0000 7f8f22449700 1 --2- 172.21.15.36:0/4253855044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f1c0ad5c0 0x7f8f1c0b9e60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f8f0c002f70 tx=0x7f8f0c006df0).stop 2022-01-10T01:26:09.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.813+0000 7f8f22449700 1 -- 172.21.15.36:0/4253855044 shutdown_connections 2022-01-10T01:26:09.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.813+0000 7f8f22449700 1 --2- 172.21.15.36:0/4253855044 >> v2:172.21.15.59:3300/0 conn(0x7f8f1c140440 0x7f8f1c1408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:09.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.813+0000 7f8f22449700 1 --2- 172.21.15.36:0/4253855044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f1c0ad5c0 0x7f8f1c0b9e60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:09.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.813+0000 7f8f22449700 1 --2- 172.21.15.36:0/4253855044 >> v2:172.21.15.36:3300/0 conn(0x7f8f1c061320 0x7f8f1c061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:09.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.813+0000 7f8f22449700 1 -- 172.21.15.36:0/4253855044 >> 172.21.15.36:0/4253855044 conn(0x7f8f1c066de0 msgr2=0x7f8f1c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:09.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.813+0000 7f8f22449700 1 -- 172.21.15.36:0/4253855044 shutdown_connections 2022-01-10T01:26:09.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f22449700 1 -- 172.21.15.36:0/4253855044 wait complete. 2022-01-10T01:26:09.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f22449700 1 Processor -- start 2022-01-10T01:26:09.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f22449700 1 -- start start 2022-01-10T01:26:09.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f22449700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f1c061320 0x7f8f1c0b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:09.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f22449700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8f1c0ad5c0 0x7f8f1c0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:09.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f22449700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f1c140440 0x7f8f1c155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:09.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f22449700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0b1230 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f22449700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0b20c0 con 0x7f8f1c140440 2022-01-10T01:26:09.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f22449700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0b0cf0 con 0x7f8f1c061320 2022-01-10T01:26:09.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f20c46700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8f1c0ad5c0 0x7f8f1c0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:09.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f20c46700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8f1c0ad5c0 0x7f8f1c0b2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35472/0 (socket says 172.21.15.36:35472) 2022-01-10T01:26:09.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f20c46700 1 -- 172.21.15.36:0/6232205 learned_addr learned my addr 172.21.15.36:0/6232205 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:09.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f21447700 1 --2- 172.21.15.36:0/6232205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f1c061320 0x7f8f1c0b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:09.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f20c46700 1 -- 172.21.15.36:0/6232205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f1c061320 msgr2=0x7f8f1c0b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:09.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f20c46700 1 --2- 172.21.15.36:0/6232205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f1c061320 0x7f8f1c0b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:09.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f20c46700 1 -- 172.21.15.36:0/6232205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f1c140440 msgr2=0x7f8f1c155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:09.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f20c46700 1 --2- 172.21.15.36:0/6232205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f1c140440 0x7f8f1c155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-01-10T01:26:09.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f20c46700 1 -- 172.21.15.36:0/6232205 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1800b1e0 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f20c46700 1 --2- 172.21.15.36:0/6232205 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8f1c0ad5c0 0x7f8f1c0b2520 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f8f0c002f70 tx=0x7f8f0c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:09.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f127fc700 1 -- 172.21.15.36:0/6232205 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0c00dea0 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f127fc700 1 -- 172.21.15.36:0/6232205 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c01e400 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f22449700 1 -- 172.21.15.36:0/6232205 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c00b180 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f127fc700 1 -- 172.21.15.36:0/6232205 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f0c01e760 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.817+0000 7f8f22449700 1 -- 172.21.15.36:0/6232205 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1c0b3d80 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.821+0000 7f8f22449700 1 -- 172.21.15.36:0/6232205 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1c0af460 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.821+0000 7f8f127fc700 1 -- 172.21.15.36:0/6232205 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8f0c01c070 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.821+0000 7f8f127fc700 1 --2- 172.21.15.36:0/6232205 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f04053560 0x7f8f04055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:09.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.821+0000 7f8f127fc700 1 -- 172.21.15.36:0/6232205 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f8f0c06c470 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.821+0000 7f8f21447700 1 --2- 172.21.15.36:0/6232205 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f04053560 0x7f8f04055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:09.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.821+0000 7f8f21447700 1 --2- 172.21.15.36:0/6232205 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f04053560 0x7f8f04055a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f8f1800b000 tx=0x7f8f18006eb0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:09.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.825+0000 7f8f127fc700 1 -- 172.21.15.36:0/6232205 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8f0c043540 con 0x7f8f1c0ad5c0 2022-01-10T01:26:09.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:09.949+0000 7f8f22449700 1 -- 172.21.15.36:0/6232205 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8f1c057350 con 0x7f8f1c0ad5c0 2022-01-10T01:26:10.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.681+0000 7f8f127fc700 1 -- 172.21.15.36:0/6232205 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) v1 ==== 173+0+0 (secure 0 0 0) 0x7f8f0c023020 con 0x7f8f1c0ad5c0 2022-01-10T01:26:10.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.685+0000 7f8f22449700 1 -- 172.21.15.36:0/6232205 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f04053560 msgr2=0x7f8f04055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:10.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.685+0000 7f8f22449700 1 --2- 172.21.15.36:0/6232205 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f04053560 0x7f8f04055a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f8f1800b000 tx=0x7f8f18006eb0).stop 2022-01-10T01:26:10.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.685+0000 7f8f22449700 1 -- 172.21.15.36:0/6232205 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8f1c0ad5c0 msgr2=0x7f8f1c0b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:10.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.685+0000 7f8f22449700 1 --2- 172.21.15.36:0/6232205 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8f1c0ad5c0 0x7f8f1c0b2520 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f8f0c002f70 tx=0x7f8f0c014000).stop 2022-01-10T01:26:10.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.685+0000 7f8f22449700 1 -- 172.21.15.36:0/6232205 shutdown_connections 2022-01-10T01:26:10.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.685+0000 7f8f22449700 1 --2- 172.21.15.36:0/6232205 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f04053560 0x7f8f04055a20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:10.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.685+0000 7f8f22449700 1 --2- 172.21.15.36:0/6232205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f1c140440 0x7f8f1c155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-01-10T01:26:10.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.685+0000 7f8f22449700 1 --2- 172.21.15.36:0/6232205 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8f1c0ad5c0 0x7f8f1c0b2520 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:10.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.685+0000 7f8f22449700 1 --2- 172.21.15.36:0/6232205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f1c061320 0x7f8f1c0b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:10.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.685+0000 7f8f22449700 1 -- 172.21.15.36:0/6232205 >> 172.21.15.36:0/6232205 conn(0x7f8f1c066de0 msgr2=0x7f8f1c141ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:10.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.689+0000 7f8f22449700 1 -- 172.21.15.36:0/6232205 shutdown_connections 2022-01-10T01:26:10.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.689+0000 7f8f22449700 1 -- 172.21.15.36:0/6232205 wait complete. 2022-01-10T01:26:10.696 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' removed 2022-01-10T01:26:10.706 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2022-01-10T01:26:10.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.801+0000 7f217f59e700 1 Processor -- start 2022-01-10T01:26:10.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.801+0000 7f217f59e700 1 -- start start 2022-01-10T01:26:10.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217f59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f218013c6e0 0x7f218013cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:10.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21800acf20 0x7f21800ad390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:10.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217f59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21800b2c30 con 0x7f21800b2850 2022-01-10T01:26:10.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217f59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21800b11b0 con 0x7f218013c6e0 2022-01-10T01:26:10.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21800b1660 con 0x7f21800acf20 2022-01-10T01:26:10.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21800acf20 0x7f21800ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:10.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217dd9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f218013c6e0 0x7f218013cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:10.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217ed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21800acf20 0x7f21800ad390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:41764/0 (socket says 172.21.15.36:41764) 2022-01-10T01:26:10.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217ed9d700 1 -- 172.21.15.36:0/1601921345 learned_addr learned my addr 172.21.15.36:0/1601921345 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:10.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217e59c700 1 --1- 172.21.15.36:0/1601921345 >> v1:172.21.15.59:6789/0 conn(0x7f21800b2850 0x7f21800b0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:50948/0 (socket says 172.21.15.36:50948) 2022-01-10T01:26:10.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217ed9d700 1 -- 172.21.15.36:0/1601921345 >> v2:172.21.15.59:3300/0 conn(0x7f218013c6e0 msgr2=0x7f218013cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:10.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217ed9d700 1 --2- 172.21.15.36:0/1601921345 >> v2:172.21.15.59:3300/0 conn(0x7f218013c6e0 0x7f218013cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:10.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217ed9d700 1 -- 172.21.15.36:0/1601921345 >> v1:172.21.15.59:6789/0 conn(0x7f21800b2850 legacy=0x7f21800b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:10.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217d59a700 1 -- 172.21.15.36:0/1601921345 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753120800 0 0) 0x7f21800b2c30 con 0x7f21800b2850 2022-01-10T01:26:10.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217ed9d700 1 -- 172.21.15.36:0/1601921345 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21800b1900 con 0x7f21800acf20 2022-01-10T01:26:10.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217dd9b700 1 --2- 172.21.15.36:0/1601921345 >> v2:172.21.15.59:3300/0 conn(0x7f218013c6e0 0x7f218013cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:26:10.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217ed9d700 1 --2- 172.21.15.36:0/1601921345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21800acf20 0x7f21800ad390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f21780032f0 tx=0x7f2178009290).ready entity=mon.2 client_cookie=c07db127f5ffc1da server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:10.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217d59a700 1 -- 172.21.15.36:0/1601921345 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f217800b8a0 con 0x7f21800acf20 2022-01-10T01:26:10.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217d59a700 1 -- 172.21.15.36:0/1601921345 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f217800ba00 con 0x7f21800acf20 2022-01-10T01:26:10.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217d59a700 1 -- 172.21.15.36:0/1601921345 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f217800bb70 con 0x7f21800acf20 2022-01-10T01:26:10.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217f59e700 1 -- 172.21.15.36:0/1601921345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21800acf20 msgr2=0x7f21800ad390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:10.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217f59e700 1 --2- 172.21.15.36:0/1601921345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21800acf20 0x7f21800ad390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f21780032f0 tx=0x7f2178009290).stop 2022-01-10T01:26:10.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217f59e700 1 -- 172.21.15.36:0/1601921345 shutdown_connections 2022-01-10T01:26:10.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217f59e700 1 --2- 172.21.15.36:0/1601921345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21800acf20 0x7f21800ad390 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:10.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217f59e700 1 --2- 172.21.15.36:0/1601921345 >> v2:172.21.15.59:3300/0 conn(0x7f218013c6e0 0x7f218013cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:10.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217f59e700 1 -- 172.21.15.36:0/1601921345 >> 172.21.15.36:0/1601921345 conn(0x7f2180061230 msgr2=0x7f2180062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:10.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217f59e700 1 -- 172.21.15.36:0/1601921345 shutdown_connections 2022-01-10T01:26:10.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.805+0000 7f217f59e700 1 -- 172.21.15.36:0/1601921345 wait complete. 2022-01-10T01:26:10.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217f59e700 1 Processor -- start 2022-01-10T01:26:10.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217f59e700 1 -- start start 2022-01-10T01:26:10.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217f59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f21800acf20 0x7f2180063e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:10.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21800b2850 0x7f21801351e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:10.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f218013c6e0 0x7f21800669e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:10.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217f59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2180065120 con 0x7f21800acf20 2022-01-10T01:26:10.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217f59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21800b5070 con 0x7f218013c6e0 2022-01-10T01:26:10.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21800b52a0 con 0x7f21800b2850 2022-01-10T01:26:10.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f21800acf20 0x7f2180063e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:10.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f21800acf20 0x7f2180063e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35484/0 (socket says 172.21.15.36:35484) 2022-01-10T01:26:10.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217e59c700 1 -- 172.21.15.36:0/1994872142 learned_addr learned my addr 172.21.15.36:0/1994872142 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:10.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217dd9b700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21800b2850 0x7f21801351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:10.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217ed9d700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f218013c6e0 0x7f21800669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:10.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217e59c700 1 -- 172.21.15.36:0/1994872142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21800b2850 msgr2=0x7f21801351e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:10.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217e59c700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21800b2850 0x7f21801351e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:10.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217e59c700 1 -- 172.21.15.36:0/1994872142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f218013c6e0 msgr2=0x7f21800669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:10.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217e59c700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f218013c6e0 0x7f21800669e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:10.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217e59c700 1 -- 172.21.15.36:0/1994872142 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216800b180 con 0x7f21800acf20 2022-01-10T01:26:10.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217ed9d700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f218013c6e0 0x7f21800669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:10.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217e59c700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f21800acf20 0x7f2180063e40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f2170000ed0 tx=0x7f2170007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:10.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f21777fe700 1 -- 172.21.15.36:0/1994872142 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2170007170 con 0x7f21800acf20 2022-01-10T01:26:10.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f21777fe700 1 -- 172.21.15.36:0/1994872142 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21700072d0 con 0x7f21800acf20 2022-01-10T01:26:10.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217f59e700 1 -- 172.21.15.36:0/1994872142 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2178009530 con 0x7f21800acf20 2022-01-10T01:26:10.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f21777fe700 1 -- 172.21.15.36:0/1994872142 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2170004710 con 0x7f21800acf20 2022-01-10T01:26:10.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.809+0000 7f217f59e700 1 -- 172.21.15.36:0/1994872142 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2180065350 con 0x7f21800acf20 2022-01-10T01:26:10.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.813+0000 7f217f59e700 1 -- 172.21.15.36:0/1994872142 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2180057350 con 0x7f21800acf20 2022-01-10T01:26:10.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.813+0000 7f21777fe700 1 -- 172.21.15.36:0/1994872142 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2170004870 con 0x7f21800acf20 2022-01-10T01:26:10.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.813+0000 7f21777fe700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2164053560 0x7f2164055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:10.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.813+0000 7f21777fe700 1 -- 172.21.15.36:0/1994872142 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f217006b110 con 0x7f21800acf20 2022-01-10T01:26:10.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.813+0000 7f217dd9b700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2164053560 0x7f2164055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:10.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.817+0000 7f217dd9b700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2164053560 0x7f2164055a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f216800b000 tx=0x7f2168006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:10.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.821+0000 7f21777fe700 1 -- 172.21.15.36:0/1994872142 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f21700423a0 con 0x7f21800acf20 2022-01-10T01:26:10.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.949+0000 7f217f59e700 1 -- 172.21.15.36:0/1994872142 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f218005f240 con 0x7f21800acf20 2022-01-10T01:26:10.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.953+0000 7f21777fe700 1 -- 172.21.15.36:0/1994872142 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f21700459c0 con 0x7f21800acf20 2022-01-10T01:26:10.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.957+0000 7f217f59e700 1 -- 172.21.15.36:0/1994872142 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2164053560 msgr2=0x7f2164055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:10.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.957+0000 7f217f59e700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2164053560 0x7f2164055a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f216800b000 tx=0x7f2168006df0).stop 2022-01-10T01:26:10.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.957+0000 7f217f59e700 1 -- 172.21.15.36:0/1994872142 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f21800acf20 msgr2=0x7f2180063e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:10.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.957+0000 7f217f59e700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f21800acf20 0x7f2180063e40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f2170000ed0 tx=0x7f2170007ab0).stop 2022-01-10T01:26:10.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.957+0000 7f217f59e700 1 -- 172.21.15.36:0/1994872142 shutdown_connections 2022-01-10T01:26:10.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.957+0000 7f217f59e700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2164053560 0x7f2164055a20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:10.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.957+0000 7f217f59e700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f218013c6e0 0x7f21800669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:10.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.957+0000 7f217f59e700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21800b2850 0x7f21801351e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:10.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.957+0000 7f217f59e700 1 --2- 172.21.15.36:0/1994872142 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f21800acf20 0x7f2180063e40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:10.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.957+0000 7f217f59e700 1 -- 172.21.15.36:0/1994872142 >> 172.21.15.36:0/1994872142 conn(0x7f2180061230 msgr2=0x7f2180138cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:10.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.957+0000 7f217f59e700 1 -- 172.21.15.36:0/1994872142 shutdown_connections 2022-01-10T01:26:10.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:10.957+0000 7f217f59e700 1 -- 172.21.15.36:0/1994872142 wait complete. 2022-01-10T01:26:10.972 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2022-01-10T01:26:11.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.065+0000 7f663f97b700 1 Processor -- start 2022-01-10T01:26:11.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.065+0000 7f663f97b700 1 -- start start 2022-01-10T01:26:11.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663f97b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66380b96e0 0x7f66380aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:11.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663f97b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f663813fff0 0x7f6638140480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:11.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663f97b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6638067500 con 0x7f6638067120 2022-01-10T01:26:11.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663f97b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6638143080 con 0x7f663813fff0 2022-01-10T01:26:11.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663f97b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66380af4d0 con 0x7f66380b96e0 2022-01-10T01:26:11.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663cf16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66380b96e0 0x7f66380aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:11.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663df18700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f663813fff0 0x7f6638140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:11.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663df18700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f663813fff0 0x7f6638140480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:60362/0 (socket says 172.21.15.36:60362) 2022-01-10T01:26:11.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663df18700 1 -- 172.21.15.36:0/2118291720 learned_addr learned my addr 172.21.15.36:0/2118291720 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:11.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663d717700 1 --1- 172.21.15.36:0/2118291720 >> v1:172.21.15.59:6789/0 conn(0x7f6638067120 0x7f66381439b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:50964/0 (socket says 172.21.15.36:50964) 2022-01-10T01:26:11.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663cf16700 1 -- 172.21.15.36:0/2118291720 >> v2:172.21.15.59:3300/0 conn(0x7f663813fff0 msgr2=0x7f6638140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:11.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663cf16700 1 --2- 172.21.15.36:0/2118291720 >> v2:172.21.15.59:3300/0 conn(0x7f663813fff0 0x7f6638140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:11.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663cf16700 1 -- 172.21.15.36:0/2118291720 >> v1:172.21.15.59:6789/0 conn(0x7f6638067120 legacy=0x7f66381439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:11.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663cf16700 1 -- 172.21.15.36:0/2118291720 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638143270 con 0x7f66380b96e0 2022-01-10T01:26:11.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663cf16700 1 --2- 172.21.15.36:0/2118291720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66380b96e0 0x7f66380aec00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f66340032f0 tx=0x7f66340091d0).ready entity=mon.2 client_cookie=8f2716bbe1f124ba server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:11.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f662ffff700 1 -- 172.21.15.36:0/2118291720 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f663400b6c0 con 0x7f66380b96e0 2022-01-10T01:26:11.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f662ffff700 1 -- 172.21.15.36:0/2118291720 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663400b820 con 0x7f66380b96e0 2022-01-10T01:26:11.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f662ffff700 1 -- 172.21.15.36:0/2118291720 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f663400b990 con 0x7f66380b96e0 2022-01-10T01:26:11.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663f97b700 1 -- 172.21.15.36:0/2118291720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66380b96e0 msgr2=0x7f66380aec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:11.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663f97b700 1 --2- 172.21.15.36:0/2118291720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66380b96e0 0x7f66380aec00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f66340032f0 tx=0x7f66340091d0).stop 2022-01-10T01:26:11.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663f97b700 1 -- 172.21.15.36:0/2118291720 shutdown_connections 2022-01-10T01:26:11.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663f97b700 1 --2- 172.21.15.36:0/2118291720 >> v2:172.21.15.59:3300/0 conn(0x7f663813fff0 0x7f6638140480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:11.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663f97b700 1 --2- 172.21.15.36:0/2118291720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66380b96e0 0x7f66380aec00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:11.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663f97b700 1 -- 172.21.15.36:0/2118291720 >> 172.21.15.36:0/2118291720 conn(0x7f663805f9f0 msgr2=0x7f66380616a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:11.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663f97b700 1 -- 172.21.15.36:0/2118291720 shutdown_connections 2022-01-10T01:26:11.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.069+0000 7f663f97b700 1 -- 172.21.15.36:0/2118291720 wait complete. 2022-01-10T01:26:11.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663f97b700 1 Processor -- start 2022-01-10T01:26:11.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663f97b700 1 -- start start 2022-01-10T01:26:11.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663f97b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6638067120 0x7f66380b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:11.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663f97b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66380b96e0 0x7f66381528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:11.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663f97b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663813fff0 0x7f6638152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:11.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663f97b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6638144400 con 0x7f6638067120 2022-01-10T01:26:11.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663f97b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66380b2240 con 0x7f663813fff0 2022-01-10T01:26:11.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663f97b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66380b24e0 con 0x7f66380b96e0 2022-01-10T01:26:11.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663d717700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6638067120 0x7f66380b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:11.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663cf16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66380b96e0 0x7f66381528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:11.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663df18700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663813fff0 0x7f6638152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:11.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663cf16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66380b96e0 0x7f66381528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:41784/0 (socket says 172.21.15.36:41784) 2022-01-10T01:26:11.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663cf16700 1 -- 172.21.15.36:0/605617385 learned_addr learned my addr 172.21.15.36:0/605617385 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:11.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663d717700 1 -- 172.21.15.36:0/605617385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66380b96e0 msgr2=0x7f66381528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:11.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663d717700 1 --2- 172.21.15.36:0/605617385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66380b96e0 0x7f66381528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:11.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663d717700 1 -- 172.21.15.36:0/605617385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663813fff0 msgr2=0x7f6638152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:11.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663d717700 1 --2- 172.21.15.36:0/605617385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663813fff0 0x7f6638152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:11.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663d717700 1 -- 172.21.15.36:0/605617385 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634009470 con 0x7f6638067120 2022-01-10T01:26:11.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663cf16700 1 --2- 172.21.15.36:0/605617385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66380b96e0 0x7f66381528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:26:11.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663df18700 1 --2- 172.21.15.36:0/605617385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663813fff0 0x7f6638152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:26:11.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663d717700 1 --2- 172.21.15.36:0/605617385 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6638067120 0x7f66380b4f30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f66380b0b40 tx=0x7f6628007b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:11.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f662e7fc700 1 -- 172.21.15.36:0/605617385 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f66280070d0 con 0x7f6638067120 2022-01-10T01:26:11.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f662e7fc700 1 -- 172.21.15.36:0/605617385 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6628007230 con 0x7f6638067120 2022-01-10T01:26:11.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f663f97b700 1 -- 172.21.15.36:0/605617385 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66380b2780 con 0x7f6638067120 2022-01-10T01:26:11.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.073+0000 7f662e7fc700 1 -- 172.21.15.36:0/605617385 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6628005740 con 0x7f6638067120 2022-01-10T01:26:11.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.077+0000 7f663f97b700 1 -- 172.21.15.36:0/605617385 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66381532d0 con 0x7f6638067120 2022-01-10T01:26:11.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.077+0000 7f663f97b700 1 -- 172.21.15.36:0/605617385 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66380b1fb0 con 0x7f6638067120 2022-01-10T01:26:11.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.077+0000 7f662e7fc700 1 -- 172.21.15.36:0/605617385 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6628010070 con 0x7f6638067120 2022-01-10T01:26:11.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.077+0000 7f662e7fc700 1 --2- 172.21.15.36:0/605617385 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f66180535f0 0x7f6618055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:11.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.077+0000 7f662e7fc700 1 -- 172.21.15.36:0/605617385 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f662806ad10 con 0x7f6638067120 2022-01-10T01:26:11.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.077+0000 7f663cf16700 1 --2- 172.21.15.36:0/605617385 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f66180535f0 0x7f6618055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:11.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.077+0000 7f663cf16700 1 --2- 172.21.15.36:0/605617385 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f66180535f0 0x7f6618055ab0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f663401b000 tx=0x7f6634016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:11.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.085+0000 7f662e7fc700 1 -- 172.21.15.36:0/605617385 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6628070020 con 0x7f6638067120 2022-01-10T01:26:11.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.257+0000 7f663f97b700 1 -- 172.21.15.36:0/605617385 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f6638143510 con 0x7f6638067120 2022-01-10T01:26:11.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.685+0000 7f662e7fc700 1 -- 172.21.15.36:0/605617385 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v97) v1 ==== 139+0+0 (secure 0 0 0) 0x7f6628041ef0 con 0x7f6638067120 2022-01-10T01:26:11.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.689+0000 7f663f97b700 1 -- 172.21.15.36:0/605617385 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f66180535f0 msgr2=0x7f6618055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:11.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.689+0000 7f663f97b700 1 --2- 172.21.15.36:0/605617385 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f66180535f0 0x7f6618055ab0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f663401b000 tx=0x7f6634016000).stop 2022-01-10T01:26:11.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.689+0000 7f663f97b700 1 -- 172.21.15.36:0/605617385 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6638067120 msgr2=0x7f66380b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:11.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.689+0000 7f663f97b700 1 --2- 172.21.15.36:0/605617385 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6638067120 0x7f66380b4f30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f66380b0b40 tx=0x7f6628007b40).stop 2022-01-10T01:26:11.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.689+0000 7f663f97b700 1 -- 172.21.15.36:0/605617385 shutdown_connections 2022-01-10T01:26:11.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.689+0000 7f663f97b700 1 --2- 172.21.15.36:0/605617385 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f66180535f0 0x7f6618055ab0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:11.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.689+0000 7f663f97b700 1 --2- 172.21.15.36:0/605617385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f663813fff0 0x7f6638152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:11.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.689+0000 7f663f97b700 1 --2- 172.21.15.36:0/605617385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66380b96e0 0x7f66381528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:11.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.689+0000 7f663f97b700 1 --2- 172.21.15.36:0/605617385 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6638067120 0x7f66380b4f30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:11.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.689+0000 7f663f97b700 1 -- 172.21.15.36:0/605617385 >> 172.21.15.36:0/605617385 conn(0x7f663805f9f0 msgr2=0x7f663813e070 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:11.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.689+0000 7f663f97b700 1 -- 172.21.15.36:0/605617385 shutdown_connections 2022-01-10T01:26:11.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.689+0000 7f663f97b700 1 -- 172.21.15.36:0/605617385 wait complete. 2022-01-10T01:26:11.707 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2022-01-10T01:26:11.707 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) 2022-01-10T01:26:11.708 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2022-01-10T01:26:11.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.809+0000 7f1bdb35a700 1 Processor -- start 2022-01-10T01:26:11.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bdb35a700 1 -- start start 2022-01-10T01:26:11.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bdb35a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd40b0010 0x7f1bd40a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:11.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bdb35a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd40a70c0 con 0x7f1bd40b2580 2022-01-10T01:26:11.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bdb35a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd40a72f0 con 0x7f1bd40afbd0 2022-01-10T01:26:11.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bdb35a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40a7590 con 0x7f1bd40b0010 2022-01-10T01:26:11.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bda358700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f1bd40b2580 0x7f1bd414ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33300/0 (socket says 172.21.15.36:33300) 2022-01-10T01:26:11.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bda358700 1 -- 172.21.15.36:0/1856223362 learned_addr learned my addr 172.21.15.36:0/1856223362 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:11.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bd9b57700 1 --2- 172.21.15.36:0/1856223362 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd40b0010 0x7f1bd40a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:11.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bd9356700 1 -- 172.21.15.36:0/1856223362 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017730942 0 0) 0x7f1bd40a70c0 con 0x7f1bd40b2580 2022-01-10T01:26:11.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bd9356700 1 -- 172.21.15.36:0/1856223362 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bbc003260 con 0x7f1bd40b2580 2022-01-10T01:26:11.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bd9356700 1 -- 172.21.15.36:0/1856223362 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463927462 0 0) 0x7f1bd40a72f0 con 0x7f1bd40afbd0 2022-01-10T01:26:11.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bd9356700 1 -- 172.21.15.36:0/1856223362 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bd40a70c0 con 0x7f1bd40afbd0 2022-01-10T01:26:11.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bd9b57700 1 -- 172.21.15.36:0/1856223362 >> v1:172.21.15.59:6789/0 conn(0x7f1bd40afbd0 legacy=0x7f1bd4151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:11.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bd9b57700 1 -- 172.21.15.36:0/1856223362 >> v1:172.21.15.36:6789/0 conn(0x7f1bd40b2580 legacy=0x7f1bd414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:11.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bd9356700 1 -- 172.21.15.36:0/1856223362 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3719597912 0 0) 0x7f1bbc003260 con 0x7f1bd40b2580 2022-01-10T01:26:11.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bd9b57700 1 -- 172.21.15.36:0/1856223362 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd40a7830 con 0x7f1bd40b0010 2022-01-10T01:26:11.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bd9b57700 1 --2- 172.21.15.36:0/1856223362 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd40b0010 0x7f1bd40a83b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1bc4001110 tx=0x7f1bd0006df0).ready entity=mon.2 client_cookie=73bed6059cb06d0f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:11.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bd9356700 1 -- 172.21.15.36:0/1856223362 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bc4001660 con 0x7f1bd40b0010 2022-01-10T01:26:11.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bd9356700 1 -- 172.21.15.36:0/1856223362 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd0000e90 con 0x7f1bd40b0010 2022-01-10T01:26:11.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bd9356700 1 -- 172.21.15.36:0/1856223362 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bd0012460 con 0x7f1bd40b0010 2022-01-10T01:26:11.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1856223362 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd40b0010 msgr2=0x7f1bd40a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:11.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bdb35a700 1 --2- 172.21.15.36:0/1856223362 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd40b0010 0x7f1bd40a83b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1bc4001110 tx=0x7f1bd0006df0).stop 2022-01-10T01:26:11.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1856223362 shutdown_connections 2022-01-10T01:26:11.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bdb35a700 1 --2- 172.21.15.36:0/1856223362 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd40b0010 0x7f1bd40a83b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:11.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1856223362 >> 172.21.15.36:0/1856223362 conn(0x7f1bd4060180 msgr2=0x7f1bd40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:11.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1856223362 shutdown_connections 2022-01-10T01:26:11.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.813+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1856223362 wait complete. 2022-01-10T01:26:11.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bdb35a700 1 Processor -- start 2022-01-10T01:26:11.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bdb35a700 1 -- start start 2022-01-10T01:26:11.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bdb35a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1bd40afbd0 0x7f1bd40b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:11.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bdb35a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd40b0010 0x7f1bd40b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:11.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bdb35a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bd40b2580 0x7f1bd40b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:11.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bdb35a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40a9810 con 0x7f1bd40afbd0 2022-01-10T01:26:11.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bdb35a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40aa7f0 con 0x7f1bd40b2580 2022-01-10T01:26:11.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bdb35a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40b4780 con 0x7f1bd40b0010 2022-01-10T01:26:11.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bda358700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1bd40afbd0 0x7f1bd40b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:11.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bda358700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1bd40afbd0 0x7f1bd40b4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35516/0 (socket says 172.21.15.36:35516) 2022-01-10T01:26:11.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bdab59700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bd40b2580 0x7f1bd40b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:11.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bda358700 1 -- 172.21.15.36:0/1571810258 learned_addr learned my addr 172.21.15.36:0/1571810258 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:11.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bd9b57700 1 --2- 172.21.15.36:0/1571810258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd40b0010 0x7f1bd40b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:11.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bda358700 1 -- 172.21.15.36:0/1571810258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd40b0010 msgr2=0x7f1bd40b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:11.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bda358700 1 --2- 172.21.15.36:0/1571810258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd40b0010 0x7f1bd40b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:11.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bda358700 1 -- 172.21.15.36:0/1571810258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bd40b2580 msgr2=0x7f1bd40b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:11.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bda358700 1 --2- 172.21.15.36:0/1571810258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bd40b2580 0x7f1bd40b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:11.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bda358700 1 -- 172.21.15.36:0/1571810258 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd000b180 con 0x7f1bd40afbd0 2022-01-10T01:26:11.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bdab59700 1 --2- 172.21.15.36:0/1571810258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bd40b2580 0x7f1bd40b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:26:11.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.817+0000 7f1bda358700 1 --2- 172.21.15.36:0/1571810258 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1bd40afbd0 0x7f1bd40b4140 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f1bc4001840 tx=0x7f1bc4001720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:11.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.821+0000 7f1bc37fe700 1 -- 172.21.15.36:0/1571810258 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bc4007170 con 0x7f1bd40afbd0 2022-01-10T01:26:11.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.821+0000 7f1bc37fe700 1 -- 172.21.15.36:0/1571810258 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc40072d0 con 0x7f1bd40afbd0 2022-01-10T01:26:11.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.821+0000 7f1bc37fe700 1 -- 172.21.15.36:0/1571810258 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1bc4004710 con 0x7f1bd40afbd0 2022-01-10T01:26:11.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.821+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1571810258 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd40a9a40 con 0x7f1bd40afbd0 2022-01-10T01:26:11.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.821+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1571810258 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd40a94d0 con 0x7f1bd40afbd0 2022-01-10T01:26:11.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.821+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1571810258 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd4057350 con 0x7f1bd40afbd0 2022-01-10T01:26:11.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.821+0000 7f1bc37fe700 1 -- 172.21.15.36:0/1571810258 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1bc401b070 con 0x7f1bd40afbd0 2022-01-10T01:26:11.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.821+0000 7f1bc37fe700 1 --2- 172.21.15.36:0/1571810258 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1bb4053500 0x7f1bb40559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:11.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.821+0000 7f1bc37fe700 1 -- 172.21.15.36:0/1571810258 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f1bc406aea0 con 0x7f1bd40afbd0 2022-01-10T01:26:11.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.821+0000 7f1bd9b57700 1 --2- 172.21.15.36:0/1571810258 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1bb4053500 0x7f1bb40559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:11.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.825+0000 7f1bd9b57700 1 --2- 172.21.15.36:0/1571810258 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1bb4053500 0x7f1bb40559c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f1bd001a000 tx=0x7f1bd0014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:11.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.829+0000 7f1bc37fe700 1 -- 172.21.15.36:0/1571810258 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1bc4042080 con 0x7f1bd40afbd0 2022-01-10T01:26:11.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:11.993+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1571810258 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f1bd40698e0 con 0x7f1bd40afbd0 2022-01-10T01:26:12.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.697+0000 7f1bc37fe700 1 -- 172.21.15.36:0/1571810258 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v98) v1 ==== 147+0+0 (secure 0 0 0) 0x7f1bc40456a0 con 0x7f1bd40afbd0 2022-01-10T01:26:12.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.697+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1571810258 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1bb4053500 msgr2=0x7f1bb40559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:12.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.697+0000 7f1bdb35a700 1 --2- 172.21.15.36:0/1571810258 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1bb4053500 0x7f1bb40559c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f1bd001a000 tx=0x7f1bd0014000).stop 2022-01-10T01:26:12.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.697+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1571810258 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1bd40afbd0 msgr2=0x7f1bd40b4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:12.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.697+0000 7f1bdb35a700 1 --2- 172.21.15.36:0/1571810258 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1bd40afbd0 0x7f1bd40b4140 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f1bc4001840 tx=0x7f1bc4001720).stop 2022-01-10T01:26:12.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.697+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1571810258 shutdown_connections 2022-01-10T01:26:12.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.697+0000 7f1bdb35a700 1 --2- 172.21.15.36:0/1571810258 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1bb4053500 0x7f1bb40559c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:12.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.697+0000 7f1bdb35a700 1 --2- 172.21.15.36:0/1571810258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bd40b2580 0x7f1bd40b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:12.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.697+0000 7f1bdb35a700 1 --2- 172.21.15.36:0/1571810258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1bd40b0010 0x7f1bd40b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:12.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.697+0000 7f1bdb35a700 1 --2- 172.21.15.36:0/1571810258 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1bd40afbd0 0x7f1bd40b4140 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:12.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.697+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1571810258 >> 172.21.15.36:0/1571810258 conn(0x7f1bd4060180 msgr2=0x7f1bd41498a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:12.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.697+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1571810258 shutdown_connections 2022-01-10T01:26:12.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.697+0000 7f1bdb35a700 1 -- 172.21.15.36:0/1571810258 wait complete. 2022-01-10T01:26:12.717 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2022-01-10T01:26:12.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0686102700 1 Processor -- start 2022-01-10T01:26:12.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0686102700 1 -- start start 2022-01-10T01:26:12.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0686102700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06800b4710 0x7f068013fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:12.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0686102700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06801439a0 0x7f0680140290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:12.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0686102700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06800b6910 con 0x7f0680061680 2022-01-10T01:26:12.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0686102700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06800b9680 con 0x7f06800b4710 2022-01-10T01:26:12.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0686102700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06800b6bb0 con 0x7f06801439a0 2022-01-10T01:26:12.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0685100700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f0680061680 0x7f06800b9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33314/0 (socket says 172.21.15.36:33314) 2022-01-10T01:26:12.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0685100700 1 -- 172.21.15.36:0/887893624 learned_addr learned my addr 172.21.15.36:0/887893624 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:12.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0685901700 1 --2- 172.21.15.36:0/887893624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06801439a0 0x7f0680140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:12.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f06848ff700 1 --2- 172.21.15.36:0/887893624 >> v2:172.21.15.59:3300/0 conn(0x7f06800b4710 0x7f068013fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:12.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0677fff700 1 -- 172.21.15.36:0/887893624 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60716264 0 0) 0x7f06800b6910 con 0x7f0680061680 2022-01-10T01:26:12.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0677fff700 1 -- 172.21.15.36:0/887893624 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0664003260 con 0x7f0680061680 2022-01-10T01:26:12.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0685901700 1 -- 172.21.15.36:0/887893624 >> v2:172.21.15.59:3300/0 conn(0x7f06800b4710 msgr2=0x7f068013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:12.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0685901700 1 --2- 172.21.15.36:0/887893624 >> v2:172.21.15.59:3300/0 conn(0x7f06800b4710 0x7f068013fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:12.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0685901700 1 -- 172.21.15.36:0/887893624 >> v1:172.21.15.36:6789/0 conn(0x7f0680061680 legacy=0x7f06800b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:12.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0685901700 1 -- 172.21.15.36:0/887893624 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06800b6e50 con 0x7f06801439a0 2022-01-10T01:26:12.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0685901700 1 --2- 172.21.15.36:0/887893624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06801439a0 0x7f0680140290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f06780032f0 tx=0x7f06780091d0).ready entity=mon.2 client_cookie=2057bc2fbea958b4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:12.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0677fff700 1 -- 172.21.15.36:0/887893624 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f067800b600 con 0x7f06801439a0 2022-01-10T01:26:12.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0677fff700 1 -- 172.21.15.36:0/887893624 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067800b760 con 0x7f06801439a0 2022-01-10T01:26:12.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.821+0000 7f0677fff700 1 -- 172.21.15.36:0/887893624 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f067800b8d0 con 0x7f06801439a0 2022-01-10T01:26:12.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 -- 172.21.15.36:0/887893624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06801439a0 msgr2=0x7f0680140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:12.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 --2- 172.21.15.36:0/887893624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06801439a0 0x7f0680140290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f06780032f0 tx=0x7f06780091d0).stop 2022-01-10T01:26:12.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 -- 172.21.15.36:0/887893624 shutdown_connections 2022-01-10T01:26:12.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 --2- 172.21.15.36:0/887893624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06801439a0 0x7f0680140290 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:12.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 --2- 172.21.15.36:0/887893624 >> v2:172.21.15.59:3300/0 conn(0x7f06800b4710 0x7f068013fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:12.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 -- 172.21.15.36:0/887893624 >> 172.21.15.36:0/887893624 conn(0x7f068006adf0 msgr2=0x7f068005f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:12.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 -- 172.21.15.36:0/887893624 shutdown_connections 2022-01-10T01:26:12.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 -- 172.21.15.36:0/887893624 wait complete. 2022-01-10T01:26:12.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 Processor -- start 2022-01-10T01:26:12.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 -- start start 2022-01-10T01:26:12.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0680061680 0x7f068013a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:12.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06801439a0 0x7f0680152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:12.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f068013a8d0 0x7f0680152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:12.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0680146cb0 con 0x7f068013a8d0 2022-01-10T01:26:12.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0680152380 con 0x7f0680061680 2022-01-10T01:26:12.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0686102700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06801442e0 con 0x7f06801439a0 2022-01-10T01:26:12.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0685901700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f068013a8d0 0x7f0680152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:12.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0685901700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f068013a8d0 0x7f0680152df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35528/0 (socket says 172.21.15.36:35528) 2022-01-10T01:26:12.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0685901700 1 -- 172.21.15.36:0/1177247177 learned_addr learned my addr 172.21.15.36:0/1177247177 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:12.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f0685100700 1 --2- 172.21.15.36:0/1177247177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0680061680 0x7f068013a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:12.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.825+0000 7f06848ff700 1 --2- 172.21.15.36:0/1177247177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06801439a0 0x7f0680152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:12.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f0685901700 1 -- 172.21.15.36:0/1177247177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06801439a0 msgr2=0x7f0680152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:12.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f0685901700 1 --2- 172.21.15.36:0/1177247177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06801439a0 0x7f0680152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:12.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f0685901700 1 -- 172.21.15.36:0/1177247177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0680061680 msgr2=0x7f068013a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:12.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f0685901700 1 --2- 172.21.15.36:0/1177247177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0680061680 0x7f068013a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:12.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f0685901700 1 -- 172.21.15.36:0/1177247177 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0678009470 con 0x7f068013a8d0 2022-01-10T01:26:12.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f0685901700 1 --2- 172.21.15.36:0/1177247177 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f068013a8d0 0x7f0680152df0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f06780032f0 tx=0x7f0678016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:12.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f06767fc700 1 -- 172.21.15.36:0/1177247177 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f067800b8d0 con 0x7f068013a8d0 2022-01-10T01:26:12.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f06767fc700 1 -- 172.21.15.36:0/1177247177 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067801f3f0 con 0x7f068013a8d0 2022-01-10T01:26:12.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f0686102700 1 -- 172.21.15.36:0/1177247177 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068013ad50 con 0x7f068013a8d0 2022-01-10T01:26:12.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f06767fc700 1 -- 172.21.15.36:0/1177247177 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f067800b600 con 0x7f068013a8d0 2022-01-10T01:26:12.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f0686102700 1 -- 172.21.15.36:0/1177247177 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068014a3e0 con 0x7f068013a8d0 2022-01-10T01:26:12.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f0686102700 1 -- 172.21.15.36:0/1177247177 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06801444a0 con 0x7f068013a8d0 2022-01-10T01:26:12.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f06767fc700 1 -- 172.21.15.36:0/1177247177 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0678026030 con 0x7f068013a8d0 2022-01-10T01:26:12.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f06767fc700 1 --2- 172.21.15.36:0/1177247177 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06680535f0 0x7f0668055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:12.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f06767fc700 1 -- 172.21.15.36:0/1177247177 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f067806c480 con 0x7f068013a8d0 2022-01-10T01:26:12.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.829+0000 7f0685100700 1 --2- 172.21.15.36:0/1177247177 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06680535f0 0x7f0668055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:12.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.833+0000 7f0685100700 1 --2- 172.21.15.36:0/1177247177 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06680535f0 0x7f0668055ab0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f067c00b000 tx=0x7f067c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:12.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.837+0000 7f06767fc700 1 -- 172.21.15.36:0/1177247177 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0678043600 con 0x7f068013a8d0 2022-01-10T01:26:12.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.965+0000 7f0686102700 1 -- 172.21.15.36:0/1177247177 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0680057350 con 0x7f068013a8d0 2022-01-10T01:26:12.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.973+0000 7f06767fc700 1 -- 172.21.15.36:0/1177247177 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f06780150c0 con 0x7f068013a8d0 2022-01-10T01:26:12.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.977+0000 7f0686102700 1 -- 172.21.15.36:0/1177247177 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06680535f0 msgr2=0x7f0668055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:12.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.977+0000 7f0686102700 1 --2- 172.21.15.36:0/1177247177 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06680535f0 0x7f0668055ab0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f067c00b000 tx=0x7f067c009040).stop 2022-01-10T01:26:12.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.977+0000 7f0686102700 1 -- 172.21.15.36:0/1177247177 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f068013a8d0 msgr2=0x7f0680152df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:12.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.977+0000 7f0686102700 1 --2- 172.21.15.36:0/1177247177 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f068013a8d0 0x7f0680152df0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f06780032f0 tx=0x7f0678016000).stop 2022-01-10T01:26:12.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.977+0000 7f0686102700 1 -- 172.21.15.36:0/1177247177 shutdown_connections 2022-01-10T01:26:12.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.977+0000 7f0686102700 1 --2- 172.21.15.36:0/1177247177 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06680535f0 0x7f0668055ab0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:12.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.977+0000 7f0686102700 1 --2- 172.21.15.36:0/1177247177 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f068013a8d0 0x7f0680152df0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:12.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.977+0000 7f0686102700 1 --2- 172.21.15.36:0/1177247177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06801439a0 0x7f0680152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:12.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.977+0000 7f0686102700 1 --2- 172.21.15.36:0/1177247177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0680061680 0x7f068013a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:12.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.977+0000 7f0686102700 1 -- 172.21.15.36:0/1177247177 >> 172.21.15.36:0/1177247177 conn(0x7f068006adf0 msgr2=0x7f06800b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:12.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.977+0000 7f0686102700 1 -- 172.21.15.36:0/1177247177 shutdown_connections 2022-01-10T01:26:12.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:12.977+0000 7f0686102700 1 -- 172.21.15.36:0/1177247177 wait complete. 2022-01-10T01:26:12.991 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:26:12.992 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:26:13.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:26:13.025 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:26:13.047 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:26:13.068 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:26:13.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:13.069 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:26:13.069 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:13.076 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2022-01-10T01:26:13.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:26:13.078 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2022-01-10T01:26:13.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:13.079 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:26:13.079 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:26:13.085 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:26:13.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:26:13.087 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:26:13.087 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:26:13.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc83db700 1 Processor -- start 2022-01-10T01:26:13.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc83db700 1 -- start start 2022-01-10T01:26:13.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc83db700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fadc00b1db0 0x7fadc00b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc83db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc01483a0 0x7fadc00b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc83db700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fadc00a70c0 0x7fadc0144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc83db700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc00a90c0 con 0x7fadc00b1db0 2022-01-10T01:26:13.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc83db700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc00b0350 con 0x7fadc00a70c0 2022-01-10T01:26:13.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc83db700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00b05f0 con 0x7fadc01483a0 2022-01-10T01:26:13.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc6177700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fadc00b1db0 0x7fadc00b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc6177700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fadc00b1db0 0x7fadc00b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35534/0 (socket says 172.21.15.36:35534) 2022-01-10T01:26:13.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc6177700 1 -- 172.21.15.36:0/4286263732 learned_addr learned my addr 172.21.15.36:0/4286263732 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:13.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc6978700 1 --2- 172.21.15.36:0/4286263732 >> v2:172.21.15.59:3300/0 conn(0x7fadc00a70c0 0x7fadc0144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc5976700 1 --2- 172.21.15.36:0/4286263732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc01483a0 0x7fadc00b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc6177700 1 -- 172.21.15.36:0/4286263732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc01483a0 msgr2=0x7fadc00b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:13.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc6177700 1 --2- 172.21.15.36:0/4286263732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc01483a0 0x7fadc00b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc6177700 1 -- 172.21.15.36:0/4286263732 >> v2:172.21.15.59:3300/0 conn(0x7fadc00a70c0 msgr2=0x7fadc0144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:13.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc6177700 1 --2- 172.21.15.36:0/4286263732 >> v2:172.21.15.59:3300/0 conn(0x7fadc00a70c0 0x7fadc0144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc6177700 1 -- 172.21.15.36:0/4286263732 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00b0890 con 0x7fadc00b1db0 2022-01-10T01:26:13.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc6978700 1 --2- 172.21.15.36:0/4286263732 >> v2:172.21.15.59:3300/0 conn(0x7fadc00a70c0 0x7fadc0144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:26:13.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc6177700 1 --2- 172.21.15.36:0/4286263732 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadc00b1db0 0x7fadc00b0fd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fadbc002f70 tx=0x7fadbc006eb0).ready entity=mon.0 client_cookie=63d164eb812d5d35 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:13.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc5175700 1 -- 172.21.15.36:0/4286263732 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadbc00d570 con 0x7fadc00b1db0 2022-01-10T01:26:13.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc5175700 1 -- 172.21.15.36:0/4286263732 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc000e90 con 0x7fadc00b1db0 2022-01-10T01:26:13.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc5175700 1 -- 172.21.15.36:0/4286263732 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadbc00d900 con 0x7fadc00b1db0 2022-01-10T01:26:13.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc83db700 1 -- 172.21.15.36:0/4286263732 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadc00b1db0 msgr2=0x7fadc00b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc83db700 1 --2- 172.21.15.36:0/4286263732 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadc00b1db0 0x7fadc00b0fd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fadbc002f70 tx=0x7fadbc006eb0).stop 2022-01-10T01:26:13.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc83db700 1 -- 172.21.15.36:0/4286263732 shutdown_connections 2022-01-10T01:26:13.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.193+0000 7fadc83db700 1 --2- 172.21.15.36:0/4286263732 >> v2:172.21.15.59:3300/0 conn(0x7fadc00a70c0 0x7fadc0144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.197+0000 7fadc83db700 1 --2- 172.21.15.36:0/4286263732 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc01483a0 0x7fadc00b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.197+0000 7fadc83db700 1 --2- 172.21.15.36:0/4286263732 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadc00b1db0 0x7fadc00b0fd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.197+0000 7fadc83db700 1 -- 172.21.15.36:0/4286263732 >> 172.21.15.36:0/4286263732 conn(0x7fadc005f6b0 msgr2=0x7fadc005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:13.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.197+0000 7fadc83db700 1 -- 172.21.15.36:0/4286263732 shutdown_connections 2022-01-10T01:26:13.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.197+0000 7fadc83db700 1 -- 172.21.15.36:0/4286263732 wait complete. 2022-01-10T01:26:13.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.197+0000 7fadc83db700 1 Processor -- start 2022-01-10T01:26:13.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.197+0000 7fadc83db700 1 -- start start 2022-01-10T01:26:13.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc83db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc00a70c0 0x7fadc00b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc83db700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadc00b1db0 0x7fadc00a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc83db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadc01483a0 0x7fadc0159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc83db700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00aa490 con 0x7fadc00b1db0 2022-01-10T01:26:13.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc83db700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc0063b00 con 0x7fadc01483a0 2022-01-10T01:26:13.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc83db700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc0063120 con 0x7fadc00a70c0 2022-01-10T01:26:13.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc5976700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadc00b1db0 0x7fadc00a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc5976700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadc00b1db0 0x7fadc00a9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35542/0 (socket says 172.21.15.36:35542) 2022-01-10T01:26:13.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc5976700 1 -- 172.21.15.36:0/2070023028 learned_addr learned my addr 172.21.15.36:0/2070023028 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:13.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc6177700 1 --2- 172.21.15.36:0/2070023028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc00a70c0 0x7fadc00b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc6978700 1 --2- 172.21.15.36:0/2070023028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadc01483a0 0x7fadc0159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc5976700 1 -- 172.21.15.36:0/2070023028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc00a70c0 msgr2=0x7fadc00b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc5976700 1 --2- 172.21.15.36:0/2070023028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc00a70c0 0x7fadc00b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc5976700 1 -- 172.21.15.36:0/2070023028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadc01483a0 msgr2=0x7fadc0159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc5976700 1 --2- 172.21.15.36:0/2070023028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadc01483a0 0x7fadc0159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc5976700 1 -- 172.21.15.36:0/2070023028 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb000b180 con 0x7fadc00b1db0 2022-01-10T01:26:13.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc5976700 1 --2- 172.21.15.36:0/2070023028 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadc00b1db0 0x7fadc00a9df0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fadb800c000 tx=0x7fadb80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:13.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadb77fe700 1 -- 172.21.15.36:0/2070023028 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadb8012600 con 0x7fadc00b1db0 2022-01-10T01:26:13.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadb77fe700 1 -- 172.21.15.36:0/2070023028 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb8012760 con 0x7fadc00b1db0 2022-01-10T01:26:13.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc83db700 1 -- 172.21.15.36:0/2070023028 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadbc00b1e0 con 0x7fadc00b1db0 2022-01-10T01:26:13.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadb77fe700 1 -- 172.21.15.36:0/2070023028 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadb8012ac0 con 0x7fadc00b1db0 2022-01-10T01:26:13.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.201+0000 7fadc83db700 1 -- 172.21.15.36:0/2070023028 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc0063660 con 0x7fadc00b1db0 2022-01-10T01:26:13.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.205+0000 7fadc83db700 1 -- 172.21.15.36:0/2070023028 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc00a9780 con 0x7fadc00b1db0 2022-01-10T01:26:13.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.205+0000 7fadb77fe700 1 -- 172.21.15.36:0/2070023028 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fadb8022070 con 0x7fadc00b1db0 2022-01-10T01:26:13.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.205+0000 7fadb77fe700 1 --2- 172.21.15.36:0/2070023028 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fada0053560 0x7fada0055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.205+0000 7fadb77fe700 1 -- 172.21.15.36:0/2070023028 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fadb806be70 con 0x7fadc00b1db0 2022-01-10T01:26:13.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.205+0000 7fadc6177700 1 --2- 172.21.15.36:0/2070023028 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fada0053560 0x7fada0055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.205+0000 7fadc6177700 1 --2- 172.21.15.36:0/2070023028 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fada0053560 0x7fada0055a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fadbc01c000 tx=0x7fadbc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:13.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.209+0000 7fadb77fe700 1 -- 172.21.15.36:0/2070023028 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fadc00a9780 con 0x7fadc00b1db0 2022-01-10T01:26:13.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.341+0000 7fadc83db700 1 -- 172.21.15.36:0/2070023028 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fadc00a9780 con 0x7fadc00b1db0 2022-01-10T01:26:13.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.341+0000 7fadb77fe700 1 -- 172.21.15.36:0/2070023028 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v39) v1 ==== 81+0+29219 (secure 0 0 0) 0x7fadc00a9780 con 0x7fadc00b1db0 2022-01-10T01:26:13.346 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:13.347 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:26:13.347 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 39, 2022-01-10T01:26:13.347 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:26:13.347 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:26:13.348 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:26:10.672367+0000", 2022-01-10T01:26:13.348 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:26:13.348 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:26:13.348 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:26:13.349 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:26:13.349 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:26:13.349 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:26:13.349 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:26:13.349 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:26:13.350 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:26:13.350 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:26:13.350 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:26:13.350 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:26:13.351 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:26:13.351 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:26:13.351 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:26:13.351 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 6, 2022-01-10T01:26:13.352 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:26:13.352 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:26:13.352 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:26:13.352 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:26:13.352 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:26:13.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.353 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:26:13.353 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:26:13.353 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:26:13.353 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:26:13.354 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:26:13.354 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:26:13.354 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:26:13.354 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:26:13.355 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:26:13.355 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:26:13.355 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:26:13.355 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:26:13.355 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:26:13.356 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:26:13.356 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:26:13.356 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:26:13.356 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:26:13.356 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:26:13.357 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:26:13.357 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:26:13.357 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:26:13.357 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:26:13.358 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:26:13.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.358 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:26:13.358 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:26:13.358 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:26:13.359 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:26:13.359 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:26:13.359 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:26:13.359 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:26:13.360 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:26:13.360 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:26:13.360 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:26:13.360 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:26:13.360 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:26:13.361 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:26:13.361 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:26:13.361 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:26:13.361 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:26:13.362 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:26:13.362 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:26:13.362 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:26:13.362 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:26:13.362 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:26:13.363 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:26:13.363 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:26:13.363 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:26:13.363 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:26:13.364 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:26:13.364 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:26:13.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.364 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:26:13.364 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:26:13.365 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:26:13.365 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:26:13.365 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:26:13.365 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:26:13.366 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:26:13.366 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:26:13.366 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:26:13.366 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:26:13.366 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:26:13.367 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:26:13.367 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:26:13.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.367 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:26:13.368 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:26:13.368 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.368 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.368 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:26:13.369 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:26:13.369 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:26:13.369 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:26:13.369 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:26:13.369 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:26:13.370 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:26:13.370 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:26:13.370 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:26:13.370 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:26:13.371 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:26:13.371 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:26:13.371 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:26:13.371 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:26:13.371 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:26:13.372 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:26:13.372 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:26:13.372 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:26:13.372 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:26:13.373 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:26:13.373 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:26:13.373 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:26:13.373 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:26:13.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.374 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:26:13.374 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:26:13.374 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:26:13.374 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:26:13.375 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:26:13.375 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:26:13.375 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:26:13.375 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:26:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:26:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:26:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:26:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:26:13.376 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:26:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:26:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:26:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:26:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:26:13.377 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:26:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:26:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:26:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:26:13.378 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:26:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:26:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:26:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:26:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:26:13.379 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:26:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:26:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:26:13.380 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:26:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:26:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:26:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:26:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:26:13.381 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:26:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:26:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:26:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:26:13.382 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:26:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:26:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:26:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.383 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:26:13.384 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:26:13.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.384 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:26:13.384 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:26:13.385 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:13.385 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:13.385 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:13.385 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:13.385 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:13.386 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:13.386 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:13.386 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 33, 2022-01-10T01:26:13.386 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:13.387 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:13.387 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:13.387 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.387 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.387 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.388 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:26:13.388 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:13.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.388 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.389 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:26:13.389 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:13.389 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.389 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.390 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:13.390 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.390 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.391 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:26:13.391 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:13.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.391 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.392 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:26:13.392 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:13.392 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.392 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.393 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:13.393 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.393 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.394 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:26:13.394 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:13.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.394 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.395 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:26:13.395 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:13.395 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.395 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.396 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:13.396 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.396 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:26:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.397 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:26:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:26:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.398 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:26:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:26:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:26:13.399 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:26:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:26:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:26:13.401 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:13.402 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 13, 2022-01-10T01:26:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:13.403 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.404 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:26:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.405 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:26:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.406 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:26:13.407 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.408 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:26:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.409 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:26:13.410 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:13.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.411 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.411 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:26:13.412 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:13.412 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.412 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.412 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:13.413 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.413 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.413 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:26:13.413 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:13.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.414 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.414 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:26:13.415 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:26:13.415 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.415 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.415 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:26:13.416 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:26:13.416 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:26:13.416 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:26:13.416 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:13.417 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:13.417 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:13.417 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.418 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:26:13.418 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:26:13.418 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:13.418 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:13.419 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:13.419 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:13.419 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:13.419 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:13.419 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:13.420 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 22, 2022-01-10T01:26:13.420 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:13.420 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:13.420 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:13.420 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.421 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.421 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:26:13.421 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:13.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.422 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.422 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:26:13.422 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:13.423 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.423 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.423 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:13.423 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.424 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.424 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:26:13.424 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:13.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.425 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.425 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:26:13.425 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:13.426 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.426 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.426 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:13.426 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.427 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.427 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:26:13.427 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:13.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.428 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.428 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:26:13.428 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:13.429 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.429 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.429 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:13.429 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.430 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.430 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:26:13.430 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:13.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.431 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.431 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:26:13.431 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:26:13.432 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.432 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.432 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:26:13.432 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:26:13.433 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:26:13.433 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:26:13.433 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:13.433 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:13.433 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:13.434 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.434 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.434 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:26:13.435 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:26:13.435 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:13.435 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:13.435 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:13.435 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:13.436 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:13.436 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:13.436 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:13.436 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 33, 2022-01-10T01:26:13.436 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:13.437 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:13.437 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:13.437 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.438 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.438 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:26:13.438 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:13.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.439 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.439 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:26:13.439 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:13.439 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.440 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.440 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:13.440 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.441 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.441 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:26:13.441 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:13.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.442 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.442 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:26:13.442 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:13.442 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.443 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.443 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:13.443 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.444 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.444 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:26:13.444 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:13.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.445 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.445 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:26:13.445 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:13.445 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.446 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.446 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:13.446 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.447 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.447 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:26:13.447 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:13.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.448 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.448 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:26:13.448 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:26:13.448 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.449 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.449 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:26:13.449 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:26:13.449 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:26:13.450 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:26:13.450 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:13.450 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:13.450 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:13.450 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.451 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:26:13.451 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:26:13.452 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:13.452 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:13.452 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:13.452 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:13.452 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:13.453 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:13.453 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:13.453 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 32, 2022-01-10T01:26:13.453 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:13.453 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:13.454 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:13.454 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.454 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.454 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:26:13.455 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:13.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.455 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:26:13.456 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:13.456 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.456 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.457 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:26:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.458 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:26:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.460 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:13.460 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.460 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.460 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:26:13.461 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:13.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.461 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.461 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:26:13.462 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:13.462 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.462 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.463 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:13.463 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.463 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.463 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:26:13.464 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:13.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.464 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.465 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:26:13.465 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:26:13.465 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.465 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.466 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:26:13.466 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:26:13.466 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:26:13.466 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:26:13.467 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:13.467 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:13.467 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:13.467 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.468 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:26:13.468 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:26:13.468 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:13.468 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:13.469 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:13.469 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:13.469 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:13.469 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:13.470 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:13.470 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 33, 2022-01-10T01:26:13.470 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:13.470 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:13.470 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:13.471 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.471 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.471 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:26:13.472 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:13.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.472 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.472 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:26:13.473 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:13.473 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.473 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.473 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:13.474 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.474 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.474 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:26:13.475 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:13.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.475 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.475 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:26:13.476 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:13.476 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.476 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.476 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:13.477 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.477 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.477 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:26:13.478 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:13.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.478 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.478 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:26:13.479 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:13.479 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.479 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.479 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:13.480 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.480 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.480 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:26:13.481 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:13.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.481 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.481 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:26:13.482 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:26:13.482 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.482 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.482 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:26:13.483 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:26:13.483 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:26:13.483 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:26:13.483 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:13.484 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:13.484 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:13.484 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.485 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:26:13.485 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:26:13.485 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:13.485 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:13.485 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:13.486 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:13.486 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:13.486 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:13.486 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:13.487 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 34, 2022-01-10T01:26:13.487 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:13.487 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:13.488 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:13.488 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.488 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.489 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:26:13.489 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:13.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.490 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.490 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:26:13.490 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:13.490 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.490 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.491 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:13.491 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.492 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.492 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:26:13.492 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:13.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.493 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.493 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:26:13.493 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:13.493 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.494 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.494 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:13.494 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.495 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.495 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:26:13.495 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:13.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.496 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.496 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:26:13.496 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:13.496 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.497 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.497 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:13.497 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.498 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.498 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:26:13.498 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:13.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.499 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.499 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:26:13.499 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:26:13.500 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.500 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.500 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:26:13.501 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:26:13.501 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:26:13.501 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:26:13.501 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:13.501 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:13.502 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:13.502 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.503 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:26:13.503 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:26:13.503 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:26:13.503 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:26:13.504 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:26:13.504 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:26:13.504 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:26:13.504 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:26:13.504 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:26:13.505 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 33, 2022-01-10T01:26:13.505 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:26:13.505 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:26:13.505 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:26:13.506 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.506 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.506 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:26:13.507 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:13.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.507 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.507 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:26:13.508 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:13.508 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.508 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.509 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:26:13.509 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.509 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.509 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:26:13.510 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:13.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.510 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.511 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:26:13.511 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:13.511 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.511 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.512 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:26:13.512 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.512 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.513 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:26:13.513 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:13.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.514 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.514 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:26:13.514 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:13.514 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.514 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.515 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:26:13.515 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:26:13.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.516 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:26:13.516 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:26:13.516 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:13.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.517 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:26:13.517 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:26:13.517 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:26:13.517 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.518 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.518 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:26:13.518 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:26:13.519 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:26:13.519 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:26:13.519 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:26:13.519 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:26:13.520 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:26:13.520 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:13.520 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.520 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:26:13.520 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:26:13.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.521 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:26:13.521 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:13.521 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:13.522 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:13.522 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:13.522 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:13.522 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:26:13.523 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:13.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.523 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:26:13.523 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:13.524 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:13.524 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:13.524 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:13.524 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:13.525 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:26:13.525 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:13.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.525 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:26:13.526 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:13.526 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:13.526 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:13.526 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:13.527 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:13.527 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:26:13.527 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:13.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.528 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:26:13.528 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:13.528 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:13.528 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:13.529 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:13.529 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:13.529 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:26:13.529 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:13.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.530 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:26:13.530 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:13.530 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:13.531 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:13.531 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:13.531 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:13.531 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:26:13.532 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:13.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.532 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:26:13.532 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:13.533 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:13.533 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:13.533 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:13.533 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:13.534 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:26:13.534 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:13.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.535 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:26:13.535 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:13.535 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:13.535 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:13.535 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:13.536 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:13.536 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:26:13.536 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:13.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:13.537 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:26:13.537 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:26:13.537 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:26:13.537 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:26:13.538 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:26:13.538 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:26:13.538 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:26:13.538 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:26:13.539 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.539 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:26:13.539 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:26:13.539 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:26:13.540 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:26:13.540 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:26:13.540 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": { 2022-01-10T01:26:13.540 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.36:6835/2488750467": "2022-01-11T01:26:07.016933+0000", 2022-01-10T01:26:13.540 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.36:6834/2488750467": "2022-01-11T01:26:07.016933+0000" 2022-01-10T01:26:13.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.541 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:26:13.541 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:26:13.541 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:26:13.542 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:26:13.542 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:26:13.542 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:26:13.542 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:26:13.543 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:26:13.543 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:26:13.543 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:26:13.543 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:26:13.543 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:26:13.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.544 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:26:13.544 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:26:13.544 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:26:13.545 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:26:13.545 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:26:13.545 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:26:13.545 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:26:13.545 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:13.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:13.546 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:26:13.546 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:26:13.546 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:26:13.547 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:26:13.547 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:26:13.547 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:26:13.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.345+0000 7fadc83db700 1 -- 172.21.15.36:0/2070023028 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fada0053560 msgr2=0x7fada0055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.345+0000 7fadc83db700 1 --2- 172.21.15.36:0/2070023028 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fada0053560 0x7fada0055a20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fadbc01c000 tx=0x7fadbc015000).stop 2022-01-10T01:26:13.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.345+0000 7fadc83db700 1 -- 172.21.15.36:0/2070023028 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadc00b1db0 msgr2=0x7fadc00a9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.345+0000 7fadc83db700 1 --2- 172.21.15.36:0/2070023028 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadc00b1db0 0x7fadc00a9df0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fadb800c000 tx=0x7fadb80091d0).stop 2022-01-10T01:26:13.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.345+0000 7fadc83db700 1 -- 172.21.15.36:0/2070023028 shutdown_connections 2022-01-10T01:26:13.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.345+0000 7fadc83db700 1 --2- 172.21.15.36:0/2070023028 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fada0053560 0x7fada0055a20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.345+0000 7fadc83db700 1 --2- 172.21.15.36:0/2070023028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadc01483a0 0x7fadc0159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.345+0000 7fadc83db700 1 --2- 172.21.15.36:0/2070023028 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadc00b1db0 0x7fadc00a9df0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.345+0000 7fadc83db700 1 --2- 172.21.15.36:0/2070023028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadc00a70c0 0x7fadc00b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.345+0000 7fadc83db700 1 -- 172.21.15.36:0/2070023028 >> 172.21.15.36:0/2070023028 conn(0x7fadc005f6b0 msgr2=0x7fadc01467b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:13.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.345+0000 7fadc83db700 1 -- 172.21.15.36:0/2070023028 shutdown_connections 2022-01-10T01:26:13.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.345+0000 7fadc83db700 1 -- 172.21.15.36:0/2070023028 wait complete. 2022-01-10T01:26:13.553 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:26:13.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.661+0000 7f94428e4700 1 Processor -- start 2022-01-10T01:26:13.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.661+0000 7f94428e4700 1 -- start start 2022-01-10T01:26:13.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f943c0b1db0 0x7f943c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f943c1483a0 0x7f943c0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f943c0a70c0 0x7f943c144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c0a90c0 con 0x7f943c0b1db0 2022-01-10T01:26:13.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c0b0350 con 0x7f943c0a70c0 2022-01-10T01:26:13.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0b05f0 con 0x7f943c1483a0 2022-01-10T01:26:13.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f943bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f943c0b1db0 0x7f943c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f943bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f943c0b1db0 0x7f943c0b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35548/0 (socket says 172.21.15.36:35548) 2022-01-10T01:26:13.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f943bfff700 1 -- 172.21.15.36:0/1523699687 learned_addr learned my addr 172.21.15.36:0/1523699687 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:13.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f943b7fe700 1 --2- 172.21.15.36:0/1523699687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f943c1483a0 0x7f943c0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f9440e81700 1 --2- 172.21.15.36:0/1523699687 >> v2:172.21.15.59:3300/0 conn(0x7f943c0a70c0 0x7f943c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f943bfff700 1 -- 172.21.15.36:0/1523699687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f943c1483a0 msgr2=0x7f943c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:13.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f943bfff700 1 --2- 172.21.15.36:0/1523699687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f943c1483a0 0x7f943c0b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f943bfff700 1 -- 172.21.15.36:0/1523699687 >> v2:172.21.15.59:3300/0 conn(0x7f943c0a70c0 msgr2=0x7f943c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:13.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f943bfff700 1 --2- 172.21.15.36:0/1523699687 >> v2:172.21.15.59:3300/0 conn(0x7f943c0a70c0 0x7f943c144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f943bfff700 1 -- 172.21.15.36:0/1523699687 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c0b0890 con 0x7f943c0b1db0 2022-01-10T01:26:13.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f943bfff700 1 --2- 172.21.15.36:0/1523699687 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f943c0b1db0 0x7f943c0b0fd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f9430002f70 tx=0x7f9430006eb0).ready entity=mon.0 client_cookie=252b77ecfcef9aef server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:13.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f943affd700 1 -- 172.21.15.36:0/1523699687 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f943000d570 con 0x7f943c0b1db0 2022-01-10T01:26:13.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f943affd700 1 -- 172.21.15.36:0/1523699687 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9430000e90 con 0x7f943c0b1db0 2022-01-10T01:26:13.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f943affd700 1 -- 172.21.15.36:0/1523699687 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f943000d900 con 0x7f943c0b1db0 2022-01-10T01:26:13.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 -- 172.21.15.36:0/1523699687 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f943c0b1db0 msgr2=0x7f943c0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 --2- 172.21.15.36:0/1523699687 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f943c0b1db0 0x7f943c0b0fd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f9430002f70 tx=0x7f9430006eb0).stop 2022-01-10T01:26:13.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 -- 172.21.15.36:0/1523699687 shutdown_connections 2022-01-10T01:26:13.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 --2- 172.21.15.36:0/1523699687 >> v2:172.21.15.59:3300/0 conn(0x7f943c0a70c0 0x7f943c144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 --2- 172.21.15.36:0/1523699687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f943c1483a0 0x7f943c0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 --2- 172.21.15.36:0/1523699687 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f943c0b1db0 0x7f943c0b0fd0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 -- 172.21.15.36:0/1523699687 >> 172.21.15.36:0/1523699687 conn(0x7f943c05f6b0 msgr2=0x7f943c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:13.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 -- 172.21.15.36:0/1523699687 shutdown_connections 2022-01-10T01:26:13.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.665+0000 7f94428e4700 1 -- 172.21.15.36:0/1523699687 wait complete. 2022-01-10T01:26:13.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.669+0000 7f94428e4700 1 Processor -- start 2022-01-10T01:26:13.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.669+0000 7f94428e4700 1 -- start start 2022-01-10T01:26:13.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.669+0000 7f94428e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f943c0a70c0 0x7f943c0abe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.669+0000 7f94428e4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f943c0b1db0 0x7f943c143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.669+0000 7f94428e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f943c1483a0 0x7f943c143e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.669+0000 7f94428e4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c14a980 con 0x7f943c0b1db0 2022-01-10T01:26:13.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.669+0000 7f94428e4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0aa6b0 con 0x7f943c0a70c0 2022-01-10T01:26:13.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.669+0000 7f94428e4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0ab6d0 con 0x7f943c1483a0 2022-01-10T01:26:13.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.669+0000 7f943b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f943c0b1db0 0x7f943c143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.669+0000 7f943bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f943c0a70c0 0x7f943c0abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.669+0000 7f943b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f943c0b1db0 0x7f943c143940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35556/0 (socket says 172.21.15.36:35556) 2022-01-10T01:26:13.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.669+0000 7f943b7fe700 1 -- 172.21.15.36:0/3559003857 learned_addr learned my addr 172.21.15.36:0/3559003857 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:13.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.669+0000 7f943bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f943c0a70c0 0x7f943c0abe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:60420/0 (socket says 172.21.15.36:60420) 2022-01-10T01:26:13.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.669+0000 7f9440e81700 1 --2- 172.21.15.36:0/3559003857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f943c1483a0 0x7f943c143e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.673+0000 7f943b7fe700 1 -- 172.21.15.36:0/3559003857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f943c1483a0 msgr2=0x7f943c143e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.673+0000 7f943b7fe700 1 --2- 172.21.15.36:0/3559003857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f943c1483a0 0x7f943c143e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.673+0000 7f943b7fe700 1 -- 172.21.15.36:0/3559003857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f943c0a70c0 msgr2=0x7f943c0abe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.673+0000 7f943b7fe700 1 --2- 172.21.15.36:0/3559003857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f943c0a70c0 0x7f943c0abe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.673+0000 7f943b7fe700 1 -- 172.21.15.36:0/3559003857 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943000b1e0 con 0x7f943c0b1db0 2022-01-10T01:26:13.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.673+0000 7f943b7fe700 1 --2- 172.21.15.36:0/3559003857 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f943c0b1db0 0x7f943c143940 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f943c14aaf0 tx=0x7f942c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:13.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.673+0000 7f94397fa700 1 -- 172.21.15.36:0/3559003857 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f942c011750 con 0x7f943c0b1db0 2022-01-10T01:26:13.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.673+0000 7f94397fa700 1 -- 172.21.15.36:0/3559003857 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c0118b0 con 0x7f943c0b1db0 2022-01-10T01:26:13.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.673+0000 7f94428e4700 1 -- 172.21.15.36:0/3559003857 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c0ab430 con 0x7f943c0b1db0 2022-01-10T01:26:13.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.673+0000 7f94397fa700 1 -- 172.21.15.36:0/3559003857 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f942c011c10 con 0x7f943c0b1db0 2022-01-10T01:26:13.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.673+0000 7f94428e4700 1 -- 172.21.15.36:0/3559003857 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c0af920 con 0x7f943c0b1db0 2022-01-10T01:26:13.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.673+0000 7f94428e4700 1 -- 172.21.15.36:0/3559003857 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943c0b0b30 con 0x7f943c0b1db0 2022-01-10T01:26:13.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.673+0000 7f94397fa700 1 -- 172.21.15.36:0/3559003857 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f942c011d70 con 0x7f943c0b1db0 2022-01-10T01:26:13.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.677+0000 7f94397fa700 1 --2- 172.21.15.36:0/3559003857 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f941c053590 0x7f941c055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.677+0000 7f94397fa700 1 -- 172.21.15.36:0/3559003857 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f942c06ba20 con 0x7f943c0b1db0 2022-01-10T01:26:13.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.677+0000 7f943bfff700 1 --2- 172.21.15.36:0/3559003857 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f941c053590 0x7f941c055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.677+0000 7f943bfff700 1 --2- 172.21.15.36:0/3559003857 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f941c053590 0x7f941c055a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f943001c000 tx=0x7f9430015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:13.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.681+0000 7f94397fa700 1 -- 172.21.15.36:0/3559003857 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f942c042cb0 con 0x7f943c0b1db0 2022-01-10T01:26:13.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.845+0000 7f94428e4700 1 -- 172.21.15.36:0/3559003857 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f943c057350 con 0x7f943c0b1db0 2022-01-10T01:26:13.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.849+0000 7f94397fa700 1 -- 172.21.15.36:0/3559003857 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f942c0462d0 con 0x7f943c0b1db0 2022-01-10T01:26:13.851 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:13.852 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1410680575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1410680575},{"type":"v1","addr":"172.21.15.36:6837","nonce":1410680575}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/1811767033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1811767033},{"type":"v1","addr":"172.21.15.59:6833","nonce":1811767033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11},{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/4012584387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":4012584387},{"type":"v1","addr":"172.21.15.36:6835","nonce":4012584387}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":15}],"filesystems":[]} 2022-01-10T01:26:13.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.849+0000 7f94428e4700 1 -- 172.21.15.36:0/3559003857 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f941c053590 msgr2=0x7f941c055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.849+0000 7f94428e4700 1 --2- 172.21.15.36:0/3559003857 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f941c053590 0x7f941c055a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f943001c000 tx=0x7f9430015000).stop 2022-01-10T01:26:13.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.849+0000 7f94428e4700 1 -- 172.21.15.36:0/3559003857 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f943c0b1db0 msgr2=0x7f943c143940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.849+0000 7f94428e4700 1 --2- 172.21.15.36:0/3559003857 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f943c0b1db0 0x7f943c143940 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f943c14aaf0 tx=0x7f942c006df0).stop 2022-01-10T01:26:13.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.849+0000 7f94428e4700 1 -- 172.21.15.36:0/3559003857 shutdown_connections 2022-01-10T01:26:13.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.849+0000 7f94428e4700 1 --2- 172.21.15.36:0/3559003857 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f941c053590 0x7f941c055a50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.849+0000 7f94428e4700 1 --2- 172.21.15.36:0/3559003857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f943c1483a0 0x7f943c143e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.849+0000 7f94428e4700 1 --2- 172.21.15.36:0/3559003857 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f943c0b1db0 0x7f943c143940 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.849+0000 7f94428e4700 1 --2- 172.21.15.36:0/3559003857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f943c0a70c0 0x7f943c0abe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.849+0000 7f94428e4700 1 -- 172.21.15.36:0/3559003857 >> 172.21.15.36:0/3559003857 conn(0x7f943c05f6b0 msgr2=0x7f943c1455a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:13.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.849+0000 7f94428e4700 1 -- 172.21.15.36:0/3559003857 shutdown_connections 2022-01-10T01:26:13.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.849+0000 7f94428e4700 1 -- 172.21.15.36:0/3559003857 wait complete. 2022-01-10T01:26:13.858 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 15 2022-01-10T01:26:13.871 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:26:13.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbdee802700 1 Processor -- start 2022-01-10T01:26:13.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbdee802700 1 -- start start 2022-01-10T01:26:13.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbdee802700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbde80b3000 0x7fbde80b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbdee802700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde80b33e0 con 0x7fbde80a9c10 2022-01-10T01:26:13.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbdee802700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde80b0c70 con 0x7fbde80b18f0 2022-01-10T01:26:13.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbdee802700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde80b27f0 con 0x7fbde80b3000 2022-01-10T01:26:13.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbdee001700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fbde80a9c10 0x7fbde8147ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33358/0 (socket says 172.21.15.36:33358) 2022-01-10T01:26:13.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbdee001700 1 -- 172.21.15.36:0/3478400567 learned_addr learned my addr 172.21.15.36:0/3478400567 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:13.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbded800700 1 --2- 172.21.15.36:0/3478400567 >> v2:172.21.15.59:3300/0 conn(0x7fbde80b3000 0x7fbde80b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbde7fff700 1 -- 172.21.15.36:0/3478400567 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169653384 0 0) 0x7fbde80b33e0 con 0x7fbde80a9c10 2022-01-10T01:26:13.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbde7fff700 1 -- 172.21.15.36:0/3478400567 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdc8003260 con 0x7fbde80a9c10 2022-01-10T01:26:13.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbded800700 1 -- 172.21.15.36:0/3478400567 >> v1:172.21.15.59:6789/0 conn(0x7fbde80b18f0 legacy=0x7fbde8065510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbded800700 1 -- 172.21.15.36:0/3478400567 >> v1:172.21.15.36:6789/0 conn(0x7fbde80a9c10 legacy=0x7fbde8147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbded800700 1 -- 172.21.15.36:0/3478400567 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde80b0f10 con 0x7fbde80b3000 2022-01-10T01:26:13.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbded800700 1 --2- 172.21.15.36:0/3478400567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde80b3000 0x7fbde80b2300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fbdd8002f70 tx=0x7fbdd8006df0).ready entity=mon.1 client_cookie=eb89605e6209fa8e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:13.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbde7fff700 1 -- 172.21.15.36:0/3478400567 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdd800d610 con 0x7fbde80b3000 2022-01-10T01:26:13.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbde7fff700 1 -- 172.21.15.36:0/3478400567 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd8000e90 con 0x7fbde80b3000 2022-01-10T01:26:13.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.969+0000 7fbde7fff700 1 -- 172.21.15.36:0/3478400567 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdd800d960 con 0x7fbde80b3000 2022-01-10T01:26:13.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 -- 172.21.15.36:0/3478400567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde80b3000 msgr2=0x7fbde80b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 --2- 172.21.15.36:0/3478400567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde80b3000 0x7fbde80b2300 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fbdd8002f70 tx=0x7fbdd8006df0).stop 2022-01-10T01:26:13.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 -- 172.21.15.36:0/3478400567 shutdown_connections 2022-01-10T01:26:13.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 --2- 172.21.15.36:0/3478400567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde80b3000 0x7fbde80b2300 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 -- 172.21.15.36:0/3478400567 >> 172.21.15.36:0/3478400567 conn(0x7fbde80636e0 msgr2=0x7fbde8063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:13.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 -- 172.21.15.36:0/3478400567 shutdown_connections 2022-01-10T01:26:13.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 -- 172.21.15.36:0/3478400567 wait complete. 2022-01-10T01:26:13.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 Processor -- start 2022-01-10T01:26:13.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 -- start start 2022-01-10T01:26:13.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde80a9c10 0x7fbde8149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbde80b18f0 0x7fbde80ae040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde80b3000 0x7fbde80ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde80ad6a0 con 0x7fbde80b18f0 2022-01-10T01:26:13.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde8156520 con 0x7fbde80b3000 2022-01-10T01:26:13.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee802700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde81567c0 con 0x7fbde80a9c10 2022-01-10T01:26:13.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdecfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbde80b18f0 0x7fbde80ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdecfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbde80b18f0 0x7fbde80ae040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35572/0 (socket says 172.21.15.36:35572) 2022-01-10T01:26:13.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdecfff700 1 -- 172.21.15.36:0/1789011548 learned_addr learned my addr 172.21.15.36:0/1789011548 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:13.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbdee001700 1 --2- 172.21.15.36:0/1789011548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde80b3000 0x7fbde80ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.973+0000 7fbded800700 1 --2- 172.21.15.36:0/1789011548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde80a9c10 0x7fbde8149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.977+0000 7fbdecfff700 1 -- 172.21.15.36:0/1789011548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde80a9c10 msgr2=0x7fbde8149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.977+0000 7fbdecfff700 1 --2- 172.21.15.36:0/1789011548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde80a9c10 0x7fbde8149a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.977+0000 7fbdecfff700 1 -- 172.21.15.36:0/1789011548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde80b3000 msgr2=0x7fbde80ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:13.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.977+0000 7fbdecfff700 1 --2- 172.21.15.36:0/1789011548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde80b3000 0x7fbde80ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:13.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.977+0000 7fbdecfff700 1 -- 172.21.15.36:0/1789011548 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd800b180 con 0x7fbde80b18f0 2022-01-10T01:26:13.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.977+0000 7fbdecfff700 1 --2- 172.21.15.36:0/1789011548 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbde80b18f0 0x7fbde80ae040 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fbde8067e80 tx=0x7fbdd0007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:13.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.977+0000 7fbde67fc700 1 -- 172.21.15.36:0/1789011548 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdd0006aa0 con 0x7fbde80b18f0 2022-01-10T01:26:13.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.977+0000 7fbde67fc700 1 -- 172.21.15.36:0/1789011548 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd0006c00 con 0x7fbde80b18f0 2022-01-10T01:26:13.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.977+0000 7fbdee802700 1 -- 172.21.15.36:0/1789011548 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde80ad900 con 0x7fbde80b18f0 2022-01-10T01:26:13.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.977+0000 7fbde67fc700 1 -- 172.21.15.36:0/1789011548 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdd0007030 con 0x7fbde80b18f0 2022-01-10T01:26:13.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.977+0000 7fbdee802700 1 -- 172.21.15.36:0/1789011548 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde8063ac0 con 0x7fbde80b18f0 2022-01-10T01:26:13.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.977+0000 7fbdee802700 1 -- 172.21.15.36:0/1789011548 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde80af180 con 0x7fbde80b18f0 2022-01-10T01:26:13.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.977+0000 7fbde67fc700 1 -- 172.21.15.36:0/1789011548 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbdd0010070 con 0x7fbde80b18f0 2022-01-10T01:26:13.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.981+0000 7fbde67fc700 1 --2- 172.21.15.36:0/1789011548 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbdcc0536b0 0x7fbdcc055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:13.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.981+0000 7fbde67fc700 1 -- 172.21.15.36:0/1789011548 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fbdd006b2a0 con 0x7fbde80b18f0 2022-01-10T01:26:13.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.981+0000 7fbded800700 1 --2- 172.21.15.36:0/1789011548 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbdcc0536b0 0x7fbdcc055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:13.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.981+0000 7fbded800700 1 --2- 172.21.15.36:0/1789011548 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbdcc0536b0 0x7fbdcc055b70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fbdd801a000 tx=0x7fbdd8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:13.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:13.985+0000 7fbde67fc700 1 -- 172.21.15.36:0/1789011548 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbdd0042590 con 0x7fbde80b18f0 2022-01-10T01:26:14.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.149+0000 7fbdee802700 1 -- 172.21.15.36:0/1789011548 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbde8057350 con 0x7fbde80b18f0 2022-01-10T01:26:14.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.149+0000 7fbde67fc700 1 -- 172.21.15.36:0/1789011548 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+1562 (secure 0 0 0) 0x7fbdd0045bb0 con 0x7fbde80b18f0 2022-01-10T01:26:14.153 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:14.154 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4866,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1410680575","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1410680575},{"type":"v1","addr":"172.21.15.36:6837","nonce":1410680575}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":10},{"gid":4869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/1811767033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1811767033},{"type":"v1","addr":"172.21.15.59:6833","nonce":1811767033}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":11},{"gid":5121,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/4012584387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":4012584387},{"type":"v1","addr":"172.21.15.36:6835","nonce":4012584387}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":15}],"filesystems":[]} 2022-01-10T01:26:14.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.153+0000 7fbdee802700 1 -- 172.21.15.36:0/1789011548 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbdcc0536b0 msgr2=0x7fbdcc055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:14.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.153+0000 7fbdee802700 1 --2- 172.21.15.36:0/1789011548 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbdcc0536b0 0x7fbdcc055b70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fbdd801a000 tx=0x7fbdd8014000).stop 2022-01-10T01:26:14.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.153+0000 7fbdee802700 1 -- 172.21.15.36:0/1789011548 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbde80b18f0 msgr2=0x7fbde80ae040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:14.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.153+0000 7fbdee802700 1 --2- 172.21.15.36:0/1789011548 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbde80b18f0 0x7fbde80ae040 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fbde8067e80 tx=0x7fbdd0007f60).stop 2022-01-10T01:26:14.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.153+0000 7fbdee802700 1 -- 172.21.15.36:0/1789011548 shutdown_connections 2022-01-10T01:26:14.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.153+0000 7fbdee802700 1 --2- 172.21.15.36:0/1789011548 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbdcc0536b0 0x7fbdcc055b70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:14.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.153+0000 7fbdee802700 1 --2- 172.21.15.36:0/1789011548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbde80b3000 0x7fbde80ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:14.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.153+0000 7fbdee802700 1 --2- 172.21.15.36:0/1789011548 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbde80b18f0 0x7fbde80ae040 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:14.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.153+0000 7fbdee802700 1 --2- 172.21.15.36:0/1789011548 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbde80a9c10 0x7fbde8149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:14.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.153+0000 7fbdee802700 1 -- 172.21.15.36:0/1789011548 >> 172.21.15.36:0/1789011548 conn(0x7fbde80636e0 msgr2=0x7fbde814de50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:14.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.153+0000 7fbdee802700 1 -- 172.21.15.36:0/1789011548 shutdown_connections 2022-01-10T01:26:14.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.153+0000 7fbdee802700 1 -- 172.21.15.36:0/1789011548 wait complete. 2022-01-10T01:26:14.159 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 15 2022-01-10T01:26:14.167 INFO:tasks.ceph.mds.a:Restarting daemon 2022-01-10T01:26:14.167 INFO:tasks.ceph.mds.a:Stopping old one... 2022-01-10T01:26:14.168 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-01-10T01:26:14.168 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:26:14.168 INFO:tasks.ceph.mds.c:Restarting daemon 2022-01-10T01:26:14.169 INFO:tasks.ceph.mds.c:Stopping old one... 2022-01-10T01:26:14.169 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-01-10T01:26:14.169 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:26:14.170 INFO:tasks.ceph.mds.b:Restarting daemon 2022-01-10T01:26:14.170 INFO:tasks.ceph.mds.b:Stopping old one... 2022-01-10T01:26:14.170 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-01-10T01:26:14.171 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:26:14.180 INFO:tasks.ceph.mds.c:Stopped 2022-01-10T01:26:14.180 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-01-10T01:26:14.182 INFO:tasks.ceph.mds.a:Stopped 2022-01-10T01:26:14.182 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-01-10T01:26:14.183 INFO:tasks.ceph.mds.c:Started 2022-01-10T01:26:14.184 DEBUG:teuthology.parallel:result is None 2022-01-10T01:26:14.184 INFO:tasks.ceph.mds.a:Started 2022-01-10T01:26:14.185 DEBUG:teuthology.parallel:result is None 2022-01-10T01:26:14.187 INFO:tasks.ceph.mds.b:Stopped 2022-01-10T01:26:14.188 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-01-10T01:26:14.190 INFO:tasks.ceph.mds.b:Started 2022-01-10T01:26:14.190 DEBUG:teuthology.parallel:result is None 2022-01-10T01:26:14.191 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2022-01-10T01:26:14.266 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:26:14.266 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:26:14.268 INFO:tasks.ceph.mds.c.smithi036.stdout:starting mds.c at 2022-01-10T01:26:14.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04d5d18700 1 Processor -- start 2022-01-10T01:26:14.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04d5d18700 1 -- start start 2022-01-10T01:26:14.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04d5d18700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f04d0060100 0x7f04d00b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:14.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04d5d18700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04d0067300 0x7f04d01438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:14.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04d5d18700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04d00b4c40 0x7f04d0143de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:14.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04d5d18700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d00aabb0 con 0x7f04d0060100 2022-01-10T01:26:14.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04d5d18700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d00604e0 con 0x7f04d00b4c40 2022-01-10T01:26:14.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04d5d18700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d0066ea0 con 0x7f04d0067300 2022-01-10T01:26:14.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04cf7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f04d0060100 0x7f04d00b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:14.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04cf7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f04d0060100 0x7f04d00b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35606/0 (socket says 172.21.15.36:35606) 2022-01-10T01:26:14.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04cf7fe700 1 -- 172.21.15.36:0/305710445 learned_addr learned my addr 172.21.15.36:0/305710445 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:14.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04ceffd700 1 --2- 172.21.15.36:0/305710445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04d0067300 0x7f04d01438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:14.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04cffff700 1 --2- 172.21.15.36:0/305710445 >> v2:172.21.15.59:3300/0 conn(0x7f04d00b4c40 0x7f04d0143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:14.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04cf7fe700 1 -- 172.21.15.36:0/305710445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04d0067300 msgr2=0x7f04d01438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:14.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04cf7fe700 1 --2- 172.21.15.36:0/305710445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04d0067300 0x7f04d01438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:14.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04cf7fe700 1 -- 172.21.15.36:0/305710445 >> v2:172.21.15.59:3300/0 conn(0x7f04d00b4c40 msgr2=0x7f04d0143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:14.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04cf7fe700 1 --2- 172.21.15.36:0/305710445 >> v2:172.21.15.59:3300/0 conn(0x7f04d00b4c40 0x7f04d0143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:14.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04cf7fe700 1 -- 172.21.15.36:0/305710445 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d01442d0 con 0x7f04d0060100 2022-01-10T01:26:14.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04cf7fe700 1 --2- 172.21.15.36:0/305710445 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04d0060100 0x7f04d00b4750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f04c0002f70 tx=0x7f04c0006eb0).ready entity=mon.0 client_cookie=be38f0d59fb5f02c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:14.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04ce7fc700 1 -- 172.21.15.36:0/305710445 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04c000d570 con 0x7f04d0060100 2022-01-10T01:26:14.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04ce7fc700 1 -- 172.21.15.36:0/305710445 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c0000e90 con 0x7f04d0060100 2022-01-10T01:26:14.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.285+0000 7f04ce7fc700 1 -- 172.21.15.36:0/305710445 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04c000d900 con 0x7f04d0060100 2022-01-10T01:26:14.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 -- 172.21.15.36:0/305710445 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04d0060100 msgr2=0x7f04d00b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:14.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 --2- 172.21.15.36:0/305710445 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04d0060100 0x7f04d00b4750 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f04c0002f70 tx=0x7f04c0006eb0).stop 2022-01-10T01:26:14.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 -- 172.21.15.36:0/305710445 shutdown_connections 2022-01-10T01:26:14.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 --2- 172.21.15.36:0/305710445 >> v2:172.21.15.59:3300/0 conn(0x7f04d00b4c40 0x7f04d0143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:14.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 --2- 172.21.15.36:0/305710445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04d0067300 0x7f04d01438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:14.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 --2- 172.21.15.36:0/305710445 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04d0060100 0x7f04d00b4750 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:14.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 -- 172.21.15.36:0/305710445 >> 172.21.15.36:0/305710445 conn(0x7f04d005cf30 msgr2=0x7f04d005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:14.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 -- 172.21.15.36:0/305710445 shutdown_connections 2022-01-10T01:26:14.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 -- 172.21.15.36:0/305710445 wait complete. 2022-01-10T01:26:14.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 Processor -- start 2022-01-10T01:26:14.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 -- start start 2022-01-10T01:26:14.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04d0060100 0x7f04d009fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:14.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04d0067300 0x7f04d009ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:14.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04d00b4c40 0x7f04d00a2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:14.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d009f110 con 0x7f04d0060100 2022-01-10T01:26:14.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d00a0f30 con 0x7f04d0067300 2022-01-10T01:26:14.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d009f360 con 0x7f04d00b4c40 2022-01-10T01:26:14.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04cf7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04d0060100 0x7f04d009fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:14.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04cf7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04d0060100 0x7f04d009fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35612/0 (socket says 172.21.15.36:35612) 2022-01-10T01:26:14.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04cf7fe700 1 -- 172.21.15.36:0/3825530255 learned_addr learned my addr 172.21.15.36:0/3825530255 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:14.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04cffff700 1 --2- 172.21.15.36:0/3825530255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04d00b4c40 0x7f04d00a2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:14.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04ceffd700 1 --2- 172.21.15.36:0/3825530255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04d0067300 0x7f04d009ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:14.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04cf7fe700 1 -- 172.21.15.36:0/3825530255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04d00b4c40 msgr2=0x7f04d00a2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:14.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04cf7fe700 1 --2- 172.21.15.36:0/3825530255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04d00b4c40 0x7f04d00a2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:14.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04cf7fe700 1 -- 172.21.15.36:0/3825530255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04d0067300 msgr2=0x7f04d009ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:14.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04cf7fe700 1 --2- 172.21.15.36:0/3825530255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04d0067300 0x7f04d009ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:14.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04cf7fe700 1 -- 172.21.15.36:0/3825530255 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c000b1e0 con 0x7f04d0060100 2022-01-10T01:26:14.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04cf7fe700 1 --2- 172.21.15.36:0/3825530255 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04d0060100 0x7f04d009fbe0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f04c0002f70 tx=0x7f04c0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:14.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04ccff9700 1 -- 172.21.15.36:0/3825530255 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04c00116e0 con 0x7f04d0060100 2022-01-10T01:26:14.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04ccff9700 1 -- 172.21.15.36:0/3825530255 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c0011840 con 0x7f04d0060100 2022-01-10T01:26:14.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 -- 172.21.15.36:0/3825530255 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d009f600 con 0x7f04d0060100 2022-01-10T01:26:14.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04ccff9700 1 -- 172.21.15.36:0/3825530255 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04c0011ba0 con 0x7f04d0060100 2022-01-10T01:26:14.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.289+0000 7f04d5d18700 1 -- 172.21.15.36:0/3825530255 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d00a2e10 con 0x7f04d0060100 2022-01-10T01:26:14.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.293+0000 7f04d5d18700 1 -- 172.21.15.36:0/3825530255 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d009ef30 con 0x7f04d0060100 2022-01-10T01:26:14.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.293+0000 7f04ccff9700 1 -- 172.21.15.36:0/3825530255 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f04c001a040 con 0x7f04d0060100 2022-01-10T01:26:14.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.293+0000 7f04ccff9700 1 --2- 172.21.15.36:0/3825530255 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04b00534d0 0x7f04b0055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:14.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.293+0000 7f04ccff9700 1 -- 172.21.15.36:0/3825530255 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f04c006c610 con 0x7f04d0060100 2022-01-10T01:26:14.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.293+0000 7f04ceffd700 1 --2- 172.21.15.36:0/3825530255 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04b00534d0 0x7f04b0055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:14.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.293+0000 7f04ceffd700 1 --2- 172.21.15.36:0/3825530255 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04b00534d0 0x7f04b0055990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f04c400b000 tx=0x7f04c4006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:14.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.297+0000 7f04ccff9700 1 -- 172.21.15.36:0/3825530255 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f04c00437f0 con 0x7f04d0060100 2022-01-10T01:26:14.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:14.433+0000 7f04d5d18700 1 -- 172.21.15.36:0/3825530255 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f04d0057350 con 0x7f04d0060100 2022-01-10T01:26:15.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.297+0000 7f04ccff9700 1 -- 172.21.15.36:0/3825530255 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v41) v1 ==== 97+0+0 (secure 0 0 0) 0x7f04c0023020 con 0x7f04d0060100 2022-01-10T01:26:15.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.301+0000 7f04d5d18700 1 -- 172.21.15.36:0/3825530255 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04b00534d0 msgr2=0x7f04b0055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:15.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.301+0000 7f04d5d18700 1 --2- 172.21.15.36:0/3825530255 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04b00534d0 0x7f04b0055990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f04c400b000 tx=0x7f04c4006df0).stop 2022-01-10T01:26:15.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.301+0000 7f04d5d18700 1 -- 172.21.15.36:0/3825530255 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04d0060100 msgr2=0x7f04d009fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:15.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.301+0000 7f04d5d18700 1 --2- 172.21.15.36:0/3825530255 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04d0060100 0x7f04d009fbe0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f04c0002f70 tx=0x7f04c0015000).stop 2022-01-10T01:26:15.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.301+0000 7f04d5d18700 1 -- 172.21.15.36:0/3825530255 shutdown_connections 2022-01-10T01:26:15.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.301+0000 7f04d5d18700 1 --2- 172.21.15.36:0/3825530255 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04b00534d0 0x7f04b0055990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.301+0000 7f04d5d18700 1 --2- 172.21.15.36:0/3825530255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04d00b4c40 0x7f04d00a2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.301+0000 7f04d5d18700 1 --2- 172.21.15.36:0/3825530255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04d0067300 0x7f04d009ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.301+0000 7f04d5d18700 1 --2- 172.21.15.36:0/3825530255 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04d0060100 0x7f04d009fbe0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.301+0000 7f04d5d18700 1 -- 172.21.15.36:0/3825530255 >> 172.21.15.36:0/3825530255 conn(0x7f04d005cf30 msgr2=0x7f04d005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:15.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.301+0000 7f04d5d18700 1 -- 172.21.15.36:0/3825530255 shutdown_connections 2022-01-10T01:26:15.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.301+0000 7f04d5d18700 1 -- 172.21.15.36:0/3825530255 wait complete. 2022-01-10T01:26:15.308 INFO:teuthology.orchestra.run.smithi036.stderr: removed all blacklist entries 2022-01-10T01:26:15.319 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2022-01-10T01:26:15.319 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2022-01-10T01:26:15.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.425+0000 7f04bbfff700 1 Processor -- start 2022-01-10T01:26:15.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.425+0000 7f04bbfff700 1 -- start start 2022-01-10T01:26:15.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.425+0000 7f04bbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04bc0a8ac0 0x7f04bc152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:15.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.425+0000 7f04bbfff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04bc0a70c0 con 0x7f04bc0b2580 2022-01-10T01:26:15.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.425+0000 7f04bbfff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04bc0a72f0 con 0x7f04bc0b0010 2022-01-10T01:26:15.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.425+0000 7f04bbfff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04bc0a7590 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.425+0000 7f04baffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f04bc0b2580 0x7f04bc14ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33418/0 (socket says 172.21.15.36:33418) 2022-01-10T01:26:15.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.425+0000 7f04baffd700 1 -- 172.21.15.36:0/1226505813 learned_addr learned my addr 172.21.15.36:0/1226505813 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:15.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.425+0000 7f04bb7fe700 1 --2- 172.21.15.36:0/1226505813 >> v2:172.21.15.59:3300/0 conn(0x7f04bc0a8ac0 0x7f04bc152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:15.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04ba7fc700 1 -- 172.21.15.36:0/1226505813 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801239946 0 0) 0x7f04bc0a70c0 con 0x7f04bc0b2580 2022-01-10T01:26:15.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04ba7fc700 1 -- 172.21.15.36:0/1226505813 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f049c003260 con 0x7f04bc0b2580 2022-01-10T01:26:15.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04bb7fe700 1 -- 172.21.15.36:0/1226505813 >> v1:172.21.15.59:6789/0 conn(0x7f04bc0b0010 legacy=0x7f04bc0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:15.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04bb7fe700 1 -- 172.21.15.36:0/1226505813 >> v1:172.21.15.36:6789/0 conn(0x7f04bc0b2580 legacy=0x7f04bc14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:15.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04bb7fe700 1 -- 172.21.15.36:0/1226505813 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc0a7830 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04bb7fe700 1 --2- 172.21.15.36:0/1226505813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04bc0a8ac0 0x7f04bc152be0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f04b40032f0 tx=0x7f04b40091d0).ready entity=mon.1 client_cookie=7f2906c6c0559534 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:15.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04ba7fc700 1 -- 172.21.15.36:0/1226505813 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04b400b6c0 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04ba7fc700 1 -- 172.21.15.36:0/1226505813 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b400b820 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04ba7fc700 1 -- 172.21.15.36:0/1226505813 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04b400b990 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04bbfff700 1 -- 172.21.15.36:0/1226505813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04bc0a8ac0 msgr2=0x7f04bc152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:15.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04bbfff700 1 --2- 172.21.15.36:0/1226505813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04bc0a8ac0 0x7f04bc152be0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f04b40032f0 tx=0x7f04b40091d0).stop 2022-01-10T01:26:15.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04bbfff700 1 -- 172.21.15.36:0/1226505813 shutdown_connections 2022-01-10T01:26:15.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04bbfff700 1 --2- 172.21.15.36:0/1226505813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04bc0a8ac0 0x7f04bc152be0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04bbfff700 1 -- 172.21.15.36:0/1226505813 >> 172.21.15.36:0/1226505813 conn(0x7f04bc060180 msgr2=0x7f04bc0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:15.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04bbfff700 1 -- 172.21.15.36:0/1226505813 shutdown_connections 2022-01-10T01:26:15.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.429+0000 7f04bbfff700 1 -- 172.21.15.36:0/1226505813 wait complete. 2022-01-10T01:26:15.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04bbfff700 1 Processor -- start 2022-01-10T01:26:15.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04bbfff700 1 -- start start 2022-01-10T01:26:15.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04bbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04bc0a8ac0 0x7f04bc0a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:15.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04bbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04bc0b0010 0x7f04bc0b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:15.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04bbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04bc0b2580 0x7f04bc0b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:15.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04bbfff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc0b3f70 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04bbfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc0b3070 con 0x7f04bc0b2580 2022-01-10T01:26:15.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04bbfff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04bc0b3310 con 0x7f04bc0b0010 2022-01-10T01:26:15.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04baffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04bc0a8ac0 0x7f04bc0a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:15.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04baffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04bc0a8ac0 0x7f04bc0a9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35630/0 (socket says 172.21.15.36:35630) 2022-01-10T01:26:15.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04bb7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04bc0b2580 0x7f04bc0b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:15.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04baffd700 1 -- 172.21.15.36:0/1587270034 learned_addr learned my addr 172.21.15.36:0/1587270034 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:15.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04b3fff700 1 --2- 172.21.15.36:0/1587270034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04bc0b0010 0x7f04bc0b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:15.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04baffd700 1 -- 172.21.15.36:0/1587270034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04bc0b0010 msgr2=0x7f04bc0b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:15.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04baffd700 1 --2- 172.21.15.36:0/1587270034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04bc0b0010 0x7f04bc0b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04baffd700 1 -- 172.21.15.36:0/1587270034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04bc0b2580 msgr2=0x7f04bc0b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:15.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04baffd700 1 --2- 172.21.15.36:0/1587270034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04bc0b2580 0x7f04bc0b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04baffd700 1 -- 172.21.15.36:0/1587270034 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b4009470 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04bb7fe700 1 --2- 172.21.15.36:0/1587270034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04bc0b2580 0x7f04bc0b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:26:15.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04baffd700 1 --2- 172.21.15.36:0/1587270034 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04bc0a8ac0 0x7f04bc0a9f30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f04ac001110 tx=0x7f04ac007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:15.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04b8ff9700 1 -- 172.21.15.36:0/1587270034 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04ac0070d0 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04b8ff9700 1 -- 172.21.15.36:0/1587270034 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ac007230 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04b8ff9700 1 -- 172.21.15.36:0/1587270034 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04ac005610 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04bbfff700 1 -- 172.21.15.36:0/1587270034 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04bc0b35b0 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.433+0000 7f04bbfff700 1 -- 172.21.15.36:0/1587270034 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04bc0b5560 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.437+0000 7f04bbfff700 1 -- 172.21.15.36:0/1587270034 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04bc057350 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.437+0000 7f04b8ff9700 1 -- 172.21.15.36:0/1587270034 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f04ac010070 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.437+0000 7f04b8ff9700 1 --2- 172.21.15.36:0/1587270034 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04a00535f0 0x7f04a0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:15.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.437+0000 7f04b8ff9700 1 -- 172.21.15.36:0/1587270034 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f04ac06ae10 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.437+0000 7f04b3fff700 1 --2- 172.21.15.36:0/1587270034 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04a00535f0 0x7f04a0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:15.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.437+0000 7f04b3fff700 1 --2- 172.21.15.36:0/1587270034 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04a00535f0 0x7f04a0055ab0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f04a400d000 tx=0x7f04a4000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:15.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.445+0000 7f04b8ff9700 1 -- 172.21.15.36:0/1587270034 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f04ac06e030 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.617+0000 7f04bbfff700 1 -- 172.21.15.36:0/1587270034 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f04bc0698e0 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.617+0000 7f04b8ff9700 1 -- 172.21.15.36:0/1587270034 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f04ac018070 con 0x7f04bc0a8ac0 2022-01-10T01:26:15.622 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:15.622 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:26:15.622 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_dump": [ 2022-01-10T01:26:15.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.623 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.a", 2022-01-10T01:26:15.623 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthuGT4IxAA5DyijS4tPjdOLn5uiLXEPg==", 2022-01-10T01:26:15.623 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.624 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:26:15.624 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:26:15.624 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:26:15.624 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:26:15.624 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.625 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.b", 2022-01-10T01:26:15.625 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthkvX0LRAAtz19usFvoObvouQeLFwicg==", 2022-01-10T01:26:15.626 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.626 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:26:15.626 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:26:15.626 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:26:15.626 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:26:15.627 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.627 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.c", 2022-01-10T01:26:15.628 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthbvUmKhAA0pVpDJO1AfsAzIHU1cAHiw==", 2022-01-10T01:26:15.628 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.628 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:26:15.628 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:26:15.628 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:26:15.629 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:26:15.629 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.630 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.0", 2022-01-10T01:26:15.630 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCWitthk4iKHRAAF7aFP+i24xFvXXm8j5GzVg==", 2022-01-10T01:26:15.630 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.630 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:26:15.630 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:26:15.631 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:26:15.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.632 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.1", 2022-01-10T01:26:15.632 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCZitthsKSXABAAb3IkNvlyLub89HwaPWZ1Bg==", 2022-01-10T01:26:15.632 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.632 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:26:15.632 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:26:15.633 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:26:15.633 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.634 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.2", 2022-01-10T01:26:15.634 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCbitthvNzhIBAAXkZ6FslnMl1gS/rOa7G+Vg==", 2022-01-10T01:26:15.634 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.634 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:26:15.634 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:26:15.635 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:26:15.635 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.635 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.636 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.3", 2022-01-10T01:26:15.636 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCeitth9P7EAxAA7KOCP7Rh5oN1yqCz9I6v3A==", 2022-01-10T01:26:15.636 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.636 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:26:15.636 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:26:15.637 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:26:15.637 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.638 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.4", 2022-01-10T01:26:15.638 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCjitth/L1UBxAAskxmSV0aE6CSvDFR8O/+SQ==", 2022-01-10T01:26:15.638 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.638 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:26:15.638 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:26:15.639 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:26:15.639 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.640 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.5", 2022-01-10T01:26:15.640 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQClitthMoY6JhAAeeIrCmMcm3MpDPtdLUf+2g==", 2022-01-10T01:26:15.640 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.640 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:26:15.640 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:26:15.641 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:26:15.641 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.641 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.6", 2022-01-10T01:26:15.642 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCoitthrUhlCxAAsYhU7Kj6HMo/kD0DezvITg==", 2022-01-10T01:26:15.642 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.642 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:26:15.642 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:26:15.643 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:26:15.643 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.643 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.7", 2022-01-10T01:26:15.644 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCqitthFaLrKRAAC2g1OlcV2KTtaOXsyCrIrQ==", 2022-01-10T01:26:15.644 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.644 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:26:15.644 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:26:15.645 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:26:15.645 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.645 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.0", 2022-01-10T01:26:15.646 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthKoa/NBAADjvHh99F8YOktGID9uyttg==", 2022-01-10T01:26:15.646 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.646 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:26:15.646 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:26:15.646 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:26:15.647 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.647 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.647 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.1", 2022-01-10T01:26:15.648 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth3x76OBAAPTrw8OUmnpEflWuB7zzaHg==", 2022-01-10T01:26:15.648 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.648 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:26:15.648 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:26:15.648 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:26:15.649 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.649 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.admin", 2022-01-10T01:26:15.650 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthf9dqChAADHRsoZKuozdsqb41ztuR7w==", 2022-01-10T01:26:15.650 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.650 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:26:15.650 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:26:15.650 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:26:15.651 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:26:15.651 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.652 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.x", 2022-01-10T01:26:15.652 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth39syIRAA6pOvLWw2ADy72TWZ65MIkA==", 2022-01-10T01:26:15.652 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.652 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:26:15.652 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:26:15.653 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:26:15.653 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:15.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:15.654 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.y", 2022-01-10T01:26:15.654 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth4novHRAACVMjo72kOB/T7Ti/CiN27w==", 2022-01-10T01:26:15.654 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:26:15.654 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:26:15.654 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:26:15.655 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:26:15.655 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.655 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:15.655 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:26:15.656 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:26:15.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.621+0000 7f04bbfff700 1 -- 172.21.15.36:0/1587270034 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04a00535f0 msgr2=0x7f04a0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:15.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.621+0000 7f04bbfff700 1 --2- 172.21.15.36:0/1587270034 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04a00535f0 0x7f04a0055ab0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f04a400d000 tx=0x7f04a4000bc0).stop 2022-01-10T01:26:15.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.621+0000 7f04bbfff700 1 -- 172.21.15.36:0/1587270034 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04bc0a8ac0 msgr2=0x7f04bc0a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:15.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.621+0000 7f04bbfff700 1 --2- 172.21.15.36:0/1587270034 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04bc0a8ac0 0x7f04bc0a9f30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f04ac001110 tx=0x7f04ac007ad0).stop 2022-01-10T01:26:15.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.621+0000 7f04bbfff700 1 -- 172.21.15.36:0/1587270034 shutdown_connections 2022-01-10T01:26:15.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.621+0000 7f04bbfff700 1 --2- 172.21.15.36:0/1587270034 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04a00535f0 0x7f04a0055ab0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.621+0000 7f04bbfff700 1 --2- 172.21.15.36:0/1587270034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04bc0b2580 0x7f04bc0b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.621+0000 7f04bbfff700 1 --2- 172.21.15.36:0/1587270034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04bc0b0010 0x7f04bc0b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.621+0000 7f04bbfff700 1 --2- 172.21.15.36:0/1587270034 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04bc0a8ac0 0x7f04bc0a9f30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.621+0000 7f04bbfff700 1 -- 172.21.15.36:0/1587270034 >> 172.21.15.36:0/1587270034 conn(0x7f04bc060180 msgr2=0x7f04bc144bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:15.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.621+0000 7f04bbfff700 1 -- 172.21.15.36:0/1587270034 shutdown_connections 2022-01-10T01:26:15.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.621+0000 7f04bbfff700 1 -- 172.21.15.36:0/1587270034 wait complete. 2022-01-10T01:26:15.661 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:26:15.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a98a700 1 Processor -- start 2022-01-10T01:26:15.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a98a700 1 -- start start 2022-01-10T01:26:15.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a98a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f78040b2580 0x7f780414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:15.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a98a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78040b0010 0x7f780414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:15.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a98a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f78040afbd0 0x7f78040a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:15.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a98a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78040a70c0 con 0x7f78040afbd0 2022-01-10T01:26:15.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a98a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78040a72f0 con 0x7f78040b2580 2022-01-10T01:26:15.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a98a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78040a7590 con 0x7f78040b0010 2022-01-10T01:26:15.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a189700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f78040afbd0 0x7f78040a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:15.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a189700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f78040afbd0 0x7f78040a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35638/0 (socket says 172.21.15.36:35638) 2022-01-10T01:26:15.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a189700 1 -- 172.21.15.36:0/912401354 learned_addr learned my addr 172.21.15.36:0/912401354 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:15.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f7809988700 1 --2- 172.21.15.36:0/912401354 >> v2:172.21.15.59:3300/0 conn(0x7f78040b2580 0x7f780414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:15.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f7809187700 1 --2- 172.21.15.36:0/912401354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78040b0010 0x7f780414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:15.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a189700 1 -- 172.21.15.36:0/912401354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78040b0010 msgr2=0x7f780414b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:15.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a189700 1 --2- 172.21.15.36:0/912401354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78040b0010 0x7f780414b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a189700 1 -- 172.21.15.36:0/912401354 >> v2:172.21.15.59:3300/0 conn(0x7f78040b2580 msgr2=0x7f780414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:15.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a189700 1 --2- 172.21.15.36:0/912401354 >> v2:172.21.15.59:3300/0 conn(0x7f78040b2580 0x7f780414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a189700 1 -- 172.21.15.36:0/912401354 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78040a7830 con 0x7f78040afbd0 2022-01-10T01:26:15.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.761+0000 7f780a189700 1 --2- 172.21.15.36:0/912401354 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78040afbd0 0x7f78040a83b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f77f4002f70 tx=0x7f77f4006eb0).ready entity=mon.0 client_cookie=2715594138d8bb2d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:15.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f7808986700 1 -- 172.21.15.36:0/912401354 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77f400d570 con 0x7f78040afbd0 2022-01-10T01:26:15.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f7808986700 1 -- 172.21.15.36:0/912401354 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4000e90 con 0x7f78040afbd0 2022-01-10T01:26:15.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f7808986700 1 -- 172.21.15.36:0/912401354 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77f400d900 con 0x7f78040afbd0 2022-01-10T01:26:15.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 -- 172.21.15.36:0/912401354 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78040afbd0 msgr2=0x7f78040a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:15.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 --2- 172.21.15.36:0/912401354 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78040afbd0 0x7f78040a83b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f77f4002f70 tx=0x7f77f4006eb0).stop 2022-01-10T01:26:15.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 -- 172.21.15.36:0/912401354 shutdown_connections 2022-01-10T01:26:15.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 --2- 172.21.15.36:0/912401354 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78040afbd0 0x7f78040a83b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 --2- 172.21.15.36:0/912401354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78040b0010 0x7f780414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 --2- 172.21.15.36:0/912401354 >> v2:172.21.15.59:3300/0 conn(0x7f78040b2580 0x7f780414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 -- 172.21.15.36:0/912401354 >> 172.21.15.36:0/912401354 conn(0x7f7804060180 msgr2=0x7f78040b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:15.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 -- 172.21.15.36:0/912401354 shutdown_connections 2022-01-10T01:26:15.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 -- 172.21.15.36:0/912401354 wait complete. 2022-01-10T01:26:15.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 Processor -- start 2022-01-10T01:26:15.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 -- start start 2022-01-10T01:26:15.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78040afbd0 0x7f7804067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:15.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78040b0010 0x7f7804156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:15.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78040b2580 0x7f780415a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:15.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78040abe40 con 0x7f78040b0010 2022-01-10T01:26:15.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78040b2dd0 con 0x7f78040b2580 2022-01-10T01:26:15.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.765+0000 7f780a98a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78040aa8c0 con 0x7f78040afbd0 2022-01-10T01:26:15.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7809187700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78040b0010 0x7f7804156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:15.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7809187700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78040b0010 0x7f7804156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35644/0 (socket says 172.21.15.36:35644) 2022-01-10T01:26:15.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7809187700 1 -- 172.21.15.36:0/3230462553 learned_addr learned my addr 172.21.15.36:0/3230462553 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:15.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7809988700 1 --2- 172.21.15.36:0/3230462553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78040afbd0 0x7f7804067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:15.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f780a189700 1 --2- 172.21.15.36:0/3230462553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78040b2580 0x7f780415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:15.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7809988700 1 -- 172.21.15.36:0/3230462553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78040b2580 msgr2=0x7f780415a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:15.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7809988700 1 --2- 172.21.15.36:0/3230462553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78040b2580 0x7f780415a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7809988700 1 -- 172.21.15.36:0/3230462553 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78040b0010 msgr2=0x7f7804156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:15.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7809988700 1 --2- 172.21.15.36:0/3230462553 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78040b0010 0x7f7804156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7809988700 1 -- 172.21.15.36:0/3230462553 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f400b1e0 con 0x7f78040afbd0 2022-01-10T01:26:15.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7809988700 1 --2- 172.21.15.36:0/3230462553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78040afbd0 0x7f7804067680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f77fc00c000 tx=0x7f77fc0091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:15.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7802ffd700 1 -- 172.21.15.36:0/3230462553 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77fc0126d0 con 0x7f78040afbd0 2022-01-10T01:26:15.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7802ffd700 1 -- 172.21.15.36:0/3230462553 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc012830 con 0x7f78040afbd0 2022-01-10T01:26:15.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f780a98a700 1 -- 172.21.15.36:0/3230462553 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78040ac070 con 0x7f78040afbd0 2022-01-10T01:26:15.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7802ffd700 1 -- 172.21.15.36:0/3230462553 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77fc012b90 con 0x7f78040afbd0 2022-01-10T01:26:15.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f780a98a700 1 -- 172.21.15.36:0/3230462553 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78040b3230 con 0x7f78040afbd0 2022-01-10T01:26:15.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7802ffd700 1 -- 172.21.15.36:0/3230462553 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f77fc022070 con 0x7f78040afbd0 2022-01-10T01:26:15.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f780a98a700 1 -- 172.21.15.36:0/3230462553 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780414cbf0 con 0x7f78040afbd0 2022-01-10T01:26:15.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7802ffd700 1 --2- 172.21.15.36:0/3230462553 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f77e4053680 0x7f77e4055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:15.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7802ffd700 1 -- 172.21.15.36:0/3230462553 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f77fc06bde0 con 0x7f78040afbd0 2022-01-10T01:26:15.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.769+0000 7f7809187700 1 --2- 172.21.15.36:0/3230462553 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f77e4053680 0x7f77e4055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:15.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.773+0000 7f7809187700 1 --2- 172.21.15.36:0/3230462553 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f77e4053680 0x7f77e4055b40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f77f800b000 tx=0x7f77f8006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:15.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.781+0000 7f7802ffd700 1 -- 172.21.15.36:0/3230462553 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f77fc043050 con 0x7f78040afbd0 2022-01-10T01:26:15.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.913+0000 7f780a98a700 1 -- 172.21.15.36:0/3230462553 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7804057350 con 0x7f78040afbd0 2022-01-10T01:26:15.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.913+0000 7f7802ffd700 1 -- 172.21.15.36:0/3230462553 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13414 (secure 0 0 0) 0x7f77fc046670 con 0x7f78040afbd0 2022-01-10T01:26:15.918 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:15.919 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":41,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:26:15.285183+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:26:15.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.917+0000 7f780a98a700 1 -- 172.21.15.36:0/3230462553 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f77e4053680 msgr2=0x7f77e4055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:15.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.917+0000 7f780a98a700 1 --2- 172.21.15.36:0/3230462553 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f77e4053680 0x7f77e4055b40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f77f800b000 tx=0x7f77f8006df0).stop 2022-01-10T01:26:15.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.917+0000 7f780a98a700 1 -- 172.21.15.36:0/3230462553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78040afbd0 msgr2=0x7f7804067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:15.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.917+0000 7f780a98a700 1 --2- 172.21.15.36:0/3230462553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78040afbd0 0x7f7804067680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f77fc00c000 tx=0x7f77fc0091d0).stop 2022-01-10T01:26:15.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.917+0000 7f780a98a700 1 -- 172.21.15.36:0/3230462553 shutdown_connections 2022-01-10T01:26:15.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.917+0000 7f780a98a700 1 --2- 172.21.15.36:0/3230462553 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f77e4053680 0x7f77e4055b40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.917+0000 7f780a98a700 1 --2- 172.21.15.36:0/3230462553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78040b2580 0x7f780415a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.917+0000 7f780a98a700 1 --2- 172.21.15.36:0/3230462553 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78040b0010 0x7f7804156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.917+0000 7f780a98a700 1 --2- 172.21.15.36:0/3230462553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78040afbd0 0x7f7804067680 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:15.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.917+0000 7f780a98a700 1 -- 172.21.15.36:0/3230462553 >> 172.21.15.36:0/3230462553 conn(0x7f7804060180 msgr2=0x7f7804144b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:15.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.917+0000 7f780a98a700 1 -- 172.21.15.36:0/3230462553 shutdown_connections 2022-01-10T01:26:15.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:15.917+0000 7f780a98a700 1 -- 172.21.15.36:0/3230462553 wait complete. 2022-01-10T01:26:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-01-10T01:26:15.935 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:26:16.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.041+0000 7f0e1e02b700 1 Processor -- start 2022-01-10T01:26:16.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.041+0000 7f0e1e02b700 1 -- start start 2022-01-10T01:26:16.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.041+0000 7f0e1e02b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e180b0010 0x7f0e180a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.041+0000 7f0e1e02b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e180a70c0 con 0x7f0e180b2580 2022-01-10T01:26:16.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.041+0000 7f0e1e02b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e180a72f0 con 0x7f0e180afbd0 2022-01-10T01:26:16.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.041+0000 7f0e1e02b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e180a7590 con 0x7f0e180b0010 2022-01-10T01:26:16.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.041+0000 7f0e1d029700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f0e180b2580 0x7f0e1814ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33444/0 (socket says 172.21.15.36:33444) 2022-01-10T01:26:16.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.041+0000 7f0e1d029700 1 -- 172.21.15.36:0/1693416871 learned_addr learned my addr 172.21.15.36:0/1693416871 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:16.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1c828700 1 --2- 172.21.15.36:0/1693416871 >> v2:172.21.15.59:3300/0 conn(0x7f0e180b0010 0x7f0e180a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e0ffff700 1 -- 172.21.15.36:0/1693416871 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170750444 0 0) 0x7f0e180a70c0 con 0x7f0e180b2580 2022-01-10T01:26:16.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e0ffff700 1 -- 172.21.15.36:0/1693416871 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dfc003260 con 0x7f0e180b2580 2022-01-10T01:26:16.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e0ffff700 1 -- 172.21.15.36:0/1693416871 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242263204 0 0) 0x7f0e180a72f0 con 0x7f0e180afbd0 2022-01-10T01:26:16.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e0ffff700 1 -- 172.21.15.36:0/1693416871 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e180a70c0 con 0x7f0e180afbd0 2022-01-10T01:26:16.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1c828700 1 -- 172.21.15.36:0/1693416871 >> v1:172.21.15.59:6789/0 conn(0x7f0e180afbd0 legacy=0x7f0e18151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1c828700 1 -- 172.21.15.36:0/1693416871 >> v1:172.21.15.36:6789/0 conn(0x7f0e180b2580 legacy=0x7f0e1814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e0ffff700 1 -- 172.21.15.36:0/1693416871 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3053233003 0 0) 0x7f0dfc003260 con 0x7f0e180b2580 2022-01-10T01:26:16.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1c828700 1 -- 172.21.15.36:0/1693416871 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e180a7830 con 0x7f0e180b0010 2022-01-10T01:26:16.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1c828700 1 --2- 172.21.15.36:0/1693416871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180b0010 0x7f0e180a83b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f0e08001110 tx=0x7f0e140091d0).ready entity=mon.1 client_cookie=a961a8ce6f9f3220 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:16.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e0ffff700 1 -- 172.21.15.36:0/1693416871 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e08001660 con 0x7f0e180b0010 2022-01-10T01:26:16.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e0ffff700 1 -- 172.21.15.36:0/1693416871 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1400f510 con 0x7f0e180b0010 2022-01-10T01:26:16.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e0ffff700 1 -- 172.21.15.36:0/1693416871 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e1400f680 con 0x7f0e180b0010 2022-01-10T01:26:16.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 -- 172.21.15.36:0/1693416871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180b0010 msgr2=0x7f0e180a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 --2- 172.21.15.36:0/1693416871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180b0010 0x7f0e180a83b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f0e08001110 tx=0x7f0e140091d0).stop 2022-01-10T01:26:16.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 -- 172.21.15.36:0/1693416871 shutdown_connections 2022-01-10T01:26:16.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 --2- 172.21.15.36:0/1693416871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180b0010 0x7f0e180a83b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 -- 172.21.15.36:0/1693416871 >> 172.21.15.36:0/1693416871 conn(0x7f0e18060180 msgr2=0x7f0e180b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:16.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 -- 172.21.15.36:0/1693416871 shutdown_connections 2022-01-10T01:26:16.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 -- 172.21.15.36:0/1693416871 wait complete. 2022-01-10T01:26:16.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 Processor -- start 2022-01-10T01:26:16.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 -- start start 2022-01-10T01:26:16.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e180afbd0 0x7f0e180ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180b0010 0x7f0e180ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e180b2580 0x7f0e18159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180ab940 con 0x7f0e180afbd0 2022-01-10T01:26:16.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180a9650 con 0x7f0e180b0010 2022-01-10T01:26:16.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1e02b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1815a510 con 0x7f0e180b2580 2022-01-10T01:26:16.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1d029700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e180afbd0 0x7f0e180ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.045+0000 7f0e1d029700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e180afbd0 0x7f0e180ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35656/0 (socket says 172.21.15.36:35656) 2022-01-10T01:26:16.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e1d029700 1 -- 172.21.15.36:0/3579543207 learned_addr learned my addr 172.21.15.36:0/3579543207 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:16.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e1d82a700 1 --2- 172.21.15.36:0/3579543207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e180b2580 0x7f0e18159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e1c828700 1 --2- 172.21.15.36:0/3579543207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180b0010 0x7f0e180ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e1d029700 1 -- 172.21.15.36:0/3579543207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e180b2580 msgr2=0x7f0e18159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e1d029700 1 --2- 172.21.15.36:0/3579543207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e180b2580 0x7f0e18159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e1d029700 1 -- 172.21.15.36:0/3579543207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180b0010 msgr2=0x7f0e180ad200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e1d029700 1 --2- 172.21.15.36:0/3579543207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180b0010 0x7f0e180ad200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e1d029700 1 -- 172.21.15.36:0/3579543207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e14009470 con 0x7f0e180afbd0 2022-01-10T01:26:16.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e1d029700 1 --2- 172.21.15.36:0/3579543207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e180afbd0 0x7f0e180ab450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f0e08001840 tx=0x7f0e08001a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:16.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e0e7fc700 1 -- 172.21.15.36:0/3579543207 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e08007170 con 0x7f0e180afbd0 2022-01-10T01:26:16.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e0e7fc700 1 -- 172.21.15.36:0/3579543207 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e080072d0 con 0x7f0e180afbd0 2022-01-10T01:26:16.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e1e02b700 1 -- 172.21.15.36:0/3579543207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1815a7b0 con 0x7f0e180afbd0 2022-01-10T01:26:16.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e0e7fc700 1 -- 172.21.15.36:0/3579543207 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e08004920 con 0x7f0e180afbd0 2022-01-10T01:26:16.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e1e02b700 1 -- 172.21.15.36:0/3579543207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e180ad6f0 con 0x7f0e180afbd0 2022-01-10T01:26:16.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e0e7fc700 1 -- 172.21.15.36:0/3579543207 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0e08004a80 con 0x7f0e180afbd0 2022-01-10T01:26:16.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e0e7fc700 1 --2- 172.21.15.36:0/3579543207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e000535f0 0x7f0e00055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e0e7fc700 1 -- 172.21.15.36:0/3579543207 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f0e0806b400 con 0x7f0e180afbd0 2022-01-10T01:26:16.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e1c828700 1 --2- 172.21.15.36:0/3579543207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e000535f0 0x7f0e00055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e1e02b700 1 -- 172.21.15.36:0/3579543207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1815a360 con 0x7f0e180afbd0 2022-01-10T01:26:16.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.049+0000 7f0e1c828700 1 --2- 172.21.15.36:0/3579543207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e000535f0 0x7f0e00055ab0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f0e14019000 tx=0x7f0e14016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:16.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.057+0000 7f0e0e7fc700 1 -- 172.21.15.36:0/3579543207 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0e08042750 con 0x7f0e180afbd0 2022-01-10T01:26:16.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.185+0000 7f0e1e02b700 1 -- 172.21.15.36:0/3579543207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0e18057350 con 0x7f0e180afbd0 2022-01-10T01:26:16.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.185+0000 7f0e0e7fc700 1 -- 172.21.15.36:0/3579543207 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v41) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0e08045d70 con 0x7f0e180afbd0 2022-01-10T01:26:16.189 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:26:16.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.189+0000 7f0e1e02b700 1 -- 172.21.15.36:0/3579543207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e000535f0 msgr2=0x7f0e00055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.189+0000 7f0e1e02b700 1 --2- 172.21.15.36:0/3579543207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e000535f0 0x7f0e00055ab0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f0e14019000 tx=0x7f0e14016000).stop 2022-01-10T01:26:16.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.189+0000 7f0e1e02b700 1 -- 172.21.15.36:0/3579543207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e180afbd0 msgr2=0x7f0e180ab450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.189+0000 7f0e1e02b700 1 --2- 172.21.15.36:0/3579543207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e180afbd0 0x7f0e180ab450 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f0e08001840 tx=0x7f0e08001a90).stop 2022-01-10T01:26:16.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.189+0000 7f0e1e02b700 1 -- 172.21.15.36:0/3579543207 shutdown_connections 2022-01-10T01:26:16.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.189+0000 7f0e1e02b700 1 --2- 172.21.15.36:0/3579543207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e000535f0 0x7f0e00055ab0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.189+0000 7f0e1e02b700 1 --2- 172.21.15.36:0/3579543207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e180b2580 0x7f0e18159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.189+0000 7f0e1e02b700 1 --2- 172.21.15.36:0/3579543207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e180b0010 0x7f0e180ad200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.189+0000 7f0e1e02b700 1 --2- 172.21.15.36:0/3579543207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e180afbd0 0x7f0e180ab450 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.189+0000 7f0e1e02b700 1 -- 172.21.15.36:0/3579543207 >> 172.21.15.36:0/3579543207 conn(0x7f0e18060180 msgr2=0x7f0e180b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:16.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.189+0000 7f0e1e02b700 1 -- 172.21.15.36:0/3579543207 shutdown_connections 2022-01-10T01:26:16.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.189+0000 7f0e1e02b700 1 -- 172.21.15.36:0/3579543207 wait complete. 2022-01-10T01:26:16.203 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:26:16.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.309+0000 7f7ee1978700 1 Processor -- start 2022-01-10T01:26:16.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.309+0000 7f7ee1978700 1 -- start start 2022-01-10T01:26:16.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1978700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7edc061680 0x7f7edc0b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1978700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7edc0b4710 0x7f7edc0ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1978700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7edc0b6910 con 0x7f7edc1439a0 2022-01-10T01:26:16.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1978700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7edc0b9680 con 0x7f7edc061680 2022-01-10T01:26:16.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1978700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc0b6bb0 con 0x7f7edc0b4710 2022-01-10T01:26:16.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee0976700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7edc061680 0x7f7edc0b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1177700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f7edc1439a0 0x7f7edc13fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33456/0 (socket says 172.21.15.36:33456) 2022-01-10T01:26:16.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1177700 1 -- 172.21.15.36:0/2599362616 learned_addr learned my addr 172.21.15.36:0/2599362616 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:16.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ed3fff700 1 --2- 172.21.15.36:0/2599362616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7edc0b4710 0x7f7edc0ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ed37fe700 1 -- 172.21.15.36:0/2599362616 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197184223 0 0) 0x7f7edc0b6910 con 0x7f7edc1439a0 2022-01-10T01:26:16.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ed37fe700 1 -- 172.21.15.36:0/2599362616 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ec8003260 con 0x7f7edc1439a0 2022-01-10T01:26:16.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee0976700 1 -- 172.21.15.36:0/2599362616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7edc0b4710 msgr2=0x7f7edc0ba200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:16.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee0976700 1 --2- 172.21.15.36:0/2599362616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7edc0b4710 0x7f7edc0ba200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee0976700 1 -- 172.21.15.36:0/2599362616 >> v1:172.21.15.36:6789/0 conn(0x7f7edc1439a0 legacy=0x7f7edc13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee0976700 1 -- 172.21.15.36:0/2599362616 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc0b6e50 con 0x7f7edc061680 2022-01-10T01:26:16.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee0976700 1 --2- 172.21.15.36:0/2599362616 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7edc061680 0x7f7edc0b9d10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f7ed8002f70 tx=0x7f7ed8006df0).ready entity=mon.0 client_cookie=727fa15a6877b15a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:16.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ed37fe700 1 -- 172.21.15.36:0/2599362616 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed800d4a0 con 0x7f7edc061680 2022-01-10T01:26:16.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ed37fe700 1 -- 172.21.15.36:0/2599362616 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed8000e90 con 0x7f7edc061680 2022-01-10T01:26:16.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ed37fe700 1 -- 172.21.15.36:0/2599362616 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed800d7f0 con 0x7f7edc061680 2022-01-10T01:26:16.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1978700 1 -- 172.21.15.36:0/2599362616 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7edc061680 msgr2=0x7f7edc0b9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1978700 1 --2- 172.21.15.36:0/2599362616 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7edc061680 0x7f7edc0b9d10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f7ed8002f70 tx=0x7f7ed8006df0).stop 2022-01-10T01:26:16.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1978700 1 -- 172.21.15.36:0/2599362616 shutdown_connections 2022-01-10T01:26:16.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1978700 1 --2- 172.21.15.36:0/2599362616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7edc0b4710 0x7f7edc0ba200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1978700 1 --2- 172.21.15.36:0/2599362616 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7edc061680 0x7f7edc0b9d10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1978700 1 -- 172.21.15.36:0/2599362616 >> 172.21.15.36:0/2599362616 conn(0x7f7edc06adf0 msgr2=0x7f7edc05f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:16.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1978700 1 -- 172.21.15.36:0/2599362616 shutdown_connections 2022-01-10T01:26:16.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.313+0000 7f7ee1978700 1 -- 172.21.15.36:0/2599362616 wait complete. 2022-01-10T01:26:16.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.317+0000 7f7ee1978700 1 Processor -- start 2022-01-10T01:26:16.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.317+0000 7f7ee1978700 1 -- start start 2022-01-10T01:26:16.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.317+0000 7f7ee1978700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7edc061680 0x7f7edc0ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.317+0000 7f7ee1978700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7edc1439a0 0x7f7edc1464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.317+0000 7f7ee1978700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7edc13f100 0x7f7edc13e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.317+0000 7f7ee1978700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc144010 con 0x7f7edc13f100 2022-01-10T01:26:16.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.317+0000 7f7ee1978700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc05ef30 con 0x7f7edc061680 2022-01-10T01:26:16.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.317+0000 7f7ee1978700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc145ec0 con 0x7f7edc1439a0 2022-01-10T01:26:16.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.317+0000 7f7ee1177700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7edc13f100 0x7f7edc13e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.317+0000 7f7ee0976700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7edc061680 0x7f7edc0ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ed3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7edc1439a0 0x7f7edc1464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.317+0000 7f7ee1177700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7edc13f100 0x7f7edc13e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35672/0 (socket says 172.21.15.36:35672) 2022-01-10T01:26:16.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ee0976700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7edc061680 0x7f7edc0ae650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:60534/0 (socket says 172.21.15.36:60534) 2022-01-10T01:26:16.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ee1177700 1 -- 172.21.15.36:0/3072560551 learned_addr learned my addr 172.21.15.36:0/3072560551 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:16.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ee1177700 1 -- 172.21.15.36:0/3072560551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7edc1439a0 msgr2=0x7f7edc1464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ee1177700 1 --2- 172.21.15.36:0/3072560551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7edc1439a0 0x7f7edc1464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ee1177700 1 -- 172.21.15.36:0/3072560551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7edc061680 msgr2=0x7f7edc0ae650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ee1177700 1 --2- 172.21.15.36:0/3072560551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7edc061680 0x7f7edc0ae650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ee1177700 1 -- 172.21.15.36:0/3072560551 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed800b180 con 0x7f7edc13f100 2022-01-10T01:26:16.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ee1177700 1 --2- 172.21.15.36:0/3072560551 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7edc13f100 0x7f7edc13e350 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f7edc146280 tx=0x7f7ed4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:16.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ed1ffb700 1 -- 172.21.15.36:0/3072560551 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed4005ba0 con 0x7f7edc13f100 2022-01-10T01:26:16.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ed1ffb700 1 -- 172.21.15.36:0/3072560551 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed4005d00 con 0x7f7edc13f100 2022-01-10T01:26:16.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ee1978700 1 -- 172.21.15.36:0/3072560551 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc0aef00 con 0x7f7edc13f100 2022-01-10T01:26:16.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ed1ffb700 1 -- 172.21.15.36:0/3072560551 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed40072c0 con 0x7f7edc13f100 2022-01-10T01:26:16.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ee1978700 1 -- 172.21.15.36:0/3072560551 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc0b0760 con 0x7f7edc13f100 2022-01-10T01:26:16.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ee1978700 1 -- 172.21.15.36:0/3072560551 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc057350 con 0x7f7edc13f100 2022-01-10T01:26:16.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.321+0000 7f7ed1ffb700 1 -- 172.21.15.36:0/3072560551 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7ed4010070 con 0x7f7edc13f100 2022-01-10T01:26:16.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.325+0000 7f7ed1ffb700 1 --2- 172.21.15.36:0/3072560551 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7ebc0535f0 0x7f7ebc055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.325+0000 7f7ed1ffb700 1 -- 172.21.15.36:0/3072560551 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f7ed406b060 con 0x7f7edc13f100 2022-01-10T01:26:16.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.325+0000 7f7ee0976700 1 --2- 172.21.15.36:0/3072560551 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7ebc0535f0 0x7f7ebc055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.325+0000 7f7ee0976700 1 --2- 172.21.15.36:0/3072560551 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7ebc0535f0 0x7f7ebc055ab0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f7ed801a000 tx=0x7f7ed8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:16.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.329+0000 7f7ed1ffb700 1 -- 172.21.15.36:0/3072560551 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7ed40423b0 con 0x7f7edc13f100 2022-01-10T01:26:16.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.461+0000 7f7ee1978700 1 -- 172.21.15.36:0/3072560551 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7edc0b0b10 con 0x7f7edc13f100 2022-01-10T01:26:16.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.461+0000 7f7ed1ffb700 1 -- 172.21.15.36:0/3072560551 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7ed40459d0 con 0x7f7edc13f100 2022-01-10T01:26:16.465 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:26:16.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.465+0000 7f7ee1978700 1 -- 172.21.15.36:0/3072560551 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7ebc0535f0 msgr2=0x7f7ebc055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.465+0000 7f7ee1978700 1 --2- 172.21.15.36:0/3072560551 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7ebc0535f0 0x7f7ebc055ab0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f7ed801a000 tx=0x7f7ed8014000).stop 2022-01-10T01:26:16.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.465+0000 7f7ee1978700 1 -- 172.21.15.36:0/3072560551 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7edc13f100 msgr2=0x7f7edc13e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.465+0000 7f7ee1978700 1 --2- 172.21.15.36:0/3072560551 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7edc13f100 0x7f7edc13e350 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f7edc146280 tx=0x7f7ed4007e00).stop 2022-01-10T01:26:16.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.465+0000 7f7ee1978700 1 -- 172.21.15.36:0/3072560551 shutdown_connections 2022-01-10T01:26:16.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.465+0000 7f7ee1978700 1 --2- 172.21.15.36:0/3072560551 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7ebc0535f0 0x7f7ebc055ab0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.465+0000 7f7ee1978700 1 --2- 172.21.15.36:0/3072560551 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7edc13f100 0x7f7edc13e350 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.465+0000 7f7ee1978700 1 --2- 172.21.15.36:0/3072560551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7edc1439a0 0x7f7edc1464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.465+0000 7f7ee1978700 1 --2- 172.21.15.36:0/3072560551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7edc061680 0x7f7edc0ae650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.465+0000 7f7ee1978700 1 -- 172.21.15.36:0/3072560551 >> 172.21.15.36:0/3072560551 conn(0x7f7edc06adf0 msgr2=0x7f7edc13fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:16.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.465+0000 7f7ee1978700 1 -- 172.21.15.36:0/3072560551 shutdown_connections 2022-01-10T01:26:16.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.465+0000 7f7ee1978700 1 -- 172.21.15.36:0/3072560551 wait complete. 2022-01-10T01:26:16.484 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-01-10T01:26:16.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.585+0000 7f629d388700 1 Processor -- start 2022-01-10T01:26:16.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.585+0000 7f629d388700 1 -- start start 2022-01-10T01:26:16.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.585+0000 7f629d388700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f62980b1db0 0x7f62980b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.585+0000 7f629d388700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62980a70c0 0x7f6298144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.585+0000 7f629d388700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62980b0350 con 0x7f62981483a0 2022-01-10T01:26:16.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.585+0000 7f629d388700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62980a90c0 con 0x7f62980b1db0 2022-01-10T01:26:16.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.585+0000 7f629d388700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62980b05f0 con 0x7f62980a70c0 2022-01-10T01:26:16.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f6296ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f62980b1db0 0x7f62980b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f62967fc700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f62981483a0 0x7f62980b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33470/0 (socket says 172.21.15.36:33470) 2022-01-10T01:26:16.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f62967fc700 1 -- 172.21.15.36:0/3521429596 learned_addr learned my addr 172.21.15.36:0/3521429596 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:16.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f62977fe700 1 --2- 172.21.15.36:0/3521429596 >> v2:172.21.15.59:3300/0 conn(0x7f62980a70c0 0x7f6298144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f6295ffb700 1 -- 172.21.15.36:0/3521429596 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943941472 0 0) 0x7f62980b0350 con 0x7f62981483a0 2022-01-10T01:26:16.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f6295ffb700 1 -- 172.21.15.36:0/3521429596 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f627c003260 con 0x7f62981483a0 2022-01-10T01:26:16.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f6295ffb700 1 -- 172.21.15.36:0/3521429596 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1407819142 0 0) 0x7f627c003260 con 0x7f62981483a0 2022-01-10T01:26:16.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f6296ffd700 1 -- 172.21.15.36:0/3521429596 >> v2:172.21.15.59:3300/0 conn(0x7f62980a70c0 msgr2=0x7f6298144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:16.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f6296ffd700 1 --2- 172.21.15.36:0/3521429596 >> v2:172.21.15.59:3300/0 conn(0x7f62980a70c0 0x7f6298144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f6296ffd700 1 -- 172.21.15.36:0/3521429596 >> v1:172.21.15.36:6789/0 conn(0x7f62981483a0 legacy=0x7f62980b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f6296ffd700 1 -- 172.21.15.36:0/3521429596 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62980b0890 con 0x7f62980b1db0 2022-01-10T01:26:16.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f6296ffd700 1 --2- 172.21.15.36:0/3521429596 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62980b1db0 0x7f62980b0fd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f6298147730 tx=0x7f628c006df0).ready entity=mon.0 client_cookie=a1fcab471eb18adf server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:16.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f6295ffb700 1 -- 172.21.15.36:0/3521429596 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62880019e0 con 0x7f62980b1db0 2022-01-10T01:26:16.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f6295ffb700 1 -- 172.21.15.36:0/3521429596 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c000e90 con 0x7f62980b1db0 2022-01-10T01:26:16.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f6295ffb700 1 -- 172.21.15.36:0/3521429596 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f628c012460 con 0x7f62980b1db0 2022-01-10T01:26:16.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f629d388700 1 -- 172.21.15.36:0/3521429596 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62980b1db0 msgr2=0x7f62980b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f629d388700 1 --2- 172.21.15.36:0/3521429596 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62980b1db0 0x7f62980b0fd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f6298147730 tx=0x7f628c006df0).stop 2022-01-10T01:26:16.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f629d388700 1 -- 172.21.15.36:0/3521429596 shutdown_connections 2022-01-10T01:26:16.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f629d388700 1 --2- 172.21.15.36:0/3521429596 >> v2:172.21.15.59:3300/0 conn(0x7f62980a70c0 0x7f6298144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f629d388700 1 --2- 172.21.15.36:0/3521429596 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62980b1db0 0x7f62980b0fd0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f629d388700 1 -- 172.21.15.36:0/3521429596 >> 172.21.15.36:0/3521429596 conn(0x7f629805f6b0 msgr2=0x7f629805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:16.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f629d388700 1 -- 172.21.15.36:0/3521429596 shutdown_connections 2022-01-10T01:26:16.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.589+0000 7f629d388700 1 -- 172.21.15.36:0/3521429596 wait complete. 2022-01-10T01:26:16.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f629d388700 1 Processor -- start 2022-01-10T01:26:16.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f629d388700 1 -- start start 2022-01-10T01:26:16.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f629d388700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62980a70c0 0x7f62980b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f629d388700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62980b1db0 0x7f6298156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f629d388700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62981483a0 0x7f6298156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f629d388700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62980afba0 con 0x7f62980b1db0 2022-01-10T01:26:16.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f629d388700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62980ab8e0 con 0x7f62980a70c0 2022-01-10T01:26:16.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f629d388700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62980abb80 con 0x7f62981483a0 2022-01-10T01:26:16.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f62967fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62980b1db0 0x7f6298156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f62967fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62980b1db0 0x7f6298156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35684/0 (socket says 172.21.15.36:35684) 2022-01-10T01:26:16.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f62967fc700 1 -- 172.21.15.36:0/2445180419 learned_addr learned my addr 172.21.15.36:0/2445180419 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:16.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f6296ffd700 1 --2- 172.21.15.36:0/2445180419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62980a70c0 0x7f62980b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f62977fe700 1 --2- 172.21.15.36:0/2445180419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62981483a0 0x7f6298156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f62967fc700 1 -- 172.21.15.36:0/2445180419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62981483a0 msgr2=0x7f6298156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f62967fc700 1 --2- 172.21.15.36:0/2445180419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62981483a0 0x7f6298156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f62967fc700 1 -- 172.21.15.36:0/2445180419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62980a70c0 msgr2=0x7f62980b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f62967fc700 1 --2- 172.21.15.36:0/2445180419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62980a70c0 0x7f62980b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.593+0000 7f62967fc700 1 -- 172.21.15.36:0/2445180419 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f628c00b180 con 0x7f62980b1db0 2022-01-10T01:26:16.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.597+0000 7f62967fc700 1 --2- 172.21.15.36:0/2445180419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62980b1db0 0x7f6298156820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f6288001c40 tx=0x7f62880020a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:16.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.597+0000 7f6287fff700 1 -- 172.21.15.36:0/2445180419 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6288005ba0 con 0x7f62980b1db0 2022-01-10T01:26:16.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.597+0000 7f6287fff700 1 -- 172.21.15.36:0/2445180419 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6288005d00 con 0x7f62980b1db0 2022-01-10T01:26:16.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.597+0000 7f629d388700 1 -- 172.21.15.36:0/2445180419 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62980abe20 con 0x7f62980b1db0 2022-01-10T01:26:16.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.597+0000 7f6287fff700 1 -- 172.21.15.36:0/2445180419 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62880072c0 con 0x7f62980b1db0 2022-01-10T01:26:16.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.597+0000 7f629d388700 1 -- 172.21.15.36:0/2445180419 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6298157200 con 0x7f62980b1db0 2022-01-10T01:26:16.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.597+0000 7f629d388700 1 -- 172.21.15.36:0/2445180419 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62980abfb0 con 0x7f62980b1db0 2022-01-10T01:26:16.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.597+0000 7f6287fff700 1 -- 172.21.15.36:0/2445180419 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6288010070 con 0x7f62980b1db0 2022-01-10T01:26:16.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.597+0000 7f6287fff700 1 --2- 172.21.15.36:0/2445180419 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6274053500 0x7f62740559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.597+0000 7f6287fff700 1 -- 172.21.15.36:0/2445180419 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f628806b010 con 0x7f62980b1db0 2022-01-10T01:26:16.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.597+0000 7f6296ffd700 1 --2- 172.21.15.36:0/2445180419 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6274053500 0x7f62740559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.597+0000 7f6296ffd700 1 --2- 172.21.15.36:0/2445180419 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6274053500 0x7f62740559c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f628c01a000 tx=0x7f628c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:16.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.605+0000 7f6287fff700 1 -- 172.21.15.36:0/2445180419 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6288042360 con 0x7f62980b1db0 2022-01-10T01:26:16.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.737+0000 7f629d388700 1 -- 172.21.15.36:0/2445180419 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f62980b0b30 con 0x7f62980b1db0 2022-01-10T01:26:16.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.737+0000 7f6287fff700 1 -- 172.21.15.36:0/2445180419 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) v1 ==== 84+0+143 (secure 0 0 0) 0x7f6288045980 con 0x7f62980b1db0 2022-01-10T01:26:16.741 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:16.742 INFO:teuthology.orchestra.run.smithi036.stdout:[ 2022-01-10T01:26:16.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:16.742 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 1, 2022-01-10T01:26:16.742 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "device_health_metrics" 2022-01-10T01:26:16.742 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:16.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:26:16.743 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 2, 2022-01-10T01:26:16.743 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "rbd" 2022-01-10T01:26:16.743 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:16.744 INFO:teuthology.orchestra.run.smithi036.stdout:] 2022-01-10T01:26:16.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.741+0000 7f629d388700 1 -- 172.21.15.36:0/2445180419 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6274053500 msgr2=0x7f62740559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.741+0000 7f629d388700 1 --2- 172.21.15.36:0/2445180419 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6274053500 0x7f62740559c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f628c01a000 tx=0x7f628c014000).stop 2022-01-10T01:26:16.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.741+0000 7f629d388700 1 -- 172.21.15.36:0/2445180419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62980b1db0 msgr2=0x7f6298156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.741+0000 7f629d388700 1 --2- 172.21.15.36:0/2445180419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62980b1db0 0x7f6298156820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f6288001c40 tx=0x7f62880020a0).stop 2022-01-10T01:26:16.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.741+0000 7f629d388700 1 -- 172.21.15.36:0/2445180419 shutdown_connections 2022-01-10T01:26:16.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.741+0000 7f629d388700 1 --2- 172.21.15.36:0/2445180419 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6274053500 0x7f62740559c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.741+0000 7f629d388700 1 --2- 172.21.15.36:0/2445180419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62981483a0 0x7f6298156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.741+0000 7f629d388700 1 --2- 172.21.15.36:0/2445180419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62980b1db0 0x7f6298156820 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.741+0000 7f629d388700 1 --2- 172.21.15.36:0/2445180419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62980a70c0 0x7f62980b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.741+0000 7f629d388700 1 -- 172.21.15.36:0/2445180419 >> 172.21.15.36:0/2445180419 conn(0x7f629805f6b0 msgr2=0x7f62980b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:16.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.741+0000 7f629d388700 1 -- 172.21.15.36:0/2445180419 shutdown_connections 2022-01-10T01:26:16.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.741+0000 7f629d388700 1 -- 172.21.15.36:0/2445180419 wait complete. 2022-01-10T01:26:16.757 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-01-10T01:26:16.758 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:26:16.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 Processor -- start 2022-01-10T01:26:16.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 -- start start 2022-01-10T01:26:16.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3840b0010 0x7fe3840a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe3840afbd0 0x7fe3840a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3840a70c0 con 0x7fe3840b2580 2022-01-10T01:26:16.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3840a72f0 con 0x7fe3840afbd0 2022-01-10T01:26:16.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3840a7590 con 0x7fe3840b0010 2022-01-10T01:26:16.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3888d4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe3840afbd0 0x7fe3840a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3888d4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe3840afbd0 0x7fe3840a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35694/0 (socket says 172.21.15.36:35694) 2022-01-10T01:26:16.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3888d4700 1 -- 172.21.15.36:0/3519250571 learned_addr learned my addr 172.21.15.36:0/3519250571 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:16.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3837fe700 1 --2- 172.21.15.36:0/3519250571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3840b0010 0x7fe3840a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3888d4700 1 -- 172.21.15.36:0/3519250571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3840b0010 msgr2=0x7fe3840a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:16.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3888d4700 1 --2- 172.21.15.36:0/3519250571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3840b0010 0x7fe3840a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3888d4700 1 -- 172.21.15.36:0/3519250571 >> v1:172.21.15.59:6789/0 conn(0x7fe3840b2580 legacy=0x7fe38414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3888d4700 1 -- 172.21.15.36:0/3519250571 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3840a7830 con 0x7fe3840afbd0 2022-01-10T01:26:16.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3888d4700 1 --2- 172.21.15.36:0/3519250571 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3840afbd0 0x7fe3840a88a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fe37c0032f0 tx=0x7fe37c009290).ready entity=mon.0 client_cookie=c6c119c6c405633d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:16.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe382ffd700 1 -- 172.21.15.36:0/3519250571 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37c00b8a0 con 0x7fe3840afbd0 2022-01-10T01:26:16.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe382ffd700 1 -- 172.21.15.36:0/3519250571 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37c00ba00 con 0x7fe3840afbd0 2022-01-10T01:26:16.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe382ffd700 1 -- 172.21.15.36:0/3519250571 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37c00bb70 con 0x7fe3840afbd0 2022-01-10T01:26:16.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 -- 172.21.15.36:0/3519250571 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3840afbd0 msgr2=0x7fe3840a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 --2- 172.21.15.36:0/3519250571 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3840afbd0 0x7fe3840a88a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fe37c0032f0 tx=0x7fe37c009290).stop 2022-01-10T01:26:16.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 -- 172.21.15.36:0/3519250571 shutdown_connections 2022-01-10T01:26:16.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 --2- 172.21.15.36:0/3519250571 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3840afbd0 0x7fe3840a88a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 --2- 172.21.15.36:0/3519250571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3840b0010 0x7fe3840a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 -- 172.21.15.36:0/3519250571 >> 172.21.15.36:0/3519250571 conn(0x7fe384060180 msgr2=0x7fe3840b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:16.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 -- 172.21.15.36:0/3519250571 shutdown_connections 2022-01-10T01:26:16.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.865+0000 7fe3890d5700 1 -- 172.21.15.36:0/3519250571 wait complete. 2022-01-10T01:26:16.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3890d5700 1 Processor -- start 2022-01-10T01:26:16.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3890d5700 1 -- start start 2022-01-10T01:26:16.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3890d5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3840afbd0 0x7fe384156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3890d5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3840b0010 0x7fe384159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3890d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3840b2580 0x7fe38414b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3890d5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3840a93f0 con 0x7fe3840afbd0 2022-01-10T01:26:16.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3890d5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3841574d0 con 0x7fe3840b0010 2022-01-10T01:26:16.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3890d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38415a250 con 0x7fe3840b2580 2022-01-10T01:26:16.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe383fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3840afbd0 0x7fe384156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe383fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3840afbd0 0x7fe384156f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35696/0 (socket says 172.21.15.36:35696) 2022-01-10T01:26:16.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe383fff700 1 -- 172.21.15.36:0/636240141 learned_addr learned my addr 172.21.15.36:0/636240141 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:16.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3888d4700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3840b2580 0x7fe38414b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3837fe700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3840b0010 0x7fe384159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe383fff700 1 -- 172.21.15.36:0/636240141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3840b2580 msgr2=0x7fe38414b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe383fff700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3840b2580 0x7fe38414b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe383fff700 1 -- 172.21.15.36:0/636240141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3840b0010 msgr2=0x7fe384159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:16.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe383fff700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3840b0010 0x7fe384159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:16.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe383fff700 1 -- 172.21.15.36:0/636240141 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c009530 con 0x7fe3840afbd0 2022-01-10T01:26:16.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3837fe700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3840b0010 0x7fe384159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:16.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3888d4700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3840b2580 0x7fe38414b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:16.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe383fff700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3840afbd0 0x7fe384156f10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fe384061a80 tx=0x7fe378007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:16.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3817fa700 1 -- 172.21.15.36:0/636240141 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37800ce30 con 0x7fe3840afbd0 2022-01-10T01:26:16.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3817fa700 1 -- 172.21.15.36:0/636240141 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37800f470 con 0x7fe3840afbd0 2022-01-10T01:26:16.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3890d5700 1 -- 172.21.15.36:0/636240141 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3840a91e0 con 0x7fe3840afbd0 2022-01-10T01:26:16.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3817fa700 1 -- 172.21.15.36:0/636240141 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37800f7d0 con 0x7fe3840afbd0 2022-01-10T01:26:16.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.869+0000 7fe3890d5700 1 -- 172.21.15.36:0/636240141 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38415a720 con 0x7fe3840afbd0 2022-01-10T01:26:16.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.873+0000 7fe3890d5700 1 -- 172.21.15.36:0/636240141 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38415a8e0 con 0x7fe3840afbd0 2022-01-10T01:26:16.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.873+0000 7fe3817fa700 1 -- 172.21.15.36:0/636240141 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe378019030 con 0x7fe3840afbd0 2022-01-10T01:26:16.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.873+0000 7fe3817fa700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe3640535f0 0x7fe364055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:16.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.873+0000 7fe3817fa700 1 -- 172.21.15.36:0/636240141 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fe37806ac20 con 0x7fe3840afbd0 2022-01-10T01:26:16.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.873+0000 7fe3837fe700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe3640535f0 0x7fe364055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:16.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.877+0000 7fe3837fe700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe3640535f0 0x7fe364055ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fe37400c000 tx=0x7fe374008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:16.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:16.877+0000 7fe3817fa700 1 -- 172.21.15.36:0/636240141 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe378041de0 con 0x7fe3840afbd0 2022-01-10T01:26:17.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.005+0000 7fe3890d5700 1 -- 172.21.15.36:0/636240141 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fe384057350 con 0x7fe3840afbd0 2022-01-10T01:26:17.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.733+0000 7fe3817fa700 1 -- 172.21.15.36:0/636240141 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v42) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe378045400 con 0x7fe3840afbd0 2022-01-10T01:26:17.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.741+0000 7fe3890d5700 1 -- 172.21.15.36:0/636240141 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe3640535f0 msgr2=0x7fe364055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:17.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.741+0000 7fe3890d5700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe3640535f0 0x7fe364055ab0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fe37400c000 tx=0x7fe374008040).stop 2022-01-10T01:26:17.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.741+0000 7fe3890d5700 1 -- 172.21.15.36:0/636240141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3840afbd0 msgr2=0x7fe384156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:17.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.741+0000 7fe3890d5700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3840afbd0 0x7fe384156f10 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fe384061a80 tx=0x7fe378007c50).stop 2022-01-10T01:26:17.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.741+0000 7fe3890d5700 1 -- 172.21.15.36:0/636240141 shutdown_connections 2022-01-10T01:26:17.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.741+0000 7fe3890d5700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe3640535f0 0x7fe364055ab0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:17.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.741+0000 7fe3890d5700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe3840b2580 0x7fe38414b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:17.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.741+0000 7fe3890d5700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3840b0010 0x7fe384159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:17.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.741+0000 7fe3890d5700 1 --2- 172.21.15.36:0/636240141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe3840afbd0 0x7fe384156f10 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:17.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.741+0000 7fe3890d5700 1 -- 172.21.15.36:0/636240141 >> 172.21.15.36:0/636240141 conn(0x7fe384060180 msgr2=0x7fe384146890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:17.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.741+0000 7fe3890d5700 1 -- 172.21.15.36:0/636240141 shutdown_connections 2022-01-10T01:26:17.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.741+0000 7fe3890d5700 1 -- 172.21.15.36:0/636240141 wait complete. 2022-01-10T01:26:17.748 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:26:17.759 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2022-01-10T01:26:17.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.869+0000 7f8345425700 1 Processor -- start 2022-01-10T01:26:17.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.869+0000 7f8345425700 1 -- start start 2022-01-10T01:26:17.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f8345425700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f83400b4180 0x7f8340140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:17.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f8345425700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83400b4690 0x7f83400b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:17.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f8345425700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8340143b60 con 0x7f8340146950 2022-01-10T01:26:17.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f8345425700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8340147510 con 0x7f83400b4180 2022-01-10T01:26:17.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f8345425700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8340143e00 con 0x7f83400b4690 2022-01-10T01:26:17.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f833e7fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f83400b4180 0x7f8340140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:17.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f833e7fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f83400b4180 0x7f8340140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35706/0 (socket says 172.21.15.36:35706) 2022-01-10T01:26:17.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f833e7fc700 1 -- 172.21.15.36:0/2082937297 learned_addr learned my addr 172.21.15.36:0/2082937297 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:17.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f833f7fe700 1 --2- 172.21.15.36:0/2082937297 >> v2:172.21.15.59:3300/0 conn(0x7f83400b4690 0x7f83400b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:17.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f833e7fc700 1 -- 172.21.15.36:0/2082937297 >> v2:172.21.15.59:3300/0 conn(0x7f83400b4690 msgr2=0x7f83400b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:17.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f833e7fc700 1 --2- 172.21.15.36:0/2082937297 >> v2:172.21.15.59:3300/0 conn(0x7f83400b4690 0x7f83400b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:17.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f833e7fc700 1 -- 172.21.15.36:0/2082937297 >> v1:172.21.15.59:6789/0 conn(0x7f8340146950 legacy=0x7f8340140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:17.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f833e7fc700 1 -- 172.21.15.36:0/2082937297 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83400b0c90 con 0x7f83400b4180 2022-01-10T01:26:17.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f833f7fe700 1 --2- 172.21.15.36:0/2082937297 >> v2:172.21.15.59:3300/0 conn(0x7f83400b4690 0x7f83400b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:26:17.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f833e7fc700 1 --2- 172.21.15.36:0/2082937297 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83400b4180 0x7f8340140940 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f8334002f70 tx=0x7f8334006eb0).ready entity=mon.0 client_cookie=74ae2c07dae2923e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:17.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f833dffb700 1 -- 172.21.15.36:0/2082937297 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f833400d5c0 con 0x7f83400b4180 2022-01-10T01:26:17.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f833dffb700 1 -- 172.21.15.36:0/2082937297 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8334000e90 con 0x7f83400b4180 2022-01-10T01:26:17.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f833dffb700 1 -- 172.21.15.36:0/2082937297 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f833400d950 con 0x7f83400b4180 2022-01-10T01:26:17.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f8345425700 1 -- 172.21.15.36:0/2082937297 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83400b4180 msgr2=0x7f8340140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:17.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.873+0000 7f8345425700 1 --2- 172.21.15.36:0/2082937297 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83400b4180 0x7f8340140940 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f8334002f70 tx=0x7f8334006eb0).stop 2022-01-10T01:26:17.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f8345425700 1 -- 172.21.15.36:0/2082937297 shutdown_connections 2022-01-10T01:26:17.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f8345425700 1 --2- 172.21.15.36:0/2082937297 >> v2:172.21.15.59:3300/0 conn(0x7f83400b4690 0x7f83400b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:17.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f8345425700 1 --2- 172.21.15.36:0/2082937297 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83400b4180 0x7f8340140940 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:17.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f8345425700 1 -- 172.21.15.36:0/2082937297 >> 172.21.15.36:0/2082937297 conn(0x7f834005c490 msgr2=0x7f834005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:17.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f8345425700 1 -- 172.21.15.36:0/2082937297 shutdown_connections 2022-01-10T01:26:17.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f8345425700 1 -- 172.21.15.36:0/2082937297 wait complete. 2022-01-10T01:26:17.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f8345425700 1 Processor -- start 2022-01-10T01:26:17.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f8345425700 1 -- start start 2022-01-10T01:26:17.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f8345425700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83400b4180 0x7f83400b9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:17.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f8345425700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83400b4690 0x7f83400b94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:17.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f8345425700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8340146950 0x7f8340152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:17.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f8345425700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8340153060 con 0x7f83400b4690 2022-01-10T01:26:17.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f8345425700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400adfe0 con 0x7f8340146950 2022-01-10T01:26:17.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f8345425700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83400ae280 con 0x7f83400b4180 2022-01-10T01:26:17.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f833e7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83400b4690 0x7f83400b94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:17.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f833e7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83400b4690 0x7f83400b94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35712/0 (socket says 172.21.15.36:35712) 2022-01-10T01:26:17.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f833e7fc700 1 -- 172.21.15.36:0/772936408 learned_addr learned my addr 172.21.15.36:0/772936408 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:17.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f833f7fe700 1 --2- 172.21.15.36:0/772936408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8340146950 0x7f8340152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:17.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f833effd700 1 --2- 172.21.15.36:0/772936408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83400b4180 0x7f83400b9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:17.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f833e7fc700 1 -- 172.21.15.36:0/772936408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83400b4180 msgr2=0x7f83400b9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:17.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f833e7fc700 1 --2- 172.21.15.36:0/772936408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83400b4180 0x7f83400b9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:17.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f833e7fc700 1 -- 172.21.15.36:0/772936408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8340146950 msgr2=0x7f8340152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:17.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.877+0000 7f833e7fc700 1 --2- 172.21.15.36:0/772936408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8340146950 0x7f8340152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:17.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.881+0000 7f833e7fc700 1 -- 172.21.15.36:0/772936408 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8338009470 con 0x7f83400b4690 2022-01-10T01:26:17.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.881+0000 7f833e7fc700 1 --2- 172.21.15.36:0/772936408 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83400b4690 0x7f83400b94f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f8334002f70 tx=0x7f8334015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:17.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.881+0000 7f832ffff700 1 -- 172.21.15.36:0/772936408 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f833400d940 con 0x7f83400b4690 2022-01-10T01:26:17.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.881+0000 7f832ffff700 1 -- 172.21.15.36:0/772936408 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8334011c30 con 0x7f83400b4690 2022-01-10T01:26:17.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.881+0000 7f832ffff700 1 -- 172.21.15.36:0/772936408 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f833401e460 con 0x7f83400b4690 2022-01-10T01:26:17.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.881+0000 7f8345425700 1 -- 172.21.15.36:0/772936408 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f833400b1e0 con 0x7f83400b4690 2022-01-10T01:26:17.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.881+0000 7f8345425700 1 -- 172.21.15.36:0/772936408 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83400adaa0 con 0x7f83400b4690 2022-01-10T01:26:17.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.881+0000 7f8345425700 1 -- 172.21.15.36:0/772936408 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8340153260 con 0x7f83400b4690 2022-01-10T01:26:17.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.881+0000 7f832ffff700 1 -- 172.21.15.36:0/772936408 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f833401a040 con 0x7f83400b4690 2022-01-10T01:26:17.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.881+0000 7f832ffff700 1 --2- 172.21.15.36:0/772936408 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f831c0535f0 0x7f831c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:17.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.881+0000 7f832ffff700 1 -- 172.21.15.36:0/772936408 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f833406c7b0 con 0x7f83400b4690 2022-01-10T01:26:17.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.881+0000 7f833effd700 1 --2- 172.21.15.36:0/772936408 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f831c0535f0 0x7f831c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:17.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.881+0000 7f833effd700 1 --2- 172.21.15.36:0/772936408 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f831c0535f0 0x7f831c055ab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f833000d000 tx=0x7f8330009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:17.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:17.885+0000 7f832ffff700 1 -- 172.21.15.36:0/772936408 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f83340472b0 con 0x7f83400b4690 2022-01-10T01:26:18.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.017+0000 7f8345425700 1 -- 172.21.15.36:0/772936408 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f83400ae440 con 0x7f83400b4690 2022-01-10T01:26:18.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.281+0000 7f832ffff700 1 -- 172.21.15.36:0/772936408 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v43) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8334023020 con 0x7f83400b4690 2022-01-10T01:26:18.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.289+0000 7f8345425700 1 -- 172.21.15.36:0/772936408 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f831c0535f0 msgr2=0x7f831c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:18.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.289+0000 7f8345425700 1 --2- 172.21.15.36:0/772936408 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f831c0535f0 0x7f831c055ab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f833000d000 tx=0x7f8330009040).stop 2022-01-10T01:26:18.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.289+0000 7f8345425700 1 -- 172.21.15.36:0/772936408 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83400b4690 msgr2=0x7f83400b94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:18.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.289+0000 7f8345425700 1 --2- 172.21.15.36:0/772936408 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83400b4690 0x7f83400b94f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f8334002f70 tx=0x7f8334015000).stop 2022-01-10T01:26:18.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.289+0000 7f8345425700 1 -- 172.21.15.36:0/772936408 shutdown_connections 2022-01-10T01:26:18.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.289+0000 7f8345425700 1 --2- 172.21.15.36:0/772936408 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f831c0535f0 0x7f831c055ab0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.289+0000 7f8345425700 1 --2- 172.21.15.36:0/772936408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8340146950 0x7f8340152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.289+0000 7f8345425700 1 --2- 172.21.15.36:0/772936408 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83400b4690 0x7f83400b94f0 secure :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0x7f8334002f70 tx=0x7f8334015000).stop 2022-01-10T01:26:18.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.289+0000 7f8345425700 1 --2- 172.21.15.36:0/772936408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83400b4180 0x7f83400b9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.289+0000 7f8345425700 1 -- 172.21.15.36:0/772936408 >> 172.21.15.36:0/772936408 conn(0x7f834005c490 msgr2=0x7f834013f580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:18.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.289+0000 7f8345425700 1 -- 172.21.15.36:0/772936408 shutdown_connections 2022-01-10T01:26:18.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.289+0000 7f8345425700 1 -- 172.21.15.36:0/772936408 wait complete. 2022-01-10T01:26:18.295 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' created 2022-01-10T01:26:18.307 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-10T01:26:18.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f099063c700 1 Processor -- start 2022-01-10T01:26:18.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f099063c700 1 -- start start 2022-01-10T01:26:18.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f099063c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f09880b6580 0x7f09880b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f099063c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09880b43c0 0x7f09880b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f099063c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09881440b0 con 0x7f0988061d30 2022-01-10T01:26:18.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f099063c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09880b6e50 con 0x7f09880b6580 2022-01-10T01:26:18.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f099063c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0988143b70 con 0x7f09880b43c0 2022-01-10T01:26:18.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f098e3d8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f09880b6580 0x7f09880b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:18.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f098e3d8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f09880b6580 0x7f09880b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35718/0 (socket says 172.21.15.36:35718) 2022-01-10T01:26:18.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f098e3d8700 1 -- 172.21.15.36:0/2543459196 learned_addr learned my addr 172.21.15.36:0/2543459196 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:18.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f098dbd7700 1 --2- 172.21.15.36:0/2543459196 >> v2:172.21.15.59:3300/0 conn(0x7f09880b43c0 0x7f09880b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:18.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f098e3d8700 1 -- 172.21.15.36:0/2543459196 >> v2:172.21.15.59:3300/0 conn(0x7f09880b43c0 msgr2=0x7f09880b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:18.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f098e3d8700 1 --2- 172.21.15.36:0/2543459196 >> v2:172.21.15.59:3300/0 conn(0x7f09880b43c0 0x7f09880b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f098e3d8700 1 -- 172.21.15.36:0/2543459196 >> v1:172.21.15.59:6789/0 conn(0x7f0988061d30 legacy=0x7f09881466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:18.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f098e3d8700 1 -- 172.21.15.36:0/2543459196 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988143e10 con 0x7f09880b6580 2022-01-10T01:26:18.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f098e3d8700 1 --2- 172.21.15.36:0/2543459196 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09880b6580 0x7f09880b5bf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f0988143120 tx=0x7f0984006eb0).ready entity=mon.0 client_cookie=7c481c3cd36e3e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:18.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f098d3d6700 1 -- 172.21.15.36:0/2543459196 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f098400d610 con 0x7f09880b6580 2022-01-10T01:26:18.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f098d3d6700 1 -- 172.21.15.36:0/2543459196 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0984000e90 con 0x7f09880b6580 2022-01-10T01:26:18.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f098d3d6700 1 -- 172.21.15.36:0/2543459196 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f098400d9a0 con 0x7f09880b6580 2022-01-10T01:26:18.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f099063c700 1 -- 172.21.15.36:0/2543459196 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09880b6580 msgr2=0x7f09880b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:18.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f099063c700 1 --2- 172.21.15.36:0/2543459196 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09880b6580 0x7f09880b5bf0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f0988143120 tx=0x7f0984006eb0).stop 2022-01-10T01:26:18.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f099063c700 1 -- 172.21.15.36:0/2543459196 shutdown_connections 2022-01-10T01:26:18.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f099063c700 1 --2- 172.21.15.36:0/2543459196 >> v2:172.21.15.59:3300/0 conn(0x7f09880b43c0 0x7f09880b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f099063c700 1 --2- 172.21.15.36:0/2543459196 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09880b6580 0x7f09880b5bf0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.409+0000 7f099063c700 1 -- 172.21.15.36:0/2543459196 >> 172.21.15.36:0/2543459196 conn(0x7f098805c490 msgr2=0x7f098805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:18.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f099063c700 1 -- 172.21.15.36:0/2543459196 shutdown_connections 2022-01-10T01:26:18.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f099063c700 1 -- 172.21.15.36:0/2543459196 wait complete. 2022-01-10T01:26:18.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f099063c700 1 Processor -- start 2022-01-10T01:26:18.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f099063c700 1 -- start start 2022-01-10T01:26:18.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f099063c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0988061d30 0x7f0988128aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f099063c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09880b43c0 0x7f09880b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f099063c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09880b6580 0x7f09881466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f099063c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880b29b0 con 0x7f09880b6580 2022-01-10T01:26:18.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f099063c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880b2e80 con 0x7f09880b43c0 2022-01-10T01:26:18.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f099063c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09880b3120 con 0x7f0988061d30 2022-01-10T01:26:18.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f098ebd9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09880b6580 0x7f09881466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:18.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f098e3d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0988061d30 0x7f0988128aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:18.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f098e3d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0988061d30 0x7f0988128aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:42006/0 (socket says 172.21.15.36:42006) 2022-01-10T01:26:18.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f098e3d8700 1 -- 172.21.15.36:0/3757813428 learned_addr learned my addr 172.21.15.36:0/3757813428 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:18.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f098ebd9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09880b6580 0x7f09881466c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35728/0 (socket says 172.21.15.36:35728) 2022-01-10T01:26:18.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.413+0000 7f098dbd7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09880b43c0 0x7f09880b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:18.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.417+0000 7f098e3d8700 1 -- 172.21.15.36:0/3757813428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09880b43c0 msgr2=0x7f09880b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:18.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.417+0000 7f098e3d8700 1 --2- 172.21.15.36:0/3757813428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09880b43c0 0x7f09880b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.417+0000 7f098e3d8700 1 -- 172.21.15.36:0/3757813428 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09880b6580 msgr2=0x7f09881466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:18.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.417+0000 7f098e3d8700 1 --2- 172.21.15.36:0/3757813428 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09880b6580 0x7f09881466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.417+0000 7f098e3d8700 1 -- 172.21.15.36:0/3757813428 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098400b1e0 con 0x7f0988061d30 2022-01-10T01:26:18.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.417+0000 7f098e3d8700 1 --2- 172.21.15.36:0/3757813428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0988061d30 0x7f0988128aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f0988143120 tx=0x7f0984015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:18.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.417+0000 7f09777fe700 1 -- 172.21.15.36:0/3757813428 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0984011860 con 0x7f0988061d30 2022-01-10T01:26:18.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.417+0000 7f09777fe700 1 -- 172.21.15.36:0/3757813428 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09840119c0 con 0x7f0988061d30 2022-01-10T01:26:18.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.417+0000 7f099063c700 1 -- 172.21.15.36:0/3757813428 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09880b33c0 con 0x7f0988061d30 2022-01-10T01:26:18.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.417+0000 7f09777fe700 1 -- 172.21.15.36:0/3757813428 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0984011d20 con 0x7f0988061d30 2022-01-10T01:26:18.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.417+0000 7f099063c700 1 -- 172.21.15.36:0/3757813428 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09880b1cc0 con 0x7f0988061d30 2022-01-10T01:26:18.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.417+0000 7f099063c700 1 -- 172.21.15.36:0/3757813428 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09880615f0 con 0x7f0988061d30 2022-01-10T01:26:18.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.421+0000 7f09777fe700 1 -- 172.21.15.36:0/3757813428 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0984025030 con 0x7f0988061d30 2022-01-10T01:26:18.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.421+0000 7f09777fe700 1 --2- 172.21.15.36:0/3757813428 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f09680535f0 0x7f0968055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.421+0000 7f09777fe700 1 -- 172.21.15.36:0/3757813428 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f098406ca60 con 0x7f0988061d30 2022-01-10T01:26:18.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.421+0000 7f098dbd7700 1 --2- 172.21.15.36:0/3757813428 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f09680535f0 0x7f0968055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:18.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.421+0000 7f098dbd7700 1 --2- 172.21.15.36:0/3757813428 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f09680535f0 0x7f0968055ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f097800b000 tx=0x7f0978006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:18.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.429+0000 7f09777fe700 1 -- 172.21.15.36:0/3757813428 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0984043af0 con 0x7f0988061d30 2022-01-10T01:26:18.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.593+0000 7f099063c700 1 -- 172.21.15.36:0/3757813428 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f0988057350 con 0x7f0988061d30 2022-01-10T01:26:18.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.605+0000 7f09777fe700 1 -- 172.21.15.36:0/3757813428 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 7 and data pool 8 v17) v1 ==== 187+0+0 (secure 0 0 0) 0x7f0984023020 con 0x7f0988061d30 2022-01-10T01:26:18.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.609+0000 7f099063c700 1 -- 172.21.15.36:0/3757813428 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f09680535f0 msgr2=0x7f0968055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:18.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.609+0000 7f099063c700 1 --2- 172.21.15.36:0/3757813428 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f09680535f0 0x7f0968055ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f097800b000 tx=0x7f0978006df0).stop 2022-01-10T01:26:18.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.609+0000 7f099063c700 1 -- 172.21.15.36:0/3757813428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0988061d30 msgr2=0x7f0988128aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:18.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.609+0000 7f099063c700 1 --2- 172.21.15.36:0/3757813428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0988061d30 0x7f0988128aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f0988143120 tx=0x7f0984015000).stop 2022-01-10T01:26:18.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.613+0000 7f099063c700 1 -- 172.21.15.36:0/3757813428 shutdown_connections 2022-01-10T01:26:18.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.613+0000 7f099063c700 1 --2- 172.21.15.36:0/3757813428 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f09680535f0 0x7f0968055ab0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.613+0000 7f099063c700 1 --2- 172.21.15.36:0/3757813428 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09880b6580 0x7f09881466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.613+0000 7f099063c700 1 --2- 172.21.15.36:0/3757813428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09880b43c0 0x7f09880b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.613+0000 7f099063c700 1 --2- 172.21.15.36:0/3757813428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0988061d30 0x7f0988128aa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.613+0000 7f099063c700 1 -- 172.21.15.36:0/3757813428 >> 172.21.15.36:0/3757813428 conn(0x7f098805c490 msgr2=0x7f0988126fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:18.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.613+0000 7f099063c700 1 -- 172.21.15.36:0/3757813428 shutdown_connections 2022-01-10T01:26:18.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.613+0000 7f099063c700 1 -- 172.21.15.36:0/3757813428 wait complete. 2022-01-10T01:26:18.617 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 7 and data pool 8 2022-01-10T01:26:18.629 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:26:18.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.721+0000 7fa45b59e700 1 Processor -- start 2022-01-10T01:26:18.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.721+0000 7fa45b59e700 1 -- start start 2022-01-10T01:26:18.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.721+0000 7fa45b59e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa45c0b3040 0x7fa45c065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.721+0000 7fa45b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45c0a9c10 0x7fa45c0607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.721+0000 7fa45b59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa45c143320 0x7fa45c1437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.721+0000 7fa45b59e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45c0648e0 con 0x7fa45c0b3040 2022-01-10T01:26:18.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.721+0000 7fa45b59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45c061dd0 con 0x7fa45c143320 2022-01-10T01:26:18.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.721+0000 7fa45b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c066ea0 con 0x7fa45c0a9c10 2022-01-10T01:26:18.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.721+0000 7fa45a59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa45c0b3040 0x7fa45c065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:18.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.721+0000 7fa45a59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa45c0b3040 0x7fa45c065e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35734/0 (socket says 172.21.15.36:35734) 2022-01-10T01:26:18.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.721+0000 7fa45a59c700 1 -- 172.21.15.36:0/2470068871 learned_addr learned my addr 172.21.15.36:0/2470068871 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:18.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa459d9b700 1 --2- 172.21.15.36:0/2470068871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45c0a9c10 0x7fa45c0607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:18.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45ad9d700 1 --2- 172.21.15.36:0/2470068871 >> v2:172.21.15.59:3300/0 conn(0x7fa45c143320 0x7fa45c1437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:18.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45a59c700 1 -- 172.21.15.36:0/2470068871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45c0a9c10 msgr2=0x7fa45c0607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:18.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45a59c700 1 --2- 172.21.15.36:0/2470068871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45c0a9c10 0x7fa45c0607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45a59c700 1 -- 172.21.15.36:0/2470068871 >> v2:172.21.15.59:3300/0 conn(0x7fa45c143320 msgr2=0x7fa45c1437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:18.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45a59c700 1 --2- 172.21.15.36:0/2470068871 >> v2:172.21.15.59:3300/0 conn(0x7fa45c143320 0x7fa45c1437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45a59c700 1 -- 172.21.15.36:0/2470068871 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c0b3420 con 0x7fa45c0b3040 2022-01-10T01:26:18.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa459d9b700 1 --2- 172.21.15.36:0/2470068871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45c0a9c10 0x7fa45c0607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:26:18.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45a59c700 1 --2- 172.21.15.36:0/2470068871 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa45c0b3040 0x7fa45c065e90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fa44c002f70 tx=0x7fa44c006eb0).ready entity=mon.0 client_cookie=5ca992160ec723a7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:18.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45959a700 1 -- 172.21.15.36:0/2470068871 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa44c00d570 con 0x7fa45c0b3040 2022-01-10T01:26:18.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45959a700 1 -- 172.21.15.36:0/2470068871 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c000e90 con 0x7fa45c0b3040 2022-01-10T01:26:18.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45959a700 1 -- 172.21.15.36:0/2470068871 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa44c00d900 con 0x7fa45c0b3040 2022-01-10T01:26:18.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45b59e700 1 -- 172.21.15.36:0/2470068871 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa45c0b3040 msgr2=0x7fa45c065e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:18.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45b59e700 1 --2- 172.21.15.36:0/2470068871 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa45c0b3040 0x7fa45c065e90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fa44c002f70 tx=0x7fa44c006eb0).stop 2022-01-10T01:26:18.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45b59e700 1 -- 172.21.15.36:0/2470068871 shutdown_connections 2022-01-10T01:26:18.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45b59e700 1 --2- 172.21.15.36:0/2470068871 >> v2:172.21.15.59:3300/0 conn(0x7fa45c143320 0x7fa45c1437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45b59e700 1 --2- 172.21.15.36:0/2470068871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45c0a9c10 0x7fa45c0607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45b59e700 1 --2- 172.21.15.36:0/2470068871 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa45c0b3040 0x7fa45c065e90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45b59e700 1 -- 172.21.15.36:0/2470068871 >> 172.21.15.36:0/2470068871 conn(0x7fa45c0636e0 msgr2=0x7fa45c063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:18.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45b59e700 1 -- 172.21.15.36:0/2470068871 shutdown_connections 2022-01-10T01:26:18.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.725+0000 7fa45b59e700 1 -- 172.21.15.36:0/2470068871 wait complete. 2022-01-10T01:26:18.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45b59e700 1 Processor -- start 2022-01-10T01:26:18.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45b59e700 1 -- start start 2022-01-10T01:26:18.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45b59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c0a9c10 0x7fa45c0aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45c0b3040 0x7fa45c0b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa45c143320 0x7fa45c152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45b59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c0a0920 con 0x7fa45c143320 2022-01-10T01:26:18.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45b59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c0af7d0 con 0x7fa45c0a9c10 2022-01-10T01:26:18.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c0afa70 con 0x7fa45c0b3040 2022-01-10T01:26:18.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45ad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa45c143320 0x7fa45c152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:18.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45ad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa45c143320 0x7fa45c152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35744/0 (socket says 172.21.15.36:35744) 2022-01-10T01:26:18.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45ad9d700 1 -- 172.21.15.36:0/3445994690 learned_addr learned my addr 172.21.15.36:0/3445994690 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:18.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45a59c700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c0a9c10 0x7fa45c0aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:18.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa459d9b700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45c0b3040 0x7fa45c0b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:18.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45ad9d700 1 -- 172.21.15.36:0/3445994690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45c0b3040 msgr2=0x7fa45c0b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:18.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45ad9d700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45c0b3040 0x7fa45c0b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45ad9d700 1 -- 172.21.15.36:0/3445994690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c0a9c10 msgr2=0x7fa45c0aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:18.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45ad9d700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c0a9c10 0x7fa45c0aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45ad9d700 1 -- 172.21.15.36:0/3445994690 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44c00b1e0 con 0x7fa45c143320 2022-01-10T01:26:18.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa459d9b700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45c0b3040 0x7fa45c0b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:18.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45ad9d700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa45c143320 0x7fa45c152230 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fa45400a000 tx=0x7fa454008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:18.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa44b7fe700 1 -- 172.21.15.36:0/3445994690 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4540127e0 con 0x7fa45c143320 2022-01-10T01:26:18.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa44b7fe700 1 -- 172.21.15.36:0/3445994690 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa454012940 con 0x7fa45c143320 2022-01-10T01:26:18.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45b59e700 1 -- 172.21.15.36:0/3445994690 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45c0ae330 con 0x7fa45c143320 2022-01-10T01:26:18.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa44b7fe700 1 -- 172.21.15.36:0/3445994690 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa454012ca0 con 0x7fa45c143320 2022-01-10T01:26:18.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.729+0000 7fa45b59e700 1 -- 172.21.15.36:0/3445994690 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45c0ae870 con 0x7fa45c143320 2022-01-10T01:26:18.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.733+0000 7fa45b59e700 1 -- 172.21.15.36:0/3445994690 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45c0aea30 con 0x7fa45c143320 2022-01-10T01:26:18.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.733+0000 7fa44b7fe700 1 -- 172.21.15.36:0/3445994690 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa454013480 con 0x7fa45c143320 2022-01-10T01:26:18.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.733+0000 7fa44b7fe700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa438053560 0x7fa438055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.733+0000 7fa45a59c700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa438053560 0x7fa438055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:18.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.733+0000 7fa44b7fe700 1 -- 172.21.15.36:0/3445994690 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa45406be80 con 0x7fa45c143320 2022-01-10T01:26:18.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.733+0000 7fa45a59c700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa438053560 0x7fa438055a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fa44c01c000 tx=0x7fa44c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:18.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.745+0000 7fa44b7fe700 1 -- 172.21.15.36:0/3445994690 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa454042d90 con 0x7fa45c143320 2022-01-10T01:26:18.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.869+0000 7fa45b59e700 1 -- 172.21.15.36:0/3445994690 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa45c066960 con 0x7fa45c143320 2022-01-10T01:26:18.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.869+0000 7fa44b7fe700 1 -- 172.21.15.36:0/3445994690 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16297 (secure 0 0 0) 0x7fa454012e00 con 0x7fa45c143320 2022-01-10T01:26:18.873 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:18.873 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":45,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:26:18.598263+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:26:17.063945+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2022-01-10T01:26:18.074904+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:26:18.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.869+0000 7fa45b59e700 1 -- 172.21.15.36:0/3445994690 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa438053560 msgr2=0x7fa438055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:18.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.869+0000 7fa45b59e700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa438053560 0x7fa438055a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fa44c01c000 tx=0x7fa44c015000).stop 2022-01-10T01:26:18.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.869+0000 7fa45b59e700 1 -- 172.21.15.36:0/3445994690 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa45c143320 msgr2=0x7fa45c152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:18.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.869+0000 7fa45b59e700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa45c143320 0x7fa45c152230 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fa45400a000 tx=0x7fa454008040).stop 2022-01-10T01:26:18.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.869+0000 7fa45b59e700 1 -- 172.21.15.36:0/3445994690 shutdown_connections 2022-01-10T01:26:18.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.869+0000 7fa45b59e700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa438053560 0x7fa438055a20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.869+0000 7fa45b59e700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa45c143320 0x7fa45c152230 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.869+0000 7fa45b59e700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45c0b3040 0x7fa45c0b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.869+0000 7fa45b59e700 1 --2- 172.21.15.36:0/3445994690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa45c0a9c10 0x7fa45c0aff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:18.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.869+0000 7fa45b59e700 1 -- 172.21.15.36:0/3445994690 >> 172.21.15.36:0/3445994690 conn(0x7fa45c0636e0 msgr2=0x7fa45c142920 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:18.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.869+0000 7fa45b59e700 1 -- 172.21.15.36:0/3445994690 shutdown_connections 2022-01-10T01:26:18.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.869+0000 7fa45b59e700 1 -- 172.21.15.36:0/3445994690 wait complete. 2022-01-10T01:26:18.886 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:26:18.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.985+0000 7fad44584700 1 Processor -- start 2022-01-10T01:26:18.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.985+0000 7fad44584700 1 -- start start 2022-01-10T01:26:18.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad44584700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad3c0b1db0 0x7fad3c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad44584700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fad3c1483a0 0x7fad3c0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:18.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad44584700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad3c0b0350 con 0x7fad3c0a70c0 2022-01-10T01:26:19.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad44584700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3c0a90c0 con 0x7fad3c1483a0 2022-01-10T01:26:19.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad44584700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad3c0b05f0 con 0x7fad3c0b1db0 2022-01-10T01:26:19.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad41b1f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fad3c1483a0 0x7fad3c0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad41b1f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fad3c1483a0 0x7fad3c0b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35748/0 (socket says 172.21.15.36:35748) 2022-01-10T01:26:19.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad41b1f700 1 -- 172.21.15.36:0/2873049830 learned_addr learned my addr 172.21.15.36:0/2873049830 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:19.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad42320700 1 --2- 172.21.15.36:0/2873049830 >> v2:172.21.15.59:3300/0 conn(0x7fad3c0b1db0 0x7fad3c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad41b1f700 1 -- 172.21.15.36:0/2873049830 >> v2:172.21.15.59:3300/0 conn(0x7fad3c0b1db0 msgr2=0x7fad3c0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:19.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad41b1f700 1 --2- 172.21.15.36:0/2873049830 >> v2:172.21.15.59:3300/0 conn(0x7fad3c0b1db0 0x7fad3c0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad41b1f700 1 -- 172.21.15.36:0/2873049830 >> v1:172.21.15.36:6789/0 conn(0x7fad3c0a70c0 legacy=0x7fad3c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad41b1f700 1 -- 172.21.15.36:0/2873049830 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c0b0890 con 0x7fad3c1483a0 2022-01-10T01:26:19.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad42320700 1 --2- 172.21.15.36:0/2873049830 >> v2:172.21.15.59:3300/0 conn(0x7fad3c0b1db0 0x7fad3c0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:19.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad41b1f700 1 --2- 172.21.15.36:0/2873049830 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad3c1483a0 0x7fad3c0b2190 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fad3c147730 tx=0x7fad38006eb0).ready entity=mon.0 client_cookie=ca2d27568c320260 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:19.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad4131e700 1 -- 172.21.15.36:0/2873049830 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3800d610 con 0x7fad3c1483a0 2022-01-10T01:26:19.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad4131e700 1 -- 172.21.15.36:0/2873049830 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad38000e90 con 0x7fad3c1483a0 2022-01-10T01:26:19.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad4131e700 1 -- 172.21.15.36:0/2873049830 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3800d960 con 0x7fad3c1483a0 2022-01-10T01:26:19.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad44584700 1 -- 172.21.15.36:0/2873049830 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad3c1483a0 msgr2=0x7fad3c0b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad44584700 1 --2- 172.21.15.36:0/2873049830 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad3c1483a0 0x7fad3c0b2190 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fad3c147730 tx=0x7fad38006eb0).stop 2022-01-10T01:26:19.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad44584700 1 -- 172.21.15.36:0/2873049830 shutdown_connections 2022-01-10T01:26:19.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad44584700 1 --2- 172.21.15.36:0/2873049830 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad3c1483a0 0x7fad3c0b2190 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad44584700 1 --2- 172.21.15.36:0/2873049830 >> v2:172.21.15.59:3300/0 conn(0x7fad3c0b1db0 0x7fad3c0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad44584700 1 -- 172.21.15.36:0/2873049830 >> 172.21.15.36:0/2873049830 conn(0x7fad3c05f6b0 msgr2=0x7fad3c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:19.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad44584700 1 -- 172.21.15.36:0/2873049830 shutdown_connections 2022-01-10T01:26:19.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.989+0000 7fad44584700 1 -- 172.21.15.36:0/2873049830 wait complete. 2022-01-10T01:26:19.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad44584700 1 Processor -- start 2022-01-10T01:26:19.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad44584700 1 -- start start 2022-01-10T01:26:19.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad44584700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3c0a70c0 0x7fad3c1492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad44584700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3c0b1db0 0x7fad3c0ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad44584700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad3c1483a0 0x7fad3c0ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad44584700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c0a9ec0 con 0x7fad3c1483a0 2022-01-10T01:26:19.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad44584700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c0ae980 con 0x7fad3c0b1db0 2022-01-10T01:26:19.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad44584700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3c0afc80 con 0x7fad3c0a70c0 2022-01-10T01:26:19.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad42b21700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad3c1483a0 0x7fad3c0ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad42b21700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad3c1483a0 0x7fad3c0ab7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35758/0 (socket says 172.21.15.36:35758) 2022-01-10T01:26:19.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad42b21700 1 -- 172.21.15.36:0/2079461674 learned_addr learned my addr 172.21.15.36:0/2079461674 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:19.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad42320700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3c0a70c0 0x7fad3c1492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad41b1f700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3c0b1db0 0x7fad3c0ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad42b21700 1 -- 172.21.15.36:0/2079461674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3c0a70c0 msgr2=0x7fad3c1492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad42b21700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3c0a70c0 0x7fad3c1492a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad42b21700 1 -- 172.21.15.36:0/2079461674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3c0b1db0 msgr2=0x7fad3c0ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad42b21700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3c0b1db0 0x7fad3c0ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad42b21700 1 -- 172.21.15.36:0/2079461674 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3800b1e0 con 0x7fad3c1483a0 2022-01-10T01:26:19.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad42320700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3c0a70c0 0x7fad3c1492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:19.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad41b1f700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3c0b1db0 0x7fad3c0ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:19.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad42b21700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad3c1483a0 0x7fad3c0ab7a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fad3c0ace60 tx=0x7fad34007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:19.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad2b7fe700 1 -- 172.21.15.36:0/2079461674 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3400e4a0 con 0x7fad3c1483a0 2022-01-10T01:26:19.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad2b7fe700 1 -- 172.21.15.36:0/2079461674 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3400e600 con 0x7fad3c1483a0 2022-01-10T01:26:19.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad44584700 1 -- 172.21.15.36:0/2079461674 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3c0af9e0 con 0x7fad3c1483a0 2022-01-10T01:26:19.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad2b7fe700 1 -- 172.21.15.36:0/2079461674 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3400e960 con 0x7fad3c1483a0 2022-01-10T01:26:19.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.993+0000 7fad44584700 1 -- 172.21.15.36:0/2079461674 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3c0adf60 con 0x7fad3c1483a0 2022-01-10T01:26:19.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.997+0000 7fad44584700 1 -- 172.21.15.36:0/2079461674 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad3c0aed80 con 0x7fad3c1483a0 2022-01-10T01:26:19.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.997+0000 7fad2b7fe700 1 -- 172.21.15.36:0/2079461674 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fad34019030 con 0x7fad3c1483a0 2022-01-10T01:26:19.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.997+0000 7fad2b7fe700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad1c053680 0x7fad1c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.997+0000 7fad42320700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad1c053680 0x7fad1c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.997+0000 7fad2b7fe700 1 -- 172.21.15.36:0/2079461674 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fad3406b2d0 con 0x7fad3c1483a0 2022-01-10T01:26:19.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:18.997+0000 7fad42320700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad1c053680 0x7fad1c055b40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fad2c00c000 tx=0x7fad2c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:19.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.001+0000 7fad2b7fe700 1 -- 172.21.15.36:0/2079461674 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fad34042170 con 0x7fad3c1483a0 2022-01-10T01:26:19.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.129+0000 7fad44584700 1 -- 172.21.15.36:0/2079461674 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad3c0b0b30 con 0x7fad3c1483a0 2022-01-10T01:26:19.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.129+0000 7fad2b7fe700 1 -- 172.21.15.36:0/2079461674 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16297 (secure 0 0 0) 0x7fad34045790 con 0x7fad3c1483a0 2022-01-10T01:26:19.134 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:19.135 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":45,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:26:18.598263+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:26:17.063945+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2022-01-10T01:26:18.074904+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:26:19.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.133+0000 7fad44584700 1 -- 172.21.15.36:0/2079461674 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad1c053680 msgr2=0x7fad1c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.133+0000 7fad44584700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad1c053680 0x7fad1c055b40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fad2c00c000 tx=0x7fad2c008040).stop 2022-01-10T01:26:19.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.133+0000 7fad44584700 1 -- 172.21.15.36:0/2079461674 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad3c1483a0 msgr2=0x7fad3c0ab7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.133+0000 7fad44584700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad3c1483a0 0x7fad3c0ab7a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fad3c0ace60 tx=0x7fad34007f40).stop 2022-01-10T01:26:19.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.133+0000 7fad44584700 1 -- 172.21.15.36:0/2079461674 shutdown_connections 2022-01-10T01:26:19.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.133+0000 7fad44584700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad1c053680 0x7fad1c055b40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.133+0000 7fad44584700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad3c1483a0 0x7fad3c0ab7a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.133+0000 7fad44584700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad3c0b1db0 0x7fad3c0ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.133+0000 7fad44584700 1 --2- 172.21.15.36:0/2079461674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad3c0a70c0 0x7fad3c1492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.133+0000 7fad44584700 1 -- 172.21.15.36:0/2079461674 >> 172.21.15.36:0/2079461674 conn(0x7fad3c05f6b0 msgr2=0x7fad3c0b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:19.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.133+0000 7fad44584700 1 -- 172.21.15.36:0/2079461674 shutdown_connections 2022-01-10T01:26:19.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.133+0000 7fad44584700 1 -- 172.21.15.36:0/2079461674 wait complete. 2022-01-10T01:26:19.148 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-01-10T01:26:19.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450f59e700 1 Processor -- start 2022-01-10T01:26:19.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450f59e700 1 -- start start 2022-01-10T01:26:19.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45100b0010 0x7f45100a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450f59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45100a70c0 con 0x7f45100afbd0 2022-01-10T01:26:19.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450f59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45100a72f0 con 0x7f45100b2580 2022-01-10T01:26:19.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45100a7590 con 0x7f45100b0010 2022-01-10T01:26:19.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450ed9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f45100afbd0 0x7f4510151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33560/0 (socket says 172.21.15.36:33560) 2022-01-10T01:26:19.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450ed9d700 1 -- 172.21.15.36:0/4114970822 learned_addr learned my addr 172.21.15.36:0/4114970822 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:19.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450dd9b700 1 --2- 172.21.15.36:0/4114970822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45100b0010 0x7f45100a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392160455 0 0) 0x7f45100a70c0 con 0x7f45100afbd0 2022-01-10T01:26:19.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44f0003260 con 0x7f45100afbd0 2022-01-10T01:26:19.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109798240 0 0) 0x7f45100a72f0 con 0x7f45100b2580 2022-01-10T01:26:19.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45100a70c0 con 0x7f45100b2580 2022-01-10T01:26:19.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 720495379 0 0) 0x7f44f0003260 con 0x7f45100afbd0 2022-01-10T01:26:19.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45100b0010 msgr2=0x7f45100a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:19.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 --2- 172.21.15.36:0/4114970822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45100b0010 0x7f45100a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 >> v1:172.21.15.59:6789/0 conn(0x7f45100b2580 legacy=0x7f451014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45100a7830 con 0x7f45100afbd0 2022-01-10T01:26:19.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f45080019e0 con 0x7f45100afbd0 2022-01-10T01:26:19.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 >> v1:172.21.15.36:6789/0 conn(0x7f45100afbd0 legacy=0x7f4510151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 --2- 172.21.15.36:0/4114970822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45100b0010 0x7f44f0003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 --2- 172.21.15.36:0/4114970822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44f0003e20 0x7f44f0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 --2- 172.21.15.36:0/4114970822 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f44f00049f0 0x7f44f0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100a7590 con 0x7f44f00049f0 2022-01-10T01:26:19.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f000b800 con 0x7f44f0003e20 2022-01-10T01:26:19.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f000b9c0 con 0x7f45100b0010 2022-01-10T01:26:19.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450ed9d700 1 --2- 172.21.15.36:0/4114970822 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f44f00049f0 0x7f44f0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.253+0000 7f450e59c700 1 --2- 172.21.15.36:0/4114970822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45100b0010 0x7f44f0003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450dd9b700 1 --2- 172.21.15.36:0/4114970822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44f0003e20 0x7f44f0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450ed9d700 1 -- 172.21.15.36:0/4114970822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45100b0010 msgr2=0x7f44f0003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:19.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450ed9d700 1 --2- 172.21.15.36:0/4114970822 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45100b0010 0x7f44f0003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450ed9d700 1 -- 172.21.15.36:0/4114970822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44f0003e20 msgr2=0x7f44f0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:19.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450ed9d700 1 --2- 172.21.15.36:0/4114970822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44f0003e20 0x7f44f0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450ed9d700 1 -- 172.21.15.36:0/4114970822 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f0003260 con 0x7f44f00049f0 2022-01-10T01:26:19.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450dd9b700 1 --2- 172.21.15.36:0/4114970822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44f0003e20 0x7f44f0004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:26:19.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450ed9d700 1 --2- 172.21.15.36:0/4114970822 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f44f00049f0 0x7f44f0004e70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f45080017b0 tx=0x7f451006a460).ready entity=mon.0 client_cookie=696a23ee4912e12b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:19.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f450800cd10 con 0x7f44f00049f0 2022-01-10T01:26:19.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f450800ce70 con 0x7f44f00049f0 2022-01-10T01:26:19.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450d59a700 1 -- 172.21.15.36:0/4114970822 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4508005b80 con 0x7f44f00049f0 2022-01-10T01:26:19.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450f59e700 1 -- 172.21.15.36:0/4114970822 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f44f00049f0 msgr2=0x7f44f0004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450f59e700 1 --2- 172.21.15.36:0/4114970822 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f44f00049f0 0x7f44f0004e70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f45080017b0 tx=0x7f451006a460).stop 2022-01-10T01:26:19.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450ed9d700 1 -- 172.21.15.36:0/4114970822 reap_dead start 2022-01-10T01:26:19.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450f59e700 1 -- 172.21.15.36:0/4114970822 shutdown_connections 2022-01-10T01:26:19.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450f59e700 1 -- 172.21.15.36:0/4114970822 >> 172.21.15.36:0/4114970822 conn(0x7f4510060180 msgr2=0x7f45100b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:19.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450f59e700 1 -- 172.21.15.36:0/4114970822 shutdown_connections 2022-01-10T01:26:19.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450f59e700 1 -- 172.21.15.36:0/4114970822 wait complete. 2022-01-10T01:26:19.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450f59e700 1 Processor -- start 2022-01-10T01:26:19.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450f59e700 1 -- start start 2022-01-10T01:26:19.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44f00049f0 0x7f45100b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450f59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45100a9fe0 0x7f4510141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45100aa460 0x7f4510141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450f59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100af9f0 con 0x7f45100a9fe0 2022-01-10T01:26:19.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450f59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100b3b30 con 0x7f45100aa460 2022-01-10T01:26:19.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45100b3d60 con 0x7f44f00049f0 2022-01-10T01:26:19.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450dd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45100a9fe0 0x7f4510141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450dd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45100a9fe0 0x7f4510141060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35776/0 (socket says 172.21.15.36:35776) 2022-01-10T01:26:19.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450dd9b700 1 -- 172.21.15.36:0/3679083716 learned_addr learned my addr 172.21.15.36:0/3679083716 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:19.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450ed9d700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45100aa460 0x7f4510141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.257+0000 7f450e59c700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44f00049f0 0x7f45100b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f450dd9b700 1 -- 172.21.15.36:0/3679083716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44f00049f0 msgr2=0x7f45100b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f450dd9b700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44f00049f0 0x7f45100b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f450dd9b700 1 -- 172.21.15.36:0/3679083716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45100aa460 msgr2=0x7f4510141550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f450dd9b700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45100aa460 0x7f4510141550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f450dd9b700 1 -- 172.21.15.36:0/3679083716 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45100b3690 con 0x7f45100a9fe0 2022-01-10T01:26:19.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f450e59c700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44f00049f0 0x7f45100b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:19.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f450dd9b700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45100a9fe0 0x7f4510141060 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f450000b000 tx=0x7f4500008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:19.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f45077fe700 1 -- 172.21.15.36:0/3679083716 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4500017070 con 0x7f45100a9fe0 2022-01-10T01:26:19.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f45077fe700 1 -- 172.21.15.36:0/3679083716 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4500000e90 con 0x7f45100a9fe0 2022-01-10T01:26:19.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f450f59e700 1 -- 172.21.15.36:0/3679083716 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45100b54a0 con 0x7f45100a9fe0 2022-01-10T01:26:19.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f45077fe700 1 -- 172.21.15.36:0/3679083716 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4500012950 con 0x7f45100a9fe0 2022-01-10T01:26:19.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f450f59e700 1 -- 172.21.15.36:0/3679083716 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45100b41c0 con 0x7f45100a9fe0 2022-01-10T01:26:19.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f45077fe700 1 -- 172.21.15.36:0/3679083716 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4500012ab0 con 0x7f45100a9fe0 2022-01-10T01:26:19.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f450f59e700 1 -- 172.21.15.36:0/3679083716 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45100b3010 con 0x7f45100a9fe0 2022-01-10T01:26:19.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f45077fe700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f44f40536b0 0x7f44f4055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f45077fe700 1 -- 172.21.15.36:0/3679083716 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f450006ba60 con 0x7f45100a9fe0 2022-01-10T01:26:19.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f450e59c700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f44f40536b0 0x7f44f4055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.261+0000 7f450e59c700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f44f40536b0 0x7f44f4055b70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f44f8003000 tx=0x7f44f8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:19.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.269+0000 7f45077fe700 1 -- 172.21.15.36:0/3679083716 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4500042a70 con 0x7f45100a9fe0 2022-01-10T01:26:19.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.429+0000 7f450f59e700 1 -- 172.21.15.36:0/3679083716 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4510057350 con 0x7f45100a9fe0 2022-01-10T01:26:19.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.745+0000 7f45077fe700 1 -- 172.21.15.36:0/3679083716 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4500046090 con 0x7f45100a9fe0 2022-01-10T01:26:19.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.749+0000 7f450f59e700 1 -- 172.21.15.36:0/3679083716 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f44f40536b0 msgr2=0x7f44f4055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.749+0000 7f450f59e700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f44f40536b0 0x7f44f4055b70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f44f8003000 tx=0x7f44f8009040).stop 2022-01-10T01:26:19.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.749+0000 7f450f59e700 1 -- 172.21.15.36:0/3679083716 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45100a9fe0 msgr2=0x7f4510141060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.749+0000 7f450f59e700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45100a9fe0 0x7f4510141060 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f450000b000 tx=0x7f4500008040).stop 2022-01-10T01:26:19.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.749+0000 7f450f59e700 1 -- 172.21.15.36:0/3679083716 shutdown_connections 2022-01-10T01:26:19.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.749+0000 7f450f59e700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f44f40536b0 0x7f44f4055b70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.749+0000 7f450f59e700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45100aa460 0x7f4510141550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.749+0000 7f450f59e700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45100a9fe0 0x7f4510141060 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.749+0000 7f450f59e700 1 --2- 172.21.15.36:0/3679083716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44f00049f0 0x7f45100b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.749+0000 7f450f59e700 1 -- 172.21.15.36:0/3679083716 >> 172.21.15.36:0/3679083716 conn(0x7f4510060180 msgr2=0x7f4510146070 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:19.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.749+0000 7f450f59e700 1 -- 172.21.15.36:0/3679083716 shutdown_connections 2022-01-10T01:26:19.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.749+0000 7f450f59e700 1 -- 172.21.15.36:0/3679083716 wait complete. 2022-01-10T01:26:19.770 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:26:19.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.873+0000 7f3c6759e700 1 Processor -- start 2022-01-10T01:26:19.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.873+0000 7f3c6759e700 1 -- start start 2022-01-10T01:26:19.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6759e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3c680b2580 0x7f3c6814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c680b0010 0x7f3c6814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6759e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c680a70c0 con 0x7f3c680afbd0 2022-01-10T01:26:19.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6759e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c680a72f0 con 0x7f3c680b2580 2022-01-10T01:26:19.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c680a7590 con 0x7f3c680b0010 2022-01-10T01:26:19.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6659c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3c680b2580 0x7f3c6814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c66d9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f3c680afbd0 0x7f3c680a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33580/0 (socket says 172.21.15.36:33580) 2022-01-10T01:26:19.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c66d9d700 1 -- 172.21.15.36:0/1149212322 learned_addr learned my addr 172.21.15.36:0/1149212322 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:19.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c65d9b700 1 --2- 172.21.15.36:0/1149212322 >> v2:172.21.15.59:3300/0 conn(0x7f3c680b0010 0x7f3c6814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6559a700 1 -- 172.21.15.36:0/1149212322 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049925212 0 0) 0x7f3c680a70c0 con 0x7f3c680afbd0 2022-01-10T01:26:19.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6559a700 1 -- 172.21.15.36:0/1149212322 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c4c003260 con 0x7f3c680afbd0 2022-01-10T01:26:19.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6659c700 1 -- 172.21.15.36:0/1149212322 >> v2:172.21.15.59:3300/0 conn(0x7f3c680b0010 msgr2=0x7f3c6814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:19.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6659c700 1 --2- 172.21.15.36:0/1149212322 >> v2:172.21.15.59:3300/0 conn(0x7f3c680b0010 0x7f3c6814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6659c700 1 -- 172.21.15.36:0/1149212322 >> v1:172.21.15.36:6789/0 conn(0x7f3c680afbd0 legacy=0x7f3c680a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6659c700 1 -- 172.21.15.36:0/1149212322 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c680a7830 con 0x7f3c680b2580 2022-01-10T01:26:19.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c65d9b700 1 --2- 172.21.15.36:0/1149212322 >> v2:172.21.15.59:3300/0 conn(0x7f3c680b0010 0x7f3c6814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:26:19.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6659c700 1 --2- 172.21.15.36:0/1149212322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c680b2580 0x7f3c6814ae40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f3c5c002f70 tx=0x7f3c5c006df0).ready entity=mon.0 client_cookie=b63e7060219063e0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:19.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6559a700 1 -- 172.21.15.36:0/1149212322 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c5c00d4f0 con 0x7f3c680b2580 2022-01-10T01:26:19.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6559a700 1 -- 172.21.15.36:0/1149212322 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c000e90 con 0x7f3c680b2580 2022-01-10T01:26:19.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6559a700 1 -- 172.21.15.36:0/1149212322 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c5c00d840 con 0x7f3c680b2580 2022-01-10T01:26:19.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6759e700 1 -- 172.21.15.36:0/1149212322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c680b2580 msgr2=0x7f3c6814ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6759e700 1 --2- 172.21.15.36:0/1149212322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c680b2580 0x7f3c6814ae40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f3c5c002f70 tx=0x7f3c5c006df0).stop 2022-01-10T01:26:19.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6759e700 1 -- 172.21.15.36:0/1149212322 shutdown_connections 2022-01-10T01:26:19.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6759e700 1 --2- 172.21.15.36:0/1149212322 >> v2:172.21.15.59:3300/0 conn(0x7f3c680b0010 0x7f3c6814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6759e700 1 --2- 172.21.15.36:0/1149212322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c680b2580 0x7f3c6814ae40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6759e700 1 -- 172.21.15.36:0/1149212322 >> 172.21.15.36:0/1149212322 conn(0x7f3c68060180 msgr2=0x7f3c680b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:19.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6759e700 1 -- 172.21.15.36:0/1149212322 shutdown_connections 2022-01-10T01:26:19.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.877+0000 7f3c6759e700 1 -- 172.21.15.36:0/1149212322 wait complete. 2022-01-10T01:26:19.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.881+0000 7f3c6759e700 1 Processor -- start 2022-01-10T01:26:19.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.881+0000 7f3c6759e700 1 -- start start 2022-01-10T01:26:19.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.881+0000 7f3c6759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c680afbd0 0x7f3c680a9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.881+0000 7f3c6759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c680b0010 0x7f3c68157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.881+0000 7f3c6759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c680b2580 0x7f3c680665e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.881+0000 7f3c6759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c680638c0 con 0x7f3c680afbd0 2022-01-10T01:26:19.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.881+0000 7f3c6759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c68157530 con 0x7f3c680b0010 2022-01-10T01:26:19.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.881+0000 7f3c6759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c68063af0 con 0x7f3c680b2580 2022-01-10T01:26:19.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.881+0000 7f3c6659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c680afbd0 0x7f3c680a9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.881+0000 7f3c6659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c680afbd0 0x7f3c680a9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35788/0 (socket says 172.21.15.36:35788) 2022-01-10T01:26:19.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.881+0000 7f3c6659c700 1 -- 172.21.15.36:0/647853600 learned_addr learned my addr 172.21.15.36:0/647853600 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:19.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.881+0000 7f3c66d9d700 1 --2- 172.21.15.36:0/647853600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c680b2580 0x7f3c680665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.881+0000 7f3c65d9b700 1 --2- 172.21.15.36:0/647853600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c680b0010 0x7f3c68157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c6659c700 1 -- 172.21.15.36:0/647853600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c680b2580 msgr2=0x7f3c680665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c6659c700 1 --2- 172.21.15.36:0/647853600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c680b2580 0x7f3c680665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c6659c700 1 -- 172.21.15.36:0/647853600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c680b0010 msgr2=0x7f3c68157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:19.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c6659c700 1 --2- 172.21.15.36:0/647853600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c680b0010 0x7f3c68157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:19.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c6659c700 1 -- 172.21.15.36:0/647853600 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5800b180 con 0x7f3c680afbd0 2022-01-10T01:26:19.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c6659c700 1 --2- 172.21.15.36:0/647853600 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c680afbd0 0x7f3c680a9ac0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f3c5c002f70 tx=0x7f3c5c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:19.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c577fe700 1 -- 172.21.15.36:0/647853600 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c5c013de0 con 0x7f3c680afbd0 2022-01-10T01:26:19.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c577fe700 1 -- 172.21.15.36:0/647853600 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c00de60 con 0x7f3c680afbd0 2022-01-10T01:26:19.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c6759e700 1 -- 172.21.15.36:0/647853600 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c00b180 con 0x7f3c680afbd0 2022-01-10T01:26:19.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c577fe700 1 -- 172.21.15.36:0/647853600 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c5c01e5f0 con 0x7f3c680afbd0 2022-01-10T01:26:19.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c6759e700 1 -- 172.21.15.36:0/647853600 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c68064030 con 0x7f3c680afbd0 2022-01-10T01:26:19.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c6759e700 1 -- 172.21.15.36:0/647853600 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c680643b0 con 0x7f3c680afbd0 2022-01-10T01:26:19.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c577fe700 1 -- 172.21.15.36:0/647853600 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3c5c025030 con 0x7f3c680afbd0 2022-01-10T01:26:19.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c577fe700 1 --2- 172.21.15.36:0/647853600 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c440535f0 0x7f3c44055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:19.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c577fe700 1 -- 172.21.15.36:0/647853600 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3c5c06c5c0 con 0x7f3c680afbd0 2022-01-10T01:26:19.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.885+0000 7f3c65d9b700 1 --2- 172.21.15.36:0/647853600 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c440535f0 0x7f3c44055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:19.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.889+0000 7f3c65d9b700 1 --2- 172.21.15.36:0/647853600 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c440535f0 0x7f3c44055ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f3c5800b000 tx=0x7f3c58006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:19.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:19.889+0000 7f3c577fe700 1 -- 172.21.15.36:0/647853600 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3c5c0435d0 con 0x7f3c680afbd0 2022-01-10T01:26:20.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.053+0000 7f3c6759e700 1 -- 172.21.15.36:0/647853600 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c680b0710 con 0x7f3c680afbd0 2022-01-10T01:26:20.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.053+0000 7f3c577fe700 1 -- 172.21.15.36:0/647853600 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f3c5c023020 con 0x7f3c680afbd0 2022-01-10T01:26:20.059 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:20.059 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/986398854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":986398854},{"type":"v1","addr":"172.21.15.36:6835","nonce":986398854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/781575126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":781575126},{"type":"v1","addr":"172.21.15.36:6837","nonce":781575126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:26:18.598647+0000","modified":"2022-01-10T01:26:19.737578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3873482962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3873482962},{"type":"v1","addr":"172.21.15.59:6833","nonce":3873482962}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2022-01-10T01:26:20.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.057+0000 7f3c6759e700 1 -- 172.21.15.36:0/647853600 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c440535f0 msgr2=0x7f3c44055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.057+0000 7f3c6759e700 1 --2- 172.21.15.36:0/647853600 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c440535f0 0x7f3c44055ab0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f3c5800b000 tx=0x7f3c58006df0).stop 2022-01-10T01:26:20.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.057+0000 7f3c6759e700 1 -- 172.21.15.36:0/647853600 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c680afbd0 msgr2=0x7f3c680a9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.057+0000 7f3c6759e700 1 --2- 172.21.15.36:0/647853600 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c680afbd0 0x7f3c680a9ac0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f3c5c002f70 tx=0x7f3c5c014000).stop 2022-01-10T01:26:20.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.057+0000 7f3c6759e700 1 -- 172.21.15.36:0/647853600 shutdown_connections 2022-01-10T01:26:20.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.057+0000 7f3c6759e700 1 --2- 172.21.15.36:0/647853600 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c440535f0 0x7f3c44055ab0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.057+0000 7f3c6759e700 1 --2- 172.21.15.36:0/647853600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c680b2580 0x7f3c680665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.057+0000 7f3c6759e700 1 --2- 172.21.15.36:0/647853600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c680b0010 0x7f3c68157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.057+0000 7f3c6759e700 1 --2- 172.21.15.36:0/647853600 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c680afbd0 0x7f3c680a9ac0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.057+0000 7f3c6759e700 1 -- 172.21.15.36:0/647853600 >> 172.21.15.36:0/647853600 conn(0x7f3c68060180 msgr2=0x7f3c68148f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:20.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.057+0000 7f3c6759e700 1 -- 172.21.15.36:0/647853600 shutdown_connections 2022-01-10T01:26:20.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.057+0000 7f3c6759e700 1 -- 172.21.15.36:0/647853600 wait complete. 2022-01-10T01:26:20.064 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 18 2022-01-10T01:26:20.072 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:26:20.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31aac58700 1 Processor -- start 2022-01-10T01:26:20.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31aac58700 1 -- start start 2022-01-10T01:26:20.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31aac58700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f31a40b00c0 0x7f31a40b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31aac58700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a40aa390 con 0x7f31a40b1f10 2022-01-10T01:26:20.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31aac58700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31a40ab260 con 0x7f31a40a9b70 2022-01-10T01:26:20.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31aac58700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31a40b04a0 con 0x7f31a40b00c0 2022-01-10T01:26:20.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31a89f4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f31a40b00c0 0x7f31a40b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31a89f4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f31a40b00c0 0x7f31a40b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35796/0 (socket says 172.21.15.36:35796) 2022-01-10T01:26:20.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31a89f4700 1 -- 172.21.15.36:0/3154593741 learned_addr learned my addr 172.21.15.36:0/3154593741 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:20.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31a3fff700 1 --1- 172.21.15.36:0/3154593741 >> v1:172.21.15.36:6789/0 conn(0x7f31a40b1f10 0x7f31a40aab50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33594/0 (socket says 172.21.15.36:33594) 2022-01-10T01:26:20.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31a89f4700 1 -- 172.21.15.36:0/3154593741 >> v1:172.21.15.59:6789/0 conn(0x7f31a40a9b70 legacy=0x7f31a40b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31a89f4700 1 -- 172.21.15.36:0/3154593741 >> v1:172.21.15.36:6789/0 conn(0x7f31a40b1f10 legacy=0x7f31a40aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31a89f4700 1 -- 172.21.15.36:0/3154593741 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a40aa0f0 con 0x7f31a40b00c0 2022-01-10T01:26:20.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31a89f4700 1 --2- 172.21.15.36:0/3154593741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f31a40b00c0 0x7f31a40b1920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f319c0032f0 tx=0x7f319c009290).ready entity=mon.0 client_cookie=9607299b885efee2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:20.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31a37fe700 1 -- 172.21.15.36:0/3154593741 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f319c00b8a0 con 0x7f31a40b00c0 2022-01-10T01:26:20.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31a37fe700 1 -- 172.21.15.36:0/3154593741 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319c00ba00 con 0x7f31a40b00c0 2022-01-10T01:26:20.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31a37fe700 1 -- 172.21.15.36:0/3154593741 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f319c00bb70 con 0x7f31a40b00c0 2022-01-10T01:26:20.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31aac58700 1 -- 172.21.15.36:0/3154593741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f31a40b00c0 msgr2=0x7f31a40b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31aac58700 1 --2- 172.21.15.36:0/3154593741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f31a40b00c0 0x7f31a40b1920 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f319c0032f0 tx=0x7f319c009290).stop 2022-01-10T01:26:20.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31aac58700 1 -- 172.21.15.36:0/3154593741 shutdown_connections 2022-01-10T01:26:20.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31aac58700 1 --2- 172.21.15.36:0/3154593741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f31a40b00c0 0x7f31a40b1920 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31aac58700 1 -- 172.21.15.36:0/3154593741 >> 172.21.15.36:0/3154593741 conn(0x7f31a40607c0 msgr2=0x7f31a4060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:20.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31aac58700 1 -- 172.21.15.36:0/3154593741 shutdown_connections 2022-01-10T01:26:20.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.173+0000 7f31aac58700 1 -- 172.21.15.36:0/3154593741 wait complete. 2022-01-10T01:26:20.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31aac58700 1 Processor -- start 2022-01-10T01:26:20.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31aac58700 1 -- start start 2022-01-10T01:26:20.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31aac58700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31a40a9b70 0x7f31a413e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31aac58700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f31a40b00c0 0x7f31a4143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31aac58700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31a40b1f10 0x7f31a4152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31aac58700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a413f560 con 0x7f31a40b00c0 2022-01-10T01:26:20.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31aac58700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a413b7e0 con 0x7f31a40b1f10 2022-01-10T01:26:20.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31aac58700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a413c620 con 0x7f31a40a9b70 2022-01-10T01:26:20.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31a3fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f31a40b00c0 0x7f31a4143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31a3fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f31a40b00c0 0x7f31a4143d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35804/0 (socket says 172.21.15.36:35804) 2022-01-10T01:26:20.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31a3fff700 1 -- 172.21.15.36:0/3808568582 learned_addr learned my addr 172.21.15.36:0/3808568582 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:20.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31a89f4700 1 --2- 172.21.15.36:0/3808568582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31a40a9b70 0x7f31a413e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31a91f5700 1 --2- 172.21.15.36:0/3808568582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31a40b1f10 0x7f31a4152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31a3fff700 1 -- 172.21.15.36:0/3808568582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31a40a9b70 msgr2=0x7f31a413e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31a3fff700 1 --2- 172.21.15.36:0/3808568582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31a40a9b70 0x7f31a413e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31a3fff700 1 -- 172.21.15.36:0/3808568582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31a40b1f10 msgr2=0x7f31a4152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31a3fff700 1 --2- 172.21.15.36:0/3808568582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31a40b1f10 0x7f31a4152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31a3fff700 1 -- 172.21.15.36:0/3808568582 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c009530 con 0x7f31a40b00c0 2022-01-10T01:26:20.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31a3fff700 1 --2- 172.21.15.36:0/3808568582 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f31a40b00c0 0x7f31a4143d20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f31a40ad9e0 tx=0x7f318c007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:20.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31a1ffb700 1 -- 172.21.15.36:0/3808568582 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f318c001d70 con 0x7f31a40b00c0 2022-01-10T01:26:20.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31a1ffb700 1 -- 172.21.15.36:0/3808568582 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c00ce30 con 0x7f31a40b00c0 2022-01-10T01:26:20.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31aac58700 1 -- 172.21.15.36:0/3808568582 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a413c850 con 0x7f31a40b00c0 2022-01-10T01:26:20.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31a1ffb700 1 -- 172.21.15.36:0/3808568582 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f318c005550 con 0x7f31a40b00c0 2022-01-10T01:26:20.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.177+0000 7f31aac58700 1 -- 172.21.15.36:0/3808568582 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a4142670 con 0x7f31a40b00c0 2022-01-10T01:26:20.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.181+0000 7f31aac58700 1 -- 172.21.15.36:0/3808568582 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a413c9e0 con 0x7f31a40b00c0 2022-01-10T01:26:20.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.181+0000 7f31a1ffb700 1 -- 172.21.15.36:0/3808568582 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f318c010070 con 0x7f31a40b00c0 2022-01-10T01:26:20.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.181+0000 7f31a1ffb700 1 --2- 172.21.15.36:0/3808568582 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f317c053560 0x7f317c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.181+0000 7f31a1ffb700 1 -- 172.21.15.36:0/3808568582 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f318c06afc0 con 0x7f31a40b00c0 2022-01-10T01:26:20.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.181+0000 7f31a89f4700 1 --2- 172.21.15.36:0/3808568582 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f317c053560 0x7f317c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.181+0000 7f31a89f4700 1 --2- 172.21.15.36:0/3808568582 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f317c053560 0x7f317c055a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f319c019000 tx=0x7f319c016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:20.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.189+0000 7f31a1ffb700 1 -- 172.21.15.36:0/3808568582 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f318c041fd0 con 0x7f31a40b00c0 2022-01-10T01:26:20.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.313+0000 7f31aac58700 1 -- 172.21.15.36:0/3808568582 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31a4057350 con 0x7f31a40b00c0 2022-01-10T01:26:20.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.313+0000 7f31a1ffb700 1 -- 172.21.15.36:0/3808568582 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f318c018030 con 0x7f31a40b00c0 2022-01-10T01:26:20.317 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:20.317 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":46,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:26:19.602372+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:26:17.063945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2022-01-10T01:26:18.074904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:26:20.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.313+0000 7f31aac58700 1 -- 172.21.15.36:0/3808568582 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f317c053560 msgr2=0x7f317c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.313+0000 7f31aac58700 1 --2- 172.21.15.36:0/3808568582 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f317c053560 0x7f317c055a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f319c019000 tx=0x7f319c016000).stop 2022-01-10T01:26:20.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.313+0000 7f31aac58700 1 -- 172.21.15.36:0/3808568582 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f31a40b00c0 msgr2=0x7f31a4143d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.313+0000 7f31aac58700 1 --2- 172.21.15.36:0/3808568582 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f31a40b00c0 0x7f31a4143d20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f31a40ad9e0 tx=0x7f318c007c30).stop 2022-01-10T01:26:20.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.317+0000 7f31aac58700 1 -- 172.21.15.36:0/3808568582 shutdown_connections 2022-01-10T01:26:20.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.317+0000 7f31aac58700 1 --2- 172.21.15.36:0/3808568582 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f317c053560 0x7f317c055a20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.317+0000 7f31aac58700 1 --2- 172.21.15.36:0/3808568582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31a40b1f10 0x7f31a4152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.317+0000 7f31aac58700 1 --2- 172.21.15.36:0/3808568582 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f31a40b00c0 0x7f31a4143d20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.317+0000 7f31aac58700 1 --2- 172.21.15.36:0/3808568582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31a40a9b70 0x7f31a413e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.317+0000 7f31aac58700 1 -- 172.21.15.36:0/3808568582 >> 172.21.15.36:0/3808568582 conn(0x7f31a40607c0 msgr2=0x7f31a40b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:20.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.317+0000 7f31aac58700 1 -- 172.21.15.36:0/3808568582 shutdown_connections 2022-01-10T01:26:20.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.317+0000 7f31aac58700 1 -- 172.21.15.36:0/3808568582 wait complete. 2022-01-10T01:26:20.330 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:26:20.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.437+0000 7fb0ed942700 1 Processor -- start 2022-01-10T01:26:20.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.437+0000 7fb0ed942700 1 -- start start 2022-01-10T01:26:20.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.437+0000 7fb0ed942700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb0e80b4060 0x7fb0e8061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.437+0000 7fb0ed942700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb0e8142e60 0x7fb0e81432f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.437+0000 7fb0ed942700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e80b5f50 con 0x7fb0e80b6290 2022-01-10T01:26:20.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.437+0000 7fb0ed942700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e80b1f70 con 0x7fb0e80b4060 2022-01-10T01:26:20.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.437+0000 7fb0ed942700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e80b2210 con 0x7fb0e8142e60 2022-01-10T01:26:20.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.437+0000 7fb0e7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb0e80b4060 0x7fb0e8061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.437+0000 7fb0e7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb0e80b4060 0x7fb0e8061b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35812/0 (socket says 172.21.15.36:35812) 2022-01-10T01:26:20.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.437+0000 7fb0e7fff700 1 -- 172.21.15.36:0/662195294 learned_addr learned my addr 172.21.15.36:0/662195294 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:20.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.437+0000 7fb0ed141700 1 --2- 172.21.15.36:0/662195294 >> v2:172.21.15.59:3300/0 conn(0x7fb0e8142e60 0x7fb0e81432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0e7fff700 1 -- 172.21.15.36:0/662195294 >> v2:172.21.15.59:3300/0 conn(0x7fb0e8142e60 msgr2=0x7fb0e81432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:20.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0e7fff700 1 --2- 172.21.15.36:0/662195294 >> v2:172.21.15.59:3300/0 conn(0x7fb0e8142e60 0x7fb0e81432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0e7fff700 1 -- 172.21.15.36:0/662195294 >> v1:172.21.15.59:6789/0 conn(0x7fb0e80b6290 legacy=0x7fb0e8061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0e7fff700 1 -- 172.21.15.36:0/662195294 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e80b24b0 con 0x7fb0e80b4060 2022-01-10T01:26:20.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0e7fff700 1 --2- 172.21.15.36:0/662195294 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0e80b4060 0x7fb0e8061b80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fb0d0002f70 tx=0x7fb0d0006eb0).ready entity=mon.0 client_cookie=cca8c831073e5395 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:20.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0e77fe700 1 -- 172.21.15.36:0/662195294 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0d000d5c0 con 0x7fb0e80b4060 2022-01-10T01:26:20.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0e77fe700 1 -- 172.21.15.36:0/662195294 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d0000e90 con 0x7fb0e80b4060 2022-01-10T01:26:20.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0e77fe700 1 -- 172.21.15.36:0/662195294 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0d000d950 con 0x7fb0e80b4060 2022-01-10T01:26:20.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 -- 172.21.15.36:0/662195294 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0e80b4060 msgr2=0x7fb0e8061b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 --2- 172.21.15.36:0/662195294 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0e80b4060 0x7fb0e8061b80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fb0d0002f70 tx=0x7fb0d0006eb0).stop 2022-01-10T01:26:20.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 -- 172.21.15.36:0/662195294 shutdown_connections 2022-01-10T01:26:20.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 --2- 172.21.15.36:0/662195294 >> v2:172.21.15.59:3300/0 conn(0x7fb0e8142e60 0x7fb0e81432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 --2- 172.21.15.36:0/662195294 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0e80b4060 0x7fb0e8061b80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 -- 172.21.15.36:0/662195294 >> 172.21.15.36:0/662195294 conn(0x7fb0e805c490 msgr2=0x7fb0e805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:20.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 -- 172.21.15.36:0/662195294 shutdown_connections 2022-01-10T01:26:20.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 -- 172.21.15.36:0/662195294 wait complete. 2022-01-10T01:26:20.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 Processor -- start 2022-01-10T01:26:20.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 -- start start 2022-01-10T01:26:20.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0e80b4060 0x7fb0e80b8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0e80b6290 0x7fb0e81527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0e8142e60 0x7fb0e8152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e813f520 con 0x7fb0e80b4060 2022-01-10T01:26:20.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e813f8c0 con 0x7fb0e80b6290 2022-01-10T01:26:20.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed942700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e813fb60 con 0x7fb0e8142e60 2022-01-10T01:26:20.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ec940700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0e80b4060 0x7fb0e80b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ec940700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0e80b4060 0x7fb0e80b8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35818/0 (socket says 172.21.15.36:35818) 2022-01-10T01:26:20.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ec940700 1 -- 172.21.15.36:0/3331347555 learned_addr learned my addr 172.21.15.36:0/3331347555 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:20.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0e7fff700 1 --2- 172.21.15.36:0/3331347555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0e80b6290 0x7fb0e81527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.441+0000 7fb0ed141700 1 --2- 172.21.15.36:0/3331347555 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0e8142e60 0x7fb0e8152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.445+0000 7fb0ec940700 1 -- 172.21.15.36:0/3331347555 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0e8142e60 msgr2=0x7fb0e8152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.445+0000 7fb0ec940700 1 --2- 172.21.15.36:0/3331347555 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0e8142e60 0x7fb0e8152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.445+0000 7fb0ec940700 1 -- 172.21.15.36:0/3331347555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0e80b6290 msgr2=0x7fb0e81527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.445+0000 7fb0ec940700 1 --2- 172.21.15.36:0/3331347555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0e80b6290 0x7fb0e81527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.445+0000 7fb0ec940700 1 -- 172.21.15.36:0/3331347555 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d000b1e0 con 0x7fb0e80b4060 2022-01-10T01:26:20.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.445+0000 7fb0ec940700 1 --2- 172.21.15.36:0/3331347555 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0e80b4060 0x7fb0e80b8370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fb0e80b2ad0 tx=0x7fb0d8007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:20.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.445+0000 7fb0e5ffb700 1 -- 172.21.15.36:0/3331347555 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0d8007030 con 0x7fb0e80b4060 2022-01-10T01:26:20.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.445+0000 7fb0e5ffb700 1 -- 172.21.15.36:0/3331347555 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d8007190 con 0x7fb0e80b4060 2022-01-10T01:26:20.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.445+0000 7fb0ed942700 1 -- 172.21.15.36:0/3331347555 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e813fe00 con 0x7fb0e80b4060 2022-01-10T01:26:20.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.445+0000 7fb0e5ffb700 1 -- 172.21.15.36:0/3331347555 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0d8006510 con 0x7fb0e80b4060 2022-01-10T01:26:20.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.445+0000 7fb0ed942700 1 -- 172.21.15.36:0/3331347555 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e813f210 con 0x7fb0e80b4060 2022-01-10T01:26:20.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.445+0000 7fb0ed942700 1 -- 172.21.15.36:0/3331347555 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e80b2750 con 0x7fb0e80b4060 2022-01-10T01:26:20.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.445+0000 7fb0e5ffb700 1 -- 172.21.15.36:0/3331347555 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb0d8006670 con 0x7fb0e80b4060 2022-01-10T01:26:20.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.445+0000 7fb0e5ffb700 1 --2- 172.21.15.36:0/3331347555 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb0cc0536b0 0x7fb0cc055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.449+0000 7fb0e5ffb700 1 -- 172.21.15.36:0/3331347555 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb0d806b240 con 0x7fb0e80b4060 2022-01-10T01:26:20.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.449+0000 7fb0e7fff700 1 --2- 172.21.15.36:0/3331347555 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb0cc0536b0 0x7fb0cc055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.449+0000 7fb0e7fff700 1 --2- 172.21.15.36:0/3331347555 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb0cc0536b0 0x7fb0cc055b70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fb0d001c000 tx=0x7fb0d0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:20.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.453+0000 7fb0e5ffb700 1 -- 172.21.15.36:0/3331347555 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb0d8042150 con 0x7fb0e80b4060 2022-01-10T01:26:20.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.617+0000 7fb0ed942700 1 -- 172.21.15.36:0/3331347555 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb0e80b5f50 con 0x7fb0e80b4060 2022-01-10T01:26:20.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.625+0000 7fb0e5ffb700 1 -- 172.21.15.36:0/3331347555 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb0e80b5f50 con 0x7fb0e80b4060 2022-01-10T01:26:20.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.625+0000 7fb0ed942700 1 -- 172.21.15.36:0/3331347555 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb0cc0536b0 msgr2=0x7fb0cc055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.625+0000 7fb0ed942700 1 --2- 172.21.15.36:0/3331347555 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb0cc0536b0 0x7fb0cc055b70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fb0d001c000 tx=0x7fb0d0015000).stop 2022-01-10T01:26:20.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.625+0000 7fb0ed942700 1 -- 172.21.15.36:0/3331347555 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0e80b4060 msgr2=0x7fb0e80b8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.625+0000 7fb0ed942700 1 --2- 172.21.15.36:0/3331347555 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0e80b4060 0x7fb0e80b8370 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fb0e80b2ad0 tx=0x7fb0d8007be0).stop 2022-01-10T01:26:20.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.625+0000 7fb0ed942700 1 -- 172.21.15.36:0/3331347555 shutdown_connections 2022-01-10T01:26:20.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.625+0000 7fb0ed942700 1 --2- 172.21.15.36:0/3331347555 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb0cc0536b0 0x7fb0cc055b70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.625+0000 7fb0ed942700 1 --2- 172.21.15.36:0/3331347555 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0e8142e60 0x7fb0e8152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.625+0000 7fb0ed942700 1 --2- 172.21.15.36:0/3331347555 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0e80b6290 0x7fb0e81527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.625+0000 7fb0ed942700 1 --2- 172.21.15.36:0/3331347555 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb0e80b4060 0x7fb0e80b8370 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.625+0000 7fb0ed942700 1 -- 172.21.15.36:0/3331347555 >> 172.21.15.36:0/3331347555 conn(0x7fb0e805c490 msgr2=0x7fb0e812c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:20.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.625+0000 7fb0ed942700 1 -- 172.21.15.36:0/3331347555 shutdown_connections 2022-01-10T01:26:20.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.625+0000 7fb0ed942700 1 -- 172.21.15.36:0/3331347555 wait complete. 2022-01-10T01:26:20.633 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.0 2022-01-10T01:26:20.643 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:26:20.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f5201af0700 1 Processor -- start 2022-01-10T01:26:20.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f5201af0700 1 -- start start 2022-01-10T01:26:20.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f5201af0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51fc0b25a0 0x7f51fc066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f5201af0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f51fc066a10 0x7f51fc14d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f5201af0700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51fc065330 con 0x7f51fc0b3000 2022-01-10T01:26:20.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f5201af0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51fc062000 con 0x7f51fc066a10 2022-01-10T01:26:20.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f5201af0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51fc0b33e0 con 0x7f51fc0b25a0 2022-01-10T01:26:20.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f5200aee700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f51fc0b3000 0x7f51fc060b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33618/0 (socket says 172.21.15.36:33618) 2022-01-10T01:26:20.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f52012ef700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f51fc066a10 0x7f51fc14d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f5200aee700 1 -- 172.21.15.36:0/3784717397 learned_addr learned my addr 172.21.15.36:0/3784717397 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:20.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f51fbfff700 1 --2- 172.21.15.36:0/3784717397 >> v2:172.21.15.59:3300/0 conn(0x7f51fc0b25a0 0x7f51fc066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f52012ef700 1 -- 172.21.15.36:0/3784717397 >> v2:172.21.15.59:3300/0 conn(0x7f51fc0b25a0 msgr2=0x7f51fc066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:20.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f52012ef700 1 --2- 172.21.15.36:0/3784717397 >> v2:172.21.15.59:3300/0 conn(0x7f51fc0b25a0 0x7f51fc066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f52012ef700 1 -- 172.21.15.36:0/3784717397 >> v1:172.21.15.36:6789/0 conn(0x7f51fc0b3000 legacy=0x7f51fc060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f52012ef700 1 -- 172.21.15.36:0/3784717397 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc05fa60 con 0x7f51fc066a10 2022-01-10T01:26:20.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f52012ef700 1 --2- 172.21.15.36:0/3784717397 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51fc066a10 0x7f51fc14d920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f51f40032f0 tx=0x7f51f40091d0).ready entity=mon.0 client_cookie=4cc25b0924c540ef server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:20.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.757+0000 7f51fb7fe700 1 -- 172.21.15.36:0/3784717397 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51f400b680 con 0x7f51fc066a10 2022-01-10T01:26:20.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.761+0000 7f51fb7fe700 1 -- 172.21.15.36:0/3784717397 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f400b7e0 con 0x7f51fc066a10 2022-01-10T01:26:20.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.761+0000 7f51fb7fe700 1 -- 172.21.15.36:0/3784717397 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51f400b950 con 0x7f51fc066a10 2022-01-10T01:26:20.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.761+0000 7f5201af0700 1 -- 172.21.15.36:0/3784717397 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51fc066a10 msgr2=0x7f51fc14d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.761+0000 7f5201af0700 1 --2- 172.21.15.36:0/3784717397 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51fc066a10 0x7f51fc14d920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f51f40032f0 tx=0x7f51f40091d0).stop 2022-01-10T01:26:20.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.761+0000 7f5201af0700 1 -- 172.21.15.36:0/3784717397 shutdown_connections 2022-01-10T01:26:20.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.761+0000 7f5201af0700 1 --2- 172.21.15.36:0/3784717397 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51fc066a10 0x7f51fc14d920 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.761+0000 7f5201af0700 1 --2- 172.21.15.36:0/3784717397 >> v2:172.21.15.59:3300/0 conn(0x7f51fc0b25a0 0x7f51fc066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.761+0000 7f5201af0700 1 -- 172.21.15.36:0/3784717397 >> 172.21.15.36:0/3784717397 conn(0x7f51fc0636e0 msgr2=0x7f51fc063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:20.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.761+0000 7f5201af0700 1 -- 172.21.15.36:0/3784717397 shutdown_connections 2022-01-10T01:26:20.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.761+0000 7f5201af0700 1 -- 172.21.15.36:0/3784717397 wait complete. 2022-01-10T01:26:20.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.761+0000 7f5201af0700 1 Processor -- start 2022-01-10T01:26:20.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.761+0000 7f5201af0700 1 -- start start 2022-01-10T01:26:20.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f5201af0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51fc066a10 0x7f51fc0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f5201af0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51fc0b25a0 0x7f51fc152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f5201af0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51fc0b3000 0x7f51fc152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f5201af0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc152d40 con 0x7f51fc0b3000 2022-01-10T01:26:20.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f5201af0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc0ab970 con 0x7f51fc066a10 2022-01-10T01:26:20.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f5201af0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc0b04d0 con 0x7f51fc0b25a0 2022-01-10T01:26:20.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f52012ef700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51fc0b3000 0x7f51fc152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f52012ef700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51fc0b3000 0x7f51fc152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35834/0 (socket says 172.21.15.36:35834) 2022-01-10T01:26:20.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f52012ef700 1 -- 172.21.15.36:0/268492364 learned_addr learned my addr 172.21.15.36:0/268492364 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:20.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f5200aee700 1 --2- 172.21.15.36:0/268492364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51fc066a10 0x7f51fc0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f51fbfff700 1 --2- 172.21.15.36:0/268492364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51fc0b25a0 0x7f51fc152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f52012ef700 1 -- 172.21.15.36:0/268492364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51fc0b25a0 msgr2=0x7f51fc152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f52012ef700 1 --2- 172.21.15.36:0/268492364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51fc0b25a0 0x7f51fc152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f52012ef700 1 -- 172.21.15.36:0/268492364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51fc066a10 msgr2=0x7f51fc0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f52012ef700 1 --2- 172.21.15.36:0/268492364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51fc066a10 0x7f51fc0b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f52012ef700 1 -- 172.21.15.36:0/268492364 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f4009470 con 0x7f51fc0b3000 2022-01-10T01:26:20.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f52012ef700 1 --2- 172.21.15.36:0/268492364 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51fc0b3000 0x7f51fc152850 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f51f40032f0 tx=0x7f51f4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:20.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f51f9ffb700 1 -- 172.21.15.36:0/268492364 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51f4011e20 con 0x7f51fc0b3000 2022-01-10T01:26:20.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f51f9ffb700 1 -- 172.21.15.36:0/268492364 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f4021440 con 0x7f51fc0b3000 2022-01-10T01:26:20.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f5201af0700 1 -- 172.21.15.36:0/268492364 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51fc156640 con 0x7f51fc0b3000 2022-01-10T01:26:20.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f51f9ffb700 1 -- 172.21.15.36:0/268492364 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51f40217a0 con 0x7f51fc0b3000 2022-01-10T01:26:20.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f5201af0700 1 -- 172.21.15.36:0/268492364 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51fc0ab620 con 0x7f51fc0b3000 2022-01-10T01:26:20.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.765+0000 7f51f9ffb700 1 -- 172.21.15.36:0/268492364 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f51f4027020 con 0x7f51fc0b3000 2022-01-10T01:26:20.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.769+0000 7f5201af0700 1 -- 172.21.15.36:0/268492364 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51fc0b0330 con 0x7f51fc0b3000 2022-01-10T01:26:20.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.769+0000 7f51f9ffb700 1 --2- 172.21.15.36:0/268492364 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51dc053590 0x7f51dc055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:20.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.769+0000 7f51f9ffb700 1 -- 172.21.15.36:0/268492364 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f51f406ceb0 con 0x7f51fc0b3000 2022-01-10T01:26:20.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.769+0000 7f5200aee700 1 --2- 172.21.15.36:0/268492364 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51dc053590 0x7f51dc055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:20.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.769+0000 7f5200aee700 1 --2- 172.21.15.36:0/268492364 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51dc053590 0x7f51dc055a50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f51e800d000 tx=0x7f51e8000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:20.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.773+0000 7f51f9ffb700 1 -- 172.21.15.36:0/268492364 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f51fc0b0330 con 0x7f51fc0b3000 2022-01-10T01:26:20.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.937+0000 7f5201af0700 1 -- 172.21.15.36:0/268492364 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f51fc0b0330 con 0x7f51fc0b3000 2022-01-10T01:26:20.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.945+0000 7f51f9ffb700 1 -- 172.21.15.36:0/268492364 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f51fc0b0330 con 0x7f51fc0b3000 2022-01-10T01:26:20.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.945+0000 7f5201af0700 1 -- 172.21.15.36:0/268492364 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51dc053590 msgr2=0x7f51dc055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.945+0000 7f5201af0700 1 --2- 172.21.15.36:0/268492364 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51dc053590 0x7f51dc055a50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f51e800d000 tx=0x7f51e8000bc0).stop 2022-01-10T01:26:20.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.945+0000 7f5201af0700 1 -- 172.21.15.36:0/268492364 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51fc0b3000 msgr2=0x7f51fc152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:20.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.945+0000 7f5201af0700 1 --2- 172.21.15.36:0/268492364 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51fc0b3000 0x7f51fc152850 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f51f40032f0 tx=0x7f51f4016000).stop 2022-01-10T01:26:20.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.945+0000 7f5201af0700 1 -- 172.21.15.36:0/268492364 shutdown_connections 2022-01-10T01:26:20.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.945+0000 7f5201af0700 1 --2- 172.21.15.36:0/268492364 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51dc053590 0x7f51dc055a50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.945+0000 7f5201af0700 1 --2- 172.21.15.36:0/268492364 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51fc0b3000 0x7f51fc152850 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.945+0000 7f5201af0700 1 --2- 172.21.15.36:0/268492364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51fc0b25a0 0x7f51fc152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.945+0000 7f5201af0700 1 --2- 172.21.15.36:0/268492364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51fc066a10 0x7f51fc0b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:20.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.945+0000 7f5201af0700 1 -- 172.21.15.36:0/268492364 >> 172.21.15.36:0/268492364 conn(0x7f51fc0636e0 msgr2=0x7f51fc0b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:20.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.945+0000 7f5201af0700 1 -- 172.21.15.36:0/268492364 shutdown_connections 2022-01-10T01:26:20.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:20.949+0000 7f5201af0700 1 -- 172.21.15.36:0/268492364 wait complete. 2022-01-10T01:26:20.954 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.1 2022-01-10T01:26:20.964 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:26:21.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f377f9700 1 Processor -- start 2022-01-10T01:26:21.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f377f9700 1 -- start start 2022-01-10T01:26:21.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f377f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f300b1db0 0x7f8f300b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:21.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f377f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f301483a0 0x7f8f300b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:21.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f377f9700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f300b0350 con 0x7f8f300a70c0 2022-01-10T01:26:21.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f377f9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f300a90c0 con 0x7f8f300b1db0 2022-01-10T01:26:21.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f377f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300b05f0 con 0x7f8f301483a0 2022-01-10T01:26:21.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f35d96700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f8f300a70c0 0x7f8f30144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33636/0 (socket says 172.21.15.36:33636) 2022-01-10T01:26:21.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f35d96700 1 -- 172.21.15.36:0/1711568999 learned_addr learned my addr 172.21.15.36:0/1711568999 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:21.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f35595700 1 --2- 172.21.15.36:0/1711568999 >> v2:172.21.15.59:3300/0 conn(0x7f8f300b1db0 0x7f8f300b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:21.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f34d94700 1 --2- 172.21.15.36:0/1711568999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f301483a0 0x7f8f300b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:21.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f27fff700 1 -- 172.21.15.36:0/1711568999 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947931997 0 0) 0x7f8f300b0350 con 0x7f8f300a70c0 2022-01-10T01:26:21.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f27fff700 1 -- 172.21.15.36:0/1711568999 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f14003260 con 0x7f8f300a70c0 2022-01-10T01:26:21.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f35595700 1 -- 172.21.15.36:0/1711568999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f301483a0 msgr2=0x7f8f300b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:21.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f35595700 1 --2- 172.21.15.36:0/1711568999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f301483a0 0x7f8f300b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f35595700 1 -- 172.21.15.36:0/1711568999 >> v1:172.21.15.36:6789/0 conn(0x7f8f300a70c0 legacy=0x7f8f30144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:21.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f35595700 1 -- 172.21.15.36:0/1711568999 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f300b0890 con 0x7f8f300b1db0 2022-01-10T01:26:21.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f35595700 1 --2- 172.21.15.36:0/1711568999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f300b1db0 0x7f8f300b0fd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f8f2c002f70 tx=0x7f8f2c006df0).ready entity=mon.1 client_cookie=2d0436cf2b44764f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:21.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f27fff700 1 -- 172.21.15.36:0/1711568999 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f2c00d4a0 con 0x7f8f300b1db0 2022-01-10T01:26:21.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f27fff700 1 -- 172.21.15.36:0/1711568999 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c000e90 con 0x7f8f300b1db0 2022-01-10T01:26:21.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.065+0000 7f8f27fff700 1 -- 172.21.15.36:0/1711568999 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f2c00d7f0 con 0x7f8f300b1db0 2022-01-10T01:26:21.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 -- 172.21.15.36:0/1711568999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f300b1db0 msgr2=0x7f8f300b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:21.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 --2- 172.21.15.36:0/1711568999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f300b1db0 0x7f8f300b0fd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f8f2c002f70 tx=0x7f8f2c006df0).stop 2022-01-10T01:26:21.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 -- 172.21.15.36:0/1711568999 shutdown_connections 2022-01-10T01:26:21.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 --2- 172.21.15.36:0/1711568999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f301483a0 0x7f8f300b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 --2- 172.21.15.36:0/1711568999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f300b1db0 0x7f8f300b0fd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 -- 172.21.15.36:0/1711568999 >> 172.21.15.36:0/1711568999 conn(0x7f8f3005f6b0 msgr2=0x7f8f3005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:21.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 -- 172.21.15.36:0/1711568999 shutdown_connections 2022-01-10T01:26:21.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 -- 172.21.15.36:0/1711568999 wait complete. 2022-01-10T01:26:21.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 Processor -- start 2022-01-10T01:26:21.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 -- start start 2022-01-10T01:26:21.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f300a70c0 0x7f8f30140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:21.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f300b1db0 0x7f8f3013d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:21.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8f301483a0 0x7f8f30159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:21.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300a9a60 con 0x7f8f301483a0 2022-01-10T01:26:21.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300abfd0 con 0x7f8f300a70c0 2022-01-10T01:26:21.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f377f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f300ac270 con 0x7f8f300b1db0 2022-01-10T01:26:21.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f35d96700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8f301483a0 0x7f8f30159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:21.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f35595700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f300a70c0 0x7f8f30140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:21.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f35d96700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8f301483a0 0x7f8f30159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35848/0 (socket says 172.21.15.36:35848) 2022-01-10T01:26:21.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f35d96700 1 -- 172.21.15.36:0/3038246060 learned_addr learned my addr 172.21.15.36:0/3038246060 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:21.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f34d94700 1 --2- 172.21.15.36:0/3038246060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f300b1db0 0x7f8f3013d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:21.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f35d96700 1 -- 172.21.15.36:0/3038246060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f300b1db0 msgr2=0x7f8f3013d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:21.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f35d96700 1 --2- 172.21.15.36:0/3038246060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f300b1db0 0x7f8f3013d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f35d96700 1 -- 172.21.15.36:0/3038246060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f300a70c0 msgr2=0x7f8f30140080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:21.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f35d96700 1 --2- 172.21.15.36:0/3038246060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f300a70c0 0x7f8f30140080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.069+0000 7f8f35d96700 1 -- 172.21.15.36:0/3038246060 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c00b180 con 0x7f8f301483a0 2022-01-10T01:26:21.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.073+0000 7f8f35d96700 1 --2- 172.21.15.36:0/3038246060 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8f301483a0 0x7f8f30159be0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f8f28001490 tx=0x7f8f28007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:21.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.073+0000 7f8f267fc700 1 -- 172.21.15.36:0/3038246060 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f28005ba0 con 0x7f8f301483a0 2022-01-10T01:26:21.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.073+0000 7f8f267fc700 1 -- 172.21.15.36:0/3038246060 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f28005d00 con 0x7f8f301483a0 2022-01-10T01:26:21.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.073+0000 7f8f377f9700 1 -- 172.21.15.36:0/3038246060 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f300a95c0 con 0x7f8f301483a0 2022-01-10T01:26:21.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.073+0000 7f8f267fc700 1 -- 172.21.15.36:0/3038246060 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f280072c0 con 0x7f8f301483a0 2022-01-10T01:26:21.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.073+0000 7f8f377f9700 1 -- 172.21.15.36:0/3038246060 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f30143230 con 0x7f8f301483a0 2022-01-10T01:26:21.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.073+0000 7f8f377f9700 1 -- 172.21.15.36:0/3038246060 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f300a9750 con 0x7f8f301483a0 2022-01-10T01:26:21.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.073+0000 7f8f267fc700 1 -- 172.21.15.36:0/3038246060 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8f28010070 con 0x7f8f301483a0 2022-01-10T01:26:21.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.073+0000 7f8f267fc700 1 --2- 172.21.15.36:0/3038246060 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f18053560 0x7f8f18055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:21.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.073+0000 7f8f267fc700 1 -- 172.21.15.36:0/3038246060 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8f2806b310 con 0x7f8f301483a0 2022-01-10T01:26:21.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.073+0000 7f8f35595700 1 --2- 172.21.15.36:0/3038246060 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f18053560 0x7f8f18055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:21.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.073+0000 7f8f35595700 1 --2- 172.21.15.36:0/3038246060 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f18053560 0x7f8f18055a20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f8f2c01a000 tx=0x7f8f2c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:21.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.081+0000 7f8f267fc700 1 -- 172.21.15.36:0/3038246060 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8f28042320 con 0x7f8f301483a0 2022-01-10T01:26:21.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.249+0000 7f8f377f9700 1 -- 172.21.15.36:0/3038246060 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f300ac430 con 0x7f8f301483a0 2022-01-10T01:26:21.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.249+0000 7f8f267fc700 1 -- 172.21.15.36:0/3038246060 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f8f28045940 con 0x7f8f301483a0 2022-01-10T01:26:21.253 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:21.253 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/986398854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":986398854},{"type":"v1","addr":"172.21.15.36:6835","nonce":986398854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/781575126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":781575126},{"type":"v1","addr":"172.21.15.36:6837","nonce":781575126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:26:18.598647+0000","modified":"2022-01-10T01:26:19.737578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3873482962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3873482962},{"type":"v1","addr":"172.21.15.59:6833","nonce":3873482962}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2022-01-10T01:26:21.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.253+0000 7f8f377f9700 1 -- 172.21.15.36:0/3038246060 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f18053560 msgr2=0x7f8f18055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:21.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.253+0000 7f8f377f9700 1 --2- 172.21.15.36:0/3038246060 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f18053560 0x7f8f18055a20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f8f2c01a000 tx=0x7f8f2c014000).stop 2022-01-10T01:26:21.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.253+0000 7f8f377f9700 1 -- 172.21.15.36:0/3038246060 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8f301483a0 msgr2=0x7f8f30159be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:21.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.253+0000 7f8f377f9700 1 --2- 172.21.15.36:0/3038246060 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8f301483a0 0x7f8f30159be0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f8f28001490 tx=0x7f8f28007e00).stop 2022-01-10T01:26:21.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.253+0000 7f8f377f9700 1 -- 172.21.15.36:0/3038246060 shutdown_connections 2022-01-10T01:26:21.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.253+0000 7f8f377f9700 1 --2- 172.21.15.36:0/3038246060 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f18053560 0x7f8f18055a20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.253+0000 7f8f377f9700 1 --2- 172.21.15.36:0/3038246060 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8f301483a0 0x7f8f30159be0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.253+0000 7f8f377f9700 1 --2- 172.21.15.36:0/3038246060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f300b1db0 0x7f8f3013d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.253+0000 7f8f377f9700 1 --2- 172.21.15.36:0/3038246060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f300a70c0 0x7f8f30140080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.253+0000 7f8f377f9700 1 -- 172.21.15.36:0/3038246060 >> 172.21.15.36:0/3038246060 conn(0x7f8f3005f6b0 msgr2=0x7f8f300b1210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:21.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.253+0000 7f8f377f9700 1 -- 172.21.15.36:0/3038246060 shutdown_connections 2022-01-10T01:26:21.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.253+0000 7f8f377f9700 1 -- 172.21.15.36:0/3038246060 wait complete. 2022-01-10T01:26:21.259 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 18 2022-01-10T01:26:21.573 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:26:18.598647+0000', 'modified': '2022-01-10T01:26:19.737578+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5239}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5239': {'gid': 5239, 'name': 'b', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/3873482962', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 3873482962}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 3873482962}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:26:21.574 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:26:21.575 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:26:21.692 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":5239,"want_state":"up:active","state":"up:active","rank_uptime":3.0795732509999998,"mdsmap_epoch":18,"osdmap_epoch":46,"osdmap_epoch_barrier":46,"uptime":7.4147996599999999} 2022-01-10T01:26:21.692 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 5239, "mdsmap_epoch": 18, "osdmap_epoch": 46, "osdmap_epoch_barrier": 46, "rank_uptime": 3.079573251, "state": "up:active", "uptime": 7.41479966, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:26:21.693 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:26:21.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2ebcee4700 1 Processor -- start 2022-01-10T01:26:21.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2ebcee4700 1 -- start start 2022-01-10T01:26:21.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2ebcee4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eb80b0010 0x7f2eb80a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:21.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2ebcee4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2eb80afbd0 0x7f2eb80a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:21.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2ebcee4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb80a70c0 con 0x7f2eb80b2580 2022-01-10T01:26:21.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2ebcee4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb80a72f0 con 0x7f2eb80afbd0 2022-01-10T01:26:21.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2ebcee4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb80a7590 con 0x7f2eb80b0010 2022-01-10T01:26:21.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2eb7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2eb80afbd0 0x7f2eb80a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:21.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2eb7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2eb80afbd0 0x7f2eb80a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35856/0 (socket says 172.21.15.36:35856) 2022-01-10T01:26:21.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2eb7fff700 1 -- 172.21.15.36:0/4015517132 learned_addr learned my addr 172.21.15.36:0/4015517132 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:21.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2eb6ffd700 1 --2- 172.21.15.36:0/4015517132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eb80b0010 0x7f2eb80a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:21.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2eb7fff700 1 -- 172.21.15.36:0/4015517132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eb80b0010 msgr2=0x7f2eb80a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:21.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2eb7fff700 1 --2- 172.21.15.36:0/4015517132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eb80b0010 0x7f2eb80a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2eb7fff700 1 -- 172.21.15.36:0/4015517132 >> v1:172.21.15.59:6789/0 conn(0x7f2eb80b2580 legacy=0x7f2eb814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:21.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2eb7fff700 1 -- 172.21.15.36:0/4015517132 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb80a7830 con 0x7f2eb80afbd0 2022-01-10T01:26:21.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2eb6ffd700 1 --2- 172.21.15.36:0/4015517132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eb80b0010 0x7f2eb80a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:21.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2eb7fff700 1 --2- 172.21.15.36:0/4015517132 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2eb80afbd0 0x7f2eb80a88a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f2ea0002f70 tx=0x7f2ea0006eb0).ready entity=mon.0 client_cookie=dedbc8c8634a188b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:21.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2eb67fc700 1 -- 172.21.15.36:0/4015517132 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ea000d5c0 con 0x7f2eb80afbd0 2022-01-10T01:26:21.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2eb67fc700 1 -- 172.21.15.36:0/4015517132 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea0000e90 con 0x7f2eb80afbd0 2022-01-10T01:26:21.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2eb67fc700 1 -- 172.21.15.36:0/4015517132 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ea000d950 con 0x7f2eb80afbd0 2022-01-10T01:26:21.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2ebcee4700 1 -- 172.21.15.36:0/4015517132 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2eb80afbd0 msgr2=0x7f2eb80a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:21.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2ebcee4700 1 --2- 172.21.15.36:0/4015517132 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2eb80afbd0 0x7f2eb80a88a0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f2ea0002f70 tx=0x7f2ea0006eb0).stop 2022-01-10T01:26:21.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2ebcee4700 1 -- 172.21.15.36:0/4015517132 shutdown_connections 2022-01-10T01:26:21.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2ebcee4700 1 --2- 172.21.15.36:0/4015517132 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2eb80afbd0 0x7f2eb80a88a0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2ebcee4700 1 --2- 172.21.15.36:0/4015517132 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eb80b0010 0x7f2eb80a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.805+0000 7f2ebcee4700 1 -- 172.21.15.36:0/4015517132 >> 172.21.15.36:0/4015517132 conn(0x7f2eb8060180 msgr2=0x7f2eb80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:21.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2ebcee4700 1 -- 172.21.15.36:0/4015517132 shutdown_connections 2022-01-10T01:26:21.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2ebcee4700 1 -- 172.21.15.36:0/4015517132 wait complete. 2022-01-10T01:26:21.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2ebcee4700 1 Processor -- start 2022-01-10T01:26:21.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2ebcee4700 1 -- start start 2022-01-10T01:26:21.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2ebcee4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb80afbd0 0x7f2eb8143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:21.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2ebcee4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2eb80b0010 0x7f2eb8141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:21.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2ebcee4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eb80b2580 0x7f2eb8141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:21.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2ebcee4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb81572f0 con 0x7f2eb80b0010 2022-01-10T01:26:21.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2ebcee4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb814ce40 con 0x7f2eb80afbd0 2022-01-10T01:26:21.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2ebcee4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb814d0e0 con 0x7f2eb80b2580 2022-01-10T01:26:21.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2eb6ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2eb80b0010 0x7f2eb8141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:21.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2eb6ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2eb80b0010 0x7f2eb8141450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35860/0 (socket says 172.21.15.36:35860) 2022-01-10T01:26:21.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2eb6ffd700 1 -- 172.21.15.36:0/2084038267 learned_addr learned my addr 172.21.15.36:0/2084038267 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:21.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2eb7fff700 1 --2- 172.21.15.36:0/2084038267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eb80b2580 0x7f2eb8141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:21.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2eb77fe700 1 --2- 172.21.15.36:0/2084038267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb80afbd0 0x7f2eb8143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:21.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2eb6ffd700 1 -- 172.21.15.36:0/2084038267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eb80b2580 msgr2=0x7f2eb8141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:21.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2eb6ffd700 1 --2- 172.21.15.36:0/2084038267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eb80b2580 0x7f2eb8141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2eb6ffd700 1 -- 172.21.15.36:0/2084038267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb80afbd0 msgr2=0x7f2eb8143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:21.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2eb6ffd700 1 --2- 172.21.15.36:0/2084038267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb80afbd0 0x7f2eb8143bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.809+0000 7f2eb6ffd700 1 -- 172.21.15.36:0/2084038267 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea000b1e0 con 0x7f2eb80b0010 2022-01-10T01:26:21.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.813+0000 7f2eb6ffd700 1 --2- 172.21.15.36:0/2084038267 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2eb80b0010 0x7f2eb8141450 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f2eb0006cc0 tx=0x7f2eb0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:21.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.813+0000 7f2eb4ff9700 1 -- 172.21.15.36:0/2084038267 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2eb0013620 con 0x7f2eb80b0010 2022-01-10T01:26:21.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.813+0000 7f2eb4ff9700 1 -- 172.21.15.36:0/2084038267 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb0013780 con 0x7f2eb80b0010 2022-01-10T01:26:21.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.813+0000 7f2eb4ff9700 1 -- 172.21.15.36:0/2084038267 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2eb0013ae0 con 0x7f2eb80b0010 2022-01-10T01:26:21.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.813+0000 7f2ebcee4700 1 -- 172.21.15.36:0/2084038267 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb814d380 con 0x7f2eb80b0010 2022-01-10T01:26:21.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.813+0000 7f2ebcee4700 1 -- 172.21.15.36:0/2084038267 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb8141e30 con 0x7f2eb80b0010 2022-01-10T01:26:21.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.813+0000 7f2ebcee4700 1 -- 172.21.15.36:0/2084038267 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb8057350 con 0x7f2eb80b0010 2022-01-10T01:26:21.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.813+0000 7f2eb4ff9700 1 -- 172.21.15.36:0/2084038267 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2eb0013c40 con 0x7f2eb80b0010 2022-01-10T01:26:21.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.813+0000 7f2eb4ff9700 1 --2- 172.21.15.36:0/2084038267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e9c053680 0x7f2e9c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:21.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.813+0000 7f2eb77fe700 1 --2- 172.21.15.36:0/2084038267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e9c053680 0x7f2e9c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:21.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.813+0000 7f2eb4ff9700 1 -- 172.21.15.36:0/2084038267 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2eb006b8d0 con 0x7f2eb80b0010 2022-01-10T01:26:21.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.817+0000 7f2eb77fe700 1 --2- 172.21.15.36:0/2084038267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e9c053680 0x7f2e9c055b40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f2ea800d000 tx=0x7f2ea8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:21.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.821+0000 7f2eb4ff9700 1 -- 172.21.15.36:0/2084038267 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2eb0042880 con 0x7f2eb80b0010 2022-01-10T01:26:21.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.941+0000 7f2ebcee4700 1 -- 172.21.15.36:0/2084038267 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2eb80698e0 con 0x7f2eb80b0010 2022-01-10T01:26:21.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.945+0000 7f2eb4ff9700 1 -- 172.21.15.36:0/2084038267 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f2eb0045ea0 con 0x7f2eb80b0010 2022-01-10T01:26:21.948 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:21.948 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":46,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:26:19.602372+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:26:17.063945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2022-01-10T01:26:18.074904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:26:21.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.945+0000 7f2ebcee4700 1 -- 172.21.15.36:0/2084038267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e9c053680 msgr2=0x7f2e9c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:21.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.945+0000 7f2ebcee4700 1 --2- 172.21.15.36:0/2084038267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e9c053680 0x7f2e9c055b40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f2ea800d000 tx=0x7f2ea8009040).stop 2022-01-10T01:26:21.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.945+0000 7f2ebcee4700 1 -- 172.21.15.36:0/2084038267 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2eb80b0010 msgr2=0x7f2eb8141450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:21.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.945+0000 7f2ebcee4700 1 --2- 172.21.15.36:0/2084038267 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2eb80b0010 0x7f2eb8141450 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f2eb0006cc0 tx=0x7f2eb0008040).stop 2022-01-10T01:26:21.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.945+0000 7f2ebcee4700 1 -- 172.21.15.36:0/2084038267 shutdown_connections 2022-01-10T01:26:21.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.945+0000 7f2ebcee4700 1 --2- 172.21.15.36:0/2084038267 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e9c053680 0x7f2e9c055b40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.945+0000 7f2ebcee4700 1 --2- 172.21.15.36:0/2084038267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2eb80b2580 0x7f2eb8141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.945+0000 7f2ebcee4700 1 --2- 172.21.15.36:0/2084038267 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2eb80b0010 0x7f2eb8141450 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.945+0000 7f2ebcee4700 1 --2- 172.21.15.36:0/2084038267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2eb80afbd0 0x7f2eb8143bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:21.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.945+0000 7f2ebcee4700 1 -- 172.21.15.36:0/2084038267 >> 172.21.15.36:0/2084038267 conn(0x7f2eb8060180 msgr2=0x7f2eb80af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:21.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.945+0000 7f2ebcee4700 1 -- 172.21.15.36:0/2084038267 shutdown_connections 2022-01-10T01:26:21.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:21.945+0000 7f2ebcee4700 1 -- 172.21.15.36:0/2084038267 wait complete. 2022-01-10T01:26:21.961 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:26:17.063945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:26:18.074904+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:26:21.962 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:26:22.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.069+0000 7f4c5f59e700 1 Processor -- start 2022-01-10T01:26:22.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5f59e700 1 -- start start 2022-01-10T01:26:22.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5f59e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4c6005d0b0 0x7f4c600b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5f59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c6013f390 0x7f4c600aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5f59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c6005cbb0 con 0x7f4c6005c7d0 2022-01-10T01:26:22.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5f59e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c600ad540 con 0x7f4c6005d0b0 2022-01-10T01:26:22.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5f59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c60067d70 con 0x7f4c6013f390 2022-01-10T01:26:22.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5dd9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4c6005d0b0 0x7f4c600b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5dd9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4c6005d0b0 0x7f4c600b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35868/0 (socket says 172.21.15.36:35868) 2022-01-10T01:26:22.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5dd9b700 1 -- 172.21.15.36:0/2483400883 learned_addr learned my addr 172.21.15.36:0/2483400883 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:22.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5ed9d700 1 --2- 172.21.15.36:0/2483400883 >> v2:172.21.15.59:3300/0 conn(0x7f4c6013f390 0x7f4c600aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5dd9b700 1 -- 172.21.15.36:0/2483400883 >> v2:172.21.15.59:3300/0 conn(0x7f4c6013f390 msgr2=0x7f4c600aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:22.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5dd9b700 1 --2- 172.21.15.36:0/2483400883 >> v2:172.21.15.59:3300/0 conn(0x7f4c6013f390 0x7f4c600aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5dd9b700 1 -- 172.21.15.36:0/2483400883 >> v1:172.21.15.59:6789/0 conn(0x7f4c6005c7d0 legacy=0x7f4c600ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5dd9b700 1 -- 172.21.15.36:0/2483400883 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600b1790 con 0x7f4c6005d0b0 2022-01-10T01:26:22.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5dd9b700 1 --2- 172.21.15.36:0/2483400883 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c6005d0b0 0x7f4c600b10f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f4c48002f70 tx=0x7f4c48006eb0).ready entity=mon.0 client_cookie=b379670500d21bbb server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:22.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5d59a700 1 -- 172.21.15.36:0/2483400883 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c4800d5c0 con 0x7f4c6005d0b0 2022-01-10T01:26:22.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5d59a700 1 -- 172.21.15.36:0/2483400883 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c48000e90 con 0x7f4c6005d0b0 2022-01-10T01:26:22.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.073+0000 7f4c5d59a700 1 -- 172.21.15.36:0/2483400883 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c4800d950 con 0x7f4c6005d0b0 2022-01-10T01:26:22.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.077+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2483400883 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c6005d0b0 msgr2=0x7f4c600b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.077+0000 7f4c5f59e700 1 --2- 172.21.15.36:0/2483400883 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c6005d0b0 0x7f4c600b10f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f4c48002f70 tx=0x7f4c48006eb0).stop 2022-01-10T01:26:22.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.077+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2483400883 shutdown_connections 2022-01-10T01:26:22.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.077+0000 7f4c5f59e700 1 --2- 172.21.15.36:0/2483400883 >> v2:172.21.15.59:3300/0 conn(0x7f4c6013f390 0x7f4c600aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.077+0000 7f4c5f59e700 1 --2- 172.21.15.36:0/2483400883 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c6005d0b0 0x7f4c600b10f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.077+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2483400883 >> 172.21.15.36:0/2483400883 conn(0x7f4c60060180 msgr2=0x7f4c600b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:22.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.077+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2483400883 shutdown_connections 2022-01-10T01:26:22.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.077+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2483400883 wait complete. 2022-01-10T01:26:22.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.077+0000 7f4c5f59e700 1 Processor -- start 2022-01-10T01:26:22.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.077+0000 7f4c5f59e700 1 -- start start 2022-01-10T01:26:22.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5f59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c6005c7d0 0x7f4c600aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c6005d0b0 0x7f4c60136a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c6013f390 0x7f4c60152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5f59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600ac0b0 con 0x7f4c6005c7d0 2022-01-10T01:26:22.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5f59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600abb70 con 0x7f4c6013f390 2022-01-10T01:26:22.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600abe10 con 0x7f4c6005d0b0 2022-01-10T01:26:22.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c6005c7d0 0x7f4c600aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c6005c7d0 0x7f4c600aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35872/0 (socket says 172.21.15.36:35872) 2022-01-10T01:26:22.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5e59c700 1 -- 172.21.15.36:0/2157287310 learned_addr learned my addr 172.21.15.36:0/2157287310 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:22.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5dd9b700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c6005d0b0 0x7f4c60136a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5ed9d700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c6013f390 0x7f4c60152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5e59c700 1 -- 172.21.15.36:0/2157287310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c6005d0b0 msgr2=0x7f4c60136a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5e59c700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c6005d0b0 0x7f4c60136a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5e59c700 1 -- 172.21.15.36:0/2157287310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c6013f390 msgr2=0x7f4c60152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5e59c700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c6013f390 0x7f4c60152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5e59c700 1 -- 172.21.15.36:0/2157287310 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4800b1e0 con 0x7f4c6005c7d0 2022-01-10T01:26:22.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5ed9d700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c6013f390 0x7f4c60152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:26:22.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5e59c700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c6005c7d0 0x7f4c600aa470 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f4c60060680 tx=0x7f4c50007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:22.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c577fe700 1 -- 172.21.15.36:0/2157287310 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c5000ce30 con 0x7f4c6005c7d0 2022-01-10T01:26:22.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c577fe700 1 -- 172.21.15.36:0/2157287310 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c50007240 con 0x7f4c6005c7d0 2022-01-10T01:26:22.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2157287310 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c601524c0 con 0x7f4c6005c7d0 2022-01-10T01:26:22.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c577fe700 1 -- 172.21.15.36:0/2157287310 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c50006700 con 0x7f4c6005c7d0 2022-01-10T01:26:22.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2157287310 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c60140710 con 0x7f4c6005c7d0 2022-01-10T01:26:22.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2157287310 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c60152650 con 0x7f4c6005c7d0 2022-01-10T01:26:22.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.081+0000 7f4c577fe700 1 -- 172.21.15.36:0/2157287310 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4c50010030 con 0x7f4c6005c7d0 2022-01-10T01:26:22.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.085+0000 7f4c577fe700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4c440535f0 0x7f4c44055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.085+0000 7f4c577fe700 1 -- 172.21.15.36:0/2157287310 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4c5006b860 con 0x7f4c6005c7d0 2022-01-10T01:26:22.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.085+0000 7f4c5dd9b700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4c440535f0 0x7f4c44055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.085+0000 7f4c5dd9b700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4c440535f0 0x7f4c44055ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f4c4801a000 tx=0x7f4c48015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:22.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.093+0000 7f4c577fe700 1 -- 172.21.15.36:0/2157287310 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c50042770 con 0x7f4c6005c7d0 2022-01-10T01:26:22.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.221+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2157287310 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4c600b1a30 con 0x7f4c6005c7d0 2022-01-10T01:26:22.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.221+0000 7f4c577fe700 1 -- 172.21.15.36:0/2157287310 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v46) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4c50045d90 con 0x7f4c6005c7d0 2022-01-10T01:26:22.225 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:26:22.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.221+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2157287310 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4c440535f0 msgr2=0x7f4c44055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.221+0000 7f4c5f59e700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4c440535f0 0x7f4c44055ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f4c4801a000 tx=0x7f4c48015000).stop 2022-01-10T01:26:22.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.225+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2157287310 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c6005c7d0 msgr2=0x7f4c600aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.225+0000 7f4c5f59e700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c6005c7d0 0x7f4c600aa470 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f4c60060680 tx=0x7f4c50007c10).stop 2022-01-10T01:26:22.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.225+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2157287310 shutdown_connections 2022-01-10T01:26:22.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.225+0000 7f4c5f59e700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4c440535f0 0x7f4c44055ab0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.225+0000 7f4c5f59e700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c6013f390 0x7f4c60152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.225+0000 7f4c5f59e700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c6005d0b0 0x7f4c60136a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.225+0000 7f4c5f59e700 1 --2- 172.21.15.36:0/2157287310 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c6005c7d0 0x7f4c600aa470 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.225+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2157287310 >> 172.21.15.36:0/2157287310 conn(0x7f4c60060180 msgr2=0x7f4c6013f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:22.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.225+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2157287310 shutdown_connections 2022-01-10T01:26:22.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.225+0000 7f4c5f59e700 1 -- 172.21.15.36:0/2157287310 wait complete. 2022-01-10T01:26:22.238 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:26:22.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.341+0000 7fb3f56b8700 1 Processor -- start 2022-01-10T01:26:22.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.341+0000 7fb3f56b8700 1 -- start start 2022-01-10T01:26:22.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3f56b8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb3f00b2200 0x7fb3f0143160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3f56b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3f0143650 0x7fb3f0143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3f56b8700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f0060860 con 0x7fb3f00b77c0 2022-01-10T01:26:22.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3f56b8700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f0060ac0 con 0x7fb3f00b2200 2022-01-10T01:26:22.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3f56b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f0060d60 con 0x7fb3f0143650 2022-01-10T01:26:22.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3e67fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb3f00b2200 0x7fb3f0143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3e67fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb3f00b2200 0x7fb3f0143160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35882/0 (socket says 172.21.15.36:35882) 2022-01-10T01:26:22.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3e67fc700 1 -- 172.21.15.36:0/1766246312 learned_addr learned my addr 172.21.15.36:0/1766246312 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:22.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3ef7fe700 1 --2- 172.21.15.36:0/1766246312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3f0143650 0x7fb3f0143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3e67fc700 1 -- 172.21.15.36:0/1766246312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3f0143650 msgr2=0x7fb3f0143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:22.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3e67fc700 1 --2- 172.21.15.36:0/1766246312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3f0143650 0x7fb3f0143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3ee7fc700 1 -- 172.21.15.36:0/1766246312 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816078710 0 0) 0x7fb3f0060860 con 0x7fb3f00b77c0 2022-01-10T01:26:22.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3e67fc700 1 -- 172.21.15.36:0/1766246312 >> v1:172.21.15.36:6789/0 conn(0x7fb3f00b77c0 legacy=0x7fb3f0140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3e67fc700 1 -- 172.21.15.36:0/1766246312 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f0147410 con 0x7fb3f00b2200 2022-01-10T01:26:22.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3e67fc700 1 --2- 172.21.15.36:0/1766246312 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb3f00b2200 0x7fb3f0143160 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fb3d8002f70 tx=0x7fb3d8006eb0).ready entity=mon.0 client_cookie=9def5bcf2330b69 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:22.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3ee7fc700 1 -- 172.21.15.36:0/1766246312 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d800d570 con 0x7fb3f00b2200 2022-01-10T01:26:22.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3ee7fc700 1 -- 172.21.15.36:0/1766246312 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d8000e90 con 0x7fb3f00b2200 2022-01-10T01:26:22.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.345+0000 7fb3ee7fc700 1 -- 172.21.15.36:0/1766246312 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3d800d8c0 con 0x7fb3f00b2200 2022-01-10T01:26:22.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.349+0000 7fb3f56b8700 1 -- 172.21.15.36:0/1766246312 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb3f00b2200 msgr2=0x7fb3f0143160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.349+0000 7fb3f56b8700 1 --2- 172.21.15.36:0/1766246312 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb3f00b2200 0x7fb3f0143160 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fb3d8002f70 tx=0x7fb3d8006eb0).stop 2022-01-10T01:26:22.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.349+0000 7fb3f56b8700 1 -- 172.21.15.36:0/1766246312 shutdown_connections 2022-01-10T01:26:22.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.349+0000 7fb3f56b8700 1 --2- 172.21.15.36:0/1766246312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3f0143650 0x7fb3f0143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.349+0000 7fb3f56b8700 1 --2- 172.21.15.36:0/1766246312 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb3f00b2200 0x7fb3f0143160 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.349+0000 7fb3f56b8700 1 -- 172.21.15.36:0/1766246312 >> 172.21.15.36:0/1766246312 conn(0x7fb3f00629d0 msgr2=0x7fb3f0062de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:22.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.349+0000 7fb3f56b8700 1 -- 172.21.15.36:0/1766246312 shutdown_connections 2022-01-10T01:26:22.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.349+0000 7fb3f56b8700 1 -- 172.21.15.36:0/1766246312 wait complete. 2022-01-10T01:26:22.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.349+0000 7fb3f56b8700 1 Processor -- start 2022-01-10T01:26:22.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.349+0000 7fb3f56b8700 1 -- start start 2022-01-10T01:26:22.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3f56b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3f00b2200 0x7fb3f00aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3f56b8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3f00b77c0 0x7fb3f00adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3f56b8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb3f0143650 0x7fb3f00ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3f56b8700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f00ad7a0 con 0x7fb3f0143650 2022-01-10T01:26:22.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3f56b8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f00acd70 con 0x7fb3f00b77c0 2022-01-10T01:26:22.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3f56b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f00ad010 con 0x7fb3f00b2200 2022-01-10T01:26:22.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3ef7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb3f0143650 0x7fb3f00ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3ef7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb3f0143650 0x7fb3f00ae0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35890/0 (socket says 172.21.15.36:35890) 2022-01-10T01:26:22.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3ef7fe700 1 -- 172.21.15.36:0/163369127 learned_addr learned my addr 172.21.15.36:0/163369127 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:22.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3eeffd700 1 --2- 172.21.15.36:0/163369127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3f00b2200 0x7fb3f00aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3e67fc700 1 --2- 172.21.15.36:0/163369127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3f00b77c0 0x7fb3f00adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3ef7fe700 1 -- 172.21.15.36:0/163369127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3f00b2200 msgr2=0x7fb3f00aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3ef7fe700 1 --2- 172.21.15.36:0/163369127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3f00b2200 0x7fb3f00aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3ef7fe700 1 -- 172.21.15.36:0/163369127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3f00b77c0 msgr2=0x7fb3f00adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3ef7fe700 1 --2- 172.21.15.36:0/163369127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3f00b77c0 0x7fb3f00adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3ef7fe700 1 -- 172.21.15.36:0/163369127 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d800b1e0 con 0x7fb3f0143650 2022-01-10T01:26:22.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3ef7fe700 1 --2- 172.21.15.36:0/163369127 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb3f0143650 0x7fb3f00ae0f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fb3e8006e00 tx=0x7fb3e80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:22.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3ecff9700 1 -- 172.21.15.36:0/163369127 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3e8012600 con 0x7fb3f0143650 2022-01-10T01:26:22.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3ecff9700 1 -- 172.21.15.36:0/163369127 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e8012760 con 0x7fb3f0143650 2022-01-10T01:26:22.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3f56b8700 1 -- 172.21.15.36:0/163369127 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f00ad2b0 con 0x7fb3f0143650 2022-01-10T01:26:22.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3ecff9700 1 -- 172.21.15.36:0/163369127 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3e8012ac0 con 0x7fb3f0143650 2022-01-10T01:26:22.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.353+0000 7fb3f56b8700 1 -- 172.21.15.36:0/163369127 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f00b1110 con 0x7fb3f0143650 2022-01-10T01:26:22.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.357+0000 7fb3f56b8700 1 -- 172.21.15.36:0/163369127 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f005f2f0 con 0x7fb3f0143650 2022-01-10T01:26:22.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.357+0000 7fb3ecff9700 1 -- 172.21.15.36:0/163369127 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb3e8022070 con 0x7fb3f0143650 2022-01-10T01:26:22.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.357+0000 7fb3ecff9700 1 --2- 172.21.15.36:0/163369127 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb3c8053560 0x7fb3c8055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.357+0000 7fb3ecff9700 1 -- 172.21.15.36:0/163369127 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb3e806c0c0 con 0x7fb3f0143650 2022-01-10T01:26:22.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.357+0000 7fb3eeffd700 1 --2- 172.21.15.36:0/163369127 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb3c8053560 0x7fb3c8055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.357+0000 7fb3eeffd700 1 --2- 172.21.15.36:0/163369127 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb3c8053560 0x7fb3c8055a20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fb3e000d000 tx=0x7fb3e0007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:22.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.365+0000 7fb3ecff9700 1 -- 172.21.15.36:0/163369127 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb3f005f2f0 con 0x7fb3f0143650 2022-01-10T01:26:22.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.489+0000 7fb3f56b8700 1 -- 172.21.15.36:0/163369127 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb3f005f2f0 con 0x7fb3f0143650 2022-01-10T01:26:22.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.489+0000 7fb3ecff9700 1 -- 172.21.15.36:0/163369127 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb3f005f2f0 con 0x7fb3f0143650 2022-01-10T01:26:22.493 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:26:22.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.489+0000 7fb3f56b8700 1 -- 172.21.15.36:0/163369127 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb3c8053560 msgr2=0x7fb3c8055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.489+0000 7fb3f56b8700 1 --2- 172.21.15.36:0/163369127 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb3c8053560 0x7fb3c8055a20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fb3e000d000 tx=0x7fb3e0007a00).stop 2022-01-10T01:26:22.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.489+0000 7fb3f56b8700 1 -- 172.21.15.36:0/163369127 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb3f0143650 msgr2=0x7fb3f00ae0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.489+0000 7fb3f56b8700 1 --2- 172.21.15.36:0/163369127 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb3f0143650 0x7fb3f00ae0f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fb3e8006e00 tx=0x7fb3e80091d0).stop 2022-01-10T01:26:22.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.489+0000 7fb3f56b8700 1 -- 172.21.15.36:0/163369127 shutdown_connections 2022-01-10T01:26:22.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.489+0000 7fb3f56b8700 1 --2- 172.21.15.36:0/163369127 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb3c8053560 0x7fb3c8055a20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.489+0000 7fb3f56b8700 1 --2- 172.21.15.36:0/163369127 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb3f0143650 0x7fb3f00ae0f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.489+0000 7fb3f56b8700 1 --2- 172.21.15.36:0/163369127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb3f00b77c0 0x7fb3f00adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.489+0000 7fb3f56b8700 1 --2- 172.21.15.36:0/163369127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb3f00b2200 0x7fb3f00aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.493+0000 7fb3f56b8700 1 -- 172.21.15.36:0/163369127 >> 172.21.15.36:0/163369127 conn(0x7fb3f00629d0 msgr2=0x7fb3f00b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:22.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.493+0000 7fb3f56b8700 1 -- 172.21.15.36:0/163369127 shutdown_connections 2022-01-10T01:26:22.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.493+0000 7fb3f56b8700 1 -- 172.21.15.36:0/163369127 wait complete. 2022-01-10T01:26:22.506 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:26:22.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.605+0000 7fe7c1299700 1 Processor -- start 2022-01-10T01:26:22.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.605+0000 7fe7c1299700 1 -- start start 2022-01-10T01:26:22.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7c1299700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7bc0b1ec0 0x7fe7bc0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7c1299700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe7bc0affb0 0x7fe7bc0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7c1299700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7bc0b2790 con 0x7fe7bc0a70c0 2022-01-10T01:26:22.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7c1299700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7bc0b03f0 con 0x7fe7bc0affb0 2022-01-10T01:26:22.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7c1299700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0b0650 con 0x7fe7bc0b1ec0 2022-01-10T01:26:22.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7bb7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe7bc0a70c0 0x7fe7bc141250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33692/0 (socket says 172.21.15.36:33692) 2022-01-10T01:26:22.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7bb7fe700 1 -- 172.21.15.36:0/381932111 learned_addr learned my addr 172.21.15.36:0/381932111 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:22.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7ba7fc700 1 --2- 172.21.15.36:0/381932111 >> v2:172.21.15.59:3300/0 conn(0x7fe7bc0affb0 0x7fe7bc0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7baffd700 1 --2- 172.21.15.36:0/381932111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7bc0b1ec0 0x7fe7bc0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 -- 172.21.15.36:0/381932111 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307811287 0 0) 0x7fe7bc0b2790 con 0x7fe7bc0a70c0 2022-01-10T01:26:22.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 -- 172.21.15.36:0/381932111 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7a0003260 con 0x7fe7bc0a70c0 2022-01-10T01:26:22.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 -- 172.21.15.36:0/381932111 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1221915710 0 0) 0x7fe7a0003260 con 0x7fe7bc0a70c0 2022-01-10T01:26:22.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 -- 172.21.15.36:0/381932111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7bc0b1ec0 msgr2=0x7fe7bc0b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:22.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 --2- 172.21.15.36:0/381932111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7bc0b1ec0 0x7fe7bc0b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 -- 172.21.15.36:0/381932111 >> v2:172.21.15.59:3300/0 conn(0x7fe7bc0affb0 msgr2=0x7fe7bc0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:22.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 --2- 172.21.15.36:0/381932111 >> v2:172.21.15.59:3300/0 conn(0x7fe7bc0affb0 0x7fe7bc0b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 -- 172.21.15.36:0/381932111 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc0b08f0 con 0x7fe7bc0a70c0 2022-01-10T01:26:22.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 -- 172.21.15.36:0/381932111 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fe7b4001660 con 0x7fe7bc0a70c0 2022-01-10T01:26:22.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 -- 172.21.15.36:0/381932111 >> v1:172.21.15.36:6789/0 conn(0x7fe7bc0a70c0 legacy=0x7fe7bc141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 --2- 172.21.15.36:0/381932111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7bc0b1ec0 0x7fe7a0003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 --2- 172.21.15.36:0/381932111 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7a0003c80 0x7fe7a0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 --2- 172.21.15.36:0/381932111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a00049f0 0x7fe7a0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 -- 172.21.15.36:0/381932111 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0b03f0 con 0x7fe7a0003c80 2022-01-10T01:26:22.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 -- 172.21.15.36:0/381932111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0b0650 con 0x7fe7a00049f0 2022-01-10T01:26:22.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 -- 172.21.15.36:0/381932111 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a000b750 con 0x7fe7bc0b1ec0 2022-01-10T01:26:22.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7ba7fc700 1 --2- 172.21.15.36:0/381932111 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7a0003c80 0x7fe7a0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7baffd700 1 --2- 172.21.15.36:0/381932111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7bc0b1ec0 0x7fe7a0003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7bb7fe700 1 --2- 172.21.15.36:0/381932111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a00049f0 0x7fe7a0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7ba7fc700 1 -- 172.21.15.36:0/381932111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7bc0b1ec0 msgr2=0x7fe7a0003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:22.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7ba7fc700 1 --2- 172.21.15.36:0/381932111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7bc0b1ec0 0x7fe7a0003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7ba7fc700 1 -- 172.21.15.36:0/381932111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a00049f0 msgr2=0x7fe7a0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:22.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7ba7fc700 1 --2- 172.21.15.36:0/381932111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a00049f0 0x7fe7a0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7ba7fc700 1 -- 172.21.15.36:0/381932111 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a0003260 con 0x7fe7a0003c80 2022-01-10T01:26:22.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7ba7fc700 1 --2- 172.21.15.36:0/381932111 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7a0003c80 0x7fe7a0004500 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fe7a00054d0 tx=0x7fe7ac0091d0).ready entity=mon.0 client_cookie=45acc4738c7931f4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:22.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 -- 172.21.15.36:0/381932111 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7ac00e7e0 con 0x7fe7a0003c80 2022-01-10T01:26:22.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 -- 172.21.15.36:0/381932111 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac00e940 con 0x7fe7a0003c80 2022-01-10T01:26:22.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.609+0000 7fe7b9ffb700 1 -- 172.21.15.36:0/381932111 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7ac00eca0 con 0x7fe7a0003c80 2022-01-10T01:26:22.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7c1299700 1 -- 172.21.15.36:0/381932111 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7a0003c80 msgr2=0x7fe7a0004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7c1299700 1 --2- 172.21.15.36:0/381932111 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7a0003c80 0x7fe7a0004500 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fe7a00054d0 tx=0x7fe7ac0091d0).stop 2022-01-10T01:26:22.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7bb7fe700 1 -- 172.21.15.36:0/381932111 reap_dead start 2022-01-10T01:26:22.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7c1299700 1 -- 172.21.15.36:0/381932111 shutdown_connections 2022-01-10T01:26:22.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7c1299700 1 -- 172.21.15.36:0/381932111 >> 172.21.15.36:0/381932111 conn(0x7fe7bc05f6b0 msgr2=0x7fe7bc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:22.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7c1299700 1 -- 172.21.15.36:0/381932111 shutdown_connections 2022-01-10T01:26:22.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7c1299700 1 -- 172.21.15.36:0/381932111 wait complete. 2022-01-10T01:26:22.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7c1299700 1 Processor -- start 2022-01-10T01:26:22.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7c1299700 1 -- start start 2022-01-10T01:26:22.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7c1299700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7bc1402e0 0x7fe7bc14b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7c1299700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7bc156ef0 0x7fe7bc157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7c1299700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7bc0ac010 0x7fe7bc157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7c1299700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0aa870 con 0x7fe7bc156ef0 2022-01-10T01:26:22.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7c1299700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc14aad0 con 0x7fe7bc1402e0 2022-01-10T01:26:22.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7c1299700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc15ae10 con 0x7fe7bc0ac010 2022-01-10T01:26:22.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7ba7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7bc156ef0 0x7fe7bc157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7ba7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7bc156ef0 0x7fe7bc157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35908/0 (socket says 172.21.15.36:35908) 2022-01-10T01:26:22.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7ba7fc700 1 -- 172.21.15.36:0/4269919685 learned_addr learned my addr 172.21.15.36:0/4269919685 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:22.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7baffd700 1 --2- 172.21.15.36:0/4269919685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7bc1402e0 0x7fe7bc14b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7bb7fe700 1 --2- 172.21.15.36:0/4269919685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7bc0ac010 0x7fe7bc157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7ba7fc700 1 -- 172.21.15.36:0/4269919685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7bc0ac010 msgr2=0x7fe7bc157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7ba7fc700 1 --2- 172.21.15.36:0/4269919685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7bc0ac010 0x7fe7bc157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7ba7fc700 1 -- 172.21.15.36:0/4269919685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7bc1402e0 msgr2=0x7fe7bc14b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7ba7fc700 1 --2- 172.21.15.36:0/4269919685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7bc1402e0 0x7fe7bc14b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.613+0000 7fe7ba7fc700 1 -- 172.21.15.36:0/4269919685 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc13e600 con 0x7fe7bc156ef0 2022-01-10T01:26:22.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.617+0000 7fe7ba7fc700 1 --2- 172.21.15.36:0/4269919685 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7bc156ef0 0x7fe7bc157580 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fe7bc15afa0 tx=0x7fe7ac01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:22.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.617+0000 7fe7abfff700 1 -- 172.21.15.36:0/4269919685 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7ac00e7e0 con 0x7fe7bc156ef0 2022-01-10T01:26:22.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.617+0000 7fe7abfff700 1 -- 172.21.15.36:0/4269919685 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac01b640 con 0x7fe7bc156ef0 2022-01-10T01:26:22.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.617+0000 7fe7abfff700 1 -- 172.21.15.36:0/4269919685 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7ac009600 con 0x7fe7bc156ef0 2022-01-10T01:26:22.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.617+0000 7fe7c1299700 1 -- 172.21.15.36:0/4269919685 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7bc0aaaa0 con 0x7fe7bc156ef0 2022-01-10T01:26:22.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.617+0000 7fe7c1299700 1 -- 172.21.15.36:0/4269919685 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7bc1406c0 con 0x7fe7bc156ef0 2022-01-10T01:26:22.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.617+0000 7fe7c1299700 1 -- 172.21.15.36:0/4269919685 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7bc0b0b90 con 0x7fe7bc156ef0 2022-01-10T01:26:22.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.617+0000 7fe7abfff700 1 -- 172.21.15.36:0/4269919685 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe7ac01b9a0 con 0x7fe7bc156ef0 2022-01-10T01:26:22.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.617+0000 7fe7abfff700 1 --2- 172.21.15.36:0/4269919685 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7980535f0 0x7fe798055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.621+0000 7fe7baffd700 1 --2- 172.21.15.36:0/4269919685 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7980535f0 0x7fe798055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.621+0000 7fe7abfff700 1 -- 172.21.15.36:0/4269919685 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe7ac06d940 con 0x7fe7bc156ef0 2022-01-10T01:26:22.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.621+0000 7fe7baffd700 1 --2- 172.21.15.36:0/4269919685 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7980535f0 0x7fe798055ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fe7b000b000 tx=0x7fe7b0006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:22.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.625+0000 7fe7abfff700 1 -- 172.21.15.36:0/4269919685 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe7ac044840 con 0x7fe7bc156ef0 2022-01-10T01:26:22.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.753+0000 7fe7c1299700 1 -- 172.21.15.36:0/4269919685 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe7bc057350 con 0x7fe7bc156ef0 2022-01-10T01:26:22.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.753+0000 7fe7abfff700 1 -- 172.21.15.36:0/4269919685 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe7ac02a020 con 0x7fe7bc156ef0 2022-01-10T01:26:22.757 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:26:22.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.757+0000 7fe7c1299700 1 -- 172.21.15.36:0/4269919685 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7980535f0 msgr2=0x7fe798055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.757+0000 7fe7c1299700 1 --2- 172.21.15.36:0/4269919685 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7980535f0 0x7fe798055ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fe7b000b000 tx=0x7fe7b0006df0).stop 2022-01-10T01:26:22.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.757+0000 7fe7c1299700 1 -- 172.21.15.36:0/4269919685 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7bc156ef0 msgr2=0x7fe7bc157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.757+0000 7fe7c1299700 1 --2- 172.21.15.36:0/4269919685 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7bc156ef0 0x7fe7bc157580 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fe7bc15afa0 tx=0x7fe7ac01a000).stop 2022-01-10T01:26:22.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.757+0000 7fe7c1299700 1 -- 172.21.15.36:0/4269919685 shutdown_connections 2022-01-10T01:26:22.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.757+0000 7fe7c1299700 1 --2- 172.21.15.36:0/4269919685 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7980535f0 0x7fe798055ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.757+0000 7fe7c1299700 1 --2- 172.21.15.36:0/4269919685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7bc0ac010 0x7fe7bc157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.757+0000 7fe7c1299700 1 --2- 172.21.15.36:0/4269919685 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7bc156ef0 0x7fe7bc157580 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.757+0000 7fe7c1299700 1 --2- 172.21.15.36:0/4269919685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7bc1402e0 0x7fe7bc14b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.757+0000 7fe7c1299700 1 -- 172.21.15.36:0/4269919685 >> 172.21.15.36:0/4269919685 conn(0x7fe7bc05f6b0 msgr2=0x7fe7bc13aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:22.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.757+0000 7fe7c1299700 1 -- 172.21.15.36:0/4269919685 shutdown_connections 2022-01-10T01:26:22.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.757+0000 7fe7c1299700 1 -- 172.21.15.36:0/4269919685 wait complete. 2022-01-10T01:26:22.776 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:26:22.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.881+0000 7f9af738d700 1 Processor -- start 2022-01-10T01:26:22.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.881+0000 7f9af738d700 1 -- start start 2022-01-10T01:26:22.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.881+0000 7f9af738d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9af0061320 0x7f9af0061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.881+0000 7f9af738d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9af0140440 0x7f9af01408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.881+0000 7f9af738d700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af00aecf0 con 0x7f9af00ad5c0 2022-01-10T01:26:22.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.881+0000 7f9af738d700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af00b6f20 con 0x7f9af0140440 2022-01-10T01:26:22.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.881+0000 7f9af738d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00aef20 con 0x7f9af0061320 2022-01-10T01:26:22.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.881+0000 7f9af5b8a700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9af00ad5c0 0x7f9af00b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33708/0 (socket says 172.21.15.36:33708) 2022-01-10T01:26:22.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.881+0000 7f9af6b8c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9af0140440 0x7f9af01408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.881+0000 7f9af5b8a700 1 -- 172.21.15.36:0/3743404867 learned_addr learned my addr 172.21.15.36:0/3743404867 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:22.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af638b700 1 --2- 172.21.15.36:0/3743404867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9af0061320 0x7f9af0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af5389700 1 -- 172.21.15.36:0/3743404867 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858563708 0 0) 0x7f9af00aecf0 con 0x7f9af00ad5c0 2022-01-10T01:26:22.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af5389700 1 -- 172.21.15.36:0/3743404867 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ad8003260 con 0x7f9af00ad5c0 2022-01-10T01:26:22.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af6b8c700 1 -- 172.21.15.36:0/3743404867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9af0061320 msgr2=0x7f9af0061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:22.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af6b8c700 1 --2- 172.21.15.36:0/3743404867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9af0061320 0x7f9af0061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af6b8c700 1 -- 172.21.15.36:0/3743404867 >> v1:172.21.15.36:6789/0 conn(0x7f9af00ad5c0 legacy=0x7f9af00b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af6b8c700 1 -- 172.21.15.36:0/3743404867 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af00af1c0 con 0x7f9af0140440 2022-01-10T01:26:22.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af6b8c700 1 --2- 172.21.15.36:0/3743404867 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9af0140440 0x7f9af01408d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f9ae80032f0 tx=0x7f9ae80091d0).ready entity=mon.0 client_cookie=da97837938169e55 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:22.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af5389700 1 -- 172.21.15.36:0/3743404867 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ae800b600 con 0x7f9af0140440 2022-01-10T01:26:22.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af5389700 1 -- 172.21.15.36:0/3743404867 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae800b760 con 0x7f9af0140440 2022-01-10T01:26:22.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af5389700 1 -- 172.21.15.36:0/3743404867 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ae800b8d0 con 0x7f9af0140440 2022-01-10T01:26:22.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af738d700 1 -- 172.21.15.36:0/3743404867 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9af0140440 msgr2=0x7f9af01408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af738d700 1 --2- 172.21.15.36:0/3743404867 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9af0140440 0x7f9af01408d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f9ae80032f0 tx=0x7f9ae80091d0).stop 2022-01-10T01:26:22.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af738d700 1 -- 172.21.15.36:0/3743404867 shutdown_connections 2022-01-10T01:26:22.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af738d700 1 --2- 172.21.15.36:0/3743404867 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9af0140440 0x7f9af01408d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af738d700 1 --2- 172.21.15.36:0/3743404867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9af0061320 0x7f9af0061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af738d700 1 -- 172.21.15.36:0/3743404867 >> 172.21.15.36:0/3743404867 conn(0x7f9af0066de0 msgr2=0x7f9af00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:22.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af738d700 1 -- 172.21.15.36:0/3743404867 shutdown_connections 2022-01-10T01:26:22.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af738d700 1 -- 172.21.15.36:0/3743404867 wait complete. 2022-01-10T01:26:22.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af738d700 1 Processor -- start 2022-01-10T01:26:22.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.885+0000 7f9af738d700 1 -- start start 2022-01-10T01:26:22.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af738d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9af0061320 0x7f9af00b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af738d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9af00ad5c0 0x7f9af00ab820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af738d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9af0140440 0x7f9af00abd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af738d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af0145e40 con 0x7f9af0061320 2022-01-10T01:26:22.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af738d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00b1190 con 0x7f9af00ad5c0 2022-01-10T01:26:22.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af738d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00aa880 con 0x7f9af0140440 2022-01-10T01:26:22.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af638b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9af0061320 0x7f9af00b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af638b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9af0061320 0x7f9af00b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35920/0 (socket says 172.21.15.36:35920) 2022-01-10T01:26:22.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af638b700 1 -- 172.21.15.36:0/3416964164 learned_addr learned my addr 172.21.15.36:0/3416964164 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:22.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af5b8a700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9af00ad5c0 0x7f9af00ab820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af6b8c700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9af0140440 0x7f9af00abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af638b700 1 -- 172.21.15.36:0/3416964164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9af0140440 msgr2=0x7f9af00abd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af638b700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9af0140440 0x7f9af00abd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af638b700 1 -- 172.21.15.36:0/3416964164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9af00ad5c0 msgr2=0x7f9af00ab820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:22.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af638b700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9af00ad5c0 0x7f9af00ab820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:22.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af638b700 1 -- 172.21.15.36:0/3416964164 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8009470 con 0x7f9af0061320 2022-01-10T01:26:22.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af5b8a700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9af00ad5c0 0x7f9af00ab820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:22.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af638b700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9af0061320 0x7f9af00b08d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f9aec00c000 tx=0x7f9aec006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:22.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9adf7fe700 1 -- 172.21.15.36:0/3416964164 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec010780 con 0x7f9af0061320 2022-01-10T01:26:22.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9adf7fe700 1 -- 172.21.15.36:0/3416964164 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec0108e0 con 0x7f9af0061320 2022-01-10T01:26:22.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af738d700 1 -- 172.21.15.36:0/3416964164 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af00acb10 con 0x7f9af0061320 2022-01-10T01:26:22.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9adf7fe700 1 -- 172.21.15.36:0/3416964164 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9aec010c40 con 0x7f9af0061320 2022-01-10T01:26:22.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af738d700 1 -- 172.21.15.36:0/3416964164 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af00ab1c0 con 0x7f9af0061320 2022-01-10T01:26:22.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.889+0000 7f9af738d700 1 -- 172.21.15.36:0/3416964164 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af00b0f60 con 0x7f9af0061320 2022-01-10T01:26:22.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.893+0000 7f9adf7fe700 1 -- 172.21.15.36:0/3416964164 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9aec01c460 con 0x7f9af0061320 2022-01-10T01:26:22.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.893+0000 7f9adf7fe700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ad00534d0 0x7f9ad0055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:22.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.893+0000 7f9adf7fe700 1 -- 172.21.15.36:0/3416964164 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9aec06c110 con 0x7f9af0061320 2022-01-10T01:26:22.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.893+0000 7f9af5b8a700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ad00534d0 0x7f9ad0055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:22.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.893+0000 7f9af5b8a700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ad00534d0 0x7f9ad0055990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f9ae000b000 tx=0x7f9ae0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:22.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:22.897+0000 7f9adf7fe700 1 -- 172.21.15.36:0/3416964164 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9aec042fb0 con 0x7f9af0061320 2022-01-10T01:26:23.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.025+0000 7f9af738d700 1 -- 172.21.15.36:0/3416964164 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9af00aaa80 con 0x7f9af0061320 2022-01-10T01:26:23.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.025+0000 7f9adf7fe700 1 -- 172.21.15.36:0/3416964164 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9aec0465d0 con 0x7f9af0061320 2022-01-10T01:26:23.028 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:26:23.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.025+0000 7f9af738d700 1 -- 172.21.15.36:0/3416964164 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ad00534d0 msgr2=0x7f9ad0055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:23.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.025+0000 7f9af738d700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ad00534d0 0x7f9ad0055990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f9ae000b000 tx=0x7f9ae0009040).stop 2022-01-10T01:26:23.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.025+0000 7f9af738d700 1 -- 172.21.15.36:0/3416964164 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9af0061320 msgr2=0x7f9af00b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:23.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.025+0000 7f9af738d700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9af0061320 0x7f9af00b08d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f9aec00c000 tx=0x7f9aec006df0).stop 2022-01-10T01:26:23.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.025+0000 7f9af738d700 1 -- 172.21.15.36:0/3416964164 shutdown_connections 2022-01-10T01:26:23.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.025+0000 7f9af738d700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ad00534d0 0x7f9ad0055990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:23.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.025+0000 7f9af738d700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9af0140440 0x7f9af00abd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:23.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.025+0000 7f9af738d700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9af00ad5c0 0x7f9af00ab820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:23.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.025+0000 7f9af738d700 1 --2- 172.21.15.36:0/3416964164 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9af0061320 0x7f9af00b08d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:23.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.025+0000 7f9af738d700 1 -- 172.21.15.36:0/3416964164 >> 172.21.15.36:0/3416964164 conn(0x7f9af0066de0 msgr2=0x7f9af00b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:23.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.025+0000 7f9af738d700 1 -- 172.21.15.36:0/3416964164 shutdown_connections 2022-01-10T01:26:23.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.025+0000 7f9af738d700 1 -- 172.21.15.36:0/3416964164 wait complete. 2022-01-10T01:26:23.042 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:26:23.042 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:26:23.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.141+0000 7f20e513a700 1 Processor -- start 2022-01-10T01:26:23.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.141+0000 7f20e513a700 1 -- start start 2022-01-10T01:26:23.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20e513a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20e00b04a0 0x7f20e00add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:23.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20e513a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f20e00aa120 0x7f20e00ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:23.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20e513a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20e00b2af0 con 0x7f20e00b0880 2022-01-10T01:26:23.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20e513a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20e00b2770 con 0x7f20e00aa120 2022-01-10T01:26:23.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20e513a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e00b2d20 con 0x7f20e00b04a0 2022-01-10T01:26:23.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20de59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f20e00aa120 0x7f20e00ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:23.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20df59e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f20e00b0880 0x7f20e0143710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:51402/0 (socket says 172.21.15.36:51402) 2022-01-10T01:26:23.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20df59e700 1 -- 172.21.15.36:0/539103330 learned_addr learned my addr 172.21.15.36:0/539103330 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:23.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20ded9d700 1 --2- 172.21.15.36:0/539103330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20e00b04a0 0x7f20e00add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:23.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20de59c700 1 -- 172.21.15.36:0/539103330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20e00b04a0 msgr2=0x7f20e00add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:23.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20de59c700 1 --2- 172.21.15.36:0/539103330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20e00b04a0 0x7f20e00add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:23.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20de59c700 1 -- 172.21.15.36:0/539103330 >> v1:172.21.15.59:6789/0 conn(0x7f20e00b0880 legacy=0x7f20e0143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:23.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20de59c700 1 -- 172.21.15.36:0/539103330 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20e00a9b70 con 0x7f20e00aa120 2022-01-10T01:26:23.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20ded9d700 1 --2- 172.21.15.36:0/539103330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20e00b04a0 0x7f20e00add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:23.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20de59c700 1 --2- 172.21.15.36:0/539103330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e00aa120 0x7f20e00ae220 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f20d0002f70 tx=0x7f20d0006df0).ready entity=mon.1 client_cookie=aded142297d83911 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:23.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20ddd9b700 1 -- 172.21.15.36:0/539103330 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20d000f970 con 0x7f20e00aa120 2022-01-10T01:26:23.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20ddd9b700 1 -- 172.21.15.36:0/539103330 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d0000e90 con 0x7f20e00aa120 2022-01-10T01:26:23.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20ddd9b700 1 -- 172.21.15.36:0/539103330 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20d000fcc0 con 0x7f20e00aa120 2022-01-10T01:26:23.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20e513a700 1 -- 172.21.15.36:0/539103330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e00aa120 msgr2=0x7f20e00ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:23.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20e513a700 1 --2- 172.21.15.36:0/539103330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e00aa120 0x7f20e00ae220 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f20d0002f70 tx=0x7f20d0006df0).stop 2022-01-10T01:26:23.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20e513a700 1 -- 172.21.15.36:0/539103330 shutdown_connections 2022-01-10T01:26:23.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20e513a700 1 --2- 172.21.15.36:0/539103330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e00aa120 0x7f20e00ae220 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:23.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20e513a700 1 --2- 172.21.15.36:0/539103330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20e00b04a0 0x7f20e00add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:23.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20e513a700 1 -- 172.21.15.36:0/539103330 >> 172.21.15.36:0/539103330 conn(0x7f20e00607c0 msgr2=0x7f20e0060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:23.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20e513a700 1 -- 172.21.15.36:0/539103330 shutdown_connections 2022-01-10T01:26:23.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.145+0000 7f20e513a700 1 -- 172.21.15.36:0/539103330 wait complete. 2022-01-10T01:26:23.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20e513a700 1 Processor -- start 2022-01-10T01:26:23.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20e513a700 1 -- start start 2022-01-10T01:26:23.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20e513a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20e00aa120 0x7f20e01405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:23.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20e513a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20e00b04a0 0x7f20e00638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:23.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20e513a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e00b0880 0x7f20e0144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:23.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20e513a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e0144cc0 con 0x7f20e00b04a0 2022-01-10T01:26:23.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20e513a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e0144f10 con 0x7f20e00b0880 2022-01-10T01:26:23.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20e513a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20e01451b0 con 0x7f20e00aa120 2022-01-10T01:26:23.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20de59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20e00b04a0 0x7f20e00638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:23.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20de59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20e00b04a0 0x7f20e00638d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35936/0 (socket says 172.21.15.36:35936) 2022-01-10T01:26:23.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20de59c700 1 -- 172.21.15.36:0/3924383326 learned_addr learned my addr 172.21.15.36:0/3924383326 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:23.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20df59e700 1 --2- 172.21.15.36:0/3924383326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e00b0880 0x7f20e0144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:23.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20ded9d700 1 --2- 172.21.15.36:0/3924383326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20e00aa120 0x7f20e01405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:23.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20de59c700 1 -- 172.21.15.36:0/3924383326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20e00aa120 msgr2=0x7f20e01405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:23.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20de59c700 1 --2- 172.21.15.36:0/3924383326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20e00aa120 0x7f20e01405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:23.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20de59c700 1 -- 172.21.15.36:0/3924383326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e00b0880 msgr2=0x7f20e0144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:23.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20de59c700 1 --2- 172.21.15.36:0/3924383326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e00b0880 0x7f20e0144480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:23.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20de59c700 1 -- 172.21.15.36:0/3924383326 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d000b180 con 0x7f20e00b04a0 2022-01-10T01:26:23.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20de59c700 1 --2- 172.21.15.36:0/3924383326 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20e00b04a0 0x7f20e00638d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f20d0002f70 tx=0x7f20d0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:23.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20cffff700 1 -- 172.21.15.36:0/3924383326 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20d0006b20 con 0x7f20e00b04a0 2022-01-10T01:26:23.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20cffff700 1 -- 172.21.15.36:0/3924383326 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d000bed0 con 0x7f20e00b04a0 2022-01-10T01:26:23.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20cffff700 1 -- 172.21.15.36:0/3924383326 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20d00187e0 con 0x7f20e00b04a0 2022-01-10T01:26:23.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20e513a700 1 -- 172.21.15.36:0/3924383326 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e0145450 con 0x7f20e00b04a0 2022-01-10T01:26:23.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.149+0000 7f20e513a700 1 -- 172.21.15.36:0/3924383326 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e013da70 con 0x7f20e00b04a0 2022-01-10T01:26:23.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.153+0000 7f20e513a700 1 -- 172.21.15.36:0/3924383326 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e0057350 con 0x7f20e00b04a0 2022-01-10T01:26:23.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.153+0000 7f20cffff700 1 -- 172.21.15.36:0/3924383326 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f20d002b070 con 0x7f20e00b04a0 2022-01-10T01:26:23.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.153+0000 7f20cffff700 1 --2- 172.21.15.36:0/3924383326 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f20bc053620 0x7f20bc055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:23.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.153+0000 7f20cffff700 1 -- 172.21.15.36:0/3924383326 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f20d006d0b0 con 0x7f20e00b04a0 2022-01-10T01:26:23.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.153+0000 7f20ded9d700 1 --2- 172.21.15.36:0/3924383326 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f20bc053620 0x7f20bc055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:23.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.153+0000 7f20ded9d700 1 --2- 172.21.15.36:0/3924383326 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f20bc053620 0x7f20bc055ae0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f20d400c000 tx=0x7f20d4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:23.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.161+0000 7f20cffff700 1 -- 172.21.15.36:0/3924383326 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f20d0047af0 con 0x7f20e00b04a0 2022-01-10T01:26:23.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.321+0000 7f20e513a700 1 -- 172.21.15.36:0/3924383326 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20e0044650 con 0x7f20e00b04a0 2022-01-10T01:26:23.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.325+0000 7f20cffff700 1 -- 172.21.15.36:0/3924383326 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f20d0029070 con 0x7f20e00b04a0 2022-01-10T01:26:23.328 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:23.328 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/986398854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":986398854},{"type":"v1","addr":"172.21.15.36:6835","nonce":986398854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/781575126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":781575126},{"type":"v1","addr":"172.21.15.36:6837","nonce":781575126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:26:18.598647+0000","modified":"2022-01-10T01:26:19.737578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3873482962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3873482962},{"type":"v1","addr":"172.21.15.59:6833","nonce":3873482962}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2022-01-10T01:26:23.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.329+0000 7f20e513a700 1 -- 172.21.15.36:0/3924383326 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f20bc053620 msgr2=0x7f20bc055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:23.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.329+0000 7f20e513a700 1 --2- 172.21.15.36:0/3924383326 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f20bc053620 0x7f20bc055ae0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f20d400c000 tx=0x7f20d4008040).stop 2022-01-10T01:26:23.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.329+0000 7f20e513a700 1 -- 172.21.15.36:0/3924383326 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20e00b04a0 msgr2=0x7f20e00638d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:23.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.329+0000 7f20e513a700 1 --2- 172.21.15.36:0/3924383326 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20e00b04a0 0x7f20e00638d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f20d0002f70 tx=0x7f20d0017000).stop 2022-01-10T01:26:23.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.329+0000 7f20e513a700 1 -- 172.21.15.36:0/3924383326 shutdown_connections 2022-01-10T01:26:23.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.329+0000 7f20e513a700 1 --2- 172.21.15.36:0/3924383326 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f20bc053620 0x7f20bc055ae0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:23.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.329+0000 7f20e513a700 1 --2- 172.21.15.36:0/3924383326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20e00b0880 0x7f20e0144480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:23.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.329+0000 7f20e513a700 1 --2- 172.21.15.36:0/3924383326 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20e00b04a0 0x7f20e00638d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:23.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.329+0000 7f20e513a700 1 --2- 172.21.15.36:0/3924383326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20e00aa120 0x7f20e01405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:23.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.329+0000 7f20e513a700 1 -- 172.21.15.36:0/3924383326 >> 172.21.15.36:0/3924383326 conn(0x7f20e00607c0 msgr2=0x7f20e00b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:23.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.329+0000 7f20e513a700 1 -- 172.21.15.36:0/3924383326 shutdown_connections 2022-01-10T01:26:23.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:23.329+0000 7f20e513a700 1 -- 172.21.15.36:0/3924383326 wait complete. 2022-01-10T01:26:23.336 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 18 2022-01-10T01:26:23.650 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:26:18.598647+0000', 'modified': '2022-01-10T01:26:19.737578+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5239}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5239': {'gid': 5239, 'name': 'b', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/3873482962', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 3873482962}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 3873482962}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:26:23.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:26:23.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:26:23.766 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":5239,"want_state":"up:active","state":"up:active","rank_uptime":5.1541159429999999,"mdsmap_epoch":18,"osdmap_epoch":46,"osdmap_epoch_barrier":46,"uptime":9.4893646779999994} 2022-01-10T01:26:23.767 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 5239, "mdsmap_epoch": 18, "osdmap_epoch": 46, "osdmap_epoch_barrier": 46, "rank_uptime": 5.154115943, "state": "up:active", "uptime": 9.489364678, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:26:23.768 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:26:23.768 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:26:23.768 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:26:23.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:23.769 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:23.778 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:26:23.792 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:26:23.793 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:26:23.850 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:26:23.851 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:26:23.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:23.852 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:26:23.859 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:26:23.860 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:23.863 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:26:23.876 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:26:23.877 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:26:23.887 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:26:23.888 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:26:23.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:23.889 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:26:23.938 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:26:23.937+0000 7ff35b716080 -1 init, newargv = 0x561ae0c78050 newargc=9 2022-01-10T01:26:23.939 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14162]: starting ceph client 2022-01-10T01:26:23.949 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14162]: starting fuse 2022-01-10T01:26:24.996 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:26:25.015 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:26:25.015 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:26:25.074 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:26:25.075 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:26:25.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:25.076 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:26:25.081 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:26:25.081 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:26:25.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:25.082 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:26:25.083 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:26:25.083 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:26:25.084 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:26:25.084 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:26:25.085 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:26:25.085 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:26:25.085 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:26:25.086 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:26:25.086 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:26:25.087 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:26:25.087 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:26:25.087 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:26:25.088 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:26:25.088 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:26:25.089 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:26:25.089 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:26:25.090 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:26:25.090 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:26:25.090 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:26:25.091 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:26:25.091 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:26:25.092 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:26:25.131 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.14162.asok 2022-01-10T01:26:25.136 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14162.asok 2022-01-10T01:26:25.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:25.137 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14162.asok status 2022-01-10T01:26:25.272 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:26:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:26:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:26:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:26:25.273 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:26:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:26:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:26:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "14162", 2022-01-10T01:26:25.274 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:26:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:26:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:26:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:26:25.275 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 34997, 2022-01-10T01:26:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:26:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:26:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:26:25.276 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 34997 2022-01-10T01:26:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:26:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:26:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:26:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:26:25.277 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 52143800 2022-01-10T01:26:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:26:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:26:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:26:25.278 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:26:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:26:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 52143800 2022-01-10T01:26:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:26:25.279 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.34997 172.21.15.139:0/52143800", 2022-01-10T01:26:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/52143800", 2022-01-10T01:26:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:26:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 18, 2022-01-10T01:26:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 46, 2022-01-10T01:26:25.280 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:26:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:26:25.281 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:26:25.281 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:26:25.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:25.283 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:26:25.283 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:25.291 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:26:25.292 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:26:25.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:25.293 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:25.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:25.353 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:26:25.353 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:25.360 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:26:25.361 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:26:25.362 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-01-10T01:26:25.362 DEBUG:teuthology.orchestra.run.smithi139:> import sys 2022-01-10T01:26:25.363 DEBUG:teuthology.orchestra.run.smithi139:> import time 2022-01-10T01:26:25.363 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:26:25.363 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:26:25.364 DEBUG:teuthology.orchestra.run.smithi139:> n = 1000 2022-01-10T01:26:25.364 DEBUG:teuthology.orchestra.run.smithi139:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2022-01-10T01:26:25.364 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:26:25.365 DEBUG:teuthology.orchestra.run.smithi139:> if not os.path.exists(os.path.dirname(abs_path)): 2022-01-10T01:26:25.365 DEBUG:teuthology.orchestra.run.smithi139:> os.makedirs(os.path.dirname(abs_path)) 2022-01-10T01:26:25.365 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:26:25.366 DEBUG:teuthology.orchestra.run.smithi139:> for i in range(0, n): 2022-01-10T01:26:25.366 DEBUG:teuthology.orchestra.run.smithi139:> fname = "{0}_{1}".format(abs_path, i) 2022-01-10T01:26:25.367 DEBUG:teuthology.orchestra.run.smithi139:> with open(fname, '"'"'w'"'"') as f: 2022-01-10T01:26:25.367 DEBUG:teuthology.orchestra.run.smithi139:> f.write('"'"'content'"'"') 2022-01-10T01:26:25.367 DEBUG:teuthology.orchestra.run.smithi139:> if True: 2022-01-10T01:26:25.368 DEBUG:teuthology.orchestra.run.smithi139:> f.flush() 2022-01-10T01:26:25.368 DEBUG:teuthology.orchestra.run.smithi139:> os.fsync(f.fileno()) 2022-01-10T01:26:25.369 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:26:30.971 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:26:30.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:26:30.977 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:26:30.979 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:26:36.453 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:26:36.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 Processor -- start 2022-01-10T01:26:36.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 -- start start 2022-01-10T01:26:36.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f486c0b1db0 0x7f486c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:36.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f486c1483a0 0x7f486c0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:36.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486c0b0350 con 0x7f486c0a70c0 2022-01-10T01:26:36.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486c0a90c0 con 0x7f486c1483a0 2022-01-10T01:26:36.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486c0b05f0 con 0x7f486c0b1db0 2022-01-10T01:26:36.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f486affd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f486c1483a0 0x7f486c0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:36.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f486affd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f486c1483a0 0x7f486c0b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35942/0 (socket says 172.21.15.36:35942) 2022-01-10T01:26:36.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f486affd700 1 -- 172.21.15.36:0/795978892 learned_addr learned my addr 172.21.15.36:0/795978892 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:36.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f486b7fe700 1 --2- 172.21.15.36:0/795978892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f486c0b1db0 0x7f486c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:36.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f486affd700 1 -- 172.21.15.36:0/795978892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f486c0b1db0 msgr2=0x7f486c0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:36.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f486affd700 1 --2- 172.21.15.36:0/795978892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f486c0b1db0 0x7f486c0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:36.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f486affd700 1 -- 172.21.15.36:0/795978892 >> v1:172.21.15.59:6789/0 conn(0x7f486c0a70c0 legacy=0x7f486c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:36.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f486affd700 1 -- 172.21.15.36:0/795978892 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c0b0890 con 0x7f486c1483a0 2022-01-10T01:26:36.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f486affd700 1 --2- 172.21.15.36:0/795978892 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f486c1483a0 0x7f486c0b2190 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f485c002f70 tx=0x7f485c006eb0).ready entity=mon.0 client_cookie=4118465d3d073740 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:36.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f486a7fc700 1 -- 172.21.15.36:0/795978892 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f485c00d570 con 0x7f486c1483a0 2022-01-10T01:26:36.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f486a7fc700 1 -- 172.21.15.36:0/795978892 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c000e90 con 0x7f486c1483a0 2022-01-10T01:26:36.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f486a7fc700 1 -- 172.21.15.36:0/795978892 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f485c00d900 con 0x7f486c1483a0 2022-01-10T01:26:36.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 -- 172.21.15.36:0/795978892 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f486c1483a0 msgr2=0x7f486c0b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:36.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 --2- 172.21.15.36:0/795978892 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f486c1483a0 0x7f486c0b2190 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f485c002f70 tx=0x7f485c006eb0).stop 2022-01-10T01:26:36.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 -- 172.21.15.36:0/795978892 shutdown_connections 2022-01-10T01:26:36.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 --2- 172.21.15.36:0/795978892 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f486c1483a0 0x7f486c0b2190 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:36.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 --2- 172.21.15.36:0/795978892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f486c0b1db0 0x7f486c0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:36.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 -- 172.21.15.36:0/795978892 >> 172.21.15.36:0/795978892 conn(0x7f486c05f6b0 msgr2=0x7f486c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:36.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 -- 172.21.15.36:0/795978892 shutdown_connections 2022-01-10T01:26:36.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.565+0000 7f4871f8f700 1 -- 172.21.15.36:0/795978892 wait complete. 2022-01-10T01:26:36.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f4871f8f700 1 Processor -- start 2022-01-10T01:26:36.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f4871f8f700 1 -- start start 2022-01-10T01:26:36.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f4871f8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f486c0a70c0 0x7f486c14b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:36.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f4871f8f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f486c0b1db0 0x7f486c149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:36.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f4871f8f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f486c1483a0 0x7f486c0ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:36.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f4871f8f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c156c90 con 0x7f486c0b1db0 2022-01-10T01:26:36.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f4871f8f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486c14b0c0 con 0x7f486c1483a0 2022-01-10T01:26:36.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f4871f8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486c14a1f0 con 0x7f486c0a70c0 2022-01-10T01:26:36.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f486affd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f486c0b1db0 0x7f486c149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:36.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f486affd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f486c0b1db0 0x7f486c149d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35950/0 (socket says 172.21.15.36:35950) 2022-01-10T01:26:36.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f486affd700 1 -- 172.21.15.36:0/4016864041 learned_addr learned my addr 172.21.15.36:0/4016864041 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:36.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f486b7fe700 1 --2- 172.21.15.36:0/4016864041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f486c0a70c0 0x7f486c14b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:36.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f486bfff700 1 --2- 172.21.15.36:0/4016864041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f486c1483a0 0x7f486c0ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:36.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f486affd700 1 -- 172.21.15.36:0/4016864041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f486c0a70c0 msgr2=0x7f486c14b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:36.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f486affd700 1 --2- 172.21.15.36:0/4016864041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f486c0a70c0 0x7f486c14b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:36.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f486affd700 1 -- 172.21.15.36:0/4016864041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f486c1483a0 msgr2=0x7f486c0ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:36.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f486affd700 1 --2- 172.21.15.36:0/4016864041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f486c1483a0 0x7f486c0ab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:36.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f486affd700 1 -- 172.21.15.36:0/4016864041 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c00b1e0 con 0x7f486c0b1db0 2022-01-10T01:26:36.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f486affd700 1 --2- 172.21.15.36:0/4016864041 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f486c0b1db0 0x7f486c149d00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f485c002f70 tx=0x7f485c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:36.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f4868ff9700 1 -- 172.21.15.36:0/4016864041 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f485c011690 con 0x7f486c0b1db0 2022-01-10T01:26:36.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f4868ff9700 1 -- 172.21.15.36:0/4016864041 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485c0117f0 con 0x7f486c0b1db0 2022-01-10T01:26:36.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f4868ff9700 1 -- 172.21.15.36:0/4016864041 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f485c011b50 con 0x7f486c0b1db0 2022-01-10T01:26:36.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f4871f8f700 1 -- 172.21.15.36:0/4016864041 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486c0a9550 con 0x7f486c0b1db0 2022-01-10T01:26:36.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.569+0000 7f4871f8f700 1 -- 172.21.15.36:0/4016864041 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f486c0a9a90 con 0x7f486c0b1db0 2022-01-10T01:26:36.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.573+0000 7f4871f8f700 1 -- 172.21.15.36:0/4016864041 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486c14ae80 con 0x7f486c0b1db0 2022-01-10T01:26:36.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.573+0000 7f4868ff9700 1 -- 172.21.15.36:0/4016864041 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f485c025030 con 0x7f486c0b1db0 2022-01-10T01:26:36.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.573+0000 7f4868ff9700 1 --2- 172.21.15.36:0/4016864041 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4850053680 0x7f4850055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:36.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.573+0000 7f4868ff9700 1 -- 172.21.15.36:0/4016864041 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f485c06cb00 con 0x7f486c0b1db0 2022-01-10T01:26:36.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.573+0000 7f486b7fe700 1 --2- 172.21.15.36:0/4016864041 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4850053680 0x7f4850055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:36.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.573+0000 7f486b7fe700 1 --2- 172.21.15.36:0/4016864041 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4850053680 0x7f4850055b40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f485400b000 tx=0x7f4854006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:36.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.581+0000 7f4868ff9700 1 -- 172.21.15.36:0/4016864041 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f486c14ae80 con 0x7f486c0b1db0 2022-01-10T01:26:36.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.741+0000 7f4871f8f700 1 -- 172.21.15.36:0/4016864041 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f486c14ae80 con 0x7f486c0b1db0 2022-01-10T01:26:36.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.745+0000 7f4868ff9700 1 -- 172.21.15.36:0/4016864041 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f486c14ae80 con 0x7f486c0b1db0 2022-01-10T01:26:36.748 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:36.748 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/986398854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":986398854},{"type":"v1","addr":"172.21.15.36:6835","nonce":986398854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/781575126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":781575126},{"type":"v1","addr":"172.21.15.36:6837","nonce":781575126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:26:18.598647+0000","modified":"2022-01-10T01:26:19.737578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3873482962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3873482962},{"type":"v1","addr":"172.21.15.59:6833","nonce":3873482962}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2022-01-10T01:26:36.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.745+0000 7f4871f8f700 1 -- 172.21.15.36:0/4016864041 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4850053680 msgr2=0x7f4850055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:36.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.745+0000 7f4871f8f700 1 --2- 172.21.15.36:0/4016864041 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4850053680 0x7f4850055b40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f485400b000 tx=0x7f4854006df0).stop 2022-01-10T01:26:36.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.745+0000 7f4871f8f700 1 -- 172.21.15.36:0/4016864041 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f486c0b1db0 msgr2=0x7f486c149d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:36.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.745+0000 7f4871f8f700 1 --2- 172.21.15.36:0/4016864041 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f486c0b1db0 0x7f486c149d00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f485c002f70 tx=0x7f485c015000).stop 2022-01-10T01:26:36.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.745+0000 7f4871f8f700 1 -- 172.21.15.36:0/4016864041 shutdown_connections 2022-01-10T01:26:36.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.745+0000 7f4871f8f700 1 --2- 172.21.15.36:0/4016864041 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4850053680 0x7f4850055b40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:36.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.745+0000 7f4871f8f700 1 --2- 172.21.15.36:0/4016864041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f486c1483a0 0x7f486c0ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:36.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.745+0000 7f4871f8f700 1 --2- 172.21.15.36:0/4016864041 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f486c0b1db0 0x7f486c149d00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:36.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.745+0000 7f4871f8f700 1 --2- 172.21.15.36:0/4016864041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f486c0a70c0 0x7f486c14b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:36.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.745+0000 7f4871f8f700 1 -- 172.21.15.36:0/4016864041 >> 172.21.15.36:0/4016864041 conn(0x7f486c05f6b0 msgr2=0x7f486c0b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:36.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.745+0000 7f4871f8f700 1 -- 172.21.15.36:0/4016864041 shutdown_connections 2022-01-10T01:26:36.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.745+0000 7f4871f8f700 1 -- 172.21.15.36:0/4016864041 wait complete. 2022-01-10T01:26:36.753 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 18 2022-01-10T01:26:36.760 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_recall_max_caps 20 2022-01-10T01:26:36.872 INFO:teuthology.orchestra.run.smithi059.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2022-01-10T01:26:36.872 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2022-01-10T01:26:36.873 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:26:36.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.981+0000 7f271759e700 1 Processor -- start 2022-01-10T01:26:36.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.981+0000 7f271759e700 1 -- start start 2022-01-10T01:26:36.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.981+0000 7f271759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27180b2580 0x7f271814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:36.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.981+0000 7f271759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f27180a8ac0 0x7f271814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:36.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.981+0000 7f271759e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27180a70c0 con 0x7f27180b0010 2022-01-10T01:26:36.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.981+0000 7f271759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180a72f0 con 0x7f27180a8ac0 2022-01-10T01:26:36.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.981+0000 7f271759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27180a7590 con 0x7f27180b2580 2022-01-10T01:26:36.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.981+0000 7f271659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27180b2580 0x7f271814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:36.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f2715d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f27180b0010 0x7f27180a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:51426/0 (socket says 172.21.15.36:51426) 2022-01-10T01:26:36.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f2715d9b700 1 -- 172.21.15.36:0/3143215660 learned_addr learned my addr 172.21.15.36:0/3143215660 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:36.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f2716d9d700 1 --2- 172.21.15.36:0/3143215660 >> v2:172.21.15.59:3300/0 conn(0x7f27180a8ac0 0x7f271814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:36.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271559a700 1 -- 172.21.15.36:0/3143215660 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676342664 0 0) 0x7f27180a70c0 con 0x7f27180b0010 2022-01-10T01:26:36.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271559a700 1 -- 172.21.15.36:0/3143215660 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26fc003260 con 0x7f27180b0010 2022-01-10T01:26:36.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271659c700 1 -- 172.21.15.36:0/3143215660 >> v2:172.21.15.59:3300/0 conn(0x7f27180a8ac0 msgr2=0x7f271814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:36.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271659c700 1 --2- 172.21.15.36:0/3143215660 >> v2:172.21.15.59:3300/0 conn(0x7f27180a8ac0 0x7f271814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:36.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271659c700 1 -- 172.21.15.36:0/3143215660 >> v1:172.21.15.59:6789/0 conn(0x7f27180b0010 legacy=0x7f27180a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:36.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271659c700 1 -- 172.21.15.36:0/3143215660 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27180a7830 con 0x7f27180b2580 2022-01-10T01:26:36.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271659c700 1 --2- 172.21.15.36:0/3143215660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27180b2580 0x7f271814ae40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f270c002f70 tx=0x7f270c006df0).ready entity=mon.2 client_cookie=8fdbead51ebf3fad server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:36.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271559a700 1 -- 172.21.15.36:0/3143215660 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f270c00d4a0 con 0x7f27180b2580 2022-01-10T01:26:36.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271559a700 1 -- 172.21.15.36:0/3143215660 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c000e90 con 0x7f27180b2580 2022-01-10T01:26:36.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271559a700 1 -- 172.21.15.36:0/3143215660 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f270c00d7f0 con 0x7f27180b2580 2022-01-10T01:26:36.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271759e700 1 -- 172.21.15.36:0/3143215660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27180b2580 msgr2=0x7f271814ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:36.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271759e700 1 --2- 172.21.15.36:0/3143215660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27180b2580 0x7f271814ae40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f270c002f70 tx=0x7f270c006df0).stop 2022-01-10T01:26:36.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271759e700 1 -- 172.21.15.36:0/3143215660 shutdown_connections 2022-01-10T01:26:36.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271759e700 1 --2- 172.21.15.36:0/3143215660 >> v2:172.21.15.59:3300/0 conn(0x7f27180a8ac0 0x7f271814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:36.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271759e700 1 --2- 172.21.15.36:0/3143215660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27180b2580 0x7f271814ae40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:36.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271759e700 1 -- 172.21.15.36:0/3143215660 >> 172.21.15.36:0/3143215660 conn(0x7f2718060180 msgr2=0x7f27180b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:36.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271759e700 1 -- 172.21.15.36:0/3143215660 shutdown_connections 2022-01-10T01:26:36.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271759e700 1 -- 172.21.15.36:0/3143215660 wait complete. 2022-01-10T01:26:36.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.985+0000 7f271759e700 1 Processor -- start 2022-01-10T01:26:36.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f271759e700 1 -- start start 2022-01-10T01:26:36.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f271759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27180a8ac0 0x7f27180b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:36.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f271759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27180b0010 0x7f27180aa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:36.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f271759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f27180b2580 0x7f2718141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:36.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f271759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180b33d0 con 0x7f27180b2580 2022-01-10T01:26:37.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f271759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180b3600 con 0x7f27180a8ac0 2022-01-10T01:26:37.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f271759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27180b5550 con 0x7f27180b0010 2022-01-10T01:26:37.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f271659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27180a8ac0 0x7f27180b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f2716d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f27180b2580 0x7f2718141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f2715d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27180b0010 0x7f27180aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f271659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27180a8ac0 0x7f27180b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:60828/0 (socket says 172.21.15.36:60828) 2022-01-10T01:26:37.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f271659c700 1 -- 172.21.15.36:0/2557901000 learned_addr learned my addr 172.21.15.36:0/2557901000 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:37.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f2715d9b700 1 -- 172.21.15.36:0/2557901000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27180a8ac0 msgr2=0x7f27180b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f2715d9b700 1 --2- 172.21.15.36:0/2557901000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27180a8ac0 0x7f27180b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f2715d9b700 1 -- 172.21.15.36:0/2557901000 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f27180b2580 msgr2=0x7f2718141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f2715d9b700 1 --2- 172.21.15.36:0/2557901000 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f27180b2580 0x7f2718141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f2715d9b700 1 -- 172.21.15.36:0/2557901000 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c00b180 con 0x7f27180b0010 2022-01-10T01:26:37.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f2715d9b700 1 --2- 172.21.15.36:0/2557901000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27180b0010 0x7f27180aa090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f27180a9480 tx=0x7f27080079e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:37.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f27077fe700 1 -- 172.21.15.36:0/2557901000 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f270800cda0 con 0x7f27180b0010 2022-01-10T01:26:37.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f271759e700 1 -- 172.21.15.36:0/2557901000 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27180b48e0 con 0x7f27180b0010 2022-01-10T01:26:37.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f27077fe700 1 -- 172.21.15.36:0/2557901000 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27080070d0 con 0x7f27180b0010 2022-01-10T01:26:37.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f271759e700 1 -- 172.21.15.36:0/2557901000 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271814d000 con 0x7f27180b0010 2022-01-10T01:26:37.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f27077fe700 1 -- 172.21.15.36:0/2557901000 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2708007280 con 0x7f27180b0010 2022-01-10T01:26:37.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.989+0000 7f271759e700 1 -- 172.21.15.36:0/2557901000 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2718057350 con 0x7f27180b0010 2022-01-10T01:26:37.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.993+0000 7f27077fe700 1 -- 172.21.15.36:0/2557901000 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2708010070 con 0x7f27180b0010 2022-01-10T01:26:37.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.993+0000 7f27077fe700 1 --2- 172.21.15.36:0/2557901000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f26f4053560 0x7f26f4055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.993+0000 7f27077fe700 1 -- 172.21.15.36:0/2557901000 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f270806ae20 con 0x7f27180b0010 2022-01-10T01:26:37.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.993+0000 7f271659c700 1 --2- 172.21.15.36:0/2557901000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f26f4053560 0x7f26f4055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:36.993+0000 7f271659c700 1 --2- 172.21.15.36:0/2557901000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f26f4053560 0x7f26f4055a20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f270c01a000 tx=0x7f270c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:37.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.001+0000 7f27077fe700 1 -- 172.21.15.36:0/2557901000 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2708041ca0 con 0x7f27180b0010 2022-01-10T01:26:37.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.165+0000 7f271759e700 1 -- 172.21.15.36:0/2557901000 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f271806a450 con 0x7f27180b0010 2022-01-10T01:26:37.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.169+0000 7f27077fe700 1 -- 172.21.15.36:0/2557901000 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f2708018030 con 0x7f27180b0010 2022-01-10T01:26:37.172 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:37.172 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/986398854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":986398854},{"type":"v1","addr":"172.21.15.36:6835","nonce":986398854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/781575126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":781575126},{"type":"v1","addr":"172.21.15.36:6837","nonce":781575126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:26:18.598647+0000","modified":"2022-01-10T01:26:19.737578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3873482962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3873482962},{"type":"v1","addr":"172.21.15.59:6833","nonce":3873482962}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2022-01-10T01:26:37.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.169+0000 7f271759e700 1 -- 172.21.15.36:0/2557901000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f26f4053560 msgr2=0x7f26f4055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.169+0000 7f271759e700 1 --2- 172.21.15.36:0/2557901000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f26f4053560 0x7f26f4055a20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f270c01a000 tx=0x7f270c014000).stop 2022-01-10T01:26:37.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.169+0000 7f271759e700 1 -- 172.21.15.36:0/2557901000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27180b0010 msgr2=0x7f27180aa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.169+0000 7f271759e700 1 --2- 172.21.15.36:0/2557901000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27180b0010 0x7f27180aa090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f27180a9480 tx=0x7f27080079e0).stop 2022-01-10T01:26:37.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.169+0000 7f271759e700 1 -- 172.21.15.36:0/2557901000 shutdown_connections 2022-01-10T01:26:37.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.169+0000 7f271759e700 1 --2- 172.21.15.36:0/2557901000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f26f4053560 0x7f26f4055a20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.169+0000 7f271759e700 1 --2- 172.21.15.36:0/2557901000 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f27180b2580 0x7f2718141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.169+0000 7f271759e700 1 --2- 172.21.15.36:0/2557901000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27180b0010 0x7f27180aa090 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.169+0000 7f271759e700 1 --2- 172.21.15.36:0/2557901000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27180a8ac0 0x7f27180b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.169+0000 7f271759e700 1 -- 172.21.15.36:0/2557901000 >> 172.21.15.36:0/2557901000 conn(0x7f2718060180 msgr2=0x7f27181449a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:37.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.169+0000 7f271759e700 1 -- 172.21.15.36:0/2557901000 shutdown_connections 2022-01-10T01:26:37.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.169+0000 7f271759e700 1 -- 172.21.15.36:0/2557901000 wait complete. 2022-01-10T01:26:37.177 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 18 2022-01-10T01:26:37.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_recall_max_decay_threshold 400 2022-01-10T01:26:37.301 INFO:teuthology.orchestra.run.smithi059.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2022-01-10T01:26:37.301 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2022-01-10T01:26:37.302 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:26:37.319 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:26:37.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.425+0000 7fcbe3185700 1 Processor -- start 2022-01-10T01:26:37.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.425+0000 7fcbe3185700 1 -- start start 2022-01-10T01:26:37.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe3185700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcbdc0b3040 0x7fcbdc065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe3185700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbdc0a9c10 0x7fcbdc0607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe3185700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbdc066ea0 con 0x7fcbdc143320 2022-01-10T01:26:37.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe3185700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbdc0648e0 con 0x7fcbdc0b3040 2022-01-10T01:26:37.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe3185700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc061dd0 con 0x7fcbdc0a9c10 2022-01-10T01:26:37.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe1982700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbdc0a9c10 0x7fcbdc0607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe2183700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcbdc0b3040 0x7fcbdc065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe2984700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcbdc143320 0x7fcbdc1437b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:51444/0 (socket says 172.21.15.36:51444) 2022-01-10T01:26:37.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe2984700 1 -- 172.21.15.36:0/1639404 learned_addr learned my addr 172.21.15.36:0/1639404 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:37.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe1982700 1 -- 172.21.15.36:0/1639404 >> v2:172.21.15.59:3300/0 conn(0x7fcbdc0b3040 msgr2=0x7fcbdc065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:37.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe1982700 1 --2- 172.21.15.36:0/1639404 >> v2:172.21.15.59:3300/0 conn(0x7fcbdc0b3040 0x7fcbdc065e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe1982700 1 -- 172.21.15.36:0/1639404 >> v1:172.21.15.59:6789/0 conn(0x7fcbdc143320 legacy=0x7fcbdc1437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe1982700 1 -- 172.21.15.36:0/1639404 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc0b3420 con 0x7fcbdc0a9c10 2022-01-10T01:26:37.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe1982700 1 --2- 172.21.15.36:0/1639404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbdc0a9c10 0x7fcbdc0607c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fcbd80032f0 tx=0x7fcbd80091d0).ready entity=mon.2 client_cookie=da734ad824a524f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:37.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe1181700 1 -- 172.21.15.36:0/1639404 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbd800b680 con 0x7fcbdc0a9c10 2022-01-10T01:26:37.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe1181700 1 -- 172.21.15.36:0/1639404 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd800b7e0 con 0x7fcbdc0a9c10 2022-01-10T01:26:37.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe1181700 1 -- 172.21.15.36:0/1639404 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbd800b990 con 0x7fcbdc0a9c10 2022-01-10T01:26:37.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe3185700 1 -- 172.21.15.36:0/1639404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbdc0a9c10 msgr2=0x7fcbdc0607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe3185700 1 --2- 172.21.15.36:0/1639404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbdc0a9c10 0x7fcbdc0607c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fcbd80032f0 tx=0x7fcbd80091d0).stop 2022-01-10T01:26:37.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe3185700 1 -- 172.21.15.36:0/1639404 shutdown_connections 2022-01-10T01:26:37.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe3185700 1 --2- 172.21.15.36:0/1639404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbdc0a9c10 0x7fcbdc0607c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe3185700 1 --2- 172.21.15.36:0/1639404 >> v2:172.21.15.59:3300/0 conn(0x7fcbdc0b3040 0x7fcbdc065e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe3185700 1 -- 172.21.15.36:0/1639404 >> 172.21.15.36:0/1639404 conn(0x7fcbdc0636e0 msgr2=0x7fcbdc063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:37.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe3185700 1 -- 172.21.15.36:0/1639404 shutdown_connections 2022-01-10T01:26:37.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.429+0000 7fcbe3185700 1 -- 172.21.15.36:0/1639404 wait complete. 2022-01-10T01:26:37.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe3185700 1 Processor -- start 2022-01-10T01:26:37.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe3185700 1 -- start start 2022-01-10T01:26:37.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe3185700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbdc0a9c10 0x7fcbdc13dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe3185700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbdc0b3040 0x7fcbdc155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe3185700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcbdc143320 0x7fcbdc156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe3185700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc13d240 con 0x7fcbdc143320 2022-01-10T01:26:37.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe3185700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc13d4e0 con 0x7fcbdc0a9c10 2022-01-10T01:26:37.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe3185700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc13d780 con 0x7fcbdc0b3040 2022-01-10T01:26:37.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe2183700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbdc0a9c10 0x7fcbdc13dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe1982700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbdc0b3040 0x7fcbdc155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe2183700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbdc0a9c10 0x7fcbdc13dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:60842/0 (socket says 172.21.15.36:60842) 2022-01-10T01:26:37.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe2183700 1 -- 172.21.15.36:0/1212809940 learned_addr learned my addr 172.21.15.36:0/1212809940 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:37.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe2984700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcbdc143320 0x7fcbdc156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe1982700 1 -- 172.21.15.36:0/1212809940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbdc0a9c10 msgr2=0x7fcbdc13dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe1982700 1 --2- 172.21.15.36:0/1212809940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbdc0a9c10 0x7fcbdc13dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe1982700 1 -- 172.21.15.36:0/1212809940 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcbdc143320 msgr2=0x7fcbdc156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe1982700 1 --2- 172.21.15.36:0/1212809940 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcbdc143320 0x7fcbdc156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe1982700 1 -- 172.21.15.36:0/1212809940 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd8009470 con 0x7fcbdc0b3040 2022-01-10T01:26:37.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe2183700 1 --2- 172.21.15.36:0/1212809940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbdc0a9c10 0x7fcbdc13dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:26:37.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe1982700 1 --2- 172.21.15.36:0/1212809940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbdc0b3040 0x7fcbdc155c30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fcbd80032f0 tx=0x7fcbd8016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:37.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbcb7fe700 1 -- 172.21.15.36:0/1212809940 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbd8011d70 con 0x7fcbdc0b3040 2022-01-10T01:26:37.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbcb7fe700 1 -- 172.21.15.36:0/1212809940 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd8021440 con 0x7fcbdc0b3040 2022-01-10T01:26:37.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe3185700 1 -- 172.21.15.36:0/1212809940 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbdc1558b0 con 0x7fcbdc0b3040 2022-01-10T01:26:37.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbcb7fe700 1 -- 172.21.15.36:0/1212809940 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcbd80217a0 con 0x7fcbdc0b3040 2022-01-10T01:26:37.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.433+0000 7fcbe3185700 1 -- 172.21.15.36:0/1212809940 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc13cd30 con 0x7fcbdc0b3040 2022-01-10T01:26:37.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.437+0000 7fcbe3185700 1 -- 172.21.15.36:0/1212809940 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbdc13d940 con 0x7fcbdc0b3040 2022-01-10T01:26:37.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.437+0000 7fcbcb7fe700 1 -- 172.21.15.36:0/1212809940 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fcbd8027020 con 0x7fcbdc0b3040 2022-01-10T01:26:37.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.437+0000 7fcbcb7fe700 1 --2- 172.21.15.36:0/1212809940 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcbbc0536b0 0x7fcbbc055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.437+0000 7fcbcb7fe700 1 -- 172.21.15.36:0/1212809940 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcbd806ceb0 con 0x7fcbdc0b3040 2022-01-10T01:26:37.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.437+0000 7fcbe2183700 1 --2- 172.21.15.36:0/1212809940 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcbbc0536b0 0x7fcbbc055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.437+0000 7fcbe2183700 1 --2- 172.21.15.36:0/1212809940 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcbbc0536b0 0x7fcbbc055b70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fcbcc00b000 tx=0x7fcbcc006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:37.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.445+0000 7fcbcb7fe700 1 -- 172.21.15.36:0/1212809940 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcbd8043df0 con 0x7fcbdc0b3040 2022-01-10T01:26:37.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.613+0000 7fcbe3185700 1 -- 172.21.15.36:0/1212809940 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbdc057350 con 0x7fcbdc0b3040 2022-01-10T01:26:37.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.613+0000 7fcbcb7fe700 1 -- 172.21.15.36:0/1212809940 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7fcbd8015090 con 0x7fcbdc0b3040 2022-01-10T01:26:37.618 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:37.619 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/986398854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":986398854},{"type":"v1","addr":"172.21.15.36:6835","nonce":986398854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/781575126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":781575126},{"type":"v1","addr":"172.21.15.36:6837","nonce":781575126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:26:18.598647+0000","modified":"2022-01-10T01:26:19.737578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3873482962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3873482962},{"type":"v1","addr":"172.21.15.59:6833","nonce":3873482962}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2022-01-10T01:26:37.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.617+0000 7fcbe3185700 1 -- 172.21.15.36:0/1212809940 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcbbc0536b0 msgr2=0x7fcbbc055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.617+0000 7fcbe3185700 1 --2- 172.21.15.36:0/1212809940 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcbbc0536b0 0x7fcbbc055b70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fcbcc00b000 tx=0x7fcbcc006df0).stop 2022-01-10T01:26:37.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.617+0000 7fcbe3185700 1 -- 172.21.15.36:0/1212809940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbdc0b3040 msgr2=0x7fcbdc155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.617+0000 7fcbe3185700 1 --2- 172.21.15.36:0/1212809940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbdc0b3040 0x7fcbdc155c30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fcbd80032f0 tx=0x7fcbd8016000).stop 2022-01-10T01:26:37.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.617+0000 7fcbe3185700 1 -- 172.21.15.36:0/1212809940 shutdown_connections 2022-01-10T01:26:37.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.617+0000 7fcbe3185700 1 --2- 172.21.15.36:0/1212809940 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcbbc0536b0 0x7fcbbc055b70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.617+0000 7fcbe3185700 1 --2- 172.21.15.36:0/1212809940 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcbdc143320 0x7fcbdc156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.617+0000 7fcbe3185700 1 --2- 172.21.15.36:0/1212809940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbdc0b3040 0x7fcbdc155c30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.617+0000 7fcbe3185700 1 --2- 172.21.15.36:0/1212809940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbdc0a9c10 0x7fcbdc13dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.617+0000 7fcbe3185700 1 -- 172.21.15.36:0/1212809940 >> 172.21.15.36:0/1212809940 conn(0x7fcbdc0636e0 msgr2=0x7fcbdc1429f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:37.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.617+0000 7fcbe3185700 1 -- 172.21.15.36:0/1212809940 shutdown_connections 2022-01-10T01:26:37.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.617+0000 7fcbe3185700 1 -- 172.21.15.36:0/1212809940 wait complete. 2022-01-10T01:26:37.623 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 18 2022-01-10T01:26:37.632 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b cache drop 2022-01-10T01:26:37.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f5975688700 1 Processor -- start 2022-01-10T01:26:37.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f5975688700 1 -- start start 2022-01-10T01:26:37.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f5975688700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59700b2580 0x7f5970140050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f5975688700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59700b00e0 0x7f5970140540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f5975688700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5970067880 con 0x7f59700ac6f0 2022-01-10T01:26:37.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f5975688700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59700ad5b0 con 0x7f59700b00e0 2022-01-10T01:26:37.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f5975688700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5970067b20 con 0x7f59700b2580 2022-01-10T01:26:37.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f596ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59700b2580 0x7f5970140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f596f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59700b00e0 0x7f5970140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f596ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59700b2580 0x7f5970140050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:42268/0 (socket says 172.21.15.36:42268) 2022-01-10T01:26:37.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f596f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59700b00e0 0x7f5970140540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:60850/0 (socket says 172.21.15.36:60850) 2022-01-10T01:26:37.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f596f7fe700 1 -- 172.21.15.36:0/2586198734 learned_addr learned my addr 172.21.15.36:0/2586198734 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:37.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f596f7fe700 1 -- 172.21.15.36:0/2586198734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59700b2580 msgr2=0x7f5970140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:37.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f596f7fe700 1 --2- 172.21.15.36:0/2586198734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59700b2580 0x7f5970140050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f596f7fe700 1 -- 172.21.15.36:0/2586198734 >> v1:172.21.15.59:6789/0 conn(0x7f59700ac6f0 legacy=0x7f5970142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f596f7fe700 1 -- 172.21.15.36:0/2586198734 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5970146fd0 con 0x7f59700b00e0 2022-01-10T01:26:37.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.733+0000 7f596f7fe700 1 --2- 172.21.15.36:0/2586198734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59700b00e0 0x7f5970140540 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f59680032f0 tx=0x7f5968009290).ready entity=mon.1 client_cookie=51f9e80b93fc5082 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:37.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f596effd700 1 -- 172.21.15.36:0/2586198734 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596800b8a0 con 0x7f59700b00e0 2022-01-10T01:26:37.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f596effd700 1 -- 172.21.15.36:0/2586198734 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596800ba00 con 0x7f59700b00e0 2022-01-10T01:26:37.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f596effd700 1 -- 172.21.15.36:0/2586198734 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596800bb70 con 0x7f59700b00e0 2022-01-10T01:26:37.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 -- 172.21.15.36:0/2586198734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59700b00e0 msgr2=0x7f5970140540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 --2- 172.21.15.36:0/2586198734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59700b00e0 0x7f5970140540 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f59680032f0 tx=0x7f5968009290).stop 2022-01-10T01:26:37.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 -- 172.21.15.36:0/2586198734 shutdown_connections 2022-01-10T01:26:37.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 --2- 172.21.15.36:0/2586198734 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59700b00e0 0x7f5970140540 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 --2- 172.21.15.36:0/2586198734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59700b2580 0x7f5970140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 -- 172.21.15.36:0/2586198734 >> 172.21.15.36:0/2586198734 conn(0x7f5970060180 msgr2=0x7f59700b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:37.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 -- 172.21.15.36:0/2586198734 shutdown_connections 2022-01-10T01:26:37.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 -- 172.21.15.36:0/2586198734 wait complete. 2022-01-10T01:26:37.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 Processor -- start 2022-01-10T01:26:37.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 -- start start 2022-01-10T01:26:37.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59700ac6f0 0x7f59700ab590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59700b00e0 0x7f597013e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59700b2580 0x7f597013eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59700a0290 con 0x7f59700b00e0 2022-01-10T01:26:37.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59701501f0 con 0x7f59700b2580 2022-01-10T01:26:37.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5975688700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5970142ee0 con 0x7f59700ac6f0 2022-01-10T01:26:37.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f596f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59700b00e0 0x7f597013e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f596f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59700b00e0 0x7f597013e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35990/0 (socket says 172.21.15.36:35990) 2022-01-10T01:26:37.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f596f7fe700 1 -- 172.21.15.36:0/853927694 learned_addr learned my addr 172.21.15.36:0/853927694 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:37.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f596ffff700 1 --2- 172.21.15.36:0/853927694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59700ac6f0 0x7f59700ab590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.737+0000 7f5974e87700 1 --2- 172.21.15.36:0/853927694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59700b2580 0x7f597013eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f596f7fe700 1 -- 172.21.15.36:0/853927694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59700ac6f0 msgr2=0x7f59700ab590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f596f7fe700 1 --2- 172.21.15.36:0/853927694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59700ac6f0 0x7f59700ab590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f596f7fe700 1 -- 172.21.15.36:0/853927694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59700b2580 msgr2=0x7f597013eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f596f7fe700 1 --2- 172.21.15.36:0/853927694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59700b2580 0x7f597013eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f596f7fe700 1 -- 172.21.15.36:0/853927694 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5968009530 con 0x7f59700b00e0 2022-01-10T01:26:37.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f596f7fe700 1 --2- 172.21.15.36:0/853927694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59700b00e0 0x7f597013e6a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f59680032f0 tx=0x7f5968016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:37.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f596d7fa700 1 -- 172.21.15.36:0/853927694 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596800b8a0 con 0x7f59700b00e0 2022-01-10T01:26:37.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f596d7fa700 1 -- 172.21.15.36:0/853927694 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968021440 con 0x7f59700b00e0 2022-01-10T01:26:37.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f5975688700 1 -- 172.21.15.36:0/853927694 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59701423c0 con 0x7f59700b00e0 2022-01-10T01:26:37.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f596d7fa700 1 -- 172.21.15.36:0/853927694 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59680217a0 con 0x7f59700b00e0 2022-01-10T01:26:37.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f5975688700 1 -- 172.21.15.36:0/853927694 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59700a14b0 con 0x7f59700b00e0 2022-01-10T01:26:37.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f596d7fa700 1 -- 172.21.15.36:0/853927694 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5968027020 con 0x7f59700b00e0 2022-01-10T01:26:37.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f596d7fa700 1 --2- 172.21.15.36:0/853927694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5950053560 0x7f5950055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f596d7fa700 1 -- 172.21.15.36:0/853927694 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f596806d300 con 0x7f59700b00e0 2022-01-10T01:26:37.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.741+0000 7f596ffff700 1 --2- 172.21.15.36:0/853927694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5950053560 0x7f5950055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.745+0000 7f596ffff700 1 --2- 172.21.15.36:0/853927694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5950053560 0x7f5950055a20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f596400b000 tx=0x7f5964006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:37.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.745+0000 7f5980b2d740 1 Processor -- start 2022-01-10T01:26:37.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.745+0000 7f5980b2d740 1 -- start start 2022-01-10T01:26:37.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.745+0000 7f5980b2d740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x137dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.745+0000 7f5980b2d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x137c9e0 0x13b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.745+0000 7f5980b2d740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 0x13b2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.745+0000 7f5980b2d740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x12ecdb0 con 0x13b2410 2022-01-10T01:26:37.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.745+0000 7f5980b2d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x12ecef0 con 0x137c9e0 2022-01-10T01:26:37.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.745+0000 7f5980b2d740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x12ee410 con 0x13b2ac0 2022-01-10T01:26:37.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.745+0000 7f596ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x137dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.745+0000 7f596ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x137dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:35998/0 (socket says 172.21.15.36:35998) 2022-01-10T01:26:37.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.745+0000 7f596ffff700 1 -- 172.21.15.36:0/1645728143 learned_addr learned my addr 172.21.15.36:0/1645728143 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:37.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.745+0000 7f596f7fe700 1 --2- 172.21.15.36:0/1645728143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x137c9e0 0x13b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.745+0000 7f5974e87700 1 --2- 172.21.15.36:0/1645728143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 0x13b2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f596f7fe700 1 -- 172.21.15.36:0/1645728143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 msgr2=0x13b2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:37.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f596f7fe700 1 --2- 172.21.15.36:0/1645728143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 0x13b2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f596f7fe700 1 -- 172.21.15.36:0/1645728143 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 msgr2=0x137dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:37.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f596f7fe700 1 --2- 172.21.15.36:0/1645728143 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x137dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f596f7fe700 1 -- 172.21.15.36:0/1645728143 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1325fc0 con 0x137c9e0 2022-01-10T01:26:37.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f596ffff700 1 --2- 172.21.15.36:0/1645728143 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x137dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:26:37.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f596f7fe700 1 --2- 172.21.15.36:0/1645728143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x137c9e0 0x13b0550 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x13397e0 tx=0x7f5968012000).ready entity=mon.1 client_cookie=3442ef85dbeb87a4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:37.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f5975688700 1 -- 172.21.15.36:0/1645728143 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596802f070 con 0x137c9e0 2022-01-10T01:26:37.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f5975688700 1 -- 172.21.15.36:0/1645728143 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968047f70 con 0x137c9e0 2022-01-10T01:26:37.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f5975688700 1 -- 172.21.15.36:0/1645728143 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5968046370 con 0x137c9e0 2022-01-10T01:26:37.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f5980b2d740 1 -- 172.21.15.36:0/1645728143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x137c9e0 msgr2=0x13b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f5980b2d740 1 --2- 172.21.15.36:0/1645728143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x137c9e0 0x13b0550 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x13397e0 tx=0x7f5968012000).stop 2022-01-10T01:26:37.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f5980b2d740 1 -- 172.21.15.36:0/1645728143 shutdown_connections 2022-01-10T01:26:37.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f5980b2d740 1 --2- 172.21.15.36:0/1645728143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 0x13b2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f5980b2d740 1 --2- 172.21.15.36:0/1645728143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x137c9e0 0x13b0550 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f5980b2d740 1 --2- 172.21.15.36:0/1645728143 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x137dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f5980b2d740 1 -- 172.21.15.36:0/1645728143 >> 172.21.15.36:0/1645728143 conn(0x137adf0 msgr2=0x137ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:37.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f5980b2d740 1 -- 172.21.15.36:0/1645728143 shutdown_connections 2022-01-10T01:26:37.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f5980b2d740 1 -- 172.21.15.36:0/1645728143 wait complete. 2022-01-10T01:26:37.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f5980b2d740 1 -- start start 2022-01-10T01:26:37.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.749+0000 7f5980b2d740 1 Processor -- start 2022-01-10T01:26:37.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x13824d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 0x13b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13c5f50 0x13af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x1382d00 con 0x13b2410 2022-01-10T01:26:37.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x1382fa0 con 0x13c5f50 2022-01-10T01:26:37.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x13c6470 con 0x13b2ac0 2022-01-10T01:26:37.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 10 client.0 ll_register_callbacks cb 0x13355a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-01-10T01:26:37.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f596ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x13824d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f596ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x13824d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36004/0 (socket says 172.21.15.36:36004) 2022-01-10T01:26:37.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f596ffff700 1 -- 172.21.15.36:0/2011120205 learned_addr learned my addr 172.21.15.36:0/2011120205 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:37.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f596f7fe700 1 --2- 172.21.15.36:0/2011120205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 0x13b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5974e87700 1 --2- 172.21.15.36:0/2011120205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13c5f50 0x13af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f596ffff700 1 -- 172.21.15.36:0/2011120205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 msgr2=0x13b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:37.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f596ffff700 1 --2- 172.21.15.36:0/2011120205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 0x13b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f596ffff700 1 -- 172.21.15.36:0/2011120205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13c5f50 msgr2=0x13af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:37.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f596ffff700 1 --2- 172.21.15.36:0/2011120205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13c5f50 0x13af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f596ffff700 1 -- 172.21.15.36:0/2011120205 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5964011880 con 0x13b2410 2022-01-10T01:26:37.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f596ffff700 1 --2- 172.21.15.36:0/2011120205 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x13824d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f596401a000 tx=0x7f5964016000).ready entity=mon.0 client_cookie=aee77bf6035b77b5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:37.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f594effd700 10 client.0 ms_handle_connect on v2:172.21.15.36:3300/0 2022-01-10T01:26:37.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f594effd700 1 -- 172.21.15.36:0/2011120205 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5964013a40 con 0x13b2410 2022-01-10T01:26:37.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f594effd700 1 -- 172.21.15.36:0/2011120205 <== mon.0 v2:172.21.15.36:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5964013ba0 con 0x13b2410 2022-01-10T01:26:37.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 1 -- 172.21.15.36:0/2011120205 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x12e4030 con 0x13b2410 2022-01-10T01:26:37.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f594effd700 1 -- 172.21.15.36:0/2011120205 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5964013d60 con 0x13b2410 2022-01-10T01:26:37.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 10 client.5385 fetch_fsmap learned FSMap version 18 2022-01-10T01:26:37.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 1 -- 172.21.15.36:0/2011120205 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x7f59700a14b0 con 0x13b2410 2022-01-10T01:26:37.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f594effd700 1 -- 172.21.15.36:0/2011120205 <== mon.0 v2:172.21.15.36:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x12e4030 con 0x13b2410 2022-01-10T01:26:37.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f594effd700 1 -- 172.21.15.36:0/2011120205 <== mon.0 v2:172.21.15.36:3300/0 5 ==== fsmap(e 18) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f59640289b0 con 0x13b2410 2022-01-10T01:26:37.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 10 client.5385 fetch_fsmap finished waiting for FSMap version 18 2022-01-10T01:26:37.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 10 client.5385 resolve_mds: resolved ID 'b' to GID 5239 2022-01-10T01:26:37.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 20 client.5385 populate_metadata read hostname 'smithi036' 2022-01-10T01:26:37.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 1 --2- 172.21.15.36:0/2011120205 >> [v2:172.21.15.59:6832/3873482962,v1:172.21.15.59:6833/3873482962] conn(0x13af4f0 0x13c2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 4 client.5385 mds_command: new command op to 5239 tid=0[{"prefix": "get_command_descriptions"}] 2022-01-10T01:26:37.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f5980b2d740 1 -- 172.21.15.36:0/2011120205 --> [v2:172.21.15.59:6832/3873482962,v1:172.21.15.59:6833/3873482962] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x12dc3a0 con 0x13af4f0 2022-01-10T01:26:37.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f596f7fe700 1 --2- 172.21.15.36:0/2011120205 >> [v2:172.21.15.59:6832/3873482962,v1:172.21.15.59:6833/3873482962] conn(0x13af4f0 0x13c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f594effd700 10 client.5385 ms_handle_connect on v2:172.21.15.59:6832/3873482962 2022-01-10T01:26:37.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.753+0000 7f596f7fe700 1 --2- 172.21.15.36:0/2011120205 >> [v2:172.21.15.59:6832/3873482962,v1:172.21.15.59:6833/3873482962] conn(0x13af4f0 0x13c2390 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7612e3b24bfbea75 server_cookie=7d4f24bb38ae597b in_seq=0 out_seq=0 2022-01-10T01:26:37.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f594effd700 1 -- 172.21.15.36:0/2011120205 <== mds.0 v2:172.21.15.59:6832/3873482962 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x12dc3a0 con 0x13af4f0 2022-01-10T01:26:37.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f594effd700 10 client.5385 handle_command_reply: tid=0 2022-01-10T01:26:37.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f5980b2d740 1 client.5385 shutdown 2022-01-10T01:26:37.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f5980b2d740 1 -- 172.21.15.36:0/2011120205 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 msgr2=0x13824d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f5980b2d740 1 --2- 172.21.15.36:0/2011120205 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x13824d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f596401a000 tx=0x7f5964016000).stop 2022-01-10T01:26:37.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f5980b2d740 1 -- 172.21.15.36:0/2011120205 shutdown_connections 2022-01-10T01:26:37.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f5980b2d740 1 --2- 172.21.15.36:0/2011120205 >> [v2:172.21.15.59:6832/3873482962,v1:172.21.15.59:6833/3873482962] conn(0x13af4f0 0x13c2390 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f5980b2d740 1 --2- 172.21.15.36:0/2011120205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13c5f50 0x13af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f594effd700 0 client.5385 ms_handle_reset on v2:172.21.15.59:6832/3873482962 2022-01-10T01:26:37.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f5980b2d740 1 --2- 172.21.15.36:0/2011120205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 0x13b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f5980b2d740 1 --2- 172.21.15.36:0/2011120205 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x13824d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f5980b2d740 1 -- 172.21.15.36:0/2011120205 >> 172.21.15.36:0/2011120205 conn(0x137c9e0 msgr2=0x1380cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:37.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f5980b2d740 1 -- 172.21.15.36:0/2011120205 shutdown_connections 2022-01-10T01:26:37.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f5980b2d740 1 -- 172.21.15.36:0/2011120205 wait complete. 2022-01-10T01:26:37.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.757+0000 7f5980b2d740 20 client.5385 trim_cache size 0 max 16384 2022-01-10T01:26:37.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f5980b2d740 1 Processor -- start 2022-01-10T01:26:37.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f5980b2d740 1 -- start start 2022-01-10T01:26:37.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f5980b2d740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13af4f0 0x13818c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f5980b2d740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2410 0x13b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f5980b2d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13b2ac0 0x13b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f5980b2d740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x13831a0 con 0x13af4f0 2022-01-10T01:26:37.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f5980b2d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x12dc3a0 con 0x13b2ac0 2022-01-10T01:26:37.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f5980b2d740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x13af380 con 0x13b2410 2022-01-10T01:26:37.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f596ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13af4f0 0x13818c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f596ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13af4f0 0x13818c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36012/0 (socket says 172.21.15.36:36012) 2022-01-10T01:26:37.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f596ffff700 1 -- 172.21.15.36:0/2443592527 learned_addr learned my addr 172.21.15.36:0/2443592527 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:37.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f596f7fe700 1 --2- 172.21.15.36:0/2443592527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2410 0x13b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f5974e87700 1 --2- 172.21.15.36:0/2443592527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13b2ac0 0x13b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f596ffff700 1 -- 172.21.15.36:0/2443592527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2410 msgr2=0x13b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:37.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f596ffff700 1 --2- 172.21.15.36:0/2443592527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2410 0x13b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.769+0000 7f596ffff700 1 -- 172.21.15.36:0/2443592527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13b2ac0 msgr2=0x13b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:37.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f596ffff700 1 --2- 172.21.15.36:0/2443592527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13b2ac0 0x13b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f596ffff700 1 -- 172.21.15.36:0/2443592527 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x12dd910 con 0x13af4f0 2022-01-10T01:26:37.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f5974e87700 1 --2- 172.21.15.36:0/2443592527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13b2ac0 0x13b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:37.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f596ffff700 1 --2- 172.21.15.36:0/2443592527 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13af4f0 0x13818c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f596401a000 tx=0x7f5964025000).ready entity=mon.0 client_cookie=6674b23b54f2afb server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:37.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f59557fa700 1 -- 172.21.15.36:0/2443592527 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5964036070 con 0x13af4f0 2022-01-10T01:26:37.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f59557fa700 1 -- 172.21.15.36:0/2443592527 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5964000e90 con 0x13af4f0 2022-01-10T01:26:37.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f59557fa700 1 -- 172.21.15.36:0/2443592527 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5964013680 con 0x13af4f0 2022-01-10T01:26:37.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f5980b2d740 1 -- 172.21.15.36:0/2443592527 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13af4f0 msgr2=0x13818c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:37.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f5980b2d740 1 --2- 172.21.15.36:0/2443592527 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13af4f0 0x13818c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f596401a000 tx=0x7f5964025000).stop 2022-01-10T01:26:37.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f5980b2d740 1 -- 172.21.15.36:0/2443592527 shutdown_connections 2022-01-10T01:26:37.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f5980b2d740 1 --2- 172.21.15.36:0/2443592527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13b2ac0 0x13b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f5980b2d740 1 --2- 172.21.15.36:0/2443592527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2410 0x13b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f5980b2d740 1 --2- 172.21.15.36:0/2443592527 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13af4f0 0x13818c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f5980b2d740 1 -- 172.21.15.36:0/2443592527 >> 172.21.15.36:0/2443592527 conn(0x137c9e0 msgr2=0x137b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:37.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f5980b2d740 1 -- 172.21.15.36:0/2443592527 shutdown_connections 2022-01-10T01:26:37.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f5980b2d740 1 -- 172.21.15.36:0/2443592527 wait complete. 2022-01-10T01:26:37.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f5980b2d740 1 -- start start 2022-01-10T01:26:37.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.773+0000 7f5980b2d740 1 Processor -- start 2022-01-10T01:26:37.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13af4f0 0x13bc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x137faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 0x13b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x13808c0 con 0x13b2410 2022-01-10T01:26:37.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x13c59f0 con 0x13af4f0 2022-01-10T01:26:37.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x1416bc0 con 0x13b2ac0 2022-01-10T01:26:37.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 10 client.0 ll_register_callbacks cb 0x7f5968006e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-01-10T01:26:37.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f596f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x137faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f596f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x137faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36020/0 (socket says 172.21.15.36:36020) 2022-01-10T01:26:37.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f596f7fe700 1 -- 172.21.15.36:0/3028799063 learned_addr learned my addr 172.21.15.36:0/3028799063 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:37.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f596ffff700 1 --2- 172.21.15.36:0/3028799063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13af4f0 0x13bc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5974e87700 1 --2- 172.21.15.36:0/3028799063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 0x13b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f596f7fe700 1 -- 172.21.15.36:0/3028799063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 msgr2=0x13b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:37.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f596f7fe700 1 --2- 172.21.15.36:0/3028799063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 0x13b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f596f7fe700 1 -- 172.21.15.36:0/3028799063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13af4f0 msgr2=0x13bc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:37.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f596f7fe700 1 --2- 172.21.15.36:0/3028799063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13af4f0 0x13bc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:37.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f596f7fe700 1 -- 172.21.15.36:0/3028799063 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59700a14b0 con 0x13b2410 2022-01-10T01:26:37.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f596f7fe700 1 --2- 172.21.15.36:0/3028799063 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x137faa0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x13c5b30 tx=0x7f596802c040).ready entity=mon.0 client_cookie=a1c3d7ccfa0cfb61 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:37.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f594ffff700 10 client.0 ms_handle_connect on v2:172.21.15.36:3300/0 2022-01-10T01:26:37.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f594ffff700 1 -- 172.21.15.36:0/3028799063 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5968039040 con 0x13b2410 2022-01-10T01:26:37.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f594ffff700 1 -- 172.21.15.36:0/3028799063 <== mon.0 v2:172.21.15.36:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5968041e60 con 0x13b2410 2022-01-10T01:26:37.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 1 -- 172.21.15.36:0/3028799063 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5968047f70 con 0x13b2410 2022-01-10T01:26:37.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f594ffff700 1 -- 172.21.15.36:0/3028799063 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5968028550 con 0x13b2410 2022-01-10T01:26:37.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 10 client.5391 fetch_fsmap learned FSMap version 18 2022-01-10T01:26:37.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 1 -- 172.21.15.36:0/3028799063 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x12e2c00 con 0x13b2410 2022-01-10T01:26:37.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f594ffff700 1 -- 172.21.15.36:0/3028799063 <== mon.0 v2:172.21.15.36:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968047f70 con 0x13b2410 2022-01-10T01:26:37.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f594ffff700 1 -- 172.21.15.36:0/3028799063 <== mon.0 v2:172.21.15.36:3300/0 5 ==== fsmap(e 18) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f59680474c0 con 0x13b2410 2022-01-10T01:26:37.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 10 client.5391 fetch_fsmap finished waiting for FSMap version 18 2022-01-10T01:26:37.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 10 client.5391 resolve_mds: resolved ID 'b' to GID 5239 2022-01-10T01:26:37.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 20 client.5391 populate_metadata read hostname 'smithi036' 2022-01-10T01:26:37.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 1 --2- 172.21.15.36:0/3028799063 >> [v2:172.21.15.59:6832/3873482962,v1:172.21.15.59:6833/3873482962] conn(0x13c5f50 0x13b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:37.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 4 client.5391 mds_command: new command op to 5239 tid=0[{"prefix": "cache drop"}] 2022-01-10T01:26:37.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f5980b2d740 1 -- 172.21.15.36:0/3028799063 --> [v2:172.21.15.59:6832/3873482962,v1:172.21.15.59:6833/3873482962] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0x11d2590 con 0x13c5f50 2022-01-10T01:26:37.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f596ffff700 1 --2- 172.21.15.36:0/3028799063 >> [v2:172.21.15.59:6832/3873482962,v1:172.21.15.59:6833/3873482962] conn(0x13c5f50 0x13b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:37.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f596ffff700 1 --2- 172.21.15.36:0/3028799063 >> [v2:172.21.15.59:6832/3873482962,v1:172.21.15.59:6833/3873482962] conn(0x13c5f50 0x13b5330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fadad7fe7fcf8bc server_cookie=4746f8f7ebec2f66 in_seq=0 out_seq=0 2022-01-10T01:26:37.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:37.777+0000 7f594ffff700 10 client.5391 ms_handle_connect on v2:172.21.15.59:6832/3873482962 2022-01-10T01:26:49.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.005+0000 7f594ffff700 1 -- 172.21.15.36:0/3028799063 <== mds.0 v2:172.21.15.59:6832/3873482962 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+386 (crc 0 0 0) 0x11d2590 con 0x13c5f50 2022-01-10T01:26:49.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.005+0000 7f594ffff700 10 client.5391 handle_command_reply: tid=0 2022-01-10T01:26:49.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.005+0000 7f5980b2d740 1 client.5391 shutdown 2022-01-10T01:26:49.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5980b2d740 1 -- 172.21.15.36:0/3028799063 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 msgr2=0x137faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5980b2d740 1 --2- 172.21.15.36:0/3028799063 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x137faa0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x13c5b30 tx=0x7f596802c040).stop 2022-01-10T01:26:49.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5980b2d740 1 -- 172.21.15.36:0/3028799063 shutdown_connections 2022-01-10T01:26:49.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5980b2d740 1 --2- 172.21.15.36:0/3028799063 >> [v2:172.21.15.59:6832/3873482962,v1:172.21.15.59:6833/3873482962] conn(0x13c5f50 0x13b5330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5980b2d740 1 --2- 172.21.15.36:0/3028799063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x13b2ac0 0x13b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f594ffff700 0 client.5391 ms_handle_reset on v2:172.21.15.59:6832/3873482962 2022-01-10T01:26:49.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5980b2d740 1 --2- 172.21.15.36:0/3028799063 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x13b2410 0x137faa0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5980b2d740 1 --2- 172.21.15.36:0/3028799063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x13af4f0 0x13bc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5980b2d740 1 -- 172.21.15.36:0/3028799063 >> 172.21.15.36:0/3028799063 conn(0x137c9e0 msgr2=0x13b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:49.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5980b2d740 1 -- 172.21.15.36:0/3028799063 shutdown_connections 2022-01-10T01:26:49.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5980b2d740 1 -- 172.21.15.36:0/3028799063 wait complete. 2022-01-10T01:26:49.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5980b2d740 20 client.5391 trim_cache size 0 max 16384 2022-01-10T01:26:49.016 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:26:49.016 INFO:teuthology.orchestra.run.smithi036.stdout: "client_recall": { 2022-01-10T01:26:49.016 INFO:teuthology.orchestra.run.smithi036.stdout: "return_code": 0, 2022-01-10T01:26:49.016 INFO:teuthology.orchestra.run.smithi036.stdout: "message": "(0) Success", 2022-01-10T01:26:49.017 INFO:teuthology.orchestra.run.smithi036.stdout: "recalled": 220 2022-01-10T01:26:49.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:49.017 INFO:teuthology.orchestra.run.smithi036.stdout: "flush_journal": { 2022-01-10T01:26:49.017 INFO:teuthology.orchestra.run.smithi036.stdout: "return_code": 0, 2022-01-10T01:26:49.018 INFO:teuthology.orchestra.run.smithi036.stdout: "message": "" 2022-01-10T01:26:49.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:49.018 INFO:teuthology.orchestra.run.smithi036.stdout: "trim_cache": { 2022-01-10T01:26:49.018 INFO:teuthology.orchestra.run.smithi036.stdout: "trimmed": 0 2022-01-10T01:26:49.019 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:49.019 INFO:teuthology.orchestra.run.smithi036.stdout: "cache": { 2022-01-10T01:26:49.019 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": { 2022-01-10T01:26:49.019 INFO:teuthology.orchestra.run.smithi036.stdout: "items": 19974, 2022-01-10T01:26:49.020 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes": 3098656 2022-01-10T01:26:49.020 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:26:49.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:26:49.020 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 11.228049625000001 2022-01-10T01:26:49.020 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:26:49.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5975688700 1 -- 172.21.15.36:0/853927694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5950053560 msgr2=0x7f5950055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5975688700 1 --2- 172.21.15.36:0/853927694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5950053560 0x7f5950055a20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f596400b000 tx=0x7f5964006df0).stop 2022-01-10T01:26:49.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5975688700 1 -- 172.21.15.36:0/853927694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59700b00e0 msgr2=0x7f597013e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5975688700 1 --2- 172.21.15.36:0/853927694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59700b00e0 0x7f597013e6a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f59680032f0 tx=0x7f5968016000).stop 2022-01-10T01:26:49.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5975688700 1 -- 172.21.15.36:0/853927694 shutdown_connections 2022-01-10T01:26:49.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5975688700 1 --2- 172.21.15.36:0/853927694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5950053560 0x7f5950055a20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5975688700 1 --2- 172.21.15.36:0/853927694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59700b2580 0x7f597013eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5975688700 1 --2- 172.21.15.36:0/853927694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59700b00e0 0x7f597013e6a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5975688700 1 --2- 172.21.15.36:0/853927694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59700ac6f0 0x7f59700ab590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5975688700 1 -- 172.21.15.36:0/853927694 >> 172.21.15.36:0/853927694 conn(0x7f5970060180 msgr2=0x7f59700b44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:49.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5975688700 1 -- 172.21.15.36:0/853927694 shutdown_connections 2022-01-10T01:26:49.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.009+0000 7f5975688700 1 -- 172.21.15.36:0/853927694 wait complete. 2022-01-10T01:26:49.027 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2022-01-10T01:26:49.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:49.028 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:26:49.029 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:49.036 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2022-01-10T01:26:49.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:26:49.038 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2022-01-10T01:26:49.038 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:26:49.039 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:26:49.039 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:49.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:49.060 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:26:49.060 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:49.109 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:26:49.110 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:26:49.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:26:49.111 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:49.119 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:26:49.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23c582700 1 Processor -- start 2022-01-10T01:26:49.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23c582700 1 -- start start 2022-01-10T01:26:49.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23c582700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe2340b6900 0x7fe2340acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23c582700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2340aa5d0 0x7fe23413c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23c582700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2340b6ce0 con 0x7fe234060910 2022-01-10T01:26:49.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23c582700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2340611e0 con 0x7fe2340b6900 2022-01-10T01:26:49.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23c582700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe234061480 con 0x7fe2340aa5d0 2022-01-10T01:26:49.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23a31e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe2340b6900 0x7fe2340acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe239b1d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe234060910 0x7fe2340a9ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33820/0 (socket says 172.21.15.36:33820) 2022-01-10T01:26:49.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe239b1d700 1 -- 172.21.15.36:0/264891262 learned_addr learned my addr 172.21.15.36:0/264891262 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:49.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23a31e700 1 --2- 172.21.15.36:0/264891262 >> v2:172.21.15.36:3300/0 conn(0x7fe2340b6900 0x7fe2340acd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36026/0 (socket says 172.21.15.36:36026) 2022-01-10T01:26:49.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23ab1f700 1 --2- 172.21.15.36:0/264891262 >> v2:172.21.15.59:3300/0 conn(0x7fe2340aa5d0 0x7fe23413c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23931c700 1 -- 172.21.15.36:0/264891262 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70939734 0 0) 0x7fe2340b6ce0 con 0x7fe234060910 2022-01-10T01:26:49.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23a31e700 1 -- 172.21.15.36:0/264891262 >> v2:172.21.15.59:3300/0 conn(0x7fe2340aa5d0 msgr2=0x7fe23413c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:49.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23a31e700 1 --2- 172.21.15.36:0/264891262 >> v2:172.21.15.59:3300/0 conn(0x7fe2340aa5d0 0x7fe23413c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23a31e700 1 -- 172.21.15.36:0/264891262 >> v1:172.21.15.36:6789/0 conn(0x7fe234060910 legacy=0x7fe2340a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23a31e700 1 -- 172.21.15.36:0/264891262 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe234061720 con 0x7fe2340b6900 2022-01-10T01:26:49.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23ab1f700 1 --2- 172.21.15.36:0/264891262 >> v2:172.21.15.59:3300/0 conn(0x7fe2340aa5d0 0x7fe23413c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:49.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23a31e700 1 --2- 172.21.15.36:0/264891262 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2340b6900 0x7fe2340acd50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fe230002f70 tx=0x7fe230006e80).ready entity=mon.0 client_cookie=8e8754d8738badd3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:49.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23931c700 1 -- 172.21.15.36:0/264891262 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe23000ba40 con 0x7fe2340b6900 2022-01-10T01:26:49.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23931c700 1 -- 172.21.15.36:0/264891262 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe230000e90 con 0x7fe2340b6900 2022-01-10T01:26:49.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23931c700 1 -- 172.21.15.36:0/264891262 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe23000bd90 con 0x7fe2340b6900 2022-01-10T01:26:49.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23c582700 1 -- 172.21.15.36:0/264891262 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2340b6900 msgr2=0x7fe2340acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23c582700 1 --2- 172.21.15.36:0/264891262 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2340b6900 0x7fe2340acd50 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fe230002f70 tx=0x7fe230006e80).stop 2022-01-10T01:26:49.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23c582700 1 -- 172.21.15.36:0/264891262 shutdown_connections 2022-01-10T01:26:49.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23c582700 1 --2- 172.21.15.36:0/264891262 >> v2:172.21.15.59:3300/0 conn(0x7fe2340aa5d0 0x7fe23413c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23c582700 1 --2- 172.21.15.36:0/264891262 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2340b6900 0x7fe2340acd50 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.229+0000 7fe23c582700 1 -- 172.21.15.36:0/264891262 >> 172.21.15.36:0/264891262 conn(0x7fe2340b3480 msgr2=0x7fe2340b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:49.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23c582700 1 -- 172.21.15.36:0/264891262 shutdown_connections 2022-01-10T01:26:49.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23c582700 1 -- 172.21.15.36:0/264891262 wait complete. 2022-01-10T01:26:49.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23c582700 1 Processor -- start 2022-01-10T01:26:49.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23c582700 1 -- start start 2022-01-10T01:26:49.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23c582700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe234060910 0x7fe2340ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23c582700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2340aa5d0 0x7fe2340ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23c582700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2340b6900 0x7fe234138970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23c582700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe234153420 con 0x7fe2340b6900 2022-01-10T01:26:49.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23c582700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2341523b0 con 0x7fe234060910 2022-01-10T01:26:49.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23c582700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2340afd30 con 0x7fe2340aa5d0 2022-01-10T01:26:49.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23ab1f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2340b6900 0x7fe234138970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23ab1f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2340b6900 0x7fe234138970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36034/0 (socket says 172.21.15.36:36034) 2022-01-10T01:26:49.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23ab1f700 1 -- 172.21.15.36:0/1319743901 learned_addr learned my addr 172.21.15.36:0/1319743901 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:49.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23a31e700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe234060910 0x7fe2340ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe239b1d700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2340aa5d0 0x7fe2340ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23a31e700 1 -- 172.21.15.36:0/1319743901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2340aa5d0 msgr2=0x7fe2340ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.233+0000 7fe23a31e700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2340aa5d0 0x7fe2340ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe23a31e700 1 -- 172.21.15.36:0/1319743901 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2340b6900 msgr2=0x7fe234138970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe23a31e700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2340b6900 0x7fe234138970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe23a31e700 1 -- 172.21.15.36:0/1319743901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23000d410 con 0x7fe234060910 2022-01-10T01:26:49.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe23ab1f700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2340b6900 0x7fe234138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:26:49.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe23a31e700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe234060910 0x7fe2340ae4d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fe234152870 tx=0x7fe23405fdb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:49.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe22b7fe700 1 -- 172.21.15.36:0/1319743901 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe23001a850 con 0x7fe234060910 2022-01-10T01:26:49.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe22b7fe700 1 -- 172.21.15.36:0/1319743901 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23001a9b0 con 0x7fe234060910 2022-01-10T01:26:49.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe23c582700 1 -- 172.21.15.36:0/1319743901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2340aeff0 con 0x7fe234060910 2022-01-10T01:26:49.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe22b7fe700 1 -- 172.21.15.36:0/1319743901 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe23001ad10 con 0x7fe234060910 2022-01-10T01:26:49.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe23c582700 1 -- 172.21.15.36:0/1319743901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2341412c0 con 0x7fe234060910 2022-01-10T01:26:49.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe23c582700 1 -- 172.21.15.36:0/1319743901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2340619c0 con 0x7fe234060910 2022-01-10T01:26:49.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe22b7fe700 1 -- 172.21.15.36:0/1319743901 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe230023470 con 0x7fe234060910 2022-01-10T01:26:49.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe22b7fe700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe214053680 0x7fe214055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe22b7fe700 1 -- 172.21.15.36:0/1319743901 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe23006d880 con 0x7fe234060910 2022-01-10T01:26:49.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.237+0000 7fe239b1d700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe214053680 0x7fe214055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.241+0000 7fe239b1d700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe214053680 0x7fe214055b40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fe22c00d000 tx=0x7fe22c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:49.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.249+0000 7fe22b7fe700 1 -- 172.21.15.36:0/1319743901 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe230044720 con 0x7fe234060910 2022-01-10T01:26:49.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.377+0000 7fe23c582700 1 -- 172.21.15.36:0/1319743901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe234057350 con 0x7fe234060910 2022-01-10T01:26:49.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.381+0000 7fe22b7fe700 1 -- 172.21.15.36:0/1319743901 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16271 (secure 0 0 0) 0x7fe230014090 con 0x7fe234060910 2022-01-10T01:26:49.384 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:49.384 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":46,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:26:19.602372+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:26:17.063945+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2022-01-10T01:26:18.074904+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:26:49.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.381+0000 7fe23c582700 1 -- 172.21.15.36:0/1319743901 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe214053680 msgr2=0x7fe214055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.381+0000 7fe23c582700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe214053680 0x7fe214055b40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fe22c00d000 tx=0x7fe22c009040).stop 2022-01-10T01:26:49.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.381+0000 7fe23c582700 1 -- 172.21.15.36:0/1319743901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe234060910 msgr2=0x7fe2340ae4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.381+0000 7fe23c582700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe234060910 0x7fe2340ae4d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fe234152870 tx=0x7fe23405fdb0).stop 2022-01-10T01:26:49.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.381+0000 7fe23c582700 1 -- 172.21.15.36:0/1319743901 shutdown_connections 2022-01-10T01:26:49.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.381+0000 7fe23c582700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe214053680 0x7fe214055b40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.381+0000 7fe23c582700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2340b6900 0x7fe234138970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.381+0000 7fe23c582700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2340aa5d0 0x7fe2340ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.381+0000 7fe23c582700 1 --2- 172.21.15.36:0/1319743901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe234060910 0x7fe2340ae4d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.381+0000 7fe23c582700 1 -- 172.21.15.36:0/1319743901 >> 172.21.15.36:0/1319743901 conn(0x7fe2340b3480 msgr2=0x7fe2340a9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:49.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.381+0000 7fe23c582700 1 -- 172.21.15.36:0/1319743901 shutdown_connections 2022-01-10T01:26:49.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.381+0000 7fe23c582700 1 -- 172.21.15.36:0/1319743901 wait complete. 2022-01-10T01:26:49.396 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:26:17.063945+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:26:18.074904+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:26:49.397 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:26:49.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa905e04700 1 Processor -- start 2022-01-10T01:26:49.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa905e04700 1 -- start start 2022-01-10T01:26:49.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa905e04700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa9000a9960 0x7fa9000b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa905e04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9000ac260 0x7fa9000aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa905e04700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9000b1c60 con 0x7fa9000b06c0 2022-01-10T01:26:49.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa905e04700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9000a9d40 con 0x7fa9000a9960 2022-01-10T01:26:49.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa905e04700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000b2940 con 0x7fa9000ac260 2022-01-10T01:26:49.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa8ff7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa9000a9960 0x7fa9000b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa8fffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa9000b06c0 0x7fa9000aec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33836/0 (socket says 172.21.15.36:33836) 2022-01-10T01:26:49.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa8fffff700 1 -- 172.21.15.36:0/79136370 learned_addr learned my addr 172.21.15.36:0/79136370 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:49.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa8feffd700 1 --2- 172.21.15.36:0/79136370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9000ac260 0x7fa9000aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa8ff7fe700 1 -- 172.21.15.36:0/79136370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9000ac260 msgr2=0x7fa9000aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:49.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa8ff7fe700 1 --2- 172.21.15.36:0/79136370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9000ac260 0x7fa9000aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa8fe7fc700 1 -- 172.21.15.36:0/79136370 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1157803053 0 0) 0x7fa8f8001490 con 0x7fa9000b06c0 2022-01-10T01:26:49.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa8ff7fe700 1 -- 172.21.15.36:0/79136370 >> v1:172.21.15.36:6789/0 conn(0x7fa9000b06c0 legacy=0x7fa9000aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa8ff7fe700 1 -- 172.21.15.36:0/79136370 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9000b00c0 con 0x7fa9000a9960 2022-01-10T01:26:49.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa8ff7fe700 1 --2- 172.21.15.36:0/79136370 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9000a9960 0x7fa9000b1770 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fa8f4002f70 tx=0x7fa8f4006df0).ready entity=mon.0 client_cookie=6993a209909967c9 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:49.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.505+0000 7fa8fe7fc700 1 -- 172.21.15.36:0/79136370 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f400d570 con 0x7fa9000a9960 2022-01-10T01:26:49.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8fe7fc700 1 -- 172.21.15.36:0/79136370 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f4000e90 con 0x7fa9000a9960 2022-01-10T01:26:49.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8fe7fc700 1 -- 172.21.15.36:0/79136370 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f400d8c0 con 0x7fa9000a9960 2022-01-10T01:26:49.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 -- 172.21.15.36:0/79136370 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9000a9960 msgr2=0x7fa9000b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 --2- 172.21.15.36:0/79136370 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9000a9960 0x7fa9000b1770 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fa8f4002f70 tx=0x7fa8f4006df0).stop 2022-01-10T01:26:49.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 -- 172.21.15.36:0/79136370 shutdown_connections 2022-01-10T01:26:49.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 --2- 172.21.15.36:0/79136370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9000ac260 0x7fa9000aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 --2- 172.21.15.36:0/79136370 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9000a9960 0x7fa9000b1770 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 -- 172.21.15.36:0/79136370 >> 172.21.15.36:0/79136370 conn(0x7fa90005f6b0 msgr2=0x7fa90005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:49.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 -- 172.21.15.36:0/79136370 shutdown_connections 2022-01-10T01:26:49.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 -- 172.21.15.36:0/79136370 wait complete. 2022-01-10T01:26:49.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 Processor -- start 2022-01-10T01:26:49.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 -- start start 2022-01-10T01:26:49.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9000a9960 0x7fa900066f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9000ac260 0x7fa90013c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9000b06c0 0x7fa90013cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000a1480 con 0x7fa9000a9960 2022-01-10T01:26:49.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000adbc0 con 0x7fa9000b06c0 2022-01-10T01:26:49.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9000ade60 con 0x7fa9000ac260 2022-01-10T01:26:49.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8ff7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9000a9960 0x7fa900066f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8ff7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9000a9960 0x7fa900066f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36044/0 (socket says 172.21.15.36:36044) 2022-01-10T01:26:49.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8ff7fe700 1 -- 172.21.15.36:0/1707554748 learned_addr learned my addr 172.21.15.36:0/1707554748 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:49.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8feffd700 1 --2- 172.21.15.36:0/1707554748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9000ac260 0x7fa90013c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8fffff700 1 --2- 172.21.15.36:0/1707554748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9000b06c0 0x7fa90013cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8ff7fe700 1 -- 172.21.15.36:0/1707554748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9000ac260 msgr2=0x7fa90013c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8ff7fe700 1 --2- 172.21.15.36:0/1707554748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9000ac260 0x7fa90013c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8ff7fe700 1 -- 172.21.15.36:0/1707554748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9000b06c0 msgr2=0x7fa90013cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8ff7fe700 1 --2- 172.21.15.36:0/1707554748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9000b06c0 0x7fa90013cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8ff7fe700 1 -- 172.21.15.36:0/1707554748 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f400b180 con 0x7fa9000a9960 2022-01-10T01:26:49.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8ff7fe700 1 --2- 172.21.15.36:0/1707554748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9000a9960 0x7fa900066f10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fa8f4002f70 tx=0x7fa8f4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:49.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8fcff9700 1 -- 172.21.15.36:0/1707554748 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f400dea0 con 0x7fa9000a9960 2022-01-10T01:26:49.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8fcff9700 1 -- 172.21.15.36:0/1707554748 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f401e400 con 0x7fa9000a9960 2022-01-10T01:26:49.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 -- 172.21.15.36:0/1707554748 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9000acfd0 con 0x7fa9000a9960 2022-01-10T01:26:49.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa8fcff9700 1 -- 172.21.15.36:0/1707554748 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8f401e760 con 0x7fa9000a9960 2022-01-10T01:26:49.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.509+0000 7fa905e04700 1 -- 172.21.15.36:0/1707554748 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9000675c0 con 0x7fa9000a9960 2022-01-10T01:26:49.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.513+0000 7fa8fcff9700 1 -- 172.21.15.36:0/1707554748 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa8f4025030 con 0x7fa9000a9960 2022-01-10T01:26:49.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.513+0000 7fa8fcff9700 1 --2- 172.21.15.36:0/1707554748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa8e00535f0 0x7fa8e0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.513+0000 7fa8fcff9700 1 -- 172.21.15.36:0/1707554748 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa8f406c990 con 0x7fa9000a9960 2022-01-10T01:26:49.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.513+0000 7fa905e04700 1 -- 172.21.15.36:0/1707554748 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90013d330 con 0x7fa9000a9960 2022-01-10T01:26:49.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.513+0000 7fa8feffd700 1 --2- 172.21.15.36:0/1707554748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa8e00535f0 0x7fa8e0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.513+0000 7fa8feffd700 1 --2- 172.21.15.36:0/1707554748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa8e00535f0 0x7fa8e0055ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fa8f000b000 tx=0x7fa8f0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:49.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.517+0000 7fa8fcff9700 1 -- 172.21.15.36:0/1707554748 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa90013d330 con 0x7fa9000a9960 2022-01-10T01:26:49.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.645+0000 7fa905e04700 1 -- 172.21.15.36:0/1707554748 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa9000ad470 con 0x7fa9000a9960 2022-01-10T01:26:49.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.645+0000 7fa8fcff9700 1 -- 172.21.15.36:0/1707554748 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v46) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa9000ad470 con 0x7fa9000a9960 2022-01-10T01:26:49.651 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:26:49.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.649+0000 7fa905e04700 1 -- 172.21.15.36:0/1707554748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa8e00535f0 msgr2=0x7fa8e0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.649+0000 7fa905e04700 1 --2- 172.21.15.36:0/1707554748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa8e00535f0 0x7fa8e0055ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fa8f000b000 tx=0x7fa8f0008040).stop 2022-01-10T01:26:49.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.649+0000 7fa905e04700 1 -- 172.21.15.36:0/1707554748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9000a9960 msgr2=0x7fa900066f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.649+0000 7fa905e04700 1 --2- 172.21.15.36:0/1707554748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9000a9960 0x7fa900066f10 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fa8f4002f70 tx=0x7fa8f4014000).stop 2022-01-10T01:26:49.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.649+0000 7fa905e04700 1 -- 172.21.15.36:0/1707554748 shutdown_connections 2022-01-10T01:26:49.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.649+0000 7fa905e04700 1 --2- 172.21.15.36:0/1707554748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa8e00535f0 0x7fa8e0055ab0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.649+0000 7fa905e04700 1 --2- 172.21.15.36:0/1707554748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9000b06c0 0x7fa90013cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.649+0000 7fa905e04700 1 --2- 172.21.15.36:0/1707554748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9000ac260 0x7fa90013c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.649+0000 7fa905e04700 1 --2- 172.21.15.36:0/1707554748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9000a9960 0x7fa900066f10 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.649+0000 7fa905e04700 1 -- 172.21.15.36:0/1707554748 >> 172.21.15.36:0/1707554748 conn(0x7fa90005f6b0 msgr2=0x7fa900142810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:49.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.649+0000 7fa905e04700 1 -- 172.21.15.36:0/1707554748 shutdown_connections 2022-01-10T01:26:49.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.649+0000 7fa905e04700 1 -- 172.21.15.36:0/1707554748 wait complete. 2022-01-10T01:26:49.664 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:26:49.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 Processor -- start 2022-01-10T01:26:49.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 -- start start 2022-01-10T01:26:49.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0f200b0610 0x7f0f200af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f201475a0 0x7f0f200acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f201479f0 con 0x7f0f200b54a0 2022-01-10T01:26:49.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f201452e0 con 0x7f0f200b0610 2022-01-10T01:26:49.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f200adff0 con 0x7f0f201475a0 2022-01-10T01:26:49.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f25493700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0f200b0610 0x7f0f200af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f25493700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0f200b0610 0x7f0f200af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36054/0 (socket says 172.21.15.36:36054) 2022-01-10T01:26:49.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f25493700 1 -- 172.21.15.36:0/4020405480 learned_addr learned my addr 172.21.15.36:0/4020405480 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:49.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26495700 1 --2- 172.21.15.36:0/4020405480 >> v2:172.21.15.59:3300/0 conn(0x7f0f201475a0 0x7f0f200acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f25493700 1 -- 172.21.15.36:0/4020405480 >> v2:172.21.15.59:3300/0 conn(0x7f0f201475a0 msgr2=0x7f0f200acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:49.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f25493700 1 --2- 172.21.15.36:0/4020405480 >> v2:172.21.15.59:3300/0 conn(0x7f0f201475a0 0x7f0f200acc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f25493700 1 -- 172.21.15.36:0/4020405480 >> v1:172.21.15.59:6789/0 conn(0x7f0f200b54a0 legacy=0x7f0f200675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f25493700 1 -- 172.21.15.36:0/4020405480 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f200b5880 con 0x7f0f200b0610 2022-01-10T01:26:49.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f25493700 1 --2- 172.21.15.36:0/4020405480 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f200b0610 0x7f0f200af550 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f0f10002f70 tx=0x7f0f10006eb0).ready entity=mon.0 client_cookie=a770b18f1174c9d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:49.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f24c92700 1 -- 172.21.15.36:0/4020405480 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f1000d610 con 0x7f0f200b0610 2022-01-10T01:26:49.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f24c92700 1 -- 172.21.15.36:0/4020405480 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f10000e90 con 0x7f0f200b0610 2022-01-10T01:26:49.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f24c92700 1 -- 172.21.15.36:0/4020405480 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f1000d9a0 con 0x7f0f200b0610 2022-01-10T01:26:49.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 -- 172.21.15.36:0/4020405480 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f200b0610 msgr2=0x7f0f200af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 --2- 172.21.15.36:0/4020405480 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f200b0610 0x7f0f200af550 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f0f10002f70 tx=0x7f0f10006eb0).stop 2022-01-10T01:26:49.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 -- 172.21.15.36:0/4020405480 shutdown_connections 2022-01-10T01:26:49.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 --2- 172.21.15.36:0/4020405480 >> v2:172.21.15.59:3300/0 conn(0x7f0f201475a0 0x7f0f200acc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 --2- 172.21.15.36:0/4020405480 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f200b0610 0x7f0f200af550 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 -- 172.21.15.36:0/4020405480 >> 172.21.15.36:0/4020405480 conn(0x7f0f20062560 msgr2=0x7f0f20062940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:49.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 -- 172.21.15.36:0/4020405480 shutdown_connections 2022-01-10T01:26:49.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.769+0000 7f0f26c96700 1 -- 172.21.15.36:0/4020405480 wait complete. 2022-01-10T01:26:49.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f26c96700 1 Processor -- start 2022-01-10T01:26:49.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f26c96700 1 -- start start 2022-01-10T01:26:49.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f26c96700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f200b0610 0x7f0f200b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f26c96700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f200b54a0 0x7f0f20142590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f26c96700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f201475a0 0x7f0f20142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f26c96700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f20064b60 con 0x7f0f200b0610 2022-01-10T01:26:49.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f26c96700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f20064eb0 con 0x7f0f201475a0 2022-01-10T01:26:49.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f26c96700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f20065150 con 0x7f0f200b54a0 2022-01-10T01:26:49.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f25c94700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f200b0610 0x7f0f200b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f26495700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f201475a0 0x7f0f20142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f25493700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f200b54a0 0x7f0f20142590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f25c94700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f200b0610 0x7f0f200b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36060/0 (socket says 172.21.15.36:36060) 2022-01-10T01:26:49.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f25c94700 1 -- 172.21.15.36:0/1724990410 learned_addr learned my addr 172.21.15.36:0/1724990410 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:49.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f25c94700 1 -- 172.21.15.36:0/1724990410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f200b54a0 msgr2=0x7f0f20142590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f25c94700 1 --2- 172.21.15.36:0/1724990410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f200b54a0 0x7f0f20142590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f25c94700 1 -- 172.21.15.36:0/1724990410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f201475a0 msgr2=0x7f0f20142a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f25c94700 1 --2- 172.21.15.36:0/1724990410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f201475a0 0x7f0f20142a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f25c94700 1 -- 172.21.15.36:0/1724990410 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1000b1e0 con 0x7f0f200b0610 2022-01-10T01:26:49.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.773+0000 7f0f26495700 1 --2- 172.21.15.36:0/1724990410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f201475a0 0x7f0f20142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:26:49.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.777+0000 7f0f25c94700 1 --2- 172.21.15.36:0/1724990410 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f200b0610 0x7f0f200b4120 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f0f20069d90 tx=0x7f0f1c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:49.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.777+0000 7f0f0effd700 1 -- 172.21.15.36:0/1724990410 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f1c007030 con 0x7f0f200b0610 2022-01-10T01:26:49.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.777+0000 7f0f0effd700 1 -- 172.21.15.36:0/1724990410 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c007190 con 0x7f0f200b0610 2022-01-10T01:26:49.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.777+0000 7f0f26c96700 1 -- 172.21.15.36:0/1724990410 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f200653f0 con 0x7f0f200b0610 2022-01-10T01:26:49.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.777+0000 7f0f0effd700 1 -- 172.21.15.36:0/1724990410 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f1c006510 con 0x7f0f200b0610 2022-01-10T01:26:49.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.777+0000 7f0f26c96700 1 -- 172.21.15.36:0/1724990410 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f200a8a90 con 0x7f0f200b0610 2022-01-10T01:26:49.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.777+0000 7f0f26c96700 1 -- 172.21.15.36:0/1724990410 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f20057350 con 0x7f0f200b0610 2022-01-10T01:26:49.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.777+0000 7f0f0effd700 1 -- 172.21.15.36:0/1724990410 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0f1c010030 con 0x7f0f200b0610 2022-01-10T01:26:49.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.777+0000 7f0f0effd700 1 --2- 172.21.15.36:0/1724990410 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f000536b0 0x7f0f00055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:49.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.777+0000 7f0f0effd700 1 -- 172.21.15.36:0/1724990410 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0f1c06b530 con 0x7f0f200b0610 2022-01-10T01:26:49.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.781+0000 7f0f25493700 1 --2- 172.21.15.36:0/1724990410 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f000536b0 0x7f0f00055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:49.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.781+0000 7f0f25493700 1 --2- 172.21.15.36:0/1724990410 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f000536b0 0x7f0f00055b70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f0f1001c000 tx=0x7f0f10015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:49.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.785+0000 7f0f0effd700 1 -- 172.21.15.36:0/1724990410 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0f1c042540 con 0x7f0f200b0610 2022-01-10T01:26:49.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.909+0000 7f0f26c96700 1 -- 172.21.15.36:0/1724990410 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0f2005f240 con 0x7f0f200b0610 2022-01-10T01:26:49.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.913+0000 7f0f0effd700 1 -- 172.21.15.36:0/1724990410 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0f1c045b60 con 0x7f0f200b0610 2022-01-10T01:26:49.916 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:26:49.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.913+0000 7f0f26c96700 1 -- 172.21.15.36:0/1724990410 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f000536b0 msgr2=0x7f0f00055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.913+0000 7f0f26c96700 1 --2- 172.21.15.36:0/1724990410 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f000536b0 0x7f0f00055b70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f0f1001c000 tx=0x7f0f10015000).stop 2022-01-10T01:26:49.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.913+0000 7f0f26c96700 1 -- 172.21.15.36:0/1724990410 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f200b0610 msgr2=0x7f0f200b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:49.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.913+0000 7f0f26c96700 1 --2- 172.21.15.36:0/1724990410 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f200b0610 0x7f0f200b4120 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f0f20069d90 tx=0x7f0f1c007c10).stop 2022-01-10T01:26:49.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.913+0000 7f0f26c96700 1 -- 172.21.15.36:0/1724990410 shutdown_connections 2022-01-10T01:26:49.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.913+0000 7f0f26c96700 1 --2- 172.21.15.36:0/1724990410 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f000536b0 0x7f0f00055b70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.913+0000 7f0f26c96700 1 --2- 172.21.15.36:0/1724990410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f201475a0 0x7f0f20142a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.913+0000 7f0f26c96700 1 --2- 172.21.15.36:0/1724990410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f200b54a0 0x7f0f20142590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.913+0000 7f0f26c96700 1 --2- 172.21.15.36:0/1724990410 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0f200b0610 0x7f0f200b4120 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:49.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.913+0000 7f0f26c96700 1 -- 172.21.15.36:0/1724990410 >> 172.21.15.36:0/1724990410 conn(0x7f0f20062560 msgr2=0x7f0f20143970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:49.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.913+0000 7f0f26c96700 1 -- 172.21.15.36:0/1724990410 shutdown_connections 2022-01-10T01:26:49.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:49.913+0000 7f0f26c96700 1 -- 172.21.15.36:0/1724990410 wait complete. 2022-01-10T01:26:49.929 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:26:50.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.037+0000 7f4bd5c06700 1 Processor -- start 2022-01-10T01:26:50.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.037+0000 7f4bd5c06700 1 -- start start 2022-01-10T01:26:50.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bd0146950 0x7f4bd0140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4bd00b4180 0x7f4bd0140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4bd00b4690 0x7f4bd00b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd0147510 con 0x7f4bd00b4180 2022-01-10T01:26:50.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd0143b60 con 0x7f4bd00b4690 2022-01-10T01:26:50.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd0143e00 con 0x7f4bd0146950 2022-01-10T01:26:50.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bc7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4bd00b4180 0x7f4bd0140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bc7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4bd00b4180 0x7f4bd0140720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36070/0 (socket says 172.21.15.36:36070) 2022-01-10T01:26:50.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bc7fff700 1 -- 172.21.15.36:0/344737745 learned_addr learned my addr 172.21.15.36:0/344737745 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:50.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bcffff700 1 --2- 172.21.15.36:0/344737745 >> v2:172.21.15.59:3300/0 conn(0x7f4bd00b4690 0x7f4bd00b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bcf7fe700 1 --2- 172.21.15.36:0/344737745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bd0146950 0x7f4bd0140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bc7fff700 1 -- 172.21.15.36:0/344737745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bd0146950 msgr2=0x7f4bd0140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:50.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bc7fff700 1 --2- 172.21.15.36:0/344737745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bd0146950 0x7f4bd0140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bc7fff700 1 -- 172.21.15.36:0/344737745 >> v2:172.21.15.59:3300/0 conn(0x7f4bd00b4690 msgr2=0x7f4bd00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:50.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bc7fff700 1 --2- 172.21.15.36:0/344737745 >> v2:172.21.15.59:3300/0 conn(0x7f4bd00b4690 0x7f4bd00b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bc7fff700 1 -- 172.21.15.36:0/344737745 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd00b0c90 con 0x7f4bd00b4180 2022-01-10T01:26:50.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bc7fff700 1 --2- 172.21.15.36:0/344737745 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bd00b4180 0x7f4bd0140720 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f4bb8002f70 tx=0x7f4bb8006eb0).ready entity=mon.0 client_cookie=68acb4f2a2861936 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:50.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bceffd700 1 -- 172.21.15.36:0/344737745 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bb800d570 con 0x7f4bd00b4180 2022-01-10T01:26:50.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bceffd700 1 -- 172.21.15.36:0/344737745 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb8000e90 con 0x7f4bd00b4180 2022-01-10T01:26:50.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bceffd700 1 -- 172.21.15.36:0/344737745 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bb800d900 con 0x7f4bd00b4180 2022-01-10T01:26:50.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 -- 172.21.15.36:0/344737745 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bd00b4180 msgr2=0x7f4bd0140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 --2- 172.21.15.36:0/344737745 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bd00b4180 0x7f4bd0140720 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f4bb8002f70 tx=0x7f4bb8006eb0).stop 2022-01-10T01:26:50.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 -- 172.21.15.36:0/344737745 shutdown_connections 2022-01-10T01:26:50.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 --2- 172.21.15.36:0/344737745 >> v2:172.21.15.59:3300/0 conn(0x7f4bd00b4690 0x7f4bd00b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 --2- 172.21.15.36:0/344737745 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bd00b4180 0x7f4bd0140720 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 --2- 172.21.15.36:0/344737745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bd0146950 0x7f4bd0140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 -- 172.21.15.36:0/344737745 >> 172.21.15.36:0/344737745 conn(0x7f4bd005c490 msgr2=0x7f4bd005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:50.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 -- 172.21.15.36:0/344737745 shutdown_connections 2022-01-10T01:26:50.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.041+0000 7f4bd5c06700 1 -- 172.21.15.36:0/344737745 wait complete. 2022-01-10T01:26:50.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bd5c06700 1 Processor -- start 2022-01-10T01:26:50.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bd5c06700 1 -- start start 2022-01-10T01:26:50.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bd5c06700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bd00b4180 0x7f4bd01496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bd5c06700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bd00b4690 0x7f4bd00ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bd5c06700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bd0146950 0x7f4bd00addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bd5c06700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd0142300 con 0x7f4bd00b4180 2022-01-10T01:26:50.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bd5c06700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd0142a90 con 0x7f4bd0146950 2022-01-10T01:26:50.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bd5c06700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00ae2e0 con 0x7f4bd00b4690 2022-01-10T01:26:50.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bcf7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bd00b4180 0x7f4bd01496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bcf7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bd00b4180 0x7f4bd01496b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36074/0 (socket says 172.21.15.36:36074) 2022-01-10T01:26:50.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bcf7fe700 1 -- 172.21.15.36:0/2374016533 learned_addr learned my addr 172.21.15.36:0/2374016533 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:50.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bc7fff700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bd00b4690 0x7f4bd00ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bcffff700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bd0146950 0x7f4bd00addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bcf7fe700 1 -- 172.21.15.36:0/2374016533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bd00b4690 msgr2=0x7f4bd00ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bcf7fe700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bd00b4690 0x7f4bd00ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bcf7fe700 1 -- 172.21.15.36:0/2374016533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bd0146950 msgr2=0x7f4bd00addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bcf7fe700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bd0146950 0x7f4bd00addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bcf7fe700 1 -- 172.21.15.36:0/2374016533 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb800b1e0 con 0x7f4bd00b4180 2022-01-10T01:26:50.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bcffff700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bd0146950 0x7f4bd00addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:26:50.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bcf7fe700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bd00b4180 0x7f4bd01496b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f4bc000c000 tx=0x7f4bc0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:50.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bcd7fa700 1 -- 172.21.15.36:0/2374016533 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bc0010780 con 0x7f4bd00b4180 2022-01-10T01:26:50.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bd5c06700 1 -- 172.21.15.36:0/2374016533 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd00b0620 con 0x7f4bd00b4180 2022-01-10T01:26:50.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bcd7fa700 1 -- 172.21.15.36:0/2374016533 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc00108e0 con 0x7f4bd00b4180 2022-01-10T01:26:50.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bcd7fa700 1 -- 172.21.15.36:0/2374016533 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bc0010c40 con 0x7f4bd00b4180 2022-01-10T01:26:50.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.045+0000 7f4bd5c06700 1 -- 172.21.15.36:0/2374016533 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd01427f0 con 0x7f4bd00b4180 2022-01-10T01:26:50.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.049+0000 7f4bd5c06700 1 -- 172.21.15.36:0/2374016533 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd00ad640 con 0x7f4bd00b4180 2022-01-10T01:26:50.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.049+0000 7f4bcd7fa700 1 -- 172.21.15.36:0/2374016533 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4bc001c460 con 0x7f4bd00b4180 2022-01-10T01:26:50.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.049+0000 7f4bcd7fa700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bb40534d0 0x7f4bb4055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.049+0000 7f4bcd7fa700 1 -- 172.21.15.36:0/2374016533 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4bc006bf40 con 0x7f4bd00b4180 2022-01-10T01:26:50.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.049+0000 7f4bc7fff700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bb40534d0 0x7f4bb4055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.049+0000 7f4bc7fff700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bb40534d0 0x7f4bb4055990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f4bb801c000 tx=0x7f4bb8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:50.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.057+0000 7f4bcd7fa700 1 -- 172.21.15.36:0/2374016533 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4bd00ad640 con 0x7f4bd00b4180 2022-01-10T01:26:50.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.181+0000 7f4bd5c06700 1 -- 172.21.15.36:0/2374016533 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4bd00ad640 con 0x7f4bd00b4180 2022-01-10T01:26:50.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.181+0000 7f4bcd7fa700 1 -- 172.21.15.36:0/2374016533 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4bd00ad640 con 0x7f4bd00b4180 2022-01-10T01:26:50.185 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:26:50.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.181+0000 7f4bd5c06700 1 -- 172.21.15.36:0/2374016533 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bb40534d0 msgr2=0x7f4bb4055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.181+0000 7f4bd5c06700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bb40534d0 0x7f4bb4055990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f4bb801c000 tx=0x7f4bb8015000).stop 2022-01-10T01:26:50.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.181+0000 7f4bd5c06700 1 -- 172.21.15.36:0/2374016533 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bd00b4180 msgr2=0x7f4bd01496b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.181+0000 7f4bd5c06700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bd00b4180 0x7f4bd01496b0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f4bc000c000 tx=0x7f4bc0006df0).stop 2022-01-10T01:26:50.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.181+0000 7f4bd5c06700 1 -- 172.21.15.36:0/2374016533 shutdown_connections 2022-01-10T01:26:50.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.181+0000 7f4bd5c06700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bb40534d0 0x7f4bb4055990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.181+0000 7f4bd5c06700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bd0146950 0x7f4bd00addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.181+0000 7f4bd5c06700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bd00b4690 0x7f4bd00ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.181+0000 7f4bd5c06700 1 --2- 172.21.15.36:0/2374016533 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bd00b4180 0x7f4bd01496b0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.181+0000 7f4bd5c06700 1 -- 172.21.15.36:0/2374016533 >> 172.21.15.36:0/2374016533 conn(0x7f4bd005c490 msgr2=0x7f4bd00b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:50.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.181+0000 7f4bd5c06700 1 -- 172.21.15.36:0/2374016533 shutdown_connections 2022-01-10T01:26:50.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.181+0000 7f4bd5c06700 1 -- 172.21.15.36:0/2374016533 wait complete. 2022-01-10T01:26:50.198 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:26:50.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.305+0000 7fb77b59e700 1 Processor -- start 2022-01-10T01:26:50.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.305+0000 7fb77b59e700 1 -- start start 2022-01-10T01:26:50.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77b59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb77c0af2c0 0x7fb77c0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77b59e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb77c0ad850 0x7fb77c0a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77b59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77c0afda0 con 0x7fb77c0ad320 2022-01-10T01:26:50.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77b59e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c05c610 con 0x7fb77c0ad850 2022-01-10T01:26:50.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77b59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77c140800 con 0x7fb77c0af2c0 2022-01-10T01:26:50.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77ad9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb77c0ad850 0x7fb77c0a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb779d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fb77c0ad320 0x7fb77c143150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33876/0 (socket says 172.21.15.36:33876) 2022-01-10T01:26:50.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb779d9b700 1 -- 172.21.15.36:0/2447225741 learned_addr learned my addr 172.21.15.36:0/2447225741 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:50.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77a59c700 1 --2- 172.21.15.36:0/2447225741 >> v2:172.21.15.59:3300/0 conn(0x7fb77c0af2c0 0x7fb77c0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77ad9d700 1 -- 172.21.15.36:0/2447225741 >> v2:172.21.15.59:3300/0 conn(0x7fb77c0af2c0 msgr2=0x7fb77c0af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:50.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77ad9d700 1 --2- 172.21.15.36:0/2447225741 >> v2:172.21.15.59:3300/0 conn(0x7fb77c0af2c0 0x7fb77c0af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77959a700 1 -- 172.21.15.36:0/2447225741 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028382124 0 0) 0x7fb77c0afda0 con 0x7fb77c0ad320 2022-01-10T01:26:50.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77ad9d700 1 -- 172.21.15.36:0/2447225741 >> v1:172.21.15.36:6789/0 conn(0x7fb77c0ad320 legacy=0x7fb77c143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77ad9d700 1 -- 172.21.15.36:0/2447225741 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c143860 con 0x7fb77c0ad850 2022-01-10T01:26:50.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77ad9d700 1 --2- 172.21.15.36:0/2447225741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb77c0ad850 0x7fb77c0a8cb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fb77c0ad770 tx=0x7fb7740091d0).ready entity=mon.0 client_cookie=9eeb1b323ee322a7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:50.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77959a700 1 -- 172.21.15.36:0/2447225741 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb77400f8a0 con 0x7fb77c0ad850 2022-01-10T01:26:50.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77959a700 1 -- 172.21.15.36:0/2447225741 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77400fa00 con 0x7fb77c0ad850 2022-01-10T01:26:50.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77959a700 1 -- 172.21.15.36:0/2447225741 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb77400fd60 con 0x7fb77c0ad850 2022-01-10T01:26:50.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77b59e700 1 -- 172.21.15.36:0/2447225741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb77c0ad850 msgr2=0x7fb77c0a8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77b59e700 1 --2- 172.21.15.36:0/2447225741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb77c0ad850 0x7fb77c0a8cb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fb77c0ad770 tx=0x7fb7740091d0).stop 2022-01-10T01:26:50.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77b59e700 1 -- 172.21.15.36:0/2447225741 shutdown_connections 2022-01-10T01:26:50.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77b59e700 1 --2- 172.21.15.36:0/2447225741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb77c0ad850 0x7fb77c0a8cb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77b59e700 1 --2- 172.21.15.36:0/2447225741 >> v2:172.21.15.59:3300/0 conn(0x7fb77c0af2c0 0x7fb77c0af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77b59e700 1 -- 172.21.15.36:0/2447225741 >> 172.21.15.36:0/2447225741 conn(0x7fb77c061140 msgr2=0x7fb77c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:50.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77b59e700 1 -- 172.21.15.36:0/2447225741 shutdown_connections 2022-01-10T01:26:50.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.309+0000 7fb77b59e700 1 -- 172.21.15.36:0/2447225741 wait complete. 2022-01-10T01:26:50.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.313+0000 7fb77b59e700 1 Processor -- start 2022-01-10T01:26:50.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.313+0000 7fb77b59e700 1 -- start start 2022-01-10T01:26:50.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.313+0000 7fb77b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb77c0ad320 0x7fb77c0b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.313+0000 7fb77b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb77c0ad850 0x7fb77c0b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.313+0000 7fb77b59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb77c0af2c0 0x7fb77c0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.313+0000 7fb77b59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0b50c0 con 0x7fb77c0ad320 2022-01-10T01:26:50.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.313+0000 7fb77b59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c0b3860 con 0x7fb77c0af2c0 2022-01-10T01:26:50.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.313+0000 7fb77b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77c14e6d0 con 0x7fb77c0ad850 2022-01-10T01:26:50.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.313+0000 7fb77a59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb77c0ad320 0x7fb77c0b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.313+0000 7fb77a59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb77c0ad320 0x7fb77c0b5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36086/0 (socket says 172.21.15.36:36086) 2022-01-10T01:26:50.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.313+0000 7fb77a59c700 1 -- 172.21.15.36:0/2578323398 learned_addr learned my addr 172.21.15.36:0/2578323398 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:50.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.313+0000 7fb779d9b700 1 --2- 172.21.15.36:0/2578323398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb77c0ad850 0x7fb77c0b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.313+0000 7fb77ad9d700 1 --2- 172.21.15.36:0/2578323398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb77c0af2c0 0x7fb77c0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.317+0000 7fb77a59c700 1 -- 172.21.15.36:0/2578323398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb77c0ad850 msgr2=0x7fb77c0b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.317+0000 7fb77a59c700 1 --2- 172.21.15.36:0/2578323398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb77c0ad850 0x7fb77c0b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.317+0000 7fb77a59c700 1 -- 172.21.15.36:0/2578323398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb77c0af2c0 msgr2=0x7fb77c0b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.317+0000 7fb77a59c700 1 --2- 172.21.15.36:0/2578323398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb77c0af2c0 0x7fb77c0b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.317+0000 7fb77a59c700 1 -- 172.21.15.36:0/2578323398 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb774009470 con 0x7fb77c0ad320 2022-01-10T01:26:50.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.317+0000 7fb77a59c700 1 --2- 172.21.15.36:0/2578323398 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb77c0ad320 0x7fb77c0b5c40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fb76c00c000 tx=0x7fb76c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:50.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.317+0000 7fb76b7fe700 1 -- 172.21.15.36:0/2578323398 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c011750 con 0x7fb77c0ad320 2022-01-10T01:26:50.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.317+0000 7fb76b7fe700 1 -- 172.21.15.36:0/2578323398 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c0118b0 con 0x7fb77c0ad320 2022-01-10T01:26:50.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.317+0000 7fb77b59e700 1 -- 172.21.15.36:0/2578323398 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77c1410e0 con 0x7fb77c0ad320 2022-01-10T01:26:50.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.317+0000 7fb76b7fe700 1 -- 172.21.15.36:0/2578323398 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb76c011c10 con 0x7fb77c0ad320 2022-01-10T01:26:50.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.317+0000 7fb77b59e700 1 -- 172.21.15.36:0/2578323398 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c141ae0 con 0x7fb77c0ad320 2022-01-10T01:26:50.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.317+0000 7fb77b59e700 1 -- 172.21.15.36:0/2578323398 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77c0b39f0 con 0x7fb77c0ad320 2022-01-10T01:26:50.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.317+0000 7fb76b7fe700 1 -- 172.21.15.36:0/2578323398 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb76c011d70 con 0x7fb77c0ad320 2022-01-10T01:26:50.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.317+0000 7fb76b7fe700 1 --2- 172.21.15.36:0/2578323398 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7580534d0 0x7fb758055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.321+0000 7fb779d9b700 1 --2- 172.21.15.36:0/2578323398 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7580534d0 0x7fb758055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.321+0000 7fb76b7fe700 1 -- 172.21.15.36:0/2578323398 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb76c06bf90 con 0x7fb77c0ad320 2022-01-10T01:26:50.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.321+0000 7fb779d9b700 1 --2- 172.21.15.36:0/2578323398 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7580534d0 0x7fb758055990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fb77000d000 tx=0x7fb770007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:50.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.321+0000 7fb76b7fe700 1 -- 172.21.15.36:0/2578323398 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb77c0b39f0 con 0x7fb77c0ad320 2022-01-10T01:26:50.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.449+0000 7fb77b59e700 1 -- 172.21.15.36:0/2578323398 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb77c0b39f0 con 0x7fb77c0ad320 2022-01-10T01:26:50.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.449+0000 7fb76b7fe700 1 -- 172.21.15.36:0/2578323398 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb77c0b39f0 con 0x7fb77c0ad320 2022-01-10T01:26:50.453 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:26:50.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.453+0000 7fb77b59e700 1 -- 172.21.15.36:0/2578323398 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7580534d0 msgr2=0x7fb758055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.453+0000 7fb77b59e700 1 --2- 172.21.15.36:0/2578323398 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7580534d0 0x7fb758055990 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fb77000d000 tx=0x7fb770007a00).stop 2022-01-10T01:26:50.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.453+0000 7fb77b59e700 1 -- 172.21.15.36:0/2578323398 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb77c0ad320 msgr2=0x7fb77c0b5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.453+0000 7fb77b59e700 1 --2- 172.21.15.36:0/2578323398 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb77c0ad320 0x7fb77c0b5c40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fb76c00c000 tx=0x7fb76c006df0).stop 2022-01-10T01:26:50.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.453+0000 7fb77b59e700 1 -- 172.21.15.36:0/2578323398 shutdown_connections 2022-01-10T01:26:50.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.453+0000 7fb77b59e700 1 --2- 172.21.15.36:0/2578323398 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7580534d0 0x7fb758055990 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.453+0000 7fb77b59e700 1 --2- 172.21.15.36:0/2578323398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb77c0af2c0 0x7fb77c0b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.453+0000 7fb77b59e700 1 --2- 172.21.15.36:0/2578323398 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb77c0ad850 0x7fb77c0b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.453+0000 7fb77b59e700 1 --2- 172.21.15.36:0/2578323398 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb77c0ad320 0x7fb77c0b5c40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.453+0000 7fb77b59e700 1 -- 172.21.15.36:0/2578323398 >> 172.21.15.36:0/2578323398 conn(0x7fb77c061140 msgr2=0x7fb77c143a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:50.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.453+0000 7fb77b59e700 1 -- 172.21.15.36:0/2578323398 shutdown_connections 2022-01-10T01:26:50.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.453+0000 7fb77b59e700 1 -- 172.21.15.36:0/2578323398 wait complete. 2022-01-10T01:26:50.471 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:26:50.472 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:26:50.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.569+0000 7f51e759e700 1 Processor -- start 2022-01-10T01:26:50.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.569+0000 7f51e759e700 1 -- start start 2022-01-10T01:26:50.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e759e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f51e80b76b0 0x7f51e8065590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e814aeb0 0x7f51e814b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e759e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e80b2a90 con 0x7f51e80b2ee0 2022-01-10T01:26:50.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e759e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e80616a0 con 0x7f51e80b76b0 2022-01-10T01:26:50.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e8065a80 con 0x7f51e814aeb0 2022-01-10T01:26:50.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51ddd9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f51e80b2ee0 0x7f51e8060f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33888/0 (socket says 172.21.15.36:33888) 2022-01-10T01:26:50.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51ddd9b700 1 -- 172.21.15.36:0/2877993391 learned_addr learned my addr 172.21.15.36:0/2877993391 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:26:50.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e659c700 1 --2- 172.21.15.36:0/2877993391 >> v2:172.21.15.36:3300/0 conn(0x7f51e80b76b0 0x7f51e8065590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e6d9d700 1 --2- 172.21.15.36:0/2877993391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e814aeb0 0x7f51e814b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e659c700 1 -- 172.21.15.36:0/2877993391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e814aeb0 msgr2=0x7f51e814b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:26:50.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e5d9b700 1 -- 172.21.15.36:0/2877993391 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338804337 0 0) 0x7f51e80b2a90 con 0x7f51e80b2ee0 2022-01-10T01:26:50.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e659c700 1 --2- 172.21.15.36:0/2877993391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e814aeb0 0x7f51e814b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e659c700 1 -- 172.21.15.36:0/2877993391 >> v1:172.21.15.36:6789/0 conn(0x7f51e80b2ee0 legacy=0x7f51e8060f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e659c700 1 -- 172.21.15.36:0/2877993391 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e80b7a90 con 0x7f51e80b76b0 2022-01-10T01:26:50.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e659c700 1 --2- 172.21.15.36:0/2877993391 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e80b76b0 0x7f51e8065590 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f51e80b33d0 tx=0x7f51d8006df0).ready entity=mon.0 client_cookie=ecbce9c51a3f26ea server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:50.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e5d9b700 1 -- 172.21.15.36:0/2877993391 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51d800d4a0 con 0x7f51e80b76b0 2022-01-10T01:26:50.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e5d9b700 1 -- 172.21.15.36:0/2877993391 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d8000e90 con 0x7f51e80b76b0 2022-01-10T01:26:50.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e5d9b700 1 -- 172.21.15.36:0/2877993391 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51d800d7f0 con 0x7f51e80b76b0 2022-01-10T01:26:50.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e759e700 1 -- 172.21.15.36:0/2877993391 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e80b76b0 msgr2=0x7f51e8065590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e759e700 1 --2- 172.21.15.36:0/2877993391 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e80b76b0 0x7f51e8065590 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f51e80b33d0 tx=0x7f51d8006df0).stop 2022-01-10T01:26:50.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e759e700 1 -- 172.21.15.36:0/2877993391 shutdown_connections 2022-01-10T01:26:50.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e759e700 1 --2- 172.21.15.36:0/2877993391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e814aeb0 0x7f51e814b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e759e700 1 --2- 172.21.15.36:0/2877993391 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e80b76b0 0x7f51e8065590 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e759e700 1 -- 172.21.15.36:0/2877993391 >> 172.21.15.36:0/2877993391 conn(0x7f51e805f6b0 msgr2=0x7f51e805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:50.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e759e700 1 -- 172.21.15.36:0/2877993391 shutdown_connections 2022-01-10T01:26:50.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.573+0000 7f51e759e700 1 -- 172.21.15.36:0/2877993391 wait complete. 2022-01-10T01:26:50.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e759e700 1 Processor -- start 2022-01-10T01:26:50.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e759e700 1 -- start start 2022-01-10T01:26:50.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e80b2ee0 0x7f51e80a00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e80b76b0 0x7f51e809f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e814aeb0 0x7f51e8157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e8157560 con 0x7f51e814aeb0 2022-01-10T01:26:50.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e809ed00 con 0x7f51e80b76b0 2022-01-10T01:26:50.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e809efa0 con 0x7f51e80b2ee0 2022-01-10T01:26:50.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e6d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e814aeb0 0x7f51e8157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e6d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e814aeb0 0x7f51e8157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36104/0 (socket says 172.21.15.36:36104) 2022-01-10T01:26:50.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e6d9d700 1 -- 172.21.15.36:0/2084177113 learned_addr learned my addr 172.21.15.36:0/2084177113 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:26:50.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e659c700 1 --2- 172.21.15.36:0/2084177113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e80b2ee0 0x7f51e80a00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51ddd9b700 1 --2- 172.21.15.36:0/2084177113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e80b76b0 0x7f51e809f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e6d9d700 1 -- 172.21.15.36:0/2084177113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e80b2ee0 msgr2=0x7f51e80a00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e6d9d700 1 --2- 172.21.15.36:0/2084177113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e80b2ee0 0x7f51e80a00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e6d9d700 1 -- 172.21.15.36:0/2084177113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e80b76b0 msgr2=0x7f51e809f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e6d9d700 1 --2- 172.21.15.36:0/2084177113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e80b76b0 0x7f51e809f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e6d9d700 1 -- 172.21.15.36:0/2084177113 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d800b120 con 0x7f51e814aeb0 2022-01-10T01:26:50.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e6d9d700 1 --2- 172.21.15.36:0/2084177113 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e814aeb0 0x7f51e8157b80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f51e0006e00 tx=0x7f51e00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:50.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51dffff700 1 -- 172.21.15.36:0/2084177113 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e0012600 con 0x7f51e814aeb0 2022-01-10T01:26:50.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51dffff700 1 -- 172.21.15.36:0/2084177113 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e0012760 con 0x7f51e814aeb0 2022-01-10T01:26:50.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e759e700 1 -- 172.21.15.36:0/2084177113 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e809f240 con 0x7f51e814aeb0 2022-01-10T01:26:50.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51dffff700 1 -- 172.21.15.36:0/2084177113 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51e0012ac0 con 0x7f51e814aeb0 2022-01-10T01:26:50.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.577+0000 7f51e759e700 1 -- 172.21.15.36:0/2084177113 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e8158070 con 0x7f51e814aeb0 2022-01-10T01:26:50.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.581+0000 7f51e759e700 1 -- 172.21.15.36:0/2084177113 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e80b27f0 con 0x7f51e814aeb0 2022-01-10T01:26:50.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.581+0000 7f51dffff700 1 -- 172.21.15.36:0/2084177113 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f51e0022070 con 0x7f51e814aeb0 2022-01-10T01:26:50.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.581+0000 7f51dffff700 1 --2- 172.21.15.36:0/2084177113 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51cc053560 0x7f51cc055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:26:50.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.581+0000 7f51dffff700 1 -- 172.21.15.36:0/2084177113 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f51e006c0c0 con 0x7f51e814aeb0 2022-01-10T01:26:50.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.581+0000 7f51e659c700 1 --2- 172.21.15.36:0/2084177113 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51cc053560 0x7f51cc055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:26:50.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.581+0000 7f51e659c700 1 --2- 172.21.15.36:0/2084177113 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51cc053560 0x7f51cc055a20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f51d801a000 tx=0x7f51d8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:26:50.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.589+0000 7f51dffff700 1 -- 172.21.15.36:0/2084177113 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f51e0042f40 con 0x7f51e814aeb0 2022-01-10T01:26:50.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.749+0000 7f51e759e700 1 -- 172.21.15.36:0/2084177113 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51e8057350 con 0x7f51e814aeb0 2022-01-10T01:26:50.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.749+0000 7f51dffff700 1 -- 172.21.15.36:0/2084177113 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f51e0016020 con 0x7f51e814aeb0 2022-01-10T01:26:50.754 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:26:50.754 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/986398854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":986398854},{"type":"v1","addr":"172.21.15.36:6835","nonce":986398854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/781575126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":781575126},{"type":"v1","addr":"172.21.15.36:6837","nonce":781575126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:26:18.598647+0000","modified":"2022-01-10T01:26:19.737578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3873482962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3873482962},{"type":"v1","addr":"172.21.15.59:6833","nonce":3873482962}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2022-01-10T01:26:50.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.753+0000 7f51e759e700 1 -- 172.21.15.36:0/2084177113 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51cc053560 msgr2=0x7f51cc055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.753+0000 7f51e759e700 1 --2- 172.21.15.36:0/2084177113 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51cc053560 0x7f51cc055a20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f51d801a000 tx=0x7f51d8014000).stop 2022-01-10T01:26:50.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.753+0000 7f51e759e700 1 -- 172.21.15.36:0/2084177113 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e814aeb0 msgr2=0x7f51e8157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:26:50.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.753+0000 7f51e759e700 1 --2- 172.21.15.36:0/2084177113 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e814aeb0 0x7f51e8157b80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f51e0006e00 tx=0x7f51e00091d0).stop 2022-01-10T01:26:50.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.753+0000 7f51e759e700 1 -- 172.21.15.36:0/2084177113 shutdown_connections 2022-01-10T01:26:50.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.753+0000 7f51e759e700 1 --2- 172.21.15.36:0/2084177113 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51cc053560 0x7f51cc055a20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.753+0000 7f51e759e700 1 --2- 172.21.15.36:0/2084177113 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51e814aeb0 0x7f51e8157b80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.753+0000 7f51e759e700 1 --2- 172.21.15.36:0/2084177113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51e80b76b0 0x7f51e809f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.753+0000 7f51e759e700 1 --2- 172.21.15.36:0/2084177113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51e80b2ee0 0x7f51e80a00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:26:50.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.753+0000 7f51e759e700 1 -- 172.21.15.36:0/2084177113 >> 172.21.15.36:0/2084177113 conn(0x7f51e805f6b0 msgr2=0x7f51e814c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:26:50.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.753+0000 7f51e759e700 1 -- 172.21.15.36:0/2084177113 shutdown_connections 2022-01-10T01:26:50.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:26:50.753+0000 7f51e759e700 1 -- 172.21.15.36:0/2084177113 wait complete. 2022-01-10T01:26:50.759 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 18 2022-01-10T01:26:51.070 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:26:18.598647+0000', 'modified': '2022-01-10T01:26:19.737578+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5239}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5239': {'gid': 5239, 'name': 'b', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/3873482962', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 3873482962}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 3873482962}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:26:51.070 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:26:51.071 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:26:51.190 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":5239,"want_state":"up:active","state":"up:active","rank_uptime":32.577802845000001,"mdsmap_epoch":18,"osdmap_epoch":46,"osdmap_epoch_barrier":46,"uptime":36.913031404999998} 2022-01-10T01:26:51.191 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 5239, "mdsmap_epoch": 18, "osdmap_epoch": 46, "osdmap_epoch_barrier": 46, "rank_uptime": 32.577802845, "state": "up:active", "uptime": 36.913031405, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:26:51.191 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:26:51.192 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:26:51.192 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:26:51.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:51.193 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:51.201 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:26:51.260 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:26:51.261 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:26:51.275 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:26:51.276 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:26:51.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:51.278 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:26:51.284 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:26:51.285 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:51.329 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:26:51.347 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:26:51.347 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:26:51.362 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:26:51.363 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:26:51.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:51.364 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:26:51.412 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:26:51.409+0000 7f3e52e67080 -1 init, newargv = 0x55e3b1e1a8c0 newargc=9 2022-01-10T01:26:51.412 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14242]: starting ceph client 2022-01-10T01:26:51.422 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14242]: starting fuse 2022-01-10T01:26:52.513 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:26:52.532 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:26:52.532 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:26:52.588 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:26:52.589 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:26:52.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:52.591 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:26:52.597 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:26:52.597 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:26:52.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:52.598 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:26:52.599 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:26:52.599 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:26:52.600 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:26:52.600 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:26:52.601 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:26:52.601 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:26:52.601 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:26:52.602 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:26:52.602 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:26:52.603 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:26:52.603 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:26:52.604 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:26:52.604 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:26:52.604 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:26:52.605 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:26:52.605 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:26:52.605 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:26:52.606 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:26:52.606 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:26:52.607 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:26:52.607 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:26:52.607 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:26:52.651 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.14242.asok 2022-01-10T01:26:52.655 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14242.asok 2022-01-10T01:26:52.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:52.656 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14242.asok status 2022-01-10T01:26:52.794 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:26:52.795 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:26:52.795 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:26:52.795 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:26:52.795 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:26:52.796 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:26:52.796 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:26:52.796 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "14242", 2022-01-10T01:26:52.796 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:26:52.797 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:26:52.797 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:26:52.797 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:26:52.797 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 5448, 2022-01-10T01:26:52.797 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:26:52.798 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:26:52.798 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:26:52.798 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 5448 2022-01-10T01:26:52.798 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:26:52.799 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:26:52.799 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:26:52.799 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:26:52.799 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 3907140540 2022-01-10T01:26:52.799 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:26:52.800 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:26:52.800 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:26:52.800 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:26:52.800 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:26:52.801 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 3907140540 2022-01-10T01:26:52.801 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:26:52.801 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.5448 172.21.15.139:0/3907140540", 2022-01-10T01:26:52.801 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/3907140540", 2022-01-10T01:26:52.801 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:26:52.802 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 18, 2022-01-10T01:26:52.802 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 46, 2022-01-10T01:26:52.802 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:26:52.802 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:26:52.803 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:26:52.803 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:26:52.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:52.805 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:26:52.805 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:26:52.812 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:26:52.813 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:26:52.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:26:52.814 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:27:01.037 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:27:01.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:27:01.043 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:27:01.046 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:27:31.218 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:27:31.222 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:27:31.225 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:27:31.228 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:27:39.279 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:27:39.279 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:27:39.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:27:39.321 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:27:39.342 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:27:39.363 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:27:39.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:27:39.365 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:27:39.365 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:27:39.394 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:27:39.395 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:27:39.396 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:27:39.396 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:27:39.396 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:27:39.411 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14242]: fuse finished with error 0 and tester_r 0 2022-01-10T01:27:39.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:27:39.414 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:27:39.414 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:27:39.421 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:27:39.422 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:27:39.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:27:39.472 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:27:39.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:27:39.480 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:27:39.480 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:27:39.488 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:27:39.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:27:39.489 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:27:39.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:27:39.490 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:27:39.539 INFO:teuthology.orchestra.run.smithi166.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:27:39.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:27:39.541 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:27:39.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 Processor -- start 2022-01-10T01:27:39.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 -- start start 2022-01-10T01:27:39.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c0b1db0 0x7f661c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:39.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f661c0a70c0 0x7f661c144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:39.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661c0b0350 con 0x7f661c1483a0 2022-01-10T01:27:39.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661c0a90c0 con 0x7f661c0a70c0 2022-01-10T01:27:39.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c0b05f0 con 0x7f661c0b1db0 2022-01-10T01:27:39.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f66219f1700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f661c1483a0 0x7f661c0b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33904/0 (socket says 172.21.15.36:33904) 2022-01-10T01:27:39.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f66219f1700 1 -- 172.21.15.36:0/165120111 learned_addr learned my addr 172.21.15.36:0/165120111 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:39.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f66229f3700 1 --2- 172.21.15.36:0/165120111 >> v2:172.21.15.36:3300/0 conn(0x7f661c0a70c0 0x7f661c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:39.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f66221f2700 1 --2- 172.21.15.36:0/165120111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c0b1db0 0x7f661c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:39.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f66211f0700 1 -- 172.21.15.36:0/165120111 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2534731002 0 0) 0x7f661c0b0350 con 0x7f661c1483a0 2022-01-10T01:27:39.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f66211f0700 1 -- 172.21.15.36:0/165120111 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6604003260 con 0x7f661c1483a0 2022-01-10T01:27:39.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f66229f3700 1 -- 172.21.15.36:0/165120111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c0b1db0 msgr2=0x7f661c0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:39.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f66229f3700 1 --2- 172.21.15.36:0/165120111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c0b1db0 0x7f661c0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:39.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f66229f3700 1 -- 172.21.15.36:0/165120111 >> v1:172.21.15.36:6789/0 conn(0x7f661c1483a0 legacy=0x7f661c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:39.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f66229f3700 1 -- 172.21.15.36:0/165120111 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c0b0890 con 0x7f661c0a70c0 2022-01-10T01:27:39.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f66229f3700 1 --2- 172.21.15.36:0/165120111 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f661c0a70c0 0x7f661c144720 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f66140032f0 tx=0x7f66140091d0).ready entity=mon.0 client_cookie=1184adb9f540b963 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:39.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f66211f0700 1 -- 172.21.15.36:0/165120111 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f661400b600 con 0x7f661c0a70c0 2022-01-10T01:27:39.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f66211f0700 1 -- 172.21.15.36:0/165120111 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661400b760 con 0x7f661c0a70c0 2022-01-10T01:27:39.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f66211f0700 1 -- 172.21.15.36:0/165120111 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f661400b8d0 con 0x7f661c0a70c0 2022-01-10T01:27:39.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 -- 172.21.15.36:0/165120111 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f661c0a70c0 msgr2=0x7f661c144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:39.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 --2- 172.21.15.36:0/165120111 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f661c0a70c0 0x7f661c144720 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f66140032f0 tx=0x7f66140091d0).stop 2022-01-10T01:27:39.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 -- 172.21.15.36:0/165120111 shutdown_connections 2022-01-10T01:27:39.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 --2- 172.21.15.36:0/165120111 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f661c0a70c0 0x7f661c144720 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:39.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 --2- 172.21.15.36:0/165120111 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c0b1db0 0x7f661c0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:39.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 -- 172.21.15.36:0/165120111 >> 172.21.15.36:0/165120111 conn(0x7f661c05f6b0 msgr2=0x7f661c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:39.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 -- 172.21.15.36:0/165120111 shutdown_connections 2022-01-10T01:27:39.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.649+0000 7f6624456700 1 -- 172.21.15.36:0/165120111 wait complete. 2022-01-10T01:27:39.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f6624456700 1 Processor -- start 2022-01-10T01:27:39.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f6624456700 1 -- start start 2022-01-10T01:27:39.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f6624456700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c0a70c0 0x7f661c0abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:39.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f6624456700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f661c0b1db0 0x7f661c13ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:39.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f6624456700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c1483a0 0x7f661c142190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:39.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f6624456700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c142830 con 0x7f661c0b1db0 2022-01-10T01:27:39.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f6624456700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c13f510 con 0x7f661c1483a0 2022-01-10T01:27:39.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f6624456700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c13f7b0 con 0x7f661c0a70c0 2022-01-10T01:27:39.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f66219f1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f661c0b1db0 0x7f661c13ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:39.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f66219f1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f661c0b1db0 0x7f661c13ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36114/0 (socket says 172.21.15.36:36114) 2022-01-10T01:27:39.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f66219f1700 1 -- 172.21.15.36:0/1970164485 learned_addr learned my addr 172.21.15.36:0/1970164485 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:39.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f66229f3700 1 --2- 172.21.15.36:0/1970164485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c1483a0 0x7f661c142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:39.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f66221f2700 1 --2- 172.21.15.36:0/1970164485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c0a70c0 0x7f661c0abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:39.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f66219f1700 1 -- 172.21.15.36:0/1970164485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c0a70c0 msgr2=0x7f661c0abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:39.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f66219f1700 1 --2- 172.21.15.36:0/1970164485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c0a70c0 0x7f661c0abe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:39.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f66219f1700 1 -- 172.21.15.36:0/1970164485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c1483a0 msgr2=0x7f661c142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:39.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f66219f1700 1 --2- 172.21.15.36:0/1970164485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c1483a0 0x7f661c142190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:39.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f66219f1700 1 -- 172.21.15.36:0/1970164485 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6614009470 con 0x7f661c0b1db0 2022-01-10T01:27:39.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f66219f1700 1 --2- 172.21.15.36:0/1970164485 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f661c0b1db0 0x7f661c13ef10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f660c001110 tx=0x7f660c007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:39.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f660b7fe700 1 -- 172.21.15.36:0/1970164485 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f660c0070d0 con 0x7f661c0b1db0 2022-01-10T01:27:39.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f660b7fe700 1 -- 172.21.15.36:0/1970164485 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660c007230 con 0x7f661c0b1db0 2022-01-10T01:27:39.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f6624456700 1 -- 172.21.15.36:0/1970164485 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661c13fa50 con 0x7f661c0b1db0 2022-01-10T01:27:39.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f660b7fe700 1 -- 172.21.15.36:0/1970164485 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f660c005610 con 0x7f661c0b1db0 2022-01-10T01:27:39.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.653+0000 7f6624456700 1 -- 172.21.15.36:0/1970164485 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661c0ab370 con 0x7f661c0b1db0 2022-01-10T01:27:39.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.657+0000 7f6624456700 1 -- 172.21.15.36:0/1970164485 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661c13fbe0 con 0x7f661c0b1db0 2022-01-10T01:27:39.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.657+0000 7f660b7fe700 1 -- 172.21.15.36:0/1970164485 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f660c010070 con 0x7f661c0b1db0 2022-01-10T01:27:39.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.657+0000 7f660b7fe700 1 --2- 172.21.15.36:0/1970164485 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f65fc0535f0 0x7f65fc055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:39.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.657+0000 7f660b7fe700 1 -- 172.21.15.36:0/1970164485 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f660c06b0a0 con 0x7f661c0b1db0 2022-01-10T01:27:39.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.657+0000 7f66221f2700 1 --2- 172.21.15.36:0/1970164485 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f65fc0535f0 0x7f65fc055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:39.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.657+0000 7f66221f2700 1 --2- 172.21.15.36:0/1970164485 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f65fc0535f0 0x7f65fc055ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f661800b000 tx=0x7f6618008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:39.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.665+0000 7f660b7fe700 1 -- 172.21.15.36:0/1970164485 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f660c0420b0 con 0x7f661c0b1db0 2022-01-10T01:27:39.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.789+0000 7f6624456700 1 -- 172.21.15.36:0/1970164485 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f661c057350 con 0x7f661c0b1db0 2022-01-10T01:27:39.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.793+0000 7f660b7fe700 1 -- 172.21.15.36:0/1970164485 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v46) v1 ==== 81+0+34037 (secure 0 0 0) 0x7f660c0456d0 con 0x7f661c0b1db0 2022-01-10T01:27:39.796 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:39.797 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:27:39.797 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 46, 2022-01-10T01:27:39.797 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:27:39.797 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:27:39.798 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:26:19.602372+0000", 2022-01-10T01:27:39.798 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:27:39.798 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:27:39.798 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:27:39.799 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:27:39.799 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:27:39.799 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:27:39.799 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:27:39.799 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:27:39.800 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:27:39.800 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:27:39.800 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:27:39.800 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:27:39.800 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:27:39.801 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:27:39.801 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:27:39.801 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 8, 2022-01-10T01:27:39.801 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:27:39.802 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:27:39.802 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:27:39.802 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:27:39.802 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:27:39.802 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.803 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:27:39.803 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:27:39.803 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:27:39.803 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:27:39.803 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:27:39.804 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:27:39.804 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:27:39.804 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:27:39.804 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:27:39.805 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:27:39.805 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:27:39.805 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:27:39.805 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:27:39.805 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:27:39.806 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:27:39.806 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:27:39.806 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:27:39.806 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:27:39.807 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:27:39.807 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:27:39.807 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:27:39.807 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:27:39.807 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:27:39.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.808 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:27:39.808 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:27:39.808 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:27:39.808 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:27:39.809 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:27:39.809 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:27:39.809 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:27:39.809 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:27:39.809 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:27:39.810 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:27:39.810 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:27:39.810 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:27:39.810 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:27:39.811 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:27:39.811 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:27:39.811 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:27:39.811 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:27:39.812 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:27:39.812 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:27:39.812 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:27:39.812 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:27:39.812 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:27:39.813 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:27:39.813 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:27:39.813 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:27:39.813 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:27:39.814 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:27:39.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.814 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:27:39.814 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:27:39.814 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:27:39.815 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:27:39.815 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:27:39.815 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:27:39.815 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:27:39.816 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:27:39.816 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:27:39.816 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:27:39.816 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:27:39.817 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:27:39.817 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:27:39.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.817 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:27:39.817 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:27:39.818 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.818 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:27:39.819 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:27:39.819 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:27:39.819 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:27:39.819 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:27:39.819 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:27:39.820 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:27:39.820 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:27:39.820 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:27:39.820 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:27:39.821 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:27:39.821 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:27:39.821 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:27:39.821 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:27:39.822 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:27:39.822 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:27:39.822 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:27:39.822 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:27:39.822 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:27:39.823 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:27:39.823 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:27:39.823 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:27:39.823 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:27:39.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.824 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:27:39.824 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:27:39.824 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:27:39.825 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:27:39.825 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:27:39.825 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:27:39.825 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:27:39.826 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:27:39.826 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:27:39.826 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:27:39.826 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:27:39.827 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:27:39.827 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:27:39.827 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:27:39.827 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:27:39.827 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:27:39.828 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:27:39.828 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:27:39.829 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:27:39.829 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:27:39.829 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:27:39.829 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:27:39.829 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:27:39.830 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:27:39.830 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:27:39.830 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:27:39.830 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:27:39.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.831 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:27:39.831 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:27:39.831 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:27:39.831 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:27:39.832 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:27:39.832 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:27:39.832 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:27:39.832 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:27:39.832 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:27:39.833 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:27:39.833 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:27:39.833 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:27:39.833 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:27:39.833 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:27:39.834 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.834 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 7, 2022-01-10T01:27:39.835 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_metadata", 2022-01-10T01:27:39.835 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:26:17.063945+0000", 2022-01-10T01:27:39.835 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:27:39.835 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:27:39.835 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:27:39.836 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:27:39.836 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:27:39.836 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:27:39.836 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:27:39.837 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:27:39.837 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:27:39.837 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:27:39.837 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:27:39.837 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:27:39.838 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:27:39.838 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:27:39.838 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:27:39.838 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:27:39.839 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:27:39.839 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:27:39.839 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:27:39.839 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:27:39.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.840 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "46", 2022-01-10T01:27:39.840 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:27:39.840 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:27:39.840 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:27:39.841 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:27:39.841 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:27:39.841 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:27:39.841 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:27:39.842 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:27:39.842 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:27:39.842 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:27:39.842 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:27:39.843 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:27:39.843 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:27:39.843 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:27:39.843 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:27:39.843 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:27:39.844 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:27:39.844 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:27:39.844 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:27:39.844 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:27:39.845 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:27:39.845 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:27:39.845 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:27:39.845 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:27:39.846 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:27:39.846 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:27:39.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.846 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:27:39.846 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:27:39.847 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:27:39.847 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:27:39.847 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:27:39.847 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:27:39.848 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:27:39.848 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:27:39.848 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:27:39.848 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:27:39.849 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:27:39.849 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:27:39.849 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_bias": 4, 2022-01-10T01:27:39.849 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 16, 2022-01-10T01:27:39.849 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_priority": 5 2022-01-10T01:27:39.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.850 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:27:39.850 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:27:39.850 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": "cephfs" 2022-01-10T01:27:39.850 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.851 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.851 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.851 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 8, 2022-01-10T01:27:39.852 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_data", 2022-01-10T01:27:39.852 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:26:18.074904+0000", 2022-01-10T01:27:39.852 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:27:39.852 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:27:39.853 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:27:39.853 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:27:39.853 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:27:39.853 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:27:39.853 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:27:39.854 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:27:39.854 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:27:39.854 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:27:39.854 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:27:39.855 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:27:39.855 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:27:39.855 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:27:39.855 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:27:39.856 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:27:39.856 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:27:39.856 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:27:39.856 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:27:39.856 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:27:39.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.857 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "46", 2022-01-10T01:27:39.857 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:27:39.857 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:27:39.858 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:27:39.858 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:27:39.858 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:27:39.858 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:27:39.859 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:27:39.859 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:27:39.859 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:27:39.859 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:27:39.859 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:27:39.860 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:27:39.860 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:27:39.860 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:27:39.860 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:27:39.860 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:27:39.861 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:27:39.861 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:27:39.861 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:27:39.861 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:27:39.862 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:27:39.862 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:27:39.862 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:27:39.862 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:27:39.862 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:27:39.863 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:27:39.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.863 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:27:39.863 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:27:39.863 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:27:39.864 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:27:39.864 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:27:39.864 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:27:39.864 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:27:39.865 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:27:39.865 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:27:39.865 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:27:39.865 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:27:39.865 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:27:39.866 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:27:39.866 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:27:39.866 INFO:teuthology.orchestra.run.smithi036.stdout: "data": "cephfs" 2022-01-10T01:27:39.866 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.867 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.867 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.867 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:27:39.867 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:27:39.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.868 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:27:39.868 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:27:39.868 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:39.868 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:39.869 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:39.869 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:39.869 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:39.869 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:39.870 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:39.870 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 33, 2022-01-10T01:27:39.870 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:39.870 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:39.870 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:39.871 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.871 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.871 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:27:39.872 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:39.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.872 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.873 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:27:39.873 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:39.873 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.873 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.874 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:39.874 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.874 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.875 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:27:39.875 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:39.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.876 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.876 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:27:39.876 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:39.876 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.876 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.877 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:39.877 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.877 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.878 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.878 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:27:39.878 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:39.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.879 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.879 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:27:39.879 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:39.880 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.880 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.880 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:39.880 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.881 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.881 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:27:39.881 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:39.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.882 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.882 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:27:39.882 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:39.883 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.883 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.883 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:27:39.884 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:27:39.884 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:27:39.884 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:27:39.884 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:39.885 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:39.885 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:39.885 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.886 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:27:39.886 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:27:39.886 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:39.886 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:39.887 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:39.887 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:39.887 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:39.887 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:39.888 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:39.888 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 43, 2022-01-10T01:27:39.888 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:39.888 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:39.888 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:39.889 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.889 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.889 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:27:39.889 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:39.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.890 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.890 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:27:39.891 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:39.891 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.891 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.891 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:39.892 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.892 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.892 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:27:39.893 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:39.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.893 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.893 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:27:39.894 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:39.894 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.894 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.895 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:39.895 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.895 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.895 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:27:39.896 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:39.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.896 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.897 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:27:39.897 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:39.897 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.897 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.898 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.898 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:39.898 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.898 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.899 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:27:39.899 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:39.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.900 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.900 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:27:39.900 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:39.900 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.900 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.901 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:27:39.901 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:27:39.901 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:27:39.902 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:27:39.902 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:39.902 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:39.902 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:39.902 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.903 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.903 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:27:39.903 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:27:39.904 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:39.904 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:39.904 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:39.904 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:39.905 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:39.905 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:39.905 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:39.905 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 43, 2022-01-10T01:27:39.905 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:39.906 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:39.906 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:39.906 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.907 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.907 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:27:39.907 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:39.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.908 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.908 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:27:39.908 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:39.908 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.909 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.909 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:39.909 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.910 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.910 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:27:39.910 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:39.910 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.911 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.911 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:27:39.911 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:39.912 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.912 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.912 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:39.913 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.913 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.913 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:27:39.913 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:39.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.914 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.914 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:27:39.915 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:39.915 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.915 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.916 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:39.916 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.916 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.916 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:27:39.917 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:39.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.917 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.918 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:27:39.918 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:39.918 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.918 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.919 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:27:39.919 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:27:39.919 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:27:39.919 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:27:39.920 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:39.920 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:39.920 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:39.920 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.921 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:27:39.921 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:27:39.922 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:39.922 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:39.922 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:39.922 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:39.922 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:39.923 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:39.923 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:39.923 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 42, 2022-01-10T01:27:39.923 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:39.924 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:39.924 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:39.924 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.924 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.925 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:27:39.925 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:39.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.926 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.926 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:27:39.926 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:39.926 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.927 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.927 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:39.927 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.928 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.928 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:27:39.928 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:39.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.929 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.929 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:27:39.929 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:39.929 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.930 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.930 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:39.930 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.931 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.931 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.931 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:27:39.931 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:39.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.932 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.932 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:27:39.932 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:39.933 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.933 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.933 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:39.934 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.934 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.934 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:27:39.934 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:39.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.935 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.935 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:27:39.936 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:39.936 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.936 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.937 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:27:39.937 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:27:39.937 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:27:39.937 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:27:39.937 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:39.938 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:39.938 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:39.938 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.939 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:27:39.939 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:27:39.939 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:39.940 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:39.940 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:39.940 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:39.940 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:39.940 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:39.941 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:39.941 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 42, 2022-01-10T01:27:39.941 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:39.941 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:39.941 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:39.942 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.942 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.942 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.942 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:27:39.943 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:39.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.943 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.944 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:27:39.944 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:39.944 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.944 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.945 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:39.945 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.946 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.946 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:27:39.946 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:39.946 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.947 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.947 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:27:39.947 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:39.947 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.948 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.948 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.948 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:39.948 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.949 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.949 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:27:39.949 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:39.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.950 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.950 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:27:39.950 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:39.951 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.951 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.951 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:39.951 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.952 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.952 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:27:39.952 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:39.953 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.953 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.953 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:27:39.954 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:39.954 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.954 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.954 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:27:39.955 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:27:39.955 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:27:39.955 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:27:39.955 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:39.956 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:39.956 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:39.956 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.957 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:27:39.957 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:27:39.957 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:39.957 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:39.958 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:39.958 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:39.958 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:39.958 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:39.959 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:39.959 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 43, 2022-01-10T01:27:39.959 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:39.959 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:39.960 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:39.960 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.960 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.960 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:27:39.961 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:39.961 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.961 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.961 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.962 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:27:39.962 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:39.962 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.962 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.963 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:39.963 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.963 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.963 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.964 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:27:39.964 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:39.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.964 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.965 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:27:39.965 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:39.965 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.965 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.966 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:39.966 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.966 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.967 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:27:39.967 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:39.967 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.968 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.968 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:27:39.968 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:39.968 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.969 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.969 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:39.969 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.970 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.970 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:27:39.970 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:39.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.971 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.971 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:27:39.972 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:39.972 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.972 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.972 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:27:39.973 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:27:39.973 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:27:39.973 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:27:39.973 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:39.974 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:39.974 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:39.974 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.975 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:27:39.975 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:27:39.975 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:39.976 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:39.976 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:39.976 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:39.976 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:39.977 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:39.977 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:39.977 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 43, 2022-01-10T01:27:39.977 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:39.978 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:39.978 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:39.978 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.978 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.979 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:27:39.979 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:39.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.980 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.980 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:27:39.980 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:39.980 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.981 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.981 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.981 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:39.981 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.982 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.982 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:27:39.982 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:39.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.983 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.983 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.983 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:27:39.983 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:39.983 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.984 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.984 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.984 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:39.984 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.985 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.985 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:27:39.985 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:39.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.986 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.986 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:27:39.986 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:39.987 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.987 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.987 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:39.988 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.988 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.988 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:27:39.989 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:39.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.989 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.989 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:27:39.990 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:39.990 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.990 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.990 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:27:39.991 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:27:39.991 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:27:39.991 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:27:39.991 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:39.992 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:39.992 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:39.992 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.993 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:27:39.993 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:27:39.993 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:39.993 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:39.994 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:39.994 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:39.994 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:39.994 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:39.995 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:39.995 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 43, 2022-01-10T01:27:39.995 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:39.995 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:39.995 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:39.996 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.996 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:39.996 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:27:39.997 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:39.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.997 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:39.997 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:27:39.998 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:39.998 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:39.998 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:39.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:39.999 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:39.999 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:39.999 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:39.999 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:40.000 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:27:40.000 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:40.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:40.000 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:40.001 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:27:40.001 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:40.001 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:40.001 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:40.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.002 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:40.002 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:40.002 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:40.003 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:40.003 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:27:40.003 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:40.003 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:40.004 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:40.004 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:27:40.004 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:40.004 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:40.005 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:40.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.005 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:40.005 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:40.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:40.006 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:40.006 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:27:40.006 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:40.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:40.007 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:40.007 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:27:40.007 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:40.008 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:40.008 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:40.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.008 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:27:40.009 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:27:40.009 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:27:40.009 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:27:40.009 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:40.010 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:40.010 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:40.010 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:40.010 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:40.010 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:27:40.011 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:27:40.011 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:40.011 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:27:40.011 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:40.012 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:40.012 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:40.012 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:40.012 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:40.012 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:27:40.013 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:40.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:40.013 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:27:40.014 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:40.014 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:40.014 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:40.014 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:40.015 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:40.015 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:27:40.015 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:40.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.015 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:40.016 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:27:40.016 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:40.016 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:40.016 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:40.017 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:40.017 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:40.017 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:27:40.017 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:40.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.018 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:40.018 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:27:40.018 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:40.018 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:40.019 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:40.019 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:40.019 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:40.019 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:27:40.020 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:40.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:40.020 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:27:40.020 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:40.021 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:40.021 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:40.021 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:40.021 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:40.022 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:27:40.022 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:40.022 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:40.023 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:27:40.023 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:40.023 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:40.023 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:40.023 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:40.024 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:40.024 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:27:40.024 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:40.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.025 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:40.025 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:27:40.025 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:40.025 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:40.025 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:40.026 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:40.026 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:40.026 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:27:40.026 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:40.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.027 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:40.027 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:27:40.027 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:40.028 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:40.028 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:40.028 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:40.028 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:40.028 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:27:40.029 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:40.029 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:40.029 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:27:40.029 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:27:40.030 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:27:40.030 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:27:40.030 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:27:40.030 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2022-01-10T01:27:40.031 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:27:40.031 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:27:40.031 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:27:40.031 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:27:40.031 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:27:40.032 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:27:40.032 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:27:40.032 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:27:40.032 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:27:40.033 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:27:40.033 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:27:40.033 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:27:40.033 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.034 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:27:40.034 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:27:40.034 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:27:40.034 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:27:40.034 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:27:40.035 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:27:40.035 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:27:40.035 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:40.035 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:40.036 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:27:40.036 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:27:40.036 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:27:40.036 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:27:40.036 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:27:40.037 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:27:40.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.793+0000 7f6624456700 1 -- 172.21.15.36:0/1970164485 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f65fc0535f0 msgr2=0x7f65fc055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:40.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.793+0000 7f6624456700 1 --2- 172.21.15.36:0/1970164485 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f65fc0535f0 0x7f65fc055ab0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f661800b000 tx=0x7f6618008040).stop 2022-01-10T01:27:40.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.793+0000 7f6624456700 1 -- 172.21.15.36:0/1970164485 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f661c0b1db0 msgr2=0x7f661c13ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:40.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.793+0000 7f6624456700 1 --2- 172.21.15.36:0/1970164485 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f661c0b1db0 0x7f661c13ef10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f660c001110 tx=0x7f660c007aa0).stop 2022-01-10T01:27:40.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.793+0000 7f6624456700 1 -- 172.21.15.36:0/1970164485 shutdown_connections 2022-01-10T01:27:40.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.793+0000 7f6624456700 1 --2- 172.21.15.36:0/1970164485 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f65fc0535f0 0x7f65fc055ab0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.793+0000 7f6624456700 1 --2- 172.21.15.36:0/1970164485 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c1483a0 0x7f661c142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.793+0000 7f6624456700 1 --2- 172.21.15.36:0/1970164485 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f661c0b1db0 0x7f661c13ef10 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.793+0000 7f6624456700 1 --2- 172.21.15.36:0/1970164485 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f661c0a70c0 0x7f661c0abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.793+0000 7f6624456700 1 -- 172.21.15.36:0/1970164485 >> 172.21.15.36:0/1970164485 conn(0x7f661c05f6b0 msgr2=0x7f661c0af770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:40.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.793+0000 7f6624456700 1 -- 172.21.15.36:0/1970164485 shutdown_connections 2022-01-10T01:27:40.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:39.793+0000 7f6624456700 1 -- 172.21.15.36:0/1970164485 wait complete. 2022-01-10T01:27:40.043 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:27:40.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dc1817700 1 Processor -- start 2022-01-10T01:27:40.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dc1817700 1 -- start start 2022-01-10T01:27:40.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dc1817700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4dbc0b1db0 0x7f4dbc0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:40.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dc1817700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4dbc1483a0 0x7f4dbc0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:40.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dc1817700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc0b0350 con 0x7f4dbc0a70c0 2022-01-10T01:27:40.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dc1817700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc0a90c0 con 0x7f4dbc1483a0 2022-01-10T01:27:40.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dc1817700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc0b05f0 con 0x7f4dbc0b1db0 2022-01-10T01:27:40.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dba7fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4dbc1483a0 0x7f4dbc0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:40.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dba7fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4dbc1483a0 0x7f4dbc0b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36124/0 (socket says 172.21.15.36:36124) 2022-01-10T01:27:40.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dba7fc700 1 -- 172.21.15.36:0/1098891540 learned_addr learned my addr 172.21.15.36:0/1098891540 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:40.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dbaffd700 1 --2- 172.21.15.36:0/1098891540 >> v2:172.21.15.59:3300/0 conn(0x7f4dbc0b1db0 0x7f4dbc0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:40.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dba7fc700 1 -- 172.21.15.36:0/1098891540 >> v2:172.21.15.59:3300/0 conn(0x7f4dbc0b1db0 msgr2=0x7f4dbc0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:40.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dba7fc700 1 --2- 172.21.15.36:0/1098891540 >> v2:172.21.15.59:3300/0 conn(0x7f4dbc0b1db0 0x7f4dbc0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dba7fc700 1 -- 172.21.15.36:0/1098891540 >> v1:172.21.15.59:6789/0 conn(0x7f4dbc0a70c0 legacy=0x7f4dbc144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:40.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dba7fc700 1 -- 172.21.15.36:0/1098891540 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc0b0890 con 0x7f4dbc1483a0 2022-01-10T01:27:40.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dba7fc700 1 --2- 172.21.15.36:0/1098891540 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dbc1483a0 0x7f4dbc0b2190 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f4dbc147730 tx=0x7f4dac009290).ready entity=mon.0 client_cookie=d7fbc43544318600 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:40.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4db9ffb700 1 -- 172.21.15.36:0/1098891540 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dac00b860 con 0x7f4dbc1483a0 2022-01-10T01:27:40.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4db9ffb700 1 -- 172.21.15.36:0/1098891540 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac00b9c0 con 0x7f4dbc1483a0 2022-01-10T01:27:40.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4db9ffb700 1 -- 172.21.15.36:0/1098891540 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dac00bb30 con 0x7f4dbc1483a0 2022-01-10T01:27:40.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dc1817700 1 -- 172.21.15.36:0/1098891540 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dbc1483a0 msgr2=0x7f4dbc0b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:40.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.149+0000 7f4dc1817700 1 --2- 172.21.15.36:0/1098891540 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dbc1483a0 0x7f4dbc0b2190 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f4dbc147730 tx=0x7f4dac009290).stop 2022-01-10T01:27:40.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dc1817700 1 -- 172.21.15.36:0/1098891540 shutdown_connections 2022-01-10T01:27:40.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dc1817700 1 --2- 172.21.15.36:0/1098891540 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dbc1483a0 0x7f4dbc0b2190 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dc1817700 1 --2- 172.21.15.36:0/1098891540 >> v2:172.21.15.59:3300/0 conn(0x7f4dbc0b1db0 0x7f4dbc0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dc1817700 1 -- 172.21.15.36:0/1098891540 >> 172.21.15.36:0/1098891540 conn(0x7f4dbc05f6b0 msgr2=0x7f4dbc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:40.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dc1817700 1 -- 172.21.15.36:0/1098891540 shutdown_connections 2022-01-10T01:27:40.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dc1817700 1 -- 172.21.15.36:0/1098891540 wait complete. 2022-01-10T01:27:40.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dc1817700 1 Processor -- start 2022-01-10T01:27:40.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dc1817700 1 -- start start 2022-01-10T01:27:40.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dc1817700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dbc0a70c0 0x7f4dbc144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:40.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dc1817700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dbc0b1db0 0x7f4dbc14b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:40.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dc1817700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dbc1483a0 0x7f4dbc156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:40.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dc1817700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0a9440 con 0x7f4dbc0a70c0 2022-01-10T01:27:40.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dc1817700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc156a40 con 0x7f4dbc1483a0 2022-01-10T01:27:40.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dc1817700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc063660 con 0x7f4dbc0b1db0 2022-01-10T01:27:40.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dbaffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dbc0a70c0 0x7f4dbc144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:40.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dbaffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dbc0a70c0 0x7f4dbc144b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36128/0 (socket says 172.21.15.36:36128) 2022-01-10T01:27:40.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dbaffd700 1 -- 172.21.15.36:0/3351409654 learned_addr learned my addr 172.21.15.36:0/3351409654 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:40.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dba7fc700 1 --2- 172.21.15.36:0/3351409654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dbc0b1db0 0x7f4dbc14b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:40.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dbb7fe700 1 --2- 172.21.15.36:0/3351409654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dbc1483a0 0x7f4dbc156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:40.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dbaffd700 1 -- 172.21.15.36:0/3351409654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dbc0b1db0 msgr2=0x7f4dbc14b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:40.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dbaffd700 1 --2- 172.21.15.36:0/3351409654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dbc0b1db0 0x7f4dbc14b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dbaffd700 1 -- 172.21.15.36:0/3351409654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dbc1483a0 msgr2=0x7f4dbc156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:40.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dbaffd700 1 --2- 172.21.15.36:0/3351409654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dbc1483a0 0x7f4dbc156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.153+0000 7f4dbaffd700 1 -- 172.21.15.36:0/3351409654 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac009530 con 0x7f4dbc0a70c0 2022-01-10T01:27:40.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.157+0000 7f4dbaffd700 1 --2- 172.21.15.36:0/3351409654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dbc0a70c0 0x7f4dbc144b70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f4db000c000 tx=0x7f4db0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:40.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.157+0000 7f4dabfff700 1 -- 172.21.15.36:0/3351409654 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4db0010780 con 0x7f4dbc0a70c0 2022-01-10T01:27:40.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.157+0000 7f4dabfff700 1 -- 172.21.15.36:0/3351409654 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db00108e0 con 0x7f4dbc0a70c0 2022-01-10T01:27:40.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.157+0000 7f4dc1817700 1 -- 172.21.15.36:0/3351409654 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc063900 con 0x7f4dbc0a70c0 2022-01-10T01:27:40.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.157+0000 7f4dabfff700 1 -- 172.21.15.36:0/3351409654 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4db0010c40 con 0x7f4dbc0a70c0 2022-01-10T01:27:40.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.157+0000 7f4dc1817700 1 -- 172.21.15.36:0/3351409654 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc0632e0 con 0x7f4dbc0a70c0 2022-01-10T01:27:40.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.157+0000 7f4dc1817700 1 -- 172.21.15.36:0/3351409654 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dbc063da0 con 0x7f4dbc0a70c0 2022-01-10T01:27:40.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.157+0000 7f4dabfff700 1 -- 172.21.15.36:0/3351409654 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4db001c460 con 0x7f4dbc0a70c0 2022-01-10T01:27:40.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.157+0000 7f4dabfff700 1 --2- 172.21.15.36:0/3351409654 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4d980535f0 0x7f4d98055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:40.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.157+0000 7f4dabfff700 1 -- 172.21.15.36:0/3351409654 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4db006be30 con 0x7f4dbc0a70c0 2022-01-10T01:27:40.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.157+0000 7f4dba7fc700 1 --2- 172.21.15.36:0/3351409654 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4d980535f0 0x7f4d98055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:40.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.161+0000 7f4dba7fc700 1 --2- 172.21.15.36:0/3351409654 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4d980535f0 0x7f4d98055ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f4dac01b000 tx=0x7f4dac016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:40.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.165+0000 7f4dabfff700 1 -- 172.21.15.36:0/3351409654 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4db0042de0 con 0x7f4dbc0a70c0 2022-01-10T01:27:40.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.329+0000 7f4dc1817700 1 -- 172.21.15.36:0/3351409654 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dbc0b0b30 con 0x7f4dbc0a70c0 2022-01-10T01:27:40.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.329+0000 7f4dabfff700 1 -- 172.21.15.36:0/3351409654 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+2485 (secure 0 0 0) 0x7f4db0046400 con 0x7f4dbc0a70c0 2022-01-10T01:27:40.335 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:40.335 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":18,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/986398854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":986398854},{"type":"v1","addr":"172.21.15.36:6835","nonce":986398854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/781575126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":781575126},{"type":"v1","addr":"172.21.15.36:6837","nonce":781575126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:26:18.598647+0000","modified":"2022-01-10T01:26:19.737578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3873482962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3873482962},{"type":"v1","addr":"172.21.15.59:6833","nonce":3873482962}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2022-01-10T01:27:40.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.333+0000 7f4dc1817700 1 -- 172.21.15.36:0/3351409654 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4d980535f0 msgr2=0x7f4d98055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:40.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.333+0000 7f4dc1817700 1 --2- 172.21.15.36:0/3351409654 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4d980535f0 0x7f4d98055ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f4dac01b000 tx=0x7f4dac016000).stop 2022-01-10T01:27:40.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.333+0000 7f4dc1817700 1 -- 172.21.15.36:0/3351409654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dbc0a70c0 msgr2=0x7f4dbc144b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:40.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.333+0000 7f4dc1817700 1 --2- 172.21.15.36:0/3351409654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dbc0a70c0 0x7f4dbc144b70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f4db000c000 tx=0x7f4db0006df0).stop 2022-01-10T01:27:40.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.333+0000 7f4dc1817700 1 -- 172.21.15.36:0/3351409654 shutdown_connections 2022-01-10T01:27:40.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.333+0000 7f4dc1817700 1 --2- 172.21.15.36:0/3351409654 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4d980535f0 0x7f4d98055ab0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.333+0000 7f4dc1817700 1 --2- 172.21.15.36:0/3351409654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dbc1483a0 0x7f4dbc156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.333+0000 7f4dc1817700 1 --2- 172.21.15.36:0/3351409654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dbc0b1db0 0x7f4dbc14b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.333+0000 7f4dc1817700 1 --2- 172.21.15.36:0/3351409654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dbc0a70c0 0x7f4dbc144b70 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.333+0000 7f4dc1817700 1 -- 172.21.15.36:0/3351409654 >> 172.21.15.36:0/3351409654 conn(0x7f4dbc05f6b0 msgr2=0x7f4dbc143e50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:40.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.333+0000 7f4dc1817700 1 -- 172.21.15.36:0/3351409654 shutdown_connections 2022-01-10T01:27:40.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.333+0000 7f4dc1817700 1 -- 172.21.15.36:0/3351409654 wait complete. 2022-01-10T01:27:40.340 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 18 2022-01-10T01:27:40.347 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2022-01-10T01:27:40.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.449+0000 7f0cc66ab700 1 Processor -- start 2022-01-10T01:27:40.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.449+0000 7f0cc66ab700 1 -- start start 2022-01-10T01:27:40.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.449+0000 7f0cc66ab700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0cc00b1db0 0x7f0cc00b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:40.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.449+0000 7f0cc66ab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cc01483a0 0x7f0cc00b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:40.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cc66ab700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc00b0350 con 0x7f0cc00a70c0 2022-01-10T01:27:40.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cc66ab700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc00a90c0 con 0x7f0cc00b1db0 2022-01-10T01:27:40.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cc66ab700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc00b05f0 con 0x7f0cc01483a0 2022-01-10T01:27:40.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0cc00b1db0 0x7f0cc00b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:40.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0cc00b1db0 0x7f0cc00b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36138/0 (socket says 172.21.15.36:36138) 2022-01-10T01:27:40.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbffff700 1 -- 172.21.15.36:0/3289835671 learned_addr learned my addr 172.21.15.36:0/3289835671 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:40.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbf7fe700 1 --2- 172.21.15.36:0/3289835671 >> v2:172.21.15.59:3300/0 conn(0x7f0cc01483a0 0x7f0cc00b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:40.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbeffd700 1 -- 172.21.15.36:0/3289835671 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023670793 0 0) 0x7f0cc00b0350 con 0x7f0cc00a70c0 2022-01-10T01:27:40.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbeffd700 1 -- 172.21.15.36:0/3289835671 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cac003260 con 0x7f0cc00a70c0 2022-01-10T01:27:40.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbf7fe700 1 -- 172.21.15.36:0/3289835671 >> v2:172.21.15.36:3300/0 conn(0x7f0cc00b1db0 msgr2=0x7f0cc00b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:40.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbf7fe700 1 --2- 172.21.15.36:0/3289835671 >> v2:172.21.15.36:3300/0 conn(0x7f0cc00b1db0 0x7f0cc00b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbf7fe700 1 -- 172.21.15.36:0/3289835671 >> v1:172.21.15.59:6789/0 conn(0x7f0cc00a70c0 legacy=0x7f0cc0144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:40.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbf7fe700 1 -- 172.21.15.36:0/3289835671 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00b0890 con 0x7f0cc01483a0 2022-01-10T01:27:40.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbffff700 1 --2- 172.21.15.36:0/3289835671 >> v2:172.21.15.36:3300/0 conn(0x7f0cc00b1db0 0x7f0cc00b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:27:40.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbf7fe700 1 --2- 172.21.15.36:0/3289835671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc01483a0 0x7f0cc00b2190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f0cc0147730 tx=0x7f0cb0006df0).ready entity=mon.1 client_cookie=f9bf4a25944071a7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:40.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbeffd700 1 -- 172.21.15.36:0/3289835671 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cb000d4f0 con 0x7f0cc01483a0 2022-01-10T01:27:40.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbeffd700 1 -- 172.21.15.36:0/3289835671 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb0000e90 con 0x7f0cc01483a0 2022-01-10T01:27:40.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cbeffd700 1 -- 172.21.15.36:0/3289835671 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cb000d840 con 0x7f0cc01483a0 2022-01-10T01:27:40.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3289835671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc01483a0 msgr2=0x7f0cc00b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:40.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cc66ab700 1 --2- 172.21.15.36:0/3289835671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc01483a0 0x7f0cc00b2190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f0cc0147730 tx=0x7f0cb0006df0).stop 2022-01-10T01:27:40.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3289835671 shutdown_connections 2022-01-10T01:27:40.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cc66ab700 1 --2- 172.21.15.36:0/3289835671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc01483a0 0x7f0cc00b2190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cc66ab700 1 --2- 172.21.15.36:0/3289835671 >> v2:172.21.15.36:3300/0 conn(0x7f0cc00b1db0 0x7f0cc00b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3289835671 >> 172.21.15.36:0/3289835671 conn(0x7f0cc005f6b0 msgr2=0x7f0cc005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:40.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3289835671 shutdown_connections 2022-01-10T01:27:40.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.453+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3289835671 wait complete. 2022-01-10T01:27:40.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cc66ab700 1 Processor -- start 2022-01-10T01:27:40.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cc66ab700 1 -- start start 2022-01-10T01:27:40.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cc66ab700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0cc00a70c0 0x7f0cc00ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:40.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cc66ab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc00b1db0 0x7f0cc014a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:40.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cc66ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cc01483a0 0x7f0cc014a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:40.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cc66ab700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00ac530 con 0x7f0cc00a70c0 2022-01-10T01:27:40.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cc66ab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00af4d0 con 0x7f0cc00b1db0 2022-01-10T01:27:40.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cc66ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc015ab50 con 0x7f0cc01483a0 2022-01-10T01:27:40.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cbffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0cc00a70c0 0x7f0cc00ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:40.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cbffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0cc00a70c0 0x7f0cc00ab120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36142/0 (socket says 172.21.15.36:36142) 2022-01-10T01:27:40.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cbffff700 1 -- 172.21.15.36:0/3957833387 learned_addr learned my addr 172.21.15.36:0/3957833387 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:40.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cbf7fe700 1 --2- 172.21.15.36:0/3957833387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc00b1db0 0x7f0cc014a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:40.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cc4c48700 1 --2- 172.21.15.36:0/3957833387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cc01483a0 0x7f0cc014a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:40.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cbffff700 1 -- 172.21.15.36:0/3957833387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cc01483a0 msgr2=0x7f0cc014a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:40.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cbffff700 1 --2- 172.21.15.36:0/3957833387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cc01483a0 0x7f0cc014a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cbffff700 1 -- 172.21.15.36:0/3957833387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc00b1db0 msgr2=0x7f0cc014a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:40.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cbffff700 1 --2- 172.21.15.36:0/3957833387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc00b1db0 0x7f0cc014a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:40.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cbffff700 1 -- 172.21.15.36:0/3957833387 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb400b1e0 con 0x7f0cc00a70c0 2022-01-10T01:27:40.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cbffff700 1 --2- 172.21.15.36:0/3957833387 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0cc00a70c0 0x7f0cc00ab120 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f0cb400c000 tx=0x7f0cb4006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:40.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cbd7fa700 1 -- 172.21.15.36:0/3957833387 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cb4012600 con 0x7f0cc00a70c0 2022-01-10T01:27:40.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cbd7fa700 1 -- 172.21.15.36:0/3957833387 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb4012760 con 0x7f0cc00a70c0 2022-01-10T01:27:40.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3957833387 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb000b180 con 0x7f0cc00a70c0 2022-01-10T01:27:40.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cbd7fa700 1 -- 172.21.15.36:0/3957833387 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0cb4012ac0 con 0x7f0cc00a70c0 2022-01-10T01:27:40.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.457+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3957833387 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc015a790 con 0x7f0cc00a70c0 2022-01-10T01:27:40.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.461+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3957833387 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc00b0b30 con 0x7f0cc00a70c0 2022-01-10T01:27:40.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.461+0000 7f0cbd7fa700 1 -- 172.21.15.36:0/3957833387 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0cb4012c20 con 0x7f0cc00a70c0 2022-01-10T01:27:40.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.461+0000 7f0cbd7fa700 1 --2- 172.21.15.36:0/3957833387 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0ca00534d0 0x7f0ca0055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:40.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.461+0000 7f0cbd7fa700 1 -- 172.21.15.36:0/3957833387 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0cb406bfd0 con 0x7f0cc00a70c0 2022-01-10T01:27:40.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.461+0000 7f0cbf7fe700 1 --2- 172.21.15.36:0/3957833387 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0ca00534d0 0x7f0ca0055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:40.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.461+0000 7f0cbf7fe700 1 --2- 172.21.15.36:0/3957833387 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0ca00534d0 0x7f0ca0055990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f0cb001a000 tx=0x7f0cb0014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:40.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.465+0000 7f0cbd7fa700 1 -- 172.21.15.36:0/3957833387 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0cb4042f40 con 0x7f0cc00a70c0 2022-01-10T01:27:40.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:40.629+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3957833387 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0cc0057350 con 0x7f0cc00a70c0 2022-01-10T01:27:41.609 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:27:41.609+0000 7f0b5376f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:27:41.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.613+0000 7f0cbd7fa700 1 -- 172.21.15.36:0/3957833387 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0cb4046560 con 0x7f0cc00a70c0 2022-01-10T01:27:41.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.617+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3957833387 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0ca00534d0 msgr2=0x7f0ca0055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:41.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.617+0000 7f0cc66ab700 1 --2- 172.21.15.36:0/3957833387 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0ca00534d0 0x7f0ca0055990 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f0cb001a000 tx=0x7f0cb0014000).stop 2022-01-10T01:27:41.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.617+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3957833387 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0cc00a70c0 msgr2=0x7f0cc00ab120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:41.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.617+0000 7f0cc66ab700 1 --2- 172.21.15.36:0/3957833387 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0cc00a70c0 0x7f0cc00ab120 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f0cb400c000 tx=0x7f0cb4006eb0).stop 2022-01-10T01:27:41.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.621+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3957833387 shutdown_connections 2022-01-10T01:27:41.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.621+0000 7f0cc66ab700 1 --2- 172.21.15.36:0/3957833387 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0ca00534d0 0x7f0ca0055990 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:41.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.621+0000 7f0cc66ab700 1 --2- 172.21.15.36:0/3957833387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cc01483a0 0x7f0cc014a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:41.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.621+0000 7f0cc66ab700 1 --2- 172.21.15.36:0/3957833387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cc00b1db0 0x7f0cc014a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:41.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.621+0000 7f0cc66ab700 1 --2- 172.21.15.36:0/3957833387 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0cc00a70c0 0x7f0cc00ab120 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:41.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.621+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3957833387 >> 172.21.15.36:0/3957833387 conn(0x7f0cc005f6b0 msgr2=0x7f0cc0147770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:41.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.621+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3957833387 shutdown_connections 2022-01-10T01:27:41.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.621+0000 7f0cc66ab700 1 -- 172.21.15.36:0/3957833387 wait complete. 2022-01-10T01:27:41.625 INFO:teuthology.orchestra.run.smithi036.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2022-01-10T01:27:41.641 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:27:41.656 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:27:41.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe55d7f8700 1 Processor -- start 2022-01-10T01:27:41.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe55d7f8700 1 -- start start 2022-01-10T01:27:41.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe55d7f8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5580af780 0x7fe558143d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:41.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe55d7f8700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5580b3880 con 0x7fe5580a9f40 2022-01-10T01:27:41.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe55d7f8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5581469b0 con 0x7fe5580b34a0 2022-01-10T01:27:41.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe55d7f8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe558144260 con 0x7fe5580af780 2022-01-10T01:27:41.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe5567fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5580af780 0x7fe558143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:41.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe5577fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe5580a9f40 0x7fe558140110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33948/0 (socket says 172.21.15.36:33948) 2022-01-10T01:27:41.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe5577fe700 1 -- 172.21.15.36:0/539166204 learned_addr learned my addr 172.21.15.36:0/539166204 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:41.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe556ffd700 1 --1- 172.21.15.36:0/539166204 >> v1:172.21.15.59:6789/0 conn(0x7fe5580b34a0 0x7fe5580af070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:51620/0 (socket says 172.21.15.36:51620) 2022-01-10T01:27:41.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe555ffb700 1 -- 172.21.15.36:0/539166204 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755605838 0 0) 0x7fe5580b3880 con 0x7fe5580a9f40 2022-01-10T01:27:41.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe555ffb700 1 -- 172.21.15.36:0/539166204 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe53c003260 con 0x7fe5580a9f40 2022-01-10T01:27:41.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe5567fc700 1 -- 172.21.15.36:0/539166204 >> v1:172.21.15.59:6789/0 conn(0x7fe5580b34a0 legacy=0x7fe5580af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:41.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe555ffb700 1 -- 172.21.15.36:0/539166204 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705687486 0 0) 0x7fe5581469b0 con 0x7fe5580b34a0 2022-01-10T01:27:41.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe5567fc700 1 -- 172.21.15.36:0/539166204 >> v1:172.21.15.36:6789/0 conn(0x7fe5580a9f40 legacy=0x7fe558140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:41.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe5567fc700 1 -- 172.21.15.36:0/539166204 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe558146c50 con 0x7fe5580af780 2022-01-10T01:27:41.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.749+0000 7fe5567fc700 1 --2- 172.21.15.36:0/539166204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5580af780 0x7fe558143d70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe54c002f70 tx=0x7fe54c006df0).ready entity=mon.1 client_cookie=84f2ea84bc3bebb7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:41.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.753+0000 7fe555ffb700 1 -- 172.21.15.36:0/539166204 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe54c00d610 con 0x7fe5580af780 2022-01-10T01:27:41.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.753+0000 7fe555ffb700 1 -- 172.21.15.36:0/539166204 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c000e90 con 0x7fe5580af780 2022-01-10T01:27:41.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.753+0000 7fe555ffb700 1 -- 172.21.15.36:0/539166204 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe54c00d960 con 0x7fe5580af780 2022-01-10T01:27:41.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.753+0000 7fe55d7f8700 1 -- 172.21.15.36:0/539166204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5580af780 msgr2=0x7fe558143d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:41.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.753+0000 7fe55d7f8700 1 --2- 172.21.15.36:0/539166204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5580af780 0x7fe558143d70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe54c002f70 tx=0x7fe54c006df0).stop 2022-01-10T01:27:41.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.753+0000 7fe55d7f8700 1 -- 172.21.15.36:0/539166204 shutdown_connections 2022-01-10T01:27:41.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.753+0000 7fe55d7f8700 1 --2- 172.21.15.36:0/539166204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5580af780 0x7fe558143d70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:41.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.753+0000 7fe55d7f8700 1 -- 172.21.15.36:0/539166204 >> 172.21.15.36:0/539166204 conn(0x7fe5580607c0 msgr2=0x7fe558060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:41.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.753+0000 7fe55d7f8700 1 -- 172.21.15.36:0/539166204 shutdown_connections 2022-01-10T01:27:41.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.753+0000 7fe55d7f8700 1 -- 172.21.15.36:0/539166204 wait complete. 2022-01-10T01:27:41.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.753+0000 7fe55d7f8700 1 Processor -- start 2022-01-10T01:27:41.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.753+0000 7fe55d7f8700 1 -- start start 2022-01-10T01:27:41.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe55d7f8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5580a9f40 0x7fe5580b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:41.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe55d7f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5580af780 0x7fe558148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:41.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe55d7f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5580b34a0 0x7fe558149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:41.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe55d7f8700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5581425f0 con 0x7fe5580a9f40 2022-01-10T01:27:41.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe55d7f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe558147ad0 con 0x7fe5580af780 2022-01-10T01:27:41.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe55d7f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5581489a0 con 0x7fe5580b34a0 2022-01-10T01:27:41.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe556ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5580a9f40 0x7fe5580b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:41.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe556ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5580a9f40 0x7fe5580b22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36156/0 (socket says 172.21.15.36:36156) 2022-01-10T01:27:41.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe556ffd700 1 -- 172.21.15.36:0/3295287229 learned_addr learned my addr 172.21.15.36:0/3295287229 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:41.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe5577fe700 1 --2- 172.21.15.36:0/3295287229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5580b34a0 0x7fe558149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:41.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe5567fc700 1 --2- 172.21.15.36:0/3295287229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5580af780 0x7fe558148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:41.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe556ffd700 1 -- 172.21.15.36:0/3295287229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5580b34a0 msgr2=0x7fe558149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:41.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe556ffd700 1 --2- 172.21.15.36:0/3295287229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5580b34a0 0x7fe558149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:41.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe556ffd700 1 -- 172.21.15.36:0/3295287229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5580af780 msgr2=0x7fe558148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:41.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe556ffd700 1 --2- 172.21.15.36:0/3295287229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5580af780 0x7fe558148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:41.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe556ffd700 1 -- 172.21.15.36:0/3295287229 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c00b180 con 0x7fe5580a9f40 2022-01-10T01:27:41.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe556ffd700 1 --2- 172.21.15.36:0/3295287229 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5580a9f40 0x7fe5580b22b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fe558145010 tx=0x7fe548007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:41.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe547fff700 1 -- 172.21.15.36:0/3295287229 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5480070d0 con 0x7fe5580a9f40 2022-01-10T01:27:41.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe547fff700 1 -- 172.21.15.36:0/3295287229 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe548007230 con 0x7fe5580a9f40 2022-01-10T01:27:41.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe55d7f8700 1 -- 172.21.15.36:0/3295287229 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe558147d00 con 0x7fe5580a9f40 2022-01-10T01:27:41.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe547fff700 1 -- 172.21.15.36:0/3295287229 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe548005740 con 0x7fe5580a9f40 2022-01-10T01:27:41.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.757+0000 7fe55d7f8700 1 -- 172.21.15.36:0/3295287229 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe558142c20 con 0x7fe5580a9f40 2022-01-10T01:27:41.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.761+0000 7fe55d7f8700 1 -- 172.21.15.36:0/3295287229 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe558142de0 con 0x7fe5580a9f40 2022-01-10T01:27:41.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.761+0000 7fe547fff700 1 -- 172.21.15.36:0/3295287229 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe548010070 con 0x7fe5580a9f40 2022-01-10T01:27:41.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.761+0000 7fe547fff700 1 --2- 172.21.15.36:0/3295287229 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe534053680 0x7fe534055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:41.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.761+0000 7fe547fff700 1 -- 172.21.15.36:0/3295287229 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fe54806b100 con 0x7fe5580a9f40 2022-01-10T01:27:41.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.761+0000 7fe5567fc700 1 --2- 172.21.15.36:0/3295287229 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe534053680 0x7fe534055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:41.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.761+0000 7fe5567fc700 1 --2- 172.21.15.36:0/3295287229 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe534053680 0x7fe534055b40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fe54c01a000 tx=0x7fe54c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:41.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.769+0000 7fe547fff700 1 -- 172.21.15.36:0/3295287229 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe5480420c0 con 0x7fe5580a9f40 2022-01-10T01:27:41.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.937+0000 7fe55d7f8700 1 -- 172.21.15.36:0/3295287229 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe558146ef0 con 0x7fe5580a9f40 2022-01-10T01:27:41.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.937+0000 7fe547fff700 1 -- 172.21.15.36:0/3295287229 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+2124 (secure 0 0 0) 0x7fe5480456e0 con 0x7fe5580a9f40 2022-01-10T01:27:41.940 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:41.941 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/986398854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":986398854},{"type":"v1","addr":"172.21.15.36:6835","nonce":986398854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/781575126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":781575126},{"type":"v1","addr":"172.21.15.36:6837","nonce":781575126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:26:18.598647+0000","modified":"2022-01-10T01:27:41.611106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":47,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2022-01-10T01:27:41.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.937+0000 7fe55d7f8700 1 -- 172.21.15.36:0/3295287229 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe534053680 msgr2=0x7fe534055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:41.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.937+0000 7fe55d7f8700 1 --2- 172.21.15.36:0/3295287229 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe534053680 0x7fe534055b40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fe54c01a000 tx=0x7fe54c014000).stop 2022-01-10T01:27:41.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.937+0000 7fe55d7f8700 1 -- 172.21.15.36:0/3295287229 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5580a9f40 msgr2=0x7fe5580b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:41.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.937+0000 7fe55d7f8700 1 --2- 172.21.15.36:0/3295287229 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5580a9f40 0x7fe5580b22b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fe558145010 tx=0x7fe548007ae0).stop 2022-01-10T01:27:41.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.937+0000 7fe55d7f8700 1 -- 172.21.15.36:0/3295287229 shutdown_connections 2022-01-10T01:27:41.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.937+0000 7fe55d7f8700 1 --2- 172.21.15.36:0/3295287229 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe534053680 0x7fe534055b40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:41.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.937+0000 7fe55d7f8700 1 --2- 172.21.15.36:0/3295287229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5580b34a0 0x7fe558149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:41.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.937+0000 7fe55d7f8700 1 --2- 172.21.15.36:0/3295287229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5580af780 0x7fe558148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:41.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.937+0000 7fe55d7f8700 1 --2- 172.21.15.36:0/3295287229 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5580a9f40 0x7fe5580b22b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:41.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.937+0000 7fe55d7f8700 1 -- 172.21.15.36:0/3295287229 >> 172.21.15.36:0/3295287229 conn(0x7fe5580607c0 msgr2=0x7fe55813d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:41.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.937+0000 7fe55d7f8700 1 -- 172.21.15.36:0/3295287229 shutdown_connections 2022-01-10T01:27:41.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:41.937+0000 7fe55d7f8700 1 -- 172.21.15.36:0/3295287229 wait complete. 2022-01-10T01:27:41.945 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 19 2022-01-10T01:27:41.959 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:27:42.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.061+0000 7f3a2b142700 1 Processor -- start 2022-01-10T01:27:42.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.061+0000 7f3a2b142700 1 -- start start 2022-01-10T01:27:42.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3a240b3040 0x7f3a24065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:42.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a240a9c10 0x7f3a240607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:42.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a24143320 0x7f3a241437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:42.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a240648e0 con 0x7f3a240b3040 2022-01-10T01:27:42.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a24061dd0 con 0x7f3a24143320 2022-01-10T01:27:42.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a24066ea0 con 0x7f3a240a9c10 2022-01-10T01:27:42.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2a140700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3a240b3040 0x7f3a24065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:42.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2a941700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a24143320 0x7f3a241437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:42.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2993f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a240a9c10 0x7f3a240607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:42.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2a140700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3a240b3040 0x7f3a24065e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36168/0 (socket says 172.21.15.36:36168) 2022-01-10T01:27:42.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2a140700 1 -- 172.21.15.36:0/2588645972 learned_addr learned my addr 172.21.15.36:0/2588645972 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:42.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2a140700 1 -- 172.21.15.36:0/2588645972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a240a9c10 msgr2=0x7f3a240607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:42.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2a140700 1 --2- 172.21.15.36:0/2588645972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a240a9c10 0x7f3a240607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:42.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2a140700 1 -- 172.21.15.36:0/2588645972 >> v2:172.21.15.59:3300/0 conn(0x7f3a24143320 msgr2=0x7f3a241437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:42.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2a140700 1 --2- 172.21.15.36:0/2588645972 >> v2:172.21.15.59:3300/0 conn(0x7f3a24143320 0x7f3a241437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:42.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2a140700 1 -- 172.21.15.36:0/2588645972 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a240b3420 con 0x7f3a240b3040 2022-01-10T01:27:42.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2a941700 1 --2- 172.21.15.36:0/2588645972 >> v2:172.21.15.59:3300/0 conn(0x7f3a24143320 0x7f3a241437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:27:42.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2993f700 1 --2- 172.21.15.36:0/2588645972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a240a9c10 0x7f3a240607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:27:42.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2a140700 1 --2- 172.21.15.36:0/2588645972 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a240b3040 0x7f3a24065e90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f3a20002f70 tx=0x7f3a20006eb0).ready entity=mon.0 client_cookie=213e2641698af72f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:42.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2913e700 1 -- 172.21.15.36:0/2588645972 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a2000d570 con 0x7f3a240b3040 2022-01-10T01:27:42.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2913e700 1 -- 172.21.15.36:0/2588645972 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a20000e90 con 0x7f3a240b3040 2022-01-10T01:27:42.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2913e700 1 -- 172.21.15.36:0/2588645972 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a2000d900 con 0x7f3a240b3040 2022-01-10T01:27:42.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 -- 172.21.15.36:0/2588645972 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a240b3040 msgr2=0x7f3a24065e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:42.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 --2- 172.21.15.36:0/2588645972 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a240b3040 0x7f3a24065e90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f3a20002f70 tx=0x7f3a20006eb0).stop 2022-01-10T01:27:42.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 -- 172.21.15.36:0/2588645972 shutdown_connections 2022-01-10T01:27:42.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 --2- 172.21.15.36:0/2588645972 >> v2:172.21.15.59:3300/0 conn(0x7f3a24143320 0x7f3a241437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:42.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 --2- 172.21.15.36:0/2588645972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a240a9c10 0x7f3a240607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:42.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 --2- 172.21.15.36:0/2588645972 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a240b3040 0x7f3a24065e90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:42.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 -- 172.21.15.36:0/2588645972 >> 172.21.15.36:0/2588645972 conn(0x7f3a240636e0 msgr2=0x7f3a24063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:42.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 -- 172.21.15.36:0/2588645972 shutdown_connections 2022-01-10T01:27:42.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.065+0000 7f3a2b142700 1 -- 172.21.15.36:0/2588645972 wait complete. 2022-01-10T01:27:42.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.069+0000 7f3a2b142700 1 Processor -- start 2022-01-10T01:27:42.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.069+0000 7f3a2b142700 1 -- start start 2022-01-10T01:27:42.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.069+0000 7f3a2b142700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a240a9c10 0x7f3a240ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:42.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.069+0000 7f3a2b142700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a240b3040 0x7f3a240ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:42.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.069+0000 7f3a2b142700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a24143320 0x7f3a240aa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:42.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.069+0000 7f3a2b142700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240ac480 con 0x7f3a240b3040 2022-01-10T01:27:42.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.069+0000 7f3a2b142700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240b52b0 con 0x7f3a240a9c10 2022-01-10T01:27:42.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.069+0000 7f3a2b142700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a240b6020 con 0x7f3a24143320 2022-01-10T01:27:42.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.069+0000 7f3a2993f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a240b3040 0x7f3a240ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:42.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.069+0000 7f3a2993f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a240b3040 0x7f3a240ad670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36172/0 (socket says 172.21.15.36:36172) 2022-01-10T01:27:42.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.069+0000 7f3a2993f700 1 -- 172.21.15.36:0/3505229771 learned_addr learned my addr 172.21.15.36:0/3505229771 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:42.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.069+0000 7f3a2a140700 1 --2- 172.21.15.36:0/3505229771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a240a9c10 0x7f3a240ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:42.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.069+0000 7f3a2a941700 1 --2- 172.21.15.36:0/3505229771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a24143320 0x7f3a240aa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:42.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a2993f700 1 -- 172.21.15.36:0/3505229771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a24143320 msgr2=0x7f3a240aa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:42.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a2993f700 1 --2- 172.21.15.36:0/3505229771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a24143320 0x7f3a240aa1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:42.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a2993f700 1 -- 172.21.15.36:0/3505229771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a240a9c10 msgr2=0x7f3a240ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:42.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a2993f700 1 --2- 172.21.15.36:0/3505229771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a240a9c10 0x7f3a240ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:42.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a2993f700 1 -- 172.21.15.36:0/3505229771 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1800b180 con 0x7f3a240b3040 2022-01-10T01:27:42.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a2993f700 1 --2- 172.21.15.36:0/3505229771 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a240b3040 0x7f3a240ad670 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f3a1800c000 tx=0x7f3a18006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:42.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a177fe700 1 -- 172.21.15.36:0/3505229771 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1800c890 con 0x7f3a240b3040 2022-01-10T01:27:42.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a177fe700 1 -- 172.21.15.36:0/3505229771 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1800c9f0 con 0x7f3a240b3040 2022-01-10T01:27:42.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a2b142700 1 -- 172.21.15.36:0/3505229771 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c009470 con 0x7f3a240b3040 2022-01-10T01:27:42.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a177fe700 1 -- 172.21.15.36:0/3505229771 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a1800cd50 con 0x7f3a240b3040 2022-01-10T01:27:42.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a2b142700 1 -- 172.21.15.36:0/3505229771 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2000b1e0 con 0x7f3a240b3040 2022-01-10T01:27:42.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a2b142700 1 -- 172.21.15.36:0/3505229771 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a240accb0 con 0x7f3a240b3040 2022-01-10T01:27:42.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a177fe700 1 -- 172.21.15.36:0/3505229771 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3a1801c460 con 0x7f3a240b3040 2022-01-10T01:27:42.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a177fe700 1 --2- 172.21.15.36:0/3505229771 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3a040534d0 0x7f3a04055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:42.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a177fe700 1 -- 172.21.15.36:0/3505229771 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f3a1806c0b0 con 0x7f3a240b3040 2022-01-10T01:27:42.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a2a140700 1 --2- 172.21.15.36:0/3505229771 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3a040534d0 0x7f3a04055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:42.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.073+0000 7f3a2a140700 1 --2- 172.21.15.36:0/3505229771 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3a040534d0 0x7f3a04055990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f3a2001c000 tx=0x7f3a20015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:42.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.081+0000 7f3a177fe700 1 -- 172.21.15.36:0/3505229771 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3a18043010 con 0x7f3a240b3040 2022-01-10T01:27:42.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.245+0000 7f3a2b142700 1 -- 172.21.15.36:0/3505229771 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3a24066960 con 0x7f3a240b3040 2022-01-10T01:27:42.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.633+0000 7f3a177fe700 1 -- 172.21.15.36:0/3505229771 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3a18046630 con 0x7f3a240b3040 2022-01-10T01:27:42.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.637+0000 7f3a2b142700 1 -- 172.21.15.36:0/3505229771 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3a040534d0 msgr2=0x7f3a04055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:42.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.637+0000 7f3a2b142700 1 --2- 172.21.15.36:0/3505229771 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3a040534d0 0x7f3a04055990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f3a2001c000 tx=0x7f3a20015000).stop 2022-01-10T01:27:42.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.637+0000 7f3a2b142700 1 -- 172.21.15.36:0/3505229771 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a240b3040 msgr2=0x7f3a240ad670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:42.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.637+0000 7f3a2b142700 1 --2- 172.21.15.36:0/3505229771 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a240b3040 0x7f3a240ad670 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f3a1800c000 tx=0x7f3a18006df0).stop 2022-01-10T01:27:42.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.637+0000 7f3a2b142700 1 -- 172.21.15.36:0/3505229771 shutdown_connections 2022-01-10T01:27:42.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.637+0000 7f3a2b142700 1 --2- 172.21.15.36:0/3505229771 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3a040534d0 0x7f3a04055990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:42.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.637+0000 7f3a2b142700 1 --2- 172.21.15.36:0/3505229771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a24143320 0x7f3a240aa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:42.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.637+0000 7f3a2b142700 1 --2- 172.21.15.36:0/3505229771 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3a240b3040 0x7f3a240ad670 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:42.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.637+0000 7f3a2b142700 1 --2- 172.21.15.36:0/3505229771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a240a9c10 0x7f3a240ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:42.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.637+0000 7f3a2b142700 1 -- 172.21.15.36:0/3505229771 >> 172.21.15.36:0/3505229771 conn(0x7f3a240636e0 msgr2=0x7f3a24060380 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:42.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.637+0000 7f3a2b142700 1 -- 172.21.15.36:0/3505229771 shutdown_connections 2022-01-10T01:27:42.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.637+0000 7f3a2b142700 1 -- 172.21.15.36:0/3505229771 wait complete. 2022-01-10T01:27:42.656 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:27:42.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.769+0000 7fa71c240700 1 Processor -- start 2022-01-10T01:27:42.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.769+0000 7fa71c240700 1 -- start start 2022-01-10T01:27:42.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.769+0000 7fa71c240700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa714061650 0x7fa7140665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:42.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.769+0000 7fa71c240700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7140604e0 con 0x7fa714060100 2022-01-10T01:27:42.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.769+0000 7fa71c240700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa714060c70 con 0x7fa714066ac0 2022-01-10T01:27:42.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.769+0000 7fa71c240700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa714060f10 con 0x7fa714061650 2022-01-10T01:27:42.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.769+0000 7fa719fdc700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa714060100 0x7fa714065970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33972/0 (socket says 172.21.15.36:33972) 2022-01-10T01:27:42.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.769+0000 7fa719fdc700 1 -- 172.21.15.36:0/1093955596 learned_addr learned my addr 172.21.15.36:0/1093955596 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:42.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.769+0000 7fa7197db700 1 --2- 172.21.15.36:0/1093955596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa714061650 0x7fa7140665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:42.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa718fda700 1 -- 172.21.15.36:0/1093955596 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51990577 0 0) 0x7fa7140604e0 con 0x7fa714060100 2022-01-10T01:27:42.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa718fda700 1 -- 172.21.15.36:0/1093955596 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6fc003260 con 0x7fa714060100 2022-01-10T01:27:42.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa718fda700 1 -- 172.21.15.36:0/1093955596 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063114624 0 0) 0x7fa714060c70 con 0x7fa714066ac0 2022-01-10T01:27:42.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa718fda700 1 -- 172.21.15.36:0/1093955596 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7140604e0 con 0x7fa714066ac0 2022-01-10T01:27:42.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa7197db700 1 -- 172.21.15.36:0/1093955596 >> v1:172.21.15.59:6789/0 conn(0x7fa714066ac0 legacy=0x7fa71414d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:42.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa7197db700 1 -- 172.21.15.36:0/1093955596 >> v1:172.21.15.36:6789/0 conn(0x7fa714060100 legacy=0x7fa714065970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:42.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa7197db700 1 -- 172.21.15.36:0/1093955596 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7140611b0 con 0x7fa714061650 2022-01-10T01:27:42.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa7197db700 1 --2- 172.21.15.36:0/1093955596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa714061650 0x7fa7140665d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fa704002f70 tx=0x7fa704006df0).ready entity=mon.2 client_cookie=b62dde1521e9b921 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:42.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa718fda700 1 -- 172.21.15.36:0/1093955596 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa70400d5c0 con 0x7fa714061650 2022-01-10T01:27:42.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa718fda700 1 -- 172.21.15.36:0/1093955596 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa704000e90 con 0x7fa714061650 2022-01-10T01:27:42.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa718fda700 1 -- 172.21.15.36:0/1093955596 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa70400d910 con 0x7fa714061650 2022-01-10T01:27:42.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa71c240700 1 -- 172.21.15.36:0/1093955596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa714061650 msgr2=0x7fa7140665d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:42.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa71c240700 1 --2- 172.21.15.36:0/1093955596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa714061650 0x7fa7140665d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fa704002f70 tx=0x7fa704006df0).stop 2022-01-10T01:27:42.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa71c240700 1 -- 172.21.15.36:0/1093955596 shutdown_connections 2022-01-10T01:27:42.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa71c240700 1 --2- 172.21.15.36:0/1093955596 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa714061650 0x7fa7140665d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:42.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa71c240700 1 -- 172.21.15.36:0/1093955596 >> 172.21.15.36:0/1093955596 conn(0x7fa71405cf30 msgr2=0x7fa71405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:42.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa71c240700 1 -- 172.21.15.36:0/1093955596 shutdown_connections 2022-01-10T01:27:42.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa71c240700 1 -- 172.21.15.36:0/1093955596 wait complete. 2022-01-10T01:27:42.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.773+0000 7fa71c240700 1 Processor -- start 2022-01-10T01:27:42.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa71c240700 1 -- start start 2022-01-10T01:27:42.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa71c240700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa714060100 0x7fa7140a4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:42.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa71c240700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa714061650 0x7fa714146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:42.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa71c240700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa714066ac0 0x7fa714152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:42.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa71c240700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7140ab080 con 0x7fa714061650 2022-01-10T01:27:42.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa71c240700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7140aab40 con 0x7fa714066ac0 2022-01-10T01:27:42.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa71c240700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7140aade0 con 0x7fa714060100 2022-01-10T01:27:42.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa7197db700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa714061650 0x7fa714146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:42.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa7197db700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa714061650 0x7fa714146b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36186/0 (socket says 172.21.15.36:36186) 2022-01-10T01:27:42.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa7197db700 1 -- 172.21.15.36:0/1776042594 learned_addr learned my addr 172.21.15.36:0/1776042594 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:42.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa719fdc700 1 --2- 172.21.15.36:0/1776042594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa714060100 0x7fa7140a4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:42.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa71a7dd700 1 --2- 172.21.15.36:0/1776042594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa714066ac0 0x7fa714152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:42.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa7197db700 1 -- 172.21.15.36:0/1776042594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa714060100 msgr2=0x7fa7140a4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:42.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa7197db700 1 --2- 172.21.15.36:0/1776042594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa714060100 0x7fa7140a4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:42.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa7197db700 1 -- 172.21.15.36:0/1776042594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa714066ac0 msgr2=0x7fa714152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:42.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa7197db700 1 --2- 172.21.15.36:0/1776042594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa714066ac0 0x7fa714152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:42.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa7197db700 1 -- 172.21.15.36:0/1776042594 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70400b180 con 0x7fa714061650 2022-01-10T01:27:42.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa7197db700 1 --2- 172.21.15.36:0/1776042594 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa714061650 0x7fa714146b60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fa704002f70 tx=0x7fa704014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:42.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa702ffd700 1 -- 172.21.15.36:0/1776042594 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa704013de0 con 0x7fa714061650 2022-01-10T01:27:42.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa702ffd700 1 -- 172.21.15.36:0/1776042594 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70401e400 con 0x7fa714061650 2022-01-10T01:27:42.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa71c240700 1 -- 172.21.15.36:0/1776042594 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7141526d0 con 0x7fa714061650 2022-01-10T01:27:42.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa702ffd700 1 -- 172.21.15.36:0/1776042594 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa70401e760 con 0x7fa714061650 2022-01-10T01:27:42.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.777+0000 7fa71c240700 1 -- 172.21.15.36:0/1776042594 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa714147050 con 0x7fa714061650 2022-01-10T01:27:42.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.781+0000 7fa71c240700 1 -- 172.21.15.36:0/1776042594 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa714057350 con 0x7fa714061650 2022-01-10T01:27:42.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.781+0000 7fa702ffd700 1 -- 172.21.15.36:0/1776042594 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa70401c070 con 0x7fa714061650 2022-01-10T01:27:42.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.781+0000 7fa702ffd700 1 --2- 172.21.15.36:0/1776042594 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6f40535f0 0x7fa6f4055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:42.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.781+0000 7fa702ffd700 1 -- 172.21.15.36:0/1776042594 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fa70406c400 con 0x7fa714061650 2022-01-10T01:27:42.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.781+0000 7fa719fdc700 1 --2- 172.21.15.36:0/1776042594 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6f40535f0 0x7fa6f4055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:42.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.781+0000 7fa719fdc700 1 --2- 172.21.15.36:0/1776042594 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6f40535f0 0x7fa6f4055ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fa71000d000 tx=0x7fa710009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:42.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.785+0000 7fa702ffd700 1 -- 172.21.15.36:0/1776042594 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa704043320 con 0x7fa714061650 2022-01-10T01:27:42.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:42.917+0000 7fa71c240700 1 -- 172.21.15.36:0/1776042594 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa7140b23c0 con 0x7fa714061650 2022-01-10T01:27:43.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.637+0000 7fa702ffd700 1 -- 172.21.15.36:0/1776042594 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) v1 ==== 185+0+0 (secure 0 0 0) 0x7fa704023020 con 0x7fa714061650 2022-01-10T01:27:43.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.641+0000 7fa71c240700 1 -- 172.21.15.36:0/1776042594 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6f40535f0 msgr2=0x7fa6f4055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:43.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.641+0000 7fa71c240700 1 --2- 172.21.15.36:0/1776042594 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6f40535f0 0x7fa6f4055ab0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fa71000d000 tx=0x7fa710009040).stop 2022-01-10T01:27:43.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.641+0000 7fa71c240700 1 -- 172.21.15.36:0/1776042594 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa714061650 msgr2=0x7fa714146b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:43.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.641+0000 7fa71c240700 1 --2- 172.21.15.36:0/1776042594 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa714061650 0x7fa714146b60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fa704002f70 tx=0x7fa704014000).stop 2022-01-10T01:27:43.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.641+0000 7fa71c240700 1 -- 172.21.15.36:0/1776042594 shutdown_connections 2022-01-10T01:27:43.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.641+0000 7fa71c240700 1 --2- 172.21.15.36:0/1776042594 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6f40535f0 0x7fa6f4055ab0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:43.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.641+0000 7fa71c240700 1 --2- 172.21.15.36:0/1776042594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa714066ac0 0x7fa714152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:43.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.641+0000 7fa71c240700 1 --2- 172.21.15.36:0/1776042594 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa714061650 0x7fa714146b60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:43.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.641+0000 7fa71c240700 1 --2- 172.21.15.36:0/1776042594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa714060100 0x7fa7140a4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:43.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.641+0000 7fa71c240700 1 -- 172.21.15.36:0/1776042594 >> 172.21.15.36:0/1776042594 conn(0x7fa71405cf30 msgr2=0x7fa714065920 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:43.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.641+0000 7fa71c240700 1 -- 172.21.15.36:0/1776042594 shutdown_connections 2022-01-10T01:27:43.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.641+0000 7fa71c240700 1 -- 172.21.15.36:0/1776042594 wait complete. 2022-01-10T01:27:43.649 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:27:43.659 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2022-01-10T01:27:43.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.765+0000 7fd248e45700 1 Processor -- start 2022-01-10T01:27:43.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd248e45700 1 -- start start 2022-01-10T01:27:43.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd248e45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd244148860 0x7fd24414ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:43.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd248e45700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd244066ea0 con 0x7fd2440b3040 2022-01-10T01:27:43.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd248e45700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2440b3420 con 0x7fd2440a9c10 2022-01-10T01:27:43.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd248e45700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2440648e0 con 0x7fd244148860 2022-01-10T01:27:43.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd2437fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd2440b3040 0x7fd244065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:33986/0 (socket says 172.21.15.36:33986) 2022-01-10T01:27:43.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd2437fe700 1 -- 172.21.15.36:0/1923622953 learned_addr learned my addr 172.21.15.36:0/1923622953 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:43.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd243fff700 1 --2- 172.21.15.36:0/1923622953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd244148860 0x7fd24414ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:43.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528167849 0 0) 0x7fd244066ea0 con 0x7fd2440b3040 2022-01-10T01:27:43.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd224003260 con 0x7fd2440b3040 2022-01-10T01:27:43.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318344622 0 0) 0x7fd2440b3420 con 0x7fd2440a9c10 2022-01-10T01:27:43.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd244066ea0 con 0x7fd2440a9c10 2022-01-10T01:27:43.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2197536484 0 0) 0x7fd224003260 con 0x7fd2440b3040 2022-01-10T01:27:43.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd244148860 msgr2=0x7fd24414ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:43.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 --2- 172.21.15.36:0/1923622953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd244148860 0x7fd24414ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:43.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 >> v1:172.21.15.59:6789/0 conn(0x7fd2440a9c10 legacy=0x7fd2440607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:43.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd244066960 con 0x7fd2440b3040 2022-01-10T01:27:43.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fd234001660 con 0x7fd2440b3040 2022-01-10T01:27:43.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 >> v1:172.21.15.36:6789/0 conn(0x7fd2440b3040 legacy=0x7fd244065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:43.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 --2- 172.21.15.36:0/1923622953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd244148860 0x7fd224003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:43.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 --2- 172.21.15.36:0/1923622953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd224003e70 0x7fd224004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:43.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 --2- 172.21.15.36:0/1923622953 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2240049f0 0x7fd224004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:43.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22400b800 con 0x7fd2240049f0 2022-01-10T01:27:43.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22400b970 con 0x7fd224003e70 2022-01-10T01:27:43.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22400bb30 con 0x7fd244148860 2022-01-10T01:27:43.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd243fff700 1 --2- 172.21.15.36:0/1923622953 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2240049f0 0x7fd224004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:43.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd2437fe700 1 --2- 172.21.15.36:0/1923622953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd244148860 0x7fd224003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:43.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.769+0000 7fd23bfff700 1 --2- 172.21.15.36:0/1923622953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd224003e70 0x7fd224004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:43.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd243fff700 1 -- 172.21.15.36:0/1923622953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd244148860 msgr2=0x7fd224003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:43.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd243fff700 1 --2- 172.21.15.36:0/1923622953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd244148860 0x7fd224003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:43.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd243fff700 1 -- 172.21.15.36:0/1923622953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd224003e70 msgr2=0x7fd224004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:43.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd243fff700 1 --2- 172.21.15.36:0/1923622953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd224003e70 0x7fd224004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:43.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd243fff700 1 -- 172.21.15.36:0/1923622953 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd224003260 con 0x7fd2240049f0 2022-01-10T01:27:43.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd243fff700 1 --2- 172.21.15.36:0/1923622953 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2240049f0 0x7fd224004e70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fd23c00c000 tx=0x7fd23c0091d0).ready entity=mon.0 client_cookie=61576f446137a1bf server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:43.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23c00e6e0 con 0x7fd2240049f0 2022-01-10T01:27:43.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c00e840 con 0x7fd2240049f0 2022-01-10T01:27:43.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd242ffd700 1 -- 172.21.15.36:0/1923622953 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23c00eba0 con 0x7fd2240049f0 2022-01-10T01:27:43.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd248e45700 1 -- 172.21.15.36:0/1923622953 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2240049f0 msgr2=0x7fd224004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:43.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd248e45700 1 --2- 172.21.15.36:0/1923622953 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2240049f0 0x7fd224004e70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fd23c00c000 tx=0x7fd23c0091d0).stop 2022-01-10T01:27:43.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd243fff700 1 -- 172.21.15.36:0/1923622953 reap_dead start 2022-01-10T01:27:43.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd248e45700 1 -- 172.21.15.36:0/1923622953 shutdown_connections 2022-01-10T01:27:43.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd248e45700 1 -- 172.21.15.36:0/1923622953 >> 172.21.15.36:0/1923622953 conn(0x7fd2440636e0 msgr2=0x7fd244063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:43.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd248e45700 1 -- 172.21.15.36:0/1923622953 shutdown_connections 2022-01-10T01:27:43.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd248e45700 1 -- 172.21.15.36:0/1923622953 wait complete. 2022-01-10T01:27:43.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd248e45700 1 Processor -- start 2022-01-10T01:27:43.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.773+0000 7fd248e45700 1 -- start start 2022-01-10T01:27:43.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd248e45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2240049f0 0x7fd2440ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:43.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd248e45700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd244153c40 0x7fd244150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:43.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd248e45700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd244150600 0x7fd24405f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:43.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd248e45700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24414fd20 con 0x7fd244150600 2022-01-10T01:27:43.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd248e45700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2441540c0 con 0x7fd244153c40 2022-01-10T01:27:43.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd248e45700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd244140840 con 0x7fd2240049f0 2022-01-10T01:27:43.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd243fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd244150600 0x7fd24405f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:43.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd243fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd244150600 0x7fd24405f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36208/0 (socket says 172.21.15.36:36208) 2022-01-10T01:27:43.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd243fff700 1 -- 172.21.15.36:0/1871892176 learned_addr learned my addr 172.21.15.36:0/1871892176 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:43.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd23bfff700 1 --2- 172.21.15.36:0/1871892176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd244153c40 0x7fd244150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:43.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd2437fe700 1 --2- 172.21.15.36:0/1871892176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2240049f0 0x7fd2440ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:43.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd243fff700 1 -- 172.21.15.36:0/1871892176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2240049f0 msgr2=0x7fd2440ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:43.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd243fff700 1 --2- 172.21.15.36:0/1871892176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2240049f0 0x7fd2440ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:43.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd243fff700 1 -- 172.21.15.36:0/1871892176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd244153c40 msgr2=0x7fd244150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:43.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd243fff700 1 --2- 172.21.15.36:0/1871892176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd244153c40 0x7fd244150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:43.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd243fff700 1 -- 172.21.15.36:0/1871892176 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd244140a70 con 0x7fd244150600 2022-01-10T01:27:43.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd243fff700 1 --2- 172.21.15.36:0/1871892176 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd244150600 0x7fd24405f6b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fd2440b0950 tx=0x7fd23c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:43.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd2417fa700 1 -- 172.21.15.36:0/1871892176 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23c00e6e0 con 0x7fd244150600 2022-01-10T01:27:43.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd2417fa700 1 -- 172.21.15.36:0/1871892176 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c01b660 con 0x7fd244150600 2022-01-10T01:27:43.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd248e45700 1 -- 172.21.15.36:0/1871892176 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd244140d10 con 0x7fd244150600 2022-01-10T01:27:43.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd2417fa700 1 -- 172.21.15.36:0/1871892176 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23c009600 con 0x7fd244150600 2022-01-10T01:27:43.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd248e45700 1 -- 172.21.15.36:0/1871892176 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2440ae040 con 0x7fd244150600 2022-01-10T01:27:43.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.777+0000 7fd248e45700 1 -- 172.21.15.36:0/1871892176 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd244066c00 con 0x7fd244150600 2022-01-10T01:27:43.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.781+0000 7fd2417fa700 1 -- 172.21.15.36:0/1871892176 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd23c01b9c0 con 0x7fd244150600 2022-01-10T01:27:43.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.781+0000 7fd2417fa700 1 --2- 172.21.15.36:0/1871892176 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd228053590 0x7fd228055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:43.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.781+0000 7fd2417fa700 1 -- 172.21.15.36:0/1871892176 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6068+0+0 (secure 0 0 0) 0x7fd23c06d0a0 con 0x7fd244150600 2022-01-10T01:27:43.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.781+0000 7fd2437fe700 1 --2- 172.21.15.36:0/1871892176 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd228053590 0x7fd228055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:43.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.781+0000 7fd2437fe700 1 --2- 172.21.15.36:0/1871892176 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd228053590 0x7fd228055a50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fd234005000 tx=0x7fd244065800).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:43.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.785+0000 7fd2417fa700 1 -- 172.21.15.36:0/1871892176 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd23c044210 con 0x7fd244150600 2022-01-10T01:27:43.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:43.909+0000 7fd248e45700 1 -- 172.21.15.36:0/1871892176 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd244057350 con 0x7fd244150600 2022-01-10T01:27:44.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.649+0000 7fd2417fa700 1 -- 172.21.15.36:0/1871892176 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd23c016070 con 0x7fd244150600 2022-01-10T01:27:44.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.653+0000 7fd248e45700 1 -- 172.21.15.36:0/1871892176 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd228053590 msgr2=0x7fd228055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:44.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.653+0000 7fd248e45700 1 --2- 172.21.15.36:0/1871892176 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd228053590 0x7fd228055a50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7fd234005000 tx=0x7fd244065800).stop 2022-01-10T01:27:44.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.653+0000 7fd248e45700 1 -- 172.21.15.36:0/1871892176 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd244150600 msgr2=0x7fd24405f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:44.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.653+0000 7fd248e45700 1 --2- 172.21.15.36:0/1871892176 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd244150600 0x7fd24405f6b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fd2440b0950 tx=0x7fd23c01a000).stop 2022-01-10T01:27:44.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.653+0000 7fd248e45700 1 -- 172.21.15.36:0/1871892176 shutdown_connections 2022-01-10T01:27:44.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.653+0000 7fd248e45700 1 --2- 172.21.15.36:0/1871892176 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd228053590 0x7fd228055a50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:44.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.653+0000 7fd248e45700 1 --2- 172.21.15.36:0/1871892176 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd244150600 0x7fd24405f6b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:44.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.653+0000 7fd248e45700 1 --2- 172.21.15.36:0/1871892176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd244153c40 0x7fd244150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:44.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.653+0000 7fd248e45700 1 --2- 172.21.15.36:0/1871892176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2240049f0 0x7fd2440ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:44.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.653+0000 7fd248e45700 1 -- 172.21.15.36:0/1871892176 >> 172.21.15.36:0/1871892176 conn(0x7fd2440636e0 msgr2=0x7fd2440b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:44.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.657+0000 7fd248e45700 1 -- 172.21.15.36:0/1871892176 shutdown_connections 2022-01-10T01:27:44.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.657+0000 7fd248e45700 1 -- 172.21.15.36:0/1871892176 wait complete. 2022-01-10T01:27:44.661 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' removed 2022-01-10T01:27:44.672 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2022-01-10T01:27:44.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.777+0000 7f6973884700 1 Processor -- start 2022-01-10T01:27:44.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.777+0000 7f6973884700 1 -- start start 2022-01-10T01:27:44.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6973884700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f696c061d20 0x7f696c1445a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:44.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6973884700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c0b3ac0 0x7f696c0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:44.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6973884700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696c062100 con 0x7f696c05ff70 2022-01-10T01:27:44.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6973884700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696c0b11e0 con 0x7f696c061d20 2022-01-10T01:27:44.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6973884700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c144a90 con 0x7f696c0b3ac0 2022-01-10T01:27:44.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6971e21700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f696c05ff70 0x7f696c0afcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34008/0 (socket says 172.21.15.36:34008) 2022-01-10T01:27:44.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6971e21700 1 -- 172.21.15.36:0/1741855549 learned_addr learned my addr 172.21.15.36:0/1741855549 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:44.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6971620700 1 --2- 172.21.15.36:0/1741855549 >> v2:172.21.15.59:3300/0 conn(0x7f696c061d20 0x7f696c1445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:44.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6970e1f700 1 --2- 172.21.15.36:0/1741855549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c0b3ac0 0x7f696c0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:44.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f695bfff700 1 -- 172.21.15.36:0/1741855549 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402783649 0 0) 0x7f696c062100 con 0x7f696c05ff70 2022-01-10T01:27:44.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f695bfff700 1 -- 172.21.15.36:0/1741855549 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6954003260 con 0x7f696c05ff70 2022-01-10T01:27:44.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6971620700 1 -- 172.21.15.36:0/1741855549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c0b3ac0 msgr2=0x7f696c0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:44.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6971620700 1 --2- 172.21.15.36:0/1741855549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c0b3ac0 0x7f696c0b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:44.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6971620700 1 -- 172.21.15.36:0/1741855549 >> v1:172.21.15.36:6789/0 conn(0x7f696c05ff70 legacy=0x7f696c0afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:44.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6971620700 1 -- 172.21.15.36:0/1741855549 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c0b2a10 con 0x7f696c061d20 2022-01-10T01:27:44.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6971620700 1 --2- 172.21.15.36:0/1741855549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f696c061d20 0x7f696c1445a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f6968002f70 tx=0x7f6968006df0).ready entity=mon.1 client_cookie=84ccbd88282db513 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:44.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f695bfff700 1 -- 172.21.15.36:0/1741855549 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f696800d4a0 con 0x7f696c061d20 2022-01-10T01:27:44.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f695bfff700 1 -- 172.21.15.36:0/1741855549 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968000e90 con 0x7f696c061d20 2022-01-10T01:27:44.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f695bfff700 1 -- 172.21.15.36:0/1741855549 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f696800d7f0 con 0x7f696c061d20 2022-01-10T01:27:44.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6973884700 1 -- 172.21.15.36:0/1741855549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f696c061d20 msgr2=0x7f696c1445a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:44.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6973884700 1 --2- 172.21.15.36:0/1741855549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f696c061d20 0x7f696c1445a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f6968002f70 tx=0x7f6968006df0).stop 2022-01-10T01:27:44.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6973884700 1 -- 172.21.15.36:0/1741855549 shutdown_connections 2022-01-10T01:27:44.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6973884700 1 --2- 172.21.15.36:0/1741855549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c0b3ac0 0x7f696c0b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:44.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6973884700 1 --2- 172.21.15.36:0/1741855549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f696c061d20 0x7f696c1445a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:44.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6973884700 1 -- 172.21.15.36:0/1741855549 >> 172.21.15.36:0/1741855549 conn(0x7f696c0639b0 msgr2=0x7f696c063d90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:44.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6973884700 1 -- 172.21.15.36:0/1741855549 shutdown_connections 2022-01-10T01:27:44.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.781+0000 7f6973884700 1 -- 172.21.15.36:0/1741855549 wait complete. 2022-01-10T01:27:44.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.785+0000 7f6973884700 1 Processor -- start 2022-01-10T01:27:44.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.785+0000 7f6973884700 1 -- start start 2022-01-10T01:27:44.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.785+0000 7f6973884700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f696c05ff70 0x7f696c147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:44.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.785+0000 7f6973884700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c061d20 0x7f696c066280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:44.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.785+0000 7f6973884700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f696c0b3ac0 0x7f696c066770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:44.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.785+0000 7f6973884700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c066c60 con 0x7f696c05ff70 2022-01-10T01:27:44.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.785+0000 7f6973884700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c144570 con 0x7f696c0b3ac0 2022-01-10T01:27:44.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.785+0000 7f6973884700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c1427a0 con 0x7f696c061d20 2022-01-10T01:27:44.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.785+0000 7f6971620700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f696c05ff70 0x7f696c147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:44.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.785+0000 7f6971620700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f696c05ff70 0x7f696c147fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36218/0 (socket says 172.21.15.36:36218) 2022-01-10T01:27:44.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.785+0000 7f6971620700 1 -- 172.21.15.36:0/2043003741 learned_addr learned my addr 172.21.15.36:0/2043003741 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:44.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.785+0000 7f6970e1f700 1 --2- 172.21.15.36:0/2043003741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c061d20 0x7f696c066280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:44.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.785+0000 7f6971e21700 1 --2- 172.21.15.36:0/2043003741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f696c0b3ac0 0x7f696c066770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:44.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.789+0000 7f6971620700 1 -- 172.21.15.36:0/2043003741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c061d20 msgr2=0x7f696c066280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:44.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.789+0000 7f6971620700 1 --2- 172.21.15.36:0/2043003741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c061d20 0x7f696c066280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:44.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.789+0000 7f6971620700 1 -- 172.21.15.36:0/2043003741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f696c0b3ac0 msgr2=0x7f696c066770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:44.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.789+0000 7f6971620700 1 --2- 172.21.15.36:0/2043003741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f696c0b3ac0 0x7f696c066770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:44.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.789+0000 7f6971620700 1 -- 172.21.15.36:0/2043003741 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696800b180 con 0x7f696c05ff70 2022-01-10T01:27:44.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.789+0000 7f6971620700 1 --2- 172.21.15.36:0/2043003741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f696c05ff70 0x7f696c147fe0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f6968002f70 tx=0x7f6968014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:44.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.789+0000 7f695a7fc700 1 -- 172.21.15.36:0/2043003741 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6968012930 con 0x7f696c05ff70 2022-01-10T01:27:44.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.789+0000 7f695a7fc700 1 -- 172.21.15.36:0/2043003741 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968012a90 con 0x7f696c05ff70 2022-01-10T01:27:44.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.789+0000 7f6973884700 1 -- 172.21.15.36:0/2043003741 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c142a40 con 0x7f696c05ff70 2022-01-10T01:27:44.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.789+0000 7f695a7fc700 1 -- 172.21.15.36:0/2043003741 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6968012df0 con 0x7f696c05ff70 2022-01-10T01:27:44.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.789+0000 7f6973884700 1 -- 172.21.15.36:0/2043003741 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c144260 con 0x7f696c05ff70 2022-01-10T01:27:44.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.789+0000 7f6973884700 1 -- 172.21.15.36:0/2043003741 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696c0b2ca0 con 0x7f696c05ff70 2022-01-10T01:27:44.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.789+0000 7f695a7fc700 1 -- 172.21.15.36:0/2043003741 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f696801c070 con 0x7f696c05ff70 2022-01-10T01:27:44.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.793+0000 7f695a7fc700 1 --2- 172.21.15.36:0/2043003741 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f694c0535f0 0x7f694c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:44.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.793+0000 7f695a7fc700 1 -- 172.21.15.36:0/2043003741 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f696806c2b0 con 0x7f696c05ff70 2022-01-10T01:27:44.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.793+0000 7f6970e1f700 1 --2- 172.21.15.36:0/2043003741 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f694c0535f0 0x7f694c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:44.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.793+0000 7f6970e1f700 1 --2- 172.21.15.36:0/2043003741 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f694c0535f0 0x7f694c055ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f695c00b000 tx=0x7f695c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:44.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.797+0000 7f695a7fc700 1 -- 172.21.15.36:0/2043003741 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f69680435a0 con 0x7f696c05ff70 2022-01-10T01:27:44.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.925+0000 7f6973884700 1 -- 172.21.15.36:0/2043003741 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f696c057350 con 0x7f696c05ff70 2022-01-10T01:27:44.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.929+0000 7f695a7fc700 1 -- 172.21.15.36:0/2043003741 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6968019020 con 0x7f696c05ff70 2022-01-10T01:27:44.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.933+0000 7f6973884700 1 -- 172.21.15.36:0/2043003741 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f694c0535f0 msgr2=0x7f694c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:44.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.933+0000 7f6973884700 1 --2- 172.21.15.36:0/2043003741 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f694c0535f0 0x7f694c055ab0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f695c00b000 tx=0x7f695c006df0).stop 2022-01-10T01:27:44.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.933+0000 7f6973884700 1 -- 172.21.15.36:0/2043003741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f696c05ff70 msgr2=0x7f696c147fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:44.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.933+0000 7f6973884700 1 --2- 172.21.15.36:0/2043003741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f696c05ff70 0x7f696c147fe0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f6968002f70 tx=0x7f6968014000).stop 2022-01-10T01:27:44.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.933+0000 7f6973884700 1 -- 172.21.15.36:0/2043003741 shutdown_connections 2022-01-10T01:27:44.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.933+0000 7f6973884700 1 --2- 172.21.15.36:0/2043003741 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f694c0535f0 0x7f694c055ab0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:44.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.933+0000 7f6973884700 1 --2- 172.21.15.36:0/2043003741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f696c0b3ac0 0x7f696c066770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:44.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.933+0000 7f6973884700 1 --2- 172.21.15.36:0/2043003741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f696c061d20 0x7f696c066280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:44.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.933+0000 7f6973884700 1 --2- 172.21.15.36:0/2043003741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f696c05ff70 0x7f696c147fe0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:44.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.933+0000 7f6973884700 1 -- 172.21.15.36:0/2043003741 >> 172.21.15.36:0/2043003741 conn(0x7f696c0639b0 msgr2=0x7f696c141040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:44.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.933+0000 7f6973884700 1 -- 172.21.15.36:0/2043003741 shutdown_connections 2022-01-10T01:27:44.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:44.933+0000 7f6973884700 1 -- 172.21.15.36:0/2043003741 wait complete. 2022-01-10T01:27:44.946 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2022-01-10T01:27:45.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.045+0000 7f9eff59e700 1 Processor -- start 2022-01-10T01:27:45.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.045+0000 7f9eff59e700 1 -- start start 2022-01-10T01:27:45.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9eff59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f000b4aa0 0x7f9f000b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:45.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9eff59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f000b8090 con 0x7f9f00064a20 2022-01-10T01:27:45.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9eff59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f00143130 con 0x7f9f00064640 2022-01-10T01:27:45.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9eff59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f00142f40 con 0x7f9f000b4aa0 2022-01-10T01:27:45.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9efed9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9f00064a20 0x7f9f00066500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34024/0 (socket says 172.21.15.36:34024) 2022-01-10T01:27:45.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9efed9d700 1 -- 172.21.15.36:0/3937728792 learned_addr learned my addr 172.21.15.36:0/3937728792 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:45.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9efdd9b700 1 --2- 172.21.15.36:0/3937728792 >> v2:172.21.15.59:3300/0 conn(0x7f9f000b4aa0 0x7f9f000b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:45.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9efd59a700 1 -- 172.21.15.36:0/3937728792 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870023686 0 0) 0x7f9f000b8090 con 0x7f9f00064a20 2022-01-10T01:27:45.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9efd59a700 1 -- 172.21.15.36:0/3937728792 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ee4003260 con 0x7f9f00064a20 2022-01-10T01:27:45.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9efdd9b700 1 -- 172.21.15.36:0/3937728792 >> v1:172.21.15.59:6789/0 conn(0x7f9f00064640 legacy=0x7f9f00143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:45.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9efdd9b700 1 -- 172.21.15.36:0/3937728792 >> v1:172.21.15.36:6789/0 conn(0x7f9f00064a20 legacy=0x7f9f00066500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:45.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9efdd9b700 1 -- 172.21.15.36:0/3937728792 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f001433d0 con 0x7f9f000b4aa0 2022-01-10T01:27:45.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9efdd9b700 1 --2- 172.21.15.36:0/3937728792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f000b4aa0 0x7f9f000b3710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f9ef0002f70 tx=0x7f9ef0006df0).ready entity=mon.1 client_cookie=437ec5ab61ccf042 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:45.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9efd59a700 1 -- 172.21.15.36:0/3937728792 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ef000d610 con 0x7f9f000b4aa0 2022-01-10T01:27:45.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9efd59a700 1 -- 172.21.15.36:0/3937728792 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef0000e90 con 0x7f9f000b4aa0 2022-01-10T01:27:45.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9efd59a700 1 -- 172.21.15.36:0/3937728792 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ef000d960 con 0x7f9f000b4aa0 2022-01-10T01:27:45.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9eff59e700 1 -- 172.21.15.36:0/3937728792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f000b4aa0 msgr2=0x7f9f000b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:45.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9eff59e700 1 --2- 172.21.15.36:0/3937728792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f000b4aa0 0x7f9f000b3710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f9ef0002f70 tx=0x7f9ef0006df0).stop 2022-01-10T01:27:45.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9eff59e700 1 -- 172.21.15.36:0/3937728792 shutdown_connections 2022-01-10T01:27:45.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9eff59e700 1 --2- 172.21.15.36:0/3937728792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f000b4aa0 0x7f9f000b3710 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:45.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9eff59e700 1 -- 172.21.15.36:0/3937728792 >> 172.21.15.36:0/3937728792 conn(0x7f9f0005f6b0 msgr2=0x7f9f0005fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:45.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9eff59e700 1 -- 172.21.15.36:0/3937728792 shutdown_connections 2022-01-10T01:27:45.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.049+0000 7f9eff59e700 1 -- 172.21.15.36:0/3937728792 wait complete. 2022-01-10T01:27:45.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9eff59e700 1 Processor -- start 2022-01-10T01:27:45.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9eff59e700 1 -- start start 2022-01-10T01:27:45.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9eff59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f00064640 0x7f9f00062170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:45.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9eff59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f00064a20 0x7f9f001460d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:45.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9eff59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f000b4aa0 0x7f9f0013c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:45.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9eff59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f001449b0 con 0x7f9f00064a20 2022-01-10T01:27:45.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9eff59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f000b1070 con 0x7f9f00064640 2022-01-10T01:27:45.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9eff59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f000b1310 con 0x7f9f000b4aa0 2022-01-10T01:27:45.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9efdd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f00064a20 0x7f9f001460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:45.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9efdd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f00064a20 0x7f9f001460d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36232/0 (socket says 172.21.15.36:36232) 2022-01-10T01:27:45.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9efdd9b700 1 -- 172.21.15.36:0/2805862899 learned_addr learned my addr 172.21.15.36:0/2805862899 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:45.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9efed9d700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f000b4aa0 0x7f9f0013c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:45.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9efe59c700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f00064640 0x7f9f00062170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:45.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9efdd9b700 1 -- 172.21.15.36:0/2805862899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f000b4aa0 msgr2=0x7f9f0013c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:45.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9efdd9b700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f000b4aa0 0x7f9f0013c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:45.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9efdd9b700 1 -- 172.21.15.36:0/2805862899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f00064640 msgr2=0x7f9f00062170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:45.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9efdd9b700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f00064640 0x7f9f00062170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:45.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9efdd9b700 1 -- 172.21.15.36:0/2805862899 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef000b180 con 0x7f9f00064a20 2022-01-10T01:27:45.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9efe59c700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f00064640 0x7f9f00062170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:27:45.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9efdd9b700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f00064a20 0x7f9f001460d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f9ef0002f70 tx=0x7f9ef0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:45.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9eef7fe700 1 -- 172.21.15.36:0/2805862899 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ef000d290 con 0x7f9f00064a20 2022-01-10T01:27:45.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9eef7fe700 1 -- 172.21.15.36:0/2805862899 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef0013e90 con 0x7f9f00064a20 2022-01-10T01:27:45.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9eff59e700 1 -- 172.21.15.36:0/2805862899 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f001446a0 con 0x7f9f00064a20 2022-01-10T01:27:45.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9eef7fe700 1 -- 172.21.15.36:0/2805862899 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ef001e5f0 con 0x7f9f00064a20 2022-01-10T01:27:45.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.053+0000 7f9eff59e700 1 -- 172.21.15.36:0/2805862899 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f00144340 con 0x7f9f00064a20 2022-01-10T01:27:45.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.057+0000 7f9eff59e700 1 -- 172.21.15.36:0/2805862899 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f000b14d0 con 0x7f9f00064a20 2022-01-10T01:27:45.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.057+0000 7f9eef7fe700 1 -- 172.21.15.36:0/2805862899 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9ef0025030 con 0x7f9f00064a20 2022-01-10T01:27:45.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.057+0000 7f9eef7fe700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9edc0534d0 0x7f9edc055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:45.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.057+0000 7f9eef7fe700 1 -- 172.21.15.36:0/2805862899 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f9ef006c5c0 con 0x7f9f00064a20 2022-01-10T01:27:45.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.057+0000 7f9efe59c700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9edc0534d0 0x7f9edc055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:45.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.057+0000 7f9efe59c700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9edc0534d0 0x7f9edc055990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f9ef400b000 tx=0x7f9ef4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:45.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.065+0000 7f9eef7fe700 1 -- 172.21.15.36:0/2805862899 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ef00437a0 con 0x7f9f00064a20 2022-01-10T01:27:45.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.237+0000 7f9eff59e700 1 -- 172.21.15.36:0/2805862899 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f9f000b7d40 con 0x7f9f00064a20 2022-01-10T01:27:45.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.653+0000 7f9eef7fe700 1 -- 172.21.15.36:0/2805862899 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v156) v1 ==== 144+0+0 (secure 0 0 0) 0x7f9ef0023020 con 0x7f9f00064a20 2022-01-10T01:27:45.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.657+0000 7f9eff59e700 1 -- 172.21.15.36:0/2805862899 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9edc0534d0 msgr2=0x7f9edc055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:45.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.657+0000 7f9eff59e700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9edc0534d0 0x7f9edc055990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f9ef400b000 tx=0x7f9ef4009040).stop 2022-01-10T01:27:45.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.657+0000 7f9eff59e700 1 -- 172.21.15.36:0/2805862899 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f00064a20 msgr2=0x7f9f001460d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:45.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.657+0000 7f9eff59e700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f00064a20 0x7f9f001460d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f9ef0002f70 tx=0x7f9ef0014000).stop 2022-01-10T01:27:45.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.657+0000 7f9eff59e700 1 -- 172.21.15.36:0/2805862899 shutdown_connections 2022-01-10T01:27:45.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.657+0000 7f9eff59e700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9edc0534d0 0x7f9edc055990 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:45.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.657+0000 7f9eff59e700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f000b4aa0 0x7f9f0013c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:45.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.657+0000 7f9eff59e700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f00064a20 0x7f9f001460d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:45.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.657+0000 7f9eff59e700 1 --2- 172.21.15.36:0/2805862899 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f00064640 0x7f9f00062170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:45.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.657+0000 7f9eff59e700 1 -- 172.21.15.36:0/2805862899 >> 172.21.15.36:0/2805862899 conn(0x7f9f0005f6b0 msgr2=0x7f9f0005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:45.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.657+0000 7f9eff59e700 1 -- 172.21.15.36:0/2805862899 shutdown_connections 2022-01-10T01:27:45.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.657+0000 7f9eff59e700 1 -- 172.21.15.36:0/2805862899 wait complete. 2022-01-10T01:27:45.674 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2022-01-10T01:27:45.675 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2022-01-10T01:27:45.675 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2022-01-10T01:27:45.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f154a019700 1 Processor -- start 2022-01-10T01:27:45.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f154a019700 1 -- start start 2022-01-10T01:27:45.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f154a019700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f15440b30d0 0x7f1544143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:45.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f154a019700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15440ace70 0x7f154413f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:45.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f154a019700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1544143920 con 0x7f15440b0710 2022-01-10T01:27:45.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f154a019700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15440b0af0 con 0x7f15440b30d0 2022-01-10T01:27:45.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f154a019700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15440ae680 con 0x7f15440ace70 2022-01-10T01:27:45.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f1548816700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f15440b30d0 0x7f1544143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:45.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f1548816700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f15440b30d0 0x7f1544143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36242/0 (socket says 172.21.15.36:36242) 2022-01-10T01:27:45.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f1548816700 1 -- 172.21.15.36:0/2609010195 learned_addr learned my addr 172.21.15.36:0/2609010195 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:45.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f1549818700 1 --2- 172.21.15.36:0/2609010195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15440ace70 0x7f154413f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:45.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f1548816700 1 -- 172.21.15.36:0/2609010195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15440ace70 msgr2=0x7f154413f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:45.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f1548816700 1 --2- 172.21.15.36:0/2609010195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15440ace70 0x7f154413f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:45.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f1548816700 1 -- 172.21.15.36:0/2609010195 >> v1:172.21.15.59:6789/0 conn(0x7f15440b0710 legacy=0x7f1544142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:45.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f1548816700 1 -- 172.21.15.36:0/2609010195 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15440ae920 con 0x7f15440b30d0 2022-01-10T01:27:45.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f1543fff700 1 -- 172.21.15.36:0/2609010195 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880184508 0 0) 0x7f1544143920 con 0x7f15440b0710 2022-01-10T01:27:45.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f1548816700 1 --2- 172.21.15.36:0/2609010195 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15440b30d0 0x7f1544143430 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f1538002f70 tx=0x7f1538006eb0).ready entity=mon.0 client_cookie=1be10dddb926fa6c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:45.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f1543fff700 1 -- 172.21.15.36:0/2609010195 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f153800d570 con 0x7f15440b30d0 2022-01-10T01:27:45.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f1543fff700 1 -- 172.21.15.36:0/2609010195 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1538000e90 con 0x7f15440b30d0 2022-01-10T01:27:45.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.789+0000 7f1543fff700 1 -- 172.21.15.36:0/2609010195 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f153800d8c0 con 0x7f15440b30d0 2022-01-10T01:27:45.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 -- 172.21.15.36:0/2609010195 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15440b30d0 msgr2=0x7f1544143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:45.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 --2- 172.21.15.36:0/2609010195 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15440b30d0 0x7f1544143430 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f1538002f70 tx=0x7f1538006eb0).stop 2022-01-10T01:27:45.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 -- 172.21.15.36:0/2609010195 shutdown_connections 2022-01-10T01:27:45.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 --2- 172.21.15.36:0/2609010195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15440ace70 0x7f154413f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:45.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 --2- 172.21.15.36:0/2609010195 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15440b30d0 0x7f1544143430 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:45.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 -- 172.21.15.36:0/2609010195 >> 172.21.15.36:0/2609010195 conn(0x7f1544061140 msgr2=0x7f1544062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:45.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 -- 172.21.15.36:0/2609010195 shutdown_connections 2022-01-10T01:27:45.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 -- 172.21.15.36:0/2609010195 wait complete. 2022-01-10T01:27:45.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 Processor -- start 2022-01-10T01:27:45.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 -- start start 2022-01-10T01:27:45.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15440ace70 0x7f15440644f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:45.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15440b0710 0x7f15441523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:45.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15440b30d0 0x7f15441528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:45.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1544152dc0 con 0x7f15440ace70 2022-01-10T01:27:45.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154413f220 con 0x7f15440b30d0 2022-01-10T01:27:45.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f154a019700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1544140ae0 con 0x7f15440b0710 2022-01-10T01:27:45.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f1549017700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15440ace70 0x7f15440644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:45.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f1549017700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15440ace70 0x7f15440644f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36246/0 (socket says 172.21.15.36:36246) 2022-01-10T01:27:45.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f1549017700 1 -- 172.21.15.36:0/1484862383 learned_addr learned my addr 172.21.15.36:0/1484862383 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:45.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f1548816700 1 --2- 172.21.15.36:0/1484862383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15440b0710 0x7f15441523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:45.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f1549818700 1 --2- 172.21.15.36:0/1484862383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15440b30d0 0x7f15441528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:45.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f1549017700 1 -- 172.21.15.36:0/1484862383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15440b0710 msgr2=0x7f15441523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:45.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f1549017700 1 --2- 172.21.15.36:0/1484862383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15440b0710 0x7f15441523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:45.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f1549017700 1 -- 172.21.15.36:0/1484862383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15440b30d0 msgr2=0x7f15441528d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:45.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f1549017700 1 --2- 172.21.15.36:0/1484862383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15440b30d0 0x7f15441528d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:45.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f1549017700 1 -- 172.21.15.36:0/1484862383 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153800b1e0 con 0x7f15440ace70 2022-01-10T01:27:45.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.793+0000 7f1549017700 1 --2- 172.21.15.36:0/1484862383 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15440ace70 0x7f15440644f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f1534001250 tx=0x7f1534007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:45.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.797+0000 7f15427fc700 1 -- 172.21.15.36:0/1484862383 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f153400e4a0 con 0x7f15440ace70 2022-01-10T01:27:45.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.797+0000 7f15427fc700 1 -- 172.21.15.36:0/1484862383 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153400e600 con 0x7f15440ace70 2022-01-10T01:27:45.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.797+0000 7f154a019700 1 -- 172.21.15.36:0/1484862383 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154413ef80 con 0x7f15440ace70 2022-01-10T01:27:45.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.797+0000 7f15427fc700 1 -- 172.21.15.36:0/1484862383 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f153400e960 con 0x7f15440ace70 2022-01-10T01:27:45.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.797+0000 7f154a019700 1 -- 172.21.15.36:0/1484862383 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1544156650 con 0x7f15440ace70 2022-01-10T01:27:45.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.797+0000 7f154a019700 1 -- 172.21.15.36:0/1484862383 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154413ede0 con 0x7f15440ace70 2022-01-10T01:27:45.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.797+0000 7f15427fc700 1 -- 172.21.15.36:0/1484862383 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1534019030 con 0x7f15440ace70 2022-01-10T01:27:45.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.797+0000 7f15427fc700 1 --2- 172.21.15.36:0/1484862383 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1524053680 0x7f1524055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:45.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.797+0000 7f1548816700 1 --2- 172.21.15.36:0/1484862383 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1524053680 0x7f1524055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:45.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.797+0000 7f15427fc700 1 -- 172.21.15.36:0/1484862383 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f153406ad90 con 0x7f15440ace70 2022-01-10T01:27:45.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.797+0000 7f1548816700 1 --2- 172.21.15.36:0/1484862383 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1524053680 0x7f1524055b40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f153801c000 tx=0x7f1538015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:45.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.801+0000 7f15427fc700 1 -- 172.21.15.36:0/1484862383 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f154413ede0 con 0x7f15440ace70 2022-01-10T01:27:45.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:45.969+0000 7f154a019700 1 -- 172.21.15.36:0/1484862383 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f154413ede0 con 0x7f15440ace70 2022-01-10T01:27:46.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.661+0000 7f15427fc700 1 -- 172.21.15.36:0/1484862383 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v157) v1 ==== 155+0+0 (secure 0 0 0) 0x7f154413ede0 con 0x7f15440ace70 2022-01-10T01:27:46.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.665+0000 7f154a019700 1 -- 172.21.15.36:0/1484862383 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1524053680 msgr2=0x7f1524055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:46.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.665+0000 7f154a019700 1 --2- 172.21.15.36:0/1484862383 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1524053680 0x7f1524055b40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f153801c000 tx=0x7f1538015000).stop 2022-01-10T01:27:46.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.665+0000 7f154a019700 1 -- 172.21.15.36:0/1484862383 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15440ace70 msgr2=0x7f15440644f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:46.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.665+0000 7f154a019700 1 --2- 172.21.15.36:0/1484862383 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15440ace70 0x7f15440644f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f1534001250 tx=0x7f1534007e40).stop 2022-01-10T01:27:46.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.665+0000 7f154a019700 1 -- 172.21.15.36:0/1484862383 shutdown_connections 2022-01-10T01:27:46.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.665+0000 7f154a019700 1 --2- 172.21.15.36:0/1484862383 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1524053680 0x7f1524055b40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:46.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.665+0000 7f154a019700 1 --2- 172.21.15.36:0/1484862383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15440b30d0 0x7f15441528d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:46.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.665+0000 7f154a019700 1 --2- 172.21.15.36:0/1484862383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15440b0710 0x7f15441523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:46.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.665+0000 7f154a019700 1 --2- 172.21.15.36:0/1484862383 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15440ace70 0x7f15440644f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:46.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.665+0000 7f154a019700 1 -- 172.21.15.36:0/1484862383 >> 172.21.15.36:0/1484862383 conn(0x7f1544061140 msgr2=0x7f1544138ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:46.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.665+0000 7f154a019700 1 -- 172.21.15.36:0/1484862383 shutdown_connections 2022-01-10T01:27:46.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.665+0000 7f154a019700 1 -- 172.21.15.36:0/1484862383 wait complete. 2022-01-10T01:27:46.683 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2022-01-10T01:27:46.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.797+0000 7f2e2da7f700 1 Processor -- start 2022-01-10T01:27:46.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.797+0000 7f2e2da7f700 1 -- start start 2022-01-10T01:27:46.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2da7f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2e28060d20 0x7f2e2805f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:46.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2da7f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e28143c90 0x7f2e2812c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:46.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2da7f700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e280b3c40 con 0x7f2e280b21b0 2022-01-10T01:27:46.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2da7f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e28063df0 con 0x7f2e28060d20 2022-01-10T01:27:46.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2da7f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e280b2590 con 0x7f2e28143c90 2022-01-10T01:27:46.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e27fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2e28060d20 0x7f2e2805f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:46.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2ca7d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f2e280b21b0 0x7f2e280b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34048/0 (socket says 172.21.15.36:34048) 2022-01-10T01:27:46.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e27fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2e28060d20 0x7f2e2805f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36256/0 (socket says 172.21.15.36:36256) 2022-01-10T01:27:46.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2ca7d700 1 -- 172.21.15.36:0/2246232635 learned_addr learned my addr 172.21.15.36:0/2246232635 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:46.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2d27e700 1 --2- 172.21.15.36:0/2246232635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e28143c90 0x7f2e2812c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:46.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e27fff700 1 -- 172.21.15.36:0/2246232635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e28143c90 msgr2=0x7f2e2812c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:46.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e27fff700 1 --2- 172.21.15.36:0/2246232635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e28143c90 0x7f2e2812c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:46.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e27fff700 1 -- 172.21.15.36:0/2246232635 >> v1:172.21.15.36:6789/0 conn(0x7f2e280b21b0 legacy=0x7f2e280b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:46.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e27fff700 1 -- 172.21.15.36:0/2246232635 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e280b2e30 con 0x7f2e28060d20 2022-01-10T01:27:46.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e27fff700 1 --2- 172.21.15.36:0/2246232635 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e28060d20 0x7f2e2805f6b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f2e1c002f70 tx=0x7f2e1c006df0).ready entity=mon.0 client_cookie=6ae070693e67ef39 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:46.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e277fe700 1 -- 172.21.15.36:0/2246232635 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e1c00d570 con 0x7f2e28060d20 2022-01-10T01:27:46.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e277fe700 1 -- 172.21.15.36:0/2246232635 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c000e90 con 0x7f2e28060d20 2022-01-10T01:27:46.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e277fe700 1 -- 172.21.15.36:0/2246232635 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e1c00d8c0 con 0x7f2e28060d20 2022-01-10T01:27:46.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2246232635 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e28060d20 msgr2=0x7f2e2805f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:46.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2da7f700 1 --2- 172.21.15.36:0/2246232635 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e28060d20 0x7f2e2805f6b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f2e1c002f70 tx=0x7f2e1c006df0).stop 2022-01-10T01:27:46.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2246232635 shutdown_connections 2022-01-10T01:27:46.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2da7f700 1 --2- 172.21.15.36:0/2246232635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e28143c90 0x7f2e2812c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:46.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2da7f700 1 --2- 172.21.15.36:0/2246232635 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e28060d20 0x7f2e2805f6b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:46.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2246232635 >> 172.21.15.36:0/2246232635 conn(0x7f2e2805c490 msgr2=0x7f2e2805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:46.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2246232635 shutdown_connections 2022-01-10T01:27:46.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.801+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2246232635 wait complete. 2022-01-10T01:27:46.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2da7f700 1 Processor -- start 2022-01-10T01:27:46.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2da7f700 1 -- start start 2022-01-10T01:27:46.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2da7f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e28060d20 0x7f2e28145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:46.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2da7f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e280b21b0 0x7f2e280ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:46.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2da7f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e28143c90 0x7f2e280aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:46.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2da7f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e280af340 con 0x7f2e28143c90 2022-01-10T01:27:46.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2da7f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e28144e20 con 0x7f2e28060d20 2022-01-10T01:27:46.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2da7f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e28156670 con 0x7f2e280b21b0 2022-01-10T01:27:46.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2d27e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e28143c90 0x7f2e280aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:46.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2ca7d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e28060d20 0x7f2e28145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:46.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e27fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e280b21b0 0x7f2e280ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:46.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2ca7d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e28060d20 0x7f2e28145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:32894/0 (socket says 172.21.15.36:32894) 2022-01-10T01:27:46.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2d27e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e28143c90 0x7f2e280aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36264/0 (socket says 172.21.15.36:36264) 2022-01-10T01:27:46.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2ca7d700 1 -- 172.21.15.36:0/2009412779 learned_addr learned my addr 172.21.15.36:0/2009412779 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:46.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2d27e700 1 -- 172.21.15.36:0/2009412779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e280b21b0 msgr2=0x7f2e280ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:46.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2d27e700 1 --2- 172.21.15.36:0/2009412779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e280b21b0 0x7f2e280ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:46.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2d27e700 1 -- 172.21.15.36:0/2009412779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e28060d20 msgr2=0x7f2e28145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:46.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.805+0000 7f2e2d27e700 1 --2- 172.21.15.36:0/2009412779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e28060d20 0x7f2e28145330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:46.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.809+0000 7f2e2d27e700 1 -- 172.21.15.36:0/2009412779 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c00b180 con 0x7f2e28143c90 2022-01-10T01:27:46.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.809+0000 7f2e2ca7d700 1 --2- 172.21.15.36:0/2009412779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e28060d20 0x7f2e28145330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:27:46.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.809+0000 7f2e2d27e700 1 --2- 172.21.15.36:0/2009412779 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e28143c90 0x7f2e280aee50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f2e280af480 tx=0x7f2e200091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:46.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.809+0000 7f2e25ffb700 1 -- 172.21.15.36:0/2009412779 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e20012600 con 0x7f2e28143c90 2022-01-10T01:27:46.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.809+0000 7f2e25ffb700 1 -- 172.21.15.36:0/2009412779 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e20012760 con 0x7f2e28143c90 2022-01-10T01:27:46.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.809+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2009412779 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e281568d0 con 0x7f2e28143c90 2022-01-10T01:27:46.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.809+0000 7f2e25ffb700 1 -- 172.21.15.36:0/2009412779 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e20012ac0 con 0x7f2e28143c90 2022-01-10T01:27:46.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.809+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2009412779 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e281473d0 con 0x7f2e28143c90 2022-01-10T01:27:46.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.809+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2009412779 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e281459c0 con 0x7f2e28143c90 2022-01-10T01:27:46.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.809+0000 7f2e25ffb700 1 -- 172.21.15.36:0/2009412779 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2e20022070 con 0x7f2e28143c90 2022-01-10T01:27:46.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.809+0000 7f2e25ffb700 1 --2- 172.21.15.36:0/2009412779 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e08053560 0x7f2e08055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:46.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.809+0000 7f2e25ffb700 1 -- 172.21.15.36:0/2009412779 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f2e2006bd00 con 0x7f2e28143c90 2022-01-10T01:27:46.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.813+0000 7f2e2ca7d700 1 --2- 172.21.15.36:0/2009412779 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e08053560 0x7f2e08055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:46.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.813+0000 7f2e2ca7d700 1 --2- 172.21.15.36:0/2009412779 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e08053560 0x7f2e08055a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f2e1800d000 tx=0x7f2e18007c40).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:46.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.821+0000 7f2e25ffb700 1 -- 172.21.15.36:0/2009412779 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2e2006f030 con 0x7f2e28143c90 2022-01-10T01:27:46.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.949+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2009412779 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2e28061bd0 con 0x7f2e28143c90 2022-01-10T01:27:46.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.956+0000 7f2e25ffb700 1 -- 172.21.15.36:0/2009412779 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2e20016020 con 0x7f2e28143c90 2022-01-10T01:27:46.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.960+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2009412779 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e08053560 msgr2=0x7f2e08055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:46.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.960+0000 7f2e2da7f700 1 --2- 172.21.15.36:0/2009412779 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e08053560 0x7f2e08055a20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f2e1800d000 tx=0x7f2e18007c40).stop 2022-01-10T01:27:46.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.960+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2009412779 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e28143c90 msgr2=0x7f2e280aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:46.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.960+0000 7f2e2da7f700 1 --2- 172.21.15.36:0/2009412779 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e28143c90 0x7f2e280aee50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f2e280af480 tx=0x7f2e200091d0).stop 2022-01-10T01:27:46.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.960+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2009412779 shutdown_connections 2022-01-10T01:27:46.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.960+0000 7f2e2da7f700 1 --2- 172.21.15.36:0/2009412779 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e08053560 0x7f2e08055a20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:46.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.960+0000 7f2e2da7f700 1 --2- 172.21.15.36:0/2009412779 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e28143c90 0x7f2e280aee50 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:46.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.960+0000 7f2e2da7f700 1 --2- 172.21.15.36:0/2009412779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e280b21b0 0x7f2e280ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:46.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.960+0000 7f2e2da7f700 1 --2- 172.21.15.36:0/2009412779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e28060d20 0x7f2e28145330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:46.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.960+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2009412779 >> 172.21.15.36:0/2009412779 conn(0x7f2e2805c490 msgr2=0x7f2e2812bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:46.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.960+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2009412779 shutdown_connections 2022-01-10T01:27:46.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:46.960+0000 7f2e2da7f700 1 -- 172.21.15.36:0/2009412779 wait complete. 2022-01-10T01:27:46.979 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:27:46.980 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:27:46.997 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:27:47.019 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:27:47.041 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:27:47.060 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:27:47.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:27:47.061 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:27:47.061 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:27:47.068 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2022-01-10T01:27:47.069 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:27:47.070 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2022-01-10T01:27:47.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:27:47.071 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:27:47.071 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:27:47.077 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:27:47.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:27:47.079 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:27:47.080 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:27:47.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.180+0000 7f8e37199700 1 Processor -- start 2022-01-10T01:27:47.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.180+0000 7f8e37199700 1 -- start start 2022-01-10T01:27:47.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e37199700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e300b6290 0x7f8e30061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e37199700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8e30142e60 0x7f8e30143310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e37199700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e300b5f50 con 0x7f8e300b4060 2022-01-10T01:27:47.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e37199700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e300b1f70 con 0x7f8e30142e60 2022-01-10T01:27:47.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e37199700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e300b2210 con 0x7f8e300b6290 2022-01-10T01:27:47.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e36998700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8e30142e60 0x7f8e30143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e36197700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e300b6290 0x7f8e30061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e36998700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8e30142e60 0x7f8e30143310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36272/0 (socket says 172.21.15.36:36272) 2022-01-10T01:27:47.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e36998700 1 -- 172.21.15.36:0/3813080672 learned_addr learned my addr 172.21.15.36:0/3813080672 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:47.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e35195700 1 -- 172.21.15.36:0/3813080672 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227376149 0 0) 0x7f8e18001110 con 0x7f8e300b4060 2022-01-10T01:27:47.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e35195700 1 -- 172.21.15.36:0/3813080672 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e10003260 con 0x7f8e300b4060 2022-01-10T01:27:47.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e36197700 1 -- 172.21.15.36:0/3813080672 >> v2:172.21.15.36:3300/0 conn(0x7f8e30142e60 msgr2=0x7f8e30143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:47.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e36197700 1 --2- 172.21.15.36:0/3813080672 >> v2:172.21.15.36:3300/0 conn(0x7f8e30142e60 0x7f8e30143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e36197700 1 -- 172.21.15.36:0/3813080672 >> v1:172.21.15.59:6789/0 conn(0x7f8e300b4060 legacy=0x7f8e30061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e36197700 1 -- 172.21.15.36:0/3813080672 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e300b24b0 con 0x7f8e300b6290 2022-01-10T01:27:47.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e36998700 1 --2- 172.21.15.36:0/3813080672 >> v2:172.21.15.36:3300/0 conn(0x7f8e30142e60 0x7f8e30143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:27:47.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e36197700 1 --2- 172.21.15.36:0/3813080672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e300b6290 0x7f8e30061470 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8e200032f0 tx=0x7f8e200091d0).ready entity=mon.2 client_cookie=370dd137fc0eddf5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:47.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e35195700 1 -- 172.21.15.36:0/3813080672 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e2000b600 con 0x7f8e300b6290 2022-01-10T01:27:47.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e35195700 1 -- 172.21.15.36:0/3813080672 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2000b760 con 0x7f8e300b6290 2022-01-10T01:27:47.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e35195700 1 -- 172.21.15.36:0/3813080672 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e2000b8d0 con 0x7f8e300b6290 2022-01-10T01:27:47.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e37199700 1 -- 172.21.15.36:0/3813080672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e300b6290 msgr2=0x7f8e30061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e37199700 1 --2- 172.21.15.36:0/3813080672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e300b6290 0x7f8e30061470 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8e200032f0 tx=0x7f8e200091d0).stop 2022-01-10T01:27:47.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e37199700 1 -- 172.21.15.36:0/3813080672 shutdown_connections 2022-01-10T01:27:47.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e37199700 1 --2- 172.21.15.36:0/3813080672 >> v2:172.21.15.36:3300/0 conn(0x7f8e30142e60 0x7f8e30143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e37199700 1 --2- 172.21.15.36:0/3813080672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e300b6290 0x7f8e30061470 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e37199700 1 -- 172.21.15.36:0/3813080672 >> 172.21.15.36:0/3813080672 conn(0x7f8e3005c490 msgr2=0x7f8e3005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:47.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e37199700 1 -- 172.21.15.36:0/3813080672 shutdown_connections 2022-01-10T01:27:47.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.184+0000 7f8e37199700 1 -- 172.21.15.36:0/3813080672 wait complete. 2022-01-10T01:27:47.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e37199700 1 Processor -- start 2022-01-10T01:27:47.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e37199700 1 -- start start 2022-01-10T01:27:47.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e37199700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e300b4060 0x7f8e300b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e37199700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e300b6290 0x7f8e3015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e37199700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e30142e60 0x7f8e3015a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e37199700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e30145ae0 con 0x7f8e30142e60 2022-01-10T01:27:47.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e37199700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e301464f0 con 0x7f8e300b4060 2022-01-10T01:27:47.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e37199700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e30146f00 con 0x7f8e300b6290 2022-01-10T01:27:47.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e36998700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e30142e60 0x7f8e3015a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e36998700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e30142e60 0x7f8e3015a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36274/0 (socket says 172.21.15.36:36274) 2022-01-10T01:27:47.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e36998700 1 -- 172.21.15.36:0/881660740 learned_addr learned my addr 172.21.15.36:0/881660740 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:47.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e36197700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e300b4060 0x7f8e300b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e35996700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e300b6290 0x7f8e3015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e36998700 1 -- 172.21.15.36:0/881660740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e300b6290 msgr2=0x7f8e3015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e36998700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e300b6290 0x7f8e3015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e36998700 1 -- 172.21.15.36:0/881660740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e300b4060 msgr2=0x7f8e300b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e36998700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e300b4060 0x7f8e300b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e36998700 1 -- 172.21.15.36:0/881660740 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2800b1e0 con 0x7f8e30142e60 2022-01-10T01:27:47.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e35996700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e300b6290 0x7f8e3015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:27:47.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e36998700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e30142e60 0x7f8e3015a670 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f8e2800c000 tx=0x7f8e28006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:47.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e2f7fe700 1 -- 172.21.15.36:0/881660740 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e2800c640 con 0x7f8e30142e60 2022-01-10T01:27:47.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e2f7fe700 1 -- 172.21.15.36:0/881660740 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2800c7a0 con 0x7f8e30142e60 2022-01-10T01:27:47.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e2f7fe700 1 -- 172.21.15.36:0/881660740 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e2800cb00 con 0x7f8e30142e60 2022-01-10T01:27:47.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e37199700 1 -- 172.21.15.36:0/881660740 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e20009470 con 0x7f8e30142e60 2022-01-10T01:27:47.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.188+0000 7f8e37199700 1 -- 172.21.15.36:0/881660740 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e301454b0 con 0x7f8e30142e60 2022-01-10T01:27:47.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.192+0000 7f8e37199700 1 -- 172.21.15.36:0/881660740 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e30159f20 con 0x7f8e30142e60 2022-01-10T01:27:47.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.192+0000 7f8e2f7fe700 1 -- 172.21.15.36:0/881660740 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8e28022070 con 0x7f8e30142e60 2022-01-10T01:27:47.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.192+0000 7f8e2f7fe700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8e14053590 0x7f8e14055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.192+0000 7f8e2f7fe700 1 -- 172.21.15.36:0/881660740 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f8e2806bc90 con 0x7f8e30142e60 2022-01-10T01:27:47.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.192+0000 7f8e36197700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8e14053590 0x7f8e14055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.192+0000 7f8e36197700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8e14053590 0x7f8e14055a50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f8e20019000 tx=0x7f8e20016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:47.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.196+0000 7f8e2f7fe700 1 -- 172.21.15.36:0/881660740 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8e28042f80 con 0x7f8e30142e60 2022-01-10T01:27:47.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.324+0000 7f8e37199700 1 -- 172.21.15.36:0/881660740 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8e300b2750 con 0x7f8e30142e60 2022-01-10T01:27:47.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.328+0000 7f8e2f7fe700 1 -- 172.21.15.36:0/881660740 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+29219 (secure 0 0 0) 0x7f8e28016020 con 0x7f8e30142e60 2022-01-10T01:27:47.331 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:47.331 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:27:47.331 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 49, 2022-01-10T01:27:47.332 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:27:47.332 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:27:47.332 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:27:44.638444+0000", 2022-01-10T01:27:47.333 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:27:47.333 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:27:47.333 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:27:47.333 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:27:47.334 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:27:47.334 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:27:47.334 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:27:47.334 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:27:47.334 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:27:47.335 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:27:47.335 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:27:47.335 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:27:47.335 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:27:47.336 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:27:47.336 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:27:47.336 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 8, 2022-01-10T01:27:47.336 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:27:47.336 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:27:47.337 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:27:47.337 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:27:47.337 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:27:47.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.337 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:27:47.338 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:27:47.338 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:27:47.338 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:27:47.338 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:27:47.338 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:27:47.339 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:27:47.339 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:27:47.339 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:27:47.339 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:27:47.340 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:27:47.340 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:27:47.340 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:27:47.340 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:27:47.340 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:27:47.341 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:27:47.341 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:27:47.341 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:27:47.341 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:27:47.341 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:27:47.342 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:27:47.342 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:27:47.342 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:27:47.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.343 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:27:47.343 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:27:47.343 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:27:47.343 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:27:47.343 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:27:47.344 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:27:47.344 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:27:47.344 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:27:47.344 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:27:47.345 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:27:47.345 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:27:47.345 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:27:47.345 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:27:47.345 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:27:47.346 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:27:47.346 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:27:47.346 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:27:47.346 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:27:47.347 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:27:47.347 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:27:47.347 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:27:47.347 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:27:47.347 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:27:47.348 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:27:47.348 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:27:47.348 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:27:47.348 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:27:47.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.349 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:27:47.349 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:27:47.349 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:27:47.349 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:27:47.350 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:27:47.350 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:27:47.350 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:27:47.350 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:27:47.350 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:27:47.351 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:27:47.351 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:27:47.351 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:27:47.351 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:27:47.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.352 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:27:47.352 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:27:47.352 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.353 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:27:47.353 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:27:47.354 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:27:47.354 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:27:47.355 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:27:47.355 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:27:47.355 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:27:47.355 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:27:47.355 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:27:47.356 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:27:47.356 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:27:47.356 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:27:47.356 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:27:47.357 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:27:47.357 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:27:47.357 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:27:47.357 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:27:47.357 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:27:47.358 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:27:47.358 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:27:47.358 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:27:47.358 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:27:47.358 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:27:47.359 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.359 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:27:47.359 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:27:47.359 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:27:47.360 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:27:47.360 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:27:47.360 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:27:47.360 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:27:47.360 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:27:47.361 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:27:47.361 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:27:47.361 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:27:47.361 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:27:47.361 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:27:47.362 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:27:47.362 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:27:47.362 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:27:47.362 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:27:47.363 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:27:47.363 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:27:47.363 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:27:47.363 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:27:47.364 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:27:47.364 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:27:47.364 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:27:47.364 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:27:47.365 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:27:47.365 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:27:47.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.365 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:27:47.366 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:27:47.366 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:27:47.366 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:27:47.366 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:27:47.367 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:27:47.367 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:27:47.367 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:27:47.367 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:27:47.368 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:27:47.368 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:27:47.368 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:27:47.368 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:27:47.368 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:27:47.369 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.369 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.369 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:27:47.369 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:27:47.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.370 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:27:47.370 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:27:47.370 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:47.370 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:47.371 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:47.371 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:47.371 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:47.371 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:47.372 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:47.372 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 33, 2022-01-10T01:27:47.372 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:47.372 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:47.372 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:47.373 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.373 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.373 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:27:47.373 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:47.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.374 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.374 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:27:47.375 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:47.375 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.375 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.375 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:47.376 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.376 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.376 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:27:47.377 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:47.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.377 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.377 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:27:47.378 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:47.378 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.378 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.378 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:47.379 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.379 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.379 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:27:47.380 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:47.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.380 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.380 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:27:47.381 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:47.381 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.381 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.381 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:47.382 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.382 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.382 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.382 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:27:47.383 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:47.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.383 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.383 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:27:47.384 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:27:47.384 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.384 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.384 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:27:47.385 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:27:47.385 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:27:47.385 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:27:47.385 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:47.386 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:47.386 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:47.386 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.387 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:27:47.387 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:27:47.387 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:47.387 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:47.387 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:47.388 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:47.388 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:47.388 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:47.388 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:47.389 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 43, 2022-01-10T01:27:47.389 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:47.389 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:47.389 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:47.389 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.390 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.390 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:27:47.390 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:47.391 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.391 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.391 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:27:47.391 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:47.392 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.392 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.392 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:47.392 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.393 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.393 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.393 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:27:47.393 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:47.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.394 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.394 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:27:47.394 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:47.395 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.395 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.395 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:47.396 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.396 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.396 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:27:47.396 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:47.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.397 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.397 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:27:47.398 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:47.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.398 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.398 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:47.399 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.399 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.399 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:27:47.400 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:47.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.400 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.400 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.400 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:27:47.401 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:27:47.401 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.401 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.401 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.401 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:27:47.402 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:27:47.402 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:27:47.402 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:27:47.402 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:47.403 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:47.403 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:47.403 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.404 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:27:47.404 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:27:47.404 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:47.404 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:47.405 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:47.405 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:47.405 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:47.405 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:47.405 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:47.406 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 43, 2022-01-10T01:27:47.406 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:47.406 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:47.406 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:47.407 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.407 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.407 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:27:47.407 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:47.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.408 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.408 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:27:47.409 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:47.409 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.409 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.409 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:47.410 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.410 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.410 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.410 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:27:47.411 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:47.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.411 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.412 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:27:47.412 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:47.412 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.412 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.413 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:47.413 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.413 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.413 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:27:47.414 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:47.414 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.414 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.415 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:27:47.415 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:47.415 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.415 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.416 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:47.416 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.417 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.417 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:27:47.417 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:47.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.418 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.418 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:27:47.418 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:27:47.418 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.419 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.419 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:27:47.419 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:27:47.420 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:27:47.420 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:27:47.420 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:47.420 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:47.420 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:47.421 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.421 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:27:47.422 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:27:47.422 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:47.422 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:47.422 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:47.423 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:47.423 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:47.423 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:47.423 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:47.423 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 42, 2022-01-10T01:27:47.424 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:47.424 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:47.424 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:47.424 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.425 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.425 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:27:47.425 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:47.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.426 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.426 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:27:47.426 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:47.427 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.427 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.427 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:47.428 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.428 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.428 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:27:47.428 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:47.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.429 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.429 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:27:47.429 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:47.430 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.430 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.430 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:47.431 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.431 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.431 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.431 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:27:47.431 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:47.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.432 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.432 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:27:47.433 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:47.433 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.433 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.434 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:47.434 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.434 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.434 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:27:47.435 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:47.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.435 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.436 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:27:47.436 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:27:47.436 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.436 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.437 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:27:47.437 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:27:47.437 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:27:47.437 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:27:47.437 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:47.438 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:47.438 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:47.438 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.439 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:27:47.439 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:27:47.439 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:47.439 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:47.440 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:47.440 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:47.440 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:47.440 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:47.440 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:47.441 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 42, 2022-01-10T01:27:47.441 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:47.441 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:47.441 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:47.441 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.442 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.442 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:27:47.442 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:47.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.443 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.443 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:27:47.443 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:47.443 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.444 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.444 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:47.444 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.445 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.445 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.445 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:27:47.445 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:47.445 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.446 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.446 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:27:47.446 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:47.447 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.447 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.447 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:47.447 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.448 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.448 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:27:47.448 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:47.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.449 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.449 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:27:47.449 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:47.450 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.450 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.450 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:47.451 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.451 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.451 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:27:47.451 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:47.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.452 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.452 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:27:47.453 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:27:47.453 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.453 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.453 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:27:47.454 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:27:47.454 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:27:47.454 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:27:47.454 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:47.454 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:47.455 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:47.455 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.456 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:27:47.456 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:27:47.456 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:47.456 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:47.456 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:47.456 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:47.457 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:47.457 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:47.457 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:47.457 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 43, 2022-01-10T01:27:47.457 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:47.458 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:47.458 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:47.458 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.459 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.459 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:27:47.459 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:47.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.460 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.460 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:27:47.460 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:47.460 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.460 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.461 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:47.461 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.462 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.462 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:27:47.462 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:47.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.463 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.463 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:27:47.463 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:47.463 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.463 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.464 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:47.464 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.464 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.465 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:27:47.465 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:47.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.466 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.466 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:27:47.466 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:47.466 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.466 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.467 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:47.467 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.467 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.468 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:27:47.468 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:47.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.469 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.469 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:27:47.469 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:27:47.469 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.469 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.470 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:27:47.470 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:27:47.470 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:27:47.470 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:27:47.471 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:47.471 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:47.471 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:47.471 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.472 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:27:47.472 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:27:47.472 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:47.473 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:47.473 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:47.473 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:47.473 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:47.473 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:47.474 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:47.474 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 43, 2022-01-10T01:27:47.474 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:47.474 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:47.475 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:47.475 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.475 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.475 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:27:47.476 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:47.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.476 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.476 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:27:47.477 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:47.477 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.477 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.478 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:47.478 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.478 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.479 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:27:47.479 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:47.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.479 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.480 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:27:47.480 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:47.480 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.480 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.481 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:47.481 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.481 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.481 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:27:47.482 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:47.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.482 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.483 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:27:47.483 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:47.483 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.483 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.484 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:47.484 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.484 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.485 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:27:47.485 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:47.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.485 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.486 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:27:47.486 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:27:47.486 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.486 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.487 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:27:47.487 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:27:47.487 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:27:47.487 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:27:47.488 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:47.488 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:47.488 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:47.488 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.489 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:27:47.489 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:27:47.489 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:27:47.490 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:27:47.490 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:27:47.490 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:27:47.490 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:27:47.490 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:27:47.491 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:27:47.491 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 43, 2022-01-10T01:27:47.491 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:27:47.491 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:27:47.491 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:27:47.492 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.492 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.492 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:27:47.493 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:47.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.493 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.493 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:27:47.494 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:47.494 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.494 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.495 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:27:47.495 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.495 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.495 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:27:47.496 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:47.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.496 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.496 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:27:47.497 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:47.497 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.497 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.497 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:27:47.498 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.498 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.498 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:27:47.499 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:47.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.499 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.499 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:27:47.500 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:47.500 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.500 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.500 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:27:47.501 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:27:47.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.501 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:27:47.501 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:27:47.501 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:47.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.502 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:27:47.502 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:27:47.503 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:27:47.503 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.503 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.503 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.504 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:27:47.504 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:27:47.504 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:27:47.504 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:27:47.504 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:27:47.505 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:27:47.505 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:27:47.505 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:47.505 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.505 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:27:47.506 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:27:47.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.506 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:27:47.506 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:47.507 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:47.507 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:47.507 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:47.507 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:47.507 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:27:47.508 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:47.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.508 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:27:47.508 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:47.509 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:47.509 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:47.509 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:47.509 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:47.509 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:27:47.509 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:47.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.510 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:27:47.510 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:47.510 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:47.511 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:47.511 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:47.511 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:47.511 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:27:47.511 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:47.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.512 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:27:47.512 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:47.512 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:47.513 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:47.513 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:47.513 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:47.513 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:27:47.513 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:47.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.514 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:27:47.514 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:47.515 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:47.515 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:47.515 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:47.515 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:47.515 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:27:47.515 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:47.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.516 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:27:47.516 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:47.516 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:47.517 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:47.517 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:47.517 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:47.517 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:27:47.517 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:47.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.518 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:27:47.518 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:47.518 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:47.519 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:47.519 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:47.519 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:47.519 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:27:47.519 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:47.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:47.520 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:27:47.520 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:27:47.520 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:27:47.521 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:27:47.521 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:27:47.521 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:27:47.521 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:27:47.521 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:27:47.522 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.522 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:27:47.522 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:27:47.522 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:27:47.522 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:27:47.523 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:27:47.523 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": { 2022-01-10T01:27:47.523 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.59:6833/3873482962": "2022-01-11T01:27:40.634789+0000", 2022-01-10T01:27:47.523 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.59:6832/3873482962": "2022-01-11T01:27:40.634789+0000" 2022-01-10T01:27:47.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.524 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:27:47.524 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:27:47.524 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:27:47.524 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:27:47.524 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:27:47.525 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:27:47.525 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:27:47.525 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:27:47.525 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:27:47.525 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:27:47.526 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:27:47.526 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:27:47.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.526 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:27:47.527 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:27:47.527 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:27:47.527 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:27:47.527 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:27:47.527 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:27:47.528 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:27:47.528 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:47.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:47.528 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:27:47.528 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:27:47.529 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:27:47.529 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:27:47.529 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:27:47.529 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:27:47.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.328+0000 7f8e37199700 1 -- 172.21.15.36:0/881660740 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8e14053590 msgr2=0x7f8e14055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.328+0000 7f8e37199700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8e14053590 0x7f8e14055a50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f8e20019000 tx=0x7f8e20016000).stop 2022-01-10T01:27:47.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.328+0000 7f8e37199700 1 -- 172.21.15.36:0/881660740 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e30142e60 msgr2=0x7f8e3015a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.328+0000 7f8e37199700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e30142e60 0x7f8e3015a670 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f8e2800c000 tx=0x7f8e28006eb0).stop 2022-01-10T01:27:47.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.328+0000 7f8e37199700 1 -- 172.21.15.36:0/881660740 shutdown_connections 2022-01-10T01:27:47.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.328+0000 7f8e37199700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8e14053590 0x7f8e14055a50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.328+0000 7f8e37199700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e30142e60 0x7f8e3015a670 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.328+0000 7f8e37199700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e300b6290 0x7f8e3015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.328+0000 7f8e37199700 1 --2- 172.21.15.36:0/881660740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e300b4060 0x7f8e300b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.328+0000 7f8e37199700 1 -- 172.21.15.36:0/881660740 >> 172.21.15.36:0/881660740 conn(0x7f8e3005c490 msgr2=0x7f8e30140d00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:47.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.328+0000 7f8e37199700 1 -- 172.21.15.36:0/881660740 shutdown_connections 2022-01-10T01:27:47.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.328+0000 7f8e37199700 1 -- 172.21.15.36:0/881660740 wait complete. 2022-01-10T01:27:47.535 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:27:47.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd3fff700 1 Processor -- start 2022-01-10T01:27:47.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd3fff700 1 -- start start 2022-01-10T01:27:47.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddd40b25a0 0x7fddd4066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd4066a10 0x7fddd4066e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd3fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd4065330 con 0x7fddd40b3000 2022-01-10T01:27:47.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd3fff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd4062000 con 0x7fddd40b25a0 2022-01-10T01:27:47.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd3fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40b33e0 con 0x7fddd4066a10 2022-01-10T01:27:47.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd27fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddd40b25a0 0x7fddd4066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd4066a10 0x7fddd4066e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd2ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fddd40b3000 0x7fddd4060b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:51752/0 (socket says 172.21.15.36:51752) 2022-01-10T01:27:47.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd27fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fddd40b25a0 0x7fddd4066520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:32918/0 (socket says 172.21.15.36:32918) 2022-01-10T01:27:47.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd2ffd700 1 -- 172.21.15.36:0/488900109 learned_addr learned my addr 172.21.15.36:0/488900109 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:47.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd37fe700 1 -- 172.21.15.36:0/488900109 >> v2:172.21.15.59:3300/0 conn(0x7fddd40b25a0 msgr2=0x7fddd4066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:47.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd37fe700 1 --2- 172.21.15.36:0/488900109 >> v2:172.21.15.59:3300/0 conn(0x7fddd40b25a0 0x7fddd4066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd37fe700 1 -- 172.21.15.36:0/488900109 >> v1:172.21.15.59:6789/0 conn(0x7fddd40b3000 legacy=0x7fddd4060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd37fe700 1 -- 172.21.15.36:0/488900109 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd405fa60 con 0x7fddd4066a10 2022-01-10T01:27:47.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd37fe700 1 --2- 172.21.15.36:0/488900109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd4066a10 0x7fddd4066e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fddcc002f70 tx=0x7fddcc006df0).ready entity=mon.2 client_cookie=80158c160cec0f49 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:47.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd1ffb700 1 -- 172.21.15.36:0/488900109 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddcc00d570 con 0x7fddd4066a10 2022-01-10T01:27:47.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd1ffb700 1 -- 172.21.15.36:0/488900109 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc000e90 con 0x7fddd4066a10 2022-01-10T01:27:47.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.640+0000 7fddd1ffb700 1 -- 172.21.15.36:0/488900109 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddcc00d8c0 con 0x7fddd4066a10 2022-01-10T01:27:47.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 -- 172.21.15.36:0/488900109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd4066a10 msgr2=0x7fddd4066e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 --2- 172.21.15.36:0/488900109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd4066a10 0x7fddd4066e50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fddcc002f70 tx=0x7fddcc006df0).stop 2022-01-10T01:27:47.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 -- 172.21.15.36:0/488900109 shutdown_connections 2022-01-10T01:27:47.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 --2- 172.21.15.36:0/488900109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd4066a10 0x7fddd4066e50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 --2- 172.21.15.36:0/488900109 >> v2:172.21.15.59:3300/0 conn(0x7fddd40b25a0 0x7fddd4066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 -- 172.21.15.36:0/488900109 >> 172.21.15.36:0/488900109 conn(0x7fddd40636e0 msgr2=0x7fddd4063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:47.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 -- 172.21.15.36:0/488900109 shutdown_connections 2022-01-10T01:27:47.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 -- 172.21.15.36:0/488900109 wait complete. 2022-01-10T01:27:47.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 Processor -- start 2022-01-10T01:27:47.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 -- start start 2022-01-10T01:27:47.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fddd4066a10 0x7fddd40a7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd40b25a0 0x7fddd41529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd40b3000 0x7fddd4155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40a7d30 con 0x7fddd4066a10 2022-01-10T01:27:47.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40a7fd0 con 0x7fddd40b25a0 2022-01-10T01:27:47.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd3fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4152550 con 0x7fddd40b3000 2022-01-10T01:27:47.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd2ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fddd4066a10 0x7fddd40a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd2ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fddd4066a10 0x7fddd40a7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36288/0 (socket says 172.21.15.36:36288) 2022-01-10T01:27:47.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd2ffd700 1 -- 172.21.15.36:0/3444789807 learned_addr learned my addr 172.21.15.36:0/3444789807 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:47.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd37fe700 1 --2- 172.21.15.36:0/3444789807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd40b3000 0x7fddd4155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd27fc700 1 --2- 172.21.15.36:0/3444789807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd40b25a0 0x7fddd41529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd2ffd700 1 -- 172.21.15.36:0/3444789807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd40b3000 msgr2=0x7fddd4155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd2ffd700 1 --2- 172.21.15.36:0/3444789807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd40b3000 0x7fddd4155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd2ffd700 1 -- 172.21.15.36:0/3444789807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd40b25a0 msgr2=0x7fddd41529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd2ffd700 1 --2- 172.21.15.36:0/3444789807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd40b25a0 0x7fddd41529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd2ffd700 1 -- 172.21.15.36:0/3444789807 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc00b180 con 0x7fddd4066a10 2022-01-10T01:27:47.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.644+0000 7fddd2ffd700 1 --2- 172.21.15.36:0/3444789807 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fddd4066a10 0x7fddd40a7280 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fddd4063350 tx=0x7fddc4007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:47.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.648+0000 7fddcbfff700 1 -- 172.21.15.36:0/3444789807 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc4005ba0 con 0x7fddd4066a10 2022-01-10T01:27:47.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.648+0000 7fddcbfff700 1 -- 172.21.15.36:0/3444789807 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc4005d00 con 0x7fddd4066a10 2022-01-10T01:27:47.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.648+0000 7fddd3fff700 1 -- 172.21.15.36:0/3444789807 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd40a7a60 con 0x7fddd4066a10 2022-01-10T01:27:47.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.648+0000 7fddcbfff700 1 -- 172.21.15.36:0/3444789807 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc40072c0 con 0x7fddd4066a10 2022-01-10T01:27:47.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.648+0000 7fddd3fff700 1 -- 172.21.15.36:0/3444789807 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd40ab830 con 0x7fddd4066a10 2022-01-10T01:27:47.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.648+0000 7fddd3fff700 1 -- 172.21.15.36:0/3444789807 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd4152710 con 0x7fddd4066a10 2022-01-10T01:27:47.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.648+0000 7fddcbfff700 1 -- 172.21.15.36:0/3444789807 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fddc4010070 con 0x7fddd4066a10 2022-01-10T01:27:47.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.648+0000 7fddcbfff700 1 --2- 172.21.15.36:0/3444789807 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fddb80535f0 0x7fddb8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.648+0000 7fddcbfff700 1 -- 172.21.15.36:0/3444789807 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fddc406b090 con 0x7fddd4066a10 2022-01-10T01:27:47.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.648+0000 7fddd27fc700 1 --2- 172.21.15.36:0/3444789807 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fddb80535f0 0x7fddb8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.648+0000 7fddd27fc700 1 --2- 172.21.15.36:0/3444789807 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fddb80535f0 0x7fddb8055ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fddbc00b000 tx=0x7fddbc006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:47.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.652+0000 7fddcbfff700 1 -- 172.21.15.36:0/3444789807 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fddc4042380 con 0x7fddd4066a10 2022-01-10T01:27:47.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.816+0000 7fddd3fff700 1 -- 172.21.15.36:0/3444789807 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddd405fd00 con 0x7fddd4066a10 2022-01-10T01:27:47.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.820+0000 7fddcbfff700 1 -- 172.21.15.36:0/3444789807 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+1556 (secure 0 0 0) 0x7fddc40459a0 con 0x7fddd4066a10 2022-01-10T01:27:47.823 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:47.823 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/986398854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":986398854},{"type":"v1","addr":"172.21.15.36:6835","nonce":986398854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/781575126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":781575126},{"type":"v1","addr":"172.21.15.36:6837","nonce":781575126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":5509,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/2652708087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2652708087},{"type":"v1","addr":"172.21.15.59:6833","nonce":2652708087}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":21}],"filesystems":[]} 2022-01-10T01:27:47.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.820+0000 7fddd3fff700 1 -- 172.21.15.36:0/3444789807 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fddb80535f0 msgr2=0x7fddb8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.820+0000 7fddd3fff700 1 --2- 172.21.15.36:0/3444789807 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fddb80535f0 0x7fddb8055ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fddbc00b000 tx=0x7fddbc006df0).stop 2022-01-10T01:27:47.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.820+0000 7fddd3fff700 1 -- 172.21.15.36:0/3444789807 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fddd4066a10 msgr2=0x7fddd40a7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.820+0000 7fddd3fff700 1 --2- 172.21.15.36:0/3444789807 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fddd4066a10 0x7fddd40a7280 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fddd4063350 tx=0x7fddc4007f90).stop 2022-01-10T01:27:47.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.820+0000 7fddd3fff700 1 -- 172.21.15.36:0/3444789807 shutdown_connections 2022-01-10T01:27:47.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.820+0000 7fddd3fff700 1 --2- 172.21.15.36:0/3444789807 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fddb80535f0 0x7fddb8055ab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.820+0000 7fddd3fff700 1 --2- 172.21.15.36:0/3444789807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd40b3000 0x7fddd4155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.820+0000 7fddd3fff700 1 --2- 172.21.15.36:0/3444789807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd40b25a0 0x7fddd41529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.820+0000 7fddd3fff700 1 --2- 172.21.15.36:0/3444789807 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fddd4066a10 0x7fddd40a7280 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.820+0000 7fddd3fff700 1 -- 172.21.15.36:0/3444789807 >> 172.21.15.36:0/3444789807 conn(0x7fddd40636e0 msgr2=0x7fddd40b5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:47.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.820+0000 7fddd3fff700 1 -- 172.21.15.36:0/3444789807 shutdown_connections 2022-01-10T01:27:47.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.820+0000 7fddd3fff700 1 -- 172.21.15.36:0/3444789807 wait complete. 2022-01-10T01:27:47.828 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 21 2022-01-10T01:27:47.836 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:27:47.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 Processor -- start 2022-01-10T01:27:47.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 -- start start 2022-01-10T01:27:47.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd5100b2580 0x7fd51014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd5100b0010 0x7fd51014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5100a70c0 con 0x7fd5100afbd0 2022-01-10T01:27:47.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5100a72f0 con 0x7fd5100b0010 2022-01-10T01:27:47.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5100a7590 con 0x7fd5100b2580 2022-01-10T01:27:47.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50dd9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd5100b0010 0x7fd51014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50dd9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd5100b0010 0x7fd51014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36296/0 (socket says 172.21.15.36:36296) 2022-01-10T01:27:47.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50dd9b700 1 -- 172.21.15.36:0/3565195207 learned_addr learned my addr 172.21.15.36:0/3565195207 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:47.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50e59c700 1 --2- 172.21.15.36:0/3565195207 >> v2:172.21.15.59:3300/0 conn(0x7fd5100b2580 0x7fd51014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50dd9b700 1 -- 172.21.15.36:0/3565195207 >> v2:172.21.15.59:3300/0 conn(0x7fd5100b2580 msgr2=0x7fd51014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:47.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50dd9b700 1 --2- 172.21.15.36:0/3565195207 >> v2:172.21.15.59:3300/0 conn(0x7fd5100b2580 0x7fd51014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50dd9b700 1 -- 172.21.15.36:0/3565195207 >> v1:172.21.15.59:6789/0 conn(0x7fd5100afbd0 legacy=0x7fd5100a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:47.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50dd9b700 1 -- 172.21.15.36:0/3565195207 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5100a7830 con 0x7fd5100b0010 2022-01-10T01:27:47.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50e59c700 1 --2- 172.21.15.36:0/3565195207 >> v2:172.21.15.59:3300/0 conn(0x7fd5100b2580 0x7fd51014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:27:47.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50dd9b700 1 --2- 172.21.15.36:0/3565195207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5100b0010 0x7fd51014b330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fd51006b7c0 tx=0x7fd508009290).ready entity=mon.0 client_cookie=440631f055598bbf server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:47.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50d59a700 1 -- 172.21.15.36:0/3565195207 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd50800b830 con 0x7fd5100b0010 2022-01-10T01:27:47.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50d59a700 1 -- 172.21.15.36:0/3565195207 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50800b990 con 0x7fd5100b0010 2022-01-10T01:27:47.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50d59a700 1 -- 172.21.15.36:0/3565195207 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd50800bb40 con 0x7fd5100b0010 2022-01-10T01:27:47.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 -- 172.21.15.36:0/3565195207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5100b0010 msgr2=0x7fd51014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 --2- 172.21.15.36:0/3565195207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5100b0010 0x7fd51014b330 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fd51006b7c0 tx=0x7fd508009290).stop 2022-01-10T01:27:47.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 -- 172.21.15.36:0/3565195207 shutdown_connections 2022-01-10T01:27:47.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 --2- 172.21.15.36:0/3565195207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5100b0010 0x7fd51014b330 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 --2- 172.21.15.36:0/3565195207 >> v2:172.21.15.59:3300/0 conn(0x7fd5100b2580 0x7fd51014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 -- 172.21.15.36:0/3565195207 >> 172.21.15.36:0/3565195207 conn(0x7fd510060180 msgr2=0x7fd5100b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:47.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 -- 172.21.15.36:0/3565195207 shutdown_connections 2022-01-10T01:27:47.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.936+0000 7fd50f59e700 1 -- 172.21.15.36:0/3565195207 wait complete. 2022-01-10T01:27:47.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50f59e700 1 Processor -- start 2022-01-10T01:27:47.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50f59e700 1 -- start start 2022-01-10T01:27:47.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5100afbd0 0x7fd51005c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50f59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5100b0010 0x7fd51015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5100b2580 0x7fd51015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50f59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5100b45a0 con 0x7fd5100b0010 2022-01-10T01:27:47.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50f59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51015abd0 con 0x7fd5100b2580 2022-01-10T01:27:47.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5100b4bd0 con 0x7fd5100afbd0 2022-01-10T01:27:47.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50dd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5100b0010 0x7fd51015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50dd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5100b0010 0x7fd51015a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36304/0 (socket says 172.21.15.36:36304) 2022-01-10T01:27:47.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50dd9b700 1 -- 172.21.15.36:0/3402507020 learned_addr learned my addr 172.21.15.36:0/3402507020 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:47.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50e59c700 1 --2- 172.21.15.36:0/3402507020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5100afbd0 0x7fd51005c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50ed9d700 1 --2- 172.21.15.36:0/3402507020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5100b2580 0x7fd51015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50dd9b700 1 -- 172.21.15.36:0/3402507020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5100afbd0 msgr2=0x7fd51005c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50dd9b700 1 --2- 172.21.15.36:0/3402507020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5100afbd0 0x7fd51005c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50dd9b700 1 -- 172.21.15.36:0/3402507020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5100b2580 msgr2=0x7fd51015a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:47.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50dd9b700 1 --2- 172.21.15.36:0/3402507020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5100b2580 0x7fd51015a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:47.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50dd9b700 1 -- 172.21.15.36:0/3402507020 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd508009530 con 0x7fd5100b0010 2022-01-10T01:27:47.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50dd9b700 1 --2- 172.21.15.36:0/3402507020 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5100b0010 0x7fd51015a1f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fd51006b7c0 tx=0x7fd508016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:47.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd5077fe700 1 -- 172.21.15.36:0/3402507020 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd508021440 con 0x7fd5100b0010 2022-01-10T01:27:47.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd5077fe700 1 -- 172.21.15.36:0/3402507020 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5080215a0 con 0x7fd5100b0010 2022-01-10T01:27:47.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50f59e700 1 -- 172.21.15.36:0/3402507020 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5100b4e70 con 0x7fd5100b0010 2022-01-10T01:27:47.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd5077fe700 1 -- 172.21.15.36:0/3402507020 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd508021900 con 0x7fd5100b0010 2022-01-10T01:27:47.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.940+0000 7fd50f59e700 1 -- 172.21.15.36:0/3402507020 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5100660e0 con 0x7fd5100b0010 2022-01-10T01:27:47.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.944+0000 7fd50f59e700 1 -- 172.21.15.36:0/3402507020 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd510057350 con 0x7fd5100b0010 2022-01-10T01:27:47.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.944+0000 7fd5077fe700 1 -- 172.21.15.36:0/3402507020 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd50800f070 con 0x7fd5100b0010 2022-01-10T01:27:47.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.944+0000 7fd5077fe700 1 --2- 172.21.15.36:0/3402507020 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4f4053680 0x7fd4f4055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:47.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.944+0000 7fd5077fe700 1 -- 172.21.15.36:0/3402507020 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fd50806be70 con 0x7fd5100b0010 2022-01-10T01:27:47.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.944+0000 7fd50e59c700 1 --2- 172.21.15.36:0/3402507020 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4f4053680 0x7fd4f4055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:47.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.944+0000 7fd50e59c700 1 --2- 172.21.15.36:0/3402507020 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4f4053680 0x7fd4f4055b40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fd4f800d000 tx=0x7fd4f8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:47.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:47.948+0000 7fd5077fe700 1 -- 172.21.15.36:0/3402507020 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd508043160 con 0x7fd5100b0010 2022-01-10T01:27:48.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.112+0000 7fd50f59e700 1 -- 172.21.15.36:0/3402507020 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd51005d1b0 con 0x7fd5100b0010 2022-01-10T01:27:48.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.112+0000 7fd5077fe700 1 -- 172.21.15.36:0/3402507020 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+1556 (secure 0 0 0) 0x7fd508015030 con 0x7fd5100b0010 2022-01-10T01:27:48.117 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:48.117 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/986398854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":986398854},{"type":"v1","addr":"172.21.15.36:6835","nonce":986398854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":17},{"gid":5199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/781575126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":781575126},{"type":"v1","addr":"172.21.15.36:6837","nonce":781575126}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":16},{"gid":5509,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/2652708087","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2652708087},{"type":"v1","addr":"172.21.15.59:6833","nonce":2652708087}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":21}],"filesystems":[]} 2022-01-10T01:27:48.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.116+0000 7fd50f59e700 1 -- 172.21.15.36:0/3402507020 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4f4053680 msgr2=0x7fd4f4055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:48.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.116+0000 7fd50f59e700 1 --2- 172.21.15.36:0/3402507020 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4f4053680 0x7fd4f4055b40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fd4f800d000 tx=0x7fd4f8008040).stop 2022-01-10T01:27:48.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.116+0000 7fd50f59e700 1 -- 172.21.15.36:0/3402507020 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5100b0010 msgr2=0x7fd51015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:48.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.116+0000 7fd50f59e700 1 --2- 172.21.15.36:0/3402507020 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5100b0010 0x7fd51015a1f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fd51006b7c0 tx=0x7fd508016000).stop 2022-01-10T01:27:48.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.116+0000 7fd50f59e700 1 -- 172.21.15.36:0/3402507020 shutdown_connections 2022-01-10T01:27:48.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.116+0000 7fd50f59e700 1 --2- 172.21.15.36:0/3402507020 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4f4053680 0x7fd4f4055b40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:48.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.116+0000 7fd50f59e700 1 --2- 172.21.15.36:0/3402507020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5100b2580 0x7fd51015a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:48.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.116+0000 7fd50f59e700 1 --2- 172.21.15.36:0/3402507020 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5100b0010 0x7fd51015a1f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:48.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.116+0000 7fd50f59e700 1 --2- 172.21.15.36:0/3402507020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5100afbd0 0x7fd51005c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:48.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.116+0000 7fd50f59e700 1 -- 172.21.15.36:0/3402507020 >> 172.21.15.36:0/3402507020 conn(0x7fd510060180 msgr2=0x7fd510149b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:48.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.116+0000 7fd50f59e700 1 -- 172.21.15.36:0/3402507020 shutdown_connections 2022-01-10T01:27:48.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.116+0000 7fd50f59e700 1 -- 172.21.15.36:0/3402507020 wait complete. 2022-01-10T01:27:48.123 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 21 2022-01-10T01:27:48.136 INFO:tasks.ceph.mds.a:Restarting daemon 2022-01-10T01:27:48.136 INFO:tasks.ceph.mds.a:Stopping old one... 2022-01-10T01:27:48.136 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-01-10T01:27:48.137 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:27:48.137 INFO:tasks.ceph.mds.c:Restarting daemon 2022-01-10T01:27:48.137 INFO:tasks.ceph.mds.c:Stopping old one... 2022-01-10T01:27:48.138 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-01-10T01:27:48.138 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:27:48.138 INFO:tasks.ceph.mds.b:Restarting daemon 2022-01-10T01:27:48.139 INFO:tasks.ceph.mds.b:Stopping old one... 2022-01-10T01:27:48.139 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-01-10T01:27:48.139 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:27:48.148 INFO:tasks.ceph.mds.c:Stopped 2022-01-10T01:27:48.148 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-01-10T01:27:48.150 INFO:tasks.ceph.mds.a:Stopped 2022-01-10T01:27:48.150 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-01-10T01:27:48.151 INFO:tasks.ceph.mds.c:Started 2022-01-10T01:27:48.152 DEBUG:teuthology.parallel:result is None 2022-01-10T01:27:48.153 INFO:tasks.ceph.mds.a:Started 2022-01-10T01:27:48.153 DEBUG:teuthology.parallel:result is None 2022-01-10T01:27:48.155 INFO:tasks.ceph.mds.b:Stopped 2022-01-10T01:27:48.155 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-01-10T01:27:48.158 INFO:tasks.ceph.mds.b:Started 2022-01-10T01:27:48.158 DEBUG:teuthology.parallel:result is None 2022-01-10T01:27:48.159 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2022-01-10T01:27:48.214 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:27:48.218 INFO:tasks.ceph.mds.c.smithi036.stdout:starting mds.c at 2022-01-10T01:27:48.238 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:27:48.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fbc9c6700 1 Processor -- start 2022-01-10T01:27:48.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fbc9c6700 1 -- start start 2022-01-10T01:27:48.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fbc9c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b55c0 0x7f0fb80b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:48.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fbc9c6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0fb80af900 0x7f0fb8141780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:48.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fbc9c6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb80ac740 con 0x7f0fb80ab760 2022-01-10T01:27:48.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fbc9c6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb81410f0 con 0x7f0fb80af900 2022-01-10T01:27:48.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fbc9c6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb80b0350 con 0x7f0fb80b55c0 2022-01-10T01:27:48.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fb659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b55c0 0x7f0fb80b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:48.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fb6d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0fb80af900 0x7f0fb8141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:48.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fadd9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0fb80ab760 0x7f0fb80ac030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:51810/0 (socket says 172.21.15.36:51810) 2022-01-10T01:27:48.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fb659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b55c0 0x7f0fb80b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:42624/0 (socket says 172.21.15.36:42624) 2022-01-10T01:27:48.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fadd9b700 1 -- 172.21.15.36:0/2337246890 learned_addr learned my addr 172.21.15.36:0/2337246890 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:48.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fb5d9b700 1 -- 172.21.15.36:0/2337246890 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444937041 0 0) 0x7f0fb80ac740 con 0x7f0fb80ab760 2022-01-10T01:27:48.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fb5d9b700 1 -- 172.21.15.36:0/2337246890 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f98003260 con 0x7f0fb80ab760 2022-01-10T01:27:48.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fb659c700 1 -- 172.21.15.36:0/2337246890 >> v2:172.21.15.59:3300/0 conn(0x7f0fb80af900 msgr2=0x7f0fb8141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:48.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fb659c700 1 --2- 172.21.15.36:0/2337246890 >> v2:172.21.15.59:3300/0 conn(0x7f0fb80af900 0x7f0fb8141780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:48.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fb659c700 1 -- 172.21.15.36:0/2337246890 >> v1:172.21.15.59:6789/0 conn(0x7f0fb80ab760 legacy=0x7f0fb80ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:48.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fb659c700 1 -- 172.21.15.36:0/2337246890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb80b05f0 con 0x7f0fb80b55c0 2022-01-10T01:27:48.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fb659c700 1 --2- 172.21.15.36:0/2337246890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b55c0 0x7f0fb80b59a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0fa8002f70 tx=0x7f0fa8006df0).ready entity=mon.2 client_cookie=cb8446e704881505 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:48.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fb5d9b700 1 -- 172.21.15.36:0/2337246890 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fa800d4a0 con 0x7f0fb80b55c0 2022-01-10T01:27:48.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fb5d9b700 1 -- 172.21.15.36:0/2337246890 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa8000e90 con 0x7f0fb80b55c0 2022-01-10T01:27:48.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.256+0000 7f0fb5d9b700 1 -- 172.21.15.36:0/2337246890 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fa800d7f0 con 0x7f0fb80b55c0 2022-01-10T01:27:48.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.260+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/2337246890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b55c0 msgr2=0x7f0fb80b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:48.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.260+0000 7f0fbc9c6700 1 --2- 172.21.15.36:0/2337246890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b55c0 0x7f0fb80b59a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f0fa8002f70 tx=0x7f0fa8006df0).stop 2022-01-10T01:27:48.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.260+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/2337246890 shutdown_connections 2022-01-10T01:27:48.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.260+0000 7f0fbc9c6700 1 --2- 172.21.15.36:0/2337246890 >> v2:172.21.15.59:3300/0 conn(0x7f0fb80af900 0x7f0fb8141780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:48.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.260+0000 7f0fbc9c6700 1 --2- 172.21.15.36:0/2337246890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b55c0 0x7f0fb80b59a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:48.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.260+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/2337246890 >> 172.21.15.36:0/2337246890 conn(0x7f0fb80608d0 msgr2=0x7f0fb8060ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:48.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.260+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/2337246890 shutdown_connections 2022-01-10T01:27:48.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.260+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/2337246890 wait complete. 2022-01-10T01:27:48.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.260+0000 7f0fbc9c6700 1 Processor -- start 2022-01-10T01:27:48.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.260+0000 7f0fbc9c6700 1 -- start start 2022-01-10T01:27:48.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fbc9c6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80ab760 0x7f0fb8140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:48.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fbc9c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80af900 0x7f0fb8144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:48.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fbc9c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b55c0 0x7f0fb8153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:48.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fbc9c6700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb8144d00 con 0x7f0fb80ab760 2022-01-10T01:27:48.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fbc9c6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb8064c80 con 0x7f0fb80b55c0 2022-01-10T01:27:48.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fbc9c6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb80644a0 con 0x7f0fb80af900 2022-01-10T01:27:48.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fb659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80ab760 0x7f0fb8140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:48.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fb6d9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b55c0 0x7f0fb8153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:48.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fb659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80ab760 0x7f0fb8140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36346/0 (socket says 172.21.15.36:36346) 2022-01-10T01:27:48.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fb659c700 1 -- 172.21.15.36:0/168689413 learned_addr learned my addr 172.21.15.36:0/168689413 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:48.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fadd9b700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80af900 0x7f0fb8144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:48.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fb659c700 1 -- 172.21.15.36:0/168689413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80af900 msgr2=0x7f0fb8144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:48.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fb659c700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80af900 0x7f0fb8144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:48.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fb659c700 1 -- 172.21.15.36:0/168689413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b55c0 msgr2=0x7f0fb8153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:48.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fb659c700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b55c0 0x7f0fb8153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:48.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fb659c700 1 -- 172.21.15.36:0/168689413 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa800b180 con 0x7f0fb80ab760 2022-01-10T01:27:48.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fadd9b700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80af900 0x7f0fb8144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:27:48.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fb6d9d700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b55c0 0x7f0fb8153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:27:48.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fb659c700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80ab760 0x7f0fb8140a80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f0fa8002f70 tx=0x7f0fa8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:48.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0faffff700 1 -- 172.21.15.36:0/168689413 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fa8016070 con 0x7f0fb80ab760 2022-01-10T01:27:48.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0faffff700 1 -- 172.21.15.36:0/168689413 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa8012670 con 0x7f0fb80ab760 2022-01-10T01:27:48.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/168689413 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb8064740 con 0x7f0fb80ab760 2022-01-10T01:27:48.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.264+0000 7f0faffff700 1 -- 172.21.15.36:0/168689413 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fa80129d0 con 0x7f0fb80ab760 2022-01-10T01:27:48.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.268+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/168689413 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb8064190 con 0x7f0fb80ab760 2022-01-10T01:27:48.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.268+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/168689413 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb81412e0 con 0x7f0fb80ab760 2022-01-10T01:27:48.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.268+0000 7f0faffff700 1 -- 172.21.15.36:0/168689413 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0fa8024030 con 0x7f0fb80ab760 2022-01-10T01:27:48.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.268+0000 7f0faffff700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f9c0534d0 0x7f0f9c055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:48.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.268+0000 7f0faffff700 1 -- 172.21.15.36:0/168689413 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f0fa806c130 con 0x7f0fb80ab760 2022-01-10T01:27:48.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.268+0000 7f0fadd9b700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f9c0534d0 0x7f0f9c055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:48.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.272+0000 7f0fadd9b700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f9c0534d0 0x7f0f9c055990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f0fa000d000 tx=0x7f0fa0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:48.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.276+0000 7f0faffff700 1 -- 172.21.15.36:0/168689413 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0fa8043420 con 0x7f0fb80ab760 2022-01-10T01:27:48.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:48.412+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/168689413 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f0fb8057350 con 0x7f0fb80ab760 2022-01-10T01:27:49.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.284+0000 7f0faffff700 1 -- 172.21.15.36:0/168689413 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v52) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0fa8022080 con 0x7f0fb80ab760 2022-01-10T01:27:49.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.284+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/168689413 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f9c0534d0 msgr2=0x7f0f9c055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:49.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.284+0000 7f0fbc9c6700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f9c0534d0 0x7f0f9c055990 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f0fa000d000 tx=0x7f0fa0009040).stop 2022-01-10T01:27:49.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.284+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/168689413 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80ab760 msgr2=0x7f0fb8140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:49.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.284+0000 7f0fbc9c6700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80ab760 0x7f0fb8140a80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f0fa8002f70 tx=0x7f0fa8014000).stop 2022-01-10T01:27:49.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.284+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/168689413 shutdown_connections 2022-01-10T01:27:49.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.284+0000 7f0fbc9c6700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f9c0534d0 0x7f0f9c055990 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.284+0000 7f0fbc9c6700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b55c0 0x7f0fb8153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.284+0000 7f0fbc9c6700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80af900 0x7f0fb8144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.284+0000 7f0fbc9c6700 1 --2- 172.21.15.36:0/168689413 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80ab760 0x7f0fb8140a80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.284+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/168689413 >> 172.21.15.36:0/168689413 conn(0x7f0fb80608d0 msgr2=0x7f0fb80aad50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:49.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.284+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/168689413 shutdown_connections 2022-01-10T01:27:49.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.284+0000 7f0fbc9c6700 1 -- 172.21.15.36:0/168689413 wait complete. 2022-01-10T01:27:49.292 INFO:teuthology.orchestra.run.smithi036.stderr: removed all blacklist entries 2022-01-10T01:27:49.301 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2022-01-10T01:27:49.302 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2022-01-10T01:27:49.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298ee6c700 1 Processor -- start 2022-01-10T01:27:49.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298ee6c700 1 -- start start 2022-01-10T01:27:49.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298ee6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29880b00c0 0x7f29880b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:49.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298ee6c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f29880b1f10 0x7f29880aab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:49.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298ee6c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f29880a9b70 0x7f29881415b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:49.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298ee6c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29880aa390 con 0x7f29880a9b70 2022-01-10T01:27:49.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298ee6c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29880b04a0 con 0x7f29880b1f10 2022-01-10T01:27:49.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298ee6c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29880aa0f0 con 0x7f29880b00c0 2022-01-10T01:27:49.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298d409700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f29880a9b70 0x7f29881415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:49.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298d409700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f29880a9b70 0x7f29881415b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36360/0 (socket says 172.21.15.36:36360) 2022-01-10T01:27:49.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298d409700 1 -- 172.21.15.36:0/1072633712 learned_addr learned my addr 172.21.15.36:0/1072633712 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:49.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298cc08700 1 --2- 172.21.15.36:0/1072633712 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29880b00c0 0x7f29880b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:49.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f2987fff700 1 --2- 172.21.15.36:0/1072633712 >> v2:172.21.15.59:3300/0 conn(0x7f29880b1f10 0x7f29880aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:49.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298d409700 1 -- 172.21.15.36:0/1072633712 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29880b00c0 msgr2=0x7f29880b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:49.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298d409700 1 --2- 172.21.15.36:0/1072633712 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29880b00c0 0x7f29880b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298d409700 1 -- 172.21.15.36:0/1072633712 >> v2:172.21.15.59:3300/0 conn(0x7f29880b1f10 msgr2=0x7f29880aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:49.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298d409700 1 --2- 172.21.15.36:0/1072633712 >> v2:172.21.15.59:3300/0 conn(0x7f29880b1f10 0x7f29880aab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298d409700 1 -- 172.21.15.36:0/1072633712 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29880b11e0 con 0x7f29880a9b70 2022-01-10T01:27:49.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.408+0000 7f298d409700 1 --2- 172.21.15.36:0/1072633712 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29880a9b70 0x7f29881415b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f29800032f0 tx=0x7f2980009290).ready entity=mon.0 client_cookie=dcd72d377259eb8f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:49.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f29877fe700 1 -- 172.21.15.36:0/1072633712 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f298000b680 con 0x7f29880a9b70 2022-01-10T01:27:49.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f29877fe700 1 -- 172.21.15.36:0/1072633712 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298000b7e0 con 0x7f29880a9b70 2022-01-10T01:27:49.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f29877fe700 1 -- 172.21.15.36:0/1072633712 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f298000b950 con 0x7f29880a9b70 2022-01-10T01:27:49.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f298ee6c700 1 -- 172.21.15.36:0/1072633712 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29880a9b70 msgr2=0x7f29881415b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:49.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f298ee6c700 1 --2- 172.21.15.36:0/1072633712 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29880a9b70 0x7f29881415b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f29800032f0 tx=0x7f2980009290).stop 2022-01-10T01:27:49.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f298ee6c700 1 -- 172.21.15.36:0/1072633712 shutdown_connections 2022-01-10T01:27:49.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f298ee6c700 1 --2- 172.21.15.36:0/1072633712 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29880a9b70 0x7f29881415b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f298ee6c700 1 --2- 172.21.15.36:0/1072633712 >> v2:172.21.15.59:3300/0 conn(0x7f29880b1f10 0x7f29880aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f298ee6c700 1 --2- 172.21.15.36:0/1072633712 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29880b00c0 0x7f29880b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f298ee6c700 1 -- 172.21.15.36:0/1072633712 >> 172.21.15.36:0/1072633712 conn(0x7f29880607c0 msgr2=0x7f2988060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:49.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f298ee6c700 1 -- 172.21.15.36:0/1072633712 shutdown_connections 2022-01-10T01:27:49.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f298ee6c700 1 -- 172.21.15.36:0/1072633712 wait complete. 2022-01-10T01:27:49.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f298ee6c700 1 Processor -- start 2022-01-10T01:27:49.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f298ee6c700 1 -- start start 2022-01-10T01:27:49.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f298ee6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29880a9b70 0x7f298814a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:49.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f298ee6c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29880b00c0 0x7f29880ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:49.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.412+0000 7f298ee6c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29880b1f10 0x7f2988155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:49.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f298ee6c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29881423e0 con 0x7f29880b00c0 2022-01-10T01:27:49.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f298ee6c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298813dc00 con 0x7f29880b1f10 2022-01-10T01:27:49.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f298ee6c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298813dea0 con 0x7f29880a9b70 2022-01-10T01:27:49.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f2987fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29880b00c0 0x7f29880ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:49.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f2987fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29880b00c0 0x7f29880ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36364/0 (socket says 172.21.15.36:36364) 2022-01-10T01:27:49.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f2987fff700 1 -- 172.21.15.36:0/2092808659 learned_addr learned my addr 172.21.15.36:0/2092808659 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:49.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f298d409700 1 --2- 172.21.15.36:0/2092808659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29880b1f10 0x7f2988155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:49.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f298cc08700 1 --2- 172.21.15.36:0/2092808659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29880a9b70 0x7f298814a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:49.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f2987fff700 1 -- 172.21.15.36:0/2092808659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29880a9b70 msgr2=0x7f298814a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:49.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f2987fff700 1 --2- 172.21.15.36:0/2092808659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29880a9b70 0x7f298814a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f2987fff700 1 -- 172.21.15.36:0/2092808659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29880b1f10 msgr2=0x7f2988155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:49.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f2987fff700 1 --2- 172.21.15.36:0/2092808659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29880b1f10 0x7f2988155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f2987fff700 1 -- 172.21.15.36:0/2092808659 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2980009530 con 0x7f29880b00c0 2022-01-10T01:27:49.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f2987fff700 1 --2- 172.21.15.36:0/2092808659 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29880b00c0 0x7f29880ac590 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f297c00c000 tx=0x7f297c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:49.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f2985ffb700 1 -- 172.21.15.36:0/2092808659 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f297c010780 con 0x7f29880b00c0 2022-01-10T01:27:49.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f2985ffb700 1 -- 172.21.15.36:0/2092808659 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c0108e0 con 0x7f29880b00c0 2022-01-10T01:27:49.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f298ee6c700 1 -- 172.21.15.36:0/2092808659 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298813f340 con 0x7f29880b00c0 2022-01-10T01:27:49.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f2985ffb700 1 -- 172.21.15.36:0/2092808659 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f297c010c40 con 0x7f29880b00c0 2022-01-10T01:27:49.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f298ee6c700 1 -- 172.21.15.36:0/2092808659 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2988155f10 con 0x7f29880b00c0 2022-01-10T01:27:49.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.416+0000 7f298ee6c700 1 -- 172.21.15.36:0/2092808659 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2988057350 con 0x7f29880b00c0 2022-01-10T01:27:49.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.420+0000 7f2985ffb700 1 -- 172.21.15.36:0/2092808659 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f297c01c460 con 0x7f29880b00c0 2022-01-10T01:27:49.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.420+0000 7f2985ffb700 1 --2- 172.21.15.36:0/2092808659 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f29680536b0 0x7f2968055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:49.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.420+0000 7f2985ffb700 1 -- 172.21.15.36:0/2092808659 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f297c06bd30 con 0x7f29880b00c0 2022-01-10T01:27:49.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.420+0000 7f298cc08700 1 --2- 172.21.15.36:0/2092808659 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f29680536b0 0x7f2968055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:49.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.420+0000 7f298cc08700 1 --2- 172.21.15.36:0/2092808659 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f29680536b0 0x7f2968055b70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f297800b000 tx=0x7f2978006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:49.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.424+0000 7f2985ffb700 1 -- 172.21.15.36:0/2092808659 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f297c042e90 con 0x7f29880b00c0 2022-01-10T01:27:49.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.592+0000 7f298ee6c700 1 -- 172.21.15.36:0/2092808659 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2988044650 con 0x7f29880b00c0 2022-01-10T01:27:49.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.592+0000 7f2985ffb700 1 -- 172.21.15.36:0/2092808659 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f297c0464b0 con 0x7f29880b00c0 2022-01-10T01:27:49.597 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:49.597 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:27:49.597 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_dump": [ 2022-01-10T01:27:49.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.598 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.a", 2022-01-10T01:27:49.598 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthuGT4IxAA5DyijS4tPjdOLn5uiLXEPg==", 2022-01-10T01:27:49.598 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.598 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:27:49.599 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:27:49.599 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:27:49.599 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:27:49.600 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.600 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.600 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.b", 2022-01-10T01:27:49.601 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthkvX0LRAAtz19usFvoObvouQeLFwicg==", 2022-01-10T01:27:49.601 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.601 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:27:49.601 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:27:49.602 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:27:49.602 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:27:49.602 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.603 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.c", 2022-01-10T01:27:49.603 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthbvUmKhAA0pVpDJO1AfsAzIHU1cAHiw==", 2022-01-10T01:27:49.604 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.604 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:27:49.604 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:27:49.604 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:27:49.605 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:27:49.605 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.605 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.0", 2022-01-10T01:27:49.606 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCWitthk4iKHRAAF7aFP+i24xFvXXm8j5GzVg==", 2022-01-10T01:27:49.606 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.606 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:27:49.606 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:27:49.607 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:27:49.607 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.607 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.1", 2022-01-10T01:27:49.608 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCZitthsKSXABAAb3IkNvlyLub89HwaPWZ1Bg==", 2022-01-10T01:27:49.608 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.608 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:27:49.608 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:27:49.609 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:27:49.609 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.610 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.2", 2022-01-10T01:27:49.610 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCbitthvNzhIBAAXkZ6FslnMl1gS/rOa7G+Vg==", 2022-01-10T01:27:49.610 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.610 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:27:49.610 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:27:49.611 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:27:49.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.612 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.3", 2022-01-10T01:27:49.612 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCeitth9P7EAxAA7KOCP7Rh5oN1yqCz9I6v3A==", 2022-01-10T01:27:49.612 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.612 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:27:49.612 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:27:49.613 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:27:49.613 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.614 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.4", 2022-01-10T01:27:49.614 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCjitth/L1UBxAAskxmSV0aE6CSvDFR8O/+SQ==", 2022-01-10T01:27:49.614 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.614 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:27:49.614 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:27:49.615 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:27:49.615 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.616 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.5", 2022-01-10T01:27:49.616 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQClitthMoY6JhAAeeIrCmMcm3MpDPtdLUf+2g==", 2022-01-10T01:27:49.616 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.616 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:27:49.617 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:27:49.617 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:27:49.617 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.617 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.618 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.6", 2022-01-10T01:27:49.618 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCoitthrUhlCxAAsYhU7Kj6HMo/kD0DezvITg==", 2022-01-10T01:27:49.618 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.618 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:27:49.619 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:27:49.619 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:27:49.619 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.619 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.620 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.7", 2022-01-10T01:27:49.620 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCqitthFaLrKRAAC2g1OlcV2KTtaOXsyCrIrQ==", 2022-01-10T01:27:49.620 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.621 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:27:49.621 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:27:49.621 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:27:49.621 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.623 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.0", 2022-01-10T01:27:49.623 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthKoa/NBAADjvHh99F8YOktGID9uyttg==", 2022-01-10T01:27:49.623 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.623 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:27:49.623 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:27:49.624 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:27:49.624 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.625 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.1", 2022-01-10T01:27:49.625 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth3x76OBAAPTrw8OUmnpEflWuB7zzaHg==", 2022-01-10T01:27:49.625 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.625 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:27:49.626 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:27:49.626 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:27:49.626 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.627 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.admin", 2022-01-10T01:27:49.627 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthf9dqChAADHRsoZKuozdsqb41ztuR7w==", 2022-01-10T01:27:49.628 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.628 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:27:49.628 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:27:49.628 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:27:49.628 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:27:49.629 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.629 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.x", 2022-01-10T01:27:49.630 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth39syIRAA6pOvLWw2ADy72TWZ65MIkA==", 2022-01-10T01:27:49.630 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.630 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:27:49.630 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:27:49.630 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:27:49.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:49.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:49.631 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.y", 2022-01-10T01:27:49.632 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth4novHRAACVMjo72kOB/T7Ti/CiN27w==", 2022-01-10T01:27:49.632 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:27:49.632 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:27:49.632 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:27:49.633 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:27:49.633 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.633 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:49.634 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:27:49.634 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:27:49.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.592+0000 7f298ee6c700 1 -- 172.21.15.36:0/2092808659 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f29680536b0 msgr2=0x7f2968055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:49.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.592+0000 7f298ee6c700 1 --2- 172.21.15.36:0/2092808659 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f29680536b0 0x7f2968055b70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f297800b000 tx=0x7f2978006df0).stop 2022-01-10T01:27:49.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.592+0000 7f298ee6c700 1 -- 172.21.15.36:0/2092808659 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29880b00c0 msgr2=0x7f29880ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:49.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.592+0000 7f298ee6c700 1 --2- 172.21.15.36:0/2092808659 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29880b00c0 0x7f29880ac590 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f297c00c000 tx=0x7f297c006df0).stop 2022-01-10T01:27:49.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.592+0000 7f298ee6c700 1 -- 172.21.15.36:0/2092808659 shutdown_connections 2022-01-10T01:27:49.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.592+0000 7f298ee6c700 1 --2- 172.21.15.36:0/2092808659 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f29680536b0 0x7f2968055b70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.592+0000 7f298ee6c700 1 --2- 172.21.15.36:0/2092808659 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29880b1f10 0x7f2988155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.596+0000 7f298ee6c700 1 --2- 172.21.15.36:0/2092808659 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29880b00c0 0x7f29880ac590 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.596+0000 7f298ee6c700 1 --2- 172.21.15.36:0/2092808659 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29880a9b70 0x7f298814a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.596+0000 7f298ee6c700 1 -- 172.21.15.36:0/2092808659 >> 172.21.15.36:0/2092808659 conn(0x7f29880607c0 msgr2=0x7f29880af270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:49.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.596+0000 7f298ee6c700 1 -- 172.21.15.36:0/2092808659 shutdown_connections 2022-01-10T01:27:49.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.596+0000 7f298ee6c700 1 -- 172.21.15.36:0/2092808659 wait complete. 2022-01-10T01:27:49.640 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:27:49.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.732+0000 7f46a520e700 1 Processor -- start 2022-01-10T01:27:49.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.732+0000 7f46a520e700 1 -- start start 2022-01-10T01:27:49.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a520e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46a00ad5c0 0x7f46a0061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:49.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a520e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46a0140440 0x7f46a01408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:49.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a520e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a00aecf0 con 0x7f46a0061320 2022-01-10T01:27:49.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a520e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a00b6f20 con 0x7f46a00ad5c0 2022-01-10T01:27:49.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a520e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00aef20 con 0x7f46a0140440 2022-01-10T01:27:49.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a4a0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46a0140440 0x7f46a01408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:49.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f469f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46a00ad5c0 0x7f46a0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:49.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a4a0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46a0140440 0x7f46a01408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:42656/0 (socket says 172.21.15.36:42656) 2022-01-10T01:27:49.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a4a0d700 1 -- 172.21.15.36:0/2727628780 learned_addr learned my addr 172.21.15.36:0/2727628780 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:49.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a4a0d700 1 -- 172.21.15.36:0/2727628780 >> v2:172.21.15.59:3300/0 conn(0x7f46a00ad5c0 msgr2=0x7f46a0061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:49.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a4a0d700 1 --2- 172.21.15.36:0/2727628780 >> v2:172.21.15.59:3300/0 conn(0x7f46a00ad5c0 0x7f46a0061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a4a0d700 1 -- 172.21.15.36:0/2727628780 >> v1:172.21.15.59:6789/0 conn(0x7f46a0061320 legacy=0x7f46a00b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:49.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a4a0d700 1 -- 172.21.15.36:0/2727628780 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00af1c0 con 0x7f46a0140440 2022-01-10T01:27:49.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a4a0d700 1 --2- 172.21.15.36:0/2727628780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46a0140440 0x7f46a01408f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f46980032f0 tx=0x7f4698009290).ready entity=mon.2 client_cookie=161172acceba054c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:49.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f469effd700 1 -- 172.21.15.36:0/2727628780 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f469800b8a0 con 0x7f46a0140440 2022-01-10T01:27:49.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f469effd700 1 -- 172.21.15.36:0/2727628780 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800ba00 con 0x7f46a0140440 2022-01-10T01:27:49.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f469effd700 1 -- 172.21.15.36:0/2727628780 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f469800bb70 con 0x7f46a0140440 2022-01-10T01:27:49.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a520e700 1 -- 172.21.15.36:0/2727628780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46a0140440 msgr2=0x7f46a01408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:49.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a520e700 1 --2- 172.21.15.36:0/2727628780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46a0140440 0x7f46a01408f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f46980032f0 tx=0x7f4698009290).stop 2022-01-10T01:27:49.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a520e700 1 -- 172.21.15.36:0/2727628780 shutdown_connections 2022-01-10T01:27:49.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a520e700 1 --2- 172.21.15.36:0/2727628780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46a0140440 0x7f46a01408f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a520e700 1 --2- 172.21.15.36:0/2727628780 >> v2:172.21.15.59:3300/0 conn(0x7f46a00ad5c0 0x7f46a0061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a520e700 1 -- 172.21.15.36:0/2727628780 >> 172.21.15.36:0/2727628780 conn(0x7f46a0066de0 msgr2=0x7f46a00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:49.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a520e700 1 -- 172.21.15.36:0/2727628780 shutdown_connections 2022-01-10T01:27:49.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.736+0000 7f46a520e700 1 -- 172.21.15.36:0/2727628780 wait complete. 2022-01-10T01:27:49.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f46a520e700 1 Processor -- start 2022-01-10T01:27:49.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f46a520e700 1 -- start start 2022-01-10T01:27:49.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f46a520e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a0061320 0x7f46a0155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:49.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f46a520e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46a00ad5c0 0x7f46a00b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:49.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f46a520e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f46a0140440 0x7f46a00b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:49.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f46a520e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00aca20 con 0x7f46a0140440 2022-01-10T01:27:49.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f46a520e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a01563d0 con 0x7f46a0061320 2022-01-10T01:27:49.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f46a520e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0156670 con 0x7f46a00ad5c0 2022-01-10T01:27:49.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f46a4a0d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f46a0140440 0x7f46a00b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:49.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f469f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46a00ad5c0 0x7f46a00b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:49.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f469f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46a00ad5c0 0x7f46a00b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:42660/0 (socket says 172.21.15.36:42660) 2022-01-10T01:27:49.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f46a4a0d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f46a0140440 0x7f46a00b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36380/0 (socket says 172.21.15.36:36380) 2022-01-10T01:27:49.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f469f7fe700 1 -- 172.21.15.36:0/887595028 learned_addr learned my addr 172.21.15.36:0/887595028 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:49.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f469ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a0061320 0x7f46a0155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:49.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f469ffff700 1 -- 172.21.15.36:0/887595028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46a00ad5c0 msgr2=0x7f46a00b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:49.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f469ffff700 1 --2- 172.21.15.36:0/887595028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46a00ad5c0 0x7f46a00b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f469ffff700 1 -- 172.21.15.36:0/887595028 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f46a0140440 msgr2=0x7f46a00b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:49.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f469ffff700 1 --2- 172.21.15.36:0/887595028 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f46a0140440 0x7f46a00b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f469ffff700 1 -- 172.21.15.36:0/887595028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4698009530 con 0x7f46a0061320 2022-01-10T01:27:49.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f46a4a0d700 1 --2- 172.21.15.36:0/887595028 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f46a0140440 0x7f46a00b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:27:49.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f469f7fe700 1 --2- 172.21.15.36:0/887595028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46a00ad5c0 0x7f46a00b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:27:49.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f469ffff700 1 --2- 172.21.15.36:0/887595028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a0061320 0x7f46a0155c00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f46a00af7e0 tx=0x7f4688007b50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:49.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f469d7fa700 1 -- 172.21.15.36:0/887595028 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4688007030 con 0x7f46a0061320 2022-01-10T01:27:49.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f469d7fa700 1 -- 172.21.15.36:0/887595028 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4688007190 con 0x7f46a0061320 2022-01-10T01:27:49.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f46a520e700 1 -- 172.21.15.36:0/887595028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a01560f0 con 0x7f46a0061320 2022-01-10T01:27:49.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f469d7fa700 1 -- 172.21.15.36:0/887595028 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4688006510 con 0x7f46a0061320 2022-01-10T01:27:49.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.740+0000 7f46a520e700 1 -- 172.21.15.36:0/887595028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a00b3b10 con 0x7f46a0061320 2022-01-10T01:27:49.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.744+0000 7f46a520e700 1 -- 172.21.15.36:0/887595028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a00af460 con 0x7f46a0061320 2022-01-10T01:27:49.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.744+0000 7f469d7fa700 1 -- 172.21.15.36:0/887595028 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4688010030 con 0x7f46a0061320 2022-01-10T01:27:49.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.744+0000 7f469d7fa700 1 --2- 172.21.15.36:0/887595028 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f46840534d0 0x7f4684055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:49.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.744+0000 7f469d7fa700 1 -- 172.21.15.36:0/887595028 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f468806b290 con 0x7f46a0061320 2022-01-10T01:27:49.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.744+0000 7f469f7fe700 1 --2- 172.21.15.36:0/887595028 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f46840534d0 0x7f4684055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:49.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.744+0000 7f469f7fe700 1 --2- 172.21.15.36:0/887595028 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f46840534d0 0x7f4684055990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f469000b000 tx=0x7f4690006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:49.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.756+0000 7f469d7fa700 1 -- 172.21.15.36:0/887595028 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4688042540 con 0x7f46a0061320 2022-01-10T01:27:49.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.880+0000 7f46a520e700 1 -- 172.21.15.36:0/887595028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46a0057350 con 0x7f46a0061320 2022-01-10T01:27:49.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.884+0000 7f469d7fa700 1 -- 172.21.15.36:0/887595028 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+13414 (secure 0 0 0) 0x7f4688045b60 con 0x7f46a0061320 2022-01-10T01:27:49.887 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:49.887 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":52,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:27:49.274351+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:27:49.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.884+0000 7f46a520e700 1 -- 172.21.15.36:0/887595028 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f46840534d0 msgr2=0x7f4684055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:49.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.884+0000 7f46a520e700 1 --2- 172.21.15.36:0/887595028 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f46840534d0 0x7f4684055990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f469000b000 tx=0x7f4690006df0).stop 2022-01-10T01:27:49.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.884+0000 7f46a520e700 1 -- 172.21.15.36:0/887595028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a0061320 msgr2=0x7f46a0155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:49.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.884+0000 7f46a520e700 1 --2- 172.21.15.36:0/887595028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a0061320 0x7f46a0155c00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f46a00af7e0 tx=0x7f4688007b50).stop 2022-01-10T01:27:49.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.884+0000 7f46a520e700 1 -- 172.21.15.36:0/887595028 shutdown_connections 2022-01-10T01:27:49.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.884+0000 7f46a520e700 1 --2- 172.21.15.36:0/887595028 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f46840534d0 0x7f4684055990 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.884+0000 7f46a520e700 1 --2- 172.21.15.36:0/887595028 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f46a0140440 0x7f46a00b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.884+0000 7f46a520e700 1 --2- 172.21.15.36:0/887595028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46a00ad5c0 0x7f46a00b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.884+0000 7f46a520e700 1 --2- 172.21.15.36:0/887595028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a0061320 0x7f46a0155c00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:49.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.884+0000 7f46a520e700 1 -- 172.21.15.36:0/887595028 >> 172.21.15.36:0/887595028 conn(0x7f46a0066de0 msgr2=0x7f46a0142890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:49.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.884+0000 7f46a520e700 1 -- 172.21.15.36:0/887595028 shutdown_connections 2022-01-10T01:27:49.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:49.884+0000 7f46a520e700 1 -- 172.21.15.36:0/887595028 wait complete. 2022-01-10T01:27:49.901 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-01-10T01:27:49.902 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:27:50.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.012+0000 7fdd2f2b4700 1 Processor -- start 2022-01-10T01:27:50.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.012+0000 7fdd2f2b4700 1 -- start start 2022-01-10T01:27:50.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2f2b4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fdd28148860 0x7fdd2814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2f2b4700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd28066ea0 con 0x7fdd280a9c10 2022-01-10T01:27:50.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2f2b4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd280b3420 con 0x7fdd280b3040 2022-01-10T01:27:50.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2f2b4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd280648e0 con 0x7fdd28148860 2022-01-10T01:27:50.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2dab1700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fdd280a9c10 0x7fdd280607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34180/0 (socket says 172.21.15.36:34180) 2022-01-10T01:27:50.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2dab1700 1 -- 172.21.15.36:0/83983693 learned_addr learned my addr 172.21.15.36:0/83983693 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:50.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2eab3700 1 --2- 172.21.15.36:0/83983693 >> v2:172.21.15.36:3300/0 conn(0x7fdd28148860 0x7fdd2814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2d2b0700 1 -- 172.21.15.36:0/83983693 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797493467 0 0) 0x7fdd28066ea0 con 0x7fdd280a9c10 2022-01-10T01:27:50.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2d2b0700 1 -- 172.21.15.36:0/83983693 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd14003260 con 0x7fdd280a9c10 2022-01-10T01:27:50.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2d2b0700 1 -- 172.21.15.36:0/83983693 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 623789235 0 0) 0x7fdd280b3420 con 0x7fdd280b3040 2022-01-10T01:27:50.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2d2b0700 1 -- 172.21.15.36:0/83983693 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd28066ea0 con 0x7fdd280b3040 2022-01-10T01:27:50.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2d2b0700 1 -- 172.21.15.36:0/83983693 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 181182817 0 0) 0x7fdd14003260 con 0x7fdd280a9c10 2022-01-10T01:27:50.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2eab3700 1 -- 172.21.15.36:0/83983693 >> v1:172.21.15.59:6789/0 conn(0x7fdd280b3040 legacy=0x7fdd28065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2eab3700 1 -- 172.21.15.36:0/83983693 >> v1:172.21.15.36:6789/0 conn(0x7fdd280a9c10 legacy=0x7fdd280607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2eab3700 1 -- 172.21.15.36:0/83983693 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd28066960 con 0x7fdd28148860 2022-01-10T01:27:50.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2eab3700 1 --2- 172.21.15.36:0/83983693 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd28148860 0x7fdd2814ac50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fdd1c001110 tx=0x7fdd200091d0).ready entity=mon.0 client_cookie=aca5b31bb28f96bb server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:50.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2d2b0700 1 -- 172.21.15.36:0/83983693 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1c001660 con 0x7fdd28148860 2022-01-10T01:27:50.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2d2b0700 1 -- 172.21.15.36:0/83983693 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2000f510 con 0x7fdd28148860 2022-01-10T01:27:50.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2d2b0700 1 -- 172.21.15.36:0/83983693 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd2000f680 con 0x7fdd28148860 2022-01-10T01:27:50.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/83983693 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd28148860 msgr2=0x7fdd2814ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2f2b4700 1 --2- 172.21.15.36:0/83983693 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd28148860 0x7fdd2814ac50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fdd1c001110 tx=0x7fdd200091d0).stop 2022-01-10T01:27:50.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/83983693 shutdown_connections 2022-01-10T01:27:50.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2f2b4700 1 --2- 172.21.15.36:0/83983693 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd28148860 0x7fdd2814ac50 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/83983693 >> 172.21.15.36:0/83983693 conn(0x7fdd280636e0 msgr2=0x7fdd28063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:50.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/83983693 shutdown_connections 2022-01-10T01:27:50.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.016+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/83983693 wait complete. 2022-01-10T01:27:50.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2f2b4700 1 Processor -- start 2022-01-10T01:27:50.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2f2b4700 1 -- start start 2022-01-10T01:27:50.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2f2b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd280a9c10 0x7fdd2805f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2f2b4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd280b3040 0x7fdd281534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2f2b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd28148860 0x7fdd28153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2f2b4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd280abf50 con 0x7fdd280b3040 2022-01-10T01:27:50.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2f2b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2813cfe0 con 0x7fdd280a9c10 2022-01-10T01:27:50.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2f2b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd280aef00 con 0x7fdd28148860 2022-01-10T01:27:50.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2dab1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd280b3040 0x7fdd281534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2dab1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd280b3040 0x7fdd281534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36392/0 (socket says 172.21.15.36:36392) 2022-01-10T01:27:50.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2dab1700 1 -- 172.21.15.36:0/3501186788 learned_addr learned my addr 172.21.15.36:0/3501186788 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:50.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2e2b2700 1 --2- 172.21.15.36:0/3501186788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd280a9c10 0x7fdd2805f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2eab3700 1 --2- 172.21.15.36:0/3501186788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd28148860 0x7fdd28153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2dab1700 1 -- 172.21.15.36:0/3501186788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd28148860 msgr2=0x7fdd28153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2dab1700 1 --2- 172.21.15.36:0/3501186788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd28148860 0x7fdd28153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2dab1700 1 -- 172.21.15.36:0/3501186788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd280a9c10 msgr2=0x7fdd2805f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2dab1700 1 --2- 172.21.15.36:0/3501186788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd280a9c10 0x7fdd2805f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2dab1700 1 -- 172.21.15.36:0/3501186788 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd20009470 con 0x7fdd280b3040 2022-01-10T01:27:50.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.020+0000 7fdd2dab1700 1 --2- 172.21.15.36:0/3501186788 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd280b3040 0x7fdd281534a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fdd1c000fe0 tx=0x7fdd1c001ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:50.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.024+0000 7fdd277fe700 1 -- 172.21.15.36:0/3501186788 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1c0072e0 con 0x7fdd280b3040 2022-01-10T01:27:50.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.024+0000 7fdd277fe700 1 -- 172.21.15.36:0/3501186788 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c007440 con 0x7fdd280b3040 2022-01-10T01:27:50.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.024+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/3501186788 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd280abcb0 con 0x7fdd280b3040 2022-01-10T01:27:50.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.024+0000 7fdd277fe700 1 -- 172.21.15.36:0/3501186788 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1c005800 con 0x7fdd280b3040 2022-01-10T01:27:50.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.024+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/3501186788 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd280b0450 con 0x7fdd280b3040 2022-01-10T01:27:50.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.024+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/3501186788 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd28066c00 con 0x7fdd280b3040 2022-01-10T01:27:50.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.024+0000 7fdd277fe700 1 -- 172.21.15.36:0/3501186788 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fdd1c010070 con 0x7fdd280b3040 2022-01-10T01:27:50.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.024+0000 7fdd277fe700 1 --2- 172.21.15.36:0/3501186788 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd080534d0 0x7fdd08055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.024+0000 7fdd277fe700 1 -- 172.21.15.36:0/3501186788 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fdd1c06af70 con 0x7fdd280b3040 2022-01-10T01:27:50.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.024+0000 7fdd2e2b2700 1 --2- 172.21.15.36:0/3501186788 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd080534d0 0x7fdd08055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.024+0000 7fdd2e2b2700 1 --2- 172.21.15.36:0/3501186788 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd080534d0 0x7fdd08055990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fdd1800d000 tx=0x7fdd18007a20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:50.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.032+0000 7fdd277fe700 1 -- 172.21.15.36:0/3501186788 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd1c042260 con 0x7fdd280b3040 2022-01-10T01:27:50.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.156+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/3501186788 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdd28057350 con 0x7fdd280b3040 2022-01-10T01:27:50.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.156+0000 7fdd277fe700 1 -- 172.21.15.36:0/3501186788 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v52) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdd1c018070 con 0x7fdd280b3040 2022-01-10T01:27:50.163 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:27:50.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.160+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/3501186788 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd080534d0 msgr2=0x7fdd08055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.160+0000 7fdd2f2b4700 1 --2- 172.21.15.36:0/3501186788 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd080534d0 0x7fdd08055990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fdd1800d000 tx=0x7fdd18007a20).stop 2022-01-10T01:27:50.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.160+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/3501186788 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd280b3040 msgr2=0x7fdd281534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.160+0000 7fdd2f2b4700 1 --2- 172.21.15.36:0/3501186788 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd280b3040 0x7fdd281534a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fdd1c000fe0 tx=0x7fdd1c001ab0).stop 2022-01-10T01:27:50.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.160+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/3501186788 shutdown_connections 2022-01-10T01:27:50.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.160+0000 7fdd2f2b4700 1 --2- 172.21.15.36:0/3501186788 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd080534d0 0x7fdd08055990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.160+0000 7fdd2f2b4700 1 --2- 172.21.15.36:0/3501186788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd28148860 0x7fdd28153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.160+0000 7fdd2f2b4700 1 --2- 172.21.15.36:0/3501186788 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd280b3040 0x7fdd281534a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.160+0000 7fdd2f2b4700 1 --2- 172.21.15.36:0/3501186788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd280a9c10 0x7fdd2805f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.160+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/3501186788 >> 172.21.15.36:0/3501186788 conn(0x7fdd280636e0 msgr2=0x7fdd280b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:50.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.160+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/3501186788 shutdown_connections 2022-01-10T01:27:50.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.160+0000 7fdd2f2b4700 1 -- 172.21.15.36:0/3501186788 wait complete. 2022-01-10T01:27:50.180 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:27:50.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1bb59e700 1 Processor -- start 2022-01-10T01:27:50.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1bb59e700 1 -- start start 2022-01-10T01:27:50.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1bb59e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa1bc061680 0x7fa1bc0b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1bb59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1bc1439a0 0x7fa1bc1404b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1bb59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1bc0b6910 con 0x7fa1bc0b4710 2022-01-10T01:27:50.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1bb59e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1bc0b9680 con 0x7fa1bc061680 2022-01-10T01:27:50.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1bb59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0b6bb0 con 0x7fa1bc1439a0 2022-01-10T01:27:50.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1b9d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa1bc0b4710 0x7fa1bc13fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34192/0 (socket says 172.21.15.36:34192) 2022-01-10T01:27:50.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1b9d9b700 1 -- 172.21.15.36:0/906399536 learned_addr learned my addr 172.21.15.36:0/906399536 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:50.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1ba59c700 1 --2- 172.21.15.36:0/906399536 >> v2:172.21.15.36:3300/0 conn(0x7fa1bc061680 0x7fa1bc0b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1bad9d700 1 --2- 172.21.15.36:0/906399536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1bc1439a0 0x7fa1bc1404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1b959a700 1 -- 172.21.15.36:0/906399536 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880652896 0 0) 0x7fa1bc0b6910 con 0x7fa1bc0b4710 2022-01-10T01:27:50.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1b959a700 1 -- 172.21.15.36:0/906399536 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1a0003260 con 0x7fa1bc0b4710 2022-01-10T01:27:50.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1ba59c700 1 -- 172.21.15.36:0/906399536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1bc1439a0 msgr2=0x7fa1bc1404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:50.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.288+0000 7fa1ba59c700 1 --2- 172.21.15.36:0/906399536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1bc1439a0 0x7fa1bc1404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1ba59c700 1 -- 172.21.15.36:0/906399536 >> v1:172.21.15.36:6789/0 conn(0x7fa1bc0b4710 legacy=0x7fa1bc13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1ba59c700 1 -- 172.21.15.36:0/906399536 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1bc0b6e50 con 0x7fa1bc061680 2022-01-10T01:27:50.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1bad9d700 1 --2- 172.21.15.36:0/906399536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1bc1439a0 0x7fa1bc1404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:27:50.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1ba59c700 1 --2- 172.21.15.36:0/906399536 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1bc061680 0x7fa1bc0b9d10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fa1b0002f70 tx=0x7fa1b0006df0).ready entity=mon.0 client_cookie=198b13658d20e7b1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:50.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1b959a700 1 -- 172.21.15.36:0/906399536 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1b000d4a0 con 0x7fa1bc061680 2022-01-10T01:27:50.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1b959a700 1 -- 172.21.15.36:0/906399536 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b0000e90 con 0x7fa1bc061680 2022-01-10T01:27:50.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1b959a700 1 -- 172.21.15.36:0/906399536 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1b000d7f0 con 0x7fa1bc061680 2022-01-10T01:27:50.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1bb59e700 1 -- 172.21.15.36:0/906399536 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1bc061680 msgr2=0x7fa1bc0b9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1bb59e700 1 --2- 172.21.15.36:0/906399536 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1bc061680 0x7fa1bc0b9d10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fa1b0002f70 tx=0x7fa1b0006df0).stop 2022-01-10T01:27:50.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1bb59e700 1 -- 172.21.15.36:0/906399536 shutdown_connections 2022-01-10T01:27:50.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1bb59e700 1 --2- 172.21.15.36:0/906399536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1bc1439a0 0x7fa1bc1404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1bb59e700 1 --2- 172.21.15.36:0/906399536 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1bc061680 0x7fa1bc0b9d10 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1bb59e700 1 -- 172.21.15.36:0/906399536 >> 172.21.15.36:0/906399536 conn(0x7fa1bc06adf0 msgr2=0x7fa1bc05f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:50.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1bb59e700 1 -- 172.21.15.36:0/906399536 shutdown_connections 2022-01-10T01:27:50.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1bb59e700 1 -- 172.21.15.36:0/906399536 wait complete. 2022-01-10T01:27:50.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1bb59e700 1 Processor -- start 2022-01-10T01:27:50.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.292+0000 7fa1bb59e700 1 -- start start 2022-01-10T01:27:50.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1bb59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1bc1439a0 0x7fa1bc112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1bb59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1bc14f560 0x7fa1bc14f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1bb59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1bc0ae170 0x7fa1bc0ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1bb59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc0add40 con 0x7fa1bc1439a0 2022-01-10T01:27:50.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1bb59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc1471e0 con 0x7fa1bc0ae170 2022-01-10T01:27:50.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1bb59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1bc146a30 con 0x7fa1bc14f560 2022-01-10T01:27:50.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1ba59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1bc1439a0 0x7fa1bc112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1ba59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1bc1439a0 0x7fa1bc112a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36404/0 (socket says 172.21.15.36:36404) 2022-01-10T01:27:50.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1ba59c700 1 -- 172.21.15.36:0/3990527363 learned_addr learned my addr 172.21.15.36:0/3990527363 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:50.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1b9d9b700 1 --2- 172.21.15.36:0/3990527363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1bc14f560 0x7fa1bc14f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1bad9d700 1 --2- 172.21.15.36:0/3990527363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1bc0ae170 0x7fa1bc0ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1ba59c700 1 -- 172.21.15.36:0/3990527363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1bc14f560 msgr2=0x7fa1bc14f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1ba59c700 1 --2- 172.21.15.36:0/3990527363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1bc14f560 0x7fa1bc14f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1ba59c700 1 -- 172.21.15.36:0/3990527363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1bc0ae170 msgr2=0x7fa1bc0ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1ba59c700 1 --2- 172.21.15.36:0/3990527363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1bc0ae170 0x7fa1bc0ae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1ba59c700 1 -- 172.21.15.36:0/3990527363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b4009470 con 0x7fa1bc1439a0 2022-01-10T01:27:50.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1ba59c700 1 --2- 172.21.15.36:0/3990527363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1bc1439a0 0x7fa1bc112a40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fa1bc152380 tx=0x7fa1b0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:50.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1ab7fe700 1 -- 172.21.15.36:0/3990527363 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1b0013970 con 0x7fa1bc1439a0 2022-01-10T01:27:50.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1ab7fe700 1 -- 172.21.15.36:0/3990527363 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b0013ad0 con 0x7fa1bc1439a0 2022-01-10T01:27:50.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1ab7fe700 1 -- 172.21.15.36:0/3990527363 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1b0013e30 con 0x7fa1bc1439a0 2022-01-10T01:27:50.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1bb59e700 1 -- 172.21.15.36:0/3990527363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b000b180 con 0x7fa1bc1439a0 2022-01-10T01:27:50.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.296+0000 7fa1bb59e700 1 -- 172.21.15.36:0/3990527363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1bc146c60 con 0x7fa1bc1439a0 2022-01-10T01:27:50.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.300+0000 7fa1bb59e700 1 -- 172.21.15.36:0/3990527363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1bc1530f0 con 0x7fa1bc1439a0 2022-01-10T01:27:50.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.300+0000 7fa1ab7fe700 1 -- 172.21.15.36:0/3990527363 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa1b0025030 con 0x7fa1bc1439a0 2022-01-10T01:27:50.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.300+0000 7fa1ab7fe700 1 --2- 172.21.15.36:0/3990527363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa198053590 0x7fa198055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.300+0000 7fa1ab7fe700 1 -- 172.21.15.36:0/3990527363 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fa1b006c440 con 0x7fa1bc1439a0 2022-01-10T01:27:50.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.300+0000 7fa1b9d9b700 1 --2- 172.21.15.36:0/3990527363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa198053590 0x7fa198055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.300+0000 7fa1b9d9b700 1 --2- 172.21.15.36:0/3990527363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa198053590 0x7fa198055a50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fa1ac00d000 tx=0x7fa1ac009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:50.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.304+0000 7fa1ab7fe700 1 -- 172.21.15.36:0/3990527363 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa1bc1530f0 con 0x7fa1bc1439a0 2022-01-10T01:27:50.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.432+0000 7fa1bb59e700 1 -- 172.21.15.36:0/3990527363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa1bc1530f0 con 0x7fa1bc1439a0 2022-01-10T01:27:50.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.432+0000 7fa1ab7fe700 1 -- 172.21.15.36:0/3990527363 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v52) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa1bc1530f0 con 0x7fa1bc1439a0 2022-01-10T01:27:50.437 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:27:50.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.432+0000 7fa1bb59e700 1 -- 172.21.15.36:0/3990527363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa198053590 msgr2=0x7fa198055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.432+0000 7fa1bb59e700 1 --2- 172.21.15.36:0/3990527363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa198053590 0x7fa198055a50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fa1ac00d000 tx=0x7fa1ac009040).stop 2022-01-10T01:27:50.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.432+0000 7fa1bb59e700 1 -- 172.21.15.36:0/3990527363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1bc1439a0 msgr2=0x7fa1bc112a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.432+0000 7fa1bb59e700 1 --2- 172.21.15.36:0/3990527363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1bc1439a0 0x7fa1bc112a40 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fa1bc152380 tx=0x7fa1b0014000).stop 2022-01-10T01:27:50.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.436+0000 7fa1bb59e700 1 -- 172.21.15.36:0/3990527363 shutdown_connections 2022-01-10T01:27:50.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.436+0000 7fa1bb59e700 1 --2- 172.21.15.36:0/3990527363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa198053590 0x7fa198055a50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.436+0000 7fa1bb59e700 1 --2- 172.21.15.36:0/3990527363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1bc0ae170 0x7fa1bc0ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.436+0000 7fa1bb59e700 1 --2- 172.21.15.36:0/3990527363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1bc14f560 0x7fa1bc14f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.436+0000 7fa1bb59e700 1 --2- 172.21.15.36:0/3990527363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1bc1439a0 0x7fa1bc112a40 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.436+0000 7fa1bb59e700 1 -- 172.21.15.36:0/3990527363 >> 172.21.15.36:0/3990527363 conn(0x7fa1bc06adf0 msgr2=0x7fa1bc142630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:50.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.436+0000 7fa1bb59e700 1 -- 172.21.15.36:0/3990527363 shutdown_connections 2022-01-10T01:27:50.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.436+0000 7fa1bb59e700 1 -- 172.21.15.36:0/3990527363 wait complete. 2022-01-10T01:27:50.449 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-01-10T01:27:50.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fc572700 1 Processor -- start 2022-01-10T01:27:50.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fc572700 1 -- start start 2022-01-10T01:27:50.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fc572700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f58f4139ae0 0x7f58f4142db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fc572700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58f40b1c50 0x7f58f40a8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fc572700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f40ac470 con 0x7f58f41432a0 2022-01-10T01:27:50.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fc572700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f40b3010 con 0x7f58f4139ae0 2022-01-10T01:27:50.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fc572700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f40af320 con 0x7f58f40b1c50 2022-01-10T01:27:50.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fa30e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f58f4139ae0 0x7f58f4142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fa30e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f58f4139ae0 0x7f58f4142db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36412/0 (socket says 172.21.15.36:36412) 2022-01-10T01:27:50.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fa30e700 1 -- 172.21.15.36:0/940621700 learned_addr learned my addr 172.21.15.36:0/940621700 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:50.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fab0f700 1 --2- 172.21.15.36:0/940621700 >> v2:172.21.15.59:3300/0 conn(0x7f58f40b1c50 0x7f58f40a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fa30e700 1 -- 172.21.15.36:0/940621700 >> v2:172.21.15.59:3300/0 conn(0x7f58f40b1c50 msgr2=0x7f58f40a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:50.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fa30e700 1 --2- 172.21.15.36:0/940621700 >> v2:172.21.15.59:3300/0 conn(0x7f58f40b1c50 0x7f58f40a8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fa30e700 1 -- 172.21.15.36:0/940621700 >> v1:172.21.15.59:6789/0 conn(0x7f58f41432a0 legacy=0x7f58f40ab530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fa30e700 1 -- 172.21.15.36:0/940621700 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f4143730 con 0x7f58f4139ae0 2022-01-10T01:27:50.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fab0f700 1 --2- 172.21.15.36:0/940621700 >> v2:172.21.15.59:3300/0 conn(0x7f58f40b1c50 0x7f58f40a8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:27:50.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58fa30e700 1 --2- 172.21.15.36:0/940621700 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58f4139ae0 0x7f58f4142db0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f58e4002f70 tx=0x7f58e4006f40).ready entity=mon.0 client_cookie=636ad8dc69ddb6d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:50.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58f930c700 1 -- 172.21.15.36:0/940621700 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58e400dc70 con 0x7f58f4139ae0 2022-01-10T01:27:50.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58f930c700 1 -- 172.21.15.36:0/940621700 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e4000e90 con 0x7f58f4139ae0 2022-01-10T01:27:50.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.552+0000 7f58f930c700 1 -- 172.21.15.36:0/940621700 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58e400be90 con 0x7f58f4139ae0 2022-01-10T01:27:50.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 -- 172.21.15.36:0/940621700 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58f4139ae0 msgr2=0x7f58f4142db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 --2- 172.21.15.36:0/940621700 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58f4139ae0 0x7f58f4142db0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f58e4002f70 tx=0x7f58e4006f40).stop 2022-01-10T01:27:50.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 -- 172.21.15.36:0/940621700 shutdown_connections 2022-01-10T01:27:50.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 --2- 172.21.15.36:0/940621700 >> v2:172.21.15.59:3300/0 conn(0x7f58f40b1c50 0x7f58f40a8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 --2- 172.21.15.36:0/940621700 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58f4139ae0 0x7f58f4142db0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 -- 172.21.15.36:0/940621700 >> 172.21.15.36:0/940621700 conn(0x7f58f405f6b0 msgr2=0x7f58f405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:50.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 -- 172.21.15.36:0/940621700 shutdown_connections 2022-01-10T01:27:50.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 -- 172.21.15.36:0/940621700 wait complete. 2022-01-10T01:27:50.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 Processor -- start 2022-01-10T01:27:50.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 -- start start 2022-01-10T01:27:50.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58f40b1c50 0x7f58f40b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f41517f0 0x7f58f4064db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f414eab0 0x7f58f4066cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f413b2d0 con 0x7f58f40b1c50 2022-01-10T01:27:50.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f4151c70 con 0x7f58f414eab0 2022-01-10T01:27:50.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fc572700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40655a0 con 0x7f58f41517f0 2022-01-10T01:27:50.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fa30e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58f40b1c50 0x7f58f40b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fa30e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58f40b1c50 0x7f58f40b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36418/0 (socket says 172.21.15.36:36418) 2022-01-10T01:27:50.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fa30e700 1 -- 172.21.15.36:0/2621847496 learned_addr learned my addr 172.21.15.36:0/2621847496 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:50.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58fab0f700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f414eab0 0x7f58f4066cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.556+0000 7f58f9b0d700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f41517f0 0x7f58f4064db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58fa30e700 1 -- 172.21.15.36:0/2621847496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f41517f0 msgr2=0x7f58f4064db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58fa30e700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f41517f0 0x7f58f4064db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58fa30e700 1 -- 172.21.15.36:0/2621847496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f414eab0 msgr2=0x7f58f4066cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58fa30e700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f414eab0 0x7f58f4066cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58fa30e700 1 -- 172.21.15.36:0/2621847496 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e400b460 con 0x7f58f40b1c50 2022-01-10T01:27:50.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58fab0f700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f414eab0 0x7f58f4066cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:27:50.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58fa30e700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58f40b1c50 0x7f58f40b3600 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f58e4002f70 tx=0x7f58f40ac600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:50.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58e37fe700 1 -- 172.21.15.36:0/2621847496 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58e4024450 con 0x7f58f40b1c50 2022-01-10T01:27:50.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58e37fe700 1 -- 172.21.15.36:0/2621847496 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e40245b0 con 0x7f58f40b1c50 2022-01-10T01:27:50.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58fc572700 1 -- 172.21.15.36:0/2621847496 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f4065840 con 0x7f58f40b1c50 2022-01-10T01:27:50.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58e37fe700 1 -- 172.21.15.36:0/2621847496 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58e4024910 con 0x7f58f40b1c50 2022-01-10T01:27:50.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58fc572700 1 -- 172.21.15.36:0/2621847496 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f414e610 con 0x7f58f40b1c50 2022-01-10T01:27:50.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58fc572700 1 -- 172.21.15.36:0/2621847496 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f413cc50 con 0x7f58f40b1c50 2022-01-10T01:27:50.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58e37fe700 1 -- 172.21.15.36:0/2621847496 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f58e4021070 con 0x7f58f40b1c50 2022-01-10T01:27:50.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58e37fe700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f58d4053590 0x7f58d4055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58e37fe700 1 -- 172.21.15.36:0/2621847496 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f58e406f190 con 0x7f58f40b1c50 2022-01-10T01:27:50.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58f9b0d700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f58d4053590 0x7f58d4055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.560+0000 7f58f9b0d700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f58d4053590 0x7f58d4055a50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f58f000b000 tx=0x7f58f0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:50.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.568+0000 7f58e37fe700 1 -- 172.21.15.36:0/2621847496 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f58e4046590 con 0x7f58f40b1c50 2022-01-10T01:27:50.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.700+0000 7f58fc572700 1 -- 172.21.15.36:0/2621847496 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f58f4143c70 con 0x7f58f40b1c50 2022-01-10T01:27:50.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.700+0000 7f58e37fe700 1 -- 172.21.15.36:0/2621847496 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v52) v1 ==== 84+0+143 (secure 0 0 0) 0x7f58e4049bb0 con 0x7f58f40b1c50 2022-01-10T01:27:50.705 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:50.705 INFO:teuthology.orchestra.run.smithi036.stdout:[ 2022-01-10T01:27:50.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:50.705 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 1, 2022-01-10T01:27:50.706 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "device_health_metrics" 2022-01-10T01:27:50.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:27:50.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:27:50.706 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 2, 2022-01-10T01:27:50.707 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "rbd" 2022-01-10T01:27:50.707 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:27:50.707 INFO:teuthology.orchestra.run.smithi036.stdout:] 2022-01-10T01:27:50.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.700+0000 7f58fc572700 1 -- 172.21.15.36:0/2621847496 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f58d4053590 msgr2=0x7f58d4055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.700+0000 7f58fc572700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f58d4053590 0x7f58d4055a50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f58f000b000 tx=0x7f58f0009040).stop 2022-01-10T01:27:50.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.700+0000 7f58fc572700 1 -- 172.21.15.36:0/2621847496 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58f40b1c50 msgr2=0x7f58f40b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.700+0000 7f58fc572700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58f40b1c50 0x7f58f40b3600 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f58e4002f70 tx=0x7f58f40ac600).stop 2022-01-10T01:27:50.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.704+0000 7f58fc572700 1 -- 172.21.15.36:0/2621847496 shutdown_connections 2022-01-10T01:27:50.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.704+0000 7f58fc572700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f58d4053590 0x7f58d4055a50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.704+0000 7f58fc572700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58f414eab0 0x7f58f4066cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.704+0000 7f58fc572700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58f41517f0 0x7f58f4064db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.704+0000 7f58fc572700 1 --2- 172.21.15.36:0/2621847496 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58f40b1c50 0x7f58f40b3600 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.704+0000 7f58fc572700 1 -- 172.21.15.36:0/2621847496 >> 172.21.15.36:0/2621847496 conn(0x7f58f405f6b0 msgr2=0x7f58f40b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:50.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.704+0000 7f58fc572700 1 -- 172.21.15.36:0/2621847496 shutdown_connections 2022-01-10T01:27:50.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.704+0000 7f58fc572700 1 -- 172.21.15.36:0/2621847496 wait complete. 2022-01-10T01:27:50.718 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-01-10T01:27:50.718 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:27:50.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2edef1700 1 Processor -- start 2022-01-10T01:27:50.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2edef1700 1 -- start start 2022-01-10T01:27:50.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2edef1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e80a9ec0 0x7ff2e80aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2edef1700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e8061990 con 0x7ff2e813f790 2022-01-10T01:27:50.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2edef1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e8061c30 con 0x7ff2e80603d0 2022-01-10T01:27:50.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2edef1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8060b90 con 0x7ff2e80a9ec0 2022-01-10T01:27:50.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e7fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff2e813f790 0x7ff2e814a020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34224/0 (socket says 172.21.15.36:34224) 2022-01-10T01:27:50.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e7fff700 1 -- 172.21.15.36:0/3977879152 learned_addr learned my addr 172.21.15.36:0/3977879152 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:50.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e77fe700 1 --2- 172.21.15.36:0/3977879152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e80a9ec0 0x7ff2e80aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e6ffd700 1 -- 172.21.15.36:0/3977879152 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455186220 0 0) 0x7ff2e8061990 con 0x7ff2e813f790 2022-01-10T01:27:50.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e6ffd700 1 -- 172.21.15.36:0/3977879152 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2c8003260 con 0x7ff2e813f790 2022-01-10T01:27:50.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e6ffd700 1 -- 172.21.15.36:0/3977879152 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435993314 0 0) 0x7ff2e8061c30 con 0x7ff2e80603d0 2022-01-10T01:27:50.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e6ffd700 1 -- 172.21.15.36:0/3977879152 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2e8061990 con 0x7ff2e80603d0 2022-01-10T01:27:50.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e6ffd700 1 -- 172.21.15.36:0/3977879152 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2265581908 0 0) 0x7ff2c8003260 con 0x7ff2e813f790 2022-01-10T01:27:50.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e77fe700 1 -- 172.21.15.36:0/3977879152 >> v1:172.21.15.59:6789/0 conn(0x7ff2e80603d0 legacy=0x7ff2e813ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e77fe700 1 -- 172.21.15.36:0/3977879152 >> v1:172.21.15.36:6789/0 conn(0x7ff2e813f790 legacy=0x7ff2e814a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e77fe700 1 -- 172.21.15.36:0/3977879152 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e8060e30 con 0x7ff2e80a9ec0 2022-01-10T01:27:50.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e77fe700 1 --2- 172.21.15.36:0/3977879152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e80a9ec0 0x7ff2e80aa2a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff2e0001b80 tx=0x7ff2d8006df0).ready entity=mon.2 client_cookie=cdf30888e5a1f658 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:50.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e6ffd700 1 -- 172.21.15.36:0/3977879152 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e00019e0 con 0x7ff2e80a9ec0 2022-01-10T01:27:50.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e6ffd700 1 -- 172.21.15.36:0/3977879152 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d8000e90 con 0x7ff2e80a9ec0 2022-01-10T01:27:50.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.824+0000 7ff2e6ffd700 1 -- 172.21.15.36:0/3977879152 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2d8012460 con 0x7ff2e80a9ec0 2022-01-10T01:27:50.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 -- 172.21.15.36:0/3977879152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e80a9ec0 msgr2=0x7ff2e80aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 --2- 172.21.15.36:0/3977879152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e80a9ec0 0x7ff2e80aa2a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff2e0001b80 tx=0x7ff2d8006df0).stop 2022-01-10T01:27:50.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 -- 172.21.15.36:0/3977879152 shutdown_connections 2022-01-10T01:27:50.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 --2- 172.21.15.36:0/3977879152 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e80a9ec0 0x7ff2e80aa2a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 -- 172.21.15.36:0/3977879152 >> 172.21.15.36:0/3977879152 conn(0x7ff2e80b2970 msgr2=0x7ff2e80b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:50.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 -- 172.21.15.36:0/3977879152 shutdown_connections 2022-01-10T01:27:50.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 -- 172.21.15.36:0/3977879152 wait complete. 2022-01-10T01:27:50.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 Processor -- start 2022-01-10T01:27:50.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 -- start start 2022-01-10T01:27:50.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e80603d0 0x7ff2e80b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e80a9ec0 0x7ff2e80add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e813f790 0x7ff2e8155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8064850 con 0x7ff2e813f790 2022-01-10T01:27:50.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8064310 con 0x7ff2e80603d0 2022-01-10T01:27:50.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2edef1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80645b0 con 0x7ff2e80a9ec0 2022-01-10T01:27:50.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2e7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e813f790 0x7ff2e8155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2e7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e813f790 0x7ff2e8155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36436/0 (socket says 172.21.15.36:36436) 2022-01-10T01:27:50.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2e7fff700 1 -- 172.21.15.36:0/3390863394 learned_addr learned my addr 172.21.15.36:0/3390863394 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:50.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2e77fe700 1 --2- 172.21.15.36:0/3390863394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e80603d0 0x7ff2e80b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.828+0000 7ff2deffd700 1 --2- 172.21.15.36:0/3390863394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e80a9ec0 0x7ff2e80add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2e7fff700 1 -- 172.21.15.36:0/3390863394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e80a9ec0 msgr2=0x7ff2e80add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2e7fff700 1 --2- 172.21.15.36:0/3390863394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e80a9ec0 0x7ff2e80add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2e7fff700 1 -- 172.21.15.36:0/3390863394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e80603d0 msgr2=0x7ff2e80b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:50.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2e7fff700 1 --2- 172.21.15.36:0/3390863394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e80603d0 0x7ff2e80b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:50.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2e7fff700 1 -- 172.21.15.36:0/3390863394 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d800b180 con 0x7ff2e813f790 2022-01-10T01:27:50.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2e7fff700 1 --2- 172.21.15.36:0/3390863394 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e813f790 0x7ff2e8155f20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7ff2e0001360 tx=0x7ff2e0001bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:50.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2e57fa700 1 -- 172.21.15.36:0/3390863394 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e0004ab0 con 0x7ff2e813f790 2022-01-10T01:27:50.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2e57fa700 1 -- 172.21.15.36:0/3390863394 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0004c10 con 0x7ff2e813f790 2022-01-10T01:27:50.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2edef1700 1 -- 172.21.15.36:0/3390863394 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e80ad620 con 0x7ff2e813f790 2022-01-10T01:27:50.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2e57fa700 1 -- 172.21.15.36:0/3390863394 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2e0007170 con 0x7ff2e813f790 2022-01-10T01:27:50.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2edef1700 1 -- 172.21.15.36:0/3390863394 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e80ae250 con 0x7ff2e813f790 2022-01-10T01:27:50.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2e57fa700 1 -- 172.21.15.36:0/3390863394 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff2e00072d0 con 0x7ff2e813f790 2022-01-10T01:27:50.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2edef1700 1 -- 172.21.15.36:0/3390863394 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e80610d0 con 0x7ff2e813f790 2022-01-10T01:27:50.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2e57fa700 1 --2- 172.21.15.36:0/3390863394 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2cc053500 0x7ff2cc0559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:50.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2e57fa700 1 -- 172.21.15.36:0/3390863394 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5600+0+0 (secure 0 0 0) 0x7ff2e006b420 con 0x7ff2e813f790 2022-01-10T01:27:50.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2e77fe700 1 --2- 172.21.15.36:0/3390863394 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2cc053500 0x7ff2cc0559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:50.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.832+0000 7ff2e77fe700 1 --2- 172.21.15.36:0/3390863394 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2cc053500 0x7ff2cc0559c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7ff2d801a000 tx=0x7ff2d8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:50.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.840+0000 7ff2e57fa700 1 -- 172.21.15.36:0/3390863394 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2e0042770 con 0x7ff2e813f790 2022-01-10T01:27:50.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:50.968+0000 7ff2edef1700 1 -- 172.21.15.36:0/3390863394 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7ff2e8057350 con 0x7ff2e813f790 2022-01-10T01:27:51.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.696+0000 7ff2e57fa700 1 -- 172.21.15.36:0/3390863394 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v53) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff2e0045d90 con 0x7ff2e813f790 2022-01-10T01:27:51.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.700+0000 7ff2edef1700 1 -- 172.21.15.36:0/3390863394 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2cc053500 msgr2=0x7ff2cc0559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:51.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.700+0000 7ff2edef1700 1 --2- 172.21.15.36:0/3390863394 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2cc053500 0x7ff2cc0559c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7ff2d801a000 tx=0x7ff2d8014000).stop 2022-01-10T01:27:51.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.700+0000 7ff2edef1700 1 -- 172.21.15.36:0/3390863394 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e813f790 msgr2=0x7ff2e8155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:51.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.700+0000 7ff2edef1700 1 --2- 172.21.15.36:0/3390863394 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e813f790 0x7ff2e8155f20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7ff2e0001360 tx=0x7ff2e0001bc0).stop 2022-01-10T01:27:51.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.700+0000 7ff2edef1700 1 -- 172.21.15.36:0/3390863394 shutdown_connections 2022-01-10T01:27:51.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.700+0000 7ff2edef1700 1 --2- 172.21.15.36:0/3390863394 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2cc053500 0x7ff2cc0559c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:51.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.700+0000 7ff2edef1700 1 --2- 172.21.15.36:0/3390863394 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e813f790 0x7ff2e8155f20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:51.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.700+0000 7ff2edef1700 1 --2- 172.21.15.36:0/3390863394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e80a9ec0 0x7ff2e80add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:51.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.700+0000 7ff2edef1700 1 --2- 172.21.15.36:0/3390863394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e80603d0 0x7ff2e80b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:51.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.700+0000 7ff2edef1700 1 -- 172.21.15.36:0/3390863394 >> 172.21.15.36:0/3390863394 conn(0x7ff2e80b2970 msgr2=0x7ff2e805f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:51.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.700+0000 7ff2edef1700 1 -- 172.21.15.36:0/3390863394 shutdown_connections 2022-01-10T01:27:51.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.700+0000 7ff2edef1700 1 -- 172.21.15.36:0/3390863394 wait complete. 2022-01-10T01:27:51.707 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:27:51.720 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2022-01-10T01:27:51.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8dbb4be700 1 Processor -- start 2022-01-10T01:27:51.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8dbb4be700 1 -- start start 2022-01-10T01:27:51.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8dbb4be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8db40b05b0 0x7f8db40b0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:51.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8dbb4be700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8db40b3710 0x7f8db413d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:51.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8dbb4be700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8db413da40 0x7f8db40b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:51.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8dbb4be700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db4143920 con 0x7f8db413da40 2022-01-10T01:27:51.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8dbb4be700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db4143bc0 con 0x7f8db40b3710 2022-01-10T01:27:51.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8dbb4be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db4143e60 con 0x7f8db40b05b0 2022-01-10T01:27:51.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8db9a5b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8db413da40 0x7f8db40b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:51.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8db9a5b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8db413da40 0x7f8db40b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36442/0 (socket says 172.21.15.36:36442) 2022-01-10T01:27:51.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8db9a5b700 1 -- 172.21.15.36:0/1791164446 learned_addr learned my addr 172.21.15.36:0/1791164446 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:51.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8db925a700 1 --2- 172.21.15.36:0/1791164446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8db40b05b0 0x7f8db40b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:51.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8db8a59700 1 --2- 172.21.15.36:0/1791164446 >> v2:172.21.15.59:3300/0 conn(0x7f8db40b3710 0x7f8db413d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:51.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8db9a5b700 1 -- 172.21.15.36:0/1791164446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8db40b05b0 msgr2=0x7f8db40b0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:51.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8db9a5b700 1 --2- 172.21.15.36:0/1791164446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8db40b05b0 0x7f8db40b0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:51.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8db9a5b700 1 -- 172.21.15.36:0/1791164446 >> v2:172.21.15.59:3300/0 conn(0x7f8db40b3710 msgr2=0x7f8db413d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:51.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8db9a5b700 1 --2- 172.21.15.36:0/1791164446 >> v2:172.21.15.59:3300/0 conn(0x7f8db40b3710 0x7f8db413d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:51.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8db9a5b700 1 -- 172.21.15.36:0/1791164446 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db4144100 con 0x7f8db413da40 2022-01-10T01:27:51.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8db925a700 1 --2- 172.21.15.36:0/1791164446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8db40b05b0 0x7f8db40b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:27:51.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8db9a5b700 1 --2- 172.21.15.36:0/1791164446 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8db413da40 0x7f8db40b10b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f8dac0032f0 tx=0x7f8dac009290).ready entity=mon.0 client_cookie=1352966558d5bf50 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:51.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8da3fff700 1 -- 172.21.15.36:0/1791164446 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dac00b870 con 0x7f8db413da40 2022-01-10T01:27:51.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8da3fff700 1 -- 172.21.15.36:0/1791164446 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac00b9d0 con 0x7f8db413da40 2022-01-10T01:27:51.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.832+0000 7f8da3fff700 1 -- 172.21.15.36:0/1791164446 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dac00bb40 con 0x7f8db413da40 2022-01-10T01:27:51.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1791164446 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8db413da40 msgr2=0x7f8db40b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:51.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 --2- 172.21.15.36:0/1791164446 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8db413da40 0x7f8db40b10b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f8dac0032f0 tx=0x7f8dac009290).stop 2022-01-10T01:27:51.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1791164446 shutdown_connections 2022-01-10T01:27:51.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 --2- 172.21.15.36:0/1791164446 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8db413da40 0x7f8db40b10b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:51.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 --2- 172.21.15.36:0/1791164446 >> v2:172.21.15.59:3300/0 conn(0x7f8db40b3710 0x7f8db413d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:51.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 --2- 172.21.15.36:0/1791164446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8db40b05b0 0x7f8db40b0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:51.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1791164446 >> 172.21.15.36:0/1791164446 conn(0x7f8db40607c0 msgr2=0x7f8db4060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:51.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1791164446 shutdown_connections 2022-01-10T01:27:51.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1791164446 wait complete. 2022-01-10T01:27:51.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 Processor -- start 2022-01-10T01:27:51.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 -- start start 2022-01-10T01:27:51.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8db40b05b0 0x7f8db40b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:51.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8db40b3710 0x7f8db413f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:51.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8db413da40 0x7f8db413e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:51.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db4138740 con 0x7f8db40b3710 2022-01-10T01:27:51.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db41389e0 con 0x7f8db413da40 2022-01-10T01:27:51.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8dbb4be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db413f300 con 0x7f8db40b05b0 2022-01-10T01:27:51.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8db8a59700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8db40b3710 0x7f8db413f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:51.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8db9a5b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8db413da40 0x7f8db413e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:51.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8db8a59700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8db40b3710 0x7f8db413f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36450/0 (socket says 172.21.15.36:36450) 2022-01-10T01:27:51.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8db925a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8db40b05b0 0x7f8db40b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:51.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8db8a59700 1 -- 172.21.15.36:0/1601257620 learned_addr learned my addr 172.21.15.36:0/1601257620 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:51.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8db8a59700 1 -- 172.21.15.36:0/1601257620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8db40b05b0 msgr2=0x7f8db40b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:51.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8db8a59700 1 --2- 172.21.15.36:0/1601257620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8db40b05b0 0x7f8db40b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:51.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8db8a59700 1 -- 172.21.15.36:0/1601257620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8db413da40 msgr2=0x7f8db413e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:51.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8db8a59700 1 --2- 172.21.15.36:0/1601257620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8db413da40 0x7f8db413e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:51.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8db8a59700 1 -- 172.21.15.36:0/1601257620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac009530 con 0x7f8db40b3710 2022-01-10T01:27:51.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8db8a59700 1 --2- 172.21.15.36:0/1601257620 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8db40b3710 0x7f8db413f7a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f8da400a000 tx=0x7f8da4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:51.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.836+0000 7f8da27fc700 1 -- 172.21.15.36:0/1601257620 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8da4011780 con 0x7f8db40b3710 2022-01-10T01:27:51.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.840+0000 7f8da27fc700 1 -- 172.21.15.36:0/1601257620 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da40118e0 con 0x7f8db40b3710 2022-01-10T01:27:51.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.840+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1601257620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db4145e70 con 0x7f8db40b3710 2022-01-10T01:27:51.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.840+0000 7f8da27fc700 1 -- 172.21.15.36:0/1601257620 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8da4011c40 con 0x7f8db40b3710 2022-01-10T01:27:51.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.840+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1601257620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db40aa590 con 0x7f8db40b3710 2022-01-10T01:27:51.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.840+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1601257620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db4138be0 con 0x7f8db40b3710 2022-01-10T01:27:51.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.840+0000 7f8da27fc700 1 -- 172.21.15.36:0/1601257620 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8da4006030 con 0x7f8db40b3710 2022-01-10T01:27:51.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.840+0000 7f8da27fc700 1 --2- 172.21.15.36:0/1601257620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8d940534d0 0x7f8d94055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:51.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.844+0000 7f8da27fc700 1 -- 172.21.15.36:0/1601257620 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f8da406b7b0 con 0x7f8db40b3710 2022-01-10T01:27:51.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.844+0000 7f8db925a700 1 --2- 172.21.15.36:0/1601257620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8d940534d0 0x7f8d94055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:51.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.844+0000 7f8db925a700 1 --2- 172.21.15.36:0/1601257620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8d940534d0 0x7f8d94055990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f8db000c000 tx=0x7f8db0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:51.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.852+0000 7f8da27fc700 1 -- 172.21.15.36:0/1601257620 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8da4042990 con 0x7f8db40b3710 2022-01-10T01:27:51.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:51.976+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1601257620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f8db413f4c0 con 0x7f8db40b3710 2022-01-10T01:27:52.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.268+0000 7f8da27fc700 1 -- 172.21.15.36:0/1601257620 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v54) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8da4045fb0 con 0x7f8db40b3710 2022-01-10T01:27:52.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.272+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1601257620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8d940534d0 msgr2=0x7f8d94055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.272+0000 7f8dbb4be700 1 --2- 172.21.15.36:0/1601257620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8d940534d0 0x7f8d94055990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f8db000c000 tx=0x7f8db0008040).stop 2022-01-10T01:27:52.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.272+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1601257620 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8db40b3710 msgr2=0x7f8db413f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.272+0000 7f8dbb4be700 1 --2- 172.21.15.36:0/1601257620 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8db40b3710 0x7f8db413f7a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f8da400a000 tx=0x7f8da4008040).stop 2022-01-10T01:27:52.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.272+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1601257620 shutdown_connections 2022-01-10T01:27:52.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.272+0000 7f8dbb4be700 1 --2- 172.21.15.36:0/1601257620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8d940534d0 0x7f8d94055990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.272+0000 7f8dbb4be700 1 --2- 172.21.15.36:0/1601257620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8db413da40 0x7f8db413e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.272+0000 7f8dbb4be700 1 --2- 172.21.15.36:0/1601257620 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8db40b3710 0x7f8db413f7a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.272+0000 7f8dbb4be700 1 --2- 172.21.15.36:0/1601257620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8db40b05b0 0x7f8db40b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.272+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1601257620 >> 172.21.15.36:0/1601257620 conn(0x7f8db40607c0 msgr2=0x7f8db40ae840 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:52.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.272+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1601257620 shutdown_connections 2022-01-10T01:27:52.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.272+0000 7f8dbb4be700 1 -- 172.21.15.36:0/1601257620 wait complete. 2022-01-10T01:27:52.280 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' created 2022-01-10T01:27:52.292 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-10T01:27:52.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.396+0000 7fccecc45700 1 Processor -- start 2022-01-10T01:27:52.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.396+0000 7fccecc45700 1 -- start start 2022-01-10T01:27:52.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fccecc45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce80b0b80 0x7fcce8146c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fccecc45700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce80b1140 con 0x7fcce80b03d0 2022-01-10T01:27:52.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fccecc45700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcce80a9570 con 0x7fcce80a9190 2022-01-10T01:27:52.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fccecc45700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce80b1370 con 0x7fcce80b0b80 2022-01-10T01:27:52.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fcce7fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fcce80b03d0 0x7fcce81401c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34252/0 (socket says 172.21.15.36:34252) 2022-01-10T01:27:52.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fcce7fff700 1 -- 172.21.15.36:0/1044334391 learned_addr learned my addr 172.21.15.36:0/1044334391 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:52.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fcce6ffd700 1 --2- 172.21.15.36:0/1044334391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce80b0b80 0x7fcce8146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fcce67fc700 1 -- 172.21.15.36:0/1044334391 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065424898 0 0) 0x7fcce80b1140 con 0x7fcce80b03d0 2022-01-10T01:27:52.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fcce67fc700 1 -- 172.21.15.36:0/1044334391 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd4003260 con 0x7fcce80b03d0 2022-01-10T01:27:52.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fcce6ffd700 1 -- 172.21.15.36:0/1044334391 >> v1:172.21.15.59:6789/0 conn(0x7fcce80a9190 legacy=0x7fcce8146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fcce6ffd700 1 -- 172.21.15.36:0/1044334391 >> v1:172.21.15.36:6789/0 conn(0x7fcce80b03d0 legacy=0x7fcce81401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fcce67fc700 1 -- 172.21.15.36:0/1044334391 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321993059 0 0) 0x7fcce80a9570 con 0x7fcce80a9190 2022-01-10T01:27:52.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fcce6ffd700 1 -- 172.21.15.36:0/1044334391 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce80b1610 con 0x7fcce80b0b80 2022-01-10T01:27:52.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fcce6ffd700 1 --2- 172.21.15.36:0/1044334391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce80b0b80 0x7fcce8146c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fccdc002f70 tx=0x7fccdc006df0).ready entity=mon.2 client_cookie=b8cd8a42992cc979 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:52.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fcce67fc700 1 -- 172.21.15.36:0/1044334391 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccdc00d570 con 0x7fcce80b0b80 2022-01-10T01:27:52.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fcce67fc700 1 -- 172.21.15.36:0/1044334391 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc000e90 con 0x7fcce80b0b80 2022-01-10T01:27:52.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.400+0000 7fcce67fc700 1 -- 172.21.15.36:0/1044334391 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccdc00d8c0 con 0x7fcce80b0b80 2022-01-10T01:27:52.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 -- 172.21.15.36:0/1044334391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce80b0b80 msgr2=0x7fcce8146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 --2- 172.21.15.36:0/1044334391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce80b0b80 0x7fcce8146c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fccdc002f70 tx=0x7fccdc006df0).stop 2022-01-10T01:27:52.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 -- 172.21.15.36:0/1044334391 shutdown_connections 2022-01-10T01:27:52.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 --2- 172.21.15.36:0/1044334391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce80b0b80 0x7fcce8146c60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 -- 172.21.15.36:0/1044334391 >> 172.21.15.36:0/1044334391 conn(0x7fcce8061140 msgr2=0x7fcce8062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:52.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 -- 172.21.15.36:0/1044334391 shutdown_connections 2022-01-10T01:27:52.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 -- 172.21.15.36:0/1044334391 wait complete. 2022-01-10T01:27:52.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 Processor -- start 2022-01-10T01:27:52.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 -- start start 2022-01-10T01:27:52.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce80a9190 0x7fcce80aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce80b03d0 0x7fcce80aaee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcce80b0b80 0x7fcce80ab730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8152180 con 0x7fcce80b0b80 2022-01-10T01:27:52.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8141610 con 0x7fcce80b03d0 2022-01-10T01:27:52.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcce8152370 con 0x7fcce80a9190 2022-01-10T01:27:52.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fcce7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcce80b0b80 0x7fcce80ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fcce6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce80b03d0 0x7fcce80aaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fcce7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcce80b0b80 0x7fcce80ab730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36464/0 (socket says 172.21.15.36:36464) 2022-01-10T01:27:52.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fcce7fff700 1 -- 172.21.15.36:0/981994614 learned_addr learned my addr 172.21.15.36:0/981994614 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:52.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fcce77fe700 1 --2- 172.21.15.36:0/981994614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce80a9190 0x7fcce80aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fcce7fff700 1 -- 172.21.15.36:0/981994614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce80a9190 msgr2=0x7fcce80aa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fcce7fff700 1 --2- 172.21.15.36:0/981994614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce80a9190 0x7fcce80aa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fcce7fff700 1 -- 172.21.15.36:0/981994614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce80b03d0 msgr2=0x7fcce80aaee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fcce7fff700 1 --2- 172.21.15.36:0/981994614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce80b03d0 0x7fcce80aaee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fcce7fff700 1 -- 172.21.15.36:0/981994614 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc00b180 con 0x7fcce80b0b80 2022-01-10T01:27:52.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fcce7fff700 1 --2- 172.21.15.36:0/981994614 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcce80b0b80 0x7fcce80ab730 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fcce0001490 tx=0x7fcce0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:52.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fcce4ff9700 1 -- 172.21.15.36:0/981994614 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce0005ba0 con 0x7fcce80b0b80 2022-01-10T01:27:52.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 -- 172.21.15.36:0/981994614 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce8145c70 con 0x7fcce80b0b80 2022-01-10T01:27:52.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.404+0000 7fccecc45700 1 -- 172.21.15.36:0/981994614 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcce8067bc0 con 0x7fcce80b0b80 2022-01-10T01:27:52.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.408+0000 7fcce4ff9700 1 -- 172.21.15.36:0/981994614 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce0005d00 con 0x7fcce80b0b80 2022-01-10T01:27:52.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.408+0000 7fcce4ff9700 1 -- 172.21.15.36:0/981994614 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce0005e70 con 0x7fcce80b0b80 2022-01-10T01:27:52.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.408+0000 7fccecc45700 1 -- 172.21.15.36:0/981994614 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc0003410 con 0x7fcce80b0b80 2022-01-10T01:27:52.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.408+0000 7fcce4ff9700 1 -- 172.21.15.36:0/981994614 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fcce0010070 con 0x7fcce80b0b80 2022-01-10T01:27:52.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.408+0000 7fcce4ff9700 1 --2- 172.21.15.36:0/981994614 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccc8053590 0x7fccc8055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.408+0000 7fcce4ff9700 1 -- 172.21.15.36:0/981994614 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6304+0+0 (secure 0 0 0) 0x7fcce006b2a0 con 0x7fcce80b0b80 2022-01-10T01:27:52.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.408+0000 7fcce77fe700 1 --2- 172.21.15.36:0/981994614 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccc8053590 0x7fccc8055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.408+0000 7fcce77fe700 1 --2- 172.21.15.36:0/981994614 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccc8053590 0x7fccc8055a50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fccd800d000 tx=0x7fccd8007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:52.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.416+0000 7fcce4ff9700 1 -- 172.21.15.36:0/981994614 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcce00421a0 con 0x7fcce80b0b80 2022-01-10T01:27:52.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.584+0000 7fccecc45700 1 -- 172.21.15.36:0/981994614 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fccc0003c40 con 0x7fcce80b0b80 2022-01-10T01:27:52.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.596+0000 7fcce4ff9700 1 -- 172.21.15.36:0/981994614 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 9 and data pool 10 v23) v1 ==== 188+0+0 (secure 0 0 0) 0x7fcce00457c0 con 0x7fcce80b0b80 2022-01-10T01:27:52.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.600+0000 7fccecc45700 1 -- 172.21.15.36:0/981994614 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccc8053590 msgr2=0x7fccc8055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.600+0000 7fccecc45700 1 --2- 172.21.15.36:0/981994614 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccc8053590 0x7fccc8055a50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fccd800d000 tx=0x7fccd8007a00).stop 2022-01-10T01:27:52.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.600+0000 7fccecc45700 1 -- 172.21.15.36:0/981994614 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcce80b0b80 msgr2=0x7fcce80ab730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.600+0000 7fccecc45700 1 --2- 172.21.15.36:0/981994614 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcce80b0b80 0x7fcce80ab730 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fcce0001490 tx=0x7fcce0007e00).stop 2022-01-10T01:27:52.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.600+0000 7fccecc45700 1 -- 172.21.15.36:0/981994614 shutdown_connections 2022-01-10T01:27:52.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.600+0000 7fccecc45700 1 --2- 172.21.15.36:0/981994614 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccc8053590 0x7fccc8055a50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.600+0000 7fccecc45700 1 --2- 172.21.15.36:0/981994614 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcce80b0b80 0x7fcce80ab730 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.600+0000 7fccecc45700 1 --2- 172.21.15.36:0/981994614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcce80b03d0 0x7fcce80aaee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.600+0000 7fccecc45700 1 --2- 172.21.15.36:0/981994614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcce80a9190 0x7fcce80aa9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.600+0000 7fccecc45700 1 -- 172.21.15.36:0/981994614 >> 172.21.15.36:0/981994614 conn(0x7fcce8061140 msgr2=0x7fcce80add50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:52.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.600+0000 7fccecc45700 1 -- 172.21.15.36:0/981994614 shutdown_connections 2022-01-10T01:27:52.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.600+0000 7fccecc45700 1 -- 172.21.15.36:0/981994614 wait complete. 2022-01-10T01:27:52.608 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 9 and data pool 10 2022-01-10T01:27:52.620 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:27:52.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38ffff700 1 Processor -- start 2022-01-10T01:27:52.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38ffff700 1 -- start start 2022-01-10T01:27:52.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff3900b3710 0x7ff390064a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38ffff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3900b8090 con 0x7ff390064640 2022-01-10T01:27:52.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38ffff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff390143130 con 0x7ff3900b4aa0 2022-01-10T01:27:52.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38ffff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff390142f40 con 0x7ff3900b3710 2022-01-10T01:27:52.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38effd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff390064640 0x7ff390143870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34264/0 (socket says 172.21.15.36:34264) 2022-01-10T01:27:52.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38effd700 1 -- 172.21.15.36:0/1956126946 learned_addr learned my addr 172.21.15.36:0/1956126946 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:52.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38f7fe700 1 --2- 172.21.15.36:0/1956126946 >> v2:172.21.15.36:3300/0 conn(0x7ff3900b3710 0x7ff390064a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38dffb700 1 -- 172.21.15.36:0/1956126946 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257094178 0 0) 0x7ff3900b8090 con 0x7ff390064640 2022-01-10T01:27:52.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38dffb700 1 -- 172.21.15.36:0/1956126946 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff370003260 con 0x7ff390064640 2022-01-10T01:27:52.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38f7fe700 1 -- 172.21.15.36:0/1956126946 >> v1:172.21.15.59:6789/0 conn(0x7ff3900b4aa0 legacy=0x7ff390066500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38f7fe700 1 -- 172.21.15.36:0/1956126946 >> v1:172.21.15.36:6789/0 conn(0x7ff390064640 legacy=0x7ff390143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38f7fe700 1 -- 172.21.15.36:0/1956126946 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3901433d0 con 0x7ff3900b3710 2022-01-10T01:27:52.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.708+0000 7ff38f7fe700 1 --2- 172.21.15.36:0/1956126946 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3900b3710 0x7ff390064a20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7ff380002f70 tx=0x7ff380006df0).ready entity=mon.0 client_cookie=e93d788f607a095d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:52.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.712+0000 7ff38dffb700 1 -- 172.21.15.36:0/1956126946 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff38000d610 con 0x7ff3900b3710 2022-01-10T01:27:52.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.712+0000 7ff38dffb700 1 -- 172.21.15.36:0/1956126946 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff380000e90 con 0x7ff3900b3710 2022-01-10T01:27:52.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.712+0000 7ff38dffb700 1 -- 172.21.15.36:0/1956126946 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff38000d960 con 0x7ff3900b3710 2022-01-10T01:27:52.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.712+0000 7ff38ffff700 1 -- 172.21.15.36:0/1956126946 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3900b3710 msgr2=0x7ff390064a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.712+0000 7ff38ffff700 1 --2- 172.21.15.36:0/1956126946 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3900b3710 0x7ff390064a20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7ff380002f70 tx=0x7ff380006df0).stop 2022-01-10T01:27:52.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.712+0000 7ff38ffff700 1 -- 172.21.15.36:0/1956126946 shutdown_connections 2022-01-10T01:27:52.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.712+0000 7ff38ffff700 1 --2- 172.21.15.36:0/1956126946 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3900b3710 0x7ff390064a20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.712+0000 7ff38ffff700 1 -- 172.21.15.36:0/1956126946 >> 172.21.15.36:0/1956126946 conn(0x7ff39005f6b0 msgr2=0x7ff39005fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:52.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.712+0000 7ff38ffff700 1 -- 172.21.15.36:0/1956126946 shutdown_connections 2022-01-10T01:27:52.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.712+0000 7ff38ffff700 1 -- 172.21.15.36:0/1956126946 wait complete. 2022-01-10T01:27:52.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.712+0000 7ff38ffff700 1 Processor -- start 2022-01-10T01:27:52.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.712+0000 7ff38ffff700 1 -- start start 2022-01-10T01:27:52.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff390064640 0x7ff390061a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3900b3710 0x7ff3900b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3900b4aa0 0x7ff3900b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38ffff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff390145c20 con 0x7ff3900b4aa0 2022-01-10T01:27:52.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38ffff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3900ae870 con 0x7ff390064640 2022-01-10T01:27:52.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38ffff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3900aeb10 con 0x7ff3900b3710 2022-01-10T01:27:52.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3900b4aa0 0x7ff3900b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff390064640 0x7ff390061a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff390064640 0x7ff390061a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:33110/0 (socket says 172.21.15.36:33110) 2022-01-10T01:27:52.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3900b4aa0 0x7ff3900b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36480/0 (socket says 172.21.15.36:36480) 2022-01-10T01:27:52.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38effd700 1 -- 172.21.15.36:0/1092402930 learned_addr learned my addr 172.21.15.36:0/1092402930 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:52.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38e7fc700 1 --2- 172.21.15.36:0/1092402930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3900b3710 0x7ff3900b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38f7fe700 1 -- 172.21.15.36:0/1092402930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3900b3710 msgr2=0x7ff3900b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38f7fe700 1 --2- 172.21.15.36:0/1092402930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3900b3710 0x7ff3900b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38f7fe700 1 -- 172.21.15.36:0/1092402930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff390064640 msgr2=0x7ff390061a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38f7fe700 1 --2- 172.21.15.36:0/1092402930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff390064640 0x7ff390061a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38f7fe700 1 -- 172.21.15.36:0/1092402930 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38000b180 con 0x7ff3900b4aa0 2022-01-10T01:27:52.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38f7fe700 1 --2- 172.21.15.36:0/1092402930 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3900b4aa0 0x7ff3900b0690 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7ff380002f70 tx=0x7ff380014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:52.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff387fff700 1 -- 172.21.15.36:0/1092402930 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff380013de0 con 0x7ff3900b4aa0 2022-01-10T01:27:52.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff387fff700 1 -- 172.21.15.36:0/1092402930 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38000d290 con 0x7ff3900b4aa0 2022-01-10T01:27:52.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff387fff700 1 -- 172.21.15.36:0/1092402930 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff38001e5f0 con 0x7ff3900b4aa0 2022-01-10T01:27:52.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38ffff700 1 -- 172.21.15.36:0/1092402930 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff390062400 con 0x7ff3900b4aa0 2022-01-10T01:27:52.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.716+0000 7ff38ffff700 1 -- 172.21.15.36:0/1092402930 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3900aefb0 con 0x7ff3900b4aa0 2022-01-10T01:27:52.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.720+0000 7ff38ffff700 1 -- 172.21.15.36:0/1092402930 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3900aecd0 con 0x7ff3900b4aa0 2022-01-10T01:27:52.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.720+0000 7ff387fff700 1 -- 172.21.15.36:0/1092402930 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff38001c070 con 0x7ff3900b4aa0 2022-01-10T01:27:52.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.720+0000 7ff387fff700 1 --2- 172.21.15.36:0/1092402930 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff374053560 0x7ff374055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.720+0000 7ff38effd700 1 --2- 172.21.15.36:0/1092402930 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff374053560 0x7ff374055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.720+0000 7ff387fff700 1 -- 172.21.15.36:0/1092402930 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff38006c4a0 con 0x7ff3900b4aa0 2022-01-10T01:27:52.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.720+0000 7ff38effd700 1 --2- 172.21.15.36:0/1092402930 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff374053560 0x7ff374055a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7ff38800d000 tx=0x7ff388009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:52.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.724+0000 7ff387fff700 1 -- 172.21.15.36:0/1092402930 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff3800433a0 con 0x7ff3900b4aa0 2022-01-10T01:27:52.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.852+0000 7ff38ffff700 1 -- 172.21.15.36:0/1092402930 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3900b7d40 con 0x7ff3900b4aa0 2022-01-10T01:27:52.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.856+0000 7ff387fff700 1 -- 172.21.15.36:0/1092402930 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16286 (secure 0 0 0) 0x7ff380023020 con 0x7ff3900b4aa0 2022-01-10T01:27:52.861 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:52.861 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":55,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:27:52.591347+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:27:51.027021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2022-01-10T01:27:52.032505+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:27:52.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.856+0000 7ff38ffff700 1 -- 172.21.15.36:0/1092402930 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff374053560 msgr2=0x7ff374055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.856+0000 7ff38ffff700 1 --2- 172.21.15.36:0/1092402930 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff374053560 0x7ff374055a20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7ff38800d000 tx=0x7ff388009040).stop 2022-01-10T01:27:52.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.856+0000 7ff38ffff700 1 -- 172.21.15.36:0/1092402930 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3900b4aa0 msgr2=0x7ff3900b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.856+0000 7ff38ffff700 1 --2- 172.21.15.36:0/1092402930 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3900b4aa0 0x7ff3900b0690 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7ff380002f70 tx=0x7ff380014000).stop 2022-01-10T01:27:52.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.860+0000 7ff38ffff700 1 -- 172.21.15.36:0/1092402930 shutdown_connections 2022-01-10T01:27:52.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.860+0000 7ff38ffff700 1 --2- 172.21.15.36:0/1092402930 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff374053560 0x7ff374055a20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.860+0000 7ff38ffff700 1 --2- 172.21.15.36:0/1092402930 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3900b4aa0 0x7ff3900b0690 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.860+0000 7ff38ffff700 1 --2- 172.21.15.36:0/1092402930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3900b3710 0x7ff3900b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.860+0000 7ff38ffff700 1 --2- 172.21.15.36:0/1092402930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff390064640 0x7ff390061a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.860+0000 7ff38ffff700 1 -- 172.21.15.36:0/1092402930 >> 172.21.15.36:0/1092402930 conn(0x7ff39005f6b0 msgr2=0x7ff390140de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:52.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.860+0000 7ff38ffff700 1 -- 172.21.15.36:0/1092402930 shutdown_connections 2022-01-10T01:27:52.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.860+0000 7ff38ffff700 1 -- 172.21.15.36:0/1092402930 wait complete. 2022-01-10T01:27:52.875 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:27:52.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979975700 1 Processor -- start 2022-01-10T01:27:52.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979975700 1 -- start start 2022-01-10T01:27:52.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979975700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59740b03e0 0x7f59740aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979975700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f597413f8b0 0x7f597413fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979975700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59740af480 con 0x7f59740ad4e0 2022-01-10T01:27:52.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979975700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59740b0ab0 con 0x7f597413f8b0 2022-01-10T01:27:52.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979975700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59740b0d50 con 0x7f59740b03e0 2022-01-10T01:27:52.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979174700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f597413f8b0 0x7f597413fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979174700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f597413f8b0 0x7f597413fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36488/0 (socket says 172.21.15.36:36488) 2022-01-10T01:27:52.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979174700 1 -- 172.21.15.36:0/334241165 learned_addr learned my addr 172.21.15.36:0/334241165 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:52.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5978973700 1 --1- 172.21.15.36:0/334241165 >> v1:172.21.15.36:6789/0 conn(0x7f59740ad4e0 0x7f59740b1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34280/0 (socket says 172.21.15.36:34280) 2022-01-10T01:27:52.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5973fff700 1 --2- 172.21.15.36:0/334241165 >> v2:172.21.15.59:3300/0 conn(0x7f59740b03e0 0x7f59740aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979174700 1 -- 172.21.15.36:0/334241165 >> v2:172.21.15.59:3300/0 conn(0x7f59740b03e0 msgr2=0x7f59740aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:52.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979174700 1 --2- 172.21.15.36:0/334241165 >> v2:172.21.15.59:3300/0 conn(0x7f59740b03e0 0x7f59740aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979174700 1 -- 172.21.15.36:0/334241165 >> v1:172.21.15.36:6789/0 conn(0x7f59740ad4e0 legacy=0x7f59740b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979174700 1 -- 172.21.15.36:0/334241165 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59740ae850 con 0x7f597413f8b0 2022-01-10T01:27:52.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5973fff700 1 --2- 172.21.15.36:0/334241165 >> v2:172.21.15.59:3300/0 conn(0x7f59740b03e0 0x7f59740aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:27:52.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f5979174700 1 --2- 172.21.15.36:0/334241165 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f597413f8b0 0x7f597413fd10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f596c002f70 tx=0x7f596c006f40).ready entity=mon.0 client_cookie=8cf7f0859fc2333b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:52.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f59737fe700 1 -- 172.21.15.36:0/334241165 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596c00dc70 con 0x7f597413f8b0 2022-01-10T01:27:52.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f59737fe700 1 -- 172.21.15.36:0/334241165 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596c000e90 con 0x7f597413f8b0 2022-01-10T01:27:52.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.972+0000 7f59737fe700 1 -- 172.21.15.36:0/334241165 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596c00be90 con 0x7f597413f8b0 2022-01-10T01:27:52.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 -- 172.21.15.36:0/334241165 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f597413f8b0 msgr2=0x7f597413fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 --2- 172.21.15.36:0/334241165 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f597413f8b0 0x7f597413fd10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f596c002f70 tx=0x7f596c006f40).stop 2022-01-10T01:27:52.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 -- 172.21.15.36:0/334241165 shutdown_connections 2022-01-10T01:27:52.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 --2- 172.21.15.36:0/334241165 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f597413f8b0 0x7f597413fd10 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 --2- 172.21.15.36:0/334241165 >> v2:172.21.15.59:3300/0 conn(0x7f59740b03e0 0x7f59740aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 -- 172.21.15.36:0/334241165 >> 172.21.15.36:0/334241165 conn(0x7f59740611d0 msgr2=0x7f5974062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:52.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 -- 172.21.15.36:0/334241165 shutdown_connections 2022-01-10T01:27:52.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 -- 172.21.15.36:0/334241165 wait complete. 2022-01-10T01:27:52.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 Processor -- start 2022-01-10T01:27:52.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 -- start start 2022-01-10T01:27:52.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59740ad4e0 0x7f5974153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59740b03e0 0x7f59740a3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597413f8b0 0x7f5974155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5974064870 con 0x7f59740ad4e0 2022-01-10T01:27:52.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59740644a0 con 0x7f597413f8b0 2022-01-10T01:27:52.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.976+0000 7f5979975700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5974064e60 con 0x7f59740b03e0 2022-01-10T01:27:52.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5978973700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59740ad4e0 0x7f5974153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5978973700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59740ad4e0 0x7f5974153130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36490/0 (socket says 172.21.15.36:36490) 2022-01-10T01:27:52.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5978973700 1 -- 172.21.15.36:0/1319875764 learned_addr learned my addr 172.21.15.36:0/1319875764 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:52.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5973fff700 1 --2- 172.21.15.36:0/1319875764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59740b03e0 0x7f59740a3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5979174700 1 --2- 172.21.15.36:0/1319875764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597413f8b0 0x7f5974155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5978973700 1 -- 172.21.15.36:0/1319875764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59740b03e0 msgr2=0x7f59740a3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5978973700 1 --2- 172.21.15.36:0/1319875764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59740b03e0 0x7f59740a3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5978973700 1 -- 172.21.15.36:0/1319875764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597413f8b0 msgr2=0x7f5974155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:52.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5978973700 1 --2- 172.21.15.36:0/1319875764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597413f8b0 0x7f5974155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:52.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5978973700 1 -- 172.21.15.36:0/1319875764 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c00b460 con 0x7f59740ad4e0 2022-01-10T01:27:52.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5978973700 1 --2- 172.21.15.36:0/1319875764 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59740ad4e0 0x7f5974153130 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f59740ae690 tx=0x7f5968007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:52.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5971ffb700 1 -- 172.21.15.36:0/1319875764 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59680070d0 con 0x7f59740ad4e0 2022-01-10T01:27:52.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5971ffb700 1 -- 172.21.15.36:0/1319875764 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968007230 con 0x7f59740ad4e0 2022-01-10T01:27:52.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5979975700 1 -- 172.21.15.36:0/1319875764 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597405c4f0 con 0x7f59740ad4e0 2022-01-10T01:27:52.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5971ffb700 1 -- 172.21.15.36:0/1319875764 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5968005740 con 0x7f59740ad4e0 2022-01-10T01:27:52.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5979975700 1 -- 172.21.15.36:0/1319875764 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59740a3560 con 0x7f59740ad4e0 2022-01-10T01:27:52.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5971ffb700 1 -- 172.21.15.36:0/1319875764 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5968010070 con 0x7f59740ad4e0 2022-01-10T01:27:52.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5979975700 1 -- 172.21.15.36:0/1319875764 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5974064660 con 0x7f59740ad4e0 2022-01-10T01:27:52.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.980+0000 7f5971ffb700 1 --2- 172.21.15.36:0/1319875764 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5954053680 0x7f5954055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:52.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.984+0000 7f5971ffb700 1 -- 172.21.15.36:0/1319875764 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f596806ada0 con 0x7f59740ad4e0 2022-01-10T01:27:52.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.984+0000 7f5973fff700 1 --2- 172.21.15.36:0/1319875764 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5954053680 0x7f5954055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:52.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.984+0000 7f5973fff700 1 --2- 172.21.15.36:0/1319875764 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5954053680 0x7f5954055b40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f596400d000 tx=0x7f5964008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:52.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:52.988+0000 7f5971ffb700 1 -- 172.21.15.36:0/1319875764 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5968041db0 con 0x7f59740ad4e0 2022-01-10T01:27:53.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.116+0000 7f5979975700 1 -- 172.21.15.36:0/1319875764 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59740af480 con 0x7f59740ad4e0 2022-01-10T01:27:53.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.116+0000 7f5971ffb700 1 -- 172.21.15.36:0/1319875764 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16286 (secure 0 0 0) 0x7f59740af480 con 0x7f59740ad4e0 2022-01-10T01:27:53.121 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:53.121 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":55,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:27:52.591347+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:27:51.027021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2022-01-10T01:27:52.032505+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:27:53.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.120+0000 7f5979975700 1 -- 172.21.15.36:0/1319875764 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5954053680 msgr2=0x7f5954055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:53.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.120+0000 7f5979975700 1 --2- 172.21.15.36:0/1319875764 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5954053680 0x7f5954055b40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f596400d000 tx=0x7f5964008040).stop 2022-01-10T01:27:53.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.120+0000 7f5979975700 1 -- 172.21.15.36:0/1319875764 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59740ad4e0 msgr2=0x7f5974153130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:53.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.120+0000 7f5979975700 1 --2- 172.21.15.36:0/1319875764 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59740ad4e0 0x7f5974153130 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f59740ae690 tx=0x7f5968007c00).stop 2022-01-10T01:27:53.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.120+0000 7f5979975700 1 -- 172.21.15.36:0/1319875764 shutdown_connections 2022-01-10T01:27:53.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.120+0000 7f5979975700 1 --2- 172.21.15.36:0/1319875764 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5954053680 0x7f5954055b40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.120+0000 7f5979975700 1 --2- 172.21.15.36:0/1319875764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f597413f8b0 0x7f5974155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.120+0000 7f5979975700 1 --2- 172.21.15.36:0/1319875764 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59740b03e0 0x7f59740a3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.120+0000 7f5979975700 1 --2- 172.21.15.36:0/1319875764 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59740ad4e0 0x7f5974153130 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.120+0000 7f5979975700 1 -- 172.21.15.36:0/1319875764 >> 172.21.15.36:0/1319875764 conn(0x7f59740611d0 msgr2=0x7f597413fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:53.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.120+0000 7f5979975700 1 -- 172.21.15.36:0/1319875764 shutdown_connections 2022-01-10T01:27:53.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.120+0000 7f5979975700 1 -- 172.21.15.36:0/1319875764 wait complete. 2022-01-10T01:27:53.135 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-01-10T01:27:53.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb716128700 1 Processor -- start 2022-01-10T01:27:53.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb716128700 1 -- start start 2022-01-10T01:27:53.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb716128700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb7100b1980 0x7fb7100b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:53.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb716128700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7100616d0 0x7fb710060b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:53.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb716128700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb710140090 con 0x7fb710139ca0 2022-01-10T01:27:53.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb716128700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7100ad0b0 con 0x7fb7100b1980 2022-01-10T01:27:53.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb716128700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7100abd30 con 0x7fb7100616d0 2022-01-10T01:27:53.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb70f7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb7100b1980 0x7fb7100b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:53.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb70f7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb7100b1980 0x7fb7100b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36498/0 (socket says 172.21.15.36:36498) 2022-01-10T01:27:53.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb70f7fe700 1 -- 172.21.15.36:0/469485572 learned_addr learned my addr 172.21.15.36:0/469485572 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:53.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb707fff700 1 --2- 172.21.15.36:0/469485572 >> v2:172.21.15.59:3300/0 conn(0x7fb7100616d0 0x7fb710060b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:53.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb70f7fe700 1 -- 172.21.15.36:0/469485572 >> v2:172.21.15.59:3300/0 conn(0x7fb7100616d0 msgr2=0x7fb710060b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:53.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb70f7fe700 1 --2- 172.21.15.36:0/469485572 >> v2:172.21.15.59:3300/0 conn(0x7fb7100616d0 0x7fb710060b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb70f7fe700 1 -- 172.21.15.36:0/469485572 >> v1:172.21.15.59:6789/0 conn(0x7fb710139ca0 legacy=0x7fb71005f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:53.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.240+0000 7fb70f7fe700 1 -- 172.21.15.36:0/469485572 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710140330 con 0x7fb7100b1980 2022-01-10T01:27:53.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb70f7fe700 1 --2- 172.21.15.36:0/469485572 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7100b1980 0x7fb7100b1d60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fb6f8002f70 tx=0x7fb6f8006f40).ready entity=mon.0 client_cookie=7177efd2ac65c6fb server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:53.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb70effd700 1 -- 172.21.15.36:0/469485572 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6f800da80 con 0x7fb7100b1980 2022-01-10T01:27:53.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb70effd700 1 -- 172.21.15.36:0/469485572 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f8000e90 con 0x7fb7100b1980 2022-01-10T01:27:53.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb70effd700 1 -- 172.21.15.36:0/469485572 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6f800de10 con 0x7fb7100b1980 2022-01-10T01:27:53.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb716128700 1 -- 172.21.15.36:0/469485572 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7100b1980 msgr2=0x7fb7100b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:53.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb716128700 1 --2- 172.21.15.36:0/469485572 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7100b1980 0x7fb7100b1d60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7fb6f8002f70 tx=0x7fb6f8006f40).stop 2022-01-10T01:27:53.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb716128700 1 -- 172.21.15.36:0/469485572 shutdown_connections 2022-01-10T01:27:53.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb716128700 1 --2- 172.21.15.36:0/469485572 >> v2:172.21.15.59:3300/0 conn(0x7fb7100616d0 0x7fb710060b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb716128700 1 --2- 172.21.15.36:0/469485572 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7100b1980 0x7fb7100b1d60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb716128700 1 -- 172.21.15.36:0/469485572 >> 172.21.15.36:0/469485572 conn(0x7fb7100b2970 msgr2=0x7fb7100b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:53.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb716128700 1 -- 172.21.15.36:0/469485572 shutdown_connections 2022-01-10T01:27:53.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb716128700 1 -- 172.21.15.36:0/469485572 wait complete. 2022-01-10T01:27:53.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb716128700 1 Processor -- start 2022-01-10T01:27:53.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb716128700 1 -- start start 2022-01-10T01:27:53.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.244+0000 7fb716128700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7100616d0 0x7fb7100b5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:53.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb716128700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7100b1980 0x7fb71014ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:53.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb716128700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb710139ca0 0x7fb710151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:53.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb716128700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71013ca30 con 0x7fb7100b1980 2022-01-10T01:27:53.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb716128700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71014f1a0 con 0x7fb7100616d0 2022-01-10T01:27:53.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb716128700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71013cc60 con 0x7fb710139ca0 2022-01-10T01:27:53.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb707fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7100b1980 0x7fb71014ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:53.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb707fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7100b1980 0x7fb71014ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36506/0 (socket says 172.21.15.36:36506) 2022-01-10T01:27:53.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb707fff700 1 -- 172.21.15.36:0/780282908 learned_addr learned my addr 172.21.15.36:0/780282908 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:53.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb70f7fe700 1 --2- 172.21.15.36:0/780282908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7100616d0 0x7fb7100b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:53.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb70ffff700 1 --2- 172.21.15.36:0/780282908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb710139ca0 0x7fb710151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:53.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb707fff700 1 -- 172.21.15.36:0/780282908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb710139ca0 msgr2=0x7fb710151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:53.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb707fff700 1 --2- 172.21.15.36:0/780282908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb710139ca0 0x7fb710151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb707fff700 1 -- 172.21.15.36:0/780282908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7100616d0 msgr2=0x7fb7100b5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:53.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb707fff700 1 --2- 172.21.15.36:0/780282908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7100616d0 0x7fb7100b5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb707fff700 1 -- 172.21.15.36:0/780282908 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f800b460 con 0x7fb7100b1980 2022-01-10T01:27:53.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb707fff700 1 --2- 172.21.15.36:0/780282908 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7100b1980 0x7fb71014ecb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fb70000c000 tx=0x7fb700006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:53.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb70d7fa700 1 -- 172.21.15.36:0/780282908 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb700010780 con 0x7fb7100b1980 2022-01-10T01:27:53.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb70d7fa700 1 -- 172.21.15.36:0/780282908 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7000108e0 con 0x7fb7100b1980 2022-01-10T01:27:53.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb716128700 1 -- 172.21.15.36:0/780282908 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71013cf00 con 0x7fb7100b1980 2022-01-10T01:27:53.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb70d7fa700 1 -- 172.21.15.36:0/780282908 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb700010c40 con 0x7fb7100b1980 2022-01-10T01:27:53.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb716128700 1 -- 172.21.15.36:0/780282908 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71013d440 con 0x7fb7100b1980 2022-01-10T01:27:53.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.248+0000 7fb716128700 1 -- 172.21.15.36:0/780282908 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7101405d0 con 0x7fb7100b1980 2022-01-10T01:27:53.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.252+0000 7fb70d7fa700 1 -- 172.21.15.36:0/780282908 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb70001c460 con 0x7fb7100b1980 2022-01-10T01:27:53.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.252+0000 7fb70d7fa700 1 --2- 172.21.15.36:0/780282908 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6e80535f0 0x7fb6e8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:53.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.252+0000 7fb70d7fa700 1 -- 172.21.15.36:0/780282908 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb70006bec0 con 0x7fb7100b1980 2022-01-10T01:27:53.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.252+0000 7fb70f7fe700 1 --2- 172.21.15.36:0/780282908 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6e80535f0 0x7fb6e8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:53.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.252+0000 7fb70f7fe700 1 --2- 172.21.15.36:0/780282908 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6e80535f0 0x7fb6e8055ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fb6f801e000 tx=0x7fb710140220).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:53.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.260+0000 7fb70d7fa700 1 -- 172.21.15.36:0/780282908 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb700042d60 con 0x7fb7100b1980 2022-01-10T01:27:53.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.424+0000 7fb716128700 1 -- 172.21.15.36:0/780282908 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb710057350 con 0x7fb7100b1980 2022-01-10T01:27:53.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.596+0000 7fb70d7fa700 1 -- 172.21.15.36:0/780282908 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb700046380 con 0x7fb7100b1980 2022-01-10T01:27:53.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.600+0000 7fb716128700 1 -- 172.21.15.36:0/780282908 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6e80535f0 msgr2=0x7fb6e8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:53.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.600+0000 7fb716128700 1 --2- 172.21.15.36:0/780282908 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6e80535f0 0x7fb6e8055ab0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fb6f801e000 tx=0x7fb710140220).stop 2022-01-10T01:27:53.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.600+0000 7fb716128700 1 -- 172.21.15.36:0/780282908 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7100b1980 msgr2=0x7fb71014ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:53.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.600+0000 7fb716128700 1 --2- 172.21.15.36:0/780282908 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7100b1980 0x7fb71014ecb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fb70000c000 tx=0x7fb700006df0).stop 2022-01-10T01:27:53.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.600+0000 7fb716128700 1 -- 172.21.15.36:0/780282908 shutdown_connections 2022-01-10T01:27:53.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.600+0000 7fb716128700 1 --2- 172.21.15.36:0/780282908 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6e80535f0 0x7fb6e8055ab0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.600+0000 7fb716128700 1 --2- 172.21.15.36:0/780282908 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb710139ca0 0x7fb710151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.600+0000 7fb716128700 1 --2- 172.21.15.36:0/780282908 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7100b1980 0x7fb71014ecb0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.600+0000 7fb716128700 1 --2- 172.21.15.36:0/780282908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7100616d0 0x7fb7100b5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.600+0000 7fb716128700 1 -- 172.21.15.36:0/780282908 >> 172.21.15.36:0/780282908 conn(0x7fb7100b2970 msgr2=0x7fb71005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:53.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.600+0000 7fb716128700 1 -- 172.21.15.36:0/780282908 shutdown_connections 2022-01-10T01:27:53.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.600+0000 7fb716128700 1 -- 172.21.15.36:0/780282908 wait complete. 2022-01-10T01:27:53.622 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:27:53.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.716+0000 7f2584da2700 1 Processor -- start 2022-01-10T01:27:53.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.716+0000 7f2584da2700 1 -- start start 2022-01-10T01:27:53.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f2584da2700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2580140cf0 0x7f25800ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:53.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f2584da2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f25800a8c70 0x7f25800aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:53.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f2584da2700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25800af090 con 0x7f25800b1280 2022-01-10T01:27:53.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f2584da2700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2580140310 con 0x7f2580140cf0 2022-01-10T01:27:53.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f2584da2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25801405b0 con 0x7f25800a8c70 2022-01-10T01:27:53.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257dd9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2580140cf0 0x7f25800ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:53.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257e59c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f25800b1280 0x7f25800b1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34304/0 (socket says 172.21.15.36:34304) 2022-01-10T01:27:53.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257dd9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2580140cf0 0x7f25800ae6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36510/0 (socket says 172.21.15.36:36510) 2022-01-10T01:27:53.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257e59c700 1 -- 172.21.15.36:0/724006915 learned_addr learned my addr 172.21.15.36:0/724006915 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:53.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257ed9d700 1 --2- 172.21.15.36:0/724006915 >> v2:172.21.15.59:3300/0 conn(0x7f25800a8c70 0x7f25800aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:53.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257dd9b700 1 -- 172.21.15.36:0/724006915 >> v2:172.21.15.59:3300/0 conn(0x7f25800a8c70 msgr2=0x7f25800aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:53.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257dd9b700 1 --2- 172.21.15.36:0/724006915 >> v2:172.21.15.59:3300/0 conn(0x7f25800a8c70 0x7f25800aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257dd9b700 1 -- 172.21.15.36:0/724006915 >> v1:172.21.15.36:6789/0 conn(0x7f25800b1280 legacy=0x7f25800b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:53.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257d59a700 1 -- 172.21.15.36:0/724006915 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3009615544 0 0) 0x7f25800af090 con 0x7f25800b1280 2022-01-10T01:27:53.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257dd9b700 1 -- 172.21.15.36:0/724006915 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2580140850 con 0x7f2580140cf0 2022-01-10T01:27:53.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257ed9d700 1 --2- 172.21.15.36:0/724006915 >> v2:172.21.15.59:3300/0 conn(0x7f25800a8c70 0x7f25800aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:27:53.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257dd9b700 1 --2- 172.21.15.36:0/724006915 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2580140cf0 0x7f25800ae6b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f25700032f0 tx=0x7f25700091d0).ready entity=mon.0 client_cookie=2771e86630da0b3e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:53.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257d59a700 1 -- 172.21.15.36:0/724006915 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2570009ea0 con 0x7f2580140cf0 2022-01-10T01:27:53.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257d59a700 1 -- 172.21.15.36:0/724006915 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257000b870 con 0x7f2580140cf0 2022-01-10T01:27:53.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f257d59a700 1 -- 172.21.15.36:0/724006915 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f257000b9e0 con 0x7f2580140cf0 2022-01-10T01:27:53.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f2584da2700 1 -- 172.21.15.36:0/724006915 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2580140cf0 msgr2=0x7f25800ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:53.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f2584da2700 1 --2- 172.21.15.36:0/724006915 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2580140cf0 0x7f25800ae6b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f25700032f0 tx=0x7f25700091d0).stop 2022-01-10T01:27:53.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f2584da2700 1 -- 172.21.15.36:0/724006915 shutdown_connections 2022-01-10T01:27:53.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f2584da2700 1 --2- 172.21.15.36:0/724006915 >> v2:172.21.15.59:3300/0 conn(0x7f25800a8c70 0x7f25800aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f2584da2700 1 --2- 172.21.15.36:0/724006915 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2580140cf0 0x7f25800ae6b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f2584da2700 1 -- 172.21.15.36:0/724006915 >> 172.21.15.36:0/724006915 conn(0x7f258005f6b0 msgr2=0x7f258005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:53.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f2584da2700 1 -- 172.21.15.36:0/724006915 shutdown_connections 2022-01-10T01:27:53.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.720+0000 7f2584da2700 1 -- 172.21.15.36:0/724006915 wait complete. 2022-01-10T01:27:53.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f2584da2700 1 Processor -- start 2022-01-10T01:27:53.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f2584da2700 1 -- start start 2022-01-10T01:27:53.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f2584da2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25800a8c70 0x7f2580147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:53.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f2584da2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25800b1280 0x7f2580150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:53.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f2584da2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2580140cf0 0x7f2580150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:53.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f2584da2700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258013a630 con 0x7f25800b1280 2022-01-10T01:27:53.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f2584da2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258013a860 con 0x7f25800a8c70 2022-01-10T01:27:53.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f2584da2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258013ab00 con 0x7f2580140cf0 2022-01-10T01:27:53.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f257dd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25800b1280 0x7f2580150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:53.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f257dd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25800b1280 0x7f2580150410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36518/0 (socket says 172.21.15.36:36518) 2022-01-10T01:27:53.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f257dd9b700 1 -- 172.21.15.36:0/3702162630 learned_addr learned my addr 172.21.15.36:0/3702162630 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:53.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f257e59c700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25800a8c70 0x7f2580147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:53.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f257ed9d700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2580140cf0 0x7f2580150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:53.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f257dd9b700 1 -- 172.21.15.36:0/3702162630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2580140cf0 msgr2=0x7f2580150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:53.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f257dd9b700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2580140cf0 0x7f2580150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f257dd9b700 1 -- 172.21.15.36:0/3702162630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25800a8c70 msgr2=0x7f2580147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:53.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f257dd9b700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25800a8c70 0x7f2580147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f257dd9b700 1 -- 172.21.15.36:0/3702162630 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570009470 con 0x7f25800b1280 2022-01-10T01:27:53.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f257e59c700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25800a8c70 0x7f2580147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:27:53.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f257ed9d700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2580140cf0 0x7f2580150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:27:53.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f257dd9b700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25800b1280 0x7f2580150410 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f25700032f0 tx=0x7f2570016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:53.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f256f7fe700 1 -- 172.21.15.36:0/3702162630 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2570006ea0 con 0x7f25800b1280 2022-01-10T01:27:53.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f256f7fe700 1 -- 172.21.15.36:0/3702162630 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25700107a0 con 0x7f25800b1280 2022-01-10T01:27:53.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f2584da2700 1 -- 172.21.15.36:0/3702162630 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258013ada0 con 0x7f25800b1280 2022-01-10T01:27:53.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f256f7fe700 1 -- 172.21.15.36:0/3702162630 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2570009ea0 con 0x7f25800b1280 2022-01-10T01:27:53.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.724+0000 7f2584da2700 1 -- 172.21.15.36:0/3702162630 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2580150df0 con 0x7f25800b1280 2022-01-10T01:27:53.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.728+0000 7f2584da2700 1 -- 172.21.15.36:0/3702162630 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2580140000 con 0x7f25800b1280 2022-01-10T01:27:53.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.728+0000 7f256f7fe700 1 -- 172.21.15.36:0/3702162630 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2570027020 con 0x7f25800b1280 2022-01-10T01:27:53.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.728+0000 7f256f7fe700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f255c0535f0 0x7f255c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:53.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.728+0000 7f256f7fe700 1 -- 172.21.15.36:0/3702162630 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f257006d0e0 con 0x7f25800b1280 2022-01-10T01:27:53.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.728+0000 7f257e59c700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f255c0535f0 0x7f255c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:53.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.728+0000 7f257e59c700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f255c0535f0 0x7f255c055ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f257400b000 tx=0x7f2574009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:53.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.732+0000 7f256f7fe700 1 -- 172.21.15.36:0/3702162630 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2570044170 con 0x7f25800b1280 2022-01-10T01:27:53.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.892+0000 7f2584da2700 1 -- 172.21.15.36:0/3702162630 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2580057350 con 0x7f25800b1280 2022-01-10T01:27:53.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.892+0000 7f256f7fe700 1 -- 172.21.15.36:0/3702162630 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2496 (secure 0 0 0) 0x7f2570015020 con 0x7f25800b1280 2022-01-10T01:27:53.898 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:53.899 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1806166752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1806166752},{"type":"v1","addr":"172.21.15.36:6837","nonce":1806166752}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":35141,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2577386810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2577386810},{"type":"v1","addr":"172.21.15.36:6835","nonce":2577386810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:27:52.591733+0000","modified":"2022-01-10T01:27:53.595043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35150":{"gid":35150,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1363567016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1363567016},{"type":"v1","addr":"172.21.15.59:6833","nonce":1363567016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2022-01-10T01:27:53.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.896+0000 7f2584da2700 1 -- 172.21.15.36:0/3702162630 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f255c0535f0 msgr2=0x7f255c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:53.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.896+0000 7f2584da2700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f255c0535f0 0x7f255c055ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f257400b000 tx=0x7f2574009040).stop 2022-01-10T01:27:53.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.896+0000 7f2584da2700 1 -- 172.21.15.36:0/3702162630 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25800b1280 msgr2=0x7f2580150410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:53.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.896+0000 7f2584da2700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25800b1280 0x7f2580150410 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f25700032f0 tx=0x7f2570016000).stop 2022-01-10T01:27:53.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.896+0000 7f2584da2700 1 -- 172.21.15.36:0/3702162630 shutdown_connections 2022-01-10T01:27:53.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.896+0000 7f2584da2700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f255c0535f0 0x7f255c055ab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.896+0000 7f2584da2700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2580140cf0 0x7f2580150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.896+0000 7f2584da2700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25800b1280 0x7f2580150410 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.896+0000 7f2584da2700 1 --2- 172.21.15.36:0/3702162630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25800a8c70 0x7f2580147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:53.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.896+0000 7f2584da2700 1 -- 172.21.15.36:0/3702162630 >> 172.21.15.36:0/3702162630 conn(0x7f258005f6b0 msgr2=0x7f25800adf10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:53.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.896+0000 7f2584da2700 1 -- 172.21.15.36:0/3702162630 shutdown_connections 2022-01-10T01:27:53.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:53.896+0000 7f2584da2700 1 -- 172.21.15.36:0/3702162630 wait complete. 2022-01-10T01:27:53.903 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 24 2022-01-10T01:27:53.911 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:27:54.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f1ce4700 1 Processor -- start 2022-01-10T01:27:54.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f1ce4700 1 -- start start 2022-01-10T01:27:54.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f1ce4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd8ec0b2580 0x7fd8ec14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f1ce4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8ec0a8ac0 0x7fd8ec14b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f1ce4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ec0a70c0 con 0x7fd8ec0b0010 2022-01-10T01:27:54.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f1ce4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ec0a72f0 con 0x7fd8ec0b2580 2022-01-10T01:27:54.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f1ce4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ec0a7590 con 0x7fd8ec0a8ac0 2022-01-10T01:27:54.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f0ce2700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd8ec0b2580 0x7fd8ec14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f0ce2700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd8ec0b2580 0x7fd8ec14ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36526/0 (socket says 172.21.15.36:36526) 2022-01-10T01:27:54.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f0ce2700 1 -- 172.21.15.36:0/3874266063 learned_addr learned my addr 172.21.15.36:0/3874266063 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:54.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f14e3700 1 --2- 172.21.15.36:0/3874266063 >> v2:172.21.15.59:3300/0 conn(0x7fd8ec0a8ac0 0x7fd8ec14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f0ce2700 1 -- 172.21.15.36:0/3874266063 >> v2:172.21.15.59:3300/0 conn(0x7fd8ec0a8ac0 msgr2=0x7fd8ec14b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:54.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f0ce2700 1 --2- 172.21.15.36:0/3874266063 >> v2:172.21.15.59:3300/0 conn(0x7fd8ec0a8ac0 0x7fd8ec14b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f0ce2700 1 -- 172.21.15.36:0/3874266063 >> v1:172.21.15.59:6789/0 conn(0x7fd8ec0b0010 legacy=0x7fd8ec0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f0ce2700 1 -- 172.21.15.36:0/3874266063 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec0a7830 con 0x7fd8ec0b2580 2022-01-10T01:27:54.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f14e3700 1 --2- 172.21.15.36:0/3874266063 >> v2:172.21.15.59:3300/0 conn(0x7fd8ec0a8ac0 0x7fd8ec14b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:27:54.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8f0ce2700 1 --2- 172.21.15.36:0/3874266063 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8ec0b2580 0x7fd8ec14ae40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fd8d4002f70 tx=0x7fd8d4006eb0).ready entity=mon.0 client_cookie=1a22efd86ed57a8b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:54.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8eb7fe700 1 -- 172.21.15.36:0/3874266063 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d400d5c0 con 0x7fd8ec0b2580 2022-01-10T01:27:54.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8eb7fe700 1 -- 172.21.15.36:0/3874266063 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d4000e90 con 0x7fd8ec0b2580 2022-01-10T01:27:54.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.012+0000 7fd8eb7fe700 1 -- 172.21.15.36:0/3874266063 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8d400d950 con 0x7fd8ec0b2580 2022-01-10T01:27:54.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3874266063 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8ec0b2580 msgr2=0x7fd8ec14ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 --2- 172.21.15.36:0/3874266063 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8ec0b2580 0x7fd8ec14ae40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fd8d4002f70 tx=0x7fd8d4006eb0).stop 2022-01-10T01:27:54.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3874266063 shutdown_connections 2022-01-10T01:27:54.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 --2- 172.21.15.36:0/3874266063 >> v2:172.21.15.59:3300/0 conn(0x7fd8ec0a8ac0 0x7fd8ec14b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 --2- 172.21.15.36:0/3874266063 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8ec0b2580 0x7fd8ec14ae40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3874266063 >> 172.21.15.36:0/3874266063 conn(0x7fd8ec060180 msgr2=0x7fd8ec0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:54.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3874266063 shutdown_connections 2022-01-10T01:27:54.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3874266063 wait complete. 2022-01-10T01:27:54.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 Processor -- start 2022-01-10T01:27:54.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 -- start start 2022-01-10T01:27:54.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8ec0a8ac0 0x7fd8ec148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8ec0b0010 0x7fd8ec0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8ec0b2580 0x7fd8ec0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec142900 con 0x7fd8ec0b0010 2022-01-10T01:27:54.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec0b49e0 con 0x7fd8ec0a8ac0 2022-01-10T01:27:54.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.016+0000 7fd8f1ce4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec0b4c10 con 0x7fd8ec0b2580 2022-01-10T01:27:54.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8ebfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8ec0b0010 0x7fd8ec0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8f14e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8ec0b2580 0x7fd8ec0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8f0ce2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8ec0a8ac0 0x7fd8ec148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8ebfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8ec0b0010 0x7fd8ec0b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36532/0 (socket says 172.21.15.36:36532) 2022-01-10T01:27:54.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8ebfff700 1 -- 172.21.15.36:0/3835254288 learned_addr learned my addr 172.21.15.36:0/3835254288 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:54.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8ebfff700 1 -- 172.21.15.36:0/3835254288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8ec0b2580 msgr2=0x7fd8ec0b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8ebfff700 1 --2- 172.21.15.36:0/3835254288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8ec0b2580 0x7fd8ec0b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8ebfff700 1 -- 172.21.15.36:0/3835254288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8ec0a8ac0 msgr2=0x7fd8ec148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8ebfff700 1 --2- 172.21.15.36:0/3835254288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8ec0a8ac0 0x7fd8ec148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8ebfff700 1 -- 172.21.15.36:0/3835254288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e400b180 con 0x7fd8ec0b0010 2022-01-10T01:27:54.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8ebfff700 1 --2- 172.21.15.36:0/3835254288 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8ec0b0010 0x7fd8ec0b2e80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fd8ec0b5ef0 tx=0x7fd8dc007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:54.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8e9ffb700 1 -- 172.21.15.36:0/3835254288 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8dc00f470 con 0x7fd8ec0b0010 2022-01-10T01:27:54.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8e9ffb700 1 -- 172.21.15.36:0/3835254288 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8dc00f5d0 con 0x7fd8ec0b0010 2022-01-10T01:27:54.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3835254288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d400b1e0 con 0x7fd8ec0b0010 2022-01-10T01:27:54.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8e9ffb700 1 -- 172.21.15.36:0/3835254288 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8dc00f930 con 0x7fd8ec0b0010 2022-01-10T01:27:54.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3835254288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ec0b53f0 con 0x7fd8ec0b0010 2022-01-10T01:27:54.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3835254288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ec0b4dd0 con 0x7fd8ec0b0010 2022-01-10T01:27:54.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8e9ffb700 1 -- 172.21.15.36:0/3835254288 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd8dc019030 con 0x7fd8ec0b0010 2022-01-10T01:27:54.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8e9ffb700 1 --2- 172.21.15.36:0/3835254288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8d0053680 0x7fd8d0055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.020+0000 7fd8e9ffb700 1 -- 172.21.15.36:0/3835254288 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd8dc06b080 con 0x7fd8ec0b0010 2022-01-10T01:27:54.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.024+0000 7fd8f0ce2700 1 --2- 172.21.15.36:0/3835254288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8d0053680 0x7fd8d0055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.024+0000 7fd8f0ce2700 1 --2- 172.21.15.36:0/3835254288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8d0053680 0x7fd8d0055b40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fd8d401c000 tx=0x7fd8d4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:54.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.028+0000 7fd8e9ffb700 1 -- 172.21.15.36:0/3835254288 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8ec0b4dd0 con 0x7fd8ec0b0010 2022-01-10T01:27:54.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.156+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3835254288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8ec0b4dd0 con 0x7fd8ec0b0010 2022-01-10T01:27:54.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.156+0000 7fd8e9ffb700 1 -- 172.21.15.36:0/3835254288 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16273 (secure 0 0 0) 0x7fd8ec0b4dd0 con 0x7fd8ec0b0010 2022-01-10T01:27:54.162 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:54.163 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":56,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:27:53.595841+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:27:51.027021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2022-01-10T01:27:52.032505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:27:54.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.160+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3835254288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8d0053680 msgr2=0x7fd8d0055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.160+0000 7fd8f1ce4700 1 --2- 172.21.15.36:0/3835254288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8d0053680 0x7fd8d0055b40 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fd8d401c000 tx=0x7fd8d4015000).stop 2022-01-10T01:27:54.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.160+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3835254288 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8ec0b0010 msgr2=0x7fd8ec0b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.160+0000 7fd8f1ce4700 1 --2- 172.21.15.36:0/3835254288 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8ec0b0010 0x7fd8ec0b2e80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fd8ec0b5ef0 tx=0x7fd8dc007f70).stop 2022-01-10T01:27:54.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.160+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3835254288 shutdown_connections 2022-01-10T01:27:54.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.160+0000 7fd8f1ce4700 1 --2- 172.21.15.36:0/3835254288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8d0053680 0x7fd8d0055b40 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.160+0000 7fd8f1ce4700 1 --2- 172.21.15.36:0/3835254288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8ec0b2580 0x7fd8ec0b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.160+0000 7fd8f1ce4700 1 --2- 172.21.15.36:0/3835254288 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8ec0b0010 0x7fd8ec0b2e80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.160+0000 7fd8f1ce4700 1 --2- 172.21.15.36:0/3835254288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8ec0a8ac0 0x7fd8ec148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.160+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3835254288 >> 172.21.15.36:0/3835254288 conn(0x7fd8ec060180 msgr2=0x7fd8ec145610 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:54.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.160+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3835254288 shutdown_connections 2022-01-10T01:27:54.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.160+0000 7fd8f1ce4700 1 -- 172.21.15.36:0/3835254288 wait complete. 2022-01-10T01:27:54.176 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:27:54.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb43b352700 1 Processor -- start 2022-01-10T01:27:54.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb43b352700 1 -- start start 2022-01-10T01:27:54.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb43b352700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb4340b3000 0x7fb434060b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb43b352700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb434065330 con 0x7fb4340b25a0 2022-01-10T01:27:54.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb43b352700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4340b33e0 con 0x7fb434061000 2022-01-10T01:27:54.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb43b352700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb434062000 con 0x7fb4340b3000 2022-01-10T01:27:54.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb43a350700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb4340b3000 0x7fb434060b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb439b4f700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fb4340b25a0 0x7fb434066520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34334/0 (socket says 172.21.15.36:34334) 2022-01-10T01:27:54.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb439b4f700 1 -- 172.21.15.36:0/3406287144 learned_addr learned my addr 172.21.15.36:0/3406287144 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:54.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb43a350700 1 -- 172.21.15.36:0/3406287144 >> v1:172.21.15.59:6789/0 conn(0x7fb434061000 legacy=0x7fb434066c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb43a350700 1 -- 172.21.15.36:0/3406287144 >> v1:172.21.15.36:6789/0 conn(0x7fb4340b25a0 legacy=0x7fb434066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb43934e700 1 -- 172.21.15.36:0/3406287144 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927929285 0 0) 0x7fb4340b33e0 con 0x7fb434061000 2022-01-10T01:27:54.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb43a350700 1 -- 172.21.15.36:0/3406287144 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43405fa60 con 0x7fb4340b3000 2022-01-10T01:27:54.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb43a350700 1 --2- 172.21.15.36:0/3406287144 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4340b3000 0x7fb434060b10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fb430002f70 tx=0x7fb430006df0).ready entity=mon.0 client_cookie=81341cdf03d8c589 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:54.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.288+0000 7fb43934e700 1 -- 172.21.15.36:0/3406287144 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43000d610 con 0x7fb4340b3000 2022-01-10T01:27:54.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.292+0000 7fb43934e700 1 -- 172.21.15.36:0/3406287144 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb430000e90 con 0x7fb4340b3000 2022-01-10T01:27:54.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.292+0000 7fb43934e700 1 -- 172.21.15.36:0/3406287144 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43000d960 con 0x7fb4340b3000 2022-01-10T01:27:54.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.292+0000 7fb43b352700 1 -- 172.21.15.36:0/3406287144 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4340b3000 msgr2=0x7fb434060b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.292+0000 7fb43b352700 1 --2- 172.21.15.36:0/3406287144 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4340b3000 0x7fb434060b10 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fb430002f70 tx=0x7fb430006df0).stop 2022-01-10T01:27:54.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.292+0000 7fb43b352700 1 -- 172.21.15.36:0/3406287144 shutdown_connections 2022-01-10T01:27:54.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.292+0000 7fb43b352700 1 --2- 172.21.15.36:0/3406287144 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4340b3000 0x7fb434060b10 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.292+0000 7fb43b352700 1 -- 172.21.15.36:0/3406287144 >> 172.21.15.36:0/3406287144 conn(0x7fb4340636e0 msgr2=0x7fb434063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:54.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.292+0000 7fb43b352700 1 -- 172.21.15.36:0/3406287144 shutdown_connections 2022-01-10T01:27:54.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.292+0000 7fb43b352700 1 -- 172.21.15.36:0/3406287144 wait complete. 2022-01-10T01:27:54.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.292+0000 7fb43b352700 1 Processor -- start 2022-01-10T01:27:54.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.292+0000 7fb43b352700 1 -- start start 2022-01-10T01:27:54.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb43b352700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb434061000 0x7fb43414a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb43b352700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4340b25a0 0x7fb4340a92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb43b352700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4340b3000 0x7fb4340a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb43b352700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340a6910 con 0x7fb4340b25a0 2022-01-10T01:27:54.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb43b352700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340a6bb0 con 0x7fb434061000 2022-01-10T01:27:54.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb43b352700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340a78d0 con 0x7fb4340b3000 2022-01-10T01:27:54.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb439b4f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4340b25a0 0x7fb4340a92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb43a350700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb434061000 0x7fb43414a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb439b4f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4340b25a0 0x7fb4340a92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36546/0 (socket says 172.21.15.36:36546) 2022-01-10T01:27:54.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb439b4f700 1 -- 172.21.15.36:0/1491208679 learned_addr learned my addr 172.21.15.36:0/1491208679 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:54.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb43ab51700 1 --2- 172.21.15.36:0/1491208679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4340b3000 0x7fb4340a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb439b4f700 1 -- 172.21.15.36:0/1491208679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4340b3000 msgr2=0x7fb4340a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb439b4f700 1 --2- 172.21.15.36:0/1491208679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4340b3000 0x7fb4340a97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb439b4f700 1 -- 172.21.15.36:0/1491208679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb434061000 msgr2=0x7fb43414a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb439b4f700 1 --2- 172.21.15.36:0/1491208679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb434061000 0x7fb43414a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb439b4f700 1 -- 172.21.15.36:0/1491208679 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43000b180 con 0x7fb4340b25a0 2022-01-10T01:27:54.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb439b4f700 1 --2- 172.21.15.36:0/1491208679 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4340b25a0 0x7fb4340a92d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fb434063350 tx=0x7fb424007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:54.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb4237fe700 1 -- 172.21.15.36:0/1491208679 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4240070d0 con 0x7fb4340b25a0 2022-01-10T01:27:54.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb4237fe700 1 -- 172.21.15.36:0/1491208679 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb424007230 con 0x7fb4340b25a0 2022-01-10T01:27:54.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb4237fe700 1 -- 172.21.15.36:0/1491208679 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb424005610 con 0x7fb4340b25a0 2022-01-10T01:27:54.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb43b352700 1 -- 172.21.15.36:0/1491208679 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4340a7b70 con 0x7fb4340b25a0 2022-01-10T01:27:54.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.296+0000 7fb43b352700 1 -- 172.21.15.36:0/1491208679 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4340a5860 con 0x7fb4340b25a0 2022-01-10T01:27:54.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.300+0000 7fb43b352700 1 -- 172.21.15.36:0/1491208679 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb434057350 con 0x7fb4340b25a0 2022-01-10T01:27:54.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.300+0000 7fb4237fe700 1 -- 172.21.15.36:0/1491208679 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb424010070 con 0x7fb4340b25a0 2022-01-10T01:27:54.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.300+0000 7fb4237fe700 1 --2- 172.21.15.36:0/1491208679 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb414053680 0x7fb414055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.300+0000 7fb4237fe700 1 -- 172.21.15.36:0/1491208679 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb42406aec0 con 0x7fb4340b25a0 2022-01-10T01:27:54.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.300+0000 7fb43a350700 1 --2- 172.21.15.36:0/1491208679 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb414053680 0x7fb414055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.300+0000 7fb43a350700 1 --2- 172.21.15.36:0/1491208679 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb414053680 0x7fb414055b40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fb43001a000 tx=0x7fb430014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:54.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.304+0000 7fb4237fe700 1 -- 172.21.15.36:0/1491208679 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb424041ed0 con 0x7fb4340b25a0 2022-01-10T01:27:54.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.472+0000 7fb43b352700 1 -- 172.21.15.36:0/1491208679 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fb4340698e0 con 0x7fb4340b25a0 2022-01-10T01:27:54.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.480+0000 7fb4237fe700 1 -- 172.21.15.36:0/1491208679 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb424018070 con 0x7fb4340b25a0 2022-01-10T01:27:54.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.480+0000 7fb43b352700 1 -- 172.21.15.36:0/1491208679 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb414053680 msgr2=0x7fb414055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.480+0000 7fb43b352700 1 --2- 172.21.15.36:0/1491208679 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb414053680 0x7fb414055b40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fb43001a000 tx=0x7fb430014000).stop 2022-01-10T01:27:54.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.480+0000 7fb43b352700 1 -- 172.21.15.36:0/1491208679 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4340b25a0 msgr2=0x7fb4340a92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.480+0000 7fb43b352700 1 --2- 172.21.15.36:0/1491208679 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4340b25a0 0x7fb4340a92d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fb434063350 tx=0x7fb424007bd0).stop 2022-01-10T01:27:54.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.480+0000 7fb43b352700 1 -- 172.21.15.36:0/1491208679 shutdown_connections 2022-01-10T01:27:54.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.480+0000 7fb43b352700 1 --2- 172.21.15.36:0/1491208679 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb414053680 0x7fb414055b40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.480+0000 7fb43b352700 1 --2- 172.21.15.36:0/1491208679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4340b3000 0x7fb4340a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.480+0000 7fb43b352700 1 --2- 172.21.15.36:0/1491208679 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4340b25a0 0x7fb4340a92d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.480+0000 7fb43b352700 1 --2- 172.21.15.36:0/1491208679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb434061000 0x7fb43414a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.480+0000 7fb43b352700 1 -- 172.21.15.36:0/1491208679 >> 172.21.15.36:0/1491208679 conn(0x7fb4340636e0 msgr2=0x7fb434066b90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:54.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.480+0000 7fb43b352700 1 -- 172.21.15.36:0/1491208679 shutdown_connections 2022-01-10T01:27:54.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.480+0000 7fb43b352700 1 -- 172.21.15.36:0/1491208679 wait complete. 2022-01-10T01:27:54.488 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.0 2022-01-10T01:27:54.498 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:27:54.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.604+0000 7f64e94ae700 1 Processor -- start 2022-01-10T01:27:54.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.604+0000 7f64e94ae700 1 -- start start 2022-01-10T01:27:54.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e94ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64e40ad5c0 0x7f64e4061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e94ae700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e40aecf0 con 0x7f64e4140440 2022-01-10T01:27:54.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e94ae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e40b6f20 con 0x7f64e4061320 2022-01-10T01:27:54.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e94ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40aef20 con 0x7f64e40ad5c0 2022-01-10T01:27:54.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e8cad700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f64e4140440 0x7f64e4146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34350/0 (socket says 172.21.15.36:34350) 2022-01-10T01:27:54.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e8cad700 1 -- 172.21.15.36:0/3642564221 learned_addr learned my addr 172.21.15.36:0/3642564221 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:54.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e37fe700 1 --2- 172.21.15.36:0/3642564221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64e40ad5c0 0x7f64e4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027654009 0 0) 0x7f64e40aecf0 con 0x7f64e4140440 2022-01-10T01:27:54.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64c4003260 con 0x7f64e4140440 2022-01-10T01:27:54.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184203990 0 0) 0x7f64e40b6f20 con 0x7f64e4061320 2022-01-10T01:27:54.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64e40aecf0 con 0x7f64e4061320 2022-01-10T01:27:54.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1590032299 0 0) 0x7f64c4003260 con 0x7f64e4140440 2022-01-10T01:27:54.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64e40ad5c0 msgr2=0x7f64e4061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:54.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 --2- 172.21.15.36:0/3642564221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64e40ad5c0 0x7f64e4061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 >> v1:172.21.15.59:6789/0 conn(0x7f64e4061320 legacy=0x7f64e40b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e40af1c0 con 0x7f64e4140440 2022-01-10T01:27:54.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f64dc0019e0 con 0x7f64e4140440 2022-01-10T01:27:54.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 >> v1:172.21.15.36:6789/0 conn(0x7f64e4140440 legacy=0x7f64e4146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 --2- 172.21.15.36:0/3642564221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64e40ad5c0 0x7f64c4003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 --2- 172.21.15.36:0/3642564221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4003e20 0x7f64c4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 --2- 172.21.15.36:0/3642564221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64c40049f0 0x7f64c4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40aef20 con 0x7f64c40049f0 2022-01-10T01:27:54.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c400b800 con 0x7f64c4003e20 2022-01-10T01:27:54.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c400b9c0 con 0x7f64e40ad5c0 2022-01-10T01:27:54.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e8cad700 1 --2- 172.21.15.36:0/3642564221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64c40049f0 0x7f64c4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e37fe700 1 --2- 172.21.15.36:0/3642564221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4003e20 0x7f64c4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e3fff700 1 --2- 172.21.15.36:0/3642564221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64e40ad5c0 0x7f64c4003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e8cad700 1 -- 172.21.15.36:0/3642564221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64e40ad5c0 msgr2=0x7f64c4003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:54.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.608+0000 7f64e8cad700 1 --2- 172.21.15.36:0/3642564221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64e40ad5c0 0x7f64c4003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.612+0000 7f64e8cad700 1 -- 172.21.15.36:0/3642564221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4003e20 msgr2=0x7f64c4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:54.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.612+0000 7f64e8cad700 1 --2- 172.21.15.36:0/3642564221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64c4003e20 0x7f64c4004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.612+0000 7f64e8cad700 1 -- 172.21.15.36:0/3642564221 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c4003260 con 0x7f64c40049f0 2022-01-10T01:27:54.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.612+0000 7f64e8cad700 1 --2- 172.21.15.36:0/3642564221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64c40049f0 0x7f64c4004e70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f64dc0017b0 tx=0x7f64e40af350).ready entity=mon.0 client_cookie=48e5b41a1d90aee3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:54.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.612+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64dc007b60 con 0x7f64c40049f0 2022-01-10T01:27:54.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.612+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64dc00cc10 con 0x7f64c40049f0 2022-01-10T01:27:54.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.612+0000 7f64e2ffd700 1 -- 172.21.15.36:0/3642564221 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64dc005990 con 0x7f64c40049f0 2022-01-10T01:27:54.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.612+0000 7f64e94ae700 1 -- 172.21.15.36:0/3642564221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64c40049f0 msgr2=0x7f64c4004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.612+0000 7f64e94ae700 1 --2- 172.21.15.36:0/3642564221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64c40049f0 0x7f64c4004e70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f64dc0017b0 tx=0x7f64e40af350).stop 2022-01-10T01:27:54.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.612+0000 7f64e8cad700 1 -- 172.21.15.36:0/3642564221 reap_dead start 2022-01-10T01:27:54.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.612+0000 7f64e94ae700 1 -- 172.21.15.36:0/3642564221 shutdown_connections 2022-01-10T01:27:54.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.612+0000 7f64e94ae700 1 -- 172.21.15.36:0/3642564221 >> 172.21.15.36:0/3642564221 conn(0x7f64e4066de0 msgr2=0x7f64e40671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:54.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.612+0000 7f64e94ae700 1 -- 172.21.15.36:0/3642564221 shutdown_connections 2022-01-10T01:27:54.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.612+0000 7f64e94ae700 1 -- 172.21.15.36:0/3642564221 wait complete. 2022-01-10T01:27:54.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e94ae700 1 Processor -- start 2022-01-10T01:27:54.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e94ae700 1 -- start start 2022-01-10T01:27:54.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e94ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64c40049f0 0x7f64e40b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e94ae700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64e40aaed0 0x7f64e40b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e94ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64e40b0ef0 0x7f64e40b38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e94ae700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e4156300 con 0x7f64e40aaed0 2022-01-10T01:27:54.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e94ae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40aa890 con 0x7f64e40b0ef0 2022-01-10T01:27:54.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e94ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e40aa5f0 con 0x7f64c40049f0 2022-01-10T01:27:54.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e37fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64e40aaed0 0x7f64e40b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e37fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64e40aaed0 0x7f64e40b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36566/0 (socket says 172.21.15.36:36566) 2022-01-10T01:27:54.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e37fe700 1 -- 172.21.15.36:0/3297607089 learned_addr learned my addr 172.21.15.36:0/3297607089 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:54.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e3fff700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64c40049f0 0x7f64e40b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e8cad700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64e40b0ef0 0x7f64e40b38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e37fe700 1 -- 172.21.15.36:0/3297607089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64c40049f0 msgr2=0x7f64e40b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e37fe700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64c40049f0 0x7f64e40b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e37fe700 1 -- 172.21.15.36:0/3297607089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64e40b0ef0 msgr2=0x7f64e40b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e37fe700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64e40b0ef0 0x7f64e40b38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e37fe700 1 -- 172.21.15.36:0/3297607089 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e4156560 con 0x7f64e40aaed0 2022-01-10T01:27:54.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e3fff700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64c40049f0 0x7f64e40b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:27:54.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e8cad700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64e40b0ef0 0x7f64e40b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:27:54.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e37fe700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64e40aaed0 0x7f64e40b33e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f64cc00b000 tx=0x7f64cc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:54.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e17fa700 1 -- 172.21.15.36:0/3297607089 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64cc00f940 con 0x7f64e40aaed0 2022-01-10T01:27:54.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e17fa700 1 -- 172.21.15.36:0/3297607089 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc00faa0 con 0x7f64e40aaed0 2022-01-10T01:27:54.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e17fa700 1 -- 172.21.15.36:0/3297607089 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64cc00fe40 con 0x7f64e40aaed0 2022-01-10T01:27:54.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e94ae700 1 -- 172.21.15.36:0/3297607089 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e40b3dc0 con 0x7f64e40aaed0 2022-01-10T01:27:54.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.616+0000 7f64e94ae700 1 -- 172.21.15.36:0/3297607089 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e40ab940 con 0x7f64e40aaed0 2022-01-10T01:27:54.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.620+0000 7f64e17fa700 1 -- 172.21.15.36:0/3297607089 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f64cc014440 con 0x7f64e40aaed0 2022-01-10T01:27:54.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.620+0000 7f64e94ae700 1 -- 172.21.15.36:0/3297607089 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e41566f0 con 0x7f64e40aaed0 2022-01-10T01:27:54.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.620+0000 7f64e17fa700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f64c80535f0 0x7f64c8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.620+0000 7f64e17fa700 1 -- 172.21.15.36:0/3297607089 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f64cc06c520 con 0x7f64e40aaed0 2022-01-10T01:27:54.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.620+0000 7f64e3fff700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f64c80535f0 0x7f64c8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.620+0000 7f64e3fff700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f64c80535f0 0x7f64c8055ab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f64d400d000 tx=0x7f64d4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:54.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.624+0000 7f64e17fa700 1 -- 172.21.15.36:0/3297607089 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f64cc0434d0 con 0x7f64e40aaed0 2022-01-10T01:27:54.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.788+0000 7f64e94ae700 1 -- 172.21.15.36:0/3297607089 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f64e40af460 con 0x7f64e40aaed0 2022-01-10T01:27:54.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.792+0000 7f64e17fa700 1 -- 172.21.15.36:0/3297607089 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7f64cc018020 con 0x7f64e40aaed0 2022-01-10T01:27:54.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.796+0000 7f64e94ae700 1 -- 172.21.15.36:0/3297607089 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f64c80535f0 msgr2=0x7f64c8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.796+0000 7f64e94ae700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f64c80535f0 0x7f64c8055ab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f64d400d000 tx=0x7f64d4009040).stop 2022-01-10T01:27:54.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.796+0000 7f64e94ae700 1 -- 172.21.15.36:0/3297607089 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64e40aaed0 msgr2=0x7f64e40b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.796+0000 7f64e94ae700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64e40aaed0 0x7f64e40b33e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f64cc00b000 tx=0x7f64cc006df0).stop 2022-01-10T01:27:54.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.796+0000 7f64e94ae700 1 -- 172.21.15.36:0/3297607089 shutdown_connections 2022-01-10T01:27:54.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.796+0000 7f64e94ae700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f64c80535f0 0x7f64c8055ab0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.796+0000 7f64e94ae700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64e40b0ef0 0x7f64e40b38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.796+0000 7f64e94ae700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64e40aaed0 0x7f64e40b33e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.796+0000 7f64e94ae700 1 --2- 172.21.15.36:0/3297607089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64c40049f0 0x7f64e40b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.796+0000 7f64e94ae700 1 -- 172.21.15.36:0/3297607089 >> 172.21.15.36:0/3297607089 conn(0x7f64e4066de0 msgr2=0x7f64e40b6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:54.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.796+0000 7f64e94ae700 1 -- 172.21.15.36:0/3297607089 shutdown_connections 2022-01-10T01:27:54.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.796+0000 7f64e94ae700 1 -- 172.21.15.36:0/3297607089 wait complete. 2022-01-10T01:27:54.803 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.1 2022-01-10T01:27:54.810 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:27:54.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.912+0000 7f55d3da1700 1 Processor -- start 2022-01-10T01:27:54.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.912+0000 7f55d3da1700 1 -- start start 2022-01-10T01:27:54.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.912+0000 7f55d3da1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55cc060100 0x7f55cc0b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.912+0000 7f55d3da1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f55cc067300 0x7f55cc1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.912+0000 7f55d3da1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55cc0b4c40 0x7f55cc143de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.912+0000 7f55d3da1700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55cc0aabb0 con 0x7f55cc067300 2022-01-10T01:27:54.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.912+0000 7f55d3da1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55cc0604e0 con 0x7f55cc060100 2022-01-10T01:27:54.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.912+0000 7f55d3da1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc066ea0 con 0x7f55cc0b4c40 2022-01-10T01:27:54.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.912+0000 7f55d133c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f55cc067300 0x7f55cc1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.912+0000 7f55d133c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f55cc067300 0x7f55cc1438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36574/0 (socket says 172.21.15.36:36574) 2022-01-10T01:27:54.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d133c700 1 -- 172.21.15.36:0/2131088551 learned_addr learned my addr 172.21.15.36:0/2131088551 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:54.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d233e700 1 --2- 172.21.15.36:0/2131088551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55cc0b4c40 0x7f55cc143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d1b3d700 1 --2- 172.21.15.36:0/2131088551 >> v2:172.21.15.59:3300/0 conn(0x7f55cc060100 0x7f55cc0b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d133c700 1 -- 172.21.15.36:0/2131088551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55cc0b4c40 msgr2=0x7f55cc143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:54.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d133c700 1 --2- 172.21.15.36:0/2131088551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55cc0b4c40 0x7f55cc143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d133c700 1 -- 172.21.15.36:0/2131088551 >> v2:172.21.15.59:3300/0 conn(0x7f55cc060100 msgr2=0x7f55cc0b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:54.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d133c700 1 --2- 172.21.15.36:0/2131088551 >> v2:172.21.15.59:3300/0 conn(0x7f55cc060100 0x7f55cc0b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d133c700 1 -- 172.21.15.36:0/2131088551 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc1442d0 con 0x7f55cc067300 2022-01-10T01:27:54.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d133c700 1 --2- 172.21.15.36:0/2131088551 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55cc067300 0x7f55cc1438f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f55bc002f70 tx=0x7f55bc006eb0).ready entity=mon.0 client_cookie=d6943e0062979a3d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:54.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d0b3b700 1 -- 172.21.15.36:0/2131088551 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55bc00d570 con 0x7f55cc067300 2022-01-10T01:27:54.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d0b3b700 1 -- 172.21.15.36:0/2131088551 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc000e90 con 0x7f55cc067300 2022-01-10T01:27:54.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d0b3b700 1 -- 172.21.15.36:0/2131088551 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55bc00d900 con 0x7f55cc067300 2022-01-10T01:27:54.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d3da1700 1 -- 172.21.15.36:0/2131088551 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55cc067300 msgr2=0x7f55cc1438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d3da1700 1 --2- 172.21.15.36:0/2131088551 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55cc067300 0x7f55cc1438f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f55bc002f70 tx=0x7f55bc006eb0).stop 2022-01-10T01:27:54.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d3da1700 1 -- 172.21.15.36:0/2131088551 shutdown_connections 2022-01-10T01:27:54.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d3da1700 1 --2- 172.21.15.36:0/2131088551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55cc0b4c40 0x7f55cc143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d3da1700 1 --2- 172.21.15.36:0/2131088551 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55cc067300 0x7f55cc1438f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d3da1700 1 --2- 172.21.15.36:0/2131088551 >> v2:172.21.15.59:3300/0 conn(0x7f55cc060100 0x7f55cc0b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d3da1700 1 -- 172.21.15.36:0/2131088551 >> 172.21.15.36:0/2131088551 conn(0x7f55cc05cf30 msgr2=0x7f55cc05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:54.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d3da1700 1 -- 172.21.15.36:0/2131088551 shutdown_connections 2022-01-10T01:27:54.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d3da1700 1 -- 172.21.15.36:0/2131088551 wait complete. 2022-01-10T01:27:54.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d3da1700 1 Processor -- start 2022-01-10T01:27:54.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.916+0000 7f55d3da1700 1 -- start start 2022-01-10T01:27:54.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d3da1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55cc060100 0x7f55cc0ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d3da1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55cc067300 0x7f55cc0617d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d3da1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55cc0b4c40 0x7f55cc061cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d3da1700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc153580 con 0x7f55cc0b4c40 2022-01-10T01:27:54.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d3da1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc152540 con 0x7f55cc060100 2022-01-10T01:27:54.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d3da1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc05ef30 con 0x7f55cc067300 2022-01-10T01:27:54.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d233e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55cc0b4c40 0x7f55cc061cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d233e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55cc0b4c40 0x7f55cc061cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36582/0 (socket says 172.21.15.36:36582) 2022-01-10T01:27:54.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d233e700 1 -- 172.21.15.36:0/4161148007 learned_addr learned my addr 172.21.15.36:0/4161148007 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:54.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d133c700 1 --2- 172.21.15.36:0/4161148007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55cc067300 0x7f55cc0617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d1b3d700 1 --2- 172.21.15.36:0/4161148007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55cc060100 0x7f55cc0ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d233e700 1 -- 172.21.15.36:0/4161148007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55cc067300 msgr2=0x7f55cc0617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d233e700 1 --2- 172.21.15.36:0/4161148007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55cc067300 0x7f55cc0617d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d233e700 1 -- 172.21.15.36:0/4161148007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55cc060100 msgr2=0x7f55cc0ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:54.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d233e700 1 --2- 172.21.15.36:0/4161148007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55cc060100 0x7f55cc0ae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:54.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d233e700 1 -- 172.21.15.36:0/4161148007 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc00b1e0 con 0x7f55cc0b4c40 2022-01-10T01:27:54.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d233e700 1 --2- 172.21.15.36:0/4161148007 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55cc0b4c40 0x7f55cc061cc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f55c400a000 tx=0x7f55c4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:54.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55baffd700 1 -- 172.21.15.36:0/4161148007 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55c400c070 con 0x7f55cc0b4c40 2022-01-10T01:27:54.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55baffd700 1 -- 172.21.15.36:0/4161148007 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c40133f0 con 0x7f55cc0b4c40 2022-01-10T01:27:54.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d3da1700 1 -- 172.21.15.36:0/4161148007 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55cc0b1430 con 0x7f55cc0b4c40 2022-01-10T01:27:54.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55baffd700 1 -- 172.21.15.36:0/4161148007 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55c4013750 con 0x7f55cc0b4c40 2022-01-10T01:27:54.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.920+0000 7f55d3da1700 1 -- 172.21.15.36:0/4161148007 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55cc152730 con 0x7f55cc0b4c40 2022-01-10T01:27:54.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.924+0000 7f55d3da1700 1 -- 172.21.15.36:0/4161148007 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55cc0abbf0 con 0x7f55cc0b4c40 2022-01-10T01:27:54.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.924+0000 7f55baffd700 1 -- 172.21.15.36:0/4161148007 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f55c40138b0 con 0x7f55cc0b4c40 2022-01-10T01:27:54.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.924+0000 7f55baffd700 1 --2- 172.21.15.36:0/4161148007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55ac053590 0x7f55ac055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:54.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.924+0000 7f55baffd700 1 -- 172.21.15.36:0/4161148007 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f55c406b880 con 0x7f55cc0b4c40 2022-01-10T01:27:54.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.924+0000 7f55d1b3d700 1 --2- 172.21.15.36:0/4161148007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55ac053590 0x7f55ac055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:54.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.924+0000 7f55d1b3d700 1 --2- 172.21.15.36:0/4161148007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55ac053590 0x7f55ac055a50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f55c800c000 tx=0x7f55c8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:54.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:54.928+0000 7f55baffd700 1 -- 172.21.15.36:0/4161148007 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f55c40427f0 con 0x7f55cc0b4c40 2022-01-10T01:27:55.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.092+0000 7f55d3da1700 1 -- 172.21.15.36:0/4161148007 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55cc057350 con 0x7f55cc0b4c40 2022-01-10T01:27:55.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.092+0000 7f55baffd700 1 -- 172.21.15.36:0/4161148007 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2496 (secure 0 0 0) 0x7f55c400f040 con 0x7f55cc0b4c40 2022-01-10T01:27:55.096 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:55.096 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1806166752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1806166752},{"type":"v1","addr":"172.21.15.36:6837","nonce":1806166752}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":35141,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2577386810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2577386810},{"type":"v1","addr":"172.21.15.36:6835","nonce":2577386810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:27:52.591733+0000","modified":"2022-01-10T01:27:53.595043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35150":{"gid":35150,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1363567016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1363567016},{"type":"v1","addr":"172.21.15.59:6833","nonce":1363567016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2022-01-10T01:27:55.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.092+0000 7f55d3da1700 1 -- 172.21.15.36:0/4161148007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55ac053590 msgr2=0x7f55ac055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:55.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.092+0000 7f55d3da1700 1 --2- 172.21.15.36:0/4161148007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55ac053590 0x7f55ac055a50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f55c800c000 tx=0x7f55c8008040).stop 2022-01-10T01:27:55.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.092+0000 7f55d3da1700 1 -- 172.21.15.36:0/4161148007 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55cc0b4c40 msgr2=0x7f55cc061cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:55.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.092+0000 7f55d3da1700 1 --2- 172.21.15.36:0/4161148007 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55cc0b4c40 0x7f55cc061cc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f55c400a000 tx=0x7f55c4008040).stop 2022-01-10T01:27:55.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.092+0000 7f55d3da1700 1 -- 172.21.15.36:0/4161148007 shutdown_connections 2022-01-10T01:27:55.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.092+0000 7f55d3da1700 1 --2- 172.21.15.36:0/4161148007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55ac053590 0x7f55ac055a50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.092+0000 7f55d3da1700 1 --2- 172.21.15.36:0/4161148007 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55cc0b4c40 0x7f55cc061cc0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.092+0000 7f55d3da1700 1 --2- 172.21.15.36:0/4161148007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55cc067300 0x7f55cc0617d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.092+0000 7f55d3da1700 1 --2- 172.21.15.36:0/4161148007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55cc060100 0x7f55cc0ae5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.092+0000 7f55d3da1700 1 -- 172.21.15.36:0/4161148007 >> 172.21.15.36:0/4161148007 conn(0x7f55cc05cf30 msgr2=0x7f55cc0b54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:55.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.092+0000 7f55d3da1700 1 -- 172.21.15.36:0/4161148007 shutdown_connections 2022-01-10T01:27:55.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.092+0000 7f55d3da1700 1 -- 172.21.15.36:0/4161148007 wait complete. 2022-01-10T01:27:55.101 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 24 2022-01-10T01:27:55.412 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:27:52.591733+0000', 'modified': '2022-01-10T01:27:53.595043+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35150}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35150': {'gid': 35150, 'name': 'b', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/1363567016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1363567016}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 1363567016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:27:55.413 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:27:55.414 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:27:55.529 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":35150,"want_state":"up:active","state":"up:active","rank_uptime":2.924764041,"mdsmap_epoch":24,"osdmap_epoch":56,"osdmap_epoch_barrier":55,"uptime":7.2798723030000003} 2022-01-10T01:27:55.530 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 35150, "mdsmap_epoch": 24, "osdmap_epoch": 56, "osdmap_epoch_barrier": 55, "rank_uptime": 2.924764041, "state": "up:active", "uptime": 7.279872303, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:27:55.530 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:27:55.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23b0cdc700 1 Processor -- start 2022-01-10T01:27:55.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23b0cdc700 1 -- start start 2022-01-10T01:27:55.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23b0cdc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0a9eb0 0x7f23ac0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:55.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23b0cdc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f23ac0b3130 0x7f23ac0af070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:55.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23b0cdc700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0aa290 con 0x7f23ac14b560 2022-01-10T01:27:55.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23b0cdc700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac0ae300 con 0x7f23ac0b3130 2022-01-10T01:27:55.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23b0cdc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0af560 con 0x7f23ac0a9eb0 2022-01-10T01:27:55.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23a9d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f23ac0b3130 0x7f23ac0af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:55.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23a9d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f23ac0b3130 0x7f23ac0af070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36588/0 (socket says 172.21.15.36:36588) 2022-01-10T01:27:55.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23a9d9b700 1 -- 172.21.15.36:0/1127254522 learned_addr learned my addr 172.21.15.36:0/1127254522 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:55.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23aa59c700 1 --2- 172.21.15.36:0/1127254522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0a9eb0 0x7f23ac0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:55.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23a9d9b700 1 -- 172.21.15.36:0/1127254522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0a9eb0 msgr2=0x7f23ac0b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:55.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23a9d9b700 1 --2- 172.21.15.36:0/1127254522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0a9eb0 0x7f23ac0b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23a9d9b700 1 -- 172.21.15.36:0/1127254522 >> v1:172.21.15.36:6789/0 conn(0x7f23ac14b560 legacy=0x7f23ac05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:55.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23a9d9b700 1 -- 172.21.15.36:0/1127254522 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac148170 con 0x7f23ac0b3130 2022-01-10T01:27:55.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23a9d9b700 1 --2- 172.21.15.36:0/1127254522 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23ac0b3130 0x7f23ac0af070 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f23a40032f0 tx=0x7f23a4009290).ready entity=mon.0 client_cookie=f1faeb7a590b8b42 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:55.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23a959a700 1 -- 172.21.15.36:0/1127254522 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23a400b8a0 con 0x7f23ac0b3130 2022-01-10T01:27:55.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23a959a700 1 -- 172.21.15.36:0/1127254522 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a400ba00 con 0x7f23ac0b3130 2022-01-10T01:27:55.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.636+0000 7f23a959a700 1 -- 172.21.15.36:0/1127254522 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23a400bb70 con 0x7f23ac0b3130 2022-01-10T01:27:55.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.640+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1127254522 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23ac0b3130 msgr2=0x7f23ac0af070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:55.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.640+0000 7f23b0cdc700 1 --2- 172.21.15.36:0/1127254522 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23ac0b3130 0x7f23ac0af070 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f23a40032f0 tx=0x7f23a4009290).stop 2022-01-10T01:27:55.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.640+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1127254522 shutdown_connections 2022-01-10T01:27:55.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.640+0000 7f23b0cdc700 1 --2- 172.21.15.36:0/1127254522 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23ac0b3130 0x7f23ac0af070 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.640+0000 7f23b0cdc700 1 --2- 172.21.15.36:0/1127254522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0a9eb0 0x7f23ac0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.640+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1127254522 >> 172.21.15.36:0/1127254522 conn(0x7f23ac0607c0 msgr2=0x7f23ac060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:55.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.640+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1127254522 shutdown_connections 2022-01-10T01:27:55.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.640+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1127254522 wait complete. 2022-01-10T01:27:55.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.640+0000 7f23b0cdc700 1 Processor -- start 2022-01-10T01:27:55.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.640+0000 7f23b0cdc700 1 -- start start 2022-01-10T01:27:55.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23b0cdc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0a9eb0 0x7f23ac1571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:55.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23b0cdc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23ac0b3130 0x7f23ac1461d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:55.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23b0cdc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23ac14b560 0x7f23ac145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:55.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23b0cdc700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac13c3b0 con 0x7f23ac0b3130 2022-01-10T01:27:55.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23b0cdc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac13c600 con 0x7f23ac14b560 2022-01-10T01:27:55.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23b0cdc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac156ab0 con 0x7f23ac0a9eb0 2022-01-10T01:27:55.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23a9d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23ac0b3130 0x7f23ac1461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:55.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23a9d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23ac0b3130 0x7f23ac1461d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36594/0 (socket says 172.21.15.36:36594) 2022-01-10T01:27:55.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23a9d9b700 1 -- 172.21.15.36:0/1579613707 learned_addr learned my addr 172.21.15.36:0/1579613707 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:55.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23aa59c700 1 --2- 172.21.15.36:0/1579613707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0a9eb0 0x7f23ac1571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:55.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23aad9d700 1 --2- 172.21.15.36:0/1579613707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23ac14b560 0x7f23ac145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:55.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23a9d9b700 1 -- 172.21.15.36:0/1579613707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0a9eb0 msgr2=0x7f23ac1571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:55.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23a9d9b700 1 --2- 172.21.15.36:0/1579613707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0a9eb0 0x7f23ac1571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23a9d9b700 1 -- 172.21.15.36:0/1579613707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23ac14b560 msgr2=0x7f23ac145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:55.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23a9d9b700 1 --2- 172.21.15.36:0/1579613707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23ac14b560 0x7f23ac145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23a9d9b700 1 -- 172.21.15.36:0/1579613707 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a4009530 con 0x7f23ac0b3130 2022-01-10T01:27:55.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23a9d9b700 1 --2- 172.21.15.36:0/1579613707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23ac0b3130 0x7f23ac1461d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f23a40032f0 tx=0x7f23a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:55.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23a37fe700 1 -- 172.21.15.36:0/1579613707 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23a400b8a0 con 0x7f23ac0b3130 2022-01-10T01:27:55.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23a37fe700 1 -- 172.21.15.36:0/1579613707 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a4021630 con 0x7f23ac0b3130 2022-01-10T01:27:55.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1579613707 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac156d50 con 0x7f23ac0b3130 2022-01-10T01:27:55.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23a37fe700 1 -- 172.21.15.36:0/1579613707 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23a4021990 con 0x7f23ac0b3130 2022-01-10T01:27:55.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1579613707 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac1567e0 con 0x7f23ac0b3130 2022-01-10T01:27:55.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1579613707 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac148410 con 0x7f23ac0b3130 2022-01-10T01:27:55.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.644+0000 7f23a37fe700 1 -- 172.21.15.36:0/1579613707 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f23a4027020 con 0x7f23ac0b3130 2022-01-10T01:27:55.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.648+0000 7f23a37fe700 1 --2- 172.21.15.36:0/1579613707 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f23840535f0 0x7f2384055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:55.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.648+0000 7f23aa59c700 1 --2- 172.21.15.36:0/1579613707 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f23840535f0 0x7f2384055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:55.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.648+0000 7f23a37fe700 1 -- 172.21.15.36:0/1579613707 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f23a406cf00 con 0x7f23ac0b3130 2022-01-10T01:27:55.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.648+0000 7f23aa59c700 1 --2- 172.21.15.36:0/1579613707 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f23840535f0 0x7f2384055ab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f239400c000 tx=0x7f2394008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:55.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.652+0000 7f23a37fe700 1 -- 172.21.15.36:0/1579613707 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f23a4043e00 con 0x7f23ac0b3130 2022-01-10T01:27:55.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.780+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1579613707 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23ac057350 con 0x7f23ac0b3130 2022-01-10T01:27:55.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.780+0000 7f23a37fe700 1 -- 172.21.15.36:0/1579613707 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16273 (secure 0 0 0) 0x7f23a4015070 con 0x7f23ac0b3130 2022-01-10T01:27:55.786 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:55.786 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":56,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:27:53.595841+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:27:51.027021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2022-01-10T01:27:52.032505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:27:55.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.784+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1579613707 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f23840535f0 msgr2=0x7f2384055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:55.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.784+0000 7f23b0cdc700 1 --2- 172.21.15.36:0/1579613707 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f23840535f0 0x7f2384055ab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f239400c000 tx=0x7f2394008040).stop 2022-01-10T01:27:55.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.784+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1579613707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23ac0b3130 msgr2=0x7f23ac1461d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:55.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.784+0000 7f23b0cdc700 1 --2- 172.21.15.36:0/1579613707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23ac0b3130 0x7f23ac1461d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f23a40032f0 tx=0x7f23a4016000).stop 2022-01-10T01:27:55.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.784+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1579613707 shutdown_connections 2022-01-10T01:27:55.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.784+0000 7f23b0cdc700 1 --2- 172.21.15.36:0/1579613707 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f23840535f0 0x7f2384055ab0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.784+0000 7f23b0cdc700 1 --2- 172.21.15.36:0/1579613707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23ac14b560 0x7f23ac145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.784+0000 7f23b0cdc700 1 --2- 172.21.15.36:0/1579613707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23ac0b3130 0x7f23ac1461d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.784+0000 7f23b0cdc700 1 --2- 172.21.15.36:0/1579613707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23ac0a9eb0 0x7f23ac1571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.784+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1579613707 >> 172.21.15.36:0/1579613707 conn(0x7f23ac0607c0 msgr2=0x7f23ac060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:55.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.784+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1579613707 shutdown_connections 2022-01-10T01:27:55.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.784+0000 7f23b0cdc700 1 -- 172.21.15.36:0/1579613707 wait complete. 2022-01-10T01:27:55.799 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:27:51.027021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:27:52.032505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:27:55.800 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:27:55.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 Processor -- start 2022-01-10T01:27:55.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 -- start start 2022-01-10T01:27:55.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fee500b2580 0x7fee5014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:55.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fee500a8ac0 0x7fee5014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:55.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee500a70c0 con 0x7fee500b0010 2022-01-10T01:27:55.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee500a72f0 con 0x7fee500a8ac0 2022-01-10T01:27:55.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee500a7590 con 0x7fee500b2580 2022-01-10T01:27:55.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5482c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fee500a8ac0 0x7fee5014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:55.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5482c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fee500a8ac0 0x7fee5014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36600/0 (socket says 172.21.15.36:36600) 2022-01-10T01:27:55.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5482c700 1 -- 172.21.15.36:0/759631622 learned_addr learned my addr 172.21.15.36:0/759631622 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:55.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee4f7fe700 1 --1- 172.21.15.36:0/759631622 >> v1:172.21.15.36:6789/0 conn(0x7fee500b0010 0x7fee500a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34398/0 (socket says 172.21.15.36:34398) 2022-01-10T01:27:55.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee4ffff700 1 --2- 172.21.15.36:0/759631622 >> v2:172.21.15.59:3300/0 conn(0x7fee500b2580 0x7fee5014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:55.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5482c700 1 -- 172.21.15.36:0/759631622 >> v2:172.21.15.59:3300/0 conn(0x7fee500b2580 msgr2=0x7fee5014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:55.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5482c700 1 --2- 172.21.15.36:0/759631622 >> v2:172.21.15.59:3300/0 conn(0x7fee500b2580 0x7fee5014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5482c700 1 -- 172.21.15.36:0/759631622 >> v1:172.21.15.36:6789/0 conn(0x7fee500b0010 legacy=0x7fee500a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:55.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5482c700 1 -- 172.21.15.36:0/759631622 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500a7830 con 0x7fee500a8ac0 2022-01-10T01:27:55.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5482c700 1 --2- 172.21.15.36:0/759631622 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee500a8ac0 0x7fee5014b330 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fee480032f0 tx=0x7fee48009290).ready entity=mon.0 client_cookie=b452a24a68f1cf31 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:55.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee4effd700 1 -- 172.21.15.36:0/759631622 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee4800b870 con 0x7fee500a8ac0 2022-01-10T01:27:55.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee4effd700 1 -- 172.21.15.36:0/759631622 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4800b9d0 con 0x7fee500a8ac0 2022-01-10T01:27:55.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee4effd700 1 -- 172.21.15.36:0/759631622 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee4800bb40 con 0x7fee500a8ac0 2022-01-10T01:27:55.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 -- 172.21.15.36:0/759631622 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee500a8ac0 msgr2=0x7fee5014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:55.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 --2- 172.21.15.36:0/759631622 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee500a8ac0 0x7fee5014b330 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fee480032f0 tx=0x7fee48009290).stop 2022-01-10T01:27:55.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 -- 172.21.15.36:0/759631622 shutdown_connections 2022-01-10T01:27:55.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 --2- 172.21.15.36:0/759631622 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee500a8ac0 0x7fee5014b330 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 --2- 172.21.15.36:0/759631622 >> v2:172.21.15.59:3300/0 conn(0x7fee500b2580 0x7fee5014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 -- 172.21.15.36:0/759631622 >> 172.21.15.36:0/759631622 conn(0x7fee50060180 msgr2=0x7fee500b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:55.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 -- 172.21.15.36:0/759631622 shutdown_connections 2022-01-10T01:27:55.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.904+0000 7fee5502d700 1 -- 172.21.15.36:0/759631622 wait complete. 2022-01-10T01:27:55.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5502d700 1 Processor -- start 2022-01-10T01:27:55.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5502d700 1 -- start start 2022-01-10T01:27:55.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5502d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee500a8ac0 0x7fee501490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:55.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5502d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee500b0010 0x7fee50064c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:55.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5502d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee500b2580 0x7fee50065130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:55.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5502d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50063b60 con 0x7fee500b2580 2022-01-10T01:27:55.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5502d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee50063000 con 0x7fee500a8ac0 2022-01-10T01:27:55.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5502d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee500632a0 con 0x7fee500b0010 2022-01-10T01:27:55.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5482c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee500b2580 0x7fee50065130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:55.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5482c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee500b2580 0x7fee50065130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36608/0 (socket says 172.21.15.36:36608) 2022-01-10T01:27:55.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5482c700 1 -- 172.21.15.36:0/3817992078 learned_addr learned my addr 172.21.15.36:0/3817992078 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:55.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee4f7fe700 1 --2- 172.21.15.36:0/3817992078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee500b0010 0x7fee50064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:55.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee4ffff700 1 --2- 172.21.15.36:0/3817992078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee500a8ac0 0x7fee501490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:55.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5482c700 1 -- 172.21.15.36:0/3817992078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee500b0010 msgr2=0x7fee50064c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:55.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5482c700 1 --2- 172.21.15.36:0/3817992078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee500b0010 0x7fee50064c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5482c700 1 -- 172.21.15.36:0/3817992078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee500a8ac0 msgr2=0x7fee501490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:55.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5482c700 1 --2- 172.21.15.36:0/3817992078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee500a8ac0 0x7fee501490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:55.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5482c700 1 -- 172.21.15.36:0/3817992078 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee48009530 con 0x7fee500b2580 2022-01-10T01:27:55.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5482c700 1 --2- 172.21.15.36:0/3817992078 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee500b2580 0x7fee50065130 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fee480032f0 tx=0x7fee48016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:55.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee4d7fa700 1 -- 172.21.15.36:0/3817992078 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee4800b870 con 0x7fee500b2580 2022-01-10T01:27:55.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee4d7fa700 1 -- 172.21.15.36:0/3817992078 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee48021440 con 0x7fee500b2580 2022-01-10T01:27:55.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee5502d700 1 -- 172.21.15.36:0/3817992078 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee50063540 con 0x7fee500b2580 2022-01-10T01:27:55.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.908+0000 7fee4d7fa700 1 -- 172.21.15.36:0/3817992078 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee480217a0 con 0x7fee500b2580 2022-01-10T01:27:55.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.912+0000 7fee5502d700 1 -- 172.21.15.36:0/3817992078 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee501495e0 con 0x7fee500b2580 2022-01-10T01:27:55.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.912+0000 7fee4d7fa700 1 -- 172.21.15.36:0/3817992078 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fee4800f070 con 0x7fee500b2580 2022-01-10T01:27:55.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.912+0000 7fee5502d700 1 -- 172.21.15.36:0/3817992078 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee50057350 con 0x7fee500b2580 2022-01-10T01:27:55.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.912+0000 7fee4d7fa700 1 --2- 172.21.15.36:0/3817992078 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fee30053680 0x7fee30055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:55.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.912+0000 7fee4d7fa700 1 -- 172.21.15.36:0/3817992078 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fee4806cd00 con 0x7fee500b2580 2022-01-10T01:27:55.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.912+0000 7fee4ffff700 1 --2- 172.21.15.36:0/3817992078 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fee30053680 0x7fee30055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:55.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.912+0000 7fee4ffff700 1 --2- 172.21.15.36:0/3817992078 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fee30053680 0x7fee30055b40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fee4400c000 tx=0x7fee44008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:55.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:55.916+0000 7fee4d7fa700 1 -- 172.21.15.36:0/3817992078 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee48043c00 con 0x7fee500b2580 2022-01-10T01:27:56.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.040+0000 7fee5502d700 1 -- 172.21.15.36:0/3817992078 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fee500698e0 con 0x7fee500b2580 2022-01-10T01:27:56.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.040+0000 7fee4d7fa700 1 -- 172.21.15.36:0/3817992078 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v56) v1 ==== 110+0+10 (secure 0 0 0) 0x7fee48015070 con 0x7fee500b2580 2022-01-10T01:27:56.045 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:27:56.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.040+0000 7fee5502d700 1 -- 172.21.15.36:0/3817992078 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fee30053680 msgr2=0x7fee30055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.040+0000 7fee5502d700 1 --2- 172.21.15.36:0/3817992078 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fee30053680 0x7fee30055b40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fee4400c000 tx=0x7fee44008040).stop 2022-01-10T01:27:56.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.040+0000 7fee5502d700 1 -- 172.21.15.36:0/3817992078 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee500b2580 msgr2=0x7fee50065130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.040+0000 7fee5502d700 1 --2- 172.21.15.36:0/3817992078 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee500b2580 0x7fee50065130 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fee480032f0 tx=0x7fee48016000).stop 2022-01-10T01:27:56.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.040+0000 7fee5502d700 1 -- 172.21.15.36:0/3817992078 shutdown_connections 2022-01-10T01:27:56.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.040+0000 7fee5502d700 1 --2- 172.21.15.36:0/3817992078 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fee30053680 0x7fee30055b40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.040+0000 7fee5502d700 1 --2- 172.21.15.36:0/3817992078 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee500b2580 0x7fee50065130 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.040+0000 7fee5502d700 1 --2- 172.21.15.36:0/3817992078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee500b0010 0x7fee50064c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.040+0000 7fee5502d700 1 --2- 172.21.15.36:0/3817992078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee500a8ac0 0x7fee501490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.040+0000 7fee5502d700 1 -- 172.21.15.36:0/3817992078 >> 172.21.15.36:0/3817992078 conn(0x7fee50060180 msgr2=0x7fee5005c560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:56.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.044+0000 7fee5502d700 1 -- 172.21.15.36:0/3817992078 shutdown_connections 2022-01-10T01:27:56.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.044+0000 7fee5502d700 1 -- 172.21.15.36:0/3817992078 wait complete. 2022-01-10T01:27:56.058 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:27:56.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae79d2e700 1 Processor -- start 2022-01-10T01:27:56.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae79d2e700 1 -- start start 2022-01-10T01:27:56.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae79d2e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae740aeab0 0x7fae740aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae79d2e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae74146ed0 0x7fae7413ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae79d2e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae740b0000 con 0x7fae740b0480 2022-01-10T01:27:56.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae79d2e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae740adf40 con 0x7fae740aeab0 2022-01-10T01:27:56.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae79d2e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae740ad0a0 con 0x7fae74146ed0 2022-01-10T01:27:56.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae73fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fae740b0480 0x7fae741467c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34410/0 (socket says 172.21.15.36:34410) 2022-01-10T01:27:56.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae73fff700 1 -- 172.21.15.36:0/232393466 learned_addr learned my addr 172.21.15.36:0/232393466 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:56.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae7952d700 1 --2- 172.21.15.36:0/232393466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae74146ed0 0x7fae7413ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae78d2c700 1 --2- 172.21.15.36:0/232393466 >> v2:172.21.15.59:3300/0 conn(0x7fae740aeab0 0x7fae740aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae737fe700 1 -- 172.21.15.36:0/232393466 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4193398964 0 0) 0x7fae740b0000 con 0x7fae740b0480 2022-01-10T01:27:56.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae737fe700 1 -- 172.21.15.36:0/232393466 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae58003260 con 0x7fae740b0480 2022-01-10T01:27:56.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae7952d700 1 -- 172.21.15.36:0/232393466 >> v2:172.21.15.59:3300/0 conn(0x7fae740aeab0 msgr2=0x7fae740aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:56.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae7952d700 1 --2- 172.21.15.36:0/232393466 >> v2:172.21.15.59:3300/0 conn(0x7fae740aeab0 0x7fae740aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae737fe700 1 -- 172.21.15.36:0/232393466 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 56136195 0 0) 0x7fae58003260 con 0x7fae740b0480 2022-01-10T01:27:56.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae7952d700 1 -- 172.21.15.36:0/232393466 >> v1:172.21.15.36:6789/0 conn(0x7fae740b0480 legacy=0x7fae741467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.168+0000 7fae7952d700 1 -- 172.21.15.36:0/232393466 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae74147350 con 0x7fae74146ed0 2022-01-10T01:27:56.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.172+0000 7fae7952d700 1 --2- 172.21.15.36:0/232393466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae74146ed0 0x7fae7413ff80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fae60001800 tx=0x7fae6c0091d0).ready entity=mon.2 client_cookie=702924cef9bc4c21 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:56.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.172+0000 7fae737fe700 1 -- 172.21.15.36:0/232393466 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae60001660 con 0x7fae74146ed0 2022-01-10T01:27:56.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.172+0000 7fae737fe700 1 -- 172.21.15.36:0/232393466 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c00f510 con 0x7fae74146ed0 2022-01-10T01:27:56.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.172+0000 7fae737fe700 1 -- 172.21.15.36:0/232393466 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6c00f680 con 0x7fae74146ed0 2022-01-10T01:27:56.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.172+0000 7fae79d2e700 1 -- 172.21.15.36:0/232393466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae74146ed0 msgr2=0x7fae7413ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.172+0000 7fae79d2e700 1 --2- 172.21.15.36:0/232393466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae74146ed0 0x7fae7413ff80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fae60001800 tx=0x7fae6c0091d0).stop 2022-01-10T01:27:56.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.172+0000 7fae79d2e700 1 -- 172.21.15.36:0/232393466 shutdown_connections 2022-01-10T01:27:56.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.172+0000 7fae79d2e700 1 --2- 172.21.15.36:0/232393466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae74146ed0 0x7fae7413ff80 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.172+0000 7fae79d2e700 1 --2- 172.21.15.36:0/232393466 >> v2:172.21.15.59:3300/0 conn(0x7fae740aeab0 0x7fae740aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.172+0000 7fae79d2e700 1 -- 172.21.15.36:0/232393466 >> 172.21.15.36:0/232393466 conn(0x7fae74061230 msgr2=0x7fae74062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:56.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.172+0000 7fae79d2e700 1 -- 172.21.15.36:0/232393466 shutdown_connections 2022-01-10T01:27:56.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.172+0000 7fae79d2e700 1 -- 172.21.15.36:0/232393466 wait complete. 2022-01-10T01:27:56.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.172+0000 7fae79d2e700 1 Processor -- start 2022-01-10T01:27:56.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.172+0000 7fae79d2e700 1 -- start start 2022-01-10T01:27:56.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae79d2e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae740aeab0 0x7fae74142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae79d2e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae740b0480 0x7fae74064740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae79d2e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae74146ed0 0x7fae741556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae79d2e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae741419e0 con 0x7fae74146ed0 2022-01-10T01:27:56.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae79d2e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae74141080 con 0x7fae740b0480 2022-01-10T01:27:56.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae79d2e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae74143620 con 0x7fae740aeab0 2022-01-10T01:27:56.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae7952d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae74146ed0 0x7fae741556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae7952d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae74146ed0 0x7fae741556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36624/0 (socket says 172.21.15.36:36624) 2022-01-10T01:27:56.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae7952d700 1 -- 172.21.15.36:0/4289266122 learned_addr learned my addr 172.21.15.36:0/4289266122 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:56.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae73fff700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae740b0480 0x7fae74064740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae78d2c700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae740aeab0 0x7fae74142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae7952d700 1 -- 172.21.15.36:0/4289266122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae740aeab0 msgr2=0x7fae74142ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae7952d700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae740aeab0 0x7fae74142ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae7952d700 1 -- 172.21.15.36:0/4289266122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae740b0480 msgr2=0x7fae74064740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae7952d700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae740b0480 0x7fae74064740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae7952d700 1 -- 172.21.15.36:0/4289266122 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c009470 con 0x7fae74146ed0 2022-01-10T01:27:56.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae73fff700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae740b0480 0x7fae74064740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:27:56.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae7952d700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae74146ed0 0x7fae741556a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fae60001800 tx=0x7fae6c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:56.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae71ffb700 1 -- 172.21.15.36:0/4289266122 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6c0032d0 con 0x7fae74146ed0 2022-01-10T01:27:56.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae71ffb700 1 -- 172.21.15.36:0/4289266122 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6c011c30 con 0x7fae74146ed0 2022-01-10T01:27:56.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae79d2e700 1 -- 172.21.15.36:0/4289266122 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae74141c10 con 0x7fae74146ed0 2022-01-10T01:27:56.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae71ffb700 1 -- 172.21.15.36:0/4289266122 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae6c021440 con 0x7fae74146ed0 2022-01-10T01:27:56.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.176+0000 7fae79d2e700 1 -- 172.21.15.36:0/4289266122 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae741414e0 con 0x7fae74146ed0 2022-01-10T01:27:56.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.180+0000 7fae79d2e700 1 -- 172.21.15.36:0/4289266122 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae740b0990 con 0x7fae74146ed0 2022-01-10T01:27:56.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.180+0000 7fae71ffb700 1 -- 172.21.15.36:0/4289266122 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fae6c027020 con 0x7fae74146ed0 2022-01-10T01:27:56.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.180+0000 7fae71ffb700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae54053500 0x7fae540559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.180+0000 7fae71ffb700 1 -- 172.21.15.36:0/4289266122 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fae6c06cbc0 con 0x7fae74146ed0 2022-01-10T01:27:56.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.180+0000 7fae78d2c700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae54053500 0x7fae540559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.180+0000 7fae78d2c700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae54053500 0x7fae540559c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fae6800b000 tx=0x7fae68006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:56.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.188+0000 7fae71ffb700 1 -- 172.21.15.36:0/4289266122 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fae6c0439e0 con 0x7fae74146ed0 2022-01-10T01:27:56.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.316+0000 7fae79d2e700 1 -- 172.21.15.36:0/4289266122 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fae74057350 con 0x7fae74146ed0 2022-01-10T01:27:56.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.316+0000 7fae71ffb700 1 -- 172.21.15.36:0/4289266122 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v56) v1 ==== 92+0+10 (secure 0 0 0) 0x7fae6c0150a0 con 0x7fae74146ed0 2022-01-10T01:27:56.320 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:27:56.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.316+0000 7fae79d2e700 1 -- 172.21.15.36:0/4289266122 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae54053500 msgr2=0x7fae540559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.316+0000 7fae79d2e700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae54053500 0x7fae540559c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fae6800b000 tx=0x7fae68006df0).stop 2022-01-10T01:27:56.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.316+0000 7fae79d2e700 1 -- 172.21.15.36:0/4289266122 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae74146ed0 msgr2=0x7fae741556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.316+0000 7fae79d2e700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae74146ed0 0x7fae741556a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fae60001800 tx=0x7fae6c016000).stop 2022-01-10T01:27:56.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.316+0000 7fae79d2e700 1 -- 172.21.15.36:0/4289266122 shutdown_connections 2022-01-10T01:27:56.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.316+0000 7fae79d2e700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae54053500 0x7fae540559c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.316+0000 7fae79d2e700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae74146ed0 0x7fae741556a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.316+0000 7fae79d2e700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae740b0480 0x7fae74064740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.316+0000 7fae79d2e700 1 --2- 172.21.15.36:0/4289266122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae740aeab0 0x7fae74142ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.316+0000 7fae79d2e700 1 -- 172.21.15.36:0/4289266122 >> 172.21.15.36:0/4289266122 conn(0x7fae74061230 msgr2=0x7fae740b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:56.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.320+0000 7fae79d2e700 1 -- 172.21.15.36:0/4289266122 shutdown_connections 2022-01-10T01:27:56.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.320+0000 7fae79d2e700 1 -- 172.21.15.36:0/4289266122 wait complete. 2022-01-10T01:27:56.334 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:27:56.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c17fff700 1 Processor -- start 2022-01-10T01:27:56.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c17fff700 1 -- start start 2022-01-10T01:27:56.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c17fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c180b2580 0x7f7c1814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c17fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c180b0010 0x7f7c1814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c17fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7c180afbd0 0x7f7c180a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c17fff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c180a70c0 con 0x7f7c180afbd0 2022-01-10T01:27:56.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c17fff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c180a72f0 con 0x7f7c180b2580 2022-01-10T01:27:56.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c17fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180a7590 con 0x7f7c180b0010 2022-01-10T01:27:56.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c177fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7c180afbd0 0x7f7c180a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c177fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7c180afbd0 0x7f7c180a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36630/0 (socket says 172.21.15.36:36630) 2022-01-10T01:27:56.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c177fe700 1 -- 172.21.15.36:0/3275788385 learned_addr learned my addr 172.21.15.36:0/3275788385 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:56.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c16ffd700 1 --2- 172.21.15.36:0/3275788385 >> v2:172.21.15.59:3300/0 conn(0x7f7c180b2580 0x7f7c1814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c167fc700 1 --2- 172.21.15.36:0/3275788385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c180b0010 0x7f7c1814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c177fe700 1 -- 172.21.15.36:0/3275788385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c180b0010 msgr2=0x7f7c1814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:56.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c177fe700 1 --2- 172.21.15.36:0/3275788385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c180b0010 0x7f7c1814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c177fe700 1 -- 172.21.15.36:0/3275788385 >> v2:172.21.15.59:3300/0 conn(0x7f7c180b2580 msgr2=0x7f7c1814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:56.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c177fe700 1 --2- 172.21.15.36:0/3275788385 >> v2:172.21.15.59:3300/0 conn(0x7f7c180b2580 0x7f7c1814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c177fe700 1 -- 172.21.15.36:0/3275788385 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c180a7830 con 0x7f7c180afbd0 2022-01-10T01:27:56.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c177fe700 1 --2- 172.21.15.36:0/3275788385 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c180afbd0 0x7f7c180a83b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f7c100032f0 tx=0x7f7c10009290).ready entity=mon.0 client_cookie=c164d17a7e5993c6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:56.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c15ffb700 1 -- 172.21.15.36:0/3275788385 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c1000b870 con 0x7f7c180afbd0 2022-01-10T01:27:56.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.440+0000 7f7c15ffb700 1 -- 172.21.15.36:0/3275788385 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1000b9d0 con 0x7f7c180afbd0 2022-01-10T01:27:56.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c15ffb700 1 -- 172.21.15.36:0/3275788385 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c1000bb40 con 0x7f7c180afbd0 2022-01-10T01:27:56.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 -- 172.21.15.36:0/3275788385 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c180afbd0 msgr2=0x7f7c180a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 --2- 172.21.15.36:0/3275788385 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c180afbd0 0x7f7c180a83b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f7c100032f0 tx=0x7f7c10009290).stop 2022-01-10T01:27:56.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 -- 172.21.15.36:0/3275788385 shutdown_connections 2022-01-10T01:27:56.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 --2- 172.21.15.36:0/3275788385 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c180afbd0 0x7f7c180a83b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 --2- 172.21.15.36:0/3275788385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c180b0010 0x7f7c1814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 --2- 172.21.15.36:0/3275788385 >> v2:172.21.15.59:3300/0 conn(0x7f7c180b2580 0x7f7c1814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 -- 172.21.15.36:0/3275788385 >> 172.21.15.36:0/3275788385 conn(0x7f7c18060180 msgr2=0x7f7c180b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:56.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 -- 172.21.15.36:0/3275788385 shutdown_connections 2022-01-10T01:27:56.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 -- 172.21.15.36:0/3275788385 wait complete. 2022-01-10T01:27:56.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 Processor -- start 2022-01-10T01:27:56.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 -- start start 2022-01-10T01:27:56.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c180afbd0 0x7f7c18143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c180b0010 0x7f7c180b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c180b2580 0x7f7c180b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180aaab0 con 0x7f7c180b0010 2022-01-10T01:27:56.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180a9140 con 0x7f7c180afbd0 2022-01-10T01:27:56.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c180a9be0 con 0x7f7c180b2580 2022-01-10T01:27:56.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c167fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c180b0010 0x7f7c180b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c167fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c180b0010 0x7f7c180b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36636/0 (socket says 172.21.15.36:36636) 2022-01-10T01:27:56.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c167fc700 1 -- 172.21.15.36:0/1936493725 learned_addr learned my addr 172.21.15.36:0/1936493725 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:56.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c177fe700 1 --2- 172.21.15.36:0/1936493725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c180b2580 0x7f7c180b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c16ffd700 1 --2- 172.21.15.36:0/1936493725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c180afbd0 0x7f7c18143e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c167fc700 1 -- 172.21.15.36:0/1936493725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c180b2580 msgr2=0x7f7c180b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c167fc700 1 --2- 172.21.15.36:0/1936493725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c180b2580 0x7f7c180b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c167fc700 1 -- 172.21.15.36:0/1936493725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c180afbd0 msgr2=0x7f7c18143e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c167fc700 1 --2- 172.21.15.36:0/1936493725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c180afbd0 0x7f7c18143e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c167fc700 1 -- 172.21.15.36:0/1936493725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10009530 con 0x7f7c180b0010 2022-01-10T01:27:56.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c167fc700 1 --2- 172.21.15.36:0/1936493725 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c180b0010 0x7f7c180b4610 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f7c0800a000 tx=0x7f7c08008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:56.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c07fff700 1 -- 172.21.15.36:0/1936493725 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c08011780 con 0x7f7c180b0010 2022-01-10T01:27:56.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c07fff700 1 -- 172.21.15.36:0/1936493725 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c080118e0 con 0x7f7c180b0010 2022-01-10T01:27:56.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c07fff700 1 -- 172.21.15.36:0/1936493725 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c08011c40 con 0x7f7c180b0010 2022-01-10T01:27:56.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 -- 172.21.15.36:0/1936493725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c180b3ed0 con 0x7f7c180b0010 2022-01-10T01:27:56.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.444+0000 7f7c17fff700 1 -- 172.21.15.36:0/1936493725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c180ac1b0 con 0x7f7c180b0010 2022-01-10T01:27:56.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.448+0000 7f7c17fff700 1 -- 172.21.15.36:0/1936493725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c180a9de0 con 0x7f7c180b0010 2022-01-10T01:27:56.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.448+0000 7f7c07fff700 1 -- 172.21.15.36:0/1936493725 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7c0801c460 con 0x7f7c180b0010 2022-01-10T01:27:56.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.448+0000 7f7c07fff700 1 --2- 172.21.15.36:0/1936493725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7bf4053680 0x7f7bf4055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.448+0000 7f7c07fff700 1 -- 172.21.15.36:0/1936493725 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7c0806bcf0 con 0x7f7c180b0010 2022-01-10T01:27:56.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.448+0000 7f7c16ffd700 1 --2- 172.21.15.36:0/1936493725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7bf4053680 0x7f7bf4055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.448+0000 7f7c16ffd700 1 --2- 172.21.15.36:0/1936493725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7bf4053680 0x7f7bf4055b40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f7c0c00c000 tx=0x7f7c0c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:56.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.456+0000 7f7c07fff700 1 -- 172.21.15.36:0/1936493725 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7c08042ca0 con 0x7f7c180b0010 2022-01-10T01:27:56.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.580+0000 7f7c17fff700 1 -- 172.21.15.36:0/1936493725 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c18057350 con 0x7f7c180b0010 2022-01-10T01:27:56.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.584+0000 7f7c07fff700 1 -- 172.21.15.36:0/1936493725 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7c080462c0 con 0x7f7c180b0010 2022-01-10T01:27:56.587 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:27:56.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.584+0000 7f7c17fff700 1 -- 172.21.15.36:0/1936493725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7bf4053680 msgr2=0x7f7bf4055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.584+0000 7f7c17fff700 1 --2- 172.21.15.36:0/1936493725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7bf4053680 0x7f7bf4055b40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f7c0c00c000 tx=0x7f7c0c008040).stop 2022-01-10T01:27:56.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.584+0000 7f7c17fff700 1 -- 172.21.15.36:0/1936493725 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c180b0010 msgr2=0x7f7c180b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.584+0000 7f7c17fff700 1 --2- 172.21.15.36:0/1936493725 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c180b0010 0x7f7c180b4610 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f7c0800a000 tx=0x7f7c08008040).stop 2022-01-10T01:27:56.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.584+0000 7f7c17fff700 1 -- 172.21.15.36:0/1936493725 shutdown_connections 2022-01-10T01:27:56.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.584+0000 7f7c17fff700 1 --2- 172.21.15.36:0/1936493725 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7bf4053680 0x7f7bf4055b40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.584+0000 7f7c17fff700 1 --2- 172.21.15.36:0/1936493725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c180b2580 0x7f7c180b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.584+0000 7f7c17fff700 1 --2- 172.21.15.36:0/1936493725 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c180b0010 0x7f7c180b4610 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.584+0000 7f7c17fff700 1 --2- 172.21.15.36:0/1936493725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c180afbd0 0x7f7c18143e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.584+0000 7f7c17fff700 1 -- 172.21.15.36:0/1936493725 >> 172.21.15.36:0/1936493725 conn(0x7f7c18060180 msgr2=0x7f7c18144ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:56.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.584+0000 7f7c17fff700 1 -- 172.21.15.36:0/1936493725 shutdown_connections 2022-01-10T01:27:56.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.584+0000 7f7c17fff700 1 -- 172.21.15.36:0/1936493725 wait complete. 2022-01-10T01:27:56.600 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:27:56.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 Processor -- start 2022-01-10T01:27:56.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 -- start start 2022-01-10T01:27:56.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff288146950 0x7ff288140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2880b4180 0x7ff288140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2880b4690 0x7ff2880b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff288147510 con 0x7ff288146950 2022-01-10T01:27:56.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff288143b60 con 0x7ff2880b4690 2022-01-10T01:27:56.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff288143e00 con 0x7ff2880b4180 2022-01-10T01:27:56.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff287fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff288146950 0x7ff288140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff287fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff288146950 0x7ff288140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36642/0 (socket says 172.21.15.36:36642) 2022-01-10T01:27:56.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff287fff700 1 -- 172.21.15.36:0/580555702 learned_addr learned my addr 172.21.15.36:0/580555702 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:56.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28c86d700 1 --2- 172.21.15.36:0/580555702 >> v2:172.21.15.59:3300/0 conn(0x7ff2880b4690 0x7ff2880b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff2877fe700 1 --2- 172.21.15.36:0/580555702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2880b4180 0x7ff288140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff287fff700 1 -- 172.21.15.36:0/580555702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2880b4180 msgr2=0x7ff288140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:56.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff287fff700 1 --2- 172.21.15.36:0/580555702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2880b4180 0x7ff288140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff287fff700 1 -- 172.21.15.36:0/580555702 >> v2:172.21.15.59:3300/0 conn(0x7ff2880b4690 msgr2=0x7ff2880b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:56.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff287fff700 1 --2- 172.21.15.36:0/580555702 >> v2:172.21.15.59:3300/0 conn(0x7ff2880b4690 0x7ff2880b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff287fff700 1 -- 172.21.15.36:0/580555702 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2880b0c90 con 0x7ff288146950 2022-01-10T01:27:56.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff287fff700 1 --2- 172.21.15.36:0/580555702 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff288146950 0x7ff288140230 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7ff2780032f0 tx=0x7ff278009290).ready entity=mon.0 client_cookie=53da0799ceeb5d20 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:56.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff286ffd700 1 -- 172.21.15.36:0/580555702 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff27800b680 con 0x7ff288146950 2022-01-10T01:27:56.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff286ffd700 1 -- 172.21.15.36:0/580555702 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27800b7e0 con 0x7ff288146950 2022-01-10T01:27:56.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff286ffd700 1 -- 172.21.15.36:0/580555702 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff27800b950 con 0x7ff288146950 2022-01-10T01:27:56.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 -- 172.21.15.36:0/580555702 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff288146950 msgr2=0x7ff288140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 --2- 172.21.15.36:0/580555702 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff288146950 0x7ff288140230 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7ff2780032f0 tx=0x7ff278009290).stop 2022-01-10T01:27:56.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 -- 172.21.15.36:0/580555702 shutdown_connections 2022-01-10T01:27:56.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 --2- 172.21.15.36:0/580555702 >> v2:172.21.15.59:3300/0 conn(0x7ff2880b4690 0x7ff2880b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 --2- 172.21.15.36:0/580555702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2880b4180 0x7ff288140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 --2- 172.21.15.36:0/580555702 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff288146950 0x7ff288140230 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.704+0000 7ff28e2d0700 1 -- 172.21.15.36:0/580555702 >> 172.21.15.36:0/580555702 conn(0x7ff28805c490 msgr2=0x7ff28805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:56.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff28e2d0700 1 -- 172.21.15.36:0/580555702 shutdown_connections 2022-01-10T01:27:56.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff28e2d0700 1 -- 172.21.15.36:0/580555702 wait complete. 2022-01-10T01:27:56.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff28e2d0700 1 Processor -- start 2022-01-10T01:27:56.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff28e2d0700 1 -- start start 2022-01-10T01:27:56.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff28e2d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2880b4180 0x7ff288144c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff28e2d0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2880b4690 0x7ff2881524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff28e2d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff288146950 0x7ff288152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff28e2d0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff288150190 con 0x7ff2880b4690 2022-01-10T01:27:56.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff28e2d0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff288152e80 con 0x7ff288146950 2022-01-10T01:27:56.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff28e2d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2880b0500 con 0x7ff2880b4180 2022-01-10T01:27:56.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff2877fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2880b4690 0x7ff2881524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff2877fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2880b4690 0x7ff2881524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36650/0 (socket says 172.21.15.36:36650) 2022-01-10T01:27:56.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff2877fe700 1 -- 172.21.15.36:0/3663221579 learned_addr learned my addr 172.21.15.36:0/3663221579 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:56.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff287fff700 1 --2- 172.21.15.36:0/3663221579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2880b4180 0x7ff288144c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff28c86d700 1 --2- 172.21.15.36:0/3663221579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff288146950 0x7ff288152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff2877fe700 1 -- 172.21.15.36:0/3663221579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2880b4180 msgr2=0x7ff288144c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff2877fe700 1 --2- 172.21.15.36:0/3663221579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2880b4180 0x7ff288144c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff2877fe700 1 -- 172.21.15.36:0/3663221579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff288146950 msgr2=0x7ff288152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff2877fe700 1 --2- 172.21.15.36:0/3663221579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff288146950 0x7ff288152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff2877fe700 1 -- 172.21.15.36:0/3663221579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff278009530 con 0x7ff2880b4690 2022-01-10T01:27:56.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff2877fe700 1 --2- 172.21.15.36:0/3663221579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2880b4690 0x7ff2881524a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7ff288152fc0 tx=0x7ff270006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:56.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff2857fa700 1 -- 172.21.15.36:0/3663221579 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff270010780 con 0x7ff2880b4690 2022-01-10T01:27:56.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff2857fa700 1 -- 172.21.15.36:0/3663221579 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2700108e0 con 0x7ff2880b4690 2022-01-10T01:27:56.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff28e2d0700 1 -- 172.21.15.36:0/3663221579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff288143220 con 0x7ff2880b4690 2022-01-10T01:27:56.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff2857fa700 1 -- 172.21.15.36:0/3663221579 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff270010c40 con 0x7ff2880b4690 2022-01-10T01:27:56.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.708+0000 7ff28e2d0700 1 -- 172.21.15.36:0/3663221579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff288142d10 con 0x7ff2880b4690 2022-01-10T01:27:56.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.712+0000 7ff28e2d0700 1 -- 172.21.15.36:0/3663221579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff288155da0 con 0x7ff2880b4690 2022-01-10T01:27:56.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.712+0000 7ff2857fa700 1 -- 172.21.15.36:0/3663221579 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff27001c460 con 0x7ff2880b4690 2022-01-10T01:27:56.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.712+0000 7ff2857fa700 1 --2- 172.21.15.36:0/3663221579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff26c053560 0x7ff26c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.712+0000 7ff2857fa700 1 -- 172.21.15.36:0/3663221579 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff27006be80 con 0x7ff2880b4690 2022-01-10T01:27:56.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.712+0000 7ff287fff700 1 --2- 172.21.15.36:0/3663221579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff26c053560 0x7ff26c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.712+0000 7ff287fff700 1 --2- 172.21.15.36:0/3663221579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff26c053560 0x7ff26c055a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7ff278018000 tx=0x7ff278017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:56.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.720+0000 7ff2857fa700 1 -- 172.21.15.36:0/3663221579 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff270042e30 con 0x7ff2880b4690 2022-01-10T01:27:56.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.844+0000 7ff28e2d0700 1 -- 172.21.15.36:0/3663221579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2881433b0 con 0x7ff2880b4690 2022-01-10T01:27:56.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.848+0000 7ff2857fa700 1 -- 172.21.15.36:0/3663221579 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff270046450 con 0x7ff2880b4690 2022-01-10T01:27:56.851 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:27:56.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.848+0000 7ff28e2d0700 1 -- 172.21.15.36:0/3663221579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff26c053560 msgr2=0x7ff26c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.848+0000 7ff28e2d0700 1 --2- 172.21.15.36:0/3663221579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff26c053560 0x7ff26c055a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7ff278018000 tx=0x7ff278017000).stop 2022-01-10T01:27:56.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.848+0000 7ff28e2d0700 1 -- 172.21.15.36:0/3663221579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2880b4690 msgr2=0x7ff2881524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.848+0000 7ff28e2d0700 1 --2- 172.21.15.36:0/3663221579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2880b4690 0x7ff2881524a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7ff288152fc0 tx=0x7ff270006df0).stop 2022-01-10T01:27:56.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.848+0000 7ff28e2d0700 1 -- 172.21.15.36:0/3663221579 shutdown_connections 2022-01-10T01:27:56.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.848+0000 7ff28e2d0700 1 --2- 172.21.15.36:0/3663221579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff26c053560 0x7ff26c055a20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.848+0000 7ff28e2d0700 1 --2- 172.21.15.36:0/3663221579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff288146950 0x7ff288152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.848+0000 7ff28e2d0700 1 --2- 172.21.15.36:0/3663221579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2880b4690 0x7ff2881524a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.848+0000 7ff28e2d0700 1 --2- 172.21.15.36:0/3663221579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2880b4180 0x7ff288144c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.848+0000 7ff28e2d0700 1 -- 172.21.15.36:0/3663221579 >> 172.21.15.36:0/3663221579 conn(0x7ff28805c490 msgr2=0x7ff2880b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:56.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.848+0000 7ff28e2d0700 1 -- 172.21.15.36:0/3663221579 shutdown_connections 2022-01-10T01:27:56.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.848+0000 7ff28e2d0700 1 -- 172.21.15.36:0/3663221579 wait complete. 2022-01-10T01:27:56.864 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:27:56.865 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:27:56.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.964+0000 7f8925525700 1 Processor -- start 2022-01-10T01:27:56.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.964+0000 7f8925525700 1 -- start start 2022-01-10T01:27:56.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.964+0000 7f8925525700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89200b2580 0x7f892014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.964+0000 7f8925525700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f89200a8ac0 0x7f892014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.964+0000 7f8925525700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89200a70c0 con 0x7f89200b0010 2022-01-10T01:27:56.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.964+0000 7f8925525700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89200a72f0 con 0x7f89200a8ac0 2022-01-10T01:27:56.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.964+0000 7f8925525700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89200a7590 con 0x7f89200b2580 2022-01-10T01:27:56.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.964+0000 7f891f7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f89200b0010 0x7f89200a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34450/0 (socket says 172.21.15.36:34450) 2022-01-10T01:27:56.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.964+0000 7f891f7fe700 1 -- 172.21.15.36:0/2465612700 learned_addr learned my addr 172.21.15.36:0/2465612700 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:27:56.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.964+0000 7f8924d24700 1 --2- 172.21.15.36:0/2465612700 >> v2:172.21.15.59:3300/0 conn(0x7f89200a8ac0 0x7f892014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.964+0000 7f891ffff700 1 --2- 172.21.15.36:0/2465612700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89200b2580 0x7f892014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.964+0000 7f891effd700 1 -- 172.21.15.36:0/2465612700 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950525632 0 0) 0x7f89200a70c0 con 0x7f89200b0010 2022-01-10T01:27:56.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.964+0000 7f891effd700 1 -- 172.21.15.36:0/2465612700 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f890c003260 con 0x7f89200b0010 2022-01-10T01:27:56.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8924d24700 1 -- 172.21.15.36:0/2465612700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89200b2580 msgr2=0x7f892014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:27:56.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f891effd700 1 -- 172.21.15.36:0/2465612700 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1445449586 0 0) 0x7f890c003260 con 0x7f89200b0010 2022-01-10T01:27:56.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8924d24700 1 --2- 172.21.15.36:0/2465612700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89200b2580 0x7f892014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8924d24700 1 -- 172.21.15.36:0/2465612700 >> v1:172.21.15.36:6789/0 conn(0x7f89200b0010 legacy=0x7f89200a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8924d24700 1 -- 172.21.15.36:0/2465612700 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89200a7830 con 0x7f89200a8ac0 2022-01-10T01:27:56.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f891ffff700 1 --2- 172.21.15.36:0/2465612700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89200b2580 0x7f892014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:27:56.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8924d24700 1 --2- 172.21.15.36:0/2465612700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89200a8ac0 0x7f892014b330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f8910001800 tx=0x7f89180091d0).ready entity=mon.1 client_cookie=f704c767d96fab94 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:56.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f891effd700 1 -- 172.21.15.36:0/2465612700 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8910001660 con 0x7f89200a8ac0 2022-01-10T01:27:56.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f891effd700 1 -- 172.21.15.36:0/2465612700 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891800f510 con 0x7f89200a8ac0 2022-01-10T01:27:56.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f891effd700 1 -- 172.21.15.36:0/2465612700 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f891800f680 con 0x7f89200a8ac0 2022-01-10T01:27:56.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8925525700 1 -- 172.21.15.36:0/2465612700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89200a8ac0 msgr2=0x7f892014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8925525700 1 --2- 172.21.15.36:0/2465612700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89200a8ac0 0x7f892014b330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f8910001800 tx=0x7f89180091d0).stop 2022-01-10T01:27:56.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8925525700 1 -- 172.21.15.36:0/2465612700 shutdown_connections 2022-01-10T01:27:56.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8925525700 1 --2- 172.21.15.36:0/2465612700 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89200a8ac0 0x7f892014b330 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8925525700 1 --2- 172.21.15.36:0/2465612700 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89200b2580 0x7f892014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8925525700 1 -- 172.21.15.36:0/2465612700 >> 172.21.15.36:0/2465612700 conn(0x7f8920060180 msgr2=0x7f89200b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:56.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8925525700 1 -- 172.21.15.36:0/2465612700 shutdown_connections 2022-01-10T01:27:56.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8925525700 1 -- 172.21.15.36:0/2465612700 wait complete. 2022-01-10T01:27:56.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8925525700 1 Processor -- start 2022-01-10T01:27:56.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.968+0000 7f8925525700 1 -- start start 2022-01-10T01:27:56.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f8925525700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89200a8ac0 0x7f8920063340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f8925525700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89200b0010 0x7f89200abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f8925525700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89200b2580 0x7f8920146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f8925525700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89200aa8e0 con 0x7f89200b0010 2022-01-10T01:27:56.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f8925525700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89200ac610 con 0x7f89200a8ac0 2022-01-10T01:27:56.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f8925525700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89200aab10 con 0x7f89200b2580 2022-01-10T01:27:56.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f891f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89200b0010 0x7f89200abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f891f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89200b0010 0x7f89200abc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36664/0 (socket says 172.21.15.36:36664) 2022-01-10T01:27:56.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f891f7fe700 1 -- 172.21.15.36:0/2796944012 learned_addr learned my addr 172.21.15.36:0/2796944012 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:27:56.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f8924d24700 1 --2- 172.21.15.36:0/2796944012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89200b2580 0x7f8920146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f891ffff700 1 --2- 172.21.15.36:0/2796944012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89200a8ac0 0x7f8920063340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f891f7fe700 1 -- 172.21.15.36:0/2796944012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89200b2580 msgr2=0x7f8920146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f891f7fe700 1 --2- 172.21.15.36:0/2796944012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89200b2580 0x7f8920146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f891f7fe700 1 -- 172.21.15.36:0/2796944012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89200a8ac0 msgr2=0x7f8920063340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:56.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f891f7fe700 1 --2- 172.21.15.36:0/2796944012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89200a8ac0 0x7f8920063340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:56.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f891f7fe700 1 -- 172.21.15.36:0/2796944012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891400b180 con 0x7f89200b0010 2022-01-10T01:27:56.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f891f7fe700 1 --2- 172.21.15.36:0/2796944012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89200b0010 0x7f89200abc00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f89100018c0 tx=0x7f89100011a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:56.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f891d7fa700 1 -- 172.21.15.36:0/2796944012 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8910007170 con 0x7f89200b0010 2022-01-10T01:27:56.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f891d7fa700 1 -- 172.21.15.36:0/2796944012 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89100072d0 con 0x7f89200b0010 2022-01-10T01:27:56.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f8925525700 1 -- 172.21.15.36:0/2796944012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8918009470 con 0x7f89200b0010 2022-01-10T01:27:56.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f891d7fa700 1 -- 172.21.15.36:0/2796944012 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8910004920 con 0x7f89200b0010 2022-01-10T01:27:56.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f8925525700 1 -- 172.21.15.36:0/2796944012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89200ab720 con 0x7f89200b0010 2022-01-10T01:27:56.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f8925525700 1 -- 172.21.15.36:0/2796944012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8920057350 con 0x7f89200b0010 2022-01-10T01:27:56.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.972+0000 7f891d7fa700 1 -- 172.21.15.36:0/2796944012 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8910004a80 con 0x7f89200b0010 2022-01-10T01:27:56.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.976+0000 7f891d7fa700 1 --2- 172.21.15.36:0/2796944012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8900053620 0x7f8900055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:27:56.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.976+0000 7f891ffff700 1 --2- 172.21.15.36:0/2796944012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8900053620 0x7f8900055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:27:56.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.976+0000 7f891d7fa700 1 -- 172.21.15.36:0/2796944012 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f891006b5d0 con 0x7f89200b0010 2022-01-10T01:27:56.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.976+0000 7f891ffff700 1 --2- 172.21.15.36:0/2796944012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8900053620 0x7f8900055ae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f891400b000 tx=0x7f8914006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:27:56.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:56.980+0000 7f891d7fa700 1 -- 172.21.15.36:0/2796944012 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f89100425e0 con 0x7f89200b0010 2022-01-10T01:27:57.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:57.140+0000 7f8925525700 1 -- 172.21.15.36:0/2796944012 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89200698e0 con 0x7f89200b0010 2022-01-10T01:27:57.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:57.144+0000 7f891d7fa700 1 -- 172.21.15.36:0/2796944012 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2496 (secure 0 0 0) 0x7f8910045c00 con 0x7f89200b0010 2022-01-10T01:27:57.147 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:27:57.147 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1806166752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1806166752},{"type":"v1","addr":"172.21.15.36:6837","nonce":1806166752}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":35141,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2577386810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2577386810},{"type":"v1","addr":"172.21.15.36:6835","nonce":2577386810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:27:52.591733+0000","modified":"2022-01-10T01:27:53.595043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35150":{"gid":35150,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1363567016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1363567016},{"type":"v1","addr":"172.21.15.59:6833","nonce":1363567016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2022-01-10T01:27:57.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:57.144+0000 7f8925525700 1 -- 172.21.15.36:0/2796944012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8900053620 msgr2=0x7f8900055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:57.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:57.144+0000 7f8925525700 1 --2- 172.21.15.36:0/2796944012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8900053620 0x7f8900055ae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f891400b000 tx=0x7f8914006df0).stop 2022-01-10T01:27:57.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:57.144+0000 7f8925525700 1 -- 172.21.15.36:0/2796944012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89200b0010 msgr2=0x7f89200abc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:27:57.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:57.144+0000 7f8925525700 1 --2- 172.21.15.36:0/2796944012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89200b0010 0x7f89200abc00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f89100018c0 tx=0x7f89100011a0).stop 2022-01-10T01:27:57.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:57.144+0000 7f8925525700 1 -- 172.21.15.36:0/2796944012 shutdown_connections 2022-01-10T01:27:57.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:57.144+0000 7f8925525700 1 --2- 172.21.15.36:0/2796944012 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8900053620 0x7f8900055ae0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:57.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:57.144+0000 7f8925525700 1 --2- 172.21.15.36:0/2796944012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89200b2580 0x7f8920146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:57.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:57.144+0000 7f8925525700 1 --2- 172.21.15.36:0/2796944012 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89200b0010 0x7f89200abc00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:57.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:57.144+0000 7f8925525700 1 --2- 172.21.15.36:0/2796944012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89200a8ac0 0x7f8920063340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:27:57.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:57.144+0000 7f8925525700 1 -- 172.21.15.36:0/2796944012 >> 172.21.15.36:0/2796944012 conn(0x7f8920060180 msgr2=0x7f8920149a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:27:57.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:57.144+0000 7f8925525700 1 -- 172.21.15.36:0/2796944012 shutdown_connections 2022-01-10T01:27:57.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:27:57.144+0000 7f8925525700 1 -- 172.21.15.36:0/2796944012 wait complete. 2022-01-10T01:27:57.152 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 24 2022-01-10T01:27:57.462 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:27:52.591733+0000', 'modified': '2022-01-10T01:27:53.595043+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35150}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35150': {'gid': 35150, 'name': 'b', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/1363567016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1363567016}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 1363567016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:27:57.463 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:27:57.464 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:27:57.580 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":35150,"want_state":"up:active","state":"up:active","rank_uptime":4.976355377,"mdsmap_epoch":24,"osdmap_epoch":56,"osdmap_epoch_barrier":55,"uptime":9.3314652549999995} 2022-01-10T01:27:57.581 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 35150, "mdsmap_epoch": 24, "osdmap_epoch": 56, "osdmap_epoch_barrier": 55, "rank_uptime": 4.976355377, "state": "up:active", "uptime": 9.331465255, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:27:57.581 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:27:57.582 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:27:57.582 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:27:57.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:27:57.583 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:27:57.592 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:27:57.608 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:27:57.609 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:27:57.664 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:27:57.665 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:27:57.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:27:57.667 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:27:57.673 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:27:57.674 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:27:57.676 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:27:57.693 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:27:57.694 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:27:57.748 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:27:57.749 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:27:57.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:27:57.751 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:27:57.752 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:27:57.751+0000 7f4d85c8b080 -1 init, newargv = 0x55b5df755910 newargc=9 2022-01-10T01:27:57.752 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14332]: starting ceph client 2022-01-10T01:27:57.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14332]: starting fuse 2022-01-10T01:27:58.860 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:27:58.879 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:27:58.879 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:27:58.938 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:27:58.938 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:27:58.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:27:58.940 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:27:58.945 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:27:58.945 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:27:58.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:27:58.946 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:27:58.947 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:27:58.947 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:27:58.947 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:27:58.948 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:27:58.948 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:27:58.948 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:27:58.949 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:27:58.949 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:27:58.950 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:27:58.950 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:27:58.950 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:27:58.951 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:27:58.951 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:27:58.952 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:27:58.952 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:27:58.952 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:27:58.953 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:27:58.953 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:27:58.954 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:27:58.954 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:27:58.954 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:27:58.955 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:27:58.999 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.14332.asok 2022-01-10T01:27:59.004 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14332.asok 2022-01-10T01:27:59.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:27:59.005 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14332.asok status 2022-01-10T01:27:59.092 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:27:59.092 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:27:59.093 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:27:59.093 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:27:59.093 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:27:59.093 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:27:59.094 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:27:59.094 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "14332", 2022-01-10T01:27:59.094 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:27:59.094 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:27:59.095 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:27:59.095 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:27:59.095 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 5727, 2022-01-10T01:27:59.095 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:27:59.095 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:27:59.096 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:27:59.096 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 5727 2022-01-10T01:27:59.096 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:27:59.096 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:27:59.097 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:27:59.097 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:27:59.097 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 1668934841 2022-01-10T01:27:59.097 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:27:59.097 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:27:59.098 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:27:59.098 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:27:59.098 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:27:59.098 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 1668934841 2022-01-10T01:27:59.099 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:27:59.099 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.5727 172.21.15.139:0/1668934841", 2022-01-10T01:27:59.099 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/1668934841", 2022-01-10T01:27:59.099 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:27:59.100 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 24, 2022-01-10T01:27:59.100 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 56, 2022-01-10T01:27:59.100 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:27:59.100 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:27:59.100 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:27:59.101 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:27:59.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:27:59.102 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:27:59.103 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:27:59.110 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:27:59.111 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:27:59.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:27:59.112 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:27:59.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:27:59.130 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:27:59.130 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:27:59.137 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:27:59.138 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:27:59.138 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-01-10T01:27:59.139 DEBUG:teuthology.orchestra.run.smithi139:> import sys 2022-01-10T01:27:59.139 DEBUG:teuthology.orchestra.run.smithi139:> import time 2022-01-10T01:27:59.139 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:27:59.140 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:27:59.140 DEBUG:teuthology.orchestra.run.smithi139:> n = 1000 2022-01-10T01:27:59.141 DEBUG:teuthology.orchestra.run.smithi139:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2022-01-10T01:27:59.141 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:27:59.141 DEBUG:teuthology.orchestra.run.smithi139:> if not os.path.exists(os.path.dirname(abs_path)): 2022-01-10T01:27:59.142 DEBUG:teuthology.orchestra.run.smithi139:> os.makedirs(os.path.dirname(abs_path)) 2022-01-10T01:27:59.142 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:27:59.143 DEBUG:teuthology.orchestra.run.smithi139:> for i in range(0, n): 2022-01-10T01:27:59.143 DEBUG:teuthology.orchestra.run.smithi139:> fname = "{0}_{1}".format(abs_path, i) 2022-01-10T01:27:59.143 DEBUG:teuthology.orchestra.run.smithi139:> with open(fname, '"'"'w'"'"') as f: 2022-01-10T01:27:59.144 DEBUG:teuthology.orchestra.run.smithi139:> f.write('"'"'content'"'"') 2022-01-10T01:27:59.144 DEBUG:teuthology.orchestra.run.smithi139:> if True: 2022-01-10T01:27:59.144 DEBUG:teuthology.orchestra.run.smithi139:> f.flush() 2022-01-10T01:27:59.145 DEBUG:teuthology.orchestra.run.smithi139:> os.fsync(f.fileno()) 2022-01-10T01:27:59.145 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:28:01.292 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:28:01.295 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:28:01.298 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:28:01.301 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:28:10.461 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:28:10.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.572+0000 7f22c9ee8700 1 Processor -- start 2022-01-10T01:28:10.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.572+0000 7f22c9ee8700 1 -- start start 2022-01-10T01:28:10.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.572+0000 7f22c9ee8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f22c40b2580 0x7f22c414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:10.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.572+0000 7f22c9ee8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22c40b0010 0x7f22c414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:10.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.572+0000 7f22c9ee8700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c40a70c0 con 0x7f22c40afbd0 2022-01-10T01:28:10.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.572+0000 7f22c9ee8700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c40a72f0 con 0x7f22c40b2580 2022-01-10T01:28:10.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.572+0000 7f22c9ee8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c40a7590 con 0x7f22c40b0010 2022-01-10T01:28:10.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.572+0000 7f22c8ee6700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f22c40b2580 0x7f22c414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:10.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.572+0000 7f22c96e7700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f22c40afbd0 0x7f22c40a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34468/0 (socket says 172.21.15.36:34468) 2022-01-10T01:28:10.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.572+0000 7f22c96e7700 1 -- 172.21.15.36:0/2499864270 learned_addr learned my addr 172.21.15.36:0/2499864270 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:28:10.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.572+0000 7f22c3fff700 1 --2- 172.21.15.36:0/2499864270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22c40b0010 0x7f22c414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:10.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.572+0000 7f22c37fe700 1 -- 172.21.15.36:0/2499864270 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119450675 0 0) 0x7f22c40a70c0 con 0x7f22c40afbd0 2022-01-10T01:28:10.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.572+0000 7f22c37fe700 1 -- 172.21.15.36:0/2499864270 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22b0003260 con 0x7f22c40afbd0 2022-01-10T01:28:10.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c37fe700 1 -- 172.21.15.36:0/2499864270 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4040477595 0 0) 0x7f22b0003260 con 0x7f22c40afbd0 2022-01-10T01:28:10.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c8ee6700 1 -- 172.21.15.36:0/2499864270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22c40b0010 msgr2=0x7f22c414b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:10.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c8ee6700 1 --2- 172.21.15.36:0/2499864270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22c40b0010 0x7f22c414b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:10.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c8ee6700 1 -- 172.21.15.36:0/2499864270 >> v1:172.21.15.36:6789/0 conn(0x7f22c40afbd0 legacy=0x7f22c40a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:10.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c8ee6700 1 -- 172.21.15.36:0/2499864270 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c40a7830 con 0x7f22c40b2580 2022-01-10T01:28:10.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c3fff700 1 --2- 172.21.15.36:0/2499864270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22c40b0010 0x7f22c414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:28:10.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c8ee6700 1 --2- 172.21.15.36:0/2499864270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22c40b2580 0x7f22c414ae40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f22bc001b80 tx=0x7f22b8006df0).ready entity=mon.0 client_cookie=39edc1c3e8e20d60 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:10.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c37fe700 1 -- 172.21.15.36:0/2499864270 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22bc0019e0 con 0x7f22c40b2580 2022-01-10T01:28:10.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c37fe700 1 -- 172.21.15.36:0/2499864270 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b8000e90 con 0x7f22c40b2580 2022-01-10T01:28:10.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c37fe700 1 -- 172.21.15.36:0/2499864270 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22b8012460 con 0x7f22c40b2580 2022-01-10T01:28:10.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c9ee8700 1 -- 172.21.15.36:0/2499864270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22c40b2580 msgr2=0x7f22c414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:10.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c9ee8700 1 --2- 172.21.15.36:0/2499864270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22c40b2580 0x7f22c414ae40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f22bc001b80 tx=0x7f22b8006df0).stop 2022-01-10T01:28:10.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c9ee8700 1 -- 172.21.15.36:0/2499864270 shutdown_connections 2022-01-10T01:28:10.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c9ee8700 1 --2- 172.21.15.36:0/2499864270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22c40b0010 0x7f22c414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:10.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c9ee8700 1 --2- 172.21.15.36:0/2499864270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22c40b2580 0x7f22c414ae40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:10.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c9ee8700 1 -- 172.21.15.36:0/2499864270 >> 172.21.15.36:0/2499864270 conn(0x7f22c4060180 msgr2=0x7f22c40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:10.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c9ee8700 1 -- 172.21.15.36:0/2499864270 shutdown_connections 2022-01-10T01:28:10.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c9ee8700 1 -- 172.21.15.36:0/2499864270 wait complete. 2022-01-10T01:28:10.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c9ee8700 1 Processor -- start 2022-01-10T01:28:10.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.576+0000 7f22c9ee8700 1 -- start start 2022-01-10T01:28:10.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c9ee8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22c40afbd0 0x7f22c40b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:10.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c9ee8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22c40b0010 0x7f22c40b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:10.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c9ee8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22c40b2580 0x7f22c414cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:10.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c9ee8700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c40b4680 con 0x7f22c40b2580 2022-01-10T01:28:10.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c9ee8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c40ac120 con 0x7f22c40b0010 2022-01-10T01:28:10.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c9ee8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4144230 con 0x7f22c40afbd0 2022-01-10T01:28:10.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c96e7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22c40b2580 0x7f22c414cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:10.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c96e7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22c40b2580 0x7f22c414cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36678/0 (socket says 172.21.15.36:36678) 2022-01-10T01:28:10.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c96e7700 1 -- 172.21.15.36:0/1382055204 learned_addr learned my addr 172.21.15.36:0/1382055204 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:10.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c8ee6700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22c40afbd0 0x7f22c40b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:10.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c3fff700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22c40b0010 0x7f22c40b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:10.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c96e7700 1 -- 172.21.15.36:0/1382055204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22c40afbd0 msgr2=0x7f22c40b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:10.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c96e7700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22c40afbd0 0x7f22c40b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:10.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c96e7700 1 -- 172.21.15.36:0/1382055204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22c40b0010 msgr2=0x7f22c40b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:10.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c96e7700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22c40b0010 0x7f22c40b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:10.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c96e7700 1 -- 172.21.15.36:0/1382055204 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b400b180 con 0x7f22c40b2580 2022-01-10T01:28:10.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c3fff700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22c40b0010 0x7f22c40b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:28:10.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c96e7700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22c40b2580 0x7f22c414cfd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f22bc001c40 tx=0x7f22bc00caf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:10.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c1ffb700 1 -- 172.21.15.36:0/1382055204 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22bc004ab0 con 0x7f22c40b2580 2022-01-10T01:28:10.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c1ffb700 1 -- 172.21.15.36:0/1382055204 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc004c10 con 0x7f22c40b2580 2022-01-10T01:28:10.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c9ee8700 1 -- 172.21.15.36:0/1382055204 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b800b180 con 0x7f22c40b2580 2022-01-10T01:28:10.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c1ffb700 1 -- 172.21.15.36:0/1382055204 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22bc007170 con 0x7f22c40b2580 2022-01-10T01:28:10.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c9ee8700 1 -- 172.21.15.36:0/1382055204 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c40ac380 con 0x7f22c40b2580 2022-01-10T01:28:10.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.580+0000 7f22c9ee8700 1 -- 172.21.15.36:0/1382055204 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c40ac540 con 0x7f22c40b2580 2022-01-10T01:28:10.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.584+0000 7f22c1ffb700 1 -- 172.21.15.36:0/1382055204 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f22bc01b060 con 0x7f22c40b2580 2022-01-10T01:28:10.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.584+0000 7f22c1ffb700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f22a40535f0 0x7f22a4055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:10.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.584+0000 7f22c1ffb700 1 -- 172.21.15.36:0/1382055204 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f22bc06b840 con 0x7f22c40b2580 2022-01-10T01:28:10.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.584+0000 7f22c8ee6700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f22a40535f0 0x7f22a4055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:10.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.584+0000 7f22c8ee6700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f22a40535f0 0x7f22a4055ab0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f22b801a000 tx=0x7f22b8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:10.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.592+0000 7f22c1ffb700 1 -- 172.21.15.36:0/1382055204 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f22bc042740 con 0x7f22c40b2580 2022-01-10T01:28:10.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.752+0000 7f22c9ee8700 1 -- 172.21.15.36:0/1382055204 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22c4057350 con 0x7f22c40b2580 2022-01-10T01:28:10.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.752+0000 7f22c1ffb700 1 -- 172.21.15.36:0/1382055204 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2496 (secure 0 0 0) 0x7f22bc019030 con 0x7f22c40b2580 2022-01-10T01:28:10.758 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:28:10.759 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1806166752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1806166752},{"type":"v1","addr":"172.21.15.36:6837","nonce":1806166752}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":35141,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2577386810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2577386810},{"type":"v1","addr":"172.21.15.36:6835","nonce":2577386810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:27:52.591733+0000","modified":"2022-01-10T01:27:53.595043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35150":{"gid":35150,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1363567016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1363567016},{"type":"v1","addr":"172.21.15.59:6833","nonce":1363567016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2022-01-10T01:28:10.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.756+0000 7f22c9ee8700 1 -- 172.21.15.36:0/1382055204 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f22a40535f0 msgr2=0x7f22a4055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:10.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.756+0000 7f22c9ee8700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f22a40535f0 0x7f22a4055ab0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f22b801a000 tx=0x7f22b8014000).stop 2022-01-10T01:28:10.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.756+0000 7f22c9ee8700 1 -- 172.21.15.36:0/1382055204 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22c40b2580 msgr2=0x7f22c414cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:10.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.756+0000 7f22c9ee8700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22c40b2580 0x7f22c414cfd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f22bc001c40 tx=0x7f22bc00caf0).stop 2022-01-10T01:28:10.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.756+0000 7f22c9ee8700 1 -- 172.21.15.36:0/1382055204 shutdown_connections 2022-01-10T01:28:10.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.756+0000 7f22c9ee8700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f22a40535f0 0x7f22a4055ab0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:10.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.756+0000 7f22c9ee8700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22c40b2580 0x7f22c414cfd0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:10.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.756+0000 7f22c9ee8700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22c40b0010 0x7f22c40b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:10.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.756+0000 7f22c9ee8700 1 --2- 172.21.15.36:0/1382055204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22c40afbd0 0x7f22c40b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:10.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.756+0000 7f22c9ee8700 1 -- 172.21.15.36:0/1382055204 >> 172.21.15.36:0/1382055204 conn(0x7f22c4060180 msgr2=0x7f22c41448f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:10.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.756+0000 7f22c9ee8700 1 -- 172.21.15.36:0/1382055204 shutdown_connections 2022-01-10T01:28:10.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.756+0000 7f22c9ee8700 1 -- 172.21.15.36:0/1382055204 wait complete. 2022-01-10T01:28:10.763 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 24 2022-01-10T01:28:10.771 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_recall_max_caps 20 2022-01-10T01:28:10.878 INFO:teuthology.orchestra.run.smithi059.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2022-01-10T01:28:10.879 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2022-01-10T01:28:10.879 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:28:10.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92229be700 1 Processor -- start 2022-01-10T01:28:10.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92229be700 1 -- start start 2022-01-10T01:28:10.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92229be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f921c061320 0x7f921c061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:10.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92229be700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f921c0ad5c0 0x7f921c0b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:10.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92229be700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f921c140440 0x7f921c1408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:10.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92229be700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921c0aecf0 con 0x7f921c140440 2022-01-10T01:28:10.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92229be700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921c0b6f20 con 0x7f921c0ad5c0 2022-01-10T01:28:10.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92229be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c0aef20 con 0x7f921c061320 2022-01-10T01:28:10.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92221bd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f921c140440 0x7f921c1408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:10.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92219bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f921c061320 0x7f921c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:10.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92221bd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f921c140440 0x7f921c1408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36688/0 (socket says 172.21.15.36:36688) 2022-01-10T01:28:10.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92221bd700 1 -- 172.21.15.36:0/397384229 learned_addr learned my addr 172.21.15.36:0/397384229 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:10.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92211bb700 1 --2- 172.21.15.36:0/397384229 >> v2:172.21.15.59:3300/0 conn(0x7f921c0ad5c0 0x7f921c0b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:10.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92219bc700 1 -- 172.21.15.36:0/397384229 >> v2:172.21.15.59:3300/0 conn(0x7f921c0ad5c0 msgr2=0x7f921c0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:10.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92219bc700 1 --2- 172.21.15.36:0/397384229 >> v2:172.21.15.59:3300/0 conn(0x7f921c0ad5c0 0x7f921c0b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:10.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92219bc700 1 -- 172.21.15.36:0/397384229 >> v2:172.21.15.36:3300/0 conn(0x7f921c140440 msgr2=0x7f921c1408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:10.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92219bc700 1 --2- 172.21.15.36:0/397384229 >> v2:172.21.15.36:3300/0 conn(0x7f921c140440 0x7f921c1408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:10.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92219bc700 1 -- 172.21.15.36:0/397384229 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0af1c0 con 0x7f921c061320 2022-01-10T01:28:10.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92221bd700 1 --2- 172.21.15.36:0/397384229 >> v2:172.21.15.36:3300/0 conn(0x7f921c140440 0x7f921c1408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:28:10.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92211bb700 1 --2- 172.21.15.36:0/397384229 >> v2:172.21.15.59:3300/0 conn(0x7f921c0ad5c0 0x7f921c0b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:28:10.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92219bc700 1 --2- 172.21.15.36:0/397384229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f921c061320 0x7f921c061700 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9218002f70 tx=0x7f9218006df0).ready entity=mon.2 client_cookie=47ccf39121e2eb29 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:11.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92209ba700 1 -- 172.21.15.36:0/397384229 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f921800d4a0 con 0x7f921c061320 2022-01-10T01:28:11.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92209ba700 1 -- 172.21.15.36:0/397384229 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9218000e90 con 0x7f921c061320 2022-01-10T01:28:11.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.988+0000 7f92209ba700 1 -- 172.21.15.36:0/397384229 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f921800d7f0 con 0x7f921c061320 2022-01-10T01:28:11.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.992+0000 7f92229be700 1 -- 172.21.15.36:0/397384229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f921c061320 msgr2=0x7f921c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:11.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.992+0000 7f92229be700 1 --2- 172.21.15.36:0/397384229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f921c061320 0x7f921c061700 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9218002f70 tx=0x7f9218006df0).stop 2022-01-10T01:28:11.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.992+0000 7f92229be700 1 -- 172.21.15.36:0/397384229 shutdown_connections 2022-01-10T01:28:11.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.992+0000 7f92229be700 1 --2- 172.21.15.36:0/397384229 >> v2:172.21.15.36:3300/0 conn(0x7f921c140440 0x7f921c1408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.992+0000 7f92229be700 1 --2- 172.21.15.36:0/397384229 >> v2:172.21.15.59:3300/0 conn(0x7f921c0ad5c0 0x7f921c0b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.992+0000 7f92229be700 1 --2- 172.21.15.36:0/397384229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f921c061320 0x7f921c061700 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.992+0000 7f92229be700 1 -- 172.21.15.36:0/397384229 >> 172.21.15.36:0/397384229 conn(0x7f921c066de0 msgr2=0x7f921c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:11.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.992+0000 7f92229be700 1 -- 172.21.15.36:0/397384229 shutdown_connections 2022-01-10T01:28:11.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.992+0000 7f92229be700 1 -- 172.21.15.36:0/397384229 wait complete. 2022-01-10T01:28:11.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.992+0000 7f92229be700 1 Processor -- start 2022-01-10T01:28:11.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.992+0000 7f92229be700 1 -- start start 2022-01-10T01:28:11.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92229be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f921c061320 0x7f921c0b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:11.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92229be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f921c0ad5c0 0x7f921c155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:11.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92229be700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f921c140440 0x7f921c156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:11.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92229be700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c0b0f90 con 0x7f921c140440 2022-01-10T01:28:11.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92229be700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c1558c0 con 0x7f921c061320 2022-01-10T01:28:11.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92229be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c09f2c0 con 0x7f921c0ad5c0 2022-01-10T01:28:11.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92221bd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f921c140440 0x7f921c156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:11.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92221bd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f921c140440 0x7f921c156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36694/0 (socket says 172.21.15.36:36694) 2022-01-10T01:28:11.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92219bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f921c061320 0x7f921c0b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:11.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92221bd700 1 -- 172.21.15.36:0/3935729039 learned_addr learned my addr 172.21.15.36:0/3935729039 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:11.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92211bb700 1 --2- 172.21.15.36:0/3935729039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f921c0ad5c0 0x7f921c155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:11.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92221bd700 1 -- 172.21.15.36:0/3935729039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f921c0ad5c0 msgr2=0x7f921c155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:11.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92221bd700 1 --2- 172.21.15.36:0/3935729039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f921c0ad5c0 0x7f921c155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92221bd700 1 -- 172.21.15.36:0/3935729039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f921c061320 msgr2=0x7f921c0b8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:11.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92221bd700 1 --2- 172.21.15.36:0/3935729039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f921c061320 0x7f921c0b8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92221bd700 1 -- 172.21.15.36:0/3935729039 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c00b180 con 0x7f921c140440 2022-01-10T01:28:11.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92221bd700 1 --2- 172.21.15.36:0/3935729039 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f921c140440 0x7f921c156250 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f9214006ec0 tx=0x7f9214009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:11.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f920affd700 1 -- 172.21.15.36:0/3935729039 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f921400c850 con 0x7f921c140440 2022-01-10T01:28:11.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f920affd700 1 -- 172.21.15.36:0/3935729039 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921400c9b0 con 0x7f921c140440 2022-01-10T01:28:11.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92229be700 1 -- 172.21.15.36:0/3935729039 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9214009530 con 0x7f921c140440 2022-01-10T01:28:11.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f920affd700 1 -- 172.21.15.36:0/3935729039 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f921400cd10 con 0x7f921c140440 2022-01-10T01:28:11.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92229be700 1 -- 172.21.15.36:0/3935729039 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921800b180 con 0x7f921c140440 2022-01-10T01:28:11.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:10.996+0000 7f92229be700 1 -- 172.21.15.36:0/3935729039 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921c0b0490 con 0x7f921c140440 2022-01-10T01:28:11.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.000+0000 7f920affd700 1 -- 172.21.15.36:0/3935729039 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9214022070 con 0x7f921c140440 2022-01-10T01:28:11.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.000+0000 7f920affd700 1 --2- 172.21.15.36:0/3935729039 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91fc0534d0 0x7f91fc055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:11.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.000+0000 7f920affd700 1 -- 172.21.15.36:0/3935729039 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f921406c2f0 con 0x7f921c140440 2022-01-10T01:28:11.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.000+0000 7f92219bc700 1 --2- 172.21.15.36:0/3935729039 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91fc0534d0 0x7f91fc055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:11.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.000+0000 7f92219bc700 1 --2- 172.21.15.36:0/3935729039 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91fc0534d0 0x7f91fc055990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f921801a000 tx=0x7f9218014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:11.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.008+0000 7f920affd700 1 -- 172.21.15.36:0/3935729039 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f92140431f0 con 0x7f921c140440 2022-01-10T01:28:11.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.168+0000 7f92229be700 1 -- 172.21.15.36:0/3935729039 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f921c155a80 con 0x7f921c140440 2022-01-10T01:28:11.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.168+0000 7f920affd700 1 -- 172.21.15.36:0/3935729039 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2496 (secure 0 0 0) 0x7f9214016020 con 0x7f921c140440 2022-01-10T01:28:11.173 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:28:11.174 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1806166752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1806166752},{"type":"v1","addr":"172.21.15.36:6837","nonce":1806166752}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":35141,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2577386810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2577386810},{"type":"v1","addr":"172.21.15.36:6835","nonce":2577386810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:27:52.591733+0000","modified":"2022-01-10T01:27:53.595043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35150":{"gid":35150,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1363567016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1363567016},{"type":"v1","addr":"172.21.15.59:6833","nonce":1363567016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2022-01-10T01:28:11.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.172+0000 7f92229be700 1 -- 172.21.15.36:0/3935729039 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91fc0534d0 msgr2=0x7f91fc055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:11.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.172+0000 7f92229be700 1 --2- 172.21.15.36:0/3935729039 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91fc0534d0 0x7f91fc055990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f921801a000 tx=0x7f9218014000).stop 2022-01-10T01:28:11.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.172+0000 7f92229be700 1 -- 172.21.15.36:0/3935729039 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f921c140440 msgr2=0x7f921c156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:11.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.172+0000 7f92229be700 1 --2- 172.21.15.36:0/3935729039 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f921c140440 0x7f921c156250 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f9214006ec0 tx=0x7f9214009290).stop 2022-01-10T01:28:11.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.172+0000 7f92229be700 1 -- 172.21.15.36:0/3935729039 shutdown_connections 2022-01-10T01:28:11.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.172+0000 7f92229be700 1 --2- 172.21.15.36:0/3935729039 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91fc0534d0 0x7f91fc055990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.172+0000 7f92229be700 1 --2- 172.21.15.36:0/3935729039 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f921c140440 0x7f921c156250 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.172+0000 7f92229be700 1 --2- 172.21.15.36:0/3935729039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f921c0ad5c0 0x7f921c155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.172+0000 7f92229be700 1 --2- 172.21.15.36:0/3935729039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f921c061320 0x7f921c0b8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.172+0000 7f92229be700 1 -- 172.21.15.36:0/3935729039 >> 172.21.15.36:0/3935729039 conn(0x7f921c066de0 msgr2=0x7f921c0b5390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:11.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.172+0000 7f92229be700 1 -- 172.21.15.36:0/3935729039 shutdown_connections 2022-01-10T01:28:11.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.172+0000 7f92229be700 1 -- 172.21.15.36:0/3935729039 wait complete. 2022-01-10T01:28:11.178 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 24 2022-01-10T01:28:11.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_recall_max_decay_threshold 400 2022-01-10T01:28:11.302 INFO:teuthology.orchestra.run.smithi059.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2022-01-10T01:28:11.303 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2022-01-10T01:28:11.303 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:28:11.322 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:28:11.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.424+0000 7fa06491f700 1 Processor -- start 2022-01-10T01:28:11.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.424+0000 7fa06491f700 1 -- start start 2022-01-10T01:28:11.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa06491f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0600b6290 0x7fa060061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:11.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa06491f700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0600b5f50 con 0x7fa0600b4060 2022-01-10T01:28:11.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa06491f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0600b1f70 con 0x7fa060142e60 2022-01-10T01:28:11.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa06491f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0600b2210 con 0x7fa0600b6290 2022-01-10T01:28:11.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa05e59c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa0600b4060 0x7fa060061960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34492/0 (socket says 172.21.15.36:34492) 2022-01-10T01:28:11.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa05e59c700 1 -- 172.21.15.36:0/2969203594 learned_addr learned my addr 172.21.15.36:0/2969203594 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:28:11.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa05ed9d700 1 --2- 172.21.15.36:0/2969203594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0600b6290 0x7fa060061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:11.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa05dd9b700 1 -- 172.21.15.36:0/2969203594 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495464622 0 0) 0x7fa048001110 con 0x7fa0600b4060 2022-01-10T01:28:11.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa05dd9b700 1 -- 172.21.15.36:0/2969203594 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa040003260 con 0x7fa0600b4060 2022-01-10T01:28:11.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa05dd9b700 1 -- 172.21.15.36:0/2969203594 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168363927 0 0) 0x7fa0600b1f70 con 0x7fa060142e60 2022-01-10T01:28:11.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa05dd9b700 1 -- 172.21.15.36:0/2969203594 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa048001110 con 0x7fa060142e60 2022-01-10T01:28:11.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa05ed9d700 1 -- 172.21.15.36:0/2969203594 >> v1:172.21.15.59:6789/0 conn(0x7fa060142e60 legacy=0x7fa060143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:11.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa05ed9d700 1 -- 172.21.15.36:0/2969203594 >> v1:172.21.15.36:6789/0 conn(0x7fa0600b4060 legacy=0x7fa060061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:11.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa05ed9d700 1 -- 172.21.15.36:0/2969203594 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0600b24b0 con 0x7fa0600b6290 2022-01-10T01:28:11.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa05ed9d700 1 --2- 172.21.15.36:0/2969203594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0600b6290 0x7fa060061470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa050002f70 tx=0x7fa050006df0).ready entity=mon.2 client_cookie=30006dcf9851a104 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:11.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa05dd9b700 1 -- 172.21.15.36:0/2969203594 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa05000d5c0 con 0x7fa0600b6290 2022-01-10T01:28:11.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa05dd9b700 1 -- 172.21.15.36:0/2969203594 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa050000e90 con 0x7fa0600b6290 2022-01-10T01:28:11.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa05dd9b700 1 -- 172.21.15.36:0/2969203594 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa05000d910 con 0x7fa0600b6290 2022-01-10T01:28:11.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa06491f700 1 -- 172.21.15.36:0/2969203594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0600b6290 msgr2=0x7fa060061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:11.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa06491f700 1 --2- 172.21.15.36:0/2969203594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0600b6290 0x7fa060061470 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fa050002f70 tx=0x7fa050006df0).stop 2022-01-10T01:28:11.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa06491f700 1 -- 172.21.15.36:0/2969203594 shutdown_connections 2022-01-10T01:28:11.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa06491f700 1 --2- 172.21.15.36:0/2969203594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0600b6290 0x7fa060061470 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa06491f700 1 -- 172.21.15.36:0/2969203594 >> 172.21.15.36:0/2969203594 conn(0x7fa06005c490 msgr2=0x7fa06005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:11.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa06491f700 1 -- 172.21.15.36:0/2969203594 shutdown_connections 2022-01-10T01:28:11.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.428+0000 7fa06491f700 1 -- 172.21.15.36:0/2969203594 wait complete. 2022-01-10T01:28:11.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa06491f700 1 Processor -- start 2022-01-10T01:28:11.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa06491f700 1 -- start start 2022-01-10T01:28:11.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa06491f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa0600b4060 0x7fa0600b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:11.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa06491f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0600b6290 0x7fa0600b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:11.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa06491f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa060142e60 0x7fa0600ad870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:11.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa06491f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa060152670 con 0x7fa0600b4060 2022-01-10T01:28:11.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa06491f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa060152860 con 0x7fa060142e60 2022-01-10T01:28:11.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa06491f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa060152b00 con 0x7fa0600b6290 2022-01-10T01:28:11.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa05ed9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa0600b4060 0x7fa0600b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:11.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa05e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0600b6290 0x7fa0600b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:11.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa05f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa060142e60 0x7fa0600ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:11.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa05ed9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa0600b4060 0x7fa0600b0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36708/0 (socket says 172.21.15.36:36708) 2022-01-10T01:28:11.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa05ed9d700 1 -- 172.21.15.36:0/2199301649 learned_addr learned my addr 172.21.15.36:0/2199301649 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:11.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa05ed9d700 1 -- 172.21.15.36:0/2199301649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0600b6290 msgr2=0x7fa0600b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:11.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa05ed9d700 1 --2- 172.21.15.36:0/2199301649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0600b6290 0x7fa0600b0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa05ed9d700 1 -- 172.21.15.36:0/2199301649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa060142e60 msgr2=0x7fa0600ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:11.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa05ed9d700 1 --2- 172.21.15.36:0/2199301649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa060142e60 0x7fa0600ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa05ed9d700 1 -- 172.21.15.36:0/2199301649 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05000b180 con 0x7fa0600b4060 2022-01-10T01:28:11.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa05f59e700 1 --2- 172.21.15.36:0/2199301649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa060142e60 0x7fa0600ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:28:11.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa05ed9d700 1 --2- 172.21.15.36:0/2199301649 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa0600b4060 0x7fa0600b0160 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fa050002f70 tx=0x7fa050014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:11.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa057fff700 1 -- 172.21.15.36:0/2199301649 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa050016070 con 0x7fa0600b4060 2022-01-10T01:28:11.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa057fff700 1 -- 172.21.15.36:0/2199301649 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0500137d0 con 0x7fa0600b4060 2022-01-10T01:28:11.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa057fff700 1 -- 172.21.15.36:0/2199301649 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa050013b30 con 0x7fa0600b4060 2022-01-10T01:28:11.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa06491f700 1 -- 172.21.15.36:0/2199301649 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa060152da0 con 0x7fa0600b4060 2022-01-10T01:28:11.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.432+0000 7fa06491f700 1 -- 172.21.15.36:0/2199301649 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0601502b0 con 0x7fa0600b4060 2022-01-10T01:28:11.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.436+0000 7fa06491f700 1 -- 172.21.15.36:0/2199301649 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0600b0b40 con 0x7fa0600b4060 2022-01-10T01:28:11.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.436+0000 7fa057fff700 1 -- 172.21.15.36:0/2199301649 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa05000f030 con 0x7fa0600b4060 2022-01-10T01:28:11.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.436+0000 7fa057fff700 1 --2- 172.21.15.36:0/2199301649 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa044053590 0x7fa044055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:11.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.436+0000 7fa057fff700 1 -- 172.21.15.36:0/2199301649 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa05006c710 con 0x7fa0600b4060 2022-01-10T01:28:11.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.436+0000 7fa05e59c700 1 --2- 172.21.15.36:0/2199301649 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa044053590 0x7fa044055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:11.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.436+0000 7fa05e59c700 1 --2- 172.21.15.36:0/2199301649 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa044053590 0x7fa044055a50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fa04800d000 tx=0x7fa048009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:11.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.440+0000 7fa057fff700 1 -- 172.21.15.36:0/2199301649 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa050043610 con 0x7fa0600b4060 2022-01-10T01:28:11.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.600+0000 7fa06491f700 1 -- 172.21.15.36:0/2199301649 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0600b2750 con 0x7fa0600b4060 2022-01-10T01:28:11.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.604+0000 7fa057fff700 1 -- 172.21.15.36:0/2199301649 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2496 (secure 0 0 0) 0x7fa050023020 con 0x7fa0600b4060 2022-01-10T01:28:11.607 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:28:11.607 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1806166752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1806166752},{"type":"v1","addr":"172.21.15.36:6837","nonce":1806166752}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":35141,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2577386810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2577386810},{"type":"v1","addr":"172.21.15.36:6835","nonce":2577386810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:27:52.591733+0000","modified":"2022-01-10T01:27:53.595043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35150":{"gid":35150,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1363567016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1363567016},{"type":"v1","addr":"172.21.15.59:6833","nonce":1363567016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2022-01-10T01:28:11.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.604+0000 7fa06491f700 1 -- 172.21.15.36:0/2199301649 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa044053590 msgr2=0x7fa044055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:11.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.604+0000 7fa06491f700 1 --2- 172.21.15.36:0/2199301649 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa044053590 0x7fa044055a50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fa04800d000 tx=0x7fa048009040).stop 2022-01-10T01:28:11.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.604+0000 7fa06491f700 1 -- 172.21.15.36:0/2199301649 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa0600b4060 msgr2=0x7fa0600b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:11.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.604+0000 7fa06491f700 1 --2- 172.21.15.36:0/2199301649 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa0600b4060 0x7fa0600b0160 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7fa050002f70 tx=0x7fa050014000).stop 2022-01-10T01:28:11.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.604+0000 7fa06491f700 1 -- 172.21.15.36:0/2199301649 shutdown_connections 2022-01-10T01:28:11.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.604+0000 7fa06491f700 1 --2- 172.21.15.36:0/2199301649 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa044053590 0x7fa044055a50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.604+0000 7fa06491f700 1 --2- 172.21.15.36:0/2199301649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa060142e60 0x7fa0600ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.604+0000 7fa06491f700 1 --2- 172.21.15.36:0/2199301649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0600b6290 0x7fa0600b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.604+0000 7fa06491f700 1 --2- 172.21.15.36:0/2199301649 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa0600b4060 0x7fa0600b0160 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:11.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.604+0000 7fa06491f700 1 -- 172.21.15.36:0/2199301649 >> 172.21.15.36:0/2199301649 conn(0x7fa06005c490 msgr2=0x7fa060140d00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:11.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.604+0000 7fa06491f700 1 -- 172.21.15.36:0/2199301649 shutdown_connections 2022-01-10T01:28:11.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.604+0000 7fa06491f700 1 -- 172.21.15.36:0/2199301649 wait complete. 2022-01-10T01:28:11.612 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 24 2022-01-10T01:28:11.619 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b cache drop 5 2022-01-10T01:28:11.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.720+0000 7f3c788c2700 1 Processor -- start 2022-01-10T01:28:12.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.720+0000 7f3c788c2700 1 -- start start 2022-01-10T01:28:12.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.720+0000 7f3c788c2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c740b2850 0x7f3c740b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.720+0000 7f3c788c2700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c740b2c30 con 0x7f3c7413c6e0 2022-01-10T01:28:12.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.720+0000 7f3c788c2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c740b1660 con 0x7f3c740acf20 2022-01-10T01:28:12.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.720+0000 7f3c788c2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c7413d230 con 0x7f3c740b2850 2022-01-10T01:28:12.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.720+0000 7f3c6affd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f3c7413c6e0 0x7f3c7413cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34506/0 (socket says 172.21.15.36:34506) 2022-01-10T01:28:12.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c6affd700 1 -- 172.21.15.36:0/2939464663 learned_addr learned my addr 172.21.15.36:0/2939464663 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:28:12.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c737fe700 1 --2- 172.21.15.36:0/2939464663 >> v2:172.21.15.59:3300/0 conn(0x7f3c740b2850 0x7f3c740b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 -- 172.21.15.36:0/2939464663 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560942748 0 0) 0x7f3c740b2c30 con 0x7f3c7413c6e0 2022-01-10T01:28:12.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 -- 172.21.15.36:0/2939464663 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c54003260 con 0x7f3c7413c6e0 2022-01-10T01:28:12.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 -- 172.21.15.36:0/2939464663 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2318329221 0 0) 0x7f3c54003260 con 0x7f3c7413c6e0 2022-01-10T01:28:12.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 -- 172.21.15.36:0/2939464663 >> v2:172.21.15.59:3300/0 conn(0x7f3c740b2850 msgr2=0x7f3c740b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:12.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 --2- 172.21.15.36:0/2939464663 >> v2:172.21.15.59:3300/0 conn(0x7f3c740b2850 0x7f3c740b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 -- 172.21.15.36:0/2939464663 >> v1:172.21.15.59:6789/0 conn(0x7f3c740acf20 legacy=0x7f3c740ad340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:12.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 -- 172.21.15.36:0/2939464663 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c740b1900 con 0x7f3c7413c6e0 2022-01-10T01:28:12.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 -- 172.21.15.36:0/2939464663 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f3c5c001680 con 0x7f3c7413c6e0 2022-01-10T01:28:12.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c737fe700 1 --2- 172.21.15.36:0/2939464663 >> v2:172.21.15.59:3300/0 conn(0x7f3c740b2850 0x7f3c740b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:28:12.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 -- 172.21.15.36:0/2939464663 >> v1:172.21.15.36:6789/0 conn(0x7f3c7413c6e0 legacy=0x7f3c7413cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:12.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 --2- 172.21.15.36:0/2939464663 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c54003750 0x7f3c54003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 --2- 172.21.15.36:0/2939464663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c54004500 0x7f3c54004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 --2- 172.21.15.36:0/2939464663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c54004ec0 0x7f3c5400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 -- 172.21.15.36:0/2939464663 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7413d230 con 0x7f3c54003750 2022-01-10T01:28:12.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 -- 172.21.15.36:0/2939464663 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5400bda0 con 0x7f3c54004ec0 2022-01-10T01:28:12.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 -- 172.21.15.36:0/2939464663 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5400bf60 con 0x7f3c54004500 2022-01-10T01:28:12.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c737fe700 1 --2- 172.21.15.36:0/2939464663 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c54003750 0x7f3c54003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c6affd700 1 --2- 172.21.15.36:0/2939464663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c54004500 0x7f3c54004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c73fff700 1 --2- 172.21.15.36:0/2939464663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c54004ec0 0x7f3c5400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c737fe700 1 -- 172.21.15.36:0/2939464663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c54004500 msgr2=0x7f3c54004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:12.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c737fe700 1 --2- 172.21.15.36:0/2939464663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c54004500 0x7f3c54004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c737fe700 1 -- 172.21.15.36:0/2939464663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c54004ec0 msgr2=0x7f3c5400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:12.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c737fe700 1 --2- 172.21.15.36:0/2939464663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c54004ec0 0x7f3c5400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c73fff700 1 -- 172.21.15.36:0/2939464663 reap_dead start 2022-01-10T01:28:12.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c737fe700 1 -- 172.21.15.36:0/2939464663 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c54003260 con 0x7f3c54003750 2022-01-10T01:28:12.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c737fe700 1 --2- 172.21.15.36:0/2939464663 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c54003750 0x7f3c54003b70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f3c6400a000 tx=0x7f3c64008040).ready entity=mon.0 client_cookie=fec6dbc767f675a4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:12.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 -- 172.21.15.36:0/2939464663 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c64012610 con 0x7f3c54003750 2022-01-10T01:28:12.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 -- 172.21.15.36:0/2939464663 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c64012770 con 0x7f3c54003750 2022-01-10T01:28:12.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c72ffd700 1 -- 172.21.15.36:0/2939464663 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c64012ad0 con 0x7f3c54003750 2022-01-10T01:28:12.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c788c2700 1 -- 172.21.15.36:0/2939464663 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c54003750 msgr2=0x7f3c54003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:12.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c788c2700 1 --2- 172.21.15.36:0/2939464663 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c54003750 0x7f3c54003b70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f3c6400a000 tx=0x7f3c64008040).stop 2022-01-10T01:28:12.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c788c2700 1 -- 172.21.15.36:0/2939464663 shutdown_connections 2022-01-10T01:28:12.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c788c2700 1 --2- 172.21.15.36:0/2939464663 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c54003750 0x7f3c54003b70 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c788c2700 1 -- 172.21.15.36:0/2939464663 >> 172.21.15.36:0/2939464663 conn(0x7f3c74061230 msgr2=0x7f3c74062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:12.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c788c2700 1 -- 172.21.15.36:0/2939464663 shutdown_connections 2022-01-10T01:28:12.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.724+0000 7f3c788c2700 1 -- 172.21.15.36:0/2939464663 wait complete. 2022-01-10T01:28:12.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c788c2700 1 Processor -- start 2022-01-10T01:28:12.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c788c2700 1 -- start start 2022-01-10T01:28:12.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c788c2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c54003750 0x7f3c740b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c788c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c74140b40 0x7f3c74140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c788c2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c74155aa0 0x7f3c74155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c788c2700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c74141490 con 0x7f3c74155aa0 2022-01-10T01:28:12.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c788c2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c74141850 con 0x7f3c54003750 2022-01-10T01:28:12.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c788c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7412db70 con 0x7f3c74140b40 2022-01-10T01:28:12.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c73fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c74155aa0 0x7f3c74155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c73fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c74155aa0 0x7f3c74155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36726/0 (socket says 172.21.15.36:36726) 2022-01-10T01:28:12.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c73fff700 1 -- 172.21.15.36:0/3650219475 learned_addr learned my addr 172.21.15.36:0/3650219475 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:12.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c737fe700 1 --2- 172.21.15.36:0/3650219475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c54003750 0x7f3c740b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c6affd700 1 --2- 172.21.15.36:0/3650219475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c74140b40 0x7f3c74140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c73fff700 1 -- 172.21.15.36:0/3650219475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c74140b40 msgr2=0x7f3c74140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:12.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c73fff700 1 --2- 172.21.15.36:0/3650219475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c74140b40 0x7f3c74140fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c73fff700 1 -- 172.21.15.36:0/3650219475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c54003750 msgr2=0x7f3c740b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:12.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c73fff700 1 --2- 172.21.15.36:0/3650219475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c54003750 0x7f3c740b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c73fff700 1 -- 172.21.15.36:0/3650219475 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c74142260 con 0x7f3c74155aa0 2022-01-10T01:28:12.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c73fff700 1 --2- 172.21.15.36:0/3650219475 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c74155aa0 0x7f3c74155f20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f3c5c001450 tx=0x7f3c6c009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:12.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c717fa700 1 -- 172.21.15.36:0/3650219475 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c6c003220 con 0x7f3c74155aa0 2022-01-10T01:28:12.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c717fa700 1 -- 172.21.15.36:0/3650219475 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c003380 con 0x7f3c74155aa0 2022-01-10T01:28:12.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c788c2700 1 -- 172.21.15.36:0/3650219475 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c741406a0 con 0x7f3c74155aa0 2022-01-10T01:28:12.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c717fa700 1 -- 172.21.15.36:0/3650219475 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c6c001770 con 0x7f3c74155aa0 2022-01-10T01:28:12.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.728+0000 7f3c788c2700 1 -- 172.21.15.36:0/3650219475 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c740b5190 con 0x7f3c74155aa0 2022-01-10T01:28:12.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.732+0000 7f3c717fa700 1 -- 172.21.15.36:0/3650219475 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3c6c01c060 con 0x7f3c74155aa0 2022-01-10T01:28:12.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.732+0000 7f3c717fa700 1 --2- 172.21.15.36:0/3650219475 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c58053500 0x7f3c580559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.732+0000 7f3c717fa700 1 -- 172.21.15.36:0/3650219475 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3c6c06b580 con 0x7f3c74155aa0 2022-01-10T01:28:12.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.732+0000 7f3c737fe700 1 --2- 172.21.15.36:0/3650219475 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c58053500 0x7f3c580559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.732+0000 7f3c737fe700 1 --2- 172.21.15.36:0/3650219475 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c58053500 0x7f3c580559c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f3c6401a000 tx=0x7f3c64008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:12.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.732+0000 7f3c83d67740 1 Processor -- start 2022-01-10T01:28:12.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.732+0000 7f3c83d67740 1 -- start start 2022-01-10T01:28:12.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a51820 0x1a88ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51c00 0x1a84f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a83610 0x1a83a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x19d2ec0 con 0x1a83610 2022-01-10T01:28:12.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x19ad8b0 con 0x1a51820 2022-01-10T01:28:12.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x19bfe50 con 0x1a51c00 2022-01-10T01:28:12.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c73fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a83610 0x1a83a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c73fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a83610 0x1a83a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36736/0 (socket says 172.21.15.36:36736) 2022-01-10T01:28:12.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c73fff700 1 -- 172.21.15.36:0/2062417792 learned_addr learned my addr 172.21.15.36:0/2062417792 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:12.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c6affd700 1 --2- 172.21.15.36:0/2062417792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51c00 0x1a84f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c737fe700 1 --2- 172.21.15.36:0/2062417792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a51820 0x1a88ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c73fff700 1 -- 172.21.15.36:0/2062417792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51c00 msgr2=0x1a84f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:12.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c73fff700 1 --2- 172.21.15.36:0/2062417792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51c00 0x1a84f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c73fff700 1 -- 172.21.15.36:0/2062417792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a51820 msgr2=0x1a88ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:12.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c73fff700 1 --2- 172.21.15.36:0/2062417792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a51820 0x1a88ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c73fff700 1 -- 172.21.15.36:0/2062417792 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x19f9310 con 0x1a83610 2022-01-10T01:28:12.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c737fe700 1 --2- 172.21.15.36:0/2062417792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a51820 0x1a88ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:28:12.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c73fff700 1 --2- 172.21.15.36:0/2062417792 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a83610 0x1a83a90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f3c6c045de0 tx=0x7f3c6c015000).ready entity=mon.0 client_cookie=e50e4f6488c71da4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:12.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c788c2700 1 -- 172.21.15.36:0/2062417792 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c6c046140 con 0x1a83610 2022-01-10T01:28:12.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c788c2700 1 -- 172.21.15.36:0/2062417792 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c06b0d0 con 0x1a83610 2022-01-10T01:28:12.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c788c2700 1 -- 172.21.15.36:0/2062417792 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c6c069b90 con 0x1a83610 2022-01-10T01:28:12.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 -- 172.21.15.36:0/2062417792 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a83610 msgr2=0x1a83a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:12.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 --2- 172.21.15.36:0/2062417792 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a83610 0x1a83a90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f3c6c045de0 tx=0x7f3c6c015000).stop 2022-01-10T01:28:12.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 -- 172.21.15.36:0/2062417792 shutdown_connections 2022-01-10T01:28:12.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 --2- 172.21.15.36:0/2062417792 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a83610 0x1a83a90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 --2- 172.21.15.36:0/2062417792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51c00 0x1a84f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 --2- 172.21.15.36:0/2062417792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a51820 0x1a88ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 -- 172.21.15.36:0/2062417792 >> 172.21.15.36:0/2062417792 conn(0x19d96c0 msgr2=0x1a4efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:12.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 -- 172.21.15.36:0/2062417792 shutdown_connections 2022-01-10T01:28:12.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 -- 172.21.15.36:0/2062417792 wait complete. 2022-01-10T01:28:12.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 -- start start 2022-01-10T01:28:12.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.736+0000 7f3c83d67740 1 Processor -- start 2022-01-10T01:28:12.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51820 0x1a86dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a51c00 0x1a85cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a83610 0x1a861b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x19bff90 con 0x1a83610 2022-01-10T01:28:12.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x19c14b0 con 0x1a51c00 2022-01-10T01:28:12.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a89750 con 0x1a51820 2022-01-10T01:28:12.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 10 client.0 ll_register_callbacks cb 0x1a088f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-01-10T01:28:12.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c73fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a83610 0x1a861b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c737fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51820 0x1a86dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c73fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a83610 0x1a861b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36742/0 (socket says 172.21.15.36:36742) 2022-01-10T01:28:12.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c73fff700 1 -- 172.21.15.36:0/1961233431 learned_addr learned my addr 172.21.15.36:0/1961233431 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:12.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c6affd700 1 --2- 172.21.15.36:0/1961233431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a51c00 0x1a85cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c73fff700 1 -- 172.21.15.36:0/1961233431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51820 msgr2=0x1a86dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:12.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c73fff700 1 --2- 172.21.15.36:0/1961233431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51820 0x1a86dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c73fff700 1 -- 172.21.15.36:0/1961233431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a51c00 msgr2=0x1a85cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:12.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c73fff700 1 --2- 172.21.15.36:0/1961233431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a51c00 0x1a85cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c73fff700 1 -- 172.21.15.36:0/1961233431 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c740b5190 con 0x1a83610 2022-01-10T01:28:12.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c73fff700 1 --2- 172.21.15.36:0/1961233431 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a83610 0x1a861b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f3c6c045de0 tx=0x7f3c6c01a000).ready entity=mon.0 client_cookie=8971b458ea2a0541 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:12.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c527fc700 10 client.0 ms_handle_connect on v2:172.21.15.36:3300/0 2022-01-10T01:28:12.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c527fc700 1 -- 172.21.15.36:0/1961233431 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c6c06b390 con 0x1a83610 2022-01-10T01:28:12.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 1 -- 172.21.15.36:0/1961233431 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x19b70d0 con 0x1a83610 2022-01-10T01:28:12.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c527fc700 1 -- 172.21.15.36:0/1961233431 <== mon.0 v2:172.21.15.36:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3c6c015dc0 con 0x1a83610 2022-01-10T01:28:12.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c527fc700 1 -- 172.21.15.36:0/1961233431 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c6c01dbb0 con 0x1a83610 2022-01-10T01:28:12.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 10 client.5760 fetch_fsmap learned FSMap version 24 2022-01-10T01:28:12.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 1 -- 172.21.15.36:0/1961233431 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x19b09b0 con 0x1a83610 2022-01-10T01:28:12.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c527fc700 1 -- 172.21.15.36:0/1961233431 <== mon.0 v2:172.21.15.36:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x19b70d0 con 0x1a83610 2022-01-10T01:28:12.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c527fc700 1 -- 172.21.15.36:0/1961233431 <== mon.0 v2:172.21.15.36:3300/0 5 ==== fsmap(e 24) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f3c6c01dd10 con 0x1a83610 2022-01-10T01:28:12.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 10 client.5760 fetch_fsmap finished waiting for FSMap version 24 2022-01-10T01:28:12.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 10 client.5760 resolve_mds: resolved ID 'b' to GID 35150 2022-01-10T01:28:12.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 20 client.5760 populate_metadata read hostname 'smithi036' 2022-01-10T01:28:12.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 1 --2- 172.21.15.36:0/1961233431 >> [v2:172.21.15.59:6832/1363567016,v1:172.21.15.59:6833/1363567016] conn(0x1a52a80 0x1a52e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 4 client.5760 mds_command: new command op to 35150 tid=0[{"prefix": "get_command_descriptions"}] 2022-01-10T01:28:12.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c83d67740 1 -- 172.21.15.36:0/1961233431 --> [v2:172.21.15.59:6832/1363567016,v1:172.21.15.59:6833/1363567016] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x19af440 con 0x1a52a80 2022-01-10T01:28:12.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c737fe700 1 --2- 172.21.15.36:0/1961233431 >> [v2:172.21.15.59:6832/1363567016,v1:172.21.15.59:6833/1363567016] conn(0x1a52a80 0x1a52e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c527fc700 10 client.5760 ms_handle_connect on v2:172.21.15.59:6832/1363567016 2022-01-10T01:28:12.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.740+0000 7f3c737fe700 1 --2- 172.21.15.36:0/1961233431 >> [v2:172.21.15.59:6832/1363567016,v1:172.21.15.59:6833/1363567016] conn(0x1a52a80 0x1a52e60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6d1f6f0520e75e9f server_cookie=43e3c7e12f23c6d in_seq=0 out_seq=0 2022-01-10T01:28:12.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c527fc700 1 -- 172.21.15.36:0/1961233431 <== mds.0 v2:172.21.15.59:6832/1363567016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x19af440 con 0x1a52a80 2022-01-10T01:28:12.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c527fc700 10 client.5760 handle_command_reply: tid=0 2022-01-10T01:28:12.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c83d67740 1 client.5760 shutdown 2022-01-10T01:28:12.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c83d67740 1 -- 172.21.15.36:0/1961233431 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a83610 msgr2=0x1a861b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:12.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c83d67740 1 --2- 172.21.15.36:0/1961233431 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a83610 0x1a861b0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f3c6c045de0 tx=0x7f3c6c01a000).stop 2022-01-10T01:28:12.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c83d67740 1 -- 172.21.15.36:0/1961233431 shutdown_connections 2022-01-10T01:28:12.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c83d67740 1 --2- 172.21.15.36:0/1961233431 >> [v2:172.21.15.59:6832/1363567016,v1:172.21.15.59:6833/1363567016] conn(0x1a52a80 0x1a52e60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c83d67740 1 --2- 172.21.15.36:0/1961233431 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a83610 0x1a861b0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c83d67740 1 --2- 172.21.15.36:0/1961233431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a51c00 0x1a85cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c527fc700 0 client.5760 ms_handle_reset on v2:172.21.15.59:6832/1363567016 2022-01-10T01:28:12.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c83d67740 1 --2- 172.21.15.36:0/1961233431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51820 0x1a86dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c83d67740 1 -- 172.21.15.36:0/1961233431 >> 172.21.15.36:0/1961233431 conn(0x19d96c0 msgr2=0x1a82930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:12.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c83d67740 1 -- 172.21.15.36:0/1961233431 shutdown_connections 2022-01-10T01:28:12.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c83d67740 1 -- 172.21.15.36:0/1961233431 wait complete. 2022-01-10T01:28:12.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.744+0000 7f3c83d67740 20 client.5760 trim_cache size 0 max 16384 2022-01-10T01:28:12.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c83d67740 1 Processor -- start 2022-01-10T01:28:12.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c83d67740 1 -- start start 2022-01-10T01:28:12.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c83d67740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51820 0x1a4ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c83d67740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a51c00 0x1a889b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c83d67740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a83610 0x1a88ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c83d67740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x19c2a00 con 0x1a51c00 2022-01-10T01:28:12.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c83d67740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x19c14b0 con 0x1a83610 2022-01-10T01:28:12.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c83d67740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a820b0 con 0x1a51820 2022-01-10T01:28:12.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c6affd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a51c00 0x1a889b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c6affd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a51c00 0x1a889b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36748/0 (socket says 172.21.15.36:36748) 2022-01-10T01:28:12.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c6affd700 1 -- 172.21.15.36:0/421649052 learned_addr learned my addr 172.21.15.36:0/421649052 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:12.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c737fe700 1 --2- 172.21.15.36:0/421649052 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51820 0x1a4ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c73fff700 1 --2- 172.21.15.36:0/421649052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a83610 0x1a88ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c6affd700 1 -- 172.21.15.36:0/421649052 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51820 msgr2=0x1a4ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:12.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c6affd700 1 --2- 172.21.15.36:0/421649052 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51820 0x1a4ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c6affd700 1 -- 172.21.15.36:0/421649052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a83610 msgr2=0x1a88ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:12.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c6affd700 1 --2- 172.21.15.36:0/421649052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a83610 0x1a88ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.756+0000 7f3c6affd700 1 -- 172.21.15.36:0/421649052 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x19b92b0 con 0x1a51c00 2022-01-10T01:28:12.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c6affd700 1 --2- 172.21.15.36:0/421649052 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a51c00 0x1a889b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f3c5c00d000 tx=0x7f3c5c009040).ready entity=mon.0 client_cookie=5594436a9b5c5aaa server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:12.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c68ff9700 1 -- 172.21.15.36:0/421649052 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c5c0169f0 con 0x1a51c00 2022-01-10T01:28:12.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c68ff9700 1 -- 172.21.15.36:0/421649052 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c016b50 con 0x1a51c00 2022-01-10T01:28:12.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c68ff9700 1 -- 172.21.15.36:0/421649052 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c5c016eb0 con 0x1a51c00 2022-01-10T01:28:12.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c83d67740 1 -- 172.21.15.36:0/421649052 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a51c00 msgr2=0x1a889b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:12.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c83d67740 1 --2- 172.21.15.36:0/421649052 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a51c00 0x1a889b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f3c5c00d000 tx=0x7f3c5c009040).stop 2022-01-10T01:28:12.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c83d67740 1 -- 172.21.15.36:0/421649052 shutdown_connections 2022-01-10T01:28:12.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c83d67740 1 --2- 172.21.15.36:0/421649052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a83610 0x1a88ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c83d67740 1 --2- 172.21.15.36:0/421649052 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a51c00 0x1a889b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c83d67740 1 --2- 172.21.15.36:0/421649052 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51820 0x1a4ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c83d67740 1 -- 172.21.15.36:0/421649052 >> 172.21.15.36:0/421649052 conn(0x19d96c0 msgr2=0x1a4ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:12.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c83d67740 1 -- 172.21.15.36:0/421649052 shutdown_connections 2022-01-10T01:28:12.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c83d67740 1 -- 172.21.15.36:0/421649052 wait complete. 2022-01-10T01:28:12.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c83d67740 1 -- start start 2022-01-10T01:28:12.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.760+0000 7f3c83d67740 1 Processor -- start 2022-01-10T01:28:12.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a51820 0x1a92a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51c00 0x1a81b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a83610 0x1aeb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a8de90 con 0x1a51820 2022-01-10T01:28:12.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a810b0 con 0x1a83610 2022-01-10T01:28:12.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a4f800 con 0x1a51c00 2022-01-10T01:28:12.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 10 client.0 ll_register_callbacks cb 0x1a4c500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-01-10T01:28:12.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c737fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a51820 0x1a92a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c737fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a51820 0x1a92a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36752/0 (socket says 172.21.15.36:36752) 2022-01-10T01:28:12.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c737fe700 1 -- 172.21.15.36:0/2076232579 learned_addr learned my addr 172.21.15.36:0/2076232579 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:12.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c73fff700 1 --2- 172.21.15.36:0/2076232579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a83610 0x1aeb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c6affd700 1 --2- 172.21.15.36:0/2076232579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51c00 0x1a81b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c737fe700 1 -- 172.21.15.36:0/2076232579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51c00 msgr2=0x1a81b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:12.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c737fe700 1 --2- 172.21.15.36:0/2076232579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51c00 0x1a81b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c737fe700 1 -- 172.21.15.36:0/2076232579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a83610 msgr2=0x1aeb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:12.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c737fe700 1 --2- 172.21.15.36:0/2076232579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a83610 0x1aeb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:12.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c737fe700 1 -- 172.21.15.36:0/2076232579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c00f040 con 0x1a51820 2022-01-10T01:28:12.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c73fff700 1 --2- 172.21.15.36:0/2076232579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a83610 0x1aeb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:28:12.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c737fe700 1 --2- 172.21.15.36:0/2076232579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a51820 0x1a92a40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f3c64033000 tx=0x7f3c6402b040).ready entity=mon.0 client_cookie=7db6007078da0bc server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:12.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c537fe700 10 client.0 ms_handle_connect on v2:172.21.15.36:3300/0 2022-01-10T01:28:12.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c537fe700 1 -- 172.21.15.36:0/2076232579 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c6402e040 con 0x1a51820 2022-01-10T01:28:12.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c537fe700 1 -- 172.21.15.36:0/2076232579 <== mon.0 v2:172.21.15.36:3300/0 2 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3c640065e0 con 0x1a51820 2022-01-10T01:28:12.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 1 -- 172.21.15.36:0/2076232579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c6c06b0d0 con 0x1a51820 2022-01-10T01:28:12.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c537fe700 1 -- 172.21.15.36:0/2076232579 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c64032280 con 0x1a51820 2022-01-10T01:28:12.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 10 client.5766 fetch_fsmap learned FSMap version 24 2022-01-10T01:28:12.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 1 -- 172.21.15.36:0/2076232579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x19b5ca0 con 0x1a51820 2022-01-10T01:28:12.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c537fe700 1 -- 172.21.15.36:0/2076232579 <== mon.0 v2:172.21.15.36:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c06b0d0 con 0x1a51820 2022-01-10T01:28:12.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c537fe700 1 -- 172.21.15.36:0/2076232579 <== mon.0 v2:172.21.15.36:3300/0 5 ==== fsmap(e 24) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f3c6403a030 con 0x1a51820 2022-01-10T01:28:12.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 10 client.5766 fetch_fsmap finished waiting for FSMap version 24 2022-01-10T01:28:12.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 10 client.5766 resolve_mds: resolved ID 'b' to GID 35150 2022-01-10T01:28:12.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 20 client.5766 populate_metadata read hostname 'smithi036' 2022-01-10T01:28:12.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 1 --2- 172.21.15.36:0/2076232579 >> [v2:172.21.15.59:6832/1363567016,v1:172.21.15.59:6833/1363567016] conn(0x1aebe90 0x1ae55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:12.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 4 client.5766 mds_command: new command op to 35150 tid=0[{"prefix": "cache drop", "timeout": 5}] 2022-01-10T01:28:12.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c83d67740 1 -- 172.21.15.36:0/2076232579 --> [v2:172.21.15.59:6832/1363567016,v1:172.21.15.59:6833/1363567016] -- command(tid 0: {"prefix": "cache drop", "timeout": 5}) v1 -- 0x18a55e0 con 0x1aebe90 2022-01-10T01:28:12.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c6affd700 1 --2- 172.21.15.36:0/2076232579 >> [v2:172.21.15.59:6832/1363567016,v1:172.21.15.59:6833/1363567016] conn(0x1aebe90 0x1ae55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:12.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c537fe700 10 client.5766 ms_handle_connect on v2:172.21.15.59:6832/1363567016 2022-01-10T01:28:12.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:11.764+0000 7f3c6affd700 1 --2- 172.21.15.36:0/2076232579 >> [v2:172.21.15.59:6832/1363567016,v1:172.21.15.59:6833/1363567016] conn(0x1aebe90 0x1ae55b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4b338d109e178c01 server_cookie=5b08894baebaf7f2 in_seq=0 out_seq=0 2022-01-10T01:28:16.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.956+0000 7f3c537fe700 1 -- 172.21.15.36:0/2076232579 <== mds.0 v2:172.21.15.59:6832/1363567016 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+404 (crc 0 0 0) 0x18a55e0 con 0x1aebe90 2022-01-10T01:28:16.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.956+0000 7f3c537fe700 10 client.5766 handle_command_reply: tid=0 2022-01-10T01:28:16.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.956+0000 7f3c83d67740 1 client.5766 shutdown 2022-01-10T01:28:16.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.956+0000 7f3c83d67740 1 -- 172.21.15.36:0/2076232579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a51820 msgr2=0x1a92a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:16.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.956+0000 7f3c83d67740 1 --2- 172.21.15.36:0/2076232579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a51820 0x1a92a40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f3c64033000 tx=0x7f3c6402b040).stop 2022-01-10T01:28:16.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.956+0000 7f3c83d67740 1 -- 172.21.15.36:0/2076232579 shutdown_connections 2022-01-10T01:28:16.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.956+0000 7f3c83d67740 1 --2- 172.21.15.36:0/2076232579 >> [v2:172.21.15.59:6832/1363567016,v1:172.21.15.59:6833/1363567016] conn(0x1aebe90 0x1ae55b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:16.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.956+0000 7f3c83d67740 1 --2- 172.21.15.36:0/2076232579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x1a83610 0x1aeb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:16.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.956+0000 7f3c83d67740 1 --2- 172.21.15.36:0/2076232579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x1a51c00 0x1a81b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:16.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.956+0000 7f3c83d67740 1 --2- 172.21.15.36:0/2076232579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x1a51820 0x1a92a40 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:16.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c83d67740 1 -- 172.21.15.36:0/2076232579 >> 172.21.15.36:0/2076232579 conn(0x19d96c0 msgr2=0x1a82630 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:16.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c537fe700 0 client.5766 ms_handle_reset on v2:172.21.15.59:6832/1363567016 2022-01-10T01:28:16.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c83d67740 1 -- 172.21.15.36:0/2076232579 shutdown_connections 2022-01-10T01:28:16.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c83d67740 1 -- 172.21.15.36:0/2076232579 wait complete. 2022-01-10T01:28:16.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c83d67740 20 client.5766 trim_cache size 0 max 16384 2022-01-10T01:28:16.968 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:28:16.968 INFO:teuthology.orchestra.run.smithi036.stdout: "client_recall": { 2022-01-10T01:28:16.968 INFO:teuthology.orchestra.run.smithi036.stdout: "return_code": -110, 2022-01-10T01:28:16.968 INFO:teuthology.orchestra.run.smithi036.stdout: "message": "(110) Connection timed out", 2022-01-10T01:28:16.969 INFO:teuthology.orchestra.run.smithi036.stdout: "recalled": 120 2022-01-10T01:28:16.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:28:16.969 INFO:teuthology.orchestra.run.smithi036.stdout: "flush_journal": { 2022-01-10T01:28:16.969 INFO:teuthology.orchestra.run.smithi036.stdout: "return_code": 0, 2022-01-10T01:28:16.970 INFO:teuthology.orchestra.run.smithi036.stdout: "message": "" 2022-01-10T01:28:16.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:28:16.970 INFO:teuthology.orchestra.run.smithi036.stdout: "trim_cache": { 2022-01-10T01:28:16.970 INFO:teuthology.orchestra.run.smithi036.stdout: "trimmed": 0 2022-01-10T01:28:16.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:28:16.971 INFO:teuthology.orchestra.run.smithi036.stdout: "cache": { 2022-01-10T01:28:16.971 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": { 2022-01-10T01:28:16.971 INFO:teuthology.orchestra.run.smithi036.stdout: "items": 19981, 2022-01-10T01:28:16.971 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes": 3099104 2022-01-10T01:28:16.972 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:28:16.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:28:16.972 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 5.1911398420000001 2022-01-10T01:28:16.972 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:28:16.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c788c2700 1 -- 172.21.15.36:0/3650219475 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c58053500 msgr2=0x7f3c580559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:16.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c788c2700 1 --2- 172.21.15.36:0/3650219475 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c58053500 0x7f3c580559c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f3c6401a000 tx=0x7f3c64008040).stop 2022-01-10T01:28:16.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c788c2700 1 -- 172.21.15.36:0/3650219475 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c74155aa0 msgr2=0x7f3c74155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:16.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c788c2700 1 --2- 172.21.15.36:0/3650219475 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c74155aa0 0x7f3c74155f20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f3c5c001450 tx=0x7f3c6c009040).stop 2022-01-10T01:28:16.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c788c2700 1 -- 172.21.15.36:0/3650219475 shutdown_connections 2022-01-10T01:28:16.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c788c2700 1 --2- 172.21.15.36:0/3650219475 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3c58053500 0x7f3c580559c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:16.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c788c2700 1 --2- 172.21.15.36:0/3650219475 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3c74155aa0 0x7f3c74155f20 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:16.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c788c2700 1 --2- 172.21.15.36:0/3650219475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c74140b40 0x7f3c74140fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:16.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c788c2700 1 --2- 172.21.15.36:0/3650219475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c54003750 0x7f3c740b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:16.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c788c2700 1 -- 172.21.15.36:0/3650219475 >> 172.21.15.36:0/3650219475 conn(0x7f3c74061230 msgr2=0x7f3c740b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:16.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c788c2700 1 -- 172.21.15.36:0/3650219475 shutdown_connections 2022-01-10T01:28:16.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:16.960+0000 7f3c788c2700 1 -- 172.21.15.36:0/3650219475 wait complete. 2022-01-10T01:28:16.980 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2022-01-10T01:28:16.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:28:16.981 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:28:16.982 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:28:16.989 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2022-01-10T01:28:16.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:28:16.991 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2022-01-10T01:28:16.992 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:28:16.992 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:28:16.993 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:28:17.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:28:17.012 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:28:17.012 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:28:17.018 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:28:17.019 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:28:17.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:28:17.020 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:28:17.027 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:28:17.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 Processor -- start 2022-01-10T01:28:17.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 -- start start 2022-01-10T01:28:17.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340b18f0 0x7f2e340b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e340a9c10 0x7f2e34147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e340b33e0 con 0x7f2e340b3000 2022-01-10T01:28:17.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e340b27f0 con 0x7f2e340a9c10 2022-01-10T01:28:17.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e340b0c70 con 0x7f2e340b18f0 2022-01-10T01:28:17.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e38d63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340b18f0 0x7f2e340b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e38d63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340b18f0 0x7f2e340b2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:43042/0 (socket says 172.21.15.36:43042) 2022-01-10T01:28:17.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e38d63700 1 -- 172.21.15.36:0/2213606253 learned_addr learned my addr 172.21.15.36:0/2213606253 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:17.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e39d65700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2e340a9c10 0x7f2e34147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e38d63700 1 -- 172.21.15.36:0/2213606253 >> v2:172.21.15.59:3300/0 conn(0x7f2e340a9c10 msgr2=0x7f2e34147ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:17.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e38d63700 1 --2- 172.21.15.36:0/2213606253 >> v2:172.21.15.59:3300/0 conn(0x7f2e340a9c10 0x7f2e34147ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e38d63700 1 -- 172.21.15.36:0/2213606253 >> v1:172.21.15.59:6789/0 conn(0x7f2e340b3000 legacy=0x7f2e34065510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e38d63700 1 -- 172.21.15.36:0/2213606253 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e340b0f10 con 0x7f2e340b18f0 2022-01-10T01:28:17.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e38d63700 1 --2- 172.21.15.36:0/2213606253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340b18f0 0x7f2e340b2300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2e30002f70 tx=0x7f2e30006eb0).ready entity=mon.2 client_cookie=3fb48e694f11eba4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:17.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e2bfff700 1 -- 172.21.15.36:0/2213606253 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e3000d570 con 0x7f2e340b18f0 2022-01-10T01:28:17.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e2bfff700 1 -- 172.21.15.36:0/2213606253 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e30000e90 con 0x7f2e340b18f0 2022-01-10T01:28:17.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e2bfff700 1 -- 172.21.15.36:0/2213606253 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e3000d900 con 0x7f2e340b18f0 2022-01-10T01:28:17.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 -- 172.21.15.36:0/2213606253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340b18f0 msgr2=0x7f2e340b2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 --2- 172.21.15.36:0/2213606253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340b18f0 0x7f2e340b2300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f2e30002f70 tx=0x7f2e30006eb0).stop 2022-01-10T01:28:17.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 -- 172.21.15.36:0/2213606253 shutdown_connections 2022-01-10T01:28:17.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 --2- 172.21.15.36:0/2213606253 >> v2:172.21.15.59:3300/0 conn(0x7f2e340a9c10 0x7f2e34147ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 --2- 172.21.15.36:0/2213606253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340b18f0 0x7f2e340b2300 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 -- 172.21.15.36:0/2213606253 >> 172.21.15.36:0/2213606253 conn(0x7f2e340636e0 msgr2=0x7f2e34063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:17.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 -- 172.21.15.36:0/2213606253 shutdown_connections 2022-01-10T01:28:17.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.136+0000 7f2e3a566700 1 -- 172.21.15.36:0/2213606253 wait complete. 2022-01-10T01:28:17.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e3a566700 1 Processor -- start 2022-01-10T01:28:17.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e3a566700 1 -- start start 2022-01-10T01:28:17.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e3a566700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a9c10 0x7f2e34065690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e3a566700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e340b18f0 0x7f2e341428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e3a566700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340b3000 0x7f2e34142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e3a566700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34143c00 con 0x7f2e340b18f0 2022-01-10T01:28:17.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e3a566700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34143ea0 con 0x7f2e340b3000 2022-01-10T01:28:17.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e3a566700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e34144140 con 0x7f2e340a9c10 2022-01-10T01:28:17.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e38d63700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e340b18f0 0x7f2e341428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e38d63700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e340b18f0 0x7f2e341428f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36768/0 (socket says 172.21.15.36:36768) 2022-01-10T01:28:17.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e38d63700 1 -- 172.21.15.36:0/2002549772 learned_addr learned my addr 172.21.15.36:0/2002549772 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:17.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e39564700 1 --2- 172.21.15.36:0/2002549772 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a9c10 0x7f2e34065690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e39d65700 1 --2- 172.21.15.36:0/2002549772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340b3000 0x7f2e34142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e38d63700 1 -- 172.21.15.36:0/2002549772 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a9c10 msgr2=0x7f2e34065690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e38d63700 1 --2- 172.21.15.36:0/2002549772 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a9c10 0x7f2e34065690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e38d63700 1 -- 172.21.15.36:0/2002549772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340b3000 msgr2=0x7f2e34142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e38d63700 1 --2- 172.21.15.36:0/2002549772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340b3000 0x7f2e34142de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e38d63700 1 -- 172.21.15.36:0/2002549772 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3000b1e0 con 0x7f2e340b18f0 2022-01-10T01:28:17.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e38d63700 1 --2- 172.21.15.36:0/2002549772 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e340b18f0 0x7f2e341428f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f2e30002f70 tx=0x7f2e30015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:17.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e2a7fc700 1 -- 172.21.15.36:0/2002549772 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e30011760 con 0x7f2e340b18f0 2022-01-10T01:28:17.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e2a7fc700 1 -- 172.21.15.36:0/2002549772 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e300118c0 con 0x7f2e340b18f0 2022-01-10T01:28:17.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e3a566700 1 -- 172.21.15.36:0/2002549772 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e341443e0 con 0x7f2e340b18f0 2022-01-10T01:28:17.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e2a7fc700 1 -- 172.21.15.36:0/2002549772 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e30011c20 con 0x7f2e340b18f0 2022-01-10T01:28:17.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.140+0000 7f2e3a566700 1 -- 172.21.15.36:0/2002549772 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e34145460 con 0x7f2e340b18f0 2022-01-10T01:28:17.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.144+0000 7f2e3a566700 1 -- 172.21.15.36:0/2002549772 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e34057350 con 0x7f2e340b18f0 2022-01-10T01:28:17.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.144+0000 7f2e2a7fc700 1 -- 172.21.15.36:0/2002549772 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2e30025030 con 0x7f2e340b18f0 2022-01-10T01:28:17.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.144+0000 7f2e2a7fc700 1 --2- 172.21.15.36:0/2002549772 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e1c0534d0 0x7f2e1c055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.144+0000 7f2e2a7fc700 1 -- 172.21.15.36:0/2002549772 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2e3006cb60 con 0x7f2e340b18f0 2022-01-10T01:28:17.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.144+0000 7f2e39564700 1 --2- 172.21.15.36:0/2002549772 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e1c0534d0 0x7f2e1c055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.144+0000 7f2e39564700 1 --2- 172.21.15.36:0/2002549772 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e1c0534d0 0x7f2e1c055990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f2e2400d000 tx=0x7f2e24000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:17.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.152+0000 7f2e2a7fc700 1 -- 172.21.15.36:0/2002549772 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2e30043b70 con 0x7f2e340b18f0 2022-01-10T01:28:17.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.284+0000 7f2e3a566700 1 -- 172.21.15.36:0/2002549772 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e341566d0 con 0x7f2e340b18f0 2022-01-10T01:28:17.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.284+0000 7f2e2a7fc700 1 -- 172.21.15.36:0/2002549772 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+16273 (secure 0 0 0) 0x7f2e30023020 con 0x7f2e340b18f0 2022-01-10T01:28:17.290 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:28:17.290 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":56,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:27:53.595841+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:27:51.027021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2022-01-10T01:27:52.032505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:28:17.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.288+0000 7f2e3a566700 1 -- 172.21.15.36:0/2002549772 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e1c0534d0 msgr2=0x7f2e1c055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.288+0000 7f2e3a566700 1 --2- 172.21.15.36:0/2002549772 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e1c0534d0 0x7f2e1c055990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f2e2400d000 tx=0x7f2e24000bc0).stop 2022-01-10T01:28:17.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.288+0000 7f2e3a566700 1 -- 172.21.15.36:0/2002549772 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e340b18f0 msgr2=0x7f2e341428f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.288+0000 7f2e3a566700 1 --2- 172.21.15.36:0/2002549772 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e340b18f0 0x7f2e341428f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f2e30002f70 tx=0x7f2e30015000).stop 2022-01-10T01:28:17.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.288+0000 7f2e3a566700 1 -- 172.21.15.36:0/2002549772 shutdown_connections 2022-01-10T01:28:17.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.288+0000 7f2e3a566700 1 --2- 172.21.15.36:0/2002549772 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2e1c0534d0 0x7f2e1c055990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.288+0000 7f2e3a566700 1 --2- 172.21.15.36:0/2002549772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2e340b3000 0x7f2e34142de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.288+0000 7f2e3a566700 1 --2- 172.21.15.36:0/2002549772 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2e340b18f0 0x7f2e341428f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.288+0000 7f2e3a566700 1 --2- 172.21.15.36:0/2002549772 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2e340a9c10 0x7f2e34065690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.288+0000 7f2e3a566700 1 -- 172.21.15.36:0/2002549772 >> 172.21.15.36:0/2002549772 conn(0x7f2e340636e0 msgr2=0x7f2e340648c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:17.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.288+0000 7f2e3a566700 1 -- 172.21.15.36:0/2002549772 shutdown_connections 2022-01-10T01:28:17.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.288+0000 7f2e3a566700 1 -- 172.21.15.36:0/2002549772 wait complete. 2022-01-10T01:28:17.304 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:27:51.027021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:27:52.032505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:28:17.304 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:28:17.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.408+0000 7fcd1e27c700 1 Processor -- start 2022-01-10T01:28:17.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.408+0000 7fcd1e27c700 1 -- start start 2022-01-10T01:28:17.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1e27c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd180b4690 0x7fcd18140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1e27c700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd18143b60 con 0x7fcd18146950 2022-01-10T01:28:17.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1e27c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd18143e00 con 0x7fcd180b4180 2022-01-10T01:28:17.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1e27c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd18147510 con 0x7fcd180b4690 2022-01-10T01:28:17.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd17fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fcd18146950 0x7fcd18140230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34568/0 (socket says 172.21.15.36:34568) 2022-01-10T01:28:17.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd17fff700 1 -- 172.21.15.36:0/356985543 learned_addr learned my addr 172.21.15.36:0/356985543 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:28:17.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1c819700 1 --2- 172.21.15.36:0/356985543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd180b4690 0x7fcd18140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd16ffd700 1 -- 172.21.15.36:0/356985543 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065433992 0 0) 0x7fcd18143b60 con 0x7fcd18146950 2022-01-10T01:28:17.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd16ffd700 1 -- 172.21.15.36:0/356985543 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd04003260 con 0x7fcd18146950 2022-01-10T01:28:17.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd16ffd700 1 -- 172.21.15.36:0/356985543 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187207441 0 0) 0x7fcd18143e00 con 0x7fcd180b4180 2022-01-10T01:28:17.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd16ffd700 1 -- 172.21.15.36:0/356985543 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd18143b60 con 0x7fcd180b4180 2022-01-10T01:28:17.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1c819700 1 -- 172.21.15.36:0/356985543 >> v1:172.21.15.59:6789/0 conn(0x7fcd180b4180 legacy=0x7fcd180b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1c819700 1 -- 172.21.15.36:0/356985543 >> v1:172.21.15.36:6789/0 conn(0x7fcd18146950 legacy=0x7fcd18140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1c819700 1 -- 172.21.15.36:0/356985543 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd180b0c90 con 0x7fcd180b4690 2022-01-10T01:28:17.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1c819700 1 --2- 172.21.15.36:0/356985543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd180b4690 0x7fcd18140940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fcd100032f0 tx=0x7fcd100091d0).ready entity=mon.2 client_cookie=46394d6d1f307723 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:17.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd16ffd700 1 -- 172.21.15.36:0/356985543 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd1000b640 con 0x7fcd180b4690 2022-01-10T01:28:17.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd16ffd700 1 -- 172.21.15.36:0/356985543 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1000b7a0 con 0x7fcd180b4690 2022-01-10T01:28:17.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd16ffd700 1 -- 172.21.15.36:0/356985543 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd1000b910 con 0x7fcd180b4690 2022-01-10T01:28:17.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1e27c700 1 -- 172.21.15.36:0/356985543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd180b4690 msgr2=0x7fcd18140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1e27c700 1 --2- 172.21.15.36:0/356985543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd180b4690 0x7fcd18140940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fcd100032f0 tx=0x7fcd100091d0).stop 2022-01-10T01:28:17.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1e27c700 1 -- 172.21.15.36:0/356985543 shutdown_connections 2022-01-10T01:28:17.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1e27c700 1 --2- 172.21.15.36:0/356985543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd180b4690 0x7fcd18140940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1e27c700 1 -- 172.21.15.36:0/356985543 >> 172.21.15.36:0/356985543 conn(0x7fcd1805c490 msgr2=0x7fcd1805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:17.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1e27c700 1 -- 172.21.15.36:0/356985543 shutdown_connections 2022-01-10T01:28:17.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.412+0000 7fcd1e27c700 1 -- 172.21.15.36:0/356985543 wait complete. 2022-01-10T01:28:17.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd1e27c700 1 Processor -- start 2022-01-10T01:28:17.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd1e27c700 1 -- start start 2022-01-10T01:28:17.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd1e27c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcd180b4180 0x7fcd180b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd1e27c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd180b4690 0x7fcd180ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd1e27c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd18146950 0x7fcd180b8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd1e27c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd18152fa0 con 0x7fcd180b4180 2022-01-10T01:28:17.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd1e27c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd180b0380 con 0x7fcd180b4690 2022-01-10T01:28:17.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd1e27c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd18152cd0 con 0x7fcd18146950 2022-01-10T01:28:17.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd17fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcd180b4180 0x7fcd180b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd17fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcd180b4180 0x7fcd180b8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36780/0 (socket says 172.21.15.36:36780) 2022-01-10T01:28:17.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd177fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd180b4690 0x7fcd180ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd1c819700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd18146950 0x7fcd180b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd17fff700 1 -- 172.21.15.36:0/2163430662 learned_addr learned my addr 172.21.15.36:0/2163430662 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:17.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd17fff700 1 -- 172.21.15.36:0/2163430662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd18146950 msgr2=0x7fcd180b8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd17fff700 1 --2- 172.21.15.36:0/2163430662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd18146950 0x7fcd180b8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd17fff700 1 -- 172.21.15.36:0/2163430662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd180b4690 msgr2=0x7fcd180ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd17fff700 1 --2- 172.21.15.36:0/2163430662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd180b4690 0x7fcd180ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd17fff700 1 -- 172.21.15.36:0/2163430662 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd10009470 con 0x7fcd180b4180 2022-01-10T01:28:17.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd177fe700 1 --2- 172.21.15.36:0/2163430662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd180b4690 0x7fcd180ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:28:17.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd17fff700 1 --2- 172.21.15.36:0/2163430662 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcd180b4180 0x7fcd180b8d90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fcd080011d0 tx=0x7fcd08007b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:17.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd157fa700 1 -- 172.21.15.36:0/2163430662 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd080070d0 con 0x7fcd180b4180 2022-01-10T01:28:17.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd157fa700 1 -- 172.21.15.36:0/2163430662 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd08007230 con 0x7fcd180b4180 2022-01-10T01:28:17.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd1e27c700 1 -- 172.21.15.36:0/2163430662 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd180ae8c0 con 0x7fcd180b4180 2022-01-10T01:28:17.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd157fa700 1 -- 172.21.15.36:0/2163430662 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd08005610 con 0x7fcd180b4180 2022-01-10T01:28:17.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.416+0000 7fcd1e27c700 1 -- 172.21.15.36:0/2163430662 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd180b8540 con 0x7fcd180b4180 2022-01-10T01:28:17.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.420+0000 7fcd1e27c700 1 -- 172.21.15.36:0/2163430662 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd180b01e0 con 0x7fcd180b4180 2022-01-10T01:28:17.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.420+0000 7fcd157fa700 1 -- 172.21.15.36:0/2163430662 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fcd08010070 con 0x7fcd180b4180 2022-01-10T01:28:17.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.420+0000 7fcd157fa700 1 --2- 172.21.15.36:0/2163430662 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccf80535f0 0x7fccf8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.420+0000 7fcd157fa700 1 -- 172.21.15.36:0/2163430662 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcd0806b240 con 0x7fcd180b4180 2022-01-10T01:28:17.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.420+0000 7fcd177fe700 1 --2- 172.21.15.36:0/2163430662 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccf80535f0 0x7fccf8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.420+0000 7fcd177fe700 1 --2- 172.21.15.36:0/2163430662 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccf80535f0 0x7fccf8055ab0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fcd0c00d000 tx=0x7fcd0c007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:17.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.428+0000 7fcd157fa700 1 -- 172.21.15.36:0/2163430662 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcd180b01e0 con 0x7fcd180b4180 2022-01-10T01:28:17.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.552+0000 7fcd1e27c700 1 -- 172.21.15.36:0/2163430662 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fcd180b01e0 con 0x7fcd180b4180 2022-01-10T01:28:17.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.552+0000 7fcd157fa700 1 -- 172.21.15.36:0/2163430662 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v56) v1 ==== 110+0+10 (secure 0 0 0) 0x7fcd180b01e0 con 0x7fcd180b4180 2022-01-10T01:28:17.558 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:28:17.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.556+0000 7fcd1e27c700 1 -- 172.21.15.36:0/2163430662 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccf80535f0 msgr2=0x7fccf8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.556+0000 7fcd1e27c700 1 --2- 172.21.15.36:0/2163430662 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccf80535f0 0x7fccf8055ab0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fcd0c00d000 tx=0x7fcd0c007a00).stop 2022-01-10T01:28:17.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.556+0000 7fcd1e27c700 1 -- 172.21.15.36:0/2163430662 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcd180b4180 msgr2=0x7fcd180b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.556+0000 7fcd1e27c700 1 --2- 172.21.15.36:0/2163430662 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcd180b4180 0x7fcd180b8d90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fcd080011d0 tx=0x7fcd08007b30).stop 2022-01-10T01:28:17.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.556+0000 7fcd1e27c700 1 -- 172.21.15.36:0/2163430662 shutdown_connections 2022-01-10T01:28:17.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.556+0000 7fcd1e27c700 1 --2- 172.21.15.36:0/2163430662 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccf80535f0 0x7fccf8055ab0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.556+0000 7fcd1e27c700 1 --2- 172.21.15.36:0/2163430662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd18146950 0x7fcd180b8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.556+0000 7fcd1e27c700 1 --2- 172.21.15.36:0/2163430662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd180b4690 0x7fcd180ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.556+0000 7fcd1e27c700 1 --2- 172.21.15.36:0/2163430662 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcd180b4180 0x7fcd180b8d90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.556+0000 7fcd1e27c700 1 -- 172.21.15.36:0/2163430662 >> 172.21.15.36:0/2163430662 conn(0x7fcd1805c490 msgr2=0x7fcd1813b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:17.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.556+0000 7fcd1e27c700 1 -- 172.21.15.36:0/2163430662 shutdown_connections 2022-01-10T01:28:17.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.556+0000 7fcd1e27c700 1 -- 172.21.15.36:0/2163430662 wait complete. 2022-01-10T01:28:17.578 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:28:17.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.684+0000 7eff42bb9700 1 Processor -- start 2022-01-10T01:28:17.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.684+0000 7eff42bb9700 1 -- start start 2022-01-10T01:28:17.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff42bb9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff3c064b40 0x7eff3c1438a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff42bb9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3c0b3940 0x7eff3c143d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff42bb9700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff3c0b2270 con 0x7eff3c0b2cf0 2022-01-10T01:28:17.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff42bb9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3c144280 con 0x7eff3c064b40 2022-01-10T01:28:17.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff42bb9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c062230 con 0x7eff3c0b3940 2022-01-10T01:28:17.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff413b6700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7eff3c0b2cf0 0x7eff3c0b3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34582/0 (socket says 172.21.15.36:34582) 2022-01-10T01:28:17.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff413b6700 1 -- 172.21.15.36:0/873750795 learned_addr learned my addr 172.21.15.36:0/873750795 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:28:17.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff423b8700 1 --2- 172.21.15.36:0/873750795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3c0b3940 0x7eff3c143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff41bb7700 1 --2- 172.21.15.36:0/873750795 >> v2:172.21.15.59:3300/0 conn(0x7eff3c064b40 0x7eff3c1438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff40bb5700 1 -- 172.21.15.36:0/873750795 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946531400 0 0) 0x7eff3c0b2270 con 0x7eff3c0b2cf0 2022-01-10T01:28:17.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff40bb5700 1 -- 172.21.15.36:0/873750795 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff24003260 con 0x7eff3c0b2cf0 2022-01-10T01:28:17.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff423b8700 1 -- 172.21.15.36:0/873750795 >> v2:172.21.15.59:3300/0 conn(0x7eff3c064b40 msgr2=0x7eff3c1438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:17.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff423b8700 1 --2- 172.21.15.36:0/873750795 >> v2:172.21.15.59:3300/0 conn(0x7eff3c064b40 0x7eff3c1438a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff423b8700 1 -- 172.21.15.36:0/873750795 >> v1:172.21.15.36:6789/0 conn(0x7eff3c0b2cf0 legacy=0x7eff3c0b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff423b8700 1 -- 172.21.15.36:0/873750795 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3c0b3d90 con 0x7eff3c0b3940 2022-01-10T01:28:17.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff423b8700 1 --2- 172.21.15.36:0/873750795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3c0b3940 0x7eff3c143d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7eff340032f0 tx=0x7eff340091d0).ready entity=mon.2 client_cookie=7c5f839853f4db67 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:17.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff40bb5700 1 -- 172.21.15.36:0/873750795 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff3400b600 con 0x7eff3c0b3940 2022-01-10T01:28:17.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff40bb5700 1 -- 172.21.15.36:0/873750795 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3400b760 con 0x7eff3c0b3940 2022-01-10T01:28:17.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff40bb5700 1 -- 172.21.15.36:0/873750795 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff3400b8d0 con 0x7eff3c0b3940 2022-01-10T01:28:17.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff42bb9700 1 -- 172.21.15.36:0/873750795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3c0b3940 msgr2=0x7eff3c143d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff42bb9700 1 --2- 172.21.15.36:0/873750795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3c0b3940 0x7eff3c143d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7eff340032f0 tx=0x7eff340091d0).stop 2022-01-10T01:28:17.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff42bb9700 1 -- 172.21.15.36:0/873750795 shutdown_connections 2022-01-10T01:28:17.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff42bb9700 1 --2- 172.21.15.36:0/873750795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3c0b3940 0x7eff3c143d90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff42bb9700 1 --2- 172.21.15.36:0/873750795 >> v2:172.21.15.59:3300/0 conn(0x7eff3c064b40 0x7eff3c1438a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff42bb9700 1 -- 172.21.15.36:0/873750795 >> 172.21.15.36:0/873750795 conn(0x7eff3c062be0 msgr2=0x7eff3c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:17.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff42bb9700 1 -- 172.21.15.36:0/873750795 shutdown_connections 2022-01-10T01:28:17.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.688+0000 7eff42bb9700 1 -- 172.21.15.36:0/873750795 wait complete. 2022-01-10T01:28:17.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.692+0000 7eff42bb9700 1 Processor -- start 2022-01-10T01:28:17.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.692+0000 7eff42bb9700 1 -- start start 2022-01-10T01:28:17.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff42bb9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff3c064b40 0x7eff3c0b7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff42bb9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff3c0b2cf0 0x7eff3c1521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff42bb9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3c0b3940 0x7eff3c144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff42bb9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c0ac6e0 con 0x7eff3c064b40 2022-01-10T01:28:17.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff42bb9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c145480 con 0x7eff3c0b2cf0 2022-01-10T01:28:17.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff42bb9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff3c145710 con 0x7eff3c0b3940 2022-01-10T01:28:17.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff41bb7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff3c064b40 0x7eff3c0b7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff41bb7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff3c064b40 0x7eff3c0b7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36794/0 (socket says 172.21.15.36:36794) 2022-01-10T01:28:17.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff41bb7700 1 -- 172.21.15.36:0/3045321238 learned_addr learned my addr 172.21.15.36:0/3045321238 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:17.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff413b6700 1 --2- 172.21.15.36:0/3045321238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff3c0b2cf0 0x7eff3c1521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff423b8700 1 --2- 172.21.15.36:0/3045321238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3c0b3940 0x7eff3c144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff41bb7700 1 -- 172.21.15.36:0/3045321238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3c0b3940 msgr2=0x7eff3c144f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff41bb7700 1 --2- 172.21.15.36:0/3045321238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3c0b3940 0x7eff3c144f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff41bb7700 1 -- 172.21.15.36:0/3045321238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff3c0b2cf0 msgr2=0x7eff3c1521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff41bb7700 1 --2- 172.21.15.36:0/3045321238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff3c0b2cf0 0x7eff3c1521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff41bb7700 1 -- 172.21.15.36:0/3045321238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff34009470 con 0x7eff3c064b40 2022-01-10T01:28:17.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff41bb7700 1 --2- 172.21.15.36:0/3045321238 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff3c064b40 0x7eff3c0b7cf0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7eff3800c000 tx=0x7eff38006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:17.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff2effd700 1 -- 172.21.15.36:0/3045321238 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff38010780 con 0x7eff3c064b40 2022-01-10T01:28:17.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff2effd700 1 -- 172.21.15.36:0/3045321238 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff380108e0 con 0x7eff3c064b40 2022-01-10T01:28:17.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff42bb9700 1 -- 172.21.15.36:0/3045321238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff3c1459b0 con 0x7eff3c064b40 2022-01-10T01:28:17.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff2effd700 1 -- 172.21.15.36:0/3045321238 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff38010c40 con 0x7eff3c064b40 2022-01-10T01:28:17.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff42bb9700 1 -- 172.21.15.36:0/3045321238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff3c155990 con 0x7eff3c064b40 2022-01-10T01:28:17.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff2effd700 1 -- 172.21.15.36:0/3045321238 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7eff3801c460 con 0x7eff3c064b40 2022-01-10T01:28:17.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.696+0000 7eff42bb9700 1 -- 172.21.15.36:0/3045321238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3c057350 con 0x7eff3c064b40 2022-01-10T01:28:17.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.700+0000 7eff2effd700 1 --2- 172.21.15.36:0/3045321238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff1c053680 0x7eff1c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.700+0000 7eff413b6700 1 --2- 172.21.15.36:0/3045321238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff1c053680 0x7eff1c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.700+0000 7eff2effd700 1 -- 172.21.15.36:0/3045321238 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7eff3806bfa0 con 0x7eff3c064b40 2022-01-10T01:28:17.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.700+0000 7eff413b6700 1 --2- 172.21.15.36:0/3045321238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff1c053680 0x7eff1c055b40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7eff3000b000 tx=0x7eff30009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:17.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.704+0000 7eff2effd700 1 -- 172.21.15.36:0/3045321238 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff38042e40 con 0x7eff3c064b40 2022-01-10T01:28:17.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.836+0000 7eff42bb9700 1 -- 172.21.15.36:0/3045321238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7eff3c155b90 con 0x7eff3c064b40 2022-01-10T01:28:17.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.836+0000 7eff2effd700 1 -- 172.21.15.36:0/3045321238 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v56) v1 ==== 92+0+10 (secure 0 0 0) 0x7eff38046460 con 0x7eff3c064b40 2022-01-10T01:28:17.841 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:28:17.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.836+0000 7eff42bb9700 1 -- 172.21.15.36:0/3045321238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff1c053680 msgr2=0x7eff1c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.836+0000 7eff42bb9700 1 --2- 172.21.15.36:0/3045321238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff1c053680 0x7eff1c055b40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7eff3000b000 tx=0x7eff30009040).stop 2022-01-10T01:28:17.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.836+0000 7eff42bb9700 1 -- 172.21.15.36:0/3045321238 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff3c064b40 msgr2=0x7eff3c0b7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.836+0000 7eff42bb9700 1 --2- 172.21.15.36:0/3045321238 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff3c064b40 0x7eff3c0b7cf0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7eff3800c000 tx=0x7eff38006df0).stop 2022-01-10T01:28:17.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.840+0000 7eff42bb9700 1 -- 172.21.15.36:0/3045321238 shutdown_connections 2022-01-10T01:28:17.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.840+0000 7eff42bb9700 1 --2- 172.21.15.36:0/3045321238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff1c053680 0x7eff1c055b40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.840+0000 7eff42bb9700 1 --2- 172.21.15.36:0/3045321238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3c0b3940 0x7eff3c144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.840+0000 7eff42bb9700 1 --2- 172.21.15.36:0/3045321238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff3c0b2cf0 0x7eff3c1521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.840+0000 7eff42bb9700 1 --2- 172.21.15.36:0/3045321238 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff3c064b40 0x7eff3c0b7cf0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.840+0000 7eff42bb9700 1 -- 172.21.15.36:0/3045321238 >> 172.21.15.36:0/3045321238 conn(0x7eff3c062be0 msgr2=0x7eff3c141490 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:17.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.840+0000 7eff42bb9700 1 -- 172.21.15.36:0/3045321238 shutdown_connections 2022-01-10T01:28:17.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.840+0000 7eff42bb9700 1 -- 172.21.15.36:0/3045321238 wait complete. 2022-01-10T01:28:17.853 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:28:17.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3f491e700 1 Processor -- start 2022-01-10T01:28:17.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3f491e700 1 -- start start 2022-01-10T01:28:17.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3f491e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa3f00b2580 0x7fa3f014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3f491e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3f00b0010 0x7fa3f014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3f491e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3f00a70c0 con 0x7fa3f00afbd0 2022-01-10T01:28:17.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3f491e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f00a72f0 con 0x7fa3f00b2580 2022-01-10T01:28:17.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3f491e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3f00a7590 con 0x7fa3f00b0010 2022-01-10T01:28:17.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3eed9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa3f00b2580 0x7fa3f014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3eed9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa3f00b2580 0x7fa3f014ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36802/0 (socket says 172.21.15.36:36802) 2022-01-10T01:28:17.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3eed9d700 1 -- 172.21.15.36:0/2340343888 learned_addr learned my addr 172.21.15.36:0/2340343888 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:17.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3ee59c700 1 --2- 172.21.15.36:0/2340343888 >> v2:172.21.15.59:3300/0 conn(0x7fa3f00b0010 0x7fa3f014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3eed9d700 1 -- 172.21.15.36:0/2340343888 >> v2:172.21.15.59:3300/0 conn(0x7fa3f00b0010 msgr2=0x7fa3f014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:17.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3eed9d700 1 --2- 172.21.15.36:0/2340343888 >> v2:172.21.15.59:3300/0 conn(0x7fa3f00b0010 0x7fa3f014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3eed9d700 1 -- 172.21.15.36:0/2340343888 >> v1:172.21.15.59:6789/0 conn(0x7fa3f00afbd0 legacy=0x7fa3f00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3eed9d700 1 -- 172.21.15.36:0/2340343888 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f00a7830 con 0x7fa3f00b2580 2022-01-10T01:28:17.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3eed9d700 1 --2- 172.21.15.36:0/2340343888 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3f00b2580 0x7fa3f014ae40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fa3e0002f70 tx=0x7fa3e0006eb0).ready entity=mon.0 client_cookie=7494f3f4ebe6a3a6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:17.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3edd9b700 1 -- 172.21.15.36:0/2340343888 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e000d5c0 con 0x7fa3f00b2580 2022-01-10T01:28:17.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3edd9b700 1 -- 172.21.15.36:0/2340343888 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e0000e90 con 0x7fa3f00b2580 2022-01-10T01:28:17.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.960+0000 7fa3edd9b700 1 -- 172.21.15.36:0/2340343888 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e000d950 con 0x7fa3f00b2580 2022-01-10T01:28:17.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 -- 172.21.15.36:0/2340343888 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3f00b2580 msgr2=0x7fa3f014ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 --2- 172.21.15.36:0/2340343888 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3f00b2580 0x7fa3f014ae40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fa3e0002f70 tx=0x7fa3e0006eb0).stop 2022-01-10T01:28:17.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 -- 172.21.15.36:0/2340343888 shutdown_connections 2022-01-10T01:28:17.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 --2- 172.21.15.36:0/2340343888 >> v2:172.21.15.59:3300/0 conn(0x7fa3f00b0010 0x7fa3f014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 --2- 172.21.15.36:0/2340343888 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3f00b2580 0x7fa3f014ae40 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 -- 172.21.15.36:0/2340343888 >> 172.21.15.36:0/2340343888 conn(0x7fa3f0060180 msgr2=0x7fa3f00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:17.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 -- 172.21.15.36:0/2340343888 shutdown_connections 2022-01-10T01:28:17.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 -- 172.21.15.36:0/2340343888 wait complete. 2022-01-10T01:28:17.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 Processor -- start 2022-01-10T01:28:17.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 -- start start 2022-01-10T01:28:17.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f00afbd0 0x7fa3f0067330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3f00b0010 0x7fa3f00ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3f00b2580 0x7fa3f0159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0067ba0 con 0x7fa3f00b0010 2022-01-10T01:28:17.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0065de0 con 0x7fa3f00b2580 2022-01-10T01:28:17.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3f491e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3f0067900 con 0x7fa3f00afbd0 2022-01-10T01:28:17.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3ee59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3f00b0010 0x7fa3f00ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3ee59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3f00b0010 0x7fa3f00ae920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36810/0 (socket says 172.21.15.36:36810) 2022-01-10T01:28:17.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3ee59c700 1 -- 172.21.15.36:0/4211091410 learned_addr learned my addr 172.21.15.36:0/4211091410 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:17.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3ef59e700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3f00b2580 0x7fa3f0159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3eed9d700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f00afbd0 0x7fa3f0067330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3ee59c700 1 -- 172.21.15.36:0/4211091410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f00afbd0 msgr2=0x7fa3f0067330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3ee59c700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f00afbd0 0x7fa3f0067330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3ee59c700 1 -- 172.21.15.36:0/4211091410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3f00b2580 msgr2=0x7fa3f0159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:17.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3ee59c700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3f00b2580 0x7fa3f0159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:17.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3ee59c700 1 -- 172.21.15.36:0/4211091410 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e000b1e0 con 0x7fa3f00b0010 2022-01-10T01:28:17.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3eed9d700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f00afbd0 0x7fa3f0067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:28:17.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.964+0000 7fa3ee59c700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3f00b0010 0x7fa3f00ae920 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fa3e400c000 tx=0x7fa3e4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:17.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.968+0000 7fa3dffff700 1 -- 172.21.15.36:0/4211091410 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e4010780 con 0x7fa3f00b0010 2022-01-10T01:28:17.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.968+0000 7fa3dffff700 1 -- 172.21.15.36:0/4211091410 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3e40108e0 con 0x7fa3f00b0010 2022-01-10T01:28:17.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.968+0000 7fa3f491e700 1 -- 172.21.15.36:0/4211091410 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f00aaf90 con 0x7fa3f00b0010 2022-01-10T01:28:17.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.968+0000 7fa3dffff700 1 -- 172.21.15.36:0/4211091410 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3e4010c40 con 0x7fa3f00b0010 2022-01-10T01:28:17.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.968+0000 7fa3f491e700 1 -- 172.21.15.36:0/4211091410 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f00ab6d0 con 0x7fa3f00b0010 2022-01-10T01:28:17.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.968+0000 7fa3f491e700 1 -- 172.21.15.36:0/4211091410 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3f00ac600 con 0x7fa3f00b0010 2022-01-10T01:28:17.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.968+0000 7fa3dffff700 1 -- 172.21.15.36:0/4211091410 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa3e401c460 con 0x7fa3f00b0010 2022-01-10T01:28:17.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.968+0000 7fa3dffff700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa3cc053680 0x7fa3cc055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:17.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.968+0000 7fa3eed9d700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa3cc053680 0x7fa3cc055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:17.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.968+0000 7fa3dffff700 1 -- 172.21.15.36:0/4211091410 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa3e406c060 con 0x7fa3f00b0010 2022-01-10T01:28:17.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.968+0000 7fa3eed9d700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa3cc053680 0x7fa3cc055b40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fa3e001a000 tx=0x7fa3e0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:17.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:17.972+0000 7fa3dffff700 1 -- 172.21.15.36:0/4211091410 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa3f00ac600 con 0x7fa3f00b0010 2022-01-10T01:28:18.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.100+0000 7fa3f491e700 1 -- 172.21.15.36:0/4211091410 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3f00ac600 con 0x7fa3f00b0010 2022-01-10T01:28:18.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.100+0000 7fa3dffff700 1 -- 172.21.15.36:0/4211091410 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa3f00ac600 con 0x7fa3f00b0010 2022-01-10T01:28:18.104 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:28:18.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.100+0000 7fa3f491e700 1 -- 172.21.15.36:0/4211091410 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa3cc053680 msgr2=0x7fa3cc055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.100+0000 7fa3f491e700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa3cc053680 0x7fa3cc055b40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fa3e001a000 tx=0x7fa3e0015000).stop 2022-01-10T01:28:18.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.100+0000 7fa3f491e700 1 -- 172.21.15.36:0/4211091410 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3f00b0010 msgr2=0x7fa3f00ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.100+0000 7fa3f491e700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3f00b0010 0x7fa3f00ae920 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fa3e400c000 tx=0x7fa3e4006df0).stop 2022-01-10T01:28:18.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.100+0000 7fa3f491e700 1 -- 172.21.15.36:0/4211091410 shutdown_connections 2022-01-10T01:28:18.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.100+0000 7fa3f491e700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa3cc053680 0x7fa3cc055b40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.100+0000 7fa3f491e700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3f00b2580 0x7fa3f0159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.100+0000 7fa3f491e700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3f00b0010 0x7fa3f00ae920 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.100+0000 7fa3f491e700 1 --2- 172.21.15.36:0/4211091410 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3f00afbd0 0x7fa3f0067330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.100+0000 7fa3f491e700 1 -- 172.21.15.36:0/4211091410 >> 172.21.15.36:0/4211091410 conn(0x7fa3f0060180 msgr2=0x7fa3f005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:18.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.100+0000 7fa3f491e700 1 -- 172.21.15.36:0/4211091410 shutdown_connections 2022-01-10T01:28:18.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.100+0000 7fa3f491e700 1 -- 172.21.15.36:0/4211091410 wait complete. 2022-01-10T01:28:18.116 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:28:18.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.212+0000 7f3764b30700 1 Processor -- start 2022-01-10T01:28:18.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.212+0000 7f3764b30700 1 -- start start 2022-01-10T01:28:18.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.212+0000 7f3764b30700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3760061160 0x7f3760143980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:18.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.212+0000 7f3764b30700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3760067050 con 0x7f37600b76b0 2022-01-10T01:28:18.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.212+0000 7f3764b30700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37600653b0 con 0x7f37600b27a0 2022-01-10T01:28:18.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.212+0000 7f3764b30700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37600b7a90 con 0x7f3760061160 2022-01-10T01:28:18.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f375f7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f37600b76b0 0x7f3760060a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34610/0 (socket says 172.21.15.36:34610) 2022-01-10T01:28:18.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f375f7fe700 1 -- 172.21.15.36:0/3541486404 learned_addr learned my addr 172.21.15.36:0/3541486404 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:28:18.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f375ffff700 1 --2- 172.21.15.36:0/3541486404 >> v2:172.21.15.59:3300/0 conn(0x7f3760061160 0x7f3760143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:18.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f375e7fc700 1 -- 172.21.15.36:0/3541486404 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086469988 0 0) 0x7f3760067050 con 0x7f37600b76b0 2022-01-10T01:28:18.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f375ffff700 1 -- 172.21.15.36:0/3541486404 >> v1:172.21.15.59:6789/0 conn(0x7f37600b27a0 legacy=0x7f3760143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f375ffff700 1 -- 172.21.15.36:0/3541486404 >> v1:172.21.15.36:6789/0 conn(0x7f37600b76b0 legacy=0x7f3760060a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f375ffff700 1 -- 172.21.15.36:0/3541486404 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3760066b50 con 0x7f3760061160 2022-01-10T01:28:18.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f375ffff700 1 --2- 172.21.15.36:0/3541486404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3760061160 0x7f3760143980 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f37580032f0 tx=0x7f37580091d0).ready entity=mon.1 client_cookie=bd15e755ddb8b001 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:18.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f375e7fc700 1 -- 172.21.15.36:0/3541486404 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3758009ea0 con 0x7f3760061160 2022-01-10T01:28:18.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f375e7fc700 1 -- 172.21.15.36:0/3541486404 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375800b8a0 con 0x7f3760061160 2022-01-10T01:28:18.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f375e7fc700 1 -- 172.21.15.36:0/3541486404 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f375800ba10 con 0x7f3760061160 2022-01-10T01:28:18.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f3764b30700 1 -- 172.21.15.36:0/3541486404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3760061160 msgr2=0x7f3760143980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f3764b30700 1 --2- 172.21.15.36:0/3541486404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3760061160 0x7f3760143980 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f37580032f0 tx=0x7f37580091d0).stop 2022-01-10T01:28:18.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f3764b30700 1 -- 172.21.15.36:0/3541486404 shutdown_connections 2022-01-10T01:28:18.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f3764b30700 1 --2- 172.21.15.36:0/3541486404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3760061160 0x7f3760143980 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f3764b30700 1 -- 172.21.15.36:0/3541486404 >> 172.21.15.36:0/3541486404 conn(0x7f376005f6b0 msgr2=0x7f376005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:18.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f3764b30700 1 -- 172.21.15.36:0/3541486404 shutdown_connections 2022-01-10T01:28:18.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.216+0000 7f3764b30700 1 -- 172.21.15.36:0/3541486404 wait complete. 2022-01-10T01:28:18.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f3764b30700 1 Processor -- start 2022-01-10T01:28:18.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f3764b30700 1 -- start start 2022-01-10T01:28:18.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f3764b30700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3760061160 0x7f3760144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:18.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f3764b30700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37600b27a0 0x7f37600abf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:18.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f3764b30700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f37600b76b0 0x7f3760142c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:18.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f3764b30700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3760141a60 con 0x7f37600b76b0 2022-01-10T01:28:18.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f3764b30700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37600ad560 con 0x7f37600b27a0 2022-01-10T01:28:18.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f3764b30700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37600ae6f0 con 0x7f3760061160 2022-01-10T01:28:18.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f375ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f37600b76b0 0x7f3760142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:18.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f375effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37600b27a0 0x7f37600abf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:18.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f375ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f37600b76b0 0x7f3760142c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36826/0 (socket says 172.21.15.36:36826) 2022-01-10T01:28:18.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f375f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3760061160 0x7f3760144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:18.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f375ffff700 1 -- 172.21.15.36:0/165213747 learned_addr learned my addr 172.21.15.36:0/165213747 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:18.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f375ffff700 1 -- 172.21.15.36:0/165213747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3760061160 msgr2=0x7f3760144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f375ffff700 1 --2- 172.21.15.36:0/165213747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3760061160 0x7f3760144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f375ffff700 1 -- 172.21.15.36:0/165213747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37600b27a0 msgr2=0x7f37600abf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f375ffff700 1 --2- 172.21.15.36:0/165213747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37600b27a0 0x7f37600abf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f375ffff700 1 -- 172.21.15.36:0/165213747 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3758009470 con 0x7f37600b76b0 2022-01-10T01:28:18.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f375ffff700 1 --2- 172.21.15.36:0/165213747 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f37600b76b0 0x7f3760142c40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f3760141ba0 tx=0x7f3758016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:18.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f375cff9700 1 -- 172.21.15.36:0/165213747 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3758009ea0 con 0x7f37600b76b0 2022-01-10T01:28:18.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f375cff9700 1 -- 172.21.15.36:0/165213747 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375801f3f0 con 0x7f37600b76b0 2022-01-10T01:28:18.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f3764b30700 1 -- 172.21.15.36:0/165213747 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37600ad790 con 0x7f37600b76b0 2022-01-10T01:28:18.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f375cff9700 1 -- 172.21.15.36:0/165213747 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3758011ea0 con 0x7f37600b76b0 2022-01-10T01:28:18.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.220+0000 7f3764b30700 1 -- 172.21.15.36:0/165213747 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37600ac850 con 0x7f37600b76b0 2022-01-10T01:28:18.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.224+0000 7f3764b30700 1 -- 172.21.15.36:0/165213747 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37600ad920 con 0x7f37600b76b0 2022-01-10T01:28:18.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.224+0000 7f375cff9700 1 -- 172.21.15.36:0/165213747 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3758026030 con 0x7f37600b76b0 2022-01-10T01:28:18.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.224+0000 7f375cff9700 1 --2- 172.21.15.36:0/165213747 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f37400535f0 0x7f3740055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:18.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.224+0000 7f375cff9700 1 -- 172.21.15.36:0/165213747 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f375806c820 con 0x7f37600b76b0 2022-01-10T01:28:18.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.224+0000 7f375f7fe700 1 --2- 172.21.15.36:0/165213747 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f37400535f0 0x7f3740055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:18.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.224+0000 7f375f7fe700 1 --2- 172.21.15.36:0/165213747 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f37400535f0 0x7f3740055ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f375000d000 tx=0x7f3750009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:18.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.232+0000 7f375cff9700 1 -- 172.21.15.36:0/165213747 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3758047150 con 0x7f37600b76b0 2022-01-10T01:28:18.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.356+0000 7f3764b30700 1 -- 172.21.15.36:0/165213747 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37600ac5d0 con 0x7f37600b76b0 2022-01-10T01:28:18.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.356+0000 7f375cff9700 1 -- 172.21.15.36:0/165213747 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3758046d40 con 0x7f37600b76b0 2022-01-10T01:28:18.362 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:28:18.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.360+0000 7f3764b30700 1 -- 172.21.15.36:0/165213747 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f37400535f0 msgr2=0x7f3740055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.360+0000 7f3764b30700 1 --2- 172.21.15.36:0/165213747 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f37400535f0 0x7f3740055ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f375000d000 tx=0x7f3750009040).stop 2022-01-10T01:28:18.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.360+0000 7f3764b30700 1 -- 172.21.15.36:0/165213747 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f37600b76b0 msgr2=0x7f3760142c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.360+0000 7f3764b30700 1 --2- 172.21.15.36:0/165213747 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f37600b76b0 0x7f3760142c40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f3760141ba0 tx=0x7f3758016000).stop 2022-01-10T01:28:18.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.360+0000 7f3764b30700 1 -- 172.21.15.36:0/165213747 shutdown_connections 2022-01-10T01:28:18.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.360+0000 7f3764b30700 1 --2- 172.21.15.36:0/165213747 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f37400535f0 0x7f3740055ab0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.360+0000 7f3764b30700 1 --2- 172.21.15.36:0/165213747 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f37600b76b0 0x7f3760142c40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.360+0000 7f3764b30700 1 --2- 172.21.15.36:0/165213747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37600b27a0 0x7f37600abf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.360+0000 7f3764b30700 1 --2- 172.21.15.36:0/165213747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3760061160 0x7f3760144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.360+0000 7f3764b30700 1 -- 172.21.15.36:0/165213747 >> 172.21.15.36:0/165213747 conn(0x7f376005f6b0 msgr2=0x7f3760145210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:18.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.360+0000 7f3764b30700 1 -- 172.21.15.36:0/165213747 shutdown_connections 2022-01-10T01:28:18.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.360+0000 7f3764b30700 1 -- 172.21.15.36:0/165213747 wait complete. 2022-01-10T01:28:18.375 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:28:18.376 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:28:18.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff19c98e700 1 Processor -- start 2022-01-10T01:28:18.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff19c98e700 1 -- start start 2022-01-10T01:28:18.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff19c98e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff198061320 0x7ff198061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:18.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff19c98e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff198140440 0x7ff1981408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:18.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff19c98e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1980aecf0 con 0x7ff1980ad5c0 2022-01-10T01:28:18.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff19c98e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1980b6f20 con 0x7ff198061320 2022-01-10T01:28:18.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff19c98e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980aef20 con 0x7ff198140440 2022-01-10T01:28:18.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff19659c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff1980ad5c0 0x7ff1980b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34624/0 (socket says 172.21.15.36:34624) 2022-01-10T01:28:18.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff19659c700 1 -- 172.21.15.36:0/2085175623 learned_addr learned my addr 172.21.15.36:0/2085175623 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:28:18.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff19759e700 1 --2- 172.21.15.36:0/2085175623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff198140440 0x7ff1981408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:18.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff196d9d700 1 --2- 172.21.15.36:0/2085175623 >> v2:172.21.15.59:3300/0 conn(0x7ff198061320 0x7ff198061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:18.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff195d9b700 1 -- 172.21.15.36:0/2085175623 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564702997 0 0) 0x7ff1980aecf0 con 0x7ff1980ad5c0 2022-01-10T01:28:18.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff195d9b700 1 -- 172.21.15.36:0/2085175623 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff178003260 con 0x7ff1980ad5c0 2022-01-10T01:28:18.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff19759e700 1 -- 172.21.15.36:0/2085175623 >> v2:172.21.15.59:3300/0 conn(0x7ff198061320 msgr2=0x7ff198061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:28:18.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff19759e700 1 --2- 172.21.15.36:0/2085175623 >> v2:172.21.15.59:3300/0 conn(0x7ff198061320 0x7ff198061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff19759e700 1 -- 172.21.15.36:0/2085175623 >> v1:172.21.15.36:6789/0 conn(0x7ff1980ad5c0 legacy=0x7ff1980b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff195d9b700 1 -- 172.21.15.36:0/2085175623 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3300606729 0 0) 0x7ff178003260 con 0x7ff1980ad5c0 2022-01-10T01:28:18.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.476+0000 7ff19759e700 1 -- 172.21.15.36:0/2085175623 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980af1c0 con 0x7ff198140440 2022-01-10T01:28:18.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19759e700 1 --2- 172.21.15.36:0/2085175623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff198140440 0x7ff1981408d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff1980aeba0 tx=0x7ff190006df0).ready entity=mon.2 client_cookie=d69c417bfeb0ce78 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:18.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff195d9b700 1 -- 172.21.15.36:0/2085175623 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1880019e0 con 0x7ff198140440 2022-01-10T01:28:18.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff195d9b700 1 -- 172.21.15.36:0/2085175623 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff190000e90 con 0x7ff198140440 2022-01-10T01:28:18.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff195d9b700 1 -- 172.21.15.36:0/2085175623 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff190012460 con 0x7ff198140440 2022-01-10T01:28:18.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 -- 172.21.15.36:0/2085175623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff198140440 msgr2=0x7ff1981408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 --2- 172.21.15.36:0/2085175623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff198140440 0x7ff1981408d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7ff1980aeba0 tx=0x7ff190006df0).stop 2022-01-10T01:28:18.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 -- 172.21.15.36:0/2085175623 shutdown_connections 2022-01-10T01:28:18.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 --2- 172.21.15.36:0/2085175623 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff198140440 0x7ff1981408d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 --2- 172.21.15.36:0/2085175623 >> v2:172.21.15.59:3300/0 conn(0x7ff198061320 0x7ff198061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 -- 172.21.15.36:0/2085175623 >> 172.21.15.36:0/2085175623 conn(0x7ff198066de0 msgr2=0x7ff1980671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:18.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 -- 172.21.15.36:0/2085175623 shutdown_connections 2022-01-10T01:28:18.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 -- 172.21.15.36:0/2085175623 wait complete. 2022-01-10T01:28:18.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 Processor -- start 2022-01-10T01:28:18.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 -- start start 2022-01-10T01:28:18.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff198061320 0x7ff198152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:18.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1980ad5c0 0x7ff1980b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:18.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff198140440 0x7ff1980b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:18.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff198153220 con 0x7ff1980ad5c0 2022-01-10T01:28:18.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff198143950 con 0x7ff198140440 2022-01-10T01:28:18.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19c98e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1980aacd0 con 0x7ff198061320 2022-01-10T01:28:18.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1980ad5c0 0x7ff1980b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:18.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff198140440 0x7ff1980b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:18.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff196d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff198061320 0x7ff198152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:18.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1980ad5c0 0x7ff1980b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36840/0 (socket says 172.21.15.36:36840) 2022-01-10T01:28:18.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.480+0000 7ff19659c700 1 -- 172.21.15.36:0/297395556 learned_addr learned my addr 172.21.15.36:0/297395556 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:28:18.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.484+0000 7ff19659c700 1 -- 172.21.15.36:0/297395556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff198061320 msgr2=0x7ff198152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.484+0000 7ff19659c700 1 --2- 172.21.15.36:0/297395556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff198061320 0x7ff198152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.484+0000 7ff19659c700 1 -- 172.21.15.36:0/297395556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff198140440 msgr2=0x7ff1980b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.484+0000 7ff19659c700 1 --2- 172.21.15.36:0/297395556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff198140440 0x7ff1980b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.484+0000 7ff19659c700 1 -- 172.21.15.36:0/297395556 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19000b180 con 0x7ff1980ad5c0 2022-01-10T01:28:18.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.484+0000 7ff19659c700 1 --2- 172.21.15.36:0/297395556 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1980ad5c0 0x7ff1980b06f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7ff1980aff40 tx=0x7ff188002180).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:18.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.484+0000 7ff18ffff700 1 -- 172.21.15.36:0/297395556 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff188005ba0 con 0x7ff1980ad5c0 2022-01-10T01:28:18.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.484+0000 7ff18ffff700 1 -- 172.21.15.36:0/297395556 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff188005d00 con 0x7ff1980ad5c0 2022-01-10T01:28:18.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.484+0000 7ff19c98e700 1 -- 172.21.15.36:0/297395556 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1980aa2f0 con 0x7ff1980ad5c0 2022-01-10T01:28:18.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.484+0000 7ff18ffff700 1 -- 172.21.15.36:0/297395556 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff188007300 con 0x7ff1980ad5c0 2022-01-10T01:28:18.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.484+0000 7ff19c98e700 1 -- 172.21.15.36:0/297395556 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1980ab620 con 0x7ff1980ad5c0 2022-01-10T01:28:18.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.484+0000 7ff19c98e700 1 -- 172.21.15.36:0/297395556 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1980b0f20 con 0x7ff1980ad5c0 2022-01-10T01:28:18.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.484+0000 7ff18ffff700 1 -- 172.21.15.36:0/297395556 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff188010030 con 0x7ff1980ad5c0 2022-01-10T01:28:18.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.484+0000 7ff18ffff700 1 --2- 172.21.15.36:0/297395556 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff17c0534d0 0x7ff17c055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:28:18.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.488+0000 7ff18ffff700 1 -- 172.21.15.36:0/297395556 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff18806ba70 con 0x7ff1980ad5c0 2022-01-10T01:28:18.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.488+0000 7ff196d9d700 1 --2- 172.21.15.36:0/297395556 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff17c0534d0 0x7ff17c055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:28:18.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.488+0000 7ff196d9d700 1 --2- 172.21.15.36:0/297395556 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff17c0534d0 0x7ff17c055990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7ff18000b000 tx=0x7ff180006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:28:18.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.496+0000 7ff18ffff700 1 -- 172.21.15.36:0/297395556 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff188042a20 con 0x7ff1980ad5c0 2022-01-10T01:28:18.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.660+0000 7ff19c98e700 1 -- 172.21.15.36:0/297395556 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1980ab7e0 con 0x7ff1980ad5c0 2022-01-10T01:28:18.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.660+0000 7ff18ffff700 1 -- 172.21.15.36:0/297395556 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2496 (secure 0 0 0) 0x7ff18806be60 con 0x7ff1980ad5c0 2022-01-10T01:28:18.665 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:28:18.665 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1806166752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1806166752},{"type":"v1","addr":"172.21.15.36:6837","nonce":1806166752}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":35141,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2577386810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2577386810},{"type":"v1","addr":"172.21.15.36:6835","nonce":2577386810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:27:52.591733+0000","modified":"2022-01-10T01:27:53.595043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35150":{"gid":35150,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1363567016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1363567016},{"type":"v1","addr":"172.21.15.59:6833","nonce":1363567016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2022-01-10T01:28:18.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.664+0000 7ff19c98e700 1 -- 172.21.15.36:0/297395556 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff17c0534d0 msgr2=0x7ff17c055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.664+0000 7ff19c98e700 1 --2- 172.21.15.36:0/297395556 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff17c0534d0 0x7ff17c055990 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7ff18000b000 tx=0x7ff180006df0).stop 2022-01-10T01:28:18.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.664+0000 7ff19c98e700 1 -- 172.21.15.36:0/297395556 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1980ad5c0 msgr2=0x7ff1980b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:28:18.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.664+0000 7ff19c98e700 1 --2- 172.21.15.36:0/297395556 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1980ad5c0 0x7ff1980b06f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7ff1980aff40 tx=0x7ff188002180).stop 2022-01-10T01:28:18.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.664+0000 7ff19c98e700 1 -- 172.21.15.36:0/297395556 shutdown_connections 2022-01-10T01:28:18.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.664+0000 7ff19c98e700 1 --2- 172.21.15.36:0/297395556 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff17c0534d0 0x7ff17c055990 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.664+0000 7ff19c98e700 1 --2- 172.21.15.36:0/297395556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff198140440 0x7ff1980b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.664+0000 7ff19c98e700 1 --2- 172.21.15.36:0/297395556 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1980ad5c0 0x7ff1980b06f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.664+0000 7ff19c98e700 1 --2- 172.21.15.36:0/297395556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff198061320 0x7ff198152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:28:18.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.664+0000 7ff19c98e700 1 -- 172.21.15.36:0/297395556 >> 172.21.15.36:0/297395556 conn(0x7ff198066de0 msgr2=0x7ff1980b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:28:18.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.664+0000 7ff19c98e700 1 -- 172.21.15.36:0/297395556 shutdown_connections 2022-01-10T01:28:18.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:28:18.664+0000 7ff19c98e700 1 -- 172.21.15.36:0/297395556 wait complete. 2022-01-10T01:28:18.671 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 24 2022-01-10T01:28:18.983 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:27:52.591733+0000', 'modified': '2022-01-10T01:27:53.595043+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35150}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35150': {'gid': 35150, 'name': 'b', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/1363567016', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1363567016}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 1363567016}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:28:18.984 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:28:18.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:28:19.103 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":35150,"want_state":"up:active","state":"up:active","rank_uptime":26.499146245999999,"mdsmap_epoch":24,"osdmap_epoch":56,"osdmap_epoch_barrier":55,"uptime":30.854258897000001} 2022-01-10T01:28:19.104 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 35150, "mdsmap_epoch": 24, "osdmap_epoch": 56, "osdmap_epoch_barrier": 55, "rank_uptime": 26.499146246, "state": "up:active", "uptime": 30.854258897, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:28:19.105 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:28:19.105 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:28:19.105 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:28:19.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:28:19.106 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:28:19.115 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:28:19.175 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:28:19.176 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:28:19.192 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:28:19.193 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:28:19.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:28:19.195 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:28:19.200 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:28:19.201 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:28:19.204 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:28:19.220 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:28:19.220 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:28:19.277 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:28:19.277 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:28:19.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:28:19.279 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:28:19.280 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:28:19.275+0000 7fa4b8710080 -1 init, newargv = 0x556e60ec79a0 newargc=9 2022-01-10T01:28:19.280 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14413]: starting ceph client 2022-01-10T01:28:19.288 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14413]: starting fuse 2022-01-10T01:28:20.387 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:28:20.406 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:28:20.406 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:28:20.462 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:28:20.463 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:28:20.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:28:20.466 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:28:20.474 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:28:20.475 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:28:20.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:28:20.476 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:28:20.476 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:28:20.476 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:28:20.477 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:28:20.477 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:28:20.478 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:28:20.478 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:28:20.478 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:28:20.479 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:28:20.479 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:28:20.480 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:28:20.480 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:28:20.480 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:28:20.481 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:28:20.481 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:28:20.482 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:28:20.482 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:28:20.483 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:28:20.483 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:28:20.483 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:28:20.484 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:28:20.484 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:28:20.485 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:28:20.530 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.14413.asok 2022-01-10T01:28:20.535 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14413.asok 2022-01-10T01:28:20.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:28:20.536 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14413.asok status 2022-01-10T01:28:20.670 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:28:20.670 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:28:20.670 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:28:20.671 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:28:20.671 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:28:20.671 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:28:20.672 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:28:20.672 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "14413", 2022-01-10T01:28:20.672 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:28:20.672 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:28:20.672 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:28:20.673 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:28:20.673 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 5821, 2022-01-10T01:28:20.673 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:28:20.673 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:28:20.674 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:28:20.674 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 5821 2022-01-10T01:28:20.674 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:28:20.674 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:28:20.675 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:28:20.675 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:28:20.675 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 699269637 2022-01-10T01:28:20.676 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:28:20.676 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:28:20.676 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:28:20.676 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:28:20.676 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:28:20.677 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 699269637 2022-01-10T01:28:20.678 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:28:20.678 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.5821 172.21.15.139:0/699269637", 2022-01-10T01:28:20.679 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/699269637", 2022-01-10T01:28:20.679 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:28:20.679 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 24, 2022-01-10T01:28:20.679 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 56, 2022-01-10T01:28:20.680 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:28:20.680 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:28:20.680 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:28:20.680 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:28:20.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:28:20.682 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:28:20.683 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:28:20.690 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:28:20.691 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:28:20.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:28:20.692 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:28:31.355 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:28:31.359 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:28:31.363 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:28:31.368 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:29:01.432 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:29:01.435 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:29:01.438 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:29:01.441 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:29:13.249 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:29:13.249 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:29:13.271 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:29:13.293 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:29:13.314 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:29:13.335 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:29:13.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:13.337 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:29:13.337 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:29:13.362 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:29:13.363 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:29:13.364 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:29:13.364 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:29:13.365 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:29:13.379 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14413]: fuse finished with error 0 and tester_r 0 2022-01-10T01:29:13.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:13.382 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:29:13.382 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:29:13.389 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:29:13.390 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:29:13.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:29:13.508 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:29:13.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:13.517 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:29:13.518 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:29:13.526 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:29:13.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:29:13.527 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:29:13.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:29:13.528 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:29:13.575 INFO:teuthology.orchestra.run.smithi166.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:29:13.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:29:13.577 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:29:13.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f8139960700 1 Processor -- start 2022-01-10T01:29:13.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f8139960700 1 -- start start 2022-01-10T01:29:13.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f8139960700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b2580 0x7f813414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:13.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f8139960700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81340a70c0 con 0x7f81340a8ac0 2022-01-10T01:29:13.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f8139960700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81340a72f0 con 0x7f81340b0010 2022-01-10T01:29:13.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f8139960700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81340a7590 con 0x7f81340b2580 2022-01-10T01:29:13.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f813915f700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f81340a8ac0 0x7f8134151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34642/0 (socket says 172.21.15.36:34642) 2022-01-10T01:29:13.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f813915f700 1 -- 172.21.15.36:0/2313179748 learned_addr learned my addr 172.21.15.36:0/2313179748 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:13.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f813895e700 1 --2- 172.21.15.36:0/2313179748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b2580 0x7f813414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:13.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209380579 0 0) 0x7f81340a70c0 con 0x7f81340a8ac0 2022-01-10T01:29:13.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8118003260 con 0x7f81340a8ac0 2022-01-10T01:29:13.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619886313 0 0) 0x7f81340a72f0 con 0x7f81340b0010 2022-01-10T01:29:13.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81340a70c0 con 0x7f81340b0010 2022-01-10T01:29:13.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2646850268 0 0) 0x7f8118003260 con 0x7f81340a8ac0 2022-01-10T01:29:13.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b2580 msgr2=0x7f813414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:13.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 --2- 172.21.15.36:0/2313179748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b2580 0x7f813414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:13.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 >> v1:172.21.15.59:6789/0 conn(0x7f81340b0010 legacy=0x7f81340a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:13.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81340a7830 con 0x7f81340a8ac0 2022-01-10T01:29:13.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f8124001660 con 0x7f81340a8ac0 2022-01-10T01:29:13.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 >> v1:172.21.15.36:6789/0 conn(0x7f81340a8ac0 legacy=0x7f8134151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:13.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 --2- 172.21.15.36:0/2313179748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8118003910 0x7f8118003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:13.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 --2- 172.21.15.36:0/2313179748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8118004500 0x7f8118004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:13.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 --2- 172.21.15.36:0/2313179748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b2580 0x7f8118004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:13.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81340a7590 con 0x7f8118003910 2022-01-10T01:29:13.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811800b780 con 0x7f8118004500 2022-01-10T01:29:13.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811800b940 con 0x7f81340b2580 2022-01-10T01:29:13.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f813895e700 1 --2- 172.21.15.36:0/2313179748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8118003910 0x7f8118003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:13.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f813915f700 1 --2- 172.21.15.36:0/2313179748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b2580 0x7f8118004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:13.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f8133fff700 1 --2- 172.21.15.36:0/2313179748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8118004500 0x7f8118004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:13.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f813895e700 1 -- 172.21.15.36:0/2313179748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b2580 msgr2=0x7f8118004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:13.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f813895e700 1 --2- 172.21.15.36:0/2313179748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b2580 0x7f8118004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:13.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f813895e700 1 -- 172.21.15.36:0/2313179748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8118004500 msgr2=0x7f8118004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:13.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f813895e700 1 --2- 172.21.15.36:0/2313179748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8118004500 0x7f8118004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:13.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f813895e700 1 -- 172.21.15.36:0/2313179748 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8118003260 con 0x7f8118003910 2022-01-10T01:29:13.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f813915f700 1 --2- 172.21.15.36:0/2313179748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b2580 0x7f8118004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:29:13.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f8133fff700 1 --2- 172.21.15.36:0/2313179748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8118004500 0x7f8118004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:29:13.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f813895e700 1 --2- 172.21.15.36:0/2313179748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8118003910 0x7f8118003d10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f811c00c000 tx=0x7f811c006df0).ready entity=mon.0 client_cookie=60847a9cb10b31fc server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:13.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.691+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f811c00e830 con 0x7f8118003910 2022-01-10T01:29:13.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.695+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c00e990 con 0x7f8118003910 2022-01-10T01:29:13.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.695+0000 7f81337fe700 1 -- 172.21.15.36:0/2313179748 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f811c00ecf0 con 0x7f8118003910 2022-01-10T01:29:13.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.695+0000 7f8139960700 1 -- 172.21.15.36:0/2313179748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8118003910 msgr2=0x7f8118003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:13.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.695+0000 7f8139960700 1 --2- 172.21.15.36:0/2313179748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8118003910 0x7f8118003d10 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f811c00c000 tx=0x7f811c006df0).stop 2022-01-10T01:29:13.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.695+0000 7f813915f700 1 -- 172.21.15.36:0/2313179748 reap_dead start 2022-01-10T01:29:13.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.695+0000 7f8139960700 1 -- 172.21.15.36:0/2313179748 shutdown_connections 2022-01-10T01:29:13.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.695+0000 7f8139960700 1 -- 172.21.15.36:0/2313179748 >> 172.21.15.36:0/2313179748 conn(0x7f8134060180 msgr2=0x7f81340b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:13.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.695+0000 7f8139960700 1 -- 172.21.15.36:0/2313179748 shutdown_connections 2022-01-10T01:29:13.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.695+0000 7f8139960700 1 -- 172.21.15.36:0/2313179748 wait complete. 2022-01-10T01:29:13.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.695+0000 7f8139960700 1 Processor -- start 2022-01-10T01:29:13.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.695+0000 7f8139960700 1 -- start start 2022-01-10T01:29:13.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f8139960700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8118003910 0x7f813405c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:13.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f8139960700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340aa0d0 0x7f81340aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:13.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f8139960700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81340aac20 0x7f8134065f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:13.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f8139960700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81340abbf0 con 0x7f81340aac20 2022-01-10T01:29:13.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f8139960700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81341573d0 con 0x7f8118003910 2022-01-10T01:29:13.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f8139960700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8134157670 con 0x7f81340aa0d0 2022-01-10T01:29:13.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f813915f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81340aac20 0x7f8134065f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:13.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f813915f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81340aac20 0x7f8134065f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36860/0 (socket says 172.21.15.36:36860) 2022-01-10T01:29:13.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f813895e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8118003910 0x7f813405c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:13.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f813915f700 1 -- 172.21.15.36:0/2730214339 learned_addr learned my addr 172.21.15.36:0/2730214339 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:13.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f8133fff700 1 --2- 172.21.15.36:0/2730214339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340aa0d0 0x7f81340aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:13.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f813915f700 1 -- 172.21.15.36:0/2730214339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340aa0d0 msgr2=0x7f81340aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:13.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f813915f700 1 --2- 172.21.15.36:0/2730214339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340aa0d0 0x7f81340aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:13.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f813915f700 1 -- 172.21.15.36:0/2730214339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8118003910 msgr2=0x7f813405c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:13.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f813915f700 1 --2- 172.21.15.36:0/2730214339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8118003910 0x7f813405c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:13.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f813915f700 1 -- 172.21.15.36:0/2730214339 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8134157090 con 0x7f81340aac20 2022-01-10T01:29:13.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f813895e700 1 --2- 172.21.15.36:0/2730214339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8118003910 0x7f813405c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:13.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f813915f700 1 --2- 172.21.15.36:0/2730214339 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81340aac20 0x7f8134065f00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f8124001840 tx=0x7f8124009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:13.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f8131ffb700 1 -- 172.21.15.36:0/2730214339 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81240070d0 con 0x7f81340aac20 2022-01-10T01:29:13.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f8139960700 1 -- 172.21.15.36:0/2730214339 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81340ac320 con 0x7f81340aac20 2022-01-10T01:29:13.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f8131ffb700 1 -- 172.21.15.36:0/2730214339 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8124007230 con 0x7f81340aac20 2022-01-10T01:29:13.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f8131ffb700 1 -- 172.21.15.36:0/2730214339 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8124004710 con 0x7f81340aac20 2022-01-10T01:29:13.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.699+0000 7f8139960700 1 -- 172.21.15.36:0/2730214339 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81340ab810 con 0x7f81340aac20 2022-01-10T01:29:13.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.703+0000 7f8131ffb700 1 -- 172.21.15.36:0/2730214339 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8124004870 con 0x7f81340aac20 2022-01-10T01:29:13.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.703+0000 7f8139960700 1 -- 172.21.15.36:0/2730214339 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8134057350 con 0x7f81340aac20 2022-01-10T01:29:13.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.703+0000 7f8131ffb700 1 --2- 172.21.15.36:0/2730214339 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f810c053680 0x7f810c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:13.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.703+0000 7f8131ffb700 1 -- 172.21.15.36:0/2730214339 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f812406aad0 con 0x7f81340aac20 2022-01-10T01:29:13.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.703+0000 7f813895e700 1 --2- 172.21.15.36:0/2730214339 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f810c053680 0x7f810c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:13.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.703+0000 7f813895e700 1 --2- 172.21.15.36:0/2730214339 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f810c053680 0x7f810c055b40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f811c01e000 tx=0x7f811c019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:13.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.707+0000 7f8131ffb700 1 -- 172.21.15.36:0/2730214339 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8124041a40 con 0x7f81340aac20 2022-01-10T01:29:13.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.831+0000 7f8139960700 1 -- 172.21.15.36:0/2730214339 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8134146ea0 con 0x7f81340aac20 2022-01-10T01:29:13.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.835+0000 7f8131ffb700 1 -- 172.21.15.36:0/2730214339 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v56) v1 ==== 81+0+34039 (secure 0 0 0) 0x7f8124045060 con 0x7f81340aac20 2022-01-10T01:29:13.837 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:13.838 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:29:13.838 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 56, 2022-01-10T01:29:13.838 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:29:13.838 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:29:13.839 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:27:53.595841+0000", 2022-01-10T01:29:13.839 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:29:13.839 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:29:13.839 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:29:13.839 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:29:13.840 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:29:13.840 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:29:13.840 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:29:13.840 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:29:13.841 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:29:13.841 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:29:13.841 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:29:13.841 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:29:13.841 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:29:13.842 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:29:13.842 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:29:13.842 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 10, 2022-01-10T01:29:13.842 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:29:13.843 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:29:13.843 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:29:13.843 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:29:13.843 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:29:13.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.844 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:29:13.844 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:29:13.844 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:29:13.844 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:29:13.845 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:29:13.845 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:29:13.845 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:29:13.845 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:29:13.845 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:29:13.846 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:29:13.846 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:29:13.846 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:29:13.846 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:29:13.846 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:29:13.847 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:29:13.847 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:29:13.847 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:29:13.847 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:29:13.848 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:29:13.848 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:29:13.848 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:29:13.848 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:29:13.848 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:29:13.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.849 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:29:13.849 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:29:13.849 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:29:13.850 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:29:13.850 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:29:13.850 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:29:13.850 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:29:13.850 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:29:13.851 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:29:13.851 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:29:13.851 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:29:13.851 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:29:13.852 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:29:13.852 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:29:13.852 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:29:13.852 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:29:13.852 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:29:13.853 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:29:13.853 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:29:13.853 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:29:13.853 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:29:13.854 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:29:13.854 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:29:13.854 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:29:13.854 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:29:13.855 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:29:13.855 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:29:13.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.855 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:29:13.855 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:29:13.856 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:29:13.856 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:29:13.856 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:29:13.856 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:29:13.856 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:29:13.857 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:29:13.857 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:29:13.857 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:29:13.857 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:29:13.858 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:29:13.858 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:29:13.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.858 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:29:13.859 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:29:13.859 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.860 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:29:13.860 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:29:13.860 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:29:13.860 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:29:13.860 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:29:13.861 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:29:13.861 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:29:13.861 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:29:13.861 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:29:13.862 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:29:13.862 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:29:13.862 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:29:13.862 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:29:13.862 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:29:13.863 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:29:13.863 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:29:13.863 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:29:13.863 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:29:13.864 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:29:13.864 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:29:13.864 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:29:13.864 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:29:13.864 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:29:13.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.865 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:29:13.865 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:29:13.865 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:29:13.865 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:29:13.866 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:29:13.866 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:29:13.866 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:29:13.866 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:29:13.867 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:29:13.867 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:29:13.867 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:29:13.867 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:29:13.867 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:29:13.868 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:29:13.868 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:29:13.868 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:29:13.868 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:29:13.868 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:29:13.869 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:29:13.869 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:29:13.869 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:29:13.869 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:29:13.869 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:29:13.870 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:29:13.870 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:29:13.870 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:29:13.870 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:29:13.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.871 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:29:13.871 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:29:13.871 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:29:13.871 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:29:13.872 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:29:13.872 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:29:13.872 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:29:13.872 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:29:13.872 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:29:13.873 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:29:13.873 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:29:13.873 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:29:13.873 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:29:13.874 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:29:13.874 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.874 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 9, 2022-01-10T01:29:13.875 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_metadata", 2022-01-10T01:29:13.875 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:27:51.027021+0000", 2022-01-10T01:29:13.875 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:29:13.875 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:29:13.875 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:29:13.876 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:29:13.876 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:29:13.876 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:29:13.876 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:29:13.877 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:29:13.877 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:29:13.877 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:29:13.877 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:29:13.877 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:29:13.878 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:29:13.878 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:29:13.878 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:29:13.878 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:29:13.879 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:29:13.879 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:29:13.879 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:29:13.879 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:29:13.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.880 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "55", 2022-01-10T01:29:13.880 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:29:13.880 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:29:13.880 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:29:13.881 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:29:13.881 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:29:13.881 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:29:13.881 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:29:13.881 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:29:13.882 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:29:13.882 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:29:13.882 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:29:13.882 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:29:13.883 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:29:13.883 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:29:13.883 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:29:13.883 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:29:13.883 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:29:13.884 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:29:13.884 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:29:13.884 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:29:13.884 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:29:13.885 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:29:13.885 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:29:13.885 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:29:13.885 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:29:13.886 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:29:13.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.886 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:29:13.886 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:29:13.886 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:29:13.887 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:29:13.887 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:29:13.887 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:29:13.887 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:29:13.888 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:29:13.888 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:29:13.888 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:29:13.888 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:29:13.888 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:29:13.889 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_bias": 4, 2022-01-10T01:29:13.889 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 16, 2022-01-10T01:29:13.889 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_priority": 5 2022-01-10T01:29:13.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.890 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:29:13.890 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:29:13.890 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": "cephfs" 2022-01-10T01:29:13.890 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.890 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.891 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 10, 2022-01-10T01:29:13.891 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_data", 2022-01-10T01:29:13.892 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:27:52.032505+0000", 2022-01-10T01:29:13.892 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:29:13.892 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:29:13.892 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:29:13.892 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:29:13.893 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:29:13.893 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:29:13.893 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:29:13.893 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:29:13.893 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:29:13.894 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:29:13.894 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:29:13.894 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:29:13.894 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:29:13.895 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:29:13.895 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:29:13.895 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:29:13.895 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:29:13.895 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:29:13.896 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:29:13.896 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:29:13.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.896 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "56", 2022-01-10T01:29:13.897 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:29:13.897 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:29:13.897 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:29:13.897 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:29:13.897 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:29:13.898 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:29:13.898 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:29:13.898 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:29:13.898 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:29:13.898 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:29:13.899 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:29:13.899 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:29:13.899 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:29:13.899 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:29:13.900 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:29:13.900 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:29:13.900 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:29:13.900 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:29:13.900 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:29:13.901 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:29:13.901 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:29:13.901 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:29:13.901 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:29:13.902 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:29:13.902 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:29:13.902 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:29:13.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.902 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:29:13.903 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:29:13.903 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:29:13.903 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:29:13.903 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:29:13.904 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:29:13.904 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:29:13.904 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:29:13.904 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:29:13.904 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:29:13.905 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:29:13.905 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:29:13.905 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:29:13.905 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:29:13.906 INFO:teuthology.orchestra.run.smithi036.stdout: "data": "cephfs" 2022-01-10T01:29:13.906 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.906 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.906 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.906 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:29:13.907 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:29:13.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.907 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:29:13.907 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:29:13.908 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:13.908 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:13.908 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:13.908 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:13.908 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:13.909 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:13.909 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:13.909 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 54, 2022-01-10T01:29:13.909 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:13.909 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:13.910 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:13.910 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.910 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.911 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:29:13.911 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:13.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.911 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.912 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:29:13.912 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:13.912 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.912 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.913 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:13.913 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.913 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.914 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:29:13.914 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:13.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.914 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.915 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:29:13.915 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:13.915 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.915 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.916 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.916 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:13.916 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.916 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.917 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:29:13.917 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:13.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.918 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.918 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:29:13.918 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:13.918 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.918 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.919 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:13.919 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.920 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.920 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:29:13.920 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:13.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.921 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.921 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:29:13.921 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:13.922 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.922 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.922 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.922 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:29:13.923 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:29:13.923 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:29:13.923 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:29:13.924 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:13.924 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:13.924 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:13.924 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.924 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.925 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:29:13.925 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:29:13.926 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:13.926 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:13.926 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:13.926 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:13.927 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:13.927 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:13.927 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:13.927 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 43, 2022-01-10T01:29:13.927 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:13.928 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:13.928 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:13.928 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.929 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.929 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:29:13.929 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:13.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.930 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.930 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:29:13.931 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:13.931 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.931 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.932 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:13.932 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.933 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.933 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:29:13.933 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:13.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.934 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.934 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:29:13.934 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:13.934 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.935 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.935 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:13.935 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.936 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.936 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.936 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:29:13.936 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:13.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.937 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.937 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:29:13.937 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:13.937 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.938 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.938 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:13.938 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.939 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.939 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.939 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:29:13.939 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:13.940 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.940 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.940 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:29:13.940 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:13.941 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.941 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.941 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:29:13.941 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:29:13.942 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:29:13.942 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:29:13.942 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:13.942 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:13.943 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:13.943 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.944 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:29:13.944 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:29:13.944 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:13.944 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:13.944 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:13.945 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:13.945 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:13.945 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:13.945 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:13.945 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 54, 2022-01-10T01:29:13.946 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:13.946 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:13.946 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:13.946 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.947 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.947 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.947 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:29:13.947 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:13.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.948 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.948 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:29:13.948 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:13.948 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.949 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.949 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:13.949 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.950 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.950 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:29:13.950 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:13.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.951 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.951 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:29:13.951 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:13.952 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.952 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.952 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:13.953 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.953 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.953 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:29:13.953 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:13.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.954 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.954 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:29:13.954 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:13.955 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.955 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.955 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:13.956 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.956 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.956 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:29:13.957 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:13.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.957 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.957 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:29:13.958 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:13.958 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.958 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.958 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.959 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:29:13.959 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:29:13.959 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:29:13.959 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:29:13.959 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:13.960 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:13.960 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:13.960 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.960 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.961 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:29:13.961 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:29:13.961 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:13.961 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:13.961 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:13.962 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:13.962 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:13.962 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:13.962 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:13.963 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 54, 2022-01-10T01:29:13.963 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:13.963 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:13.963 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:13.964 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.964 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.964 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.964 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:29:13.964 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:13.965 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.965 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.965 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.965 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:29:13.966 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:13.966 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.966 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.967 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:13.967 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.967 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.967 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:29:13.968 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:13.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.968 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.968 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.968 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:29:13.969 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:13.969 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.969 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.969 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.970 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:13.970 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.970 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.970 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:29:13.971 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:13.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.971 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.971 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.972 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:29:13.972 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:13.972 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.972 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.972 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.973 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:13.973 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.973 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.973 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:29:13.974 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:13.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.974 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.974 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.975 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:29:13.975 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:13.975 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.975 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.975 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.976 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:29:13.976 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:29:13.976 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:29:13.976 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:29:13.977 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:13.977 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:13.977 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:13.977 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.977 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.978 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.978 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:29:13.978 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:29:13.978 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:13.979 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:13.979 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:13.979 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:13.979 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:13.979 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:13.980 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:13.980 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 54, 2022-01-10T01:29:13.980 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:13.980 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:13.980 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:13.981 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.981 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.981 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.981 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:29:13.981 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:13.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.982 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.982 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:29:13.982 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:13.983 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.983 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.983 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.983 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:13.983 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.984 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.984 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.984 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:29:13.984 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:13.985 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.985 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.985 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.985 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:29:13.985 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:13.986 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.986 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.986 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.986 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:13.987 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.987 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.987 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:29:13.987 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:13.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.988 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.988 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.988 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:29:13.988 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:13.989 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.989 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.989 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.989 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:13.989 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.990 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.990 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:29:13.990 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:13.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.991 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.991 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.991 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:29:13.991 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:13.992 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.992 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.992 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.992 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:29:13.992 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:29:13.993 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:29:13.993 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:29:13.993 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:13.993 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:13.993 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:13.994 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:13.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.994 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.994 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:29:13.994 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:29:13.995 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:13.995 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:13.995 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:13.995 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:13.995 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:13.996 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:13.996 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:13.996 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 54, 2022-01-10T01:29:13.996 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:13.996 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:13.997 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:13.997 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:13.997 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.997 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:13.997 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:29:13.998 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:13.998 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:13.998 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:13.998 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:13.999 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:29:13.999 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:13.999 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:13.999 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.000 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.000 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:14.000 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:14.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.000 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:14.000 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:29:14.001 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:14.001 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.001 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.001 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:14.001 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:29:14.002 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:14.002 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:14.002 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.002 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.003 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:14.003 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:14.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.003 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:14.003 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:29:14.004 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:14.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.004 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:14.004 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:29:14.005 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:14.005 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:14.005 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.005 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:14.006 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:14.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.006 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:14.006 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:29:14.006 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:14.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.007 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:14.007 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:29:14.007 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:14.008 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:14.008 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.008 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:29:14.008 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:29:14.009 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:29:14.009 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:29:14.009 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:14.009 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:14.009 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:14.010 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.010 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:29:14.010 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:29:14.011 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:14.011 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:14.011 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:14.011 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:14.011 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:14.012 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:14.012 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:14.012 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 53, 2022-01-10T01:29:14.012 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:14.012 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:14.013 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:14.013 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:14.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.013 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:14.013 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:29:14.014 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:14.014 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.014 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.014 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:14.014 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:29:14.015 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:14.015 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:14.015 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.015 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:14.016 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:14.016 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.016 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:14.016 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:29:14.017 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:14.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.017 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:14.017 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:29:14.018 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:14.018 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:14.018 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.018 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.018 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:14.019 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:14.019 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.019 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:14.019 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:29:14.020 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:14.020 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.020 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:14.020 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:29:14.021 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:14.021 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:14.021 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.021 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:14.022 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:14.022 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.022 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:14.022 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:29:14.023 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:14.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.023 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:14.023 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:29:14.023 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:14.024 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:14.024 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.024 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:29:14.024 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:29:14.025 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:29:14.025 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:29:14.025 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:14.025 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:14.026 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:14.026 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.027 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:29:14.027 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:29:14.027 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:14.027 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:14.027 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:14.028 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:14.028 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:14.028 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:14.028 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:14.028 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 53, 2022-01-10T01:29:14.029 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:14.029 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:14.029 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:14.029 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:14.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.030 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:14.030 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:29:14.030 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:14.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.031 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:14.031 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:29:14.031 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:14.032 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:14.032 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.032 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:14.033 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:14.033 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.033 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:14.033 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:29:14.033 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:14.034 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.034 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.034 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:14.035 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:29:14.035 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:14.035 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:14.035 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.036 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.036 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:14.036 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:14.036 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.036 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:14.037 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:29:14.037 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:14.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.038 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:14.038 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:29:14.038 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:14.038 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:14.038 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.039 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:14.039 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:14.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.040 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:14.040 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:29:14.040 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:14.040 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.040 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.041 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:14.041 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:29:14.041 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:14.041 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:14.041 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.042 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.042 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:29:14.042 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:29:14.042 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:29:14.043 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:29:14.043 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:14.043 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:14.043 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:14.043 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:14.044 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:14.044 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:29:14.044 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:29:14.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.044 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:29:14.045 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:14.045 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:14.045 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:14.045 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:14.046 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:14.046 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:29:14.046 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:14.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.047 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:29:14.047 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:14.047 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:14.047 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:14.047 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:14.048 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:14.048 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:29:14.048 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:14.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.049 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:29:14.049 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:14.049 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:14.049 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:14.049 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:14.050 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:14.050 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:29:14.050 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:14.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.051 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.051 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:29:14.051 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:14.051 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:14.051 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:14.052 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:14.052 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:14.052 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:29:14.052 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:14.053 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.053 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.053 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:29:14.053 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:14.053 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:14.054 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:14.054 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:14.054 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:14.054 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:29:14.055 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:14.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.055 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.055 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:29:14.055 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:14.056 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:14.056 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:14.056 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:14.056 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:14.056 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:29:14.057 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:14.057 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.057 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.057 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:29:14.058 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:14.058 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:14.058 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:14.058 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:14.058 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:14.059 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:29:14.059 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:14.059 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.059 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:14.060 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:29:14.060 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:14.060 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:14.060 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:14.060 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:14.061 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:14.061 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:29:14.061 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:14.061 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:14.062 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:29:14.062 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:29:14.062 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:29:14.062 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:29:14.062 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:29:14.063 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2022-01-10T01:29:14.063 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:29:14.063 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:29:14.063 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:29:14.063 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:29:14.064 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:29:14.064 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:29:14.064 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:29:14.064 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:29:14.065 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:29:14.065 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:29:14.065 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:29:14.065 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:29:14.066 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.066 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:29:14.066 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:29:14.066 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:29:14.066 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:29:14.067 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:29:14.067 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:29:14.067 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:29:14.067 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:14.068 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:14.068 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:29:14.068 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:29:14.068 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:29:14.068 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:29:14.069 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:29:14.069 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:29:14.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.839+0000 7f8139960700 1 -- 172.21.15.36:0/2730214339 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f810c053680 msgr2=0x7f810c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:14.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.839+0000 7f8139960700 1 --2- 172.21.15.36:0/2730214339 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f810c053680 0x7f810c055b40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f811c01e000 tx=0x7f811c019000).stop 2022-01-10T01:29:14.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.839+0000 7f8139960700 1 -- 172.21.15.36:0/2730214339 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81340aac20 msgr2=0x7f8134065f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:14.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.839+0000 7f8139960700 1 --2- 172.21.15.36:0/2730214339 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81340aac20 0x7f8134065f00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f8124001840 tx=0x7f8124009040).stop 2022-01-10T01:29:14.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.839+0000 7f8139960700 1 -- 172.21.15.36:0/2730214339 shutdown_connections 2022-01-10T01:29:14.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.839+0000 7f8139960700 1 --2- 172.21.15.36:0/2730214339 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f810c053680 0x7f810c055b40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.839+0000 7f8139960700 1 --2- 172.21.15.36:0/2730214339 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81340aac20 0x7f8134065f00 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.839+0000 7f8139960700 1 --2- 172.21.15.36:0/2730214339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340aa0d0 0x7f81340aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.839+0000 7f8139960700 1 --2- 172.21.15.36:0/2730214339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8118003910 0x7f813405c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.839+0000 7f8139960700 1 -- 172.21.15.36:0/2730214339 >> 172.21.15.36:0/2730214339 conn(0x7f8134060180 msgr2=0x7f8134149b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:14.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.839+0000 7f8139960700 1 -- 172.21.15.36:0/2730214339 shutdown_connections 2022-01-10T01:29:14.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:13.839+0000 7f8139960700 1 -- 172.21.15.36:0/2730214339 wait complete. 2022-01-10T01:29:14.074 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:29:14.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d8f2a700 1 Processor -- start 2022-01-10T01:29:14.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d8f2a700 1 -- start start 2022-01-10T01:29:14.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d8f2a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc6d4061320 0x7fc6d4061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:14.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d8f2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6d40ad5c0 0x7fc6d40b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:14.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d8f2a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6d4140440 0x7fc6d41408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:14.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d8f2a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d40aecf0 con 0x7fc6d4061320 2022-01-10T01:29:14.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d8f2a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6d40b6f20 con 0x7fc6d4140440 2022-01-10T01:29:14.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d8f2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40aef20 con 0x7fc6d40ad5c0 2022-01-10T01:29:14.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d37fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc6d4061320 0x7fc6d4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:14.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d37fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc6d4061320 0x7fc6d4061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36864/0 (socket says 172.21.15.36:36864) 2022-01-10T01:29:14.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d37fe700 1 -- 172.21.15.36:0/1360819660 learned_addr learned my addr 172.21.15.36:0/1360819660 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:14.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d3fff700 1 --2- 172.21.15.36:0/1360819660 >> v2:172.21.15.59:3300/0 conn(0x7fc6d4140440 0x7fc6d41408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:14.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d2ffd700 1 --2- 172.21.15.36:0/1360819660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6d40ad5c0 0x7fc6d40b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:14.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d37fe700 1 -- 172.21.15.36:0/1360819660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6d40ad5c0 msgr2=0x7fc6d40b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:14.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d37fe700 1 --2- 172.21.15.36:0/1360819660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6d40ad5c0 0x7fc6d40b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d37fe700 1 -- 172.21.15.36:0/1360819660 >> v2:172.21.15.59:3300/0 conn(0x7fc6d4140440 msgr2=0x7fc6d41408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:14.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d37fe700 1 --2- 172.21.15.36:0/1360819660 >> v2:172.21.15.59:3300/0 conn(0x7fc6d4140440 0x7fc6d41408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d37fe700 1 -- 172.21.15.36:0/1360819660 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d40af1c0 con 0x7fc6d4061320 2022-01-10T01:29:14.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d2ffd700 1 --2- 172.21.15.36:0/1360819660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6d40ad5c0 0x7fc6d40b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:14.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d37fe700 1 --2- 172.21.15.36:0/1360819660 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6d4061320 0x7fc6d4061700 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fc6c4002f70 tx=0x7fc6c4006eb0).ready entity=mon.0 client_cookie=2708606a11c2c7fa server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:14.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d27fc700 1 -- 172.21.15.36:0/1360819660 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6c400d570 con 0x7fc6d4061320 2022-01-10T01:29:14.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d27fc700 1 -- 172.21.15.36:0/1360819660 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c4000e90 con 0x7fc6d4061320 2022-01-10T01:29:14.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d27fc700 1 -- 172.21.15.36:0/1360819660 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6c400d900 con 0x7fc6d4061320 2022-01-10T01:29:14.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/1360819660 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6d4061320 msgr2=0x7fc6d4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:14.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.187+0000 7fc6d8f2a700 1 --2- 172.21.15.36:0/1360819660 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6d4061320 0x7fc6d4061700 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fc6c4002f70 tx=0x7fc6c4006eb0).stop 2022-01-10T01:29:14.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/1360819660 shutdown_connections 2022-01-10T01:29:14.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 --2- 172.21.15.36:0/1360819660 >> v2:172.21.15.59:3300/0 conn(0x7fc6d4140440 0x7fc6d41408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 --2- 172.21.15.36:0/1360819660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6d40ad5c0 0x7fc6d40b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 --2- 172.21.15.36:0/1360819660 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6d4061320 0x7fc6d4061700 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/1360819660 >> 172.21.15.36:0/1360819660 conn(0x7fc6d4066de0 msgr2=0x7fc6d40671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:14.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/1360819660 shutdown_connections 2022-01-10T01:29:14.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/1360819660 wait complete. 2022-01-10T01:29:14.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 Processor -- start 2022-01-10T01:29:14.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 -- start start 2022-01-10T01:29:14.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4061320 0x7fc6d40b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:14.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6d40ad5c0 0x7fc6d4155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:14.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6d4140440 0x7fc6d40b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:14.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40b0330 con 0x7fc6d4140440 2022-01-10T01:29:14.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d41565b0 con 0x7fc6d4061320 2022-01-10T01:29:14.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d8f2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40b0560 con 0x7fc6d40ad5c0 2022-01-10T01:29:14.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d3fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6d4140440 0x7fc6d40b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:14.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6d40ad5c0 0x7fc6d4155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:14.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.191+0000 7fc6d37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4061320 0x7fc6d40b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:14.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6d40ad5c0 0x7fc6d4155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:43154/0 (socket says 172.21.15.36:43154) 2022-01-10T01:29:14.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d2ffd700 1 -- 172.21.15.36:0/2287415971 learned_addr learned my addr 172.21.15.36:0/2287415971 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:14.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d2ffd700 1 -- 172.21.15.36:0/2287415971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4061320 msgr2=0x7fc6d40b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:14.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d2ffd700 1 --2- 172.21.15.36:0/2287415971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4061320 0x7fc6d40b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d2ffd700 1 -- 172.21.15.36:0/2287415971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6d4140440 msgr2=0x7fc6d40b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:14.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d2ffd700 1 --2- 172.21.15.36:0/2287415971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6d4140440 0x7fc6d40b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d2ffd700 1 -- 172.21.15.36:0/2287415971 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c400b1e0 con 0x7fc6d40ad5c0 2022-01-10T01:29:14.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d3fff700 1 --2- 172.21.15.36:0/2287415971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6d4140440 0x7fc6d40b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:14.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d2ffd700 1 --2- 172.21.15.36:0/2287415971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6d40ad5c0 0x7fc6d4155cd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc6bc006940 tx=0x7fc6bc008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:14.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d0ff9700 1 -- 172.21.15.36:0/2287415971 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6bc011780 con 0x7fc6d40ad5c0 2022-01-10T01:29:14.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d0ff9700 1 -- 172.21.15.36:0/2287415971 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc0118e0 con 0x7fc6d40ad5c0 2022-01-10T01:29:14.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/2287415971 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d4156310 con 0x7fc6d40ad5c0 2022-01-10T01:29:14.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d0ff9700 1 -- 172.21.15.36:0/2287415971 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6bc011c40 con 0x7fc6d40ad5c0 2022-01-10T01:29:14.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/2287415971 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d4145ee0 con 0x7fc6d40ad5c0 2022-01-10T01:29:14.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/2287415971 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d40b00d0 con 0x7fc6d40ad5c0 2022-01-10T01:29:14.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.195+0000 7fc6d0ff9700 1 -- 172.21.15.36:0/2287415971 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc6bc012420 con 0x7fc6d40ad5c0 2022-01-10T01:29:14.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.199+0000 7fc6d0ff9700 1 --2- 172.21.15.36:0/2287415971 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc6b8053500 0x7fc6b80559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:14.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.199+0000 7fc6d0ff9700 1 -- 172.21.15.36:0/2287415971 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc6bc06b830 con 0x7fc6d40ad5c0 2022-01-10T01:29:14.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.199+0000 7fc6d37fe700 1 --2- 172.21.15.36:0/2287415971 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc6b8053500 0x7fc6b80559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:14.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.199+0000 7fc6d37fe700 1 --2- 172.21.15.36:0/2287415971 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc6b8053500 0x7fc6b80559c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fc6c401c000 tx=0x7fc6c4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:14.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.207+0000 7fc6d0ff9700 1 -- 172.21.15.36:0/2287415971 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc6bc0427e0 con 0x7fc6d40ad5c0 2022-01-10T01:29:14.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.371+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/2287415971 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6d40af460 con 0x7fc6d40ad5c0 2022-01-10T01:29:14.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.371+0000 7fc6d0ff9700 1 -- 172.21.15.36:0/2287415971 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2496 (secure 0 0 0) 0x7fc6bc045e00 con 0x7fc6d40ad5c0 2022-01-10T01:29:14.373 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:14.373 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1806166752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1806166752},{"type":"v1","addr":"172.21.15.36:6837","nonce":1806166752}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":35141,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2577386810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2577386810},{"type":"v1","addr":"172.21.15.36:6835","nonce":2577386810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:27:52.591733+0000","modified":"2022-01-10T01:27:53.595043+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35150":{"gid":35150,"name":"b","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1363567016","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1363567016},{"type":"v1","addr":"172.21.15.59:6833","nonce":1363567016}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2022-01-10T01:29:14.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.375+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/2287415971 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc6b8053500 msgr2=0x7fc6b80559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:14.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.375+0000 7fc6d8f2a700 1 --2- 172.21.15.36:0/2287415971 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc6b8053500 0x7fc6b80559c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fc6c401c000 tx=0x7fc6c4015000).stop 2022-01-10T01:29:14.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.375+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/2287415971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6d40ad5c0 msgr2=0x7fc6d4155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:14.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.375+0000 7fc6d8f2a700 1 --2- 172.21.15.36:0/2287415971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6d40ad5c0 0x7fc6d4155cd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fc6bc006940 tx=0x7fc6bc008040).stop 2022-01-10T01:29:14.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.375+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/2287415971 shutdown_connections 2022-01-10T01:29:14.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.375+0000 7fc6d8f2a700 1 --2- 172.21.15.36:0/2287415971 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc6b8053500 0x7fc6b80559c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.375+0000 7fc6d8f2a700 1 --2- 172.21.15.36:0/2287415971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6d4140440 0x7fc6d40b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.375+0000 7fc6d8f2a700 1 --2- 172.21.15.36:0/2287415971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6d40ad5c0 0x7fc6d4155cd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.375+0000 7fc6d8f2a700 1 --2- 172.21.15.36:0/2287415971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc6d4061320 0x7fc6d40b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.375+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/2287415971 >> 172.21.15.36:0/2287415971 conn(0x7fc6d4066de0 msgr2=0x7fc6d4146780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:14.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.375+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/2287415971 shutdown_connections 2022-01-10T01:29:14.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.375+0000 7fc6d8f2a700 1 -- 172.21.15.36:0/2287415971 wait complete. 2022-01-10T01:29:14.378 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 24 2022-01-10T01:29:14.386 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2022-01-10T01:29:14.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.487+0000 7fe7d4019700 1 Processor -- start 2022-01-10T01:29:14.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.487+0000 7fe7d4019700 1 -- start start 2022-01-10T01:29:14.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.487+0000 7fe7d4019700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe7cc0b6580 0x7fe7cc0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:14.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.487+0000 7fe7d4019700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7cc0b43c0 0x7fe7cc0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:14.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.487+0000 7fe7d4019700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7cc1440b0 con 0x7fe7cc061d30 2022-01-10T01:29:14.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.487+0000 7fe7d4019700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7cc0b6e50 con 0x7fe7cc0b6580 2022-01-10T01:29:14.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.487+0000 7fe7d4019700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc143b70 con 0x7fe7cc0b43c0 2022-01-10T01:29:14.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.487+0000 7fe7d1db5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe7cc0b6580 0x7fe7cc0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:14.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d15b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7cc0b43c0 0x7fe7cc0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:14.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d25b6700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe7cc061d30 0x7fe7cc1466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:52352/0 (socket says 172.21.15.36:52352) 2022-01-10T01:29:14.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d25b6700 1 -- 172.21.15.36:0/498492536 learned_addr learned my addr 172.21.15.36:0/498492536 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:14.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d15b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7cc0b43c0 0x7fe7cc0b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:43160/0 (socket says 172.21.15.36:43160) 2022-01-10T01:29:14.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d1db5700 1 -- 172.21.15.36:0/498492536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7cc0b43c0 msgr2=0x7fe7cc0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:14.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d1db5700 1 --2- 172.21.15.36:0/498492536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7cc0b43c0 0x7fe7cc0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d1db5700 1 -- 172.21.15.36:0/498492536 >> v1:172.21.15.59:6789/0 conn(0x7fe7cc061d30 legacy=0x7fe7cc1466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:14.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d1db5700 1 -- 172.21.15.36:0/498492536 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc143e10 con 0x7fe7cc0b6580 2022-01-10T01:29:14.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d1db5700 1 --2- 172.21.15.36:0/498492536 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7cc0b6580 0x7fe7cc0b5bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fe7bc002f70 tx=0x7fe7bc006df0).ready entity=mon.0 client_cookie=7898757de033345e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:14.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d0db3700 1 -- 172.21.15.36:0/498492536 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7bc00d570 con 0x7fe7cc0b6580 2022-01-10T01:29:14.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d0db3700 1 -- 172.21.15.36:0/498492536 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc000e90 con 0x7fe7cc0b6580 2022-01-10T01:29:14.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d0db3700 1 -- 172.21.15.36:0/498492536 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7bc00d8c0 con 0x7fe7cc0b6580 2022-01-10T01:29:14.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d4019700 1 -- 172.21.15.36:0/498492536 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7cc0b6580 msgr2=0x7fe7cc0b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:14.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d4019700 1 --2- 172.21.15.36:0/498492536 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7cc0b6580 0x7fe7cc0b5bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fe7bc002f70 tx=0x7fe7bc006df0).stop 2022-01-10T01:29:14.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d4019700 1 -- 172.21.15.36:0/498492536 shutdown_connections 2022-01-10T01:29:14.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d4019700 1 --2- 172.21.15.36:0/498492536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7cc0b43c0 0x7fe7cc0b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d4019700 1 --2- 172.21.15.36:0/498492536 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7cc0b6580 0x7fe7cc0b5bf0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d4019700 1 -- 172.21.15.36:0/498492536 >> 172.21.15.36:0/498492536 conn(0x7fe7cc05c490 msgr2=0x7fe7cc05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:14.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d4019700 1 -- 172.21.15.36:0/498492536 shutdown_connections 2022-01-10T01:29:14.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d4019700 1 -- 172.21.15.36:0/498492536 wait complete. 2022-01-10T01:29:14.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d4019700 1 Processor -- start 2022-01-10T01:29:14.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.491+0000 7fe7d4019700 1 -- start start 2022-01-10T01:29:14.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d4019700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7cc061d30 0x7fe7cc144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:14.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d4019700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7cc0b43c0 0x7fe7cc155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:14.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d4019700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7cc0b6580 0x7fe7cc155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:14.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d4019700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc1562f0 con 0x7fe7cc061d30 2022-01-10T01:29:14.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d4019700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc1482a0 con 0x7fe7cc0b6580 2022-01-10T01:29:14.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d4019700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc1495f0 con 0x7fe7cc0b43c0 2022-01-10T01:29:14.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d1db5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7cc061d30 0x7fe7cc144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:14.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d1db5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7cc061d30 0x7fe7cc144b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36886/0 (socket says 172.21.15.36:36886) 2022-01-10T01:29:14.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d1db5700 1 -- 172.21.15.36:0/2022971201 learned_addr learned my addr 172.21.15.36:0/2022971201 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:14.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d15b4700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7cc0b43c0 0x7fe7cc155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:14.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d25b6700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7cc0b6580 0x7fe7cc155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:14.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d1db5700 1 -- 172.21.15.36:0/2022971201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7cc0b43c0 msgr2=0x7fe7cc155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:14.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d1db5700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7cc0b43c0 0x7fe7cc155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d1db5700 1 -- 172.21.15.36:0/2022971201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7cc0b6580 msgr2=0x7fe7cc155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:14.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d1db5700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7cc0b6580 0x7fe7cc155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:14.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d1db5700 1 -- 172.21.15.36:0/2022971201 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc00b180 con 0x7fe7cc061d30 2022-01-10T01:29:14.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d15b4700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7cc0b43c0 0x7fe7cc155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:14.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d1db5700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7cc061d30 0x7fe7cc144b60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fe7cc156430 tx=0x7fe7bc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:14.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7caffd700 1 -- 172.21.15.36:0/2022971201 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7bc00dea0 con 0x7fe7cc061d30 2022-01-10T01:29:14.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7caffd700 1 -- 172.21.15.36:0/2022971201 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc01e400 con 0x7fe7cc061d30 2022-01-10T01:29:14.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d4019700 1 -- 172.21.15.36:0/2022971201 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7cc1484d0 con 0x7fe7cc061d30 2022-01-10T01:29:14.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7caffd700 1 -- 172.21.15.36:0/2022971201 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7bc01e760 con 0x7fe7cc061d30 2022-01-10T01:29:14.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d4019700 1 -- 172.21.15.36:0/2022971201 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7cc0b3000 con 0x7fe7cc061d30 2022-01-10T01:29:14.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.495+0000 7fe7d4019700 1 -- 172.21.15.36:0/2022971201 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7cc0615f0 con 0x7fe7cc061d30 2022-01-10T01:29:14.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.499+0000 7fe7caffd700 1 -- 172.21.15.36:0/2022971201 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe7bc025030 con 0x7fe7cc061d30 2022-01-10T01:29:14.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.499+0000 7fe7caffd700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7ac053680 0x7fe7ac055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:14.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.499+0000 7fe7caffd700 1 -- 172.21.15.36:0/2022971201 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe7bc06c910 con 0x7fe7cc061d30 2022-01-10T01:29:14.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.499+0000 7fe7d15b4700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7ac053680 0x7fe7ac055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:14.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.499+0000 7fe7d15b4700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7ac053680 0x7fe7ac055b40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fe7c000b000 tx=0x7fe7c0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:14.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.507+0000 7fe7caffd700 1 -- 172.21.15.36:0/2022971201 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe7bc043aa0 con 0x7fe7cc061d30 2022-01-10T01:29:14.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:14.671+0000 7fe7d4019700 1 -- 172.21.15.36:0/2022971201 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe7cc149340 con 0x7fe7cc061d30 2022-01-10T01:29:15.598 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:29:15.595+0000 7f0b5376f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:29:15.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.611+0000 7fe7caffd700 1 -- 172.21.15.36:0/2022971201 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe7bc023020 con 0x7fe7cc061d30 2022-01-10T01:29:15.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.615+0000 7fe7d4019700 1 -- 172.21.15.36:0/2022971201 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7ac053680 msgr2=0x7fe7ac055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:15.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.615+0000 7fe7d4019700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7ac053680 0x7fe7ac055b40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fe7c000b000 tx=0x7fe7c0008040).stop 2022-01-10T01:29:15.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.615+0000 7fe7d4019700 1 -- 172.21.15.36:0/2022971201 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7cc061d30 msgr2=0x7fe7cc144b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:15.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.615+0000 7fe7d4019700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7cc061d30 0x7fe7cc144b60 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fe7cc156430 tx=0x7fe7bc014000).stop 2022-01-10T01:29:15.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.615+0000 7fe7d4019700 1 -- 172.21.15.36:0/2022971201 shutdown_connections 2022-01-10T01:29:15.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.615+0000 7fe7d4019700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe7ac053680 0x7fe7ac055b40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:15.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.615+0000 7fe7d4019700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7cc0b6580 0x7fe7cc155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:15.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.615+0000 7fe7d4019700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7cc0b43c0 0x7fe7cc155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:15.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.615+0000 7fe7d4019700 1 --2- 172.21.15.36:0/2022971201 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7cc061d30 0x7fe7cc144b60 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:15.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.615+0000 7fe7d4019700 1 -- 172.21.15.36:0/2022971201 >> 172.21.15.36:0/2022971201 conn(0x7fe7cc05c490 msgr2=0x7fe7cc128af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:15.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.615+0000 7fe7d4019700 1 -- 172.21.15.36:0/2022971201 shutdown_connections 2022-01-10T01:29:15.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.615+0000 7fe7d4019700 1 -- 172.21.15.36:0/2022971201 wait complete. 2022-01-10T01:29:15.618 INFO:teuthology.orchestra.run.smithi036.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2022-01-10T01:29:15.630 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:29:15.649 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:29:15.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.739+0000 7f02df59e700 1 Processor -- start 2022-01-10T01:29:15.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.739+0000 7f02df59e700 1 -- start start 2022-01-10T01:29:15.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02df59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02e00ad320 0x7f02e00af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:15.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02df59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e00ad850 0x7f02e00a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:15.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02df59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e00afda0 con 0x7f02e00af2c0 2022-01-10T01:29:15.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02df59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e005c610 con 0x7f02e00ad320 2022-01-10T01:29:15.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02df59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e0140800 con 0x7f02e00ad850 2022-01-10T01:29:15.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02de59c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f02e00af2c0 0x7f02e0143150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34686/0 (socket says 172.21.15.36:34686) 2022-01-10T01:29:15.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02de59c700 1 -- 172.21.15.36:0/1996603173 learned_addr learned my addr 172.21.15.36:0/1996603173 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:15.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02d7fff700 1 --2- 172.21.15.36:0/1996603173 >> v2:172.21.15.59:3300/0 conn(0x7f02e00ad320 0x7f02e00af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:15.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02ded9d700 1 --2- 172.21.15.36:0/1996603173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e00ad850 0x7f02e00a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:15.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02ddd9b700 1 -- 172.21.15.36:0/1996603173 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000284556 0 0) 0x7f02e00afda0 con 0x7f02e00af2c0 2022-01-10T01:29:15.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02ddd9b700 1 -- 172.21.15.36:0/1996603173 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02c0003260 con 0x7f02e00af2c0 2022-01-10T01:29:15.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02d7fff700 1 -- 172.21.15.36:0/1996603173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e00ad850 msgr2=0x7f02e00a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:15.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02d7fff700 1 --2- 172.21.15.36:0/1996603173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e00ad850 0x7f02e00a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:15.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02d7fff700 1 -- 172.21.15.36:0/1996603173 >> v1:172.21.15.36:6789/0 conn(0x7f02e00af2c0 legacy=0x7f02e0143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:15.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02d7fff700 1 -- 172.21.15.36:0/1996603173 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e0143860 con 0x7f02e00ad320 2022-01-10T01:29:15.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02ded9d700 1 --2- 172.21.15.36:0/1996603173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e00ad850 0x7f02e00a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:15.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02d7fff700 1 --2- 172.21.15.36:0/1996603173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e00ad320 0x7f02e00af6a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f02e00ad770 tx=0x7f02c8006df0).ready entity=mon.1 client_cookie=c0d37ac3f4f6dd4a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:15.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02ddd9b700 1 -- 172.21.15.36:0/1996603173 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02c800d570 con 0x7f02e00ad320 2022-01-10T01:29:15.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02ddd9b700 1 -- 172.21.15.36:0/1996603173 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c8000e90 con 0x7f02e00ad320 2022-01-10T01:29:15.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.743+0000 7f02ddd9b700 1 -- 172.21.15.36:0/1996603173 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02c800d8c0 con 0x7f02e00ad320 2022-01-10T01:29:15.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 -- 172.21.15.36:0/1996603173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e00ad320 msgr2=0x7f02e00af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:15.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 --2- 172.21.15.36:0/1996603173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e00ad320 0x7f02e00af6a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f02e00ad770 tx=0x7f02c8006df0).stop 2022-01-10T01:29:15.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 -- 172.21.15.36:0/1996603173 shutdown_connections 2022-01-10T01:29:15.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 --2- 172.21.15.36:0/1996603173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e00ad850 0x7f02e00a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:15.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 --2- 172.21.15.36:0/1996603173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e00ad320 0x7f02e00af6a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:15.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 -- 172.21.15.36:0/1996603173 >> 172.21.15.36:0/1996603173 conn(0x7f02e0061140 msgr2=0x7f02e0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:15.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 -- 172.21.15.36:0/1996603173 shutdown_connections 2022-01-10T01:29:15.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 -- 172.21.15.36:0/1996603173 wait complete. 2022-01-10T01:29:15.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 Processor -- start 2022-01-10T01:29:15.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 -- start start 2022-01-10T01:29:15.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e00ad320 0x7f02e01395b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:15.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e00ad850 0x7f02e00b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:15.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02e00af2c0 0x7f02e0142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:15.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e01417f0 con 0x7f02e00af2c0 2022-01-10T01:29:15.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00b5010 con 0x7f02e00ad320 2022-01-10T01:29:15.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02df59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00b3d50 con 0x7f02e00ad850 2022-01-10T01:29:15.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02ded9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02e00af2c0 0x7f02e0142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:15.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02ded9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02e00af2c0 0x7f02e0142b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36902/0 (socket says 172.21.15.36:36902) 2022-01-10T01:29:15.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02de59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e00ad320 0x7f02e01395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:15.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02ded9d700 1 -- 172.21.15.36:0/3261237650 learned_addr learned my addr 172.21.15.36:0/3261237650 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:15.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.747+0000 7f02d7fff700 1 --2- 172.21.15.36:0/3261237650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e00ad850 0x7f02e00b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:15.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02ded9d700 1 -- 172.21.15.36:0/3261237650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e00ad850 msgr2=0x7f02e00b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:15.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02ded9d700 1 --2- 172.21.15.36:0/3261237650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e00ad850 0x7f02e00b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:15.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02ded9d700 1 -- 172.21.15.36:0/3261237650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e00ad320 msgr2=0x7f02e01395b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:15.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02ded9d700 1 --2- 172.21.15.36:0/3261237650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e00ad320 0x7f02e01395b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:15.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02ded9d700 1 -- 172.21.15.36:0/3261237650 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d8009470 con 0x7f02e00af2c0 2022-01-10T01:29:15.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02ded9d700 1 --2- 172.21.15.36:0/3261237650 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02e00af2c0 0x7f02e0142b80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f02d800c000 tx=0x7f02d80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:15.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02d77fe700 1 -- 172.21.15.36:0/3261237650 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02d800c850 con 0x7f02e00af2c0 2022-01-10T01:29:15.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02d77fe700 1 -- 172.21.15.36:0/3261237650 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d800c9b0 con 0x7f02e00af2c0 2022-01-10T01:29:15.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02df59e700 1 -- 172.21.15.36:0/3261237650 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c800b180 con 0x7f02e00af2c0 2022-01-10T01:29:15.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02d77fe700 1 -- 172.21.15.36:0/3261237650 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02d800cd10 con 0x7f02e00af2c0 2022-01-10T01:29:15.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02df59e700 1 -- 172.21.15.36:0/3261237650 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e0141bb0 con 0x7f02e00af2c0 2022-01-10T01:29:15.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02df59e700 1 -- 172.21.15.36:0/3261237650 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e0057350 con 0x7f02e00af2c0 2022-01-10T01:29:15.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02d77fe700 1 -- 172.21.15.36:0/3261237650 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f02d8022070 con 0x7f02e00af2c0 2022-01-10T01:29:15.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02d77fe700 1 --2- 172.21.15.36:0/3261237650 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02c4053620 0x7f02c4055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:15.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02d77fe700 1 -- 172.21.15.36:0/3261237650 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f02d806c1f0 con 0x7f02e00af2c0 2022-01-10T01:29:15.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.751+0000 7f02de59c700 1 --2- 172.21.15.36:0/3261237650 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02c4053620 0x7f02c4055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:15.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.755+0000 7f02de59c700 1 --2- 172.21.15.36:0/3261237650 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02c4053620 0x7f02c4055ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f02d000d000 tx=0x7f02d0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:15.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.759+0000 7f02d77fe700 1 -- 172.21.15.36:0/3261237650 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f02d80431b0 con 0x7f02e00af2c0 2022-01-10T01:29:15.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.923+0000 7f02df59e700 1 -- 172.21.15.36:0/3261237650 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02e00b6890 con 0x7f02e00af2c0 2022-01-10T01:29:15.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.923+0000 7f02d77fe700 1 -- 172.21.15.36:0/3261237650 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+2132 (secure 0 0 0) 0x7f02d8016870 con 0x7f02e00af2c0 2022-01-10T01:29:15.924 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:15.925 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":25,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1806166752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1806166752},{"type":"v1","addr":"172.21.15.36:6837","nonce":1806166752}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":35141,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2577386810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2577386810},{"type":"v1","addr":"172.21.15.36:6835","nonce":2577386810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[{"mdsmap":{"epoch":25,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:27:52.591733+0000","modified":"2022-01-10T01:29:15.599625+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2022-01-10T01:29:15.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.923+0000 7f02df59e700 1 -- 172.21.15.36:0/3261237650 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02c4053620 msgr2=0x7f02c4055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:15.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.923+0000 7f02df59e700 1 --2- 172.21.15.36:0/3261237650 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02c4053620 0x7f02c4055ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f02d000d000 tx=0x7f02d0009040).stop 2022-01-10T01:29:15.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.923+0000 7f02df59e700 1 -- 172.21.15.36:0/3261237650 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02e00af2c0 msgr2=0x7f02e0142b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:15.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.923+0000 7f02df59e700 1 --2- 172.21.15.36:0/3261237650 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02e00af2c0 0x7f02e0142b80 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f02d800c000 tx=0x7f02d80091d0).stop 2022-01-10T01:29:15.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.923+0000 7f02df59e700 1 -- 172.21.15.36:0/3261237650 shutdown_connections 2022-01-10T01:29:15.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.923+0000 7f02df59e700 1 --2- 172.21.15.36:0/3261237650 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02c4053620 0x7f02c4055ae0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:15.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.923+0000 7f02df59e700 1 --2- 172.21.15.36:0/3261237650 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02e00af2c0 0x7f02e0142b80 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:15.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.923+0000 7f02df59e700 1 --2- 172.21.15.36:0/3261237650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02e00ad850 0x7f02e00b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:15.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.923+0000 7f02df59e700 1 --2- 172.21.15.36:0/3261237650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02e00ad320 0x7f02e01395b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:15.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.923+0000 7f02df59e700 1 -- 172.21.15.36:0/3261237650 >> 172.21.15.36:0/3261237650 conn(0x7f02e0061140 msgr2=0x7f02e00a8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:15.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.923+0000 7f02df59e700 1 -- 172.21.15.36:0/3261237650 shutdown_connections 2022-01-10T01:29:15.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:15.923+0000 7f02df59e700 1 -- 172.21.15.36:0/3261237650 wait complete. 2022-01-10T01:29:15.929 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 25 2022-01-10T01:29:15.942 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:29:16.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6e4fc700 1 Processor -- start 2022-01-10T01:29:16.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6e4fc700 1 -- start start 2022-01-10T01:29:16.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6e4fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2a68061320 0x7f2a68061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:16.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6e4fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a680ad5c0 0x7f2a680b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:16.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6e4fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68140440 0x7f2a681408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:16.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6e4fc700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a680aecf0 con 0x7f2a68061320 2022-01-10T01:29:16.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6e4fc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a680b6f20 con 0x7f2a680ad5c0 2022-01-10T01:29:16.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6e4fc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680aef20 con 0x7f2a68140440 2022-01-10T01:29:16.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6d4fa700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2a68061320 0x7f2a68061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:16.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6d4fa700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2a68061320 0x7f2a68061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36906/0 (socket says 172.21.15.36:36906) 2022-01-10T01:29:16.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6d4fa700 1 -- 172.21.15.36:0/3182260226 learned_addr learned my addr 172.21.15.36:0/3182260226 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:16.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6ccf9700 1 --2- 172.21.15.36:0/3182260226 >> v2:172.21.15.59:3300/0 conn(0x7f2a680ad5c0 0x7f2a680b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:16.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6dcfb700 1 --2- 172.21.15.36:0/3182260226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68140440 0x7f2a681408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:16.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6d4fa700 1 -- 172.21.15.36:0/3182260226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68140440 msgr2=0x7f2a681408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:16.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.047+0000 7f2a6d4fa700 1 --2- 172.21.15.36:0/3182260226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68140440 0x7f2a681408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a6d4fa700 1 -- 172.21.15.36:0/3182260226 >> v2:172.21.15.59:3300/0 conn(0x7f2a680ad5c0 msgr2=0x7f2a680b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:16.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a6d4fa700 1 --2- 172.21.15.36:0/3182260226 >> v2:172.21.15.59:3300/0 conn(0x7f2a680ad5c0 0x7f2a680b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a6d4fa700 1 -- 172.21.15.36:0/3182260226 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a680af1c0 con 0x7f2a68061320 2022-01-10T01:29:16.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a6d4fa700 1 --2- 172.21.15.36:0/3182260226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2a68061320 0x7f2a68061700 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f2a680aeba0 tx=0x7f2a58006eb0).ready entity=mon.0 client_cookie=db020f1edc58ad19 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:16.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a5ffff700 1 -- 172.21.15.36:0/3182260226 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a5800e610 con 0x7f2a68061320 2022-01-10T01:29:16.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a5ffff700 1 -- 172.21.15.36:0/3182260226 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a58000e90 con 0x7f2a68061320 2022-01-10T01:29:16.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a5ffff700 1 -- 172.21.15.36:0/3182260226 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a5800e9a0 con 0x7f2a68061320 2022-01-10T01:29:16.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/3182260226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2a68061320 msgr2=0x7f2a68061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:16.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a6e4fc700 1 --2- 172.21.15.36:0/3182260226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2a68061320 0x7f2a68061700 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f2a680aeba0 tx=0x7f2a58006eb0).stop 2022-01-10T01:29:16.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/3182260226 shutdown_connections 2022-01-10T01:29:16.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a6e4fc700 1 --2- 172.21.15.36:0/3182260226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68140440 0x7f2a681408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a6e4fc700 1 --2- 172.21.15.36:0/3182260226 >> v2:172.21.15.59:3300/0 conn(0x7f2a680ad5c0 0x7f2a680b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a6e4fc700 1 --2- 172.21.15.36:0/3182260226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2a68061320 0x7f2a68061700 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/3182260226 >> 172.21.15.36:0/3182260226 conn(0x7f2a68066de0 msgr2=0x7f2a680671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:16.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/3182260226 shutdown_connections 2022-01-10T01:29:16.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.051+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/3182260226 wait complete. 2022-01-10T01:29:16.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6e4fc700 1 Processor -- start 2022-01-10T01:29:16.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6e4fc700 1 -- start start 2022-01-10T01:29:16.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6e4fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68061320 0x7f2a68156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:16.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6e4fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2a680ad5c0 0x7f2a680b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:16.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6e4fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a68140440 0x7f2a680b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:16.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6e4fc700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a68143c10 con 0x7f2a680ad5c0 2022-01-10T01:29:16.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6e4fc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680ac950 con 0x7f2a68140440 2022-01-10T01:29:16.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6e4fc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a68156940 con 0x7f2a68061320 2022-01-10T01:29:16.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6ccf9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2a680ad5c0 0x7f2a680b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:16.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6ccf9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2a680ad5c0 0x7f2a680b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36914/0 (socket says 172.21.15.36:36914) 2022-01-10T01:29:16.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6ccf9700 1 -- 172.21.15.36:0/2808705433 learned_addr learned my addr 172.21.15.36:0/2808705433 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:16.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6d4fa700 1 --2- 172.21.15.36:0/2808705433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68061320 0x7f2a68156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:16.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6dcfb700 1 --2- 172.21.15.36:0/2808705433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a68140440 0x7f2a680b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:16.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6ccf9700 1 -- 172.21.15.36:0/2808705433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68061320 msgr2=0x7f2a68156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:16.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6ccf9700 1 --2- 172.21.15.36:0/2808705433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68061320 0x7f2a68156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6ccf9700 1 -- 172.21.15.36:0/2808705433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a68140440 msgr2=0x7f2a680b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:16.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6ccf9700 1 --2- 172.21.15.36:0/2808705433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a68140440 0x7f2a680b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6ccf9700 1 -- 172.21.15.36:0/2808705433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5800b1e0 con 0x7f2a680ad5c0 2022-01-10T01:29:16.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a6ccf9700 1 --2- 172.21.15.36:0/2808705433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2a680ad5c0 0x7f2a680b0340 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f2a6400c000 tx=0x7f2a64006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:16.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.055+0000 7f2a5e7fc700 1 -- 172.21.15.36:0/2808705433 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a64010780 con 0x7f2a680ad5c0 2022-01-10T01:29:16.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.059+0000 7f2a5e7fc700 1 -- 172.21.15.36:0/2808705433 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a640108e0 con 0x7f2a680ad5c0 2022-01-10T01:29:16.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.059+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/2808705433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a680a9ba0 con 0x7f2a680ad5c0 2022-01-10T01:29:16.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.059+0000 7f2a5e7fc700 1 -- 172.21.15.36:0/2808705433 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a64010c40 con 0x7f2a680ad5c0 2022-01-10T01:29:16.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.059+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/2808705433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a680aa5e0 con 0x7f2a680ad5c0 2022-01-10T01:29:16.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.059+0000 7f2a5e7fc700 1 -- 172.21.15.36:0/2808705433 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2a6401c460 con 0x7f2a680ad5c0 2022-01-10T01:29:16.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.059+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/2808705433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a680aa7a0 con 0x7f2a680ad5c0 2022-01-10T01:29:16.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.059+0000 7f2a5e7fc700 1 --2- 172.21.15.36:0/2808705433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2a500534d0 0x7f2a50055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:16.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.059+0000 7f2a5e7fc700 1 -- 172.21.15.36:0/2808705433 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f2a6406be80 con 0x7f2a680ad5c0 2022-01-10T01:29:16.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.059+0000 7f2a6d4fa700 1 --2- 172.21.15.36:0/2808705433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2a500534d0 0x7f2a50055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:16.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.059+0000 7f2a6d4fa700 1 --2- 172.21.15.36:0/2808705433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2a500534d0 0x7f2a50055990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f2a5801c000 tx=0x7f2a58015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:16.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.067+0000 7f2a5e7fc700 1 -- 172.21.15.36:0/2808705433 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2a64042d40 con 0x7f2a680ad5c0 2022-01-10T01:29:16.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.231+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/2808705433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2a680af460 con 0x7f2a680ad5c0 2022-01-10T01:29:16.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.615+0000 7f2a5e7fc700 1 -- 172.21.15.36:0/2808705433 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2a64046360 con 0x7f2a680ad5c0 2022-01-10T01:29:16.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.619+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/2808705433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2a500534d0 msgr2=0x7f2a50055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:16.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.619+0000 7f2a6e4fc700 1 --2- 172.21.15.36:0/2808705433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2a500534d0 0x7f2a50055990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f2a5801c000 tx=0x7f2a58015000).stop 2022-01-10T01:29:16.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.619+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/2808705433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2a680ad5c0 msgr2=0x7f2a680b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:16.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.619+0000 7f2a6e4fc700 1 --2- 172.21.15.36:0/2808705433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2a680ad5c0 0x7f2a680b0340 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f2a6400c000 tx=0x7f2a64006df0).stop 2022-01-10T01:29:16.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.619+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/2808705433 shutdown_connections 2022-01-10T01:29:16.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.619+0000 7f2a6e4fc700 1 --2- 172.21.15.36:0/2808705433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2a500534d0 0x7f2a50055990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.619+0000 7f2a6e4fc700 1 --2- 172.21.15.36:0/2808705433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a68140440 0x7f2a680b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.619+0000 7f2a6e4fc700 1 --2- 172.21.15.36:0/2808705433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2a680ad5c0 0x7f2a680b0340 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.619+0000 7f2a6e4fc700 1 --2- 172.21.15.36:0/2808705433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68061320 0x7f2a68156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.619+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/2808705433 >> 172.21.15.36:0/2808705433 conn(0x7f2a68066de0 msgr2=0x7f2a680b86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:16.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.619+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/2808705433 shutdown_connections 2022-01-10T01:29:16.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.619+0000 7f2a6e4fc700 1 -- 172.21.15.36:0/2808705433 wait complete. 2022-01-10T01:29:16.634 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:29:16.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.747+0000 7ff8af59e700 1 Processor -- start 2022-01-10T01:29:16.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.747+0000 7ff8af59e700 1 -- start start 2022-01-10T01:29:16.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.747+0000 7ff8af59e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff8b00b2580 0x7ff8b014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:16.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.747+0000 7ff8af59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b00a8ac0 0x7ff8b014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:16.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.747+0000 7ff8af59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b00a70c0 con 0x7ff8b00b0010 2022-01-10T01:29:16.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.747+0000 7ff8af59e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b00a72f0 con 0x7ff8b00b2580 2022-01-10T01:29:16.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.747+0000 7ff8af59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00a7590 con 0x7ff8b00a8ac0 2022-01-10T01:29:16.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.747+0000 7ff8ae59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff8b00b2580 0x7ff8b014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:16.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8ae59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff8b00b2580 0x7ff8b014ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36920/0 (socket says 172.21.15.36:36920) 2022-01-10T01:29:16.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8ae59c700 1 -- 172.21.15.36:0/3574869189 learned_addr learned my addr 172.21.15.36:0/3574869189 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:16.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8add9b700 1 --1- 172.21.15.36:0/3574869189 >> v1:172.21.15.59:6789/0 conn(0x7ff8b00b0010 0x7ff8b00a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:52392/0 (socket says 172.21.15.36:52392) 2022-01-10T01:29:16.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8aed9d700 1 --2- 172.21.15.36:0/3574869189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b00a8ac0 0x7ff8b014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:16.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8ad59a700 1 -- 172.21.15.36:0/3574869189 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699004911 0 0) 0x7ff8b00a70c0 con 0x7ff8b00b0010 2022-01-10T01:29:16.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8ad59a700 1 -- 172.21.15.36:0/3574869189 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff894003260 con 0x7ff8b00b0010 2022-01-10T01:29:16.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8ae59c700 1 -- 172.21.15.36:0/3574869189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b00a8ac0 msgr2=0x7ff8b014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:16.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8ae59c700 1 --2- 172.21.15.36:0/3574869189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b00a8ac0 0x7ff8b014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8ae59c700 1 -- 172.21.15.36:0/3574869189 >> v1:172.21.15.59:6789/0 conn(0x7ff8b00b0010 legacy=0x7ff8b00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:16.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8ae59c700 1 -- 172.21.15.36:0/3574869189 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b00a7830 con 0x7ff8b00b2580 2022-01-10T01:29:16.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8aed9d700 1 --2- 172.21.15.36:0/3574869189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b00a8ac0 0x7ff8b014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:16.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8ae59c700 1 --2- 172.21.15.36:0/3574869189 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8b00b2580 0x7ff8b014ae40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7ff8a4002f70 tx=0x7ff8a4006eb0).ready entity=mon.0 client_cookie=1a12c1b9a28e8a2a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:16.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8ad59a700 1 -- 172.21.15.36:0/3574869189 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a400d5c0 con 0x7ff8b00b2580 2022-01-10T01:29:16.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8ad59a700 1 -- 172.21.15.36:0/3574869189 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a4000e90 con 0x7ff8b00b2580 2022-01-10T01:29:16.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8ad59a700 1 -- 172.21.15.36:0/3574869189 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a400d950 con 0x7ff8b00b2580 2022-01-10T01:29:16.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8af59e700 1 -- 172.21.15.36:0/3574869189 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8b00b2580 msgr2=0x7ff8b014ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:16.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8af59e700 1 --2- 172.21.15.36:0/3574869189 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8b00b2580 0x7ff8b014ae40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7ff8a4002f70 tx=0x7ff8a4006eb0).stop 2022-01-10T01:29:16.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8af59e700 1 -- 172.21.15.36:0/3574869189 shutdown_connections 2022-01-10T01:29:16.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8af59e700 1 --2- 172.21.15.36:0/3574869189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b00a8ac0 0x7ff8b014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8af59e700 1 --2- 172.21.15.36:0/3574869189 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8b00b2580 0x7ff8b014ae40 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8af59e700 1 -- 172.21.15.36:0/3574869189 >> 172.21.15.36:0/3574869189 conn(0x7ff8b0060180 msgr2=0x7ff8b00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:16.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8af59e700 1 -- 172.21.15.36:0/3574869189 shutdown_connections 2022-01-10T01:29:16.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8af59e700 1 -- 172.21.15.36:0/3574869189 wait complete. 2022-01-10T01:29:16.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8af59e700 1 Processor -- start 2022-01-10T01:29:16.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.751+0000 7ff8af59e700 1 -- start start 2022-01-10T01:29:16.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8af59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b00a8ac0 0x7ff8b00aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:16.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8af59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8b00b0010 0x7ff8b00aa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:16.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8af59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b00b2580 0x7ff8b00aab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:16.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8af59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b01453f0 con 0x7ff8b00b0010 2022-01-10T01:29:16.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8af59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00b3540 con 0x7ff8b00a8ac0 2022-01-10T01:29:16.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8af59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00b37e0 con 0x7ff8b00b2580 2022-01-10T01:29:16.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8add9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8b00b0010 0x7ff8b00aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:16.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8ae59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b00a8ac0 0x7ff8b00aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:16.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8add9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8b00b0010 0x7ff8b00aa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36926/0 (socket says 172.21.15.36:36926) 2022-01-10T01:29:16.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8aed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b00b2580 0x7ff8b00aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:16.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8add9b700 1 -- 172.21.15.36:0/156706677 learned_addr learned my addr 172.21.15.36:0/156706677 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:16.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8add9b700 1 -- 172.21.15.36:0/156706677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b00b2580 msgr2=0x7ff8b00aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:16.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8add9b700 1 --2- 172.21.15.36:0/156706677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b00b2580 0x7ff8b00aab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8add9b700 1 -- 172.21.15.36:0/156706677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b00a8ac0 msgr2=0x7ff8b00aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:16.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8add9b700 1 --2- 172.21.15.36:0/156706677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b00a8ac0 0x7ff8b00aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:16.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8add9b700 1 -- 172.21.15.36:0/156706677 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a800b180 con 0x7ff8b00b0010 2022-01-10T01:29:16.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8aed9d700 1 --2- 172.21.15.36:0/156706677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b00b2580 0x7ff8b00aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:16.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8add9b700 1 --2- 172.21.15.36:0/156706677 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8b00b0010 0x7ff8b00aa680 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7ff8a0001490 tx=0x7ff8a0007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:16.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff89f7fe700 1 -- 172.21.15.36:0/156706677 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a0005c80 con 0x7ff8b00b0010 2022-01-10T01:29:16.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff89f7fe700 1 -- 172.21.15.36:0/156706677 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a0005de0 con 0x7ff8b00b0010 2022-01-10T01:29:16.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8af59e700 1 -- 172.21.15.36:0/156706677 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a400b1e0 con 0x7ff8b00b0010 2022-01-10T01:29:16.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff89f7fe700 1 -- 172.21.15.36:0/156706677 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8a00072c0 con 0x7ff8b00b0010 2022-01-10T01:29:16.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.755+0000 7ff8af59e700 1 -- 172.21.15.36:0/156706677 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b00af5a0 con 0x7ff8b00b0010 2022-01-10T01:29:16.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.759+0000 7ff8af59e700 1 -- 172.21.15.36:0/156706677 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b0057350 con 0x7ff8b00b0010 2022-01-10T01:29:16.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.759+0000 7ff89f7fe700 1 -- 172.21.15.36:0/156706677 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff8a001a060 con 0x7ff8b00b0010 2022-01-10T01:29:16.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.759+0000 7ff89f7fe700 1 --2- 172.21.15.36:0/156706677 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff88c0536b0 0x7ff88c055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:16.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.759+0000 7ff89f7fe700 1 -- 172.21.15.36:0/156706677 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6506+0+0 (secure 0 0 0) 0x7ff8a006b640 con 0x7ff8b00b0010 2022-01-10T01:29:16.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.759+0000 7ff8ae59c700 1 --2- 172.21.15.36:0/156706677 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff88c0536b0 0x7ff88c055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:16.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.759+0000 7ff8ae59c700 1 --2- 172.21.15.36:0/156706677 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff88c0536b0 0x7ff88c055b70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7ff8a401c000 tx=0x7ff8a4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:16.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.763+0000 7ff89f7fe700 1 -- 172.21.15.36:0/156706677 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff8a0042560 con 0x7ff8b00b0010 2022-01-10T01:29:16.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:16.891+0000 7ff8af59e700 1 -- 172.21.15.36:0/156706677 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff8b00698e0 con 0x7ff8b00b0010 2022-01-10T01:29:17.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.667+0000 7ff89f7fe700 1 -- 172.21.15.36:0/156706677 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 185+0+0 (secure 0 0 0) 0x7ff8a0018070 con 0x7ff8b00b0010 2022-01-10T01:29:17.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.671+0000 7ff8af59e700 1 -- 172.21.15.36:0/156706677 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff88c0536b0 msgr2=0x7ff88c055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:17.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.671+0000 7ff8af59e700 1 --2- 172.21.15.36:0/156706677 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff88c0536b0 0x7ff88c055b70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7ff8a401c000 tx=0x7ff8a4015000).stop 2022-01-10T01:29:17.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.671+0000 7ff8af59e700 1 -- 172.21.15.36:0/156706677 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8b00b0010 msgr2=0x7ff8b00aa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:17.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.671+0000 7ff8af59e700 1 --2- 172.21.15.36:0/156706677 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8b00b0010 0x7ff8b00aa680 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7ff8a0001490 tx=0x7ff8a0007df0).stop 2022-01-10T01:29:17.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.671+0000 7ff8af59e700 1 -- 172.21.15.36:0/156706677 shutdown_connections 2022-01-10T01:29:17.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.671+0000 7ff8af59e700 1 --2- 172.21.15.36:0/156706677 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff88c0536b0 0x7ff88c055b70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:17.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.671+0000 7ff8af59e700 1 --2- 172.21.15.36:0/156706677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8b00b2580 0x7ff8b00aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:17.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.671+0000 7ff8af59e700 1 --2- 172.21.15.36:0/156706677 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8b00b0010 0x7ff8b00aa680 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:17.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.671+0000 7ff8af59e700 1 --2- 172.21.15.36:0/156706677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8b00a8ac0 0x7ff8b00aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:17.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.671+0000 7ff8af59e700 1 -- 172.21.15.36:0/156706677 >> 172.21.15.36:0/156706677 conn(0x7ff8b0060180 msgr2=0x7ff8b0149f70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:17.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.671+0000 7ff8af59e700 1 -- 172.21.15.36:0/156706677 shutdown_connections 2022-01-10T01:29:17.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.675+0000 7ff8af59e700 1 -- 172.21.15.36:0/156706677 wait complete. 2022-01-10T01:29:17.677 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:29:17.688 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2022-01-10T01:29:17.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.803+0000 7fd9171fb700 1 Processor -- start 2022-01-10T01:29:17.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.803+0000 7fd9171fb700 1 -- start start 2022-01-10T01:29:17.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.803+0000 7fd9171fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9100ac6f0 0x7fd910143580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:17.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.803+0000 7fd9171fb700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd910067880 con 0x7fd9100b2580 2022-01-10T01:29:17.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.803+0000 7fd9171fb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd910067b20 con 0x7fd9100b00e0 2022-01-10T01:29:17.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.803+0000 7fd9171fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100ad5b0 con 0x7fd9100ac6f0 2022-01-10T01:29:17.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.803+0000 7fd9161f9700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd9100b2580 0x7fd910140050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34726/0 (socket says 172.21.15.36:34726) 2022-01-10T01:29:17.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.803+0000 7fd9161f9700 1 -- 172.21.15.36:0/3515829000 learned_addr learned my addr 172.21.15.36:0/3515829000 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:17.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.803+0000 7fd9169fa700 1 --2- 172.21.15.36:0/3515829000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9100ac6f0 0x7fd910143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:17.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.803+0000 7fd9151f7700 1 -- 172.21.15.36:0/3515829000 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868768269 0 0) 0x7fd910067880 con 0x7fd9100b2580 2022-01-10T01:29:17.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.803+0000 7fd9151f7700 1 -- 172.21.15.36:0/3515829000 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f8003260 con 0x7fd9100b2580 2022-01-10T01:29:17.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.803+0000 7fd9151f7700 1 -- 172.21.15.36:0/3515829000 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005887962 0 0) 0x7fd910067b20 con 0x7fd9100b00e0 2022-01-10T01:29:17.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.803+0000 7fd9151f7700 1 -- 172.21.15.36:0/3515829000 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd910067880 con 0x7fd9100b00e0 2022-01-10T01:29:17.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9169fa700 1 -- 172.21.15.36:0/3515829000 >> v1:172.21.15.59:6789/0 conn(0x7fd9100b00e0 legacy=0x7fd910142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:17.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9169fa700 1 -- 172.21.15.36:0/3515829000 >> v1:172.21.15.36:6789/0 conn(0x7fd9100b2580 legacy=0x7fd910140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:17.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9169fa700 1 -- 172.21.15.36:0/3515829000 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd910146fd0 con 0x7fd9100ac6f0 2022-01-10T01:29:17.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9169fa700 1 --2- 172.21.15.36:0/3515829000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9100ac6f0 0x7fd910143580 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fd9080032f0 tx=0x7fd9080091d0).ready entity=mon.2 client_cookie=be74f8a8e9112c67 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:17.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9151f7700 1 -- 172.21.15.36:0/3515829000 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd90800b640 con 0x7fd9100ac6f0 2022-01-10T01:29:17.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9151f7700 1 -- 172.21.15.36:0/3515829000 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90800b7a0 con 0x7fd9100ac6f0 2022-01-10T01:29:17.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9151f7700 1 -- 172.21.15.36:0/3515829000 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd90800b910 con 0x7fd9100ac6f0 2022-01-10T01:29:17.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9171fb700 1 -- 172.21.15.36:0/3515829000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9100ac6f0 msgr2=0x7fd910143580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:17.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9171fb700 1 --2- 172.21.15.36:0/3515829000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9100ac6f0 0x7fd910143580 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fd9080032f0 tx=0x7fd9080091d0).stop 2022-01-10T01:29:17.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9171fb700 1 -- 172.21.15.36:0/3515829000 shutdown_connections 2022-01-10T01:29:17.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9171fb700 1 --2- 172.21.15.36:0/3515829000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9100ac6f0 0x7fd910143580 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:17.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9171fb700 1 -- 172.21.15.36:0/3515829000 >> 172.21.15.36:0/3515829000 conn(0x7fd910060180 msgr2=0x7fd9100b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:17.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9171fb700 1 -- 172.21.15.36:0/3515829000 shutdown_connections 2022-01-10T01:29:17.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9171fb700 1 -- 172.21.15.36:0/3515829000 wait complete. 2022-01-10T01:29:17.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9171fb700 1 Processor -- start 2022-01-10T01:29:17.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.807+0000 7fd9171fb700 1 -- start start 2022-01-10T01:29:17.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9171fb700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd9100ac6f0 0x7fd91005cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:17.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9171fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9100b00e0 0x7fd9100aa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:17.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9171fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9100b2580 0x7fd91009e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:17.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9171fb700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100ab4c0 con 0x7fd9100ac6f0 2022-01-10T01:29:17.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9171fb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100ab760 con 0x7fd9100b2580 2022-01-10T01:29:17.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9171fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9100aba00 con 0x7fd9100b00e0 2022-01-10T01:29:17.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9161f9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd9100ac6f0 0x7fd91005cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:17.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9161f9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd9100ac6f0 0x7fd91005cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36938/0 (socket says 172.21.15.36:36938) 2022-01-10T01:29:17.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9161f9700 1 -- 172.21.15.36:0/655455367 learned_addr learned my addr 172.21.15.36:0/655455367 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:17.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9159f8700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9100b00e0 0x7fd9100aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:17.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9169fa700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9100b2580 0x7fd91009e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:17.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9161f9700 1 -- 172.21.15.36:0/655455367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9100b00e0 msgr2=0x7fd9100aa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:17.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9161f9700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9100b00e0 0x7fd9100aa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:17.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9161f9700 1 -- 172.21.15.36:0/655455367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9100b2580 msgr2=0x7fd91009e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:17.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9161f9700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9100b2580 0x7fd91009e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:17.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9161f9700 1 -- 172.21.15.36:0/655455367 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd908009470 con 0x7fd9100ac6f0 2022-01-10T01:29:17.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9159f8700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9100b00e0 0x7fd9100aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:17.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9161f9700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd9100ac6f0 0x7fd91005cbe0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fd90c0010d0 tx=0x7fd90c007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:17.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd8ff7fe700 1 -- 172.21.15.36:0/655455367 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd90c0070d0 con 0x7fd9100ac6f0 2022-01-10T01:29:17.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd8ff7fe700 1 -- 172.21.15.36:0/655455367 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c007230 con 0x7fd9100ac6f0 2022-01-10T01:29:17.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9171fb700 1 -- 172.21.15.36:0/655455367 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9100abca0 con 0x7fd9100ac6f0 2022-01-10T01:29:17.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd8ff7fe700 1 -- 172.21.15.36:0/655455367 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd90c005610 con 0x7fd9100ac6f0 2022-01-10T01:29:17.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.811+0000 7fd9171fb700 1 -- 172.21.15.36:0/655455367 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9100aab20 con 0x7fd9100ac6f0 2022-01-10T01:29:17.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.815+0000 7fd9171fb700 1 -- 172.21.15.36:0/655455367 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd910143a70 con 0x7fd9100ac6f0 2022-01-10T01:29:17.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.815+0000 7fd8ff7fe700 1 -- 172.21.15.36:0/655455367 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd90c010070 con 0x7fd9100ac6f0 2022-01-10T01:29:17.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.815+0000 7fd8ff7fe700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8f0053560 0x7fd8f0055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:17.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.815+0000 7fd9159f8700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8f0053560 0x7fd8f0055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:17.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.815+0000 7fd8ff7fe700 1 -- 172.21.15.36:0/655455367 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6068+0+0 (secure 0 0 0) 0x7fd90c06af30 con 0x7fd9100ac6f0 2022-01-10T01:29:17.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.815+0000 7fd9159f8700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8f0053560 0x7fd8f0055a20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fd90000b000 tx=0x7fd900009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:17.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.823+0000 7fd8ff7fe700 1 -- 172.21.15.36:0/655455367 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd90c0420a0 con 0x7fd9100ac6f0 2022-01-10T01:29:17.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:17.947+0000 7fd9171fb700 1 -- 172.21.15.36:0/655455367 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd910057350 con 0x7fd9100ac6f0 2022-01-10T01:29:18.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.683+0000 7fd8ff7fe700 1 -- 172.21.15.36:0/655455367 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd90c0456c0 con 0x7fd9100ac6f0 2022-01-10T01:29:18.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.687+0000 7fd9171fb700 1 -- 172.21.15.36:0/655455367 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8f0053560 msgr2=0x7fd8f0055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:18.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.687+0000 7fd9171fb700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8f0053560 0x7fd8f0055a20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fd90000b000 tx=0x7fd900009040).stop 2022-01-10T01:29:18.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.687+0000 7fd9171fb700 1 -- 172.21.15.36:0/655455367 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd9100ac6f0 msgr2=0x7fd91005cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:18.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.687+0000 7fd9171fb700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd9100ac6f0 0x7fd91005cbe0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fd90c0010d0 tx=0x7fd90c007b00).stop 2022-01-10T01:29:18.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.691+0000 7fd9171fb700 1 -- 172.21.15.36:0/655455367 shutdown_connections 2022-01-10T01:29:18.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.691+0000 7fd9171fb700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8f0053560 0x7fd8f0055a20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:18.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.691+0000 7fd9171fb700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9100b2580 0x7fd91009e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:18.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.691+0000 7fd9171fb700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9100b00e0 0x7fd9100aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:18.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.691+0000 7fd9171fb700 1 --2- 172.21.15.36:0/655455367 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd9100ac6f0 0x7fd91005cbe0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:18.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.691+0000 7fd9171fb700 1 -- 172.21.15.36:0/655455367 >> 172.21.15.36:0/655455367 conn(0x7fd910060180 msgr2=0x7fd91013f940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:18.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.691+0000 7fd9171fb700 1 -- 172.21.15.36:0/655455367 shutdown_connections 2022-01-10T01:29:18.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.691+0000 7fd9171fb700 1 -- 172.21.15.36:0/655455367 wait complete. 2022-01-10T01:29:18.699 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' removed 2022-01-10T01:29:18.707 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2022-01-10T01:29:18.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.815+0000 7f0722a34700 1 Processor -- start 2022-01-10T01:29:18.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.815+0000 7f0722a34700 1 -- start start 2022-01-10T01:29:18.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.815+0000 7f0722a34700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f071c0affa0 0x7f071c1471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:18.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.815+0000 7f0722a34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f071c0b5210 0x7f071c0b0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:18.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f0722a34700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071c0ad770 con 0x7f071c0b2b60 2022-01-10T01:29:18.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f0722a34700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f071c1476a0 con 0x7f071c0affa0 2022-01-10T01:29:18.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f0722a34700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071c0b2f40 con 0x7f071c0b5210 2022-01-10T01:29:18.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f071b7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f071c0affa0 0x7f071c1471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:18.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f071b7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f071c0affa0 0x7f071c1471b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36948/0 (socket says 172.21.15.36:36948) 2022-01-10T01:29:18.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f071b7fe700 1 -- 172.21.15.36:0/3033637666 learned_addr learned my addr 172.21.15.36:0/3033637666 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:18.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f0720fd1700 1 --2- 172.21.15.36:0/3033637666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f071c0b5210 0x7f071c0b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:18.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f071b7fe700 1 -- 172.21.15.36:0/3033637666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f071c0b5210 msgr2=0x7f071c0b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:18.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f071b7fe700 1 --2- 172.21.15.36:0/3033637666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f071c0b5210 0x7f071c0b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:18.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f071b7fe700 1 -- 172.21.15.36:0/3033637666 >> v1:172.21.15.59:6789/0 conn(0x7f071c0b2b60 legacy=0x7f071c0af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:18.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f071b7fe700 1 -- 172.21.15.36:0/3033637666 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c05ca70 con 0x7f071c0affa0 2022-01-10T01:29:18.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f071b7fe700 1 --2- 172.21.15.36:0/3033637666 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f071c0affa0 0x7f071c1471b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f0710002f70 tx=0x7f0710006eb0).ready entity=mon.0 client_cookie=ec9a549cddec9137 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:18.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f071affd700 1 -- 172.21.15.36:0/3033637666 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f071000d570 con 0x7f071c0affa0 2022-01-10T01:29:18.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f071affd700 1 -- 172.21.15.36:0/3033637666 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0710000e90 con 0x7f071c0affa0 2022-01-10T01:29:18.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f071affd700 1 -- 172.21.15.36:0/3033637666 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f071000d900 con 0x7f071c0affa0 2022-01-10T01:29:18.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f0722a34700 1 -- 172.21.15.36:0/3033637666 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f071c0affa0 msgr2=0x7f071c1471b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:18.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f0722a34700 1 --2- 172.21.15.36:0/3033637666 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f071c0affa0 0x7f071c1471b0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f0710002f70 tx=0x7f0710006eb0).stop 2022-01-10T01:29:18.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f0722a34700 1 -- 172.21.15.36:0/3033637666 shutdown_connections 2022-01-10T01:29:18.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f0722a34700 1 --2- 172.21.15.36:0/3033637666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f071c0b5210 0x7f071c0b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:18.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f0722a34700 1 --2- 172.21.15.36:0/3033637666 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f071c0affa0 0x7f071c1471b0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:18.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f0722a34700 1 -- 172.21.15.36:0/3033637666 >> 172.21.15.36:0/3033637666 conn(0x7f071c06a110 msgr2=0x7f071c05cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:18.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f0722a34700 1 -- 172.21.15.36:0/3033637666 shutdown_connections 2022-01-10T01:29:18.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f0722a34700 1 -- 172.21.15.36:0/3033637666 wait complete. 2022-01-10T01:29:18.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f0722a34700 1 Processor -- start 2022-01-10T01:29:18.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.819+0000 7f0722a34700 1 -- start start 2022-01-10T01:29:18.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0722a34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f071c0affa0 0x7f071c1436d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:18.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0722a34700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f071c0b2b60 0x7f071c13af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:18.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0722a34700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f071c0b5210 0x7f071c13b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:18.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0722a34700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c146560 con 0x7f071c0b5210 2022-01-10T01:29:18.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0722a34700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c141f50 con 0x7f071c0b2b60 2022-01-10T01:29:18.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0722a34700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071c13b950 con 0x7f071c0affa0 2022-01-10T01:29:18.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0720fd1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f071c0b5210 0x7f071c13b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:18.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0720fd1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f071c0b5210 0x7f071c13b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36954/0 (socket says 172.21.15.36:36954) 2022-01-10T01:29:18.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0720fd1700 1 -- 172.21.15.36:0/3140574762 learned_addr learned my addr 172.21.15.36:0/3140574762 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:18.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f071b7fe700 1 --2- 172.21.15.36:0/3140574762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f071c0b2b60 0x7f071c13af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:18.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f071bfff700 1 --2- 172.21.15.36:0/3140574762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f071c0affa0 0x7f071c1436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:18.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0720fd1700 1 -- 172.21.15.36:0/3140574762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f071c0affa0 msgr2=0x7f071c1436d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:18.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0720fd1700 1 --2- 172.21.15.36:0/3140574762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f071c0affa0 0x7f071c1436d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:18.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0720fd1700 1 -- 172.21.15.36:0/3140574762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f071c0b2b60 msgr2=0x7f071c13af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:18.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0720fd1700 1 --2- 172.21.15.36:0/3140574762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f071c0b2b60 0x7f071c13af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:18.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0720fd1700 1 -- 172.21.15.36:0/3140574762 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071000b1e0 con 0x7f071c0b5210 2022-01-10T01:29:18.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0720fd1700 1 --2- 172.21.15.36:0/3140574762 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f071c0b5210 0x7f071c13b460 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f071400c000 tx=0x7f07140091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:18.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f07197fa700 1 -- 172.21.15.36:0/3140574762 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f071400ee70 con 0x7f071c0b5210 2022-01-10T01:29:18.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f07197fa700 1 -- 172.21.15.36:0/3140574762 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071400c850 con 0x7f071c0b5210 2022-01-10T01:29:18.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0722a34700 1 -- 172.21.15.36:0/3140574762 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071c143fb0 con 0x7f071c0b5210 2022-01-10T01:29:18.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f07197fa700 1 -- 172.21.15.36:0/3140574762 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f071400cbb0 con 0x7f071c0b5210 2022-01-10T01:29:18.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0722a34700 1 -- 172.21.15.36:0/3140574762 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071c065c40 con 0x7f071c0b5210 2022-01-10T01:29:18.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f0722a34700 1 -- 172.21.15.36:0/3140574762 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071c142110 con 0x7f071c0b5210 2022-01-10T01:29:18.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f07197fa700 1 -- 172.21.15.36:0/3140574762 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0714022070 con 0x7f071c0b5210 2022-01-10T01:29:18.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.823+0000 7f07197fa700 1 --2- 172.21.15.36:0/3140574762 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06fc0535f0 0x7f06fc055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:18.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.827+0000 7f07197fa700 1 -- 172.21.15.36:0/3140574762 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f071406bdd0 con 0x7f071c0b5210 2022-01-10T01:29:18.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.827+0000 7f071bfff700 1 --2- 172.21.15.36:0/3140574762 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06fc0535f0 0x7f06fc055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:18.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.827+0000 7f071bfff700 1 --2- 172.21.15.36:0/3140574762 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06fc0535f0 0x7f06fc055ab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f070c00b000 tx=0x7f070c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:18.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.831+0000 7f07197fa700 1 -- 172.21.15.36:0/3140574762 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f07140430c0 con 0x7f071c0b5210 2022-01-10T01:29:18.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.959+0000 7f0722a34700 1 -- 172.21.15.36:0/3140574762 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f071c0ad9a0 con 0x7f071c0b5210 2022-01-10T01:29:18.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.963+0000 7f07197fa700 1 -- 172.21.15.36:0/3140574762 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f07140160a0 con 0x7f071c0b5210 2022-01-10T01:29:18.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.967+0000 7f0722a34700 1 -- 172.21.15.36:0/3140574762 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06fc0535f0 msgr2=0x7f06fc055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:18.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.967+0000 7f0722a34700 1 --2- 172.21.15.36:0/3140574762 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06fc0535f0 0x7f06fc055ab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f070c00b000 tx=0x7f070c009040).stop 2022-01-10T01:29:18.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.967+0000 7f0722a34700 1 -- 172.21.15.36:0/3140574762 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f071c0b5210 msgr2=0x7f071c13b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:18.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.967+0000 7f0722a34700 1 --2- 172.21.15.36:0/3140574762 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f071c0b5210 0x7f071c13b460 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f071400c000 tx=0x7f07140091d0).stop 2022-01-10T01:29:18.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.967+0000 7f0722a34700 1 -- 172.21.15.36:0/3140574762 shutdown_connections 2022-01-10T01:29:18.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.967+0000 7f0722a34700 1 --2- 172.21.15.36:0/3140574762 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06fc0535f0 0x7f06fc055ab0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:18.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.967+0000 7f0722a34700 1 --2- 172.21.15.36:0/3140574762 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f071c0b5210 0x7f071c13b460 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:18.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.967+0000 7f0722a34700 1 --2- 172.21.15.36:0/3140574762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f071c0b2b60 0x7f071c13af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:18.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.967+0000 7f0722a34700 1 --2- 172.21.15.36:0/3140574762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f071c0affa0 0x7f071c1436d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:18.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.967+0000 7f0722a34700 1 -- 172.21.15.36:0/3140574762 >> 172.21.15.36:0/3140574762 conn(0x7f071c06a110 msgr2=0x7f071c060910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:18.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.967+0000 7f0722a34700 1 -- 172.21.15.36:0/3140574762 shutdown_connections 2022-01-10T01:29:18.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:18.967+0000 7f0722a34700 1 -- 172.21.15.36:0/3140574762 wait complete. 2022-01-10T01:29:18.978 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2022-01-10T01:29:19.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff182311700 1 Processor -- start 2022-01-10T01:29:19.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff182311700 1 -- start start 2022-01-10T01:29:19.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff182311700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff17c0b2580 0x7ff17c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:19.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff182311700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff17c0b0010 0x7ff17c14b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:19.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff182311700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17c0a70c0 con 0x7ff17c0afbd0 2022-01-10T01:29:19.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff182311700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17c0a72f0 con 0x7ff17c0b2580 2022-01-10T01:29:19.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff182311700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c0a7590 con 0x7ff17c0b0010 2022-01-10T01:29:19.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff18130f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff17c0b2580 0x7ff17c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:19.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff181b10700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff17c0afbd0 0x7ff17c0a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34756/0 (socket says 172.21.15.36:34756) 2022-01-10T01:29:19.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff18130f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff17c0b2580 0x7ff17c14ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36962/0 (socket says 172.21.15.36:36962) 2022-01-10T01:29:19.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff181b10700 1 -- 172.21.15.36:0/1674538294 learned_addr learned my addr 172.21.15.36:0/1674538294 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:19.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff180b0e700 1 --2- 172.21.15.36:0/1674538294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff17c0b0010 0x7ff17c14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:19.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff18130f700 1 -- 172.21.15.36:0/1674538294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff17c0b0010 msgr2=0x7ff17c14b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:19.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff18130f700 1 --2- 172.21.15.36:0/1674538294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff17c0b0010 0x7ff17c14b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:19.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff18130f700 1 -- 172.21.15.36:0/1674538294 >> v1:172.21.15.36:6789/0 conn(0x7ff17c0afbd0 legacy=0x7ff17c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:19.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff18130f700 1 -- 172.21.15.36:0/1674538294 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c0a7830 con 0x7ff17c0b2580 2022-01-10T01:29:19.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff18130f700 1 --2- 172.21.15.36:0/1674538294 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff17c0b2580 0x7ff17c14ae40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7ff1740032f0 tx=0x7ff1740091d0).ready entity=mon.0 client_cookie=fc383150a97e8944 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:19.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff16ffff700 1 -- 172.21.15.36:0/1674538294 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff174009ea0 con 0x7ff17c0b2580 2022-01-10T01:29:19.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff16ffff700 1 -- 172.21.15.36:0/1674538294 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17400b8a0 con 0x7ff17c0b2580 2022-01-10T01:29:19.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.079+0000 7ff16ffff700 1 -- 172.21.15.36:0/1674538294 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff17400ba10 con 0x7ff17c0b2580 2022-01-10T01:29:19.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 -- 172.21.15.36:0/1674538294 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff17c0b2580 msgr2=0x7ff17c14ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:19.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 --2- 172.21.15.36:0/1674538294 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff17c0b2580 0x7ff17c14ae40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7ff1740032f0 tx=0x7ff1740091d0).stop 2022-01-10T01:29:19.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 -- 172.21.15.36:0/1674538294 shutdown_connections 2022-01-10T01:29:19.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 --2- 172.21.15.36:0/1674538294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff17c0b0010 0x7ff17c14b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:19.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 --2- 172.21.15.36:0/1674538294 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff17c0b2580 0x7ff17c14ae40 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:19.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 -- 172.21.15.36:0/1674538294 >> 172.21.15.36:0/1674538294 conn(0x7ff17c060180 msgr2=0x7ff17c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:19.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 -- 172.21.15.36:0/1674538294 shutdown_connections 2022-01-10T01:29:19.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 -- 172.21.15.36:0/1674538294 wait complete. 2022-01-10T01:29:19.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 Processor -- start 2022-01-10T01:29:19.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 -- start start 2022-01-10T01:29:19.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff17c0afbd0 0x7ff17c0af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:19.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c0b0010 0x7ff17c0b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:19.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff17c0b2580 0x7ff17c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:19.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c0b2f90 con 0x7ff17c0b2580 2022-01-10T01:29:19.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c0b3230 con 0x7ff17c0b0010 2022-01-10T01:29:19.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff182311700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c0b34d0 con 0x7ff17c0afbd0 2022-01-10T01:29:19.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff181b10700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff17c0b2580 0x7ff17c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:19.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff18130f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff17c0afbd0 0x7ff17c0af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:19.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff18130f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff17c0afbd0 0x7ff17c0af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:43248/0 (socket says 172.21.15.36:43248) 2022-01-10T01:29:19.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff18130f700 1 -- 172.21.15.36:0/3519002855 learned_addr learned my addr 172.21.15.36:0/3519002855 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:19.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff180b0e700 1 --2- 172.21.15.36:0/3519002855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c0b0010 0x7ff17c0b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:19.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff181b10700 1 -- 172.21.15.36:0/3519002855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff17c0afbd0 msgr2=0x7ff17c0af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:19.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff181b10700 1 --2- 172.21.15.36:0/3519002855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff17c0afbd0 0x7ff17c0af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:19.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff181b10700 1 -- 172.21.15.36:0/3519002855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c0b0010 msgr2=0x7ff17c0b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:19.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff181b10700 1 --2- 172.21.15.36:0/3519002855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c0b0010 0x7ff17c0b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:19.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff181b10700 1 -- 172.21.15.36:0/3519002855 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff174009470 con 0x7ff17c0b2580 2022-01-10T01:29:19.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff181b10700 1 --2- 172.21.15.36:0/3519002855 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff17c0b2580 0x7ff17c0b4fb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7ff17c061a80 tx=0x7ff170007b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:19.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff16e7fc700 1 -- 172.21.15.36:0/3519002855 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff17000cd50 con 0x7ff17c0b2580 2022-01-10T01:29:19.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.083+0000 7ff16e7fc700 1 -- 172.21.15.36:0/3519002855 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1700070d0 con 0x7ff17c0b2580 2022-01-10T01:29:19.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.087+0000 7ff16e7fc700 1 -- 172.21.15.36:0/3519002855 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff170007470 con 0x7ff17c0b2580 2022-01-10T01:29:19.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.087+0000 7ff182311700 1 -- 172.21.15.36:0/3519002855 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff17c0aa540 con 0x7ff17c0b2580 2022-01-10T01:29:19.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.087+0000 7ff182311700 1 -- 172.21.15.36:0/3519002855 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17c0b42f0 con 0x7ff17c0b2580 2022-01-10T01:29:19.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.087+0000 7ff182311700 1 -- 172.21.15.36:0/3519002855 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17c057350 con 0x7ff17c0b2580 2022-01-10T01:29:19.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.087+0000 7ff16e7fc700 1 -- 172.21.15.36:0/3519002855 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff170010070 con 0x7ff17c0b2580 2022-01-10T01:29:19.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.087+0000 7ff16e7fc700 1 --2- 172.21.15.36:0/3519002855 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff164053560 0x7ff164055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:19.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.087+0000 7ff16e7fc700 1 -- 172.21.15.36:0/3519002855 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ff17006ac60 con 0x7ff17c0b2580 2022-01-10T01:29:19.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.087+0000 7ff18130f700 1 --2- 172.21.15.36:0/3519002855 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff164053560 0x7ff164055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:19.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.087+0000 7ff18130f700 1 --2- 172.21.15.36:0/3519002855 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff164053560 0x7ff164055a20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7ff17401b000 tx=0x7ff174016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:19.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.095+0000 7ff16e7fc700 1 -- 172.21.15.36:0/3519002855 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff170041eb0 con 0x7ff17c0b2580 2022-01-10T01:29:19.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.259+0000 7ff182311700 1 -- 172.21.15.36:0/3519002855 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7ff17c0698e0 con 0x7ff17c0b2580 2022-01-10T01:29:19.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.683+0000 7ff16e7fc700 1 -- 172.21.15.36:0/3519002855 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v217) v1 ==== 152+0+0 (secure 0 0 0) 0x7ff170018070 con 0x7ff17c0b2580 2022-01-10T01:29:19.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.687+0000 7ff182311700 1 -- 172.21.15.36:0/3519002855 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff164053560 msgr2=0x7ff164055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:19.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.687+0000 7ff182311700 1 --2- 172.21.15.36:0/3519002855 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff164053560 0x7ff164055a20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7ff17401b000 tx=0x7ff174016000).stop 2022-01-10T01:29:19.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.687+0000 7ff182311700 1 -- 172.21.15.36:0/3519002855 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff17c0b2580 msgr2=0x7ff17c0b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:19.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.687+0000 7ff182311700 1 --2- 172.21.15.36:0/3519002855 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff17c0b2580 0x7ff17c0b4fb0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7ff17c061a80 tx=0x7ff170007b10).stop 2022-01-10T01:29:19.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.687+0000 7ff182311700 1 -- 172.21.15.36:0/3519002855 shutdown_connections 2022-01-10T01:29:19.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.687+0000 7ff182311700 1 --2- 172.21.15.36:0/3519002855 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff164053560 0x7ff164055a20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:19.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.687+0000 7ff182311700 1 --2- 172.21.15.36:0/3519002855 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff17c0b2580 0x7ff17c0b4fb0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:19.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.687+0000 7ff182311700 1 --2- 172.21.15.36:0/3519002855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c0b0010 0x7ff17c0b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:19.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.687+0000 7ff182311700 1 --2- 172.21.15.36:0/3519002855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff17c0afbd0 0x7ff17c0af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:19.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.687+0000 7ff182311700 1 -- 172.21.15.36:0/3519002855 >> 172.21.15.36:0/3519002855 conn(0x7ff17c060180 msgr2=0x7ff17c149940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:19.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.687+0000 7ff182311700 1 -- 172.21.15.36:0/3519002855 shutdown_connections 2022-01-10T01:29:19.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.687+0000 7ff182311700 1 -- 172.21.15.36:0/3519002855 wait complete. 2022-01-10T01:29:19.705 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2022-01-10T01:29:19.705 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2022-01-10T01:29:19.706 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2022-01-10T01:29:19.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.803+0000 7fe46b1d6700 1 Processor -- start 2022-01-10T01:29:19.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.803+0000 7fe46b1d6700 1 -- start start 2022-01-10T01:29:19.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe46b1d6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4640b0710 0x7fe464142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:19.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe46b1d6700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe4640b30d0 0x7fe464143210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:19.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe46b1d6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4640b0af0 con 0x7fe4640ace70 2022-01-10T01:29:19.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe46b1d6700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4640ae680 con 0x7fe4640b30d0 2022-01-10T01:29:19.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe46b1d6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4640ae920 con 0x7fe4640b0710 2022-01-10T01:29:19.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe4699d3700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe4640b30d0 0x7fe464143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:19.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe46a1d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4640b0710 0x7fe464142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:19.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe4699d3700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe4640b30d0 0x7fe464143210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36976/0 (socket says 172.21.15.36:36976) 2022-01-10T01:29:19.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe4699d3700 1 -- 172.21.15.36:0/2910971322 learned_addr learned my addr 172.21.15.36:0/2910971322 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:19.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe46a1d4700 1 -- 172.21.15.36:0/2910971322 >> v2:172.21.15.36:3300/0 conn(0x7fe4640b30d0 msgr2=0x7fe464143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:19.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe46a1d4700 1 --2- 172.21.15.36:0/2910971322 >> v2:172.21.15.36:3300/0 conn(0x7fe4640b30d0 0x7fe464143210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:19.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe46a1d4700 1 -- 172.21.15.36:0/2910971322 >> v1:172.21.15.59:6789/0 conn(0x7fe4640ace70 legacy=0x7fe46405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:19.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe46a1d4700 1 -- 172.21.15.36:0/2910971322 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4640aebc0 con 0x7fe4640b0710 2022-01-10T01:29:19.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe4699d3700 1 --2- 172.21.15.36:0/2910971322 >> v2:172.21.15.36:3300/0 conn(0x7fe4640b30d0 0x7fe464143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:19.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe46a1d4700 1 --2- 172.21.15.36:0/2910971322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4640b0710 0x7fe464142d20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fe460002f70 tx=0x7fe460006df0).ready entity=mon.1 client_cookie=95e46dca3838c155 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:19.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe4691d2700 1 -- 172.21.15.36:0/2910971322 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe460014070 con 0x7fe4640b0710 2022-01-10T01:29:19.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe4691d2700 1 -- 172.21.15.36:0/2910971322 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe460000e90 con 0x7fe4640b0710 2022-01-10T01:29:19.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.807+0000 7fe4691d2700 1 -- 172.21.15.36:0/2910971322 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe46000fb60 con 0x7fe4640b0710 2022-01-10T01:29:19.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.811+0000 7fe46b1d6700 1 -- 172.21.15.36:0/2910971322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4640b0710 msgr2=0x7fe464142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:19.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.811+0000 7fe46b1d6700 1 --2- 172.21.15.36:0/2910971322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4640b0710 0x7fe464142d20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fe460002f70 tx=0x7fe460006df0).stop 2022-01-10T01:29:19.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.811+0000 7fe46b1d6700 1 -- 172.21.15.36:0/2910971322 shutdown_connections 2022-01-10T01:29:19.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.811+0000 7fe46b1d6700 1 --2- 172.21.15.36:0/2910971322 >> v2:172.21.15.36:3300/0 conn(0x7fe4640b30d0 0x7fe464143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:19.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.811+0000 7fe46b1d6700 1 --2- 172.21.15.36:0/2910971322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4640b0710 0x7fe464142d20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:19.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.811+0000 7fe46b1d6700 1 -- 172.21.15.36:0/2910971322 >> 172.21.15.36:0/2910971322 conn(0x7fe464061140 msgr2=0x7fe464062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:19.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.811+0000 7fe46b1d6700 1 -- 172.21.15.36:0/2910971322 shutdown_connections 2022-01-10T01:29:19.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.811+0000 7fe46b1d6700 1 -- 172.21.15.36:0/2910971322 wait complete. 2022-01-10T01:29:19.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.811+0000 7fe46b1d6700 1 Processor -- start 2022-01-10T01:29:19.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.811+0000 7fe46b1d6700 1 -- start start 2022-01-10T01:29:19.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46b1d6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4640ace70 0x7fe46409ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:19.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46b1d6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4640b0710 0x7fe4640651a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:19.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46b1d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4640b30d0 0x7fe464065690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:19.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46b1d6700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4640b5250 con 0x7fe4640ace70 2022-01-10T01:29:19.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46b1d6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe464063ce0 con 0x7fe4640b0710 2022-01-10T01:29:19.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46b1d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4640664b0 con 0x7fe4640b30d0 2022-01-10T01:29:19.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46a1d4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4640ace70 0x7fe46409ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:19.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46a1d4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4640ace70 0x7fe46409ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36980/0 (socket says 172.21.15.36:36980) 2022-01-10T01:29:19.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46a1d4700 1 -- 172.21.15.36:0/845025903 learned_addr learned my addr 172.21.15.36:0/845025903 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:19.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe4699d3700 1 --2- 172.21.15.36:0/845025903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4640b0710 0x7fe4640651a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:19.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46a9d5700 1 --2- 172.21.15.36:0/845025903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4640b30d0 0x7fe464065690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:19.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46a1d4700 1 -- 172.21.15.36:0/845025903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4640b30d0 msgr2=0x7fe464065690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:19.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46a1d4700 1 --2- 172.21.15.36:0/845025903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4640b30d0 0x7fe464065690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:19.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46a1d4700 1 -- 172.21.15.36:0/845025903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4640b0710 msgr2=0x7fe4640651a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:19.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46a1d4700 1 --2- 172.21.15.36:0/845025903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4640b0710 0x7fe4640651a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:19.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46a1d4700 1 -- 172.21.15.36:0/845025903 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45400b1e0 con 0x7fe4640ace70 2022-01-10T01:29:19.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46a1d4700 1 --2- 172.21.15.36:0/845025903 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4640ace70 0x7fe46409ebf0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fe46414e390 tx=0x7fe460016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:19.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe4537fe700 1 -- 172.21.15.36:0/845025903 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe46001d450 con 0x7fe4640ace70 2022-01-10T01:29:19.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46b1d6700 1 -- 172.21.15.36:0/845025903 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46000b180 con 0x7fe4640ace70 2022-01-10T01:29:19.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46b1d6700 1 -- 172.21.15.36:0/845025903 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46414ed90 con 0x7fe4640ace70 2022-01-10T01:29:19.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe4537fe700 1 -- 172.21.15.36:0/845025903 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46001d5b0 con 0x7fe4640ace70 2022-01-10T01:29:19.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe4537fe700 1 -- 172.21.15.36:0/845025903 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe46001d910 con 0x7fe4640ace70 2022-01-10T01:29:19.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe46b1d6700 1 -- 172.21.15.36:0/845025903 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe440003410 con 0x7fe4640ace70 2022-01-10T01:29:19.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.815+0000 7fe4537fe700 1 -- 172.21.15.36:0/845025903 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe46001da70 con 0x7fe4640ace70 2022-01-10T01:29:19.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.819+0000 7fe4537fe700 1 --2- 172.21.15.36:0/845025903 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe4440534d0 0x7fe444055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:19.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.819+0000 7fe4537fe700 1 -- 172.21.15.36:0/845025903 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fe46006f940 con 0x7fe4640ace70 2022-01-10T01:29:19.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.819+0000 7fe4699d3700 1 --2- 172.21.15.36:0/845025903 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe4440534d0 0x7fe444055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:19.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.819+0000 7fe4699d3700 1 --2- 172.21.15.36:0/845025903 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe4440534d0 0x7fe444055990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fe45400b000 tx=0x7fe454008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:19.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.827+0000 7fe4537fe700 1 -- 172.21.15.36:0/845025903 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe460046b90 con 0x7fe4640ace70 2022-01-10T01:29:19.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:19.991+0000 7fe46b1d6700 1 -- 172.21.15.36:0/845025903 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7fe440003c40 con 0x7fe4640ace70 2022-01-10T01:29:20.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.691+0000 7fe4537fe700 1 -- 172.21.15.36:0/845025903 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v218) v1 ==== 150+0+0 (secure 0 0 0) 0x7fe46004a1b0 con 0x7fe4640ace70 2022-01-10T01:29:20.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.695+0000 7fe46b1d6700 1 -- 172.21.15.36:0/845025903 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe4440534d0 msgr2=0x7fe444055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:20.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.695+0000 7fe46b1d6700 1 --2- 172.21.15.36:0/845025903 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe4440534d0 0x7fe444055990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7fe45400b000 tx=0x7fe454008040).stop 2022-01-10T01:29:20.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.695+0000 7fe46b1d6700 1 -- 172.21.15.36:0/845025903 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4640ace70 msgr2=0x7fe46409ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:20.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.695+0000 7fe46b1d6700 1 --2- 172.21.15.36:0/845025903 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4640ace70 0x7fe46409ebf0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fe46414e390 tx=0x7fe460016000).stop 2022-01-10T01:29:20.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.695+0000 7fe46b1d6700 1 -- 172.21.15.36:0/845025903 shutdown_connections 2022-01-10T01:29:20.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.695+0000 7fe46b1d6700 1 --2- 172.21.15.36:0/845025903 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe4440534d0 0x7fe444055990 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:20.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.695+0000 7fe46b1d6700 1 --2- 172.21.15.36:0/845025903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4640b30d0 0x7fe464065690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:20.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.695+0000 7fe46b1d6700 1 --2- 172.21.15.36:0/845025903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4640b0710 0x7fe4640651a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:20.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.695+0000 7fe46b1d6700 1 --2- 172.21.15.36:0/845025903 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4640ace70 0x7fe46409ebf0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:20.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.695+0000 7fe46b1d6700 1 -- 172.21.15.36:0/845025903 >> 172.21.15.36:0/845025903 conn(0x7fe464061140 msgr2=0x7fe4641411c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:20.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.695+0000 7fe46b1d6700 1 -- 172.21.15.36:0/845025903 shutdown_connections 2022-01-10T01:29:20.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.695+0000 7fe46b1d6700 1 -- 172.21.15.36:0/845025903 wait complete. 2022-01-10T01:29:20.712 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2022-01-10T01:29:20.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 Processor -- start 2022-01-10T01:29:20.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 -- start start 2022-01-10T01:29:20.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f87640b54a0 0x7f87640af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:20.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87641475a0 0x7f87640acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:20.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87641479f0 con 0x7f87640b0610 2022-01-10T01:29:20.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87641452e0 con 0x7f87640b54a0 2022-01-10T01:29:20.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87640adff0 con 0x7f87641475a0 2022-01-10T01:29:20.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876259c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f87640b54a0 0x7f87640af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:20.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876259c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f87640b54a0 0x7f87640af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36988/0 (socket says 172.21.15.36:36988) 2022-01-10T01:29:20.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876259c700 1 -- 172.21.15.36:0/3980352479 learned_addr learned my addr 172.21.15.36:0/3980352479 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:20.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f8762d9d700 1 --2- 172.21.15.36:0/3980352479 >> v2:172.21.15.59:3300/0 conn(0x7f87641475a0 0x7f87640acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:20.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876259c700 1 -- 172.21.15.36:0/3980352479 >> v2:172.21.15.59:3300/0 conn(0x7f87641475a0 msgr2=0x7f87640acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:20.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876259c700 1 --2- 172.21.15.36:0/3980352479 >> v2:172.21.15.59:3300/0 conn(0x7f87641475a0 0x7f87640acc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:20.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876259c700 1 -- 172.21.15.36:0/3980352479 >> v1:172.21.15.36:6789/0 conn(0x7f87640b0610 legacy=0x7f87640675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:20.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876259c700 1 -- 172.21.15.36:0/3980352479 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87640b5880 con 0x7f87640b54a0 2022-01-10T01:29:20.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f8762d9d700 1 --2- 172.21.15.36:0/3980352479 >> v2:172.21.15.59:3300/0 conn(0x7f87641475a0 0x7f87640acc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:20.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876259c700 1 --2- 172.21.15.36:0/3980352479 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87640b54a0 0x7f87640af550 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f874c002f70 tx=0x7f874c006eb0).ready entity=mon.0 client_cookie=f7e1080c4e2e8983 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:20.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876159a700 1 -- 172.21.15.36:0/3980352479 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f874c00d610 con 0x7f87640b54a0 2022-01-10T01:29:20.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876159a700 1 -- 172.21.15.36:0/3980352479 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c000e90 con 0x7f87640b54a0 2022-01-10T01:29:20.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876159a700 1 -- 172.21.15.36:0/3980352479 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f874c00d9a0 con 0x7f87640b54a0 2022-01-10T01:29:20.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 -- 172.21.15.36:0/3980352479 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87640b54a0 msgr2=0x7f87640af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:20.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 --2- 172.21.15.36:0/3980352479 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87640b54a0 0x7f87640af550 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f874c002f70 tx=0x7f874c006eb0).stop 2022-01-10T01:29:20.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 -- 172.21.15.36:0/3980352479 shutdown_connections 2022-01-10T01:29:20.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 --2- 172.21.15.36:0/3980352479 >> v2:172.21.15.59:3300/0 conn(0x7f87641475a0 0x7f87640acc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:20.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 --2- 172.21.15.36:0/3980352479 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87640b54a0 0x7f87640af550 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:20.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 -- 172.21.15.36:0/3980352479 >> 172.21.15.36:0/3980352479 conn(0x7f8764062560 msgr2=0x7f8764062940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:20.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 -- 172.21.15.36:0/3980352479 shutdown_connections 2022-01-10T01:29:20.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.823+0000 7f876359e700 1 -- 172.21.15.36:0/3980352479 wait complete. 2022-01-10T01:29:20.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f876359e700 1 Processor -- start 2022-01-10T01:29:20.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f876359e700 1 -- start start 2022-01-10T01:29:20.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f876359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87640b0610 0x7f87641466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:20.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f876359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87640b54a0 0x7f8764156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:20.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f876359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87641475a0 0x7f8764157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:20.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f876359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87640b3ff0 con 0x7f87641475a0 2022-01-10T01:29:20.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f876359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87640b4930 con 0x7f87640b54a0 2022-01-10T01:29:20.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f876359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87640b4bd0 con 0x7f87640b0610 2022-01-10T01:29:20.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f8762d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87641475a0 0x7f8764157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:20.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f8762d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87641475a0 0x7f8764157260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:36996/0 (socket says 172.21.15.36:36996) 2022-01-10T01:29:20.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f8762d9d700 1 -- 172.21.15.36:0/548558960 learned_addr learned my addr 172.21.15.36:0/548558960 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:20.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f876259c700 1 --2- 172.21.15.36:0/548558960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87640b0610 0x7f87641466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:20.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f8761d9b700 1 --2- 172.21.15.36:0/548558960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87640b54a0 0x7f8764156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:20.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f8762d9d700 1 -- 172.21.15.36:0/548558960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87640b0610 msgr2=0x7f87641466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:20.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f8762d9d700 1 --2- 172.21.15.36:0/548558960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87640b0610 0x7f87641466f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:20.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f8762d9d700 1 -- 172.21.15.36:0/548558960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87640b54a0 msgr2=0x7f8764156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:20.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f8762d9d700 1 --2- 172.21.15.36:0/548558960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87640b54a0 0x7f8764156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:20.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f8762d9d700 1 -- 172.21.15.36:0/548558960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c00b1e0 con 0x7f87641475a0 2022-01-10T01:29:20.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f8762d9d700 1 --2- 172.21.15.36:0/548558960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87641475a0 0x7f8764157260 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f875c006940 tx=0x7f875c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:20.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f875b7fe700 1 -- 172.21.15.36:0/548558960 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f875c011780 con 0x7f87641475a0 2022-01-10T01:29:20.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f875b7fe700 1 -- 172.21.15.36:0/548558960 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c0118e0 con 0x7f87641475a0 2022-01-10T01:29:20.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f876359e700 1 -- 172.21.15.36:0/548558960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87640b4e70 con 0x7f87641475a0 2022-01-10T01:29:20.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.827+0000 7f875b7fe700 1 -- 172.21.15.36:0/548558960 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f875c011c40 con 0x7f87641475a0 2022-01-10T01:29:20.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.831+0000 7f876359e700 1 -- 172.21.15.36:0/548558960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87641578f0 con 0x7f87641475a0 2022-01-10T01:29:20.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.831+0000 7f876359e700 1 -- 172.21.15.36:0/548558960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876415af50 con 0x7f87641475a0 2022-01-10T01:29:20.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.831+0000 7f875b7fe700 1 -- 172.21.15.36:0/548558960 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f875c01c460 con 0x7f87641475a0 2022-01-10T01:29:20.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.831+0000 7f875b7fe700 1 --2- 172.21.15.36:0/548558960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8748053590 0x7f8748055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:20.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.831+0000 7f875b7fe700 1 -- 172.21.15.36:0/548558960 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f875c06b880 con 0x7f87641475a0 2022-01-10T01:29:20.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.831+0000 7f876259c700 1 --2- 172.21.15.36:0/548558960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8748053590 0x7f8748055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:20.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.831+0000 7f876259c700 1 --2- 172.21.15.36:0/548558960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8748053590 0x7f8748055a50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f874c01c000 tx=0x7f874c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:20.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.839+0000 7f875b7fe700 1 -- 172.21.15.36:0/548558960 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f876415af50 con 0x7f87641475a0 2022-01-10T01:29:20.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.963+0000 7f876359e700 1 -- 172.21.15.36:0/548558960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f876415af50 con 0x7f87641475a0 2022-01-10T01:29:20.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.975+0000 7f875b7fe700 1 -- 172.21.15.36:0/548558960 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f876415af50 con 0x7f87641475a0 2022-01-10T01:29:20.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.975+0000 7f876359e700 1 -- 172.21.15.36:0/548558960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8748053590 msgr2=0x7f8748055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:20.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.975+0000 7f876359e700 1 --2- 172.21.15.36:0/548558960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8748053590 0x7f8748055a50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f874c01c000 tx=0x7f874c015000).stop 2022-01-10T01:29:20.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.975+0000 7f876359e700 1 -- 172.21.15.36:0/548558960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87641475a0 msgr2=0x7f8764157260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:20.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.975+0000 7f876359e700 1 --2- 172.21.15.36:0/548558960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87641475a0 0x7f8764157260 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f875c006940 tx=0x7f875c008040).stop 2022-01-10T01:29:20.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.975+0000 7f876359e700 1 -- 172.21.15.36:0/548558960 shutdown_connections 2022-01-10T01:29:20.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.975+0000 7f876359e700 1 --2- 172.21.15.36:0/548558960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8748053590 0x7f8748055a50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:20.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.975+0000 7f876359e700 1 --2- 172.21.15.36:0/548558960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87641475a0 0x7f8764157260 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:20.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.975+0000 7f876359e700 1 --2- 172.21.15.36:0/548558960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87640b54a0 0x7f8764156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:20.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.975+0000 7f876359e700 1 --2- 172.21.15.36:0/548558960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87640b0610 0x7f87641466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:20.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.975+0000 7f876359e700 1 -- 172.21.15.36:0/548558960 >> 172.21.15.36:0/548558960 conn(0x7f8764062560 msgr2=0x7f8764067370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:20.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.975+0000 7f876359e700 1 -- 172.21.15.36:0/548558960 shutdown_connections 2022-01-10T01:29:20.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:20.975+0000 7f876359e700 1 -- 172.21.15.36:0/548558960 wait complete. 2022-01-10T01:29:20.993 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:29:20.994 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:29:21.012 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:29:21.032 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:29:21.053 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:29:21.075 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:29:21.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:21.076 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:29:21.077 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:29:21.101 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2022-01-10T01:29:21.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:29:21.103 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2022-01-10T01:29:21.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:21.104 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:29:21.104 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:29:21.111 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:29:21.112 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:29:21.113 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:29:21.113 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:29:21.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.223+0000 7f1ef8c8c700 1 Processor -- start 2022-01-10T01:29:21.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef8c8c700 1 -- start start 2022-01-10T01:29:21.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef8c8c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ef41483a0 0x7f1ef40b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef8c8c700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef40b0350 con 0x7f1ef40a70c0 2022-01-10T01:29:21.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef8c8c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef40b05f0 con 0x7f1ef40b1db0 2022-01-10T01:29:21.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef8c8c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef40a90c0 con 0x7f1ef41483a0 2022-01-10T01:29:21.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef2d9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f1ef40a70c0 0x7f1ef4144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34800/0 (socket says 172.21.15.36:34800) 2022-01-10T01:29:21.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef2d9d700 1 -- 172.21.15.36:0/4019808950 learned_addr learned my addr 172.21.15.36:0/4019808950 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:21.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef1d9b700 1 --2- 172.21.15.36:0/4019808950 >> v2:172.21.15.59:3300/0 conn(0x7f1ef41483a0 0x7f1ef40b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 -- 172.21.15.36:0/4019808950 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908861376 0 0) 0x7f1ef40b0350 con 0x7f1ef40a70c0 2022-01-10T01:29:21.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 -- 172.21.15.36:0/4019808950 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ed8003260 con 0x7f1ef40a70c0 2022-01-10T01:29:21.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 -- 172.21.15.36:0/4019808950 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 768877020 0 0) 0x7f1ed8003260 con 0x7f1ef40a70c0 2022-01-10T01:29:21.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 -- 172.21.15.36:0/4019808950 >> v2:172.21.15.59:3300/0 conn(0x7f1ef41483a0 msgr2=0x7f1ef40b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:21.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 --2- 172.21.15.36:0/4019808950 >> v2:172.21.15.59:3300/0 conn(0x7f1ef41483a0 0x7f1ef40b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 -- 172.21.15.36:0/4019808950 >> v1:172.21.15.59:6789/0 conn(0x7f1ef40b1db0 legacy=0x7f1ef40b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:21.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 -- 172.21.15.36:0/4019808950 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef40b0890 con 0x7f1ef40a70c0 2022-01-10T01:29:21.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 -- 172.21.15.36:0/4019808950 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f1eec0019e0 con 0x7f1ef40a70c0 2022-01-10T01:29:21.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 -- 172.21.15.36:0/4019808950 >> v1:172.21.15.36:6789/0 conn(0x7f1ef40a70c0 legacy=0x7f1ef4144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:21.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 --2- 172.21.15.36:0/4019808950 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ed8003780 0x7f1ed8003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 --2- 172.21.15.36:0/4019808950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ed8004500 0x7f1ed8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 --2- 172.21.15.36:0/4019808950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ed8004e70 0x7f1ed800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 -- 172.21.15.36:0/4019808950 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed800bcf0 con 0x7f1ed8003780 2022-01-10T01:29:21.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 -- 172.21.15.36:0/4019808950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed800be60 con 0x7f1ed8004e70 2022-01-10T01:29:21.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 -- 172.21.15.36:0/4019808950 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed800c020 con 0x7f1ed8004500 2022-01-10T01:29:21.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef259c700 1 --2- 172.21.15.36:0/4019808950 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ed8003780 0x7f1ed8003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef1d9b700 1 --2- 172.21.15.36:0/4019808950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ed8004500 0x7f1ed8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef2d9d700 1 --2- 172.21.15.36:0/4019808950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ed8004e70 0x7f1ed800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef259c700 1 -- 172.21.15.36:0/4019808950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ed8004500 msgr2=0x7f1ed8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:21.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef259c700 1 --2- 172.21.15.36:0/4019808950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ed8004500 0x7f1ed8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef259c700 1 -- 172.21.15.36:0/4019808950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ed8004e70 msgr2=0x7f1ed800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:21.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef259c700 1 --2- 172.21.15.36:0/4019808950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ed8004e70 0x7f1ed800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef259c700 1 -- 172.21.15.36:0/4019808950 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed8003260 con 0x7f1ed8003780 2022-01-10T01:29:21.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef2d9d700 1 --2- 172.21.15.36:0/4019808950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ed8004e70 0x7f1ed800b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:21.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef2d9d700 1 -- 172.21.15.36:0/4019808950 reap_dead start 2022-01-10T01:29:21.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef259c700 1 --2- 172.21.15.36:0/4019808950 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ed8003780 0x7f1ed8003ba0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f1ef40b3170 tx=0x7f1ee8007a00).ready entity=mon.0 client_cookie=22a0744a1de42235 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:21.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 -- 172.21.15.36:0/4019808950 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ee8007d10 con 0x7f1ed8003780 2022-01-10T01:29:21.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 -- 172.21.15.36:0/4019808950 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee8007030 con 0x7f1ed8003780 2022-01-10T01:29:21.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.227+0000 7f1ef159a700 1 -- 172.21.15.36:0/4019808950 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ee8007390 con 0x7f1ed8003780 2022-01-10T01:29:21.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/4019808950 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ed8003780 msgr2=0x7f1ed8003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:21.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 --2- 172.21.15.36:0/4019808950 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ed8003780 0x7f1ed8003ba0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f1ef40b3170 tx=0x7f1ee8007a00).stop 2022-01-10T01:29:21.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/4019808950 shutdown_connections 2022-01-10T01:29:21.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 --2- 172.21.15.36:0/4019808950 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ed8003780 0x7f1ed8003ba0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/4019808950 >> 172.21.15.36:0/4019808950 conn(0x7f1ef405f6b0 msgr2=0x7f1ef405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:21.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/4019808950 shutdown_connections 2022-01-10T01:29:21.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/4019808950 wait complete. 2022-01-10T01:29:21.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 Processor -- start 2022-01-10T01:29:21.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 -- start start 2022-01-10T01:29:21.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ed8003780 0x7f1ef414b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ef40ae330 0x7f1ef40a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ef415a410 0x7f1ef415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef414a790 con 0x7f1ef40ae330 2022-01-10T01:29:21.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef40ac740 con 0x7f1ef415a410 2022-01-10T01:29:21.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef8c8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef414adb0 con 0x7f1ed8003780 2022-01-10T01:29:21.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef1d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ef40ae330 0x7f1ef40a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef1d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ef40ae330 0x7f1ef40a93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37016/0 (socket says 172.21.15.36:37016) 2022-01-10T01:29:21.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef1d9b700 1 -- 172.21.15.36:0/1728309717 learned_addr learned my addr 172.21.15.36:0/1728309717 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:21.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef259c700 1 --2- 172.21.15.36:0/1728309717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ed8003780 0x7f1ef414b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef2d9d700 1 --2- 172.21.15.36:0/1728309717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ef415a410 0x7f1ef415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef1d9b700 1 -- 172.21.15.36:0/1728309717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ed8003780 msgr2=0x7f1ef414b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:21.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef1d9b700 1 --2- 172.21.15.36:0/1728309717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ed8003780 0x7f1ef414b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef1d9b700 1 -- 172.21.15.36:0/1728309717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ef415a410 msgr2=0x7f1ef415a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:21.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef1d9b700 1 --2- 172.21.15.36:0/1728309717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ef415a410 0x7f1ef415a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef1d9b700 1 -- 172.21.15.36:0/1728309717 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef414a4f0 con 0x7f1ef40ae330 2022-01-10T01:29:21.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.231+0000 7f1ef1d9b700 1 --2- 172.21.15.36:0/1728309717 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ef40ae330 0x7f1ef40a93a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f1ee400b000 tx=0x7f1ee4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:21.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.235+0000 7f1ee37fe700 1 -- 172.21.15.36:0/1728309717 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ee4011ee0 con 0x7f1ef40ae330 2022-01-10T01:29:21.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.235+0000 7f1ee37fe700 1 -- 172.21.15.36:0/1728309717 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4000e90 con 0x7f1ef40ae330 2022-01-10T01:29:21.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.235+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/1728309717 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef414b360 con 0x7f1ef40ae330 2022-01-10T01:29:21.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.235+0000 7f1ee37fe700 1 -- 172.21.15.36:0/1728309717 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ee400fb30 con 0x7f1ef40ae330 2022-01-10T01:29:21.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.235+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/1728309717 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef40af160 con 0x7f1ef40ae330 2022-01-10T01:29:21.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.235+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/1728309717 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef414b4f0 con 0x7f1ef40ae330 2022-01-10T01:29:21.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.235+0000 7f1ee37fe700 1 -- 172.21.15.36:0/1728309717 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1ee400fc90 con 0x7f1ef40ae330 2022-01-10T01:29:21.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.235+0000 7f1ee37fe700 1 --2- 172.21.15.36:0/1728309717 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ed00535f0 0x7f1ed0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.239+0000 7f1ee37fe700 1 -- 172.21.15.36:0/1728309717 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f1ee406beb0 con 0x7f1ef40ae330 2022-01-10T01:29:21.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.239+0000 7f1ef259c700 1 --2- 172.21.15.36:0/1728309717 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ed00535f0 0x7f1ed0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.239+0000 7f1ef259c700 1 --2- 172.21.15.36:0/1728309717 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ed00535f0 0x7f1ed0055ab0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f1ee801b000 tx=0x7f1ee8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:21.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.243+0000 7f1ee37fe700 1 -- 172.21.15.36:0/1728309717 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1ee40431a0 con 0x7f1ef40ae330 2022-01-10T01:29:21.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.371+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/1728309717 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1ef40b0b30 con 0x7f1ef40ae330 2022-01-10T01:29:21.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.375+0000 7f1ee37fe700 1 -- 172.21.15.36:0/1728309717 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v59) v1 ==== 81+0+29220 (secure 0 0 0) 0x7f1ee4018020 con 0x7f1ef40ae330 2022-01-10T01:29:21.375 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:21.375 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:29:21.376 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 59, 2022-01-10T01:29:21.376 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:29:21.376 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:29:21.376 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:29:18.666935+0000", 2022-01-10T01:29:21.376 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:29:21.377 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:29:21.377 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:29:21.377 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:29:21.377 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:29:21.378 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:29:21.378 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:29:21.378 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:29:21.378 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:29:21.379 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:29:21.379 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:29:21.379 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:29:21.379 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:29:21.379 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:29:21.380 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:29:21.380 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 10, 2022-01-10T01:29:21.380 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:29:21.380 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:29:21.381 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:29:21.381 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:29:21.381 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:29:21.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.381 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:29:21.382 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:29:21.382 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:29:21.382 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:29:21.382 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:29:21.383 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:29:21.383 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:29:21.383 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:29:21.383 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:29:21.384 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:29:21.384 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:29:21.384 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:29:21.384 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:29:21.384 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:29:21.385 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:29:21.385 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:29:21.385 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:29:21.385 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:29:21.386 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:29:21.386 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:29:21.386 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:29:21.386 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:29:21.386 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:29:21.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.387 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:29:21.387 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:29:21.387 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:29:21.388 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:29:21.388 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:29:21.388 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:29:21.388 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:29:21.388 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:29:21.389 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:29:21.389 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:29:21.389 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:29:21.389 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:29:21.389 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:29:21.390 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:29:21.390 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:29:21.390 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:29:21.390 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:29:21.391 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:29:21.391 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:29:21.391 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:29:21.391 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:29:21.392 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:29:21.392 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:29:21.392 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:29:21.392 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:29:21.392 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:29:21.393 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:29:21.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.393 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:29:21.393 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:29:21.394 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:29:21.394 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:29:21.394 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:29:21.394 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:29:21.394 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:29:21.395 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:29:21.395 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:29:21.395 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:29:21.395 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:29:21.396 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:29:21.396 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:29:21.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.396 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:29:21.396 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:29:21.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.397 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:29:21.397 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:29:21.398 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:29:21.398 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:29:21.398 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:29:21.398 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:29:21.399 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:29:21.399 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:29:21.399 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:29:21.399 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:29:21.400 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:29:21.400 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:29:21.400 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:29:21.400 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:29:21.400 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:29:21.401 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:29:21.401 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:29:21.401 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:29:21.401 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:29:21.401 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:29:21.402 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:29:21.402 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:29:21.402 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:29:21.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.403 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:29:21.403 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:29:21.403 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:29:21.403 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:29:21.404 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:29:21.404 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:29:21.404 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:29:21.404 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:29:21.404 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:29:21.405 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:29:21.405 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:29:21.405 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:29:21.405 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:29:21.405 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:29:21.406 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:29:21.406 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:29:21.406 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:29:21.406 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:29:21.406 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:29:21.407 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:29:21.407 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:29:21.407 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:29:21.407 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:29:21.408 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:29:21.408 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:29:21.408 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:29:21.408 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:29:21.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.409 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:29:21.409 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:29:21.409 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:29:21.409 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:29:21.410 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:29:21.410 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:29:21.410 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:29:21.410 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:29:21.411 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:29:21.411 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:29:21.411 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:29:21.412 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:29:21.412 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:29:21.412 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:29:21.412 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.412 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.413 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:29:21.413 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:29:21.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.413 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:29:21.414 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:29:21.414 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:21.414 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:21.414 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:21.414 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:21.415 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:21.415 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:21.415 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:21.415 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 54, 2022-01-10T01:29:21.416 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:21.416 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:21.416 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:21.416 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.417 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.417 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:29:21.417 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:21.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.418 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.418 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:29:21.418 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:21.418 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.419 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.419 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:21.419 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.420 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.420 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:29:21.420 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:21.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.421 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.421 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:29:21.421 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:21.421 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.422 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.422 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:21.423 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.423 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.423 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:29:21.423 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:21.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.424 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.424 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.424 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:29:21.425 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:21.425 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.425 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.425 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:21.426 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.426 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.426 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:29:21.427 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:21.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.427 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.427 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.427 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:29:21.428 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:21.428 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.428 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.428 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:29:21.429 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:29:21.429 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:29:21.429 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:29:21.429 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:21.430 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:21.430 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:21.430 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.431 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:29:21.431 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:29:21.431 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:21.431 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:21.432 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:21.432 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:21.432 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:21.432 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:21.432 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:21.433 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 43, 2022-01-10T01:29:21.433 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:21.433 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:21.433 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:21.434 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.434 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.434 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:29:21.434 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:21.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.435 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.435 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:29:21.436 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:21.436 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.436 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.436 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:21.437 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.437 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.437 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:29:21.438 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:21.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.438 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.438 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:29:21.439 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:21.439 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.439 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.440 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:21.440 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.440 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.440 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:29:21.441 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:21.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.441 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.442 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:29:21.442 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:21.442 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.442 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.443 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:21.443 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.443 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.444 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:29:21.444 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:21.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.445 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.445 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:29:21.445 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:21.445 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.445 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.446 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:29:21.446 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:29:21.446 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:29:21.447 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:29:21.447 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:21.447 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:21.447 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:21.447 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.448 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:29:21.448 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:29:21.449 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:21.449 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:21.449 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:21.449 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:21.449 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:21.450 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:21.450 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:21.450 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 54, 2022-01-10T01:29:21.450 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:21.450 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:21.451 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:21.451 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.451 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.452 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:29:21.452 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:21.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.452 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.453 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:29:21.453 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:21.453 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.453 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.454 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:21.454 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.454 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.455 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:29:21.455 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:21.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.456 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:29:21.456 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:21.456 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.456 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.457 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:21.457 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.457 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.458 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:29:21.458 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:21.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.459 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.459 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:29:21.459 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:21.459 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.459 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.460 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:21.460 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.461 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.461 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:29:21.461 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:21.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.462 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.462 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:29:21.462 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:21.462 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.463 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.463 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:29:21.463 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:29:21.463 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:29:21.464 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:29:21.464 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:21.464 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:21.465 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:21.465 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.465 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:29:21.466 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:29:21.466 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:21.466 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:21.467 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:21.467 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:21.467 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:21.467 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:21.468 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:21.468 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 54, 2022-01-10T01:29:21.468 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:21.468 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:21.468 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:21.469 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.469 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.469 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:29:21.470 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:21.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.470 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.470 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:29:21.471 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:21.471 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.471 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.472 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:21.472 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.472 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.472 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:29:21.473 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:21.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.473 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.473 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:29:21.474 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:21.474 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.474 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.475 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:21.475 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.475 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.476 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:29:21.476 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:21.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.477 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.477 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:29:21.477 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:21.477 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.477 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.478 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:21.478 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.479 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.479 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:29:21.479 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:21.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.480 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.480 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:29:21.480 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:21.480 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.481 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.481 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:29:21.481 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:29:21.481 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:29:21.482 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:29:21.482 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:21.482 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:21.482 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:21.483 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.483 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:29:21.483 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:29:21.484 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:21.484 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:21.484 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:21.484 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:21.485 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:21.485 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:21.485 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:21.485 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 54, 2022-01-10T01:29:21.485 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:21.486 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:21.486 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:21.486 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.487 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.487 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:29:21.487 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:21.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.488 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.488 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:29:21.488 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:21.488 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.489 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.489 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:21.489 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.490 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.490 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:29:21.490 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:21.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.491 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.491 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:29:21.491 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:21.492 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.492 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.492 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:21.492 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.493 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.493 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:29:21.493 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:21.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.494 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.494 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:29:21.494 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:21.495 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.495 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.495 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:21.496 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.496 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.496 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:29:21.496 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:21.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.497 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.497 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.497 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:29:21.498 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:21.498 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.498 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.499 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:29:21.499 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:29:21.499 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:29:21.499 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:29:21.500 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:21.500 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:21.500 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:21.500 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.501 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:29:21.501 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:29:21.501 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:21.502 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:21.502 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:21.502 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:21.502 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:21.502 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:21.503 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:21.503 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 54, 2022-01-10T01:29:21.503 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:21.503 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:21.504 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:21.504 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.504 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.504 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:29:21.505 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:21.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.505 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.506 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:29:21.506 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:21.506 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.506 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.507 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:21.507 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.507 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.508 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:29:21.508 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:21.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.508 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.509 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:29:21.509 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:21.509 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.509 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.510 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:21.510 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.510 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.511 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:29:21.511 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:21.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.512 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.512 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:29:21.512 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:21.512 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.512 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.513 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:21.513 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.514 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.514 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:29:21.514 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:21.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.515 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.515 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:29:21.515 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:21.515 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.516 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.516 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:29:21.516 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:29:21.517 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:29:21.517 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:29:21.517 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:21.517 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:21.517 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:21.518 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.518 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:29:21.518 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:29:21.519 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:21.519 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:21.519 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:21.519 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:21.520 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:21.520 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:21.520 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:21.520 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 53, 2022-01-10T01:29:21.520 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:21.521 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:21.521 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:21.521 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.522 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.522 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:29:21.522 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:21.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.523 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.523 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:29:21.523 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:21.523 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.524 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.524 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:21.524 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.525 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.525 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:29:21.525 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:21.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.526 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.526 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:29:21.526 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:21.526 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.527 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.527 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:21.527 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.528 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.528 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:29:21.528 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:21.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.529 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.529 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:29:21.529 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:21.529 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.530 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.530 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:21.530 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.531 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.531 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:29:21.531 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:21.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.532 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.532 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:29:21.532 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:21.532 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.533 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.533 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:29:21.533 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:29:21.534 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:29:21.534 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:29:21.534 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:21.534 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:21.534 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:21.535 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.535 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:29:21.536 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:29:21.536 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:21.536 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:21.536 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:21.536 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:21.537 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:21.537 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:21.537 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:21.537 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 53, 2022-01-10T01:29:21.537 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:21.538 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:21.538 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:21.538 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.539 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.539 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:29:21.539 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:21.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.540 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.540 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:29:21.540 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:21.540 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.541 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.541 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:21.541 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.541 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.542 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.542 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:29:21.542 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:21.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.543 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.543 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:29:21.543 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:21.543 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.544 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.544 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:21.544 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.545 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.545 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:29:21.545 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:21.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.546 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.546 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:29:21.546 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:21.547 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.547 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.547 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:21.548 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:21.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.548 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:21.548 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:29:21.548 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:21.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.549 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:21.549 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:29:21.549 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:21.550 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.550 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.550 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:29:21.551 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:29:21.551 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:29:21.551 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:29:21.551 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:21.552 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:21.552 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:21.552 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:21.552 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.552 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:29:21.553 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:29:21.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.553 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:29:21.553 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:21.554 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:21.554 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:21.554 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:21.554 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:21.554 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:29:21.555 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:21.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.555 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:29:21.556 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:21.556 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:21.556 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:21.556 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:21.556 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:21.557 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:29:21.557 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:21.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.558 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:29:21.558 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:21.558 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:21.558 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:21.558 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:21.559 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:21.559 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:29:21.559 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:21.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.560 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:29:21.560 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:21.560 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:21.560 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:21.561 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:21.561 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:21.561 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:29:21.561 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:21.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.562 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:29:21.562 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:21.562 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:21.563 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:21.563 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:21.563 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:21.563 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:29:21.564 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:21.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.564 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:29:21.564 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:21.565 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:21.565 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:21.565 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:21.565 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:21.566 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:29:21.566 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:21.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.567 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:29:21.567 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:21.567 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:21.567 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:21.567 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:21.568 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:21.568 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:29:21.568 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:21.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:21.569 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:29:21.569 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:21.569 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:21.569 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:21.570 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:21.570 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:21.570 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:29:21.570 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:21.570 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.571 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:29:21.571 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:29:21.571 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:29:21.571 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:29:21.572 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:29:21.572 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": { 2022-01-10T01:29:21.572 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.59:6833/1363567016": "2022-01-11T01:29:14.674967+0000", 2022-01-10T01:29:21.572 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.59:6832/1363567016": "2022-01-11T01:29:14.674967+0000" 2022-01-10T01:29:21.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.573 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:29:21.573 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:29:21.573 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:29:21.573 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:29:21.574 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:29:21.574 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:29:21.574 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:29:21.574 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:29:21.574 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:29:21.575 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:29:21.575 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:29:21.575 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:29:21.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.576 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:29:21.576 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:29:21.576 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:29:21.576 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:29:21.577 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:29:21.577 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:29:21.577 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:29:21.577 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:21.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:21.578 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:29:21.578 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:29:21.578 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:29:21.578 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:29:21.579 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:29:21.579 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:29:21.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.375+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/1728309717 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ed00535f0 msgr2=0x7f1ed0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:21.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.375+0000 7f1ef8c8c700 1 --2- 172.21.15.36:0/1728309717 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ed00535f0 0x7f1ed0055ab0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f1ee801b000 tx=0x7f1ee8015000).stop 2022-01-10T01:29:21.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.375+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/1728309717 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ef40ae330 msgr2=0x7f1ef40a93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:21.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.375+0000 7f1ef8c8c700 1 --2- 172.21.15.36:0/1728309717 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ef40ae330 0x7f1ef40a93a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f1ee400b000 tx=0x7f1ee4006df0).stop 2022-01-10T01:29:21.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.375+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/1728309717 shutdown_connections 2022-01-10T01:29:21.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.375+0000 7f1ef8c8c700 1 --2- 172.21.15.36:0/1728309717 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ed00535f0 0x7f1ed0055ab0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.375+0000 7f1ef8c8c700 1 --2- 172.21.15.36:0/1728309717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ef415a410 0x7f1ef415a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.375+0000 7f1ef8c8c700 1 --2- 172.21.15.36:0/1728309717 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ef40ae330 0x7f1ef40a93a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.375+0000 7f1ef8c8c700 1 --2- 172.21.15.36:0/1728309717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ed8003780 0x7f1ef414b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.375+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/1728309717 >> 172.21.15.36:0/1728309717 conn(0x7f1ef405f6b0 msgr2=0x7f1ef40b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:21.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.375+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/1728309717 shutdown_connections 2022-01-10T01:29:21.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.375+0000 7f1ef8c8c700 1 -- 172.21.15.36:0/1728309717 wait complete. 2022-01-10T01:29:21.584 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:29:21.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31b58700 1 Processor -- start 2022-01-10T01:29:21.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31b58700 1 -- start start 2022-01-10T01:29:21.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31b58700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0b0710 0x7f5a2c142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31b58700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a2c0b30d0 0x7f5a2c143210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31b58700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5a2c0ace70 0x7f5a2c05f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31b58700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2c0b0af0 con 0x7f5a2c0ace70 2022-01-10T01:29:21.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31b58700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2c0ae680 con 0x7f5a2c0b30d0 2022-01-10T01:29:21.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31b58700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c0ae920 con 0x7f5a2c0b0710 2022-01-10T01:29:21.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31357700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5a2c0ace70 0x7f5a2c05f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31357700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5a2c0ace70 0x7f5a2c05f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37026/0 (socket says 172.21.15.36:37026) 2022-01-10T01:29:21.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31357700 1 -- 172.21.15.36:0/3882493789 learned_addr learned my addr 172.21.15.36:0/3882493789 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:21.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a30b56700 1 --2- 172.21.15.36:0/3882493789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0b0710 0x7f5a2c142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a2bfff700 1 --2- 172.21.15.36:0/3882493789 >> v2:172.21.15.59:3300/0 conn(0x7f5a2c0b30d0 0x7f5a2c143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31357700 1 -- 172.21.15.36:0/3882493789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0b0710 msgr2=0x7f5a2c142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:21.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31357700 1 --2- 172.21.15.36:0/3882493789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0b0710 0x7f5a2c142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31357700 1 -- 172.21.15.36:0/3882493789 >> v2:172.21.15.59:3300/0 conn(0x7f5a2c0b30d0 msgr2=0x7f5a2c143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:21.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31357700 1 --2- 172.21.15.36:0/3882493789 >> v2:172.21.15.59:3300/0 conn(0x7f5a2c0b30d0 0x7f5a2c143210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31357700 1 -- 172.21.15.36:0/3882493789 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c0aebc0 con 0x7f5a2c0ace70 2022-01-10T01:29:21.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a2bfff700 1 --2- 172.21.15.36:0/3882493789 >> v2:172.21.15.59:3300/0 conn(0x7f5a2c0b30d0 0x7f5a2c143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:21.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.699+0000 7f5a31357700 1 --2- 172.21.15.36:0/3882493789 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a2c0ace70 0x7f5a2c05f6b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f5a240032f0 tx=0x7f5a24009290).ready entity=mon.0 client_cookie=fa87c65a65c378c7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:21.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.703+0000 7f5a2b7fe700 1 -- 172.21.15.36:0/3882493789 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2400b870 con 0x7f5a2c0ace70 2022-01-10T01:29:21.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.703+0000 7f5a2b7fe700 1 -- 172.21.15.36:0/3882493789 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2400b9d0 con 0x7f5a2c0ace70 2022-01-10T01:29:21.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.703+0000 7f5a2b7fe700 1 -- 172.21.15.36:0/3882493789 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2400bb40 con 0x7f5a2c0ace70 2022-01-10T01:29:21.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.703+0000 7f5a31b58700 1 -- 172.21.15.36:0/3882493789 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a2c0ace70 msgr2=0x7f5a2c05f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:21.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.703+0000 7f5a31b58700 1 --2- 172.21.15.36:0/3882493789 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a2c0ace70 0x7f5a2c05f6b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f5a240032f0 tx=0x7f5a24009290).stop 2022-01-10T01:29:21.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.703+0000 7f5a31b58700 1 -- 172.21.15.36:0/3882493789 shutdown_connections 2022-01-10T01:29:21.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.703+0000 7f5a31b58700 1 --2- 172.21.15.36:0/3882493789 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a2c0ace70 0x7f5a2c05f6b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.703+0000 7f5a31b58700 1 --2- 172.21.15.36:0/3882493789 >> v2:172.21.15.59:3300/0 conn(0x7f5a2c0b30d0 0x7f5a2c143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.703+0000 7f5a31b58700 1 --2- 172.21.15.36:0/3882493789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0b0710 0x7f5a2c142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.703+0000 7f5a31b58700 1 -- 172.21.15.36:0/3882493789 >> 172.21.15.36:0/3882493789 conn(0x7f5a2c061140 msgr2=0x7f5a2c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:21.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.703+0000 7f5a31b58700 1 -- 172.21.15.36:0/3882493789 shutdown_connections 2022-01-10T01:29:21.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.703+0000 7f5a31b58700 1 -- 172.21.15.36:0/3882493789 wait complete. 2022-01-10T01:29:21.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.703+0000 7f5a31b58700 1 Processor -- start 2022-01-10T01:29:21.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.703+0000 7f5a31b58700 1 -- start start 2022-01-10T01:29:21.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a31b58700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0ace70 0x7f5a2c151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a31b58700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2c0b0710 0x7f5a2c0648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a31b58700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a2c0b30d0 0x7f5a2c064d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a31b58700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c1522a0 con 0x7f5a2c0b30d0 2022-01-10T01:29:21.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a31b58700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c09fa80 con 0x7f5a2c0b0710 2022-01-10T01:29:21.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a31b58700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c152000 con 0x7f5a2c0ace70 2022-01-10T01:29:21.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a31357700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a2c0b30d0 0x7f5a2c064d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a31357700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a2c0b30d0 0x7f5a2c064d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37032/0 (socket says 172.21.15.36:37032) 2022-01-10T01:29:21.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a31357700 1 -- 172.21.15.36:0/2342355743 learned_addr learned my addr 172.21.15.36:0/2342355743 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:21.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a30b56700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0ace70 0x7f5a2c151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a2bfff700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2c0b0710 0x7f5a2c0648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a30b56700 1 -- 172.21.15.36:0/2342355743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2c0b0710 msgr2=0x7f5a2c0648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:21.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a30b56700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2c0b0710 0x7f5a2c0648a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a30b56700 1 -- 172.21.15.36:0/2342355743 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a2c0b30d0 msgr2=0x7f5a2c064d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:21.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a30b56700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a2c0b30d0 0x7f5a2c064d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a30b56700 1 -- 172.21.15.36:0/2342355743 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a24009530 con 0x7f5a2c0ace70 2022-01-10T01:29:21.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a31357700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a2c0b30d0 0x7f5a2c064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:21.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a2bfff700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2c0b0710 0x7f5a2c0648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:21.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a30b56700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0ace70 0x7f5a2c151950 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f5a2c0652b0 tx=0x7f5a20006e80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:21.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a29ffb700 1 -- 172.21.15.36:0/2342355743 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a20010630 con 0x7f5a2c0ace70 2022-01-10T01:29:21.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a29ffb700 1 -- 172.21.15.36:0/2342355743 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a20010790 con 0x7f5a2c0ace70 2022-01-10T01:29:21.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a31b58700 1 -- 172.21.15.36:0/2342355743 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2c09fce0 con 0x7f5a2c0ace70 2022-01-10T01:29:21.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a29ffb700 1 -- 172.21.15.36:0/2342355743 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a20010af0 con 0x7f5a2c0ace70 2022-01-10T01:29:21.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.707+0000 7f5a31b58700 1 -- 172.21.15.36:0/2342355743 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2c066d50 con 0x7f5a2c0ace70 2022-01-10T01:29:21.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.711+0000 7f5a31b58700 1 -- 172.21.15.36:0/2342355743 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2c0adaf0 con 0x7f5a2c0ace70 2022-01-10T01:29:21.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.711+0000 7f5a29ffb700 1 -- 172.21.15.36:0/2342355743 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5a20021070 con 0x7f5a2c0ace70 2022-01-10T01:29:21.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.711+0000 7f5a29ffb700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5a0c053560 0x7f5a0c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:21.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.711+0000 7f5a29ffb700 1 -- 172.21.15.36:0/2342355743 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f5a2006b790 con 0x7f5a2c0ace70 2022-01-10T01:29:21.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.711+0000 7f5a2bfff700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5a0c053560 0x7f5a0c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:21.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.711+0000 7f5a2bfff700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5a0c053560 0x7f5a0c055a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f5a1800c000 tx=0x7f5a18008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:21.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.723+0000 7f5a29ffb700 1 -- 172.21.15.36:0/2342355743 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5a20042a80 con 0x7f5a2c0ace70 2022-01-10T01:29:21.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.887+0000 7f5a31b58700 1 -- 172.21.15.36:0/2342355743 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a2c09f8c0 con 0x7f5a2c0ace70 2022-01-10T01:29:21.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.887+0000 7f5a29ffb700 1 -- 172.21.15.36:0/2342355743 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+1563 (secure 0 0 0) 0x7f5a20015090 con 0x7f5a2c0ace70 2022-01-10T01:29:21.888 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:21.888 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1806166752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1806166752},{"type":"v1","addr":"172.21.15.36:6837","nonce":1806166752}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1969254698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1969254698},{"type":"v1","addr":"172.21.15.59:6833","nonce":1969254698}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26},{"gid":35141,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2577386810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2577386810},{"type":"v1","addr":"172.21.15.36:6835","nonce":2577386810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[]} 2022-01-10T01:29:21.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.887+0000 7f5a31b58700 1 -- 172.21.15.36:0/2342355743 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5a0c053560 msgr2=0x7f5a0c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:21.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.887+0000 7f5a31b58700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5a0c053560 0x7f5a0c055a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f5a1800c000 tx=0x7f5a18008040).stop 2022-01-10T01:29:21.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.887+0000 7f5a31b58700 1 -- 172.21.15.36:0/2342355743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0ace70 msgr2=0x7f5a2c151950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:21.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.887+0000 7f5a31b58700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0ace70 0x7f5a2c151950 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f5a2c0652b0 tx=0x7f5a20006e80).stop 2022-01-10T01:29:21.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.887+0000 7f5a31b58700 1 -- 172.21.15.36:0/2342355743 shutdown_connections 2022-01-10T01:29:21.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.887+0000 7f5a31b58700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5a0c053560 0x7f5a0c055a20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.887+0000 7f5a31b58700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a2c0b30d0 0x7f5a2c064d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.887+0000 7f5a31b58700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a2c0b0710 0x7f5a2c0648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.887+0000 7f5a31b58700 1 --2- 172.21.15.36:0/2342355743 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a2c0ace70 0x7f5a2c151950 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:21.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.887+0000 7f5a31b58700 1 -- 172.21.15.36:0/2342355743 >> 172.21.15.36:0/2342355743 conn(0x7f5a2c061140 msgr2=0x7f5a2c141400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:21.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.887+0000 7f5a31b58700 1 -- 172.21.15.36:0/2342355743 shutdown_connections 2022-01-10T01:29:21.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:21.887+0000 7f5a31b58700 1 -- 172.21.15.36:0/2342355743 wait complete. 2022-01-10T01:29:21.893 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 26 2022-01-10T01:29:21.901 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:29:22.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 Processor -- start 2022-01-10T01:29:22.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 -- start start 2022-01-10T01:29:22.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc99c0b1db0 0x7fc99c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:22.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc99c0a70c0 0x7fc99c144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:22.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99c0b0350 con 0x7fc99c1483a0 2022-01-10T01:29:22.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99c0a90c0 con 0x7fc99c0b1db0 2022-01-10T01:29:22.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99c0b05f0 con 0x7fc99c0a70c0 2022-01-10T01:29:22.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc99affd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc99c0b1db0 0x7fc99c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:22.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc99affd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc99c0b1db0 0x7fc99c0b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37038/0 (socket says 172.21.15.36:37038) 2022-01-10T01:29:22.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc99affd700 1 -- 172.21.15.36:0/3162305748 learned_addr learned my addr 172.21.15.36:0/3162305748 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:22.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc99a7fc700 1 --1- 172.21.15.36:0/3162305748 >> v1:172.21.15.36:6789/0 conn(0x7fc99c1483a0 0x7fc99c0b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34830/0 (socket says 172.21.15.36:34830) 2022-01-10T01:29:22.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc99b7fe700 1 --2- 172.21.15.36:0/3162305748 >> v2:172.21.15.59:3300/0 conn(0x7fc99c0a70c0 0x7fc99c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:22.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc999ffb700 1 -- 172.21.15.36:0/3162305748 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955279643 0 0) 0x7fc99c0b0350 con 0x7fc99c1483a0 2022-01-10T01:29:22.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc99affd700 1 -- 172.21.15.36:0/3162305748 >> v2:172.21.15.59:3300/0 conn(0x7fc99c0a70c0 msgr2=0x7fc99c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:22.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc99affd700 1 --2- 172.21.15.36:0/3162305748 >> v2:172.21.15.59:3300/0 conn(0x7fc99c0a70c0 0x7fc99c144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc99affd700 1 -- 172.21.15.36:0/3162305748 >> v1:172.21.15.36:6789/0 conn(0x7fc99c1483a0 legacy=0x7fc99c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:22.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc99affd700 1 -- 172.21.15.36:0/3162305748 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c0b0890 con 0x7fc99c0b1db0 2022-01-10T01:29:22.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc99affd700 1 --2- 172.21.15.36:0/3162305748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc99c0b1db0 0x7fc99c0b0fd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fc99c147730 tx=0x7fc984006eb0).ready entity=mon.0 client_cookie=3bea6109c168eba6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:22.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc999ffb700 1 -- 172.21.15.36:0/3162305748 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc98400d610 con 0x7fc99c0b1db0 2022-01-10T01:29:22.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc999ffb700 1 -- 172.21.15.36:0/3162305748 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc984000e90 con 0x7fc99c0b1db0 2022-01-10T01:29:22.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc999ffb700 1 -- 172.21.15.36:0/3162305748 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc98400d960 con 0x7fc99c0b1db0 2022-01-10T01:29:22.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 -- 172.21.15.36:0/3162305748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc99c0b1db0 msgr2=0x7fc99c0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:22.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 --2- 172.21.15.36:0/3162305748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc99c0b1db0 0x7fc99c0b0fd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fc99c147730 tx=0x7fc984006eb0).stop 2022-01-10T01:29:22.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 -- 172.21.15.36:0/3162305748 shutdown_connections 2022-01-10T01:29:22.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 --2- 172.21.15.36:0/3162305748 >> v2:172.21.15.59:3300/0 conn(0x7fc99c0a70c0 0x7fc99c144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 --2- 172.21.15.36:0/3162305748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc99c0b1db0 0x7fc99c0b0fd0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 -- 172.21.15.36:0/3162305748 >> 172.21.15.36:0/3162305748 conn(0x7fc99c05f6b0 msgr2=0x7fc99c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:22.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 -- 172.21.15.36:0/3162305748 shutdown_connections 2022-01-10T01:29:22.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.007+0000 7fc9a16cc700 1 -- 172.21.15.36:0/3162305748 wait complete. 2022-01-10T01:29:22.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc9a16cc700 1 Processor -- start 2022-01-10T01:29:22.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc9a16cc700 1 -- start start 2022-01-10T01:29:22.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc9a16cc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc99c0a70c0 0x7fc99c0af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:22.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc9a16cc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc99c0b1db0 0x7fc99c14aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:22.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc9a16cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc99c1483a0 0x7fc99c14b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:22.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc9a16cc700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c148e80 con 0x7fc99c0a70c0 2022-01-10T01:29:22.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc9a16cc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0aec90 con 0x7fc99c0b1db0 2022-01-10T01:29:22.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc9a16cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0ad970 con 0x7fc99c1483a0 2022-01-10T01:29:22.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc99affd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc99c0a70c0 0x7fc99c0af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:22.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc99affd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc99c0a70c0 0x7fc99c0af4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37042/0 (socket says 172.21.15.36:37042) 2022-01-10T01:29:22.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc99affd700 1 -- 172.21.15.36:0/2186720414 learned_addr learned my addr 172.21.15.36:0/2186720414 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:22.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc99a7fc700 1 --2- 172.21.15.36:0/2186720414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc99c0b1db0 0x7fc99c14aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:22.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc99b7fe700 1 --2- 172.21.15.36:0/2186720414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc99c1483a0 0x7fc99c14b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:22.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc99affd700 1 -- 172.21.15.36:0/2186720414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc99c1483a0 msgr2=0x7fc99c14b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:22.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc99affd700 1 --2- 172.21.15.36:0/2186720414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc99c1483a0 0x7fc99c14b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc99affd700 1 -- 172.21.15.36:0/2186720414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc99c0b1db0 msgr2=0x7fc99c14aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:22.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc99affd700 1 --2- 172.21.15.36:0/2186720414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc99c0b1db0 0x7fc99c14aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc99affd700 1 -- 172.21.15.36:0/2186720414 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98400b1e0 con 0x7fc99c0a70c0 2022-01-10T01:29:22.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc99affd700 1 --2- 172.21.15.36:0/2186720414 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc99c0a70c0 0x7fc99c0af4f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fc99c147730 tx=0x7fc984015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:22.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc993fff700 1 -- 172.21.15.36:0/2186720414 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc98400bec0 con 0x7fc99c0a70c0 2022-01-10T01:29:22.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc993fff700 1 -- 172.21.15.36:0/2186720414 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98400de70 con 0x7fc99c0a70c0 2022-01-10T01:29:22.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc9a16cc700 1 -- 172.21.15.36:0/2186720414 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c14aca0 con 0x7fc99c0a70c0 2022-01-10T01:29:22.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc993fff700 1 -- 172.21.15.36:0/2186720414 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc984011d30 con 0x7fc99c0a70c0 2022-01-10T01:29:22.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.011+0000 7fc9a16cc700 1 -- 172.21.15.36:0/2186720414 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c0ade10 con 0x7fc99c0a70c0 2022-01-10T01:29:22.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.015+0000 7fc9a16cc700 1 -- 172.21.15.36:0/2186720414 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c0aee00 con 0x7fc99c0a70c0 2022-01-10T01:29:22.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.015+0000 7fc993fff700 1 -- 172.21.15.36:0/2186720414 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc984025030 con 0x7fc99c0a70c0 2022-01-10T01:29:22.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.015+0000 7fc993fff700 1 --2- 172.21.15.36:0/2186720414 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc980053590 0x7fc980055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:22.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.015+0000 7fc993fff700 1 -- 172.21.15.36:0/2186720414 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fc98406c8e0 con 0x7fc99c0a70c0 2022-01-10T01:29:22.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.015+0000 7fc99a7fc700 1 --2- 172.21.15.36:0/2186720414 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc980053590 0x7fc980055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:22.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.015+0000 7fc99a7fc700 1 --2- 172.21.15.36:0/2186720414 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc980053590 0x7fc980055a50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fc99400d000 tx=0x7fc994007f40).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:22.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.023+0000 7fc993fff700 1 -- 172.21.15.36:0/2186720414 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc99c0aee00 con 0x7fc99c0a70c0 2022-01-10T01:29:22.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.187+0000 7fc9a16cc700 1 -- 172.21.15.36:0/2186720414 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc99c0aee00 con 0x7fc99c0a70c0 2022-01-10T01:29:22.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.187+0000 7fc993fff700 1 -- 172.21.15.36:0/2186720414 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+1563 (secure 0 0 0) 0x7fc99c0aee00 con 0x7fc99c0a70c0 2022-01-10T01:29:22.190 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:22.191 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5556,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1806166752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1806166752},{"type":"v1","addr":"172.21.15.36:6837","nonce":1806166752}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":22},{"gid":5829,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1969254698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1969254698},{"type":"v1","addr":"172.21.15.59:6833","nonce":1969254698}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26},{"gid":35141,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/2577386810","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2577386810},{"type":"v1","addr":"172.21.15.36:6835","nonce":2577386810}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":23}],"filesystems":[]} 2022-01-10T01:29:22.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.191+0000 7fc9a16cc700 1 -- 172.21.15.36:0/2186720414 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc980053590 msgr2=0x7fc980055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:22.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.191+0000 7fc9a16cc700 1 --2- 172.21.15.36:0/2186720414 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc980053590 0x7fc980055a50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fc99400d000 tx=0x7fc994007f40).stop 2022-01-10T01:29:22.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.191+0000 7fc9a16cc700 1 -- 172.21.15.36:0/2186720414 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc99c0a70c0 msgr2=0x7fc99c0af4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:22.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.191+0000 7fc9a16cc700 1 --2- 172.21.15.36:0/2186720414 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc99c0a70c0 0x7fc99c0af4f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fc99c147730 tx=0x7fc984015000).stop 2022-01-10T01:29:22.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.191+0000 7fc9a16cc700 1 -- 172.21.15.36:0/2186720414 shutdown_connections 2022-01-10T01:29:22.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.191+0000 7fc9a16cc700 1 --2- 172.21.15.36:0/2186720414 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc980053590 0x7fc980055a50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.191+0000 7fc9a16cc700 1 --2- 172.21.15.36:0/2186720414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc99c1483a0 0x7fc99c14b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.191+0000 7fc9a16cc700 1 --2- 172.21.15.36:0/2186720414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc99c0b1db0 0x7fc99c14aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.191+0000 7fc9a16cc700 1 --2- 172.21.15.36:0/2186720414 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc99c0a70c0 0x7fc99c0af4f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.191+0000 7fc9a16cc700 1 -- 172.21.15.36:0/2186720414 >> 172.21.15.36:0/2186720414 conn(0x7fc99c05f6b0 msgr2=0x7fc99c147b90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:22.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.191+0000 7fc9a16cc700 1 -- 172.21.15.36:0/2186720414 shutdown_connections 2022-01-10T01:29:22.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.191+0000 7fc9a16cc700 1 -- 172.21.15.36:0/2186720414 wait complete. 2022-01-10T01:29:22.195 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 26 2022-01-10T01:29:22.207 INFO:tasks.ceph.mds.a:Restarting daemon 2022-01-10T01:29:22.208 INFO:tasks.ceph.mds.a:Stopping old one... 2022-01-10T01:29:22.208 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-01-10T01:29:22.208 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:29:22.209 INFO:tasks.ceph.mds.c:Restarting daemon 2022-01-10T01:29:22.209 INFO:tasks.ceph.mds.c:Stopping old one... 2022-01-10T01:29:22.209 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-01-10T01:29:22.210 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:29:22.210 INFO:tasks.ceph.mds.b:Restarting daemon 2022-01-10T01:29:22.210 INFO:tasks.ceph.mds.b:Stopping old one... 2022-01-10T01:29:22.211 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-01-10T01:29:22.211 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:29:22.219 INFO:tasks.ceph.mds.a:Stopped 2022-01-10T01:29:22.219 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-01-10T01:29:22.222 INFO:tasks.ceph.mds.a:Started 2022-01-10T01:29:22.222 DEBUG:teuthology.parallel:result is None 2022-01-10T01:29:22.225 INFO:tasks.ceph.mds.c:Stopped 2022-01-10T01:29:22.226 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-01-10T01:29:22.227 INFO:tasks.ceph.mds.b:Stopped 2022-01-10T01:29:22.227 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-01-10T01:29:22.230 INFO:tasks.ceph.mds.c:Started 2022-01-10T01:29:22.230 DEBUG:teuthology.parallel:result is None 2022-01-10T01:29:22.231 INFO:tasks.ceph.mds.b:Started 2022-01-10T01:29:22.232 DEBUG:teuthology.parallel:result is None 2022-01-10T01:29:22.232 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2022-01-10T01:29:22.295 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:29:22.296 INFO:tasks.ceph.mds.c.smithi036.stdout:starting mds.c at 2022-01-10T01:29:22.312 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:29:22.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.335+0000 7f9aeacc1700 1 Processor -- start 2022-01-10T01:29:22.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.335+0000 7f9aeacc1700 1 -- start start 2022-01-10T01:29:22.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ae40b1db0 0x7f9ae40b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:22.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9ae41483a0 0x7f9ae40b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:22.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ae40a70c0 0x7f9ae4144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:22.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae40a90c0 con 0x7f9ae41483a0 2022-01-10T01:29:22.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae40b0350 con 0x7f9ae40b1db0 2022-01-10T01:29:22.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae40b05f0 con 0x7f9ae40a70c0 2022-01-10T01:29:22.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9ae3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9ae41483a0 0x7f9ae40b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:22.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9ae3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9ae41483a0 0x7f9ae40b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37074/0 (socket says 172.21.15.36:37074) 2022-01-10T01:29:22.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9ae3fff700 1 -- 172.21.15.36:0/1250644482 learned_addr learned my addr 172.21.15.36:0/1250644482 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:22.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9ae8a5d700 1 --2- 172.21.15.36:0/1250644482 >> v2:172.21.15.59:3300/0 conn(0x7f9ae40b1db0 0x7f9ae40b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:22.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9ae925e700 1 --2- 172.21.15.36:0/1250644482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ae40a70c0 0x7f9ae4144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:22.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9ae3fff700 1 -- 172.21.15.36:0/1250644482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ae40a70c0 msgr2=0x7f9ae4144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:22.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9ae3fff700 1 --2- 172.21.15.36:0/1250644482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ae40a70c0 0x7f9ae4144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9ae3fff700 1 -- 172.21.15.36:0/1250644482 >> v2:172.21.15.59:3300/0 conn(0x7f9ae40b1db0 msgr2=0x7f9ae40b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:22.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9ae3fff700 1 --2- 172.21.15.36:0/1250644482 >> v2:172.21.15.59:3300/0 conn(0x7f9ae40b1db0 0x7f9ae40b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9ae3fff700 1 -- 172.21.15.36:0/1250644482 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae40b0890 con 0x7f9ae41483a0 2022-01-10T01:29:22.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9ae3fff700 1 --2- 172.21.15.36:0/1250644482 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ae41483a0 0x7f9ae40b2190 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f9ae4147730 tx=0x7f9ad8006eb0).ready entity=mon.0 client_cookie=500fb5cc2e9349b0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:22.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9ae37fe700 1 -- 172.21.15.36:0/1250644482 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad800e610 con 0x7f9ae41483a0 2022-01-10T01:29:22.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9ae37fe700 1 -- 172.21.15.36:0/1250644482 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad8000e90 con 0x7f9ae41483a0 2022-01-10T01:29:22.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9ae37fe700 1 -- 172.21.15.36:0/1250644482 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad800e9a0 con 0x7f9ae41483a0 2022-01-10T01:29:22.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 -- 172.21.15.36:0/1250644482 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ae41483a0 msgr2=0x7f9ae40b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:22.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 --2- 172.21.15.36:0/1250644482 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ae41483a0 0x7f9ae40b2190 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f9ae4147730 tx=0x7f9ad8006eb0).stop 2022-01-10T01:29:22.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 -- 172.21.15.36:0/1250644482 shutdown_connections 2022-01-10T01:29:22.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 --2- 172.21.15.36:0/1250644482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ae40a70c0 0x7f9ae4144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 --2- 172.21.15.36:0/1250644482 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ae41483a0 0x7f9ae40b2190 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 --2- 172.21.15.36:0/1250644482 >> v2:172.21.15.59:3300/0 conn(0x7f9ae40b1db0 0x7f9ae40b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 -- 172.21.15.36:0/1250644482 >> 172.21.15.36:0/1250644482 conn(0x7f9ae405f6b0 msgr2=0x7f9ae405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:22.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 -- 172.21.15.36:0/1250644482 shutdown_connections 2022-01-10T01:29:22.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 -- 172.21.15.36:0/1250644482 wait complete. 2022-01-10T01:29:22.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 Processor -- start 2022-01-10T01:29:22.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.339+0000 7f9aeacc1700 1 -- start start 2022-01-10T01:29:22.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9aeacc1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae40a70c0 0x7f9ae414a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:22.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9aeacc1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ae40b1db0 0x7f9ae4143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:22.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9aeacc1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ae41483a0 0x7f9ae4143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:22.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9aeacc1700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae414aa20 con 0x7f9ae41483a0 2022-01-10T01:29:22.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9aeacc1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae4144300 con 0x7f9ae40a70c0 2022-01-10T01:29:22.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9aeacc1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae40ae090 con 0x7f9ae40b1db0 2022-01-10T01:29:22.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae925e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ae41483a0 0x7f9ae4143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:22.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ae40b1db0 0x7f9ae4143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:22.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae8a5d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae40a70c0 0x7f9ae414a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:22.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae8a5d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae40a70c0 0x7f9ae414a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:33714/0 (socket says 172.21.15.36:33714) 2022-01-10T01:29:22.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae8a5d700 1 -- 172.21.15.36:0/514147323 learned_addr learned my addr 172.21.15.36:0/514147323 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:22.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae3fff700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ae40b1db0 0x7f9ae4143920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:43364/0 (socket says 172.21.15.36:43364) 2022-01-10T01:29:22.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae3fff700 1 -- 172.21.15.36:0/514147323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae40a70c0 msgr2=0x7f9ae414a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:22.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae3fff700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae40a70c0 0x7f9ae414a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae3fff700 1 -- 172.21.15.36:0/514147323 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ae41483a0 msgr2=0x7f9ae4143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:22.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae3fff700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ae41483a0 0x7f9ae4143e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:22.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae3fff700 1 -- 172.21.15.36:0/514147323 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad800b1e0 con 0x7f9ae40b1db0 2022-01-10T01:29:22.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae8a5d700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae40a70c0 0x7f9ae414a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:22.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae925e700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ae41483a0 0x7f9ae4143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:22.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae3fff700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ae40b1db0 0x7f9ae4143920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9ae4147730 tx=0x7f9ad8015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:22.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae1ffb700 1 -- 172.21.15.36:0/514147323 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad800e0f0 con 0x7f9ae40b1db0 2022-01-10T01:29:22.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae1ffb700 1 -- 172.21.15.36:0/514147323 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad8011610 con 0x7f9ae40b1db0 2022-01-10T01:29:22.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9aeacc1700 1 -- 172.21.15.36:0/514147323 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae40add00 con 0x7f9ae40b1db0 2022-01-10T01:29:22.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9ae1ffb700 1 -- 172.21.15.36:0/514147323 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad8011970 con 0x7f9ae40b1db0 2022-01-10T01:29:22.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9aeacc1700 1 -- 172.21.15.36:0/514147323 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae40ad890 con 0x7f9ae40b1db0 2022-01-10T01:29:22.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.343+0000 7f9aeacc1700 1 -- 172.21.15.36:0/514147323 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae40afd00 con 0x7f9ae40b1db0 2022-01-10T01:29:22.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.347+0000 7f9ae1ffb700 1 -- 172.21.15.36:0/514147323 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9ad8025030 con 0x7f9ae40b1db0 2022-01-10T01:29:22.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.347+0000 7f9ae1ffb700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ac4053560 0x7f9ac4055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:22.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.347+0000 7f9ae1ffb700 1 -- 172.21.15.36:0/514147323 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f9ad806c750 con 0x7f9ae40b1db0 2022-01-10T01:29:22.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.347+0000 7f9ae8a5d700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ac4053560 0x7f9ac4055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:22.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.347+0000 7f9ae8a5d700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ac4053560 0x7f9ac4055a20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f9ad000b000 tx=0x7f9ad0006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:22.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.355+0000 7f9ae1ffb700 1 -- 172.21.15.36:0/514147323 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ad8043a40 con 0x7f9ae40b1db0 2022-01-10T01:29:22.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:22.495+0000 7f9aeacc1700 1 -- 172.21.15.36:0/514147323 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f9ae40b0b30 con 0x7f9ae40b1db0 2022-01-10T01:29:23.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.343+0000 7f9ae1ffb700 1 -- 172.21.15.36:0/514147323 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v63) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9ad8047060 con 0x7f9ae40b1db0 2022-01-10T01:29:23.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.347+0000 7f9aeacc1700 1 -- 172.21.15.36:0/514147323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ac4053560 msgr2=0x7f9ac4055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:23.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.347+0000 7f9aeacc1700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ac4053560 0x7f9ac4055a20 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f9ad000b000 tx=0x7f9ad0006df0).stop 2022-01-10T01:29:23.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.347+0000 7f9aeacc1700 1 -- 172.21.15.36:0/514147323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ae40b1db0 msgr2=0x7f9ae4143920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:23.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.347+0000 7f9aeacc1700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ae40b1db0 0x7f9ae4143920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9ae4147730 tx=0x7f9ad8015000).stop 2022-01-10T01:29:23.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.347+0000 7f9aeacc1700 1 -- 172.21.15.36:0/514147323 shutdown_connections 2022-01-10T01:29:23.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.347+0000 7f9aeacc1700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ac4053560 0x7f9ac4055a20 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.347+0000 7f9aeacc1700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ae41483a0 0x7f9ae4143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.347+0000 7f9aeacc1700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ae40b1db0 0x7f9ae4143920 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.347+0000 7f9aeacc1700 1 --2- 172.21.15.36:0/514147323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae40a70c0 0x7f9ae414a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.347+0000 7f9aeacc1700 1 -- 172.21.15.36:0/514147323 >> 172.21.15.36:0/514147323 conn(0x7f9ae405f6b0 msgr2=0x7f9ae40b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:23.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.347+0000 7f9aeacc1700 1 -- 172.21.15.36:0/514147323 shutdown_connections 2022-01-10T01:29:23.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.347+0000 7f9aeacc1700 1 -- 172.21.15.36:0/514147323 wait complete. 2022-01-10T01:29:23.352 INFO:teuthology.orchestra.run.smithi036.stderr: removed all blacklist entries 2022-01-10T01:29:23.364 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2022-01-10T01:29:23.364 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2022-01-10T01:29:23.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f7831f7b700 1 Processor -- start 2022-01-10T01:29:23.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f7831f7b700 1 -- start start 2022-01-10T01:29:23.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f7831f7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782c0a9190 0x7f782c146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:23.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f7831f7b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f782c0b0b80 0x7f782c146a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:23.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f7831f7b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f782c0b03d0 0x7f782c1401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:23.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f7831f7b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c0b1140 con 0x7f782c0b03d0 2022-01-10T01:29:23.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f7831f7b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c0a9570 con 0x7f782c0b0b80 2022-01-10T01:29:23.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f7831f7b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0b1370 con 0x7f782c0a9190 2022-01-10T01:29:23.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f783177a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f782c0b03d0 0x7f782c1401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:23.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f783177a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f782c0b03d0 0x7f782c1401c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37096/0 (socket says 172.21.15.36:37096) 2022-01-10T01:29:23.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f783177a700 1 -- 172.21.15.36:0/3745549219 learned_addr learned my addr 172.21.15.36:0/3745549219 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:23.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f782bfff700 1 --2- 172.21.15.36:0/3745549219 >> v2:172.21.15.59:3300/0 conn(0x7f782c0b0b80 0x7f782c146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:23.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f7830f79700 1 --2- 172.21.15.36:0/3745549219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782c0a9190 0x7f782c146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:23.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f783177a700 1 -- 172.21.15.36:0/3745549219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782c0a9190 msgr2=0x7f782c146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:23.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f783177a700 1 --2- 172.21.15.36:0/3745549219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782c0a9190 0x7f782c146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f783177a700 1 -- 172.21.15.36:0/3745549219 >> v2:172.21.15.59:3300/0 conn(0x7f782c0b0b80 msgr2=0x7f782c146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:23.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f783177a700 1 --2- 172.21.15.36:0/3745549219 >> v2:172.21.15.59:3300/0 conn(0x7f782c0b0b80 0x7f782c146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f783177a700 1 -- 172.21.15.36:0/3745549219 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c0b1610 con 0x7f782c0b03d0 2022-01-10T01:29:23.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.475+0000 7f7830f79700 1 --2- 172.21.15.36:0/3745549219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782c0a9190 0x7f782c146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:23.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.479+0000 7f783177a700 1 --2- 172.21.15.36:0/3745549219 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f782c0b03d0 0x7f782c1401c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f78240032f0 tx=0x7f7824009290).ready entity=mon.0 client_cookie=75f0d7bc56059336 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:23.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.479+0000 7f782b7fe700 1 -- 172.21.15.36:0/3745549219 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f782400b870 con 0x7f782c0b03d0 2022-01-10T01:29:23.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.479+0000 7f782b7fe700 1 -- 172.21.15.36:0/3745549219 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782400b9d0 con 0x7f782c0b03d0 2022-01-10T01:29:23.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.479+0000 7f782b7fe700 1 -- 172.21.15.36:0/3745549219 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f782400bb40 con 0x7f782c0b03d0 2022-01-10T01:29:23.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.479+0000 7f7831f7b700 1 -- 172.21.15.36:0/3745549219 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f782c0b03d0 msgr2=0x7f782c1401c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:23.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.479+0000 7f7831f7b700 1 --2- 172.21.15.36:0/3745549219 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f782c0b03d0 0x7f782c1401c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f78240032f0 tx=0x7f7824009290).stop 2022-01-10T01:29:23.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.479+0000 7f7831f7b700 1 -- 172.21.15.36:0/3745549219 shutdown_connections 2022-01-10T01:29:23.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.479+0000 7f7831f7b700 1 --2- 172.21.15.36:0/3745549219 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f782c0b03d0 0x7f782c1401c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.479+0000 7f7831f7b700 1 --2- 172.21.15.36:0/3745549219 >> v2:172.21.15.59:3300/0 conn(0x7f782c0b0b80 0x7f782c146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.479+0000 7f7831f7b700 1 --2- 172.21.15.36:0/3745549219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782c0a9190 0x7f782c146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.479+0000 7f7831f7b700 1 -- 172.21.15.36:0/3745549219 >> 172.21.15.36:0/3745549219 conn(0x7f782c061140 msgr2=0x7f782c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:23.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.479+0000 7f7831f7b700 1 -- 172.21.15.36:0/3745549219 shutdown_connections 2022-01-10T01:29:23.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.479+0000 7f7831f7b700 1 -- 172.21.15.36:0/3745549219 wait complete. 2022-01-10T01:29:23.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.479+0000 7f7831f7b700 1 Processor -- start 2022-01-10T01:29:23.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f7831f7b700 1 -- start start 2022-01-10T01:29:23.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f7831f7b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782c0a9190 0x7f782c156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:23.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f7831f7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782c0b03d0 0x7f782c0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:23.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f7831f7b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f782c0b0b80 0x7f782c152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:23.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f7831f7b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c14ff40 con 0x7f782c0b0b80 2022-01-10T01:29:23.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f7831f7b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0aa040 con 0x7f782c0a9190 2022-01-10T01:29:23.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f7831f7b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c1558a0 con 0x7f782c0b03d0 2022-01-10T01:29:23.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f783177a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f782c0b0b80 0x7f782c152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:23.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f783177a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f782c0b0b80 0x7f782c152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37102/0 (socket says 172.21.15.36:37102) 2022-01-10T01:29:23.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f7830f79700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782c0a9190 0x7f782c156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:23.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f783177a700 1 -- 172.21.15.36:0/2856507406 learned_addr learned my addr 172.21.15.36:0/2856507406 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:23.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f782bfff700 1 --2- 172.21.15.36:0/2856507406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782c0b03d0 0x7f782c0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:23.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f783177a700 1 -- 172.21.15.36:0/2856507406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782c0b03d0 msgr2=0x7f782c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:23.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f783177a700 1 --2- 172.21.15.36:0/2856507406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782c0b03d0 0x7f782c0b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f783177a700 1 -- 172.21.15.36:0/2856507406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782c0a9190 msgr2=0x7f782c156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:23.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f783177a700 1 --2- 172.21.15.36:0/2856507406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782c0a9190 0x7f782c156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f783177a700 1 -- 172.21.15.36:0/2856507406 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7824009530 con 0x7f782c0b0b80 2022-01-10T01:29:23.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f782bfff700 1 --2- 172.21.15.36:0/2856507406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782c0b03d0 0x7f782c0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:23.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f783177a700 1 --2- 172.21.15.36:0/2856507406 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f782c0b0b80 0x7f782c152230 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f78240032f0 tx=0x7f7824016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:23.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f7829ffb700 1 -- 172.21.15.36:0/2856507406 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f782400b870 con 0x7f782c0b0b80 2022-01-10T01:29:23.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f7829ffb700 1 -- 172.21.15.36:0/2856507406 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7824020430 con 0x7f782c0b0b80 2022-01-10T01:29:23.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f7831f7b700 1 -- 172.21.15.36:0/2856507406 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c155b40 con 0x7f782c0b0b80 2022-01-10T01:29:23.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f7829ffb700 1 -- 172.21.15.36:0/2856507406 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7824020790 con 0x7f782c0b0b80 2022-01-10T01:29:23.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.483+0000 7f7831f7b700 1 -- 172.21.15.36:0/2856507406 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c0b2680 con 0x7f782c0b0b80 2022-01-10T01:29:23.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.487+0000 7f7831f7b700 1 -- 172.21.15.36:0/2856507406 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c057350 con 0x7f782c0b0b80 2022-01-10T01:29:23.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.487+0000 7f7829ffb700 1 -- 172.21.15.36:0/2856507406 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7824026020 con 0x7f782c0b0b80 2022-01-10T01:29:23.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.487+0000 7f7829ffb700 1 --2- 172.21.15.36:0/2856507406 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f780c053590 0x7f780c055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:23.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.487+0000 7f7829ffb700 1 -- 172.21.15.36:0/2856507406 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f782406c540 con 0x7f782c0b0b80 2022-01-10T01:29:23.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.487+0000 7f7830f79700 1 --2- 172.21.15.36:0/2856507406 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f780c053590 0x7f780c055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:23.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.487+0000 7f7830f79700 1 --2- 172.21.15.36:0/2856507406 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f780c053590 0x7f780c055a50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f782000c000 tx=0x7f7820008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:23.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.491+0000 7f7829ffb700 1 -- 172.21.15.36:0/2856507406 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7824043780 con 0x7f782c0b0b80 2022-01-10T01:29:23.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.659+0000 7f7831f7b700 1 -- 172.21.15.36:0/2856507406 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f782c147430 con 0x7f782c0b0b80 2022-01-10T01:29:23.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.659+0000 7f7829ffb700 1 -- 172.21.15.36:0/2856507406 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f7824015020 con 0x7f782c0b0b80 2022-01-10T01:29:23.662 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:23.662 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:29:23.663 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_dump": [ 2022-01-10T01:29:23.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.663 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.a", 2022-01-10T01:29:23.663 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthuGT4IxAA5DyijS4tPjdOLn5uiLXEPg==", 2022-01-10T01:29:23.663 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.664 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:29:23.664 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:29:23.664 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:29:23.664 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:29:23.665 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.665 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.b", 2022-01-10T01:29:23.666 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthkvX0LRAAtz19usFvoObvouQeLFwicg==", 2022-01-10T01:29:23.666 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.666 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:29:23.666 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:29:23.667 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:29:23.667 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:29:23.667 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.668 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.c", 2022-01-10T01:29:23.668 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthbvUmKhAA0pVpDJO1AfsAzIHU1cAHiw==", 2022-01-10T01:29:23.669 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.669 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:29:23.669 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:29:23.669 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:29:23.669 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:29:23.670 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.670 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.0", 2022-01-10T01:29:23.671 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCWitthk4iKHRAAF7aFP+i24xFvXXm8j5GzVg==", 2022-01-10T01:29:23.671 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.671 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:29:23.671 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:29:23.671 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:29:23.672 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.673 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.1", 2022-01-10T01:29:23.673 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCZitthsKSXABAAb3IkNvlyLub89HwaPWZ1Bg==", 2022-01-10T01:29:23.673 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.673 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:29:23.674 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:29:23.674 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:29:23.674 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.675 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.2", 2022-01-10T01:29:23.675 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCbitthvNzhIBAAXkZ6FslnMl1gS/rOa7G+Vg==", 2022-01-10T01:29:23.675 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.676 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:29:23.676 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:29:23.676 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:29:23.676 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.677 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.3", 2022-01-10T01:29:23.677 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCeitth9P7EAxAA7KOCP7Rh5oN1yqCz9I6v3A==", 2022-01-10T01:29:23.677 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.678 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:29:23.678 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:29:23.678 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:29:23.678 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.679 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.4", 2022-01-10T01:29:23.679 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCjitth/L1UBxAAskxmSV0aE6CSvDFR8O/+SQ==", 2022-01-10T01:29:23.679 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.680 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:29:23.680 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:29:23.680 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:29:23.680 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.681 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.5", 2022-01-10T01:29:23.681 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQClitthMoY6JhAAeeIrCmMcm3MpDPtdLUf+2g==", 2022-01-10T01:29:23.681 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.682 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:29:23.682 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:29:23.682 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:29:23.682 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.683 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.6", 2022-01-10T01:29:23.683 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCoitthrUhlCxAAsYhU7Kj6HMo/kD0DezvITg==", 2022-01-10T01:29:23.683 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.684 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:29:23.684 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:29:23.684 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:29:23.684 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.685 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.7", 2022-01-10T01:29:23.685 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCqitthFaLrKRAAC2g1OlcV2KTtaOXsyCrIrQ==", 2022-01-10T01:29:23.685 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.685 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:29:23.686 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:29:23.686 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:29:23.686 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.687 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.0", 2022-01-10T01:29:23.687 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthKoa/NBAADjvHh99F8YOktGID9uyttg==", 2022-01-10T01:29:23.687 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.687 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:29:23.688 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:29:23.688 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:29:23.688 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.688 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.689 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.1", 2022-01-10T01:29:23.689 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth3x76OBAAPTrw8OUmnpEflWuB7zzaHg==", 2022-01-10T01:29:23.689 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.689 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:29:23.689 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:29:23.690 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:29:23.690 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.691 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.admin", 2022-01-10T01:29:23.691 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthf9dqChAADHRsoZKuozdsqb41ztuR7w==", 2022-01-10T01:29:23.691 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.691 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:29:23.691 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:29:23.692 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:29:23.692 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:29:23.692 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.693 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.x", 2022-01-10T01:29:23.693 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth39syIRAA6pOvLWw2ADy72TWZ65MIkA==", 2022-01-10T01:29:23.693 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.693 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:29:23.693 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:29:23.694 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:29:23.694 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:23.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:23.695 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.y", 2022-01-10T01:29:23.695 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth4novHRAACVMjo72kOB/T7Ti/CiN27w==", 2022-01-10T01:29:23.695 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:29:23.695 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:29:23.695 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:29:23.696 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:29:23.696 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.696 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:23.696 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:23.696 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:29:23.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.663+0000 7f7831f7b700 1 -- 172.21.15.36:0/2856507406 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f780c053590 msgr2=0x7f780c055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:23.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.663+0000 7f7831f7b700 1 --2- 172.21.15.36:0/2856507406 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f780c053590 0x7f780c055a50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f782000c000 tx=0x7f7820008040).stop 2022-01-10T01:29:23.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.663+0000 7f7831f7b700 1 -- 172.21.15.36:0/2856507406 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f782c0b0b80 msgr2=0x7f782c152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:23.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.663+0000 7f7831f7b700 1 --2- 172.21.15.36:0/2856507406 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f782c0b0b80 0x7f782c152230 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f78240032f0 tx=0x7f7824016000).stop 2022-01-10T01:29:23.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.663+0000 7f7831f7b700 1 -- 172.21.15.36:0/2856507406 shutdown_connections 2022-01-10T01:29:23.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.663+0000 7f7831f7b700 1 --2- 172.21.15.36:0/2856507406 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f780c053590 0x7f780c055a50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.663+0000 7f7831f7b700 1 --2- 172.21.15.36:0/2856507406 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f782c0b0b80 0x7f782c152230 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.663+0000 7f7831f7b700 1 --2- 172.21.15.36:0/2856507406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f782c0b03d0 0x7f782c0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.663+0000 7f7831f7b700 1 --2- 172.21.15.36:0/2856507406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f782c0a9190 0x7f782c156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.663+0000 7f7831f7b700 1 -- 172.21.15.36:0/2856507406 >> 172.21.15.36:0/2856507406 conn(0x7f782c061140 msgr2=0x7f782c13bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:23.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.663+0000 7f7831f7b700 1 -- 172.21.15.36:0/2856507406 shutdown_connections 2022-01-10T01:29:23.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.663+0000 7f7831f7b700 1 -- 172.21.15.36:0/2856507406 wait complete. 2022-01-10T01:29:23.701 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:29:23.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b7759e700 1 Processor -- start 2022-01-10T01:29:23.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b7759e700 1 -- start start 2022-01-10T01:29:23.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b7759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b78066c30 0x7f0b7814e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:23.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b7759e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b78065330 con 0x7f0b780b25a0 2022-01-10T01:29:23.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b7759e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b780b33e0 con 0x7f0b780b3000 2022-01-10T01:29:23.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b7759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b78062000 con 0x7f0b78066c30 2022-01-10T01:29:23.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b6ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f0b780b25a0 0x7f0b78066520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34902/0 (socket says 172.21.15.36:34902) 2022-01-10T01:29:23.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b6ffff700 1 -- 172.21.15.36:0/2200300751 learned_addr learned my addr 172.21.15.36:0/2200300751 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:23.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b76d9d700 1 --2- 172.21.15.36:0/2200300751 >> v2:172.21.15.59:3300/0 conn(0x7f0b78066c30 0x7f0b7814e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:23.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b75d9b700 1 -- 172.21.15.36:0/2200300751 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242618003 0 0) 0x7f0b780b33e0 con 0x7f0b780b3000 2022-01-10T01:29:23.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b75d9b700 1 -- 172.21.15.36:0/2200300751 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b58003260 con 0x7f0b780b3000 2022-01-10T01:29:23.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b75d9b700 1 -- 172.21.15.36:0/2200300751 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195799456 0 0) 0x7f0b78065330 con 0x7f0b780b25a0 2022-01-10T01:29:23.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b75d9b700 1 -- 172.21.15.36:0/2200300751 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b780b33e0 con 0x7f0b780b25a0 2022-01-10T01:29:23.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b76d9d700 1 -- 172.21.15.36:0/2200300751 >> v1:172.21.15.59:6789/0 conn(0x7f0b780b3000 legacy=0x7f0b78060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:23.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b76d9d700 1 -- 172.21.15.36:0/2200300751 >> v1:172.21.15.36:6789/0 conn(0x7f0b780b25a0 legacy=0x7f0b78066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:23.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b76d9d700 1 -- 172.21.15.36:0/2200300751 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b7805fa60 con 0x7f0b78066c30 2022-01-10T01:29:23.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b76d9d700 1 --2- 172.21.15.36:0/2200300751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b78066c30 0x7f0b7814e930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f0b700032f0 tx=0x7f0b700091d0).ready entity=mon.1 client_cookie=93d5babc9a58d32c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:23.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.803+0000 7f0b75d9b700 1 -- 172.21.15.36:0/2200300751 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b7000b600 con 0x7f0b78066c30 2022-01-10T01:29:23.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.807+0000 7f0b75d9b700 1 -- 172.21.15.36:0/2200300751 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7000b760 con 0x7f0b78066c30 2022-01-10T01:29:23.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.807+0000 7f0b75d9b700 1 -- 172.21.15.36:0/2200300751 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b7000b8d0 con 0x7f0b78066c30 2022-01-10T01:29:23.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.807+0000 7f0b7759e700 1 -- 172.21.15.36:0/2200300751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b78066c30 msgr2=0x7f0b7814e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:23.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.807+0000 7f0b7759e700 1 --2- 172.21.15.36:0/2200300751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b78066c30 0x7f0b7814e930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f0b700032f0 tx=0x7f0b700091d0).stop 2022-01-10T01:29:23.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.807+0000 7f0b7759e700 1 -- 172.21.15.36:0/2200300751 shutdown_connections 2022-01-10T01:29:23.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.807+0000 7f0b7759e700 1 --2- 172.21.15.36:0/2200300751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b78066c30 0x7f0b7814e930 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.807+0000 7f0b7759e700 1 -- 172.21.15.36:0/2200300751 >> 172.21.15.36:0/2200300751 conn(0x7f0b780636e0 msgr2=0x7f0b78063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:23.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.807+0000 7f0b7759e700 1 -- 172.21.15.36:0/2200300751 shutdown_connections 2022-01-10T01:29:23.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.807+0000 7f0b7759e700 1 -- 172.21.15.36:0/2200300751 wait complete. 2022-01-10T01:29:23.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.807+0000 7f0b7759e700 1 Processor -- start 2022-01-10T01:29:23.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.807+0000 7f0b7759e700 1 -- start start 2022-01-10T01:29:23.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b7759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b78066c30 0x7f0b78152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:23.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b7759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b780b25a0 0x7f0b780b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:23.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b7759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b780b3000 0x7f0b78144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:23.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b7759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b781520c0 con 0x7f0b780b3000 2022-01-10T01:29:23.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b7759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b781522b0 con 0x7f0b780b25a0 2022-01-10T01:29:23.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b7759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78152550 con 0x7f0b78066c30 2022-01-10T01:29:23.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b76d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b780b3000 0x7f0b78144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:23.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b76d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b780b3000 0x7f0b78144410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37116/0 (socket says 172.21.15.36:37116) 2022-01-10T01:29:23.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b76d9d700 1 -- 172.21.15.36:0/3379430668 learned_addr learned my addr 172.21.15.36:0/3379430668 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:23.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b6ffff700 1 --2- 172.21.15.36:0/3379430668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b780b25a0 0x7f0b780b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:23.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b7659c700 1 --2- 172.21.15.36:0/3379430668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b78066c30 0x7f0b78152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:23.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b76d9d700 1 -- 172.21.15.36:0/3379430668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b78066c30 msgr2=0x7f0b78152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:23.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b76d9d700 1 --2- 172.21.15.36:0/3379430668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b78066c30 0x7f0b78152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b76d9d700 1 -- 172.21.15.36:0/3379430668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b780b25a0 msgr2=0x7f0b780b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:23.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b76d9d700 1 --2- 172.21.15.36:0/3379430668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b780b25a0 0x7f0b780b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b76d9d700 1 -- 172.21.15.36:0/3379430668 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b70009470 con 0x7f0b780b3000 2022-01-10T01:29:23.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b76d9d700 1 --2- 172.21.15.36:0/3379430668 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b780b3000 0x7f0b78144410 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f0b700032f0 tx=0x7f0b70016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:23.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b6f7fe700 1 -- 172.21.15.36:0/3379430668 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b7000b600 con 0x7f0b780b3000 2022-01-10T01:29:23.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b6f7fe700 1 -- 172.21.15.36:0/3379430668 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b70011e60 con 0x7f0b780b3000 2022-01-10T01:29:23.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b7759e700 1 -- 172.21.15.36:0/3379430668 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b781527f0 con 0x7f0b780b3000 2022-01-10T01:29:23.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b6f7fe700 1 -- 172.21.15.36:0/3379430668 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b7001f5e0 con 0x7f0b780b3000 2022-01-10T01:29:23.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.811+0000 7f0b7759e700 1 -- 172.21.15.36:0/3379430668 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b78146b00 con 0x7f0b780b3000 2022-01-10T01:29:23.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.815+0000 7f0b7759e700 1 -- 172.21.15.36:0/3379430668 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b78152980 con 0x7f0b780b3000 2022-01-10T01:29:23.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.815+0000 7f0b6f7fe700 1 -- 172.21.15.36:0/3379430668 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0b70026030 con 0x7f0b780b3000 2022-01-10T01:29:23.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.815+0000 7f0b6f7fe700 1 --2- 172.21.15.36:0/3379430668 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0b5c0534d0 0x7f0b5c055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:23.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.815+0000 7f0b6f7fe700 1 -- 172.21.15.36:0/3379430668 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f0b7006c270 con 0x7f0b780b3000 2022-01-10T01:29:23.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.815+0000 7f0b7659c700 1 --2- 172.21.15.36:0/3379430668 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0b5c0534d0 0x7f0b5c055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:23.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.815+0000 7f0b7659c700 1 --2- 172.21.15.36:0/3379430668 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0b5c0534d0 0x7f0b5c055990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f0b6800d000 tx=0x7f0b68007a40).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:23.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.819+0000 7f0b6f7fe700 1 -- 172.21.15.36:0/3379430668 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0b700434b0 con 0x7f0b780b3000 2022-01-10T01:29:23.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.951+0000 7f0b7759e700 1 -- 172.21.15.36:0/3379430668 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b7805fd00 con 0x7f0b780b3000 2022-01-10T01:29:23.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.951+0000 7f0b6f7fe700 1 -- 172.21.15.36:0/3379430668 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+13415 (secure 0 0 0) 0x7f0b70015090 con 0x7f0b780b3000 2022-01-10T01:29:23.952 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:23.953 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":63,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:29:23.333713+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:29:23.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.951+0000 7f0b7759e700 1 -- 172.21.15.36:0/3379430668 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0b5c0534d0 msgr2=0x7f0b5c055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:23.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.951+0000 7f0b7759e700 1 --2- 172.21.15.36:0/3379430668 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0b5c0534d0 0x7f0b5c055990 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f0b6800d000 tx=0x7f0b68007a40).stop 2022-01-10T01:29:23.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.951+0000 7f0b7759e700 1 -- 172.21.15.36:0/3379430668 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b780b3000 msgr2=0x7f0b78144410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:23.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.951+0000 7f0b7759e700 1 --2- 172.21.15.36:0/3379430668 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b780b3000 0x7f0b78144410 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f0b700032f0 tx=0x7f0b70016000).stop 2022-01-10T01:29:23.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.951+0000 7f0b7759e700 1 -- 172.21.15.36:0/3379430668 shutdown_connections 2022-01-10T01:29:23.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.951+0000 7f0b7759e700 1 --2- 172.21.15.36:0/3379430668 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0b5c0534d0 0x7f0b5c055990 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.951+0000 7f0b7759e700 1 --2- 172.21.15.36:0/3379430668 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b780b3000 0x7f0b78144410 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.951+0000 7f0b7759e700 1 --2- 172.21.15.36:0/3379430668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b780b25a0 0x7f0b780b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.951+0000 7f0b7759e700 1 --2- 172.21.15.36:0/3379430668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b78066c30 0x7f0b78152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:23.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.951+0000 7f0b7759e700 1 -- 172.21.15.36:0/3379430668 >> 172.21.15.36:0/3379430668 conn(0x7f0b780636e0 msgr2=0x7f0b78142f60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:23.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.951+0000 7f0b7759e700 1 -- 172.21.15.36:0/3379430668 shutdown_connections 2022-01-10T01:29:23.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:23.951+0000 7f0b7759e700 1 -- 172.21.15.36:0/3379430668 wait complete. 2022-01-10T01:29:23.965 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-01-10T01:29:23.966 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:29:24.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5f656700 1 Processor -- start 2022-01-10T01:29:24.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5f656700 1 -- start start 2022-01-10T01:29:24.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5f656700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b58144440 0x7f9b58144970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5f656700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b58065420 0x7f9b58144e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5f656700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b58145350 con 0x7f9b58060100 2022-01-10T01:29:24.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5f656700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b58065c80 con 0x7f9b58065420 2022-01-10T01:29:24.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5f656700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b580604e0 con 0x7f9b58144440 2022-01-10T01:29:24.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5d3f2700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9b58060100 0x7f9b58064d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34914/0 (socket says 172.21.15.36:34914) 2022-01-10T01:29:24.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5d3f2700 1 -- 172.21.15.36:0/1626154604 learned_addr learned my addr 172.21.15.36:0/1626154604 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:24.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5dbf3700 1 --2- 172.21.15.36:0/1626154604 >> v2:172.21.15.59:3300/0 conn(0x7f9b58065420 0x7f9b58144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5cbf1700 1 --2- 172.21.15.36:0/1626154604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b58144440 0x7f9b58144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 -- 172.21.15.36:0/1626154604 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339679196 0 0) 0x7f9b58145350 con 0x7f9b58060100 2022-01-10T01:29:24.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 -- 172.21.15.36:0/1626154604 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b40003260 con 0x7f9b58060100 2022-01-10T01:29:24.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 -- 172.21.15.36:0/1626154604 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 535585443 0 0) 0x7f9b40003260 con 0x7f9b58060100 2022-01-10T01:29:24.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 -- 172.21.15.36:0/1626154604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b58144440 msgr2=0x7f9b58144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:24.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 --2- 172.21.15.36:0/1626154604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b58144440 0x7f9b58144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 -- 172.21.15.36:0/1626154604 >> v2:172.21.15.59:3300/0 conn(0x7f9b58065420 msgr2=0x7f9b58144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:24.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 --2- 172.21.15.36:0/1626154604 >> v2:172.21.15.59:3300/0 conn(0x7f9b58065420 0x7f9b58144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 -- 172.21.15.36:0/1626154604 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b580b23b0 con 0x7f9b58060100 2022-01-10T01:29:24.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 -- 172.21.15.36:0/1626154604 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f9b500019e0 con 0x7f9b58060100 2022-01-10T01:29:24.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5dbf3700 1 --2- 172.21.15.36:0/1626154604 >> v2:172.21.15.59:3300/0 conn(0x7f9b58065420 0x7f9b58144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:24.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 -- 172.21.15.36:0/1626154604 >> v1:172.21.15.36:6789/0 conn(0x7f9b58060100 legacy=0x7f9b58064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 --2- 172.21.15.36:0/1626154604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b40003750 0x7f9b40003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 --2- 172.21.15.36:0/1626154604 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b40004060 0x7f9b40004540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 --2- 172.21.15.36:0/1626154604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b40004b60 0x7f9b40004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 -- 172.21.15.36:0/1626154604 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b58065c80 con 0x7f9b40004060 2022-01-10T01:29:24.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 -- 172.21.15.36:0/1626154604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b580604e0 con 0x7f9b40004b60 2022-01-10T01:29:24.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 -- 172.21.15.36:0/1626154604 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4000ba90 con 0x7f9b40003750 2022-01-10T01:29:24.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5cbf1700 1 --2- 172.21.15.36:0/1626154604 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b40004060 0x7f9b40004540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5dbf3700 1 --2- 172.21.15.36:0/1626154604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b40004b60 0x7f9b40004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5d3f2700 1 --2- 172.21.15.36:0/1626154604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b40003750 0x7f9b40003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5cbf1700 1 -- 172.21.15.36:0/1626154604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b40003750 msgr2=0x7f9b40003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:24.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5cbf1700 1 --2- 172.21.15.36:0/1626154604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b40003750 0x7f9b40003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5cbf1700 1 -- 172.21.15.36:0/1626154604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b40004b60 msgr2=0x7f9b40004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:24.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5cbf1700 1 --2- 172.21.15.36:0/1626154604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b40004b60 0x7f9b40004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5cbf1700 1 -- 172.21.15.36:0/1626154604 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b40003260 con 0x7f9b40004060 2022-01-10T01:29:24.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b5cbf1700 1 --2- 172.21.15.36:0/1626154604 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b40004060 0x7f9b40004540 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f9b4800c000 tx=0x7f9b48006df0).ready entity=mon.0 client_cookie=b5ac7f3c48fb8488 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:24.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.075+0000 7f9b47fff700 1 -- 172.21.15.36:0/1626154604 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b4800e830 con 0x7f9b40004060 2022-01-10T01:29:24.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b47fff700 1 -- 172.21.15.36:0/1626154604 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4800e990 con 0x7f9b40004060 2022-01-10T01:29:24.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b47fff700 1 -- 172.21.15.36:0/1626154604 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b4800ecf0 con 0x7f9b40004060 2022-01-10T01:29:24.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5f656700 1 -- 172.21.15.36:0/1626154604 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b40004060 msgr2=0x7f9b40004540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5f656700 1 --2- 172.21.15.36:0/1626154604 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b40004060 0x7f9b40004540 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f9b4800c000 tx=0x7f9b48006df0).stop 2022-01-10T01:29:24.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5dbf3700 1 -- 172.21.15.36:0/1626154604 reap_dead start 2022-01-10T01:29:24.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5f656700 1 -- 172.21.15.36:0/1626154604 shutdown_connections 2022-01-10T01:29:24.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5f656700 1 -- 172.21.15.36:0/1626154604 >> 172.21.15.36:0/1626154604 conn(0x7f9b5805cf60 msgr2=0x7f9b5805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:24.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5f656700 1 -- 172.21.15.36:0/1626154604 shutdown_connections 2022-01-10T01:29:24.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5f656700 1 -- 172.21.15.36:0/1626154604 wait complete. 2022-01-10T01:29:24.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5f656700 1 Processor -- start 2022-01-10T01:29:24.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5f656700 1 -- start start 2022-01-10T01:29:24.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5f656700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b40004060 0x7f9b58141c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5f656700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b580b1610 0x7f9b580b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5f656700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b58145840 0x7f9b58153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5f656700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b58142440 con 0x7f9b40004060 2022-01-10T01:29:24.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5f656700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b580b07d0 con 0x7f9b58145840 2022-01-10T01:29:24.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.079+0000 7f9b5f656700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b58141230 con 0x7f9b580b1610 2022-01-10T01:29:24.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5d3f2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b40004060 0x7f9b58141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5d3f2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b40004060 0x7f9b58141c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37132/0 (socket says 172.21.15.36:37132) 2022-01-10T01:29:24.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5d3f2700 1 -- 172.21.15.36:0/488639938 learned_addr learned my addr 172.21.15.36:0/488639938 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:24.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5cbf1700 1 --2- 172.21.15.36:0/488639938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b580b1610 0x7f9b580b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5dbf3700 1 --2- 172.21.15.36:0/488639938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b58145840 0x7f9b58153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5d3f2700 1 -- 172.21.15.36:0/488639938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b580b1610 msgr2=0x7f9b580b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5d3f2700 1 --2- 172.21.15.36:0/488639938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b580b1610 0x7f9b580b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5d3f2700 1 -- 172.21.15.36:0/488639938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b58145840 msgr2=0x7f9b58153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5d3f2700 1 --2- 172.21.15.36:0/488639938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b58145840 0x7f9b58153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5d3f2700 1 -- 172.21.15.36:0/488639938 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b581414d0 con 0x7f9b40004060 2022-01-10T01:29:24.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5d3f2700 1 --2- 172.21.15.36:0/488639938 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b40004060 0x7f9b58141c10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f9b5000b000 tx=0x7f9b50001840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:24.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b467fc700 1 -- 172.21.15.36:0/488639938 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b5000ca10 con 0x7f9b40004060 2022-01-10T01:29:24.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b467fc700 1 -- 172.21.15.36:0/488639938 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5000cb70 con 0x7f9b40004060 2022-01-10T01:29:24.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5f656700 1 -- 172.21.15.36:0/488639938 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b58141770 con 0x7f9b40004060 2022-01-10T01:29:24.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b467fc700 1 -- 172.21.15.36:0/488639938 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b5000ee70 con 0x7f9b40004060 2022-01-10T01:29:24.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5f656700 1 -- 172.21.15.36:0/488639938 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b58153ac0 con 0x7f9b40004060 2022-01-10T01:29:24.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5f656700 1 -- 172.21.15.36:0/488639938 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b58145c50 con 0x7f9b40004060 2022-01-10T01:29:24.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b467fc700 1 -- 172.21.15.36:0/488639938 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9b50014430 con 0x7f9b40004060 2022-01-10T01:29:24.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b467fc700 1 --2- 172.21.15.36:0/488639938 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9b38053620 0x7f9b38055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b467fc700 1 -- 172.21.15.36:0/488639938 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f9b5006bc00 con 0x7f9b40004060 2022-01-10T01:29:24.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.083+0000 7f9b5cbf1700 1 --2- 172.21.15.36:0/488639938 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9b38053620 0x7f9b38055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.087+0000 7f9b5cbf1700 1 --2- 172.21.15.36:0/488639938 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9b38053620 0x7f9b38055ae0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f9b4801e000 tx=0x7f9b48019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:24.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.091+0000 7f9b467fc700 1 -- 172.21.15.36:0/488639938 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9b50071020 con 0x7f9b40004060 2022-01-10T01:29:24.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.215+0000 7f9b5f656700 1 -- 172.21.15.36:0/488639938 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9b58141900 con 0x7f9b40004060 2022-01-10T01:29:24.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.219+0000 7f9b467fc700 1 -- 172.21.15.36:0/488639938 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v63) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9b50042ef0 con 0x7f9b40004060 2022-01-10T01:29:24.219 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:29:24.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.219+0000 7f9b5f656700 1 -- 172.21.15.36:0/488639938 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9b38053620 msgr2=0x7f9b38055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.219+0000 7f9b5f656700 1 --2- 172.21.15.36:0/488639938 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9b38053620 0x7f9b38055ae0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f9b4801e000 tx=0x7f9b48019000).stop 2022-01-10T01:29:24.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.219+0000 7f9b5f656700 1 -- 172.21.15.36:0/488639938 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b40004060 msgr2=0x7f9b58141c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.219+0000 7f9b5f656700 1 --2- 172.21.15.36:0/488639938 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b40004060 0x7f9b58141c10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f9b5000b000 tx=0x7f9b50001840).stop 2022-01-10T01:29:24.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.219+0000 7f9b5f656700 1 -- 172.21.15.36:0/488639938 shutdown_connections 2022-01-10T01:29:24.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.219+0000 7f9b5f656700 1 --2- 172.21.15.36:0/488639938 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9b38053620 0x7f9b38055ae0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.219+0000 7f9b5f656700 1 --2- 172.21.15.36:0/488639938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b58145840 0x7f9b58153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.219+0000 7f9b5f656700 1 --2- 172.21.15.36:0/488639938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b580b1610 0x7f9b580b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.219+0000 7f9b5f656700 1 --2- 172.21.15.36:0/488639938 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b40004060 0x7f9b58141c10 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.219+0000 7f9b5f656700 1 -- 172.21.15.36:0/488639938 >> 172.21.15.36:0/488639938 conn(0x7f9b5805cf60 msgr2=0x7f9b580b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:24.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.219+0000 7f9b5f656700 1 -- 172.21.15.36:0/488639938 shutdown_connections 2022-01-10T01:29:24.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.219+0000 7f9b5f656700 1 -- 172.21.15.36:0/488639938 wait complete. 2022-01-10T01:29:24.236 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:29:24.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f622dca2700 1 Processor -- start 2022-01-10T01:29:24.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f622dca2700 1 -- start start 2022-01-10T01:29:24.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f622dca2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62280b54a0 0x7f62280af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f622dca2700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62281479f0 con 0x7f62280b0610 2022-01-10T01:29:24.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f622dca2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62280b5880 con 0x7f62281475a0 2022-01-10T01:29:24.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f622dca2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62281452e0 con 0x7f62280b54a0 2022-01-10T01:29:24.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f6227fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f62280b0610 0x7f62280675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34934/0 (socket says 172.21.15.36:34934) 2022-01-10T01:29:24.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f6227fff700 1 -- 172.21.15.36:0/927314022 learned_addr learned my addr 172.21.15.36:0/927314022 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:24.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f622cca0700 1 --2- 172.21.15.36:0/927314022 >> v2:172.21.15.59:3300/0 conn(0x7f62280b54a0 0x7f62280af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966943220 0 0) 0x7f62281479f0 con 0x7f62280b0610 2022-01-10T01:29:24.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6214003260 con 0x7f62280b0610 2022-01-10T01:29:24.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087799979 0 0) 0x7f62280b5880 con 0x7f62281475a0 2022-01-10T01:29:24.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62281479f0 con 0x7f62281475a0 2022-01-10T01:29:24.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1512116597 0 0) 0x7f6214003260 con 0x7f62280b0610 2022-01-10T01:29:24.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 >> v2:172.21.15.59:3300/0 conn(0x7f62280b54a0 msgr2=0x7f62280af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:24.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f62277fe700 1 --2- 172.21.15.36:0/927314022 >> v2:172.21.15.59:3300/0 conn(0x7f62280b54a0 0x7f62280af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 >> v1:172.21.15.59:6789/0 conn(0x7f62281475a0 legacy=0x7f62280acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62280ac800 con 0x7f62280b0610 2022-01-10T01:29:24.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f62180019e0 con 0x7f62280b0610 2022-01-10T01:29:24.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 >> v1:172.21.15.36:6789/0 conn(0x7f62280b0610 legacy=0x7f62280675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f62277fe700 1 --2- 172.21.15.36:0/927314022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6214003930 0x7f6214003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.347+0000 7f62277fe700 1 --2- 172.21.15.36:0/927314022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6214004500 0x7f6214004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f62277fe700 1 --2- 172.21.15.36:0/927314022 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6214004e70 0x7f621400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62281452e0 con 0x7f6214004e70 2022-01-10T01:29:24.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621400bda0 con 0x7f6214004500 2022-01-10T01:29:24.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621400bf60 con 0x7f6214003930 2022-01-10T01:29:24.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622d4a1700 1 --2- 172.21.15.36:0/927314022 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6214004e70 0x7f621400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f6227fff700 1 --2- 172.21.15.36:0/927314022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6214004500 0x7f6214004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622cca0700 1 --2- 172.21.15.36:0/927314022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6214003930 0x7f6214003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622d4a1700 1 -- 172.21.15.36:0/927314022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6214003930 msgr2=0x7f6214003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:24.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622d4a1700 1 --2- 172.21.15.36:0/927314022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6214003930 0x7f6214003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622d4a1700 1 -- 172.21.15.36:0/927314022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6214004500 msgr2=0x7f6214004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:24.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622d4a1700 1 --2- 172.21.15.36:0/927314022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6214004500 0x7f6214004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622d4a1700 1 -- 172.21.15.36:0/927314022 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6214003260 con 0x7f6214004e70 2022-01-10T01:29:24.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622d4a1700 1 -- 172.21.15.36:0/927314022 reap_dead start 2022-01-10T01:29:24.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622d4a1700 1 --2- 172.21.15.36:0/927314022 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6214004e70 0x7f621400b750 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f6220001110 tx=0x7f6220007a00).ready entity=mon.0 client_cookie=b230ad276ab007e3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:24.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6220007d10 con 0x7f6214004e70 2022-01-10T01:29:24.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6220007030 con 0x7f6214004e70 2022-01-10T01:29:24.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f62277fe700 1 -- 172.21.15.36:0/927314022 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6220007390 con 0x7f6214004e70 2022-01-10T01:29:24.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 -- 172.21.15.36:0/927314022 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6214004e70 msgr2=0x7f621400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 --2- 172.21.15.36:0/927314022 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6214004e70 0x7f621400b750 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f6220001110 tx=0x7f6220007a00).stop 2022-01-10T01:29:24.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 -- 172.21.15.36:0/927314022 shutdown_connections 2022-01-10T01:29:24.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 --2- 172.21.15.36:0/927314022 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6214004e70 0x7f621400b750 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 -- 172.21.15.36:0/927314022 >> 172.21.15.36:0/927314022 conn(0x7f6228062560 msgr2=0x7f6228062940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:24.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 -- 172.21.15.36:0/927314022 shutdown_connections 2022-01-10T01:29:24.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 -- 172.21.15.36:0/927314022 wait complete. 2022-01-10T01:29:24.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 Processor -- start 2022-01-10T01:29:24.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 -- start start 2022-01-10T01:29:24.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6214004e70 0x7f6228066d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6228063240 0x7f6228144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62280a70c0 0x7f6228144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62280adff0 con 0x7f6214004e70 2022-01-10T01:29:24.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62280638e0 con 0x7f6228063240 2022-01-10T01:29:24.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622dca2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62280b4bf0 con 0x7f62280a70c0 2022-01-10T01:29:24.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622cca0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6214004e70 0x7f6228066d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622cca0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6214004e70 0x7f6228066d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37152/0 (socket says 172.21.15.36:37152) 2022-01-10T01:29:24.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622cca0700 1 -- 172.21.15.36:0/1794545148 learned_addr learned my addr 172.21.15.36:0/1794545148 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:24.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f6227fff700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6228063240 0x7f6228144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.351+0000 7f622d4a1700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62280a70c0 0x7f6228144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f6227fff700 1 -- 172.21.15.36:0/1794545148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62280a70c0 msgr2=0x7f6228144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f6227fff700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62280a70c0 0x7f6228144960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f6227fff700 1 -- 172.21.15.36:0/1794545148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6214004e70 msgr2=0x7f6228066d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f6227fff700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6214004e70 0x7f6228066d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f6227fff700 1 -- 172.21.15.36:0/1794545148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6228157450 con 0x7f6228063240 2022-01-10T01:29:24.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f622cca0700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6214004e70 0x7f6228066d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:24.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f6227fff700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6228063240 0x7f6228144470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f62280b47b0 tx=0x7f6218002060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:24.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f6225ffb700 1 -- 172.21.15.36:0/1794545148 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62180116b0 con 0x7f6228063240 2022-01-10T01:29:24.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f6225ffb700 1 -- 172.21.15.36:0/1794545148 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6218011810 con 0x7f6228063240 2022-01-10T01:29:24.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f622dca2700 1 -- 172.21.15.36:0/1794545148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62280b4e20 con 0x7f6228063240 2022-01-10T01:29:24.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f6225ffb700 1 -- 172.21.15.36:0/1794545148 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6218011b70 con 0x7f6228063240 2022-01-10T01:29:24.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f622dca2700 1 -- 172.21.15.36:0/1794545148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6228157960 con 0x7f6228063240 2022-01-10T01:29:24.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f622dca2700 1 -- 172.21.15.36:0/1794545148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6228064240 con 0x7f6228063240 2022-01-10T01:29:24.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f6225ffb700 1 -- 172.21.15.36:0/1794545148 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6218033020 con 0x7f6228063240 2022-01-10T01:29:24.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.355+0000 7f6225ffb700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6208053680 0x7f6208055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.359+0000 7f622cca0700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6208053680 0x7f6208055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.359+0000 7f6225ffb700 1 -- 172.21.15.36:0/1794545148 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f621806ba50 con 0x7f6228063240 2022-01-10T01:29:24.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.359+0000 7f622cca0700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6208053680 0x7f6208055b40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f621c00b000 tx=0x7f621c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:24.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.363+0000 7f6225ffb700 1 -- 172.21.15.36:0/1794545148 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6218042c90 con 0x7f6228063240 2022-01-10T01:29:24.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.495+0000 7f622dca2700 1 -- 172.21.15.36:0/1794545148 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f62280b14f0 con 0x7f6228063240 2022-01-10T01:29:24.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.495+0000 7f6225ffb700 1 -- 172.21.15.36:0/1794545148 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6218019070 con 0x7f6228063240 2022-01-10T01:29:24.496 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:29:24.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.499+0000 7f622dca2700 1 -- 172.21.15.36:0/1794545148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6208053680 msgr2=0x7f6208055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.499+0000 7f622dca2700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6208053680 0x7f6208055b40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f621c00b000 tx=0x7f621c006df0).stop 2022-01-10T01:29:24.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.499+0000 7f622dca2700 1 -- 172.21.15.36:0/1794545148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6228063240 msgr2=0x7f6228144470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.499+0000 7f622dca2700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6228063240 0x7f6228144470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f62280b47b0 tx=0x7f6218002060).stop 2022-01-10T01:29:24.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.499+0000 7f622dca2700 1 -- 172.21.15.36:0/1794545148 shutdown_connections 2022-01-10T01:29:24.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.499+0000 7f622dca2700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6208053680 0x7f6208055b40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.499+0000 7f622dca2700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62280a70c0 0x7f6228144960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.499+0000 7f622dca2700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6228063240 0x7f6228144470 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.499+0000 7f622dca2700 1 --2- 172.21.15.36:0/1794545148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6214004e70 0x7f6228066d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.499+0000 7f622dca2700 1 -- 172.21.15.36:0/1794545148 >> 172.21.15.36:0/1794545148 conn(0x7f6228062560 msgr2=0x7f62280af250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:24.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.499+0000 7f622dca2700 1 -- 172.21.15.36:0/1794545148 shutdown_connections 2022-01-10T01:29:24.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.499+0000 7f622dca2700 1 -- 172.21.15.36:0/1794545148 wait complete. 2022-01-10T01:29:24.516 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-01-10T01:29:24.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.615+0000 7f82cd794700 1 Processor -- start 2022-01-10T01:29:24.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.615+0000 7f82cd794700 1 -- start start 2022-01-10T01:29:24.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.615+0000 7f82cd794700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82c80b0010 0x7f82c80a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.615+0000 7f82cd794700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c80a70c0 con 0x7f82c80b2580 2022-01-10T01:29:24.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.615+0000 7f82cd794700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c80a72f0 con 0x7f82c80afbd0 2022-01-10T01:29:24.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.615+0000 7f82cd794700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82c80a7590 con 0x7f82c80b0010 2022-01-10T01:29:24.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.615+0000 7f82c7fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f82c80b2580 0x7f82c814ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34956/0 (socket says 172.21.15.36:34956) 2022-01-10T01:29:24.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.615+0000 7f82c7fff700 1 -- 172.21.15.36:0/3303983406 learned_addr learned my addr 172.21.15.36:0/3303983406 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:24.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.615+0000 7f82c77fe700 1 --2- 172.21.15.36:0/3303983406 >> v2:172.21.15.59:3300/0 conn(0x7f82c80b0010 0x7f82c80a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82c6ffd700 1 -- 172.21.15.36:0/3303983406 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621814266 0 0) 0x7f82c80a70c0 con 0x7f82c80b2580 2022-01-10T01:29:24.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82c6ffd700 1 -- 172.21.15.36:0/3303983406 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b4003260 con 0x7f82c80b2580 2022-01-10T01:29:24.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82c77fe700 1 -- 172.21.15.36:0/3303983406 >> v1:172.21.15.59:6789/0 conn(0x7f82c80afbd0 legacy=0x7f82c8151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82c77fe700 1 -- 172.21.15.36:0/3303983406 >> v1:172.21.15.36:6789/0 conn(0x7f82c80b2580 legacy=0x7f82c814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82c77fe700 1 -- 172.21.15.36:0/3303983406 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c80a7830 con 0x7f82c80b0010 2022-01-10T01:29:24.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82c77fe700 1 --2- 172.21.15.36:0/3303983406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c80b0010 0x7f82c80a83b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f82b80032f0 tx=0x7f82b80091d0).ready entity=mon.1 client_cookie=b3475ddf57ad4631 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:24.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82c6ffd700 1 -- 172.21.15.36:0/3303983406 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82b800b6c0 con 0x7f82c80b0010 2022-01-10T01:29:24.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82c6ffd700 1 -- 172.21.15.36:0/3303983406 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b800b820 con 0x7f82c80b0010 2022-01-10T01:29:24.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82c6ffd700 1 -- 172.21.15.36:0/3303983406 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82b800b990 con 0x7f82c80b0010 2022-01-10T01:29:24.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 -- 172.21.15.36:0/3303983406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c80b0010 msgr2=0x7f82c80a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 --2- 172.21.15.36:0/3303983406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c80b0010 0x7f82c80a83b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f82b80032f0 tx=0x7f82b80091d0).stop 2022-01-10T01:29:24.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 -- 172.21.15.36:0/3303983406 shutdown_connections 2022-01-10T01:29:24.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 --2- 172.21.15.36:0/3303983406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c80b0010 0x7f82c80a83b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 -- 172.21.15.36:0/3303983406 >> 172.21.15.36:0/3303983406 conn(0x7f82c8060180 msgr2=0x7f82c80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:24.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 -- 172.21.15.36:0/3303983406 shutdown_connections 2022-01-10T01:29:24.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 -- 172.21.15.36:0/3303983406 wait complete. 2022-01-10T01:29:24.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 Processor -- start 2022-01-10T01:29:24.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 -- start start 2022-01-10T01:29:24.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c80afbd0 0x7f82c80a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82c80b0010 0x7f82c80aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82c80b2580 0x7f82c80abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c80aa940 con 0x7f82c80b0010 2022-01-10T01:29:24.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8157520 con 0x7f82c80afbd0 2022-01-10T01:29:24.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82cd794700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c8156fe0 con 0x7f82c80b2580 2022-01-10T01:29:24.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82c77fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82c80b0010 0x7f82c80aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82c77fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82c80b0010 0x7f82c80aa450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37166/0 (socket says 172.21.15.36:37166) 2022-01-10T01:29:24.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82c77fe700 1 -- 172.21.15.36:0/3663638750 learned_addr learned my addr 172.21.15.36:0/3663638750 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:24.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82c7fff700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c80afbd0 0x7f82c80a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.619+0000 7f82ccf93700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82c80b2580 0x7f82c80abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82c77fe700 1 -- 172.21.15.36:0/3663638750 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82c80b2580 msgr2=0x7f82c80abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82c77fe700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82c80b2580 0x7f82c80abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82c77fe700 1 -- 172.21.15.36:0/3663638750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c80afbd0 msgr2=0x7f82c80a9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82c77fe700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c80afbd0 0x7f82c80a9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82c77fe700 1 -- 172.21.15.36:0/3663638750 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b8009470 con 0x7f82c80b0010 2022-01-10T01:29:24.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82ccf93700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82c80b2580 0x7f82c80abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:24.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82c77fe700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82c80b0010 0x7f82c80aa450 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f82b80032f0 tx=0x7f82b8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:24.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82c57fa700 1 -- 172.21.15.36:0/3663638750 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82b800b6c0 con 0x7f82c80b0010 2022-01-10T01:29:24.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82c57fa700 1 -- 172.21.15.36:0/3663638750 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b8021630 con 0x7f82c80b0010 2022-01-10T01:29:24.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82cd794700 1 -- 172.21.15.36:0/3663638750 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c8157280 con 0x7f82c80b0010 2022-01-10T01:29:24.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82c57fa700 1 -- 172.21.15.36:0/3663638750 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82b8021990 con 0x7f82c80b0010 2022-01-10T01:29:24.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82cd794700 1 -- 172.21.15.36:0/3663638750 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c80b4480 con 0x7f82c80b0010 2022-01-10T01:29:24.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82cd794700 1 -- 172.21.15.36:0/3663638750 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c80b3430 con 0x7f82c80b0010 2022-01-10T01:29:24.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82c57fa700 1 -- 172.21.15.36:0/3663638750 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f82b8027020 con 0x7f82c80b0010 2022-01-10T01:29:24.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82c57fa700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f82a8053620 0x7f82a8055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82c7fff700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f82a8053620 0x7f82a8055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.623+0000 7f82c57fa700 1 -- 172.21.15.36:0/3663638750 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f82b806cca0 con 0x7f82c80b0010 2022-01-10T01:29:24.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.627+0000 7f82c7fff700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f82a8053620 0x7f82a8055ae0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f82bc00d000 tx=0x7f82bc009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:24.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.635+0000 7f82c57fa700 1 -- 172.21.15.36:0/3663638750 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f82c80b3430 con 0x7f82c80b0010 2022-01-10T01:29:24.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.763+0000 7f82cd794700 1 -- 172.21.15.36:0/3663638750 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f82c80b3430 con 0x7f82c80b0010 2022-01-10T01:29:24.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.763+0000 7f82c57fa700 1 -- 172.21.15.36:0/3663638750 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) v1 ==== 84+0+143 (secure 0 0 0) 0x7f82c80b3430 con 0x7f82c80b0010 2022-01-10T01:29:24.766 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:24.766 INFO:teuthology.orchestra.run.smithi036.stdout:[ 2022-01-10T01:29:24.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:24.766 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 1, 2022-01-10T01:29:24.767 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "device_health_metrics" 2022-01-10T01:29:24.767 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:24.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:24.767 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 2, 2022-01-10T01:29:24.768 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "rbd" 2022-01-10T01:29:24.768 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:24.768 INFO:teuthology.orchestra.run.smithi036.stdout:] 2022-01-10T01:29:24.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.767+0000 7f82cd794700 1 -- 172.21.15.36:0/3663638750 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f82a8053620 msgr2=0x7f82a8055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.767+0000 7f82cd794700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f82a8053620 0x7f82a8055ae0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f82bc00d000 tx=0x7f82bc009040).stop 2022-01-10T01:29:24.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.767+0000 7f82cd794700 1 -- 172.21.15.36:0/3663638750 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82c80b0010 msgr2=0x7f82c80aa450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.767+0000 7f82cd794700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82c80b0010 0x7f82c80aa450 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f82b80032f0 tx=0x7f82b8016000).stop 2022-01-10T01:29:24.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.767+0000 7f82cd794700 1 -- 172.21.15.36:0/3663638750 shutdown_connections 2022-01-10T01:29:24.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.767+0000 7f82cd794700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f82a8053620 0x7f82a8055ae0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.767+0000 7f82cd794700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82c80b2580 0x7f82c80abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.767+0000 7f82cd794700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82c80b0010 0x7f82c80aa450 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.767+0000 7f82cd794700 1 --2- 172.21.15.36:0/3663638750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82c80afbd0 0x7f82c80a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.767+0000 7f82cd794700 1 -- 172.21.15.36:0/3663638750 >> 172.21.15.36:0/3663638750 conn(0x7f82c8060180 msgr2=0x7f82c8145f30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:24.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.767+0000 7f82cd794700 1 -- 172.21.15.36:0/3663638750 shutdown_connections 2022-01-10T01:29:24.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.767+0000 7f82cd794700 1 -- 172.21.15.36:0/3663638750 wait complete. 2022-01-10T01:29:24.784 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-01-10T01:29:24.786 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:29:24.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.895+0000 7f03bab37700 1 Processor -- start 2022-01-10T01:29:24.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03bab37700 1 -- start start 2022-01-10T01:29:24.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03bab37700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b4146950 0x7f03b4140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03bab37700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f03b40b4690 0x7f03b40b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03bab37700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b4143b60 con 0x7f03b40b4180 2022-01-10T01:29:24.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03bab37700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b4147510 con 0x7f03b40b4690 2022-01-10T01:29:24.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03bab37700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b4143e00 con 0x7f03b4146950 2022-01-10T01:29:24.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03b90d4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f03b40b4690 0x7f03b40b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03b90d4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f03b40b4690 0x7f03b40b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37178/0 (socket says 172.21.15.36:37178) 2022-01-10T01:29:24.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03b90d4700 1 -- 172.21.15.36:0/3666093417 learned_addr learned my addr 172.21.15.36:0/3666093417 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:24.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03b88d3700 1 --2- 172.21.15.36:0/3666093417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b4146950 0x7f03b4140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03b90d4700 1 -- 172.21.15.36:0/3666093417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b4146950 msgr2=0x7f03b4140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:24.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03b90d4700 1 --2- 172.21.15.36:0/3666093417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b4146950 0x7f03b4140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03b90d4700 1 -- 172.21.15.36:0/3666093417 >> v1:172.21.15.59:6789/0 conn(0x7f03b40b4180 legacy=0x7f03b4140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03b90d4700 1 -- 172.21.15.36:0/3666093417 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b40b0c90 con 0x7f03b40b4690 2022-01-10T01:29:24.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03b90d4700 1 --2- 172.21.15.36:0/3666093417 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03b40b4690 0x7f03b40b4ed0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f03ac0032f0 tx=0x7f03ac009290).ready entity=mon.0 client_cookie=366942ff17b695d2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:24.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03b37fe700 1 -- 172.21.15.36:0/3666093417 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03ac00b8a0 con 0x7f03b40b4690 2022-01-10T01:29:24.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03b37fe700 1 -- 172.21.15.36:0/3666093417 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac00ba00 con 0x7f03b40b4690 2022-01-10T01:29:24.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03b37fe700 1 -- 172.21.15.36:0/3666093417 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03ac00bb70 con 0x7f03b40b4690 2022-01-10T01:29:24.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03bab37700 1 -- 172.21.15.36:0/3666093417 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03b40b4690 msgr2=0x7f03b40b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03bab37700 1 --2- 172.21.15.36:0/3666093417 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03b40b4690 0x7f03b40b4ed0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f03ac0032f0 tx=0x7f03ac009290).stop 2022-01-10T01:29:24.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03bab37700 1 -- 172.21.15.36:0/3666093417 shutdown_connections 2022-01-10T01:29:24.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03bab37700 1 --2- 172.21.15.36:0/3666093417 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03b40b4690 0x7f03b40b4ed0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03bab37700 1 --2- 172.21.15.36:0/3666093417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b4146950 0x7f03b4140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03bab37700 1 -- 172.21.15.36:0/3666093417 >> 172.21.15.36:0/3666093417 conn(0x7f03b405c490 msgr2=0x7f03b405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:24.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03bab37700 1 -- 172.21.15.36:0/3666093417 shutdown_connections 2022-01-10T01:29:24.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.899+0000 7f03bab37700 1 -- 172.21.15.36:0/3666093417 wait complete. 2022-01-10T01:29:24.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03bab37700 1 Processor -- start 2022-01-10T01:29:24.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03bab37700 1 -- start start 2022-01-10T01:29:24.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03bab37700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b40b4180 0x7f03b41562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03bab37700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b40b4690 0x7f03b4145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03bab37700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03b4146950 0x7f03b4152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03bab37700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40ad900 con 0x7f03b4146950 2022-01-10T01:29:24.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03bab37700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b41558f0 con 0x7f03b40b4180 2022-01-10T01:29:24.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03bab37700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b4155b90 con 0x7f03b40b4690 2022-01-10T01:29:24.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03b90d4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03b4146950 0x7f03b4152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03b90d4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03b4146950 0x7f03b4152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37184/0 (socket says 172.21.15.36:37184) 2022-01-10T01:29:24.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03b90d4700 1 -- 172.21.15.36:0/1131625141 learned_addr learned my addr 172.21.15.36:0/1131625141 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:24.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03b88d3700 1 --2- 172.21.15.36:0/1131625141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b40b4180 0x7f03b41562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03b3fff700 1 --2- 172.21.15.36:0/1131625141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b40b4690 0x7f03b4145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03b90d4700 1 -- 172.21.15.36:0/1131625141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b40b4690 msgr2=0x7f03b4145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03b90d4700 1 --2- 172.21.15.36:0/1131625141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b40b4690 0x7f03b4145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03b90d4700 1 -- 172.21.15.36:0/1131625141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b40b4180 msgr2=0x7f03b41562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:24.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03b90d4700 1 --2- 172.21.15.36:0/1131625141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b40b4180 0x7f03b41562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:24.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03b90d4700 1 -- 172.21.15.36:0/1131625141 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac009530 con 0x7f03b4146950 2022-01-10T01:29:24.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03b90d4700 1 --2- 172.21.15.36:0/1131625141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03b4146950 0x7f03b4152280 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f03ac0032f0 tx=0x7f03ac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:24.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03b1ffb700 1 -- 172.21.15.36:0/1131625141 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03ac00b8a0 con 0x7f03b4146950 2022-01-10T01:29:24.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03b1ffb700 1 -- 172.21.15.36:0/1131625141 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03ac021480 con 0x7f03b4146950 2022-01-10T01:29:24.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03bab37700 1 -- 172.21.15.36:0/1131625141 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b4155e30 con 0x7f03b4146950 2022-01-10T01:29:24.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03b1ffb700 1 -- 172.21.15.36:0/1131625141 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03ac0217e0 con 0x7f03b4146950 2022-01-10T01:29:24.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.903+0000 7f03bab37700 1 -- 172.21.15.36:0/1131625141 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b40ad5f0 con 0x7f03b4146950 2022-01-10T01:29:24.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.907+0000 7f03bab37700 1 -- 172.21.15.36:0/1131625141 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b4155fc0 con 0x7f03b4146950 2022-01-10T01:29:24.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.907+0000 7f03b1ffb700 1 -- 172.21.15.36:0/1131625141 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f03ac00f070 con 0x7f03b4146950 2022-01-10T01:29:24.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.907+0000 7f03b1ffb700 1 --2- 172.21.15.36:0/1131625141 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f03980535f0 0x7f0398055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:24.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.907+0000 7f03b1ffb700 1 -- 172.21.15.36:0/1131625141 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f03ac06cba0 con 0x7f03b4146950 2022-01-10T01:29:24.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.907+0000 7f03b88d3700 1 --2- 172.21.15.36:0/1131625141 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f03980535f0 0x7f0398055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:24.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.907+0000 7f03b88d3700 1 --2- 172.21.15.36:0/1131625141 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f03980535f0 0x7f0398055ab0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f039c00b000 tx=0x7f039c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:24.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:24.915+0000 7f03b1ffb700 1 -- 172.21.15.36:0/1131625141 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f03ac043f00 con 0x7f03b4146950 2022-01-10T01:29:25.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.043+0000 7f03bab37700 1 -- 172.21.15.36:0/1131625141 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f03b4057350 con 0x7f03b4146950 2022-01-10T01:29:25.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.727+0000 7f03b1ffb700 1 -- 172.21.15.36:0/1131625141 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v64) v1 ==== 133+0+0 (secure 0 0 0) 0x7f03ac026070 con 0x7f03b4146950 2022-01-10T01:29:25.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.735+0000 7f03bab37700 1 -- 172.21.15.36:0/1131625141 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f03980535f0 msgr2=0x7f0398055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:25.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.735+0000 7f03bab37700 1 --2- 172.21.15.36:0/1131625141 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f03980535f0 0x7f0398055ab0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f039c00b000 tx=0x7f039c006df0).stop 2022-01-10T01:29:25.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.735+0000 7f03bab37700 1 -- 172.21.15.36:0/1131625141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03b4146950 msgr2=0x7f03b4152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:25.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.735+0000 7f03bab37700 1 --2- 172.21.15.36:0/1131625141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03b4146950 0x7f03b4152280 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f03ac0032f0 tx=0x7f03ac016000).stop 2022-01-10T01:29:25.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.735+0000 7f03bab37700 1 -- 172.21.15.36:0/1131625141 shutdown_connections 2022-01-10T01:29:25.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.735+0000 7f03bab37700 1 --2- 172.21.15.36:0/1131625141 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f03980535f0 0x7f0398055ab0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:25.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.735+0000 7f03bab37700 1 --2- 172.21.15.36:0/1131625141 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03b4146950 0x7f03b4152280 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:25.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.735+0000 7f03bab37700 1 --2- 172.21.15.36:0/1131625141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03b40b4690 0x7f03b4145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:25.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.735+0000 7f03bab37700 1 --2- 172.21.15.36:0/1131625141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03b40b4180 0x7f03b41562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:25.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.735+0000 7f03bab37700 1 -- 172.21.15.36:0/1131625141 >> 172.21.15.36:0/1131625141 conn(0x7f03b405c490 msgr2=0x7f03b413b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:25.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.739+0000 7f03bab37700 1 -- 172.21.15.36:0/1131625141 shutdown_connections 2022-01-10T01:29:25.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.739+0000 7f03bab37700 1 -- 172.21.15.36:0/1131625141 wait complete. 2022-01-10T01:29:25.741 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:29:25.752 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2022-01-10T01:29:25.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.859+0000 7f6a3db3b700 1 Processor -- start 2022-01-10T01:29:25.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.859+0000 7f6a3db3b700 1 -- start start 2022-01-10T01:29:25.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.859+0000 7f6a3db3b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f6a380b0b80 0x7f6a38146c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:25.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.859+0000 7f6a3db3b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a380b1140 con 0x7f6a380b03d0 2022-01-10T01:29:25.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.859+0000 7f6a3db3b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a380a9570 con 0x7f6a380a9190 2022-01-10T01:29:25.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.859+0000 7f6a3db3b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a380b1370 con 0x7f6a380b0b80 2022-01-10T01:29:25.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.859+0000 7f6a3d33a700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f6a380b03d0 0x7f6a381401c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:34984/0 (socket says 172.21.15.36:34984) 2022-01-10T01:29:25.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.859+0000 7f6a3d33a700 1 -- 172.21.15.36:0/1566849879 learned_addr learned my addr 172.21.15.36:0/1566849879 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:25.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.859+0000 7f6a37fff700 1 --2- 172.21.15.36:0/1566849879 >> v2:172.21.15.36:3300/0 conn(0x7f6a380b0b80 0x7f6a38146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:25.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.859+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164104951 0 0) 0x7f6a380b1140 con 0x7f6a380b03d0 2022-01-10T01:29:25.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.859+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a24003260 con 0x7f6a380b03d0 2022-01-10T01:29:25.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.859+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015637617 0 0) 0x7f6a380a9570 con 0x7f6a380a9190 2022-01-10T01:29:25.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.859+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a380b1140 con 0x7f6a380a9190 2022-01-10T01:29:25.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4191532471 0 0) 0x7f6a24003260 con 0x7f6a380b03d0 2022-01-10T01:29:25.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 >> v2:172.21.15.36:3300/0 conn(0x7f6a380b0b80 msgr2=0x7f6a38146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:25.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 --2- 172.21.15.36:0/1566849879 >> v2:172.21.15.36:3300/0 conn(0x7f6a380b0b80 0x7f6a38146c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:25.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 >> v1:172.21.15.59:6789/0 conn(0x7f6a380a9190 legacy=0x7f6a38146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:25.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a380b1610 con 0x7f6a380b03d0 2022-01-10T01:29:25.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f6a300019e0 con 0x7f6a380b03d0 2022-01-10T01:29:25.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 >> v1:172.21.15.36:6789/0 conn(0x7f6a380b03d0 legacy=0x7f6a381401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:25.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 --2- 172.21.15.36:0/1566849879 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a240038e0 0x7f6a24003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:25.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 --2- 172.21.15.36:0/1566849879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24004500 0x7f6a24004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:25.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 --2- 172.21.15.36:0/1566849879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24004e70 0x7f6a2400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:25.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a380b1370 con 0x7f6a240038e0 2022-01-10T01:29:25.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2400bd20 con 0x7f6a24004500 2022-01-10T01:29:25.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2400bee0 con 0x7f6a24004e70 2022-01-10T01:29:25.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3cb39700 1 --2- 172.21.15.36:0/1566849879 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a240038e0 0x7f6a24003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:25.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a37fff700 1 --2- 172.21.15.36:0/1566849879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24004500 0x7f6a24004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:25.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3d33a700 1 --2- 172.21.15.36:0/1566849879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24004e70 0x7f6a2400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:25.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3cb39700 1 -- 172.21.15.36:0/1566849879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24004e70 msgr2=0x7f6a2400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:25.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3cb39700 1 --2- 172.21.15.36:0/1566849879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24004e70 0x7f6a2400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:25.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3cb39700 1 -- 172.21.15.36:0/1566849879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24004500 msgr2=0x7f6a24004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:25.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3cb39700 1 --2- 172.21.15.36:0/1566849879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a24004500 0x7f6a24004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:25.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3cb39700 1 -- 172.21.15.36:0/1566849879 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a24003260 con 0x7f6a240038e0 2022-01-10T01:29:25.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3d33a700 1 --2- 172.21.15.36:0/1566849879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a24004e70 0x7f6a2400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:25.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3d33a700 1 -- 172.21.15.36:0/1566849879 reap_dead start 2022-01-10T01:29:25.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3cb39700 1 --2- 172.21.15.36:0/1566849879 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a240038e0 0x7f6a24003d00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f6a28001110 tx=0x7f6a28007a00).ready entity=mon.0 client_cookie=3b82002bb9ab510f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:25.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a28007d10 con 0x7f6a240038e0 2022-01-10T01:29:25.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a28007030 con 0x7f6a240038e0 2022-01-10T01:29:25.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a377fe700 1 -- 172.21.15.36:0/1566849879 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a28007390 con 0x7f6a240038e0 2022-01-10T01:29:25.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3db3b700 1 -- 172.21.15.36:0/1566849879 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a240038e0 msgr2=0x7f6a24003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:25.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3db3b700 1 --2- 172.21.15.36:0/1566849879 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a240038e0 0x7f6a24003d00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f6a28001110 tx=0x7f6a28007a00).stop 2022-01-10T01:29:25.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3db3b700 1 -- 172.21.15.36:0/1566849879 shutdown_connections 2022-01-10T01:29:25.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3db3b700 1 --2- 172.21.15.36:0/1566849879 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a240038e0 0x7f6a24003d00 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:25.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3db3b700 1 -- 172.21.15.36:0/1566849879 >> 172.21.15.36:0/1566849879 conn(0x7f6a38061140 msgr2=0x7f6a38062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:25.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3db3b700 1 -- 172.21.15.36:0/1566849879 shutdown_connections 2022-01-10T01:29:25.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3db3b700 1 -- 172.21.15.36:0/1566849879 wait complete. 2022-01-10T01:29:25.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3db3b700 1 Processor -- start 2022-01-10T01:29:25.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.863+0000 7f6a3db3b700 1 -- start start 2022-01-10T01:29:25.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a3db3b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a240038e0 0x7f6a3813f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:25.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a3db3b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a38155e80 0x7f6a381562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:25.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a3db3b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a381528b0 0x7f6a38152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:25.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a3db3b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a38153220 con 0x7f6a38155e80 2022-01-10T01:29:25.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a3db3b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a381567d0 con 0x7f6a240038e0 2022-01-10T01:29:25.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a3db3b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a380b53b0 con 0x7f6a381528b0 2022-01-10T01:29:25.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a37fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a38155e80 0x7f6a381562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:25.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a37fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a38155e80 0x7f6a381562e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37202/0 (socket says 172.21.15.36:37202) 2022-01-10T01:29:25.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a37fff700 1 -- 172.21.15.36:0/2403918741 learned_addr learned my addr 172.21.15.36:0/2403918741 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:25.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a3cb39700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a240038e0 0x7f6a3813f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:25.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a3d33a700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a381528b0 0x7f6a38152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:25.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a37fff700 1 -- 172.21.15.36:0/2403918741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a381528b0 msgr2=0x7f6a38152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:25.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a37fff700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a381528b0 0x7f6a38152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:25.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a37fff700 1 -- 172.21.15.36:0/2403918741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a240038e0 msgr2=0x7f6a3813f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:25.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a37fff700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a240038e0 0x7f6a3813f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:25.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a37fff700 1 -- 172.21.15.36:0/2403918741 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a381415a0 con 0x7f6a38155e80 2022-01-10T01:29:25.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a3d33a700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a381528b0 0x7f6a38152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:25.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a37fff700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a38155e80 0x7f6a381562e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f6a2c00b000 tx=0x7f6a2c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:25.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a35ffb700 1 -- 172.21.15.36:0/2403918741 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a2c00f940 con 0x7f6a38155e80 2022-01-10T01:29:25.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a35ffb700 1 -- 172.21.15.36:0/2403918741 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c00faa0 con 0x7f6a38155e80 2022-01-10T01:29:25.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a3db3b700 1 -- 172.21.15.36:0/2403918741 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a38152450 con 0x7f6a38155e80 2022-01-10T01:29:25.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a35ffb700 1 -- 172.21.15.36:0/2403918741 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a2c00fe00 con 0x7f6a38155e80 2022-01-10T01:29:25.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a3db3b700 1 -- 172.21.15.36:0/2403918741 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a38142170 con 0x7f6a38155e80 2022-01-10T01:29:25.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.867+0000 7f6a3db3b700 1 -- 172.21.15.36:0/2403918741 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a38057350 con 0x7f6a38155e80 2022-01-10T01:29:25.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.871+0000 7f6a35ffb700 1 -- 172.21.15.36:0/2403918741 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6a2c014440 con 0x7f6a38155e80 2022-01-10T01:29:25.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.871+0000 7f6a35ffb700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a18053560 0x7f6a18055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:25.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.871+0000 7f6a35ffb700 1 -- 172.21.15.36:0/2403918741 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f6a2c06c330 con 0x7f6a38155e80 2022-01-10T01:29:25.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.871+0000 7f6a3cb39700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a18053560 0x7f6a18055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:25.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.871+0000 7f6a3cb39700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a18053560 0x7f6a18055a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f6a2801a000 tx=0x7f6a28016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:25.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:25.875+0000 7f6a35ffb700 1 -- 172.21.15.36:0/2403918741 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a2c0434b0 con 0x7f6a38155e80 2022-01-10T01:29:26.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.003+0000 7f6a3db3b700 1 -- 172.21.15.36:0/2403918741 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f6a38067930 con 0x7f6a38155e80 2022-01-10T01:29:26.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.743+0000 7f6a35ffb700 1 -- 172.21.15.36:0/2403918741 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v65) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6a2c018020 con 0x7f6a38155e80 2022-01-10T01:29:26.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.751+0000 7f6a3db3b700 1 -- 172.21.15.36:0/2403918741 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a18053560 msgr2=0x7f6a18055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:26.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.751+0000 7f6a3db3b700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a18053560 0x7f6a18055a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f6a2801a000 tx=0x7f6a28016000).stop 2022-01-10T01:29:26.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.751+0000 7f6a3db3b700 1 -- 172.21.15.36:0/2403918741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a38155e80 msgr2=0x7f6a381562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:26.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.751+0000 7f6a3db3b700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a38155e80 0x7f6a381562e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f6a2c00b000 tx=0x7f6a2c006df0).stop 2022-01-10T01:29:26.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.751+0000 7f6a3db3b700 1 -- 172.21.15.36:0/2403918741 shutdown_connections 2022-01-10T01:29:26.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.751+0000 7f6a3db3b700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a18053560 0x7f6a18055a20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:26.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.751+0000 7f6a3db3b700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a381528b0 0x7f6a38152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:26.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.751+0000 7f6a3db3b700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a38155e80 0x7f6a381562e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:26.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.751+0000 7f6a3db3b700 1 --2- 172.21.15.36:0/2403918741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a240038e0 0x7f6a3813f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:26.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.751+0000 7f6a3db3b700 1 -- 172.21.15.36:0/2403918741 >> 172.21.15.36:0/2403918741 conn(0x7f6a38061140 msgr2=0x7f6a3813c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:26.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.755+0000 7f6a3db3b700 1 -- 172.21.15.36:0/2403918741 shutdown_connections 2022-01-10T01:29:26.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.755+0000 7f6a3db3b700 1 -- 172.21.15.36:0/2403918741 wait complete. 2022-01-10T01:29:26.757 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' created 2022-01-10T01:29:26.766 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-10T01:29:26.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfdb1ef700 1 Processor -- start 2022-01-10T01:29:26.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfdb1ef700 1 -- start start 2022-01-10T01:29:26.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfdb1ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfd40ad5c0 0x7fbfd4061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:26.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfdb1ef700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd40aecf0 con 0x7fbfd4061320 2022-01-10T01:29:26.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfdb1ef700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd40b6f20 con 0x7fbfd4140440 2022-01-10T01:29:26.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfdb1ef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40aef20 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfda1ed700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fbfd4061320 0x7fbfd40b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35002/0 (socket says 172.21.15.36:35002) 2022-01-10T01:29:26.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfda1ed700 1 -- 172.21.15.36:0/2437428549 learned_addr learned my addr 172.21.15.36:0/2437428549 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:26.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfd99ec700 1 --2- 172.21.15.36:0/2437428549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfd40ad5c0 0x7fbfd4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:26.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfd91eb700 1 -- 172.21.15.36:0/2437428549 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281797721 0 0) 0x7fbfd40aecf0 con 0x7fbfd4061320 2022-01-10T01:29:26.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfd91eb700 1 -- 172.21.15.36:0/2437428549 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfbc003260 con 0x7fbfd4061320 2022-01-10T01:29:26.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfd91eb700 1 -- 172.21.15.36:0/2437428549 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765655621 0 0) 0x7fbfd40b6f20 con 0x7fbfd4140440 2022-01-10T01:29:26.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfd91eb700 1 -- 172.21.15.36:0/2437428549 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfd40aecf0 con 0x7fbfd4140440 2022-01-10T01:29:26.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfd99ec700 1 -- 172.21.15.36:0/2437428549 >> v1:172.21.15.59:6789/0 conn(0x7fbfd4140440 legacy=0x7fbfd4146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:26.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfd99ec700 1 -- 172.21.15.36:0/2437428549 >> v1:172.21.15.36:6789/0 conn(0x7fbfd4061320 legacy=0x7fbfd40b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:26.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfd99ec700 1 -- 172.21.15.36:0/2437428549 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd40af1c0 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfd99ec700 1 --2- 172.21.15.36:0/2437428549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfd40ad5c0 0x7fbfd4061700 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbfc4002f70 tx=0x7fbfc4006df0).ready entity=mon.2 client_cookie=8802e44b4baab5bc server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:26.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfd91eb700 1 -- 172.21.15.36:0/2437428549 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfc400d5c0 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfd91eb700 1 -- 172.21.15.36:0/2437428549 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc4000e90 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.871+0000 7fbfd91eb700 1 -- 172.21.15.36:0/2437428549 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfc400d910 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.875+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/2437428549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfd40ad5c0 msgr2=0x7fbfd4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:26.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.875+0000 7fbfdb1ef700 1 --2- 172.21.15.36:0/2437428549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfd40ad5c0 0x7fbfd4061700 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbfc4002f70 tx=0x7fbfc4006df0).stop 2022-01-10T01:29:26.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.875+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/2437428549 shutdown_connections 2022-01-10T01:29:26.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.875+0000 7fbfdb1ef700 1 --2- 172.21.15.36:0/2437428549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfd40ad5c0 0x7fbfd4061700 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:26.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.875+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/2437428549 >> 172.21.15.36:0/2437428549 conn(0x7fbfd4066de0 msgr2=0x7fbfd40671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:26.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.875+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/2437428549 shutdown_connections 2022-01-10T01:29:26.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.875+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/2437428549 wait complete. 2022-01-10T01:29:26.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.875+0000 7fbfdb1ef700 1 Processor -- start 2022-01-10T01:29:26.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.875+0000 7fbfdb1ef700 1 -- start start 2022-01-10T01:29:26.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.875+0000 7fbfdb1ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfd4061320 0x7fbfd40b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:26.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.875+0000 7fbfdb1ef700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfd40ad5c0 0x7fbfd40ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:26.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.875+0000 7fbfdb1ef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfd4140440 0x7fbfd40ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:26.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.875+0000 7fbfdb1ef700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4145eb0 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfdb1ef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40b1b00 con 0x7fbfd4140440 2022-01-10T01:29:26.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfdb1ef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40b3e00 con 0x7fbfd4061320 2022-01-10T01:29:26.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfd99ec700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfd40ad5c0 0x7fbfd40ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:26.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfd99ec700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfd40ad5c0 0x7fbfd40ac180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37216/0 (socket says 172.21.15.36:37216) 2022-01-10T01:29:26.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfd99ec700 1 -- 172.21.15.36:0/3351975888 learned_addr learned my addr 172.21.15.36:0/3351975888 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:26.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfda1ed700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfd4061320 0x7fbfd40b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:26.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfda9ee700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfd4140440 0x7fbfd40ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:26.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfd99ec700 1 -- 172.21.15.36:0/3351975888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfd4061320 msgr2=0x7fbfd40b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:26.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfd99ec700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfd4061320 0x7fbfd40b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:26.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfd99ec700 1 -- 172.21.15.36:0/3351975888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfd4140440 msgr2=0x7fbfd40ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:26.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfd99ec700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfd4140440 0x7fbfd40ac670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:26.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfd99ec700 1 -- 172.21.15.36:0/3351975888 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc400b180 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfda1ed700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfd4061320 0x7fbfd40b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:26.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfd99ec700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfd40ad5c0 0x7fbfd40ac180 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fbfc4002f70 tx=0x7fbfc4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:26.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfc37fe700 1 -- 172.21.15.36:0/3351975888 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfc4016070 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfc37fe700 1 -- 172.21.15.36:0/3351975888 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc4013850 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/3351975888 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd40b1120 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfc37fe700 1 -- 172.21.15.36:0/3351975888 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfc4013bb0 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/3351975888 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd40acb60 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/3351975888 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd40af460 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.879+0000 7fbfc37fe700 1 -- 172.21.15.36:0/3351975888 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbfc4025030 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.883+0000 7fbfc37fe700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbfb40534d0 0x7fbfb4055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:26.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.883+0000 7fbfc37fe700 1 -- 172.21.15.36:0/3351975888 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6304+0+0 (secure 0 0 0) 0x7fbfc406c9f0 con 0x7fbfd40ad5c0 2022-01-10T01:29:26.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.883+0000 7fbfda1ed700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbfb40534d0 0x7fbfb4055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:26.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.883+0000 7fbfda1ed700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbfb40534d0 0x7fbfb4055990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fbfd000b000 tx=0x7fbfd0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:26.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:26.887+0000 7fbfc37fe700 1 -- 172.21.15.36:0/3351975888 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbfc406ee60 con 0x7fbfd40ad5c0 2022-01-10T01:29:27.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.055+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/3351975888 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fbfd4057350 con 0x7fbfd40ad5c0 2022-01-10T01:29:27.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.067+0000 7fbfc37fe700 1 -- 172.21.15.36:0/3351975888 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 11 and data pool 12 v28) v1 ==== 189+0+0 (secure 0 0 0) 0x7fbfc40230d0 con 0x7fbfd40ad5c0 2022-01-10T01:29:27.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.067+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/3351975888 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbfb40534d0 msgr2=0x7fbfb4055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.067+0000 7fbfdb1ef700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbfb40534d0 0x7fbfb4055990 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fbfd000b000 tx=0x7fbfd0009040).stop 2022-01-10T01:29:27.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.071+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/3351975888 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfd40ad5c0 msgr2=0x7fbfd40ac180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.071+0000 7fbfdb1ef700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfd40ad5c0 0x7fbfd40ac180 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fbfc4002f70 tx=0x7fbfc4014000).stop 2022-01-10T01:29:27.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.071+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/3351975888 shutdown_connections 2022-01-10T01:29:27.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.071+0000 7fbfdb1ef700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbfb40534d0 0x7fbfb4055990 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.071+0000 7fbfdb1ef700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfd4140440 0x7fbfd40ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.071+0000 7fbfdb1ef700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfd40ad5c0 0x7fbfd40ac180 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.071+0000 7fbfdb1ef700 1 --2- 172.21.15.36:0/3351975888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfd4061320 0x7fbfd40b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.071+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/3351975888 >> 172.21.15.36:0/3351975888 conn(0x7fbfd4066de0 msgr2=0x7fbfd41466f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:27.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.071+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/3351975888 shutdown_connections 2022-01-10T01:29:27.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.071+0000 7fbfdb1ef700 1 -- 172.21.15.36:0/3351975888 wait complete. 2022-01-10T01:29:27.075 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 11 and data pool 12 2022-01-10T01:29:27.087 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:29:27.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff866c12700 1 Processor -- start 2022-01-10T01:29:27.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff866c12700 1 -- start start 2022-01-10T01:29:27.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff866c12700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8600b2580 0x7ff86014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff866c12700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff8600a8ac0 0x7ff86014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff866c12700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8600a70c0 con 0x7ff8600b0010 2022-01-10T01:29:27.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff866c12700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8600a72f0 con 0x7ff8600a8ac0 2022-01-10T01:29:27.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff866c12700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8600a7590 con 0x7ff8600b2580 2022-01-10T01:29:27.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff866411700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff8600a8ac0 0x7ff86014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff86540f700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff8600b0010 0x7ff8600a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35016/0 (socket says 172.21.15.36:35016) 2022-01-10T01:29:27.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff86540f700 1 -- 172.21.15.36:0/4147453303 learned_addr learned my addr 172.21.15.36:0/4147453303 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:27.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff865c10700 1 --2- 172.21.15.36:0/4147453303 >> v2:172.21.15.59:3300/0 conn(0x7ff8600b2580 0x7ff86014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff866411700 1 -- 172.21.15.36:0/4147453303 >> v2:172.21.15.59:3300/0 conn(0x7ff8600b2580 msgr2=0x7ff86014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:27.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff866411700 1 --2- 172.21.15.36:0/4147453303 >> v2:172.21.15.59:3300/0 conn(0x7ff8600b2580 0x7ff86014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff866411700 1 -- 172.21.15.36:0/4147453303 >> v1:172.21.15.36:6789/0 conn(0x7ff8600b0010 legacy=0x7ff8600a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff866411700 1 -- 172.21.15.36:0/4147453303 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8600a7830 con 0x7ff8600a8ac0 2022-01-10T01:29:27.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff864c0e700 1 -- 172.21.15.36:0/4147453303 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632825138 0 0) 0x7ff8600a70c0 con 0x7ff8600b0010 2022-01-10T01:29:27.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff866411700 1 --2- 172.21.15.36:0/4147453303 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8600a8ac0 0x7ff86014b330 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7ff8580032f0 tx=0x7ff8580091d0).ready entity=mon.0 client_cookie=c7559b0e6d1a9aa6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:27.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff864c0e700 1 -- 172.21.15.36:0/4147453303 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff858009ea0 con 0x7ff8600a8ac0 2022-01-10T01:29:27.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff864c0e700 1 -- 172.21.15.36:0/4147453303 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85800b870 con 0x7ff8600a8ac0 2022-01-10T01:29:27.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.175+0000 7ff864c0e700 1 -- 172.21.15.36:0/4147453303 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff85800b9e0 con 0x7ff8600a8ac0 2022-01-10T01:29:27.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 -- 172.21.15.36:0/4147453303 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8600a8ac0 msgr2=0x7ff86014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 --2- 172.21.15.36:0/4147453303 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8600a8ac0 0x7ff86014b330 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7ff8580032f0 tx=0x7ff8580091d0).stop 2022-01-10T01:29:27.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 -- 172.21.15.36:0/4147453303 shutdown_connections 2022-01-10T01:29:27.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 --2- 172.21.15.36:0/4147453303 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8600a8ac0 0x7ff86014b330 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 --2- 172.21.15.36:0/4147453303 >> v2:172.21.15.59:3300/0 conn(0x7ff8600b2580 0x7ff86014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 -- 172.21.15.36:0/4147453303 >> 172.21.15.36:0/4147453303 conn(0x7ff860060180 msgr2=0x7ff8600b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:27.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 -- 172.21.15.36:0/4147453303 shutdown_connections 2022-01-10T01:29:27.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 -- 172.21.15.36:0/4147453303 wait complete. 2022-01-10T01:29:27.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 Processor -- start 2022-01-10T01:29:27.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 -- start start 2022-01-10T01:29:27.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8600a8ac0 0x7ff8600ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8600b0010 0x7ff8600b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8600b2580 0x7ff8600aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600abe20 con 0x7ff8600b2580 2022-01-10T01:29:27.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff860157070 con 0x7ff8600a8ac0 2022-01-10T01:29:27.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866c12700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600ac050 con 0x7ff8600b0010 2022-01-10T01:29:27.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866411700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8600b2580 0x7ff8600aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866411700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8600b2580 0x7ff8600aa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37232/0 (socket says 172.21.15.36:37232) 2022-01-10T01:29:27.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866411700 1 -- 172.21.15.36:0/2651940236 learned_addr learned my addr 172.21.15.36:0/2651940236 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:27.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff865c10700 1 --2- 172.21.15.36:0/2651940236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8600a8ac0 0x7ff8600ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff86540f700 1 --2- 172.21.15.36:0/2651940236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8600b0010 0x7ff8600b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866411700 1 -- 172.21.15.36:0/2651940236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8600b0010 msgr2=0x7ff8600b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866411700 1 --2- 172.21.15.36:0/2651940236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8600b0010 0x7ff8600b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866411700 1 -- 172.21.15.36:0/2651940236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8600a8ac0 msgr2=0x7ff8600ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866411700 1 --2- 172.21.15.36:0/2651940236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8600a8ac0 0x7ff8600ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866411700 1 -- 172.21.15.36:0/2651940236 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff858009470 con 0x7ff8600b2580 2022-01-10T01:29:27.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.179+0000 7ff866411700 1 --2- 172.21.15.36:0/2651940236 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8600b2580 0x7ff8600aa5c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7ff8580032f0 tx=0x7ff858016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:27.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.183+0000 7ff84effd700 1 -- 172.21.15.36:0/2651940236 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff858009ea0 con 0x7ff8600b2580 2022-01-10T01:29:27.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.183+0000 7ff84effd700 1 -- 172.21.15.36:0/2651940236 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85800b9e0 con 0x7ff8600b2580 2022-01-10T01:29:27.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.183+0000 7ff84effd700 1 -- 172.21.15.36:0/2651940236 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff85801f5e0 con 0x7ff8600b2580 2022-01-10T01:29:27.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.183+0000 7ff866c12700 1 -- 172.21.15.36:0/2651940236 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8600ac2f0 con 0x7ff8600b2580 2022-01-10T01:29:27.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.183+0000 7ff866c12700 1 -- 172.21.15.36:0/2651940236 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8600aaab0 con 0x7ff8600b2580 2022-01-10T01:29:27.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.183+0000 7ff84effd700 1 -- 172.21.15.36:0/2651940236 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff858026030 con 0x7ff8600b2580 2022-01-10T01:29:27.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.183+0000 7ff866c12700 1 -- 172.21.15.36:0/2651940236 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff860057350 con 0x7ff8600b2580 2022-01-10T01:29:27.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.183+0000 7ff84effd700 1 --2- 172.21.15.36:0/2651940236 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff840053620 0x7ff840055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.183+0000 7ff84effd700 1 -- 172.21.15.36:0/2651940236 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff85806c540 con 0x7ff8600b2580 2022-01-10T01:29:27.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.183+0000 7ff865c10700 1 --2- 172.21.15.36:0/2651940236 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff840053620 0x7ff840055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.187+0000 7ff865c10700 1 --2- 172.21.15.36:0/2651940236 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff840053620 0x7ff840055ae0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7ff85000c000 tx=0x7ff850008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:27.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.191+0000 7ff84effd700 1 -- 172.21.15.36:0/2651940236 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff8580434b0 con 0x7ff8600b2580 2022-01-10T01:29:27.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.315+0000 7ff866c12700 1 -- 172.21.15.36:0/2651940236 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8600698e0 con 0x7ff8600b2580 2022-01-10T01:29:27.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.319+0000 7ff84effd700 1 -- 172.21.15.36:0/2651940236 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16287 (secure 0 0 0) 0x7ff858015090 con 0x7ff8600b2580 2022-01-10T01:29:27.320 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:27.320 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":66,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:29:27.059809+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:29:25.099175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2022-01-10T01:29:26.058962+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:29:27.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.319+0000 7ff866c12700 1 -- 172.21.15.36:0/2651940236 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff840053620 msgr2=0x7ff840055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.319+0000 7ff866c12700 1 --2- 172.21.15.36:0/2651940236 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff840053620 0x7ff840055ae0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7ff85000c000 tx=0x7ff850008040).stop 2022-01-10T01:29:27.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.319+0000 7ff866c12700 1 -- 172.21.15.36:0/2651940236 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8600b2580 msgr2=0x7ff8600aa5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.319+0000 7ff866c12700 1 --2- 172.21.15.36:0/2651940236 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8600b2580 0x7ff8600aa5c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7ff8580032f0 tx=0x7ff858016000).stop 2022-01-10T01:29:27.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.319+0000 7ff866c12700 1 -- 172.21.15.36:0/2651940236 shutdown_connections 2022-01-10T01:29:27.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.319+0000 7ff866c12700 1 --2- 172.21.15.36:0/2651940236 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff840053620 0x7ff840055ae0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.319+0000 7ff866c12700 1 --2- 172.21.15.36:0/2651940236 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff8600b2580 0x7ff8600aa5c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.319+0000 7ff866c12700 1 --2- 172.21.15.36:0/2651940236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8600b0010 0x7ff8600b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.319+0000 7ff866c12700 1 --2- 172.21.15.36:0/2651940236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8600a8ac0 0x7ff8600ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.319+0000 7ff866c12700 1 -- 172.21.15.36:0/2651940236 >> 172.21.15.36:0/2651940236 conn(0x7ff860060180 msgr2=0x7ff8601486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:27.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.319+0000 7ff866c12700 1 -- 172.21.15.36:0/2651940236 shutdown_connections 2022-01-10T01:29:27.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.319+0000 7ff866c12700 1 -- 172.21.15.36:0/2651940236 wait complete. 2022-01-10T01:29:27.333 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:29:27.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.435+0000 7f82cffff700 1 Processor -- start 2022-01-10T01:29:27.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.435+0000 7f82cffff700 1 -- start start 2022-01-10T01:29:27.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.435+0000 7f82cffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82d00b1d10 0x7f82d0147470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.435+0000 7f82cffff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d014b8e0 con 0x7f82d005c490 2022-01-10T01:29:27.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.435+0000 7f82cffff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d00b2b80 con 0x7f82d00b27a0 2022-01-10T01:29:27.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.435+0000 7f82cffff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d01451b0 con 0x7f82d00b1d10 2022-01-10T01:29:27.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.435+0000 7f82cf7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f82d005c490 0x7f82d00a8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35034/0 (socket says 172.21.15.36:35034) 2022-01-10T01:29:27.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.435+0000 7f82cf7fe700 1 -- 172.21.15.36:0/492102721 learned_addr learned my addr 172.21.15.36:0/492102721 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:27.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.435+0000 7f82ce7fc700 1 --2- 172.21.15.36:0/492102721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82d00b1d10 0x7f82d0147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cdffb700 1 -- 172.21.15.36:0/492102721 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103628593 0 0) 0x7f82d014b8e0 con 0x7f82d005c490 2022-01-10T01:29:27.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cdffb700 1 -- 172.21.15.36:0/492102721 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b4003260 con 0x7f82d005c490 2022-01-10T01:29:27.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cdffb700 1 -- 172.21.15.36:0/492102721 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574964002 0 0) 0x7f82d00b2b80 con 0x7f82d00b27a0 2022-01-10T01:29:27.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cdffb700 1 -- 172.21.15.36:0/492102721 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82d014b8e0 con 0x7f82d00b27a0 2022-01-10T01:29:27.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cdffb700 1 -- 172.21.15.36:0/492102721 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 712317698 0 0) 0x7f82b4003260 con 0x7f82d005c490 2022-01-10T01:29:27.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82ce7fc700 1 -- 172.21.15.36:0/492102721 >> v1:172.21.15.59:6789/0 conn(0x7f82d00b27a0 legacy=0x7f82d014b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82ce7fc700 1 -- 172.21.15.36:0/492102721 >> v1:172.21.15.36:6789/0 conn(0x7f82d005c490 legacy=0x7f82d00a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82ce7fc700 1 -- 172.21.15.36:0/492102721 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d014aad0 con 0x7f82d00b1d10 2022-01-10T01:29:27.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82ce7fc700 1 --2- 172.21.15.36:0/492102721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82d00b1d10 0x7f82d0147470 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f82c8001490 tx=0x7f82b8006df0).ready entity=mon.2 client_cookie=b45ad0e29b270f29 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:27.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cdffb700 1 -- 172.21.15.36:0/492102721 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82c80019e0 con 0x7f82d00b1d10 2022-01-10T01:29:27.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cdffb700 1 -- 172.21.15.36:0/492102721 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b8000e90 con 0x7f82d00b1d10 2022-01-10T01:29:27.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cdffb700 1 -- 172.21.15.36:0/492102721 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82b8012460 con 0x7f82d00b1d10 2022-01-10T01:29:27.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cffff700 1 -- 172.21.15.36:0/492102721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82d00b1d10 msgr2=0x7f82d0147470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cffff700 1 --2- 172.21.15.36:0/492102721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82d00b1d10 0x7f82d0147470 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f82c8001490 tx=0x7f82b8006df0).stop 2022-01-10T01:29:27.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cffff700 1 -- 172.21.15.36:0/492102721 shutdown_connections 2022-01-10T01:29:27.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cffff700 1 --2- 172.21.15.36:0/492102721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82d00b1d10 0x7f82d0147470 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cffff700 1 -- 172.21.15.36:0/492102721 >> 172.21.15.36:0/492102721 conn(0x7f82d0061140 msgr2=0x7f82d0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:27.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cffff700 1 -- 172.21.15.36:0/492102721 shutdown_connections 2022-01-10T01:29:27.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cffff700 1 -- 172.21.15.36:0/492102721 wait complete. 2022-01-10T01:29:27.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cffff700 1 Processor -- start 2022-01-10T01:29:27.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.439+0000 7f82cffff700 1 -- start start 2022-01-10T01:29:27.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d005c490 0x7f82d00aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82d00b1d10 0x7f82d01424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82d00b27a0 0x7f82d01429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cffff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d0142e90 con 0x7f82d00b27a0 2022-01-10T01:29:27.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cffff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00a9870 con 0x7f82d005c490 2022-01-10T01:29:27.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cffff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00a9b10 con 0x7f82d00b1d10 2022-01-10T01:29:27.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cf7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82d00b27a0 0x7f82d01429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cf7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82d00b27a0 0x7f82d01429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37246/0 (socket says 172.21.15.36:37246) 2022-01-10T01:29:27.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cf7fe700 1 -- 172.21.15.36:0/3217369284 learned_addr learned my addr 172.21.15.36:0/3217369284 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:27.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82ce7fc700 1 --2- 172.21.15.36:0/3217369284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82d00b1d10 0x7f82d01424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82ceffd700 1 --2- 172.21.15.36:0/3217369284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d005c490 0x7f82d00aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cf7fe700 1 -- 172.21.15.36:0/3217369284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82d00b1d10 msgr2=0x7f82d01424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cf7fe700 1 --2- 172.21.15.36:0/3217369284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82d00b1d10 0x7f82d01424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cf7fe700 1 -- 172.21.15.36:0/3217369284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d005c490 msgr2=0x7f82d00aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cf7fe700 1 --2- 172.21.15.36:0/3217369284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d005c490 0x7f82d00aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cf7fe700 1 -- 172.21.15.36:0/3217369284 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b800b180 con 0x7f82d00b27a0 2022-01-10T01:29:27.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cf7fe700 1 --2- 172.21.15.36:0/3217369284 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82d00b27a0 0x7f82d01429a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f82c8001bc0 tx=0x7f82c8001a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:27.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82c7fff700 1 -- 172.21.15.36:0/3217369284 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82c8004ab0 con 0x7f82d00b27a0 2022-01-10T01:29:27.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82c7fff700 1 -- 172.21.15.36:0/3217369284 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c8004c10 con 0x7f82d00b27a0 2022-01-10T01:29:27.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cffff700 1 -- 172.21.15.36:0/3217369284 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d00a9db0 con 0x7f82d00b27a0 2022-01-10T01:29:27.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82c7fff700 1 -- 172.21.15.36:0/3217369284 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82c8007170 con 0x7f82d00b27a0 2022-01-10T01:29:27.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.443+0000 7f82cffff700 1 -- 172.21.15.36:0/3217369284 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d00ac310 con 0x7f82d00b27a0 2022-01-10T01:29:27.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.447+0000 7f82cffff700 1 -- 172.21.15.36:0/3217369284 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d0057350 con 0x7f82d00b27a0 2022-01-10T01:29:27.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.447+0000 7f82c7fff700 1 -- 172.21.15.36:0/3217369284 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f82c801b070 con 0x7f82d00b27a0 2022-01-10T01:29:27.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.447+0000 7f82c7fff700 1 --2- 172.21.15.36:0/3217369284 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f82a8053620 0x7f82a8055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.447+0000 7f82c7fff700 1 -- 172.21.15.36:0/3217369284 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f82c806b400 con 0x7f82d00b27a0 2022-01-10T01:29:27.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.447+0000 7f82ceffd700 1 --2- 172.21.15.36:0/3217369284 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f82a8053620 0x7f82a8055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.447+0000 7f82ceffd700 1 --2- 172.21.15.36:0/3217369284 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f82a8053620 0x7f82a8055ae0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f82c000d000 tx=0x7f82c0007a20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:27.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.455+0000 7f82c7fff700 1 -- 172.21.15.36:0/3217369284 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f82c8042370 con 0x7f82d00b27a0 2022-01-10T01:29:27.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.583+0000 7f82cffff700 1 -- 172.21.15.36:0/3217369284 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82d014b660 con 0x7f82d00b27a0 2022-01-10T01:29:27.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.583+0000 7f82c7fff700 1 -- 172.21.15.36:0/3217369284 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f82c8045990 con 0x7f82d00b27a0 2022-01-10T01:29:27.586 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:27.586 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":66,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:29:27.059809+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:29:25.099175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2022-01-10T01:29:26.058962+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:29:27.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.587+0000 7f82cffff700 1 -- 172.21.15.36:0/3217369284 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f82a8053620 msgr2=0x7f82a8055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.587+0000 7f82cffff700 1 --2- 172.21.15.36:0/3217369284 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f82a8053620 0x7f82a8055ae0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f82c000d000 tx=0x7f82c0007a20).stop 2022-01-10T01:29:27.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.587+0000 7f82cffff700 1 -- 172.21.15.36:0/3217369284 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82d00b27a0 msgr2=0x7f82d01429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.587+0000 7f82cffff700 1 --2- 172.21.15.36:0/3217369284 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82d00b27a0 0x7f82d01429a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f82c8001bc0 tx=0x7f82c8001a40).stop 2022-01-10T01:29:27.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.587+0000 7f82cffff700 1 -- 172.21.15.36:0/3217369284 shutdown_connections 2022-01-10T01:29:27.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.587+0000 7f82cffff700 1 --2- 172.21.15.36:0/3217369284 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f82a8053620 0x7f82a8055ae0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.587+0000 7f82cffff700 1 --2- 172.21.15.36:0/3217369284 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82d00b27a0 0x7f82d01429a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.587+0000 7f82cffff700 1 --2- 172.21.15.36:0/3217369284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82d00b1d10 0x7f82d01424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.587+0000 7f82cffff700 1 --2- 172.21.15.36:0/3217369284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d005c490 0x7f82d00aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.587+0000 7f82cffff700 1 -- 172.21.15.36:0/3217369284 >> 172.21.15.36:0/3217369284 conn(0x7f82d0061140 msgr2=0x7f82d00b5230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:27.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.587+0000 7f82cffff700 1 -- 172.21.15.36:0/3217369284 shutdown_connections 2022-01-10T01:29:27.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.587+0000 7f82cffff700 1 -- 172.21.15.36:0/3217369284 wait complete. 2022-01-10T01:29:27.599 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-01-10T01:29:27.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5af38b7700 1 Processor -- start 2022-01-10T01:29:27.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5af38b7700 1 -- start start 2022-01-10T01:29:27.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5af38b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5aec0a9c10 0x7f5aec0b0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5af38b7700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aec143920 con 0x7f5aec0b3710 2022-01-10T01:29:27.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5af38b7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aec143bc0 con 0x7f5aec0b05b0 2022-01-10T01:29:27.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5af38b7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec143e60 con 0x7f5aec0a9c10 2022-01-10T01:29:27.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5af0e52700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f5aec0b3710 0x7f5aec0b10b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35046/0 (socket says 172.21.15.36:35046) 2022-01-10T01:29:27.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5af0e52700 1 -- 172.21.15.36:0/3186106185 learned_addr learned my addr 172.21.15.36:0/3186106185 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:27.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5af1e54700 1 --2- 172.21.15.36:0/3186106185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5aec0a9c10 0x7f5aec0b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5ae3fff700 1 -- 172.21.15.36:0/3186106185 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818996556 0 0) 0x7f5aec143920 con 0x7f5aec0b3710 2022-01-10T01:29:27.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5ae3fff700 1 -- 172.21.15.36:0/3186106185 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ad0003260 con 0x7f5aec0b3710 2022-01-10T01:29:27.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5ae3fff700 1 -- 172.21.15.36:0/3186106185 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924399404 0 0) 0x7f5aec143bc0 con 0x7f5aec0b05b0 2022-01-10T01:29:27.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5ae3fff700 1 -- 172.21.15.36:0/3186106185 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5aec143920 con 0x7f5aec0b05b0 2022-01-10T01:29:27.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5af1e54700 1 -- 172.21.15.36:0/3186106185 >> v1:172.21.15.59:6789/0 conn(0x7f5aec0b05b0 legacy=0x7f5aec13d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5af1e54700 1 -- 172.21.15.36:0/3186106185 >> v1:172.21.15.36:6789/0 conn(0x7f5aec0b3710 legacy=0x7f5aec0b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5af1e54700 1 -- 172.21.15.36:0/3186106185 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec144100 con 0x7f5aec0a9c10 2022-01-10T01:29:27.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5af1e54700 1 --2- 172.21.15.36:0/3186106185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5aec0a9c10 0x7f5aec0b0990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f5ae40032f0 tx=0x7f5ae40091d0).ready entity=mon.2 client_cookie=ca918e0f89c85f41 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:27.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5ae3fff700 1 -- 172.21.15.36:0/3186106185 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ae400b640 con 0x7f5aec0a9c10 2022-01-10T01:29:27.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5ae3fff700 1 -- 172.21.15.36:0/3186106185 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae400b7a0 con 0x7f5aec0a9c10 2022-01-10T01:29:27.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.711+0000 7f5ae3fff700 1 -- 172.21.15.36:0/3186106185 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ae400b910 con 0x7f5aec0a9c10 2022-01-10T01:29:27.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.715+0000 7f5af38b7700 1 -- 172.21.15.36:0/3186106185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5aec0a9c10 msgr2=0x7f5aec0b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.715+0000 7f5af38b7700 1 --2- 172.21.15.36:0/3186106185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5aec0a9c10 0x7f5aec0b0990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f5ae40032f0 tx=0x7f5ae40091d0).stop 2022-01-10T01:29:27.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.715+0000 7f5af38b7700 1 -- 172.21.15.36:0/3186106185 shutdown_connections 2022-01-10T01:29:27.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.715+0000 7f5af38b7700 1 --2- 172.21.15.36:0/3186106185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5aec0a9c10 0x7f5aec0b0990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.715+0000 7f5af38b7700 1 -- 172.21.15.36:0/3186106185 >> 172.21.15.36:0/3186106185 conn(0x7f5aec0607c0 msgr2=0x7f5aec060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:27.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.715+0000 7f5af38b7700 1 -- 172.21.15.36:0/3186106185 shutdown_connections 2022-01-10T01:29:27.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.715+0000 7f5af38b7700 1 -- 172.21.15.36:0/3186106185 wait complete. 2022-01-10T01:29:27.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.715+0000 7f5af38b7700 1 Processor -- start 2022-01-10T01:29:27.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.715+0000 7f5af38b7700 1 -- start start 2022-01-10T01:29:27.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.715+0000 7f5af38b7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5aec0a9c10 0x7f5aec13fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af38b7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5aec0b05b0 0x7f5aec05f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af38b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5aec0b3710 0x7f5aec150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af38b7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec066090 con 0x7f5aec0a9c10 2022-01-10T01:29:27.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af38b7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec066330 con 0x7f5aec0b05b0 2022-01-10T01:29:27.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af38b7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec1503e0 con 0x7f5aec0b3710 2022-01-10T01:29:27.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af1653700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5aec0a9c10 0x7f5aec13fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af1653700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5aec0a9c10 0x7f5aec13fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37258/0 (socket says 172.21.15.36:37258) 2022-01-10T01:29:27.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af1653700 1 -- 172.21.15.36:0/2427587059 learned_addr learned my addr 172.21.15.36:0/2427587059 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:27.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af0e52700 1 --2- 172.21.15.36:0/2427587059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5aec0b05b0 0x7f5aec05f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af1e54700 1 --2- 172.21.15.36:0/2427587059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5aec0b3710 0x7f5aec150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af1653700 1 -- 172.21.15.36:0/2427587059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5aec0b3710 msgr2=0x7f5aec150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af1653700 1 --2- 172.21.15.36:0/2427587059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5aec0b3710 0x7f5aec150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af1653700 1 -- 172.21.15.36:0/2427587059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5aec0b05b0 msgr2=0x7f5aec05f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:27.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af1653700 1 --2- 172.21.15.36:0/2427587059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5aec0b05b0 0x7f5aec05f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:27.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af1653700 1 -- 172.21.15.36:0/2427587059 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae4009470 con 0x7f5aec0a9c10 2022-01-10T01:29:27.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af1653700 1 --2- 172.21.15.36:0/2427587059 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5aec0a9c10 0x7f5aec13fbc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f5ae8001110 tx=0x7f5ae8007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:27.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5ae27fc700 1 -- 172.21.15.36:0/2427587059 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ae800ce30 con 0x7f5aec0a9c10 2022-01-10T01:29:27.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5ae27fc700 1 -- 172.21.15.36:0/2427587059 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae800f470 con 0x7f5aec0a9c10 2022-01-10T01:29:27.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af38b7700 1 -- 172.21.15.36:0/2427587059 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aec150680 con 0x7f5aec0a9c10 2022-01-10T01:29:27.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5ae27fc700 1 -- 172.21.15.36:0/2427587059 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ae800f7d0 con 0x7f5aec0a9c10 2022-01-10T01:29:27.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af38b7700 1 -- 172.21.15.36:0/2427587059 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aec065ae0 con 0x7f5aec0a9c10 2022-01-10T01:29:27.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5af38b7700 1 -- 172.21.15.36:0/2427587059 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aec13dc60 con 0x7f5aec0a9c10 2022-01-10T01:29:27.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.719+0000 7f5ae27fc700 1 -- 172.21.15.36:0/2427587059 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5ae8019030 con 0x7f5aec0a9c10 2022-01-10T01:29:27.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.723+0000 7f5ae27fc700 1 --2- 172.21.15.36:0/2427587059 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ad40534d0 0x7f5ad4055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:27.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.723+0000 7f5ae27fc700 1 -- 172.21.15.36:0/2427587059 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5ae806af50 con 0x7f5aec0a9c10 2022-01-10T01:29:27.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.723+0000 7f5af0e52700 1 --2- 172.21.15.36:0/2427587059 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ad40534d0 0x7f5ad4055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:27.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.723+0000 7f5af0e52700 1 --2- 172.21.15.36:0/2427587059 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ad40534d0 0x7f5ad4055990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f5adc00b000 tx=0x7f5adc009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:27.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.727+0000 7f5ae27fc700 1 -- 172.21.15.36:0/2427587059 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ae8041f60 con 0x7f5aec0a9c10 2022-01-10T01:29:27.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:27.891+0000 7f5af38b7700 1 -- 172.21.15.36:0/2427587059 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5aec057350 con 0x7f5aec0a9c10 2022-01-10T01:29:28.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.067+0000 7f5ae27fc700 1 -- 172.21.15.36:0/2427587059 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5ae8045580 con 0x7f5aec0a9c10 2022-01-10T01:29:28.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.071+0000 7f5af38b7700 1 -- 172.21.15.36:0/2427587059 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ad40534d0 msgr2=0x7f5ad4055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.071+0000 7f5af38b7700 1 --2- 172.21.15.36:0/2427587059 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ad40534d0 0x7f5ad4055990 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f5adc00b000 tx=0x7f5adc009040).stop 2022-01-10T01:29:28.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.071+0000 7f5af38b7700 1 -- 172.21.15.36:0/2427587059 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5aec0a9c10 msgr2=0x7f5aec13fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.071+0000 7f5af38b7700 1 --2- 172.21.15.36:0/2427587059 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5aec0a9c10 0x7f5aec13fbc0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f5ae8001110 tx=0x7f5ae8007a90).stop 2022-01-10T01:29:28.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.071+0000 7f5af38b7700 1 -- 172.21.15.36:0/2427587059 shutdown_connections 2022-01-10T01:29:28.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.071+0000 7f5af38b7700 1 --2- 172.21.15.36:0/2427587059 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ad40534d0 0x7f5ad4055990 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.071+0000 7f5af38b7700 1 --2- 172.21.15.36:0/2427587059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5aec0b3710 0x7f5aec150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.071+0000 7f5af38b7700 1 --2- 172.21.15.36:0/2427587059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5aec0b05b0 0x7f5aec05f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.071+0000 7f5af38b7700 1 --2- 172.21.15.36:0/2427587059 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5aec0a9c10 0x7f5aec13fbc0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.071+0000 7f5af38b7700 1 -- 172.21.15.36:0/2427587059 >> 172.21.15.36:0/2427587059 conn(0x7f5aec0607c0 msgr2=0x7f5aec0ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:28.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.071+0000 7f5af38b7700 1 -- 172.21.15.36:0/2427587059 shutdown_connections 2022-01-10T01:29:28.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.071+0000 7f5af38b7700 1 -- 172.21.15.36:0/2427587059 wait complete. 2022-01-10T01:29:28.089 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:29:28.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228f59e700 1 Processor -- start 2022-01-10T01:29:28.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228f59e700 1 -- start start 2022-01-10T01:29:28.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228f59e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f229014b7c0 0x7f229014dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228f59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22900b5f50 con 0x7f22900b6290 2022-01-10T01:29:28.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228f59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22900b1f70 con 0x7f22900b4060 2022-01-10T01:29:28.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228f59e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22900b2210 con 0x7f229014b7c0 2022-01-10T01:29:28.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228ed9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f229014b7c0 0x7f229014dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228ed9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f229014b7c0 0x7f229014dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37268/0 (socket says 172.21.15.36:37268) 2022-01-10T01:29:28.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228ed9d700 1 -- 172.21.15.36:0/2877240713 learned_addr learned my addr 172.21.15.36:0/2877240713 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:28.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228e59c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f22900b6290 0x7f2290061470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35060/0 (socket says 172.21.15.36:35060) 2022-01-10T01:29:28.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228ed9d700 1 -- 172.21.15.36:0/2877240713 >> v1:172.21.15.59:6789/0 conn(0x7f22900b4060 legacy=0x7f2290061b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228ed9d700 1 -- 172.21.15.36:0/2877240713 >> v1:172.21.15.36:6789/0 conn(0x7f22900b6290 legacy=0x7f2290061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228ed9d700 1 -- 172.21.15.36:0/2877240713 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22900b24b0 con 0x7f229014b7c0 2022-01-10T01:29:28.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228ed9d700 1 --2- 172.21.15.36:0/2877240713 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f229014b7c0 0x7f229014dbb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f2288002f70 tx=0x7f2288006eb0).ready entity=mon.0 client_cookie=a4f0f1f0f976f90b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:28.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228d59a700 1 -- 172.21.15.36:0/2877240713 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f228800d660 con 0x7f229014b7c0 2022-01-10T01:29:28.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228d59a700 1 -- 172.21.15.36:0/2877240713 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2288000e90 con 0x7f229014b7c0 2022-01-10T01:29:28.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.195+0000 7f228d59a700 1 -- 172.21.15.36:0/2877240713 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f228800d9f0 con 0x7f229014b7c0 2022-01-10T01:29:28.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 -- 172.21.15.36:0/2877240713 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f229014b7c0 msgr2=0x7f229014dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 --2- 172.21.15.36:0/2877240713 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f229014b7c0 0x7f229014dbb0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f2288002f70 tx=0x7f2288006eb0).stop 2022-01-10T01:29:28.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 -- 172.21.15.36:0/2877240713 shutdown_connections 2022-01-10T01:29:28.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 --2- 172.21.15.36:0/2877240713 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f229014b7c0 0x7f229014dbb0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 -- 172.21.15.36:0/2877240713 >> 172.21.15.36:0/2877240713 conn(0x7f229005c490 msgr2=0x7f229005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:28.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 -- 172.21.15.36:0/2877240713 shutdown_connections 2022-01-10T01:29:28.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 -- 172.21.15.36:0/2877240713 wait complete. 2022-01-10T01:29:28.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 Processor -- start 2022-01-10T01:29:28.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 -- start start 2022-01-10T01:29:28.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22900b4060 0x7f2290148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22900b6290 0x7f22901493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f229014b7c0 0x7f2290127920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22900afd20 con 0x7f22900b4060 2022-01-10T01:29:28.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22901461a0 con 0x7f22900b6290 2022-01-10T01:29:28.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2290147ac0 con 0x7f229014b7c0 2022-01-10T01:29:28.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22900b4060 0x7f2290148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22900b4060 0x7f2290148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37272/0 (socket says 172.21.15.36:37272) 2022-01-10T01:29:28.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228e59c700 1 -- 172.21.15.36:0/1909858095 learned_addr learned my addr 172.21.15.36:0/1909858095 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:28.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228dd9b700 1 --2- 172.21.15.36:0/1909858095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22900b6290 0x7f22901493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228ed9d700 1 --2- 172.21.15.36:0/1909858095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f229014b7c0 0x7f2290127920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228e59c700 1 -- 172.21.15.36:0/1909858095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f229014b7c0 msgr2=0x7f2290127920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228e59c700 1 --2- 172.21.15.36:0/1909858095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f229014b7c0 0x7f2290127920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228e59c700 1 -- 172.21.15.36:0/1909858095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22900b6290 msgr2=0x7f22901493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228e59c700 1 --2- 172.21.15.36:0/1909858095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22900b6290 0x7f22901493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.199+0000 7f228e59c700 1 -- 172.21.15.36:0/1909858095 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228800b1e0 con 0x7f22900b4060 2022-01-10T01:29:28.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.203+0000 7f228e59c700 1 --2- 172.21.15.36:0/1909858095 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22900b4060 0x7f2290148ed0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f22901284f0 tx=0x7f22800014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:28.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.203+0000 7f22877fe700 1 -- 172.21.15.36:0/1909858095 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2280005ae0 con 0x7f22900b4060 2022-01-10T01:29:28.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.203+0000 7f228f59e700 1 -- 172.21.15.36:0/1909858095 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2290147cf0 con 0x7f22900b4060 2022-01-10T01:29:28.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.203+0000 7f22877fe700 1 -- 172.21.15.36:0/1909858095 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2280005c40 con 0x7f22900b4060 2022-01-10T01:29:28.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.203+0000 7f228f59e700 1 -- 172.21.15.36:0/1909858095 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22900aff00 con 0x7f22900b4060 2022-01-10T01:29:28.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.203+0000 7f22877fe700 1 -- 172.21.15.36:0/1909858095 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2280005db0 con 0x7f22900b4060 2022-01-10T01:29:28.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.203+0000 7f228f59e700 1 -- 172.21.15.36:0/1909858095 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22900b2750 con 0x7f22900b4060 2022-01-10T01:29:28.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.203+0000 7f22877fe700 1 -- 172.21.15.36:0/1909858095 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2280010070 con 0x7f22900b4060 2022-01-10T01:29:28.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.203+0000 7f22877fe700 1 --2- 172.21.15.36:0/1909858095 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f22740535f0 0x7f2274055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.203+0000 7f22877fe700 1 -- 172.21.15.36:0/1909858095 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f228006b0e0 con 0x7f22900b4060 2022-01-10T01:29:28.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.203+0000 7f228dd9b700 1 --2- 172.21.15.36:0/1909858095 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f22740535f0 0x7f2274055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.207+0000 7f228dd9b700 1 --2- 172.21.15.36:0/1909858095 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f22740535f0 0x7f2274055ab0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f227800d000 tx=0x7f2278007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:28.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.211+0000 7f22877fe700 1 -- 172.21.15.36:0/1909858095 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2280042050 con 0x7f22900b4060 2022-01-10T01:29:28.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.375+0000 7f228f59e700 1 -- 172.21.15.36:0/1909858095 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22900b5f50 con 0x7f22900b4060 2022-01-10T01:29:28.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.379+0000 7f22877fe700 1 -- 172.21.15.36:0/1909858095 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f22900b5f50 con 0x7f22900b4060 2022-01-10T01:29:28.379 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:28.379 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":29,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6836/1674052345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":1674052345},{"type":"v1","addr":"172.21.15.36:6836","nonce":1674052345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27},{"gid":5919,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/3906479610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":3906479610},{"type":"v1","addr":"172.21.15.36:6837","nonce":3906479610}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:29:27.060192+0000","modified":"2022-01-10T01:29:28.063204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5922},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5922":{"gid":5922,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1356140607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1356140607},{"type":"v1","addr":"172.21.15.59:6833","nonce":1356140607}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2022-01-10T01:29:28.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.379+0000 7f228f59e700 1 -- 172.21.15.36:0/1909858095 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f22740535f0 msgr2=0x7f2274055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.379+0000 7f228f59e700 1 --2- 172.21.15.36:0/1909858095 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f22740535f0 0x7f2274055ab0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f227800d000 tx=0x7f2278007b90).stop 2022-01-10T01:29:28.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.379+0000 7f228f59e700 1 -- 172.21.15.36:0/1909858095 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22900b4060 msgr2=0x7f2290148ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.379+0000 7f228f59e700 1 --2- 172.21.15.36:0/1909858095 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22900b4060 0x7f2290148ed0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f22901284f0 tx=0x7f22800014a0).stop 2022-01-10T01:29:28.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.379+0000 7f228f59e700 1 -- 172.21.15.36:0/1909858095 shutdown_connections 2022-01-10T01:29:28.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.379+0000 7f228f59e700 1 --2- 172.21.15.36:0/1909858095 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f22740535f0 0x7f2274055ab0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.379+0000 7f228f59e700 1 --2- 172.21.15.36:0/1909858095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f229014b7c0 0x7f2290127920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.379+0000 7f228f59e700 1 --2- 172.21.15.36:0/1909858095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22900b6290 0x7f22901493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.379+0000 7f228f59e700 1 --2- 172.21.15.36:0/1909858095 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22900b4060 0x7f2290148ed0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.379+0000 7f228f59e700 1 -- 172.21.15.36:0/1909858095 >> 172.21.15.36:0/1909858095 conn(0x7f229005c490 msgr2=0x7f22901468b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:28.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.379+0000 7f228f59e700 1 -- 172.21.15.36:0/1909858095 shutdown_connections 2022-01-10T01:29:28.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.379+0000 7f228f59e700 1 -- 172.21.15.36:0/1909858095 wait complete. 2022-01-10T01:29:28.385 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 29 2022-01-10T01:29:28.398 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:29:28.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 Processor -- start 2022-01-10T01:29:28.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 -- start start 2022-01-10T01:29:28.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4bf80b30d0 0x7f4bf8143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4bf80ace70 0x7f4bf805c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf8143920 con 0x7f4bf80b0710 2022-01-10T01:29:28.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf80b0af0 con 0x7f4bf80b30d0 2022-01-10T01:29:28.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf80ae680 con 0x7f4bf80ace70 2022-01-10T01:29:28.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf67fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4bf80b30d0 0x7f4bf8143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf67fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4bf80b30d0 0x7f4bf8143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37280/0 (socket says 172.21.15.36:37280) 2022-01-10T01:29:28.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf6ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f4bf80b0710 0x7f4bf8142d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35072/0 (socket says 172.21.15.36:35072) 2022-01-10T01:29:28.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf67fc700 1 -- 172.21.15.36:0/613745675 learned_addr learned my addr 172.21.15.36:0/613745675 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:28.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf77fe700 1 --2- 172.21.15.36:0/613745675 >> v2:172.21.15.59:3300/0 conn(0x7f4bf80ace70 0x7f4bf805c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf67fc700 1 -- 172.21.15.36:0/613745675 >> v2:172.21.15.59:3300/0 conn(0x7f4bf80ace70 msgr2=0x7f4bf805c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:28.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf67fc700 1 --2- 172.21.15.36:0/613745675 >> v2:172.21.15.59:3300/0 conn(0x7f4bf80ace70 0x7f4bf805c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf67fc700 1 -- 172.21.15.36:0/613745675 >> v1:172.21.15.36:6789/0 conn(0x7f4bf80b0710 legacy=0x7f4bf8142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf67fc700 1 -- 172.21.15.36:0/613745675 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80ae920 con 0x7f4bf80b30d0 2022-01-10T01:29:28.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf67fc700 1 --2- 172.21.15.36:0/613745675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bf80b30d0 0x7f4bf8143430 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f4be80032f0 tx=0x7f4be8009290).ready entity=mon.0 client_cookie=6fee6572d8d4e74d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:28.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf5ffb700 1 -- 172.21.15.36:0/613745675 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4be800b870 con 0x7f4bf80b30d0 2022-01-10T01:29:28.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf5ffb700 1 -- 172.21.15.36:0/613745675 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be800b9d0 con 0x7f4bf80b30d0 2022-01-10T01:29:28.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf5ffb700 1 -- 172.21.15.36:0/613745675 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4be800bb40 con 0x7f4bf80b30d0 2022-01-10T01:29:28.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 -- 172.21.15.36:0/613745675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bf80b30d0 msgr2=0x7f4bf8143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 --2- 172.21.15.36:0/613745675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bf80b30d0 0x7f4bf8143430 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f4be80032f0 tx=0x7f4be8009290).stop 2022-01-10T01:29:28.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 -- 172.21.15.36:0/613745675 shutdown_connections 2022-01-10T01:29:28.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 --2- 172.21.15.36:0/613745675 >> v2:172.21.15.59:3300/0 conn(0x7f4bf80ace70 0x7f4bf805c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 --2- 172.21.15.36:0/613745675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bf80b30d0 0x7f4bf8143430 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 -- 172.21.15.36:0/613745675 >> 172.21.15.36:0/613745675 conn(0x7f4bf8061140 msgr2=0x7f4bf8062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:28.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 -- 172.21.15.36:0/613745675 shutdown_connections 2022-01-10T01:29:28.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.503+0000 7f4bf7fff700 1 -- 172.21.15.36:0/613745675 wait complete. 2022-01-10T01:29:28.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.507+0000 7f4bf7fff700 1 Processor -- start 2022-01-10T01:29:28.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.507+0000 7f4bf7fff700 1 -- start start 2022-01-10T01:29:28.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bf80ace70 0x7f4bf8064c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bf80b0710 0x7f4bf8067810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bf80b30d0 0x7f4bf8141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf7fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80ac750 con 0x7f4bf80ace70 2022-01-10T01:29:28.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf7fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80ab830 con 0x7f4bf80b0710 2022-01-10T01:29:28.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf7fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80abad0 con 0x7f4bf80b30d0 2022-01-10T01:29:28.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf6ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bf80ace70 0x7f4bf8064c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf6ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bf80ace70 0x7f4bf8064c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37284/0 (socket says 172.21.15.36:37284) 2022-01-10T01:29:28.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf6ffd700 1 -- 172.21.15.36:0/1511259944 learned_addr learned my addr 172.21.15.36:0/1511259944 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:28.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf67fc700 1 --2- 172.21.15.36:0/1511259944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bf80b0710 0x7f4bf8067810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf77fe700 1 --2- 172.21.15.36:0/1511259944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bf80b30d0 0x7f4bf8141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf6ffd700 1 -- 172.21.15.36:0/1511259944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bf80b30d0 msgr2=0x7f4bf8141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf6ffd700 1 --2- 172.21.15.36:0/1511259944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bf80b30d0 0x7f4bf8141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf6ffd700 1 -- 172.21.15.36:0/1511259944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bf80b0710 msgr2=0x7f4bf8067810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf6ffd700 1 --2- 172.21.15.36:0/1511259944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bf80b0710 0x7f4bf8067810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf6ffd700 1 -- 172.21.15.36:0/1511259944 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be8009530 con 0x7f4bf80ace70 2022-01-10T01:29:28.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf6ffd700 1 --2- 172.21.15.36:0/1511259944 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bf80ace70 0x7f4bf8064c80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f4bf80b6a40 tx=0x7f4be0007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:28.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4beffff700 1 -- 172.21.15.36:0/1511259944 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4be00070d0 con 0x7f4bf80ace70 2022-01-10T01:29:28.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4beffff700 1 -- 172.21.15.36:0/1511259944 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be0007230 con 0x7f4bf80ace70 2022-01-10T01:29:28.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4beffff700 1 -- 172.21.15.36:0/1511259944 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4be0005740 con 0x7f4bf80ace70 2022-01-10T01:29:28.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf7fff700 1 -- 172.21.15.36:0/1511259944 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf80abd70 con 0x7f4bf80ace70 2022-01-10T01:29:28.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf7fff700 1 -- 172.21.15.36:0/1511259944 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf80aabd0 con 0x7f4bf80ace70 2022-01-10T01:29:28.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.511+0000 7f4bf7fff700 1 -- 172.21.15.36:0/1511259944 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf8140da0 con 0x7f4bf80ace70 2022-01-10T01:29:28.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.515+0000 7f4beffff700 1 -- 172.21.15.36:0/1511259944 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4be0010070 con 0x7f4bf80ace70 2022-01-10T01:29:28.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.515+0000 7f4beffff700 1 --2- 172.21.15.36:0/1511259944 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bdc053560 0x7f4bdc055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.515+0000 7f4beffff700 1 -- 172.21.15.36:0/1511259944 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4be006af80 con 0x7f4bf80ace70 2022-01-10T01:29:28.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.515+0000 7f4bf67fc700 1 --2- 172.21.15.36:0/1511259944 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bdc053560 0x7f4bdc055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.515+0000 7f4bf67fc700 1 --2- 172.21.15.36:0/1511259944 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bdc053560 0x7f4bdc055a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f4be801b000 tx=0x7f4be8016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:28.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.523+0000 7f4beffff700 1 -- 172.21.15.36:0/1511259944 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4be0041f90 con 0x7f4bf80ace70 2022-01-10T01:29:28.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.651+0000 7f4bf7fff700 1 -- 172.21.15.36:0/1511259944 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bf8057350 con 0x7f4bf80ace70 2022-01-10T01:29:28.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.651+0000 7f4beffff700 1 -- 172.21.15.36:0/1511259944 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f4be0018030 con 0x7f4bf80ace70 2022-01-10T01:29:28.652 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:28.653 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":67,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:29:28.063908+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:29:25.099175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2022-01-10T01:29:26.058962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:29:28.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.651+0000 7f4bf7fff700 1 -- 172.21.15.36:0/1511259944 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bdc053560 msgr2=0x7f4bdc055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.651+0000 7f4bf7fff700 1 --2- 172.21.15.36:0/1511259944 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bdc053560 0x7f4bdc055a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f4be801b000 tx=0x7f4be8016000).stop 2022-01-10T01:29:28.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.651+0000 7f4bf7fff700 1 -- 172.21.15.36:0/1511259944 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bf80ace70 msgr2=0x7f4bf8064c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.651+0000 7f4bf7fff700 1 --2- 172.21.15.36:0/1511259944 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bf80ace70 0x7f4bf8064c80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f4bf80b6a40 tx=0x7f4be0007c00).stop 2022-01-10T01:29:28.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.651+0000 7f4bf7fff700 1 -- 172.21.15.36:0/1511259944 shutdown_connections 2022-01-10T01:29:28.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.651+0000 7f4bf7fff700 1 --2- 172.21.15.36:0/1511259944 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bdc053560 0x7f4bdc055a20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.651+0000 7f4bf7fff700 1 --2- 172.21.15.36:0/1511259944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bf80b30d0 0x7f4bf8141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.651+0000 7f4bf7fff700 1 --2- 172.21.15.36:0/1511259944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bf80b0710 0x7f4bf8067810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.651+0000 7f4bf7fff700 1 --2- 172.21.15.36:0/1511259944 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4bf80ace70 0x7f4bf8064c80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.651+0000 7f4bf7fff700 1 -- 172.21.15.36:0/1511259944 >> 172.21.15.36:0/1511259944 conn(0x7f4bf8061140 msgr2=0x7f4bf8142080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:28.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.655+0000 7f4bf7fff700 1 -- 172.21.15.36:0/1511259944 shutdown_connections 2022-01-10T01:29:28.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.655+0000 7f4bf7fff700 1 -- 172.21.15.36:0/1511259944 wait complete. 2022-01-10T01:29:28.666 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:29:28.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadbb407700 1 Processor -- start 2022-01-10T01:29:28.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadbb407700 1 -- start start 2022-01-10T01:29:28.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadbb407700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fadb40b6580 0x7fadb40b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadbb407700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fadb40b6960 0x7fadb412ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadbb407700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb41440b0 con 0x7fadb40b43c0 2022-01-10T01:29:28.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadbb407700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb4143b70 con 0x7fadb40b6960 2022-01-10T01:29:28.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadbb407700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb4143e10 con 0x7fadb40b6580 2022-01-10T01:29:28.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadb99a4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fadb40b6960 0x7fadb412ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadb89a2700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fadb40b43c0 0x7fadb4061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35086/0 (socket says 172.21.15.36:35086) 2022-01-10T01:29:28.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadb89a2700 1 -- 172.21.15.36:0/1760191944 learned_addr learned my addr 172.21.15.36:0/1760191944 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:28.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadb91a3700 1 --2- 172.21.15.36:0/1760191944 >> v2:172.21.15.59:3300/0 conn(0x7fadb40b6580 0x7fadb40b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadb99a4700 1 -- 172.21.15.36:0/1760191944 >> v2:172.21.15.59:3300/0 conn(0x7fadb40b6580 msgr2=0x7fadb40b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:28.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadb99a4700 1 --2- 172.21.15.36:0/1760191944 >> v2:172.21.15.59:3300/0 conn(0x7fadb40b6580 0x7fadb40b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadb99a4700 1 -- 172.21.15.36:0/1760191944 >> v1:172.21.15.36:6789/0 conn(0x7fadb40b43c0 legacy=0x7fadb4061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadb99a4700 1 -- 172.21.15.36:0/1760191944 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb40615f0 con 0x7fadb40b6960 2022-01-10T01:29:28.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadb99a4700 1 --2- 172.21.15.36:0/1760191944 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b6960 0x7fadb412ba00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fadb4143120 tx=0x7fadac0091d0).ready entity=mon.0 client_cookie=3cb8168d40c1aefc server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:28.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.775+0000 7fadabfff700 1 -- 172.21.15.36:0/1760191944 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadac00b680 con 0x7fadb40b6960 2022-01-10T01:29:28.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadabfff700 1 -- 172.21.15.36:0/1760191944 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac00b7e0 con 0x7fadb40b6960 2022-01-10T01:29:28.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadabfff700 1 -- 172.21.15.36:0/1760191944 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadac00b950 con 0x7fadb40b6960 2022-01-10T01:29:28.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 -- 172.21.15.36:0/1760191944 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b6960 msgr2=0x7fadb412ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 --2- 172.21.15.36:0/1760191944 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b6960 0x7fadb412ba00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fadb4143120 tx=0x7fadac0091d0).stop 2022-01-10T01:29:28.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 -- 172.21.15.36:0/1760191944 shutdown_connections 2022-01-10T01:29:28.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 --2- 172.21.15.36:0/1760191944 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b6960 0x7fadb412ba00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 --2- 172.21.15.36:0/1760191944 >> v2:172.21.15.59:3300/0 conn(0x7fadb40b6580 0x7fadb40b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 -- 172.21.15.36:0/1760191944 >> 172.21.15.36:0/1760191944 conn(0x7fadb405c490 msgr2=0x7fadb405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:28.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 -- 172.21.15.36:0/1760191944 shutdown_connections 2022-01-10T01:29:28.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 -- 172.21.15.36:0/1760191944 wait complete. 2022-01-10T01:29:28.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 Processor -- start 2022-01-10T01:29:28.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 -- start start 2022-01-10T01:29:28.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadb40b43c0 0x7fadb4128c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb40b6580 0x7fadb41468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b6960 0x7fadb4152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb4147100 con 0x7fadb40b6960 2022-01-10T01:29:28.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb40b1fe0 con 0x7fadb40b43c0 2022-01-10T01:29:28.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadbb407700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb40b2280 con 0x7fadb40b6580 2022-01-10T01:29:28.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadb99a4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b6960 0x7fadb4152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadb99a4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b6960 0x7fadb4152620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37298/0 (socket says 172.21.15.36:37298) 2022-01-10T01:29:28.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.779+0000 7fadb99a4700 1 -- 172.21.15.36:0/3612034486 learned_addr learned my addr 172.21.15.36:0/3612034486 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:28.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadb91a3700 1 --2- 172.21.15.36:0/3612034486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadb40b43c0 0x7fadb4128c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadb89a2700 1 --2- 172.21.15.36:0/3612034486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb40b6580 0x7fadb41468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadb99a4700 1 -- 172.21.15.36:0/3612034486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb40b6580 msgr2=0x7fadb41468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadb99a4700 1 --2- 172.21.15.36:0/3612034486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb40b6580 0x7fadb41468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadb99a4700 1 -- 172.21.15.36:0/3612034486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadb40b43c0 msgr2=0x7fadb4128c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadb99a4700 1 --2- 172.21.15.36:0/3612034486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadb40b43c0 0x7fadb4128c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadb99a4700 1 -- 172.21.15.36:0/3612034486 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac009470 con 0x7fadb40b6960 2022-01-10T01:29:28.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadb99a4700 1 --2- 172.21.15.36:0/3612034486 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b6960 0x7fadb4152620 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fadb4143120 tx=0x7fadac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:28.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadaa7fc700 1 -- 172.21.15.36:0/3612034486 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadac021630 con 0x7fadb40b6960 2022-01-10T01:29:28.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadaa7fc700 1 -- 172.21.15.36:0/3612034486 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac021790 con 0x7fadb40b6960 2022-01-10T01:29:28.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadbb407700 1 -- 172.21.15.36:0/3612034486 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb40b2520 con 0x7fadb40b6960 2022-01-10T01:29:28.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadaa7fc700 1 -- 172.21.15.36:0/3612034486 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadac021af0 con 0x7fadb40b6960 2022-01-10T01:29:28.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadbb407700 1 -- 172.21.15.36:0/3612034486 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb4146dc0 con 0x7fadb40b6960 2022-01-10T01:29:28.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadbb407700 1 -- 172.21.15.36:0/3612034486 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb40b26b0 con 0x7fadb40b6960 2022-01-10T01:29:28.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadaa7fc700 1 -- 172.21.15.36:0/3612034486 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fadac027020 con 0x7fadb40b6960 2022-01-10T01:29:28.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.783+0000 7fadaa7fc700 1 --2- 172.21.15.36:0/3612034486 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad9c053680 0x7fad9c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:28.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.787+0000 7fadaa7fc700 1 -- 172.21.15.36:0/3612034486 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fadac06d220 con 0x7fadb40b6960 2022-01-10T01:29:28.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.787+0000 7fadb91a3700 1 --2- 172.21.15.36:0/3612034486 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad9c053680 0x7fad9c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:28.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.787+0000 7fadb91a3700 1 --2- 172.21.15.36:0/3612034486 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad9c053680 0x7fad9c055b40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fadb000b000 tx=0x7fadb0006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:28.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.791+0000 7fadaa7fc700 1 -- 172.21.15.36:0/3612034486 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fadac0441d0 con 0x7fadb40b6960 2022-01-10T01:29:28.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.959+0000 7fadbb407700 1 -- 172.21.15.36:0/3612034486 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fadb4061890 con 0x7fadb40b6960 2022-01-10T01:29:28.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.967+0000 7fadaa7fc700 1 -- 172.21.15.36:0/3612034486 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7fadac015020 con 0x7fadb40b6960 2022-01-10T01:29:28.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.971+0000 7fadbb407700 1 -- 172.21.15.36:0/3612034486 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad9c053680 msgr2=0x7fad9c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.971+0000 7fadbb407700 1 --2- 172.21.15.36:0/3612034486 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad9c053680 0x7fad9c055b40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fadb000b000 tx=0x7fadb0006df0).stop 2022-01-10T01:29:28.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.971+0000 7fadbb407700 1 -- 172.21.15.36:0/3612034486 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b6960 msgr2=0x7fadb4152620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:28.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.971+0000 7fadbb407700 1 --2- 172.21.15.36:0/3612034486 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b6960 0x7fadb4152620 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fadb4143120 tx=0x7fadac016000).stop 2022-01-10T01:29:28.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.971+0000 7fadbb407700 1 -- 172.21.15.36:0/3612034486 shutdown_connections 2022-01-10T01:29:28.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.971+0000 7fadbb407700 1 --2- 172.21.15.36:0/3612034486 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad9c053680 0x7fad9c055b40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.971+0000 7fadbb407700 1 --2- 172.21.15.36:0/3612034486 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fadb40b6960 0x7fadb4152620 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.971+0000 7fadbb407700 1 --2- 172.21.15.36:0/3612034486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fadb40b6580 0x7fadb41468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.971+0000 7fadbb407700 1 --2- 172.21.15.36:0/3612034486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadb40b43c0 0x7fadb4128c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:28.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.971+0000 7fadbb407700 1 -- 172.21.15.36:0/3612034486 >> 172.21.15.36:0/3612034486 conn(0x7fadb405c490 msgr2=0x7fadb4142060 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:28.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.971+0000 7fadbb407700 1 -- 172.21.15.36:0/3612034486 shutdown_connections 2022-01-10T01:29:28.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:28.971+0000 7fadbb407700 1 -- 172.21.15.36:0/3612034486 wait complete. 2022-01-10T01:29:28.974 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.0 2022-01-10T01:29:28.983 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:29:29.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.099+0000 7f8656bc2700 1 Processor -- start 2022-01-10T01:29:29.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.099+0000 7f8656bc2700 1 -- start start 2022-01-10T01:29:29.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.099+0000 7f8656bc2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8650061320 0x7f8650061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:29.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.099+0000 7f8656bc2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86500ad5c0 0x7f86500b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:29.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.099+0000 7f8656bc2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86500aecf0 con 0x7f8650140440 2022-01-10T01:29:29.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.099+0000 7f8656bc2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86500b6f20 con 0x7f8650061320 2022-01-10T01:29:29.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.099+0000 7f8656bc2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86500aef20 con 0x7f86500ad5c0 2022-01-10T01:29:29.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f8655bc0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8650061320 0x7f8650061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:29.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f86553bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86500ad5c0 0x7f86500b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:29.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f86563c1700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8650140440 0x7f8650146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:52778/0 (socket says 172.21.15.36:52778) 2022-01-10T01:29:29.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f86553bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86500ad5c0 0x7f86500b9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:43586/0 (socket says 172.21.15.36:43586) 2022-01-10T01:29:29.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f8655bc0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8650061320 0x7f8650061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:33940/0 (socket says 172.21.15.36:33940) 2022-01-10T01:29:29.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f86563c1700 1 -- 172.21.15.36:0/1514218224 learned_addr learned my addr 172.21.15.36:0/1514218224 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:29.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f86553bf700 1 -- 172.21.15.36:0/1514218224 >> v2:172.21.15.59:3300/0 conn(0x7f8650061320 msgr2=0x7f8650061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:29.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f86553bf700 1 --2- 172.21.15.36:0/1514218224 >> v2:172.21.15.59:3300/0 conn(0x7f8650061320 0x7f8650061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f86553bf700 1 -- 172.21.15.36:0/1514218224 >> v1:172.21.15.59:6789/0 conn(0x7f8650140440 legacy=0x7f8650146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:29.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f86553bf700 1 -- 172.21.15.36:0/1514218224 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86500af1c0 con 0x7f86500ad5c0 2022-01-10T01:29:29.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f8655bc0700 1 --2- 172.21.15.36:0/1514218224 >> v2:172.21.15.59:3300/0 conn(0x7f8650061320 0x7f8650061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:29.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f86553bf700 1 --2- 172.21.15.36:0/1514218224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86500ad5c0 0x7f86500b9e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f863c002f70 tx=0x7f863c006df0).ready entity=mon.2 client_cookie=d156152e0fbc1083 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:29.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f8654bbe700 1 -- 172.21.15.36:0/1514218224 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f863c00d570 con 0x7f86500ad5c0 2022-01-10T01:29:29.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f8654bbe700 1 -- 172.21.15.36:0/1514218224 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c000e90 con 0x7f86500ad5c0 2022-01-10T01:29:29.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f8654bbe700 1 -- 172.21.15.36:0/1514218224 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f863c00d8c0 con 0x7f86500ad5c0 2022-01-10T01:29:29.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f8656bc2700 1 -- 172.21.15.36:0/1514218224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86500ad5c0 msgr2=0x7f86500b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:29.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f8656bc2700 1 --2- 172.21.15.36:0/1514218224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86500ad5c0 0x7f86500b9e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f863c002f70 tx=0x7f863c006df0).stop 2022-01-10T01:29:29.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f8656bc2700 1 -- 172.21.15.36:0/1514218224 shutdown_connections 2022-01-10T01:29:29.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f8656bc2700 1 --2- 172.21.15.36:0/1514218224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86500ad5c0 0x7f86500b9e60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f8656bc2700 1 --2- 172.21.15.36:0/1514218224 >> v2:172.21.15.59:3300/0 conn(0x7f8650061320 0x7f8650061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f8656bc2700 1 -- 172.21.15.36:0/1514218224 >> 172.21.15.36:0/1514218224 conn(0x7f8650066de0 msgr2=0x7f86500671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:29.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f8656bc2700 1 -- 172.21.15.36:0/1514218224 shutdown_connections 2022-01-10T01:29:29.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.103+0000 7f8656bc2700 1 -- 172.21.15.36:0/1514218224 wait complete. 2022-01-10T01:29:29.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f8656bc2700 1 Processor -- start 2022-01-10T01:29:29.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f8656bc2700 1 -- start start 2022-01-10T01:29:29.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f8656bc2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8650061320 0x7f8650146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:29.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f8656bc2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f86500ad5c0 0x7f865013f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:29.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f8656bc2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8650140440 0x7f865013fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:29.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f8656bc2700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86500b1db0 con 0x7f86500ad5c0 2022-01-10T01:29:29.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f8656bc2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86500b2820 con 0x7f8650140440 2022-01-10T01:29:29.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f8656bc2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8650156580 con 0x7f8650061320 2022-01-10T01:29:29.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f86553bf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f86500ad5c0 0x7f865013f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:29.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f86553bf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f86500ad5c0 0x7f865013f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37312/0 (socket says 172.21.15.36:37312) 2022-01-10T01:29:29.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f86553bf700 1 -- 172.21.15.36:0/1247473059 learned_addr learned my addr 172.21.15.36:0/1247473059 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:29.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f8655bc0700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8650061320 0x7f8650146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:29.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f86563c1700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8650140440 0x7f865013fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:29.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f86553bf700 1 -- 172.21.15.36:0/1247473059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8650061320 msgr2=0x7f8650146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:29.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f86553bf700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8650061320 0x7f8650146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f86553bf700 1 -- 172.21.15.36:0/1247473059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8650140440 msgr2=0x7f865013fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:29.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f86553bf700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8650140440 0x7f865013fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f86553bf700 1 -- 172.21.15.36:0/1247473059 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864400b180 con 0x7f86500ad5c0 2022-01-10T01:29:29.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f86563c1700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8650140440 0x7f865013fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:29.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f86553bf700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f86500ad5c0 0x7f865013f820 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f863c002f70 tx=0x7f863c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:29.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f864effd700 1 -- 172.21.15.36:0/1247473059 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f863c00dea0 con 0x7f86500ad5c0 2022-01-10T01:29:29.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f864effd700 1 -- 172.21.15.36:0/1247473059 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c013e90 con 0x7f86500ad5c0 2022-01-10T01:29:29.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f8656bc2700 1 -- 172.21.15.36:0/1247473059 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c00b180 con 0x7f86500ad5c0 2022-01-10T01:29:29.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f864effd700 1 -- 172.21.15.36:0/1247473059 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f863c01e5f0 con 0x7f86500ad5c0 2022-01-10T01:29:29.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.107+0000 7f8656bc2700 1 -- 172.21.15.36:0/1247473059 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86500b2a80 con 0x7f86500ad5c0 2022-01-10T01:29:29.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.111+0000 7f864effd700 1 -- 172.21.15.36:0/1247473059 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f863c025030 con 0x7f86500ad5c0 2022-01-10T01:29:29.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.111+0000 7f8656bc2700 1 -- 172.21.15.36:0/1247473059 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86500af460 con 0x7f86500ad5c0 2022-01-10T01:29:29.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.111+0000 7f864effd700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8638053560 0x7f8638055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:29.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.111+0000 7f864effd700 1 -- 172.21.15.36:0/1247473059 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f863c06c7b0 con 0x7f86500ad5c0 2022-01-10T01:29:29.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.111+0000 7f8655bc0700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8638053560 0x7f8638055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:29.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.111+0000 7f8655bc0700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8638053560 0x7f8638055a20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f864400b000 tx=0x7f8644006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:29.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.119+0000 7f864effd700 1 -- 172.21.15.36:0/1247473059 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f863c0437c0 con 0x7f86500ad5c0 2022-01-10T01:29:29.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.287+0000 7f8656bc2700 1 -- 172.21.15.36:0/1247473059 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8650057350 con 0x7f86500ad5c0 2022-01-10T01:29:29.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.295+0000 7f864effd700 1 -- 172.21.15.36:0/1247473059 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7f863c023020 con 0x7f86500ad5c0 2022-01-10T01:29:29.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.299+0000 7f8656bc2700 1 -- 172.21.15.36:0/1247473059 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8638053560 msgr2=0x7f8638055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:29.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.299+0000 7f8656bc2700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8638053560 0x7f8638055a20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f864400b000 tx=0x7f8644006df0).stop 2022-01-10T01:29:29.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.299+0000 7f8656bc2700 1 -- 172.21.15.36:0/1247473059 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f86500ad5c0 msgr2=0x7f865013f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:29.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.299+0000 7f8656bc2700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f86500ad5c0 0x7f865013f820 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f863c002f70 tx=0x7f863c014000).stop 2022-01-10T01:29:29.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.299+0000 7f8656bc2700 1 -- 172.21.15.36:0/1247473059 shutdown_connections 2022-01-10T01:29:29.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.299+0000 7f8656bc2700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8638053560 0x7f8638055a20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.299+0000 7f8656bc2700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8650140440 0x7f865013fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.299+0000 7f8656bc2700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f86500ad5c0 0x7f865013f820 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.299+0000 7f8656bc2700 1 --2- 172.21.15.36:0/1247473059 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8650061320 0x7f8650146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.299+0000 7f8656bc2700 1 -- 172.21.15.36:0/1247473059 >> 172.21.15.36:0/1247473059 conn(0x7f8650066de0 msgr2=0x7f86500b8790 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:29.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.299+0000 7f8656bc2700 1 -- 172.21.15.36:0/1247473059 shutdown_connections 2022-01-10T01:29:29.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.299+0000 7f8656bc2700 1 -- 172.21.15.36:0/1247473059 wait complete. 2022-01-10T01:29:29.304 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.1 2022-01-10T01:29:29.312 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:29:29.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.415+0000 7fabb0a05700 1 Processor -- start 2022-01-10T01:29:29.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.415+0000 7fabb0a05700 1 -- start start 2022-01-10T01:29:29.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabb0a05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabac067110 0x7fabac141840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:29.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabb0a05700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabac066500 con 0x7fabac064980 2022-01-10T01:29:29.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabb0a05700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabac0b46c0 con 0x7fabac0b3550 2022-01-10T01:29:29.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabb0a05700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabac0b3ea0 con 0x7fabac067110 2022-01-10T01:29:29.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabab7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fabac064980 0x7fabac066a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35112/0 (socket says 172.21.15.36:35112) 2022-01-10T01:29:29.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabab7fe700 1 -- 172.21.15.36:0/4255261715 learned_addr learned my addr 172.21.15.36:0/4255261715 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:29.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fababfff700 1 --2- 172.21.15.36:0/4255261715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabac067110 0x7fabac141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:29.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabaa7fc700 1 -- 172.21.15.36:0/4255261715 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340892734 0 0) 0x7fabac066500 con 0x7fabac064980 2022-01-10T01:29:29.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabaa7fc700 1 -- 172.21.15.36:0/4255261715 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab98003260 con 0x7fabac064980 2022-01-10T01:29:29.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fababfff700 1 -- 172.21.15.36:0/4255261715 >> v1:172.21.15.59:6789/0 conn(0x7fabac0b3550 legacy=0x7fabac141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:29.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabaa7fc700 1 -- 172.21.15.36:0/4255261715 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274524989 0 0) 0x7fabac0b46c0 con 0x7fabac0b3550 2022-01-10T01:29:29.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fababfff700 1 -- 172.21.15.36:0/4255261715 >> v1:172.21.15.36:6789/0 conn(0x7fabac064980 legacy=0x7fabac066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:29.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fababfff700 1 -- 172.21.15.36:0/4255261715 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac064d60 con 0x7fabac067110 2022-01-10T01:29:29.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fababfff700 1 --2- 172.21.15.36:0/4255261715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabac067110 0x7fabac141840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7faba40032f0 tx=0x7faba40091d0).ready entity=mon.2 client_cookie=29827fa8c70cce15 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:29.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabaa7fc700 1 -- 172.21.15.36:0/4255261715 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faba400b6c0 con 0x7fabac067110 2022-01-10T01:29:29.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabaa7fc700 1 -- 172.21.15.36:0/4255261715 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba400b820 con 0x7fabac067110 2022-01-10T01:29:29.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabaa7fc700 1 -- 172.21.15.36:0/4255261715 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faba400b990 con 0x7fabac067110 2022-01-10T01:29:29.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabb0a05700 1 -- 172.21.15.36:0/4255261715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabac067110 msgr2=0x7fabac141840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:29.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabb0a05700 1 --2- 172.21.15.36:0/4255261715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabac067110 0x7fabac141840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7faba40032f0 tx=0x7faba40091d0).stop 2022-01-10T01:29:29.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabb0a05700 1 -- 172.21.15.36:0/4255261715 shutdown_connections 2022-01-10T01:29:29.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabb0a05700 1 --2- 172.21.15.36:0/4255261715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabac067110 0x7fabac141840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabb0a05700 1 -- 172.21.15.36:0/4255261715 >> 172.21.15.36:0/4255261715 conn(0x7fabac05f6b0 msgr2=0x7fabac05fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:29.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabb0a05700 1 -- 172.21.15.36:0/4255261715 shutdown_connections 2022-01-10T01:29:29.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.419+0000 7fabb0a05700 1 -- 172.21.15.36:0/4255261715 wait complete. 2022-01-10T01:29:29.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabb0a05700 1 Processor -- start 2022-01-10T01:29:29.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabb0a05700 1 -- start start 2022-01-10T01:29:29.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabb0a05700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabac064980 0x7fabac150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:29.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabb0a05700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabac067110 0x7fabac05cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:29.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabb0a05700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabac0b3550 0x7fabac13c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:29.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabb0a05700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac0b5f50 con 0x7fabac067110 2022-01-10T01:29:29.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabb0a05700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac0b5770 con 0x7fabac0b3550 2022-01-10T01:29:29.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabb0a05700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabac0b5a10 con 0x7fabac064980 2022-01-10T01:29:29.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabaaffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabac067110 0x7fabac05cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:29.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabac064980 0x7fabac150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:29.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fababfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabac0b3550 0x7fabac13c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:29.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabab7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabac064980 0x7fabac150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:43606/0 (socket says 172.21.15.36:43606) 2022-01-10T01:29:29.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabaaffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabac067110 0x7fabac05cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37326/0 (socket says 172.21.15.36:37326) 2022-01-10T01:29:29.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabab7fe700 1 -- 172.21.15.36:0/2089743206 learned_addr learned my addr 172.21.15.36:0/2089743206 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:29.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabab7fe700 1 -- 172.21.15.36:0/2089743206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabac0b3550 msgr2=0x7fabac13c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:29.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabab7fe700 1 --2- 172.21.15.36:0/2089743206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabac0b3550 0x7fabac13c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabab7fe700 1 -- 172.21.15.36:0/2089743206 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabac067110 msgr2=0x7fabac05cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:29.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabab7fe700 1 --2- 172.21.15.36:0/2089743206 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabac067110 0x7fabac05cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabab7fe700 1 -- 172.21.15.36:0/2089743206 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba4009470 con 0x7fabac064980 2022-01-10T01:29:29.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabab7fe700 1 --2- 172.21.15.36:0/2089743206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabac064980 0x7fabac150970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fab9c001110 tx=0x7fab9c007aa0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:29.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7faba8ff9700 1 -- 172.21.15.36:0/2089743206 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab9c0070d0 con 0x7fabac064980 2022-01-10T01:29:29.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7faba8ff9700 1 -- 172.21.15.36:0/2089743206 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c007230 con 0x7fabac064980 2022-01-10T01:29:29.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabb0a05700 1 -- 172.21.15.36:0/2089743206 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabac0b5cb0 con 0x7fabac064980 2022-01-10T01:29:29.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7faba8ff9700 1 -- 172.21.15.36:0/2089743206 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab9c005610 con 0x7fabac064980 2022-01-10T01:29:29.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.423+0000 7fabb0a05700 1 -- 172.21.15.36:0/2089743206 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabac05d340 con 0x7fabac064980 2022-01-10T01:29:29.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.427+0000 7fabb0a05700 1 -- 172.21.15.36:0/2089743206 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabac136a90 con 0x7fabac064980 2022-01-10T01:29:29.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.427+0000 7faba8ff9700 1 -- 172.21.15.36:0/2089743206 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fab9c010070 con 0x7fabac064980 2022-01-10T01:29:29.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.427+0000 7faba8ff9700 1 --2- 172.21.15.36:0/2089743206 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fab8c053620 0x7fab8c055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:29.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.427+0000 7faba8ff9700 1 -- 172.21.15.36:0/2089743206 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fab9c06b270 con 0x7fabac064980 2022-01-10T01:29:29.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.427+0000 7fabaaffd700 1 --2- 172.21.15.36:0/2089743206 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fab8c053620 0x7fab8c055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:29.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.427+0000 7fabaaffd700 1 --2- 172.21.15.36:0/2089743206 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fab8c053620 0x7fab8c055ae0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7faba000d000 tx=0x7faba0007b70).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:29.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.439+0000 7faba8ff9700 1 -- 172.21.15.36:0/2089743206 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fab9c042090 con 0x7fabac064980 2022-01-10T01:29:29.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.603+0000 7fabb0a05700 1 -- 172.21.15.36:0/2089743206 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fabac057350 con 0x7fabac064980 2022-01-10T01:29:29.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.603+0000 7faba8ff9700 1 -- 172.21.15.36:0/2089743206 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fab9c0456b0 con 0x7fabac064980 2022-01-10T01:29:29.606 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:29.606 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":29,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6836/1674052345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":1674052345},{"type":"v1","addr":"172.21.15.36:6836","nonce":1674052345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27},{"gid":5919,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/3906479610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":3906479610},{"type":"v1","addr":"172.21.15.36:6837","nonce":3906479610}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:29:27.060192+0000","modified":"2022-01-10T01:29:28.063204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5922},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5922":{"gid":5922,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1356140607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1356140607},{"type":"v1","addr":"172.21.15.59:6833","nonce":1356140607}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2022-01-10T01:29:29.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.607+0000 7fabb0a05700 1 -- 172.21.15.36:0/2089743206 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fab8c053620 msgr2=0x7fab8c055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:29.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.607+0000 7fabb0a05700 1 --2- 172.21.15.36:0/2089743206 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fab8c053620 0x7fab8c055ae0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7faba000d000 tx=0x7faba0007b70).stop 2022-01-10T01:29:29.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.607+0000 7fabb0a05700 1 -- 172.21.15.36:0/2089743206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabac064980 msgr2=0x7fabac150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:29.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.607+0000 7fabb0a05700 1 --2- 172.21.15.36:0/2089743206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabac064980 0x7fabac150970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fab9c001110 tx=0x7fab9c007aa0).stop 2022-01-10T01:29:29.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.607+0000 7fabb0a05700 1 -- 172.21.15.36:0/2089743206 shutdown_connections 2022-01-10T01:29:29.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.607+0000 7fabb0a05700 1 --2- 172.21.15.36:0/2089743206 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fab8c053620 0x7fab8c055ae0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.607+0000 7fabb0a05700 1 --2- 172.21.15.36:0/2089743206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabac0b3550 0x7fabac13c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.607+0000 7fabb0a05700 1 --2- 172.21.15.36:0/2089743206 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabac067110 0x7fabac05cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.607+0000 7fabb0a05700 1 --2- 172.21.15.36:0/2089743206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabac064980 0x7fabac150970 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:29.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.607+0000 7fabb0a05700 1 -- 172.21.15.36:0/2089743206 >> 172.21.15.36:0/2089743206 conn(0x7fabac05f6b0 msgr2=0x7fabac139ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:29.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.607+0000 7fabb0a05700 1 -- 172.21.15.36:0/2089743206 shutdown_connections 2022-01-10T01:29:29.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:29.607+0000 7fabb0a05700 1 -- 172.21.15.36:0/2089743206 wait complete. 2022-01-10T01:29:29.613 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 29 2022-01-10T01:29:29.927 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:29:27.060192+0000', 'modified': '2022-01-10T01:29:28.063204+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5922}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5922': {'gid': 5922, 'name': 'b', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/1356140607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1356140607}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 1356140607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:29:29.928 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:29:29.929 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:29:30.047 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":5922,"want_state":"up:active","state":"up:active","rank_uptime":2.9758610779999999,"mdsmap_epoch":29,"osdmap_epoch":67,"osdmap_epoch_barrier":66,"uptime":7.7200034540000004} 2022-01-10T01:29:30.048 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 5922, "mdsmap_epoch": 29, "osdmap_epoch": 67, "osdmap_epoch_barrier": 66, "rank_uptime": 2.975861078, "state": "up:active", "uptime": 7.720003454, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:29:30.049 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:29:30.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612f74700 1 Processor -- start 2022-01-10T01:29:30.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612f74700 1 -- start start 2022-01-10T01:29:30.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612f74700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f960c0b0010 0x7f960c0a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612f74700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f960c0afbd0 0x7f960c0a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612f74700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c0a70c0 con 0x7f960c0b2580 2022-01-10T01:29:30.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612f74700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c0a72f0 con 0x7f960c0afbd0 2022-01-10T01:29:30.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612f74700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c0a7590 con 0x7f960c0b0010 2022-01-10T01:29:30.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612773700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f960c0afbd0 0x7f960c0a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612773700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f960c0afbd0 0x7f960c0a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37336/0 (socket says 172.21.15.36:37336) 2022-01-10T01:29:30.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612773700 1 -- 172.21.15.36:0/860227157 learned_addr learned my addr 172.21.15.36:0/860227157 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:30.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9611771700 1 --2- 172.21.15.36:0/860227157 >> v2:172.21.15.59:3300/0 conn(0x7f960c0b0010 0x7f960c0a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612773700 1 -- 172.21.15.36:0/860227157 >> v2:172.21.15.59:3300/0 conn(0x7f960c0b0010 msgr2=0x7f960c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:30.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612773700 1 --2- 172.21.15.36:0/860227157 >> v2:172.21.15.59:3300/0 conn(0x7f960c0b0010 0x7f960c0a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612773700 1 -- 172.21.15.36:0/860227157 >> v1:172.21.15.59:6789/0 conn(0x7f960c0b2580 legacy=0x7f960c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612773700 1 -- 172.21.15.36:0/860227157 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c0a7830 con 0x7f960c0afbd0 2022-01-10T01:29:30.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9612773700 1 --2- 172.21.15.36:0/860227157 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f960c0afbd0 0x7f960c0a88a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f96040032f0 tx=0x7f9604009290).ready entity=mon.0 client_cookie=8ff644d22269b9ea server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:30.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9610f70700 1 -- 172.21.15.36:0/860227157 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f960400b870 con 0x7f960c0afbd0 2022-01-10T01:29:30.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9610f70700 1 -- 172.21.15.36:0/860227157 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960400b9d0 con 0x7f960c0afbd0 2022-01-10T01:29:30.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.163+0000 7f9610f70700 1 -- 172.21.15.36:0/860227157 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f960400bb40 con 0x7f960c0afbd0 2022-01-10T01:29:30.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 -- 172.21.15.36:0/860227157 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f960c0afbd0 msgr2=0x7f960c0a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 --2- 172.21.15.36:0/860227157 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f960c0afbd0 0x7f960c0a88a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f96040032f0 tx=0x7f9604009290).stop 2022-01-10T01:29:30.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 -- 172.21.15.36:0/860227157 shutdown_connections 2022-01-10T01:29:30.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 --2- 172.21.15.36:0/860227157 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f960c0afbd0 0x7f960c0a88a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 --2- 172.21.15.36:0/860227157 >> v2:172.21.15.59:3300/0 conn(0x7f960c0b0010 0x7f960c0a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 -- 172.21.15.36:0/860227157 >> 172.21.15.36:0/860227157 conn(0x7f960c060180 msgr2=0x7f960c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:30.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 -- 172.21.15.36:0/860227157 shutdown_connections 2022-01-10T01:29:30.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 -- 172.21.15.36:0/860227157 wait complete. 2022-01-10T01:29:30.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 Processor -- start 2022-01-10T01:29:30.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 -- start start 2022-01-10T01:29:30.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f960c0afbd0 0x7f960c14a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f960c0b0010 0x7f960c064dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f960c0b2580 0x7f960c0652b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0ac520 con 0x7f960c0b2580 2022-01-10T01:29:30.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c063180 con 0x7f960c0afbd0 2022-01-10T01:29:30.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.167+0000 7f9612f74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c063420 con 0x7f960c0b0010 2022-01-10T01:29:30.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9612773700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f960c0b2580 0x7f960c0652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9612773700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f960c0b2580 0x7f960c0652b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37342/0 (socket says 172.21.15.36:37342) 2022-01-10T01:29:30.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9612773700 1 -- 172.21.15.36:0/1271891218 learned_addr learned my addr 172.21.15.36:0/1271891218 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:30.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9611f72700 1 --2- 172.21.15.36:0/1271891218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f960c0afbd0 0x7f960c14a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9611771700 1 --2- 172.21.15.36:0/1271891218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f960c0b0010 0x7f960c064dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9612773700 1 -- 172.21.15.36:0/1271891218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f960c0b0010 msgr2=0x7f960c064dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9612773700 1 --2- 172.21.15.36:0/1271891218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f960c0b0010 0x7f960c064dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9612773700 1 -- 172.21.15.36:0/1271891218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f960c0afbd0 msgr2=0x7f960c14a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9612773700 1 --2- 172.21.15.36:0/1271891218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f960c0afbd0 0x7f960c14a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9612773700 1 -- 172.21.15.36:0/1271891218 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9604009530 con 0x7f960c0b2580 2022-01-10T01:29:30.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9612773700 1 --2- 172.21.15.36:0/1271891218 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f960c0b2580 0x7f960c0652b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f96040032f0 tx=0x7f9604016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:30.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f95faffd700 1 -- 172.21.15.36:0/1271891218 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f960400b870 con 0x7f960c0b2580 2022-01-10T01:29:30.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f95faffd700 1 -- 172.21.15.36:0/1271891218 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9604021440 con 0x7f960c0b2580 2022-01-10T01:29:30.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9612f74700 1 -- 172.21.15.36:0/1271891218 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c156690 con 0x7f960c0b2580 2022-01-10T01:29:30.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f95faffd700 1 -- 172.21.15.36:0/1271891218 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96040217a0 con 0x7f960c0b2580 2022-01-10T01:29:30.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9612f74700 1 -- 172.21.15.36:0/1271891218 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c154200 con 0x7f960c0b2580 2022-01-10T01:29:30.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9612f74700 1 -- 172.21.15.36:0/1271891218 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c057350 con 0x7f960c0b2580 2022-01-10T01:29:30.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f95faffd700 1 -- 172.21.15.36:0/1271891218 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f960400f070 con 0x7f960c0b2580 2022-01-10T01:29:30.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f95faffd700 1 --2- 172.21.15.36:0/1271891218 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f95ec053620 0x7f95ec055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f95faffd700 1 -- 172.21.15.36:0/1271891218 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f960406c200 con 0x7f960c0b2580 2022-01-10T01:29:30.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.171+0000 7f9611f72700 1 --2- 172.21.15.36:0/1271891218 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f95ec053620 0x7f95ec055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.175+0000 7f9611f72700 1 --2- 172.21.15.36:0/1271891218 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f95ec053620 0x7f95ec055ae0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f95fc00d000 tx=0x7f95fc009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:30.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.179+0000 7f95faffd700 1 -- 172.21.15.36:0/1271891218 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9604043210 con 0x7f960c0b2580 2022-01-10T01:29:30.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.303+0000 7f9612f74700 1 -- 172.21.15.36:0/1271891218 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f960c0698e0 con 0x7f960c0b2580 2022-01-10T01:29:30.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.307+0000 7f95faffd700 1 -- 172.21.15.36:0/1271891218 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f9604015090 con 0x7f960c0b2580 2022-01-10T01:29:30.307 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:30.307 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":67,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:29:28.063908+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:29:25.099175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2022-01-10T01:29:26.058962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:29:30.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.307+0000 7f9612f74700 1 -- 172.21.15.36:0/1271891218 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f95ec053620 msgr2=0x7f95ec055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.307+0000 7f9612f74700 1 --2- 172.21.15.36:0/1271891218 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f95ec053620 0x7f95ec055ae0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f95fc00d000 tx=0x7f95fc009040).stop 2022-01-10T01:29:30.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.307+0000 7f9612f74700 1 -- 172.21.15.36:0/1271891218 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f960c0b2580 msgr2=0x7f960c0652b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.307+0000 7f9612f74700 1 --2- 172.21.15.36:0/1271891218 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f960c0b2580 0x7f960c0652b0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f96040032f0 tx=0x7f9604016000).stop 2022-01-10T01:29:30.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.307+0000 7f9612f74700 1 -- 172.21.15.36:0/1271891218 shutdown_connections 2022-01-10T01:29:30.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.307+0000 7f9612f74700 1 --2- 172.21.15.36:0/1271891218 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f95ec053620 0x7f95ec055ae0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.307+0000 7f9612f74700 1 --2- 172.21.15.36:0/1271891218 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f960c0b2580 0x7f960c0652b0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.307+0000 7f9612f74700 1 --2- 172.21.15.36:0/1271891218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f960c0b0010 0x7f960c064dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.307+0000 7f9612f74700 1 --2- 172.21.15.36:0/1271891218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f960c0afbd0 0x7f960c14a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.307+0000 7f9612f74700 1 -- 172.21.15.36:0/1271891218 >> 172.21.15.36:0/1271891218 conn(0x7f960c060180 msgr2=0x7f960c148b50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:30.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.307+0000 7f9612f74700 1 -- 172.21.15.36:0/1271891218 shutdown_connections 2022-01-10T01:29:30.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.307+0000 7f9612f74700 1 -- 172.21.15.36:0/1271891218 wait complete. 2022-01-10T01:29:30.321 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:29:25.099175+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:29:26.058962+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:29:30.322 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:29:30.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.431+0000 7f3d45513700 1 Processor -- start 2022-01-10T01:29:30.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.431+0000 7f3d45513700 1 -- start start 2022-01-10T01:29:30.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.431+0000 7f3d45513700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3d400b2580 0x7f3d4014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.431+0000 7f3d45513700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d400b0010 0x7f3d4014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.431+0000 7f3d45513700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d400a70c0 con 0x7f3d400afbd0 2022-01-10T01:29:30.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.431+0000 7f3d45513700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d400a72f0 con 0x7f3d400b2580 2022-01-10T01:29:30.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.431+0000 7f3d45513700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d400a7590 con 0x7f3d400b0010 2022-01-10T01:29:30.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d3ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3d400b2580 0x7f3d4014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d3f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d400b0010 0x7f3d4014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d44d12700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3d400afbd0 0x7f3d400a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:52816/0 (socket says 172.21.15.36:52816) 2022-01-10T01:29:30.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d44d12700 1 -- 172.21.15.36:0/1424564478 learned_addr learned my addr 172.21.15.36:0/1424564478 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:30.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d3f7fe700 1 -- 172.21.15.36:0/1424564478 >> v2:172.21.15.36:3300/0 conn(0x7f3d400b2580 msgr2=0x7f3d4014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:30.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d3f7fe700 1 --2- 172.21.15.36:0/1424564478 >> v2:172.21.15.36:3300/0 conn(0x7f3d400b2580 0x7f3d4014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d3effd700 1 -- 172.21.15.36:0/1424564478 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678630612 0 0) 0x7f3d400a70c0 con 0x7f3d400afbd0 2022-01-10T01:29:30.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d3f7fe700 1 -- 172.21.15.36:0/1424564478 >> v1:172.21.15.59:6789/0 conn(0x7f3d400afbd0 legacy=0x7f3d400a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d3f7fe700 1 -- 172.21.15.36:0/1424564478 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d400a7830 con 0x7f3d400b0010 2022-01-10T01:29:30.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d3f7fe700 1 --2- 172.21.15.36:0/1424564478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d400b0010 0x7f3d4014b330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3d30002f70 tx=0x7f3d30006df0).ready entity=mon.2 client_cookie=cb31950f9b9f65e5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:30.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d3effd700 1 -- 172.21.15.36:0/1424564478 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3000d570 con 0x7f3d400b0010 2022-01-10T01:29:30.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d3effd700 1 -- 172.21.15.36:0/1424564478 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d30000e90 con 0x7f3d400b0010 2022-01-10T01:29:30.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d3effd700 1 -- 172.21.15.36:0/1424564478 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3000d8c0 con 0x7f3d400b0010 2022-01-10T01:29:30.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d45513700 1 -- 172.21.15.36:0/1424564478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d400b0010 msgr2=0x7f3d4014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d45513700 1 --2- 172.21.15.36:0/1424564478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d400b0010 0x7f3d4014b330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3d30002f70 tx=0x7f3d30006df0).stop 2022-01-10T01:29:30.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d45513700 1 -- 172.21.15.36:0/1424564478 shutdown_connections 2022-01-10T01:29:30.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d45513700 1 --2- 172.21.15.36:0/1424564478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d400b0010 0x7f3d4014b330 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d45513700 1 --2- 172.21.15.36:0/1424564478 >> v2:172.21.15.36:3300/0 conn(0x7f3d400b2580 0x7f3d4014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d45513700 1 -- 172.21.15.36:0/1424564478 >> 172.21.15.36:0/1424564478 conn(0x7f3d40060180 msgr2=0x7f3d400b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:30.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d45513700 1 -- 172.21.15.36:0/1424564478 shutdown_connections 2022-01-10T01:29:30.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d45513700 1 -- 172.21.15.36:0/1424564478 wait complete. 2022-01-10T01:29:30.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d45513700 1 Processor -- start 2022-01-10T01:29:30.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.435+0000 7f3d45513700 1 -- start start 2022-01-10T01:29:30.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d45513700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d400afbd0 0x7f3d4005bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d45513700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d400b0010 0x7f3d40159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d45513700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d400b2580 0x7f3d4015a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d45513700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4015a7a0 con 0x7f3d400b0010 2022-01-10T01:29:30.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d45513700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40141b80 con 0x7f3d400b2580 2022-01-10T01:29:30.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d45513700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40159920 con 0x7f3d400afbd0 2022-01-10T01:29:30.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d3f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d400b0010 0x7f3d40159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d3f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d400b0010 0x7f3d40159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37352/0 (socket says 172.21.15.36:37352) 2022-01-10T01:29:30.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d3f7fe700 1 -- 172.21.15.36:0/161342126 learned_addr learned my addr 172.21.15.36:0/161342126 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:30.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d3ffff700 1 --2- 172.21.15.36:0/161342126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d400afbd0 0x7f3d4005bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d44d12700 1 --2- 172.21.15.36:0/161342126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d400b2580 0x7f3d4015a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d3f7fe700 1 -- 172.21.15.36:0/161342126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d400afbd0 msgr2=0x7f3d4005bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d3f7fe700 1 --2- 172.21.15.36:0/161342126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d400afbd0 0x7f3d4005bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d3f7fe700 1 -- 172.21.15.36:0/161342126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d400b2580 msgr2=0x7f3d4015a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d3f7fe700 1 --2- 172.21.15.36:0/161342126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d400b2580 0x7f3d4015a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d3f7fe700 1 -- 172.21.15.36:0/161342126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3000b180 con 0x7f3d400b0010 2022-01-10T01:29:30.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d3f7fe700 1 --2- 172.21.15.36:0/161342126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d400b0010 0x7f3d40159dc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f3d30002f70 tx=0x7f3d30014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:30.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d3d7fa700 1 -- 172.21.15.36:0/161342126 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d30016070 con 0x7f3d400b0010 2022-01-10T01:29:30.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d3d7fa700 1 -- 172.21.15.36:0/161342126 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d300138d0 con 0x7f3d400b0010 2022-01-10T01:29:30.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d45513700 1 -- 172.21.15.36:0/161342126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4013e970 con 0x7f3d400b0010 2022-01-10T01:29:30.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.439+0000 7f3d3d7fa700 1 -- 172.21.15.36:0/161342126 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d30013c30 con 0x7f3d400b0010 2022-01-10T01:29:30.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.443+0000 7f3d45513700 1 -- 172.21.15.36:0/161342126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d40140650 con 0x7f3d400b0010 2022-01-10T01:29:30.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.443+0000 7f3d45513700 1 -- 172.21.15.36:0/161342126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d40057350 con 0x7f3d400b0010 2022-01-10T01:29:30.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.443+0000 7f3d3d7fa700 1 -- 172.21.15.36:0/161342126 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3d30025030 con 0x7f3d400b0010 2022-01-10T01:29:30.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.443+0000 7f3d3d7fa700 1 --2- 172.21.15.36:0/161342126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d200534d0 0x7f3d20055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.443+0000 7f3d3d7fa700 1 -- 172.21.15.36:0/161342126 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3d3006c990 con 0x7f3d400b0010 2022-01-10T01:29:30.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.443+0000 7f3d3ffff700 1 --2- 172.21.15.36:0/161342126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d200534d0 0x7f3d20055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.443+0000 7f3d3ffff700 1 --2- 172.21.15.36:0/161342126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d200534d0 0x7f3d20055990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f3d3400b000 tx=0x7f3d34006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:30.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.451+0000 7f3d3d7fa700 1 -- 172.21.15.36:0/161342126 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3d300439a0 con 0x7f3d400b0010 2022-01-10T01:29:30.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.579+0000 7f3d45513700 1 -- 172.21.15.36:0/161342126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3d40159b20 con 0x7f3d400b0010 2022-01-10T01:29:30.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.579+0000 7f3d3d7fa700 1 -- 172.21.15.36:0/161342126 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v67) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3d30023020 con 0x7f3d400b0010 2022-01-10T01:29:30.581 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:29:30.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.583+0000 7f3d45513700 1 -- 172.21.15.36:0/161342126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d200534d0 msgr2=0x7f3d20055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.583+0000 7f3d45513700 1 --2- 172.21.15.36:0/161342126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d200534d0 0x7f3d20055990 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f3d3400b000 tx=0x7f3d34006df0).stop 2022-01-10T01:29:30.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.583+0000 7f3d45513700 1 -- 172.21.15.36:0/161342126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d400b0010 msgr2=0x7f3d40159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.583+0000 7f3d45513700 1 --2- 172.21.15.36:0/161342126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d400b0010 0x7f3d40159dc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f3d30002f70 tx=0x7f3d30014000).stop 2022-01-10T01:29:30.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.583+0000 7f3d45513700 1 -- 172.21.15.36:0/161342126 shutdown_connections 2022-01-10T01:29:30.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.583+0000 7f3d45513700 1 --2- 172.21.15.36:0/161342126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d200534d0 0x7f3d20055990 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.583+0000 7f3d45513700 1 --2- 172.21.15.36:0/161342126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d400b2580 0x7f3d4015a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.583+0000 7f3d45513700 1 --2- 172.21.15.36:0/161342126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d400b0010 0x7f3d40159dc0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.583+0000 7f3d45513700 1 --2- 172.21.15.36:0/161342126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d400afbd0 0x7f3d4005bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.583+0000 7f3d45513700 1 -- 172.21.15.36:0/161342126 >> 172.21.15.36:0/161342126 conn(0x7f3d40060180 msgr2=0x7f3d401492f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:30.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.583+0000 7f3d45513700 1 -- 172.21.15.36:0/161342126 shutdown_connections 2022-01-10T01:29:30.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.583+0000 7f3d45513700 1 -- 172.21.15.36:0/161342126 wait complete. 2022-01-10T01:29:30.599 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:29:30.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.703+0000 7f3ecc9df700 1 Processor -- start 2022-01-10T01:29:30.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.703+0000 7f3ecc9df700 1 -- start start 2022-01-10T01:29:30.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec80b4710 0x7f3ec813fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3ec81439a0 0x7f3ec8140290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec80b6910 con 0x7f3ec8061680 2022-01-10T01:29:30.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec80b9680 con 0x7f3ec81439a0 2022-01-10T01:29:30.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80b6bb0 con 0x7f3ec80b4710 2022-01-10T01:29:30.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ec759e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3ec81439a0 0x7f3ec8140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ec6d9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f3ec8061680 0x7f3ec80b9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35156/0 (socket says 172.21.15.36:35156) 2022-01-10T01:29:30.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ec6d9d700 1 -- 172.21.15.36:0/3520719906 learned_addr learned my addr 172.21.15.36:0/3520719906 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:30.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ec659c700 1 --2- 172.21.15.36:0/3520719906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec80b4710 0x7f3ec813fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ec759e700 1 -- 172.21.15.36:0/3520719906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec80b4710 msgr2=0x7f3ec813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:30.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ec759e700 1 --2- 172.21.15.36:0/3520719906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec80b4710 0x7f3ec813fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ec759e700 1 -- 172.21.15.36:0/3520719906 >> v1:172.21.15.36:6789/0 conn(0x7f3ec8061680 legacy=0x7f3ec80b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ec5d9b700 1 -- 172.21.15.36:0/3520719906 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199325099 0 0) 0x7f3ec80b6910 con 0x7f3ec8061680 2022-01-10T01:29:30.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ec759e700 1 -- 172.21.15.36:0/3520719906 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec80b6e50 con 0x7f3ec81439a0 2022-01-10T01:29:30.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ec659c700 1 --2- 172.21.15.36:0/3520719906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec80b4710 0x7f3ec813fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:30.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ec759e700 1 --2- 172.21.15.36:0/3520719906 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3ec81439a0 0x7f3ec8140290 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f3ec00032f0 tx=0x7f3ec00091d0).ready entity=mon.0 client_cookie=3bcb048b2c037375 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:30.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ec5d9b700 1 -- 172.21.15.36:0/3520719906 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ec0009ea0 con 0x7f3ec81439a0 2022-01-10T01:29:30.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ec5d9b700 1 -- 172.21.15.36:0/3520719906 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec000b8a0 con 0x7f3ec81439a0 2022-01-10T01:29:30.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ec5d9b700 1 -- 172.21.15.36:0/3520719906 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ec000ba10 con 0x7f3ec81439a0 2022-01-10T01:29:30.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 -- 172.21.15.36:0/3520719906 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3ec81439a0 msgr2=0x7f3ec8140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 --2- 172.21.15.36:0/3520719906 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3ec81439a0 0x7f3ec8140290 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f3ec00032f0 tx=0x7f3ec00091d0).stop 2022-01-10T01:29:30.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 -- 172.21.15.36:0/3520719906 shutdown_connections 2022-01-10T01:29:30.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 --2- 172.21.15.36:0/3520719906 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3ec81439a0 0x7f3ec8140290 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 --2- 172.21.15.36:0/3520719906 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec80b4710 0x7f3ec813fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 -- 172.21.15.36:0/3520719906 >> 172.21.15.36:0/3520719906 conn(0x7f3ec806adf0 msgr2=0x7f3ec805f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:30.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 -- 172.21.15.36:0/3520719906 shutdown_connections 2022-01-10T01:29:30.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 -- 172.21.15.36:0/3520719906 wait complete. 2022-01-10T01:29:30.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 Processor -- start 2022-01-10T01:29:30.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.707+0000 7f3ecc9df700 1 -- start start 2022-01-10T01:29:30.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ecc9df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec8061680 0x7f3ec81561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ecc9df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec81439a0 0x7f3ec8152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ecc9df700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3ec813ee50 0x7f3ec8152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ecc9df700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec81441d0 con 0x7f3ec813ee50 2022-01-10T01:29:30.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ecc9df700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec81522b0 con 0x7f3ec81439a0 2022-01-10T01:29:30.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ecc9df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec81566c0 con 0x7f3ec8061680 2022-01-10T01:29:30.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ec759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3ec813ee50 0x7f3ec8152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ec759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3ec813ee50 0x7f3ec8152e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37368/0 (socket says 172.21.15.36:37368) 2022-01-10T01:29:30.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ec759e700 1 -- 172.21.15.36:0/1379457270 learned_addr learned my addr 172.21.15.36:0/1379457270 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:30.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ec6d9d700 1 --2- 172.21.15.36:0/1379457270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec8061680 0x7f3ec81561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ec659c700 1 --2- 172.21.15.36:0/1379457270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec81439a0 0x7f3ec8152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ec759e700 1 -- 172.21.15.36:0/1379457270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec8061680 msgr2=0x7f3ec81561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ec759e700 1 --2- 172.21.15.36:0/1379457270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec8061680 0x7f3ec81561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ec759e700 1 -- 172.21.15.36:0/1379457270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec81439a0 msgr2=0x7f3ec8152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ec759e700 1 --2- 172.21.15.36:0/1379457270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec81439a0 0x7f3ec8152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ec759e700 1 -- 172.21.15.36:0/1379457270 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0009470 con 0x7f3ec813ee50 2022-01-10T01:29:30.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ec759e700 1 --2- 172.21.15.36:0/1379457270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3ec813ee50 0x7f3ec8152e30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f3ec80ad930 tx=0x7f3ec0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:30.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3eb7fff700 1 -- 172.21.15.36:0/1379457270 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ec0009ea0 con 0x7f3ec813ee50 2022-01-10T01:29:30.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3eb7fff700 1 -- 172.21.15.36:0/1379457270 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec0021630 con 0x7f3ec813ee50 2022-01-10T01:29:30.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ecc9df700 1 -- 172.21.15.36:0/1379457270 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec81443c0 con 0x7f3ec813ee50 2022-01-10T01:29:30.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3eb7fff700 1 -- 172.21.15.36:0/1379457270 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ec0021990 con 0x7f3ec813ee50 2022-01-10T01:29:30.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ecc9df700 1 -- 172.21.15.36:0/1379457270 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec81524a0 con 0x7f3ec813ee50 2022-01-10T01:29:30.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.711+0000 7f3ecc9df700 1 -- 172.21.15.36:0/1379457270 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec8152660 con 0x7f3ec813ee50 2022-01-10T01:29:30.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.715+0000 7f3eb7fff700 1 -- 172.21.15.36:0/1379457270 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3ec0027020 con 0x7f3ec813ee50 2022-01-10T01:29:30.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.715+0000 7f3eb7fff700 1 --2- 172.21.15.36:0/1379457270 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ea40535f0 0x7f3ea4055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.715+0000 7f3eb7fff700 1 -- 172.21.15.36:0/1379457270 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3ec006d120 con 0x7f3ec813ee50 2022-01-10T01:29:30.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.715+0000 7f3ec6d9d700 1 --2- 172.21.15.36:0/1379457270 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ea40535f0 0x7f3ea4055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.715+0000 7f3ec6d9d700 1 --2- 172.21.15.36:0/1379457270 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ea40535f0 0x7f3ea4055ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f3eb800d000 tx=0x7f3eb80011a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:30.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.719+0000 7f3eb7fff700 1 -- 172.21.15.36:0/1379457270 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3ec0044130 con 0x7f3ec813ee50 2022-01-10T01:29:30.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.847+0000 7f3ecc9df700 1 -- 172.21.15.36:0/1379457270 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3ec8057350 con 0x7f3ec813ee50 2022-01-10T01:29:30.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.847+0000 7f3eb7fff700 1 -- 172.21.15.36:0/1379457270 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v67) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3ec00150a0 con 0x7f3ec813ee50 2022-01-10T01:29:30.850 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:29:30.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.851+0000 7f3ecc9df700 1 -- 172.21.15.36:0/1379457270 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ea40535f0 msgr2=0x7f3ea4055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.851+0000 7f3ecc9df700 1 --2- 172.21.15.36:0/1379457270 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ea40535f0 0x7f3ea4055ab0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f3eb800d000 tx=0x7f3eb80011a0).stop 2022-01-10T01:29:30.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.851+0000 7f3ecc9df700 1 -- 172.21.15.36:0/1379457270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3ec813ee50 msgr2=0x7f3ec8152e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.851+0000 7f3ecc9df700 1 --2- 172.21.15.36:0/1379457270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3ec813ee50 0x7f3ec8152e30 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f3ec80ad930 tx=0x7f3ec0016000).stop 2022-01-10T01:29:30.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.851+0000 7f3ecc9df700 1 -- 172.21.15.36:0/1379457270 shutdown_connections 2022-01-10T01:29:30.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.851+0000 7f3ecc9df700 1 --2- 172.21.15.36:0/1379457270 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ea40535f0 0x7f3ea4055ab0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.851+0000 7f3ecc9df700 1 --2- 172.21.15.36:0/1379457270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3ec813ee50 0x7f3ec8152e30 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.851+0000 7f3ecc9df700 1 --2- 172.21.15.36:0/1379457270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ec81439a0 0x7f3ec8152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.851+0000 7f3ecc9df700 1 --2- 172.21.15.36:0/1379457270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3ec8061680 0x7f3ec81561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.851+0000 7f3ecc9df700 1 -- 172.21.15.36:0/1379457270 >> 172.21.15.36:0/1379457270 conn(0x7f3ec806adf0 msgr2=0x7f3ec8142210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:30.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.851+0000 7f3ecc9df700 1 -- 172.21.15.36:0/1379457270 shutdown_connections 2022-01-10T01:29:30.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.851+0000 7f3ecc9df700 1 -- 172.21.15.36:0/1379457270 wait complete. 2022-01-10T01:29:30.863 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:29:30.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.963+0000 7fcad9bf2700 1 Processor -- start 2022-01-10T01:29:30.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.963+0000 7fcad9bf2700 1 -- start start 2022-01-10T01:29:30.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcad40b7370 0x7fcad40b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fcad40b3060 0x7fcad413e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcad413e710 0x7fcad4064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad40b2380 con 0x7fcad40b3060 2022-01-10T01:29:30.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad4144250 con 0x7fcad40b7370 2022-01-10T01:29:30.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40b3570 con 0x7fcad413e710 2022-01-10T01:29:30.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fcad40b3060 0x7fcad413e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fcad40b3060 0x7fcad413e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37372/0 (socket says 172.21.15.36:37372) 2022-01-10T01:29:30.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad3fff700 1 -- 172.21.15.36:0/535398823 learned_addr learned my addr 172.21.15.36:0/535398823 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:30.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad8bf0700 1 --2- 172.21.15.36:0/535398823 >> v2:172.21.15.59:3300/0 conn(0x7fcad40b7370 0x7fcad40b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad93f1700 1 --2- 172.21.15.36:0/535398823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcad413e710 0x7fcad4064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad3fff700 1 -- 172.21.15.36:0/535398823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcad413e710 msgr2=0x7fcad4064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:30.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad3fff700 1 --2- 172.21.15.36:0/535398823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcad413e710 0x7fcad4064ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad3fff700 1 -- 172.21.15.36:0/535398823 >> v2:172.21.15.59:3300/0 conn(0x7fcad40b7370 msgr2=0x7fcad40b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:30.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad3fff700 1 --2- 172.21.15.36:0/535398823 >> v2:172.21.15.59:3300/0 conn(0x7fcad40b7370 0x7fcad40b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad3fff700 1 -- 172.21.15.36:0/535398823 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad40b25b0 con 0x7fcad40b3060 2022-01-10T01:29:30.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad93f1700 1 --2- 172.21.15.36:0/535398823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcad413e710 0x7fcad4064ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:30.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad3fff700 1 --2- 172.21.15.36:0/535398823 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcad40b3060 0x7fcad413e220 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fcabc002f70 tx=0x7fcabc006eb0).ready entity=mon.0 client_cookie=44955bd2412a4da6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:30.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad37fe700 1 -- 172.21.15.36:0/535398823 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcabc00d570 con 0x7fcad40b3060 2022-01-10T01:29:30.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad37fe700 1 -- 172.21.15.36:0/535398823 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc000e90 con 0x7fcad40b3060 2022-01-10T01:29:30.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad37fe700 1 -- 172.21.15.36:0/535398823 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcabc00d900 con 0x7fcad40b3060 2022-01-10T01:29:30.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 -- 172.21.15.36:0/535398823 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcad40b3060 msgr2=0x7fcad413e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 --2- 172.21.15.36:0/535398823 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcad40b3060 0x7fcad413e220 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fcabc002f70 tx=0x7fcabc006eb0).stop 2022-01-10T01:29:30.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 -- 172.21.15.36:0/535398823 shutdown_connections 2022-01-10T01:29:30.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 --2- 172.21.15.36:0/535398823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcad413e710 0x7fcad4064ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 --2- 172.21.15.36:0/535398823 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcad40b3060 0x7fcad413e220 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 --2- 172.21.15.36:0/535398823 >> v2:172.21.15.59:3300/0 conn(0x7fcad40b7370 0x7fcad40b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 -- 172.21.15.36:0/535398823 >> 172.21.15.36:0/535398823 conn(0x7fcad405f6b0 msgr2=0x7fcad405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:30.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 -- 172.21.15.36:0/535398823 shutdown_connections 2022-01-10T01:29:30.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.967+0000 7fcad9bf2700 1 -- 172.21.15.36:0/535398823 wait complete. 2022-01-10T01:29:30.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad9bf2700 1 Processor -- start 2022-01-10T01:29:30.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad9bf2700 1 -- start start 2022-01-10T01:29:30.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad9bf2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcad40b3060 0x7fcad4141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad9bf2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcad40b7370 0x7fcad40add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad9bf2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcad413e710 0x7fcad40607c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad9bf2700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40b1b40 con 0x7fcad413e710 2022-01-10T01:29:30.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad9bf2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40b1d20 con 0x7fcad40b3060 2022-01-10T01:29:30.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad9bf2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad4140c10 con 0x7fcad40b7370 2022-01-10T01:29:30.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad93f1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcad413e710 0x7fcad40607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad93f1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcad413e710 0x7fcad40607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37382/0 (socket says 172.21.15.36:37382) 2022-01-10T01:29:30.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad93f1700 1 -- 172.21.15.36:0/1239703776 learned_addr learned my addr 172.21.15.36:0/1239703776 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:30.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad8bf0700 1 --2- 172.21.15.36:0/1239703776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcad40b3060 0x7fcad4141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad3fff700 1 --2- 172.21.15.36:0/1239703776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcad40b7370 0x7fcad40add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad8bf0700 1 -- 172.21.15.36:0/1239703776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcad40b7370 msgr2=0x7fcad40add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad8bf0700 1 --2- 172.21.15.36:0/1239703776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcad40b7370 0x7fcad40add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad8bf0700 1 -- 172.21.15.36:0/1239703776 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcad413e710 msgr2=0x7fcad40607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:30.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad8bf0700 1 --2- 172.21.15.36:0/1239703776 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcad413e710 0x7fcad40607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:30.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad8bf0700 1 -- 172.21.15.36:0/1239703776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc00b1e0 con 0x7fcad40b3060 2022-01-10T01:29:30.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad8bf0700 1 --2- 172.21.15.36:0/1239703776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcad40b3060 0x7fcad4141350 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fcad41409e0 tx=0x7fcac4006d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:30.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad1ffb700 1 -- 172.21.15.36:0/1239703776 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac40104c0 con 0x7fcad40b3060 2022-01-10T01:29:30.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad1ffb700 1 -- 172.21.15.36:0/1239703776 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac4010620 con 0x7fcad40b3060 2022-01-10T01:29:30.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad9bf2700 1 -- 172.21.15.36:0/1239703776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad4140eb0 con 0x7fcad40b3060 2022-01-10T01:29:30.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad1ffb700 1 -- 172.21.15.36:0/1239703776 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcac4010980 con 0x7fcad40b3060 2022-01-10T01:29:30.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.971+0000 7fcad9bf2700 1 -- 172.21.15.36:0/1239703776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad413f590 con 0x7fcad40b3060 2022-01-10T01:29:30.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.975+0000 7fcad9bf2700 1 -- 172.21.15.36:0/1239703776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad40b1e90 con 0x7fcad40b3060 2022-01-10T01:29:30.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.975+0000 7fcad1ffb700 1 -- 172.21.15.36:0/1239703776 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fcac4010ae0 con 0x7fcad40b3060 2022-01-10T01:29:30.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.975+0000 7fcad1ffb700 1 --2- 172.21.15.36:0/1239703776 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcab80535f0 0x7fcab8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:30.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.975+0000 7fcad1ffb700 1 -- 172.21.15.36:0/1239703776 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcac406b4b0 con 0x7fcad40b3060 2022-01-10T01:29:30.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.975+0000 7fcad3fff700 1 --2- 172.21.15.36:0/1239703776 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcab80535f0 0x7fcab8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:30.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.975+0000 7fcad3fff700 1 --2- 172.21.15.36:0/1239703776 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcab80535f0 0x7fcab8055ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fcabc01c000 tx=0x7fcabc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:30.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:30.983+0000 7fcad1ffb700 1 -- 172.21.15.36:0/1239703776 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcad40b1e90 con 0x7fcad40b3060 2022-01-10T01:29:31.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.115+0000 7fcad9bf2700 1 -- 172.21.15.36:0/1239703776 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcad40b1e60 con 0x7fcad40b3060 2022-01-10T01:29:31.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.115+0000 7fcad1ffb700 1 -- 172.21.15.36:0/1239703776 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) v1 ==== 104+0+10 (secure 0 0 0) 0x7fcac4042570 con 0x7fcad40b3060 2022-01-10T01:29:31.116 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:29:31.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.115+0000 7fcad9bf2700 1 -- 172.21.15.36:0/1239703776 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcab80535f0 msgr2=0x7fcab8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:31.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.115+0000 7fcad9bf2700 1 --2- 172.21.15.36:0/1239703776 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcab80535f0 0x7fcab8055ab0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fcabc01c000 tx=0x7fcabc015000).stop 2022-01-10T01:29:31.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.115+0000 7fcad9bf2700 1 -- 172.21.15.36:0/1239703776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcad40b3060 msgr2=0x7fcad4141350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:31.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.115+0000 7fcad9bf2700 1 --2- 172.21.15.36:0/1239703776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcad40b3060 0x7fcad4141350 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fcad41409e0 tx=0x7fcac4006d90).stop 2022-01-10T01:29:31.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.115+0000 7fcad9bf2700 1 -- 172.21.15.36:0/1239703776 shutdown_connections 2022-01-10T01:29:31.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.115+0000 7fcad9bf2700 1 --2- 172.21.15.36:0/1239703776 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcab80535f0 0x7fcab8055ab0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.115+0000 7fcad9bf2700 1 --2- 172.21.15.36:0/1239703776 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcad413e710 0x7fcad40607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.115+0000 7fcad9bf2700 1 --2- 172.21.15.36:0/1239703776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcad40b7370 0x7fcad40add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.115+0000 7fcad9bf2700 1 --2- 172.21.15.36:0/1239703776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcad40b3060 0x7fcad4141350 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.115+0000 7fcad9bf2700 1 -- 172.21.15.36:0/1239703776 >> 172.21.15.36:0/1239703776 conn(0x7fcad405f6b0 msgr2=0x7fcad4142e70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:31.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.115+0000 7fcad9bf2700 1 -- 172.21.15.36:0/1239703776 shutdown_connections 2022-01-10T01:29:31.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.115+0000 7fcad9bf2700 1 -- 172.21.15.36:0/1239703776 wait complete. 2022-01-10T01:29:31.129 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:29:31.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.235+0000 7f81ecaae700 1 Processor -- start 2022-01-10T01:29:31.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.235+0000 7f81ecaae700 1 -- start start 2022-01-10T01:29:31.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.235+0000 7f81ecaae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81e80b6290 0x7f81e8061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:31.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.235+0000 7f81ecaae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e80b4060 0x7f81e8061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:31.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.235+0000 7f81ecaae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e80b5f50 con 0x7f81e8061e50 2022-01-10T01:29:31.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.235+0000 7f81ecaae700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e80b1f70 con 0x7f81e80b6290 2022-01-10T01:29:31.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.235+0000 7f81ecaae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80b2210 con 0x7f81e80b4060 2022-01-10T01:29:31.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81e77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81e80b6290 0x7f81e8061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:31.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81e6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e80b4060 0x7f81e8061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:31.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81e77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81e80b6290 0x7f81e8061470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:34020/0 (socket says 172.21.15.36:34020) 2022-01-10T01:29:31.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81e77fe700 1 -- 172.21.15.36:0/1010696065 learned_addr learned my addr 172.21.15.36:0/1010696065 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:31.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81e77fe700 1 -- 172.21.15.36:0/1010696065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e80b4060 msgr2=0x7f81e8061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:31.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81e77fe700 1 --2- 172.21.15.36:0/1010696065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e80b4060 0x7f81e8061960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81e77fe700 1 -- 172.21.15.36:0/1010696065 >> v1:172.21.15.59:6789/0 conn(0x7f81e8061e50 legacy=0x7f81e8146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:31.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81e77fe700 1 -- 172.21.15.36:0/1010696065 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e80b24b0 con 0x7f81e80b6290 2022-01-10T01:29:31.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81e77fe700 1 --2- 172.21.15.36:0/1010696065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80b6290 0x7f81e8061470 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f81d80032f0 tx=0x7f81d8009290).ready entity=mon.1 client_cookie=b5bb16fec4dbea50 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:31.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81e67fc700 1 -- 172.21.15.36:0/1010696065 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d800b8a0 con 0x7f81e80b6290 2022-01-10T01:29:31.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81e67fc700 1 -- 172.21.15.36:0/1010696065 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d800ba00 con 0x7f81e80b6290 2022-01-10T01:29:31.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81e67fc700 1 -- 172.21.15.36:0/1010696065 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d800bb70 con 0x7f81e80b6290 2022-01-10T01:29:31.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81ecaae700 1 -- 172.21.15.36:0/1010696065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80b6290 msgr2=0x7f81e8061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:31.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81ecaae700 1 --2- 172.21.15.36:0/1010696065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80b6290 0x7f81e8061470 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f81d80032f0 tx=0x7f81d8009290).stop 2022-01-10T01:29:31.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81ecaae700 1 -- 172.21.15.36:0/1010696065 shutdown_connections 2022-01-10T01:29:31.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81ecaae700 1 --2- 172.21.15.36:0/1010696065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e80b4060 0x7f81e8061960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81ecaae700 1 --2- 172.21.15.36:0/1010696065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80b6290 0x7f81e8061470 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81ecaae700 1 -- 172.21.15.36:0/1010696065 >> 172.21.15.36:0/1010696065 conn(0x7f81e805c490 msgr2=0x7f81e805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:31.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81ecaae700 1 -- 172.21.15.36:0/1010696065 shutdown_connections 2022-01-10T01:29:31.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81ecaae700 1 -- 172.21.15.36:0/1010696065 wait complete. 2022-01-10T01:29:31.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81ecaae700 1 Processor -- start 2022-01-10T01:29:31.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81ecaae700 1 -- start start 2022-01-10T01:29:31.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81ecaae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e8061e50 0x7f81e8143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:31.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.239+0000 7f81ecaae700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81e80b4060 0x7f81e80b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:31.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81ecaae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80b6290 0x7f81e8156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:31.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81ecaae700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e81527e0 con 0x7f81e80b4060 2022-01-10T01:29:31.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81ecaae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80b0390 con 0x7f81e80b6290 2022-01-10T01:29:31.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81ecaae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80b0630 con 0x7f81e8061e50 2022-01-10T01:29:31.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e6ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81e80b4060 0x7f81e80b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:31.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e6ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81e80b4060 0x7f81e80b8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37394/0 (socket says 172.21.15.36:37394) 2022-01-10T01:29:31.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e8061e50 0x7f81e8143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:31.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e6ffd700 1 -- 172.21.15.36:0/3224441142 learned_addr learned my addr 172.21.15.36:0/3224441142 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:31.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e7fff700 1 --2- 172.21.15.36:0/3224441142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80b6290 0x7f81e8156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:31.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e6ffd700 1 -- 172.21.15.36:0/3224441142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e8061e50 msgr2=0x7f81e8143100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:31.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e6ffd700 1 --2- 172.21.15.36:0/3224441142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e8061e50 0x7f81e8143100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e6ffd700 1 -- 172.21.15.36:0/3224441142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80b6290 msgr2=0x7f81e8156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:31.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e6ffd700 1 --2- 172.21.15.36:0/3224441142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80b6290 0x7f81e8156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e6ffd700 1 -- 172.21.15.36:0/3224441142 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d8009530 con 0x7f81e80b4060 2022-01-10T01:29:31.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e6ffd700 1 --2- 172.21.15.36:0/3224441142 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81e80b4060 0x7f81e80b8d50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f81dc00c000 tx=0x7f81dc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:31.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e4ff9700 1 -- 172.21.15.36:0/3224441142 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81dc010590 con 0x7f81e80b4060 2022-01-10T01:29:31.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e4ff9700 1 -- 172.21.15.36:0/3224441142 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc0106f0 con 0x7f81e80b4060 2022-01-10T01:29:31.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81ecaae700 1 -- 172.21.15.36:0/3224441142 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e80b08d0 con 0x7f81e80b4060 2022-01-10T01:29:31.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e4ff9700 1 -- 172.21.15.36:0/3224441142 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81dc010a50 con 0x7f81e80b4060 2022-01-10T01:29:31.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81ecaae700 1 -- 172.21.15.36:0/3224441142 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e80afec0 con 0x7f81e80b4060 2022-01-10T01:29:31.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81ecaae700 1 -- 172.21.15.36:0/3224441142 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e80b2750 con 0x7f81e80b4060 2022-01-10T01:29:31.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e4ff9700 1 -- 172.21.15.36:0/3224441142 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f81dc010bb0 con 0x7f81e80b4060 2022-01-10T01:29:31.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.243+0000 7f81e4ff9700 1 --2- 172.21.15.36:0/3224441142 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81c80536b0 0x7f81c8055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:31.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.247+0000 7f81e4ff9700 1 -- 172.21.15.36:0/3224441142 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f81dc06ba60 con 0x7f81e80b4060 2022-01-10T01:29:31.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.247+0000 7f81e77fe700 1 --2- 172.21.15.36:0/3224441142 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81c80536b0 0x7f81c8055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:31.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.247+0000 7f81e77fe700 1 --2- 172.21.15.36:0/3224441142 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81c80536b0 0x7f81c8055b70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f81d801b000 tx=0x7f81d8016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:31.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.251+0000 7f81e4ff9700 1 -- 172.21.15.36:0/3224441142 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f81dc0429d0 con 0x7f81e80b4060 2022-01-10T01:29:31.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.375+0000 7f81ecaae700 1 -- 172.21.15.36:0/3224441142 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81e8057350 con 0x7f81e80b4060 2022-01-10T01:29:31.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.375+0000 7f81e4ff9700 1 -- 172.21.15.36:0/3224441142 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) v1 ==== 100+0+10 (secure 0 0 0) 0x7f81dc045ff0 con 0x7f81e80b4060 2022-01-10T01:29:31.378 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:29:31.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.379+0000 7f81ecaae700 1 -- 172.21.15.36:0/3224441142 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81c80536b0 msgr2=0x7f81c8055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:31.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.379+0000 7f81ecaae700 1 --2- 172.21.15.36:0/3224441142 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81c80536b0 0x7f81c8055b70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f81d801b000 tx=0x7f81d8016000).stop 2022-01-10T01:29:31.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.379+0000 7f81ecaae700 1 -- 172.21.15.36:0/3224441142 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81e80b4060 msgr2=0x7f81e80b8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:31.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.379+0000 7f81ecaae700 1 --2- 172.21.15.36:0/3224441142 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81e80b4060 0x7f81e80b8d50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f81dc00c000 tx=0x7f81dc006df0).stop 2022-01-10T01:29:31.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.379+0000 7f81ecaae700 1 -- 172.21.15.36:0/3224441142 shutdown_connections 2022-01-10T01:29:31.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.379+0000 7f81ecaae700 1 --2- 172.21.15.36:0/3224441142 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81c80536b0 0x7f81c8055b70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.379+0000 7f81ecaae700 1 --2- 172.21.15.36:0/3224441142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e80b6290 0x7f81e8156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.379+0000 7f81ecaae700 1 --2- 172.21.15.36:0/3224441142 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81e80b4060 0x7f81e80b8d50 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.379+0000 7f81ecaae700 1 --2- 172.21.15.36:0/3224441142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e8061e50 0x7f81e8143100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.379+0000 7f81ecaae700 1 -- 172.21.15.36:0/3224441142 >> 172.21.15.36:0/3224441142 conn(0x7f81e805c490 msgr2=0x7f81e80b7260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:31.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.379+0000 7f81ecaae700 1 -- 172.21.15.36:0/3224441142 shutdown_connections 2022-01-10T01:29:31.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.379+0000 7f81ecaae700 1 -- 172.21.15.36:0/3224441142 wait complete. 2022-01-10T01:29:31.391 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:29:31.392 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:29:31.490 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:29:31.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64affff700 1 Processor -- start 2022-01-10T01:29:31.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64affff700 1 -- start start 2022-01-10T01:29:31.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:29:31.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64affff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64b00b2580 0x7f64b014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:31.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64affff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f64b00b0010 0x7f64b014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:31.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64affff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f64b00afbd0 0x7f64b00a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:31.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64affff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b00a70c0 con 0x7f64b00afbd0 2022-01-10T01:29:31.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64affff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b00a72f0 con 0x7f64b00b0010 2022-01-10T01:29:31.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64affff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00a7590 con 0x7f64b00b2580 2022-01-10T01:29:31.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64af7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f64b00afbd0 0x7f64b00a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:31.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64af7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f64b00afbd0 0x7f64b00a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37404/0 (socket says 172.21.15.36:37404) 2022-01-10T01:29:31.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64af7fe700 1 -- 172.21.15.36:0/3740104242 learned_addr learned my addr 172.21.15.36:0/3740104242 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:31.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64ae7fc700 1 --2- 172.21.15.36:0/3740104242 >> v2:172.21.15.59:3300/0 conn(0x7f64b00b0010 0x7f64b014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:31.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64aeffd700 1 --2- 172.21.15.36:0/3740104242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64b00b2580 0x7f64b014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:31.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64af7fe700 1 -- 172.21.15.36:0/3740104242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64b00b2580 msgr2=0x7f64b014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:31.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64af7fe700 1 --2- 172.21.15.36:0/3740104242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64b00b2580 0x7f64b014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64af7fe700 1 -- 172.21.15.36:0/3740104242 >> v2:172.21.15.59:3300/0 conn(0x7f64b00b0010 msgr2=0x7f64b014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:31.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64af7fe700 1 --2- 172.21.15.36:0/3740104242 >> v2:172.21.15.59:3300/0 conn(0x7f64b00b0010 0x7f64b014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64af7fe700 1 -- 172.21.15.36:0/3740104242 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b00a7830 con 0x7f64b00afbd0 2022-01-10T01:29:31.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64ae7fc700 1 --2- 172.21.15.36:0/3740104242 >> v2:172.21.15.59:3300/0 conn(0x7f64b00b0010 0x7f64b014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:31.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64af7fe700 1 --2- 172.21.15.36:0/3740104242 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64b00afbd0 0x7f64b00a83b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f64a8002f70 tx=0x7f64a8006eb0).ready entity=mon.0 client_cookie=b4913a8c82f39885 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:31.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64adffb700 1 -- 172.21.15.36:0/3740104242 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a800d570 con 0x7f64b00afbd0 2022-01-10T01:29:31.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64adffb700 1 -- 172.21.15.36:0/3740104242 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a8000e90 con 0x7f64b00afbd0 2022-01-10T01:29:31.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.491+0000 7f64adffb700 1 -- 172.21.15.36:0/3740104242 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a800d900 con 0x7f64b00afbd0 2022-01-10T01:29:31.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.495+0000 7f64affff700 1 -- 172.21.15.36:0/3740104242 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64b00afbd0 msgr2=0x7f64b00a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:31.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.495+0000 7f64affff700 1 --2- 172.21.15.36:0/3740104242 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64b00afbd0 0x7f64b00a83b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f64a8002f70 tx=0x7f64a8006eb0).stop 2022-01-10T01:29:31.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.495+0000 7f64affff700 1 -- 172.21.15.36:0/3740104242 shutdown_connections 2022-01-10T01:29:31.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.495+0000 7f64affff700 1 --2- 172.21.15.36:0/3740104242 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64b00afbd0 0x7f64b00a83b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.495+0000 7f64affff700 1 --2- 172.21.15.36:0/3740104242 >> v2:172.21.15.59:3300/0 conn(0x7f64b00b0010 0x7f64b014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.495+0000 7f64affff700 1 --2- 172.21.15.36:0/3740104242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64b00b2580 0x7f64b014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.495+0000 7f64affff700 1 -- 172.21.15.36:0/3740104242 >> 172.21.15.36:0/3740104242 conn(0x7f64b0060180 msgr2=0x7f64b00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:31.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.495+0000 7f64affff700 1 -- 172.21.15.36:0/3740104242 shutdown_connections 2022-01-10T01:29:31.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.495+0000 7f64affff700 1 -- 172.21.15.36:0/3740104242 wait complete. 2022-01-10T01:29:31.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.495+0000 7f64affff700 1 Processor -- start 2022-01-10T01:29:31.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.495+0000 7f64affff700 1 -- start start 2022-01-10T01:29:31.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64affff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64b00afbd0 0x7f64b00b4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:31.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64affff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64b00b0010 0x7f64b014cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:31.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64affff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64b00b2580 0x7f64b0141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:31.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64affff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00b5e00 con 0x7f64b00b0010 2022-01-10T01:29:31.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64affff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b0143ae0 con 0x7f64b00afbd0 2022-01-10T01:29:31.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64affff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b0143d80 con 0x7f64b00b2580 2022-01-10T01:29:31.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64ae7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64b00b0010 0x7f64b014cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:31.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64ae7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64b00b0010 0x7f64b014cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37408/0 (socket says 172.21.15.36:37408) 2022-01-10T01:29:31.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64aeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64b00afbd0 0x7f64b00b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:31.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64ae7fc700 1 -- 172.21.15.36:0/3189744856 learned_addr learned my addr 172.21.15.36:0/3189744856 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:31.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64af7fe700 1 --2- 172.21.15.36:0/3189744856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64b00b2580 0x7f64b0141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:31.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64aeffd700 1 -- 172.21.15.36:0/3189744856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64b00b2580 msgr2=0x7f64b0141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:31.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64aeffd700 1 --2- 172.21.15.36:0/3189744856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64b00b2580 0x7f64b0141520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64aeffd700 1 -- 172.21.15.36:0/3189744856 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64b00b0010 msgr2=0x7f64b014cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:31.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64aeffd700 1 --2- 172.21.15.36:0/3189744856 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64b00b0010 0x7f64b014cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64aeffd700 1 -- 172.21.15.36:0/3189744856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a0009470 con 0x7f64b00afbd0 2022-01-10T01:29:31.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64af7fe700 1 --2- 172.21.15.36:0/3189744856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64b00b2580 0x7f64b0141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:31.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64aeffd700 1 --2- 172.21.15.36:0/3189744856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64b00afbd0 0x7f64b00b4470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f64a400c000 tx=0x7f64a4006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:31.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f649ffff700 1 -- 172.21.15.36:0/3189744856 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a4016070 con 0x7f64b00afbd0 2022-01-10T01:29:31.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f649ffff700 1 -- 172.21.15.36:0/3189744856 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a4011750 con 0x7f64b00afbd0 2022-01-10T01:29:31.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64affff700 1 -- 172.21.15.36:0/3189744856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a800b1e0 con 0x7f64b00afbd0 2022-01-10T01:29:31.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f649ffff700 1 -- 172.21.15.36:0/3189744856 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64a4011ab0 con 0x7f64b00afbd0 2022-01-10T01:29:31.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.499+0000 7f64affff700 1 -- 172.21.15.36:0/3189744856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b0156d30 con 0x7f64b00afbd0 2022-01-10T01:29:31.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.503+0000 7f64affff700 1 -- 172.21.15.36:0/3189744856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b0057350 con 0x7f64b00afbd0 2022-01-10T01:29:31.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.503+0000 7f649ffff700 1 -- 172.21.15.36:0/3189744856 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f64a4011c10 con 0x7f64b00afbd0 2022-01-10T01:29:31.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.503+0000 7f649ffff700 1 --2- 172.21.15.36:0/3189744856 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f648c053680 0x7f648c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:31.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.503+0000 7f649ffff700 1 -- 172.21.15.36:0/3189744856 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f64a406ba00 con 0x7f64b00afbd0 2022-01-10T01:29:31.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.503+0000 7f64ae7fc700 1 --2- 172.21.15.36:0/3189744856 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f648c053680 0x7f648c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:31.513 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:29:31.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.503+0000 7f64ae7fc700 1 --2- 172.21.15.36:0/3189744856 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f648c053680 0x7f648c055b40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f64a000b000 tx=0x7f64a00091d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:31.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.515+0000 7f649ffff700 1 -- 172.21.15.36:0/3189744856 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f64a40429b0 con 0x7f64b00afbd0 2022-01-10T01:29:31.516 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:29:31.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.683+0000 7f64affff700 1 -- 172.21.15.36:0/3189744856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64b00698e0 con 0x7f64b00afbd0 2022-01-10T01:29:31.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.683+0000 7f649ffff700 1 -- 172.21.15.36:0/3189744856 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f64a4045fd0 con 0x7f64b00afbd0 2022-01-10T01:29:31.684 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:31.684 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":29,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6836/1674052345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":1674052345},{"type":"v1","addr":"172.21.15.36:6836","nonce":1674052345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27},{"gid":5919,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/3906479610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":3906479610},{"type":"v1","addr":"172.21.15.36:6837","nonce":3906479610}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:29:27.060192+0000","modified":"2022-01-10T01:29:28.063204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5922},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5922":{"gid":5922,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1356140607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1356140607},{"type":"v1","addr":"172.21.15.59:6833","nonce":1356140607}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2022-01-10T01:29:31.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.683+0000 7f64affff700 1 -- 172.21.15.36:0/3189744856 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f648c053680 msgr2=0x7f648c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:31.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.683+0000 7f64affff700 1 --2- 172.21.15.36:0/3189744856 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f648c053680 0x7f648c055b40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f64a000b000 tx=0x7f64a00091d0).stop 2022-01-10T01:29:31.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.683+0000 7f64affff700 1 -- 172.21.15.36:0/3189744856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64b00afbd0 msgr2=0x7f64b00b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:31.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.683+0000 7f64affff700 1 --2- 172.21.15.36:0/3189744856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64b00afbd0 0x7f64b00b4470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f64a400c000 tx=0x7f64a4006df0).stop 2022-01-10T01:29:31.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.683+0000 7f64affff700 1 -- 172.21.15.36:0/3189744856 shutdown_connections 2022-01-10T01:29:31.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.683+0000 7f64affff700 1 --2- 172.21.15.36:0/3189744856 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f648c053680 0x7f648c055b40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.683+0000 7f64affff700 1 --2- 172.21.15.36:0/3189744856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f64b00b2580 0x7f64b0141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.683+0000 7f64affff700 1 --2- 172.21.15.36:0/3189744856 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64b00b0010 0x7f64b014cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.683+0000 7f64affff700 1 --2- 172.21.15.36:0/3189744856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64b00afbd0 0x7f64b00b4470 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:31.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.683+0000 7f64affff700 1 -- 172.21.15.36:0/3189744856 >> 172.21.15.36:0/3189744856 conn(0x7f64b0060180 msgr2=0x7f64b0144ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:31.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.683+0000 7f64affff700 1 -- 172.21.15.36:0/3189744856 shutdown_connections 2022-01-10T01:29:31.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:31.683+0000 7f64affff700 1 -- 172.21.15.36:0/3189744856 wait complete. 2022-01-10T01:29:31.689 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 29 2022-01-10T01:29:32.000 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:29:27.060192+0000', 'modified': '2022-01-10T01:29:28.063204+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5922}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5922': {'gid': 5922, 'name': 'b', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/1356140607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1356140607}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 1356140607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:29:32.001 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:29:32.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:29:32.118 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":5922,"want_state":"up:active","state":"up:active","rank_uptime":5.0466939159999997,"mdsmap_epoch":29,"osdmap_epoch":67,"osdmap_epoch_barrier":66,"uptime":9.7908349109999993} 2022-01-10T01:29:32.119 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 5922, "mdsmap_epoch": 29, "osdmap_epoch": 67, "osdmap_epoch_barrier": 66, "rank_uptime": 5.046693916, "state": "up:active", "uptime": 9.790834911, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:29:32.120 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:29:32.120 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:29:32.121 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:29:32.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:32.121 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:29:32.130 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:29:32.146 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:29:32.146 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:29:32.200 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:29:32.201 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:29:32.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:32.203 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:29:32.209 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:29:32.210 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:29:32.212 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:29:32.227 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:29:32.227 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:29:32.286 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:29:32.285+0000 7f83ddfe7080 -1 init, newargv = 0x563535fffaf0 newargc=9ceph-fuse[14513]: starting ceph client 2022-01-10T01:29:32.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr: 2022-01-10T01:29:32.289 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:29:32.290 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:29:32.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:32.291 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:29:32.296 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14513]: starting fuse 2022-01-10T01:29:32.298 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:29:32.299 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:29:32.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:32.299 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:29:32.300 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:29:32.300 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:29:32.301 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:29:32.301 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:29:32.301 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:29:32.302 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:29:32.302 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:29:32.303 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:29:32.303 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:29:32.303 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:29:32.304 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:29:32.304 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:29:32.305 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:29:32.305 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:29:32.306 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:29:32.306 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:29:32.306 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:29:32.307 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:29:32.307 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:29:32.308 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:29:32.308 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:29:32.308 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:29:32.350 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.14513.asok 2022-01-10T01:29:32.355 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14513.asok 2022-01-10T01:29:32.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:32.356 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14513.asok status 2022-01-10T01:29:32.489 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:29:32.490 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:29:32.490 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:29:32.490 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:29:32.491 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:29:32.491 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:29:32.491 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:29:32.491 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "14513", 2022-01-10T01:29:32.492 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:29:32.492 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:29:32.492 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:29:32.492 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:29:32.493 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 6091, 2022-01-10T01:29:32.493 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:29:32.493 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:29:32.493 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:29:32.493 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 6091 2022-01-10T01:29:32.494 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:29:32.494 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:29:32.494 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:29:32.494 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:29:32.494 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 1380682107 2022-01-10T01:29:32.495 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:29:32.495 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:29:32.495 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:29:32.495 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:29:32.496 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:29:32.496 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 1380682107 2022-01-10T01:29:32.496 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:29:32.496 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.6091 172.21.15.139:0/1380682107", 2022-01-10T01:29:32.497 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/1380682107", 2022-01-10T01:29:32.497 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:29:32.497 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 29, 2022-01-10T01:29:32.497 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 67, 2022-01-10T01:29:32.498 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:29:32.498 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:29:32.498 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:29:32.498 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:29:32.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:32.500 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:29:32.501 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:29:32.509 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:29:32.510 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:29:32.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:32.511 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:29:32.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:32.528 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:29:32.528 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:29:32.578 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:29:32.579 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:29:32.580 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-01-10T01:29:32.580 DEBUG:teuthology.orchestra.run.smithi139:> import sys 2022-01-10T01:29:32.581 DEBUG:teuthology.orchestra.run.smithi139:> import time 2022-01-10T01:29:32.581 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:29:32.582 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:29:32.582 DEBUG:teuthology.orchestra.run.smithi139:> n = 1000 2022-01-10T01:29:32.582 DEBUG:teuthology.orchestra.run.smithi139:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2022-01-10T01:29:32.583 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:29:32.583 DEBUG:teuthology.orchestra.run.smithi139:> if not os.path.exists(os.path.dirname(abs_path)): 2022-01-10T01:29:32.584 DEBUG:teuthology.orchestra.run.smithi139:> os.makedirs(os.path.dirname(abs_path)) 2022-01-10T01:29:32.584 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:29:32.584 DEBUG:teuthology.orchestra.run.smithi139:> for i in range(0, n): 2022-01-10T01:29:32.585 DEBUG:teuthology.orchestra.run.smithi139:> fname = "{0}_{1}".format(abs_path, i) 2022-01-10T01:29:32.585 DEBUG:teuthology.orchestra.run.smithi139:> with open(fname, '"'"'w'"'"') as f: 2022-01-10T01:29:32.586 DEBUG:teuthology.orchestra.run.smithi139:> f.write('"'"'content'"'"') 2022-01-10T01:29:32.586 DEBUG:teuthology.orchestra.run.smithi139:> if True: 2022-01-10T01:29:32.587 DEBUG:teuthology.orchestra.run.smithi139:> f.flush() 2022-01-10T01:29:32.587 DEBUG:teuthology.orchestra.run.smithi139:> os.fsync(f.fileno()) 2022-01-10T01:29:32.587 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:29:44.273 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:29:44.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.383+0000 7ff9acb9d700 1 Processor -- start 2022-01-10T01:29:44.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.383+0000 7ff9acb9d700 1 -- start start 2022-01-10T01:29:44.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9acb9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9a80665f0 0x7ff9a80669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:44.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9acb9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff9a8140cb0 0x7ff9a813e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:44.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9acb9d700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a805f750 con 0x7ff9a80b1a30 2022-01-10T01:29:44.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9acb9d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a80b14a0 con 0x7ff9a8140cb0 2022-01-10T01:29:44.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9acb9d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a805f980 con 0x7ff9a80665f0 2022-01-10T01:29:44.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff99effd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff9a80b1a30 0x7ff9a805fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35208/0 (socket says 172.21.15.36:35208) 2022-01-10T01:29:44.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff99effd700 1 -- 172.21.15.36:0/1695468347 learned_addr learned my addr 172.21.15.36:0/1695468347 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:44.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9a7fff700 1 --2- 172.21.15.36:0/1695468347 >> v2:172.21.15.59:3300/0 conn(0x7ff9a8140cb0 0x7ff9a813e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:44.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9a77fe700 1 --2- 172.21.15.36:0/1695468347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9a80665f0 0x7ff9a80669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:44.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9a6ffd700 1 -- 172.21.15.36:0/1695468347 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88267285 0 0) 0x7ff9a805f750 con 0x7ff9a80b1a30 2022-01-10T01:29:44.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9a6ffd700 1 -- 172.21.15.36:0/1695468347 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff988003260 con 0x7ff9a80b1a30 2022-01-10T01:29:44.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9a7fff700 1 -- 172.21.15.36:0/1695468347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9a80665f0 msgr2=0x7ff9a80669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:44.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9a7fff700 1 --2- 172.21.15.36:0/1695468347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9a80665f0 0x7ff9a80669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9a7fff700 1 -- 172.21.15.36:0/1695468347 >> v1:172.21.15.36:6789/0 conn(0x7ff9a80b1a30 legacy=0x7ff9a805fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:44.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9a6ffd700 1 -- 172.21.15.36:0/1695468347 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 517513220 0 0) 0x7ff988003260 con 0x7ff9a80b1a30 2022-01-10T01:29:44.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9a7fff700 1 -- 172.21.15.36:0/1695468347 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a80b1740 con 0x7ff9a8140cb0 2022-01-10T01:29:44.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9a7fff700 1 --2- 172.21.15.36:0/1695468347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9a8140cb0 0x7ff9a813e120 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7ff990001800 tx=0x7ff9a00091d0).ready entity=mon.1 client_cookie=c4f2f7d54310fd14 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:44.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9a6ffd700 1 -- 172.21.15.36:0/1695468347 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff990001660 con 0x7ff9a8140cb0 2022-01-10T01:29:44.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9a6ffd700 1 -- 172.21.15.36:0/1695468347 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a000f510 con 0x7ff9a8140cb0 2022-01-10T01:29:44.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9a6ffd700 1 -- 172.21.15.36:0/1695468347 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9a000f680 con 0x7ff9a8140cb0 2022-01-10T01:29:44.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9acb9d700 1 -- 172.21.15.36:0/1695468347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9a8140cb0 msgr2=0x7ff9a813e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:44.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9acb9d700 1 --2- 172.21.15.36:0/1695468347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9a8140cb0 0x7ff9a813e120 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7ff990001800 tx=0x7ff9a00091d0).stop 2022-01-10T01:29:44.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9acb9d700 1 -- 172.21.15.36:0/1695468347 shutdown_connections 2022-01-10T01:29:44.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9acb9d700 1 --2- 172.21.15.36:0/1695468347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9a8140cb0 0x7ff9a813e120 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9acb9d700 1 --2- 172.21.15.36:0/1695468347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9a80665f0 0x7ff9a80669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9acb9d700 1 -- 172.21.15.36:0/1695468347 >> 172.21.15.36:0/1695468347 conn(0x7ff9a80636e0 msgr2=0x7ff9a8063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:44.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.387+0000 7ff9acb9d700 1 -- 172.21.15.36:0/1695468347 shutdown_connections 2022-01-10T01:29:44.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.391+0000 7ff9acb9d700 1 -- 172.21.15.36:0/1695468347 wait complete. 2022-01-10T01:29:44.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.391+0000 7ff9acb9d700 1 Processor -- start 2022-01-10T01:29:44.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.391+0000 7ff9acb9d700 1 -- start start 2022-01-10T01:29:44.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.391+0000 7ff9acb9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9a80665f0 0x7ff9a8153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:44.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.391+0000 7ff9acb9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9a80b1a30 0x7ff9a80b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:44.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.391+0000 7ff9acb9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9a8140cb0 0x7ff9a80af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:44.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.391+0000 7ff9acb9d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a813ebe0 con 0x7ff9a8140cb0 2022-01-10T01:29:44.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.391+0000 7ff9acb9d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a80aaa90 con 0x7ff9a80665f0 2022-01-10T01:29:44.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.391+0000 7ff9acb9d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a80aad30 con 0x7ff9a80b1a30 2022-01-10T01:29:44.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.391+0000 7ff9a7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9a8140cb0 0x7ff9a80af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:44.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.391+0000 7ff9a7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9a8140cb0 0x7ff9a80af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37424/0 (socket says 172.21.15.36:37424) 2022-01-10T01:29:44.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.391+0000 7ff9a7fff700 1 -- 172.21.15.36:0/108151961 learned_addr learned my addr 172.21.15.36:0/108151961 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:44.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.391+0000 7ff99effd700 1 --2- 172.21.15.36:0/108151961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9a80b1a30 0x7ff9a80b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:44.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.391+0000 7ff9a77fe700 1 --2- 172.21.15.36:0/108151961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9a80665f0 0x7ff9a8153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:44.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.395+0000 7ff9a7fff700 1 -- 172.21.15.36:0/108151961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9a80b1a30 msgr2=0x7ff9a80b59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:44.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.395+0000 7ff9a7fff700 1 --2- 172.21.15.36:0/108151961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9a80b1a30 0x7ff9a80b59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.395+0000 7ff9a7fff700 1 -- 172.21.15.36:0/108151961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9a80665f0 msgr2=0x7ff9a8153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:44.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.395+0000 7ff9a7fff700 1 --2- 172.21.15.36:0/108151961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9a80665f0 0x7ff9a8153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.395+0000 7ff9a7fff700 1 -- 172.21.15.36:0/108151961 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a0009470 con 0x7ff9a8140cb0 2022-01-10T01:29:44.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.395+0000 7ff9a7fff700 1 --2- 172.21.15.36:0/108151961 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9a8140cb0 0x7ff9a80af7d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7ff990001800 tx=0x7ff9a0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:44.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.395+0000 7ff9a57fa700 1 -- 172.21.15.36:0/108151961 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9a00032d0 con 0x7ff9a8140cb0 2022-01-10T01:29:44.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.395+0000 7ff9a57fa700 1 -- 172.21.15.36:0/108151961 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a0011c30 con 0x7ff9a8140cb0 2022-01-10T01:29:44.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.395+0000 7ff9acb9d700 1 -- 172.21.15.36:0/108151961 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a80aafd0 con 0x7ff9a8140cb0 2022-01-10T01:29:44.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.395+0000 7ff9a57fa700 1 -- 172.21.15.36:0/108151961 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9a0021440 con 0x7ff9a8140cb0 2022-01-10T01:29:44.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.395+0000 7ff9acb9d700 1 -- 172.21.15.36:0/108151961 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a8142070 con 0x7ff9a8140cb0 2022-01-10T01:29:44.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.395+0000 7ff9acb9d700 1 -- 172.21.15.36:0/108151961 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a8141160 con 0x7ff9a8140cb0 2022-01-10T01:29:44.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.395+0000 7ff9a57fa700 1 -- 172.21.15.36:0/108151961 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff9a000f070 con 0x7ff9a8140cb0 2022-01-10T01:29:44.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.399+0000 7ff9a57fa700 1 --2- 172.21.15.36:0/108151961 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff98c0536b0 0x7ff98c055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:44.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.399+0000 7ff9a77fe700 1 --2- 172.21.15.36:0/108151961 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff98c0536b0 0x7ff98c055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:44.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.399+0000 7ff9a57fa700 1 -- 172.21.15.36:0/108151961 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff9a006ce80 con 0x7ff9a8140cb0 2022-01-10T01:29:44.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.399+0000 7ff9a77fe700 1 --2- 172.21.15.36:0/108151961 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff98c0536b0 0x7ff98c055b70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7ff99800b000 tx=0x7ff998006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:44.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.407+0000 7ff9a57fa700 1 -- 172.21.15.36:0/108151961 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff9a0043ed0 con 0x7ff9a8140cb0 2022-01-10T01:29:44.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.575+0000 7ff9acb9d700 1 -- 172.21.15.36:0/108151961 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9a8057350 con 0x7ff9a8140cb0 2022-01-10T01:29:44.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.575+0000 7ff9a57fa700 1 -- 172.21.15.36:0/108151961 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2493 (secure 0 0 0) 0x7ff9a0015090 con 0x7ff9a8140cb0 2022-01-10T01:29:44.577 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:44.577 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":29,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6836/1674052345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":1674052345},{"type":"v1","addr":"172.21.15.36:6836","nonce":1674052345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27},{"gid":5919,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/3906479610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":3906479610},{"type":"v1","addr":"172.21.15.36:6837","nonce":3906479610}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:29:27.060192+0000","modified":"2022-01-10T01:29:28.063204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5922},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5922":{"gid":5922,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1356140607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1356140607},{"type":"v1","addr":"172.21.15.59:6833","nonce":1356140607}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2022-01-10T01:29:44.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.579+0000 7ff9acb9d700 1 -- 172.21.15.36:0/108151961 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff98c0536b0 msgr2=0x7ff98c055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:44.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.579+0000 7ff9acb9d700 1 --2- 172.21.15.36:0/108151961 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff98c0536b0 0x7ff98c055b70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7ff99800b000 tx=0x7ff998006df0).stop 2022-01-10T01:29:44.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.579+0000 7ff9acb9d700 1 -- 172.21.15.36:0/108151961 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9a8140cb0 msgr2=0x7ff9a80af7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:44.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.579+0000 7ff9acb9d700 1 --2- 172.21.15.36:0/108151961 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9a8140cb0 0x7ff9a80af7d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7ff990001800 tx=0x7ff9a0016000).stop 2022-01-10T01:29:44.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.579+0000 7ff9acb9d700 1 -- 172.21.15.36:0/108151961 shutdown_connections 2022-01-10T01:29:44.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.579+0000 7ff9acb9d700 1 --2- 172.21.15.36:0/108151961 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff98c0536b0 0x7ff98c055b70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.579+0000 7ff9acb9d700 1 --2- 172.21.15.36:0/108151961 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9a8140cb0 0x7ff9a80af7d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.579+0000 7ff9acb9d700 1 --2- 172.21.15.36:0/108151961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9a80b1a30 0x7ff9a80b59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.579+0000 7ff9acb9d700 1 --2- 172.21.15.36:0/108151961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9a80665f0 0x7ff9a8153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.579+0000 7ff9acb9d700 1 -- 172.21.15.36:0/108151961 >> 172.21.15.36:0/108151961 conn(0x7ff9a80636e0 msgr2=0x7ff9a80b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:44.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.579+0000 7ff9acb9d700 1 -- 172.21.15.36:0/108151961 shutdown_connections 2022-01-10T01:29:44.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.579+0000 7ff9acb9d700 1 -- 172.21.15.36:0/108151961 wait complete. 2022-01-10T01:29:44.582 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 29 2022-01-10T01:29:44.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_recall_max_caps 20 2022-01-10T01:29:44.704 INFO:teuthology.orchestra.run.smithi059.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2022-01-10T01:29:44.705 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2022-01-10T01:29:44.706 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:29:44.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 Processor -- start 2022-01-10T01:29:44.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 -- start start 2022-01-10T01:29:44.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a800aa120 0x7f6a800ae440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:44.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a800b0880 0x7f6a801405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:44.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a800b2af0 con 0x7f6a800b04a0 2022-01-10T01:29:44.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a800b2770 con 0x7f6a800b0880 2022-01-10T01:29:44.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800b2d20 con 0x7f6a800aa120 2022-01-10T01:29:44.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a7ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f6a800b04a0 0x7f6a800add30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35222/0 (socket says 172.21.15.36:35222) 2022-01-10T01:29:44.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a7ffff700 1 -- 172.21.15.36:0/3402062962 learned_addr learned my addr 172.21.15.36:0/3402062962 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:44.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a84ab2700 1 --2- 172.21.15.36:0/3402062962 >> v2:172.21.15.59:3300/0 conn(0x7f6a800b0880 0x7f6a801405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:44.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a7f7fe700 1 --2- 172.21.15.36:0/3402062962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a800aa120 0x7f6a800ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:44.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a7effd700 1 -- 172.21.15.36:0/3402062962 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373274941 0 0) 0x7f6a800b2af0 con 0x7f6a800b04a0 2022-01-10T01:29:44.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a7effd700 1 -- 172.21.15.36:0/3402062962 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a60003260 con 0x7f6a800b04a0 2022-01-10T01:29:44.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a84ab2700 1 -- 172.21.15.36:0/3402062962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a800aa120 msgr2=0x7f6a800ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:44.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a84ab2700 1 --2- 172.21.15.36:0/3402062962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a800aa120 0x7f6a800ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a84ab2700 1 -- 172.21.15.36:0/3402062962 >> v1:172.21.15.36:6789/0 conn(0x7f6a800b04a0 legacy=0x7f6a800add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:44.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a84ab2700 1 -- 172.21.15.36:0/3402062962 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a800a9b70 con 0x7f6a800b0880 2022-01-10T01:29:44.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a84ab2700 1 --2- 172.21.15.36:0/3402062962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a800b0880 0x7f6a801405a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f6a78002f70 tx=0x7f6a78006df0).ready entity=mon.1 client_cookie=d0e09da4d19c6771 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:44.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a7effd700 1 -- 172.21.15.36:0/3402062962 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a7800d4a0 con 0x7f6a800b0880 2022-01-10T01:29:44.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a7effd700 1 -- 172.21.15.36:0/3402062962 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a78000e90 con 0x7f6a800b0880 2022-01-10T01:29:44.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a7effd700 1 -- 172.21.15.36:0/3402062962 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a7800d7f0 con 0x7f6a800b0880 2022-01-10T01:29:44.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 -- 172.21.15.36:0/3402062962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a800b0880 msgr2=0x7f6a801405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:44.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 --2- 172.21.15.36:0/3402062962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a800b0880 0x7f6a801405a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f6a78002f70 tx=0x7f6a78006df0).stop 2022-01-10T01:29:44.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 -- 172.21.15.36:0/3402062962 shutdown_connections 2022-01-10T01:29:44.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 --2- 172.21.15.36:0/3402062962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a800b0880 0x7f6a801405a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 --2- 172.21.15.36:0/3402062962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a800aa120 0x7f6a800ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 -- 172.21.15.36:0/3402062962 >> 172.21.15.36:0/3402062962 conn(0x7f6a800607c0 msgr2=0x7f6a80060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:44.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 -- 172.21.15.36:0/3402062962 shutdown_connections 2022-01-10T01:29:44.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.815+0000 7f6a86515700 1 -- 172.21.15.36:0/3402062962 wait complete. 2022-01-10T01:29:44.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.819+0000 7f6a86515700 1 Processor -- start 2022-01-10T01:29:44.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.819+0000 7f6a86515700 1 -- start start 2022-01-10T01:29:44.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.819+0000 7f6a86515700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a800aa120 0x7f6a800ac010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:44.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.819+0000 7f6a86515700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a800b04a0 0x7f6a80066f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:44.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.819+0000 7f6a86515700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a800b0880 0x7f6a80067460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:44.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.819+0000 7f6a86515700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800656b0 con 0x7f6a800aa120 2022-01-10T01:29:44.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.819+0000 7f6a86515700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800603f0 con 0x7f6a800b0880 2022-01-10T01:29:44.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.819+0000 7f6a86515700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800648b0 con 0x7f6a800b04a0 2022-01-10T01:29:44.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.819+0000 7f6a7ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a800aa120 0x7f6a800ac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:44.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.819+0000 7f6a7ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a800aa120 0x7f6a800ac010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37434/0 (socket says 172.21.15.36:37434) 2022-01-10T01:29:44.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.819+0000 7f6a7ffff700 1 -- 172.21.15.36:0/516602604 learned_addr learned my addr 172.21.15.36:0/516602604 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:44.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.819+0000 7f6a7f7fe700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a800b04a0 0x7f6a80066f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:44.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.819+0000 7f6a84ab2700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a800b0880 0x7f6a80067460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:44.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a7ffff700 1 -- 172.21.15.36:0/516602604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a800b04a0 msgr2=0x7f6a80066f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:44.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a7ffff700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a800b04a0 0x7f6a80066f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a7ffff700 1 -- 172.21.15.36:0/516602604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a800b0880 msgr2=0x7f6a80067460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:44.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a7ffff700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a800b0880 0x7f6a80067460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a7ffff700 1 -- 172.21.15.36:0/516602604 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7800b180 con 0x7f6a800aa120 2022-01-10T01:29:44.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a84ab2700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a800b0880 0x7f6a80067460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:44.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a7ffff700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a800aa120 0x7f6a800ac010 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f6a80065e80 tx=0x7f6a68007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:44.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a7d7fa700 1 -- 172.21.15.36:0/516602604 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a6800ce70 con 0x7f6a800aa120 2022-01-10T01:29:44.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a7d7fa700 1 -- 172.21.15.36:0/516602604 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a680070d0 con 0x7f6a800aa120 2022-01-10T01:29:44.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a86515700 1 -- 172.21.15.36:0/516602604 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a80060150 con 0x7f6a800aa120 2022-01-10T01:29:44.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a7d7fa700 1 -- 172.21.15.36:0/516602604 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a68007430 con 0x7f6a800aa120 2022-01-10T01:29:44.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a86515700 1 -- 172.21.15.36:0/516602604 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a800668f0 con 0x7f6a800aa120 2022-01-10T01:29:44.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a86515700 1 -- 172.21.15.36:0/516602604 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a80064ab0 con 0x7f6a800aa120 2022-01-10T01:29:44.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a7d7fa700 1 -- 172.21.15.36:0/516602604 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6a68010070 con 0x7f6a800aa120 2022-01-10T01:29:44.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.823+0000 7f6a7d7fa700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a64053620 0x7f6a64055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:44.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.827+0000 7f6a7d7fa700 1 -- 172.21.15.36:0/516602604 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6a6806af30 con 0x7f6a800aa120 2022-01-10T01:29:44.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.827+0000 7f6a7f7fe700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a64053620 0x7f6a64055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:44.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.827+0000 7f6a7f7fe700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a64053620 0x7f6a64055ae0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f6a7000b000 tx=0x7f6a700091d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:44.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.831+0000 7f6a7d7fa700 1 -- 172.21.15.36:0/516602604 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a68041f40 con 0x7f6a800aa120 2022-01-10T01:29:44.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.991+0000 7f6a86515700 1 -- 172.21.15.36:0/516602604 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a80063a70 con 0x7f6a800aa120 2022-01-10T01:29:44.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.991+0000 7f6a7d7fa700 1 -- 172.21.15.36:0/516602604 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f6a68045560 con 0x7f6a800aa120 2022-01-10T01:29:44.993 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:44.994 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":29,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6836/1674052345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":1674052345},{"type":"v1","addr":"172.21.15.36:6836","nonce":1674052345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27},{"gid":5919,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/3906479610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":3906479610},{"type":"v1","addr":"172.21.15.36:6837","nonce":3906479610}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:29:27.060192+0000","modified":"2022-01-10T01:29:28.063204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5922},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5922":{"gid":5922,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1356140607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1356140607},{"type":"v1","addr":"172.21.15.59:6833","nonce":1356140607}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2022-01-10T01:29:44.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.995+0000 7f6a86515700 1 -- 172.21.15.36:0/516602604 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a64053620 msgr2=0x7f6a64055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:44.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.995+0000 7f6a86515700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a64053620 0x7f6a64055ae0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f6a7000b000 tx=0x7f6a700091d0).stop 2022-01-10T01:29:44.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.995+0000 7f6a86515700 1 -- 172.21.15.36:0/516602604 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a800aa120 msgr2=0x7f6a800ac010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:44.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.995+0000 7f6a86515700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a800aa120 0x7f6a800ac010 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f6a80065e80 tx=0x7f6a68007aa0).stop 2022-01-10T01:29:44.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.995+0000 7f6a86515700 1 -- 172.21.15.36:0/516602604 shutdown_connections 2022-01-10T01:29:44.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.995+0000 7f6a86515700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a64053620 0x7f6a64055ae0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.995+0000 7f6a86515700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a800b0880 0x7f6a80067460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.995+0000 7f6a86515700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a800b04a0 0x7f6a80066f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.995+0000 7f6a86515700 1 --2- 172.21.15.36:0/516602604 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a800aa120 0x7f6a800ac010 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:44.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.995+0000 7f6a86515700 1 -- 172.21.15.36:0/516602604 >> 172.21.15.36:0/516602604 conn(0x7f6a800607c0 msgr2=0x7f6a8013ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:44.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.995+0000 7f6a86515700 1 -- 172.21.15.36:0/516602604 shutdown_connections 2022-01-10T01:29:44.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:44.995+0000 7f6a86515700 1 -- 172.21.15.36:0/516602604 wait complete. 2022-01-10T01:29:45.000 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 29 2022-01-10T01:29:45.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json config set mds_recall_max_decay_threshold 400 2022-01-10T01:29:45.119 INFO:teuthology.orchestra.run.smithi059.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2022-01-10T01:29:45.120 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2022-01-10T01:29:45.120 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:29:45.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.227+0000 7f2942710700 1 Processor -- start 2022-01-10T01:29:45.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.227+0000 7f2942710700 1 -- start start 2022-01-10T01:29:45.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.227+0000 7f2942710700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f293c0b2580 0x7f293c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.227+0000 7f2942710700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f293c0a8ac0 0x7f293c14b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.227+0000 7f2942710700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293c0a70c0 con 0x7f293c0b0010 2022-01-10T01:29:45.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.227+0000 7f2942710700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293c0a72f0 con 0x7f293c0a8ac0 2022-01-10T01:29:45.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.227+0000 7f2942710700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c0a7590 con 0x7f293c0b2580 2022-01-10T01:29:45.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2940f0d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f293c0b0010 0x7f293c0a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35236/0 (socket says 172.21.15.36:35236) 2022-01-10T01:29:45.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2940f0d700 1 -- 172.21.15.36:0/1632785932 learned_addr learned my addr 172.21.15.36:0/1632785932 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:45.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2941f0f700 1 --2- 172.21.15.36:0/1632785932 >> v2:172.21.15.36:3300/0 conn(0x7f293c0a8ac0 0x7f293c14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f294170e700 1 --2- 172.21.15.36:0/1632785932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f293c0b2580 0x7f293c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2933fff700 1 -- 172.21.15.36:0/1632785932 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923123482 0 0) 0x7f293c0a70c0 con 0x7f293c0b0010 2022-01-10T01:29:45.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2933fff700 1 -- 172.21.15.36:0/1632785932 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2920003260 con 0x7f293c0b0010 2022-01-10T01:29:45.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2941f0f700 1 -- 172.21.15.36:0/1632785932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f293c0b2580 msgr2=0x7f293c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:45.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2941f0f700 1 --2- 172.21.15.36:0/1632785932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f293c0b2580 0x7f293c14ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2941f0f700 1 -- 172.21.15.36:0/1632785932 >> v1:172.21.15.36:6789/0 conn(0x7f293c0b0010 legacy=0x7f293c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:45.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2941f0f700 1 -- 172.21.15.36:0/1632785932 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c0a7830 con 0x7f293c0a8ac0 2022-01-10T01:29:45.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f294170e700 1 --2- 172.21.15.36:0/1632785932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f293c0b2580 0x7f293c14ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:45.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2941f0f700 1 --2- 172.21.15.36:0/1632785932 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f293c0a8ac0 0x7f293c14b330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f2934002f70 tx=0x7f2934006df0).ready entity=mon.0 client_cookie=c661d1fee6bf8cb1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:45.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2933fff700 1 -- 172.21.15.36:0/1632785932 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f293400d4a0 con 0x7f293c0a8ac0 2022-01-10T01:29:45.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2933fff700 1 -- 172.21.15.36:0/1632785932 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2934000e90 con 0x7f293c0a8ac0 2022-01-10T01:29:45.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2933fff700 1 -- 172.21.15.36:0/1632785932 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f293400d7f0 con 0x7f293c0a8ac0 2022-01-10T01:29:45.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2942710700 1 -- 172.21.15.36:0/1632785932 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f293c0a8ac0 msgr2=0x7f293c14b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:45.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2942710700 1 --2- 172.21.15.36:0/1632785932 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f293c0a8ac0 0x7f293c14b330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f2934002f70 tx=0x7f2934006df0).stop 2022-01-10T01:29:45.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2942710700 1 -- 172.21.15.36:0/1632785932 shutdown_connections 2022-01-10T01:29:45.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2942710700 1 --2- 172.21.15.36:0/1632785932 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f293c0a8ac0 0x7f293c14b330 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2942710700 1 --2- 172.21.15.36:0/1632785932 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f293c0b2580 0x7f293c14ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2942710700 1 -- 172.21.15.36:0/1632785932 >> 172.21.15.36:0/1632785932 conn(0x7f293c060180 msgr2=0x7f293c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:45.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2942710700 1 -- 172.21.15.36:0/1632785932 shutdown_connections 2022-01-10T01:29:45.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.231+0000 7f2942710700 1 -- 172.21.15.36:0/1632785932 wait complete. 2022-01-10T01:29:45.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2942710700 1 Processor -- start 2022-01-10T01:29:45.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2942710700 1 -- start start 2022-01-10T01:29:45.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2942710700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f293c0a8ac0 0x7f293c0b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2942710700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f293c0b0010 0x7f293c0a9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2942710700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f293c0b2580 0x7f293c0aa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2942710700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c14cc90 con 0x7f293c0b0010 2022-01-10T01:29:45.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2942710700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293c0b3e00 con 0x7f293c0a8ac0 2022-01-10T01:29:45.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2942710700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f293c14c550 con 0x7f293c0b2580 2022-01-10T01:29:45.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2940f0d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f293c0b0010 0x7f293c0a9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2940f0d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f293c0b0010 0x7f293c0a9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37450/0 (socket says 172.21.15.36:37450) 2022-01-10T01:29:45.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2940f0d700 1 -- 172.21.15.36:0/1006680841 learned_addr learned my addr 172.21.15.36:0/1006680841 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:45.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f294170e700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f293c0a8ac0 0x7f293c0b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2941f0f700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f293c0b2580 0x7f293c0aa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2940f0d700 1 -- 172.21.15.36:0/1006680841 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f293c0b2580 msgr2=0x7f293c0aa0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:45.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2940f0d700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f293c0b2580 0x7f293c0aa0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2940f0d700 1 -- 172.21.15.36:0/1006680841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f293c0a8ac0 msgr2=0x7f293c0b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:45.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.235+0000 7f2940f0d700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f293c0a8ac0 0x7f293c0b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.239+0000 7f2940f0d700 1 -- 172.21.15.36:0/1006680841 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292c00b180 con 0x7f293c0b0010 2022-01-10T01:29:45.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.239+0000 7f2941f0f700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f293c0b2580 0x7f293c0aa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:45.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.239+0000 7f2940f0d700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f293c0b0010 0x7f293c0a9bf0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f2938001490 tx=0x7f2938007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:45.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.239+0000 7f29327fc700 1 -- 172.21.15.36:0/1006680841 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2938005ba0 con 0x7f293c0b0010 2022-01-10T01:29:45.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.239+0000 7f29327fc700 1 -- 172.21.15.36:0/1006680841 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2938005d00 con 0x7f293c0b0010 2022-01-10T01:29:45.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.239+0000 7f2942710700 1 -- 172.21.15.36:0/1006680841 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293400b180 con 0x7f293c0b0010 2022-01-10T01:29:45.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.239+0000 7f29327fc700 1 -- 172.21.15.36:0/1006680841 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29380072c0 con 0x7f293c0b0010 2022-01-10T01:29:45.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.239+0000 7f2942710700 1 -- 172.21.15.36:0/1006680841 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293c0b40a0 con 0x7f293c0b0010 2022-01-10T01:29:45.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.239+0000 7f2942710700 1 -- 172.21.15.36:0/1006680841 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293c057350 con 0x7f293c0b0010 2022-01-10T01:29:45.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.239+0000 7f29327fc700 1 -- 172.21.15.36:0/1006680841 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f293801a070 con 0x7f293c0b0010 2022-01-10T01:29:45.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.239+0000 7f29327fc700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2924053590 0x7f2924055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.239+0000 7f29327fc700 1 -- 172.21.15.36:0/1006680841 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f293806b000 con 0x7f293c0b0010 2022-01-10T01:29:45.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.239+0000 7f294170e700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2924053590 0x7f2924055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.243+0000 7f294170e700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2924053590 0x7f2924055a50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f292c00b000 tx=0x7f292c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:45.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.247+0000 7f29327fc700 1 -- 172.21.15.36:0/1006680841 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2938042010 con 0x7f293c0b0010 2022-01-10T01:29:45.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.411+0000 7f2942710700 1 -- 172.21.15.36:0/1006680841 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f293c14c9f0 con 0x7f293c0b0010 2022-01-10T01:29:45.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.411+0000 7f29327fc700 1 -- 172.21.15.36:0/1006680841 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f2938018020 con 0x7f293c0b0010 2022-01-10T01:29:45.412 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:45.412 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":29,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6836/1674052345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":1674052345},{"type":"v1","addr":"172.21.15.36:6836","nonce":1674052345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27},{"gid":5919,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/3906479610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":3906479610},{"type":"v1","addr":"172.21.15.36:6837","nonce":3906479610}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:29:27.060192+0000","modified":"2022-01-10T01:29:28.063204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5922},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5922":{"gid":5922,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1356140607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1356140607},{"type":"v1","addr":"172.21.15.59:6833","nonce":1356140607}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2022-01-10T01:29:45.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.415+0000 7f2942710700 1 -- 172.21.15.36:0/1006680841 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2924053590 msgr2=0x7f2924055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:45.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.415+0000 7f2942710700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2924053590 0x7f2924055a50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f292c00b000 tx=0x7f292c006df0).stop 2022-01-10T01:29:45.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.415+0000 7f2942710700 1 -- 172.21.15.36:0/1006680841 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f293c0b0010 msgr2=0x7f293c0a9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:45.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.415+0000 7f2942710700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f293c0b0010 0x7f293c0a9bf0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f2938001490 tx=0x7f2938007e20).stop 2022-01-10T01:29:45.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.415+0000 7f2942710700 1 -- 172.21.15.36:0/1006680841 shutdown_connections 2022-01-10T01:29:45.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.415+0000 7f2942710700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2924053590 0x7f2924055a50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.415+0000 7f2942710700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f293c0b2580 0x7f293c0aa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.415+0000 7f2942710700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f293c0b0010 0x7f293c0a9bf0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.415+0000 7f2942710700 1 --2- 172.21.15.36:0/1006680841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f293c0a8ac0 0x7f293c0b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.415+0000 7f2942710700 1 -- 172.21.15.36:0/1006680841 >> 172.21.15.36:0/1006680841 conn(0x7f293c060180 msgr2=0x7f293c1486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:45.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.415+0000 7f2942710700 1 -- 172.21.15.36:0/1006680841 shutdown_connections 2022-01-10T01:29:45.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.415+0000 7f2942710700 1 -- 172.21.15.36:0/1006680841 wait complete. 2022-01-10T01:29:45.419 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 29 2022-01-10T01:29:45.432 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b cache drop 10 2022-01-10T01:29:45.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.539+0000 7f9e59229700 1 Processor -- start 2022-01-10T01:29:45.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.539+0000 7f9e59229700 1 -- start start 2022-01-10T01:29:45.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e59229700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9e540af550 0x7f9e541475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e59229700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e540b5880 con 0x7f9e540b54a0 2022-01-10T01:29:45.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e59229700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e540ac800 con 0x7f9e540b0610 2022-01-10T01:29:45.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e59229700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e541452e0 con 0x7f9e540af550 2022-01-10T01:29:45.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e58a28700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9e540af550 0x7f9e541475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e53fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9e540b54a0 0x7f9e540675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35250/0 (socket says 172.21.15.36:35250) 2022-01-10T01:29:45.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e53fff700 1 -- 172.21.15.36:0/2463815701 learned_addr learned my addr 172.21.15.36:0/2463815701 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:45.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e58a28700 1 -- 172.21.15.36:0/2463815701 >> v1:172.21.15.59:6789/0 conn(0x7f9e540b0610 legacy=0x7f9e540acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:45.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e58a28700 1 -- 172.21.15.36:0/2463815701 >> v1:172.21.15.36:6789/0 conn(0x7f9e540b54a0 legacy=0x7f9e540675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:45.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e58a28700 1 -- 172.21.15.36:0/2463815701 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e540b1a30 con 0x7f9e540af550 2022-01-10T01:29:45.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e58a28700 1 --2- 172.21.15.36:0/2463815701 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e540af550 0x7f9e541475a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f9e4c0032f0 tx=0x7f9e4c0091d0).ready entity=mon.0 client_cookie=5c586cf47152017f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:45.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e52ffd700 1 -- 172.21.15.36:0/2463815701 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e4c009ea0 con 0x7f9e540af550 2022-01-10T01:29:45.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e52ffd700 1 -- 172.21.15.36:0/2463815701 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c00b8a0 con 0x7f9e540af550 2022-01-10T01:29:45.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e52ffd700 1 -- 172.21.15.36:0/2463815701 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e4c00ba10 con 0x7f9e540af550 2022-01-10T01:29:45.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e59229700 1 -- 172.21.15.36:0/2463815701 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e540af550 msgr2=0x7f9e541475a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:45.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e59229700 1 --2- 172.21.15.36:0/2463815701 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e540af550 0x7f9e541475a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f9e4c0032f0 tx=0x7f9e4c0091d0).stop 2022-01-10T01:29:45.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e59229700 1 -- 172.21.15.36:0/2463815701 shutdown_connections 2022-01-10T01:29:45.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e59229700 1 --2- 172.21.15.36:0/2463815701 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e540af550 0x7f9e541475a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e59229700 1 -- 172.21.15.36:0/2463815701 >> 172.21.15.36:0/2463815701 conn(0x7f9e54062560 msgr2=0x7f9e54062940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:45.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e59229700 1 -- 172.21.15.36:0/2463815701 shutdown_connections 2022-01-10T01:29:45.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.543+0000 7f9e59229700 1 -- 172.21.15.36:0/2463815701 wait complete. 2022-01-10T01:29:45.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e59229700 1 Processor -- start 2022-01-10T01:29:45.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e59229700 1 -- start start 2022-01-10T01:29:45.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e59229700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e540af550 0x7f9e5414a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e59229700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e540b0610 0x7f9e54142320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e59229700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e540b54a0 0x7f9e54142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e59229700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e540adff0 con 0x7f9e540af550 2022-01-10T01:29:45.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e59229700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e54065ed0 con 0x7f9e540b54a0 2022-01-10T01:29:45.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e59229700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e54064b10 con 0x7f9e540b0610 2022-01-10T01:29:45.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e53fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e540af550 0x7f9e5414a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e53fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e540af550 0x7f9e5414a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37462/0 (socket says 172.21.15.36:37462) 2022-01-10T01:29:45.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e58a28700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e540b54a0 0x7f9e54142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e53fff700 1 -- 172.21.15.36:0/2205966997 learned_addr learned my addr 172.21.15.36:0/2205966997 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:45.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e537fe700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e540b0610 0x7f9e54142320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e53fff700 1 -- 172.21.15.36:0/2205966997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e540b0610 msgr2=0x7f9e54142320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:45.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e53fff700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e540b0610 0x7f9e54142320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e53fff700 1 -- 172.21.15.36:0/2205966997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e540b54a0 msgr2=0x7f9e54142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:45.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e53fff700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e540b54a0 0x7f9e54142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e53fff700 1 -- 172.21.15.36:0/2205966997 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c009470 con 0x7f9e540af550 2022-01-10T01:29:45.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e537fe700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e540b0610 0x7f9e54142320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:45.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e58a28700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e540b54a0 0x7f9e54142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:45.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.547+0000 7f9e53fff700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e540af550 0x7f9e5414a1f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f9e54069d90 tx=0x7f9e48007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:45.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.551+0000 7f9e517fa700 1 -- 172.21.15.36:0/2205966997 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e480070d0 con 0x7f9e540af550 2022-01-10T01:29:45.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.551+0000 7f9e517fa700 1 -- 172.21.15.36:0/2205966997 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e48007230 con 0x7f9e540af550 2022-01-10T01:29:45.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.551+0000 7f9e59229700 1 -- 172.21.15.36:0/2205966997 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e54064db0 con 0x7f9e540af550 2022-01-10T01:29:45.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.551+0000 7f9e517fa700 1 -- 172.21.15.36:0/2205966997 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e48005610 con 0x7f9e540af550 2022-01-10T01:29:45.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.551+0000 7f9e59229700 1 -- 172.21.15.36:0/2205966997 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e541475d0 con 0x7f9e540af550 2022-01-10T01:29:45.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.551+0000 7f9e517fa700 1 -- 172.21.15.36:0/2205966997 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9e48010070 con 0x7f9e540af550 2022-01-10T01:29:45.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.551+0000 7f9e517fa700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e340536b0 0x7f9e34055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.551+0000 7f9e517fa700 1 -- 172.21.15.36:0/2205966997 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9e4806b070 con 0x7f9e540af550 2022-01-10T01:29:45.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.551+0000 7f9e537fe700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e340536b0 0x7f9e34055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.551+0000 7f9e537fe700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e340536b0 0x7f9e34055b70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f9e4400d000 tx=0x7f9e44007b50).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:45.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 Processor -- start 2022-01-10T01:29:45.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 -- start start 2022-01-10T01:29:45.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1820 0x16f8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1c00 0x16f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16f3610 0x16f3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x1642ec0 con 0x16f3610 2022-01-10T01:29:45.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x161d8b0 con 0x16c1820 2022-01-10T01:29:45.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x162fe50 con 0x16c1c00 2022-01-10T01:29:45.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e58a28700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16f3610 0x16f3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e58a28700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16f3610 0x16f3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37474/0 (socket says 172.21.15.36:37474) 2022-01-10T01:29:45.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e58a28700 1 -- 172.21.15.36:0/1847626379 learned_addr learned my addr 172.21.15.36:0/1847626379 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:45.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e53fff700 1 --2- 172.21.15.36:0/1847626379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1820 0x16f8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e537fe700 1 --2- 172.21.15.36:0/1847626379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1c00 0x16f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e58a28700 1 -- 172.21.15.36:0/1847626379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1c00 msgr2=0x16f4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:45.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e58a28700 1 --2- 172.21.15.36:0/1847626379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1c00 0x16f4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e58a28700 1 -- 172.21.15.36:0/1847626379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1820 msgr2=0x16f8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:45.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e58a28700 1 --2- 172.21.15.36:0/1847626379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1820 0x16f8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e58a28700 1 -- 172.21.15.36:0/1847626379 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1669310 con 0x16f3610 2022-01-10T01:29:45.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e537fe700 1 --2- 172.21.15.36:0/1847626379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1c00 0x16f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:45.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e58a28700 1 --2- 172.21.15.36:0/1847626379 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16f3610 0x16f3a90 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x167d200 tx=0x7f9e4c016000).ready entity=mon.0 client_cookie=22dc2130389dceee server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:45.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e59229700 1 -- 172.21.15.36:0/1847626379 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e4c020410 con 0x16f3610 2022-01-10T01:29:45.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e59229700 1 -- 172.21.15.36:0/1847626379 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c020570 con 0x16f3610 2022-01-10T01:29:45.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e59229700 1 -- 172.21.15.36:0/1847626379 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e4c0208d0 con 0x16f3610 2022-01-10T01:29:45.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 -- 172.21.15.36:0/1847626379 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16f3610 msgr2=0x16f3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:45.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1847626379 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16f3610 0x16f3a90 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x167d200 tx=0x7f9e4c016000).stop 2022-01-10T01:29:45.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 -- 172.21.15.36:0/1847626379 shutdown_connections 2022-01-10T01:29:45.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1847626379 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16f3610 0x16f3a90 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1847626379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1c00 0x16f4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1847626379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1820 0x16f8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 -- 172.21.15.36:0/1847626379 >> 172.21.15.36:0/1847626379 conn(0x16496c0 msgr2=0x16befc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:45.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.555+0000 7f9e646ce740 1 -- 172.21.15.36:0/1847626379 shutdown_connections 2022-01-10T01:29:45.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e646ce740 1 -- 172.21.15.36:0/1847626379 wait complete. 2022-01-10T01:29:45.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e646ce740 1 -- start start 2022-01-10T01:29:45.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e646ce740 1 Processor -- start 2022-01-10T01:29:45.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e646ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1820 0x16f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e646ce740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16c1c00 0x16f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e646ce740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16f3610 0x16f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e646ce740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x162ff90 con 0x16c1c00 2022-01-10T01:29:45.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e646ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x16314b0 con 0x16c1820 2022-01-10T01:29:45.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e646ce740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x16f5ca0 con 0x16f3610 2022-01-10T01:29:45.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e537fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16c1c00 0x16f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e646ce740 10 client.0 ll_register_callbacks cb 0x16788f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-01-10T01:29:45.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e537fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16c1c00 0x16f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37478/0 (socket says 172.21.15.36:37478) 2022-01-10T01:29:45.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e537fe700 1 -- 172.21.15.36:0/1101822594 learned_addr learned my addr 172.21.15.36:0/1101822594 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:45.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e53fff700 1 --2- 172.21.15.36:0/1101822594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1820 0x16f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e58a28700 1 --2- 172.21.15.36:0/1101822594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16f3610 0x16f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e537fe700 1 -- 172.21.15.36:0/1101822594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16f3610 msgr2=0x16f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:45.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e537fe700 1 --2- 172.21.15.36:0/1101822594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16f3610 0x16f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e537fe700 1 -- 172.21.15.36:0/1101822594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1820 msgr2=0x16f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:45.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e537fe700 1 --2- 172.21.15.36:0/1101822594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1820 0x16f8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e537fe700 1 -- 172.21.15.36:0/1101822594 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e540b1a30 con 0x16c1c00 2022-01-10T01:29:45.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e537fe700 1 --2- 172.21.15.36:0/1101822594 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16c1c00 0x16f52c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x16f5de0 tx=0x7f9e44003000).ready entity=mon.0 client_cookie=ecd89e534fa643b8 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:45.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.36:3300/0 2022-01-10T01:29:45.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e32ffd700 1 -- 172.21.15.36:0/1101822594 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e44023640 con 0x16c1c00 2022-01-10T01:29:45.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e32ffd700 1 -- 172.21.15.36:0/1101822594 <== mon.0 v2:172.21.15.36:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9e44020c80 con 0x16c1c00 2022-01-10T01:29:45.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e646ce740 1 -- 172.21.15.36:0/1101822594 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x16270d0 con 0x16c1c00 2022-01-10T01:29:45.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e32ffd700 1 -- 172.21.15.36:0/1101822594 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e44020e80 con 0x16c1c00 2022-01-10T01:29:45.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.559+0000 7f9e646ce740 10 client.6114 fetch_fsmap learned FSMap version 29 2022-01-10T01:29:45.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 1 -- 172.21.15.36:0/1101822594 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x16209b0 con 0x16c1c00 2022-01-10T01:29:45.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e32ffd700 1 -- 172.21.15.36:0/1101822594 <== mon.0 v2:172.21.15.36:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x16270d0 con 0x16c1c00 2022-01-10T01:29:45.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e32ffd700 1 -- 172.21.15.36:0/1101822594 <== mon.0 v2:172.21.15.36:3300/0 5 ==== fsmap(e 29) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f9e44020950 con 0x16c1c00 2022-01-10T01:29:45.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 10 client.6114 fetch_fsmap finished waiting for FSMap version 29 2022-01-10T01:29:45.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 10 client.6114 resolve_mds: resolved ID 'b' to GID 5922 2022-01-10T01:29:45.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 20 client.6114 populate_metadata read hostname 'smithi036' 2022-01-10T01:29:45.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1101822594 >> [v2:172.21.15.59:6832/1356140607,v1:172.21.15.59:6833/1356140607] conn(0x16effd0 0x16f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 4 client.6114 mds_command: new command op to 5922 tid=0[{"prefix": "get_command_descriptions"}] 2022-01-10T01:29:45.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 1 -- 172.21.15.36:0/1101822594 --> [v2:172.21.15.59:6832/1356140607,v1:172.21.15.59:6833/1356140607] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x161f440 con 0x16effd0 2022-01-10T01:29:45.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e53fff700 1 --2- 172.21.15.36:0/1101822594 >> [v2:172.21.15.59:6832/1356140607,v1:172.21.15.59:6833/1356140607] conn(0x16effd0 0x16f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e32ffd700 10 client.6114 ms_handle_connect on v2:172.21.15.59:6832/1356140607 2022-01-10T01:29:45.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e53fff700 1 --2- 172.21.15.36:0/1101822594 >> [v2:172.21.15.59:6832/1356140607,v1:172.21.15.59:6833/1356140607] conn(0x16effd0 0x16f03b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b0b69c9206eabaa8 server_cookie=9a68bc503aa60ab3 in_seq=0 out_seq=0 2022-01-10T01:29:45.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e32ffd700 1 -- 172.21.15.36:0/1101822594 <== mds.0 v2:172.21.15.59:6832/1356140607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (crc 0 0 0) 0x161f440 con 0x16effd0 2022-01-10T01:29:45.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e32ffd700 10 client.6114 handle_command_reply: tid=0 2022-01-10T01:29:45.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 1 client.6114 shutdown 2022-01-10T01:29:45.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 1 -- 172.21.15.36:0/1101822594 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16c1c00 msgr2=0x16f52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:45.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1101822594 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16c1c00 0x16f52c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x16f5de0 tx=0x7f9e44003000).stop 2022-01-10T01:29:45.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 1 -- 172.21.15.36:0/1101822594 shutdown_connections 2022-01-10T01:29:45.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1101822594 >> [v2:172.21.15.59:6832/1356140607,v1:172.21.15.59:6833/1356140607] conn(0x16effd0 0x16f03b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1101822594 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16f3610 0x16f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e32ffd700 0 client.6114 ms_handle_reset on v2:172.21.15.59:6832/1356140607 2022-01-10T01:29:45.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1101822594 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16c1c00 0x16f52c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1101822594 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1820 0x16f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 1 -- 172.21.15.36:0/1101822594 >> 172.21.15.36:0/1101822594 conn(0x16496c0 msgr2=0x16bba00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:45.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 1 -- 172.21.15.36:0/1101822594 shutdown_connections 2022-01-10T01:29:45.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 1 -- 172.21.15.36:0/1101822594 wait complete. 2022-01-10T01:29:45.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.563+0000 7f9e646ce740 20 client.6114 trim_cache size 0 max 16384 2022-01-10T01:29:45.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 Processor -- start 2022-01-10T01:29:45.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 -- start start 2022-01-10T01:29:45.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1820 0x16f5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1c00 0x16f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16effd0 0x16f8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x1632a00 con 0x16effd0 2022-01-10T01:29:45.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x16f73f0 con 0x16c1c00 2022-01-10T01:29:45.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x16c52a0 con 0x16c1820 2022-01-10T01:29:45.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e58a28700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16effd0 0x16f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e58a28700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16effd0 0x16f8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37488/0 (socket says 172.21.15.36:37488) 2022-01-10T01:29:45.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e53fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1820 0x16f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e58a28700 1 -- 172.21.15.36:0/1256458459 learned_addr learned my addr 172.21.15.36:0/1256458459 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:45.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e537fe700 1 --2- 172.21.15.36:0/1256458459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1c00 0x16f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e58a28700 1 -- 172.21.15.36:0/1256458459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1820 msgr2=0x16f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:45.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e58a28700 1 --2- 172.21.15.36:0/1256458459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1820 0x16f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e58a28700 1 -- 172.21.15.36:0/1256458459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1c00 msgr2=0x16f15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:45.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e58a28700 1 --2- 172.21.15.36:0/1256458459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1c00 0x16f15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e58a28700 1 -- 172.21.15.36:0/1256458459 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x16292b0 con 0x16effd0 2022-01-10T01:29:45.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e53fff700 1 --2- 172.21.15.36:0/1256458459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1820 0x16f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:45.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e58a28700 1 --2- 172.21.15.36:0/1256458459 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16effd0 0x16f8570 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f9e4c02a000 tx=0x7f9e4c01f000).ready entity=mon.0 client_cookie=58e5cfe34bd0e40c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:45.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e397fa700 1 -- 172.21.15.36:0/1256458459 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e4c02f070 con 0x16effd0 2022-01-10T01:29:45.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e397fa700 1 -- 172.21.15.36:0/1256458459 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c00bdd0 con 0x16effd0 2022-01-10T01:29:45.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e397fa700 1 -- 172.21.15.36:0/1256458459 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e4c020410 con 0x16effd0 2022-01-10T01:29:45.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 -- 172.21.15.36:0/1256458459 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16effd0 msgr2=0x16f8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:45.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1256458459 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16effd0 0x16f8570 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f9e4c02a000 tx=0x7f9e4c01f000).stop 2022-01-10T01:29:45.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 -- 172.21.15.36:0/1256458459 shutdown_connections 2022-01-10T01:29:45.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1256458459 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16effd0 0x16f8570 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1256458459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16c1c00 0x16f15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1256458459 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1820 0x16f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 -- 172.21.15.36:0/1256458459 >> 172.21.15.36:0/1256458459 conn(0x16496c0 msgr2=0x16bba00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:45.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 -- 172.21.15.36:0/1256458459 shutdown_connections 2022-01-10T01:29:45.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.579+0000 7f9e646ce740 1 -- 172.21.15.36:0/1256458459 wait complete. 2022-01-10T01:29:45.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 1 -- start start 2022-01-10T01:29:45.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 1 Processor -- start 2022-01-10T01:29:45.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16c1820 0x1708d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1c00 0x1758650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16effd0 0x1758b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x16f1c90 con 0x16c1820 2022-01-10T01:29:45.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x175bc20 con 0x16effd0 2022-01-10T01:29:45.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x175be50 con 0x16c1c00 2022-01-10T01:29:45.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 10 client.0 ll_register_callbacks cb 0x16c4a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-01-10T01:29:45.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e53fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16c1820 0x1708d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e53fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16c1820 0x1708d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37490/0 (socket says 172.21.15.36:37490) 2022-01-10T01:29:45.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e53fff700 1 -- 172.21.15.36:0/1130176795 learned_addr learned my addr 172.21.15.36:0/1130176795 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:45.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e537fe700 1 --2- 172.21.15.36:0/1130176795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1c00 0x1758650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e58a28700 1 --2- 172.21.15.36:0/1130176795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16effd0 0x1758b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e53fff700 1 -- 172.21.15.36:0/1130176795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1c00 msgr2=0x1758650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:45.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e53fff700 1 --2- 172.21.15.36:0/1130176795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1c00 0x1758650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e53fff700 1 -- 172.21.15.36:0/1130176795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16effd0 msgr2=0x1758b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:45.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e53fff700 1 --2- 172.21.15.36:0/1130176795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16effd0 0x1758b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:45.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e53fff700 1 -- 172.21.15.36:0/1130176795 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e541475d0 con 0x16c1820 2022-01-10T01:29:45.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e53fff700 1 --2- 172.21.15.36:0/1130176795 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16c1820 0x1708d80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f9e4804c000 tx=0x7f9e4800cf90).ready entity=mon.0 client_cookie=c80f23091351194d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:45.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e33fff700 10 client.0 ms_handle_connect on v2:172.21.15.36:3300/0 2022-01-10T01:29:45.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e33fff700 1 -- 172.21.15.36:0/1130176795 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e48044020 con 0x16c1820 2022-01-10T01:29:45.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 1 -- 172.21.15.36:0/1130176795 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9e4c020570 con 0x16c1820 2022-01-10T01:29:45.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e33fff700 1 -- 172.21.15.36:0/1130176795 <== mon.0 v2:172.21.15.36:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9e480450a0 con 0x16c1820 2022-01-10T01:29:45.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e33fff700 1 -- 172.21.15.36:0/1130176795 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e48045260 con 0x16c1820 2022-01-10T01:29:45.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 10 client.6120 fetch_fsmap learned FSMap version 29 2022-01-10T01:29:45.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 1 -- 172.21.15.36:0/1130176795 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x1669310 con 0x16c1820 2022-01-10T01:29:45.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e33fff700 1 -- 172.21.15.36:0/1130176795 <== mon.0 v2:172.21.15.36:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c020570 con 0x16c1820 2022-01-10T01:29:45.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e33fff700 1 -- 172.21.15.36:0/1130176795 <== mon.0 v2:172.21.15.36:3300/0 5 ==== fsmap(e 29) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f9e4800fb30 con 0x16c1820 2022-01-10T01:29:45.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 10 client.6120 fetch_fsmap finished waiting for FSMap version 29 2022-01-10T01:29:45.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 10 client.6120 resolve_mds: resolved ID 'b' to GID 5922 2022-01-10T01:29:45.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 20 client.6120 populate_metadata read hostname 'smithi036' 2022-01-10T01:29:45.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1130176795 >> [v2:172.21.15.59:6832/1356140607,v1:172.21.15.59:6833/1356140607] conn(0x16f3610 0x16f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:45.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 4 client.6120 mds_command: new command op to 5922 tid=0[{"prefix": "cache drop", "timeout": 10}] 2022-01-10T01:29:45.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e646ce740 1 -- 172.21.15.36:0/1130176795 --> [v2:172.21.15.59:6832/1356140607,v1:172.21.15.59:6833/1356140607] -- command(tid 0: {"prefix": "cache drop", "timeout": 10}) v1 -- 0x15155e0 con 0x16f3610 2022-01-10T01:29:45.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.583+0000 7f9e537fe700 1 --2- 172.21.15.36:0/1130176795 >> [v2:172.21.15.59:6832/1356140607,v1:172.21.15.59:6833/1356140607] conn(0x16f3610 0x16f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:45.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.587+0000 7f9e33fff700 10 client.6120 ms_handle_connect on v2:172.21.15.59:6832/1356140607 2022-01-10T01:29:45.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:45.587+0000 7f9e537fe700 1 --2- 172.21.15.36:0/1130176795 >> [v2:172.21.15.59:6832/1356140607,v1:172.21.15.59:6833/1356140607] conn(0x16f3610 0x16f03b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=17224d5f3d82957d server_cookie=960832af10509906 in_seq=0 out_seq=0 2022-01-10T01:29:55.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e33fff700 1 -- 172.21.15.36:0/1130176795 <== mds.0 v2:172.21.15.59:6832/1356140607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+406 (crc 0 0 0) 0x15155e0 con 0x16f3610 2022-01-10T01:29:55.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e33fff700 10 client.6120 handle_command_reply: tid=0 2022-01-10T01:29:55.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e646ce740 1 client.6120 shutdown 2022-01-10T01:29:55.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e646ce740 1 -- 172.21.15.36:0/1130176795 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16c1820 msgr2=0x1708d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:55.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1130176795 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16c1820 0x1708d80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f9e4804c000 tx=0x7f9e4800cf90).stop 2022-01-10T01:29:55.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e646ce740 1 -- 172.21.15.36:0/1130176795 shutdown_connections 2022-01-10T01:29:55.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1130176795 >> [v2:172.21.15.59:6832/1356140607,v1:172.21.15.59:6833/1356140607] conn(0x16f3610 0x16f03b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:55.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1130176795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x16effd0 0x1758b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:55.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e33fff700 0 client.6120 ms_handle_reset on v2:172.21.15.59:6832/1356140607 2022-01-10T01:29:55.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1130176795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x16c1c00 0x1758650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:55.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e646ce740 1 --2- 172.21.15.36:0/1130176795 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x16c1820 0x1708d80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:55.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e646ce740 1 -- 172.21.15.36:0/1130176795 >> 172.21.15.36:0/1130176795 conn(0x16496c0 msgr2=0x1709870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:55.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e646ce740 1 -- 172.21.15.36:0/1130176795 shutdown_connections 2022-01-10T01:29:55.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e646ce740 1 -- 172.21.15.36:0/1130176795 wait complete. 2022-01-10T01:29:55.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e646ce740 20 client.6120 trim_cache size 0 max 16384 2022-01-10T01:29:55.835 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:29:55.836 INFO:teuthology.orchestra.run.smithi036.stdout: "client_recall": { 2022-01-10T01:29:55.836 INFO:teuthology.orchestra.run.smithi036.stdout: "return_code": -110, 2022-01-10T01:29:55.836 INFO:teuthology.orchestra.run.smithi036.stdout: "message": "(110) Connection timed out", 2022-01-10T01:29:55.836 INFO:teuthology.orchestra.run.smithi036.stdout: "recalled": 240 2022-01-10T01:29:55.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:55.837 INFO:teuthology.orchestra.run.smithi036.stdout: "flush_journal": { 2022-01-10T01:29:55.837 INFO:teuthology.orchestra.run.smithi036.stdout: "return_code": 0, 2022-01-10T01:29:55.837 INFO:teuthology.orchestra.run.smithi036.stdout: "message": "" 2022-01-10T01:29:55.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:55.838 INFO:teuthology.orchestra.run.smithi036.stdout: "trim_cache": { 2022-01-10T01:29:55.838 INFO:teuthology.orchestra.run.smithi036.stdout: "trimmed": 220 2022-01-10T01:29:55.838 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:55.839 INFO:teuthology.orchestra.run.smithi036.stdout: "cache": { 2022-01-10T01:29:55.839 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": { 2022-01-10T01:29:55.839 INFO:teuthology.orchestra.run.smithi036.stdout: "items": 15414, 2022-01-10T01:29:55.839 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes": 2428192 2022-01-10T01:29:55.839 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:55.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:55.840 INFO:teuthology.orchestra.run.smithi036.stdout: "duration": 10.243216267999999 2022-01-10T01:29:55.840 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:29:55.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e59229700 1 -- 172.21.15.36:0/2205966997 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e340536b0 msgr2=0x7f9e34055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:55.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e59229700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e340536b0 0x7f9e34055b70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f9e4400d000 tx=0x7f9e44007b50).stop 2022-01-10T01:29:55.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e59229700 1 -- 172.21.15.36:0/2205966997 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e540af550 msgr2=0x7f9e5414a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:55.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e59229700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e540af550 0x7f9e5414a1f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f9e54069d90 tx=0x7f9e48007ca0).stop 2022-01-10T01:29:55.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e59229700 1 -- 172.21.15.36:0/2205966997 shutdown_connections 2022-01-10T01:29:55.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e59229700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e340536b0 0x7f9e34055b70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:55.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e59229700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e540b54a0 0x7f9e54142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:55.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e59229700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e540b0610 0x7f9e54142320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:55.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e59229700 1 --2- 172.21.15.36:0/2205966997 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e540af550 0x7f9e5414a1f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:55.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e59229700 1 -- 172.21.15.36:0/2205966997 >> 172.21.15.36:0/2205966997 conn(0x7f9e54062560 msgr2=0x7f9e54143910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:55.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e59229700 1 -- 172.21.15.36:0/2205966997 shutdown_connections 2022-01-10T01:29:55.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:55.831+0000 7f9e59229700 1 -- 172.21.15.36:0/2205966997 wait complete. 2022-01-10T01:29:55.845 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:29:55.846 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:29:55.863 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:29:55.883 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:29:55.903 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:29:55.924 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:29:55.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:55.925 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:29:55.925 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:29:55.950 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:29:55.951 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:29:55.952 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:29:55.952 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:29:55.952 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:29:55.968 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14513]: fuse finished with error 0 and tester_r 0 2022-01-10T01:29:55.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:55.970 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:29:55.970 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:29:56.017 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:29:56.019 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:29:56.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:29:56.111 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:29:56.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:29:56.118 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:29:56.119 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:29:56.126 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:29:56.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:29:56.127 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:29:56.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:29:56.129 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:29:56.135 INFO:teuthology.orchestra.run.smithi166.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:29:56.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:29:56.137 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:29:56.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.247+0000 7f470359e700 1 Processor -- start 2022-01-10T01:29:56.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.247+0000 7f470359e700 1 -- start start 2022-01-10T01:29:56.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47040b3040 0x7f4704065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:56.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47040a9c10 0x7f47040607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:56.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4704143320 0x7f47041437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:56.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47040648e0 con 0x7f4704143320 2022-01-10T01:29:56.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4704061dd0 con 0x7f47040a9c10 2022-01-10T01:29:56.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4704066ea0 con 0x7f47040b3040 2022-01-10T01:29:56.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f4702d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4704143320 0x7f47041437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:56.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f4702d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4704143320 0x7f47041437b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37502/0 (socket says 172.21.15.36:37502) 2022-01-10T01:29:56.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f4702d9d700 1 -- 172.21.15.36:0/2002414629 learned_addr learned my addr 172.21.15.36:0/2002414629 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:56.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f46f9d9b700 1 --2- 172.21.15.36:0/2002414629 >> v2:172.21.15.59:3300/0 conn(0x7f47040a9c10 0x7f47040607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:56.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470259c700 1 --2- 172.21.15.36:0/2002414629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47040b3040 0x7f4704065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:56.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f4702d9d700 1 -- 172.21.15.36:0/2002414629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47040b3040 msgr2=0x7f4704065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:56.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f4702d9d700 1 --2- 172.21.15.36:0/2002414629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47040b3040 0x7f4704065e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f4702d9d700 1 -- 172.21.15.36:0/2002414629 >> v2:172.21.15.59:3300/0 conn(0x7f47040a9c10 msgr2=0x7f47040607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:56.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f4702d9d700 1 --2- 172.21.15.36:0/2002414629 >> v2:172.21.15.59:3300/0 conn(0x7f47040a9c10 0x7f47040607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f4702d9d700 1 -- 172.21.15.36:0/2002414629 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040b3420 con 0x7f4704143320 2022-01-10T01:29:56.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f46f9d9b700 1 --2- 172.21.15.36:0/2002414629 >> v2:172.21.15.59:3300/0 conn(0x7f47040a9c10 0x7f47040607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:29:56.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f4702d9d700 1 --2- 172.21.15.36:0/2002414629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4704143320 0x7f47041437b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f46fc0032f0 tx=0x7f46fc00b530).ready entity=mon.0 client_cookie=66e8c7dddd91d054 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:56.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f4701d9b700 1 -- 172.21.15.36:0/2002414629 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46fc00be70 con 0x7f4704143320 2022-01-10T01:29:56.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f4701d9b700 1 -- 172.21.15.36:0/2002414629 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc010470 con 0x7f4704143320 2022-01-10T01:29:56.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f4701d9b700 1 -- 172.21.15.36:0/2002414629 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46fc0107d0 con 0x7f4704143320 2022-01-10T01:29:56.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 -- 172.21.15.36:0/2002414629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4704143320 msgr2=0x7f47041437b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:56.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 --2- 172.21.15.36:0/2002414629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4704143320 0x7f47041437b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f46fc0032f0 tx=0x7f46fc00b530).stop 2022-01-10T01:29:56.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 -- 172.21.15.36:0/2002414629 shutdown_connections 2022-01-10T01:29:56.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 --2- 172.21.15.36:0/2002414629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4704143320 0x7f47041437b0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 --2- 172.21.15.36:0/2002414629 >> v2:172.21.15.59:3300/0 conn(0x7f47040a9c10 0x7f47040607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 --2- 172.21.15.36:0/2002414629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47040b3040 0x7f4704065e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 -- 172.21.15.36:0/2002414629 >> 172.21.15.36:0/2002414629 conn(0x7f47040636e0 msgr2=0x7f4704063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:56.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 -- 172.21.15.36:0/2002414629 shutdown_connections 2022-01-10T01:29:56.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.251+0000 7f470359e700 1 -- 172.21.15.36:0/2002414629 wait complete. 2022-01-10T01:29:56.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f470359e700 1 Processor -- start 2022-01-10T01:29:56.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f470359e700 1 -- start start 2022-01-10T01:29:56.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f470359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47040a9c10 0x7f47040b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:56.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f470359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47040b3040 0x7f4704139950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:56.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f470359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4704143320 0x7f4704139e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:56.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f470359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47041403c0 con 0x7f4704143320 2022-01-10T01:29:56.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f470359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470413f330 con 0x7f47040a9c10 2022-01-10T01:29:56.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f470359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470413fd40 con 0x7f47040b3040 2022-01-10T01:29:56.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f4702d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4704143320 0x7f4704139e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:56.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f470259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47040a9c10 0x7f47040b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:56.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f4702d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4704143320 0x7f4704139e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37508/0 (socket says 172.21.15.36:37508) 2022-01-10T01:29:56.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f46f9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47040b3040 0x7f4704139950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:56.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f4702d9d700 1 -- 172.21.15.36:0/2963443670 learned_addr learned my addr 172.21.15.36:0/2963443670 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:56.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f4702d9d700 1 -- 172.21.15.36:0/2963443670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47040b3040 msgr2=0x7f4704139950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:56.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f4702d9d700 1 --2- 172.21.15.36:0/2963443670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47040b3040 0x7f4704139950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f4702d9d700 1 -- 172.21.15.36:0/2963443670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47040a9c10 msgr2=0x7f47040b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:56.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f4702d9d700 1 --2- 172.21.15.36:0/2963443670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47040a9c10 0x7f47040b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f4702d9d700 1 -- 172.21.15.36:0/2963443670 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc00b7d0 con 0x7f4704143320 2022-01-10T01:29:56.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f4702d9d700 1 --2- 172.21.15.36:0/2963443670 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4704143320 0x7f4704139e40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f46fc0032f0 tx=0x7f47040671d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:56.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f46fbfff700 1 -- 172.21.15.36:0/2963443670 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46fc00be70 con 0x7f4704143320 2022-01-10T01:29:56.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f46fbfff700 1 -- 172.21.15.36:0/2963443670 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc018610 con 0x7f4704143320 2022-01-10T01:29:56.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f470359e700 1 -- 172.21.15.36:0/2963443670 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47041395f0 con 0x7f4704143320 2022-01-10T01:29:56.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f46fbfff700 1 -- 172.21.15.36:0/2963443670 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46fc0189b0 con 0x7f4704143320 2022-01-10T01:29:56.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.255+0000 7f470359e700 1 -- 172.21.15.36:0/2963443670 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47040b2920 con 0x7f4704143320 2022-01-10T01:29:56.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.259+0000 7f470359e700 1 -- 172.21.15.36:0/2963443670 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470413ff40 con 0x7f4704143320 2022-01-10T01:29:56.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.259+0000 7f46fbfff700 1 -- 172.21.15.36:0/2963443670 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f46fc021020 con 0x7f4704143320 2022-01-10T01:29:56.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.259+0000 7f46fbfff700 1 --2- 172.21.15.36:0/2963443670 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f46e8053500 0x7f46e80559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:56.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.259+0000 7f46fbfff700 1 -- 172.21.15.36:0/2963443670 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f46fc06fad0 con 0x7f4704143320 2022-01-10T01:29:56.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.259+0000 7f470259c700 1 --2- 172.21.15.36:0/2963443670 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f46e8053500 0x7f46e80559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:56.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.259+0000 7f470259c700 1 --2- 172.21.15.36:0/2963443670 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f46e8053500 0x7f46e80559c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f46f400c000 tx=0x7f46f4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:56.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.267+0000 7f46fbfff700 1 -- 172.21.15.36:0/2963443670 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f46fc046950 con 0x7f4704143320 2022-01-10T01:29:56.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.391+0000 7f470359e700 1 -- 172.21.15.36:0/2963443670 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4704066960 con 0x7f4704143320 2022-01-10T01:29:56.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.395+0000 7f46fbfff700 1 -- 172.21.15.36:0/2963443670 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v67) v1 ==== 81+0+34040 (secure 0 0 0) 0x7f46fc049f70 con 0x7f4704143320 2022-01-10T01:29:56.397 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:56.397 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:29:56.398 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 67, 2022-01-10T01:29:56.398 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:29:56.398 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:29:56.399 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:29:28.063908+0000", 2022-01-10T01:29:56.399 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:29:56.399 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:29:56.399 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:29:56.400 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:29:56.400 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:29:56.400 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:29:56.400 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:29:56.400 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:29:56.401 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:29:56.401 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:29:56.401 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:29:56.401 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:29:56.402 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:29:56.402 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:29:56.402 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:29:56.402 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 12, 2022-01-10T01:29:56.403 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:29:56.403 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:29:56.403 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:29:56.403 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:29:56.403 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:29:56.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.404 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:29:56.404 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:29:56.404 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:29:56.405 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:29:56.405 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:29:56.405 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:29:56.405 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:29:56.405 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:29:56.406 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:29:56.406 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:29:56.406 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:29:56.406 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:29:56.407 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:29:56.407 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:29:56.407 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:29:56.407 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:29:56.408 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:29:56.408 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:29:56.408 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:29:56.408 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:29:56.408 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:29:56.409 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:29:56.409 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:29:56.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.409 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:29:56.410 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:29:56.410 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:29:56.410 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:29:56.410 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:29:56.411 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:29:56.411 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:29:56.411 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:29:56.411 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:29:56.412 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:29:56.412 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:29:56.412 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:29:56.412 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:29:56.412 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:29:56.413 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:29:56.413 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:29:56.413 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:29:56.414 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:29:56.414 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:29:56.414 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:29:56.414 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:29:56.414 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:29:56.415 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:29:56.415 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:29:56.415 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:29:56.415 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:29:56.416 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:29:56.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.416 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:29:56.416 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:29:56.417 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:29:56.417 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:29:56.417 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:29:56.417 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:29:56.418 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:29:56.418 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:29:56.418 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:29:56.418 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:29:56.419 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:29:56.419 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:29:56.419 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:29:56.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.420 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:29:56.420 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:29:56.420 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.421 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:29:56.421 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:29:56.421 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:29:56.422 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:29:56.422 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:29:56.422 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:29:56.422 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:29:56.423 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:29:56.423 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:29:56.423 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:29:56.423 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:29:56.423 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:29:56.424 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:29:56.424 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:29:56.424 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:29:56.424 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:29:56.425 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:29:56.425 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:29:56.425 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:29:56.425 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:29:56.425 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:29:56.426 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:29:56.426 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:29:56.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.426 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:29:56.427 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:29:56.427 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:29:56.427 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:29:56.427 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:29:56.428 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:29:56.428 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:29:56.428 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:29:56.428 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:29:56.428 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:29:56.429 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:29:56.429 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:29:56.429 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:29:56.429 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:29:56.430 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:29:56.430 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:29:56.430 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:29:56.430 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:29:56.430 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:29:56.431 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:29:56.431 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:29:56.431 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:29:56.431 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:29:56.432 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:29:56.432 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:29:56.432 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:29:56.432 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:29:56.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.433 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:29:56.433 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:29:56.433 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:29:56.433 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:29:56.434 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:29:56.434 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:29:56.434 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:29:56.434 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:29:56.434 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:29:56.435 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:29:56.435 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:29:56.435 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:29:56.435 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:29:56.436 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:29:56.436 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.436 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 11, 2022-01-10T01:29:56.437 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_metadata", 2022-01-10T01:29:56.437 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:29:25.099175+0000", 2022-01-10T01:29:56.437 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:29:56.437 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:29:56.438 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:29:56.438 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:29:56.438 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:29:56.438 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:29:56.439 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:29:56.439 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:29:56.439 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:29:56.439 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:29:56.439 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:29:56.440 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:29:56.440 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:29:56.440 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:29:56.440 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:29:56.441 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:29:56.441 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:29:56.441 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:29:56.441 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:29:56.441 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:29:56.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.442 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "66", 2022-01-10T01:29:56.442 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:29:56.442 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:29:56.443 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:29:56.443 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:29:56.443 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:29:56.444 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:29:56.444 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:29:56.444 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:29:56.444 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:29:56.444 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:29:56.445 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:29:56.445 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:29:56.445 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:29:56.445 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:29:56.445 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:29:56.446 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:29:56.446 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:29:56.446 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:29:56.446 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:29:56.447 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:29:56.447 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:29:56.447 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:29:56.447 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:29:56.447 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:29:56.448 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:29:56.448 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:29:56.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.448 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:29:56.449 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:29:56.449 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:29:56.449 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:29:56.449 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:29:56.449 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:29:56.450 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:29:56.450 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:29:56.450 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:29:56.450 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:29:56.451 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:29:56.451 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:29:56.451 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_bias": 4, 2022-01-10T01:29:56.451 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 16, 2022-01-10T01:29:56.452 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_priority": 5 2022-01-10T01:29:56.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.452 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:29:56.452 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:29:56.452 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": "cephfs" 2022-01-10T01:29:56.453 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.453 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.454 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 12, 2022-01-10T01:29:56.454 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_data", 2022-01-10T01:29:56.454 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:29:26.058962+0000", 2022-01-10T01:29:56.454 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:29:56.454 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:29:56.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:29:56.455 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:29:56.455 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:29:56.455 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:29:56.456 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:29:56.456 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:29:56.456 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:29:56.456 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:29:56.456 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:29:56.457 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:29:56.457 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:29:56.457 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:29:56.457 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:29:56.458 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:29:56.458 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:29:56.458 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:29:56.458 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:29:56.458 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:29:56.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.459 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "67", 2022-01-10T01:29:56.459 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:29:56.459 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:29:56.460 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:29:56.460 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:29:56.460 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:29:56.460 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:29:56.461 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:29:56.461 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:29:56.461 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:29:56.461 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:29:56.461 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:29:56.462 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:29:56.462 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:29:56.462 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:29:56.462 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:29:56.463 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:29:56.463 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:29:56.463 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:29:56.463 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:29:56.464 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:29:56.464 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:29:56.464 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:29:56.464 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:29:56.464 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:29:56.465 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:29:56.465 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:29:56.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.465 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:29:56.466 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:29:56.466 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:29:56.466 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:29:56.466 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:29:56.467 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:29:56.467 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:29:56.467 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:29:56.467 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:29:56.468 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:29:56.468 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:29:56.468 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:29:56.468 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:29:56.468 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:29:56.469 INFO:teuthology.orchestra.run.smithi036.stdout: "data": "cephfs" 2022-01-10T01:29:56.469 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.469 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.470 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.470 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:29:56.470 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:29:56.470 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.471 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:29:56.471 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:29:56.471 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:56.471 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:56.471 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:56.472 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:56.472 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:56.472 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:56.472 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:56.473 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 65, 2022-01-10T01:29:56.473 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:56.473 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:56.473 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:56.474 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.474 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.474 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:29:56.475 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:56.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.475 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.475 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:29:56.476 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:56.476 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.477 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.477 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:56.478 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.479 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.479 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:29:56.480 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:56.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.481 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.482 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:29:56.482 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:56.482 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.483 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.484 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:56.484 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.485 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.486 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:29:56.486 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:56.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.487 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.488 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:29:56.488 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:56.489 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.489 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.490 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:56.491 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.491 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.492 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:29:56.492 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:56.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.494 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.494 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:29:56.495 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:29:56.495 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.496 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.496 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:29:56.497 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:29:56.497 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:29:56.498 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:29:56.498 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:56.499 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:56.499 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:56.500 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.501 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:29:56.501 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:29:56.502 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:56.502 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:56.503 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:56.503 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:56.504 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:56.504 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:56.505 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:56.505 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 65, 2022-01-10T01:29:56.505 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:56.506 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:56.506 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:56.507 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.508 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.508 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:29:56.509 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:56.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.510 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.510 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:29:56.511 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:56.511 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.512 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.513 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:56.513 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.513 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.514 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.514 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:29:56.515 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:56.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.516 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.517 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:29:56.517 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:56.517 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.518 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.518 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.519 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:56.519 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.520 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.520 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:29:56.520 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:56.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.521 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.521 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:29:56.521 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:56.521 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.522 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.522 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:56.522 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.523 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.523 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:29:56.523 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:56.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.524 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.524 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:29:56.525 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:29:56.525 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.525 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.525 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:29:56.526 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:29:56.526 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:29:56.526 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:29:56.526 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:56.527 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:56.527 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:56.527 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.528 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:29:56.528 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:29:56.528 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:56.528 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:56.529 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:56.529 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:56.529 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:56.529 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:56.530 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:56.530 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 65, 2022-01-10T01:29:56.530 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:56.530 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:56.530 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:56.531 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.531 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.531 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:29:56.532 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:56.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.532 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.532 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:29:56.533 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:56.533 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.533 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.534 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:56.534 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.534 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.535 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:29:56.535 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:56.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.536 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.536 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:29:56.536 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:56.536 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.536 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.537 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:56.537 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.538 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.538 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:29:56.538 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:56.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.539 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.539 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:29:56.539 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:56.539 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.540 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.540 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:56.540 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.541 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.541 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:29:56.541 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:56.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.542 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.542 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:29:56.542 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:29:56.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.543 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.543 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:29:56.543 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:29:56.544 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:29:56.544 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:29:56.544 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:56.544 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:56.545 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:56.545 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.545 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:29:56.546 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:29:56.546 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:56.546 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:56.546 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:56.547 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:56.547 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:56.547 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:56.547 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:56.547 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 64, 2022-01-10T01:29:56.548 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:56.548 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:56.548 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:56.548 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.549 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.549 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:29:56.549 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:56.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.550 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.550 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:29:56.550 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:56.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.551 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.551 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:56.551 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.552 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.552 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.552 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:29:56.552 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:56.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.553 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.553 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:29:56.554 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:56.554 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.554 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.554 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:56.555 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.555 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.555 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:29:56.556 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:56.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.556 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.556 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.556 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:29:56.557 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:56.557 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.557 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.558 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:56.558 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.558 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.558 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:29:56.559 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:56.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.559 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.559 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.559 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:29:56.560 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:29:56.560 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.560 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.561 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:29:56.561 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:29:56.561 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:29:56.561 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:29:56.561 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:56.562 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:56.562 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:56.562 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.563 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:29:56.563 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:29:56.563 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:56.563 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:56.564 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:56.564 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:56.564 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:56.564 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:56.565 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:56.565 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 65, 2022-01-10T01:29:56.565 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:56.565 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:56.565 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:56.566 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.566 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.566 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:29:56.566 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:56.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.567 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.567 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:29:56.568 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:56.568 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.568 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.568 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:56.569 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.569 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.569 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:29:56.570 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:56.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.570 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.570 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.571 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:29:56.571 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:56.571 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.571 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.572 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:56.572 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.572 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.573 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:29:56.573 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:56.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.573 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.574 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:29:56.574 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:56.574 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.575 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.575 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:56.575 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.576 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.576 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:29:56.576 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:56.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.577 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.577 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:29:56.577 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:29:56.577 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.578 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.578 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:29:56.578 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:29:56.579 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:29:56.579 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:29:56.579 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:56.579 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:56.580 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:56.580 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.580 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.580 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:29:56.581 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:29:56.581 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:56.581 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:56.581 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:56.582 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:56.582 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:56.582 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:56.582 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:56.583 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 64, 2022-01-10T01:29:56.583 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:56.583 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:56.583 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:56.583 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.584 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.584 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:29:56.584 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:56.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.585 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.585 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:29:56.586 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:56.586 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.586 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.586 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:56.587 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.587 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.587 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:29:56.588 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:56.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.588 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.588 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:29:56.589 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:56.589 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.589 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.589 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:56.590 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.590 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.590 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:29:56.591 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:56.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.591 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.591 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.592 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:29:56.592 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:56.592 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.592 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.593 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:56.593 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.594 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.594 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:29:56.594 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:56.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.594 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.595 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.595 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:29:56.595 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:29:56.595 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.596 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.596 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:29:56.596 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:29:56.597 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:29:56.597 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:29:56.597 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:56.597 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:56.597 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:56.598 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.598 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:29:56.598 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:29:56.599 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:56.599 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:56.599 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:56.599 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:56.600 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:56.600 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:56.600 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:56.600 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 65, 2022-01-10T01:29:56.600 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:56.601 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:56.601 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:56.601 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.602 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.602 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:29:56.602 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:56.602 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.603 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.603 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:29:56.603 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:56.603 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.604 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.604 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:56.604 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.605 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.605 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:29:56.605 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:56.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.606 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.606 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:29:56.607 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:56.607 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.607 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.607 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:56.608 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.608 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.608 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:29:56.609 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:56.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.609 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.609 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:29:56.610 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:56.610 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.610 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.611 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:56.611 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.611 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.612 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:29:56.612 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:56.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.612 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.613 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:29:56.613 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:29:56.613 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.613 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.614 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:29:56.614 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:29:56.614 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:29:56.615 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:29:56.615 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:56.615 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:56.615 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:56.616 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.616 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:29:56.617 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:29:56.617 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:29:56.617 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:29:56.617 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:29:56.617 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:29:56.618 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:29:56.618 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:29:56.618 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:29:56.618 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 65, 2022-01-10T01:29:56.619 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:29:56.619 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:29:56.619 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:29:56.619 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.620 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.620 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:29:56.620 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:56.621 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.621 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.621 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:29:56.622 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:56.622 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.622 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.623 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:29:56.623 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.623 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.623 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:29:56.624 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:56.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.624 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.625 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:29:56.625 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:56.625 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.625 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.626 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:29:56.626 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.626 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.627 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:29:56.627 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:56.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.628 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.628 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:29:56.628 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:56.628 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.628 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.629 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:29:56.629 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:29:56.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.630 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:29:56.630 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:29:56.630 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:56.630 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.631 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:29:56.631 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:29:56.631 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:29:56.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.632 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.632 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:29:56.632 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:29:56.632 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:29:56.633 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:29:56.633 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:29:56.633 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:29:56.633 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:29:56.634 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:29:56.634 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.634 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:29:56.634 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:29:56.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.635 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:29:56.635 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:56.635 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:56.635 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:56.636 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:56.636 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:56.636 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:29:56.636 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:56.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.638 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:29:56.638 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:56.639 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:56.639 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:56.639 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:56.640 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:56.640 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:29:56.641 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:56.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.642 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:29:56.643 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:56.643 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:56.644 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:56.644 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:56.644 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:56.645 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:29:56.645 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:56.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.647 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:29:56.647 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:56.647 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:56.647 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:56.648 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:56.648 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:56.648 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:29:56.648 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:56.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.649 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.649 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:29:56.649 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:56.649 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:56.650 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:56.650 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:56.650 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:56.650 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:29:56.651 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:56.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.652 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:29:56.652 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:56.653 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:56.653 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:56.654 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:56.654 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:56.655 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:29:56.655 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:56.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.656 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:29:56.656 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:56.657 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:56.657 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:56.657 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:56.657 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:56.658 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:29:56.658 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:56.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:29:56.659 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:29:56.659 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:29:56.659 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:29:56.659 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:29:56.659 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:29:56.660 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:29:56.660 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:29:56.660 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:29:56.660 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.661 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:29:56.661 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:29:56.661 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:29:56.661 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:29:56.661 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:29:56.662 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2022-01-10T01:29:56.662 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:29:56.662 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:29:56.662 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:29:56.663 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:29:56.663 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:29:56.663 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:29:56.663 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:29:56.663 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:29:56.664 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:29:56.664 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:29:56.664 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:29:56.664 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:29:56.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.665 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:29:56.665 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:29:56.665 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:29:56.665 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:29:56.666 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:29:56.666 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:29:56.666 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:29:56.666 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:29:56.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:29:56.667 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:29:56.667 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:29:56.667 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:29:56.667 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:29:56.668 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:29:56.668 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:29:56.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.395+0000 7f470359e700 1 -- 172.21.15.36:0/2963443670 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f46e8053500 msgr2=0x7f46e80559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:56.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.395+0000 7f470359e700 1 --2- 172.21.15.36:0/2963443670 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f46e8053500 0x7f46e80559c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f46f400c000 tx=0x7f46f4008040).stop 2022-01-10T01:29:56.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.395+0000 7f470359e700 1 -- 172.21.15.36:0/2963443670 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4704143320 msgr2=0x7f4704139e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:56.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.395+0000 7f470359e700 1 --2- 172.21.15.36:0/2963443670 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4704143320 0x7f4704139e40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f46fc0032f0 tx=0x7f47040671d0).stop 2022-01-10T01:29:56.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.399+0000 7f470359e700 1 -- 172.21.15.36:0/2963443670 shutdown_connections 2022-01-10T01:29:56.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.399+0000 7f470359e700 1 --2- 172.21.15.36:0/2963443670 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f46e8053500 0x7f46e80559c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.399+0000 7f470359e700 1 --2- 172.21.15.36:0/2963443670 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4704143320 0x7f4704139e40 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.399+0000 7f470359e700 1 --2- 172.21.15.36:0/2963443670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47040b3040 0x7f4704139950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.399+0000 7f470359e700 1 --2- 172.21.15.36:0/2963443670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47040a9c10 0x7f47040b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.399+0000 7f470359e700 1 -- 172.21.15.36:0/2963443670 >> 172.21.15.36:0/2963443670 conn(0x7f47040636e0 msgr2=0x7f4704141150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:56.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.399+0000 7f470359e700 1 -- 172.21.15.36:0/2963443670 shutdown_connections 2022-01-10T01:29:56.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.399+0000 7f470359e700 1 -- 172.21.15.36:0/2963443670 wait complete. 2022-01-10T01:29:56.674 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:29:56.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f02537ad700 1 Processor -- start 2022-01-10T01:29:56.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f02537ad700 1 -- start start 2022-01-10T01:29:56.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f02537ad700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f024c1483a0 0x7f024c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:56.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f02537ad700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024c0b0350 con 0x7f024c0b1db0 2022-01-10T01:29:56.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f02537ad700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024c0b05f0 con 0x7f024c0a70c0 2022-01-10T01:29:56.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f02537ad700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f024c0a90c0 con 0x7f024c1483a0 2022-01-10T01:29:56.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f0251549700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f024c0b1db0 0x7f024c0b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35306/0 (socket says 172.21.15.36:35306) 2022-01-10T01:29:56.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f0251549700 1 -- 172.21.15.36:0/1979016878 learned_addr learned my addr 172.21.15.36:0/1979016878 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:56.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f0250d48700 1 --2- 172.21.15.36:0/1979016878 >> v2:172.21.15.59:3300/0 conn(0x7f024c1483a0 0x7f024c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:56.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f024bfff700 1 -- 172.21.15.36:0/1979016878 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146744798 0 0) 0x7f024c0b0350 con 0x7f024c0b1db0 2022-01-10T01:29:56.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f024bfff700 1 -- 172.21.15.36:0/1979016878 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0238003260 con 0x7f024c0b1db0 2022-01-10T01:29:56.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f024bfff700 1 -- 172.21.15.36:0/1979016878 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4140164806 0 0) 0x7f0238003260 con 0x7f024c0b1db0 2022-01-10T01:29:56.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f0250d48700 1 -- 172.21.15.36:0/1979016878 >> v1:172.21.15.59:6789/0 conn(0x7f024c0a70c0 legacy=0x7f024c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:56.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f0250d48700 1 -- 172.21.15.36:0/1979016878 >> v1:172.21.15.36:6789/0 conn(0x7f024c0b1db0 legacy=0x7f024c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:56.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f0250d48700 1 -- 172.21.15.36:0/1979016878 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c0b0890 con 0x7f024c1483a0 2022-01-10T01:29:56.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f0250d48700 1 --2- 172.21.15.36:0/1979016878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024c1483a0 0x7f024c0b0fd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f0240001800 tx=0x7f02440091d0).ready entity=mon.1 client_cookie=7349369e4a1ea3d1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:56.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f024bfff700 1 -- 172.21.15.36:0/1979016878 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0240001660 con 0x7f024c1483a0 2022-01-10T01:29:56.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f024bfff700 1 -- 172.21.15.36:0/1979016878 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024400b580 con 0x7f024c1483a0 2022-01-10T01:29:56.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f024bfff700 1 -- 172.21.15.36:0/1979016878 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f024400b6f0 con 0x7f024c1483a0 2022-01-10T01:29:56.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f02537ad700 1 -- 172.21.15.36:0/1979016878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024c1483a0 msgr2=0x7f024c0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:56.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f02537ad700 1 --2- 172.21.15.36:0/1979016878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024c1483a0 0x7f024c0b0fd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f0240001800 tx=0x7f02440091d0).stop 2022-01-10T01:29:56.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f02537ad700 1 -- 172.21.15.36:0/1979016878 shutdown_connections 2022-01-10T01:29:56.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f02537ad700 1 --2- 172.21.15.36:0/1979016878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024c1483a0 0x7f024c0b0fd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f02537ad700 1 -- 172.21.15.36:0/1979016878 >> 172.21.15.36:0/1979016878 conn(0x7f024c05f6b0 msgr2=0x7f024c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:56.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f02537ad700 1 -- 172.21.15.36:0/1979016878 shutdown_connections 2022-01-10T01:29:56.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.783+0000 7f02537ad700 1 -- 172.21.15.36:0/1979016878 wait complete. 2022-01-10T01:29:56.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f02537ad700 1 Processor -- start 2022-01-10T01:29:56.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f02537ad700 1 -- start start 2022-01-10T01:29:56.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f02537ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024c0a70c0 0x7f024c1434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:56.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f02537ad700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f024c0b1db0 0x7f024c1439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:56.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f02537ad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024c1483a0 0x7f024c143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:56.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f02537ad700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c1443b0 con 0x7f024c0b1db0 2022-01-10T01:29:56.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f02537ad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024c14a2d0 con 0x7f024c1483a0 2022-01-10T01:29:56.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f02537ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024c0a95c0 con 0x7f024c0a70c0 2022-01-10T01:29:56.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f0250d48700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f024c0b1db0 0x7f024c1439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:56.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f0251d4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024c1483a0 0x7f024c143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:56.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f0251d4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024c1483a0 0x7f024c143ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:34156/0 (socket says 172.21.15.36:34156) 2022-01-10T01:29:56.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f0251d4a700 1 -- 172.21.15.36:0/3095300274 learned_addr learned my addr 172.21.15.36:0/3095300274 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:56.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f0250d48700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f024c0b1db0 0x7f024c1439d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37520/0 (socket says 172.21.15.36:37520) 2022-01-10T01:29:56.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f0251549700 1 --2- 172.21.15.36:0/3095300274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024c0a70c0 0x7f024c1434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:56.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f0250d48700 1 -- 172.21.15.36:0/3095300274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024c0a70c0 msgr2=0x7f024c1434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:56.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f0250d48700 1 --2- 172.21.15.36:0/3095300274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024c0a70c0 0x7f024c1434e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f0250d48700 1 -- 172.21.15.36:0/3095300274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024c1483a0 msgr2=0x7f024c143ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:56.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f0250d48700 1 --2- 172.21.15.36:0/3095300274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024c1483a0 0x7f024c143ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f0250d48700 1 -- 172.21.15.36:0/3095300274 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0244009470 con 0x7f024c0b1db0 2022-01-10T01:29:56.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f0250d48700 1 --2- 172.21.15.36:0/3095300274 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f024c0b1db0 0x7f024c1439d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f0240001800 tx=0x7f0244016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:56.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f024a7fc700 1 -- 172.21.15.36:0/3095300274 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f024400b6f0 con 0x7f024c0b1db0 2022-01-10T01:29:56.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f024a7fc700 1 -- 172.21.15.36:0/3095300274 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02440032d0 con 0x7f024c0b1db0 2022-01-10T01:29:56.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f02537ad700 1 -- 172.21.15.36:0/3095300274 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024c149a50 con 0x7f024c0b1db0 2022-01-10T01:29:56.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f024a7fc700 1 -- 172.21.15.36:0/3095300274 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02440205e0 con 0x7f024c0b1db0 2022-01-10T01:29:56.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.787+0000 7f02537ad700 1 -- 172.21.15.36:0/3095300274 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024c149710 con 0x7f024c0b1db0 2022-01-10T01:29:56.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.791+0000 7f02537ad700 1 -- 172.21.15.36:0/3095300274 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f024c0b0b30 con 0x7f024c0b1db0 2022-01-10T01:29:56.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.791+0000 7f024a7fc700 1 -- 172.21.15.36:0/3095300274 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f024401e070 con 0x7f024c0b1db0 2022-01-10T01:29:56.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.791+0000 7f024a7fc700 1 --2- 172.21.15.36:0/3095300274 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f022c053560 0x7f022c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:56.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.791+0000 7f024a7fc700 1 -- 172.21.15.36:0/3095300274 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f024406c700 con 0x7f024c0b1db0 2022-01-10T01:29:56.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.791+0000 7f0251549700 1 --2- 172.21.15.36:0/3095300274 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f022c053560 0x7f022c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:56.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.791+0000 7f0251549700 1 --2- 172.21.15.36:0/3095300274 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f022c053560 0x7f022c055a20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f024000d000 tx=0x7f0240000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:56.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.795+0000 7f024a7fc700 1 -- 172.21.15.36:0/3095300274 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0244043710 con 0x7f024c0b1db0 2022-01-10T01:29:56.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.955+0000 7f02537ad700 1 -- 172.21.15.36:0/3095300274 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f024c057350 con 0x7f024c0b1db0 2022-01-10T01:29:56.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.959+0000 7f024a7fc700 1 -- 172.21.15.36:0/3095300274 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f024401b9d0 con 0x7f024c0b1db0 2022-01-10T01:29:56.959 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:56.959 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":29,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6836/1674052345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":1674052345},{"type":"v1","addr":"172.21.15.36:6836","nonce":1674052345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27},{"gid":5919,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/3906479610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":3906479610},{"type":"v1","addr":"172.21.15.36:6837","nonce":3906479610}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:29:27.060192+0000","modified":"2022-01-10T01:29:28.063204+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5922},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5922":{"gid":5922,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/1356140607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1356140607},{"type":"v1","addr":"172.21.15.59:6833","nonce":1356140607}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2022-01-10T01:29:56.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.959+0000 7f02537ad700 1 -- 172.21.15.36:0/3095300274 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f022c053560 msgr2=0x7f022c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:56.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.959+0000 7f02537ad700 1 --2- 172.21.15.36:0/3095300274 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f022c053560 0x7f022c055a20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f024000d000 tx=0x7f0240000bc0).stop 2022-01-10T01:29:56.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.959+0000 7f02537ad700 1 -- 172.21.15.36:0/3095300274 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f024c0b1db0 msgr2=0x7f024c1439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:56.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.959+0000 7f02537ad700 1 --2- 172.21.15.36:0/3095300274 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f024c0b1db0 0x7f024c1439d0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f0240001800 tx=0x7f0244016000).stop 2022-01-10T01:29:56.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.959+0000 7f02537ad700 1 -- 172.21.15.36:0/3095300274 shutdown_connections 2022-01-10T01:29:56.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.959+0000 7f02537ad700 1 --2- 172.21.15.36:0/3095300274 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f022c053560 0x7f022c055a20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.959+0000 7f02537ad700 1 --2- 172.21.15.36:0/3095300274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f024c1483a0 0x7f024c143ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.959+0000 7f02537ad700 1 --2- 172.21.15.36:0/3095300274 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f024c0b1db0 0x7f024c1439d0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.959+0000 7f02537ad700 1 --2- 172.21.15.36:0/3095300274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f024c0a70c0 0x7f024c1434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:56.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.959+0000 7f02537ad700 1 -- 172.21.15.36:0/3095300274 >> 172.21.15.36:0/3095300274 conn(0x7f024c05f6b0 msgr2=0x7f024c0b4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:56.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.959+0000 7f02537ad700 1 -- 172.21.15.36:0/3095300274 shutdown_connections 2022-01-10T01:29:56.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:56.959+0000 7f02537ad700 1 -- 172.21.15.36:0/3095300274 wait complete. 2022-01-10T01:29:56.965 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 29 2022-01-10T01:29:56.972 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2022-01-10T01:29:57.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.075+0000 7fb14b21b700 1 Processor -- start 2022-01-10T01:29:57.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.075+0000 7fb14b21b700 1 -- start start 2022-01-10T01:29:57.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.075+0000 7fb14b21b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb144067300 0x7fb1441438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:57.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.075+0000 7fb14b21b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb144143de0 0x7fb14414b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:57.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.075+0000 7fb14b21b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1440aabb0 con 0x7fb144060100 2022-01-10T01:29:57.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.075+0000 7fb14b21b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1440604e0 con 0x7fb144067300 2022-01-10T01:29:57.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.075+0000 7fb14b21b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb144066ea0 con 0x7fb144143de0 2022-01-10T01:29:57.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.075+0000 7fb1497b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb144143de0 0x7fb14414b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:57.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.075+0000 7fb143fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb144067300 0x7fb1441438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:57.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.075+0000 7fb1497b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb144143de0 0x7fb14414b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:43812/0 (socket says 172.21.15.36:43812) 2022-01-10T01:29:57.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb1497b8700 1 -- 172.21.15.36:0/534020053 learned_addr learned my addr 172.21.15.36:0/534020053 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:57.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb1497b8700 1 -- 172.21.15.36:0/534020053 >> v2:172.21.15.59:3300/0 conn(0x7fb144067300 msgr2=0x7fb1441438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:57.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb1497b8700 1 --2- 172.21.15.36:0/534020053 >> v2:172.21.15.59:3300/0 conn(0x7fb144067300 0x7fb1441438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb1497b8700 1 -- 172.21.15.36:0/534020053 >> v1:172.21.15.59:6789/0 conn(0x7fb144060100 legacy=0x7fb1440b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:57.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb1497b8700 1 -- 172.21.15.36:0/534020053 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1440b33b0 con 0x7fb144143de0 2022-01-10T01:29:57.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb143fff700 1 --2- 172.21.15.36:0/534020053 >> v2:172.21.15.59:3300/0 conn(0x7fb144067300 0x7fb1441438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:57.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb1497b8700 1 --2- 172.21.15.36:0/534020053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb144143de0 0x7fb14414b850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb13c0032f0 tx=0x7fb13c009290).ready entity=mon.2 client_cookie=3e6f663c0d854655 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:57.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb1437fe700 1 -- 172.21.15.36:0/534020053 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb13c00b8a0 con 0x7fb144143de0 2022-01-10T01:29:57.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb1437fe700 1 -- 172.21.15.36:0/534020053 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c00ba00 con 0x7fb144143de0 2022-01-10T01:29:57.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb1437fe700 1 -- 172.21.15.36:0/534020053 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb13c00bb70 con 0x7fb144143de0 2022-01-10T01:29:57.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb14b21b700 1 -- 172.21.15.36:0/534020053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb144143de0 msgr2=0x7fb14414b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:57.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb14b21b700 1 --2- 172.21.15.36:0/534020053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb144143de0 0x7fb14414b850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fb13c0032f0 tx=0x7fb13c009290).stop 2022-01-10T01:29:57.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb14b21b700 1 -- 172.21.15.36:0/534020053 shutdown_connections 2022-01-10T01:29:57.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb14b21b700 1 --2- 172.21.15.36:0/534020053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb144143de0 0x7fb14414b850 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb14b21b700 1 --2- 172.21.15.36:0/534020053 >> v2:172.21.15.59:3300/0 conn(0x7fb144067300 0x7fb1441438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb14b21b700 1 -- 172.21.15.36:0/534020053 >> 172.21.15.36:0/534020053 conn(0x7fb14405cf30 msgr2=0x7fb14405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:57.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb14b21b700 1 -- 172.21.15.36:0/534020053 shutdown_connections 2022-01-10T01:29:57.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb14b21b700 1 -- 172.21.15.36:0/534020053 wait complete. 2022-01-10T01:29:57.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb14b21b700 1 Processor -- start 2022-01-10T01:29:57.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.079+0000 7fb14b21b700 1 -- start start 2022-01-10T01:29:57.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb14b21b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb144060100 0x7fb1440adc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:57.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb14b21b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb144067300 0x7fb1440a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:57.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb14b21b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb144143de0 0x7fb1441504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:57.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb14b21b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14409e8b0 con 0x7fb144060100 2022-01-10T01:29:57.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb14b21b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440aead0 con 0x7fb144067300 2022-01-10T01:29:57.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb14b21b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14409eae0 con 0x7fb144143de0 2022-01-10T01:29:57.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb148fb7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb144060100 0x7fb1440adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:57.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb148fb7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb144060100 0x7fb1440adc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37532/0 (socket says 172.21.15.36:37532) 2022-01-10T01:29:57.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb148fb7700 1 -- 172.21.15.36:0/2969550126 learned_addr learned my addr 172.21.15.36:0/2969550126 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:57.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb143fff700 1 --2- 172.21.15.36:0/2969550126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb144067300 0x7fb1440a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:57.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb1497b8700 1 --2- 172.21.15.36:0/2969550126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb144143de0 0x7fb1441504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:57.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb148fb7700 1 -- 172.21.15.36:0/2969550126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb144143de0 msgr2=0x7fb1441504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:57.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb148fb7700 1 --2- 172.21.15.36:0/2969550126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb144143de0 0x7fb1441504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb148fb7700 1 -- 172.21.15.36:0/2969550126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb144067300 msgr2=0x7fb1440a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:57.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb148fb7700 1 --2- 172.21.15.36:0/2969550126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb144067300 0x7fb1440a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb148fb7700 1 -- 172.21.15.36:0/2969550126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13400b180 con 0x7fb144060100 2022-01-10T01:29:57.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb148fb7700 1 --2- 172.21.15.36:0/2969550126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb144060100 0x7fb1440adc50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fb14405f1e0 tx=0x7fb138007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:57.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb141ffb700 1 -- 172.21.15.36:0/2969550126 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb138007030 con 0x7fb144060100 2022-01-10T01:29:57.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb141ffb700 1 -- 172.21.15.36:0/2969550126 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb138007190 con 0x7fb144060100 2022-01-10T01:29:57.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb14b21b700 1 -- 172.21.15.36:0/2969550126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c009530 con 0x7fb144060100 2022-01-10T01:29:57.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb141ffb700 1 -- 172.21.15.36:0/2969550126 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb138006510 con 0x7fb144060100 2022-01-10T01:29:57.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.083+0000 7fb14b21b700 1 -- 172.21.15.36:0/2969550126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1440b6e80 con 0x7fb144060100 2022-01-10T01:29:57.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.087+0000 7fb14b21b700 1 -- 172.21.15.36:0/2969550126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb144057350 con 0x7fb144060100 2022-01-10T01:29:57.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.087+0000 7fb141ffb700 1 -- 172.21.15.36:0/2969550126 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb138010030 con 0x7fb144060100 2022-01-10T01:29:57.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.087+0000 7fb141ffb700 1 --2- 172.21.15.36:0/2969550126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb1240535f0 0x7fb124055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:57.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.087+0000 7fb141ffb700 1 -- 172.21.15.36:0/2969550126 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb13806b5b0 con 0x7fb144060100 2022-01-10T01:29:57.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.087+0000 7fb143fff700 1 --2- 172.21.15.36:0/2969550126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb1240535f0 0x7fb124055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:57.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.087+0000 7fb143fff700 1 --2- 172.21.15.36:0/2969550126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb1240535f0 0x7fb124055ab0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fb13400b000 tx=0x7fb134006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:57.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.095+0000 7fb141ffb700 1 -- 172.21.15.36:0/2969550126 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb1380425c0 con 0x7fb144060100 2022-01-10T01:29:57.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.255+0000 7fb14b21b700 1 -- 172.21.15.36:0/2969550126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb1440655b0 con 0x7fb144060100 2022-01-10T01:29:57.326 INFO:tasks.ceph.mds.b.smithi059.stderr:2022-01-10T01:29:57.324+0000 7fe6b4cd3700 -1 MDSIOContextBase: blacklisted! Restarting... 2022-01-10T01:29:57.346 INFO:tasks.ceph.mds.b.smithi059.stderr: -1> 2022-01-10T01:29:57.324+0000 7fe6b4cd3700 -1 MDSIOContextBase: blacklisted! Restarting... 2022-01-10T01:29:57.368 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:29:57.618 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:29:57.615+0000 7f0b5376f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:29:57.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.631+0000 7fb141ffb700 1 -- 172.21.15.36:0/2969550126 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb138045be0 con 0x7fb144060100 2022-01-10T01:29:57.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.635+0000 7fb14b21b700 1 -- 172.21.15.36:0/2969550126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb1240535f0 msgr2=0x7fb124055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:57.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.635+0000 7fb14b21b700 1 --2- 172.21.15.36:0/2969550126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb1240535f0 0x7fb124055ab0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fb13400b000 tx=0x7fb134006df0).stop 2022-01-10T01:29:57.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.635+0000 7fb14b21b700 1 -- 172.21.15.36:0/2969550126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb144060100 msgr2=0x7fb1440adc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:57.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.635+0000 7fb14b21b700 1 --2- 172.21.15.36:0/2969550126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb144060100 0x7fb1440adc50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fb14405f1e0 tx=0x7fb138007c10).stop 2022-01-10T01:29:57.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.635+0000 7fb14b21b700 1 -- 172.21.15.36:0/2969550126 shutdown_connections 2022-01-10T01:29:57.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.635+0000 7fb14b21b700 1 --2- 172.21.15.36:0/2969550126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb1240535f0 0x7fb124055ab0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.635+0000 7fb14b21b700 1 --2- 172.21.15.36:0/2969550126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb144143de0 0x7fb1441504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.635+0000 7fb14b21b700 1 --2- 172.21.15.36:0/2969550126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb144067300 0x7fb1440a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.635+0000 7fb14b21b700 1 --2- 172.21.15.36:0/2969550126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb144060100 0x7fb1440adc50 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.635+0000 7fb14b21b700 1 -- 172.21.15.36:0/2969550126 >> 172.21.15.36:0/2969550126 conn(0x7fb14405cf30 msgr2=0x7fb1440b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:57.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.635+0000 7fb14b21b700 1 -- 172.21.15.36:0/2969550126 shutdown_connections 2022-01-10T01:29:57.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.635+0000 7fb14b21b700 1 -- 172.21.15.36:0/2969550126 wait complete. 2022-01-10T01:29:57.638 INFO:teuthology.orchestra.run.smithi036.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2022-01-10T01:29:57.652 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:29:57.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.759+0000 7f7d37375700 1 Processor -- start 2022-01-10T01:29:57.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.759+0000 7f7d37375700 1 -- start start 2022-01-10T01:29:57.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d37375700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d300a9c10 0x7f7d300607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:57.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d37375700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d30066ea0 con 0x7f7d300b3040 2022-01-10T01:29:57.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d37375700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d300b3420 con 0x7f7d30140140 2022-01-10T01:29:57.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d37375700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300648e0 con 0x7f7d300a9c10 2022-01-10T01:29:57.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d36373700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f7d300b3040 0x7f7d30065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35334/0 (socket says 172.21.15.36:35334) 2022-01-10T01:29:57.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d36373700 1 -- 172.21.15.36:0/1088060466 learned_addr learned my addr 172.21.15.36:0/1088060466 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:57.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d35b72700 1 --2- 172.21.15.36:0/1088060466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d300a9c10 0x7f7d300607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:57.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d35371700 1 -- 172.21.15.36:0/1088060466 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1025899960 0 0) 0x7f7d30066ea0 con 0x7f7d300b3040 2022-01-10T01:29:57.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d35371700 1 -- 172.21.15.36:0/1088060466 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d18003260 con 0x7f7d300b3040 2022-01-10T01:29:57.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d35371700 1 -- 172.21.15.36:0/1088060466 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767803478 0 0) 0x7f7d300b3420 con 0x7f7d30140140 2022-01-10T01:29:57.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d35371700 1 -- 172.21.15.36:0/1088060466 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d30066ea0 con 0x7f7d30140140 2022-01-10T01:29:57.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d35b72700 1 -- 172.21.15.36:0/1088060466 >> v1:172.21.15.59:6789/0 conn(0x7f7d30140140 legacy=0x7f7d301405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:57.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d35b72700 1 -- 172.21.15.36:0/1088060466 >> v1:172.21.15.36:6789/0 conn(0x7f7d300b3040 legacy=0x7f7d30065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:57.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d35b72700 1 -- 172.21.15.36:0/1088060466 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d30066960 con 0x7f7d300a9c10 2022-01-10T01:29:57.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d35b72700 1 --2- 172.21.15.36:0/1088060466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d300a9c10 0x7f7d300607c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7d20002f70 tx=0x7f7d20006df0).ready entity=mon.2 client_cookie=ccf1db6b013490b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:57.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d35371700 1 -- 172.21.15.36:0/1088060466 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d2000d5c0 con 0x7f7d300a9c10 2022-01-10T01:29:57.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d35371700 1 -- 172.21.15.36:0/1088060466 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d20000e90 con 0x7f7d300a9c10 2022-01-10T01:29:57.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d35371700 1 -- 172.21.15.36:0/1088060466 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d2000d910 con 0x7f7d300a9c10 2022-01-10T01:29:57.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d37375700 1 -- 172.21.15.36:0/1088060466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d300a9c10 msgr2=0x7f7d300607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:57.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d37375700 1 --2- 172.21.15.36:0/1088060466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d300a9c10 0x7f7d300607c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7d20002f70 tx=0x7f7d20006df0).stop 2022-01-10T01:29:57.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d37375700 1 -- 172.21.15.36:0/1088060466 shutdown_connections 2022-01-10T01:29:57.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d37375700 1 --2- 172.21.15.36:0/1088060466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d300a9c10 0x7f7d300607c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d37375700 1 -- 172.21.15.36:0/1088060466 >> 172.21.15.36:0/1088060466 conn(0x7f7d300636e0 msgr2=0x7f7d30063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:57.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d37375700 1 -- 172.21.15.36:0/1088060466 shutdown_connections 2022-01-10T01:29:57.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.763+0000 7f7d37375700 1 -- 172.21.15.36:0/1088060466 wait complete. 2022-01-10T01:29:57.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.767+0000 7f7d37375700 1 Processor -- start 2022-01-10T01:29:57.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.767+0000 7f7d37375700 1 -- start start 2022-01-10T01:29:57.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d37375700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7d300a9c10 0x7f7d30133c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:57.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d37375700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d300b3040 0x7f7d30134790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:57.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d37375700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d30140140 0x7f7d30134c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:57.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d37375700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300aa8e0 con 0x7f7d300a9c10 2022-01-10T01:29:57.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d37375700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300aafb0 con 0x7f7d300b3040 2022-01-10T01:29:57.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d37375700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300ab290 con 0x7f7d30140140 2022-01-10T01:29:57.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d36373700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7d300a9c10 0x7f7d30133c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:57.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d36373700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7d300a9c10 0x7f7d30133c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37544/0 (socket says 172.21.15.36:37544) 2022-01-10T01:29:57.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d36373700 1 -- 172.21.15.36:0/602466032 learned_addr learned my addr 172.21.15.36:0/602466032 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:57.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d35b72700 1 --2- 172.21.15.36:0/602466032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d300b3040 0x7f7d30134790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:57.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d36b74700 1 --2- 172.21.15.36:0/602466032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d30140140 0x7f7d30134c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:57.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d36373700 1 -- 172.21.15.36:0/602466032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d30140140 msgr2=0x7f7d30134c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:57.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d36373700 1 --2- 172.21.15.36:0/602466032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d30140140 0x7f7d30134c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d36373700 1 -- 172.21.15.36:0/602466032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d300b3040 msgr2=0x7f7d30134790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:57.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d36373700 1 --2- 172.21.15.36:0/602466032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d300b3040 0x7f7d30134790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d36373700 1 -- 172.21.15.36:0/602466032 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2000b180 con 0x7f7d300a9c10 2022-01-10T01:29:57.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d36373700 1 --2- 172.21.15.36:0/602466032 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7d300a9c10 0x7f7d30133c60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f7d2c0011d0 tx=0x7f7d2c007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:57.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d1f7fe700 1 -- 172.21.15.36:0/602466032 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d2c0070d0 con 0x7f7d300a9c10 2022-01-10T01:29:57.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d1f7fe700 1 -- 172.21.15.36:0/602466032 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c007230 con 0x7f7d300a9c10 2022-01-10T01:29:57.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d37375700 1 -- 172.21.15.36:0/602466032 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d300ab530 con 0x7f7d300a9c10 2022-01-10T01:29:57.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d1f7fe700 1 -- 172.21.15.36:0/602466032 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d2c005610 con 0x7f7d300a9c10 2022-01-10T01:29:57.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d37375700 1 -- 172.21.15.36:0/602466032 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d300aab10 con 0x7f7d300a9c10 2022-01-10T01:29:57.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.771+0000 7f7d37375700 1 -- 172.21.15.36:0/602466032 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d300af100 con 0x7f7d300a9c10 2022-01-10T01:29:57.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.775+0000 7f7d1f7fe700 1 -- 172.21.15.36:0/602466032 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7d2c010070 con 0x7f7d300a9c10 2022-01-10T01:29:57.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.775+0000 7f7d1f7fe700 1 --2- 172.21.15.36:0/602466032 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7d10053620 0x7f7d10055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:57.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.775+0000 7f7d1f7fe700 1 -- 172.21.15.36:0/602466032 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f7d2c06b780 con 0x7f7d300a9c10 2022-01-10T01:29:57.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.775+0000 7f7d35b72700 1 --2- 172.21.15.36:0/602466032 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7d10053620 0x7f7d10055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:57.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.775+0000 7f7d35b72700 1 --2- 172.21.15.36:0/602466032 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7d10053620 0x7f7d10055ae0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f7d20018000 tx=0x7f7d20014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:57.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.783+0000 7f7d1f7fe700 1 -- 172.21.15.36:0/602466032 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7d2c042740 con 0x7f7d300a9c10 2022-01-10T01:29:57.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.947+0000 7f7d37375700 1 -- 172.21.15.36:0/602466032 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d30066c00 con 0x7f7d300a9c10 2022-01-10T01:29:57.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.947+0000 7f7d1f7fe700 1 -- 172.21.15.36:0/602466032 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f7d2c045d60 con 0x7f7d300a9c10 2022-01-10T01:29:57.949 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:29:57.949 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":30,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6836/1674052345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":1674052345},{"type":"v1","addr":"172.21.15.36:6836","nonce":1674052345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27},{"gid":5919,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/3906479610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":3906479610},{"type":"v1","addr":"172.21.15.36:6837","nonce":3906479610}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27},{"gid":35594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1321638193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1321638193},{"type":"v1","addr":"172.21.15.59:6833","nonce":1321638193}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[{"mdsmap":{"epoch":30,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:29:27.060192+0000","modified":"2022-01-10T01:29:57.619536+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":68,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2022-01-10T01:29:57.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.951+0000 7f7d37375700 1 -- 172.21.15.36:0/602466032 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7d10053620 msgr2=0x7f7d10055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:57.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.951+0000 7f7d37375700 1 --2- 172.21.15.36:0/602466032 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7d10053620 0x7f7d10055ae0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f7d20018000 tx=0x7f7d20014000).stop 2022-01-10T01:29:57.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.951+0000 7f7d37375700 1 -- 172.21.15.36:0/602466032 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7d300a9c10 msgr2=0x7f7d30133c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:57.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.951+0000 7f7d37375700 1 --2- 172.21.15.36:0/602466032 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7d300a9c10 0x7f7d30133c60 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f7d2c0011d0 tx=0x7f7d2c007b50).stop 2022-01-10T01:29:57.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.951+0000 7f7d37375700 1 -- 172.21.15.36:0/602466032 shutdown_connections 2022-01-10T01:29:57.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.951+0000 7f7d37375700 1 --2- 172.21.15.36:0/602466032 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7d10053620 0x7f7d10055ae0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.951+0000 7f7d37375700 1 --2- 172.21.15.36:0/602466032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7d30140140 0x7f7d30134c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.951+0000 7f7d37375700 1 --2- 172.21.15.36:0/602466032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d300b3040 0x7f7d30134790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.951+0000 7f7d37375700 1 --2- 172.21.15.36:0/602466032 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7d300a9c10 0x7f7d30133c60 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:57.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.951+0000 7f7d37375700 1 -- 172.21.15.36:0/602466032 >> 172.21.15.36:0/602466032 conn(0x7f7d300636e0 msgr2=0x7f7d300b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:57.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.951+0000 7f7d37375700 1 -- 172.21.15.36:0/602466032 shutdown_connections 2022-01-10T01:29:57.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:57.951+0000 7f7d37375700 1 -- 172.21.15.36:0/602466032 wait complete. 2022-01-10T01:29:57.954 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 30 2022-01-10T01:29:57.963 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:29:58.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.067+0000 7fbf46567700 1 Processor -- start 2022-01-10T01:29:58.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.067+0000 7fbf46567700 1 -- start start 2022-01-10T01:29:58.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.067+0000 7fbf46567700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbf40144440 0x7fbf40144970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:58.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.067+0000 7fbf46567700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf400604e0 con 0x7fbf40065420 2022-01-10T01:29:58.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.067+0000 7fbf46567700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf400b23b0 con 0x7fbf40060100 2022-01-10T01:29:58.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.067+0000 7fbf46567700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf40065c80 con 0x7fbf40144440 2022-01-10T01:29:58.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.067+0000 7fbf3f7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbf40144440 0x7fbf40144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:58.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.067+0000 7fbf44b04700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fbf40065420 0x7fbf4014b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35350/0 (socket says 172.21.15.36:35350) 2022-01-10T01:29:58.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.067+0000 7fbf44b04700 1 -- 172.21.15.36:0/2284072632 learned_addr learned my addr 172.21.15.36:0/2284072632 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:58.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.067+0000 7fbf3ffff700 1 --1- 172.21.15.36:0/2284072632 >> v1:172.21.15.59:6789/0 conn(0x7fbf40060100 0x7fbf40064d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:53022/0 (socket says 172.21.15.36:53022) 2022-01-10T01:29:58.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.067+0000 7fbf3f7fe700 1 -- 172.21.15.36:0/2284072632 >> v1:172.21.15.59:6789/0 conn(0x7fbf40060100 legacy=0x7fbf40064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:58.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.067+0000 7fbf3f7fe700 1 -- 172.21.15.36:0/2284072632 >> v1:172.21.15.36:6789/0 conn(0x7fbf40065420 legacy=0x7fbf4014b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:58.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.067+0000 7fbf3f7fe700 1 -- 172.21.15.36:0/2284072632 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400b2650 con 0x7fbf40144440 2022-01-10T01:29:58.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.067+0000 7fbf3f7fe700 1 --2- 172.21.15.36:0/2284072632 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf40144440 0x7fbf40144970 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fbf34002f70 tx=0x7fbf34006df0).ready entity=mon.0 client_cookie=2f6b353a913b0659 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:58.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.071+0000 7fbf3effd700 1 -- 172.21.15.36:0/2284072632 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf3400d610 con 0x7fbf40144440 2022-01-10T01:29:58.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.071+0000 7fbf3effd700 1 -- 172.21.15.36:0/2284072632 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf34000e90 con 0x7fbf40144440 2022-01-10T01:29:58.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.071+0000 7fbf3effd700 1 -- 172.21.15.36:0/2284072632 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf3400d960 con 0x7fbf40144440 2022-01-10T01:29:58.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.071+0000 7fbf46567700 1 -- 172.21.15.36:0/2284072632 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf40144440 msgr2=0x7fbf40144970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:58.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.071+0000 7fbf46567700 1 --2- 172.21.15.36:0/2284072632 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf40144440 0x7fbf40144970 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fbf34002f70 tx=0x7fbf34006df0).stop 2022-01-10T01:29:58.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.071+0000 7fbf46567700 1 -- 172.21.15.36:0/2284072632 shutdown_connections 2022-01-10T01:29:58.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.071+0000 7fbf46567700 1 --2- 172.21.15.36:0/2284072632 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf40144440 0x7fbf40144970 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:58.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.071+0000 7fbf46567700 1 -- 172.21.15.36:0/2284072632 >> 172.21.15.36:0/2284072632 conn(0x7fbf4005cf60 msgr2=0x7fbf4005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:58.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.071+0000 7fbf46567700 1 -- 172.21.15.36:0/2284072632 shutdown_connections 2022-01-10T01:29:58.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.071+0000 7fbf46567700 1 -- 172.21.15.36:0/2284072632 wait complete. 2022-01-10T01:29:58.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.071+0000 7fbf46567700 1 Processor -- start 2022-01-10T01:29:58.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.071+0000 7fbf46567700 1 -- start start 2022-01-10T01:29:58.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf46567700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf40060100 0x7fbf4013cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:58.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf46567700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf40065420 0x7fbf4013d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:58.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf46567700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf400ab750 0x7fbf400abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:58.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf46567700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4013d9a0 con 0x7fbf400ab750 2022-01-10T01:29:58.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf46567700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4013be40 con 0x7fbf40065420 2022-01-10T01:29:58.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf46567700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4013c0e0 con 0x7fbf40060100 2022-01-10T01:29:58.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf44b04700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf400ab750 0x7fbf400abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:58.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf3ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf40060100 0x7fbf4013cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:58.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf3f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf40065420 0x7fbf4013d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:58.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf44b04700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf400ab750 0x7fbf400abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37562/0 (socket says 172.21.15.36:37562) 2022-01-10T01:29:58.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf44b04700 1 -- 172.21.15.36:0/1615770124 learned_addr learned my addr 172.21.15.36:0/1615770124 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:58.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf44b04700 1 -- 172.21.15.36:0/1615770124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf40060100 msgr2=0x7fbf4013cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:58.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf44b04700 1 --2- 172.21.15.36:0/1615770124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf40060100 0x7fbf4013cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:58.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf44b04700 1 -- 172.21.15.36:0/1615770124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf40065420 msgr2=0x7fbf4013d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:58.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf44b04700 1 --2- 172.21.15.36:0/1615770124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf40065420 0x7fbf4013d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:58.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf44b04700 1 -- 172.21.15.36:0/1615770124 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3400b180 con 0x7fbf400ab750 2022-01-10T01:29:58.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf3f7fe700 1 --2- 172.21.15.36:0/1615770124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf40065420 0x7fbf4013d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:58.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf44b04700 1 --2- 172.21.15.36:0/1615770124 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf400ab750 0x7fbf400abbe0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fbf4005d460 tx=0x7fbf38007f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:58.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf3d7fa700 1 -- 172.21.15.36:0/1615770124 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf38005b80 con 0x7fbf400ab750 2022-01-10T01:29:58.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf3d7fa700 1 -- 172.21.15.36:0/1615770124 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf38005ce0 con 0x7fbf400ab750 2022-01-10T01:29:58.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf3d7fa700 1 -- 172.21.15.36:0/1615770124 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf380072c0 con 0x7fbf400ab750 2022-01-10T01:29:58.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf46567700 1 -- 172.21.15.36:0/1615770124 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4013c380 con 0x7fbf400ab750 2022-01-10T01:29:58.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf46567700 1 -- 172.21.15.36:0/1615770124 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf400b1180 con 0x7fbf400ab750 2022-01-10T01:29:58.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.075+0000 7fbf46567700 1 -- 172.21.15.36:0/1615770124 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf40064870 con 0x7fbf400ab750 2022-01-10T01:29:58.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.079+0000 7fbf3d7fa700 1 -- 172.21.15.36:0/1615770124 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbf38010070 con 0x7fbf400ab750 2022-01-10T01:29:58.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.079+0000 7fbf3d7fa700 1 --2- 172.21.15.36:0/1615770124 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf20053620 0x7fbf20055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:58.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.079+0000 7fbf3d7fa700 1 -- 172.21.15.36:0/1615770124 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fbf3806b380 con 0x7fbf400ab750 2022-01-10T01:29:58.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.079+0000 7fbf3ffff700 1 --2- 172.21.15.36:0/1615770124 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf20053620 0x7fbf20055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:58.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.079+0000 7fbf3ffff700 1 --2- 172.21.15.36:0/1615770124 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf20053620 0x7fbf20055ae0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fbf3000d000 tx=0x7fbf30007b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:58.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.083+0000 7fbf3d7fa700 1 -- 172.21.15.36:0/1615770124 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbf38042340 con 0x7fbf400ab750 2022-01-10T01:29:58.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.247+0000 7fbf46567700 1 -- 172.21.15.36:0/1615770124 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbf40057350 con 0x7fbf400ab750 2022-01-10T01:29:58.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.639+0000 7fbf3d7fa700 1 -- 172.21.15.36:0/1615770124 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbf38045960 con 0x7fbf400ab750 2022-01-10T01:29:58.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.643+0000 7fbf46567700 1 -- 172.21.15.36:0/1615770124 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf20053620 msgr2=0x7fbf20055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:58.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.643+0000 7fbf46567700 1 --2- 172.21.15.36:0/1615770124 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf20053620 0x7fbf20055ae0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7fbf3000d000 tx=0x7fbf30007b80).stop 2022-01-10T01:29:58.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.643+0000 7fbf46567700 1 -- 172.21.15.36:0/1615770124 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf400ab750 msgr2=0x7fbf400abbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:58.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.643+0000 7fbf46567700 1 --2- 172.21.15.36:0/1615770124 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf400ab750 0x7fbf400abbe0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fbf4005d460 tx=0x7fbf38007f00).stop 2022-01-10T01:29:58.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.643+0000 7fbf46567700 1 -- 172.21.15.36:0/1615770124 shutdown_connections 2022-01-10T01:29:58.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.643+0000 7fbf46567700 1 --2- 172.21.15.36:0/1615770124 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf20053620 0x7fbf20055ae0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:58.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.643+0000 7fbf46567700 1 --2- 172.21.15.36:0/1615770124 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf400ab750 0x7fbf400abbe0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:58.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.643+0000 7fbf46567700 1 --2- 172.21.15.36:0/1615770124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf40065420 0x7fbf4013d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:58.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.643+0000 7fbf46567700 1 --2- 172.21.15.36:0/1615770124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf40060100 0x7fbf4013cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:58.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.643+0000 7fbf46567700 1 -- 172.21.15.36:0/1615770124 >> 172.21.15.36:0/1615770124 conn(0x7fbf4005cf60 msgr2=0x7fbf401437e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:58.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.647+0000 7fbf46567700 1 -- 172.21.15.36:0/1615770124 shutdown_connections 2022-01-10T01:29:58.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.647+0000 7fbf46567700 1 -- 172.21.15.36:0/1615770124 wait complete. 2022-01-10T01:29:58.662 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:29:58.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.779+0000 7f0af74e9700 1 Processor -- start 2022-01-10T01:29:58.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.779+0000 7f0af74e9700 1 -- start start 2022-01-10T01:29:58.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0af74e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0af00b04a0 0x7f0af00add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:58.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0af74e9700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0af00aa120 0x7f0af00ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:58.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0af74e9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0af00b2af0 con 0x7f0af00b0880 2022-01-10T01:29:58.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0af74e9700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0af00b2770 con 0x7f0af00aa120 2022-01-10T01:29:58.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0af74e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af00b2d20 con 0x7f0af00b04a0 2022-01-10T01:29:58.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0af4a84700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0af00aa120 0x7f0af00ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:58.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0af4a84700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0af00aa120 0x7f0af00ae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37568/0 (socket says 172.21.15.36:37568) 2022-01-10T01:29:58.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0af4a84700 1 -- 172.21.15.36:0/2597340843 learned_addr learned my addr 172.21.15.36:0/2597340843 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:58.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0af5285700 1 --2- 172.21.15.36:0/2597340843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0af00b04a0 0x7f0af00add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:58.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0af4a84700 1 -- 172.21.15.36:0/2597340843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0af00b04a0 msgr2=0x7f0af00add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:58.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0af4a84700 1 --2- 172.21.15.36:0/2597340843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0af00b04a0 0x7f0af00add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:58.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0af4a84700 1 -- 172.21.15.36:0/2597340843 >> v1:172.21.15.59:6789/0 conn(0x7f0af00b0880 legacy=0x7f0af0143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:58.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0af4a84700 1 -- 172.21.15.36:0/2597340843 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af00a9b70 con 0x7f0af00aa120 2022-01-10T01:29:58.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0af4a84700 1 --2- 172.21.15.36:0/2597340843 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0af00aa120 0x7f0af00ae220 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f0ae0002f70 tx=0x7f0ae0006eb0).ready entity=mon.0 client_cookie=554ccdc97582f6d7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:58.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0adffff700 1 -- 172.21.15.36:0/2597340843 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ae000d5c0 con 0x7f0af00aa120 2022-01-10T01:29:58.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0adffff700 1 -- 172.21.15.36:0/2597340843 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae0000e90 con 0x7f0af00aa120 2022-01-10T01:29:58.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.783+0000 7f0adffff700 1 -- 172.21.15.36:0/2597340843 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ae000d950 con 0x7f0af00aa120 2022-01-10T01:29:58.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.787+0000 7f0af74e9700 1 -- 172.21.15.36:0/2597340843 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0af00aa120 msgr2=0x7f0af00ae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:58.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.787+0000 7f0af74e9700 1 --2- 172.21.15.36:0/2597340843 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0af00aa120 0x7f0af00ae220 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f0ae0002f70 tx=0x7f0ae0006eb0).stop 2022-01-10T01:29:58.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.787+0000 7f0af74e9700 1 -- 172.21.15.36:0/2597340843 shutdown_connections 2022-01-10T01:29:58.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.787+0000 7f0af74e9700 1 --2- 172.21.15.36:0/2597340843 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0af00aa120 0x7f0af00ae220 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:58.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.787+0000 7f0af74e9700 1 --2- 172.21.15.36:0/2597340843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0af00b04a0 0x7f0af00add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:58.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.787+0000 7f0af74e9700 1 -- 172.21.15.36:0/2597340843 >> 172.21.15.36:0/2597340843 conn(0x7f0af00607c0 msgr2=0x7f0af0060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:58.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.787+0000 7f0af74e9700 1 -- 172.21.15.36:0/2597340843 shutdown_connections 2022-01-10T01:29:58.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.787+0000 7f0af74e9700 1 -- 172.21.15.36:0/2597340843 wait complete. 2022-01-10T01:29:58.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.787+0000 7f0af74e9700 1 Processor -- start 2022-01-10T01:29:58.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.787+0000 7f0af74e9700 1 -- start start 2022-01-10T01:29:58.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af74e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0af00aa120 0x7f0af00ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:58.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af74e9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af00b04a0 0x7f0af0066e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:58.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af74e9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0af00b0880 0x7f0af0067340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:58.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af74e9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0066150 con 0x7f0af00b0880 2022-01-10T01:29:58.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af74e9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0066930 con 0x7f0af00b04a0 2022-01-10T01:29:58.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af74e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0af0142d70 con 0x7f0af00aa120 2022-01-10T01:29:58.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af5a86700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0af00b0880 0x7f0af0067340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:58.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af5a86700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0af00b0880 0x7f0af0067340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37576/0 (socket says 172.21.15.36:37576) 2022-01-10T01:29:58.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af5a86700 1 -- 172.21.15.36:0/2654498016 learned_addr learned my addr 172.21.15.36:0/2654498016 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:58.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af4a84700 1 --2- 172.21.15.36:0/2654498016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af00b04a0 0x7f0af0066e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:58.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af5285700 1 --2- 172.21.15.36:0/2654498016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0af00aa120 0x7f0af00ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:58.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af5a86700 1 -- 172.21.15.36:0/2654498016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0af00aa120 msgr2=0x7f0af00ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:58.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af5a86700 1 --2- 172.21.15.36:0/2654498016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0af00aa120 0x7f0af00ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:58.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af5a86700 1 -- 172.21.15.36:0/2654498016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af00b04a0 msgr2=0x7f0af0066e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:58.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af5a86700 1 --2- 172.21.15.36:0/2654498016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af00b04a0 0x7f0af0066e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:58.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af5a86700 1 -- 172.21.15.36:0/2654498016 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae000b1e0 con 0x7f0af00b0880 2022-01-10T01:29:58.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af5a86700 1 --2- 172.21.15.36:0/2654498016 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0af00b0880 0x7f0af0067340 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f0af0066290 tx=0x7f0ae80013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:58.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0ade7fc700 1 -- 172.21.15.36:0/2654498016 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ae8006aa0 con 0x7f0af00b0880 2022-01-10T01:29:58.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0ade7fc700 1 -- 172.21.15.36:0/2654498016 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae8006c00 con 0x7f0af00b0880 2022-01-10T01:29:58.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0ade7fc700 1 -- 172.21.15.36:0/2654498016 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0ae8007030 con 0x7f0af00b0880 2022-01-10T01:29:58.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af74e9700 1 -- 172.21.15.36:0/2654498016 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af0143010 con 0x7f0af00b0880 2022-01-10T01:29:58.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.791+0000 7f0af74e9700 1 -- 172.21.15.36:0/2654498016 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af0065ae0 con 0x7f0af00b0880 2022-01-10T01:29:58.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.795+0000 7f0ade7fc700 1 -- 172.21.15.36:0/2654498016 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0ae8010030 con 0x7f0af00b0880 2022-01-10T01:29:58.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.795+0000 7f0af74e9700 1 -- 172.21.15.36:0/2654498016 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af0057350 con 0x7f0af00b0880 2022-01-10T01:29:58.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.795+0000 7f0ade7fc700 1 --2- 172.21.15.36:0/2654498016 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0ad00535f0 0x7f0ad0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:58.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.795+0000 7f0ade7fc700 1 -- 172.21.15.36:0/2654498016 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f0ae806b8e0 con 0x7f0af00b0880 2022-01-10T01:29:58.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.795+0000 7f0af5285700 1 --2- 172.21.15.36:0/2654498016 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0ad00535f0 0x7f0ad0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:58.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.795+0000 7f0af5285700 1 --2- 172.21.15.36:0/2654498016 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0ad00535f0 0x7f0ad0055ab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f0aec00c000 tx=0x7f0aec008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:58.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.803+0000 7f0ade7fc700 1 -- 172.21.15.36:0/2654498016 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0ae80427d0 con 0x7f0af00b0880 2022-01-10T01:29:58.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:58.939+0000 7f0af74e9700 1 -- 172.21.15.36:0/2654498016 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0af0044650 con 0x7f0af00b0880 2022-01-10T01:29:59.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.647+0000 7f0ade7fc700 1 -- 172.21.15.36:0/2654498016 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) v1 ==== 185+0+0 (secure 0 0 0) 0x7f0ae8045df0 con 0x7f0af00b0880 2022-01-10T01:29:59.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.651+0000 7f0af74e9700 1 -- 172.21.15.36:0/2654498016 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0ad00535f0 msgr2=0x7f0ad0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:59.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.651+0000 7f0af74e9700 1 --2- 172.21.15.36:0/2654498016 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0ad00535f0 0x7f0ad0055ab0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f0aec00c000 tx=0x7f0aec008040).stop 2022-01-10T01:29:59.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.651+0000 7f0af74e9700 1 -- 172.21.15.36:0/2654498016 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0af00b0880 msgr2=0x7f0af0067340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:59.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.651+0000 7f0af74e9700 1 --2- 172.21.15.36:0/2654498016 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0af00b0880 0x7f0af0067340 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f0af0066290 tx=0x7f0ae80013a0).stop 2022-01-10T01:29:59.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.651+0000 7f0af74e9700 1 -- 172.21.15.36:0/2654498016 shutdown_connections 2022-01-10T01:29:59.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.651+0000 7f0af74e9700 1 --2- 172.21.15.36:0/2654498016 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0ad00535f0 0x7f0ad0055ab0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:59.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.651+0000 7f0af74e9700 1 --2- 172.21.15.36:0/2654498016 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0af00b0880 0x7f0af0067340 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:59.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.651+0000 7f0af74e9700 1 --2- 172.21.15.36:0/2654498016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0af00b04a0 0x7f0af0066e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:59.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.651+0000 7f0af74e9700 1 --2- 172.21.15.36:0/2654498016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0af00aa120 0x7f0af00ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:59.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.651+0000 7f0af74e9700 1 -- 172.21.15.36:0/2654498016 >> 172.21.15.36:0/2654498016 conn(0x7f0af00607c0 msgr2=0x7f0af00b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:59.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.651+0000 7f0af74e9700 1 -- 172.21.15.36:0/2654498016 shutdown_connections 2022-01-10T01:29:59.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.651+0000 7f0af74e9700 1 -- 172.21.15.36:0/2654498016 wait complete. 2022-01-10T01:29:59.655 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:29:59.667 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2022-01-10T01:29:59.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.767+0000 7fd6bebb9700 1 Processor -- start 2022-01-10T01:29:59.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.767+0000 7fd6bebb9700 1 -- start start 2022-01-10T01:29:59.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bebb9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd6b8060100 0x7fd6b8061650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:59.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bebb9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6b8065970 0x7fd6b8065e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:59.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bebb9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b80604e0 con 0x7fd6b80665d0 2022-01-10T01:29:59.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bebb9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b8067150 con 0x7fd6b8060100 2022-01-10T01:29:59.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bebb9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8060c70 con 0x7fd6b8065970 2022-01-10T01:29:59.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6b7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6b8065970 0x7fd6b8065e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:59.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bc955700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd6b8060100 0x7fd6b8061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:59.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bd156700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd6b80665d0 0x7fd6b8066a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:53054/0 (socket says 172.21.15.36:53054) 2022-01-10T01:29:59.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bd156700 1 -- 172.21.15.36:0/2148243820 learned_addr learned my addr 172.21.15.36:0/2148243820 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:29:59.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6b7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6b8065970 0x7fd6b8065e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:43864/0 (socket says 172.21.15.36:43864) 2022-01-10T01:29:59.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6b7fff700 1 -- 172.21.15.36:0/2148243820 >> v2:172.21.15.59:3300/0 conn(0x7fd6b8060100 msgr2=0x7fd6b8061650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:29:59.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6b7fff700 1 --2- 172.21.15.36:0/2148243820 >> v2:172.21.15.59:3300/0 conn(0x7fd6b8060100 0x7fd6b8061650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:59.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6b7fff700 1 -- 172.21.15.36:0/2148243820 >> v1:172.21.15.59:6789/0 conn(0x7fd6b80665d0 legacy=0x7fd6b8066a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:59.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6b7fff700 1 -- 172.21.15.36:0/2148243820 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b8060f10 con 0x7fd6b8065970 2022-01-10T01:29:59.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bc955700 1 --2- 172.21.15.36:0/2148243820 >> v2:172.21.15.59:3300/0 conn(0x7fd6b8060100 0x7fd6b8061650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:29:59.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6b7fff700 1 --2- 172.21.15.36:0/2148243820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6b8065970 0x7fd6b8065e20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd6ac002f70 tx=0x7fd6ac006df0).ready entity=mon.2 client_cookie=6f44a505ca4b801d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:59.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6b77fe700 1 -- 172.21.15.36:0/2148243820 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6ac00d570 con 0x7fd6b8065970 2022-01-10T01:29:59.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6b77fe700 1 -- 172.21.15.36:0/2148243820 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac000e90 con 0x7fd6b8065970 2022-01-10T01:29:59.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6b77fe700 1 -- 172.21.15.36:0/2148243820 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6ac00d8c0 con 0x7fd6b8065970 2022-01-10T01:29:59.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bebb9700 1 -- 172.21.15.36:0/2148243820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6b8065970 msgr2=0x7fd6b8065e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:59.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bebb9700 1 --2- 172.21.15.36:0/2148243820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6b8065970 0x7fd6b8065e20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd6ac002f70 tx=0x7fd6ac006df0).stop 2022-01-10T01:29:59.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bebb9700 1 -- 172.21.15.36:0/2148243820 shutdown_connections 2022-01-10T01:29:59.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bebb9700 1 --2- 172.21.15.36:0/2148243820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6b8065970 0x7fd6b8065e20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:59.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bebb9700 1 --2- 172.21.15.36:0/2148243820 >> v2:172.21.15.59:3300/0 conn(0x7fd6b8060100 0x7fd6b8061650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:59.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bebb9700 1 -- 172.21.15.36:0/2148243820 >> 172.21.15.36:0/2148243820 conn(0x7fd6b805cf30 msgr2=0x7fd6b805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:29:59.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bebb9700 1 -- 172.21.15.36:0/2148243820 shutdown_connections 2022-01-10T01:29:59.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.771+0000 7fd6bebb9700 1 -- 172.21.15.36:0/2148243820 wait complete. 2022-01-10T01:29:59.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6bebb9700 1 Processor -- start 2022-01-10T01:29:59.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6bebb9700 1 -- start start 2022-01-10T01:29:59.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6bebb9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6b8060100 0x7fd6b81414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:59.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6bebb9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6b8065970 0x7fd6b80b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:59.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6bebb9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6b80665d0 0x7fd6b80b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:59.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6bebb9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80b71e0 con 0x7fd6b8065970 2022-01-10T01:29:59.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6bebb9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80b7480 con 0x7fd6b80665d0 2022-01-10T01:29:59.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6bebb9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b80b7720 con 0x7fd6b8060100 2022-01-10T01:29:59.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6b7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6b8065970 0x7fd6b80b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:59.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6bc955700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6b8060100 0x7fd6b81414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:59.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6b7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6b8065970 0x7fd6b80b5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37590/0 (socket says 172.21.15.36:37590) 2022-01-10T01:29:59.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6b7fff700 1 -- 172.21.15.36:0/3120144321 learned_addr learned my addr 172.21.15.36:0/3120144321 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:29:59.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6bd156700 1 --2- 172.21.15.36:0/3120144321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6b80665d0 0x7fd6b80b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:59.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6b7fff700 1 -- 172.21.15.36:0/3120144321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6b8060100 msgr2=0x7fd6b81414e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:59.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6b7fff700 1 --2- 172.21.15.36:0/3120144321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6b8060100 0x7fd6b81414e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:59.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6b7fff700 1 -- 172.21.15.36:0/3120144321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6b80665d0 msgr2=0x7fd6b80b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:29:59.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6b7fff700 1 --2- 172.21.15.36:0/3120144321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6b80665d0 0x7fd6b80b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:29:59.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6b7fff700 1 -- 172.21.15.36:0/3120144321 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a800b180 con 0x7fd6b8065970 2022-01-10T01:29:59.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6b7fff700 1 --2- 172.21.15.36:0/3120144321 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6b8065970 0x7fd6b80b5d40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7fd6ac002f70 tx=0x7fd6ac014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:59.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6b5ffb700 1 -- 172.21.15.36:0/3120144321 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6ac016070 con 0x7fd6b8065970 2022-01-10T01:29:59.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6b5ffb700 1 -- 172.21.15.36:0/3120144321 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac00de30 con 0x7fd6b8065970 2022-01-10T01:29:59.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6bebb9700 1 -- 172.21.15.36:0/3120144321 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ac00b180 con 0x7fd6b8065970 2022-01-10T01:29:59.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6b5ffb700 1 -- 172.21.15.36:0/3120144321 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6ac013da0 con 0x7fd6b8065970 2022-01-10T01:29:59.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.775+0000 7fd6bebb9700 1 -- 172.21.15.36:0/3120144321 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b80a5a50 con 0x7fd6b8065970 2022-01-10T01:29:59.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.779+0000 7fd6bebb9700 1 -- 172.21.15.36:0/3120144321 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b80611b0 con 0x7fd6b8065970 2022-01-10T01:29:59.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.779+0000 7fd6b5ffb700 1 -- 172.21.15.36:0/3120144321 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd6ac00f030 con 0x7fd6b8065970 2022-01-10T01:29:59.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.779+0000 7fd6b5ffb700 1 --2- 172.21.15.36:0/3120144321 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd6980536b0 0x7fd698055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:29:59.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.779+0000 7fd6b5ffb700 1 -- 172.21.15.36:0/3120144321 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6068+0+0 (secure 0 0 0) 0x7fd6ac06c5b0 con 0x7fd6b8065970 2022-01-10T01:29:59.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.779+0000 7fd6bc955700 1 --2- 172.21.15.36:0/3120144321 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd6980536b0 0x7fd698055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:29:59.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.779+0000 7fd6bc955700 1 --2- 172.21.15.36:0/3120144321 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd6980536b0 0x7fd698055b70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fd6a800b000 tx=0x7fd6a8006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:29:59.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.783+0000 7fd6b5ffb700 1 -- 172.21.15.36:0/3120144321 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd6ac043680 con 0x7fd6b8065970 2022-01-10T01:29:59.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:29:59.915+0000 7fd6bebb9700 1 -- 172.21.15.36:0/3120144321 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd6b8057350 con 0x7fd6b8065970 2022-01-10T01:30:00.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.659+0000 7fd6b5ffb700 1 -- 172.21.15.36:0/3120144321 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd6ac023020 con 0x7fd6b8065970 2022-01-10T01:30:00.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.663+0000 7fd6bebb9700 1 -- 172.21.15.36:0/3120144321 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd6980536b0 msgr2=0x7fd698055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:00.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.663+0000 7fd6bebb9700 1 --2- 172.21.15.36:0/3120144321 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd6980536b0 0x7fd698055b70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fd6a800b000 tx=0x7fd6a8006df0).stop 2022-01-10T01:30:00.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.663+0000 7fd6bebb9700 1 -- 172.21.15.36:0/3120144321 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6b8065970 msgr2=0x7fd6b80b5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:00.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.663+0000 7fd6bebb9700 1 --2- 172.21.15.36:0/3120144321 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6b8065970 0x7fd6b80b5d40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7fd6ac002f70 tx=0x7fd6ac014000).stop 2022-01-10T01:30:00.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.667+0000 7fd6bebb9700 1 -- 172.21.15.36:0/3120144321 shutdown_connections 2022-01-10T01:30:00.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.667+0000 7fd6bebb9700 1 --2- 172.21.15.36:0/3120144321 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd6980536b0 0x7fd698055b70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:00.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.667+0000 7fd6bebb9700 1 --2- 172.21.15.36:0/3120144321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6b80665d0 0x7fd6b80b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:00.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.667+0000 7fd6bebb9700 1 --2- 172.21.15.36:0/3120144321 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6b8065970 0x7fd6b80b5d40 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:00.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.667+0000 7fd6bebb9700 1 --2- 172.21.15.36:0/3120144321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6b8060100 0x7fd6b81414e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:00.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.667+0000 7fd6bebb9700 1 -- 172.21.15.36:0/3120144321 >> 172.21.15.36:0/3120144321 conn(0x7fd6b805cf30 msgr2=0x7fd6b8145790 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:00.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.667+0000 7fd6bebb9700 1 -- 172.21.15.36:0/3120144321 shutdown_connections 2022-01-10T01:30:00.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.667+0000 7fd6bebb9700 1 -- 172.21.15.36:0/3120144321 wait complete. 2022-01-10T01:30:00.671 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' removed 2022-01-10T01:30:00.681 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2022-01-10T01:30:00.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.791+0000 7fac3e16f700 1 Processor -- start 2022-01-10T01:30:00.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.791+0000 7fac3e16f700 1 -- start start 2022-01-10T01:30:00.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.791+0000 7fac3e16f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac38061d20 0x7fac380af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:00.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.791+0000 7fac3e16f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fac380b1c60 0x7fac380b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:00.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.791+0000 7fac3e16f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac380b28b0 con 0x7fac380afc50 2022-01-10T01:30:00.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.791+0000 7fac3e16f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac38062100 con 0x7fac380b1c60 2022-01-10T01:30:00.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.791+0000 7fac3e16f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac380b2ae0 con 0x7fac38061d20 2022-01-10T01:30:00.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.791+0000 7fac36ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fac380b1c60 0x7fac380b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:00.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.791+0000 7fac36ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fac380b1c60 0x7fac380b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37596/0 (socket says 172.21.15.36:37596) 2022-01-10T01:30:00.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.791+0000 7fac36ffd700 1 -- 172.21.15.36:0/3730534366 learned_addr learned my addr 172.21.15.36:0/3730534366 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:00.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.791+0000 7fac377fe700 1 --2- 172.21.15.36:0/3730534366 >> v2:172.21.15.59:3300/0 conn(0x7fac38061d20 0x7fac380af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:00.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac36ffd700 1 -- 172.21.15.36:0/3730534366 >> v2:172.21.15.59:3300/0 conn(0x7fac38061d20 msgr2=0x7fac380af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:00.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac36ffd700 1 --2- 172.21.15.36:0/3730534366 >> v2:172.21.15.59:3300/0 conn(0x7fac38061d20 0x7fac380af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:00.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac36ffd700 1 -- 172.21.15.36:0/3730534366 >> v1:172.21.15.59:6789/0 conn(0x7fac380afc50 legacy=0x7fac38143490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:00.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac36ffd700 1 -- 172.21.15.36:0/3730534366 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac380b2d80 con 0x7fac380b1c60 2022-01-10T01:30:00.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac36ffd700 1 --2- 172.21.15.36:0/3730534366 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac380b1c60 0x7fac380b22f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fac20002f70 tx=0x7fac20006eb0).ready entity=mon.0 client_cookie=aa646c712487e7a2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:00.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac367fc700 1 -- 172.21.15.36:0/3730534366 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac2000d5c0 con 0x7fac380b1c60 2022-01-10T01:30:00.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac367fc700 1 -- 172.21.15.36:0/3730534366 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac20000e90 con 0x7fac380b1c60 2022-01-10T01:30:00.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac367fc700 1 -- 172.21.15.36:0/3730534366 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac2000d950 con 0x7fac380b1c60 2022-01-10T01:30:00.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac3e16f700 1 -- 172.21.15.36:0/3730534366 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac380b1c60 msgr2=0x7fac380b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:00.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac3e16f700 1 --2- 172.21.15.36:0/3730534366 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac380b1c60 0x7fac380b22f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fac20002f70 tx=0x7fac20006eb0).stop 2022-01-10T01:30:00.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac3e16f700 1 -- 172.21.15.36:0/3730534366 shutdown_connections 2022-01-10T01:30:00.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac3e16f700 1 --2- 172.21.15.36:0/3730534366 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac380b1c60 0x7fac380b22f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:00.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac3e16f700 1 --2- 172.21.15.36:0/3730534366 >> v2:172.21.15.59:3300/0 conn(0x7fac38061d20 0x7fac380af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:00.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac3e16f700 1 -- 172.21.15.36:0/3730534366 >> 172.21.15.36:0/3730534366 conn(0x7fac380639b0 msgr2=0x7fac38063d90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:00.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac3e16f700 1 -- 172.21.15.36:0/3730534366 shutdown_connections 2022-01-10T01:30:00.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac3e16f700 1 -- 172.21.15.36:0/3730534366 wait complete. 2022-01-10T01:30:00.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac3e16f700 1 Processor -- start 2022-01-10T01:30:00.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.795+0000 7fac3e16f700 1 -- start start 2022-01-10T01:30:00.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac3e16f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac38061d20 0x7fac380b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:00.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac3e16f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac380afc50 0x7fac380b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:00.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac3e16f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac380b1c60 0x7fac38140340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:00.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac3e16f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3813e160 con 0x7fac38061d20 2022-01-10T01:30:00.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac3e16f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac380b3af0 con 0x7fac380afc50 2022-01-10T01:30:00.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac3e16f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac380b5450 con 0x7fac380b1c60 2022-01-10T01:30:00.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac377fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac38061d20 0x7fac380b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:00.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac377fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac38061d20 0x7fac380b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37600/0 (socket says 172.21.15.36:37600) 2022-01-10T01:30:00.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac377fe700 1 -- 172.21.15.36:0/544321876 learned_addr learned my addr 172.21.15.36:0/544321876 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:00.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac36ffd700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac380afc50 0x7fac380b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:00.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac37fff700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac380b1c60 0x7fac38140340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:00.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac377fe700 1 -- 172.21.15.36:0/544321876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac380b1c60 msgr2=0x7fac38140340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:00.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac377fe700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac380b1c60 0x7fac38140340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:00.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac377fe700 1 -- 172.21.15.36:0/544321876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac380afc50 msgr2=0x7fac380b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:00.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac377fe700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac380afc50 0x7fac380b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:00.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac377fe700 1 -- 172.21.15.36:0/544321876 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2000b1e0 con 0x7fac38061d20 2022-01-10T01:30:00.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac37fff700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac380b1c60 0x7fac38140340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:30:00.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac36ffd700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac380afc50 0x7fac380b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:00.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac377fe700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac38061d20 0x7fac380b58b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fac2800c000 tx=0x7fac28006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:00.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac34ff9700 1 -- 172.21.15.36:0/544321876 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac28010780 con 0x7fac38061d20 2022-01-10T01:30:00.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac34ff9700 1 -- 172.21.15.36:0/544321876 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac280108e0 con 0x7fac38061d20 2022-01-10T01:30:00.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac34ff9700 1 -- 172.21.15.36:0/544321876 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac28010c40 con 0x7fac38061d20 2022-01-10T01:30:00.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac3e16f700 1 -- 172.21.15.36:0/544321876 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac380b4390 con 0x7fac38061d20 2022-01-10T01:30:00.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.799+0000 7fac3e16f700 1 -- 172.21.15.36:0/544321876 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3813dde0 con 0x7fac38061d20 2022-01-10T01:30:00.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.803+0000 7fac3e16f700 1 -- 172.21.15.36:0/544321876 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac380aef50 con 0x7fac38061d20 2022-01-10T01:30:00.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.803+0000 7fac34ff9700 1 -- 172.21.15.36:0/544321876 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fac2801c460 con 0x7fac38061d20 2022-01-10T01:30:00.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.803+0000 7fac34ff9700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fac1c053590 0x7fac1c055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:00.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.803+0000 7fac34ff9700 1 -- 172.21.15.36:0/544321876 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fac2806bb70 con 0x7fac38061d20 2022-01-10T01:30:00.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.803+0000 7fac36ffd700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fac1c053590 0x7fac1c055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:00.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.803+0000 7fac36ffd700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fac1c053590 0x7fac1c055a50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fac2001a000 tx=0x7fac20015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:00.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.811+0000 7fac34ff9700 1 -- 172.21.15.36:0/544321876 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac28042e00 con 0x7fac38061d20 2022-01-10T01:30:00.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.943+0000 7fac3e16f700 1 -- 172.21.15.36:0/544321876 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fac38057350 con 0x7fac38061d20 2022-01-10T01:30:00.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.951+0000 7fac34ff9700 1 -- 172.21.15.36:0/544321876 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fac28046420 con 0x7fac38061d20 2022-01-10T01:30:00.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.951+0000 7fac3e16f700 1 -- 172.21.15.36:0/544321876 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fac1c053590 msgr2=0x7fac1c055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:00.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.951+0000 7fac3e16f700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fac1c053590 0x7fac1c055a50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fac2001a000 tx=0x7fac20015000).stop 2022-01-10T01:30:00.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.951+0000 7fac3e16f700 1 -- 172.21.15.36:0/544321876 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac38061d20 msgr2=0x7fac380b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:00.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.951+0000 7fac3e16f700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac38061d20 0x7fac380b58b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fac2800c000 tx=0x7fac28006df0).stop 2022-01-10T01:30:00.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.951+0000 7fac3e16f700 1 -- 172.21.15.36:0/544321876 shutdown_connections 2022-01-10T01:30:00.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.951+0000 7fac3e16f700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fac1c053590 0x7fac1c055a50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:00.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.951+0000 7fac3e16f700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac380b1c60 0x7fac38140340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:00.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.951+0000 7fac3e16f700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac380afc50 0x7fac380b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:00.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.951+0000 7fac3e16f700 1 --2- 172.21.15.36:0/544321876 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac38061d20 0x7fac380b58b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:00.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.951+0000 7fac3e16f700 1 -- 172.21.15.36:0/544321876 >> 172.21.15.36:0/544321876 conn(0x7fac380639b0 msgr2=0x7fac38063d90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:00.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.951+0000 7fac3e16f700 1 -- 172.21.15.36:0/544321876 shutdown_connections 2022-01-10T01:30:00.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:00.951+0000 7fac3e16f700 1 -- 172.21.15.36:0/544321876 wait complete. 2022-01-10T01:30:00.965 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2022-01-10T01:30:01.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.063+0000 7f4b51187700 1 Processor -- start 2022-01-10T01:30:01.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.063+0000 7f4b51187700 1 -- start start 2022-01-10T01:30:01.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b51187700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4b4c0b2580 0x7f4b4c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:01.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b51187700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4b4c0b0010 0x7f4b4c14b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:01.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b51187700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b4c0a70c0 con 0x7f4b4c0afbd0 2022-01-10T01:30:01.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b51187700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4c0a72f0 con 0x7f4b4c0b2580 2022-01-10T01:30:01.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b51187700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4c0a7590 con 0x7f4b4c0b0010 2022-01-10T01:30:01.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b4bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4b4c0b2580 0x7f4b4c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:01.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b50986700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f4b4c0afbd0 0x7f4b4c0a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35406/0 (socket says 172.21.15.36:35406) 2022-01-10T01:30:01.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b50986700 1 -- 172.21.15.36:0/101916138 learned_addr learned my addr 172.21.15.36:0/101916138 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:01.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b4b7fe700 1 --2- 172.21.15.36:0/101916138 >> v2:172.21.15.59:3300/0 conn(0x7f4b4c0b0010 0x7f4b4c14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:01.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b4affd700 1 -- 172.21.15.36:0/101916138 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542843074 0 0) 0x7f4b4c0a70c0 con 0x7f4b4c0afbd0 2022-01-10T01:30:01.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b4affd700 1 -- 172.21.15.36:0/101916138 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b38003260 con 0x7f4b4c0afbd0 2022-01-10T01:30:01.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b4bfff700 1 -- 172.21.15.36:0/101916138 >> v2:172.21.15.59:3300/0 conn(0x7f4b4c0b0010 msgr2=0x7f4b4c14b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:01.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b4bfff700 1 --2- 172.21.15.36:0/101916138 >> v2:172.21.15.59:3300/0 conn(0x7f4b4c0b0010 0x7f4b4c14b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:01.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b4bfff700 1 -- 172.21.15.36:0/101916138 >> v1:172.21.15.36:6789/0 conn(0x7f4b4c0afbd0 legacy=0x7f4b4c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:01.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b4bfff700 1 -- 172.21.15.36:0/101916138 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0a7830 con 0x7f4b4c0b2580 2022-01-10T01:30:01.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b4bfff700 1 --2- 172.21.15.36:0/101916138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b4c0b2580 0x7f4b4c14ae40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f4b40002f70 tx=0x7f4b40006df0).ready entity=mon.0 client_cookie=2e2e75029f4ecce4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:01.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b4affd700 1 -- 172.21.15.36:0/101916138 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b4000d4f0 con 0x7f4b4c0b2580 2022-01-10T01:30:01.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b4affd700 1 -- 172.21.15.36:0/101916138 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b40000e90 con 0x7f4b4c0b2580 2022-01-10T01:30:01.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b4affd700 1 -- 172.21.15.36:0/101916138 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b4000d840 con 0x7f4b4c0b2580 2022-01-10T01:30:01.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b51187700 1 -- 172.21.15.36:0/101916138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b4c0b2580 msgr2=0x7f4b4c14ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:01.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b51187700 1 --2- 172.21.15.36:0/101916138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b4c0b2580 0x7f4b4c14ae40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f4b40002f70 tx=0x7f4b40006df0).stop 2022-01-10T01:30:01.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b51187700 1 -- 172.21.15.36:0/101916138 shutdown_connections 2022-01-10T01:30:01.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b51187700 1 --2- 172.21.15.36:0/101916138 >> v2:172.21.15.59:3300/0 conn(0x7f4b4c0b0010 0x7f4b4c14b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:01.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b51187700 1 --2- 172.21.15.36:0/101916138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b4c0b2580 0x7f4b4c14ae40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:01.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b51187700 1 -- 172.21.15.36:0/101916138 >> 172.21.15.36:0/101916138 conn(0x7f4b4c060180 msgr2=0x7f4b4c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:01.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b51187700 1 -- 172.21.15.36:0/101916138 shutdown_connections 2022-01-10T01:30:01.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.067+0000 7f4b51187700 1 -- 172.21.15.36:0/101916138 wait complete. 2022-01-10T01:30:01.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b51187700 1 Processor -- start 2022-01-10T01:30:01.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b51187700 1 -- start start 2022-01-10T01:30:01.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b51187700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b4c0afbd0 0x7f4b4c0aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:01.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b51187700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b4c0b0010 0x7f4b4c156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:01.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b51187700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b4c0b2580 0x7f4b4c1597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:01.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b51187700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c156350 con 0x7f4b4c0b2580 2022-01-10T01:30:01.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b51187700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c0a9920 con 0x7f4b4c0afbd0 2022-01-10T01:30:01.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b51187700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c1565b0 con 0x7f4b4c0b0010 2022-01-10T01:30:01.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b50986700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b4c0b2580 0x7f4b4c1597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:01.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b4b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b4c0b0010 0x7f4b4c156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:01.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b4c0afbd0 0x7f4b4c0aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:01.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b50986700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b4c0b2580 0x7f4b4c1597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37618/0 (socket says 172.21.15.36:37618) 2022-01-10T01:30:01.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b50986700 1 -- 172.21.15.36:0/3199569337 learned_addr learned my addr 172.21.15.36:0/3199569337 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:01.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b50986700 1 -- 172.21.15.36:0/3199569337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b4c0b0010 msgr2=0x7f4b4c156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:01.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b50986700 1 --2- 172.21.15.36:0/3199569337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b4c0b0010 0x7f4b4c156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:01.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b50986700 1 -- 172.21.15.36:0/3199569337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b4c0afbd0 msgr2=0x7f4b4c0aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:01.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b50986700 1 --2- 172.21.15.36:0/3199569337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b4c0afbd0 0x7f4b4c0aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:01.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b50986700 1 -- 172.21.15.36:0/3199569337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4000b180 con 0x7f4b4c0b2580 2022-01-10T01:30:01.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b50986700 1 --2- 172.21.15.36:0/3199569337 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b4c0b2580 0x7f4b4c1597d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f4b44001490 tx=0x7f4b44007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:01.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b497fa700 1 -- 172.21.15.36:0/3199569337 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b44005ba0 con 0x7f4b4c0b2580 2022-01-10T01:30:01.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b497fa700 1 -- 172.21.15.36:0/3199569337 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b44005d00 con 0x7f4b4c0b2580 2022-01-10T01:30:01.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b51187700 1 -- 172.21.15.36:0/3199569337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c0a9bc0 con 0x7f4b4c0b2580 2022-01-10T01:30:01.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b497fa700 1 -- 172.21.15.36:0/3199569337 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b440072c0 con 0x7f4b4c0b2580 2022-01-10T01:30:01.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.071+0000 7f4b51187700 1 -- 172.21.15.36:0/3199569337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c0a9480 con 0x7f4b4c0b2580 2022-01-10T01:30:01.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.075+0000 7f4b51187700 1 -- 172.21.15.36:0/3199569337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c057350 con 0x7f4b4c0b2580 2022-01-10T01:30:01.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.075+0000 7f4b497fa700 1 -- 172.21.15.36:0/3199569337 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4b44010070 con 0x7f4b4c0b2580 2022-01-10T01:30:01.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.075+0000 7f4b497fa700 1 --2- 172.21.15.36:0/3199569337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b2c0535f0 0x7f4b2c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:01.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.075+0000 7f4b497fa700 1 -- 172.21.15.36:0/3199569337 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f4b4406b140 con 0x7f4b4c0b2580 2022-01-10T01:30:01.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.075+0000 7f4b4bfff700 1 --2- 172.21.15.36:0/3199569337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b2c0535f0 0x7f4b2c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:01.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.075+0000 7f4b4bfff700 1 --2- 172.21.15.36:0/3199569337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b2c0535f0 0x7f4b2c055ab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f4b4001a000 tx=0x7f4b40014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:01.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.079+0000 7f4b497fa700 1 -- 172.21.15.36:0/3199569337 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b44042320 con 0x7f4b4c0b2580 2022-01-10T01:30:01.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.247+0000 7f4b51187700 1 -- 172.21.15.36:0/3199569337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f4b4c156780 con 0x7f4b4c0b2580 2022-01-10T01:30:01.602 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:30:01.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:30:01.609 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:30:01.611 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:30:01.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.663+0000 7f4b497fa700 1 -- 172.21.15.36:0/3199569337 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v248) v1 ==== 147+0+0 (secure 0 0 0) 0x7f4b44045940 con 0x7f4b4c0b2580 2022-01-10T01:30:01.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.663+0000 7f4b51187700 1 -- 172.21.15.36:0/3199569337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b2c0535f0 msgr2=0x7f4b2c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:01.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.663+0000 7f4b51187700 1 --2- 172.21.15.36:0/3199569337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b2c0535f0 0x7f4b2c055ab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f4b4001a000 tx=0x7f4b40014000).stop 2022-01-10T01:30:01.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.663+0000 7f4b51187700 1 -- 172.21.15.36:0/3199569337 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b4c0b2580 msgr2=0x7f4b4c1597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:01.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.663+0000 7f4b51187700 1 --2- 172.21.15.36:0/3199569337 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b4c0b2580 0x7f4b4c1597d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f4b44001490 tx=0x7f4b44007d60).stop 2022-01-10T01:30:01.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.667+0000 7f4b51187700 1 -- 172.21.15.36:0/3199569337 shutdown_connections 2022-01-10T01:30:01.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.667+0000 7f4b51187700 1 --2- 172.21.15.36:0/3199569337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b2c0535f0 0x7f4b2c055ab0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:01.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.667+0000 7f4b51187700 1 --2- 172.21.15.36:0/3199569337 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b4c0b2580 0x7f4b4c1597d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:01.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.667+0000 7f4b51187700 1 --2- 172.21.15.36:0/3199569337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b4c0b0010 0x7f4b4c156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:01.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.667+0000 7f4b51187700 1 --2- 172.21.15.36:0/3199569337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b4c0afbd0 0x7f4b4c0aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:01.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.667+0000 7f4b51187700 1 -- 172.21.15.36:0/3199569337 >> 172.21.15.36:0/3199569337 conn(0x7f4b4c060180 msgr2=0x7f4b4c14b080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:01.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.667+0000 7f4b51187700 1 -- 172.21.15.36:0/3199569337 shutdown_connections 2022-01-10T01:30:01.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.667+0000 7f4b51187700 1 -- 172.21.15.36:0/3199569337 wait complete. 2022-01-10T01:30:01.682 INFO:tasks.cephfs_test_runner:test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2022-01-10T01:30:01.682 INFO:tasks.cephfs_test_runner:Starting test: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2022-01-10T01:30:01.683 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2022-01-10T01:30:01.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.787+0000 7fa90cfcf700 1 Processor -- start 2022-01-10T01:30:01.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.787+0000 7fa90cfcf700 1 -- start start 2022-01-10T01:30:01.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.787+0000 7fa90cfcf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9080b2580 0x7fa90814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:01.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.787+0000 7fa90cfcf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9080a8ac0 0x7fa90814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:01.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.787+0000 7fa90cfcf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9080a70c0 con 0x7fa9080b0010 2022-01-10T01:30:01.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.787+0000 7fa90cfcf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9080a72f0 con 0x7fa9080b2580 2022-01-10T01:30:01.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.787+0000 7fa90cfcf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080a7590 con 0x7fa9080a8ac0 2022-01-10T01:30:01.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.787+0000 7fa907fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9080a8ac0 0x7fa90814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:01.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.787+0000 7fa9077fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9080b2580 0x7fa90814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:01.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.787+0000 7fa907fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9080a8ac0 0x7fa90814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:43908/0 (socket says 172.21.15.36:43908) 2022-01-10T01:30:01.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.787+0000 7fa907fff700 1 -- 172.21.15.36:0/1426862275 learned_addr learned my addr 172.21.15.36:0/1426862275 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:01.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa9067fc700 1 -- 172.21.15.36:0/1426862275 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600105121 0 0) 0x7fa9080a70c0 con 0x7fa9080b0010 2022-01-10T01:30:01.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa9067fc700 1 -- 172.21.15.36:0/1426862275 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8f4003260 con 0x7fa9080b0010 2022-01-10T01:30:01.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa907fff700 1 -- 172.21.15.36:0/1426862275 >> v2:172.21.15.59:3300/0 conn(0x7fa9080b2580 msgr2=0x7fa90814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:01.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa907fff700 1 --2- 172.21.15.36:0/1426862275 >> v2:172.21.15.59:3300/0 conn(0x7fa9080b2580 0x7fa90814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:01.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa907fff700 1 -- 172.21.15.36:0/1426862275 >> v1:172.21.15.59:6789/0 conn(0x7fa9080b0010 legacy=0x7fa9080a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:01.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa907fff700 1 -- 172.21.15.36:0/1426862275 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9080a7830 con 0x7fa9080a8ac0 2022-01-10T01:30:01.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa907fff700 1 --2- 172.21.15.36:0/1426862275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9080a8ac0 0x7fa90814b330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa9000032f0 tx=0x7fa900009290).ready entity=mon.2 client_cookie=6fbccfd16aee01eb server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:01.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa9067fc700 1 -- 172.21.15.36:0/1426862275 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa90000b6c0 con 0x7fa9080a8ac0 2022-01-10T01:30:01.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa9067fc700 1 -- 172.21.15.36:0/1426862275 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90000b820 con 0x7fa9080a8ac0 2022-01-10T01:30:01.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa9067fc700 1 -- 172.21.15.36:0/1426862275 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa90000b990 con 0x7fa9080a8ac0 2022-01-10T01:30:01.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa90cfcf700 1 -- 172.21.15.36:0/1426862275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9080a8ac0 msgr2=0x7fa90814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:01.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa90cfcf700 1 --2- 172.21.15.36:0/1426862275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9080a8ac0 0x7fa90814b330 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa9000032f0 tx=0x7fa900009290).stop 2022-01-10T01:30:01.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa90cfcf700 1 -- 172.21.15.36:0/1426862275 shutdown_connections 2022-01-10T01:30:01.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa90cfcf700 1 --2- 172.21.15.36:0/1426862275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9080a8ac0 0x7fa90814b330 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:01.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa90cfcf700 1 --2- 172.21.15.36:0/1426862275 >> v2:172.21.15.59:3300/0 conn(0x7fa9080b2580 0x7fa90814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:01.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa90cfcf700 1 -- 172.21.15.36:0/1426862275 >> 172.21.15.36:0/1426862275 conn(0x7fa908060180 msgr2=0x7fa9080b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:01.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa90cfcf700 1 -- 172.21.15.36:0/1426862275 shutdown_connections 2022-01-10T01:30:01.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa90cfcf700 1 -- 172.21.15.36:0/1426862275 wait complete. 2022-01-10T01:30:01.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa90cfcf700 1 Processor -- start 2022-01-10T01:30:01.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.791+0000 7fa90cfcf700 1 -- start start 2022-01-10T01:30:01.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa90cfcf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9080a8ac0 0x7fa9080aed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:01.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa90cfcf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9080b0010 0x7fa9080a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:01.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa90cfcf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9080b2580 0x7fa9080a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:01.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa90cfcf700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080b2e70 con 0x7fa9080b2580 2022-01-10T01:30:01.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa90cfcf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080af800 con 0x7fa9080a8ac0 2022-01-10T01:30:01.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa90cfcf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90815a670 con 0x7fa9080b0010 2022-01-10T01:30:01.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa907fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9080b2580 0x7fa9080a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:01.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa907fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9080b2580 0x7fa9080a9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37632/0 (socket says 172.21.15.36:37632) 2022-01-10T01:30:01.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa907fff700 1 -- 172.21.15.36:0/3211950858 learned_addr learned my addr 172.21.15.36:0/3211950858 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:01.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa906ffd700 1 --2- 172.21.15.36:0/3211950858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9080b0010 0x7fa9080a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:01.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa9077fe700 1 --2- 172.21.15.36:0/3211950858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9080a8ac0 0x7fa9080aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:01.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa907fff700 1 -- 172.21.15.36:0/3211950858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9080b0010 msgr2=0x7fa9080a9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:01.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa907fff700 1 --2- 172.21.15.36:0/3211950858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9080b0010 0x7fa9080a9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:01.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa907fff700 1 -- 172.21.15.36:0/3211950858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9080a8ac0 msgr2=0x7fa9080aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:01.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa907fff700 1 --2- 172.21.15.36:0/3211950858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9080a8ac0 0x7fa9080aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:01.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa907fff700 1 -- 172.21.15.36:0/3211950858 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa900009530 con 0x7fa9080b2580 2022-01-10T01:30:01.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa907fff700 1 --2- 172.21.15.36:0/3211950858 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9080b2580 0x7fa9080a9df0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fa9000032f0 tx=0x7fa900016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:01.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa904ff9700 1 -- 172.21.15.36:0/3211950858 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa90000b990 con 0x7fa9080b2580 2022-01-10T01:30:01.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa904ff9700 1 -- 172.21.15.36:0/3211950858 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa900021670 con 0x7fa9080b2580 2022-01-10T01:30:01.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa90cfcf700 1 -- 172.21.15.36:0/3211950858 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90815a380 con 0x7fa9080b2580 2022-01-10T01:30:01.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa904ff9700 1 -- 172.21.15.36:0/3211950858 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa90000b6c0 con 0x7fa9080b2580 2022-01-10T01:30:01.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.795+0000 7fa90cfcf700 1 -- 172.21.15.36:0/3211950858 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9080a9140 con 0x7fa9080b2580 2022-01-10T01:30:01.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.799+0000 7fa904ff9700 1 -- 172.21.15.36:0/3211950858 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa90000f070 con 0x7fa9080b2580 2022-01-10T01:30:01.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.799+0000 7fa90cfcf700 1 -- 172.21.15.36:0/3211950858 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9080b3000 con 0x7fa9080b2580 2022-01-10T01:30:01.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.799+0000 7fa904ff9700 1 --2- 172.21.15.36:0/3211950858 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa8e8053620 0x7fa8e8055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:01.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.799+0000 7fa904ff9700 1 -- 172.21.15.36:0/3211950858 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fa90006ca20 con 0x7fa9080b2580 2022-01-10T01:30:01.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.799+0000 7fa9077fe700 1 --2- 172.21.15.36:0/3211950858 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa8e8053620 0x7fa8e8055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:01.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.799+0000 7fa9077fe700 1 --2- 172.21.15.36:0/3211950858 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa8e8053620 0x7fa8e8055ae0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fa8fc00b000 tx=0x7fa8fc006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:01.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.803+0000 7fa904ff9700 1 -- 172.21.15.36:0/3211950858 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa9080b3000 con 0x7fa9080b2580 2022-01-10T01:30:01.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:01.979+0000 7fa90cfcf700 1 -- 172.21.15.36:0/3211950858 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7fa9080b3000 con 0x7fa9080b2580 2022-01-10T01:30:02.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.671+0000 7fa904ff9700 1 -- 172.21.15.36:0/3211950858 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v249) v1 ==== 142+0+0 (secure 0 0 0) 0x7fa9080b3000 con 0x7fa9080b2580 2022-01-10T01:30:02.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.675+0000 7fa90cfcf700 1 -- 172.21.15.36:0/3211950858 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa8e8053620 msgr2=0x7fa8e8055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:02.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.675+0000 7fa90cfcf700 1 --2- 172.21.15.36:0/3211950858 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa8e8053620 0x7fa8e8055ae0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fa8fc00b000 tx=0x7fa8fc006df0).stop 2022-01-10T01:30:02.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.675+0000 7fa90cfcf700 1 -- 172.21.15.36:0/3211950858 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9080b2580 msgr2=0x7fa9080a9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:02.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.675+0000 7fa90cfcf700 1 --2- 172.21.15.36:0/3211950858 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9080b2580 0x7fa9080a9df0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fa9000032f0 tx=0x7fa900016000).stop 2022-01-10T01:30:02.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.679+0000 7fa90cfcf700 1 -- 172.21.15.36:0/3211950858 shutdown_connections 2022-01-10T01:30:02.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.679+0000 7fa90cfcf700 1 --2- 172.21.15.36:0/3211950858 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa8e8053620 0x7fa8e8055ae0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:02.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.679+0000 7fa90cfcf700 1 --2- 172.21.15.36:0/3211950858 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa9080b2580 0x7fa9080a9df0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:02.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.679+0000 7fa90cfcf700 1 --2- 172.21.15.36:0/3211950858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9080b0010 0x7fa9080a9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:02.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.679+0000 7fa90cfcf700 1 --2- 172.21.15.36:0/3211950858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9080a8ac0 0x7fa9080aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:02.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.679+0000 7fa90cfcf700 1 -- 172.21.15.36:0/3211950858 >> 172.21.15.36:0/3211950858 conn(0x7fa908060180 msgr2=0x7fa9081486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:02.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.679+0000 7fa90cfcf700 1 -- 172.21.15.36:0/3211950858 shutdown_connections 2022-01-10T01:30:02.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.679+0000 7fa90cfcf700 1 -- 172.21.15.36:0/3211950858 wait complete. 2022-01-10T01:30:02.693 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2022-01-10T01:30:02.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f3fff700 1 Processor -- start 2022-01-10T01:30:02.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f3fff700 1 -- start start 2022-01-10T01:30:02.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18f40af550 0x7f18f41475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:02.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f3fff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f40b5880 con 0x7f18f40b54a0 2022-01-10T01:30:02.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f3fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f40ac800 con 0x7f18f40b0610 2022-01-10T01:30:02.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f3fff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f41452e0 con 0x7f18f40af550 2022-01-10T01:30:02.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f2ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f18f40b54a0 0x7f18f40675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35430/0 (socket says 172.21.15.36:35430) 2022-01-10T01:30:02.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f2ffd700 1 -- 172.21.15.36:0/1840390270 learned_addr learned my addr 172.21.15.36:0/1840390270 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:02.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f37fe700 1 --2- 172.21.15.36:0/1840390270 >> v2:172.21.15.59:3300/0 conn(0x7f18f40af550 0x7f18f41475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:02.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 -- 172.21.15.36:0/1840390270 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387417867 0 0) 0x7f18f40b5880 con 0x7f18f40b54a0 2022-01-10T01:30:02.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 -- 172.21.15.36:0/1840390270 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18d4003260 con 0x7f18f40b54a0 2022-01-10T01:30:02.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 -- 172.21.15.36:0/1840390270 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2481709312 0 0) 0x7f18d4003260 con 0x7f18f40b54a0 2022-01-10T01:30:02.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 -- 172.21.15.36:0/1840390270 >> v2:172.21.15.59:3300/0 conn(0x7f18f40af550 msgr2=0x7f18f41475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:02.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 --2- 172.21.15.36:0/1840390270 >> v2:172.21.15.59:3300/0 conn(0x7f18f40af550 0x7f18f41475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:02.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 -- 172.21.15.36:0/1840390270 >> v1:172.21.15.59:6789/0 conn(0x7f18f40b0610 legacy=0x7f18f40acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:02.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 -- 172.21.15.36:0/1840390270 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f40b1a30 con 0x7f18f40b54a0 2022-01-10T01:30:02.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 -- 172.21.15.36:0/1840390270 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f18e4001660 con 0x7f18f40b54a0 2022-01-10T01:30:02.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 -- 172.21.15.36:0/1840390270 >> v1:172.21.15.36:6789/0 conn(0x7f18f40b54a0 legacy=0x7f18f40675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:02.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 --2- 172.21.15.36:0/1840390270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18d4003750 0x7f18d4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:02.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 --2- 172.21.15.36:0/1840390270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18d4004500 0x7f18d4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:02.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 --2- 172.21.15.36:0/1840390270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d4004e70 0x7f18d400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:02.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 -- 172.21.15.36:0/1840390270 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f41452e0 con 0x7f18d4003750 2022-01-10T01:30:02.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 -- 172.21.15.36:0/1840390270 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d400bd20 con 0x7f18d4004e70 2022-01-10T01:30:02.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 -- 172.21.15.36:0/1840390270 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d400bee0 con 0x7f18d4004500 2022-01-10T01:30:02.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f2ffd700 1 --2- 172.21.15.36:0/1840390270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18d4003750 0x7f18d4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:02.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f37fe700 1 --2- 172.21.15.36:0/1840390270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d4004e70 0x7f18d400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:02.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f2ffd700 1 -- 172.21.15.36:0/1840390270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18d4004500 msgr2=0x7f18d4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:02.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18ea7fc700 1 --2- 172.21.15.36:0/1840390270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18d4004500 0x7f18d4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:02.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f2ffd700 1 --2- 172.21.15.36:0/1840390270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18d4004500 0x7f18d4004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:02.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f2ffd700 1 -- 172.21.15.36:0/1840390270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d4004e70 msgr2=0x7f18d400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:02.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f2ffd700 1 --2- 172.21.15.36:0/1840390270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d4004e70 0x7f18d400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:02.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f2ffd700 1 -- 172.21.15.36:0/1840390270 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d4003260 con 0x7f18d4003750 2022-01-10T01:30:02.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f37fe700 1 --2- 172.21.15.36:0/1840390270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d4004e70 0x7f18d400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:30:02.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18ea7fc700 1 --2- 172.21.15.36:0/1840390270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18d4004500 0x7f18d4004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:30:02.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f37fe700 1 -- 172.21.15.36:0/1840390270 reap_dead start 2022-01-10T01:30:02.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f2ffd700 1 --2- 172.21.15.36:0/1840390270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18d4003750 0x7f18d4003b70 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f18e4001370 tx=0x7f18e4001e10).ready entity=mon.0 client_cookie=3b79babdfbbff53a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:02.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.811+0000 7f18f27fc700 1 -- 172.21.15.36:0/1840390270 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18e40071a0 con 0x7f18d4003750 2022-01-10T01:30:02.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f27fc700 1 -- 172.21.15.36:0/1840390270 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e4007300 con 0x7f18d4003750 2022-01-10T01:30:02.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f27fc700 1 -- 172.21.15.36:0/1840390270 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18e400c8f0 con 0x7f18d4003750 2022-01-10T01:30:02.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 -- 172.21.15.36:0/1840390270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18d4003750 msgr2=0x7f18d4003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:02.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 --2- 172.21.15.36:0/1840390270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18d4003750 0x7f18d4003b70 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f18e4001370 tx=0x7f18e4001e10).stop 2022-01-10T01:30:02.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 -- 172.21.15.36:0/1840390270 shutdown_connections 2022-01-10T01:30:02.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 --2- 172.21.15.36:0/1840390270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18d4003750 0x7f18d4003b70 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:02.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 -- 172.21.15.36:0/1840390270 >> 172.21.15.36:0/1840390270 conn(0x7f18f4062560 msgr2=0x7f18f4062940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:02.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 -- 172.21.15.36:0/1840390270 shutdown_connections 2022-01-10T01:30:02.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 -- 172.21.15.36:0/1840390270 wait complete. 2022-01-10T01:30:02.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 Processor -- start 2022-01-10T01:30:02.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 -- start start 2022-01-10T01:30:02.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d4003750 0x7f18f40a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:02.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18f40a8370 0x7f18f4065d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:02.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f4063fb0 0x7f18f4066260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:02.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f40adff0 con 0x7f18f40a8370 2022-01-10T01:30:02.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f41575e0 con 0x7f18d4003750 2022-01-10T01:30:02.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.815+0000 7f18f3fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f4157880 con 0x7f18f4063fb0 2022-01-10T01:30:02.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18ea7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18f40a8370 0x7f18f4065d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:02.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18f2ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d4003750 0x7f18f40a7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:02.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18ea7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18f40a8370 0x7f18f4065d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37650/0 (socket says 172.21.15.36:37650) 2022-01-10T01:30:02.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18ea7fc700 1 -- 172.21.15.36:0/894949971 learned_addr learned my addr 172.21.15.36:0/894949971 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:02.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18f37fe700 1 --2- 172.21.15.36:0/894949971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f4063fb0 0x7f18f4066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:02.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18ea7fc700 1 -- 172.21.15.36:0/894949971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f4063fb0 msgr2=0x7f18f4066260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:02.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18ea7fc700 1 --2- 172.21.15.36:0/894949971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f4063fb0 0x7f18f4066260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:02.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18ea7fc700 1 -- 172.21.15.36:0/894949971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d4003750 msgr2=0x7f18f40a7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:02.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18ea7fc700 1 --2- 172.21.15.36:0/894949971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d4003750 0x7f18f40a7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:02.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18ea7fc700 1 -- 172.21.15.36:0/894949971 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f4146530 con 0x7f18f40a8370 2022-01-10T01:30:02.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18ea7fc700 1 --2- 172.21.15.36:0/894949971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18f40a8370 0x7f18f4065d70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f18dc008000 tx=0x7f18dc009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:02.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18f0ff9700 1 -- 172.21.15.36:0/894949971 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18dc013420 con 0x7f18f40a8370 2022-01-10T01:30:02.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18f0ff9700 1 -- 172.21.15.36:0/894949971 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc013580 con 0x7f18f40a8370 2022-01-10T01:30:02.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18f3fff700 1 -- 172.21.15.36:0/894949971 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f4064530 con 0x7f18f40a8370 2022-01-10T01:30:02.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18f0ff9700 1 -- 172.21.15.36:0/894949971 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18dc0138e0 con 0x7f18f40a8370 2022-01-10T01:30:02.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18f3fff700 1 -- 172.21.15.36:0/894949971 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f4066970 con 0x7f18f40a8370 2022-01-10T01:30:02.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18f0ff9700 1 -- 172.21.15.36:0/894949971 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f18dc013a40 con 0x7f18f40a8370 2022-01-10T01:30:02.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18f3fff700 1 -- 172.21.15.36:0/894949971 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f4157a80 con 0x7f18f40a8370 2022-01-10T01:30:02.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18f0ff9700 1 --2- 172.21.15.36:0/894949971 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f18d8053680 0x7f18d8055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:02.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18f0ff9700 1 -- 172.21.15.36:0/894949971 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f18dc06b7f0 con 0x7f18f40a8370 2022-01-10T01:30:02.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.819+0000 7f18f2ffd700 1 --2- 172.21.15.36:0/894949971 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f18d8053680 0x7f18d8055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:02.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.823+0000 7f18f2ffd700 1 --2- 172.21.15.36:0/894949971 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f18d8053680 0x7f18d8055b40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f18e4019000 tx=0x7f18e4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:02.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.827+0000 7f18f0ff9700 1 -- 172.21.15.36:0/894949971 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f18dc0429d0 con 0x7f18f40a8370 2022-01-10T01:30:02.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.959+0000 7f18f3fff700 1 -- 172.21.15.36:0/894949971 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f18f40b14f0 con 0x7f18f40a8370 2022-01-10T01:30:02.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.967+0000 7f18f0ff9700 1 -- 172.21.15.36:0/894949971 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f18dc045ff0 con 0x7f18f40a8370 2022-01-10T01:30:02.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.971+0000 7f18f3fff700 1 -- 172.21.15.36:0/894949971 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f18d8053680 msgr2=0x7f18d8055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:02.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.971+0000 7f18f3fff700 1 --2- 172.21.15.36:0/894949971 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f18d8053680 0x7f18d8055b40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f18e4019000 tx=0x7f18e4015000).stop 2022-01-10T01:30:02.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.971+0000 7f18f3fff700 1 -- 172.21.15.36:0/894949971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18f40a8370 msgr2=0x7f18f4065d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:02.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.971+0000 7f18f3fff700 1 --2- 172.21.15.36:0/894949971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18f40a8370 0x7f18f4065d70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f18dc008000 tx=0x7f18dc009040).stop 2022-01-10T01:30:02.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.971+0000 7f18f3fff700 1 -- 172.21.15.36:0/894949971 shutdown_connections 2022-01-10T01:30:02.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.971+0000 7f18f3fff700 1 --2- 172.21.15.36:0/894949971 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f18d8053680 0x7f18d8055b40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:02.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.971+0000 7f18f3fff700 1 --2- 172.21.15.36:0/894949971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18f4063fb0 0x7f18f4066260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:02.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.971+0000 7f18f3fff700 1 --2- 172.21.15.36:0/894949971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18f40a8370 0x7f18f4065d70 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:02.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.971+0000 7f18f3fff700 1 --2- 172.21.15.36:0/894949971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18d4003750 0x7f18f40a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:02.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.971+0000 7f18f3fff700 1 -- 172.21.15.36:0/894949971 >> 172.21.15.36:0/894949971 conn(0x7f18f4062560 msgr2=0x7f18f4143a00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:02.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.971+0000 7f18f3fff700 1 -- 172.21.15.36:0/894949971 shutdown_connections 2022-01-10T01:30:02.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:02.971+0000 7f18f3fff700 1 -- 172.21.15.36:0/894949971 wait complete. 2022-01-10T01:30:02.988 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:30:02.988 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:30:03.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:30:03.026 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:30:03.047 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:30:03.068 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:30:03.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:03.069 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:30:03.069 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:30:03.076 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2022-01-10T01:30:03.077 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:30:03.078 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2022-01-10T01:30:03.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:03.079 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:30:03.079 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:30:03.086 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:30:03.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:30:03.088 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:30:03.089 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:30:03.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe23d418700 1 Processor -- start 2022-01-10T01:30:03.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe23d418700 1 -- start start 2022-01-10T01:30:03.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe23d418700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2380b1db0 0x7fe2380b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe23d418700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe2380a70c0 0x7fe238144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe23d418700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2380b0350 con 0x7fe2381483a0 2022-01-10T01:30:03.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe23d418700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2380a90c0 con 0x7fe2380a70c0 2022-01-10T01:30:03.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe23d418700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380b05f0 con 0x7fe2380b1db0 2022-01-10T01:30:03.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe2367fc700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe2381483a0 0x7fe2380b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35452/0 (socket says 172.21.15.36:35452) 2022-01-10T01:30:03.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe2367fc700 1 -- 172.21.15.36:0/4062529656 learned_addr learned my addr 172.21.15.36:0/4062529656 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:03.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe2377fe700 1 --2- 172.21.15.36:0/4062529656 >> v2:172.21.15.36:3300/0 conn(0x7fe2380a70c0 0x7fe238144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe236ffd700 1 --2- 172.21.15.36:0/4062529656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2380b1db0 0x7fe2380b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 -- 172.21.15.36:0/4062529656 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1071288589 0 0) 0x7fe2380b0350 con 0x7fe2381483a0 2022-01-10T01:30:03.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 -- 172.21.15.36:0/4062529656 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe21c003260 con 0x7fe2381483a0 2022-01-10T01:30:03.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 -- 172.21.15.36:0/4062529656 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4102259053 0 0) 0x7fe21c003260 con 0x7fe2381483a0 2022-01-10T01:30:03.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 -- 172.21.15.36:0/4062529656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2380b1db0 msgr2=0x7fe2380b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:03.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 --2- 172.21.15.36:0/4062529656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2380b1db0 0x7fe2380b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 -- 172.21.15.36:0/4062529656 >> v2:172.21.15.36:3300/0 conn(0x7fe2380a70c0 msgr2=0x7fe238144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:03.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 --2- 172.21.15.36:0/4062529656 >> v2:172.21.15.36:3300/0 conn(0x7fe2380a70c0 0x7fe238144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 -- 172.21.15.36:0/4062529656 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2380b0890 con 0x7fe2381483a0 2022-01-10T01:30:03.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 -- 172.21.15.36:0/4062529656 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fe2280019e0 con 0x7fe2381483a0 2022-01-10T01:30:03.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 -- 172.21.15.36:0/4062529656 >> v1:172.21.15.36:6789/0 conn(0x7fe2381483a0 legacy=0x7fe2380b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 --2- 172.21.15.36:0/4062529656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2380b1db0 0x7fe21c003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 --2- 172.21.15.36:0/4062529656 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe21c003c80 0x7fe21c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 --2- 172.21.15.36:0/4062529656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe21c0049f0 0x7fe21c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 -- 172.21.15.36:0/4062529656 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380b05f0 con 0x7fe21c003c80 2022-01-10T01:30:03.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 -- 172.21.15.36:0/4062529656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c00b750 con 0x7fe21c0049f0 2022-01-10T01:30:03.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 -- 172.21.15.36:0/4062529656 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c00b890 con 0x7fe2380b1db0 2022-01-10T01:30:03.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe2367fc700 1 --2- 172.21.15.36:0/4062529656 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe21c003c80 0x7fe21c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe236ffd700 1 --2- 172.21.15.36:0/4062529656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2380b1db0 0x7fe21c003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe2377fe700 1 --2- 172.21.15.36:0/4062529656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe21c0049f0 0x7fe21c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe2367fc700 1 -- 172.21.15.36:0/4062529656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2380b1db0 msgr2=0x7fe21c003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:03.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe2367fc700 1 --2- 172.21.15.36:0/4062529656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2380b1db0 0x7fe21c003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe2367fc700 1 -- 172.21.15.36:0/4062529656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe21c0049f0 msgr2=0x7fe21c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:03.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe2367fc700 1 --2- 172.21.15.36:0/4062529656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe21c0049f0 0x7fe21c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe2367fc700 1 -- 172.21.15.36:0/4062529656 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c003260 con 0x7fe21c003c80 2022-01-10T01:30:03.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe2377fe700 1 --2- 172.21.15.36:0/4062529656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe21c0049f0 0x7fe21c004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:03.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe2367fc700 1 --2- 172.21.15.36:0/4062529656 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe21c003c80 0x7fe21c004500 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fe21c0054d0 tx=0x7fe2380b0a20).ready entity=mon.0 client_cookie=fecc09c30ffdb482 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:03.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.199+0000 7fe235ffb700 1 -- 172.21.15.36:0/4062529656 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe22800cd60 con 0x7fe21c003c80 2022-01-10T01:30:03.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.203+0000 7fe235ffb700 1 -- 172.21.15.36:0/4062529656 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe228005990 con 0x7fe21c003c80 2022-01-10T01:30:03.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.203+0000 7fe235ffb700 1 -- 172.21.15.36:0/4062529656 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe228005cf0 con 0x7fe21c003c80 2022-01-10T01:30:03.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.203+0000 7fe23d418700 1 -- 172.21.15.36:0/4062529656 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe21c003c80 msgr2=0x7fe21c004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.203+0000 7fe23d418700 1 --2- 172.21.15.36:0/4062529656 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe21c003c80 0x7fe21c004500 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fe21c0054d0 tx=0x7fe2380b0a20).stop 2022-01-10T01:30:03.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.203+0000 7fe2377fe700 1 -- 172.21.15.36:0/4062529656 reap_dead start 2022-01-10T01:30:03.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.203+0000 7fe23d418700 1 -- 172.21.15.36:0/4062529656 shutdown_connections 2022-01-10T01:30:03.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.203+0000 7fe23d418700 1 -- 172.21.15.36:0/4062529656 >> 172.21.15.36:0/4062529656 conn(0x7fe23805f6b0 msgr2=0x7fe23805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:03.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.203+0000 7fe23d418700 1 -- 172.21.15.36:0/4062529656 shutdown_connections 2022-01-10T01:30:03.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.203+0000 7fe23d418700 1 -- 172.21.15.36:0/4062529656 wait complete. 2022-01-10T01:30:03.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe23d418700 1 Processor -- start 2022-01-10T01:30:03.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe23d418700 1 -- start start 2022-01-10T01:30:03.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe23d418700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe21c003c80 0x7fe2380ac890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe23d418700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2380acd80 0x7fe2380658e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe23d418700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe238065dd0 0x7fe2380aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe23d418700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380afd50 con 0x7fe238065dd0 2022-01-10T01:30:03.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe23d418700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe238067770 con 0x7fe2380acd80 2022-01-10T01:30:03.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe23d418700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380a9cf0 con 0x7fe21c003c80 2022-01-10T01:30:03.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe2377fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe238065dd0 0x7fe2380aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe2377fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe238065dd0 0x7fe2380aa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37672/0 (socket says 172.21.15.36:37672) 2022-01-10T01:30:03.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe2377fe700 1 -- 172.21.15.36:0/3492530425 learned_addr learned my addr 172.21.15.36:0/3492530425 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:03.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe2367fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2380acd80 0x7fe2380658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe236ffd700 1 --2- 172.21.15.36:0/3492530425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe21c003c80 0x7fe2380ac890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe2377fe700 1 -- 172.21.15.36:0/3492530425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe21c003c80 msgr2=0x7fe2380ac890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe2377fe700 1 --2- 172.21.15.36:0/3492530425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe21c003c80 0x7fe2380ac890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe2377fe700 1 -- 172.21.15.36:0/3492530425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2380acd80 msgr2=0x7fe2380658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe2377fe700 1 --2- 172.21.15.36:0/3492530425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2380acd80 0x7fe2380658e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe2377fe700 1 -- 172.21.15.36:0/3492530425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe238157260 con 0x7fe238065dd0 2022-01-10T01:30:03.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe2377fe700 1 --2- 172.21.15.36:0/3492530425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe238065dd0 0x7fe2380aa0f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fe23000b000 tx=0x7fe230008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:03.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe227fff700 1 -- 172.21.15.36:0/3492530425 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe230010ec0 con 0x7fe238065dd0 2022-01-10T01:30:03.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe227fff700 1 -- 172.21.15.36:0/3492530425 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe230012540 con 0x7fe238065dd0 2022-01-10T01:30:03.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe23d418700 1 -- 172.21.15.36:0/3492530425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe238066d80 con 0x7fe238065dd0 2022-01-10T01:30:03.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe227fff700 1 -- 172.21.15.36:0/3492530425 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2300128a0 con 0x7fe238065dd0 2022-01-10T01:30:03.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.207+0000 7fe23d418700 1 -- 172.21.15.36:0/3492530425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe238066280 con 0x7fe238065dd0 2022-01-10T01:30:03.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.211+0000 7fe23d418700 1 -- 172.21.15.36:0/3492530425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2381573f0 con 0x7fe238065dd0 2022-01-10T01:30:03.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.211+0000 7fe227fff700 1 -- 172.21.15.36:0/3492530425 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe23001c030 con 0x7fe238065dd0 2022-01-10T01:30:03.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.211+0000 7fe227fff700 1 --2- 172.21.15.36:0/3492530425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe214053560 0x7fe214055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.211+0000 7fe227fff700 1 -- 172.21.15.36:0/3492530425 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fe23006b240 con 0x7fe238065dd0 2022-01-10T01:30:03.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.211+0000 7fe236ffd700 1 --2- 172.21.15.36:0/3492530425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe214053560 0x7fe214055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.211+0000 7fe236ffd700 1 --2- 172.21.15.36:0/3492530425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe214053560 0x7fe214055a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fe22c00b000 tx=0x7fe22c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:03.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.219+0000 7fe227fff700 1 -- 172.21.15.36:0/3492530425 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe2300424d0 con 0x7fe238065dd0 2022-01-10T01:30:03.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.347+0000 7fe23d418700 1 -- 172.21.15.36:0/3492530425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe238057350 con 0x7fe238065dd0 2022-01-10T01:30:03.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.351+0000 7fe227fff700 1 -- 172.21.15.36:0/3492530425 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v70) v1 ==== 81+0+29220 (secure 0 0 0) 0x7fe230045af0 con 0x7fe238065dd0 2022-01-10T01:30:03.351 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:03.352 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:30:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 70, 2022-01-10T01:30:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:30:03.352 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:30:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:30:00.647051+0000", 2022-01-10T01:30:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:30:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:30:03.353 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:30:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:30:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:30:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:30:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:30:03.354 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:30:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:30:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:30:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:30:03.355 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:30:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:30:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:30:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:30:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 12, 2022-01-10T01:30:03.356 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:30:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:30:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:30:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:30:03.357 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:30:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:30:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:30:03.358 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:30:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:30:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:30:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:30:03.359 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:30:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:30:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:30:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:30:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:30:03.360 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:30:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:30:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:30:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:30:03.361 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:30:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:30:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:30:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:30:03.362 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:30:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:30:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:30:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:30:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.363 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:30:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:30:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:30:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:30:03.364 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:30:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:30:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:30:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:30:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:30:03.365 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:30:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:30:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:30:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:30:03.366 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:30:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:30:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:30:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:30:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:30:03.367 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:30:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:30:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:30:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:30:03.368 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:30:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:30:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:30:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:30:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:30:03.369 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:30:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:30:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:30:03.370 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:30:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:30:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:30:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:30:03.371 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:30:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:30:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:30:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:30:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:30:03.372 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:30:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:30:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:30:03.373 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:30:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:30:03.374 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:30:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:30:03.375 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:30:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:30:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:30:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:30:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:30:03.376 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:30:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:30:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:30:03.377 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:30:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:30:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:30:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:30:03.378 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:30:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:30:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:30:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:30:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:30:03.379 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:30:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:30:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:30:03.380 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:30:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:30:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:30:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:30:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:30:03.381 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:30:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:30:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:30:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:30:03.382 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:30:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:30:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:30:03.383 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:30:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:30:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:30:03.384 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:30:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:30:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:30:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:30:03.385 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:30:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:30:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:30:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:30:03.386 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:30:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:30:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:30:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.387 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:30:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:30:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:30:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:30:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:30:03.388 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:30:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:30:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:30:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:30:03.389 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:30:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:30:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:30:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:30:03.390 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:30:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:30:03.391 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:30:03.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.392 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:30:03.392 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:30:03.392 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:30:03.392 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:30:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:30:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:30:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:30:03.393 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:30:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:30:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 65, 2022-01-10T01:30:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:30:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:30:03.394 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:30:03.395 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.395 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.395 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:30:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:30:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.396 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:30:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:30:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.397 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:30:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.398 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:30:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:30:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.399 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:30:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:30:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:30:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.401 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:30:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:30:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.402 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:30:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:30:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.403 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:30:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.404 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:30:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:30:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:30:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:30:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.406 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:30:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:30:03.407 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:30:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:30:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:30:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:30:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:30:03.408 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:30:03.409 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:30:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:30:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:30:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:30:03.410 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:30:03.411 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:30:03.411 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:30:03.411 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:30:03.411 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 65, 2022-01-10T01:30:03.411 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:30:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:30:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:30:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.412 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:30:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:30:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:30:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:30:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.414 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:30:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:30:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:30:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:30:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:30:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.417 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:30:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:30:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:30:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:30:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:30:03.420 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:30:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:30:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:30:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.423 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.423 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:30:03.423 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:30:03.423 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.424 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.424 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:30:03.424 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:30:03.424 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:30:03.425 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:30:03.425 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:30:03.425 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:30:03.425 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:30:03.426 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.426 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:30:03.426 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:30:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:30:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:30:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:30:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:30:03.427 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:30:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:30:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:30:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 65, 2022-01-10T01:30:03.428 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:30:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:30:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:30:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:30:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:30:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:30:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:30:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.431 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:30:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.433 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.433 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:30:03.433 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:30:03.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:30:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:30:03.434 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:30:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.435 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:30:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:30:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.437 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.437 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:30:03.437 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:30:03.437 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:30:03.438 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:30:03.439 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:30:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:30:03.440 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:30:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.441 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:30:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:30:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:30:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:30:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:30:03.442 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:30:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:30:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:30:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:30:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:30:03.444 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:30:03.445 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:30:03.445 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:30:03.445 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:30:03.445 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:30:03.445 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:30:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 64, 2022-01-10T01:30:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:30:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:30:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:30:03.446 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.447 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.447 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:30:03.447 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:30:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:30:03.448 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:30:03.449 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.449 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.449 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:30:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:30:03.450 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:30:03.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.451 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.451 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:30:03.452 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:30:03.452 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.452 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:30:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.454 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.454 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:30:03.454 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:30:03.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.455 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:30:03.456 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:30:03.456 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.456 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:30:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.457 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:30:03.458 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:30:03.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.458 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:30:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:30:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.460 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:30:03.460 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:30:03.460 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:30:03.460 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:30:03.461 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:30:03.461 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:30:03.461 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:30:03.461 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.462 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:30:03.462 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:30:03.463 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:30:03.463 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:30:03.463 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:30:03.463 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:30:03.463 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:30:03.464 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:30:03.464 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:30:03.464 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 65, 2022-01-10T01:30:03.464 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:30:03.464 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:30:03.465 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:30:03.465 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.465 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.466 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:30:03.466 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:30:03.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.466 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:30:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:30:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.467 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.468 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:30:03.468 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:30:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:30:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.470 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:30:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:30:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.471 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:30:03.472 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.472 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.472 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:30:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:30:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.473 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:30:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:30:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:30:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.475 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:30:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:30:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:30:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:30:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.477 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:30:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:30:03.478 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:30:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:30:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:30:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:30:03.479 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:30:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:30:03.480 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:30:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:30:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:30:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:30:03.481 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:30:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:30:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:30:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:30:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 64, 2022-01-10T01:30:03.482 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:30:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:30:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:30:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:30:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:30:03.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:30:03.485 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:30:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:30:03.486 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:30:03.487 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:30:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:30:03.488 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:30:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.489 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:30:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:30:03.490 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:30:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.491 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:30:03.492 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:30:03.492 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.492 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:30:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.493 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:30:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:30:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.494 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:30:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:30:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:30:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:30:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:30:03.496 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:30:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:30:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:30:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:30:03.497 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:30:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:30:03.498 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:30:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:30:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:30:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:30:03.499 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:30:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:30:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:30:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 65, 2022-01-10T01:30:03.500 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:30:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:30:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:30:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.501 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:30:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:30:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:30:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:30:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.503 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:30:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:30:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:30:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:30:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:30:03.506 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:30:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:30:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:30:03.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:30:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:30:03.509 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:30:03.510 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:30:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:30:03.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:30:03.512 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:30:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:30:03.513 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:30:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:30:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:30:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:30:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:30:03.514 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:30:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.515 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:30:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:30:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:30:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:30:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:30:03.516 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:30:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:30:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:30:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:30:03.517 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 65, 2022-01-10T01:30:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:30:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:30:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:30:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:30:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:30:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:30:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:30:03.520 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:30:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:30:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:30:03.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:30:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:30:03.523 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:30:03.524 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:30:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:30:03.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:30:03.526 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:30:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.527 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:30:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:30:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:30:03.528 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:30:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:30:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:30:03.529 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:30:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:30:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:30:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:30:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:30:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:30:03.531 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:30:03.532 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:30:03.532 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:30:03.532 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:03.532 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.533 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:30:03.533 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:30:03.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.533 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:30:03.533 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:30:03.534 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:30:03.534 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:30:03.534 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:30:03.534 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:30:03.535 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:30:03.535 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:30:03.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.536 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:30:03.536 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:30:03.536 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:30:03.536 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:30:03.536 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:30:03.537 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:30:03.537 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:30:03.537 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:30:03.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.538 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:30:03.538 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:30:03.538 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:30:03.538 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:30:03.539 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:30:03.539 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:30:03.539 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:30:03.539 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:30:03.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.540 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:30:03.540 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:30:03.541 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:30:03.541 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:30:03.541 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:30:03.541 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:30:03.541 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:30:03.542 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:30:03.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.542 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:30:03.543 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:30:03.543 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:30:03.543 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:30:03.543 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:30:03.543 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:30:03.544 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:30:03.544 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:30:03.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.545 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:30:03.545 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:30:03.545 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:30:03.545 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:30:03.545 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:30:03.546 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:30:03.546 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:30:03.546 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:30:03.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.547 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:30:03.547 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:30:03.547 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:30:03.547 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:30:03.548 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:30:03.548 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:30:03.548 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:30:03.548 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:30:03.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:03.549 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:30:03.549 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:30:03.549 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:30:03.550 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:30:03.550 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:30:03.550 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:30:03.550 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:30:03.551 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:30:03.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.551 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:30:03.551 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:30:03.551 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:30:03.552 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:30:03.552 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:30:03.552 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": { 2022-01-10T01:30:03.552 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.59:6833/1356140607": "2022-01-11T01:29:57.259759+0000", 2022-01-10T01:30:03.553 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.59:6832/1356140607": "2022-01-11T01:29:57.259759+0000" 2022-01-10T01:30:03.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.553 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:30:03.553 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:30:03.553 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:30:03.554 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:30:03.554 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:30:03.554 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:30:03.554 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:30:03.555 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:30:03.555 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:30:03.555 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:30:03.555 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:30:03.556 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:30:03.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.556 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:30:03.556 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:30:03.556 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:30:03.557 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:30:03.557 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:30:03.557 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:30:03.557 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:30:03.558 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:03.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:03.558 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:30:03.558 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:30:03.558 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:30:03.559 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:30:03.559 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:30:03.559 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:30:03.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.351+0000 7fe23d418700 1 -- 172.21.15.36:0/3492530425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe214053560 msgr2=0x7fe214055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.351+0000 7fe23d418700 1 --2- 172.21.15.36:0/3492530425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe214053560 0x7fe214055a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fe22c00b000 tx=0x7fe22c006df0).stop 2022-01-10T01:30:03.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.351+0000 7fe23d418700 1 -- 172.21.15.36:0/3492530425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe238065dd0 msgr2=0x7fe2380aa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.351+0000 7fe23d418700 1 --2- 172.21.15.36:0/3492530425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe238065dd0 0x7fe2380aa0f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7fe23000b000 tx=0x7fe230008040).stop 2022-01-10T01:30:03.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.351+0000 7fe23d418700 1 -- 172.21.15.36:0/3492530425 shutdown_connections 2022-01-10T01:30:03.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.351+0000 7fe23d418700 1 --2- 172.21.15.36:0/3492530425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe214053560 0x7fe214055a20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.351+0000 7fe23d418700 1 --2- 172.21.15.36:0/3492530425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe238065dd0 0x7fe2380aa0f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.351+0000 7fe23d418700 1 --2- 172.21.15.36:0/3492530425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2380acd80 0x7fe2380658e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.351+0000 7fe23d418700 1 --2- 172.21.15.36:0/3492530425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe21c003c80 0x7fe2380ac890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.351+0000 7fe23d418700 1 -- 172.21.15.36:0/3492530425 >> 172.21.15.36:0/3492530425 conn(0x7fe23805f6b0 msgr2=0x7fe2381447a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:03.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.351+0000 7fe23d418700 1 -- 172.21.15.36:0/3492530425 shutdown_connections 2022-01-10T01:30:03.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.351+0000 7fe23d418700 1 -- 172.21.15.36:0/3492530425 wait complete. 2022-01-10T01:30:03.565 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:30:03.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.679+0000 7f7ccffff700 1 Processor -- start 2022-01-10T01:30:03.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.679+0000 7f7ccffff700 1 -- start start 2022-01-10T01:30:03.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.679+0000 7f7ccffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd005c7d0 0x7f7cd00b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.679+0000 7f7ccffff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd005cbb0 con 0x7f7cd005d0b0 2022-01-10T01:30:03.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.679+0000 7f7ccffff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd00b1790 con 0x7f7cd013f390 2022-01-10T01:30:03.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.679+0000 7f7ccffff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd00ad540 con 0x7f7cd005c7d0 2022-01-10T01:30:03.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.679+0000 7f7cc67fc700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f7cd005d0b0 0x7f7cd00ace30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35470/0 (socket says 172.21.15.36:35470) 2022-01-10T01:30:03.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.679+0000 7f7cc67fc700 1 -- 172.21.15.36:0/2184377494 learned_addr learned my addr 172.21.15.36:0/2184377494 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:03.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7cceffd700 1 --2- 172.21.15.36:0/2184377494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd005c7d0 0x7f7cd00b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7cceffd700 1 -- 172.21.15.36:0/2184377494 >> v1:172.21.15.59:6789/0 conn(0x7f7cd013f390 legacy=0x7f7cd00aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7cceffd700 1 -- 172.21.15.36:0/2184377494 >> v1:172.21.15.36:6789/0 conn(0x7f7cd005d0b0 legacy=0x7f7cd00ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7cceffd700 1 -- 172.21.15.36:0/2184377494 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd00b1a30 con 0x7f7cd005c7d0 2022-01-10T01:30:03.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7cceffd700 1 --2- 172.21.15.36:0/2184377494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd005c7d0 0x7f7cd00b10f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7cb8002f70 tx=0x7f7cb8006df0).ready entity=mon.2 client_cookie=d4924c5e4f61d95a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:03.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7cce7fc700 1 -- 172.21.15.36:0/2184377494 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cb800d5c0 con 0x7f7cd005c7d0 2022-01-10T01:30:03.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7cce7fc700 1 -- 172.21.15.36:0/2184377494 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb8000e90 con 0x7f7cd005c7d0 2022-01-10T01:30:03.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7cce7fc700 1 -- 172.21.15.36:0/2184377494 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cb800d910 con 0x7f7cd005c7d0 2022-01-10T01:30:03.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7ccffff700 1 -- 172.21.15.36:0/2184377494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd005c7d0 msgr2=0x7f7cd00b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7ccffff700 1 --2- 172.21.15.36:0/2184377494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd005c7d0 0x7f7cd00b10f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7cb8002f70 tx=0x7f7cb8006df0).stop 2022-01-10T01:30:03.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7ccffff700 1 -- 172.21.15.36:0/2184377494 shutdown_connections 2022-01-10T01:30:03.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7ccffff700 1 --2- 172.21.15.36:0/2184377494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd005c7d0 0x7f7cd00b10f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7ccffff700 1 -- 172.21.15.36:0/2184377494 >> 172.21.15.36:0/2184377494 conn(0x7f7cd0060180 msgr2=0x7f7cd00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:03.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7ccffff700 1 -- 172.21.15.36:0/2184377494 shutdown_connections 2022-01-10T01:30:03.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.683+0000 7f7ccffff700 1 -- 172.21.15.36:0/2184377494 wait complete. 2022-01-10T01:30:03.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7ccffff700 1 Processor -- start 2022-01-10T01:30:03.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7ccffff700 1 -- start start 2022-01-10T01:30:03.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7ccffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd005c7d0 0x7f7cd00b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7ccffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7cd005d0b0 0x7f7cd00b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7ccffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd013f390 0x7f7cd00b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7ccffff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd00b5fe0 con 0x7f7cd005d0b0 2022-01-10T01:30:03.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7ccffff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd00a9480 con 0x7f7cd013f390 2022-01-10T01:30:03.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7ccffff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd00b5d40 con 0x7f7cd005c7d0 2022-01-10T01:30:03.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7cc67fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7cd005d0b0 0x7f7cd00b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7cceffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd005c7d0 0x7f7cd00b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7cc67fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7cd005d0b0 0x7f7cd00b0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37684/0 (socket says 172.21.15.36:37684) 2022-01-10T01:30:03.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7cc67fc700 1 -- 172.21.15.36:0/1226158939 learned_addr learned my addr 172.21.15.36:0/1226158939 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:03.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7ccf7fe700 1 --2- 172.21.15.36:0/1226158939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd013f390 0x7f7cd00b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7cc67fc700 1 -- 172.21.15.36:0/1226158939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd005c7d0 msgr2=0x7f7cd00b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7cc67fc700 1 --2- 172.21.15.36:0/1226158939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd005c7d0 0x7f7cd00b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7cc67fc700 1 -- 172.21.15.36:0/1226158939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd013f390 msgr2=0x7f7cd00b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7cc67fc700 1 --2- 172.21.15.36:0/1226158939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd013f390 0x7f7cd00b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7cc67fc700 1 -- 172.21.15.36:0/1226158939 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb800b180 con 0x7f7cd005d0b0 2022-01-10T01:30:03.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7cc67fc700 1 --2- 172.21.15.36:0/1226158939 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7cd005d0b0 0x7f7cd00b0230 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f7cd00a9610 tx=0x7f7cc0007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:03.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7cccff9700 1 -- 172.21.15.36:0/1226158939 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cc00070d0 con 0x7f7cd005d0b0 2022-01-10T01:30:03.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7cccff9700 1 -- 172.21.15.36:0/1226158939 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc0007230 con 0x7f7cd005d0b0 2022-01-10T01:30:03.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7ccffff700 1 -- 172.21.15.36:0/1226158939 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd00a91e0 con 0x7f7cd005d0b0 2022-01-10T01:30:03.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7cccff9700 1 -- 172.21.15.36:0/1226158939 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7cc00055d0 con 0x7f7cd005d0b0 2022-01-10T01:30:03.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.687+0000 7f7ccffff700 1 -- 172.21.15.36:0/1226158939 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd00b0da0 con 0x7f7cd005d0b0 2022-01-10T01:30:03.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.691+0000 7f7cccff9700 1 -- 172.21.15.36:0/1226158939 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7cc0010070 con 0x7f7cd005d0b0 2022-01-10T01:30:03.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.691+0000 7f7ccffff700 1 -- 172.21.15.36:0/1226158939 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd0057350 con 0x7f7cd005d0b0 2022-01-10T01:30:03.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.691+0000 7f7cccff9700 1 --2- 172.21.15.36:0/1226158939 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7cb40536b0 0x7f7cb4055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.691+0000 7f7cccff9700 1 -- 172.21.15.36:0/1226158939 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f7cc006ac80 con 0x7f7cd005d0b0 2022-01-10T01:30:03.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.691+0000 7f7cceffd700 1 --2- 172.21.15.36:0/1226158939 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7cb40536b0 0x7f7cb4055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.691+0000 7f7cceffd700 1 --2- 172.21.15.36:0/1226158939 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7cb40536b0 0x7f7cb4055b70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f7cb801c000 tx=0x7f7cb8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:03.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.695+0000 7f7cccff9700 1 -- 172.21.15.36:0/1226158939 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7cc0045e60 con 0x7f7cd005d0b0 2022-01-10T01:30:03.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.859+0000 7f7ccffff700 1 -- 172.21.15.36:0/1226158939 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cd00b2dd0 con 0x7f7cd005d0b0 2022-01-10T01:30:03.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.859+0000 7f7cccff9700 1 -- 172.21.15.36:0/1226158939 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+1563 (secure 0 0 0) 0x7f7cc0045e60 con 0x7f7cd005d0b0 2022-01-10T01:30:03.861 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:03.862 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":31,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6836/1674052345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":1674052345},{"type":"v1","addr":"172.21.15.36:6836","nonce":1674052345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27},{"gid":5919,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/3906479610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":3906479610},{"type":"v1","addr":"172.21.15.36:6837","nonce":3906479610}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27},{"gid":35594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1321638193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1321638193},{"type":"v1","addr":"172.21.15.59:6833","nonce":1321638193}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[]} 2022-01-10T01:30:03.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.863+0000 7f7ccffff700 1 -- 172.21.15.36:0/1226158939 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7cb40536b0 msgr2=0x7f7cb4055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.863+0000 7f7ccffff700 1 --2- 172.21.15.36:0/1226158939 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7cb40536b0 0x7f7cb4055b70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f7cb801c000 tx=0x7f7cb8015000).stop 2022-01-10T01:30:03.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.863+0000 7f7ccffff700 1 -- 172.21.15.36:0/1226158939 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7cd005d0b0 msgr2=0x7f7cd00b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.863+0000 7f7ccffff700 1 --2- 172.21.15.36:0/1226158939 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7cd005d0b0 0x7f7cd00b0230 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f7cd00a9610 tx=0x7f7cc0007c30).stop 2022-01-10T01:30:03.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.863+0000 7f7ccffff700 1 -- 172.21.15.36:0/1226158939 shutdown_connections 2022-01-10T01:30:03.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.863+0000 7f7ccffff700 1 --2- 172.21.15.36:0/1226158939 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7cb40536b0 0x7f7cb4055b70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.863+0000 7f7ccffff700 1 --2- 172.21.15.36:0/1226158939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cd013f390 0x7f7cd00b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.863+0000 7f7ccffff700 1 --2- 172.21.15.36:0/1226158939 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7cd005d0b0 0x7f7cd00b0230 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.863+0000 7f7ccffff700 1 --2- 172.21.15.36:0/1226158939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cd005c7d0 0x7f7cd00b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.863+0000 7f7ccffff700 1 -- 172.21.15.36:0/1226158939 >> 172.21.15.36:0/1226158939 conn(0x7f7cd0060180 msgr2=0x7f7cd013f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:03.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.863+0000 7f7ccffff700 1 -- 172.21.15.36:0/1226158939 shutdown_connections 2022-01-10T01:30:03.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.863+0000 7f7ccffff700 1 -- 172.21.15.36:0/1226158939 wait complete. 2022-01-10T01:30:03.867 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 31 2022-01-10T01:30:03.874 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:30:03.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5597c8a700 1 Processor -- start 2022-01-10T01:30:03.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5597c8a700 1 -- start start 2022-01-10T01:30:03.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5597c8a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f55900b0fd0 0x7f5590144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5597c8a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55900b0350 con 0x7f55901483a0 2022-01-10T01:30:03.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5597c8a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55900b05f0 con 0x7f55900b1db0 2022-01-10T01:30:03.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5597c8a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55900a90c0 con 0x7f55900b0fd0 2022-01-10T01:30:03.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5595225700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f55901483a0 0x7f55900a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35484/0 (socket says 172.21.15.36:35484) 2022-01-10T01:30:03.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5595225700 1 -- 172.21.15.36:0/2324191707 learned_addr learned my addr 172.21.15.36:0/2324191707 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:03.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5596227700 1 --2- 172.21.15.36:0/2324191707 >> v2:172.21.15.36:3300/0 conn(0x7f55900b0fd0 0x7f5590144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5594a24700 1 -- 172.21.15.36:0/2324191707 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666767998 0 0) 0x7f55900b0350 con 0x7f55901483a0 2022-01-10T01:30:03.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5594a24700 1 -- 172.21.15.36:0/2324191707 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5574003260 con 0x7f55901483a0 2022-01-10T01:30:03.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5596227700 1 -- 172.21.15.36:0/2324191707 >> v1:172.21.15.59:6789/0 conn(0x7f55900b1db0 legacy=0x7f55900b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5596227700 1 -- 172.21.15.36:0/2324191707 >> v1:172.21.15.36:6789/0 conn(0x7f55901483a0 legacy=0x7f55900a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5596227700 1 -- 172.21.15.36:0/2324191707 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55900b0890 con 0x7f55900b0fd0 2022-01-10T01:30:03.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5596227700 1 --2- 172.21.15.36:0/2324191707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55900b0fd0 0x7f5590144720 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f5590147730 tx=0x7f55880091d0).ready entity=mon.0 client_cookie=4a04590d9ed4f8ec server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:03.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5594a24700 1 -- 172.21.15.36:0/2324191707 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f558800b680 con 0x7f55900b0fd0 2022-01-10T01:30:03.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5594a24700 1 -- 172.21.15.36:0/2324191707 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558800b7e0 con 0x7f55900b0fd0 2022-01-10T01:30:03.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5594a24700 1 -- 172.21.15.36:0/2324191707 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f558800b950 con 0x7f55900b0fd0 2022-01-10T01:30:03.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5597c8a700 1 -- 172.21.15.36:0/2324191707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55900b0fd0 msgr2=0x7f5590144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5597c8a700 1 --2- 172.21.15.36:0/2324191707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55900b0fd0 0x7f5590144720 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f5590147730 tx=0x7f55880091d0).stop 2022-01-10T01:30:03.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5597c8a700 1 -- 172.21.15.36:0/2324191707 shutdown_connections 2022-01-10T01:30:03.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5597c8a700 1 --2- 172.21.15.36:0/2324191707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55900b0fd0 0x7f5590144720 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5597c8a700 1 -- 172.21.15.36:0/2324191707 >> 172.21.15.36:0/2324191707 conn(0x7f559005f6b0 msgr2=0x7f559005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:03.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.971+0000 7f5597c8a700 1 -- 172.21.15.36:0/2324191707 shutdown_connections 2022-01-10T01:30:03.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.975+0000 7f5597c8a700 1 -- 172.21.15.36:0/2324191707 wait complete. 2022-01-10T01:30:03.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.975+0000 7f5597c8a700 1 Processor -- start 2022-01-10T01:30:03.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.975+0000 7f5597c8a700 1 -- start start 2022-01-10T01:30:03.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5597c8a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55900b0fd0 0x7f55901488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5597c8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55900b1db0 0x7f559014a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5597c8a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55901483a0 0x7f55900ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5597c8a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55901497c0 con 0x7f55901483a0 2022-01-10T01:30:03.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5597c8a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55900af980 con 0x7f55900b1db0 2022-01-10T01:30:03.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5597c8a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55900af1e0 con 0x7f55900b0fd0 2022-01-10T01:30:03.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5596227700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55901483a0 0x7f55900ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5596227700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55901483a0 0x7f55900ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37700/0 (socket says 172.21.15.36:37700) 2022-01-10T01:30:03.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5596227700 1 -- 172.21.15.36:0/3266481776 learned_addr learned my addr 172.21.15.36:0/3266481776 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:03.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5595225700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55900b1db0 0x7f559014a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5595a26700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55900b0fd0 0x7f55901488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5596227700 1 -- 172.21.15.36:0/3266481776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55900b0fd0 msgr2=0x7f55901488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5596227700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55900b0fd0 0x7f55901488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5596227700 1 -- 172.21.15.36:0/3266481776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55900b1db0 msgr2=0x7f559014a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:03.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5596227700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55900b1db0 0x7f559014a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:03.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5596227700 1 -- 172.21.15.36:0/3266481776 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5588009470 con 0x7f55901483a0 2022-01-10T01:30:03.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5595a26700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55900b0fd0 0x7f55901488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:03.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5596227700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55901483a0 0x7f55900ad8d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f5590147730 tx=0x7f5588016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:03.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5586ffd700 1 -- 172.21.15.36:0/3266481776 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f558800b680 con 0x7f55901483a0 2022-01-10T01:30:03.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5586ffd700 1 -- 172.21.15.36:0/3266481776 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5588021630 con 0x7f55901483a0 2022-01-10T01:30:03.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5597c8a700 1 -- 172.21.15.36:0/3266481776 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55900afbb0 con 0x7f55901483a0 2022-01-10T01:30:03.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5586ffd700 1 -- 172.21.15.36:0/3266481776 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5588021990 con 0x7f55901483a0 2022-01-10T01:30:03.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5597c8a700 1 -- 172.21.15.36:0/3266481776 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559014a940 con 0x7f55901483a0 2022-01-10T01:30:03.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5597c8a700 1 -- 172.21.15.36:0/3266481776 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55900b0b30 con 0x7f55901483a0 2022-01-10T01:30:03.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.979+0000 7f5586ffd700 1 -- 172.21.15.36:0/3266481776 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5588027020 con 0x7f55901483a0 2022-01-10T01:30:03.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.983+0000 7f5586ffd700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55780535f0 0x7f5578055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:03.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.983+0000 7f5586ffd700 1 -- 172.21.15.36:0/3266481776 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f558806cbc0 con 0x7f55901483a0 2022-01-10T01:30:03.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.983+0000 7f5595a26700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55780535f0 0x7f5578055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:03.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.983+0000 7f5595a26700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55780535f0 0x7f5578055ab0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f558000b000 tx=0x7f5580009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:03.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:03.987+0000 7f5586ffd700 1 -- 172.21.15.36:0/3266481776 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5588043e10 con 0x7f55901483a0 2022-01-10T01:30:04.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.147+0000 7f5597c8a700 1 -- 172.21.15.36:0/3266481776 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5590057350 con 0x7f55901483a0 2022-01-10T01:30:04.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.147+0000 7f5586ffd700 1 -- 172.21.15.36:0/3266481776 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+1563 (secure 0 0 0) 0x7f5588015630 con 0x7f55901483a0 2022-01-10T01:30:04.151 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:04.151 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":31,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6836/1674052345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":1674052345},{"type":"v1","addr":"172.21.15.36:6836","nonce":1674052345}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27},{"gid":5919,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/3906479610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":3906479610},{"type":"v1","addr":"172.21.15.36:6837","nonce":3906479610}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":27},{"gid":35594,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1321638193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1321638193},{"type":"v1","addr":"172.21.15.59:6833","nonce":1321638193}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":30}],"filesystems":[]} 2022-01-10T01:30:04.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.151+0000 7f5597c8a700 1 -- 172.21.15.36:0/3266481776 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55780535f0 msgr2=0x7f5578055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:04.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.151+0000 7f5597c8a700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55780535f0 0x7f5578055ab0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f558000b000 tx=0x7f5580009040).stop 2022-01-10T01:30:04.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.151+0000 7f5597c8a700 1 -- 172.21.15.36:0/3266481776 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55901483a0 msgr2=0x7f55900ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:04.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.151+0000 7f5597c8a700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55901483a0 0x7f55900ad8d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f5590147730 tx=0x7f5588016000).stop 2022-01-10T01:30:04.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.151+0000 7f5597c8a700 1 -- 172.21.15.36:0/3266481776 shutdown_connections 2022-01-10T01:30:04.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.151+0000 7f5597c8a700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55780535f0 0x7f5578055ab0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:04.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.151+0000 7f5597c8a700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55901483a0 0x7f55900ad8d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:04.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.151+0000 7f5597c8a700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55900b1db0 0x7f559014a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:04.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.151+0000 7f5597c8a700 1 --2- 172.21.15.36:0/3266481776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55900b0fd0 0x7f55901488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:04.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.151+0000 7f5597c8a700 1 -- 172.21.15.36:0/3266481776 >> 172.21.15.36:0/3266481776 conn(0x7f559005f6b0 msgr2=0x7f55900b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:04.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.151+0000 7f5597c8a700 1 -- 172.21.15.36:0/3266481776 shutdown_connections 2022-01-10T01:30:04.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.151+0000 7f5597c8a700 1 -- 172.21.15.36:0/3266481776 wait complete. 2022-01-10T01:30:04.156 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 31 2022-01-10T01:30:04.164 INFO:tasks.ceph.mds.a:Restarting daemon 2022-01-10T01:30:04.164 INFO:tasks.ceph.mds.a:Stopping old one... 2022-01-10T01:30:04.164 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-01-10T01:30:04.165 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:30:04.165 INFO:tasks.ceph.mds.c:Restarting daemon 2022-01-10T01:30:04.165 INFO:tasks.ceph.mds.c:Stopping old one... 2022-01-10T01:30:04.166 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-01-10T01:30:04.166 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:30:04.166 INFO:tasks.ceph.mds.b:Restarting daemon 2022-01-10T01:30:04.167 INFO:tasks.ceph.mds.b:Stopping old one... 2022-01-10T01:30:04.167 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-01-10T01:30:04.167 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:30:04.176 INFO:tasks.ceph.mds.c:Stopped 2022-01-10T01:30:04.177 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-01-10T01:30:04.179 INFO:tasks.ceph.mds.a:Stopped 2022-01-10T01:30:04.179 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-01-10T01:30:04.183 INFO:tasks.ceph.mds.b:Stopped 2022-01-10T01:30:04.184 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-01-10T01:30:04.186 INFO:tasks.ceph.mds.b:Started 2022-01-10T01:30:04.186 DEBUG:teuthology.parallel:result is None 2022-01-10T01:30:04.223 INFO:tasks.ceph.mds.c:Started 2022-01-10T01:30:04.224 DEBUG:teuthology.parallel:result is None 2022-01-10T01:30:04.225 INFO:tasks.ceph.mds.a:Started 2022-01-10T01:30:04.226 DEBUG:teuthology.parallel:result is None 2022-01-10T01:30:04.226 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2022-01-10T01:30:04.263 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:30:04.299 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:30:04.311 INFO:tasks.ceph.mds.c.smithi036.stdout:starting mds.c at 2022-01-10T01:30:04.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed6819700 1 Processor -- start 2022-01-10T01:30:04.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed6819700 1 -- start start 2022-01-10T01:30:04.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed6819700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2ed0148860 0x7f2ed014ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:04.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed6819700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed0066ea0 con 0x7f2ed00a9c10 2022-01-10T01:30:04.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed6819700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed00b3420 con 0x7f2ed00b3040 2022-01-10T01:30:04.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed6819700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed00648e0 con 0x7f2ed0148860 2022-01-10T01:30:04.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed5016700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f2ed00a9c10 0x7f2ed00607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35524/0 (socket says 172.21.15.36:35524) 2022-01-10T01:30:04.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed5016700 1 -- 172.21.15.36:0/1996682910 learned_addr learned my addr 172.21.15.36:0/1996682910 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:04.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed6018700 1 --2- 172.21.15.36:0/1996682910 >> v2:172.21.15.36:3300/0 conn(0x7f2ed0148860 0x7f2ed014ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:04.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed6018700 1 -- 172.21.15.36:0/1996682910 >> v1:172.21.15.59:6789/0 conn(0x7f2ed00b3040 legacy=0x7f2ed0065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:04.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed6018700 1 -- 172.21.15.36:0/1996682910 >> v1:172.21.15.36:6789/0 conn(0x7f2ed00a9c10 legacy=0x7f2ed00607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:04.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed4815700 1 -- 172.21.15.36:0/1996682910 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057118724 0 0) 0x7f2ed0066ea0 con 0x7f2ed00a9c10 2022-01-10T01:30:04.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed6018700 1 -- 172.21.15.36:0/1996682910 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed0066960 con 0x7f2ed0148860 2022-01-10T01:30:04.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed6018700 1 --2- 172.21.15.36:0/1996682910 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ed0148860 0x7f2ed014ac50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f2ec80032f0 tx=0x7f2ec80091d0).ready entity=mon.0 client_cookie=9ad514ba4b35d7c6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:04.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed4815700 1 -- 172.21.15.36:0/1996682910 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ec8009ea0 con 0x7f2ed0148860 2022-01-10T01:30:04.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed4815700 1 -- 172.21.15.36:0/1996682910 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec800b8a0 con 0x7f2ed0148860 2022-01-10T01:30:04.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.343+0000 7f2ed4815700 1 -- 172.21.15.36:0/1996682910 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ec800ba10 con 0x7f2ed0148860 2022-01-10T01:30:04.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 -- 172.21.15.36:0/1996682910 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ed0148860 msgr2=0x7f2ed014ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:04.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 --2- 172.21.15.36:0/1996682910 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ed0148860 0x7f2ed014ac50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f2ec80032f0 tx=0x7f2ec80091d0).stop 2022-01-10T01:30:04.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 -- 172.21.15.36:0/1996682910 shutdown_connections 2022-01-10T01:30:04.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 --2- 172.21.15.36:0/1996682910 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ed0148860 0x7f2ed014ac50 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:04.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 -- 172.21.15.36:0/1996682910 >> 172.21.15.36:0/1996682910 conn(0x7f2ed00636e0 msgr2=0x7f2ed0063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:04.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 -- 172.21.15.36:0/1996682910 shutdown_connections 2022-01-10T01:30:04.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 -- 172.21.15.36:0/1996682910 wait complete. 2022-01-10T01:30:04.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 Processor -- start 2022-01-10T01:30:04.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 -- start start 2022-01-10T01:30:04.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed00a9c10 0x7f2ed0143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:04.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed00b3040 0x7f2ed0143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:04.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ed0148860 0x7f2ed014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:04.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed013f610 con 0x7f2ed0148860 2022-01-10T01:30:04.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed0140db0 con 0x7f2ed00a9c10 2022-01-10T01:30:04.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6819700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed013f870 con 0x7f2ed00b3040 2022-01-10T01:30:04.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6018700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ed0148860 0x7f2ed014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:04.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6018700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ed0148860 0x7f2ed014dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37738/0 (socket says 172.21.15.36:37738) 2022-01-10T01:30:04.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed6018700 1 -- 172.21.15.36:0/521042406 learned_addr learned my addr 172.21.15.36:0/521042406 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:04.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed5016700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed00b3040 0x7f2ed0143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:04.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.347+0000 7f2ed5817700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed00a9c10 0x7f2ed0143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:04.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ed6018700 1 -- 172.21.15.36:0/521042406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed00b3040 msgr2=0x7f2ed0143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:04.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ed6018700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed00b3040 0x7f2ed0143e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:04.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ed6018700 1 -- 172.21.15.36:0/521042406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed00a9c10 msgr2=0x7f2ed0143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:04.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ed6018700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed00a9c10 0x7f2ed0143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:04.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ed6018700 1 -- 172.21.15.36:0/521042406 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec8009470 con 0x7f2ed0148860 2022-01-10T01:30:04.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ed5016700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed00b3040 0x7f2ed0143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:04.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ed6018700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ed0148860 0x7f2ed014dd60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f2ec80032f0 tx=0x7f2ec8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:04.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ebeffd700 1 -- 172.21.15.36:0/521042406 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ec8009ea0 con 0x7f2ed0148860 2022-01-10T01:30:04.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ebeffd700 1 -- 172.21.15.36:0/521042406 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec801f3f0 con 0x7f2ed0148860 2022-01-10T01:30:04.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ed6819700 1 -- 172.21.15.36:0/521042406 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed0141010 con 0x7f2ed0148860 2022-01-10T01:30:04.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ebeffd700 1 -- 172.21.15.36:0/521042406 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ec801f750 con 0x7f2ed0148860 2022-01-10T01:30:04.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ed6819700 1 -- 172.21.15.36:0/521042406 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed013f250 con 0x7f2ed0148860 2022-01-10T01:30:04.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ed6819700 1 -- 172.21.15.36:0/521042406 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed01411a0 con 0x7f2ed0148860 2022-01-10T01:30:04.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ebeffd700 1 -- 172.21.15.36:0/521042406 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2ec8026030 con 0x7f2ed0148860 2022-01-10T01:30:04.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ebeffd700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2eb00536b0 0x7f2eb0055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:04.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ebeffd700 1 -- 172.21.15.36:0/521042406 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f2ec806c330 con 0x7f2ed0148860 2022-01-10T01:30:04.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ed5817700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2eb00536b0 0x7f2eb0055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:04.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.351+0000 7f2ed5817700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2eb00536b0 0x7f2eb0055b70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f2ecc00d000 tx=0x7f2ecc009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:04.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.359+0000 7f2ebeffd700 1 -- 172.21.15.36:0/521042406 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2ec8043620 con 0x7f2ed0148860 2022-01-10T01:30:04.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:04.495+0000 7f2ed6819700 1 -- 172.21.15.36:0/521042406 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f2ed0066c00 con 0x7f2ed0148860 2022-01-10T01:30:05.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.339+0000 7f2ebeffd700 1 -- 172.21.15.36:0/521042406 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v73) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2ec8046c40 con 0x7f2ed0148860 2022-01-10T01:30:05.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.343+0000 7f2ed6819700 1 -- 172.21.15.36:0/521042406 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2eb00536b0 msgr2=0x7f2eb0055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:05.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.343+0000 7f2ed6819700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2eb00536b0 0x7f2eb0055b70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f2ecc00d000 tx=0x7f2ecc009040).stop 2022-01-10T01:30:05.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.343+0000 7f2ed6819700 1 -- 172.21.15.36:0/521042406 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ed0148860 msgr2=0x7f2ed014dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:05.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.343+0000 7f2ed6819700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ed0148860 0x7f2ed014dd60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f2ec80032f0 tx=0x7f2ec8016000).stop 2022-01-10T01:30:05.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.343+0000 7f2ed6819700 1 -- 172.21.15.36:0/521042406 shutdown_connections 2022-01-10T01:30:05.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.343+0000 7f2ed6819700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2eb00536b0 0x7f2eb0055b70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.343+0000 7f2ed6819700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ed0148860 0x7f2ed014dd60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.343+0000 7f2ed6819700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ed00b3040 0x7f2ed0143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.347+0000 7f2ed6819700 1 --2- 172.21.15.36:0/521042406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ed00a9c10 0x7f2ed0143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.347+0000 7f2ed6819700 1 -- 172.21.15.36:0/521042406 >> 172.21.15.36:0/521042406 conn(0x7f2ed00636e0 msgr2=0x7f2ed00b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:05.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.347+0000 7f2ed6819700 1 -- 172.21.15.36:0/521042406 shutdown_connections 2022-01-10T01:30:05.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.347+0000 7f2ed6819700 1 -- 172.21.15.36:0/521042406 wait complete. 2022-01-10T01:30:05.350 INFO:teuthology.orchestra.run.smithi036.stderr: removed all blacklist entries 2022-01-10T01:30:05.362 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2022-01-10T01:30:05.363 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2022-01-10T01:30:05.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.471+0000 7f4b2e7bf700 1 Processor -- start 2022-01-10T01:30:05.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.471+0000 7f4b2e7bf700 1 -- start start 2022-01-10T01:30:05.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.471+0000 7f4b2e7bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b280b0010 0x7f4b280a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:05.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.471+0000 7f4b2e7bf700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b280a70c0 con 0x7f4b280b2580 2022-01-10T01:30:05.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.471+0000 7f4b2e7bf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b280a72f0 con 0x7f4b280afbd0 2022-01-10T01:30:05.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.471+0000 7f4b2e7bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280a7590 con 0x7f4b280b0010 2022-01-10T01:30:05.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.471+0000 7f4b2d7bd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f4b280b2580 0x7f4b2814ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35540/0 (socket says 172.21.15.36:35540) 2022-01-10T01:30:05.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.471+0000 7f4b2d7bd700 1 -- 172.21.15.36:0/4055334902 learned_addr learned my addr 172.21.15.36:0/4055334902 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:05.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.471+0000 7f4b2cfbc700 1 --2- 172.21.15.36:0/4055334902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b280b0010 0x7f4b280a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:05.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b27fff700 1 -- 172.21.15.36:0/4055334902 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207487473 0 0) 0x7f4b280a70c0 con 0x7f4b280b2580 2022-01-10T01:30:05.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b27fff700 1 -- 172.21.15.36:0/4055334902 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b14003260 con 0x7f4b280b2580 2022-01-10T01:30:05.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b27fff700 1 -- 172.21.15.36:0/4055334902 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584026833 0 0) 0x7f4b280a72f0 con 0x7f4b280afbd0 2022-01-10T01:30:05.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b27fff700 1 -- 172.21.15.36:0/4055334902 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b280a70c0 con 0x7f4b280afbd0 2022-01-10T01:30:05.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2cfbc700 1 -- 172.21.15.36:0/4055334902 >> v1:172.21.15.59:6789/0 conn(0x7f4b280afbd0 legacy=0x7f4b28151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:05.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2cfbc700 1 -- 172.21.15.36:0/4055334902 >> v1:172.21.15.36:6789/0 conn(0x7f4b280b2580 legacy=0x7f4b2814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:05.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2cfbc700 1 -- 172.21.15.36:0/4055334902 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b280a7830 con 0x7f4b280b0010 2022-01-10T01:30:05.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2cfbc700 1 --2- 172.21.15.36:0/4055334902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b280b0010 0x7f4b280a83b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f4b180032f0 tx=0x7f4b180091d0).ready entity=mon.2 client_cookie=12a5398970345306 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:05.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b27fff700 1 -- 172.21.15.36:0/4055334902 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1800b640 con 0x7f4b280b0010 2022-01-10T01:30:05.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b27fff700 1 -- 172.21.15.36:0/4055334902 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1800b7a0 con 0x7f4b280b0010 2022-01-10T01:30:05.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b27fff700 1 -- 172.21.15.36:0/4055334902 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1800b910 con 0x7f4b280b0010 2022-01-10T01:30:05.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/4055334902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b280b0010 msgr2=0x7f4b280a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:05.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2e7bf700 1 --2- 172.21.15.36:0/4055334902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b280b0010 0x7f4b280a83b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f4b180032f0 tx=0x7f4b180091d0).stop 2022-01-10T01:30:05.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/4055334902 shutdown_connections 2022-01-10T01:30:05.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2e7bf700 1 --2- 172.21.15.36:0/4055334902 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b280b0010 0x7f4b280a83b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/4055334902 >> 172.21.15.36:0/4055334902 conn(0x7f4b28060180 msgr2=0x7f4b280b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:05.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/4055334902 shutdown_connections 2022-01-10T01:30:05.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/4055334902 wait complete. 2022-01-10T01:30:05.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2e7bf700 1 Processor -- start 2022-01-10T01:30:05.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2e7bf700 1 -- start start 2022-01-10T01:30:05.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2e7bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b280afbd0 0x7f4b280af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:05.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2e7bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b280b0010 0x7f4b2813e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:05.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.475+0000 7f4b2e7bf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b280b2580 0x7f4b2813e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:05.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2e7bf700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280b3400 con 0x7f4b280b2580 2022-01-10T01:30:05.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2e7bf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280b3150 con 0x7f4b280afbd0 2022-01-10T01:30:05.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2e7bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28159ab0 con 0x7f4b280b0010 2022-01-10T01:30:05.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2dfbe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b280b2580 0x7f4b2813e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:05.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2dfbe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b280b2580 0x7f4b2813e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37752/0 (socket says 172.21.15.36:37752) 2022-01-10T01:30:05.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2dfbe700 1 -- 172.21.15.36:0/2029879375 learned_addr learned my addr 172.21.15.36:0/2029879375 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:05.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2cfbc700 1 --2- 172.21.15.36:0/2029879375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b280b0010 0x7f4b2813e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:05.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2d7bd700 1 --2- 172.21.15.36:0/2029879375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b280afbd0 0x7f4b280af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:05.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2dfbe700 1 -- 172.21.15.36:0/2029879375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b280b0010 msgr2=0x7f4b2813e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:05.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2dfbe700 1 --2- 172.21.15.36:0/2029879375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b280b0010 0x7f4b2813e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2dfbe700 1 -- 172.21.15.36:0/2029879375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b280afbd0 msgr2=0x7f4b280af0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:05.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2dfbe700 1 --2- 172.21.15.36:0/2029879375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b280afbd0 0x7f4b280af0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2dfbe700 1 -- 172.21.15.36:0/2029879375 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b18009470 con 0x7f4b280b2580 2022-01-10T01:30:05.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2dfbe700 1 --2- 172.21.15.36:0/2029879375 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b280b2580 0x7f4b2813e960 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f4b20001110 tx=0x7f4b20007a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:05.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b267fc700 1 -- 172.21.15.36:0/2029879375 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b20012400 con 0x7f4b280b2580 2022-01-10T01:30:05.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b267fc700 1 -- 172.21.15.36:0/2029879375 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b20012560 con 0x7f4b280b2580 2022-01-10T01:30:05.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/2029879375 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b281570d0 con 0x7f4b280b2580 2022-01-10T01:30:05.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b267fc700 1 -- 172.21.15.36:0/2029879375 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b200128c0 con 0x7f4b280b2580 2022-01-10T01:30:05.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/2029879375 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2813ee50 con 0x7f4b280b2580 2022-01-10T01:30:05.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/2029879375 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b28159c20 con 0x7f4b280b2580 2022-01-10T01:30:05.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b267fc700 1 -- 172.21.15.36:0/2029879375 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4b20010070 con 0x7f4b280b2580 2022-01-10T01:30:05.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b267fc700 1 --2- 172.21.15.36:0/2029879375 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b080535f0 0x7f4b08055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:05.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b267fc700 1 -- 172.21.15.36:0/2029879375 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f4b2006a800 con 0x7f4b280b2580 2022-01-10T01:30:05.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.479+0000 7f4b2d7bd700 1 --2- 172.21.15.36:0/2029879375 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b080535f0 0x7f4b08055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:05.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.483+0000 7f4b2d7bd700 1 --2- 172.21.15.36:0/2029879375 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b080535f0 0x7f4b08055ab0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f4b1c00d000 tx=0x7f4b1c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:05.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.487+0000 7f4b267fc700 1 -- 172.21.15.36:0/2029879375 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b28159c20 con 0x7f4b280b2580 2022-01-10T01:30:05.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.655+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/2029879375 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4b28159c20 con 0x7f4b280b2580 2022-01-10T01:30:05.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.655+0000 7f4b267fc700 1 -- 172.21.15.36:0/2029879375 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f4b28159c20 con 0x7f4b280b2580 2022-01-10T01:30:05.658 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:05.659 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:30:05.659 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_dump": [ 2022-01-10T01:30:05.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.659 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.a", 2022-01-10T01:30:05.660 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthuGT4IxAA5DyijS4tPjdOLn5uiLXEPg==", 2022-01-10T01:30:05.660 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.660 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:30:05.660 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:30:05.660 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:30:05.661 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:30:05.661 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.662 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.b", 2022-01-10T01:30:05.662 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthkvX0LRAAtz19usFvoObvouQeLFwicg==", 2022-01-10T01:30:05.662 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.662 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:30:05.662 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:30:05.663 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:30:05.663 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:30:05.663 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.664 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.c", 2022-01-10T01:30:05.664 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthbvUmKhAA0pVpDJO1AfsAzIHU1cAHiw==", 2022-01-10T01:30:05.664 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.664 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:30:05.665 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:30:05.665 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:30:05.665 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:30:05.665 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.666 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.0", 2022-01-10T01:30:05.666 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCWitthk4iKHRAAF7aFP+i24xFvXXm8j5GzVg==", 2022-01-10T01:30:05.666 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.667 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:30:05.667 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:30:05.667 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:30:05.667 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.668 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.1", 2022-01-10T01:30:05.668 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCZitthsKSXABAAb3IkNvlyLub89HwaPWZ1Bg==", 2022-01-10T01:30:05.668 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.669 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:30:05.669 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:30:05.669 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:30:05.669 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.670 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.2", 2022-01-10T01:30:05.670 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCbitthvNzhIBAAXkZ6FslnMl1gS/rOa7G+Vg==", 2022-01-10T01:30:05.670 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.671 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:30:05.671 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:30:05.671 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:30:05.671 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.671 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.672 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.3", 2022-01-10T01:30:05.672 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCeitth9P7EAxAA7KOCP7Rh5oN1yqCz9I6v3A==", 2022-01-10T01:30:05.672 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.672 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:30:05.673 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:30:05.673 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:30:05.673 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.674 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.4", 2022-01-10T01:30:05.674 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCjitth/L1UBxAAskxmSV0aE6CSvDFR8O/+SQ==", 2022-01-10T01:30:05.674 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.674 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:30:05.675 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:30:05.675 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:30:05.675 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.676 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.5", 2022-01-10T01:30:05.676 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQClitthMoY6JhAAeeIrCmMcm3MpDPtdLUf+2g==", 2022-01-10T01:30:05.676 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.676 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:30:05.677 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:30:05.677 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:30:05.677 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.678 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.6", 2022-01-10T01:30:05.678 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCoitthrUhlCxAAsYhU7Kj6HMo/kD0DezvITg==", 2022-01-10T01:30:05.678 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.678 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:30:05.678 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:30:05.679 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:30:05.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.680 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.7", 2022-01-10T01:30:05.680 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCqitthFaLrKRAAC2g1OlcV2KTtaOXsyCrIrQ==", 2022-01-10T01:30:05.680 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.680 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:30:05.680 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:30:05.681 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:30:05.681 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.681 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.0", 2022-01-10T01:30:05.682 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthKoa/NBAADjvHh99F8YOktGID9uyttg==", 2022-01-10T01:30:05.682 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.682 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:30:05.682 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:30:05.683 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:30:05.683 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.683 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.1", 2022-01-10T01:30:05.684 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth3x76OBAAPTrw8OUmnpEflWuB7zzaHg==", 2022-01-10T01:30:05.684 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.684 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:30:05.684 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:30:05.685 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:30:05.685 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.685 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.admin", 2022-01-10T01:30:05.685 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthf9dqChAADHRsoZKuozdsqb41ztuR7w==", 2022-01-10T01:30:05.686 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.686 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:30:05.686 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:30:05.686 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:30:05.687 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:30:05.687 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.688 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.x", 2022-01-10T01:30:05.688 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth39syIRAA6pOvLWw2ADy72TWZ65MIkA==", 2022-01-10T01:30:05.688 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.688 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:30:05.688 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:30:05.689 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:30:05.689 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:05.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:05.689 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.y", 2022-01-10T01:30:05.690 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth4novHRAACVMjo72kOB/T7Ti/CiN27w==", 2022-01-10T01:30:05.690 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:30:05.690 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:30:05.690 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:30:05.691 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:30:05.691 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.691 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:05.691 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:30:05.691 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:30:05.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.659+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/2029879375 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b080535f0 msgr2=0x7f4b08055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:05.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.659+0000 7f4b2e7bf700 1 --2- 172.21.15.36:0/2029879375 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b080535f0 0x7f4b08055ab0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f4b1c00d000 tx=0x7f4b1c009040).stop 2022-01-10T01:30:05.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.659+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/2029879375 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b280b2580 msgr2=0x7f4b2813e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:05.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.659+0000 7f4b2e7bf700 1 --2- 172.21.15.36:0/2029879375 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b280b2580 0x7f4b2813e960 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f4b20001110 tx=0x7f4b20007a10).stop 2022-01-10T01:30:05.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.659+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/2029879375 shutdown_connections 2022-01-10T01:30:05.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.659+0000 7f4b2e7bf700 1 --2- 172.21.15.36:0/2029879375 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b080535f0 0x7f4b08055ab0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.659+0000 7f4b2e7bf700 1 --2- 172.21.15.36:0/2029879375 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b280b2580 0x7f4b2813e960 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.659+0000 7f4b2e7bf700 1 --2- 172.21.15.36:0/2029879375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b280b0010 0x7f4b2813e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.659+0000 7f4b2e7bf700 1 --2- 172.21.15.36:0/2029879375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b280afbd0 0x7f4b280af0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.659+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/2029879375 >> 172.21.15.36:0/2029879375 conn(0x7f4b28060180 msgr2=0x7f4b281497c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:05.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.659+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/2029879375 shutdown_connections 2022-01-10T01:30:05.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.659+0000 7f4b2e7bf700 1 -- 172.21.15.36:0/2029879375 wait complete. 2022-01-10T01:30:05.697 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:30:05.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 Processor -- start 2022-01-10T01:30:05.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 -- start start 2022-01-10T01:30:05.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7180b6900 0x7fb7180acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:05.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb718060910 0x7fb71805c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:05.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7180a9ec0 0x7fb7180aa330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:05.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7180b6ce0 con 0x7fb718060910 2022-01-10T01:30:05.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7180611e0 con 0x7fb7180b6900 2022-01-10T01:30:05.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb718061480 con 0x7fb7180a9ec0 2022-01-10T01:30:05.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb70e59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb718060910 0x7fb71805c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:05.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb70e59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb718060910 0x7fb71805c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37760/0 (socket says 172.21.15.36:37760) 2022-01-10T01:30:05.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb70e59c700 1 -- 172.21.15.36:0/4063805899 learned_addr learned my addr 172.21.15.36:0/4063805899 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:05.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71759e700 1 --2- 172.21.15.36:0/4063805899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7180a9ec0 0x7fb7180aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:05.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb716d9d700 1 --2- 172.21.15.36:0/4063805899 >> v2:172.21.15.59:3300/0 conn(0x7fb7180b6900 0x7fb7180acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:05.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb70e59c700 1 -- 172.21.15.36:0/4063805899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7180a9ec0 msgr2=0x7fb7180aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:05.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb70e59c700 1 --2- 172.21.15.36:0/4063805899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7180a9ec0 0x7fb7180aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb70e59c700 1 -- 172.21.15.36:0/4063805899 >> v2:172.21.15.59:3300/0 conn(0x7fb7180b6900 msgr2=0x7fb7180acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:05.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb70e59c700 1 --2- 172.21.15.36:0/4063805899 >> v2:172.21.15.59:3300/0 conn(0x7fb7180b6900 0x7fb7180acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb70e59c700 1 -- 172.21.15.36:0/4063805899 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718061720 con 0x7fb718060910 2022-01-10T01:30:05.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb716d9d700 1 --2- 172.21.15.36:0/4063805899 >> v2:172.21.15.59:3300/0 conn(0x7fb7180b6900 0x7fb7180acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:30:05.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71759e700 1 --2- 172.21.15.36:0/4063805899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7180a9ec0 0x7fb7180aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:30:05.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb70e59c700 1 --2- 172.21.15.36:0/4063805899 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb718060910 0x7fb71805c490 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fb700002f70 tx=0x7fb700006eb0).ready entity=mon.0 client_cookie=18a7aa6c6cad23ce server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:05.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71659c700 1 -- 172.21.15.36:0/4063805899 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb70000f970 con 0x7fb718060910 2022-01-10T01:30:05.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71659c700 1 -- 172.21.15.36:0/4063805899 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb700000e90 con 0x7fb718060910 2022-01-10T01:30:05.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71659c700 1 -- 172.21.15.36:0/4063805899 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb70000fd00 con 0x7fb718060910 2022-01-10T01:30:05.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 -- 172.21.15.36:0/4063805899 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb718060910 msgr2=0x7fb71805c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:05.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 --2- 172.21.15.36:0/4063805899 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb718060910 0x7fb71805c490 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fb700002f70 tx=0x7fb700006eb0).stop 2022-01-10T01:30:05.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 -- 172.21.15.36:0/4063805899 shutdown_connections 2022-01-10T01:30:05.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 --2- 172.21.15.36:0/4063805899 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7180a9ec0 0x7fb7180aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 --2- 172.21.15.36:0/4063805899 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb718060910 0x7fb71805c490 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 --2- 172.21.15.36:0/4063805899 >> v2:172.21.15.59:3300/0 conn(0x7fb7180b6900 0x7fb7180acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 -- 172.21.15.36:0/4063805899 >> 172.21.15.36:0/4063805899 conn(0x7fb7180b3480 msgr2=0x7fb7180b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:05.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 -- 172.21.15.36:0/4063805899 shutdown_connections 2022-01-10T01:30:05.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.799+0000 7fb71d0a5700 1 -- 172.21.15.36:0/4063805899 wait complete. 2022-01-10T01:30:05.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb71d0a5700 1 Processor -- start 2022-01-10T01:30:05.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb71d0a5700 1 -- start start 2022-01-10T01:30:05.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb71d0a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb718060910 0x7fb71813e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:05.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb71d0a5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180a9ec0 0x7fb71813ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:05.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb71d0a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7180b6900 0x7fb7181424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:05.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb71d0a5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb718067140 con 0x7fb7180a9ec0 2022-01-10T01:30:05.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb71d0a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71813fcf0 con 0x7fb7180b6900 2022-01-10T01:30:05.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb71d0a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71813f310 con 0x7fb718060910 2022-01-10T01:30:05.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb70e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180a9ec0 0x7fb71813ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:05.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb70e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180a9ec0 0x7fb71813ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37766/0 (socket says 172.21.15.36:37766) 2022-01-10T01:30:05.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb70e59c700 1 -- 172.21.15.36:0/2944477087 learned_addr learned my addr 172.21.15.36:0/2944477087 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:05.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb716d9d700 1 --2- 172.21.15.36:0/2944477087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb718060910 0x7fb71813e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:05.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb71759e700 1 --2- 172.21.15.36:0/2944477087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7180b6900 0x7fb7181424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:05.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb70e59c700 1 -- 172.21.15.36:0/2944477087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb718060910 msgr2=0x7fb71813e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:05.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb70e59c700 1 --2- 172.21.15.36:0/2944477087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb718060910 0x7fb71813e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb70e59c700 1 -- 172.21.15.36:0/2944477087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7180b6900 msgr2=0x7fb7181424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:05.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb70e59c700 1 --2- 172.21.15.36:0/2944477087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7180b6900 0x7fb7181424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb70e59c700 1 -- 172.21.15.36:0/2944477087 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70000b1e0 con 0x7fb7180a9ec0 2022-01-10T01:30:05.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb70e59c700 1 --2- 172.21.15.36:0/2944477087 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180a9ec0 0x7fb71813ee20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fb71813dba0 tx=0x7fb700017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:05.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb714d99700 1 -- 172.21.15.36:0/2944477087 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb70000e1d0 con 0x7fb7180a9ec0 2022-01-10T01:30:05.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb714d99700 1 -- 172.21.15.36:0/2944477087 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb700018400 con 0x7fb7180a9ec0 2022-01-10T01:30:05.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb71d0a5700 1 -- 172.21.15.36:0/2944477087 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7180af850 con 0x7fb7180a9ec0 2022-01-10T01:30:05.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb714d99700 1 -- 172.21.15.36:0/2944477087 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb700018760 con 0x7fb7180a9ec0 2022-01-10T01:30:05.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.803+0000 7fb71d0a5700 1 -- 172.21.15.36:0/2944477087 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71813fa20 con 0x7fb7180a9ec0 2022-01-10T01:30:05.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.807+0000 7fb71d0a5700 1 -- 172.21.15.36:0/2944477087 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb718140660 con 0x7fb7180a9ec0 2022-01-10T01:30:05.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.807+0000 7fb714d99700 1 -- 172.21.15.36:0/2944477087 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb70002b070 con 0x7fb7180a9ec0 2022-01-10T01:30:05.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.807+0000 7fb714d99700 1 --2- 172.21.15.36:0/2944477087 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6fc053500 0x7fb6fc0559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:05.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.807+0000 7fb714d99700 1 -- 172.21.15.36:0/2944477087 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fb70006cac0 con 0x7fb7180a9ec0 2022-01-10T01:30:05.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.807+0000 7fb716d9d700 1 --2- 172.21.15.36:0/2944477087 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6fc053500 0x7fb6fc0559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:05.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.807+0000 7fb716d9d700 1 --2- 172.21.15.36:0/2944477087 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6fc053500 0x7fb6fc0559c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fb70800d000 tx=0x7fb708008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:05.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.811+0000 7fb714d99700 1 -- 172.21.15.36:0/2944477087 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb700043e10 con 0x7fb7180a9ec0 2022-01-10T01:30:05.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.943+0000 7fb71d0a5700 1 -- 172.21.15.36:0/2944477087 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7180619c0 con 0x7fb7180a9ec0 2022-01-10T01:30:05.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.943+0000 7fb714d99700 1 -- 172.21.15.36:0/2944477087 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+13415 (secure 0 0 0) 0x7fb700047430 con 0x7fb7180a9ec0 2022-01-10T01:30:05.946 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:05.946 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":73,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:30:05.327596+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:30:05.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.947+0000 7fb71d0a5700 1 -- 172.21.15.36:0/2944477087 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6fc053500 msgr2=0x7fb6fc0559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:05.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.947+0000 7fb71d0a5700 1 --2- 172.21.15.36:0/2944477087 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6fc053500 0x7fb6fc0559c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fb70800d000 tx=0x7fb708008040).stop 2022-01-10T01:30:05.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.947+0000 7fb71d0a5700 1 -- 172.21.15.36:0/2944477087 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180a9ec0 msgr2=0x7fb71813ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:05.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.947+0000 7fb71d0a5700 1 --2- 172.21.15.36:0/2944477087 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180a9ec0 0x7fb71813ee20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fb71813dba0 tx=0x7fb700017000).stop 2022-01-10T01:30:05.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.947+0000 7fb71d0a5700 1 -- 172.21.15.36:0/2944477087 shutdown_connections 2022-01-10T01:30:05.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.947+0000 7fb71d0a5700 1 --2- 172.21.15.36:0/2944477087 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6fc053500 0x7fb6fc0559c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.947+0000 7fb71d0a5700 1 --2- 172.21.15.36:0/2944477087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7180b6900 0x7fb7181424e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.947+0000 7fb71d0a5700 1 --2- 172.21.15.36:0/2944477087 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180a9ec0 0x7fb71813ee20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.947+0000 7fb71d0a5700 1 --2- 172.21.15.36:0/2944477087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb718060910 0x7fb71813e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:05.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.947+0000 7fb71d0a5700 1 -- 172.21.15.36:0/2944477087 >> 172.21.15.36:0/2944477087 conn(0x7fb7180b3480 msgr2=0x7fb7180b4820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:05.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.947+0000 7fb71d0a5700 1 -- 172.21.15.36:0/2944477087 shutdown_connections 2022-01-10T01:30:05.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:05.947+0000 7fb71d0a5700 1 -- 172.21.15.36:0/2944477087 wait complete. 2022-01-10T01:30:05.962 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-01-10T01:30:05.963 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:30:06.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f93521a4700 1 Processor -- start 2022-01-10T01:30:06.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f93521a4700 1 -- start start 2022-01-10T01:30:06.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f93521a4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f934c146950 0x7f934c140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f93521a4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f934c0b4180 0x7f934c140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f93521a4700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f934c143b60 con 0x7f934c0b4690 2022-01-10T01:30:06.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f93521a4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f934c147510 con 0x7f934c146950 2022-01-10T01:30:06.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f93521a4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c143e00 con 0x7f934c0b4180 2022-01-10T01:30:06.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f934bfff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f934c0b4690 0x7f934c0b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35570/0 (socket says 172.21.15.36:35570) 2022-01-10T01:30:06.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f934bfff700 1 -- 172.21.15.36:0/2994922624 learned_addr learned my addr 172.21.15.36:0/2994922624 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:06.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f934affd700 1 --2- 172.21.15.36:0/2994922624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f934c0b4180 0x7f934c140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f934b7fe700 1 --2- 172.21.15.36:0/2994922624 >> v2:172.21.15.59:3300/0 conn(0x7f934c146950 0x7f934c140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f934a7fc700 1 -- 172.21.15.36:0/2994922624 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750503100 0 0) 0x7f934c143b60 con 0x7f934c0b4690 2022-01-10T01:30:06.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f934a7fc700 1 -- 172.21.15.36:0/2994922624 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9338003260 con 0x7f934c0b4690 2022-01-10T01:30:06.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f934affd700 1 -- 172.21.15.36:0/2994922624 >> v2:172.21.15.59:3300/0 conn(0x7f934c146950 msgr2=0x7f934c140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:06.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f934affd700 1 --2- 172.21.15.36:0/2994922624 >> v2:172.21.15.59:3300/0 conn(0x7f934c146950 0x7f934c140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f934affd700 1 -- 172.21.15.36:0/2994922624 >> v1:172.21.15.36:6789/0 conn(0x7f934c0b4690 legacy=0x7f934c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f934affd700 1 -- 172.21.15.36:0/2994922624 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c0b0c90 con 0x7f934c0b4180 2022-01-10T01:30:06.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f934affd700 1 --2- 172.21.15.36:0/2994922624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f934c0b4180 0x7f934c140720 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f9340002f70 tx=0x7f9340006df0).ready entity=mon.2 client_cookie=f0def71cb8eaccf2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:06.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f934a7fc700 1 -- 172.21.15.36:0/2994922624 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f934000d4a0 con 0x7f934c0b4180 2022-01-10T01:30:06.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f934a7fc700 1 -- 172.21.15.36:0/2994922624 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9340000e90 con 0x7f934c0b4180 2022-01-10T01:30:06.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.071+0000 7f934a7fc700 1 -- 172.21.15.36:0/2994922624 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f934000d7f0 con 0x7f934c0b4180 2022-01-10T01:30:06.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 -- 172.21.15.36:0/2994922624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f934c0b4180 msgr2=0x7f934c140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 --2- 172.21.15.36:0/2994922624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f934c0b4180 0x7f934c140720 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f9340002f70 tx=0x7f9340006df0).stop 2022-01-10T01:30:06.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 -- 172.21.15.36:0/2994922624 shutdown_connections 2022-01-10T01:30:06.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 --2- 172.21.15.36:0/2994922624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f934c0b4180 0x7f934c140720 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 --2- 172.21.15.36:0/2994922624 >> v2:172.21.15.59:3300/0 conn(0x7f934c146950 0x7f934c140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 -- 172.21.15.36:0/2994922624 >> 172.21.15.36:0/2994922624 conn(0x7f934c05c490 msgr2=0x7f934c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:06.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 -- 172.21.15.36:0/2994922624 shutdown_connections 2022-01-10T01:30:06.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 -- 172.21.15.36:0/2994922624 wait complete. 2022-01-10T01:30:06.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 Processor -- start 2022-01-10T01:30:06.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 -- start start 2022-01-10T01:30:06.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f934c0b4180 0x7f934c0b88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f934c0b4690 0x7f934c0ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f934c146950 0x7f934c0add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c155750 con 0x7f934c0b4180 2022-01-10T01:30:06.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934c0b0710 con 0x7f934c0b4690 2022-01-10T01:30:06.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f93521a4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934c142820 con 0x7f934c146950 2022-01-10T01:30:06.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f934b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f934c0b4180 0x7f934c0b88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f934b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f934c0b4180 0x7f934c0b88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37778/0 (socket says 172.21.15.36:37778) 2022-01-10T01:30:06.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f934b7fe700 1 -- 172.21.15.36:0/1258748276 learned_addr learned my addr 172.21.15.36:0/1258748276 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:06.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f934affd700 1 --2- 172.21.15.36:0/1258748276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f934c0b4690 0x7f934c0ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.075+0000 7f934bfff700 1 --2- 172.21.15.36:0/1258748276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f934c146950 0x7f934c0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f934b7fe700 1 -- 172.21.15.36:0/1258748276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f934c146950 msgr2=0x7f934c0add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f934b7fe700 1 --2- 172.21.15.36:0/1258748276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f934c146950 0x7f934c0add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f934b7fe700 1 -- 172.21.15.36:0/1258748276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f934c0b4690 msgr2=0x7f934c0ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f934b7fe700 1 --2- 172.21.15.36:0/1258748276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f934c0b4690 0x7f934c0ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f934b7fe700 1 -- 172.21.15.36:0/1258748276 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934000b180 con 0x7f934c0b4180 2022-01-10T01:30:06.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f934b7fe700 1 --2- 172.21.15.36:0/1258748276 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f934c0b4180 0x7f934c0b88a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f933c00c000 tx=0x7f933c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:06.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f9348ff9700 1 -- 172.21.15.36:0/1258748276 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f933c011750 con 0x7f934c0b4180 2022-01-10T01:30:06.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f93521a4700 1 -- 172.21.15.36:0/1258748276 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934c142fa0 con 0x7f934c0b4180 2022-01-10T01:30:06.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f9348ff9700 1 -- 172.21.15.36:0/1258748276 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933c0118b0 con 0x7f934c0b4180 2022-01-10T01:30:06.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f93521a4700 1 -- 172.21.15.36:0/1258748276 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934c0b8ed0 con 0x7f934c0b4180 2022-01-10T01:30:06.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f9348ff9700 1 -- 172.21.15.36:0/1258748276 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f933c011c10 con 0x7f934c0b4180 2022-01-10T01:30:06.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f93521a4700 1 -- 172.21.15.36:0/1258748276 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f934c1429e0 con 0x7f934c0b4180 2022-01-10T01:30:06.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f9348ff9700 1 -- 172.21.15.36:0/1258748276 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f933c011d70 con 0x7f934c0b4180 2022-01-10T01:30:06.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f9348ff9700 1 --2- 172.21.15.36:0/1258748276 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f932c053560 0x7f932c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f934affd700 1 --2- 172.21.15.36:0/1258748276 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f932c053560 0x7f932c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.079+0000 7f9348ff9700 1 -- 172.21.15.36:0/1258748276 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f933c06c7d0 con 0x7f934c0b4180 2022-01-10T01:30:06.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.083+0000 7f934affd700 1 --2- 172.21.15.36:0/1258748276 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f932c053560 0x7f932c055a20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f934001a000 tx=0x7f9340014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:06.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.087+0000 7f9348ff9700 1 -- 172.21.15.36:0/1258748276 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f933c043a10 con 0x7f934c0b4180 2022-01-10T01:30:06.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.211+0000 7f93521a4700 1 -- 172.21.15.36:0/1258748276 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f934c142de0 con 0x7f934c0b4180 2022-01-10T01:30:06.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.211+0000 7f9348ff9700 1 -- 172.21.15.36:0/1258748276 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v73) v1 ==== 110+0+10 (secure 0 0 0) 0x7f933c047030 con 0x7f934c0b4180 2022-01-10T01:30:06.214 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:30:06.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.215+0000 7f93521a4700 1 -- 172.21.15.36:0/1258748276 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f932c053560 msgr2=0x7f932c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.215+0000 7f93521a4700 1 --2- 172.21.15.36:0/1258748276 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f932c053560 0x7f932c055a20 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f934001a000 tx=0x7f9340014000).stop 2022-01-10T01:30:06.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.215+0000 7f93521a4700 1 -- 172.21.15.36:0/1258748276 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f934c0b4180 msgr2=0x7f934c0b88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.215+0000 7f93521a4700 1 --2- 172.21.15.36:0/1258748276 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f934c0b4180 0x7f934c0b88a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f933c00c000 tx=0x7f933c006df0).stop 2022-01-10T01:30:06.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.215+0000 7f93521a4700 1 -- 172.21.15.36:0/1258748276 shutdown_connections 2022-01-10T01:30:06.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.215+0000 7f93521a4700 1 --2- 172.21.15.36:0/1258748276 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f932c053560 0x7f932c055a20 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.215+0000 7f93521a4700 1 --2- 172.21.15.36:0/1258748276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f934c146950 0x7f934c0add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.215+0000 7f93521a4700 1 --2- 172.21.15.36:0/1258748276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f934c0b4690 0x7f934c0ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.215+0000 7f93521a4700 1 --2- 172.21.15.36:0/1258748276 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f934c0b4180 0x7f934c0b88a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.215+0000 7f93521a4700 1 -- 172.21.15.36:0/1258748276 >> 172.21.15.36:0/1258748276 conn(0x7f934c05c490 msgr2=0x7f934c0b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:06.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.215+0000 7f93521a4700 1 -- 172.21.15.36:0/1258748276 shutdown_connections 2022-01-10T01:30:06.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.215+0000 7f93521a4700 1 -- 172.21.15.36:0/1258748276 wait complete. 2022-01-10T01:30:06.227 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:30:06.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.339+0000 7f090f59e700 1 Processor -- start 2022-01-10T01:30:06.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.339+0000 7f090f59e700 1 -- start start 2022-01-10T01:30:06.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090f59e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f09100b2cf0 0x7f09100b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090f59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09100b2270 con 0x7f0910064b40 2022-01-10T01:30:06.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090f59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0910064f20 con 0x7f0910143fb0 2022-01-10T01:30:06.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090f59e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0910062230 con 0x7f09100b2cf0 2022-01-10T01:30:06.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f0905d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f09100b2cf0 0x7f09100b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f0905d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f09100b2cf0 0x7f09100b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37788/0 (socket says 172.21.15.36:37788) 2022-01-10T01:30:06.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f0905d9b700 1 -- 172.21.15.36:0/928652486 learned_addr learned my addr 172.21.15.36:0/928652486 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:06.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f0905d9b700 1 -- 172.21.15.36:0/928652486 >> v1:172.21.15.59:6789/0 conn(0x7f0910143fb0 legacy=0x7f09100b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f0905d9b700 1 -- 172.21.15.36:0/928652486 >> v1:172.21.15.36:6789/0 conn(0x7f0910064b40 legacy=0x7f09101438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f0905d9b700 1 -- 172.21.15.36:0/928652486 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0910065760 con 0x7f09100b2cf0 2022-01-10T01:30:06.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090dd9b700 1 -- 172.21.15.36:0/928652486 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560316842 0 0) 0x7f09100b2270 con 0x7f0910064b40 2022-01-10T01:30:06.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f0905d9b700 1 --2- 172.21.15.36:0/928652486 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09100b2cf0 0x7f09100b3230 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f08f8002f70 tx=0x7f08f8006e50).ready entity=mon.0 client_cookie=35be2f795b45a00c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:06.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090dd9b700 1 -- 172.21.15.36:0/928652486 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f800d660 con 0x7f09100b2cf0 2022-01-10T01:30:06.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090dd9b700 1 -- 172.21.15.36:0/928652486 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f8000e90 con 0x7f09100b2cf0 2022-01-10T01:30:06.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090dd9b700 1 -- 172.21.15.36:0/928652486 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08f800d9b0 con 0x7f09100b2cf0 2022-01-10T01:30:06.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090f59e700 1 -- 172.21.15.36:0/928652486 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09100b2cf0 msgr2=0x7f09100b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090f59e700 1 --2- 172.21.15.36:0/928652486 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09100b2cf0 0x7f09100b3230 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f08f8002f70 tx=0x7f08f8006e50).stop 2022-01-10T01:30:06.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090f59e700 1 -- 172.21.15.36:0/928652486 shutdown_connections 2022-01-10T01:30:06.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090f59e700 1 --2- 172.21.15.36:0/928652486 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09100b2cf0 0x7f09100b3230 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090f59e700 1 -- 172.21.15.36:0/928652486 >> 172.21.15.36:0/928652486 conn(0x7f0910062be0 msgr2=0x7f091005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:06.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090f59e700 1 -- 172.21.15.36:0/928652486 shutdown_connections 2022-01-10T01:30:06.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.343+0000 7f090f59e700 1 -- 172.21.15.36:0/928652486 wait complete. 2022-01-10T01:30:06.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.347+0000 7f090f59e700 1 Processor -- start 2022-01-10T01:30:06.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.347+0000 7f090f59e700 1 -- start start 2022-01-10T01:30:06.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.347+0000 7f090f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0910064b40 0x7f09100af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.347+0000 7f090f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09100b2cf0 0x7f09100afb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.347+0000 7f090f59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0910143fb0 0x7f09101413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.347+0000 7f090f59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09100b56f0 con 0x7f0910143fb0 2022-01-10T01:30:06.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.347+0000 7f090f59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09100b61f0 con 0x7f0910064b40 2022-01-10T01:30:06.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09100b5920 con 0x7f09100b2cf0 2022-01-10T01:30:06.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090ed9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0910143fb0 0x7f09101413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090ed9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0910143fb0 0x7f09101413c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37796/0 (socket says 172.21.15.36:37796) 2022-01-10T01:30:06.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090ed9d700 1 -- 172.21.15.36:0/1244660137 learned_addr learned my addr 172.21.15.36:0/1244660137 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:06.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f0905d9b700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09100b2cf0 0x7f09100afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090e59c700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0910064b40 0x7f09100af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090ed9d700 1 -- 172.21.15.36:0/1244660137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09100b2cf0 msgr2=0x7f09100afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090ed9d700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09100b2cf0 0x7f09100afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090ed9d700 1 -- 172.21.15.36:0/1244660137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0910064b40 msgr2=0x7f09100af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090ed9d700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0910064b40 0x7f09100af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090ed9d700 1 -- 172.21.15.36:0/1244660137 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f800b1e0 con 0x7f0910143fb0 2022-01-10T01:30:06.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f0905d9b700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09100b2cf0 0x7f09100afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:06.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090e59c700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0910064b40 0x7f09100af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:06.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090ed9d700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0910143fb0 0x7f09101413c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f09100b6380 tx=0x7f0908007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:06.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f0907fff700 1 -- 172.21.15.36:0/1244660137 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0908006b70 con 0x7f0910143fb0 2022-01-10T01:30:06.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f0907fff700 1 -- 172.21.15.36:0/1244660137 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0908006cd0 con 0x7f0910143fb0 2022-01-10T01:30:06.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090f59e700 1 -- 172.21.15.36:0/1244660137 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09100b5f50 con 0x7f0910143fb0 2022-01-10T01:30:06.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f0907fff700 1 -- 172.21.15.36:0/1244660137 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0908007220 con 0x7f0910143fb0 2022-01-10T01:30:06.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090f59e700 1 -- 172.21.15.36:0/1244660137 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091005be80 con 0x7f0910143fb0 2022-01-10T01:30:06.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f090f59e700 1 -- 172.21.15.36:0/1244660137 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09100b5490 con 0x7f0910143fb0 2022-01-10T01:30:06.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.351+0000 7f0907fff700 1 -- 172.21.15.36:0/1244660137 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0908010030 con 0x7f0910143fb0 2022-01-10T01:30:06.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.355+0000 7f0907fff700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f08e8053560 0x7f08e8055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.355+0000 7f0907fff700 1 -- 172.21.15.36:0/1244660137 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f090806b750 con 0x7f0910143fb0 2022-01-10T01:30:06.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.355+0000 7f090e59c700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f08e8053560 0x7f08e8055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.355+0000 7f090e59c700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f08e8053560 0x7f08e8055a20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f090000b000 tx=0x7f0900009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:06.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.359+0000 7f0907fff700 1 -- 172.21.15.36:0/1244660137 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0908042aa0 con 0x7f0910143fb0 2022-01-10T01:30:06.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.483+0000 7f090f59e700 1 -- 172.21.15.36:0/1244660137 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0910057350 con 0x7f0910143fb0 2022-01-10T01:30:06.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.483+0000 7f0907fff700 1 -- 172.21.15.36:0/1244660137 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v73) v1 ==== 92+0+10 (secure 0 0 0) 0x7f09080460c0 con 0x7f0910143fb0 2022-01-10T01:30:06.487 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:30:06.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.487+0000 7f090f59e700 1 -- 172.21.15.36:0/1244660137 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f08e8053560 msgr2=0x7f08e8055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.487+0000 7f090f59e700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f08e8053560 0x7f08e8055a20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f090000b000 tx=0x7f0900009040).stop 2022-01-10T01:30:06.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.487+0000 7f090f59e700 1 -- 172.21.15.36:0/1244660137 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0910143fb0 msgr2=0x7f09101413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.487+0000 7f090f59e700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0910143fb0 0x7f09101413c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f09100b6380 tx=0x7f0908007f70).stop 2022-01-10T01:30:06.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.487+0000 7f090f59e700 1 -- 172.21.15.36:0/1244660137 shutdown_connections 2022-01-10T01:30:06.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.487+0000 7f090f59e700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f08e8053560 0x7f08e8055a20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.487+0000 7f090f59e700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0910143fb0 0x7f09101413c0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.487+0000 7f090f59e700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09100b2cf0 0x7f09100afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.487+0000 7f090f59e700 1 --2- 172.21.15.36:0/1244660137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0910064b40 0x7f09100af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.487+0000 7f090f59e700 1 -- 172.21.15.36:0/1244660137 >> 172.21.15.36:0/1244660137 conn(0x7f0910062be0 msgr2=0x7f091005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:06.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.487+0000 7f090f59e700 1 -- 172.21.15.36:0/1244660137 shutdown_connections 2022-01-10T01:30:06.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.487+0000 7f090f59e700 1 -- 172.21.15.36:0/1244660137 wait complete. 2022-01-10T01:30:06.505 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-01-10T01:30:06.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.607+0000 7f3ff0b28700 1 Processor -- start 2022-01-10T01:30:06.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.607+0000 7f3ff0b28700 1 -- start start 2022-01-10T01:30:06.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3ff0b28700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3fec0b0710 0x7f3fec142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3ff0b28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fec0b30d0 0x7f3fec143210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3ff0b28700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec0b0af0 con 0x7f3fec0ace70 2022-01-10T01:30:06.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3ff0b28700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec0ae680 con 0x7f3fec0b0710 2022-01-10T01:30:06.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3ff0b28700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0ae920 con 0x7f3fec0b30d0 2022-01-10T01:30:06.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3feb7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3fec0b0710 0x7f3fec142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3feb7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3fec0b0710 0x7f3fec142d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37800/0 (socket says 172.21.15.36:37800) 2022-01-10T01:30:06.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3feb7fe700 1 -- 172.21.15.36:0/793107605 learned_addr learned my addr 172.21.15.36:0/793107605 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:06.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3fe3fff700 1 --2- 172.21.15.36:0/793107605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fec0b30d0 0x7f3fec143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3feb7fe700 1 -- 172.21.15.36:0/793107605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fec0b30d0 msgr2=0x7f3fec143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3feb7fe700 1 --2- 172.21.15.36:0/793107605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fec0b30d0 0x7f3fec143210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3feb7fe700 1 -- 172.21.15.36:0/793107605 >> v1:172.21.15.59:6789/0 conn(0x7f3fec0ace70 legacy=0x7f3fec05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3feb7fe700 1 -- 172.21.15.36:0/793107605 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec0aebc0 con 0x7f3fec0b0710 2022-01-10T01:30:06.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3feb7fe700 1 --2- 172.21.15.36:0/793107605 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fec0b0710 0x7f3fec142d20 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f3fdc002f70 tx=0x7f3fdc006eb0).ready entity=mon.0 client_cookie=f6bf3ac02e5b4c62 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:06.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3feaffd700 1 -- 172.21.15.36:0/793107605 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fdc00d570 con 0x7f3fec0b0710 2022-01-10T01:30:06.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3feaffd700 1 -- 172.21.15.36:0/793107605 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc000e90 con 0x7f3fec0b0710 2022-01-10T01:30:06.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3feaffd700 1 -- 172.21.15.36:0/793107605 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fdc00d900 con 0x7f3fec0b0710 2022-01-10T01:30:06.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3ff0b28700 1 -- 172.21.15.36:0/793107605 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fec0b0710 msgr2=0x7f3fec142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3ff0b28700 1 --2- 172.21.15.36:0/793107605 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fec0b0710 0x7f3fec142d20 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f3fdc002f70 tx=0x7f3fdc006eb0).stop 2022-01-10T01:30:06.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3ff0b28700 1 -- 172.21.15.36:0/793107605 shutdown_connections 2022-01-10T01:30:06.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3ff0b28700 1 --2- 172.21.15.36:0/793107605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fec0b30d0 0x7f3fec143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3ff0b28700 1 --2- 172.21.15.36:0/793107605 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fec0b0710 0x7f3fec142d20 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3ff0b28700 1 -- 172.21.15.36:0/793107605 >> 172.21.15.36:0/793107605 conn(0x7f3fec061140 msgr2=0x7f3fec062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:06.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3ff0b28700 1 -- 172.21.15.36:0/793107605 shutdown_connections 2022-01-10T01:30:06.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.611+0000 7f3ff0b28700 1 -- 172.21.15.36:0/793107605 wait complete. 2022-01-10T01:30:06.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3ff0b28700 1 Processor -- start 2022-01-10T01:30:06.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3ff0b28700 1 -- start start 2022-01-10T01:30:06.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3ff0b28700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fec0ace70 0x7f3fec0660a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3ff0b28700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fec0b0710 0x7f3fec153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3ff0b28700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fec0b30d0 0x7f3fec148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3ff0b28700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec153550 con 0x7f3fec0b30d0 2022-01-10T01:30:06.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3ff0b28700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec149b30 con 0x7f3fec0b0710 2022-01-10T01:30:06.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3ff0b28700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec148ff0 con 0x7f3fec0ace70 2022-01-10T01:30:06.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3febfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fec0b30d0 0x7f3fec148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3febfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fec0b30d0 0x7f3fec148b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37808/0 (socket says 172.21.15.36:37808) 2022-01-10T01:30:06.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3febfff700 1 -- 172.21.15.36:0/310397681 learned_addr learned my addr 172.21.15.36:0/310397681 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:06.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3fe3fff700 1 --2- 172.21.15.36:0/310397681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fec0b0710 0x7f3fec153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3feb7fe700 1 --2- 172.21.15.36:0/310397681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fec0ace70 0x7f3fec0660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3febfff700 1 -- 172.21.15.36:0/310397681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fec0ace70 msgr2=0x7f3fec0660a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3febfff700 1 --2- 172.21.15.36:0/310397681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fec0ace70 0x7f3fec0660a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3febfff700 1 -- 172.21.15.36:0/310397681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fec0b0710 msgr2=0x7f3fec153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3febfff700 1 --2- 172.21.15.36:0/310397681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fec0b0710 0x7f3fec153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3febfff700 1 -- 172.21.15.36:0/310397681 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc00b1e0 con 0x7f3fec0b30d0 2022-01-10T01:30:06.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3febfff700 1 --2- 172.21.15.36:0/310397681 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fec0b30d0 0x7f3fec148b00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f3fec14a8f0 tx=0x7f3fe4007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:06.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3fe97fa700 1 -- 172.21.15.36:0/310397681 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fe400f470 con 0x7f3fec0b30d0 2022-01-10T01:30:06.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3fe97fa700 1 -- 172.21.15.36:0/310397681 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe400f5d0 con 0x7f3fec0b30d0 2022-01-10T01:30:06.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3ff0b28700 1 -- 172.21.15.36:0/310397681 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec149890 con 0x7f3fec0b30d0 2022-01-10T01:30:06.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3fe97fa700 1 -- 172.21.15.36:0/310397681 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fe400f930 con 0x7f3fec0b30d0 2022-01-10T01:30:06.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.615+0000 7f3ff0b28700 1 -- 172.21.15.36:0/310397681 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec0a9e20 con 0x7f3fec0b30d0 2022-01-10T01:30:06.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.619+0000 7f3ff0b28700 1 -- 172.21.15.36:0/310397681 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec0ab0c0 con 0x7f3fec0b30d0 2022-01-10T01:30:06.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.619+0000 7f3fe97fa700 1 -- 172.21.15.36:0/310397681 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3fe4019030 con 0x7f3fec0b30d0 2022-01-10T01:30:06.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.619+0000 7f3fe97fa700 1 --2- 172.21.15.36:0/310397681 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3fd00535f0 0x7f3fd0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.619+0000 7f3fe97fa700 1 -- 172.21.15.36:0/310397681 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f3fe406aea0 con 0x7f3fec0b30d0 2022-01-10T01:30:06.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.619+0000 7f3feb7fe700 1 --2- 172.21.15.36:0/310397681 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3fd00535f0 0x7f3fd0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.619+0000 7f3feb7fe700 1 --2- 172.21.15.36:0/310397681 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3fd00535f0 0x7f3fd0055ab0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f3fdc01c000 tx=0x7f3fdc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:06.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.623+0000 7f3fe97fa700 1 -- 172.21.15.36:0/310397681 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3fe40421f0 con 0x7f3fec0b30d0 2022-01-10T01:30:06.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.755+0000 7f3ff0b28700 1 -- 172.21.15.36:0/310397681 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3fec149130 con 0x7f3fec0b30d0 2022-01-10T01:30:06.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.755+0000 7f3fe97fa700 1 -- 172.21.15.36:0/310397681 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) v1 ==== 84+0+143 (secure 0 0 0) 0x7f3fe4045810 con 0x7f3fec0b30d0 2022-01-10T01:30:06.759 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:06.759 INFO:teuthology.orchestra.run.smithi036.stdout:[ 2022-01-10T01:30:06.759 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:06.759 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 1, 2022-01-10T01:30:06.760 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "device_health_metrics" 2022-01-10T01:30:06.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:30:06.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:30:06.760 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 2, 2022-01-10T01:30:06.761 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "rbd" 2022-01-10T01:30:06.761 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:30:06.761 INFO:teuthology.orchestra.run.smithi036.stdout:] 2022-01-10T01:30:06.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.759+0000 7f3ff0b28700 1 -- 172.21.15.36:0/310397681 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3fd00535f0 msgr2=0x7f3fd0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.759+0000 7f3ff0b28700 1 --2- 172.21.15.36:0/310397681 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3fd00535f0 0x7f3fd0055ab0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f3fdc01c000 tx=0x7f3fdc015000).stop 2022-01-10T01:30:06.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.759+0000 7f3ff0b28700 1 -- 172.21.15.36:0/310397681 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fec0b30d0 msgr2=0x7f3fec148b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.759+0000 7f3ff0b28700 1 --2- 172.21.15.36:0/310397681 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fec0b30d0 0x7f3fec148b00 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f3fec14a8f0 tx=0x7f3fe4007f10).stop 2022-01-10T01:30:06.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.759+0000 7f3ff0b28700 1 -- 172.21.15.36:0/310397681 shutdown_connections 2022-01-10T01:30:06.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.759+0000 7f3ff0b28700 1 --2- 172.21.15.36:0/310397681 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3fd00535f0 0x7f3fd0055ab0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.759+0000 7f3ff0b28700 1 --2- 172.21.15.36:0/310397681 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fec0b30d0 0x7f3fec148b00 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.759+0000 7f3ff0b28700 1 --2- 172.21.15.36:0/310397681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fec0b0710 0x7f3fec153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.759+0000 7f3ff0b28700 1 --2- 172.21.15.36:0/310397681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fec0ace70 0x7f3fec0660a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.759+0000 7f3ff0b28700 1 -- 172.21.15.36:0/310397681 >> 172.21.15.36:0/310397681 conn(0x7f3fec061140 msgr2=0x7f3fec0b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:06.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.759+0000 7f3ff0b28700 1 -- 172.21.15.36:0/310397681 shutdown_connections 2022-01-10T01:30:06.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.759+0000 7f3ff0b28700 1 -- 172.21.15.36:0/310397681 wait complete. 2022-01-10T01:30:06.771 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-01-10T01:30:06.772 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:30:06.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 Processor -- start 2022-01-10T01:30:06.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 -- start start 2022-01-10T01:30:06.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5254061320 0x7f5254061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5254140440 0x7f52541408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52540aecf0 con 0x7f52540ad5c0 2022-01-10T01:30:06.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52540b6f20 con 0x7f5254061320 2022-01-10T01:30:06.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52540aef20 con 0x7f5254140440 2022-01-10T01:30:06.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f52537fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5254061320 0x7f5254061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f52537fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5254061320 0x7f5254061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37814/0 (socket says 172.21.15.36:37814) 2022-01-10T01:30:06.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f52537fe700 1 -- 172.21.15.36:0/4266362273 learned_addr learned my addr 172.21.15.36:0/4266362273 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:06.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5253fff700 1 --2- 172.21.15.36:0/4266362273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5254140440 0x7f52541408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f52537fe700 1 -- 172.21.15.36:0/4266362273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5254140440 msgr2=0x7f52541408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:06.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f52537fe700 1 --2- 172.21.15.36:0/4266362273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5254140440 0x7f52541408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f52537fe700 1 -- 172.21.15.36:0/4266362273 >> v1:172.21.15.59:6789/0 conn(0x7f52540ad5c0 legacy=0x7f52540b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f52537fe700 1 -- 172.21.15.36:0/4266362273 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52540af1c0 con 0x7f5254061320 2022-01-10T01:30:06.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5253fff700 1 --2- 172.21.15.36:0/4266362273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5254140440 0x7f52541408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:06.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f52537fe700 1 --2- 172.21.15.36:0/4266362273 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5254061320 0x7f5254061700 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f52540aeba0 tx=0x7f5248006eb0).ready entity=mon.0 client_cookie=f9adf961b2eb0e93 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:06.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f52527fc700 1 -- 172.21.15.36:0/4266362273 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f524800d5c0 con 0x7f5254061320 2022-01-10T01:30:06.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f52527fc700 1 -- 172.21.15.36:0/4266362273 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5248000e90 con 0x7f5254061320 2022-01-10T01:30:06.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f52527fc700 1 -- 172.21.15.36:0/4266362273 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f524800d950 con 0x7f5254061320 2022-01-10T01:30:06.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 -- 172.21.15.36:0/4266362273 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5254061320 msgr2=0x7f5254061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 --2- 172.21.15.36:0/4266362273 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5254061320 0x7f5254061700 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f52540aeba0 tx=0x7f5248006eb0).stop 2022-01-10T01:30:06.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 -- 172.21.15.36:0/4266362273 shutdown_connections 2022-01-10T01:30:06.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 --2- 172.21.15.36:0/4266362273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5254140440 0x7f52541408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 --2- 172.21.15.36:0/4266362273 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5254061320 0x7f5254061700 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 -- 172.21.15.36:0/4266362273 >> 172.21.15.36:0/4266362273 conn(0x7f5254066de0 msgr2=0x7f52540671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:06.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 -- 172.21.15.36:0/4266362273 shutdown_connections 2022-01-10T01:30:06.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.879+0000 7f5258f9f700 1 -- 172.21.15.36:0/4266362273 wait complete. 2022-01-10T01:30:06.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5258f9f700 1 Processor -- start 2022-01-10T01:30:06.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5258f9f700 1 -- start start 2022-01-10T01:30:06.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5258f9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5254061320 0x7f5254145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5258f9f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52540ad5c0 0x7f52541523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5258f9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5254140440 0x7f5254156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5258f9f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52540acf30 con 0x7f52540ad5c0 2022-01-10T01:30:06.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5258f9f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52540acc80 con 0x7f5254061320 2022-01-10T01:30:06.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5258f9f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52541528c0 con 0x7f5254140440 2022-01-10T01:30:06.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5252ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52540ad5c0 0x7f52541523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5252ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52540ad5c0 0x7f52541523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37822/0 (socket says 172.21.15.36:37822) 2022-01-10T01:30:06.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5253fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5254140440 0x7f5254156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5252ffd700 1 -- 172.21.15.36:0/3964376648 learned_addr learned my addr 172.21.15.36:0/3964376648 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:06.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f52537fe700 1 --2- 172.21.15.36:0/3964376648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5254061320 0x7f5254145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5252ffd700 1 -- 172.21.15.36:0/3964376648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5254140440 msgr2=0x7f5254156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5252ffd700 1 --2- 172.21.15.36:0/3964376648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5254140440 0x7f5254156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5252ffd700 1 -- 172.21.15.36:0/3964376648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5254061320 msgr2=0x7f5254145900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:06.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5252ffd700 1 --2- 172.21.15.36:0/3964376648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5254061320 0x7f5254145900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:06.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5252ffd700 1 -- 172.21.15.36:0/3964376648 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524800b1e0 con 0x7f52540ad5c0 2022-01-10T01:30:06.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5252ffd700 1 --2- 172.21.15.36:0/3964376648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52540ad5c0 0x7f52541523d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f52540af7e0 tx=0x7f5244007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:06.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5250ff9700 1 -- 172.21.15.36:0/3964376648 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f524400ce80 con 0x7f52540ad5c0 2022-01-10T01:30:06.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5250ff9700 1 -- 172.21.15.36:0/3964376648 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5244012400 con 0x7f52540ad5c0 2022-01-10T01:30:06.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5258f9f700 1 -- 172.21.15.36:0/3964376648 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5254155b00 con 0x7f52540ad5c0 2022-01-10T01:30:06.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5250ff9700 1 -- 172.21.15.36:0/3964376648 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5244012760 con 0x7f52540ad5c0 2022-01-10T01:30:06.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.883+0000 7f5258f9f700 1 -- 172.21.15.36:0/3964376648 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5254155d60 con 0x7f52540ad5c0 2022-01-10T01:30:06.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.887+0000 7f5258f9f700 1 -- 172.21.15.36:0/3964376648 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5254155910 con 0x7f52540ad5c0 2022-01-10T01:30:06.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.887+0000 7f5250ff9700 1 -- 172.21.15.36:0/3964376648 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5244019030 con 0x7f52540ad5c0 2022-01-10T01:30:06.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.887+0000 7f5250ff9700 1 --2- 172.21.15.36:0/3964376648 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5234053620 0x7f5234055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:06.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.887+0000 7f5250ff9700 1 -- 172.21.15.36:0/3964376648 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f524406aa50 con 0x7f52540ad5c0 2022-01-10T01:30:06.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.887+0000 7f52537fe700 1 --2- 172.21.15.36:0/3964376648 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5234053620 0x7f5234055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:06.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.887+0000 7f52537fe700 1 --2- 172.21.15.36:0/3964376648 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5234053620 0x7f5234055ae0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f524801c000 tx=0x7f5248015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:06.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:06.895+0000 7f5250ff9700 1 -- 172.21.15.36:0/3964376648 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5244041c30 con 0x7f52540ad5c0 2022-01-10T01:30:07.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.019+0000 7f5258f9f700 1 -- 172.21.15.36:0/3964376648 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f52540af460 con 0x7f52540ad5c0 2022-01-10T01:30:07.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.715+0000 7f5250ff9700 1 -- 172.21.15.36:0/3964376648 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v74) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5244045250 con 0x7f52540ad5c0 2022-01-10T01:30:07.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.719+0000 7f5258f9f700 1 -- 172.21.15.36:0/3964376648 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5234053620 msgr2=0x7f5234055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:07.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.719+0000 7f5258f9f700 1 --2- 172.21.15.36:0/3964376648 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5234053620 0x7f5234055ae0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f524801c000 tx=0x7f5248015000).stop 2022-01-10T01:30:07.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.719+0000 7f5258f9f700 1 -- 172.21.15.36:0/3964376648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52540ad5c0 msgr2=0x7f52541523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:07.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.719+0000 7f5258f9f700 1 --2- 172.21.15.36:0/3964376648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52540ad5c0 0x7f52541523d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f52540af7e0 tx=0x7f5244007bf0).stop 2022-01-10T01:30:07.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.719+0000 7f5258f9f700 1 -- 172.21.15.36:0/3964376648 shutdown_connections 2022-01-10T01:30:07.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.719+0000 7f5258f9f700 1 --2- 172.21.15.36:0/3964376648 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5234053620 0x7f5234055ae0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:07.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.719+0000 7f5258f9f700 1 --2- 172.21.15.36:0/3964376648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5254140440 0x7f5254156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:07.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.719+0000 7f5258f9f700 1 --2- 172.21.15.36:0/3964376648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52540ad5c0 0x7f52541523d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:07.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.719+0000 7f5258f9f700 1 --2- 172.21.15.36:0/3964376648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5254061320 0x7f5254145900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:07.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.719+0000 7f5258f9f700 1 -- 172.21.15.36:0/3964376648 >> 172.21.15.36:0/3964376648 conn(0x7f5254066de0 msgr2=0x7f52540b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:07.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.719+0000 7f5258f9f700 1 -- 172.21.15.36:0/3964376648 shutdown_connections 2022-01-10T01:30:07.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.719+0000 7f5258f9f700 1 -- 172.21.15.36:0/3964376648 wait complete. 2022-01-10T01:30:07.722 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:30:07.733 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2022-01-10T01:30:07.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.843+0000 7f6c593b7700 1 Processor -- start 2022-01-10T01:30:07.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.843+0000 7f6c593b7700 1 -- start start 2022-01-10T01:30:07.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.843+0000 7f6c593b7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c540665f0 0x7f6c540669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:07.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.843+0000 7f6c593b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c54140cb0 0x7f6c5413e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:07.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.843+0000 7f6c593b7700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c5405f750 con 0x7f6c540b1a30 2022-01-10T01:30:07.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.843+0000 7f6c593b7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540b14a0 con 0x7f6c540665f0 2022-01-10T01:30:07.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.843+0000 7f6c593b7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5405f980 con 0x7f6c54140cb0 2022-01-10T01:30:07.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.843+0000 7f6c537fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f6c540b1a30 0x7f6c5405fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35626/0 (socket says 172.21.15.36:35626) 2022-01-10T01:30:07.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.843+0000 7f6c537fe700 1 -- 172.21.15.36:0/2266201115 learned_addr learned my addr 172.21.15.36:0/2266201115 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:07.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c58bb6700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c54140cb0 0x7f6c5413e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:07.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c53fff700 1 --2- 172.21.15.36:0/2266201115 >> v2:172.21.15.59:3300/0 conn(0x7f6c540665f0 0x7f6c540669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:07.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 -- 172.21.15.36:0/2266201115 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26487274 0 0) 0x7f6c5405f750 con 0x7f6c540b1a30 2022-01-10T01:30:07.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 -- 172.21.15.36:0/2266201115 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c34003260 con 0x7f6c540b1a30 2022-01-10T01:30:07.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 -- 172.21.15.36:0/2266201115 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1509062785 0 0) 0x7f6c34003260 con 0x7f6c540b1a30 2022-01-10T01:30:07.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 -- 172.21.15.36:0/2266201115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c54140cb0 msgr2=0x7f6c5413e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:07.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c54140cb0 0x7f6c5413e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:07.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 -- 172.21.15.36:0/2266201115 >> v2:172.21.15.59:3300/0 conn(0x7f6c540665f0 msgr2=0x7f6c540669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:07.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 --2- 172.21.15.36:0/2266201115 >> v2:172.21.15.59:3300/0 conn(0x7f6c540665f0 0x7f6c540669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:07.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 -- 172.21.15.36:0/2266201115 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540b1740 con 0x7f6c540b1a30 2022-01-10T01:30:07.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 -- 172.21.15.36:0/2266201115 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f6c3c001660 con 0x7f6c540b1a30 2022-01-10T01:30:07.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c58bb6700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c54140cb0 0x7f6c5413e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:30:07.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 -- 172.21.15.36:0/2266201115 >> v1:172.21.15.36:6789/0 conn(0x7f6c540b1a30 legacy=0x7f6c5405fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:07.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c34003750 0x7f6c34003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:07.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c34004500 0x7f6c34004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:07.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c54140cb0 0x7f6c34004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:07.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 -- 172.21.15.36:0/2266201115 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540b14a0 con 0x7f6c34004500 2022-01-10T01:30:07.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 -- 172.21.15.36:0/2266201115 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5405f980 con 0x7f6c34003750 2022-01-10T01:30:07.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 -- 172.21.15.36:0/2266201115 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3400b750 con 0x7f6c54140cb0 2022-01-10T01:30:07.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c537fe700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c34004500 0x7f6c34004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:07.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c53fff700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c34003750 0x7f6c34003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:07.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c58bb6700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c54140cb0 0x7f6c34004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:07.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c537fe700 1 -- 172.21.15.36:0/2266201115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c54140cb0 msgr2=0x7f6c34004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:07.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c537fe700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c54140cb0 0x7f6c34004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:07.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c537fe700 1 -- 172.21.15.36:0/2266201115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c34003750 msgr2=0x7f6c34003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:07.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c537fe700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c34003750 0x7f6c34003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:07.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c537fe700 1 -- 172.21.15.36:0/2266201115 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c00b180 con 0x7f6c34004500 2022-01-10T01:30:07.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c53fff700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c34003750 0x7f6c34003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:30:07.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c58bb6700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c54140cb0 0x7f6c34004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:30:07.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c537fe700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c34004500 0x7f6c34004980 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f6c3c001370 tx=0x7f6c54062390).ready entity=mon.0 client_cookie=a25d33132016303a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:07.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 -- 172.21.15.36:0/2266201115 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c3c0070d0 con 0x7f6c34004500 2022-01-10T01:30:07.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 -- 172.21.15.36:0/2266201115 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c007230 con 0x7f6c34004500 2022-01-10T01:30:07.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c52ffd700 1 -- 172.21.15.36:0/2266201115 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c3c00c8f0 con 0x7f6c34004500 2022-01-10T01:30:07.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c593b7700 1 -- 172.21.15.36:0/2266201115 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c34004500 msgr2=0x7f6c34004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:07.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c593b7700 1 --2- 172.21.15.36:0/2266201115 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c34004500 0x7f6c34004980 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f6c3c001370 tx=0x7f6c54062390).stop 2022-01-10T01:30:07.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c58bb6700 1 -- 172.21.15.36:0/2266201115 reap_dead start 2022-01-10T01:30:07.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c593b7700 1 -- 172.21.15.36:0/2266201115 shutdown_connections 2022-01-10T01:30:07.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c593b7700 1 -- 172.21.15.36:0/2266201115 >> 172.21.15.36:0/2266201115 conn(0x7f6c540636e0 msgr2=0x7f6c54063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:07.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c593b7700 1 -- 172.21.15.36:0/2266201115 shutdown_connections 2022-01-10T01:30:07.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.847+0000 7f6c593b7700 1 -- 172.21.15.36:0/2266201115 wait complete. 2022-01-10T01:30:07.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c593b7700 1 Processor -- start 2022-01-10T01:30:07.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c593b7700 1 -- start start 2022-01-10T01:30:07.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c593b7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c540b06b0 0x7f6c54142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:07.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c593b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c540afc10 0x7f6c541445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:07.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c593b7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c54144ac0 0x7f6c541556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:07.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c593b7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5414fe80 con 0x7f6c54144ac0 2022-01-10T01:30:07.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c593b7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54143f40 con 0x7f6c540b06b0 2022-01-10T01:30:07.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c593b7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540b0a90 con 0x7f6c540afc10 2022-01-10T01:30:07.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c58bb6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c54144ac0 0x7f6c541556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:07.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c58bb6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c54144ac0 0x7f6c541556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37844/0 (socket says 172.21.15.36:37844) 2022-01-10T01:30:07.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c58bb6700 1 -- 172.21.15.36:0/315911816 learned_addr learned my addr 172.21.15.36:0/315911816 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:07.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c53fff700 1 --2- 172.21.15.36:0/315911816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c540b06b0 0x7f6c54142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:07.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c537fe700 1 --2- 172.21.15.36:0/315911816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c540afc10 0x7f6c541445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:07.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c58bb6700 1 -- 172.21.15.36:0/315911816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c540afc10 msgr2=0x7f6c541445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:07.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c58bb6700 1 --2- 172.21.15.36:0/315911816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c540afc10 0x7f6c541445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:07.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c58bb6700 1 -- 172.21.15.36:0/315911816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c540b06b0 msgr2=0x7f6c54142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:07.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c58bb6700 1 --2- 172.21.15.36:0/315911816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c540b06b0 0x7f6c54142870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:07.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c58bb6700 1 -- 172.21.15.36:0/315911816 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540aefd0 con 0x7f6c54144ac0 2022-01-10T01:30:07.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c58bb6700 1 --2- 172.21.15.36:0/315911816 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c54144ac0 0x7f6c541556f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f6c54143e90 tx=0x7f6c4c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:07.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c517fa700 1 -- 172.21.15.36:0/315911816 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c4c018070 con 0x7f6c54144ac0 2022-01-10T01:30:07.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c517fa700 1 -- 172.21.15.36:0/315911816 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c000e90 con 0x7f6c54144ac0 2022-01-10T01:30:07.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c593b7700 1 -- 172.21.15.36:0/315911816 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c540af270 con 0x7f6c54144ac0 2022-01-10T01:30:07.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c517fa700 1 -- 172.21.15.36:0/315911816 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c4c00faa0 con 0x7f6c54144ac0 2022-01-10T01:30:07.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.851+0000 7f6c593b7700 1 -- 172.21.15.36:0/315911816 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c54144130 con 0x7f6c54144ac0 2022-01-10T01:30:07.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.855+0000 7f6c593b7700 1 -- 172.21.15.36:0/315911816 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c54141140 con 0x7f6c54144ac0 2022-01-10T01:30:07.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.855+0000 7f6c517fa700 1 -- 172.21.15.36:0/315911816 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6c4c00fc00 con 0x7f6c54144ac0 2022-01-10T01:30:07.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.855+0000 7f6c517fa700 1 --2- 172.21.15.36:0/315911816 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6c38053590 0x7f6c38055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:07.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.855+0000 7f6c517fa700 1 -- 172.21.15.36:0/315911816 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f6c4c06bd10 con 0x7f6c54144ac0 2022-01-10T01:30:07.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.855+0000 7f6c53fff700 1 --2- 172.21.15.36:0/315911816 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6c38053590 0x7f6c38055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:07.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.855+0000 7f6c53fff700 1 --2- 172.21.15.36:0/315911816 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6c38053590 0x7f6c38055a50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f6c4400b000 tx=0x7f6c440091d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:07.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.863+0000 7f6c517fa700 1 -- 172.21.15.36:0/315911816 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6c4c042ef0 con 0x7f6c54144ac0 2022-01-10T01:30:07.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:07.995+0000 7f6c593b7700 1 -- 172.21.15.36:0/315911816 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f6c54057350 con 0x7f6c54144ac0 2022-01-10T01:30:08.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.315+0000 7f6c517fa700 1 -- 172.21.15.36:0/315911816 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v75) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6c4c046510 con 0x7f6c54144ac0 2022-01-10T01:30:08.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.323+0000 7f6c593b7700 1 -- 172.21.15.36:0/315911816 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6c38053590 msgr2=0x7f6c38055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:08.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.323+0000 7f6c593b7700 1 --2- 172.21.15.36:0/315911816 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6c38053590 0x7f6c38055a50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f6c4400b000 tx=0x7f6c440091d0).stop 2022-01-10T01:30:08.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.323+0000 7f6c593b7700 1 -- 172.21.15.36:0/315911816 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c54144ac0 msgr2=0x7f6c541556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:08.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.323+0000 7f6c593b7700 1 --2- 172.21.15.36:0/315911816 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c54144ac0 0x7f6c541556f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f6c54143e90 tx=0x7f6c4c006df0).stop 2022-01-10T01:30:08.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.327+0000 7f6c593b7700 1 -- 172.21.15.36:0/315911816 shutdown_connections 2022-01-10T01:30:08.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.327+0000 7f6c593b7700 1 --2- 172.21.15.36:0/315911816 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6c38053590 0x7f6c38055a50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.327+0000 7f6c593b7700 1 --2- 172.21.15.36:0/315911816 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c54144ac0 0x7f6c541556f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.327+0000 7f6c593b7700 1 --2- 172.21.15.36:0/315911816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c540afc10 0x7f6c541445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.327+0000 7f6c593b7700 1 --2- 172.21.15.36:0/315911816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c540b06b0 0x7f6c54142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.327+0000 7f6c593b7700 1 -- 172.21.15.36:0/315911816 >> 172.21.15.36:0/315911816 conn(0x7f6c540636e0 msgr2=0x7f6c540605d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:08.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.327+0000 7f6c593b7700 1 -- 172.21.15.36:0/315911816 shutdown_connections 2022-01-10T01:30:08.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.327+0000 7f6c593b7700 1 -- 172.21.15.36:0/315911816 wait complete. 2022-01-10T01:30:08.330 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' created 2022-01-10T01:30:08.340 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-10T01:30:08.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 Processor -- start 2022-01-10T01:30:08.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 -- start start 2022-01-10T01:30:08.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff9140ad4e0 0x7ff9140b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:08.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff9140aef90 0x7ff9140b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:08.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91405c490 0x7ff91405f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:08.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9140b0ab0 con 0x7ff9140ad4e0 2022-01-10T01:30:08.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9140b0d50 con 0x7ff9140aef90 2022-01-10T01:30:08.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9140ae850 con 0x7ff91405c490 2022-01-10T01:30:08.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff912ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff9140ad4e0 0x7ff9140b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:08.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff912ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff9140ad4e0 0x7ff9140b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37848/0 (socket says 172.21.15.36:37848) 2022-01-10T01:30:08.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff912ffd700 1 -- 172.21.15.36:0/486160729 learned_addr learned my addr 172.21.15.36:0/486160729 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:08.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff9137fe700 1 --2- 172.21.15.36:0/486160729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91405c490 0x7ff91405f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:08.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff9127fc700 1 --2- 172.21.15.36:0/486160729 >> v2:172.21.15.59:3300/0 conn(0x7ff9140aef90 0x7ff9140b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:08.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff912ffd700 1 -- 172.21.15.36:0/486160729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91405c490 msgr2=0x7ff91405f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:08.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff912ffd700 1 --2- 172.21.15.36:0/486160729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91405c490 0x7ff91405f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff912ffd700 1 -- 172.21.15.36:0/486160729 >> v2:172.21.15.59:3300/0 conn(0x7ff9140aef90 msgr2=0x7ff9140b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:08.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff912ffd700 1 --2- 172.21.15.36:0/486160729 >> v2:172.21.15.59:3300/0 conn(0x7ff9140aef90 0x7ff9140b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff912ffd700 1 -- 172.21.15.36:0/486160729 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9140aeaf0 con 0x7ff9140ad4e0 2022-01-10T01:30:08.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff9127fc700 1 --2- 172.21.15.36:0/486160729 >> v2:172.21.15.59:3300/0 conn(0x7ff9140aef90 0x7ff9140b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:08.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff912ffd700 1 --2- 172.21.15.36:0/486160729 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9140ad4e0 0x7ff9140b03e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7ff908002f70 tx=0x7ff908006f40).ready entity=mon.0 client_cookie=2052dcedbf02099b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:08.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff911ffb700 1 -- 172.21.15.36:0/486160729 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff90800da80 con 0x7ff9140ad4e0 2022-01-10T01:30:08.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff911ffb700 1 -- 172.21.15.36:0/486160729 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff908000e90 con 0x7ff9140ad4e0 2022-01-10T01:30:08.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff911ffb700 1 -- 172.21.15.36:0/486160729 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff90800de10 con 0x7ff9140ad4e0 2022-01-10T01:30:08.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 -- 172.21.15.36:0/486160729 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9140ad4e0 msgr2=0x7ff9140b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:08.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 --2- 172.21.15.36:0/486160729 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9140ad4e0 0x7ff9140b03e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7ff908002f70 tx=0x7ff908006f40).stop 2022-01-10T01:30:08.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 -- 172.21.15.36:0/486160729 shutdown_connections 2022-01-10T01:30:08.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 --2- 172.21.15.36:0/486160729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91405c490 0x7ff91405f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 --2- 172.21.15.36:0/486160729 >> v2:172.21.15.59:3300/0 conn(0x7ff9140aef90 0x7ff9140b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 --2- 172.21.15.36:0/486160729 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9140ad4e0 0x7ff9140b03e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 -- 172.21.15.36:0/486160729 >> 172.21.15.36:0/486160729 conn(0x7ff9140611d0 msgr2=0x7ff914062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:08.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 -- 172.21.15.36:0/486160729 shutdown_connections 2022-01-10T01:30:08.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.443+0000 7ff913fff700 1 -- 172.21.15.36:0/486160729 wait complete. 2022-01-10T01:30:08.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff913fff700 1 Processor -- start 2022-01-10T01:30:08.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff913fff700 1 -- start start 2022-01-10T01:30:08.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff913fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91405c490 0x7ff91413de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:08.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff913fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9140ad4e0 0x7ff914066d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:08.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff913fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9140aef90 0x7ff914067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:08.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff913fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9140ac350 con 0x7ff9140aef90 2022-01-10T01:30:08.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff913fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9140ac000 con 0x7ff9140ad4e0 2022-01-10T01:30:08.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff913fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9140ac580 con 0x7ff91405c490 2022-01-10T01:30:08.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff9137fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9140aef90 0x7ff914067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:08.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff912ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91405c490 0x7ff91413de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:08.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff9137fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9140aef90 0x7ff914067270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37856/0 (socket says 172.21.15.36:37856) 2022-01-10T01:30:08.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff9137fe700 1 -- 172.21.15.36:0/970121550 learned_addr learned my addr 172.21.15.36:0/970121550 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:08.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff9127fc700 1 --2- 172.21.15.36:0/970121550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9140ad4e0 0x7ff914066d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:08.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff9137fe700 1 -- 172.21.15.36:0/970121550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91405c490 msgr2=0x7ff91413de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:08.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff9137fe700 1 --2- 172.21.15.36:0/970121550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91405c490 0x7ff91413de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff9137fe700 1 -- 172.21.15.36:0/970121550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9140ad4e0 msgr2=0x7ff914066d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:08.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff9137fe700 1 --2- 172.21.15.36:0/970121550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9140ad4e0 0x7ff914066d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff9137fe700 1 -- 172.21.15.36:0/970121550 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90800b460 con 0x7ff9140aef90 2022-01-10T01:30:08.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.447+0000 7ff912ffd700 1 --2- 172.21.15.36:0/970121550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91405c490 0x7ff91413de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:30:08.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.451+0000 7ff9137fe700 1 --2- 172.21.15.36:0/970121550 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9140aef90 0x7ff914067270 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7ff90c00c000 tx=0x7ff90c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:08.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.451+0000 7ff903fff700 1 -- 172.21.15.36:0/970121550 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff90c011750 con 0x7ff9140aef90 2022-01-10T01:30:08.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.451+0000 7ff903fff700 1 -- 172.21.15.36:0/970121550 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c00b3b0 con 0x7ff9140aef90 2022-01-10T01:30:08.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.451+0000 7ff913fff700 1 -- 172.21.15.36:0/970121550 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff914150d70 con 0x7ff9140aef90 2022-01-10T01:30:08.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.451+0000 7ff903fff700 1 -- 172.21.15.36:0/970121550 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff90c011aa0 con 0x7ff9140aef90 2022-01-10T01:30:08.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.451+0000 7ff913fff700 1 -- 172.21.15.36:0/970121550 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9140ac830 con 0x7ff9140aef90 2022-01-10T01:30:08.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.451+0000 7ff913fff700 1 -- 172.21.15.36:0/970121550 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff914151550 con 0x7ff9140aef90 2022-01-10T01:30:08.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.451+0000 7ff903fff700 1 -- 172.21.15.36:0/970121550 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff90c011c00 con 0x7ff9140aef90 2022-01-10T01:30:08.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.451+0000 7ff903fff700 1 --2- 172.21.15.36:0/970121550 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff8f00534d0 0x7ff8f0055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:08.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.455+0000 7ff903fff700 1 -- 172.21.15.36:0/970121550 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6304+0+0 (secure 0 0 0) 0x7ff90c06bc40 con 0x7ff9140aef90 2022-01-10T01:30:08.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.455+0000 7ff912ffd700 1 --2- 172.21.15.36:0/970121550 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff8f00534d0 0x7ff8f0055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:08.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.455+0000 7ff912ffd700 1 --2- 172.21.15.36:0/970121550 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff8f00534d0 0x7ff8f0055990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7ff90801e000 tx=0x7ff9140a95e0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:08.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.459+0000 7ff903fff700 1 -- 172.21.15.36:0/970121550 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff90c042bc0 con 0x7ff9140aef90 2022-01-10T01:30:08.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.615+0000 7ff913fff700 1 -- 172.21.15.36:0/970121550 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7ff9140af400 con 0x7ff9140aef90 2022-01-10T01:30:08.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.627+0000 7ff903fff700 1 -- 172.21.15.36:0/970121550 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 13 and data pool 14 v33) v1 ==== 189+0+0 (secure 0 0 0) 0x7ff90c0461e0 con 0x7ff9140aef90 2022-01-10T01:30:08.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.631+0000 7ff913fff700 1 -- 172.21.15.36:0/970121550 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff8f00534d0 msgr2=0x7ff8f0055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:08.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.631+0000 7ff913fff700 1 --2- 172.21.15.36:0/970121550 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff8f00534d0 0x7ff8f0055990 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7ff90801e000 tx=0x7ff9140a95e0).stop 2022-01-10T01:30:08.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.631+0000 7ff913fff700 1 -- 172.21.15.36:0/970121550 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9140aef90 msgr2=0x7ff914067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:08.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.631+0000 7ff913fff700 1 --2- 172.21.15.36:0/970121550 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9140aef90 0x7ff914067270 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7ff90c00c000 tx=0x7ff90c006df0).stop 2022-01-10T01:30:08.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.635+0000 7ff913fff700 1 -- 172.21.15.36:0/970121550 shutdown_connections 2022-01-10T01:30:08.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.635+0000 7ff913fff700 1 --2- 172.21.15.36:0/970121550 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff8f00534d0 0x7ff8f0055990 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.635+0000 7ff913fff700 1 --2- 172.21.15.36:0/970121550 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9140aef90 0x7ff914067270 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.635+0000 7ff913fff700 1 --2- 172.21.15.36:0/970121550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9140ad4e0 0x7ff914066d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.635+0000 7ff913fff700 1 --2- 172.21.15.36:0/970121550 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff91405c490 0x7ff91413de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.635+0000 7ff913fff700 1 -- 172.21.15.36:0/970121550 >> 172.21.15.36:0/970121550 conn(0x7ff9140611d0 msgr2=0x7ff9140b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:08.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.635+0000 7ff913fff700 1 -- 172.21.15.36:0/970121550 shutdown_connections 2022-01-10T01:30:08.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.635+0000 7ff913fff700 1 -- 172.21.15.36:0/970121550 wait complete. 2022-01-10T01:30:08.638 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 13 and data pool 14 2022-01-10T01:30:08.652 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:30:08.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.735+0000 7f6fbceef700 1 Processor -- start 2022-01-10T01:30:08.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.735+0000 7f6fbceef700 1 -- start start 2022-01-10T01:30:08.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fbceef700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6fb80b27a0 0x7f6fb8061160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:08.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fbceef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb8143270 0x7f6fb81436d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:08.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fbceef700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb8067050 con 0x7f6fb80b76b0 2022-01-10T01:30:08.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fbceef700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb80653b0 con 0x7f6fb80b27a0 2022-01-10T01:30:08.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fbceef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80b7a90 con 0x7f6fb8143270 2022-01-10T01:30:08.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fb77fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f6fb80b76b0 0x7f6fb8060a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35666/0 (socket says 172.21.15.36:35666) 2022-01-10T01:30:08.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fb77fe700 1 -- 172.21.15.36:0/4142345845 learned_addr learned my addr 172.21.15.36:0/4142345845 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:08.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6faeffd700 1 --2- 172.21.15.36:0/4142345845 >> v2:172.21.15.59:3300/0 conn(0x7f6fb80b27a0 0x7f6fb8061160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:08.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fb7fff700 1 --2- 172.21.15.36:0/4142345845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb8143270 0x7f6fb81436d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:08.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fb6ffd700 1 -- 172.21.15.36:0/4142345845 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804682738 0 0) 0x7f6fb8067050 con 0x7f6fb80b76b0 2022-01-10T01:30:08.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fb6ffd700 1 -- 172.21.15.36:0/4142345845 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f98003260 con 0x7f6fb80b76b0 2022-01-10T01:30:08.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fb7fff700 1 -- 172.21.15.36:0/4142345845 >> v2:172.21.15.59:3300/0 conn(0x7f6fb80b27a0 msgr2=0x7f6fb8061160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:08.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fb7fff700 1 --2- 172.21.15.36:0/4142345845 >> v2:172.21.15.59:3300/0 conn(0x7f6fb80b27a0 0x7f6fb8061160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fb7fff700 1 -- 172.21.15.36:0/4142345845 >> v1:172.21.15.36:6789/0 conn(0x7f6fb80b76b0 legacy=0x7f6fb8060a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:08.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fb7fff700 1 -- 172.21.15.36:0/4142345845 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb8061650 con 0x7f6fb8143270 2022-01-10T01:30:08.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6faeffd700 1 --2- 172.21.15.36:0/4142345845 >> v2:172.21.15.59:3300/0 conn(0x7f6fb80b27a0 0x7f6fb8061160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:30:08.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fb7fff700 1 --2- 172.21.15.36:0/4142345845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb8143270 0x7f6fb81436d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f6fb00032f0 tx=0x7f6fb00091d0).ready entity=mon.2 client_cookie=7b69fe4ae9c6f1d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:08.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fb6ffd700 1 -- 172.21.15.36:0/4142345845 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fb000b600 con 0x7f6fb8143270 2022-01-10T01:30:08.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fb6ffd700 1 -- 172.21.15.36:0/4142345845 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb000b760 con 0x7f6fb8143270 2022-01-10T01:30:08.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fb6ffd700 1 -- 172.21.15.36:0/4142345845 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fb000b8d0 con 0x7f6fb8143270 2022-01-10T01:30:08.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fbceef700 1 -- 172.21.15.36:0/4142345845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb8143270 msgr2=0x7f6fb81436d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:08.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fbceef700 1 --2- 172.21.15.36:0/4142345845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb8143270 0x7f6fb81436d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f6fb00032f0 tx=0x7f6fb00091d0).stop 2022-01-10T01:30:08.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fbceef700 1 -- 172.21.15.36:0/4142345845 shutdown_connections 2022-01-10T01:30:08.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fbceef700 1 --2- 172.21.15.36:0/4142345845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb8143270 0x7f6fb81436d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fbceef700 1 --2- 172.21.15.36:0/4142345845 >> v2:172.21.15.59:3300/0 conn(0x7f6fb80b27a0 0x7f6fb8061160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fbceef700 1 -- 172.21.15.36:0/4142345845 >> 172.21.15.36:0/4142345845 conn(0x7f6fb805f6b0 msgr2=0x7f6fb805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:08.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fbceef700 1 -- 172.21.15.36:0/4142345845 shutdown_connections 2022-01-10T01:30:08.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.739+0000 7f6fbceef700 1 -- 172.21.15.36:0/4142345845 wait complete. 2022-01-10T01:30:08.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fbceef700 1 Processor -- start 2022-01-10T01:30:08.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fbceef700 1 -- start start 2022-01-10T01:30:08.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fbceef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fb80b27a0 0x7f6fb8152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:08.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fbceef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb80b76b0 0x7f6fb814a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:08.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fbceef700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6fb8143270 0x7f6fb8155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:08.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fbceef700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb81531a0 con 0x7f6fb8143270 2022-01-10T01:30:08.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fbceef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb80b0fc0 con 0x7f6fb80b27a0 2022-01-10T01:30:08.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fbceef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb8155820 con 0x7f6fb80b76b0 2022-01-10T01:30:08.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fb7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6fb8143270 0x7f6fb8155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:08.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fb7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6fb8143270 0x7f6fb8155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37882/0 (socket says 172.21.15.36:37882) 2022-01-10T01:30:08.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fb7fff700 1 -- 172.21.15.36:0/3789872729 learned_addr learned my addr 172.21.15.36:0/3789872729 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:08.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fb77fe700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fb80b27a0 0x7f6fb8152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:08.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6faeffd700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb80b76b0 0x7f6fb814a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:08.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fb7fff700 1 -- 172.21.15.36:0/3789872729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb80b76b0 msgr2=0x7f6fb814a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:08.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fb7fff700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb80b76b0 0x7f6fb814a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fb7fff700 1 -- 172.21.15.36:0/3789872729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fb80b27a0 msgr2=0x7f6fb8152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:08.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fb7fff700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fb80b27a0 0x7f6fb8152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fb7fff700 1 -- 172.21.15.36:0/3789872729 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa000b180 con 0x7f6fb8143270 2022-01-10T01:30:08.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6faeffd700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb80b76b0 0x7f6fb814a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:08.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fb7fff700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6fb8143270 0x7f6fb8155c80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f6fb00032f0 tx=0x7f6fb0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:08.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fb57fa700 1 -- 172.21.15.36:0/3789872729 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fb000b8d0 con 0x7f6fb8143270 2022-01-10T01:30:08.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fb57fa700 1 -- 172.21.15.36:0/3789872729 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb001f3f0 con 0x7f6fb8143270 2022-01-10T01:30:08.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fbceef700 1 -- 172.21.15.36:0/3789872729 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb0009470 con 0x7f6fb8143270 2022-01-10T01:30:08.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fb57fa700 1 -- 172.21.15.36:0/3789872729 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fb000b600 con 0x7f6fb8143270 2022-01-10T01:30:08.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.743+0000 7f6fbceef700 1 -- 172.21.15.36:0/3789872729 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb814a790 con 0x7f6fb8143270 2022-01-10T01:30:08.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.747+0000 7f6fbceef700 1 -- 172.21.15.36:0/3789872729 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb81559e0 con 0x7f6fb8143270 2022-01-10T01:30:08.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.747+0000 7f6fb57fa700 1 -- 172.21.15.36:0/3789872729 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6fb0026030 con 0x7f6fb8143270 2022-01-10T01:30:08.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.747+0000 7f6fb57fa700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f9c0535f0 0x7f6f9c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:08.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.747+0000 7f6fb57fa700 1 -- 172.21.15.36:0/3789872729 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6fb006c650 con 0x7f6fb8143270 2022-01-10T01:30:08.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.747+0000 7f6fb77fe700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f9c0535f0 0x7f6f9c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:08.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.747+0000 7f6fb77fe700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f9c0535f0 0x7f6f9c055ab0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f6fa800d000 tx=0x7f6fa80079c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:08.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.755+0000 7f6fb57fa700 1 -- 172.21.15.36:0/3789872729 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6fb81559e0 con 0x7f6fb8143270 2022-01-10T01:30:08.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.883+0000 7f6fbceef700 1 -- 172.21.15.36:0/3789872729 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fb81559e0 con 0x7f6fb8143270 2022-01-10T01:30:08.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.887+0000 7f6fb57fa700 1 -- 172.21.15.36:0/3789872729 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16300 (secure 0 0 0) 0x7f6fb81559e0 con 0x7f6fb8143270 2022-01-10T01:30:08.888 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:08.888 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":76,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:30:08.620614+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:30:07.078168+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2022-01-10T01:30:08.044365+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:30:08.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.891+0000 7f6fbceef700 1 -- 172.21.15.36:0/3789872729 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f9c0535f0 msgr2=0x7f6f9c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:08.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.891+0000 7f6fbceef700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f9c0535f0 0x7f6f9c055ab0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f6fa800d000 tx=0x7f6fa80079c0).stop 2022-01-10T01:30:08.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.891+0000 7f6fbceef700 1 -- 172.21.15.36:0/3789872729 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6fb8143270 msgr2=0x7f6fb8155c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:08.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.891+0000 7f6fbceef700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6fb8143270 0x7f6fb8155c80 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f6fb00032f0 tx=0x7f6fb0016000).stop 2022-01-10T01:30:08.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.891+0000 7f6fbceef700 1 -- 172.21.15.36:0/3789872729 shutdown_connections 2022-01-10T01:30:08.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.891+0000 7f6fbceef700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f9c0535f0 0x7f6f9c055ab0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.891+0000 7f6fbceef700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6fb8143270 0x7f6fb8155c80 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.891+0000 7f6fbceef700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6fb80b76b0 0x7f6fb814a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.891+0000 7f6fbceef700 1 --2- 172.21.15.36:0/3789872729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fb80b27a0 0x7f6fb8152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:08.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.891+0000 7f6fbceef700 1 -- 172.21.15.36:0/3789872729 >> 172.21.15.36:0/3789872729 conn(0x7f6fb805f6b0 msgr2=0x7f6fb8145880 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:08.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.891+0000 7f6fbceef700 1 -- 172.21.15.36:0/3789872729 shutdown_connections 2022-01-10T01:30:08.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:08.891+0000 7f6fbceef700 1 -- 172.21.15.36:0/3789872729 wait complete. 2022-01-10T01:30:08.906 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:30:09.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9fb59e700 1 Processor -- start 2022-01-10T01:30:09.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9fb59e700 1 -- start start 2022-01-10T01:30:09.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9fb59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc0b30d0 0x7ff9fc143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9fb59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff9fc0ace70 0x7ff9fc13f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9fb59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9fc143920 con 0x7ff9fc0b0710 2022-01-10T01:30:09.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9fb59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9fc0b0af0 con 0x7ff9fc0ace70 2022-01-10T01:30:09.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9fb59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc0ae680 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9fa59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff9fc0b0710 0x7ff9fc142d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:53356/0 (socket says 172.21.15.36:53356) 2022-01-10T01:30:09.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9fa59c700 1 -- 172.21.15.36:0/1668690047 learned_addr learned my addr 172.21.15.36:0/1668690047 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:09.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9fad9d700 1 --2- 172.21.15.36:0/1668690047 >> v2:172.21.15.59:3300/0 conn(0x7ff9fc0ace70 0x7ff9fc13f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9f9d9b700 1 --2- 172.21.15.36:0/1668690047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc0b30d0 0x7ff9fc143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9f959a700 1 -- 172.21.15.36:0/1668690047 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667554220 0 0) 0x7ff9fc143920 con 0x7ff9fc0b0710 2022-01-10T01:30:09.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9f959a700 1 -- 172.21.15.36:0/1668690047 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9dc003260 con 0x7ff9fc0b0710 2022-01-10T01:30:09.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9f9d9b700 1 -- 172.21.15.36:0/1668690047 >> v2:172.21.15.59:3300/0 conn(0x7ff9fc0ace70 msgr2=0x7ff9fc13f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:09.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9f9d9b700 1 --2- 172.21.15.36:0/1668690047 >> v2:172.21.15.59:3300/0 conn(0x7ff9fc0ace70 0x7ff9fc13f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9f9d9b700 1 -- 172.21.15.36:0/1668690047 >> v1:172.21.15.59:6789/0 conn(0x7ff9fc0b0710 legacy=0x7ff9fc142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9f9d9b700 1 -- 172.21.15.36:0/1668690047 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc0ae920 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.007+0000 7ff9fad9d700 1 --2- 172.21.15.36:0/1668690047 >> v2:172.21.15.59:3300/0 conn(0x7ff9fc0ace70 0x7ff9fc13f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:30:09.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.011+0000 7ff9f9d9b700 1 --2- 172.21.15.36:0/1668690047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc0b30d0 0x7ff9fc143430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7ff9ec0032f0 tx=0x7ff9ec0091d0).ready entity=mon.2 client_cookie=8aeeb1bb4df46b1b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:09.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.011+0000 7ff9f959a700 1 -- 172.21.15.36:0/1668690047 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9ec00f8a0 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.011+0000 7ff9f959a700 1 -- 172.21.15.36:0/1668690047 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9ec00fa00 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.011+0000 7ff9f959a700 1 -- 172.21.15.36:0/1668690047 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9ec00fd60 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.011+0000 7ff9fb59e700 1 -- 172.21.15.36:0/1668690047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc0b30d0 msgr2=0x7ff9fc143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.011+0000 7ff9fb59e700 1 --2- 172.21.15.36:0/1668690047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc0b30d0 0x7ff9fc143430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7ff9ec0032f0 tx=0x7ff9ec0091d0).stop 2022-01-10T01:30:09.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.011+0000 7ff9fb59e700 1 -- 172.21.15.36:0/1668690047 shutdown_connections 2022-01-10T01:30:09.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.011+0000 7ff9fb59e700 1 --2- 172.21.15.36:0/1668690047 >> v2:172.21.15.59:3300/0 conn(0x7ff9fc0ace70 0x7ff9fc13f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.011+0000 7ff9fb59e700 1 --2- 172.21.15.36:0/1668690047 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc0b30d0 0x7ff9fc143430 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.011+0000 7ff9fb59e700 1 -- 172.21.15.36:0/1668690047 >> 172.21.15.36:0/1668690047 conn(0x7ff9fc061140 msgr2=0x7ff9fc062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:09.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.011+0000 7ff9fb59e700 1 -- 172.21.15.36:0/1668690047 shutdown_connections 2022-01-10T01:30:09.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.011+0000 7ff9fb59e700 1 -- 172.21.15.36:0/1668690047 wait complete. 2022-01-10T01:30:09.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.011+0000 7ff9fb59e700 1 Processor -- start 2022-01-10T01:30:09.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.011+0000 7ff9fb59e700 1 -- start start 2022-01-10T01:30:09.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fb59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9fc0ace70 0x7ff9fc140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fb59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc0b0710 0x7ff9fc155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fb59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9fc0b30d0 0x7ff9fc155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fb59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc156260 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fb59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc065440 con 0x7ff9fc0ace70 2022-01-10T01:30:09.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fb59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc0aab60 con 0x7ff9fc0b0710 2022-01-10T01:30:09.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fa59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9fc0ace70 0x7ff9fc140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9fc0b30d0 0x7ff9fc155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fa59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9fc0ace70 0x7ff9fc140960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:34526/0 (socket says 172.21.15.36:34526) 2022-01-10T01:30:09.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9f9d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc0b0710 0x7ff9fc155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fa59c700 1 -- 172.21.15.36:0/2305212470 learned_addr learned my addr 172.21.15.36:0/2305212470 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:09.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fad9d700 1 -- 172.21.15.36:0/2305212470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc0b0710 msgr2=0x7ff9fc155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fad9d700 1 --2- 172.21.15.36:0/2305212470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc0b0710 0x7ff9fc155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fad9d700 1 -- 172.21.15.36:0/2305212470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9fc0ace70 msgr2=0x7ff9fc140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fad9d700 1 --2- 172.21.15.36:0/2305212470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9fc0ace70 0x7ff9fc140960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fad9d700 1 -- 172.21.15.36:0/2305212470 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f400b180 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fad9d700 1 --2- 172.21.15.36:0/2305212470 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9fc0b30d0 0x7ff9fc155d70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7ff9f400c000 tx=0x7ff9f4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:09.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9f37fe700 1 -- 172.21.15.36:0/2305212470 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f4010780 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9f37fe700 1 -- 172.21.15.36:0/2305212470 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f40108e0 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9f37fe700 1 -- 172.21.15.36:0/2305212470 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9f4010c40 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fb59e700 1 -- 172.21.15.36:0/2305212470 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ec009470 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.015+0000 7ff9fb59e700 1 -- 172.21.15.36:0/2305212470 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9fc065670 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.019+0000 7ff9fb59e700 1 -- 172.21.15.36:0/2305212470 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9fc057350 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.019+0000 7ff9f37fe700 1 -- 172.21.15.36:0/2305212470 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff9f401c460 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.019+0000 7ff9f37fe700 1 --2- 172.21.15.36:0/2305212470 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e0053590 0x7ff9e0055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.019+0000 7ff9f37fe700 1 -- 172.21.15.36:0/2305212470 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff9f406be90 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.019+0000 7ff9fa59c700 1 --2- 172.21.15.36:0/2305212470 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e0053590 0x7ff9e0055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.019+0000 7ff9fa59c700 1 --2- 172.21.15.36:0/2305212470 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e0053590 0x7ff9e0055a50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7ff9e400d000 tx=0x7ff9e4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:09.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.027+0000 7ff9f37fe700 1 -- 172.21.15.36:0/2305212470 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff9f4042da0 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.155+0000 7ff9fb59e700 1 -- 172.21.15.36:0/2305212470 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9fc0b2c70 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.155+0000 7ff9f37fe700 1 -- 172.21.15.36:0/2305212470 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16300 (secure 0 0 0) 0x7ff9f40463c0 con 0x7ff9fc0b30d0 2022-01-10T01:30:09.159 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:09.159 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":76,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:30:08.620614+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:30:07.078168+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2022-01-10T01:30:08.044365+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:30:09.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.159+0000 7ff9fb59e700 1 -- 172.21.15.36:0/2305212470 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e0053590 msgr2=0x7ff9e0055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.159+0000 7ff9fb59e700 1 --2- 172.21.15.36:0/2305212470 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e0053590 0x7ff9e0055a50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7ff9e400d000 tx=0x7ff9e4009040).stop 2022-01-10T01:30:09.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.159+0000 7ff9fb59e700 1 -- 172.21.15.36:0/2305212470 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9fc0b30d0 msgr2=0x7ff9fc155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.159+0000 7ff9fb59e700 1 --2- 172.21.15.36:0/2305212470 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9fc0b30d0 0x7ff9fc155d70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7ff9f400c000 tx=0x7ff9f4006df0).stop 2022-01-10T01:30:09.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.159+0000 7ff9fb59e700 1 -- 172.21.15.36:0/2305212470 shutdown_connections 2022-01-10T01:30:09.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.159+0000 7ff9fb59e700 1 --2- 172.21.15.36:0/2305212470 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff9e0053590 0x7ff9e0055a50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.159+0000 7ff9fb59e700 1 --2- 172.21.15.36:0/2305212470 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9fc0b30d0 0x7ff9fc155d70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.159+0000 7ff9fb59e700 1 --2- 172.21.15.36:0/2305212470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9fc0b0710 0x7ff9fc155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.159+0000 7ff9fb59e700 1 --2- 172.21.15.36:0/2305212470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9fc0ace70 0x7ff9fc140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.159+0000 7ff9fb59e700 1 -- 172.21.15.36:0/2305212470 >> 172.21.15.36:0/2305212470 conn(0x7ff9fc061140 msgr2=0x7ff9fc141280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:09.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.159+0000 7ff9fb59e700 1 -- 172.21.15.36:0/2305212470 shutdown_connections 2022-01-10T01:30:09.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.159+0000 7ff9fb59e700 1 -- 172.21.15.36:0/2305212470 wait complete. 2022-01-10T01:30:09.171 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-01-10T01:30:09.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.279+0000 7f489a122700 1 Processor -- start 2022-01-10T01:30:09.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.279+0000 7f489a122700 1 -- start start 2022-01-10T01:30:09.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4894146950 0x7f4894140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48940b4180 0x7f4894140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48940b4690 0x7f48940b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4894147510 con 0x7f4894146950 2022-01-10T01:30:09.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4894143b60 con 0x7f48940b4180 2022-01-10T01:30:09.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4894143e00 con 0x7f48940b4690 2022-01-10T01:30:09.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f48937fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4894146950 0x7f4894140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f48937fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4894146950 0x7f4894140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37902/0 (socket says 172.21.15.36:37902) 2022-01-10T01:30:09.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f48937fe700 1 -- 172.21.15.36:0/1321190956 learned_addr learned my addr 172.21.15.36:0/1321190956 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:09.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f4893fff700 1 --2- 172.21.15.36:0/1321190956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48940b4690 0x7f48940b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f4892ffd700 1 --2- 172.21.15.36:0/1321190956 >> v2:172.21.15.59:3300/0 conn(0x7f48940b4180 0x7f4894140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f48937fe700 1 -- 172.21.15.36:0/1321190956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48940b4690 msgr2=0x7f48940b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:09.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f48937fe700 1 --2- 172.21.15.36:0/1321190956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48940b4690 0x7f48940b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f48937fe700 1 -- 172.21.15.36:0/1321190956 >> v2:172.21.15.59:3300/0 conn(0x7f48940b4180 msgr2=0x7f4894140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:09.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f48937fe700 1 --2- 172.21.15.36:0/1321190956 >> v2:172.21.15.59:3300/0 conn(0x7f48940b4180 0x7f4894140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f48937fe700 1 -- 172.21.15.36:0/1321190956 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940b0c90 con 0x7f4894146950 2022-01-10T01:30:09.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f48937fe700 1 --2- 172.21.15.36:0/1321190956 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4894146950 0x7f4894140230 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f487c002f70 tx=0x7f487c006eb0).ready entity=mon.0 client_cookie=48061fe4f418b7ac server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:09.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f48927fc700 1 -- 172.21.15.36:0/1321190956 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f487c00d570 con 0x7f4894146950 2022-01-10T01:30:09.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f48927fc700 1 -- 172.21.15.36:0/1321190956 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c000e90 con 0x7f4894146950 2022-01-10T01:30:09.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f48927fc700 1 -- 172.21.15.36:0/1321190956 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f487c00d900 con 0x7f4894146950 2022-01-10T01:30:09.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 -- 172.21.15.36:0/1321190956 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4894146950 msgr2=0x7f4894140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 --2- 172.21.15.36:0/1321190956 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4894146950 0x7f4894140230 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f487c002f70 tx=0x7f487c006eb0).stop 2022-01-10T01:30:09.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 -- 172.21.15.36:0/1321190956 shutdown_connections 2022-01-10T01:30:09.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 --2- 172.21.15.36:0/1321190956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48940b4690 0x7f48940b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 --2- 172.21.15.36:0/1321190956 >> v2:172.21.15.59:3300/0 conn(0x7f48940b4180 0x7f4894140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 --2- 172.21.15.36:0/1321190956 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4894146950 0x7f4894140230 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 -- 172.21.15.36:0/1321190956 >> 172.21.15.36:0/1321190956 conn(0x7f489405c490 msgr2=0x7f489405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:09.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 -- 172.21.15.36:0/1321190956 shutdown_connections 2022-01-10T01:30:09.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.283+0000 7f489a122700 1 -- 172.21.15.36:0/1321190956 wait complete. 2022-01-10T01:30:09.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f489a122700 1 Processor -- start 2022-01-10T01:30:09.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f489a122700 1 -- start start 2022-01-10T01:30:09.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f489a122700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48940b4180 0x7f4894152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f489a122700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48940b4690 0x7f489413e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f489a122700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4894146950 0x7f4894155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f489a122700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48940b7af0 con 0x7f48940b4180 2022-01-10T01:30:09.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f489a122700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4894155df0 con 0x7f48940b4690 2022-01-10T01:30:09.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f489a122700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48941567f0 con 0x7f4894146950 2022-01-10T01:30:09.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f48937fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48940b4180 0x7f4894152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f48937fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48940b4180 0x7f4894152350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37906/0 (socket says 172.21.15.36:37906) 2022-01-10T01:30:09.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f48937fe700 1 -- 172.21.15.36:0/3126547292 learned_addr learned my addr 172.21.15.36:0/3126547292 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:09.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f4892ffd700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48940b4690 0x7f489413e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f4893fff700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4894146950 0x7f4894155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f48937fe700 1 -- 172.21.15.36:0/3126547292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4894146950 msgr2=0x7f4894155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f48937fe700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4894146950 0x7f4894155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f48937fe700 1 -- 172.21.15.36:0/3126547292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48940b4690 msgr2=0x7f489413e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f48937fe700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48940b4690 0x7f489413e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f48937fe700 1 -- 172.21.15.36:0/3126547292 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c00b1e0 con 0x7f48940b4180 2022-01-10T01:30:09.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f4893fff700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4894146950 0x7f4894155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:09.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f4892ffd700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48940b4690 0x7f489413e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:09.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f48937fe700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48940b4180 0x7f4894152350 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f4894155f30 tx=0x7f487c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:09.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f4890ff9700 1 -- 172.21.15.36:0/3126547292 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f487c011910 con 0x7f48940b4180 2022-01-10T01:30:09.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f4890ff9700 1 -- 172.21.15.36:0/3126547292 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c011a70 con 0x7f48940b4180 2022-01-10T01:30:09.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f489a122700 1 -- 172.21.15.36:0/3126547292 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4894156010 con 0x7f48940b4180 2022-01-10T01:30:09.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f4890ff9700 1 -- 172.21.15.36:0/3126547292 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f487c011dd0 con 0x7f48940b4180 2022-01-10T01:30:09.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.287+0000 7f489a122700 1 -- 172.21.15.36:0/3126547292 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4894156550 con 0x7f48940b4180 2022-01-10T01:30:09.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.291+0000 7f489a122700 1 -- 172.21.15.36:0/3126547292 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48940b8350 con 0x7f48940b4180 2022-01-10T01:30:09.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.291+0000 7f4890ff9700 1 -- 172.21.15.36:0/3126547292 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f487c025030 con 0x7f48940b4180 2022-01-10T01:30:09.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.291+0000 7f4890ff9700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4878053560 0x7f4878055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.291+0000 7f4890ff9700 1 -- 172.21.15.36:0/3126547292 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f487c06cd10 con 0x7f48940b4180 2022-01-10T01:30:09.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.291+0000 7f4892ffd700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4878053560 0x7f4878055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.291+0000 7f4892ffd700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4878053560 0x7f4878055a20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f488400b000 tx=0x7f4884008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:09.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.299+0000 7f4890ff9700 1 -- 172.21.15.36:0/3126547292 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f487c043d20 con 0x7f48940b4180 2022-01-10T01:30:09.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.463+0000 7f489a122700 1 -- 172.21.15.36:0/3126547292 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4894057350 con 0x7f48940b4180 2022-01-10T01:30:09.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.627+0000 7f4890ff9700 1 -- 172.21.15.36:0/3126547292 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7f487c023070 con 0x7f48940b4180 2022-01-10T01:30:09.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.631+0000 7f489a122700 1 -- 172.21.15.36:0/3126547292 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4878053560 msgr2=0x7f4878055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.631+0000 7f489a122700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4878053560 0x7f4878055a20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f488400b000 tx=0x7f4884008040).stop 2022-01-10T01:30:09.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.631+0000 7f489a122700 1 -- 172.21.15.36:0/3126547292 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48940b4180 msgr2=0x7f4894152350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.631+0000 7f489a122700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48940b4180 0x7f4894152350 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f4894155f30 tx=0x7f487c015000).stop 2022-01-10T01:30:09.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.631+0000 7f489a122700 1 -- 172.21.15.36:0/3126547292 shutdown_connections 2022-01-10T01:30:09.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.631+0000 7f489a122700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4878053560 0x7f4878055a20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.631+0000 7f489a122700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4894146950 0x7f4894155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.631+0000 7f489a122700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48940b4690 0x7f489413e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.631+0000 7f489a122700 1 --2- 172.21.15.36:0/3126547292 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48940b4180 0x7f4894152350 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.631+0000 7f489a122700 1 -- 172.21.15.36:0/3126547292 >> 172.21.15.36:0/3126547292 conn(0x7f489405c490 msgr2=0x7f4894061550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:09.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.631+0000 7f489a122700 1 -- 172.21.15.36:0/3126547292 shutdown_connections 2022-01-10T01:30:09.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.631+0000 7f489a122700 1 -- 172.21.15.36:0/3126547292 wait complete. 2022-01-10T01:30:09.646 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:30:09.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.751+0000 7fd95759e700 1 Processor -- start 2022-01-10T01:30:09.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.751+0000 7fd95759e700 1 -- start start 2022-01-10T01:30:09.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.751+0000 7fd95759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd958061320 0x7fd958061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.751+0000 7fd95759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd9580ad5c0 0x7fd9580b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.751+0000 7fd95759e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9580aecf0 con 0x7fd958140440 2022-01-10T01:30:09.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.751+0000 7fd95759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9580b6f20 con 0x7fd9580ad5c0 2022-01-10T01:30:09.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.751+0000 7fd95759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580aef20 con 0x7fd958061320 2022-01-10T01:30:09.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd956d9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd958140440 0x7fd958146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35712/0 (socket says 172.21.15.36:35712) 2022-01-10T01:30:09.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd956d9d700 1 -- 172.21.15.36:0/884289939 learned_addr learned my addr 172.21.15.36:0/884289939 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:09.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd94ffff700 1 --2- 172.21.15.36:0/884289939 >> v2:172.21.15.59:3300/0 conn(0x7fd9580ad5c0 0x7fd9580b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd95659c700 1 --2- 172.21.15.36:0/884289939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd958061320 0x7fd958061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd955d9b700 1 -- 172.21.15.36:0/884289939 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198015422 0 0) 0x7fd9580aecf0 con 0x7fd958140440 2022-01-10T01:30:09.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd955d9b700 1 -- 172.21.15.36:0/884289939 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd93c003260 con 0x7fd958140440 2022-01-10T01:30:09.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd955d9b700 1 -- 172.21.15.36:0/884289939 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 610506208 0 0) 0x7fd93c003260 con 0x7fd958140440 2022-01-10T01:30:09.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd94ffff700 1 -- 172.21.15.36:0/884289939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd958061320 msgr2=0x7fd958061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:09.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd94ffff700 1 --2- 172.21.15.36:0/884289939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd958061320 0x7fd958061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd94ffff700 1 -- 172.21.15.36:0/884289939 >> v1:172.21.15.36:6789/0 conn(0x7fd958140440 legacy=0x7fd958146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd94ffff700 1 -- 172.21.15.36:0/884289939 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9580af1c0 con 0x7fd9580ad5c0 2022-01-10T01:30:09.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd94ffff700 1 --2- 172.21.15.36:0/884289939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9580ad5c0 0x7fd9580b9e60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fd950001b80 tx=0x7fd948006df0).ready entity=mon.1 client_cookie=ab43e0cd3daa1be server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:09.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd955d9b700 1 -- 172.21.15.36:0/884289939 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd9500019e0 con 0x7fd9580ad5c0 2022-01-10T01:30:09.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd955d9b700 1 -- 172.21.15.36:0/884289939 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd948000e90 con 0x7fd9580ad5c0 2022-01-10T01:30:09.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd955d9b700 1 -- 172.21.15.36:0/884289939 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd948012460 con 0x7fd9580ad5c0 2022-01-10T01:30:09.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd95759e700 1 -- 172.21.15.36:0/884289939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9580ad5c0 msgr2=0x7fd9580b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd95759e700 1 --2- 172.21.15.36:0/884289939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9580ad5c0 0x7fd9580b9e60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fd950001b80 tx=0x7fd948006df0).stop 2022-01-10T01:30:09.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd95759e700 1 -- 172.21.15.36:0/884289939 shutdown_connections 2022-01-10T01:30:09.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd95759e700 1 --2- 172.21.15.36:0/884289939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9580ad5c0 0x7fd9580b9e60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd95759e700 1 --2- 172.21.15.36:0/884289939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd958061320 0x7fd958061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd95759e700 1 -- 172.21.15.36:0/884289939 >> 172.21.15.36:0/884289939 conn(0x7fd958066de0 msgr2=0x7fd9580671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:09.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd95759e700 1 -- 172.21.15.36:0/884289939 shutdown_connections 2022-01-10T01:30:09.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.755+0000 7fd95759e700 1 -- 172.21.15.36:0/884289939 wait complete. 2022-01-10T01:30:09.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd95759e700 1 Processor -- start 2022-01-10T01:30:09.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd95759e700 1 -- start start 2022-01-10T01:30:09.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd95759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd958061320 0x7fd958145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd95759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9580ad5c0 0x7fd958140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd95759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd958140440 0x7fd958141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd95759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95809e8b0 con 0x7fd958140440 2022-01-10T01:30:09.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd95759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd958142c90 con 0x7fd9580ad5c0 2022-01-10T01:30:09.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd95759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd958152d40 con 0x7fd958061320 2022-01-10T01:30:09.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd956d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd958140440 0x7fd958141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd956d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd958140440 0x7fd958141360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37924/0 (socket says 172.21.15.36:37924) 2022-01-10T01:30:09.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd956d9d700 1 -- 172.21.15.36:0/1012481381 learned_addr learned my addr 172.21.15.36:0/1012481381 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:09.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd95659c700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd958061320 0x7fd958145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd94ffff700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9580ad5c0 0x7fd958140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd956d9d700 1 -- 172.21.15.36:0/1012481381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd958061320 msgr2=0x7fd958145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd956d9d700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd958061320 0x7fd958145620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd956d9d700 1 -- 172.21.15.36:0/1012481381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9580ad5c0 msgr2=0x7fd958140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd956d9d700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9580ad5c0 0x7fd958140e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd956d9d700 1 -- 172.21.15.36:0/1012481381 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94800b180 con 0x7fd958140440 2022-01-10T01:30:09.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd94ffff700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9580ad5c0 0x7fd958140e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:09.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd956d9d700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd958140440 0x7fd958141360 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fd950001c40 tx=0x7fd950002100).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:09.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd94f7fe700 1 -- 172.21.15.36:0/1012481381 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd950004ab0 con 0x7fd958140440 2022-01-10T01:30:09.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd94f7fe700 1 -- 172.21.15.36:0/1012481381 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd950004c10 con 0x7fd958140440 2022-01-10T01:30:09.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd95759e700 1 -- 172.21.15.36:0/1012481381 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd958152fe0 con 0x7fd958140440 2022-01-10T01:30:09.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd94f7fe700 1 -- 172.21.15.36:0/1012481381 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd950007170 con 0x7fd958140440 2022-01-10T01:30:09.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.759+0000 7fd95759e700 1 -- 172.21.15.36:0/1012481381 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9581425a0 con 0x7fd958140440 2022-01-10T01:30:09.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.763+0000 7fd95759e700 1 -- 172.21.15.36:0/1012481381 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95809ea20 con 0x7fd958140440 2022-01-10T01:30:09.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.763+0000 7fd94f7fe700 1 -- 172.21.15.36:0/1012481381 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd95001b060 con 0x7fd958140440 2022-01-10T01:30:09.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.763+0000 7fd94f7fe700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd930053560 0x7fd930055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:09.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.763+0000 7fd94f7fe700 1 -- 172.21.15.36:0/1012481381 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd95006b770 con 0x7fd958140440 2022-01-10T01:30:09.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.763+0000 7fd95659c700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd930053560 0x7fd930055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:09.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.763+0000 7fd95659c700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd930053560 0x7fd930055a20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fd94000b000 tx=0x7fd940006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:09.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.767+0000 7fd94f7fe700 1 -- 172.21.15.36:0/1012481381 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd95809ea20 con 0x7fd958140440 2022-01-10T01:30:09.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.931+0000 7fd95759e700 1 -- 172.21.15.36:0/1012481381 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd95809e9f0 con 0x7fd958140440 2022-01-10T01:30:09.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.931+0000 7fd94f7fe700 1 -- 172.21.15.36:0/1012481381 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fd950019020 con 0x7fd958140440 2022-01-10T01:30:09.933 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:09.933 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":34,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3321682930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3321682930},{"type":"v1","addr":"172.21.15.59:6833","nonce":3321682930}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/635174626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":635174626},{"type":"v1","addr":"172.21.15.36:6837","nonce":635174626}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:30:08.620792+0000","modified":"2022-01-10T01:30:09.623530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35654":{"gid":35654,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/452951292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":452951292},{"type":"v1","addr":"172.21.15.36:6835","nonce":452951292}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2022-01-10T01:30:09.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.935+0000 7fd95759e700 1 -- 172.21.15.36:0/1012481381 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd930053560 msgr2=0x7fd930055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.935+0000 7fd95759e700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd930053560 0x7fd930055a20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fd94000b000 tx=0x7fd940006df0).stop 2022-01-10T01:30:09.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.935+0000 7fd95759e700 1 -- 172.21.15.36:0/1012481381 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd958140440 msgr2=0x7fd958141360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:09.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.935+0000 7fd95759e700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd958140440 0x7fd958141360 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fd950001c40 tx=0x7fd950002100).stop 2022-01-10T01:30:09.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.935+0000 7fd95759e700 1 -- 172.21.15.36:0/1012481381 shutdown_connections 2022-01-10T01:30:09.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.935+0000 7fd95759e700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd930053560 0x7fd930055a20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.935+0000 7fd95759e700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd958140440 0x7fd958141360 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.935+0000 7fd95759e700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9580ad5c0 0x7fd958140e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.935+0000 7fd95759e700 1 --2- 172.21.15.36:0/1012481381 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd958061320 0x7fd958145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:09.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.935+0000 7fd95759e700 1 -- 172.21.15.36:0/1012481381 >> 172.21.15.36:0/1012481381 conn(0x7fd958066de0 msgr2=0x7fd9580b7510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:09.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.935+0000 7fd95759e700 1 -- 172.21.15.36:0/1012481381 shutdown_connections 2022-01-10T01:30:09.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:09.935+0000 7fd95759e700 1 -- 172.21.15.36:0/1012481381 wait complete. 2022-01-10T01:30:09.939 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 34 2022-01-10T01:30:09.946 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:30:10.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.043+0000 7fb94759e700 1 Processor -- start 2022-01-10T01:30:10.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.043+0000 7fb94759e700 1 -- start start 2022-01-10T01:30:10.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb948061320 0x7fb948061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb9480ad5c0 0x7fb9480b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb948140440 0x7fb9481408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9480aecf0 con 0x7fb9480ad5c0 2022-01-10T01:30:10.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9480b6f20 con 0x7fb948061320 2022-01-10T01:30:10.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9480aef20 con 0x7fb948140440 2022-01-10T01:30:10.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb945d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb9480ad5c0 0x7fb9480b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb945d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb9480ad5c0 0x7fb9480b9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37928/0 (socket says 172.21.15.36:37928) 2022-01-10T01:30:10.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb945d9b700 1 -- 172.21.15.36:0/3010692777 learned_addr learned my addr 172.21.15.36:0/3010692777 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:10.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb946d9d700 1 --2- 172.21.15.36:0/3010692777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb948140440 0x7fb9481408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94659c700 1 --2- 172.21.15.36:0/3010692777 >> v2:172.21.15.59:3300/0 conn(0x7fb948061320 0x7fb948061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb945d9b700 1 -- 172.21.15.36:0/3010692777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb948140440 msgr2=0x7fb9481408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:10.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb945d9b700 1 --2- 172.21.15.36:0/3010692777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb948140440 0x7fb9481408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb945d9b700 1 -- 172.21.15.36:0/3010692777 >> v2:172.21.15.59:3300/0 conn(0x7fb948061320 msgr2=0x7fb948061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:10.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb945d9b700 1 --2- 172.21.15.36:0/3010692777 >> v2:172.21.15.59:3300/0 conn(0x7fb948061320 0x7fb948061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb945d9b700 1 -- 172.21.15.36:0/3010692777 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9480af1c0 con 0x7fb9480ad5c0 2022-01-10T01:30:10.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94659c700 1 --2- 172.21.15.36:0/3010692777 >> v2:172.21.15.59:3300/0 conn(0x7fb948061320 0x7fb948061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:30:10.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb945d9b700 1 --2- 172.21.15.36:0/3010692777 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb9480ad5c0 0x7fb9480b9e60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fb9480aeba0 tx=0x7fb938006eb0).ready entity=mon.0 client_cookie=862f83f99a4727ce server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:10.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94559a700 1 -- 172.21.15.36:0/3010692777 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb93800d570 con 0x7fb9480ad5c0 2022-01-10T01:30:10.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94559a700 1 -- 172.21.15.36:0/3010692777 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb938000e90 con 0x7fb9480ad5c0 2022-01-10T01:30:10.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94559a700 1 -- 172.21.15.36:0/3010692777 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb93800d8c0 con 0x7fb9480ad5c0 2022-01-10T01:30:10.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 -- 172.21.15.36:0/3010692777 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb9480ad5c0 msgr2=0x7fb9480b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 --2- 172.21.15.36:0/3010692777 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb9480ad5c0 0x7fb9480b9e60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fb9480aeba0 tx=0x7fb938006eb0).stop 2022-01-10T01:30:10.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 -- 172.21.15.36:0/3010692777 shutdown_connections 2022-01-10T01:30:10.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 --2- 172.21.15.36:0/3010692777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb948140440 0x7fb9481408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 --2- 172.21.15.36:0/3010692777 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb9480ad5c0 0x7fb9480b9e60 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 --2- 172.21.15.36:0/3010692777 >> v2:172.21.15.59:3300/0 conn(0x7fb948061320 0x7fb948061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 -- 172.21.15.36:0/3010692777 >> 172.21.15.36:0/3010692777 conn(0x7fb948066de0 msgr2=0x7fb9480671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:10.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 -- 172.21.15.36:0/3010692777 shutdown_connections 2022-01-10T01:30:10.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.047+0000 7fb94759e700 1 -- 172.21.15.36:0/3010692777 wait complete. 2022-01-10T01:30:10.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb94759e700 1 Processor -- start 2022-01-10T01:30:10.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb94759e700 1 -- start start 2022-01-10T01:30:10.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb94759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb948061320 0x7fb948143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb94759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb9480ad5c0 0x7fb9480a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb94759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb948140440 0x7fb9480a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb94759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94809f000 con 0x7fb9480ad5c0 2022-01-10T01:30:10.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb94759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb948153050 con 0x7fb948061320 2022-01-10T01:30:10.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb94759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9481532f0 con 0x7fb948140440 2022-01-10T01:30:10.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb945d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb9480ad5c0 0x7fb9480a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb94659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb948061320 0x7fb948143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb945d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb9480ad5c0 0x7fb9480a1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37938/0 (socket says 172.21.15.36:37938) 2022-01-10T01:30:10.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb945d9b700 1 -- 172.21.15.36:0/610172441 learned_addr learned my addr 172.21.15.36:0/610172441 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:10.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb946d9d700 1 --2- 172.21.15.36:0/610172441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb948140440 0x7fb9480a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb945d9b700 1 -- 172.21.15.36:0/610172441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb948140440 msgr2=0x7fb9480a1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb945d9b700 1 --2- 172.21.15.36:0/610172441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb948140440 0x7fb9480a1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb945d9b700 1 -- 172.21.15.36:0/610172441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb948061320 msgr2=0x7fb948143980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb945d9b700 1 --2- 172.21.15.36:0/610172441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb948061320 0x7fb948143980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb945d9b700 1 -- 172.21.15.36:0/610172441 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93800b1e0 con 0x7fb9480ad5c0 2022-01-10T01:30:10.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb945d9b700 1 --2- 172.21.15.36:0/610172441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb9480ad5c0 0x7fb9480a1b00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fb9480aeba0 tx=0x7fb938015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:10.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb9377fe700 1 -- 172.21.15.36:0/610172441 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb938011760 con 0x7fb9480ad5c0 2022-01-10T01:30:10.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb9377fe700 1 -- 172.21.15.36:0/610172441 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9380118c0 con 0x7fb9480ad5c0 2022-01-10T01:30:10.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb9377fe700 1 -- 172.21.15.36:0/610172441 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb938011c20 con 0x7fb9480ad5c0 2022-01-10T01:30:10.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb94759e700 1 -- 172.21.15.36:0/610172441 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb948144900 con 0x7fb9480ad5c0 2022-01-10T01:30:10.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.051+0000 7fb94759e700 1 -- 172.21.15.36:0/610172441 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9480b3060 con 0x7fb9480ad5c0 2022-01-10T01:30:10.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.055+0000 7fb94759e700 1 -- 172.21.15.36:0/610172441 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94809f200 con 0x7fb9480ad5c0 2022-01-10T01:30:10.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.055+0000 7fb9377fe700 1 -- 172.21.15.36:0/610172441 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb93801a040 con 0x7fb9480ad5c0 2022-01-10T01:30:10.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.055+0000 7fb9377fe700 1 --2- 172.21.15.36:0/610172441 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb924053590 0x7fb924055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.055+0000 7fb9377fe700 1 -- 172.21.15.36:0/610172441 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb93806c7c0 con 0x7fb9480ad5c0 2022-01-10T01:30:10.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.055+0000 7fb94659c700 1 --2- 172.21.15.36:0/610172441 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb924053590 0x7fb924055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.055+0000 7fb94659c700 1 --2- 172.21.15.36:0/610172441 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb924053590 0x7fb924055a50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fb93c00d000 tx=0x7fb93c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:10.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.059+0000 7fb9377fe700 1 -- 172.21.15.36:0/610172441 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb9380438d0 con 0x7fb9480ad5c0 2022-01-10T01:30:10.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.187+0000 7fb94759e700 1 -- 172.21.15.36:0/610172441 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9480af460 con 0x7fb9480ad5c0 2022-01-10T01:30:10.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.191+0000 7fb9377fe700 1 -- 172.21.15.36:0/610172441 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16274 (secure 0 0 0) 0x7fb938046df0 con 0x7fb9480ad5c0 2022-01-10T01:30:10.191 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:10.191 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":77,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:30:09.624310+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:30:07.078168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2022-01-10T01:30:08.044365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:30:10.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.191+0000 7fb94759e700 1 -- 172.21.15.36:0/610172441 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb924053590 msgr2=0x7fb924055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.191+0000 7fb94759e700 1 --2- 172.21.15.36:0/610172441 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb924053590 0x7fb924055a50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fb93c00d000 tx=0x7fb93c008040).stop 2022-01-10T01:30:10.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.191+0000 7fb94759e700 1 -- 172.21.15.36:0/610172441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb9480ad5c0 msgr2=0x7fb9480a1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.191+0000 7fb94759e700 1 --2- 172.21.15.36:0/610172441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb9480ad5c0 0x7fb9480a1b00 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fb9480aeba0 tx=0x7fb938015000).stop 2022-01-10T01:30:10.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.191+0000 7fb94759e700 1 -- 172.21.15.36:0/610172441 shutdown_connections 2022-01-10T01:30:10.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.191+0000 7fb94759e700 1 --2- 172.21.15.36:0/610172441 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb924053590 0x7fb924055a50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.191+0000 7fb94759e700 1 --2- 172.21.15.36:0/610172441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb948140440 0x7fb9480a1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.191+0000 7fb94759e700 1 --2- 172.21.15.36:0/610172441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb9480ad5c0 0x7fb9480a1b00 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.191+0000 7fb94759e700 1 --2- 172.21.15.36:0/610172441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb948061320 0x7fb948143980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.191+0000 7fb94759e700 1 -- 172.21.15.36:0/610172441 >> 172.21.15.36:0/610172441 conn(0x7fb948066de0 msgr2=0x7fb948145810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:10.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.191+0000 7fb94759e700 1 -- 172.21.15.36:0/610172441 shutdown_connections 2022-01-10T01:30:10.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.191+0000 7fb94759e700 1 -- 172.21.15.36:0/610172441 wait complete. 2022-01-10T01:30:10.204 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:30:10.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.323+0000 7f38415a2700 1 Processor -- start 2022-01-10T01:30:10.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.323+0000 7f38415a2700 1 -- start start 2022-01-10T01:30:10.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f38415a2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f383c0b76b0 0x7f383c060a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f38415a2700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383c067050 con 0x7f383c0b27a0 2022-01-10T01:30:10.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f38415a2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383c061650 con 0x7f383c143270 2022-01-10T01:30:10.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f38415a2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383c0653b0 con 0x7f383c0b76b0 2022-01-10T01:30:10.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f38337fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f383c0b27a0 0x7f383c060f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35738/0 (socket says 172.21.15.36:35738) 2022-01-10T01:30:10.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f38337fe700 1 -- 172.21.15.36:0/2465423144 learned_addr learned my addr 172.21.15.36:0/2465423144 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:10.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383bfff700 1 --2- 172.21.15.36:0/2465423144 >> v2:172.21.15.59:3300/0 conn(0x7f383c0b76b0 0x7f383c060a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 -- 172.21.15.36:0/2465423144 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137540012 0 0) 0x7f383c067050 con 0x7f383c0b27a0 2022-01-10T01:30:10.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 -- 172.21.15.36:0/2465423144 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f381c003260 con 0x7f383c0b27a0 2022-01-10T01:30:10.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 -- 172.21.15.36:0/2465423144 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1600780514 0 0) 0x7f381c003260 con 0x7f383c0b27a0 2022-01-10T01:30:10.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 -- 172.21.15.36:0/2465423144 >> v2:172.21.15.59:3300/0 conn(0x7f383c0b76b0 msgr2=0x7f383c060a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:10.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 --2- 172.21.15.36:0/2465423144 >> v2:172.21.15.59:3300/0 conn(0x7f383c0b76b0 0x7f383c060a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 -- 172.21.15.36:0/2465423144 >> v1:172.21.15.59:6789/0 conn(0x7f383c143270 legacy=0x7f383c143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 -- 172.21.15.36:0/2465423144 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c0b7a90 con 0x7f383c0b27a0 2022-01-10T01:30:10.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 -- 172.21.15.36:0/2465423144 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f3824001660 con 0x7f383c0b27a0 2022-01-10T01:30:10.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 -- 172.21.15.36:0/2465423144 >> v1:172.21.15.36:6789/0 conn(0x7f383c0b27a0 legacy=0x7f383c060f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 --2- 172.21.15.36:0/2465423144 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f381c003750 0x7f381c003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 --2- 172.21.15.36:0/2465423144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381c004500 0x7f381c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 --2- 172.21.15.36:0/2465423144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f381c004e70 0x7f381c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 -- 172.21.15.36:0/2465423144 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c0653b0 con 0x7f381c003750 2022-01-10T01:30:10.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 -- 172.21.15.36:0/2465423144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c00bcc0 con 0x7f381c004e70 2022-01-10T01:30:10.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 -- 172.21.15.36:0/2465423144 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c00be80 con 0x7f381c004500 2022-01-10T01:30:10.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383bfff700 1 --2- 172.21.15.36:0/2465423144 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f381c003750 0x7f381c003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f38337fe700 1 --2- 172.21.15.36:0/2465423144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381c004500 0x7f381c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f3840da1700 1 --2- 172.21.15.36:0/2465423144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f381c004e70 0x7f381c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383bfff700 1 -- 172.21.15.36:0/2465423144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381c004500 msgr2=0x7f381c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:10.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383bfff700 1 --2- 172.21.15.36:0/2465423144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381c004500 0x7f381c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383bfff700 1 -- 172.21.15.36:0/2465423144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f381c004e70 msgr2=0x7f381c00b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:10.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383bfff700 1 --2- 172.21.15.36:0/2465423144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f381c004e70 0x7f381c00b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383bfff700 1 -- 172.21.15.36:0/2465423144 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c003260 con 0x7f381c003750 2022-01-10T01:30:10.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f3840da1700 1 --2- 172.21.15.36:0/2465423144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f381c004e70 0x7f381c00b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:30:10.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f3840da1700 1 -- 172.21.15.36:0/2465423144 reap_dead start 2022-01-10T01:30:10.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383bfff700 1 --2- 172.21.15.36:0/2465423144 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f381c003750 0x7f381c003b30 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f382c00c000 tx=0x7f382c006d90).ready entity=mon.0 client_cookie=6898e743fa8c5931 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:10.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 -- 172.21.15.36:0/2465423144 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f382c013450 con 0x7f381c003750 2022-01-10T01:30:10.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 -- 172.21.15.36:0/2465423144 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c0135b0 con 0x7f381c003750 2022-01-10T01:30:10.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f383b7fe700 1 -- 172.21.15.36:0/2465423144 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f382c013910 con 0x7f381c003750 2022-01-10T01:30:10.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f38415a2700 1 -- 172.21.15.36:0/2465423144 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f381c003750 msgr2=0x7f381c003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f38415a2700 1 --2- 172.21.15.36:0/2465423144 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f381c003750 0x7f381c003b30 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f382c00c000 tx=0x7f382c006d90).stop 2022-01-10T01:30:10.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f38415a2700 1 -- 172.21.15.36:0/2465423144 shutdown_connections 2022-01-10T01:30:10.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.327+0000 7f38415a2700 1 --2- 172.21.15.36:0/2465423144 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f381c003750 0x7f381c003b30 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f38415a2700 1 -- 172.21.15.36:0/2465423144 >> 172.21.15.36:0/2465423144 conn(0x7f383c05f6b0 msgr2=0x7f383c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:10.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f38415a2700 1 -- 172.21.15.36:0/2465423144 shutdown_connections 2022-01-10T01:30:10.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f38415a2700 1 -- 172.21.15.36:0/2465423144 wait complete. 2022-01-10T01:30:10.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f38415a2700 1 Processor -- start 2022-01-10T01:30:10.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f38415a2700 1 -- start start 2022-01-10T01:30:10.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f38415a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381c003750 0x7f383c144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f38415a2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f383c0ac5c0 0x7f383c0ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f38415a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f383c0ab820 0x7f383c15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f38415a2700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c0b0ce0 con 0x7f383c0ac5c0 2022-01-10T01:30:10.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f38415a2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c145030 con 0x7f383c0ab820 2022-01-10T01:30:10.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f38415a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383c0ad2a0 con 0x7f381c003750 2022-01-10T01:30:10.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f38337fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f383c0ac5c0 0x7f383c0ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f38337fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f383c0ac5c0 0x7f383c0ab330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37956/0 (socket says 172.21.15.36:37956) 2022-01-10T01:30:10.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f38337fe700 1 -- 172.21.15.36:0/3822466233 learned_addr learned my addr 172.21.15.36:0/3822466233 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:10.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f383bfff700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381c003750 0x7f383c144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.331+0000 7f3840da1700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f383c0ab820 0x7f383c15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f38337fe700 1 -- 172.21.15.36:0/3822466233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381c003750 msgr2=0x7f383c144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f38337fe700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381c003750 0x7f383c144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f38337fe700 1 -- 172.21.15.36:0/3822466233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f383c0ab820 msgr2=0x7f383c15a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f38337fe700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f383c0ab820 0x7f383c15a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f38337fe700 1 -- 172.21.15.36:0/3822466233 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c0b0f10 con 0x7f383c0ac5c0 2022-01-10T01:30:10.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f3840da1700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f383c0ab820 0x7f383c15a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:10.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f38337fe700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f383c0ac5c0 0x7f383c0ab330 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f3824001940 tx=0x7f383c067370).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:10.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f3839ffb700 1 -- 172.21.15.36:0/3822466233 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3824010640 con 0x7f383c0ac5c0 2022-01-10T01:30:10.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f3839ffb700 1 -- 172.21.15.36:0/3822466233 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38240107a0 con 0x7f383c0ac5c0 2022-01-10T01:30:10.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f38415a2700 1 -- 172.21.15.36:0/3822466233 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383c0ad540 con 0x7f383c0ac5c0 2022-01-10T01:30:10.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f3839ffb700 1 -- 172.21.15.36:0/3822466233 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3824010b00 con 0x7f383c0ac5c0 2022-01-10T01:30:10.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f38415a2700 1 -- 172.21.15.36:0/3822466233 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383c14a8c0 con 0x7f383c0ac5c0 2022-01-10T01:30:10.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f3839ffb700 1 -- 172.21.15.36:0/3822466233 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3824010c60 con 0x7f383c0ac5c0 2022-01-10T01:30:10.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f38415a2700 1 -- 172.21.15.36:0/3822466233 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383c0b10a0 con 0x7f383c0ac5c0 2022-01-10T01:30:10.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f3839ffb700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f38200536b0 0x7f3820055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f3839ffb700 1 -- 172.21.15.36:0/3822466233 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f382406c010 con 0x7f383c0ac5c0 2022-01-10T01:30:10.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f383bfff700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f38200536b0 0x7f3820055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.335+0000 7f383bfff700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f38200536b0 0x7f3820055b70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f382c01d000 tx=0x7f382c017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:10.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.343+0000 7f3839ffb700 1 -- 172.21.15.36:0/3822466233 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3824042f20 con 0x7f383c0ac5c0 2022-01-10T01:30:10.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.507+0000 7f38415a2700 1 -- 172.21.15.36:0/3822466233 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f383c057350 con 0x7f383c0ac5c0 2022-01-10T01:30:10.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.511+0000 7f3839ffb700 1 -- 172.21.15.36:0/3822466233 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3824046540 con 0x7f383c0ac5c0 2022-01-10T01:30:10.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.515+0000 7f38415a2700 1 -- 172.21.15.36:0/3822466233 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f38200536b0 msgr2=0x7f3820055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.515+0000 7f38415a2700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f38200536b0 0x7f3820055b70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f382c01d000 tx=0x7f382c017000).stop 2022-01-10T01:30:10.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.515+0000 7f38415a2700 1 -- 172.21.15.36:0/3822466233 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f383c0ac5c0 msgr2=0x7f383c0ab330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.515+0000 7f38415a2700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f383c0ac5c0 0x7f383c0ab330 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f3824001940 tx=0x7f383c067370).stop 2022-01-10T01:30:10.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.515+0000 7f38415a2700 1 -- 172.21.15.36:0/3822466233 shutdown_connections 2022-01-10T01:30:10.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.515+0000 7f38415a2700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f38200536b0 0x7f3820055b70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.515+0000 7f38415a2700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f383c0ab820 0x7f383c15a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.515+0000 7f38415a2700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f383c0ac5c0 0x7f383c0ab330 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.515+0000 7f38415a2700 1 --2- 172.21.15.36:0/3822466233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f381c003750 0x7f383c144970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.515+0000 7f38415a2700 1 -- 172.21.15.36:0/3822466233 >> 172.21.15.36:0/3822466233 conn(0x7f383c05f6b0 msgr2=0x7f383c0b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:10.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.515+0000 7f38415a2700 1 -- 172.21.15.36:0/3822466233 shutdown_connections 2022-01-10T01:30:10.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.515+0000 7f38415a2700 1 -- 172.21.15.36:0/3822466233 wait complete. 2022-01-10T01:30:10.519 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.0 2022-01-10T01:30:10.528 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:30:10.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.647+0000 7fcf509f5700 1 Processor -- start 2022-01-10T01:30:10.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.647+0000 7fcf509f5700 1 -- start start 2022-01-10T01:30:10.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.647+0000 7fcf509f5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fcf4c0b7370 0x7fcf4c0b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.647+0000 7fcf509f5700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4c0b2380 con 0x7fcf4c0b3060 2022-01-10T01:30:10.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.647+0000 7fcf509f5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4c144250 con 0x7fcf4c0aac20 2022-01-10T01:30:10.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.647+0000 7fcf509f5700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c0b3570 con 0x7fcf4c0b7370 2022-01-10T01:30:10.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.647+0000 7fcf4ad9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fcf4c0b7370 0x7fcf4c0b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.647+0000 7fcf4ad9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fcf4c0b7370 0x7fcf4c0b7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37962/0 (socket says 172.21.15.36:37962) 2022-01-10T01:30:10.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.647+0000 7fcf4ad9d700 1 -- 172.21.15.36:0/2295124808 learned_addr learned my addr 172.21.15.36:0/2295124808 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:10.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.647+0000 7fcf4ad9d700 1 -- 172.21.15.36:0/2295124808 >> v1:172.21.15.59:6789/0 conn(0x7fcf4c0aac20 legacy=0x7fcf4c064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:10.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.647+0000 7fcf4ad9d700 1 -- 172.21.15.36:0/2295124808 >> v1:172.21.15.36:6789/0 conn(0x7fcf4c0b3060 legacy=0x7fcf4c13e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.647+0000 7fcf4ad9d700 1 -- 172.21.15.36:0/2295124808 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c0b25b0 con 0x7fcf4c0b7370 2022-01-10T01:30:10.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.647+0000 7fcf4ad9d700 1 --2- 172.21.15.36:0/2295124808 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf4c0b7370 0x7fcf4c0b7750 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fcf4c0b4fa0 tx=0x7fcf3c006eb0).ready entity=mon.0 client_cookie=8a32b44ce4edde8f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:10.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf4a59c700 1 -- 172.21.15.36:0/2295124808 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf3c00d610 con 0x7fcf4c0b7370 2022-01-10T01:30:10.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf4a59c700 1 -- 172.21.15.36:0/2295124808 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c000e90 con 0x7fcf4c0b7370 2022-01-10T01:30:10.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf4a59c700 1 -- 172.21.15.36:0/2295124808 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf3c00d9a0 con 0x7fcf4c0b7370 2022-01-10T01:30:10.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 -- 172.21.15.36:0/2295124808 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf4c0b7370 msgr2=0x7fcf4c0b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 --2- 172.21.15.36:0/2295124808 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf4c0b7370 0x7fcf4c0b7750 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fcf4c0b4fa0 tx=0x7fcf3c006eb0).stop 2022-01-10T01:30:10.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 -- 172.21.15.36:0/2295124808 shutdown_connections 2022-01-10T01:30:10.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 --2- 172.21.15.36:0/2295124808 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf4c0b7370 0x7fcf4c0b7750 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 -- 172.21.15.36:0/2295124808 >> 172.21.15.36:0/2295124808 conn(0x7fcf4c05f6b0 msgr2=0x7fcf4c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:10.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 -- 172.21.15.36:0/2295124808 shutdown_connections 2022-01-10T01:30:10.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 -- 172.21.15.36:0/2295124808 wait complete. 2022-01-10T01:30:10.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 Processor -- start 2022-01-10T01:30:10.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 -- start start 2022-01-10T01:30:10.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4c0aac20 0x7fcf4c0b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4c0b3060 0x7fcf4c0adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf4c0b7370 0x7fcf4c0afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0b2e50 con 0x7fcf4c0b7370 2022-01-10T01:30:10.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0b09b0 con 0x7fcf4c0b3060 2022-01-10T01:30:10.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf509f5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c0ace10 con 0x7fcf4c0aac20 2022-01-10T01:30:10.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf4b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf4c0b7370 0x7fcf4c0afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf4b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf4c0b7370 0x7fcf4c0afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37972/0 (socket says 172.21.15.36:37972) 2022-01-10T01:30:10.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf4b59e700 1 -- 172.21.15.36:0/1010607000 learned_addr learned my addr 172.21.15.36:0/1010607000 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:10.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf4ad9d700 1 --2- 172.21.15.36:0/1010607000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4c0aac20 0x7fcf4c0b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf43fff700 1 --2- 172.21.15.36:0/1010607000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4c0b3060 0x7fcf4c0adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf4b59e700 1 -- 172.21.15.36:0/1010607000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4c0aac20 msgr2=0x7fcf4c0b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf4b59e700 1 --2- 172.21.15.36:0/1010607000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4c0aac20 0x7fcf4c0b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf4b59e700 1 -- 172.21.15.36:0/1010607000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4c0b3060 msgr2=0x7fcf4c0adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf4b59e700 1 --2- 172.21.15.36:0/1010607000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4c0b3060 0x7fcf4c0adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf4b59e700 1 -- 172.21.15.36:0/1010607000 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c00b1e0 con 0x7fcf4c0b7370 2022-01-10T01:30:10.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.651+0000 7fcf4b59e700 1 --2- 172.21.15.36:0/1010607000 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf4c0b7370 0x7fcf4c0afcd0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fcf44002320 tx=0x7fcf440023f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:10.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.655+0000 7fcf48d99700 1 -- 172.21.15.36:0/1010607000 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf44006aa0 con 0x7fcf4c0b7370 2022-01-10T01:30:10.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.655+0000 7fcf48d99700 1 -- 172.21.15.36:0/1010607000 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf44006c00 con 0x7fcf4c0b7370 2022-01-10T01:30:10.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.655+0000 7fcf509f5700 1 -- 172.21.15.36:0/1010607000 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c0ae460 con 0x7fcf4c0b7370 2022-01-10T01:30:10.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.655+0000 7fcf48d99700 1 -- 172.21.15.36:0/1010607000 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf44007030 con 0x7fcf4c0b7370 2022-01-10T01:30:10.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.655+0000 7fcf509f5700 1 -- 172.21.15.36:0/1010607000 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c0b0c30 con 0x7fcf4c0b7370 2022-01-10T01:30:10.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.655+0000 7fcf509f5700 1 -- 172.21.15.36:0/1010607000 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4c0b0df0 con 0x7fcf4c0b7370 2022-01-10T01:30:10.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.655+0000 7fcf48d99700 1 -- 172.21.15.36:0/1010607000 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fcf44010030 con 0x7fcf4c0b7370 2022-01-10T01:30:10.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.655+0000 7fcf48d99700 1 --2- 172.21.15.36:0/1010607000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf300535f0 0x7fcf30055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.655+0000 7fcf48d99700 1 -- 172.21.15.36:0/1010607000 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcf4406b990 con 0x7fcf4c0b7370 2022-01-10T01:30:10.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.655+0000 7fcf4ad9d700 1 --2- 172.21.15.36:0/1010607000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf300535f0 0x7fcf30055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.659+0000 7fcf4ad9d700 1 --2- 172.21.15.36:0/1010607000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf300535f0 0x7fcf30055ab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fcf3c01c000 tx=0x7fcf3c013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:10.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.663+0000 7fcf48d99700 1 -- 172.21.15.36:0/1010607000 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf440429a0 con 0x7fcf4c0b7370 2022-01-10T01:30:10.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.835+0000 7fcf509f5700 1 -- 172.21.15.36:0/1010607000 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fcf4c057350 con 0x7fcf4c0b7370 2022-01-10T01:30:10.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.843+0000 7fcf48d99700 1 -- 172.21.15.36:0/1010607000 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7fcf44045fc0 con 0x7fcf4c0b7370 2022-01-10T01:30:10.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.847+0000 7fcf509f5700 1 -- 172.21.15.36:0/1010607000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf300535f0 msgr2=0x7fcf30055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.847+0000 7fcf509f5700 1 --2- 172.21.15.36:0/1010607000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf300535f0 0x7fcf30055ab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fcf3c01c000 tx=0x7fcf3c013000).stop 2022-01-10T01:30:10.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.847+0000 7fcf509f5700 1 -- 172.21.15.36:0/1010607000 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf4c0b7370 msgr2=0x7fcf4c0afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.847+0000 7fcf509f5700 1 --2- 172.21.15.36:0/1010607000 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf4c0b7370 0x7fcf4c0afcd0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fcf44002320 tx=0x7fcf440023f0).stop 2022-01-10T01:30:10.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.847+0000 7fcf509f5700 1 -- 172.21.15.36:0/1010607000 shutdown_connections 2022-01-10T01:30:10.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.847+0000 7fcf509f5700 1 --2- 172.21.15.36:0/1010607000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf300535f0 0x7fcf30055ab0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.847+0000 7fcf509f5700 1 --2- 172.21.15.36:0/1010607000 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf4c0b7370 0x7fcf4c0afcd0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.847+0000 7fcf509f5700 1 --2- 172.21.15.36:0/1010607000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4c0b3060 0x7fcf4c0adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.847+0000 7fcf509f5700 1 --2- 172.21.15.36:0/1010607000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf4c0aac20 0x7fcf4c0b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.847+0000 7fcf509f5700 1 -- 172.21.15.36:0/1010607000 >> 172.21.15.36:0/1010607000 conn(0x7fcf4c05f6b0 msgr2=0x7fcf4c05cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:10.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.847+0000 7fcf509f5700 1 -- 172.21.15.36:0/1010607000 shutdown_connections 2022-01-10T01:30:10.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.847+0000 7fcf509f5700 1 -- 172.21.15.36:0/1010607000 wait complete. 2022-01-10T01:30:10.852 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.1 2022-01-10T01:30:10.862 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:30:10.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 Processor -- start 2022-01-10T01:30:10.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 -- start start 2022-01-10T01:30:10.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f78e40b1db0 0x7f78e40b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f78e40a70c0 0x7f78e4144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e40b0350 con 0x7f78e41483a0 2022-01-10T01:30:10.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e40a90c0 con 0x7f78e40b1db0 2022-01-10T01:30:10.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e40b05f0 con 0x7f78e40a70c0 2022-01-10T01:30:10.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78e9e39700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f78e40b1db0 0x7f78e40b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78e9e39700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f78e40b1db0 0x7f78e40b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37978/0 (socket says 172.21.15.36:37978) 2022-01-10T01:30:10.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78e9e39700 1 -- 172.21.15.36:0/2179973978 learned_addr learned my addr 172.21.15.36:0/2179973978 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:10.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ea63a700 1 --2- 172.21.15.36:0/2179973978 >> v2:172.21.15.59:3300/0 conn(0x7f78e40a70c0 0x7f78e4144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78e9e39700 1 -- 172.21.15.36:0/2179973978 >> v2:172.21.15.59:3300/0 conn(0x7f78e40a70c0 msgr2=0x7f78e4144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:10.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78e9e39700 1 --2- 172.21.15.36:0/2179973978 >> v2:172.21.15.59:3300/0 conn(0x7f78e40a70c0 0x7f78e4144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78e9e39700 1 -- 172.21.15.36:0/2179973978 >> v1:172.21.15.59:6789/0 conn(0x7f78e41483a0 legacy=0x7f78e40b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78e9e39700 1 -- 172.21.15.36:0/2179973978 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e40b0890 con 0x7f78e40b1db0 2022-01-10T01:30:10.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78e9e39700 1 --2- 172.21.15.36:0/2179973978 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78e40b1db0 0x7f78e40b0fd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f78e4147730 tx=0x7f78d4006eb0).ready entity=mon.0 client_cookie=e58a72b032b8f476 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:10.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78e8e37700 1 -- 172.21.15.36:0/2179973978 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d400d610 con 0x7f78e40b1db0 2022-01-10T01:30:10.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78e8e37700 1 -- 172.21.15.36:0/2179973978 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d4000e90 con 0x7f78e40b1db0 2022-01-10T01:30:10.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78e8e37700 1 -- 172.21.15.36:0/2179973978 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78d400d960 con 0x7f78e40b1db0 2022-01-10T01:30:10.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 -- 172.21.15.36:0/2179973978 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78e40b1db0 msgr2=0x7f78e40b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 --2- 172.21.15.36:0/2179973978 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78e40b1db0 0x7f78e40b0fd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f78e4147730 tx=0x7f78d4006eb0).stop 2022-01-10T01:30:10.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 -- 172.21.15.36:0/2179973978 shutdown_connections 2022-01-10T01:30:10.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 --2- 172.21.15.36:0/2179973978 >> v2:172.21.15.59:3300/0 conn(0x7f78e40a70c0 0x7f78e4144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 --2- 172.21.15.36:0/2179973978 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78e40b1db0 0x7f78e40b0fd0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 -- 172.21.15.36:0/2179973978 >> 172.21.15.36:0/2179973978 conn(0x7f78e405f6b0 msgr2=0x7f78e405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:10.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 -- 172.21.15.36:0/2179973978 shutdown_connections 2022-01-10T01:30:10.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.967+0000 7f78ec09d700 1 -- 172.21.15.36:0/2179973978 wait complete. 2022-01-10T01:30:10.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78ec09d700 1 Processor -- start 2022-01-10T01:30:10.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78ec09d700 1 -- start start 2022-01-10T01:30:10.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78ec09d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78e40a70c0 0x7f78e40ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78ec09d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78e40b1db0 0x7f78e414b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78ec09d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78e41483a0 0x7f78e41488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78ec09d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e40aa400 con 0x7f78e40b1db0 2022-01-10T01:30:10.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78ec09d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e41579a0 con 0x7f78e41483a0 2022-01-10T01:30:10.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78ec09d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e414a200 con 0x7f78e40a70c0 2022-01-10T01:30:10.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78e9638700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78e40b1db0 0x7f78e414b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78e9638700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78e40b1db0 0x7f78e414b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:37984/0 (socket says 172.21.15.36:37984) 2022-01-10T01:30:10.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78e9638700 1 -- 172.21.15.36:0/3627955545 learned_addr learned my addr 172.21.15.36:0/3627955545 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:10.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78e9e39700 1 --2- 172.21.15.36:0/3627955545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78e40a70c0 0x7f78e40ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78ea63a700 1 --2- 172.21.15.36:0/3627955545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78e41483a0 0x7f78e41488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78e9638700 1 -- 172.21.15.36:0/3627955545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78e40a70c0 msgr2=0x7f78e40ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78e9638700 1 --2- 172.21.15.36:0/3627955545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78e40a70c0 0x7f78e40ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78e9638700 1 -- 172.21.15.36:0/3627955545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78e41483a0 msgr2=0x7f78e41488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:10.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78e9638700 1 --2- 172.21.15.36:0/3627955545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78e41483a0 0x7f78e41488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:10.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78e9638700 1 -- 172.21.15.36:0/3627955545 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d400b1e0 con 0x7f78e40b1db0 2022-01-10T01:30:10.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78e9638700 1 --2- 172.21.15.36:0/3627955545 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78e40b1db0 0x7f78e414b100 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f78e40ace60 tx=0x7f78e0007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:10.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78d2ffd700 1 -- 172.21.15.36:0/3627955545 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e0007e40 con 0x7f78e40b1db0 2022-01-10T01:30:10.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78d2ffd700 1 -- 172.21.15.36:0/3627955545 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e0007030 con 0x7f78e40b1db0 2022-01-10T01:30:10.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78ec09d700 1 -- 172.21.15.36:0/3627955545 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e414a4a0 con 0x7f78e40b1db0 2022-01-10T01:30:10.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78d2ffd700 1 -- 172.21.15.36:0/3627955545 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78e0007390 con 0x7f78e40b1db0 2022-01-10T01:30:10.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.971+0000 7f78ec09d700 1 -- 172.21.15.36:0/3627955545 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e414b800 con 0x7f78e40b1db0 2022-01-10T01:30:10.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.975+0000 7f78ec09d700 1 -- 172.21.15.36:0/3627955545 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e40b0b30 con 0x7f78e40b1db0 2022-01-10T01:30:10.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.975+0000 7f78d2ffd700 1 -- 172.21.15.36:0/3627955545 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f78e0010030 con 0x7f78e40b1db0 2022-01-10T01:30:10.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.975+0000 7f78d2ffd700 1 --2- 172.21.15.36:0/3627955545 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f78c4053590 0x7f78c4055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:10.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.975+0000 7f78d2ffd700 1 -- 172.21.15.36:0/3627955545 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f78e006b460 con 0x7f78e40b1db0 2022-01-10T01:30:10.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.975+0000 7f78e9e39700 1 --2- 172.21.15.36:0/3627955545 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f78c4053590 0x7f78c4055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:10.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.975+0000 7f78e9e39700 1 --2- 172.21.15.36:0/3627955545 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f78c4053590 0x7f78c4055a50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f78d401c000 tx=0x7f78d4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:10.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:10.983+0000 7f78d2ffd700 1 -- 172.21.15.36:0/3627955545 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f78e0042410 con 0x7f78e40b1db0 2022-01-10T01:30:11.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.139+0000 7f78ec09d700 1 -- 172.21.15.36:0/3627955545 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78e4057350 con 0x7f78e40b1db0 2022-01-10T01:30:11.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.139+0000 7f78d2ffd700 1 -- 172.21.15.36:0/3627955545 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f78e0045a30 con 0x7f78e40b1db0 2022-01-10T01:30:11.141 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:11.142 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":34,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3321682930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3321682930},{"type":"v1","addr":"172.21.15.59:6833","nonce":3321682930}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/635174626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":635174626},{"type":"v1","addr":"172.21.15.36:6837","nonce":635174626}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:30:08.620792+0000","modified":"2022-01-10T01:30:09.623530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35654":{"gid":35654,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/452951292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":452951292},{"type":"v1","addr":"172.21.15.36:6835","nonce":452951292}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2022-01-10T01:30:11.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.143+0000 7f78ec09d700 1 -- 172.21.15.36:0/3627955545 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f78c4053590 msgr2=0x7f78c4055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:11.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.143+0000 7f78ec09d700 1 --2- 172.21.15.36:0/3627955545 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f78c4053590 0x7f78c4055a50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f78d401c000 tx=0x7f78d4015000).stop 2022-01-10T01:30:11.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.143+0000 7f78ec09d700 1 -- 172.21.15.36:0/3627955545 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78e40b1db0 msgr2=0x7f78e414b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:11.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.143+0000 7f78ec09d700 1 --2- 172.21.15.36:0/3627955545 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78e40b1db0 0x7f78e414b100 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f78e40ace60 tx=0x7f78e0007bd0).stop 2022-01-10T01:30:11.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.143+0000 7f78ec09d700 1 -- 172.21.15.36:0/3627955545 shutdown_connections 2022-01-10T01:30:11.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.143+0000 7f78ec09d700 1 --2- 172.21.15.36:0/3627955545 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f78c4053590 0x7f78c4055a50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.143+0000 7f78ec09d700 1 --2- 172.21.15.36:0/3627955545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78e41483a0 0x7f78e41488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.143+0000 7f78ec09d700 1 --2- 172.21.15.36:0/3627955545 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78e40b1db0 0x7f78e414b100 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.143+0000 7f78ec09d700 1 --2- 172.21.15.36:0/3627955545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78e40a70c0 0x7f78e40ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.143+0000 7f78ec09d700 1 -- 172.21.15.36:0/3627955545 >> 172.21.15.36:0/3627955545 conn(0x7f78e405f6b0 msgr2=0x7f78e41448c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:11.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.143+0000 7f78ec09d700 1 -- 172.21.15.36:0/3627955545 shutdown_connections 2022-01-10T01:30:11.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.143+0000 7f78ec09d700 1 -- 172.21.15.36:0/3627955545 wait complete. 2022-01-10T01:30:11.148 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 34 2022-01-10T01:30:11.462 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:30:08.620792+0000', 'modified': '2022-01-10T01:30:09.623530+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35654}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35654': {'gid': 35654, 'name': 'a', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6835/452951292', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6834', 'nonce': 452951292}, {'type': 'v1', 'addr': '172.21.15.36:6835', 'nonce': 452951292}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:30:11.463 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:30:11.463 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-10T01:30:11.582 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":35654,"want_state":"up:active","state":"up:active","rank_uptime":2.9459394510000001,"mdsmap_epoch":34,"osdmap_epoch":77,"osdmap_epoch_barrier":76,"uptime":7.2712428950000003} 2022-01-10T01:30:11.582 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 35654, "mdsmap_epoch": 34, "osdmap_epoch": 77, "osdmap_epoch_barrier": 76, "rank_uptime": 2.945939451, "state": "up:active", "uptime": 7.271242895, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:30:11.583 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:30:11.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96f59e700 1 Processor -- start 2022-01-10T01:30:11.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96f59e700 1 -- start start 2022-01-10T01:30:11.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96f59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff9700a8ac0 0x7ff970152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96f59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9700a70c0 con 0x7ff9700b0010 2022-01-10T01:30:11.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96f59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9700a72f0 con 0x7ff9700b2580 2022-01-10T01:30:11.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96f59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9700a7590 con 0x7ff9700a8ac0 2022-01-10T01:30:11.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96dd9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff9700b0010 0x7ff9700a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35784/0 (socket says 172.21.15.36:35784) 2022-01-10T01:30:11.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96dd9b700 1 -- 172.21.15.36:0/1615342078 learned_addr learned my addr 172.21.15.36:0/1615342078 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:11.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96ed9d700 1 --2- 172.21.15.36:0/1615342078 >> v2:172.21.15.59:3300/0 conn(0x7ff9700a8ac0 0x7ff970152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 -- 172.21.15.36:0/1615342078 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663756349 0 0) 0x7ff9700a70c0 con 0x7ff9700b0010 2022-01-10T01:30:11.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 -- 172.21.15.36:0/1615342078 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff954003260 con 0x7ff9700b0010 2022-01-10T01:30:11.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 -- 172.21.15.36:0/1615342078 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 342728042 0 0) 0x7ff954003260 con 0x7ff9700b0010 2022-01-10T01:30:11.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 -- 172.21.15.36:0/1615342078 >> v2:172.21.15.59:3300/0 conn(0x7ff9700a8ac0 msgr2=0x7ff970152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:11.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 --2- 172.21.15.36:0/1615342078 >> v2:172.21.15.59:3300/0 conn(0x7ff9700a8ac0 0x7ff970152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 -- 172.21.15.36:0/1615342078 >> v1:172.21.15.59:6789/0 conn(0x7ff9700b2580 legacy=0x7ff97014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:11.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 -- 172.21.15.36:0/1615342078 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9700a7830 con 0x7ff9700b0010 2022-01-10T01:30:11.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 -- 172.21.15.36:0/1615342078 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7ff9600019e0 con 0x7ff9700b0010 2022-01-10T01:30:11.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 -- 172.21.15.36:0/1615342078 >> v1:172.21.15.36:6789/0 conn(0x7ff9700b0010 legacy=0x7ff9700a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:11.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 --2- 172.21.15.36:0/1615342078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff954003750 0x7ff954003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 --2- 172.21.15.36:0/1615342078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff954004500 0x7ff954004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 --2- 172.21.15.36:0/1615342078 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff954004e70 0x7ff95400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 -- 172.21.15.36:0/1615342078 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700a7590 con 0x7ff954004e70 2022-01-10T01:30:11.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 -- 172.21.15.36:0/1615342078 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95400bd20 con 0x7ff954003750 2022-01-10T01:30:11.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.691+0000 7ff96d59a700 1 -- 172.21.15.36:0/1615342078 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95400bee0 con 0x7ff954004500 2022-01-10T01:30:11.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96e59c700 1 --2- 172.21.15.36:0/1615342078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff954003750 0x7ff954003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96ed9d700 1 --2- 172.21.15.36:0/1615342078 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff954004e70 0x7ff95400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96dd9b700 1 --2- 172.21.15.36:0/1615342078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff954004500 0x7ff954004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96ed9d700 1 -- 172.21.15.36:0/1615342078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff954004500 msgr2=0x7ff954004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:11.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96ed9d700 1 --2- 172.21.15.36:0/1615342078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff954004500 0x7ff954004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96ed9d700 1 -- 172.21.15.36:0/1615342078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff954003750 msgr2=0x7ff954003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:11.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96ed9d700 1 --2- 172.21.15.36:0/1615342078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff954003750 0x7ff954003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96ed9d700 1 -- 172.21.15.36:0/1615342078 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff954003260 con 0x7ff954004e70 2022-01-10T01:30:11.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96ed9d700 1 -- 172.21.15.36:0/1615342078 reap_dead start 2022-01-10T01:30:11.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96ed9d700 1 --2- 172.21.15.36:0/1615342078 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff954004e70 0x7ff95400b750 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7ff96800c000 tx=0x7ff968006df0).ready entity=mon.0 client_cookie=4b2b16d54724ec45 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:11.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96d59a700 1 -- 172.21.15.36:0/1615342078 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff968016070 con 0x7ff954004e70 2022-01-10T01:30:11.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96d59a700 1 -- 172.21.15.36:0/1615342078 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96800e5f0 con 0x7ff954004e70 2022-01-10T01:30:11.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96d59a700 1 -- 172.21.15.36:0/1615342078 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff96800e950 con 0x7ff954004e70 2022-01-10T01:30:11.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96f59e700 1 -- 172.21.15.36:0/1615342078 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff954004e70 msgr2=0x7ff95400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:11.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96f59e700 1 --2- 172.21.15.36:0/1615342078 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff954004e70 0x7ff95400b750 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7ff96800c000 tx=0x7ff968006df0).stop 2022-01-10T01:30:11.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96f59e700 1 -- 172.21.15.36:0/1615342078 shutdown_connections 2022-01-10T01:30:11.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96f59e700 1 --2- 172.21.15.36:0/1615342078 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff954004e70 0x7ff95400b750 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96f59e700 1 -- 172.21.15.36:0/1615342078 >> 172.21.15.36:0/1615342078 conn(0x7ff970060180 msgr2=0x7ff9700b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:11.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96f59e700 1 -- 172.21.15.36:0/1615342078 shutdown_connections 2022-01-10T01:30:11.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.695+0000 7ff96f59e700 1 -- 172.21.15.36:0/1615342078 wait complete. 2022-01-10T01:30:11.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96f59e700 1 Processor -- start 2022-01-10T01:30:11.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96f59e700 1 -- start start 2022-01-10T01:30:11.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96f59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff954004e70 0x7ff970148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9700abae0 0x7ff9700aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff970157000 0x7ff970153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96f59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700aa5c0 con 0x7ff954004e70 2022-01-10T01:30:11.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96f59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700ac060 con 0x7ff970157000 2022-01-10T01:30:11.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff970156620 con 0x7ff9700abae0 2022-01-10T01:30:11.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff954004e70 0x7ff970148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff954004e70 0x7ff970148d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38002/0 (socket says 172.21.15.36:38002) 2022-01-10T01:30:11.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96e59c700 1 -- 172.21.15.36:0/3798367207 learned_addr learned my addr 172.21.15.36:0/3798367207 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:11.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96ed9d700 1 --2- 172.21.15.36:0/3798367207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff970157000 0x7ff970153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96dd9b700 1 --2- 172.21.15.36:0/3798367207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9700abae0 0x7ff9700aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96e59c700 1 -- 172.21.15.36:0/3798367207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9700abae0 msgr2=0x7ff9700aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:11.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96e59c700 1 --2- 172.21.15.36:0/3798367207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9700abae0 0x7ff9700aa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96e59c700 1 -- 172.21.15.36:0/3798367207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff970157000 msgr2=0x7ff970153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:11.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96e59c700 1 --2- 172.21.15.36:0/3798367207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff970157000 0x7ff970153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96e59c700 1 -- 172.21.15.36:0/3798367207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9701568c0 con 0x7ff954004e70 2022-01-10T01:30:11.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96e59c700 1 --2- 172.21.15.36:0/3798367207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff954004e70 0x7ff970148d60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7ff96400d000 tx=0x7ff964007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:11.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff95f7fe700 1 -- 172.21.15.36:0/3798367207 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9640133f0 con 0x7ff954004e70 2022-01-10T01:30:11.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff95f7fe700 1 -- 172.21.15.36:0/3798367207 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff964013550 con 0x7ff954004e70 2022-01-10T01:30:11.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96f59e700 1 -- 172.21.15.36:0/3798367207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff970156b60 con 0x7ff954004e70 2022-01-10T01:30:11.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff95f7fe700 1 -- 172.21.15.36:0/3798367207 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9640138b0 con 0x7ff954004e70 2022-01-10T01:30:11.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.699+0000 7ff96f59e700 1 -- 172.21.15.36:0/3798367207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9700ac900 con 0x7ff954004e70 2022-01-10T01:30:11.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.703+0000 7ff96f59e700 1 -- 172.21.15.36:0/3798367207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff970057350 con 0x7ff954004e70 2022-01-10T01:30:11.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.703+0000 7ff95f7fe700 1 -- 172.21.15.36:0/3798367207 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff96401a030 con 0x7ff954004e70 2022-01-10T01:30:11.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.703+0000 7ff95f7fe700 1 --2- 172.21.15.36:0/3798367207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff94c0536b0 0x7ff94c055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.703+0000 7ff95f7fe700 1 -- 172.21.15.36:0/3798367207 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff96406b370 con 0x7ff954004e70 2022-01-10T01:30:11.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.703+0000 7ff96dd9b700 1 --2- 172.21.15.36:0/3798367207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff94c0536b0 0x7ff94c055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.703+0000 7ff96dd9b700 1 --2- 172.21.15.36:0/3798367207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff94c0536b0 0x7ff94c055b70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7ff960005000 tx=0x7ff9700a79c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:11.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.707+0000 7ff95f7fe700 1 -- 172.21.15.36:0/3798367207 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff964042430 con 0x7ff954004e70 2022-01-10T01:30:11.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.839+0000 7ff96f59e700 1 -- 172.21.15.36:0/3798367207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9700698e0 con 0x7ff954004e70 2022-01-10T01:30:11.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.843+0000 7ff95f7fe700 1 -- 172.21.15.36:0/3798367207 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16274 (secure 0 0 0) 0x7ff964025fb0 con 0x7ff954004e70 2022-01-10T01:30:11.844 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:11.844 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":77,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:30:09.624310+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:30:07.078168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2022-01-10T01:30:08.044365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:30:11.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.843+0000 7ff96f59e700 1 -- 172.21.15.36:0/3798367207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff94c0536b0 msgr2=0x7ff94c055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:11.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.843+0000 7ff96f59e700 1 --2- 172.21.15.36:0/3798367207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff94c0536b0 0x7ff94c055b70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7ff960005000 tx=0x7ff9700a79c0).stop 2022-01-10T01:30:11.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.843+0000 7ff96f59e700 1 -- 172.21.15.36:0/3798367207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff954004e70 msgr2=0x7ff970148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:11.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.843+0000 7ff96f59e700 1 --2- 172.21.15.36:0/3798367207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff954004e70 0x7ff970148d60 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7ff96400d000 tx=0x7ff964007a00).stop 2022-01-10T01:30:11.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.843+0000 7ff96f59e700 1 -- 172.21.15.36:0/3798367207 shutdown_connections 2022-01-10T01:30:11.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.843+0000 7ff96f59e700 1 --2- 172.21.15.36:0/3798367207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff94c0536b0 0x7ff94c055b70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.843+0000 7ff96f59e700 1 --2- 172.21.15.36:0/3798367207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff970157000 0x7ff970153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.843+0000 7ff96f59e700 1 --2- 172.21.15.36:0/3798367207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9700abae0 0x7ff9700aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.843+0000 7ff96f59e700 1 --2- 172.21.15.36:0/3798367207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff954004e70 0x7ff970148d60 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.843+0000 7ff96f59e700 1 -- 172.21.15.36:0/3798367207 >> 172.21.15.36:0/3798367207 conn(0x7ff970060180 msgr2=0x7ff97014a890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:11.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.843+0000 7ff96f59e700 1 -- 172.21.15.36:0/3798367207 shutdown_connections 2022-01-10T01:30:11.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.843+0000 7ff96f59e700 1 -- 172.21.15.36:0/3798367207 wait complete. 2022-01-10T01:30:11.857 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:30:07.078168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:30:08.044365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:30:11.858 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:30:11.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bf59e700 1 Processor -- start 2022-01-10T01:30:11.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bf59e700 1 -- start start 2022-01-10T01:30:11.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bf59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09c00b0710 0x7f09c0142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bf59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09c00ace70 0x7f09c013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bf59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c0143920 con 0x7f09c00b30d0 2022-01-10T01:30:11.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bf59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09c00b0af0 con 0x7f09c00ace70 2022-01-10T01:30:11.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bf59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00ae680 con 0x7f09c00b0710 2022-01-10T01:30:11.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bdd9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f09c00b30d0 0x7f09c0143210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35806/0 (socket says 172.21.15.36:35806) 2022-01-10T01:30:11.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bdd9b700 1 -- 172.21.15.36:0/1191165860 learned_addr learned my addr 172.21.15.36:0/1191165860 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:11.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bed9d700 1 --2- 172.21.15.36:0/1191165860 >> v2:172.21.15.59:3300/0 conn(0x7f09c00ace70 0x7f09c013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09be59c700 1 --2- 172.21.15.36:0/1191165860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09c00b0710 0x7f09c0142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 -- 172.21.15.36:0/1191165860 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629909932 0 0) 0x7f09c0143920 con 0x7f09c00b30d0 2022-01-10T01:30:11.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 -- 172.21.15.36:0/1191165860 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09a0003260 con 0x7f09c00b30d0 2022-01-10T01:30:11.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 -- 172.21.15.36:0/1191165860 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2509352994 0 0) 0x7f09a0003260 con 0x7f09c00b30d0 2022-01-10T01:30:11.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 -- 172.21.15.36:0/1191165860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09c00b0710 msgr2=0x7f09c0142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:11.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 --2- 172.21.15.36:0/1191165860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09c00b0710 0x7f09c0142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 -- 172.21.15.36:0/1191165860 >> v2:172.21.15.59:3300/0 conn(0x7f09c00ace70 msgr2=0x7f09c013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:11.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 --2- 172.21.15.36:0/1191165860 >> v2:172.21.15.59:3300/0 conn(0x7f09c00ace70 0x7f09c013f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 -- 172.21.15.36:0/1191165860 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c00ae920 con 0x7f09c00b30d0 2022-01-10T01:30:11.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 -- 172.21.15.36:0/1191165860 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f09b0001660 con 0x7f09c00b30d0 2022-01-10T01:30:11.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 -- 172.21.15.36:0/1191165860 >> v1:172.21.15.36:6789/0 conn(0x7f09c00b30d0 legacy=0x7f09c0143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:11.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 --2- 172.21.15.36:0/1191165860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a0003750 0x7f09a0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 --2- 172.21.15.36:0/1191165860 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09a0004500 0x7f09a0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 --2- 172.21.15.36:0/1191165860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09c00b0710 0x7f09a0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 -- 172.21.15.36:0/1191165860 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00b0af0 con 0x7f09a0004500 2022-01-10T01:30:11.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 -- 172.21.15.36:0/1191165860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c00ae680 con 0x7f09a0003750 2022-01-10T01:30:11.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bd59a700 1 -- 172.21.15.36:0/1191165860 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a000fb60 con 0x7f09c00b0710 2022-01-10T01:30:11.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bdd9b700 1 --2- 172.21.15.36:0/1191165860 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09a0004500 0x7f09a0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09be59c700 1 --2- 172.21.15.36:0/1191165860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a0003750 0x7f09a0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bed9d700 1 --2- 172.21.15.36:0/1191165860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09c00b0710 0x7f09a0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bdd9b700 1 -- 172.21.15.36:0/1191165860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09c00b0710 msgr2=0x7f09a0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:11.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bdd9b700 1 --2- 172.21.15.36:0/1191165860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09c00b0710 0x7f09a0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bdd9b700 1 -- 172.21.15.36:0/1191165860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a0003750 msgr2=0x7f09a0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:11.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bdd9b700 1 --2- 172.21.15.36:0/1191165860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a0003750 0x7f09a0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.971+0000 7f09bdd9b700 1 -- 172.21.15.36:0/1191165860 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0003260 con 0x7f09a0004500 2022-01-10T01:30:11.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.975+0000 7f09bdd9b700 1 --2- 172.21.15.36:0/1191165860 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09a0004500 0x7f09a0004980 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f09b0001370 tx=0x7f09c00ae5a0).ready entity=mon.0 client_cookie=ad33252bbcd0bfec server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:11.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.975+0000 7f09bd59a700 1 -- 172.21.15.36:0/1191165860 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09b00071a0 con 0x7f09a0004500 2022-01-10T01:30:11.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.975+0000 7f09bd59a700 1 -- 172.21.15.36:0/1191165860 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b0007300 con 0x7f09a0004500 2022-01-10T01:30:11.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.975+0000 7f09bd59a700 1 -- 172.21.15.36:0/1191165860 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09b000cbb0 con 0x7f09a0004500 2022-01-10T01:30:11.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.975+0000 7f09bf59e700 1 -- 172.21.15.36:0/1191165860 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09a0004500 msgr2=0x7f09a0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:11.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.975+0000 7f09bf59e700 1 --2- 172.21.15.36:0/1191165860 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09a0004500 0x7f09a0004980 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f09b0001370 tx=0x7f09c00ae5a0).stop 2022-01-10T01:30:11.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.975+0000 7f09bed9d700 1 -- 172.21.15.36:0/1191165860 reap_dead start 2022-01-10T01:30:11.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.975+0000 7f09bf59e700 1 -- 172.21.15.36:0/1191165860 shutdown_connections 2022-01-10T01:30:11.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.975+0000 7f09bf59e700 1 -- 172.21.15.36:0/1191165860 >> 172.21.15.36:0/1191165860 conn(0x7f09c0061140 msgr2=0x7f09c0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:11.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.975+0000 7f09bf59e700 1 -- 172.21.15.36:0/1191165860 shutdown_connections 2022-01-10T01:30:11.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.975+0000 7f09bf59e700 1 -- 172.21.15.36:0/1191165860 wait complete. 2022-01-10T01:30:11.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.975+0000 7f09bf59e700 1 Processor -- start 2022-01-10T01:30:11.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.975+0000 7f09bf59e700 1 -- start start 2022-01-10T01:30:11.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bf59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a0004500 0x7f09c00b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bf59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09c0065270 0x7f09c009e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bf59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09c009eda0 0x7f09c013db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bf59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c0066240 con 0x7f09c009eda0 2022-01-10T01:30:11.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bf59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c0066470 con 0x7f09a0004500 2022-01-10T01:30:11.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bf59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c0063ea0 con 0x7f09c0065270 2022-01-10T01:30:11.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bed9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09c009eda0 0x7f09c013db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bdd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09c0065270 0x7f09c009e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bed9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09c009eda0 0x7f09c013db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38026/0 (socket says 172.21.15.36:38026) 2022-01-10T01:30:11.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bed9d700 1 -- 172.21.15.36:0/260629998 learned_addr learned my addr 172.21.15.36:0/260629998 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:11.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09be59c700 1 --2- 172.21.15.36:0/260629998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a0004500 0x7f09c00b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bed9d700 1 -- 172.21.15.36:0/260629998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09c0065270 msgr2=0x7f09c009e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:11.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bed9d700 1 --2- 172.21.15.36:0/260629998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09c0065270 0x7f09c009e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bed9d700 1 -- 172.21.15.36:0/260629998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a0004500 msgr2=0x7f09c00b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:11.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bed9d700 1 --2- 172.21.15.36:0/260629998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a0004500 0x7f09c00b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:11.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bed9d700 1 -- 172.21.15.36:0/260629998 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c0064340 con 0x7f09c009eda0 2022-01-10T01:30:11.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bed9d700 1 --2- 172.21.15.36:0/260629998 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09c009eda0 0x7f09c013db20 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f09b800b000 tx=0x7f09b80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:11.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09b77fe700 1 -- 172.21.15.36:0/260629998 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09b8013750 con 0x7f09c009eda0 2022-01-10T01:30:11.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09b77fe700 1 -- 172.21.15.36:0/260629998 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b80138b0 con 0x7f09c009eda0 2022-01-10T01:30:11.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bf59e700 1 -- 172.21.15.36:0/260629998 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c0151750 con 0x7f09c009eda0 2022-01-10T01:30:11.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09b77fe700 1 -- 172.21.15.36:0/260629998 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09b8013a20 con 0x7f09c009eda0 2022-01-10T01:30:11.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.979+0000 7f09bf59e700 1 -- 172.21.15.36:0/260629998 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c0067c10 con 0x7f09c009eda0 2022-01-10T01:30:11.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.983+0000 7f09bf59e700 1 -- 172.21.15.36:0/260629998 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c0057350 con 0x7f09c009eda0 2022-01-10T01:30:11.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.983+0000 7f09b77fe700 1 -- 172.21.15.36:0/260629998 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f09b8013b80 con 0x7f09c009eda0 2022-01-10T01:30:11.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.983+0000 7f09b77fe700 1 --2- 172.21.15.36:0/260629998 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f09a40535f0 0x7f09a4055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:11.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.983+0000 7f09b77fe700 1 -- 172.21.15.36:0/260629998 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f09b806c160 con 0x7f09c009eda0 2022-01-10T01:30:11.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.983+0000 7f09be59c700 1 --2- 172.21.15.36:0/260629998 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f09a40535f0 0x7f09a4055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:11.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.983+0000 7f09be59c700 1 --2- 172.21.15.36:0/260629998 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f09a40535f0 0x7f09a4055ab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f09a800b000 tx=0x7f09a8006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:11.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:11.991+0000 7f09b77fe700 1 -- 172.21.15.36:0/260629998 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f09b8043060 con 0x7f09c009eda0 2022-01-10T01:30:12.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.119+0000 7f09bf59e700 1 -- 172.21.15.36:0/260629998 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f09c0064060 con 0x7f09c009eda0 2022-01-10T01:30:12.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.119+0000 7f09b77fe700 1 -- 172.21.15.36:0/260629998 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v77) v1 ==== 110+0+10 (secure 0 0 0) 0x7f09b80180b0 con 0x7f09c009eda0 2022-01-10T01:30:12.120 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:30:12.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.119+0000 7f09bf59e700 1 -- 172.21.15.36:0/260629998 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f09a40535f0 msgr2=0x7f09a4055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.119+0000 7f09bf59e700 1 --2- 172.21.15.36:0/260629998 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f09a40535f0 0x7f09a4055ab0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f09a800b000 tx=0x7f09a8006df0).stop 2022-01-10T01:30:12.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.119+0000 7f09bf59e700 1 -- 172.21.15.36:0/260629998 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09c009eda0 msgr2=0x7f09c013db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.119+0000 7f09bf59e700 1 --2- 172.21.15.36:0/260629998 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09c009eda0 0x7f09c013db20 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f09b800b000 tx=0x7f09b80091d0).stop 2022-01-10T01:30:12.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.119+0000 7f09bf59e700 1 -- 172.21.15.36:0/260629998 shutdown_connections 2022-01-10T01:30:12.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.119+0000 7f09bf59e700 1 --2- 172.21.15.36:0/260629998 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f09a40535f0 0x7f09a4055ab0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.119+0000 7f09bf59e700 1 --2- 172.21.15.36:0/260629998 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09c009eda0 0x7f09c013db20 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.119+0000 7f09bf59e700 1 --2- 172.21.15.36:0/260629998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09c0065270 0x7f09c009e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.119+0000 7f09bf59e700 1 --2- 172.21.15.36:0/260629998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09a0004500 0x7f09c00b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.119+0000 7f09bf59e700 1 -- 172.21.15.36:0/260629998 >> 172.21.15.36:0/260629998 conn(0x7f09c0061140 msgr2=0x7f09c0142010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:12.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.119+0000 7f09bf59e700 1 -- 172.21.15.36:0/260629998 shutdown_connections 2022-01-10T01:30:12.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.119+0000 7f09bf59e700 1 -- 172.21.15.36:0/260629998 wait complete. 2022-01-10T01:30:12.134 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:30:12.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.239+0000 7f00990ef700 1 Processor -- start 2022-01-10T01:30:12.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.239+0000 7f00990ef700 1 -- start start 2022-01-10T01:30:12.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f00990ef700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f009405fc00 0x7f00940b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f00990ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00940b5990 0x7f00940b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f00990ef700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0094143f60 con 0x7f00940b6560 2022-01-10T01:30:12.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f00990ef700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00940ba6b0 con 0x7f009405fc00 2022-01-10T01:30:12.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f00990ef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009405ffe0 con 0x7f00940b5990 2022-01-10T01:30:12.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f009259c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f00940b6560 0x7f00940b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35826/0 (socket says 172.21.15.36:35826) 2022-01-10T01:30:12.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f009259c700 1 -- 172.21.15.36:0/582548265 learned_addr learned my addr 172.21.15.36:0/582548265 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:12.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f0092d9d700 1 --2- 172.21.15.36:0/582548265 >> v2:172.21.15.36:3300/0 conn(0x7f009405fc00 0x7f00940b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f009359e700 1 --2- 172.21.15.36:0/582548265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00940b5990 0x7f00940b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f0091d9b700 1 -- 172.21.15.36:0/582548265 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174367218 0 0) 0x7f0094143f60 con 0x7f00940b6560 2022-01-10T01:30:12.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f0091d9b700 1 -- 172.21.15.36:0/582548265 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0078003260 con 0x7f00940b6560 2022-01-10T01:30:12.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f0092d9d700 1 -- 172.21.15.36:0/582548265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00940b5990 msgr2=0x7f00940b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:12.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f0092d9d700 1 --2- 172.21.15.36:0/582548265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00940b5990 0x7f00940b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f0092d9d700 1 -- 172.21.15.36:0/582548265 >> v1:172.21.15.36:6789/0 conn(0x7f00940b6560 legacy=0x7f00940b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f0092d9d700 1 -- 172.21.15.36:0/582548265 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0094143a50 con 0x7f009405fc00 2022-01-10T01:30:12.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f009359e700 1 --2- 172.21.15.36:0/582548265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00940b5990 0x7f00940b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:30:12.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f0092d9d700 1 --2- 172.21.15.36:0/582548265 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f009405fc00 0x7f00940b41b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f0088002f70 tx=0x7f0088006df0).ready entity=mon.0 client_cookie=ceecd80d8308c125 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:12.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f0091d9b700 1 -- 172.21.15.36:0/582548265 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f008800d4a0 con 0x7f009405fc00 2022-01-10T01:30:12.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f0091d9b700 1 -- 172.21.15.36:0/582548265 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0088000e90 con 0x7f009405fc00 2022-01-10T01:30:12.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f0091d9b700 1 -- 172.21.15.36:0/582548265 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f008800d7f0 con 0x7f009405fc00 2022-01-10T01:30:12.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f00990ef700 1 -- 172.21.15.36:0/582548265 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f009405fc00 msgr2=0x7f00940b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f00990ef700 1 --2- 172.21.15.36:0/582548265 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f009405fc00 0x7f00940b41b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f0088002f70 tx=0x7f0088006df0).stop 2022-01-10T01:30:12.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f00990ef700 1 -- 172.21.15.36:0/582548265 shutdown_connections 2022-01-10T01:30:12.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f00990ef700 1 --2- 172.21.15.36:0/582548265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00940b5990 0x7f00940b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f00990ef700 1 --2- 172.21.15.36:0/582548265 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f009405fc00 0x7f00940b41b0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f00990ef700 1 -- 172.21.15.36:0/582548265 >> 172.21.15.36:0/582548265 conn(0x7f00940623a0 msgr2=0x7f0094066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:12.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f00990ef700 1 -- 172.21.15.36:0/582548265 shutdown_connections 2022-01-10T01:30:12.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.243+0000 7f00990ef700 1 -- 172.21.15.36:0/582548265 wait complete. 2022-01-10T01:30:12.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f00990ef700 1 Processor -- start 2022-01-10T01:30:12.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f00990ef700 1 -- start start 2022-01-10T01:30:12.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f00990ef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f009405fc00 0x7f0094141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f00990ef700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00940b5990 0x7f0094155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f00990ef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00940b6560 0x7f00940ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f00990ef700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009412ca00 con 0x7f00940b5990 2022-01-10T01:30:12.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f00990ef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00940afc90 con 0x7f00940b6560 2022-01-10T01:30:12.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f00990ef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00941558b0 con 0x7f009405fc00 2022-01-10T01:30:12.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f009259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00940b5990 0x7f0094155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f009259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00940b5990 0x7f0094155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38038/0 (socket says 172.21.15.36:38038) 2022-01-10T01:30:12.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f009259c700 1 -- 172.21.15.36:0/4060908950 learned_addr learned my addr 172.21.15.36:0/4060908950 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:12.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f0092d9d700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f009405fc00 0x7f0094141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f009359e700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00940b6560 0x7f00940ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f009259c700 1 -- 172.21.15.36:0/4060908950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f009405fc00 msgr2=0x7f0094141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f009259c700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f009405fc00 0x7f0094141fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f009259c700 1 -- 172.21.15.36:0/4060908950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00940b6560 msgr2=0x7f00940ad620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f009259c700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00940b6560 0x7f00940ad620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f009259c700 1 -- 172.21.15.36:0/4060908950 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c009470 con 0x7f00940b5990 2022-01-10T01:30:12.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.247+0000 7f009359e700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00940b6560 0x7f00940ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:12.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.251+0000 7f009259c700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00940b5990 0x7f0094155ff0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f0084001110 tx=0x7f0084007ad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:12.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.251+0000 7f0083fff700 1 -- 172.21.15.36:0/4060908950 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00840070d0 con 0x7f00940b5990 2022-01-10T01:30:12.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.251+0000 7f00990ef700 1 -- 172.21.15.36:0/4060908950 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008800b180 con 0x7f00940b5990 2022-01-10T01:30:12.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.251+0000 7f0083fff700 1 -- 172.21.15.36:0/4060908950 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0084007230 con 0x7f00940b5990 2022-01-10T01:30:12.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.251+0000 7f00990ef700 1 -- 172.21.15.36:0/4060908950 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00941424d0 con 0x7f00940b5990 2022-01-10T01:30:12.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.251+0000 7f0083fff700 1 -- 172.21.15.36:0/4060908950 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00840073a0 con 0x7f00940b5990 2022-01-10T01:30:12.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.251+0000 7f00990ef700 1 -- 172.21.15.36:0/4060908950 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0094143cc0 con 0x7f00940b5990 2022-01-10T01:30:12.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.251+0000 7f0083fff700 1 -- 172.21.15.36:0/4060908950 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0084010070 con 0x7f00940b5990 2022-01-10T01:30:12.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.251+0000 7f0083fff700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0070053620 0x7f0070055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.251+0000 7f0083fff700 1 -- 172.21.15.36:0/4060908950 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f008406afd0 con 0x7f00940b5990 2022-01-10T01:30:12.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.251+0000 7f0092d9d700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0070053620 0x7f0070055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.251+0000 7f0092d9d700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0070053620 0x7f0070055ae0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f008801a000 tx=0x7f0088014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:12.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.259+0000 7f0083fff700 1 -- 172.21.15.36:0/4060908950 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0084041e80 con 0x7f00940b5990 2022-01-10T01:30:12.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.383+0000 7f00990ef700 1 -- 172.21.15.36:0/4060908950 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f00940afe50 con 0x7f00940b5990 2022-01-10T01:30:12.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.383+0000 7f0083fff700 1 -- 172.21.15.36:0/4060908950 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0084018070 con 0x7f00940b5990 2022-01-10T01:30:12.385 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:30:12.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.383+0000 7f00990ef700 1 -- 172.21.15.36:0/4060908950 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0070053620 msgr2=0x7f0070055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.383+0000 7f00990ef700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0070053620 0x7f0070055ae0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f008801a000 tx=0x7f0088014000).stop 2022-01-10T01:30:12.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.383+0000 7f00990ef700 1 -- 172.21.15.36:0/4060908950 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00940b5990 msgr2=0x7f0094155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.383+0000 7f00990ef700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00940b5990 0x7f0094155ff0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f0084001110 tx=0x7f0084007ad0).stop 2022-01-10T01:30:12.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.383+0000 7f00990ef700 1 -- 172.21.15.36:0/4060908950 shutdown_connections 2022-01-10T01:30:12.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.383+0000 7f00990ef700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0070053620 0x7f0070055ae0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.383+0000 7f00990ef700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00940b6560 0x7f00940ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.383+0000 7f00990ef700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00940b5990 0x7f0094155ff0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.383+0000 7f00990ef700 1 --2- 172.21.15.36:0/4060908950 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f009405fc00 0x7f0094141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.387+0000 7f00990ef700 1 -- 172.21.15.36:0/4060908950 >> 172.21.15.36:0/4060908950 conn(0x7f00940623a0 msgr2=0x7f0094149090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:12.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.387+0000 7f00990ef700 1 -- 172.21.15.36:0/4060908950 shutdown_connections 2022-01-10T01:30:12.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.387+0000 7f00990ef700 1 -- 172.21.15.36:0/4060908950 wait complete. 2022-01-10T01:30:12.398 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:30:12.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a18b29700 1 Processor -- start 2022-01-10T01:30:12.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a18b29700 1 -- start start 2022-01-10T01:30:12.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a18b29700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7a14061320 0x7f7a14061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a18b29700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a14140440 0x7f7a141408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a18b29700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a140aecf0 con 0x7f7a140ad5c0 2022-01-10T01:30:12.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a18b29700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a140b6f20 con 0x7f7a14061320 2022-01-10T01:30:12.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a18b29700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a140aef20 con 0x7f7a14140440 2022-01-10T01:30:12.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a137fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7a14061320 0x7f7a14061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a137fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7a14061320 0x7f7a14061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38044/0 (socket says 172.21.15.36:38044) 2022-01-10T01:30:12.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a12ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f7a140ad5c0 0x7f7a140b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35840/0 (socket says 172.21.15.36:35840) 2022-01-10T01:30:12.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a137fe700 1 -- 172.21.15.36:0/601377313 learned_addr learned my addr 172.21.15.36:0/601377313 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:12.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a13fff700 1 --2- 172.21.15.36:0/601377313 >> v2:172.21.15.59:3300/0 conn(0x7f7a14140440 0x7f7a141408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a137fe700 1 -- 172.21.15.36:0/601377313 >> v2:172.21.15.59:3300/0 conn(0x7f7a14140440 msgr2=0x7f7a141408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:12.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a137fe700 1 --2- 172.21.15.36:0/601377313 >> v2:172.21.15.59:3300/0 conn(0x7f7a14140440 0x7f7a141408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a137fe700 1 -- 172.21.15.36:0/601377313 >> v1:172.21.15.36:6789/0 conn(0x7f7a140ad5c0 legacy=0x7f7a140b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a137fe700 1 -- 172.21.15.36:0/601377313 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a140af1c0 con 0x7f7a14061320 2022-01-10T01:30:12.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a137fe700 1 --2- 172.21.15.36:0/601377313 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7a14061320 0x7f7a14061700 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f7a140aeba0 tx=0x7f79fc006eb0).ready entity=mon.0 client_cookie=cb0dce08426f0715 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:12.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a127fc700 1 -- 172.21.15.36:0/601377313 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79fc00d610 con 0x7f7a14061320 2022-01-10T01:30:12.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a127fc700 1 -- 172.21.15.36:0/601377313 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc000e90 con 0x7f7a14061320 2022-01-10T01:30:12.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.507+0000 7f7a127fc700 1 -- 172.21.15.36:0/601377313 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79fc00d960 con 0x7f7a14061320 2022-01-10T01:30:12.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.511+0000 7f7a18b29700 1 -- 172.21.15.36:0/601377313 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7a14061320 msgr2=0x7f7a14061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.511+0000 7f7a18b29700 1 --2- 172.21.15.36:0/601377313 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7a14061320 0x7f7a14061700 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f7a140aeba0 tx=0x7f79fc006eb0).stop 2022-01-10T01:30:12.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.511+0000 7f7a18b29700 1 -- 172.21.15.36:0/601377313 shutdown_connections 2022-01-10T01:30:12.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.511+0000 7f7a18b29700 1 --2- 172.21.15.36:0/601377313 >> v2:172.21.15.59:3300/0 conn(0x7f7a14140440 0x7f7a141408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.511+0000 7f7a18b29700 1 --2- 172.21.15.36:0/601377313 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7a14061320 0x7f7a14061700 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.511+0000 7f7a18b29700 1 -- 172.21.15.36:0/601377313 >> 172.21.15.36:0/601377313 conn(0x7f7a14066de0 msgr2=0x7f7a140671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:12.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.511+0000 7f7a18b29700 1 -- 172.21.15.36:0/601377313 shutdown_connections 2022-01-10T01:30:12.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.511+0000 7f7a18b29700 1 -- 172.21.15.36:0/601377313 wait complete. 2022-01-10T01:30:12.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.511+0000 7f7a18b29700 1 Processor -- start 2022-01-10T01:30:12.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.511+0000 7f7a18b29700 1 -- start start 2022-01-10T01:30:12.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.511+0000 7f7a18b29700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7a14061320 0x7f7a14152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.511+0000 7f7a18b29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a140ad5c0 0x7f7a141432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a18b29700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a14140440 0x7f7a141437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a18b29700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a14152c60 con 0x7f7a14061320 2022-01-10T01:30:12.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a18b29700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a14152e90 con 0x7f7a14140440 2022-01-10T01:30:12.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a18b29700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a14141ea0 con 0x7f7a140ad5c0 2022-01-10T01:30:12.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a137fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7a14061320 0x7f7a14152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a137fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7a14061320 0x7f7a14152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38050/0 (socket says 172.21.15.36:38050) 2022-01-10T01:30:12.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a137fe700 1 -- 172.21.15.36:0/2644753397 learned_addr learned my addr 172.21.15.36:0/2644753397 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:12.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a12ffd700 1 --2- 172.21.15.36:0/2644753397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a140ad5c0 0x7f7a141432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a13fff700 1 --2- 172.21.15.36:0/2644753397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a14140440 0x7f7a141437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a137fe700 1 -- 172.21.15.36:0/2644753397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a140ad5c0 msgr2=0x7f7a141432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a137fe700 1 --2- 172.21.15.36:0/2644753397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a140ad5c0 0x7f7a141432e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a137fe700 1 -- 172.21.15.36:0/2644753397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a14140440 msgr2=0x7f7a141437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a137fe700 1 --2- 172.21.15.36:0/2644753397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a14140440 0x7f7a141437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a137fe700 1 -- 172.21.15.36:0/2644753397 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc00b1e0 con 0x7f7a14061320 2022-01-10T01:30:12.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a137fe700 1 --2- 172.21.15.36:0/2644753397 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7a14061320 0x7f7a14152770 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f7a140aeba0 tx=0x7f79fc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:12.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a10ff9700 1 -- 172.21.15.36:0/2644753397 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79fc002f50 con 0x7f7a14061320 2022-01-10T01:30:12.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a10ff9700 1 -- 172.21.15.36:0/2644753397 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc00d990 con 0x7f7a14061320 2022-01-10T01:30:12.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a18b29700 1 -- 172.21.15.36:0/2644753397 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a14142140 con 0x7f7a14061320 2022-01-10T01:30:12.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a10ff9700 1 -- 172.21.15.36:0/2644753397 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79fc011d30 con 0x7f7a14061320 2022-01-10T01:30:12.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a18b29700 1 -- 172.21.15.36:0/2644753397 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a14143cc0 con 0x7f7a14061320 2022-01-10T01:30:12.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a18b29700 1 -- 172.21.15.36:0/2644753397 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a141415b0 con 0x7f7a14061320 2022-01-10T01:30:12.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.515+0000 7f7a10ff9700 1 -- 172.21.15.36:0/2644753397 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f79fc025030 con 0x7f7a14061320 2022-01-10T01:30:12.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.519+0000 7f7a10ff9700 1 --2- 172.21.15.36:0/2644753397 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79f8053560 0x7f79f8055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.519+0000 7f7a10ff9700 1 -- 172.21.15.36:0/2644753397 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f79fc06cd70 con 0x7f7a14061320 2022-01-10T01:30:12.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.519+0000 7f7a12ffd700 1 --2- 172.21.15.36:0/2644753397 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79f8053560 0x7f79f8055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.519+0000 7f7a12ffd700 1 --2- 172.21.15.36:0/2644753397 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79f8053560 0x7f79f8055a20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f7a0400d000 tx=0x7f7a04007b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:12.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.523+0000 7f7a10ff9700 1 -- 172.21.15.36:0/2644753397 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f79fc043c70 con 0x7f7a14061320 2022-01-10T01:30:12.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.651+0000 7f7a18b29700 1 -- 172.21.15.36:0/2644753397 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a140af460 con 0x7f7a14061320 2022-01-10T01:30:12.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.651+0000 7f7a10ff9700 1 -- 172.21.15.36:0/2644753397 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+10 (secure 0 0 0) 0x7f79fc0230a0 con 0x7f7a14061320 2022-01-10T01:30:12.653 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:30:12.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.655+0000 7f7a18b29700 1 -- 172.21.15.36:0/2644753397 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79f8053560 msgr2=0x7f79f8055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.655+0000 7f7a18b29700 1 --2- 172.21.15.36:0/2644753397 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79f8053560 0x7f79f8055a20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f7a0400d000 tx=0x7f7a04007b80).stop 2022-01-10T01:30:12.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.655+0000 7f7a18b29700 1 -- 172.21.15.36:0/2644753397 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7a14061320 msgr2=0x7f7a14152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.655+0000 7f7a18b29700 1 --2- 172.21.15.36:0/2644753397 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7a14061320 0x7f7a14152770 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f7a140aeba0 tx=0x7f79fc015000).stop 2022-01-10T01:30:12.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.655+0000 7f7a18b29700 1 -- 172.21.15.36:0/2644753397 shutdown_connections 2022-01-10T01:30:12.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.655+0000 7f7a18b29700 1 --2- 172.21.15.36:0/2644753397 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79f8053560 0x7f79f8055a20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.655+0000 7f7a18b29700 1 --2- 172.21.15.36:0/2644753397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a14140440 0x7f7a141437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.655+0000 7f7a18b29700 1 --2- 172.21.15.36:0/2644753397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a140ad5c0 0x7f7a141432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.655+0000 7f7a18b29700 1 --2- 172.21.15.36:0/2644753397 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7a14061320 0x7f7a14152770 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.655+0000 7f7a18b29700 1 -- 172.21.15.36:0/2644753397 >> 172.21.15.36:0/2644753397 conn(0x7f7a14066de0 msgr2=0x7f7a1405cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:12.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.655+0000 7f7a18b29700 1 -- 172.21.15.36:0/2644753397 shutdown_connections 2022-01-10T01:30:12.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.655+0000 7f7a18b29700 1 -- 172.21.15.36:0/2644753397 wait complete. 2022-01-10T01:30:12.666 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:30:12.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.779+0000 7f84c3441700 1 Processor -- start 2022-01-10T01:30:12.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.779+0000 7f84c3441700 1 -- start start 2022-01-10T01:30:12.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.779+0000 7f84c3441700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84bc0a9190 0x7f84bc146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.779+0000 7f84c3441700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f84bc0b03d0 0x7f84bc1401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.779+0000 7f84c3441700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc0b1140 con 0x7f84bc0b0b80 2022-01-10T01:30:12.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.779+0000 7f84c3441700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0a9570 con 0x7f84bc0b03d0 2022-01-10T01:30:12.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.779+0000 7f84c3441700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0b1370 con 0x7f84bc0a9190 2022-01-10T01:30:12.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.779+0000 7f84c2c40700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f84bc0b03d0 0x7f84bc1401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.779+0000 7f84c2c40700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f84bc0b03d0 0x7f84bc1401c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38062/0 (socket says 172.21.15.36:38062) 2022-01-10T01:30:12.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.779+0000 7f84c2c40700 1 -- 172.21.15.36:0/94309717 learned_addr learned my addr 172.21.15.36:0/94309717 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:12.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c243f700 1 --2- 172.21.15.36:0/94309717 >> v2:172.21.15.59:3300/0 conn(0x7f84bc0a9190 0x7f84bc146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c2c40700 1 -- 172.21.15.36:0/94309717 >> v2:172.21.15.59:3300/0 conn(0x7f84bc0a9190 msgr2=0x7f84bc146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:12.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c2c40700 1 --2- 172.21.15.36:0/94309717 >> v2:172.21.15.59:3300/0 conn(0x7f84bc0a9190 0x7f84bc146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c2c40700 1 -- 172.21.15.36:0/94309717 >> v1:172.21.15.59:6789/0 conn(0x7f84bc0b0b80 legacy=0x7f84bc146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:12.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c2c40700 1 -- 172.21.15.36:0/94309717 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0b1610 con 0x7f84bc0b03d0 2022-01-10T01:30:12.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c243f700 1 --2- 172.21.15.36:0/94309717 >> v2:172.21.15.59:3300/0 conn(0x7f84bc0a9190 0x7f84bc146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:12.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c2c40700 1 --2- 172.21.15.36:0/94309717 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84bc0b03d0 0x7f84bc1401c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f84bc0b6a40 tx=0x7f84ac006eb0).ready entity=mon.0 client_cookie=2979b746c5f8bbb8 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:12.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c143d700 1 -- 172.21.15.36:0/94309717 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84ac00d5c0 con 0x7f84bc0b03d0 2022-01-10T01:30:12.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c143d700 1 -- 172.21.15.36:0/94309717 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac000e90 con 0x7f84bc0b03d0 2022-01-10T01:30:12.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c143d700 1 -- 172.21.15.36:0/94309717 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84ac00d910 con 0x7f84bc0b03d0 2022-01-10T01:30:12.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 -- 172.21.15.36:0/94309717 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84bc0b03d0 msgr2=0x7f84bc1401c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 --2- 172.21.15.36:0/94309717 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84bc0b03d0 0x7f84bc1401c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f84bc0b6a40 tx=0x7f84ac006eb0).stop 2022-01-10T01:30:12.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 -- 172.21.15.36:0/94309717 shutdown_connections 2022-01-10T01:30:12.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 --2- 172.21.15.36:0/94309717 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84bc0b03d0 0x7f84bc1401c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 --2- 172.21.15.36:0/94309717 >> v2:172.21.15.59:3300/0 conn(0x7f84bc0a9190 0x7f84bc146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 -- 172.21.15.36:0/94309717 >> 172.21.15.36:0/94309717 conn(0x7f84bc061140 msgr2=0x7f84bc062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:12.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 -- 172.21.15.36:0/94309717 shutdown_connections 2022-01-10T01:30:12.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 -- 172.21.15.36:0/94309717 wait complete. 2022-01-10T01:30:12.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 Processor -- start 2022-01-10T01:30:12.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 -- start start 2022-01-10T01:30:12.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84bc0a9190 0x7f84bc0b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84bc0b03d0 0x7f84bc145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84bc0b0b80 0x7f84bc145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0ac110 con 0x7f84bc0b03d0 2022-01-10T01:30:12.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0b6730 con 0x7f84bc0b0b80 2022-01-10T01:30:12.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c3441700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0ac340 con 0x7f84bc0a9190 2022-01-10T01:30:12.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c1c3e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84bc0b03d0 0x7f84bc145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c243f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84bc0a9190 0x7f84bc0b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c2c40700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84bc0b0b80 0x7f84bc145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c1c3e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84bc0b03d0 0x7f84bc145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38068/0 (socket says 172.21.15.36:38068) 2022-01-10T01:30:12.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.783+0000 7f84c1c3e700 1 -- 172.21.15.36:0/3982393021 learned_addr learned my addr 172.21.15.36:0/3982393021 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:12.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84c2c40700 1 -- 172.21.15.36:0/3982393021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84bc0a9190 msgr2=0x7f84bc0b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84c2c40700 1 --2- 172.21.15.36:0/3982393021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84bc0a9190 0x7f84bc0b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84c2c40700 1 -- 172.21.15.36:0/3982393021 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84bc0b03d0 msgr2=0x7f84bc145310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84c2c40700 1 --2- 172.21.15.36:0/3982393021 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84bc0b03d0 0x7f84bc145310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84c2c40700 1 -- 172.21.15.36:0/3982393021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac00b1e0 con 0x7f84bc0b0b80 2022-01-10T01:30:12.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84c1c3e700 1 --2- 172.21.15.36:0/3982393021 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84bc0b03d0 0x7f84bc145310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:30:12.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84c2c40700 1 --2- 172.21.15.36:0/3982393021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84bc0b0b80 0x7f84bc145800 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f84bc0b6a00 tx=0x7f84ac015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:12.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84bb7fe700 1 -- 172.21.15.36:0/3982393021 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84ac011610 con 0x7f84bc0b0b80 2022-01-10T01:30:12.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84c3441700 1 -- 172.21.15.36:0/3982393021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc1462a0 con 0x7f84bc0b0b80 2022-01-10T01:30:12.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84bb7fe700 1 -- 172.21.15.36:0/3982393021 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac011770 con 0x7f84bc0b0b80 2022-01-10T01:30:12.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84c3441700 1 -- 172.21.15.36:0/3982393021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc0ac5e0 con 0x7f84bc0b0b80 2022-01-10T01:30:12.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84bb7fe700 1 -- 172.21.15.36:0/3982393021 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84ac011ad0 con 0x7f84bc0b0b80 2022-01-10T01:30:12.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84c3441700 1 -- 172.21.15.36:0/3982393021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc057350 con 0x7f84bc0b0b80 2022-01-10T01:30:12.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84bb7fe700 1 -- 172.21.15.36:0/3982393021 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f84ac01a040 con 0x7f84bc0b0b80 2022-01-10T01:30:12.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84bb7fe700 1 --2- 172.21.15.36:0/3982393021 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f849c053680 0x7f849c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:12.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84bb7fe700 1 -- 172.21.15.36:0/3982393021 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f84ac06c690 con 0x7f84bc0b0b80 2022-01-10T01:30:12.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.787+0000 7f84c243f700 1 --2- 172.21.15.36:0/3982393021 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f849c053680 0x7f849c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:12.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.791+0000 7f84c243f700 1 --2- 172.21.15.36:0/3982393021 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f849c053680 0x7f849c055b40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f84b400c000 tx=0x7f84b4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:12.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.799+0000 7f84bb7fe700 1 -- 172.21.15.36:0/3982393021 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f84ac0436b0 con 0x7f84bc0b0b80 2022-01-10T01:30:12.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.927+0000 7f84c3441700 1 -- 172.21.15.36:0/3982393021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f84bc0ab3f0 con 0x7f84bc0b0b80 2022-01-10T01:30:12.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.927+0000 7f84bb7fe700 1 -- 172.21.15.36:0/3982393021 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+10 (secure 0 0 0) 0x7f84ac023020 con 0x7f84bc0b0b80 2022-01-10T01:30:12.930 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:30:12.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.931+0000 7f84c3441700 1 -- 172.21.15.36:0/3982393021 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f849c053680 msgr2=0x7f849c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.931+0000 7f84c3441700 1 --2- 172.21.15.36:0/3982393021 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f849c053680 0x7f849c055b40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f84b400c000 tx=0x7f84b4008040).stop 2022-01-10T01:30:12.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.931+0000 7f84c3441700 1 -- 172.21.15.36:0/3982393021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84bc0b0b80 msgr2=0x7f84bc145800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:12.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.931+0000 7f84c3441700 1 --2- 172.21.15.36:0/3982393021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84bc0b0b80 0x7f84bc145800 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f84bc0b6a00 tx=0x7f84ac015000).stop 2022-01-10T01:30:12.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.931+0000 7f84c3441700 1 -- 172.21.15.36:0/3982393021 shutdown_connections 2022-01-10T01:30:12.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.931+0000 7f84c3441700 1 --2- 172.21.15.36:0/3982393021 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f849c053680 0x7f849c055b40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.931+0000 7f84c3441700 1 --2- 172.21.15.36:0/3982393021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84bc0b0b80 0x7f84bc145800 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.931+0000 7f84c3441700 1 --2- 172.21.15.36:0/3982393021 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84bc0b03d0 0x7f84bc145310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.931+0000 7f84c3441700 1 --2- 172.21.15.36:0/3982393021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84bc0a9190 0x7f84bc0b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:12.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.931+0000 7f84c3441700 1 -- 172.21.15.36:0/3982393021 >> 172.21.15.36:0/3982393021 conn(0x7f84bc061140 msgr2=0x7f84bc140ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:12.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.931+0000 7f84c3441700 1 -- 172.21.15.36:0/3982393021 shutdown_connections 2022-01-10T01:30:12.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:12.931+0000 7f84c3441700 1 -- 172.21.15.36:0/3982393021 wait complete. 2022-01-10T01:30:12.944 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:30:12.944 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:30:13.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f7219631700 1 Processor -- start 2022-01-10T01:30:13.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f7219631700 1 -- start start 2022-01-10T01:30:13.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f7219631700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f72140ad5c0 0x7f7214061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:13.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f7219631700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7214140440 0x7f72141408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:13.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f7219631700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72140aecf0 con 0x7f7214061320 2022-01-10T01:30:13.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f7219631700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72140b6f20 con 0x7f72140ad5c0 2022-01-10T01:30:13.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f7219631700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72140aef20 con 0x7f7214140440 2022-01-10T01:30:13.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f72137fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f72140ad5c0 0x7f7214061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:13.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f72137fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f72140ad5c0 0x7f7214061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38072/0 (socket says 172.21.15.36:38072) 2022-01-10T01:30:13.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f72137fe700 1 -- 172.21.15.36:0/3890365802 learned_addr learned my addr 172.21.15.36:0/3890365802 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:13.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f7218e30700 1 --2- 172.21.15.36:0/3890365802 >> v2:172.21.15.59:3300/0 conn(0x7f7214140440 0x7f72141408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:13.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f72137fe700 1 -- 172.21.15.36:0/3890365802 >> v2:172.21.15.59:3300/0 conn(0x7f7214140440 msgr2=0x7f72141408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:13.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f72137fe700 1 --2- 172.21.15.36:0/3890365802 >> v2:172.21.15.59:3300/0 conn(0x7f7214140440 0x7f72141408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:13.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f72137fe700 1 -- 172.21.15.36:0/3890365802 >> v1:172.21.15.59:6789/0 conn(0x7f7214061320 legacy=0x7f72140b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:13.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f72137fe700 1 -- 172.21.15.36:0/3890365802 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72140af1c0 con 0x7f72140ad5c0 2022-01-10T01:30:13.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f72137fe700 1 --2- 172.21.15.36:0/3890365802 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72140ad5c0 0x7f7214061700 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f72040032f0 tx=0x7f7204009290).ready entity=mon.0 client_cookie=80b19ce916a4e5e7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:13.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f7212ffd700 1 -- 172.21.15.36:0/3890365802 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f720400b870 con 0x7f72140ad5c0 2022-01-10T01:30:13.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f7212ffd700 1 -- 172.21.15.36:0/3890365802 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720400b9d0 con 0x7f72140ad5c0 2022-01-10T01:30:13.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.051+0000 7f7212ffd700 1 -- 172.21.15.36:0/3890365802 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f720400bb40 con 0x7f72140ad5c0 2022-01-10T01:30:13.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.055+0000 7f7219631700 1 -- 172.21.15.36:0/3890365802 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72140ad5c0 msgr2=0x7f7214061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:13.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.055+0000 7f7219631700 1 --2- 172.21.15.36:0/3890365802 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72140ad5c0 0x7f7214061700 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f72040032f0 tx=0x7f7204009290).stop 2022-01-10T01:30:13.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.055+0000 7f7219631700 1 -- 172.21.15.36:0/3890365802 shutdown_connections 2022-01-10T01:30:13.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.055+0000 7f7219631700 1 --2- 172.21.15.36:0/3890365802 >> v2:172.21.15.59:3300/0 conn(0x7f7214140440 0x7f72141408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:13.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.055+0000 7f7219631700 1 --2- 172.21.15.36:0/3890365802 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f72140ad5c0 0x7f7214061700 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:13.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.055+0000 7f7219631700 1 -- 172.21.15.36:0/3890365802 >> 172.21.15.36:0/3890365802 conn(0x7f7214066de0 msgr2=0x7f72140671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:13.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.055+0000 7f7219631700 1 -- 172.21.15.36:0/3890365802 shutdown_connections 2022-01-10T01:30:13.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.055+0000 7f7219631700 1 -- 172.21.15.36:0/3890365802 wait complete. 2022-01-10T01:30:13.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.055+0000 7f7219631700 1 Processor -- start 2022-01-10T01:30:13.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.055+0000 7f7219631700 1 -- start start 2022-01-10T01:30:13.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7219631700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7214061320 0x7f72141432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:13.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7219631700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72140ad5c0 0x7f72140ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:13.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7219631700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7214140440 0x7f72140ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:13.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7219631700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72140ac770 con 0x7f7214140440 2022-01-10T01:30:13.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7219631700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72140acc60 con 0x7f7214061320 2022-01-10T01:30:13.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7219631700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72140afab0 con 0x7f72140ad5c0 2022-01-10T01:30:13.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7218e30700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7214140440 0x7f72140ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:13.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7218e30700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7214140440 0x7f72140ab9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38082/0 (socket says 172.21.15.36:38082) 2022-01-10T01:30:13.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7213fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7214061320 0x7f72141432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:13.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7218e30700 1 -- 172.21.15.36:0/546164269 learned_addr learned my addr 172.21.15.36:0/546164269 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:13.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f72137fe700 1 --2- 172.21.15.36:0/546164269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72140ad5c0 0x7f72140ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:13.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7218e30700 1 -- 172.21.15.36:0/546164269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72140ad5c0 msgr2=0x7f72140ab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:13.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7218e30700 1 --2- 172.21.15.36:0/546164269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72140ad5c0 0x7f72140ab4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:13.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7218e30700 1 -- 172.21.15.36:0/546164269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7214061320 msgr2=0x7f72141432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:13.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7218e30700 1 --2- 172.21.15.36:0/546164269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7214061320 0x7f72141432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:13.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7218e30700 1 -- 172.21.15.36:0/546164269 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7204009530 con 0x7f7214140440 2022-01-10T01:30:13.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7218e30700 1 --2- 172.21.15.36:0/546164269 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7214140440 0x7f72140ab9a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f720c00c000 tx=0x7f720c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:13.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f72117fa700 1 -- 172.21.15.36:0/546164269 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f720c011750 con 0x7f7214140440 2022-01-10T01:30:13.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f72117fa700 1 -- 172.21.15.36:0/546164269 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c0118b0 con 0x7f7214140440 2022-01-10T01:30:13.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7219631700 1 -- 172.21.15.36:0/546164269 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72140b1d10 con 0x7f7214140440 2022-01-10T01:30:13.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f72117fa700 1 -- 172.21.15.36:0/546164269 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f720c011c10 con 0x7f7214140440 2022-01-10T01:30:13.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.059+0000 7f7219631700 1 -- 172.21.15.36:0/546164269 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72140ac3f0 con 0x7f7214140440 2022-01-10T01:30:13.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.063+0000 7f7219631700 1 -- 172.21.15.36:0/546164269 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72140afc70 con 0x7f7214140440 2022-01-10T01:30:13.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.063+0000 7f72117fa700 1 -- 172.21.15.36:0/546164269 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f720c011d70 con 0x7f7214140440 2022-01-10T01:30:13.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.063+0000 7f72117fa700 1 --2- 172.21.15.36:0/546164269 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71f40535f0 0x7f71f4055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:13.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.063+0000 7f72117fa700 1 -- 172.21.15.36:0/546164269 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f720c06bef0 con 0x7f7214140440 2022-01-10T01:30:13.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.063+0000 7f7213fff700 1 --2- 172.21.15.36:0/546164269 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71f40535f0 0x7f71f4055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:13.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.063+0000 7f7213fff700 1 --2- 172.21.15.36:0/546164269 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71f40535f0 0x7f71f4055ab0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f720800d000 tx=0x7f7208009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:13.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.067+0000 7f72117fa700 1 -- 172.21.15.36:0/546164269 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f720c042d90 con 0x7f7214140440 2022-01-10T01:30:13.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.231+0000 7f7219631700 1 -- 172.21.15.36:0/546164269 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72140af460 con 0x7f7214140440 2022-01-10T01:30:13.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.235+0000 7f72117fa700 1 -- 172.21.15.36:0/546164269 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f720c0463b0 con 0x7f7214140440 2022-01-10T01:30:13.236 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:13.236 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":34,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3321682930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3321682930},{"type":"v1","addr":"172.21.15.59:6833","nonce":3321682930}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/635174626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":635174626},{"type":"v1","addr":"172.21.15.36:6837","nonce":635174626}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:30:08.620792+0000","modified":"2022-01-10T01:30:09.623530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35654":{"gid":35654,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/452951292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":452951292},{"type":"v1","addr":"172.21.15.36:6835","nonce":452951292}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2022-01-10T01:30:13.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.235+0000 7f7219631700 1 -- 172.21.15.36:0/546164269 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71f40535f0 msgr2=0x7f71f4055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:13.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.235+0000 7f7219631700 1 --2- 172.21.15.36:0/546164269 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71f40535f0 0x7f71f4055ab0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f720800d000 tx=0x7f7208009040).stop 2022-01-10T01:30:13.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.235+0000 7f7219631700 1 -- 172.21.15.36:0/546164269 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7214140440 msgr2=0x7f72140ab9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:13.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.235+0000 7f7219631700 1 --2- 172.21.15.36:0/546164269 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7214140440 0x7f72140ab9a0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f720c00c000 tx=0x7f720c006df0).stop 2022-01-10T01:30:13.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.235+0000 7f7219631700 1 -- 172.21.15.36:0/546164269 shutdown_connections 2022-01-10T01:30:13.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.235+0000 7f7219631700 1 --2- 172.21.15.36:0/546164269 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71f40535f0 0x7f71f4055ab0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:13.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.235+0000 7f7219631700 1 --2- 172.21.15.36:0/546164269 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7214140440 0x7f72140ab9a0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:13.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.235+0000 7f7219631700 1 --2- 172.21.15.36:0/546164269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72140ad5c0 0x7f72140ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:13.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.235+0000 7f7219631700 1 --2- 172.21.15.36:0/546164269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7214061320 0x7f72141432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:13.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.235+0000 7f7219631700 1 -- 172.21.15.36:0/546164269 >> 172.21.15.36:0/546164269 conn(0x7f7214066de0 msgr2=0x7f7214144b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:13.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.235+0000 7f7219631700 1 -- 172.21.15.36:0/546164269 shutdown_connections 2022-01-10T01:30:13.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:13.235+0000 7f7219631700 1 -- 172.21.15.36:0/546164269 wait complete. 2022-01-10T01:30:13.241 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 34 2022-01-10T01:30:13.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:30:08.620792+0000', 'modified': '2022-01-10T01:30:09.623530+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35654}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35654': {'gid': 35654, 'name': 'a', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6835/452951292', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6834', 'nonce': 452951292}, {'type': 'v1', 'addr': '172.21.15.36:6835', 'nonce': 452951292}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:30:13.553 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:30:13.554 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-10T01:30:13.670 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":35654,"want_state":"up:active","state":"up:active","rank_uptime":5.0340772520000003,"mdsmap_epoch":34,"osdmap_epoch":77,"osdmap_epoch_barrier":76,"uptime":9.3593783699999999} 2022-01-10T01:30:13.671 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 35654, "mdsmap_epoch": 34, "osdmap_epoch": 77, "osdmap_epoch_barrier": 76, "rank_uptime": 5.034077252, "state": "up:active", "uptime": 9.35937837, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:30:13.671 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:30:13.672 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:30:13.672 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:30:13.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:13.673 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:30:13.681 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:30:13.696 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:30:13.696 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:30:13.708 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:30:13.709 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:30:13.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:13.711 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:30:13.757 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:30:13.758 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:30:13.760 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:30:13.777 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:30:13.778 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:30:13.834 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:30:13.835 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:30:13.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:13.837 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:30:13.838 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:30:13.836+0000 7fc90f057080 -1 init, newargv = 0x562eb2ad7a90 newargc=9 2022-01-10T01:30:13.838 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14606]: starting ceph client 2022-01-10T01:30:13.847 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14606]: starting fuse 2022-01-10T01:30:14.946 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:30:14.965 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:30:14.965 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:30:15.022 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:30:15.023 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:30:15.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:15.024 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:30:15.029 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:30:15.030 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:30:15.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:15.031 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:30:15.031 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:30:15.031 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:30:15.032 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:30:15.032 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:30:15.033 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:30:15.033 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:30:15.034 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:30:15.034 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:30:15.034 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:30:15.035 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:30:15.035 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:30:15.036 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:30:15.036 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:30:15.036 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:30:15.037 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:30:15.037 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:30:15.038 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:30:15.038 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:30:15.038 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:30:15.039 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:30:15.039 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:30:15.040 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:30:15.114 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.14606.asok 2022-01-10T01:30:15.119 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14606.asok 2022-01-10T01:30:15.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:15.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14606.asok status 2022-01-10T01:30:15.209 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:30:15.209 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:30:15.209 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:30:15.210 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:30:15.210 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:30:15.210 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:30:15.210 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:30:15.211 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "14606", 2022-01-10T01:30:15.211 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:30:15.211 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:30:15.211 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:30:15.212 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:30:15.212 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 6394, 2022-01-10T01:30:15.212 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:30:15.212 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:30:15.213 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:30:15.213 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 6394 2022-01-10T01:30:15.213 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:30:15.213 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:30:15.214 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:30:15.214 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:30:15.214 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 1396023791 2022-01-10T01:30:15.214 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:30:15.214 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:30:15.215 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:30:15.215 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:30:15.215 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:30:15.215 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 1396023791 2022-01-10T01:30:15.216 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:30:15.216 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.6394 172.21.15.139:0/1396023791", 2022-01-10T01:30:15.216 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/1396023791", 2022-01-10T01:30:15.216 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:30:15.217 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 34, 2022-01-10T01:30:15.217 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 77, 2022-01-10T01:30:15.217 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:30:15.217 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:30:15.217 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:30:15.218 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:30:15.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:15.219 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:30:15.220 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:30:15.226 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:30:15.228 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:30:15.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:15.229 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:30:15.246 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:30:15.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d730a700 1 Processor -- start 2022-01-10T01:30:15.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d730a700 1 -- start start 2022-01-10T01:30:15.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d730a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9d00b2580 0x7fc9d014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d730a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc9d00b0010 0x7fc9d014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d730a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9d00afbd0 0x7fc9d00a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d730a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d00a70c0 con 0x7fc9d00b0010 2022-01-10T01:30:15.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d730a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d00a72f0 con 0x7fc9d00afbd0 2022-01-10T01:30:15.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d730a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00a7590 con 0x7fc9d00b2580 2022-01-10T01:30:15.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d5b07700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc9d00b0010 0x7fc9d014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d5b07700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc9d00b0010 0x7fc9d014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38086/0 (socket says 172.21.15.36:38086) 2022-01-10T01:30:15.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d5b07700 1 -- 172.21.15.36:0/1707097083 learned_addr learned my addr 172.21.15.36:0/1707097083 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:15.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d6b09700 1 --2- 172.21.15.36:0/1707097083 >> v2:172.21.15.59:3300/0 conn(0x7fc9d00afbd0 0x7fc9d00a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d6308700 1 --2- 172.21.15.36:0/1707097083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9d00b2580 0x7fc9d014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d5b07700 1 -- 172.21.15.36:0/1707097083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9d00b2580 msgr2=0x7fc9d014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:15.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d5b07700 1 --2- 172.21.15.36:0/1707097083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9d00b2580 0x7fc9d014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d5b07700 1 -- 172.21.15.36:0/1707097083 >> v2:172.21.15.59:3300/0 conn(0x7fc9d00afbd0 msgr2=0x7fc9d00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:15.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d5b07700 1 --2- 172.21.15.36:0/1707097083 >> v2:172.21.15.59:3300/0 conn(0x7fc9d00afbd0 0x7fc9d00a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d5b07700 1 -- 172.21.15.36:0/1707097083 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d00a7830 con 0x7fc9d00b0010 2022-01-10T01:30:15.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d6b09700 1 --2- 172.21.15.36:0/1707097083 >> v2:172.21.15.59:3300/0 conn(0x7fc9d00afbd0 0x7fc9d00a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:30:15.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d6308700 1 --2- 172.21.15.36:0/1707097083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9d00b2580 0x7fc9d014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:30:15.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d5b07700 1 --2- 172.21.15.36:0/1707097083 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d00b0010 0x7fc9d014b330 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fc9cc0032f0 tx=0x7fc9cc009290).ready entity=mon.0 client_cookie=462169e4ded9d815 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:15.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d5306700 1 -- 172.21.15.36:0/1707097083 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9cc00b870 con 0x7fc9d00b0010 2022-01-10T01:30:15.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d5306700 1 -- 172.21.15.36:0/1707097083 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc00b9d0 con 0x7fc9d00b0010 2022-01-10T01:30:15.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.354+0000 7fc9d5306700 1 -- 172.21.15.36:0/1707097083 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9cc00bb40 con 0x7fc9d00b0010 2022-01-10T01:30:15.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 -- 172.21.15.36:0/1707097083 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d00b0010 msgr2=0x7fc9d014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 --2- 172.21.15.36:0/1707097083 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d00b0010 0x7fc9d014b330 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fc9cc0032f0 tx=0x7fc9cc009290).stop 2022-01-10T01:30:15.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 -- 172.21.15.36:0/1707097083 shutdown_connections 2022-01-10T01:30:15.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 --2- 172.21.15.36:0/1707097083 >> v2:172.21.15.59:3300/0 conn(0x7fc9d00afbd0 0x7fc9d00a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 --2- 172.21.15.36:0/1707097083 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d00b0010 0x7fc9d014b330 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 --2- 172.21.15.36:0/1707097083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9d00b2580 0x7fc9d014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 -- 172.21.15.36:0/1707097083 >> 172.21.15.36:0/1707097083 conn(0x7fc9d0060180 msgr2=0x7fc9d00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:15.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 -- 172.21.15.36:0/1707097083 shutdown_connections 2022-01-10T01:30:15.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 -- 172.21.15.36:0/1707097083 wait complete. 2022-01-10T01:30:15.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 Processor -- start 2022-01-10T01:30:15.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 -- start start 2022-01-10T01:30:15.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9d00afbd0 0x7fc9d00af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d00b0010 0x7fc9d00b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9d00b2580 0x7fc9d00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00b3500 con 0x7fc9d00b0010 2022-01-10T01:30:15.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00b3a30 con 0x7fc9d00afbd0 2022-01-10T01:30:15.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00b3260 con 0x7fc9d00b2580 2022-01-10T01:30:15.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d5b07700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d00b0010 0x7fc9d00b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d5b07700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d00b0010 0x7fc9d00b4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38092/0 (socket says 172.21.15.36:38092) 2022-01-10T01:30:15.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d5b07700 1 -- 172.21.15.36:0/2376744363 learned_addr learned my addr 172.21.15.36:0/2376744363 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:15.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d6308700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9d00afbd0 0x7fc9d00af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d6b09700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9d00b2580 0x7fc9d00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d5b07700 1 -- 172.21.15.36:0/2376744363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9d00b2580 msgr2=0x7fc9d00b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d5b07700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9d00b2580 0x7fc9d00b4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d5b07700 1 -- 172.21.15.36:0/2376744363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9d00afbd0 msgr2=0x7fc9d00af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d5b07700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9d00afbd0 0x7fc9d00af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d5b07700 1 -- 172.21.15.36:0/2376744363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc009530 con 0x7fc9d00b0010 2022-01-10T01:30:15.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d6308700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9d00afbd0 0x7fc9d00af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:15.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d5b07700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d00b0010 0x7fc9d00b4960 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fc9cc0032f0 tx=0x7fc9cc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:15.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9bf7fe700 1 -- 172.21.15.36:0/2376744363 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9cc00b870 con 0x7fc9d00b0010 2022-01-10T01:30:15.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9bf7fe700 1 -- 172.21.15.36:0/2376744363 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc021630 con 0x7fc9d00b0010 2022-01-10T01:30:15.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9bf7fe700 1 -- 172.21.15.36:0/2376744363 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9cc021990 con 0x7fc9d00b0010 2022-01-10T01:30:15.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 -- 172.21.15.36:0/2376744363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d00aa570 con 0x7fc9d00b0010 2022-01-10T01:30:15.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.358+0000 7fc9d730a700 1 -- 172.21.15.36:0/2376744363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d0143dd0 con 0x7fc9d00b0010 2022-01-10T01:30:15.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.362+0000 7fc9d730a700 1 -- 172.21.15.36:0/2376744363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d00b3460 con 0x7fc9d00b0010 2022-01-10T01:30:15.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.362+0000 7fc9bf7fe700 1 -- 172.21.15.36:0/2376744363 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc9cc027020 con 0x7fc9d00b0010 2022-01-10T01:30:15.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.362+0000 7fc9bf7fe700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9b00535f0 0x7fc9b0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.362+0000 7fc9bf7fe700 1 -- 172.21.15.36:0/2376744363 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc9cc06d020 con 0x7fc9d00b0010 2022-01-10T01:30:15.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.362+0000 7fc9d6308700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9b00535f0 0x7fc9b0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.362+0000 7fc9d6308700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9b00535f0 0x7fc9b0055ab0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fc9c000b000 tx=0x7fc9c0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:15.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.374+0000 7fc9bf7fe700 1 -- 172.21.15.36:0/2376744363 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc9cc044030 con 0x7fc9d00b0010 2022-01-10T01:30:15.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.506+0000 7fc9d730a700 1 -- 172.21.15.36:0/2376744363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9d0057350 con 0x7fc9d00b0010 2022-01-10T01:30:15.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.506+0000 7fc9bf7fe700 1 -- 172.21.15.36:0/2376744363 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16274 (secure 0 0 0) 0x7fc9cc015070 con 0x7fc9d00b0010 2022-01-10T01:30:15.509 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:15.510 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":77,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:30:09.624310+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:30:07.078168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2022-01-10T01:30:08.044365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:30:15.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.506+0000 7fc9d730a700 1 -- 172.21.15.36:0/2376744363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9b00535f0 msgr2=0x7fc9b0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.506+0000 7fc9d730a700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9b00535f0 0x7fc9b0055ab0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fc9c000b000 tx=0x7fc9c0008040).stop 2022-01-10T01:30:15.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.506+0000 7fc9d730a700 1 -- 172.21.15.36:0/2376744363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d00b0010 msgr2=0x7fc9d00b4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.506+0000 7fc9d730a700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d00b0010 0x7fc9d00b4960 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fc9cc0032f0 tx=0x7fc9cc016000).stop 2022-01-10T01:30:15.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.510+0000 7fc9d730a700 1 -- 172.21.15.36:0/2376744363 shutdown_connections 2022-01-10T01:30:15.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.510+0000 7fc9d730a700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9b00535f0 0x7fc9b0055ab0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.510+0000 7fc9d730a700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9d00b2580 0x7fc9d00b4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.510+0000 7fc9d730a700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d00b0010 0x7fc9d00b4960 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.510+0000 7fc9d730a700 1 --2- 172.21.15.36:0/2376744363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9d00afbd0 0x7fc9d00af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.510+0000 7fc9d730a700 1 -- 172.21.15.36:0/2376744363 >> 172.21.15.36:0/2376744363 conn(0x7fc9d0060180 msgr2=0x7fc9d01486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:15.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.510+0000 7fc9d730a700 1 -- 172.21.15.36:0/2376744363 shutdown_connections 2022-01-10T01:30:15.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.510+0000 7fc9d730a700 1 -- 172.21.15.36:0/2376744363 wait complete. 2022-01-10T01:30:15.527 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:30:07.078168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:30:08.044365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:30:15.529 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:30:15.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.634+0000 7f995a2b0700 1 Processor -- start 2022-01-10T01:30:15.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f995a2b0700 1 -- start start 2022-01-10T01:30:15.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f995a2b0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9954146950 0x7f9954140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f995a2b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99540b4690 0x7f99540b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f995a2b0700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9954143b60 con 0x7f99540b4180 2022-01-10T01:30:15.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f995a2b0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9954147510 con 0x7f9954146950 2022-01-10T01:30:15.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f995a2b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9954143e00 con 0x7f99540b4690 2022-01-10T01:30:15.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f99537fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f99540b4180 0x7f9954140720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35894/0 (socket says 172.21.15.36:35894) 2022-01-10T01:30:15.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f99537fe700 1 -- 172.21.15.36:0/2002976654 learned_addr learned my addr 172.21.15.36:0/2002976654 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:15.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f9953fff700 1 --2- 172.21.15.36:0/2002976654 >> v2:172.21.15.36:3300/0 conn(0x7f9954146950 0x7f9954140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f995884d700 1 --2- 172.21.15.36:0/2002976654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99540b4690 0x7f99540b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f9952ffd700 1 -- 172.21.15.36:0/2002976654 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752899444 0 0) 0x7f9954143b60 con 0x7f99540b4180 2022-01-10T01:30:15.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f9952ffd700 1 -- 172.21.15.36:0/2002976654 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9934003260 con 0x7f99540b4180 2022-01-10T01:30:15.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f9952ffd700 1 -- 172.21.15.36:0/2002976654 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2020355229 0 0) 0x7f9934003260 con 0x7f99540b4180 2022-01-10T01:30:15.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f9953fff700 1 -- 172.21.15.36:0/2002976654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99540b4690 msgr2=0x7f99540b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:15.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f9953fff700 1 --2- 172.21.15.36:0/2002976654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99540b4690 0x7f99540b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f9953fff700 1 -- 172.21.15.36:0/2002976654 >> v1:172.21.15.36:6789/0 conn(0x7f99540b4180 legacy=0x7f9954140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f9953fff700 1 -- 172.21.15.36:0/2002976654 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99540b0c90 con 0x7f9954146950 2022-01-10T01:30:15.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f9953fff700 1 --2- 172.21.15.36:0/2002976654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9954146950 0x7f9954140230 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f993c001800 tx=0x7f9944006df0).ready entity=mon.0 client_cookie=a9c108eb595fd1e4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:15.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f9952ffd700 1 -- 172.21.15.36:0/2002976654 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f993c001660 con 0x7f9954146950 2022-01-10T01:30:15.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f9952ffd700 1 -- 172.21.15.36:0/2002976654 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9944000e90 con 0x7f9954146950 2022-01-10T01:30:15.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f9952ffd700 1 -- 172.21.15.36:0/2002976654 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9944012460 con 0x7f9954146950 2022-01-10T01:30:15.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f995a2b0700 1 -- 172.21.15.36:0/2002976654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9954146950 msgr2=0x7f9954140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f995a2b0700 1 --2- 172.21.15.36:0/2002976654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9954146950 0x7f9954140230 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f993c001800 tx=0x7f9944006df0).stop 2022-01-10T01:30:15.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f995a2b0700 1 -- 172.21.15.36:0/2002976654 shutdown_connections 2022-01-10T01:30:15.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f995a2b0700 1 --2- 172.21.15.36:0/2002976654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99540b4690 0x7f99540b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f995a2b0700 1 --2- 172.21.15.36:0/2002976654 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9954146950 0x7f9954140230 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.638+0000 7f995a2b0700 1 -- 172.21.15.36:0/2002976654 >> 172.21.15.36:0/2002976654 conn(0x7f995405c490 msgr2=0x7f995405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:15.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f995a2b0700 1 -- 172.21.15.36:0/2002976654 shutdown_connections 2022-01-10T01:30:15.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f995a2b0700 1 -- 172.21.15.36:0/2002976654 wait complete. 2022-01-10T01:30:15.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f995a2b0700 1 Processor -- start 2022-01-10T01:30:15.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f995a2b0700 1 -- start start 2022-01-10T01:30:15.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f995a2b0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99540b4180 0x7f99540b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f995a2b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99540b4690 0x7f99541528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f995a2b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9954152410 0x7f9954152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f995a2b0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99540ba520 con 0x7f99540b4180 2022-01-10T01:30:15.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f995a2b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99540b7a10 con 0x7f9954152410 2022-01-10T01:30:15.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f995a2b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99540b7cb0 con 0x7f99540b4690 2022-01-10T01:30:15.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f9953fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99540b4180 0x7f99540b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f9953fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99540b4180 0x7f99540b83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38106/0 (socket says 172.21.15.36:38106) 2022-01-10T01:30:15.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f9953fff700 1 -- 172.21.15.36:0/1046073334 learned_addr learned my addr 172.21.15.36:0/1046073334 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:15.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f99537fe700 1 --2- 172.21.15.36:0/1046073334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99540b4690 0x7f99541528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f995884d700 1 --2- 172.21.15.36:0/1046073334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9954152410 0x7f9954152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f9953fff700 1 -- 172.21.15.36:0/1046073334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99540b4690 msgr2=0x7f99541528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f9953fff700 1 --2- 172.21.15.36:0/1046073334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99540b4690 0x7f99541528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f9953fff700 1 -- 172.21.15.36:0/1046073334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9954152410 msgr2=0x7f9954152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f9953fff700 1 --2- 172.21.15.36:0/1046073334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9954152410 0x7f9954152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f9953fff700 1 -- 172.21.15.36:0/1046073334 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994400b180 con 0x7f99540b4180 2022-01-10T01:30:15.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.642+0000 7f9953fff700 1 --2- 172.21.15.36:0/1046073334 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99540b4180 0x7f99540b83f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f993c001800 tx=0x7f9944014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:15.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.646+0000 7f99517fa700 1 -- 172.21.15.36:0/1046073334 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f994400d8d0 con 0x7f99540b4180 2022-01-10T01:30:15.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.646+0000 7f99517fa700 1 -- 172.21.15.36:0/1046073334 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994400da30 con 0x7f99540b4180 2022-01-10T01:30:15.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.646+0000 7f995a2b0700 1 -- 172.21.15.36:0/1046073334 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99540b7f50 con 0x7f99540b4180 2022-01-10T01:30:15.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.646+0000 7f99517fa700 1 -- 172.21.15.36:0/1046073334 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f994400dd90 con 0x7f99540b4180 2022-01-10T01:30:15.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.646+0000 7f995a2b0700 1 -- 172.21.15.36:0/1046073334 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9954145ed0 con 0x7f99540b4180 2022-01-10T01:30:15.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.646+0000 7f995a2b0700 1 -- 172.21.15.36:0/1046073334 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99540b80e0 con 0x7f99540b4180 2022-01-10T01:30:15.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.646+0000 7f99517fa700 1 -- 172.21.15.36:0/1046073334 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9944025030 con 0x7f99540b4180 2022-01-10T01:30:15.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.646+0000 7f99517fa700 1 --2- 172.21.15.36:0/1046073334 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9938053560 0x7f9938055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.646+0000 7f99517fa700 1 -- 172.21.15.36:0/1046073334 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f994406c530 con 0x7f99540b4180 2022-01-10T01:30:15.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.646+0000 7f99537fe700 1 --2- 172.21.15.36:0/1046073334 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9938053560 0x7f9938055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.646+0000 7f99537fe700 1 --2- 172.21.15.36:0/1046073334 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9938053560 0x7f9938055a20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f993c00d000 tx=0x7f993c001d80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:15.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.650+0000 7f99517fa700 1 -- 172.21.15.36:0/1046073334 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f99440434c0 con 0x7f99540b4180 2022-01-10T01:30:15.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.778+0000 7f995a2b0700 1 -- 172.21.15.36:0/1046073334 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9954057350 con 0x7f99540b4180 2022-01-10T01:30:15.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.778+0000 7f99517fa700 1 -- 172.21.15.36:0/1046073334 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v77) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9944023020 con 0x7f99540b4180 2022-01-10T01:30:15.781 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:30:15.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.778+0000 7f995a2b0700 1 -- 172.21.15.36:0/1046073334 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9938053560 msgr2=0x7f9938055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.778+0000 7f995a2b0700 1 --2- 172.21.15.36:0/1046073334 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9938053560 0x7f9938055a20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f993c00d000 tx=0x7f993c001d80).stop 2022-01-10T01:30:15.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.778+0000 7f995a2b0700 1 -- 172.21.15.36:0/1046073334 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99540b4180 msgr2=0x7f99540b83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.778+0000 7f995a2b0700 1 --2- 172.21.15.36:0/1046073334 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99540b4180 0x7f99540b83f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f993c001800 tx=0x7f9944014000).stop 2022-01-10T01:30:15.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.778+0000 7f995a2b0700 1 -- 172.21.15.36:0/1046073334 shutdown_connections 2022-01-10T01:30:15.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.778+0000 7f995a2b0700 1 --2- 172.21.15.36:0/1046073334 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9938053560 0x7f9938055a20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.778+0000 7f995a2b0700 1 --2- 172.21.15.36:0/1046073334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9954152410 0x7f9954152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.778+0000 7f995a2b0700 1 --2- 172.21.15.36:0/1046073334 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99540b4690 0x7f99541528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.782+0000 7f995a2b0700 1 --2- 172.21.15.36:0/1046073334 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f99540b4180 0x7f99540b83f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.782+0000 7f995a2b0700 1 -- 172.21.15.36:0/1046073334 >> 172.21.15.36:0/1046073334 conn(0x7f995405c490 msgr2=0x7f995413dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:15.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.782+0000 7f995a2b0700 1 -- 172.21.15.36:0/1046073334 shutdown_connections 2022-01-10T01:30:15.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.782+0000 7f995a2b0700 1 -- 172.21.15.36:0/1046073334 wait complete. 2022-01-10T01:30:15.794 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:30:15.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9869b27700 1 Processor -- start 2022-01-10T01:30:15.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9869b27700 1 -- start start 2022-01-10T01:30:15.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9869b27700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98640b54a0 0x7f98640af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9869b27700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f98641475a0 0x7f98640acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9869b27700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98641479f0 con 0x7f98640b0610 2022-01-10T01:30:15.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9869b27700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98641452e0 con 0x7f98641475a0 2022-01-10T01:30:15.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9869b27700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98640adff0 con 0x7f98640b54a0 2022-01-10T01:30:15.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9869326700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f98641475a0 0x7f98640acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9863fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f98640b0610 0x7f98640675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35908/0 (socket says 172.21.15.36:35908) 2022-01-10T01:30:15.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9869326700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f98641475a0 0x7f98640acc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38114/0 (socket says 172.21.15.36:38114) 2022-01-10T01:30:15.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9863fff700 1 -- 172.21.15.36:0/2225924901 learned_addr learned my addr 172.21.15.36:0/2225924901 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:15.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9868b25700 1 --2- 172.21.15.36:0/2225924901 >> v2:172.21.15.59:3300/0 conn(0x7f98640b54a0 0x7f98640af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9869326700 1 -- 172.21.15.36:0/2225924901 >> v2:172.21.15.59:3300/0 conn(0x7f98640b54a0 msgr2=0x7f98640af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:15.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9869326700 1 --2- 172.21.15.36:0/2225924901 >> v2:172.21.15.59:3300/0 conn(0x7f98640b54a0 0x7f98640af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9869326700 1 -- 172.21.15.36:0/2225924901 >> v1:172.21.15.36:6789/0 conn(0x7f98640b0610 legacy=0x7f98640675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9869326700 1 -- 172.21.15.36:0/2225924901 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98640b5880 con 0x7f98641475a0 2022-01-10T01:30:15.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9868b25700 1 --2- 172.21.15.36:0/2225924901 >> v2:172.21.15.59:3300/0 conn(0x7f98640b54a0 0x7f98640af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:30:15.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f9869326700 1 --2- 172.21.15.36:0/2225924901 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98641475a0 0x7f98640acc60 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f985c002f70 tx=0x7f985c006df0).ready entity=mon.0 client_cookie=8fc6b0f1bbfd1954 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:15.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f98637fe700 1 -- 172.21.15.36:0/2225924901 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f985c00d5c0 con 0x7f98641475a0 2022-01-10T01:30:15.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f98637fe700 1 -- 172.21.15.36:0/2225924901 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c000e90 con 0x7f98641475a0 2022-01-10T01:30:15.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.898+0000 7f98637fe700 1 -- 172.21.15.36:0/2225924901 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f985c00d910 con 0x7f98641475a0 2022-01-10T01:30:15.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 -- 172.21.15.36:0/2225924901 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98641475a0 msgr2=0x7f98640acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 --2- 172.21.15.36:0/2225924901 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98641475a0 0x7f98640acc60 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f985c002f70 tx=0x7f985c006df0).stop 2022-01-10T01:30:15.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 -- 172.21.15.36:0/2225924901 shutdown_connections 2022-01-10T01:30:15.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 --2- 172.21.15.36:0/2225924901 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98641475a0 0x7f98640acc60 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 --2- 172.21.15.36:0/2225924901 >> v2:172.21.15.59:3300/0 conn(0x7f98640b54a0 0x7f98640af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 -- 172.21.15.36:0/2225924901 >> 172.21.15.36:0/2225924901 conn(0x7f9864062560 msgr2=0x7f9864062940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:15.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 -- 172.21.15.36:0/2225924901 shutdown_connections 2022-01-10T01:30:15.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 -- 172.21.15.36:0/2225924901 wait complete. 2022-01-10T01:30:15.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 Processor -- start 2022-01-10T01:30:15.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 -- start start 2022-01-10T01:30:15.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98640b0610 0x7f9864145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98640b54a0 0x7f98640636a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98641475a0 0x7f9864063b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9864064080 con 0x7f98640b54a0 2022-01-10T01:30:15.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98640b4750 con 0x7f98640b0610 2022-01-10T01:30:15.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869b27700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98640659c0 con 0x7f98641475a0 2022-01-10T01:30:15.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9863fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98640b54a0 0x7f98640636a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9863fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98640b54a0 0x7f98640636a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38122/0 (socket says 172.21.15.36:38122) 2022-01-10T01:30:15.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9863fff700 1 -- 172.21.15.36:0/3153409034 learned_addr learned my addr 172.21.15.36:0/3153409034 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:15.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9868b25700 1 --2- 172.21.15.36:0/3153409034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98640b0610 0x7f9864145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9869326700 1 --2- 172.21.15.36:0/3153409034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98641475a0 0x7f9864063b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9863fff700 1 -- 172.21.15.36:0/3153409034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98641475a0 msgr2=0x7f9864063b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.902+0000 7f9863fff700 1 --2- 172.21.15.36:0/3153409034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98641475a0 0x7f9864063b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9863fff700 1 -- 172.21.15.36:0/3153409034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98640b0610 msgr2=0x7f9864145aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:15.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9863fff700 1 --2- 172.21.15.36:0/3153409034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98640b0610 0x7f9864145aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:15.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9863fff700 1 -- 172.21.15.36:0/3153409034 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c00b180 con 0x7f98640b54a0 2022-01-10T01:30:15.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9863fff700 1 --2- 172.21.15.36:0/3153409034 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98640b54a0 0x7f98640636a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f98640641c0 tx=0x7f9854007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:15.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9861ffb700 1 -- 172.21.15.36:0/3153409034 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9854005ba0 con 0x7f98640b54a0 2022-01-10T01:30:15.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9861ffb700 1 -- 172.21.15.36:0/3153409034 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9854005d00 con 0x7f98640b54a0 2022-01-10T01:30:15.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9869b27700 1 -- 172.21.15.36:0/3153409034 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98640b4980 con 0x7f98640b54a0 2022-01-10T01:30:15.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9861ffb700 1 -- 172.21.15.36:0/3153409034 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98540072c0 con 0x7f98640b54a0 2022-01-10T01:30:15.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9869b27700 1 -- 172.21.15.36:0/3153409034 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9864065e90 con 0x7f98640b54a0 2022-01-10T01:30:15.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9861ffb700 1 -- 172.21.15.36:0/3153409034 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9854010070 con 0x7f98640b54a0 2022-01-10T01:30:15.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9861ffb700 1 --2- 172.21.15.36:0/3153409034 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9844053560 0x7f9844055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:15.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9869b27700 1 -- 172.21.15.36:0/3153409034 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9864066050 con 0x7f98640b54a0 2022-01-10T01:30:15.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9868b25700 1 --2- 172.21.15.36:0/3153409034 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9844053560 0x7f9844055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:15.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9861ffb700 1 -- 172.21.15.36:0/3153409034 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f985406b310 con 0x7f98640b54a0 2022-01-10T01:30:15.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.906+0000 7f9868b25700 1 --2- 172.21.15.36:0/3153409034 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9844053560 0x7f9844055a20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f985800d000 tx=0x7f9858008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:15.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:15.914+0000 7f9861ffb700 1 -- 172.21.15.36:0/3153409034 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9854045d50 con 0x7f98640b54a0 2022-01-10T01:30:16.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.042+0000 7f9869b27700 1 -- 172.21.15.36:0/3153409034 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9864057350 con 0x7f98640b54a0 2022-01-10T01:30:16.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.042+0000 7f9861ffb700 1 -- 172.21.15.36:0/3153409034 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9854018020 con 0x7f98640b54a0 2022-01-10T01:30:16.046 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:30:16.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.046+0000 7f9869b27700 1 -- 172.21.15.36:0/3153409034 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9844053560 msgr2=0x7f9844055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.046+0000 7f9869b27700 1 --2- 172.21.15.36:0/3153409034 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9844053560 0x7f9844055a20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f985800d000 tx=0x7f9858008040).stop 2022-01-10T01:30:16.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.046+0000 7f9869b27700 1 -- 172.21.15.36:0/3153409034 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98640b54a0 msgr2=0x7f98640636a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.046+0000 7f9869b27700 1 --2- 172.21.15.36:0/3153409034 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98640b54a0 0x7f98640636a0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f98640641c0 tx=0x7f9854007f90).stop 2022-01-10T01:30:16.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.046+0000 7f9869b27700 1 -- 172.21.15.36:0/3153409034 shutdown_connections 2022-01-10T01:30:16.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.046+0000 7f9869b27700 1 --2- 172.21.15.36:0/3153409034 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9844053560 0x7f9844055a20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.046+0000 7f9869b27700 1 --2- 172.21.15.36:0/3153409034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f98641475a0 0x7f9864063b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.046+0000 7f9869b27700 1 --2- 172.21.15.36:0/3153409034 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f98640b54a0 0x7f98640636a0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.046+0000 7f9869b27700 1 --2- 172.21.15.36:0/3153409034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98640b0610 0x7f9864145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.046+0000 7f9869b27700 1 -- 172.21.15.36:0/3153409034 >> 172.21.15.36:0/3153409034 conn(0x7f9864062560 msgr2=0x7f98641445b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:16.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.046+0000 7f9869b27700 1 -- 172.21.15.36:0/3153409034 shutdown_connections 2022-01-10T01:30:16.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.046+0000 7f9869b27700 1 -- 172.21.15.36:0/3153409034 wait complete. 2022-01-10T01:30:16.058 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:30:16.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.166+0000 7fedb87a3700 1 Processor -- start 2022-01-10T01:30:16.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.166+0000 7fedb87a3700 1 -- start start 2022-01-10T01:30:16.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.166+0000 7fedb87a3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fedb00b2710 0x7fedb0143110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.166+0000 7fedb87a3700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb0064910 con 0x7fedb005ff60 2022-01-10T01:30:16.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.166+0000 7fedb87a3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb0064bb0 con 0x7fedb00611d0 2022-01-10T01:30:16.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.166+0000 7fedb87a3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb0064e50 con 0x7fedb00b2710 2022-01-10T01:30:16.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb653f700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fedb005ff60 0x7fedb0140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35922/0 (socket says 172.21.15.36:35922) 2022-01-10T01:30:16.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb653f700 1 -- 172.21.15.36:0/3033000180 learned_addr learned my addr 172.21.15.36:0/3033000180 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:16.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb5d3e700 1 --2- 172.21.15.36:0/3033000180 >> v2:172.21.15.59:3300/0 conn(0x7fedb00b2710 0x7fedb0143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 -- 172.21.15.36:0/3033000180 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470249070 0 0) 0x7fedb0064910 con 0x7fedb005ff60 2022-01-10T01:30:16.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 -- 172.21.15.36:0/3033000180 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed98003260 con 0x7fedb005ff60 2022-01-10T01:30:16.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 -- 172.21.15.36:0/3033000180 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2738749593 0 0) 0x7fed98003260 con 0x7fedb005ff60 2022-01-10T01:30:16.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 -- 172.21.15.36:0/3033000180 >> v2:172.21.15.59:3300/0 conn(0x7fedb00b2710 msgr2=0x7fedb0143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:16.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 --2- 172.21.15.36:0/3033000180 >> v2:172.21.15.59:3300/0 conn(0x7fedb00b2710 0x7fedb0143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 -- 172.21.15.36:0/3033000180 >> v1:172.21.15.59:6789/0 conn(0x7fedb00611d0 legacy=0x7fedb0143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 -- 172.21.15.36:0/3033000180 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb00650f0 con 0x7fedb005ff60 2022-01-10T01:30:16.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 -- 172.21.15.36:0/3033000180 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fedac001660 con 0x7fedb005ff60 2022-01-10T01:30:16.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb5d3e700 1 --2- 172.21.15.36:0/3033000180 >> v2:172.21.15.59:3300/0 conn(0x7fedb00b2710 0x7fedb0143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:30:16.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 -- 172.21.15.36:0/3033000180 >> v1:172.21.15.36:6789/0 conn(0x7fedb005ff60 legacy=0x7fedb0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 --2- 172.21.15.36:0/3033000180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed98003750 0x7fed98003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 --2- 172.21.15.36:0/3033000180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed98004500 0x7fed98004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 --2- 172.21.15.36:0/3033000180 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed98004e70 0x7fed9800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 -- 172.21.15.36:0/3033000180 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb0064e50 con 0x7fed98004e70 2022-01-10T01:30:16.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 -- 172.21.15.36:0/3033000180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9800bc70 con 0x7fed98003750 2022-01-10T01:30:16.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 -- 172.21.15.36:0/3033000180 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9800be30 con 0x7fed98004500 2022-01-10T01:30:16.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb6d40700 1 --2- 172.21.15.36:0/3033000180 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed98004e70 0x7fed9800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb653f700 1 --2- 172.21.15.36:0/3033000180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed98003750 0x7fed98003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb5d3e700 1 --2- 172.21.15.36:0/3033000180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed98004500 0x7fed98004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb6d40700 1 -- 172.21.15.36:0/3033000180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed98004500 msgr2=0x7fed98004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:16.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb6d40700 1 --2- 172.21.15.36:0/3033000180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed98004500 0x7fed98004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb6d40700 1 -- 172.21.15.36:0/3033000180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed98003750 msgr2=0x7fed98003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:16.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb6d40700 1 --2- 172.21.15.36:0/3033000180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed98003750 0x7fed98003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb6d40700 1 -- 172.21.15.36:0/3033000180 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed98003260 con 0x7fed98004e70 2022-01-10T01:30:16.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb5d3e700 1 --2- 172.21.15.36:0/3033000180 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed98004500 0x7fed98004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:30:16.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb6d40700 1 -- 172.21.15.36:0/3033000180 reap_dead start 2022-01-10T01:30:16.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb6d40700 1 --2- 172.21.15.36:0/3033000180 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed98004e70 0x7fed9800b750 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7feda80013a0 tx=0x7feda8007d60).ready entity=mon.0 client_cookie=9c406ddd22da8659 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:16.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 -- 172.21.15.36:0/3033000180 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feda80016c0 con 0x7fed98004e70 2022-01-10T01:30:16.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 -- 172.21.15.36:0/3033000180 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda8006890 con 0x7fed98004e70 2022-01-10T01:30:16.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb553d700 1 -- 172.21.15.36:0/3033000180 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feda8006bf0 con 0x7fed98004e70 2022-01-10T01:30:16.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb87a3700 1 -- 172.21.15.36:0/3033000180 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed98004e70 msgr2=0x7fed9800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb87a3700 1 --2- 172.21.15.36:0/3033000180 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed98004e70 0x7fed9800b750 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7feda80013a0 tx=0x7feda8007d60).stop 2022-01-10T01:30:16.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb87a3700 1 -- 172.21.15.36:0/3033000180 shutdown_connections 2022-01-10T01:30:16.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb87a3700 1 --2- 172.21.15.36:0/3033000180 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed98004e70 0x7fed9800b750 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb87a3700 1 -- 172.21.15.36:0/3033000180 >> 172.21.15.36:0/3033000180 conn(0x7fedb005cf60 msgr2=0x7fedb005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:16.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb87a3700 1 -- 172.21.15.36:0/3033000180 shutdown_connections 2022-01-10T01:30:16.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.170+0000 7fedb87a3700 1 -- 172.21.15.36:0/3033000180 wait complete. 2022-01-10T01:30:16.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb87a3700 1 Processor -- start 2022-01-10T01:30:16.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb87a3700 1 -- start start 2022-01-10T01:30:16.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb87a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed98004e70 0x7fedb00ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb87a3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedb00b1550 0x7fedb01436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb87a3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedb0143b90 0x7fedb00ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb87a3700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb0141180 con 0x7fedb0143b90 2022-01-10T01:30:16.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb87a3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb0155780 con 0x7fedb00b1550 2022-01-10T01:30:16.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb87a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb0155a20 con 0x7fed98004e70 2022-01-10T01:30:16.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb6d40700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedb0143b90 0x7fedb00ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb5d3e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedb00b1550 0x7fedb01436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb6d40700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedb0143b90 0x7fedb00ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38144/0 (socket says 172.21.15.36:38144) 2022-01-10T01:30:16.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb6d40700 1 -- 172.21.15.36:0/2662538959 learned_addr learned my addr 172.21.15.36:0/2662538959 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:16.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb653f700 1 --2- 172.21.15.36:0/2662538959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed98004e70 0x7fedb00ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb6d40700 1 -- 172.21.15.36:0/2662538959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed98004e70 msgr2=0x7fedb00ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb6d40700 1 --2- 172.21.15.36:0/2662538959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed98004e70 0x7fedb00ab460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb6d40700 1 -- 172.21.15.36:0/2662538959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedb00b1550 msgr2=0x7fedb01436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb6d40700 1 --2- 172.21.15.36:0/2662538959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedb00b1550 0x7fedb01436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb6d40700 1 -- 172.21.15.36:0/2662538959 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb0155cc0 con 0x7fedb0143b90 2022-01-10T01:30:16.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb5d3e700 1 --2- 172.21.15.36:0/2662538959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedb00b1550 0x7fedb01436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:30:16.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fedb6d40700 1 --2- 172.21.15.36:0/2662538959 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedb0143b90 0x7fedb00ac740 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7feda80013a0 tx=0x7feda8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:16.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fed9f7fe700 1 -- 172.21.15.36:0/2662538959 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feda80016c0 con 0x7fedb0143b90 2022-01-10T01:30:16.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fed9f7fe700 1 -- 172.21.15.36:0/2662538959 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda800ca10 con 0x7fedb0143b90 2022-01-10T01:30:16.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.174+0000 7fed9f7fe700 1 -- 172.21.15.36:0/2662538959 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feda8006ea0 con 0x7fedb0143b90 2022-01-10T01:30:16.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.178+0000 7fedb87a3700 1 -- 172.21.15.36:0/2662538959 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb0155f60 con 0x7fedb0143b90 2022-01-10T01:30:16.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.178+0000 7fedb87a3700 1 -- 172.21.15.36:0/2662538959 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb00ab950 con 0x7fedb0143b90 2022-01-10T01:30:16.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.178+0000 7fedb87a3700 1 -- 172.21.15.36:0/2662538959 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb01560f0 con 0x7fedb0143b90 2022-01-10T01:30:16.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.178+0000 7fed9f7fe700 1 -- 172.21.15.36:0/2662538959 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7feda8010070 con 0x7fedb0143b90 2022-01-10T01:30:16.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.178+0000 7fed9f7fe700 1 --2- 172.21.15.36:0/2662538959 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed900535f0 0x7fed90055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.178+0000 7fedb653f700 1 --2- 172.21.15.36:0/2662538959 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed900535f0 0x7fed90055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.178+0000 7fed9f7fe700 1 -- 172.21.15.36:0/2662538959 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7feda806ca50 con 0x7fedb0143b90 2022-01-10T01:30:16.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.182+0000 7fedb653f700 1 --2- 172.21.15.36:0/2662538959 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed900535f0 0x7fed90055ab0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fedac005000 tx=0x7fedac001e30).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:16.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.186+0000 7fed9f7fe700 1 -- 172.21.15.36:0/2662538959 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7feda8043a60 con 0x7fedb0143b90 2022-01-10T01:30:16.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.318+0000 7fedb87a3700 1 -- 172.21.15.36:0/2662538959 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fedb0060340 con 0x7fedb0143b90 2022-01-10T01:30:16.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.318+0000 7fed9f7fe700 1 -- 172.21.15.36:0/2662538959 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+10 (secure 0 0 0) 0x7feda8047080 con 0x7fedb0143b90 2022-01-10T01:30:16.321 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:30:16.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.318+0000 7fedb87a3700 1 -- 172.21.15.36:0/2662538959 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed900535f0 msgr2=0x7fed90055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.318+0000 7fedb87a3700 1 --2- 172.21.15.36:0/2662538959 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed900535f0 0x7fed90055ab0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fedac005000 tx=0x7fedac001e30).stop 2022-01-10T01:30:16.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.318+0000 7fedb87a3700 1 -- 172.21.15.36:0/2662538959 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedb0143b90 msgr2=0x7fedb00ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.318+0000 7fedb87a3700 1 --2- 172.21.15.36:0/2662538959 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedb0143b90 0x7fedb00ac740 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7feda80013a0 tx=0x7feda8015000).stop 2022-01-10T01:30:16.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.318+0000 7fedb87a3700 1 -- 172.21.15.36:0/2662538959 shutdown_connections 2022-01-10T01:30:16.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.318+0000 7fedb87a3700 1 --2- 172.21.15.36:0/2662538959 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed900535f0 0x7fed90055ab0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.318+0000 7fedb87a3700 1 --2- 172.21.15.36:0/2662538959 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fedb0143b90 0x7fedb00ac740 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.318+0000 7fedb87a3700 1 --2- 172.21.15.36:0/2662538959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedb00b1550 0x7fedb01436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.322+0000 7fedb87a3700 1 --2- 172.21.15.36:0/2662538959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed98004e70 0x7fedb00ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.322+0000 7fedb87a3700 1 -- 172.21.15.36:0/2662538959 >> 172.21.15.36:0/2662538959 conn(0x7fedb005cf60 msgr2=0x7fedb00b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:16.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.322+0000 7fedb87a3700 1 -- 172.21.15.36:0/2662538959 shutdown_connections 2022-01-10T01:30:16.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.322+0000 7fedb87a3700 1 -- 172.21.15.36:0/2662538959 wait complete. 2022-01-10T01:30:16.334 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:30:16.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.438+0000 7fd717348700 1 Processor -- start 2022-01-10T01:30:16.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.438+0000 7fd717348700 1 -- start start 2022-01-10T01:30:16.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.438+0000 7fd717348700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd710146950 0x7fd710140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.438+0000 7fd717348700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd7100b4690 0x7fd7100b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.438+0000 7fd717348700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd710143b60 con 0x7fd7100b4180 2022-01-10T01:30:16.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.438+0000 7fd717348700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd710147510 con 0x7fd7100b4690 2022-01-10T01:30:16.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.438+0000 7fd717348700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd710143e00 con 0x7fd710146950 2022-01-10T01:30:16.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.438+0000 7fd7158e5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd7100b4690 0x7fd7100b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.438+0000 7fd7148e3700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd7100b4180 0x7fd710140720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:35942/0 (socket says 172.21.15.36:35942) 2022-01-10T01:30:16.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.438+0000 7fd7148e3700 1 -- 172.21.15.36:0/2843647826 learned_addr learned my addr 172.21.15.36:0/2843647826 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:30:16.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd7150e4700 1 --2- 172.21.15.36:0/2843647826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd710146950 0x7fd710140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd7158e5700 1 -- 172.21.15.36:0/2843647826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd710146950 msgr2=0x7fd710140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:16.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd7158e5700 1 --2- 172.21.15.36:0/2843647826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd710146950 0x7fd710140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd7158e5700 1 -- 172.21.15.36:0/2843647826 >> v1:172.21.15.36:6789/0 conn(0x7fd7100b4180 legacy=0x7fd710140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd7158e5700 1 -- 172.21.15.36:0/2843647826 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7100b0c90 con 0x7fd7100b4690 2022-01-10T01:30:16.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd7158e5700 1 --2- 172.21.15.36:0/2843647826 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7100b4690 0x7fd7100b4ed0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fd7080032f0 tx=0x7fd7080091d0).ready entity=mon.0 client_cookie=743f10c25fd01f35 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:16.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd707fff700 1 -- 172.21.15.36:0/2843647826 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd708009ea0 con 0x7fd7100b4690 2022-01-10T01:30:16.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd707fff700 1 -- 172.21.15.36:0/2843647826 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70800b8a0 con 0x7fd7100b4690 2022-01-10T01:30:16.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd707fff700 1 -- 172.21.15.36:0/2843647826 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd70800ba10 con 0x7fd7100b4690 2022-01-10T01:30:16.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd717348700 1 -- 172.21.15.36:0/2843647826 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7100b4690 msgr2=0x7fd7100b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd717348700 1 --2- 172.21.15.36:0/2843647826 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7100b4690 0x7fd7100b4ed0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fd7080032f0 tx=0x7fd7080091d0).stop 2022-01-10T01:30:16.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd717348700 1 -- 172.21.15.36:0/2843647826 shutdown_connections 2022-01-10T01:30:16.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd717348700 1 --2- 172.21.15.36:0/2843647826 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7100b4690 0x7fd7100b4ed0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd717348700 1 --2- 172.21.15.36:0/2843647826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd710146950 0x7fd710140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd717348700 1 -- 172.21.15.36:0/2843647826 >> 172.21.15.36:0/2843647826 conn(0x7fd71005c490 msgr2=0x7fd71005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:16.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd717348700 1 -- 172.21.15.36:0/2843647826 shutdown_connections 2022-01-10T01:30:16.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd717348700 1 -- 172.21.15.36:0/2843647826 wait complete. 2022-01-10T01:30:16.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd717348700 1 Processor -- start 2022-01-10T01:30:16.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.442+0000 7fd717348700 1 -- start start 2022-01-10T01:30:16.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd717348700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7100b4180 0x7fd710145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd717348700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7100b4690 0x7fd7100adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd717348700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd710146950 0x7fd7100afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd717348700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7101559c0 con 0x7fd7100b4690 2022-01-10T01:30:16.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd717348700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd710155c60 con 0x7fd7100b4180 2022-01-10T01:30:16.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd717348700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd710155f00 con 0x7fd710146950 2022-01-10T01:30:16.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7148e3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7100b4690 0x7fd7100adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7150e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7100b4180 0x7fd710145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7158e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd710146950 0x7fd7100afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7148e3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7100b4690 0x7fd7100adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38156/0 (socket says 172.21.15.36:38156) 2022-01-10T01:30:16.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7150e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7100b4180 0x7fd710145c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:34788/0 (socket says 172.21.15.36:34788) 2022-01-10T01:30:16.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7148e3700 1 -- 172.21.15.36:0/2228946351 learned_addr learned my addr 172.21.15.36:0/2228946351 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:16.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7158e5700 1 -- 172.21.15.36:0/2228946351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7100b4180 msgr2=0x7fd710145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7158e5700 1 --2- 172.21.15.36:0/2228946351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7100b4180 0x7fd710145c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7158e5700 1 -- 172.21.15.36:0/2228946351 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7100b4690 msgr2=0x7fd7100adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7158e5700 1 --2- 172.21.15.36:0/2228946351 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7100b4690 0x7fd7100adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7158e5700 1 -- 172.21.15.36:0/2228946351 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd708009470 con 0x7fd710146950 2022-01-10T01:30:16.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7150e4700 1 --2- 172.21.15.36:0/2228946351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7100b4180 0x7fd710145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:30:16.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7158e5700 1 --2- 172.21.15.36:0/2228946351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd710146950 0x7fd7100afac0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd7080032f0 tx=0x7fd708016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:16.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7067fc700 1 -- 172.21.15.36:0/2228946351 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd708009ea0 con 0x7fd710146950 2022-01-10T01:30:16.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd717348700 1 -- 172.21.15.36:0/2228946351 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7101561a0 con 0x7fd710146950 2022-01-10T01:30:16.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7067fc700 1 -- 172.21.15.36:0/2228946351 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70800ba10 con 0x7fd710146950 2022-01-10T01:30:16.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd7067fc700 1 -- 172.21.15.36:0/2228946351 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd70801f5e0 con 0x7fd710146950 2022-01-10T01:30:16.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd717348700 1 -- 172.21.15.36:0/2228946351 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7100b8cc0 con 0x7fd710146950 2022-01-10T01:30:16.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.446+0000 7fd717348700 1 -- 172.21.15.36:0/2228946351 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7100ae1a0 con 0x7fd710146950 2022-01-10T01:30:16.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.450+0000 7fd7067fc700 1 -- 172.21.15.36:0/2228946351 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd70800f070 con 0x7fd710146950 2022-01-10T01:30:16.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.450+0000 7fd7067fc700 1 --2- 172.21.15.36:0/2228946351 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd6f80535f0 0x7fd6f8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.450+0000 7fd7067fc700 1 -- 172.21.15.36:0/2228946351 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd70806c310 con 0x7fd710146950 2022-01-10T01:30:16.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.450+0000 7fd7150e4700 1 --2- 172.21.15.36:0/2228946351 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd6f80535f0 0x7fd6f8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.450+0000 7fd7150e4700 1 --2- 172.21.15.36:0/2228946351 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd6f80535f0 0x7fd6f8055ab0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fd70000c000 tx=0x7fd700008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:16.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.458+0000 7fd7067fc700 1 -- 172.21.15.36:0/2228946351 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd708069e90 con 0x7fd710146950 2022-01-10T01:30:16.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.586+0000 7fd717348700 1 -- 172.21.15.36:0/2228946351 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd710057350 con 0x7fd710146950 2022-01-10T01:30:16.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.586+0000 7fd7067fc700 1 -- 172.21.15.36:0/2228946351 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd7080150a0 con 0x7fd710146950 2022-01-10T01:30:16.590 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:30:16.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.590+0000 7fd717348700 1 -- 172.21.15.36:0/2228946351 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd6f80535f0 msgr2=0x7fd6f8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.590+0000 7fd717348700 1 --2- 172.21.15.36:0/2228946351 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd6f80535f0 0x7fd6f8055ab0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fd70000c000 tx=0x7fd700008040).stop 2022-01-10T01:30:16.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.590+0000 7fd717348700 1 -- 172.21.15.36:0/2228946351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd710146950 msgr2=0x7fd7100afac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.590+0000 7fd717348700 1 --2- 172.21.15.36:0/2228946351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd710146950 0x7fd7100afac0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd7080032f0 tx=0x7fd708016000).stop 2022-01-10T01:30:16.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.590+0000 7fd717348700 1 -- 172.21.15.36:0/2228946351 shutdown_connections 2022-01-10T01:30:16.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.590+0000 7fd717348700 1 --2- 172.21.15.36:0/2228946351 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd6f80535f0 0x7fd6f8055ab0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.590+0000 7fd717348700 1 --2- 172.21.15.36:0/2228946351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd710146950 0x7fd7100afac0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.590+0000 7fd717348700 1 --2- 172.21.15.36:0/2228946351 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7100b4690 0x7fd7100adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.590+0000 7fd717348700 1 --2- 172.21.15.36:0/2228946351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7100b4180 0x7fd710145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.590+0000 7fd717348700 1 -- 172.21.15.36:0/2228946351 >> 172.21.15.36:0/2228946351 conn(0x7fd71005c490 msgr2=0x7fd710140000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:16.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.590+0000 7fd717348700 1 -- 172.21.15.36:0/2228946351 shutdown_connections 2022-01-10T01:30:16.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.590+0000 7fd717348700 1 -- 172.21.15.36:0/2228946351 wait complete. 2022-01-10T01:30:16.603 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:30:16.604 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:30:16.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f7093341700 1 Processor -- start 2022-01-10T01:30:16.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f7093341700 1 -- start start 2022-01-10T01:30:16.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f7093341700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708c0a9eb0 0x7f708c0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f7093341700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f708c0b3130 0x7f708c0af070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f7093341700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f708c14b560 0x7f708c05f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f7093341700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708c0ae300 con 0x7f708c14b560 2022-01-10T01:30:16.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f7093341700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708c0aa290 con 0x7f708c0b3130 2022-01-10T01:30:16.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f7093341700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708c0af560 con 0x7f708c0a9eb0 2022-01-10T01:30:16.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f70918de700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f708c14b560 0x7f708c05f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f70918de700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f708c14b560 0x7f708c05f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38166/0 (socket says 172.21.15.36:38166) 2022-01-10T01:30:16.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f70908dc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f708c0b3130 0x7f708c0af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f70918de700 1 -- 172.21.15.36:0/1488868721 learned_addr learned my addr 172.21.15.36:0/1488868721 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:16.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f70910dd700 1 --2- 172.21.15.36:0/1488868721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708c0a9eb0 0x7f708c0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f70918de700 1 -- 172.21.15.36:0/1488868721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708c0a9eb0 msgr2=0x7f708c0b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:16.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f70918de700 1 --2- 172.21.15.36:0/1488868721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708c0a9eb0 0x7f708c0b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f70918de700 1 -- 172.21.15.36:0/1488868721 >> v2:172.21.15.59:3300/0 conn(0x7f708c0b3130 msgr2=0x7f708c0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:16.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f70918de700 1 --2- 172.21.15.36:0/1488868721 >> v2:172.21.15.59:3300/0 conn(0x7f708c0b3130 0x7f708c0af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f70918de700 1 -- 172.21.15.36:0/1488868721 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c148170 con 0x7f708c14b560 2022-01-10T01:30:16.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f70908dc700 1 --2- 172.21.15.36:0/1488868721 >> v2:172.21.15.59:3300/0 conn(0x7f708c0b3130 0x7f708c0af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:30:16.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f70910dd700 1 --2- 172.21.15.36:0/1488868721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708c0a9eb0 0x7f708c0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:30:16.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f70918de700 1 --2- 172.21.15.36:0/1488868721 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f708c14b560 0x7f708c05f6b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f707c002f70 tx=0x7f707c006eb0).ready entity=mon.0 client_cookie=f6e9d8200934a8a8 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:16.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f7083fff700 1 -- 172.21.15.36:0/1488868721 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f707c00d570 con 0x7f708c14b560 2022-01-10T01:30:16.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f7083fff700 1 -- 172.21.15.36:0/1488868721 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c000e90 con 0x7f708c14b560 2022-01-10T01:30:16.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.702+0000 7f7083fff700 1 -- 172.21.15.36:0/1488868721 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f707c00d900 con 0x7f708c14b560 2022-01-10T01:30:16.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.706+0000 7f7093341700 1 -- 172.21.15.36:0/1488868721 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f708c14b560 msgr2=0x7f708c05f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.706+0000 7f7093341700 1 --2- 172.21.15.36:0/1488868721 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f708c14b560 0x7f708c05f6b0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f707c002f70 tx=0x7f707c006eb0).stop 2022-01-10T01:30:16.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.706+0000 7f7093341700 1 -- 172.21.15.36:0/1488868721 shutdown_connections 2022-01-10T01:30:16.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.706+0000 7f7093341700 1 --2- 172.21.15.36:0/1488868721 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f708c14b560 0x7f708c05f6b0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.706+0000 7f7093341700 1 --2- 172.21.15.36:0/1488868721 >> v2:172.21.15.59:3300/0 conn(0x7f708c0b3130 0x7f708c0af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.706+0000 7f7093341700 1 --2- 172.21.15.36:0/1488868721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708c0a9eb0 0x7f708c0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.706+0000 7f7093341700 1 -- 172.21.15.36:0/1488868721 >> 172.21.15.36:0/1488868721 conn(0x7f708c0607c0 msgr2=0x7f708c060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:16.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.706+0000 7f7093341700 1 -- 172.21.15.36:0/1488868721 shutdown_connections 2022-01-10T01:30:16.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.706+0000 7f7093341700 1 -- 172.21.15.36:0/1488868721 wait complete. 2022-01-10T01:30:16.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.706+0000 7f7093341700 1 Processor -- start 2022-01-10T01:30:16.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.706+0000 7f7093341700 1 -- start start 2022-01-10T01:30:16.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f7093341700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f708c0a9eb0 0x7f708c14a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f7093341700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708c0b3130 0x7f708c15a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f7093341700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f708c14b560 0x7f708c13dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f7093341700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c146fc0 con 0x7f708c14b560 2022-01-10T01:30:16.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f7093341700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c1471a0 con 0x7f708c0a9eb0 2022-01-10T01:30:16.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f7093341700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708c147440 con 0x7f708c0b3130 2022-01-10T01:30:16.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70918de700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f708c14b560 0x7f708c13dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70910dd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f708c0a9eb0 0x7f708c14a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70910dd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f708c0a9eb0 0x7f708c14a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:34802/0 (socket says 172.21.15.36:34802) 2022-01-10T01:30:16.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70908dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708c0b3130 0x7f708c15a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70918de700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f708c14b560 0x7f708c13dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38172/0 (socket says 172.21.15.36:38172) 2022-01-10T01:30:16.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70910dd700 1 -- 172.21.15.36:0/270800672 learned_addr learned my addr 172.21.15.36:0/270800672 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:16.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70910dd700 1 -- 172.21.15.36:0/270800672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708c0b3130 msgr2=0x7f708c15a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70910dd700 1 --2- 172.21.15.36:0/270800672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708c0b3130 0x7f708c15a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70910dd700 1 -- 172.21.15.36:0/270800672 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f708c14b560 msgr2=0x7f708c13dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70910dd700 1 --2- 172.21.15.36:0/270800672 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f708c14b560 0x7f708c13dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70910dd700 1 -- 172.21.15.36:0/270800672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708800b180 con 0x7f708c0a9eb0 2022-01-10T01:30:16.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70918de700 1 --2- 172.21.15.36:0/270800672 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f708c14b560 0x7f708c13dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:30:16.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70910dd700 1 --2- 172.21.15.36:0/270800672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f708c0a9eb0 0x7f708c14a630 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f708c149da0 tx=0x7f7088006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:16.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70827fc700 1 -- 172.21.15.36:0/270800672 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f708800c7e0 con 0x7f708c0a9eb0 2022-01-10T01:30:16.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70827fc700 1 -- 172.21.15.36:0/270800672 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708800c940 con 0x7f708c0a9eb0 2022-01-10T01:30:16.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f70827fc700 1 -- 172.21.15.36:0/270800672 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f708800cca0 con 0x7f708c0a9eb0 2022-01-10T01:30:16.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f7093341700 1 -- 172.21.15.36:0/270800672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7084009470 con 0x7f708c0a9eb0 2022-01-10T01:30:16.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f7093341700 1 -- 172.21.15.36:0/270800672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c00b1e0 con 0x7f708c0a9eb0 2022-01-10T01:30:16.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.710+0000 7f7093341700 1 -- 172.21.15.36:0/270800672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708c148410 con 0x7f708c0a9eb0 2022-01-10T01:30:16.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.714+0000 7f70827fc700 1 -- 172.21.15.36:0/270800672 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f708801c460 con 0x7f708c0a9eb0 2022-01-10T01:30:16.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.714+0000 7f70827fc700 1 --2- 172.21.15.36:0/270800672 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f706c053560 0x7f706c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:16.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.714+0000 7f70827fc700 1 -- 172.21.15.36:0/270800672 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f708806c0e0 con 0x7f708c0a9eb0 2022-01-10T01:30:16.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.714+0000 7f70908dc700 1 --2- 172.21.15.36:0/270800672 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f706c053560 0x7f706c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:16.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.714+0000 7f70908dc700 1 --2- 172.21.15.36:0/270800672 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f706c053560 0x7f706c055a20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f708400b000 tx=0x7f70840091d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:16.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.722+0000 7f70827fc700 1 -- 172.21.15.36:0/270800672 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7088042ff0 con 0x7f708c0a9eb0 2022-01-10T01:30:16.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.886+0000 7f7093341700 1 -- 172.21.15.36:0/270800672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f708c057350 con 0x7f708c0a9eb0 2022-01-10T01:30:16.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.890+0000 7f70827fc700 1 -- 172.21.15.36:0/270800672 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f7088046610 con 0x7f708c0a9eb0 2022-01-10T01:30:16.891 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:16.891 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":34,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3321682930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3321682930},{"type":"v1","addr":"172.21.15.59:6833","nonce":3321682930}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/635174626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":635174626},{"type":"v1","addr":"172.21.15.36:6837","nonce":635174626}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:30:08.620792+0000","modified":"2022-01-10T01:30:09.623530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35654":{"gid":35654,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/452951292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":452951292},{"type":"v1","addr":"172.21.15.36:6835","nonce":452951292}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2022-01-10T01:30:16.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.890+0000 7f7093341700 1 -- 172.21.15.36:0/270800672 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f706c053560 msgr2=0x7f706c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.890+0000 7f7093341700 1 --2- 172.21.15.36:0/270800672 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f706c053560 0x7f706c055a20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f708400b000 tx=0x7f70840091d0).stop 2022-01-10T01:30:16.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.890+0000 7f7093341700 1 -- 172.21.15.36:0/270800672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f708c0a9eb0 msgr2=0x7f708c14a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:16.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.890+0000 7f7093341700 1 --2- 172.21.15.36:0/270800672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f708c0a9eb0 0x7f708c14a630 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f708c149da0 tx=0x7f7088006df0).stop 2022-01-10T01:30:16.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.890+0000 7f7093341700 1 -- 172.21.15.36:0/270800672 shutdown_connections 2022-01-10T01:30:16.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.890+0000 7f7093341700 1 --2- 172.21.15.36:0/270800672 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f706c053560 0x7f706c055a20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.890+0000 7f7093341700 1 --2- 172.21.15.36:0/270800672 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f708c14b560 0x7f708c13dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.890+0000 7f7093341700 1 --2- 172.21.15.36:0/270800672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f708c0b3130 0x7f708c15a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.890+0000 7f7093341700 1 --2- 172.21.15.36:0/270800672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f708c0a9eb0 0x7f708c14a630 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:16.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.890+0000 7f7093341700 1 -- 172.21.15.36:0/270800672 >> 172.21.15.36:0/270800672 conn(0x7f708c0607c0 msgr2=0x7f708c060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:16.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.890+0000 7f7093341700 1 -- 172.21.15.36:0/270800672 shutdown_connections 2022-01-10T01:30:16.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:16.890+0000 7f7093341700 1 -- 172.21.15.36:0/270800672 wait complete. 2022-01-10T01:30:16.896 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 34 2022-01-10T01:30:17.206 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:30:08.620792+0000', 'modified': '2022-01-10T01:30:09.623530+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35654}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35654': {'gid': 35654, 'name': 'a', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6835/452951292', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6834', 'nonce': 452951292}, {'type': 'v1', 'addr': '172.21.15.36:6835', 'nonce': 452951292}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:30:17.207 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:30:17.207 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-10T01:30:17.327 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":35654,"want_state":"up:active","state":"up:active","rank_uptime":8.6916137019999997,"mdsmap_epoch":34,"osdmap_epoch":77,"osdmap_epoch_barrier":76,"uptime":13.0169166} 2022-01-10T01:30:17.328 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 35654, "mdsmap_epoch": 34, "osdmap_epoch": 77, "osdmap_epoch_barrier": 76, "rank_uptime": 8.691613702, "state": "up:active", "uptime": 13.0169166, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:30:17.329 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:30:17.329 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2022-01-10T01:30:17.329 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi166.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2022-01-10T01:30:17.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:17.330 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:30:17.338 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:30:17.356 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:30:17.357 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:30:17.370 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:30:17.371 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:30:17.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:17.372 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:30:17.421 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:30:17.421 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:30:17.424 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:30:17.441 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:30:17.441 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:30:17.452 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:30:17.453 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:30:17.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:17.454 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:30:17.498 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:2022-01-10T01:30:17.493+0000 7ff7330d8080 -1 init, newargv = 0x55b88a5f1d40 newargc=9ceph-fuse[14175]: starting ceph client 2022-01-10T01:30:17.499 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr: 2022-01-10T01:30:17.508 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14175]: starting fuse 2022-01-10T01:30:18.605 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:30:18.623 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:30:18.624 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:30:18.682 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:30:18.683 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:30:18.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:18.684 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:30:18.691 INFO:teuthology.orchestra.run.smithi166.stdout:52 2022-01-10T01:30:18.691 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:30:18.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:18.692 DEBUG:teuthology.orchestra.run.smithi166:> sudo python3 -c ' 2022-01-10T01:30:18.692 DEBUG:teuthology.orchestra.run.smithi166:> import glob 2022-01-10T01:30:18.693 DEBUG:teuthology.orchestra.run.smithi166:> import re 2022-01-10T01:30:18.693 DEBUG:teuthology.orchestra.run.smithi166:> import os 2022-01-10T01:30:18.694 DEBUG:teuthology.orchestra.run.smithi166:> import subprocess 2022-01-10T01:30:18.694 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:30:18.695 DEBUG:teuthology.orchestra.run.smithi166:> def find_socket(client_name): 2022-01-10T01:30:18.695 DEBUG:teuthology.orchestra.run.smithi166:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2022-01-10T01:30:18.695 DEBUG:teuthology.orchestra.run.smithi166:> files = glob.glob(asok_path) 2022-01-10T01:30:18.696 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:30:18.696 DEBUG:teuthology.orchestra.run.smithi166:> # Given a non-glob path, it better be there 2022-01-10T01:30:18.697 DEBUG:teuthology.orchestra.run.smithi166:> if "*" not in asok_path: 2022-01-10T01:30:18.697 DEBUG:teuthology.orchestra.run.smithi166:> assert(len(files) == 1) 2022-01-10T01:30:18.697 DEBUG:teuthology.orchestra.run.smithi166:> return files[0] 2022-01-10T01:30:18.698 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:30:18.698 DEBUG:teuthology.orchestra.run.smithi166:> for f in files: 2022-01-10T01:30:18.699 DEBUG:teuthology.orchestra.run.smithi166:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:30:18.699 DEBUG:teuthology.orchestra.run.smithi166:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:30:18.699 DEBUG:teuthology.orchestra.run.smithi166:> return f 2022-01-10T01:30:18.700 DEBUG:teuthology.orchestra.run.smithi166:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:30:18.700 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:30:18.701 DEBUG:teuthology.orchestra.run.smithi166:> print(find_socket("client.1")) 2022-01-10T01:30:18.701 DEBUG:teuthology.orchestra.run.smithi166:> ' 2022-01-10T01:30:18.746 INFO:teuthology.orchestra.run.smithi166.stdout:/var/run/ceph/ceph-client.1.14175.asok 2022-01-10T01:30:18.751 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14175.asok 2022-01-10T01:30:18.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:18.752 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14175.asok status 2022-01-10T01:30:18.893 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2022-01-10T01:30:18.893 INFO:teuthology.orchestra.run.smithi166.stdout: "metadata": { 2022-01-10T01:30:18.894 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:30:18.894 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:30:18.894 INFO:teuthology.orchestra.run.smithi166.stdout: "entity_id": "1", 2022-01-10T01:30:18.894 INFO:teuthology.orchestra.run.smithi166.stdout: "hostname": "smithi166", 2022-01-10T01:30:18.895 INFO:teuthology.orchestra.run.smithi166.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2022-01-10T01:30:18.895 INFO:teuthology.orchestra.run.smithi166.stdout: "pid": "14175", 2022-01-10T01:30:18.895 INFO:teuthology.orchestra.run.smithi166.stdout: "root": "/" 2022-01-10T01:30:18.895 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:30:18.896 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_count": 0, 2022-01-10T01:30:18.896 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_pinned_count": 0, 2022-01-10T01:30:18.896 INFO:teuthology.orchestra.run.smithi166.stdout: "id": 6441, 2022-01-10T01:30:18.897 INFO:teuthology.orchestra.run.smithi166.stdout: "inst": { 2022-01-10T01:30:18.897 INFO:teuthology.orchestra.run.smithi166.stdout: "name": { 2022-01-10T01:30:18.898 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "client", 2022-01-10T01:30:18.898 INFO:teuthology.orchestra.run.smithi166.stdout: "num": 6441 2022-01-10T01:30:18.898 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:30:18.899 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:30:18.899 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:30:18.900 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:30:18.900 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 1073792881 2022-01-10T01:30:18.901 INFO:teuthology.orchestra.run.smithi166.stdout: } 2022-01-10T01:30:18.901 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:30:18.901 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:30:18.901 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:30:18.902 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:30:18.902 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 1073792881 2022-01-10T01:30:18.902 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:30:18.903 INFO:teuthology.orchestra.run.smithi166.stdout: "inst_str": "client.6441 172.21.15.166:0/1073792881", 2022-01-10T01:30:18.903 INFO:teuthology.orchestra.run.smithi166.stdout: "addr_str": "172.21.15.166:0/1073792881", 2022-01-10T01:30:18.903 INFO:teuthology.orchestra.run.smithi166.stdout: "inode_count": 1, 2022-01-10T01:30:18.903 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_epoch": 34, 2022-01-10T01:30:18.904 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch": 77, 2022-01-10T01:30:18.904 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:30:18.905 INFO:teuthology.orchestra.run.smithi166.stdout: "blacklisted": false, 2022-01-10T01:30:18.905 INFO:teuthology.orchestra.run.smithi166.stdout: "fs_name": "cephfs" 2022-01-10T01:30:18.906 INFO:teuthology.orchestra.run.smithi166.stdout:} 2022-01-10T01:30:18.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:18.909 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:30:18.909 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:30:18.917 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:30:18.919 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:30:18.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:18.920 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:30:18.940 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:30:19.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 Processor -- start 2022-01-10T01:30:19.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 -- start start 2022-01-10T01:30:19.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccd80b22d0 0x7fccd813c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:19.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fccd80a8dd0 0x7fccd813c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:19.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd80b26b0 con 0x7fccd80b01d0 2022-01-10T01:30:19.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd8143740 con 0x7fccd80a8dd0 2022-01-10T01:30:19.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80af700 con 0x7fccd80b22d0 2022-01-10T01:30:19.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fcccffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fccd80a8dd0 0x7fccd813c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:19.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccd6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccd80b22d0 0x7fccd813c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:19.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fcccffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fccd80a8dd0 0x7fccd813c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:34810/0 (socket says 172.21.15.36:34810) 2022-01-10T01:30:19.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fcccffff700 1 -- 172.21.15.36:0/2513030081 learned_addr learned my addr 172.21.15.36:0/2513030081 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:19.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccd77fe700 1 --1- 172.21.15.36:0/2513030081 >> v1:172.21.15.59:6789/0 conn(0x7fccd80b01d0 0x7fccd80b0640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:53650/0 (socket says 172.21.15.36:53650) 2022-01-10T01:30:19.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fcccffff700 1 -- 172.21.15.36:0/2513030081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccd80b22d0 msgr2=0x7fccd813c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:19.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fcccffff700 1 --2- 172.21.15.36:0/2513030081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccd80b22d0 0x7fccd813c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fcccffff700 1 -- 172.21.15.36:0/2513030081 >> v1:172.21.15.59:6789/0 conn(0x7fccd80b01d0 legacy=0x7fccd80b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:19.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fcccffff700 1 -- 172.21.15.36:0/2513030081 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd80af9a0 con 0x7fccd80a8dd0 2022-01-10T01:30:19.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fcccffff700 1 --2- 172.21.15.36:0/2513030081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd80a8dd0 0x7fccd813c960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fccc8002f70 tx=0x7fccc8006eb0).ready entity=mon.1 client_cookie=17983925b73f50d7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:19.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccd67fc700 1 -- 172.21.15.36:0/2513030081 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccc800d570 con 0x7fccd80a8dd0 2022-01-10T01:30:19.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccd67fc700 1 -- 172.21.15.36:0/2513030081 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc8000e90 con 0x7fccd80a8dd0 2022-01-10T01:30:19.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccd67fc700 1 -- 172.21.15.36:0/2513030081 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccc800d900 con 0x7fccd80a8dd0 2022-01-10T01:30:19.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 -- 172.21.15.36:0/2513030081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd80a8dd0 msgr2=0x7fccd813c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:19.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 --2- 172.21.15.36:0/2513030081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd80a8dd0 0x7fccd813c960 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fccc8002f70 tx=0x7fccc8006eb0).stop 2022-01-10T01:30:19.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 -- 172.21.15.36:0/2513030081 shutdown_connections 2022-01-10T01:30:19.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 --2- 172.21.15.36:0/2513030081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd80a8dd0 0x7fccd813c960 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 --2- 172.21.15.36:0/2513030081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccd80b22d0 0x7fccd813c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 -- 172.21.15.36:0/2513030081 >> 172.21.15.36:0/2513030081 conn(0x7fccd805f6b0 msgr2=0x7fccd805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:19.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 -- 172.21.15.36:0/2513030081 shutdown_connections 2022-01-10T01:30:19.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.054+0000 7fccdd515700 1 -- 172.21.15.36:0/2513030081 wait complete. 2022-01-10T01:30:19.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fccdd515700 1 Processor -- start 2022-01-10T01:30:19.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fccdd515700 1 -- start start 2022-01-10T01:30:19.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fccdd515700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd80a8dd0 0x7fccd81494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:19.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fccdd515700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fccd80b01d0 0x7fccd8142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:19.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fccdd515700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccd80b22d0 0x7fccd8142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:19.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fccdd515700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80b5340 con 0x7fccd80b01d0 2022-01-10T01:30:19.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fccdd515700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd81499e0 con 0x7fccd80a8dd0 2022-01-10T01:30:19.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fccdd515700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd80b3d20 con 0x7fccd80b22d0 2022-01-10T01:30:19.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fcccffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fccd80b01d0 0x7fccd8142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:19.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fccd6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd80a8dd0 0x7fccd81494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:19.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fccd6ffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd80a8dd0 0x7fccd81494f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:34816/0 (socket says 172.21.15.36:34816) 2022-01-10T01:30:19.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fccd6ffd700 1 -- 172.21.15.36:0/3759338046 learned_addr learned my addr 172.21.15.36:0/3759338046 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:19.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fcccffff700 1 --2- 172.21.15.36:0/3759338046 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fccd80b01d0 0x7fccd8142a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38184/0 (socket says 172.21.15.36:38184) 2022-01-10T01:30:19.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fccd77fe700 1 --2- 172.21.15.36:0/3759338046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccd80b22d0 0x7fccd8142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:19.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fcccffff700 1 -- 172.21.15.36:0/3759338046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccd80b22d0 msgr2=0x7fccd8142f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:19.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fcccffff700 1 --2- 172.21.15.36:0/3759338046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccd80b22d0 0x7fccd8142f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fcccffff700 1 -- 172.21.15.36:0/3759338046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd80a8dd0 msgr2=0x7fccd81494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:19.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fcccffff700 1 --2- 172.21.15.36:0/3759338046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd80a8dd0 0x7fccd81494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.058+0000 7fcccffff700 1 -- 172.21.15.36:0/3759338046 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc800b1e0 con 0x7fccd80b01d0 2022-01-10T01:30:19.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.062+0000 7fcccffff700 1 --2- 172.21.15.36:0/3759338046 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fccd80b01d0 0x7fccd8142a50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fccc8002f70 tx=0x7fccc8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:19.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.062+0000 7fccd4ff9700 1 -- 172.21.15.36:0/3759338046 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccc800d8f0 con 0x7fccd80b01d0 2022-01-10T01:30:19.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.062+0000 7fccd4ff9700 1 -- 172.21.15.36:0/3759338046 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc8011b80 con 0x7fccd80b01d0 2022-01-10T01:30:19.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.062+0000 7fccdd515700 1 -- 172.21.15.36:0/3759338046 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd8147e80 con 0x7fccd80b01d0 2022-01-10T01:30:19.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.062+0000 7fccd4ff9700 1 -- 172.21.15.36:0/3759338046 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fccc801e460 con 0x7fccd80b01d0 2022-01-10T01:30:19.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.062+0000 7fccdd515700 1 -- 172.21.15.36:0/3759338046 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd80b4ea0 con 0x7fccd80b01d0 2022-01-10T01:30:19.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.062+0000 7fccdd515700 1 -- 172.21.15.36:0/3759338046 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd8148120 con 0x7fccd80b01d0 2022-01-10T01:30:19.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.062+0000 7fccd4ff9700 1 -- 172.21.15.36:0/3759338046 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fccc8025030 con 0x7fccd80b01d0 2022-01-10T01:30:19.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.062+0000 7fccd4ff9700 1 --2- 172.21.15.36:0/3759338046 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccb0053560 0x7fccb0055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:19.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.062+0000 7fccd4ff9700 1 -- 172.21.15.36:0/3759338046 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fccc806ca30 con 0x7fccd80b01d0 2022-01-10T01:30:19.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.062+0000 7fccd6ffd700 1 --2- 172.21.15.36:0/3759338046 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccb0053560 0x7fccb0055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:19.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.062+0000 7fccd6ffd700 1 --2- 172.21.15.36:0/3759338046 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccb0053560 0x7fccb0055a20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fccc000b000 tx=0x7fccc0006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:19.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.070+0000 7fccd4ff9700 1 -- 172.21.15.36:0/3759338046 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fccd8148120 con 0x7fccd80b01d0 2022-01-10T01:30:19.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.234+0000 7fccdd515700 1 -- 172.21.15.36:0/3759338046 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fccd8148120 con 0x7fccd80b01d0 2022-01-10T01:30:19.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.234+0000 7fccd4ff9700 1 -- 172.21.15.36:0/3759338046 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fccc80239d0 con 0x7fccd80b01d0 2022-01-10T01:30:19.236 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:19.237 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":34,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3321682930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3321682930},{"type":"v1","addr":"172.21.15.59:6833","nonce":3321682930}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/635174626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":635174626},{"type":"v1","addr":"172.21.15.36:6837","nonce":635174626}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:30:08.620792+0000","modified":"2022-01-10T01:30:09.623530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35654":{"gid":35654,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/452951292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":452951292},{"type":"v1","addr":"172.21.15.36:6835","nonce":452951292}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2022-01-10T01:30:19.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.238+0000 7fccdd515700 1 -- 172.21.15.36:0/3759338046 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccb0053560 msgr2=0x7fccb0055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:19.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.238+0000 7fccdd515700 1 --2- 172.21.15.36:0/3759338046 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccb0053560 0x7fccb0055a20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fccc000b000 tx=0x7fccc0006df0).stop 2022-01-10T01:30:19.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.238+0000 7fccdd515700 1 -- 172.21.15.36:0/3759338046 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fccd80b01d0 msgr2=0x7fccd8142a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:19.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.238+0000 7fccdd515700 1 --2- 172.21.15.36:0/3759338046 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fccd80b01d0 0x7fccd8142a50 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fccc8002f70 tx=0x7fccc8015000).stop 2022-01-10T01:30:19.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.238+0000 7fccdd515700 1 -- 172.21.15.36:0/3759338046 shutdown_connections 2022-01-10T01:30:19.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.238+0000 7fccdd515700 1 --2- 172.21.15.36:0/3759338046 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fccb0053560 0x7fccb0055a20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.238+0000 7fccdd515700 1 --2- 172.21.15.36:0/3759338046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccd80b22d0 0x7fccd8142f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.238+0000 7fccdd515700 1 --2- 172.21.15.36:0/3759338046 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fccd80b01d0 0x7fccd8142a50 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.238+0000 7fccdd515700 1 --2- 172.21.15.36:0/3759338046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd80a8dd0 0x7fccd81494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.238+0000 7fccdd515700 1 -- 172.21.15.36:0/3759338046 >> 172.21.15.36:0/3759338046 conn(0x7fccd805f6b0 msgr2=0x7fccd813abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:19.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.238+0000 7fccdd515700 1 -- 172.21.15.36:0/3759338046 shutdown_connections 2022-01-10T01:30:19.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.238+0000 7fccdd515700 1 -- 172.21.15.36:0/3759338046 wait complete. 2022-01-10T01:30:19.243 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 34 2022-01-10T01:30:19.256 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:30:19.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 Processor -- start 2022-01-10T01:30:19.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 -- start start 2022-01-10T01:30:19.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9edc0b2580 0x7f9edc14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:19.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9edc0b0010 0x7f9edc14b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:19.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9edc0afbd0 0x7f9edc0a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:19.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9edc0a70c0 con 0x7f9edc0b0010 2022-01-10T01:30:19.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9edc0a72f0 con 0x7f9edc0b2580 2022-01-10T01:30:19.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0a7590 con 0x7f9edc0afbd0 2022-01-10T01:30:19.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ed3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9edc0b0010 0x7f9edc14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:19.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ed3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9edc0b0010 0x7f9edc14b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38190/0 (socket says 172.21.15.36:38190) 2022-01-10T01:30:19.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ed3fff700 1 -- 172.21.15.36:0/982321556 learned_addr learned my addr 172.21.15.36:0/982321556 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:19.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9edb7fe700 1 --2- 172.21.15.36:0/982321556 >> v2:172.21.15.59:3300/0 conn(0x7f9edc0b2580 0x7f9edc14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:19.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9edbfff700 1 --2- 172.21.15.36:0/982321556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9edc0afbd0 0x7f9edc0a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:19.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ed3fff700 1 -- 172.21.15.36:0/982321556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9edc0afbd0 msgr2=0x7f9edc0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:19.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ed3fff700 1 --2- 172.21.15.36:0/982321556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9edc0afbd0 0x7f9edc0a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ed3fff700 1 -- 172.21.15.36:0/982321556 >> v2:172.21.15.59:3300/0 conn(0x7f9edc0b2580 msgr2=0x7f9edc14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:30:19.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ed3fff700 1 --2- 172.21.15.36:0/982321556 >> v2:172.21.15.59:3300/0 conn(0x7f9edc0b2580 0x7f9edc14ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ed3fff700 1 -- 172.21.15.36:0/982321556 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc0a7830 con 0x7f9edc0b0010 2022-01-10T01:30:19.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ed3fff700 1 --2- 172.21.15.36:0/982321556 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9edc0b0010 0x7f9edc14b330 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f9ecc002f70 tx=0x7f9ecc006eb0).ready entity=mon.0 client_cookie=8c140efbc179626d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:19.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9edaffd700 1 -- 172.21.15.36:0/982321556 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ecc00d570 con 0x7f9edc0b0010 2022-01-10T01:30:19.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9edaffd700 1 -- 172.21.15.36:0/982321556 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc000e90 con 0x7f9edc0b0010 2022-01-10T01:30:19.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9edaffd700 1 -- 172.21.15.36:0/982321556 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ecc00d900 con 0x7f9edc0b0010 2022-01-10T01:30:19.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/982321556 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9edc0b0010 msgr2=0x7f9edc14b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:19.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 --2- 172.21.15.36:0/982321556 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9edc0b0010 0x7f9edc14b330 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f9ecc002f70 tx=0x7f9ecc006eb0).stop 2022-01-10T01:30:19.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/982321556 shutdown_connections 2022-01-10T01:30:19.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 --2- 172.21.15.36:0/982321556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9edc0afbd0 0x7f9edc0a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 --2- 172.21.15.36:0/982321556 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9edc0b0010 0x7f9edc14b330 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 --2- 172.21.15.36:0/982321556 >> v2:172.21.15.59:3300/0 conn(0x7f9edc0b2580 0x7f9edc14ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/982321556 >> 172.21.15.36:0/982321556 conn(0x7f9edc060180 msgr2=0x7f9edc0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:19.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/982321556 shutdown_connections 2022-01-10T01:30:19.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.358+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/982321556 wait complete. 2022-01-10T01:30:19.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9ee0c2a700 1 Processor -- start 2022-01-10T01:30:19.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9ee0c2a700 1 -- start start 2022-01-10T01:30:19.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9ee0c2a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9edc0afbd0 0x7f9edc0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:19.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9ee0c2a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0b0010 0x7f9edc0aa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:19.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9ee0c2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9edc0b2580 0x7f9edc0aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:19.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9ee0c2a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0a9bc0 con 0x7f9edc0afbd0 2022-01-10T01:30:19.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9ee0c2a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc067d10 con 0x7f9edc0b0010 2022-01-10T01:30:19.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9ee0c2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0b53c0 con 0x7f9edc0b2580 2022-01-10T01:30:19.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9edb7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9edc0afbd0 0x7f9edc0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:19.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9edb7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9edc0afbd0 0x7f9edc0aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38196/0 (socket says 172.21.15.36:38196) 2022-01-10T01:30:19.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9edb7fe700 1 -- 172.21.15.36:0/519759472 learned_addr learned my addr 172.21.15.36:0/519759472 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:30:19.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9ed3fff700 1 --2- 172.21.15.36:0/519759472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0b0010 0x7f9edc0aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:19.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9edbfff700 1 --2- 172.21.15.36:0/519759472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9edc0b2580 0x7f9edc0aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:19.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9edb7fe700 1 -- 172.21.15.36:0/519759472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9edc0b2580 msgr2=0x7f9edc0aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:19.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9edb7fe700 1 --2- 172.21.15.36:0/519759472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9edc0b2580 0x7f9edc0aa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9edb7fe700 1 -- 172.21.15.36:0/519759472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0b0010 msgr2=0x7f9edc0aa370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:19.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9edb7fe700 1 --2- 172.21.15.36:0/519759472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0b0010 0x7f9edc0aa370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9edb7fe700 1 -- 172.21.15.36:0/519759472 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc00b1e0 con 0x7f9edc0afbd0 2022-01-10T01:30:19.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9edb7fe700 1 --2- 172.21.15.36:0/519759472 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9edc0afbd0 0x7f9edc0aee40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f9ec400c000 tx=0x7f9ec4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:19.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9ed97fa700 1 -- 172.21.15.36:0/519759472 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec4010780 con 0x7f9edc0afbd0 2022-01-10T01:30:19.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9ed97fa700 1 -- 172.21.15.36:0/519759472 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec40108e0 con 0x7f9edc0afbd0 2022-01-10T01:30:19.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9ed97fa700 1 -- 172.21.15.36:0/519759472 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec4010c40 con 0x7f9edc0afbd0 2022-01-10T01:30:19.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/519759472 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc0b3420 con 0x7f9edc0afbd0 2022-01-10T01:30:19.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.362+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/519759472 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc0b3c00 con 0x7f9edc0afbd0 2022-01-10T01:30:19.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.366+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/519759472 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc0b3a70 con 0x7f9edc0afbd0 2022-01-10T01:30:19.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.366+0000 7f9ed97fa700 1 -- 172.21.15.36:0/519759472 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9ec401c460 con 0x7f9edc0afbd0 2022-01-10T01:30:19.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.366+0000 7f9ed97fa700 1 --2- 172.21.15.36:0/519759472 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ec0053590 0x7f9ec0055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:30:19.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.366+0000 7f9ed97fa700 1 -- 172.21.15.36:0/519759472 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9ec406be30 con 0x7f9edc0afbd0 2022-01-10T01:30:19.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.366+0000 7f9ed3fff700 1 --2- 172.21.15.36:0/519759472 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ec0053590 0x7f9ec0055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:30:19.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.366+0000 7f9ed3fff700 1 --2- 172.21.15.36:0/519759472 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ec0053590 0x7f9ec0055a50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f9ecc01c000 tx=0x7f9ecc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:30:19.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.370+0000 7f9ed97fa700 1 -- 172.21.15.36:0/519759472 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ec4042de0 con 0x7f9edc0afbd0 2022-01-10T01:30:19.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.534+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/519759472 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9edc057350 con 0x7f9edc0afbd0 2022-01-10T01:30:19.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.534+0000 7f9ed97fa700 1 -- 172.21.15.36:0/519759472 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f9ec4046400 con 0x7f9edc0afbd0 2022-01-10T01:30:19.539 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:30:19.540 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":34,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3321682930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3321682930},{"type":"v1","addr":"172.21.15.59:6833","nonce":3321682930}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/635174626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":635174626},{"type":"v1","addr":"172.21.15.36:6837","nonce":635174626}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:30:08.620792+0000","modified":"2022-01-10T01:30:09.623530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35654":{"gid":35654,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/452951292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":452951292},{"type":"v1","addr":"172.21.15.36:6835","nonce":452951292}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2022-01-10T01:30:19.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.538+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/519759472 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ec0053590 msgr2=0x7f9ec0055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:19.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.538+0000 7f9ee0c2a700 1 --2- 172.21.15.36:0/519759472 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ec0053590 0x7f9ec0055a50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f9ecc01c000 tx=0x7f9ecc015000).stop 2022-01-10T01:30:19.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.538+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/519759472 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9edc0afbd0 msgr2=0x7f9edc0aee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:30:19.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.538+0000 7f9ee0c2a700 1 --2- 172.21.15.36:0/519759472 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9edc0afbd0 0x7f9edc0aee40 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f9ec400c000 tx=0x7f9ec4006df0).stop 2022-01-10T01:30:19.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.538+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/519759472 shutdown_connections 2022-01-10T01:30:19.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.538+0000 7f9ee0c2a700 1 --2- 172.21.15.36:0/519759472 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9ec0053590 0x7f9ec0055a50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.538+0000 7f9ee0c2a700 1 --2- 172.21.15.36:0/519759472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9edc0b2580 0x7f9edc0aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.538+0000 7f9ee0c2a700 1 --2- 172.21.15.36:0/519759472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9edc0b0010 0x7f9edc0aa370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.538+0000 7f9ee0c2a700 1 --2- 172.21.15.36:0/519759472 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9edc0afbd0 0x7f9edc0aee40 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:30:19.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.538+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/519759472 >> 172.21.15.36:0/519759472 conn(0x7f9edc060180 msgr2=0x7f9edc145ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:30:19.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.538+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/519759472 shutdown_connections 2022-01-10T01:30:19.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:30:19.542+0000 7f9ee0c2a700 1 -- 172.21.15.36:0/519759472 wait complete. 2022-01-10T01:30:19.546 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 34 2022-01-10T01:30:19.557 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_cap_revoke_eviction_timeout 30.0 2022-01-10T01:30:19.662 INFO:teuthology.orchestra.run.smithi036.stdout:{"success":"mds_cap_revoke_eviction_timeout = '30.000000' "} 2022-01-10T01:30:19.663 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_cap_revoke_eviction_timeout = '30.000000' " } 2022-01-10T01:30:19.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:19.665 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:30:19.665 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:30:19.674 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:30:19.676 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:30:19.677 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-01-10T01:30:19.677 DEBUG:teuthology.orchestra.run.smithi139:> import time 2022-01-10T01:30:19.677 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:30:19.678 DEBUG:teuthology.orchestra.run.smithi139:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2022-01-10T01:30:19.678 DEBUG:teuthology.orchestra.run.smithi139:> f.write('"'"'content'"'"') 2022-01-10T01:30:19.679 DEBUG:teuthology.orchestra.run.smithi139:> f.flush() 2022-01-10T01:30:19.679 DEBUG:teuthology.orchestra.run.smithi139:> f.write('"'"'content2'"'"') 2022-01-10T01:30:19.680 DEBUG:teuthology.orchestra.run.smithi139:> while True: 2022-01-10T01:30:19.680 DEBUG:teuthology.orchestra.run.smithi139:> time.sleep(1) 2022-01-10T01:30:19.680 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:30:19.721 DEBUG:teuthology.orchestra.run.smithi139:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2022-01-10T01:30:19.740 DEBUG:teuthology.orchestra.run:got remote process result: 2 2022-01-10T01:30:19.742 INFO:teuthology.orchestra.run.smithi139.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/background_file': No such file or directory 2022-01-10T01:30:20.743 DEBUG:teuthology.orchestra.run.smithi139:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2022-01-10T01:30:20.760 INFO:teuthology.orchestra.run.smithi139.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2022-01-10T01:30:20.762 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2022-01-10T01:30:20.762 DEBUG:teuthology.orchestra.run.smithi166:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2022-01-10T01:30:20.804 INFO:teuthology.orchestra.run.smithi166.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2022-01-10T01:30:20.806 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2022-01-10T01:30:20.806 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:30:20.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:30:20.823 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:30:20.824 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:30:20.832 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:30:20.833 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:30:20.834 DEBUG:teuthology.orchestra.run.smithi166:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-01-10T01:30:20.834 DEBUG:teuthology.orchestra.run.smithi166:> import os 2022-01-10T01:30:20.835 DEBUG:teuthology.orchestra.run.smithi166:> import time 2022-01-10T01:30:20.835 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:30:20.835 DEBUG:teuthology.orchestra.run.smithi166:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2022-01-10T01:30:20.836 DEBUG:teuthology.orchestra.run.smithi166:> try: 2022-01-10T01:30:20.836 DEBUG:teuthology.orchestra.run.smithi166:> while True: 2022-01-10T01:30:20.837 DEBUG:teuthology.orchestra.run.smithi166:> os.write(fd, b'"'"'content'"'"') 2022-01-10T01:30:20.837 DEBUG:teuthology.orchestra.run.smithi166:> time.sleep(1) 2022-01-10T01:30:20.838 DEBUG:teuthology.orchestra.run.smithi166:> if not False: 2022-01-10T01:30:20.838 DEBUG:teuthology.orchestra.run.smithi166:> break 2022-01-10T01:30:20.838 DEBUG:teuthology.orchestra.run.smithi166:> except IOError as e: 2022-01-10T01:30:20.839 DEBUG:teuthology.orchestra.run.smithi166:> pass 2022-01-10T01:30:20.839 DEBUG:teuthology.orchestra.run.smithi166:> os.close(fd) 2022-01-10T01:30:20.840 DEBUG:teuthology.orchestra.run.smithi166:> ' 2022-01-10T01:30:31.664 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:30:31.669 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:30:31.672 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:30:31.675 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:31:00.368 INFO:tasks.cephfs.test_misc:cap_waiter waited 39.525856018066406s 2022-01-10T01:31:00.369 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist ls --format=json 2022-01-10T01:31:00.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.477+0000 7f4a521b0700 1 Processor -- start 2022-01-10T01:31:00.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.477+0000 7f4a521b0700 1 -- start start 2022-01-10T01:31:00.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.477+0000 7f4a521b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4a4c0b3040 0x7f4a4c065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:00.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.477+0000 7f4a521b0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4a4c0a9c10 0x7f4a4c0607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:00.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.477+0000 7f4a521b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a4c143320 0x7f4a4c1437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:00.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.477+0000 7f4a521b0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c0648e0 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.477+0000 7f4a521b0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c061dd0 con 0x7f4a4c0b3040 2022-01-10T01:31:00.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.477+0000 7f4a521b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c066ea0 con 0x7f4a4c143320 2022-01-10T01:31:00.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.477+0000 7f4a509ad700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4a4c0a9c10 0x7f4a4c0607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:00.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a509ad700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4a4c0a9c10 0x7f4a4c0607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38208/0 (socket says 172.21.15.36:38208) 2022-01-10T01:31:00.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a509ad700 1 -- 172.21.15.36:0/713420190 learned_addr learned my addr 172.21.15.36:0/713420190 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:00.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a519af700 1 --2- 172.21.15.36:0/713420190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a4c143320 0x7f4a4c1437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:00.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a511ae700 1 --2- 172.21.15.36:0/713420190 >> v2:172.21.15.59:3300/0 conn(0x7f4a4c0b3040 0x7f4a4c065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:00.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a509ad700 1 -- 172.21.15.36:0/713420190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a4c143320 msgr2=0x7f4a4c1437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:00.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a509ad700 1 --2- 172.21.15.36:0/713420190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a4c143320 0x7f4a4c1437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a509ad700 1 -- 172.21.15.36:0/713420190 >> v2:172.21.15.59:3300/0 conn(0x7f4a4c0b3040 msgr2=0x7f4a4c065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:00.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a509ad700 1 --2- 172.21.15.36:0/713420190 >> v2:172.21.15.59:3300/0 conn(0x7f4a4c0b3040 0x7f4a4c065e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a509ad700 1 -- 172.21.15.36:0/713420190 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c0b3420 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a519af700 1 --2- 172.21.15.36:0/713420190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a4c143320 0x7f4a4c1437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:00.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a511ae700 1 --2- 172.21.15.36:0/713420190 >> v2:172.21.15.59:3300/0 conn(0x7f4a4c0b3040 0x7f4a4c065e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:00.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a509ad700 1 --2- 172.21.15.36:0/713420190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4a4c0a9c10 0x7f4a4c0607c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f4a40002f70 tx=0x7f4a40006eb0).ready entity=mon.0 client_cookie=26dffe705bf3878c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:00.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a37fff700 1 -- 172.21.15.36:0/713420190 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4000d570 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a37fff700 1 -- 172.21.15.36:0/713420190 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a40000e90 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a37fff700 1 -- 172.21.15.36:0/713420190 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4000d900 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a521b0700 1 -- 172.21.15.36:0/713420190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4a4c0a9c10 msgr2=0x7f4a4c0607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:00.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a521b0700 1 --2- 172.21.15.36:0/713420190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4a4c0a9c10 0x7f4a4c0607c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f4a40002f70 tx=0x7f4a40006eb0).stop 2022-01-10T01:31:00.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a521b0700 1 -- 172.21.15.36:0/713420190 shutdown_connections 2022-01-10T01:31:00.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a521b0700 1 --2- 172.21.15.36:0/713420190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a4c143320 0x7f4a4c1437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a521b0700 1 --2- 172.21.15.36:0/713420190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4a4c0a9c10 0x7f4a4c0607c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a521b0700 1 --2- 172.21.15.36:0/713420190 >> v2:172.21.15.59:3300/0 conn(0x7f4a4c0b3040 0x7f4a4c065e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a521b0700 1 -- 172.21.15.36:0/713420190 >> 172.21.15.36:0/713420190 conn(0x7f4a4c0636e0 msgr2=0x7f4a4c063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:00.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a521b0700 1 -- 172.21.15.36:0/713420190 shutdown_connections 2022-01-10T01:31:00.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.481+0000 7f4a521b0700 1 -- 172.21.15.36:0/713420190 wait complete. 2022-01-10T01:31:00.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a521b0700 1 Processor -- start 2022-01-10T01:31:00.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a521b0700 1 -- start start 2022-01-10T01:31:00.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a521b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a4c0a9c10 0x7f4a4c0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:00.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a521b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a4c0b3040 0x7f4a4c140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:00.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a521b0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4a4c143320 0x7f4a4c14fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:00.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a521b0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0ac0e0 con 0x7f4a4c143320 2022-01-10T01:31:00.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a521b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c1407b0 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a521b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c140a50 con 0x7f4a4c0b3040 2022-01-10T01:31:00.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a511ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a4c0a9c10 0x7f4a4c0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:00.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a519af700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4a4c143320 0x7f4a4c14fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:00.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a509ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a4c0b3040 0x7f4a4c140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:00.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a511ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a4c0a9c10 0x7f4a4c0b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:34846/0 (socket says 172.21.15.36:34846) 2022-01-10T01:31:00.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a511ae700 1 -- 172.21.15.36:0/2033489443 learned_addr learned my addr 172.21.15.36:0/2033489443 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:00.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a511ae700 1 -- 172.21.15.36:0/2033489443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a4c0b3040 msgr2=0x7f4a4c140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:00.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a511ae700 1 --2- 172.21.15.36:0/2033489443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a4c0b3040 0x7f4a4c140ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a511ae700 1 -- 172.21.15.36:0/2033489443 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4a4c143320 msgr2=0x7f4a4c14fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:00.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a511ae700 1 --2- 172.21.15.36:0/2033489443 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4a4c143320 0x7f4a4c14fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a511ae700 1 -- 172.21.15.36:0/2033489443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4800b180 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a511ae700 1 --2- 172.21.15.36:0/2033489443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a4c0a9c10 0x7f4a4c0b53d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f4a4800c000 tx=0x7f4a48006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:00.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a3effd700 1 -- 172.21.15.36:0/2033489443 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4800c890 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a3effd700 1 -- 172.21.15.36:0/2033489443 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4800c9f0 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a521b0700 1 -- 172.21.15.36:0/2033489443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a44009470 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a3effd700 1 -- 172.21.15.36:0/2033489443 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a4800cd50 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.485+0000 7f4a521b0700 1 -- 172.21.15.36:0/2033489443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4000b1e0 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.489+0000 7f4a521b0700 1 -- 172.21.15.36:0/2033489443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4c0ac2a0 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.489+0000 7f4a3effd700 1 -- 172.21.15.36:0/2033489443 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4a4801c460 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.489+0000 7f4a3effd700 1 --2- 172.21.15.36:0/2033489443 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4a280534d0 0x7f4a28055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:00.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.489+0000 7f4a3effd700 1 -- 172.21.15.36:0/2033489443 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f4a4806c620 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.489+0000 7f4a509ad700 1 --2- 172.21.15.36:0/2033489443 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4a280534d0 0x7f4a28055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:00.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.489+0000 7f4a509ad700 1 --2- 172.21.15.36:0/2033489443 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4a280534d0 0x7f4a28055990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f4a4001c000 tx=0x7f4a40015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:00.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.501+0000 7f4a3effd700 1 -- 172.21.15.36:0/2033489443 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4a48043610 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.637+0000 7f4a521b0700 1 -- 172.21.15.36:0/2033489443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blacklist ls", "format": "json"} v 0) v1 -- 0x7f4a4c066960 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.637+0000 7f4a3effd700 1 -- 172.21.15.36:0/2033489443 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls", "format": "json"}]=0 listed 1 entries v78) v1 ==== 98+0+81 (secure 0 0 0) 0x7f4a48046c30 con 0x7f4a4c0a9c10 2022-01-10T01:31:00.643 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:00.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.641+0000 7f4a521b0700 1 -- 172.21.15.36:0/2033489443 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4a280534d0 msgr2=0x7f4a28055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:00.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.641+0000 7f4a521b0700 1 --2- 172.21.15.36:0/2033489443 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4a280534d0 0x7f4a28055990 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f4a4001c000 tx=0x7f4a40015000).stop 2022-01-10T01:31:00.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.641+0000 7f4a521b0700 1 -- 172.21.15.36:0/2033489443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a4c0a9c10 msgr2=0x7f4a4c0b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:00.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.641+0000 7f4a521b0700 1 --2- 172.21.15.36:0/2033489443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a4c0a9c10 0x7f4a4c0b53d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f4a4800c000 tx=0x7f4a48006df0).stop 2022-01-10T01:31:00.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.641+0000 7f4a521b0700 1 -- 172.21.15.36:0/2033489443 shutdown_connections 2022-01-10T01:31:00.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.641+0000 7f4a521b0700 1 --2- 172.21.15.36:0/2033489443 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4a280534d0 0x7f4a28055990 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.641+0000 7f4a521b0700 1 --2- 172.21.15.36:0/2033489443 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4a4c143320 0x7f4a4c14fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.641+0000 7f4a521b0700 1 --2- 172.21.15.36:0/2033489443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4a4c0b3040 0x7f4a4c140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.641+0000 7f4a521b0700 1 --2- 172.21.15.36:0/2033489443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a4c0a9c10 0x7f4a4c0b53d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.641+0000 7f4a521b0700 1 -- 172.21.15.36:0/2033489443 >> 172.21.15.36:0/2033489443 conn(0x7f4a4c0636e0 msgr2=0x7f4a4c0609e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:00.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.641+0000 7f4a521b0700 1 -- 172.21.15.36:0/2033489443 shutdown_connections 2022-01-10T01:31:00.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.641+0000 7f4a521b0700 1 -- 172.21.15.36:0/2033489443 wait complete. 2022-01-10T01:31:00.650 INFO:teuthology.orchestra.run.smithi036.stderr:listed 1 entries 2022-01-10T01:31:00.656 INFO:teuthology.orchestra.run.smithi036.stdout:[{"addr":"172.21.15.139:0/1396023791","until":"2022-01-10T02:30:54.308570+0000"}] 2022-01-10T01:31:00.673 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2022-01-10T01:31:00.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:00.674 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:00.675 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:00.722 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2022-01-10T01:31:00.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:31:00.724 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2022-01-10T01:31:00.724 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:31:00.724 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:31:00.725 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:00.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:00.744 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:00.744 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:00.751 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:31:00.752 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:31:00.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:31:00.753 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:00.802 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:31:00.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c912bb700 1 Processor -- start 2022-01-10T01:31:00.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c912bb700 1 -- start start 2022-01-10T01:31:00.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c912bb700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2c8c064980 0x7f2c8c144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:00.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c912bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8c0b3550 0x7f2c8c066a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:00.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c912bb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8c066500 con 0x7f2c8c066ef0 2022-01-10T01:31:00.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c912bb700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c8c0b3ea0 con 0x7f2c8c064980 2022-01-10T01:31:00.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c912bb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c140d40 con 0x7f2c8c0b3550 2022-01-10T01:31:00.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c8bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2c8c064980 0x7f2c8c144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:00.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c8bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2c8c064980 0x7f2c8c144ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38220/0 (socket says 172.21.15.36:38220) 2022-01-10T01:31:00.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c8bfff700 1 -- 172.21.15.36:0/4186204777 learned_addr learned my addr 172.21.15.36:0/4186204777 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:00.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c8b7fe700 1 --2- 172.21.15.36:0/4186204777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8c0b3550 0x7f2c8c066a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:00.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c8bfff700 1 -- 172.21.15.36:0/4186204777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8c0b3550 msgr2=0x7f2c8c066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:00.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c8bfff700 1 --2- 172.21.15.36:0/4186204777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8c0b3550 0x7f2c8c066a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c8bfff700 1 -- 172.21.15.36:0/4186204777 >> v1:172.21.15.59:6789/0 conn(0x7f2c8c066ef0 legacy=0x7f2c8c141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:00.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c8bfff700 1 -- 172.21.15.36:0/4186204777 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c0b46c0 con 0x7f2c8c064980 2022-01-10T01:31:00.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c8bfff700 1 --2- 172.21.15.36:0/4186204777 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2c8c064980 0x7f2c8c144ce0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f2c840032f0 tx=0x7f2c84009290).ready entity=mon.0 client_cookie=86a4c8733e371fe5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:00.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c8affd700 1 -- 172.21.15.36:0/4186204777 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c8400b8a0 con 0x7f2c8c064980 2022-01-10T01:31:00.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c8affd700 1 -- 172.21.15.36:0/4186204777 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8400ba00 con 0x7f2c8c064980 2022-01-10T01:31:00.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.913+0000 7f2c8affd700 1 -- 172.21.15.36:0/4186204777 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c8400bb70 con 0x7f2c8c064980 2022-01-10T01:31:00.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 -- 172.21.15.36:0/4186204777 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2c8c064980 msgr2=0x7f2c8c144ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:00.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 --2- 172.21.15.36:0/4186204777 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2c8c064980 0x7f2c8c144ce0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f2c840032f0 tx=0x7f2c84009290).stop 2022-01-10T01:31:00.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 -- 172.21.15.36:0/4186204777 shutdown_connections 2022-01-10T01:31:00.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 --2- 172.21.15.36:0/4186204777 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8c0b3550 0x7f2c8c066a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 --2- 172.21.15.36:0/4186204777 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2c8c064980 0x7f2c8c144ce0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 -- 172.21.15.36:0/4186204777 >> 172.21.15.36:0/4186204777 conn(0x7f2c8c05f6b0 msgr2=0x7f2c8c05fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:00.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 -- 172.21.15.36:0/4186204777 shutdown_connections 2022-01-10T01:31:00.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 -- 172.21.15.36:0/4186204777 wait complete. 2022-01-10T01:31:00.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 Processor -- start 2022-01-10T01:31:00.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 -- start start 2022-01-10T01:31:00.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2c8c064980 0x7f2c8c142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:00.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8c066ef0 0x7f2c8c142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:00.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8c0b3550 0x7f2c8c152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:00.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c152450 con 0x7f2c8c064980 2022-01-10T01:31:00.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c143270 con 0x7f2c8c0b3550 2022-01-10T01:31:00.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c143ef0 con 0x7f2c8c066ef0 2022-01-10T01:31:00.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c8bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2c8c064980 0x7f2c8c142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:00.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c8bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2c8c064980 0x7f2c8c142480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38228/0 (socket says 172.21.15.36:38228) 2022-01-10T01:31:00.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c8bfff700 1 -- 172.21.15.36:0/808526781 learned_addr learned my addr 172.21.15.36:0/808526781 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:00.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c8b7fe700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8c066ef0 0x7f2c8c142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:00.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c90aba700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8c0b3550 0x7f2c8c152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:00.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c8bfff700 1 -- 172.21.15.36:0/808526781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8c066ef0 msgr2=0x7f2c8c142d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:00.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c8bfff700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8c066ef0 0x7f2c8c142d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c8bfff700 1 -- 172.21.15.36:0/808526781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8c0b3550 msgr2=0x7f2c8c152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:00.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c8bfff700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8c0b3550 0x7f2c8c152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:00.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c8bfff700 1 -- 172.21.15.36:0/808526781 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c84009530 con 0x7f2c8c064980 2022-01-10T01:31:00.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c90aba700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8c0b3550 0x7f2c8c152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:00.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c8bfff700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2c8c064980 0x7f2c8c142480 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f2c8c062270 tx=0x7f2c84016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:00.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c897fa700 1 -- 172.21.15.36:0/808526781 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c8400b8a0 con 0x7f2c8c064980 2022-01-10T01:31:00.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c897fa700 1 -- 172.21.15.36:0/808526781 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c84021630 con 0x7f2c8c064980 2022-01-10T01:31:00.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c912bb700 1 -- 172.21.15.36:0/808526781 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c8c1482d0 con 0x7f2c8c064980 2022-01-10T01:31:00.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.917+0000 7f2c897fa700 1 -- 172.21.15.36:0/808526781 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2c84021990 con 0x7f2c8c064980 2022-01-10T01:31:00.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.921+0000 7f2c912bb700 1 -- 172.21.15.36:0/808526781 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8c1528e0 con 0x7f2c8c064980 2022-01-10T01:31:00.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.921+0000 7f2c912bb700 1 -- 172.21.15.36:0/808526781 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c8c0b48f0 con 0x7f2c8c064980 2022-01-10T01:31:00.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.921+0000 7f2c897fa700 1 -- 172.21.15.36:0/808526781 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2c8400f070 con 0x7f2c8c064980 2022-01-10T01:31:00.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.921+0000 7f2c897fa700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2c6c0534d0 0x7f2c6c055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:00.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.921+0000 7f2c897fa700 1 -- 172.21.15.36:0/808526781 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f2c8406c280 con 0x7f2c8c064980 2022-01-10T01:31:00.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.921+0000 7f2c8b7fe700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2c6c0534d0 0x7f2c6c055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:00.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.921+0000 7f2c8b7fe700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2c6c0534d0 0x7f2c6c055990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f2c8000c000 tx=0x7f2c80008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:00.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:00.925+0000 7f2c897fa700 1 -- 172.21.15.36:0/808526781 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2c840432b0 con 0x7f2c8c064980 2022-01-10T01:31:01.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.061+0000 7f2c912bb700 1 -- 172.21.15.36:0/808526781 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c8c057350 con 0x7f2c8c064980 2022-01-10T01:31:01.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.061+0000 7f2c897fa700 1 -- 172.21.15.36:0/808526781 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16336 (secure 0 0 0) 0x7f2c84015070 con 0x7f2c8c064980 2022-01-10T01:31:01.067 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:01.067 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":78,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:30:54.647270+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:30:07.078168+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2022-01-10T01:30:08.044365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.139:0/1396023791":"2022-01-10T02:30:54.308570+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:31:01.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.065+0000 7f2c912bb700 1 -- 172.21.15.36:0/808526781 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2c6c0534d0 msgr2=0x7f2c6c055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.065+0000 7f2c912bb700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2c6c0534d0 0x7f2c6c055990 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f2c8000c000 tx=0x7f2c80008040).stop 2022-01-10T01:31:01.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.065+0000 7f2c912bb700 1 -- 172.21.15.36:0/808526781 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2c8c064980 msgr2=0x7f2c8c142480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.065+0000 7f2c912bb700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2c8c064980 0x7f2c8c142480 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f2c8c062270 tx=0x7f2c84016000).stop 2022-01-10T01:31:01.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.065+0000 7f2c912bb700 1 -- 172.21.15.36:0/808526781 shutdown_connections 2022-01-10T01:31:01.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.065+0000 7f2c912bb700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2c6c0534d0 0x7f2c6c055990 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.065+0000 7f2c912bb700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8c0b3550 0x7f2c8c152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.065+0000 7f2c912bb700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c8c066ef0 0x7f2c8c142d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.065+0000 7f2c912bb700 1 --2- 172.21.15.36:0/808526781 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2c8c064980 0x7f2c8c142480 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.065+0000 7f2c912bb700 1 -- 172.21.15.36:0/808526781 >> 172.21.15.36:0/808526781 conn(0x7f2c8c05f6b0 msgr2=0x7f2c8c13f770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:01.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.065+0000 7f2c912bb700 1 -- 172.21.15.36:0/808526781 shutdown_connections 2022-01-10T01:31:01.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.065+0000 7f2c912bb700 1 -- 172.21.15.36:0/808526781 wait complete. 2022-01-10T01:31:01.080 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:30:07.078168+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:30:08.044365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:31:01.081 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:31:01.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.189+0000 7f6eb359e700 1 Processor -- start 2022-01-10T01:31:01.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.189+0000 7f6eb359e700 1 -- start start 2022-01-10T01:31:01.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.189+0000 7f6eb359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6eb40b1260 0x7f6eb40afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.189+0000 7f6eb359e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb40add80 con 0x7f6eb40b2580 2022-01-10T01:31:01.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.189+0000 7f6eb359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb40ae020 con 0x7f6eb40b1790 2022-01-10T01:31:01.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.189+0000 7f6eb359e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb40a9390 con 0x7f6eb40b1260 2022-01-10T01:31:01.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.189+0000 7f6eb259c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f6eb40b2580 0x7f6eb40abb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36028/0 (socket says 172.21.15.36:36028) 2022-01-10T01:31:01.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.189+0000 7f6eb259c700 1 -- 172.21.15.36:0/2037593015 learned_addr learned my addr 172.21.15.36:0/2037593015 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:01.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.189+0000 7f6eabfff700 1 --2- 172.21.15.36:0/2037593015 >> v2:172.21.15.59:3300/0 conn(0x7f6eb40b1260 0x7f6eb40afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.189+0000 7f6eb1d9b700 1 -- 172.21.15.36:0/2037593015 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198402003 0 0) 0x7f6eb40add80 con 0x7f6eb40b2580 2022-01-10T01:31:01.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.189+0000 7f6eb1d9b700 1 -- 172.21.15.36:0/2037593015 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e94003260 con 0x7f6eb40b2580 2022-01-10T01:31:01.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.189+0000 7f6eb1d9b700 1 -- 172.21.15.36:0/2037593015 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738913127 0 0) 0x7f6eb40ae020 con 0x7f6eb40b1790 2022-01-10T01:31:01.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eb1d9b700 1 -- 172.21.15.36:0/2037593015 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb40add80 con 0x7f6eb40b1790 2022-01-10T01:31:01.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eb1d9b700 1 -- 172.21.15.36:0/2037593015 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 130613341 0 0) 0x7f6e94003260 con 0x7f6eb40b2580 2022-01-10T01:31:01.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eabfff700 1 -- 172.21.15.36:0/2037593015 >> v1:172.21.15.59:6789/0 conn(0x7f6eb40b1790 legacy=0x7f6eb414a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eabfff700 1 -- 172.21.15.36:0/2037593015 >> v1:172.21.15.36:6789/0 conn(0x7f6eb40b2580 legacy=0x7f6eb40abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eabfff700 1 -- 172.21.15.36:0/2037593015 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb40a9830 con 0x7f6eb40b1260 2022-01-10T01:31:01.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eabfff700 1 --2- 172.21.15.36:0/2037593015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6eb40b1260 0x7f6eb40afbd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f6ea4001110 tx=0x7f6e9c006df0).ready entity=mon.1 client_cookie=84ad3f1f8163b13e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:01.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eb1d9b700 1 -- 172.21.15.36:0/2037593015 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ea4001660 con 0x7f6eb40b1260 2022-01-10T01:31:01.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eb1d9b700 1 -- 172.21.15.36:0/2037593015 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c000e90 con 0x7f6eb40b1260 2022-01-10T01:31:01.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eb1d9b700 1 -- 172.21.15.36:0/2037593015 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e9c012460 con 0x7f6eb40b1260 2022-01-10T01:31:01.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eb359e700 1 -- 172.21.15.36:0/2037593015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6eb40b1260 msgr2=0x7f6eb40afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eb359e700 1 --2- 172.21.15.36:0/2037593015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6eb40b1260 0x7f6eb40afbd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f6ea4001110 tx=0x7f6e9c006df0).stop 2022-01-10T01:31:01.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eb359e700 1 -- 172.21.15.36:0/2037593015 shutdown_connections 2022-01-10T01:31:01.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eb359e700 1 --2- 172.21.15.36:0/2037593015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6eb40b1260 0x7f6eb40afbd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eb359e700 1 -- 172.21.15.36:0/2037593015 >> 172.21.15.36:0/2037593015 conn(0x7f6eb4060180 msgr2=0x7f6eb40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:01.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eb359e700 1 -- 172.21.15.36:0/2037593015 shutdown_connections 2022-01-10T01:31:01.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eb359e700 1 -- 172.21.15.36:0/2037593015 wait complete. 2022-01-10T01:31:01.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eb359e700 1 Processor -- start 2022-01-10T01:31:01.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.193+0000 7f6eb359e700 1 -- start start 2022-01-10T01:31:01.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6eb40b1260 0x7f6eb40b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eb40b1790 0x7f6eb41557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6eb40b2580 0x7f6eb4155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4064700 con 0x7f6eb40b1260 2022-01-10T01:31:01.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb40649a0 con 0x7f6eb40b2580 2022-01-10T01:31:01.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb4064c40 con 0x7f6eb40b1790 2022-01-10T01:31:01.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6eb40b1260 0x7f6eb40b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6eb40b1260 0x7f6eb40b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38240/0 (socket says 172.21.15.36:38240) 2022-01-10T01:31:01.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb259c700 1 -- 172.21.15.36:0/4126489714 learned_addr learned my addr 172.21.15.36:0/4126489714 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:01.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eabfff700 1 --2- 172.21.15.36:0/4126489714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eb40b1790 0x7f6eb41557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb2d9d700 1 --2- 172.21.15.36:0/4126489714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6eb40b2580 0x7f6eb4155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb259c700 1 -- 172.21.15.36:0/4126489714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eb40b1790 msgr2=0x7f6eb41557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb259c700 1 --2- 172.21.15.36:0/4126489714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eb40b1790 0x7f6eb41557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb259c700 1 -- 172.21.15.36:0/4126489714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6eb40b2580 msgr2=0x7f6eb4155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb259c700 1 --2- 172.21.15.36:0/4126489714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6eb40b2580 0x7f6eb4155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb259c700 1 -- 172.21.15.36:0/4126489714 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c00b180 con 0x7f6eb40b1260 2022-01-10T01:31:01.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb259c700 1 --2- 172.21.15.36:0/4126489714 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6eb40b1260 0x7f6eb40b5420 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f6ea4001840 tx=0x7f6ea4001720).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:01.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eab7fe700 1 -- 172.21.15.36:0/4126489714 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ea4007170 con 0x7f6eb40b1260 2022-01-10T01:31:01.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eab7fe700 1 -- 172.21.15.36:0/4126489714 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea40072d0 con 0x7f6eb40b1260 2022-01-10T01:31:01.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb359e700 1 -- 172.21.15.36:0/4126489714 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb4064ee0 con 0x7f6eb40b1260 2022-01-10T01:31:01.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eab7fe700 1 -- 172.21.15.36:0/4126489714 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ea4004710 con 0x7f6eb40b1260 2022-01-10T01:31:01.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb359e700 1 -- 172.21.15.36:0/4126489714 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb4156190 con 0x7f6eb40b1260 2022-01-10T01:31:01.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.197+0000 7f6eb359e700 1 -- 172.21.15.36:0/4126489714 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb40ae200 con 0x7f6eb40b1260 2022-01-10T01:31:01.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.201+0000 7f6eab7fe700 1 -- 172.21.15.36:0/4126489714 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6ea401b070 con 0x7f6eb40b1260 2022-01-10T01:31:01.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.201+0000 7f6eab7fe700 1 --2- 172.21.15.36:0/4126489714 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e98053590 0x7f6e98055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.201+0000 7f6eab7fe700 1 -- 172.21.15.36:0/4126489714 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f6ea406b040 con 0x7f6eb40b1260 2022-01-10T01:31:01.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.201+0000 7f6eabfff700 1 --2- 172.21.15.36:0/4126489714 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e98053590 0x7f6e98055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.201+0000 7f6eabfff700 1 --2- 172.21.15.36:0/4126489714 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e98053590 0x7f6e98055a50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f6e9c01a000 tx=0x7f6e9c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:01.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.205+0000 7f6eab7fe700 1 -- 172.21.15.36:0/4126489714 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6ea4042030 con 0x7f6eb40b1260 2022-01-10T01:31:01.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.333+0000 7f6eb359e700 1 -- 172.21.15.36:0/4126489714 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6eb4057350 con 0x7f6eb40b1260 2022-01-10T01:31:01.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.333+0000 7f6eab7fe700 1 -- 172.21.15.36:0/4126489714 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v78) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6ea4045650 con 0x7f6eb40b1260 2022-01-10T01:31:01.338 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:31:01.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.337+0000 7f6eb359e700 1 -- 172.21.15.36:0/4126489714 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e98053590 msgr2=0x7f6e98055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.337+0000 7f6eb359e700 1 --2- 172.21.15.36:0/4126489714 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e98053590 0x7f6e98055a50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f6e9c01a000 tx=0x7f6e9c014000).stop 2022-01-10T01:31:01.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.337+0000 7f6eb359e700 1 -- 172.21.15.36:0/4126489714 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6eb40b1260 msgr2=0x7f6eb40b5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.337+0000 7f6eb359e700 1 --2- 172.21.15.36:0/4126489714 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6eb40b1260 0x7f6eb40b5420 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f6ea4001840 tx=0x7f6ea4001720).stop 2022-01-10T01:31:01.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.337+0000 7f6eb359e700 1 -- 172.21.15.36:0/4126489714 shutdown_connections 2022-01-10T01:31:01.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.337+0000 7f6eb359e700 1 --2- 172.21.15.36:0/4126489714 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e98053590 0x7f6e98055a50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.337+0000 7f6eb359e700 1 --2- 172.21.15.36:0/4126489714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6eb40b2580 0x7f6eb4155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.337+0000 7f6eb359e700 1 --2- 172.21.15.36:0/4126489714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6eb40b1790 0x7f6eb41557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.337+0000 7f6eb359e700 1 --2- 172.21.15.36:0/4126489714 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6eb40b1260 0x7f6eb40b5420 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.337+0000 7f6eb359e700 1 -- 172.21.15.36:0/4126489714 >> 172.21.15.36:0/4126489714 conn(0x7f6eb4060180 msgr2=0x7f6eb40b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:01.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.337+0000 7f6eb359e700 1 -- 172.21.15.36:0/4126489714 shutdown_connections 2022-01-10T01:31:01.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.337+0000 7f6eb359e700 1 -- 172.21.15.36:0/4126489714 wait complete. 2022-01-10T01:31:01.351 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:31:01.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.457+0000 7ff49259f700 1 Processor -- start 2022-01-10T01:31:01.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.457+0000 7ff49259f700 1 -- start start 2022-01-10T01:31:01.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.457+0000 7ff49259f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c061680 0x7ff48c0b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.457+0000 7ff49259f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff48c0b4710 0x7ff48c0ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.457+0000 7ff49259f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff48c0b6910 con 0x7ff48c1439a0 2022-01-10T01:31:01.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.457+0000 7ff49259f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48c0b9680 con 0x7ff48c0b4710 2022-01-10T01:31:01.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.457+0000 7ff49259f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0b6bb0 con 0x7ff48c061680 2022-01-10T01:31:01.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.457+0000 7ff490d9c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff48c0b4710 0x7ff48c0ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.457+0000 7ff491d9e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff48c1439a0 0x7ff48c13fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:53722/0 (socket says 172.21.15.36:53722) 2022-01-10T01:31:01.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.457+0000 7ff49159d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c061680 0x7ff48c0b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.457+0000 7ff491d9e700 1 -- 172.21.15.36:0/3931638922 learned_addr learned my addr 172.21.15.36:0/3931638922 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:01.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff490d9c700 1 -- 172.21.15.36:0/3931638922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c061680 msgr2=0x7ff48c0b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:01.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff490d9c700 1 --2- 172.21.15.36:0/3931638922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c061680 0x7ff48c0b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff490d9c700 1 -- 172.21.15.36:0/3931638922 >> v1:172.21.15.59:6789/0 conn(0x7ff48c1439a0 legacy=0x7ff48c13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff490d9c700 1 -- 172.21.15.36:0/3931638922 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c0b6e50 con 0x7ff48c0b4710 2022-01-10T01:31:01.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff490d9c700 1 --2- 172.21.15.36:0/3931638922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c0b4710 0x7ff48c0ba200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7ff488002f70 tx=0x7ff488006df0).ready entity=mon.1 client_cookie=e0bb8ca8ef35a18 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:01.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff47bfff700 1 -- 172.21.15.36:0/3931638922 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff48800d570 con 0x7ff48c0b4710 2022-01-10T01:31:01.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff47bfff700 1 -- 172.21.15.36:0/3931638922 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff488000e90 con 0x7ff48c0b4710 2022-01-10T01:31:01.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff47bfff700 1 -- 172.21.15.36:0/3931638922 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff48800d8c0 con 0x7ff48c0b4710 2022-01-10T01:31:01.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff49259f700 1 -- 172.21.15.36:0/3931638922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c0b4710 msgr2=0x7ff48c0ba200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff49259f700 1 --2- 172.21.15.36:0/3931638922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c0b4710 0x7ff48c0ba200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7ff488002f70 tx=0x7ff488006df0).stop 2022-01-10T01:31:01.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff49259f700 1 -- 172.21.15.36:0/3931638922 shutdown_connections 2022-01-10T01:31:01.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff49259f700 1 --2- 172.21.15.36:0/3931638922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c0b4710 0x7ff48c0ba200 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff49259f700 1 --2- 172.21.15.36:0/3931638922 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c061680 0x7ff48c0b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff49259f700 1 -- 172.21.15.36:0/3931638922 >> 172.21.15.36:0/3931638922 conn(0x7ff48c06adf0 msgr2=0x7ff48c05f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:01.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff49259f700 1 -- 172.21.15.36:0/3931638922 shutdown_connections 2022-01-10T01:31:01.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.461+0000 7ff49259f700 1 -- 172.21.15.36:0/3931638922 wait complete. 2022-01-10T01:31:01.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff49259f700 1 Processor -- start 2022-01-10T01:31:01.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff49259f700 1 -- start start 2022-01-10T01:31:01.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff49259f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c061680 0x7ff48c146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff49259f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff48c1439a0 0x7ff48c0adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff49259f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c0ae440 0x7ff48c114830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff49259f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0aee70 con 0x7ff48c1439a0 2022-01-10T01:31:01.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff49259f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c112c50 con 0x7ff48c0ae440 2022-01-10T01:31:01.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff49259f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c0af0a0 con 0x7ff48c061680 2022-01-10T01:31:01.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff490d9c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff48c1439a0 0x7ff48c0adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff490d9c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff48c1439a0 0x7ff48c0adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38256/0 (socket says 172.21.15.36:38256) 2022-01-10T01:31:01.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff490d9c700 1 -- 172.21.15.36:0/2888535694 learned_addr learned my addr 172.21.15.36:0/2888535694 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:01.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff49159d700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c061680 0x7ff48c146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff491d9e700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c0ae440 0x7ff48c114830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff490d9c700 1 -- 172.21.15.36:0/2888535694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c061680 msgr2=0x7ff48c146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff490d9c700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c061680 0x7ff48c146340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff490d9c700 1 -- 172.21.15.36:0/2888535694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c0ae440 msgr2=0x7ff48c114830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff490d9c700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c0ae440 0x7ff48c114830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff490d9c700 1 -- 172.21.15.36:0/2888535694 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48800b180 con 0x7ff48c1439a0 2022-01-10T01:31:01.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff49159d700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c061680 0x7ff48c146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:01.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff490d9c700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff48c1439a0 0x7ff48c0adf50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7ff488002f70 tx=0x7ff488014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:01.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff47a7fc700 1 -- 172.21.15.36:0/2888535694 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff488016070 con 0x7ff48c1439a0 2022-01-10T01:31:01.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff47a7fc700 1 -- 172.21.15.36:0/2888535694 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48800d8f0 con 0x7ff48c1439a0 2022-01-10T01:31:01.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff47a7fc700 1 -- 172.21.15.36:0/2888535694 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff48801e450 con 0x7ff48c1439a0 2022-01-10T01:31:01.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff49259f700 1 -- 172.21.15.36:0/2888535694 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48c146830 con 0x7ff48c1439a0 2022-01-10T01:31:01.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.465+0000 7ff49259f700 1 -- 172.21.15.36:0/2888535694 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48c112ef0 con 0x7ff48c1439a0 2022-01-10T01:31:01.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.469+0000 7ff49259f700 1 -- 172.21.15.36:0/2888535694 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48c0af420 con 0x7ff48c1439a0 2022-01-10T01:31:01.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.469+0000 7ff47a7fc700 1 -- 172.21.15.36:0/2888535694 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff48800f030 con 0x7ff48c1439a0 2022-01-10T01:31:01.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.469+0000 7ff47a7fc700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff46c053560 0x7ff46c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.469+0000 7ff47a7fc700 1 -- 172.21.15.36:0/2888535694 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7ff48806c8d0 con 0x7ff48c1439a0 2022-01-10T01:31:01.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.469+0000 7ff49159d700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff46c053560 0x7ff46c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.469+0000 7ff49159d700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff46c053560 0x7ff46c055a20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7ff47c00b000 tx=0x7ff47c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:01.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.477+0000 7ff47a7fc700 1 -- 172.21.15.36:0/2888535694 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff488043820 con 0x7ff48c1439a0 2022-01-10T01:31:01.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.601+0000 7ff49259f700 1 -- 172.21.15.36:0/2888535694 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff48c057350 con 0x7ff48c1439a0 2022-01-10T01:31:01.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.601+0000 7ff47a7fc700 1 -- 172.21.15.36:0/2888535694 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v78) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff488023020 con 0x7ff48c1439a0 2022-01-10T01:31:01.606 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:01.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.601+0000 7ff49259f700 1 -- 172.21.15.36:0/2888535694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff46c053560 msgr2=0x7ff46c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.601+0000 7ff49259f700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff46c053560 0x7ff46c055a20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7ff47c00b000 tx=0x7ff47c008040).stop 2022-01-10T01:31:01.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.601+0000 7ff49259f700 1 -- 172.21.15.36:0/2888535694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff48c1439a0 msgr2=0x7ff48c0adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.601+0000 7ff49259f700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff48c1439a0 0x7ff48c0adf50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7ff488002f70 tx=0x7ff488014000).stop 2022-01-10T01:31:01.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.601+0000 7ff49259f700 1 -- 172.21.15.36:0/2888535694 shutdown_connections 2022-01-10T01:31:01.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.601+0000 7ff49259f700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff46c053560 0x7ff46c055a20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.601+0000 7ff49259f700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48c0ae440 0x7ff48c114830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.601+0000 7ff49259f700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff48c1439a0 0x7ff48c0adf50 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.601+0000 7ff49259f700 1 --2- 172.21.15.36:0/2888535694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff48c061680 0x7ff48c146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.601+0000 7ff49259f700 1 -- 172.21.15.36:0/2888535694 >> 172.21.15.36:0/2888535694 conn(0x7ff48c06adf0 msgr2=0x7ff48c13f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:01.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.605+0000 7ff49259f700 1 -- 172.21.15.36:0/2888535694 shutdown_connections 2022-01-10T01:31:01.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.605+0000 7ff49259f700 1 -- 172.21.15.36:0/2888535694 wait complete. 2022-01-10T01:31:01.618 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:31:01.729 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:31:01.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.725+0000 7fa4ff20e700 1 Processor -- start 2022-01-10T01:31:01.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.725+0000 7fa4ff20e700 1 -- start start 2022-01-10T01:31:01.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4ff20e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4f80a9190 0x7fa4f8146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4ff20e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f80b1140 con 0x7fa4f80b0b80 2022-01-10T01:31:01.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4ff20e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f80a9570 con 0x7fa4f80b03d0 2022-01-10T01:31:01.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4ff20e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f80b1370 con 0x7fa4f80a9190 2022-01-10T01:31:01.734 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:31:01.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4fda0b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa4f80b0b80 0x7fa4f8146a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36060/0 (socket says 172.21.15.36:36060) 2022-01-10T01:31:01.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4fda0b700 1 -- 172.21.15.36:0/3300744072 learned_addr learned my addr 172.21.15.36:0/3300744072 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:01.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4fe20c700 1 --2- 172.21.15.36:0/3300744072 >> v2:172.21.15.59:3300/0 conn(0x7fa4f80a9190 0x7fa4f8146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4fd20a700 1 -- 172.21.15.36:0/3300744072 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006824709 0 0) 0x7fa4f80b1140 con 0x7fa4f80b0b80 2022-01-10T01:31:01.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4fd20a700 1 -- 172.21.15.36:0/3300744072 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4e0003260 con 0x7fa4f80b0b80 2022-01-10T01:31:01.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4fd20a700 1 -- 172.21.15.36:0/3300744072 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431179893 0 0) 0x7fa4f80a9570 con 0x7fa4f80b03d0 2022-01-10T01:31:01.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4fd20a700 1 -- 172.21.15.36:0/3300744072 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4f80b1140 con 0x7fa4f80b03d0 2022-01-10T01:31:01.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4fe20c700 1 -- 172.21.15.36:0/3300744072 >> v1:172.21.15.59:6789/0 conn(0x7fa4f80b03d0 legacy=0x7fa4f81401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4fe20c700 1 -- 172.21.15.36:0/3300744072 >> v1:172.21.15.36:6789/0 conn(0x7fa4f80b0b80 legacy=0x7fa4f8146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4fe20c700 1 -- 172.21.15.36:0/3300744072 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80b1610 con 0x7fa4f80a9190 2022-01-10T01:31:01.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4fe20c700 1 --2- 172.21.15.36:0/3300744072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80a9190 0x7fa4f8146550 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fa4f4002f70 tx=0x7fa4f4006df0).ready entity=mon.1 client_cookie=f50130ec6e64f750 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:01.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4fd20a700 1 -- 172.21.15.36:0/3300744072 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f400d540 con 0x7fa4f80a9190 2022-01-10T01:31:01.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4fd20a700 1 -- 172.21.15.36:0/3300744072 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f4000e90 con 0x7fa4f80a9190 2022-01-10T01:31:01.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4fd20a700 1 -- 172.21.15.36:0/3300744072 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f400d890 con 0x7fa4f80a9190 2022-01-10T01:31:01.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4ff20e700 1 -- 172.21.15.36:0/3300744072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80a9190 msgr2=0x7fa4f8146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4ff20e700 1 --2- 172.21.15.36:0/3300744072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80a9190 0x7fa4f8146550 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fa4f4002f70 tx=0x7fa4f4006df0).stop 2022-01-10T01:31:01.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4ff20e700 1 -- 172.21.15.36:0/3300744072 shutdown_connections 2022-01-10T01:31:01.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4ff20e700 1 --2- 172.21.15.36:0/3300744072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80a9190 0x7fa4f8146550 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4ff20e700 1 -- 172.21.15.36:0/3300744072 >> 172.21.15.36:0/3300744072 conn(0x7fa4f8061140 msgr2=0x7fa4f8062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:01.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4ff20e700 1 -- 172.21.15.36:0/3300744072 shutdown_connections 2022-01-10T01:31:01.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.729+0000 7fa4ff20e700 1 -- 172.21.15.36:0/3300744072 wait complete. 2022-01-10T01:31:01.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4ff20e700 1 Processor -- start 2022-01-10T01:31:01.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4ff20e700 1 -- start start 2022-01-10T01:31:01.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4ff20e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4f80a9190 0x7fa4f8144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4ff20e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f80b03d0 0x7fa4f8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4ff20e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80b0b80 0x7fa4f80abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4ff20e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80aa720 con 0x7fa4f80a9190 2022-01-10T01:31:01.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4ff20e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f81558e0 con 0x7fa4f80b0b80 2022-01-10T01:31:01.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4ff20e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80a9b60 con 0x7fa4f80b03d0 2022-01-10T01:31:01.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4fe20c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4f80a9190 0x7fa4f8144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4fea0d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80b0b80 0x7fa4f80abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4fe20c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4f80a9190 0x7fa4f8144d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38270/0 (socket says 172.21.15.36:38270) 2022-01-10T01:31:01.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4fe20c700 1 -- 172.21.15.36:0/1401288096 learned_addr learned my addr 172.21.15.36:0/1401288096 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:01.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4fda0b700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f80b03d0 0x7fa4f8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4fe20c700 1 -- 172.21.15.36:0/1401288096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f80b03d0 msgr2=0x7fa4f8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4fe20c700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f80b03d0 0x7fa4f8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4fe20c700 1 -- 172.21.15.36:0/1401288096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80b0b80 msgr2=0x7fa4f80abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4fe20c700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80b0b80 0x7fa4f80abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4fe20c700 1 -- 172.21.15.36:0/1401288096 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f400b180 con 0x7fa4f80a9190 2022-01-10T01:31:01.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4fea0d700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80b0b80 0x7fa4f80abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:01.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4fda0b700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f80b03d0 0x7fa4f8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:01.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4fe20c700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4f80a9190 0x7fa4f8144d80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7fa4f4002f70 tx=0x7fa4f4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:01.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4e77fe700 1 -- 172.21.15.36:0/1401288096 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f4016070 con 0x7fa4f80a9190 2022-01-10T01:31:01.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4ff20e700 1 -- 172.21.15.36:0/1401288096 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f80a98c0 con 0x7fa4f80a9190 2022-01-10T01:31:01.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4e77fe700 1 -- 172.21.15.36:0/1401288096 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f4013850 con 0x7fa4f80a9190 2022-01-10T01:31:01.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4ff20e700 1 -- 172.21.15.36:0/1401288096 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f8156550 con 0x7fa4f80a9190 2022-01-10T01:31:01.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.733+0000 7fa4e77fe700 1 -- 172.21.15.36:0/1401288096 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f4013bb0 con 0x7fa4f80a9190 2022-01-10T01:31:01.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.737+0000 7fa4e77fe700 1 -- 172.21.15.36:0/1401288096 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa4f4025030 con 0x7fa4f80a9190 2022-01-10T01:31:01.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.737+0000 7fa4ff20e700 1 -- 172.21.15.36:0/1401288096 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d4003410 con 0x7fa4f80a9190 2022-01-10T01:31:01.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.737+0000 7fa4e77fe700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4d80535f0 0x7fa4d8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.737+0000 7fa4fda0b700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4d80535f0 0x7fa4d8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:01.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.737+0000 7fa4e77fe700 1 -- 172.21.15.36:0/1401288096 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fa4f406cb70 con 0x7fa4f80a9190 2022-01-10T01:31:01.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.737+0000 7fa4fda0b700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4d80535f0 0x7fa4d8055ab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fa4e800d000 tx=0x7fa4e8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:01.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.741+0000 7fa4e77fe700 1 -- 172.21.15.36:0/1401288096 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa4f40439d0 con 0x7fa4f80a9190 2022-01-10T01:31:01.755 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:31:01.757 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:31:01.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.865+0000 7fa4ff20e700 1 -- 172.21.15.36:0/1401288096 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4d4003c40 con 0x7fa4f80a9190 2022-01-10T01:31:01.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.869+0000 7fa4e77fe700 1 -- 172.21.15.36:0/1401288096 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa4f40230a0 con 0x7fa4f80a9190 2022-01-10T01:31:01.872 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:01.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.869+0000 7fa4ff20e700 1 -- 172.21.15.36:0/1401288096 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4d80535f0 msgr2=0x7fa4d8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.869+0000 7fa4ff20e700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4d80535f0 0x7fa4d8055ab0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fa4e800d000 tx=0x7fa4e8009040).stop 2022-01-10T01:31:01.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.869+0000 7fa4ff20e700 1 -- 172.21.15.36:0/1401288096 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4f80a9190 msgr2=0x7fa4f8144d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:01.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.869+0000 7fa4ff20e700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4f80a9190 0x7fa4f8144d80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7fa4f4002f70 tx=0x7fa4f4014000).stop 2022-01-10T01:31:01.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.869+0000 7fa4ff20e700 1 -- 172.21.15.36:0/1401288096 shutdown_connections 2022-01-10T01:31:01.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.869+0000 7fa4ff20e700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4d80535f0 0x7fa4d8055ab0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.869+0000 7fa4ff20e700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4f80b0b80 0x7fa4f80abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.869+0000 7fa4ff20e700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4f80b03d0 0x7fa4f8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.869+0000 7fa4ff20e700 1 --2- 172.21.15.36:0/1401288096 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4f80a9190 0x7fa4f8144d80 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:01.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.869+0000 7fa4ff20e700 1 -- 172.21.15.36:0/1401288096 >> 172.21.15.36:0/1401288096 conn(0x7fa4f8061140 msgr2=0x7fa4f8140e80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:01.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.869+0000 7fa4ff20e700 1 -- 172.21.15.36:0/1401288096 shutdown_connections 2022-01-10T01:31:01.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.869+0000 7fa4ff20e700 1 -- 172.21.15.36:0/1401288096 wait complete. 2022-01-10T01:31:01.885 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:31:01.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf497cb700 1 Processor -- start 2022-01-10T01:31:01.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf497cb700 1 -- start start 2022-01-10T01:31:01.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf497cb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbf44060100 0x7fbf44064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf497cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf440b38d0 0x7fbf44065200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:01.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf497cb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf440604e0 con 0x7fbf44144440 2022-01-10T01:31:01.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf497cb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf440656f0 con 0x7fbf44060100 2022-01-10T01:31:01.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf497cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf44065c80 con 0x7fbf440b38d0 2022-01-10T01:31:02.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf42ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbf44060100 0x7fbf44064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:02.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf427fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbf44144440 0x7fbf44144970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:53746/0 (socket says 172.21.15.36:53746) 2022-01-10T01:31:02.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf437fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf440b38d0 0x7fbf44065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:02.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf427fc700 1 -- 172.21.15.36:0/2268751066 learned_addr learned my addr 172.21.15.36:0/2268751066 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:02.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf41ffb700 1 -- 172.21.15.36:0/2268751066 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815446905 0 0) 0x7fbf440604e0 con 0x7fbf44144440 2022-01-10T01:31:02.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf41ffb700 1 -- 172.21.15.36:0/2268751066 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf24003260 con 0x7fbf44144440 2022-01-10T01:31:02.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf42ffd700 1 -- 172.21.15.36:0/2268751066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf440b38d0 msgr2=0x7fbf44065200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:02.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf42ffd700 1 --2- 172.21.15.36:0/2268751066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf440b38d0 0x7fbf44065200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf42ffd700 1 -- 172.21.15.36:0/2268751066 >> v1:172.21.15.59:6789/0 conn(0x7fbf44144440 legacy=0x7fbf44144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:02.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf42ffd700 1 -- 172.21.15.36:0/2268751066 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf440b23b0 con 0x7fbf44060100 2022-01-10T01:31:02.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf437fe700 1 --2- 172.21.15.36:0/2268751066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf440b38d0 0x7fbf44065200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:02.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf42ffd700 1 --2- 172.21.15.36:0/2268751066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf44060100 0x7fbf44064d10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fbf34002f70 tx=0x7fbf34006df0).ready entity=mon.1 client_cookie=3539fa9d0e018247 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:02.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.993+0000 7fbf41ffb700 1 -- 172.21.15.36:0/2268751066 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf3400d4a0 con 0x7fbf44060100 2022-01-10T01:31:02.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.997+0000 7fbf41ffb700 1 -- 172.21.15.36:0/2268751066 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf34000e90 con 0x7fbf44060100 2022-01-10T01:31:02.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.997+0000 7fbf41ffb700 1 -- 172.21.15.36:0/2268751066 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf3400d7f0 con 0x7fbf44060100 2022-01-10T01:31:02.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.997+0000 7fbf497cb700 1 -- 172.21.15.36:0/2268751066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf44060100 msgr2=0x7fbf44064d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:02.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.997+0000 7fbf497cb700 1 --2- 172.21.15.36:0/2268751066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf44060100 0x7fbf44064d10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7fbf34002f70 tx=0x7fbf34006df0).stop 2022-01-10T01:31:02.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.997+0000 7fbf497cb700 1 -- 172.21.15.36:0/2268751066 shutdown_connections 2022-01-10T01:31:02.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.997+0000 7fbf497cb700 1 --2- 172.21.15.36:0/2268751066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf440b38d0 0x7fbf44065200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.997+0000 7fbf497cb700 1 --2- 172.21.15.36:0/2268751066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf44060100 0x7fbf44064d10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.997+0000 7fbf497cb700 1 -- 172.21.15.36:0/2268751066 >> 172.21.15.36:0/2268751066 conn(0x7fbf4405cf60 msgr2=0x7fbf4405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:02.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.997+0000 7fbf497cb700 1 -- 172.21.15.36:0/2268751066 shutdown_connections 2022-01-10T01:31:02.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.997+0000 7fbf497cb700 1 -- 172.21.15.36:0/2268751066 wait complete. 2022-01-10T01:31:02.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.997+0000 7fbf497cb700 1 Processor -- start 2022-01-10T01:31:02.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:01.997+0000 7fbf497cb700 1 -- start start 2022-01-10T01:31:02.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf497cb700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf44060100 0x7fbf44141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:02.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf497cb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf440b38d0 0x7fbf44150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:02.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf497cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf440b0f30 0x7fbf4413cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:02.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf497cb700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf44141670 con 0x7fbf44060100 2022-01-10T01:31:02.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf497cb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440ae720 con 0x7fbf440b38d0 2022-01-10T01:31:02.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf497cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf441511c0 con 0x7fbf440b0f30 2022-01-10T01:31:02.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf42ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf44060100 0x7fbf44141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:02.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf42ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf44060100 0x7fbf44141180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38282/0 (socket says 172.21.15.36:38282) 2022-01-10T01:31:02.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf42ffd700 1 -- 172.21.15.36:0/4018318289 learned_addr learned my addr 172.21.15.36:0/4018318289 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:02.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf427fc700 1 --2- 172.21.15.36:0/4018318289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf440b38d0 0x7fbf44150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:02.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf437fe700 1 --2- 172.21.15.36:0/4018318289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf440b0f30 0x7fbf4413cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:02.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf42ffd700 1 -- 172.21.15.36:0/4018318289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf440b0f30 msgr2=0x7fbf4413cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:02.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf42ffd700 1 --2- 172.21.15.36:0/4018318289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf440b0f30 0x7fbf4413cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf42ffd700 1 -- 172.21.15.36:0/4018318289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf440b38d0 msgr2=0x7fbf44150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:02.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf42ffd700 1 --2- 172.21.15.36:0/4018318289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf440b38d0 0x7fbf44150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf42ffd700 1 -- 172.21.15.36:0/4018318289 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c009470 con 0x7fbf44060100 2022-01-10T01:31:02.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf42ffd700 1 --2- 172.21.15.36:0/4018318289 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf44060100 0x7fbf44141180 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7fbf441417b0 tx=0x7fbf34014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:02.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf3bfff700 1 -- 172.21.15.36:0/4018318289 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf34016070 con 0x7fbf44060100 2022-01-10T01:31:02.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf3bfff700 1 -- 172.21.15.36:0/4018318289 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf340138d0 con 0x7fbf44060100 2022-01-10T01:31:02.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf497cb700 1 -- 172.21.15.36:0/4018318289 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf3400b180 con 0x7fbf44060100 2022-01-10T01:31:02.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf3bfff700 1 -- 172.21.15.36:0/4018318289 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf34013c30 con 0x7fbf44060100 2022-01-10T01:31:02.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf497cb700 1 -- 172.21.15.36:0/4018318289 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf440ae950 con 0x7fbf44060100 2022-01-10T01:31:02.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf497cb700 1 -- 172.21.15.36:0/4018318289 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf44141be0 con 0x7fbf44060100 2022-01-10T01:31:02.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.001+0000 7fbf3bfff700 1 -- 172.21.15.36:0/4018318289 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbf34025030 con 0x7fbf44060100 2022-01-10T01:31:02.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.005+0000 7fbf3bfff700 1 --2- 172.21.15.36:0/4018318289 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf280535f0 0x7fbf28055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:02.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.005+0000 7fbf427fc700 1 --2- 172.21.15.36:0/4018318289 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf280535f0 0x7fbf28055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:02.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.005+0000 7fbf3bfff700 1 -- 172.21.15.36:0/4018318289 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fbf3406cac0 con 0x7fbf44060100 2022-01-10T01:31:02.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.005+0000 7fbf427fc700 1 --2- 172.21.15.36:0/4018318289 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf280535f0 0x7fbf28055ab0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fbf2c00d000 tx=0x7fbf2c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:02.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.013+0000 7fbf3bfff700 1 -- 172.21.15.36:0/4018318289 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbf340439a0 con 0x7fbf44060100 2022-01-10T01:31:02.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.137+0000 7fbf497cb700 1 -- 172.21.15.36:0/4018318289 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf44057350 con 0x7fbf44060100 2022-01-10T01:31:02.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.137+0000 7fbf3bfff700 1 -- 172.21.15.36:0/4018318289 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbf340230a0 con 0x7fbf44060100 2022-01-10T01:31:02.144 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:02.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.141+0000 7fbf497cb700 1 -- 172.21.15.36:0/4018318289 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf280535f0 msgr2=0x7fbf28055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:02.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.141+0000 7fbf497cb700 1 --2- 172.21.15.36:0/4018318289 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf280535f0 0x7fbf28055ab0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fbf2c00d000 tx=0x7fbf2c009040).stop 2022-01-10T01:31:02.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.141+0000 7fbf497cb700 1 -- 172.21.15.36:0/4018318289 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf44060100 msgr2=0x7fbf44141180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:02.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.141+0000 7fbf497cb700 1 --2- 172.21.15.36:0/4018318289 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf44060100 0x7fbf44141180 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7fbf441417b0 tx=0x7fbf34014000).stop 2022-01-10T01:31:02.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.141+0000 7fbf497cb700 1 -- 172.21.15.36:0/4018318289 shutdown_connections 2022-01-10T01:31:02.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.141+0000 7fbf497cb700 1 --2- 172.21.15.36:0/4018318289 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbf280535f0 0x7fbf28055ab0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.141+0000 7fbf497cb700 1 --2- 172.21.15.36:0/4018318289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf440b0f30 0x7fbf4413cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.141+0000 7fbf497cb700 1 --2- 172.21.15.36:0/4018318289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf440b38d0 0x7fbf44150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.141+0000 7fbf497cb700 1 --2- 172.21.15.36:0/4018318289 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbf44060100 0x7fbf44141180 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.141+0000 7fbf497cb700 1 -- 172.21.15.36:0/4018318289 >> 172.21.15.36:0/4018318289 conn(0x7fbf4405cf60 msgr2=0x7fbf4413a950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:02.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.141+0000 7fbf497cb700 1 -- 172.21.15.36:0/4018318289 shutdown_connections 2022-01-10T01:31:02.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.141+0000 7fbf497cb700 1 -- 172.21.15.36:0/4018318289 wait complete. 2022-01-10T01:31:02.156 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:31:02.157 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:02.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f5114b94700 1 Processor -- start 2022-01-10T01:31:02.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f5114b94700 1 -- start start 2022-01-10T01:31:02.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f5114b94700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f51101483a0 0x7f51100b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:02.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f5114b94700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51100b0350 con 0x7f51100a70c0 2022-01-10T01:31:02.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f5114b94700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51100b05f0 con 0x7f51100b1db0 2022-01-10T01:31:02.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f5114b94700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51100a90c0 con 0x7f51101483a0 2022-01-10T01:31:02.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f510dd9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f51101483a0 0x7f51100b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:02.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f510ed9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f51100a70c0 0x7f5110144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36086/0 (socket says 172.21.15.36:36086) 2022-01-10T01:31:02.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f510dd9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f51101483a0 0x7f51100b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38294/0 (socket says 172.21.15.36:38294) 2022-01-10T01:31:02.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f510ed9d700 1 -- 172.21.15.36:0/359479051 learned_addr learned my addr 172.21.15.36:0/359479051 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:02.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f510dd9b700 1 -- 172.21.15.36:0/359479051 >> v1:172.21.15.59:6789/0 conn(0x7f51100b1db0 legacy=0x7f51100b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:02.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f510dd9b700 1 -- 172.21.15.36:0/359479051 >> v1:172.21.15.36:6789/0 conn(0x7f51100a70c0 legacy=0x7f5110144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:02.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f510dd9b700 1 -- 172.21.15.36:0/359479051 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51100b0890 con 0x7f51101483a0 2022-01-10T01:31:02.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f510d59a700 1 -- 172.21.15.36:0/359479051 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822059746 0 0) 0x7f51100b0350 con 0x7f51100a70c0 2022-01-10T01:31:02.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f510dd9b700 1 --2- 172.21.15.36:0/359479051 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51101483a0 0x7f51100b0fd0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f5110147730 tx=0x7f50f8006df0).ready entity=mon.0 client_cookie=950df8cb3c5c71c3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:02.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f510d59a700 1 -- 172.21.15.36:0/359479051 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50f800d610 con 0x7f51101483a0 2022-01-10T01:31:02.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f510d59a700 1 -- 172.21.15.36:0/359479051 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f8000e90 con 0x7f51101483a0 2022-01-10T01:31:02.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f510d59a700 1 -- 172.21.15.36:0/359479051 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50f800d960 con 0x7f51101483a0 2022-01-10T01:31:02.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f5114b94700 1 -- 172.21.15.36:0/359479051 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51101483a0 msgr2=0x7f51100b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:02.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f5114b94700 1 --2- 172.21.15.36:0/359479051 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51101483a0 0x7f51100b0fd0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f5110147730 tx=0x7f50f8006df0).stop 2022-01-10T01:31:02.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f5114b94700 1 -- 172.21.15.36:0/359479051 shutdown_connections 2022-01-10T01:31:02.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f5114b94700 1 --2- 172.21.15.36:0/359479051 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51101483a0 0x7f51100b0fd0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f5114b94700 1 -- 172.21.15.36:0/359479051 >> 172.21.15.36:0/359479051 conn(0x7f511005f6b0 msgr2=0x7f511005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:02.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f5114b94700 1 -- 172.21.15.36:0/359479051 shutdown_connections 2022-01-10T01:31:02.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.257+0000 7f5114b94700 1 -- 172.21.15.36:0/359479051 wait complete. 2022-01-10T01:31:02.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f5114b94700 1 Processor -- start 2022-01-10T01:31:02.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f5114b94700 1 -- start start 2022-01-10T01:31:02.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f5114b94700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51100a70c0 0x7f51100ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:02.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f5114b94700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51100b1db0 0x7f51100af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:02.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f5114b94700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51101483a0 0x7f5110063190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:02.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f5114b94700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5110063680 con 0x7f51101483a0 2022-01-10T01:31:02.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f5114b94700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51100ab8c0 con 0x7f51100a70c0 2022-01-10T01:31:02.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f5114b94700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51100abb60 con 0x7f51100b1db0 2022-01-10T01:31:02.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f510ed9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51101483a0 0x7f5110063190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:02.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f510ed9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51101483a0 0x7f5110063190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38300/0 (socket says 172.21.15.36:38300) 2022-01-10T01:31:02.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f510ed9d700 1 -- 172.21.15.36:0/3478038422 learned_addr learned my addr 172.21.15.36:0/3478038422 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:02.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f510dd9b700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51100b1db0 0x7f51100af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:02.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f510e59c700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51100a70c0 0x7f51100ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:02.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f510dd9b700 1 -- 172.21.15.36:0/3478038422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51100a70c0 msgr2=0x7f51100ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:02.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f510dd9b700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51100a70c0 0x7f51100ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f510dd9b700 1 -- 172.21.15.36:0/3478038422 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51101483a0 msgr2=0x7f5110063190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:02.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f510dd9b700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51101483a0 0x7f5110063190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f510dd9b700 1 -- 172.21.15.36:0/3478038422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f800b180 con 0x7f51100b1db0 2022-01-10T01:31:02.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f510ed9d700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51101483a0 0x7f5110063190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:02.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f510dd9b700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51100b1db0 0x7f51100af280 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f5110147730 tx=0x7f50f8015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:02.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f51077fe700 1 -- 172.21.15.36:0/3478038422 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50f800de90 con 0x7f51100b1db0 2022-01-10T01:31:02.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f51077fe700 1 -- 172.21.15.36:0/3478038422 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f8002f70 con 0x7f51100b1db0 2022-01-10T01:31:02.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f5114b94700 1 -- 172.21.15.36:0/3478038422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51100aae80 con 0x7f51100b1db0 2022-01-10T01:31:02.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f51077fe700 1 -- 172.21.15.36:0/3478038422 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50f8011d70 con 0x7f51100b1db0 2022-01-10T01:31:02.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.261+0000 7f5114b94700 1 -- 172.21.15.36:0/3478038422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511015a030 con 0x7f51100b1db0 2022-01-10T01:31:02.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.265+0000 7f5114b94700 1 -- 172.21.15.36:0/3478038422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51100ab010 con 0x7f51100b1db0 2022-01-10T01:31:02.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.265+0000 7f51077fe700 1 -- 172.21.15.36:0/3478038422 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f50f801a040 con 0x7f51100b1db0 2022-01-10T01:31:02.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.265+0000 7f51077fe700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f50f40536b0 0x7f50f4055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:02.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.265+0000 7f51077fe700 1 -- 172.21.15.36:0/3478038422 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f50f806c830 con 0x7f51100b1db0 2022-01-10T01:31:02.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.265+0000 7f510e59c700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f50f40536b0 0x7f50f4055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:02.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.265+0000 7f510e59c700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f50f40536b0 0x7f50f4055b70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f510000d000 tx=0x7f5100007f10).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:02.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.277+0000 7f51077fe700 1 -- 172.21.15.36:0/3478038422 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f50f8043780 con 0x7f51100b1db0 2022-01-10T01:31:02.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.441+0000 7f5114b94700 1 -- 172.21.15.36:0/3478038422 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51100b0b30 con 0x7f51100b1db0 2022-01-10T01:31:02.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.441+0000 7f51077fe700 1 -- 172.21.15.36:0/3478038422 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f50f8046da0 con 0x7f51100b1db0 2022-01-10T01:31:02.447 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:02.447 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":34,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3321682930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3321682930},{"type":"v1","addr":"172.21.15.59:6833","nonce":3321682930}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/635174626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":635174626},{"type":"v1","addr":"172.21.15.36:6837","nonce":635174626}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:30:08.620792+0000","modified":"2022-01-10T01:30:09.623530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35654":{"gid":35654,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/452951292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":452951292},{"type":"v1","addr":"172.21.15.36:6835","nonce":452951292}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2022-01-10T01:31:02.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.445+0000 7f5114b94700 1 -- 172.21.15.36:0/3478038422 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f50f40536b0 msgr2=0x7f50f4055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:02.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.445+0000 7f5114b94700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f50f40536b0 0x7f50f4055b70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f510000d000 tx=0x7f5100007f10).stop 2022-01-10T01:31:02.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.445+0000 7f5114b94700 1 -- 172.21.15.36:0/3478038422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51100b1db0 msgr2=0x7f51100af280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:02.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.445+0000 7f5114b94700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51100b1db0 0x7f51100af280 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f5110147730 tx=0x7f50f8015000).stop 2022-01-10T01:31:02.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.445+0000 7f5114b94700 1 -- 172.21.15.36:0/3478038422 shutdown_connections 2022-01-10T01:31:02.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.445+0000 7f5114b94700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f50f40536b0 0x7f50f4055b70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.445+0000 7f5114b94700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51101483a0 0x7f5110063190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.445+0000 7f5114b94700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51100b1db0 0x7f51100af280 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.445+0000 7f5114b94700 1 --2- 172.21.15.36:0/3478038422 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51100a70c0 0x7f51100ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:02.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.445+0000 7f5114b94700 1 -- 172.21.15.36:0/3478038422 >> 172.21.15.36:0/3478038422 conn(0x7f511005f6b0 msgr2=0x7f51100b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:02.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.445+0000 7f5114b94700 1 -- 172.21.15.36:0/3478038422 shutdown_connections 2022-01-10T01:31:02.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:02.445+0000 7f5114b94700 1 -- 172.21.15.36:0/3478038422 wait complete. 2022-01-10T01:31:02.452 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 34 2022-01-10T01:31:02.763 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:30:08.620792+0000', 'modified': '2022-01-10T01:30:09.623530+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35654}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35654': {'gid': 35654, 'name': 'a', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6835/452951292', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6834', 'nonce': 452951292}, {'type': 'v1', 'addr': '172.21.15.36:6835', 'nonce': 452951292}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:31:02.764 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:31:02.765 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-10T01:31:02.884 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":35654,"want_state":"up:active","state":"up:active","rank_uptime":54.247477633000003,"mdsmap_epoch":34,"osdmap_epoch":78,"osdmap_epoch_barrier":78,"uptime":58.572782490999998} 2022-01-10T01:31:02.885 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 35654, "mdsmap_epoch": 34, "osdmap_epoch": 78, "osdmap_epoch_barrier": 78, "rank_uptime": 54.247477633, "state": "up:active", "uptime": 58.572782491, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:31:02.885 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:31:02.886 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:31:02.886 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:31:02.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:02.887 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:02.895 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:31:02.956 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:31:02.957 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:31:02.973 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:31:02.974 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:31:02.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:02.976 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:31:02.981 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:31:02.982 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:02.984 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:31:03.002 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:31:03.002 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:31:03.056 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:31:03.057 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:31:03.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:03.059 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:31:03.060 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:31:03.054+0000 7f7848bbc080 -1 init, newargv = 0x558ac52421d0 newargc=9 2022-01-10T01:31:03.060 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14692]: starting ceph client 2022-01-10T01:31:03.069 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14692]: starting fuse 2022-01-10T01:31:04.166 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:31:04.185 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:31:04.185 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:31:04.242 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:31:04.243 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:31:04.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:04.245 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:31:04.250 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:31:04.251 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:31:04.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:04.252 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:31:04.252 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:31:04.253 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:31:04.253 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:31:04.253 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:31:04.254 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:31:04.254 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:31:04.254 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:31:04.255 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:31:04.256 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:31:04.256 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:31:04.256 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:31:04.257 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:31:04.257 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:31:04.258 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:31:04.258 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:31:04.258 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:31:04.259 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:31:04.259 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:31:04.260 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:31:04.260 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:31:04.260 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:31:04.261 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:31:04.303 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.14692.asok 2022-01-10T01:31:04.308 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14692.asok 2022-01-10T01:31:04.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:04.309 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14692.asok status 2022-01-10T01:31:04.445 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:31:04.445 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:31:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:31:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:31:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:31:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:31:04.446 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:31:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "14692", 2022-01-10T01:31:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:31:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:31:04.447 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:31:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:31:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 6499, 2022-01-10T01:31:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:31:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:31:04.448 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:31:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 6499 2022-01-10T01:31:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:31:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:31:04.449 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:31:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:31:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 450910944 2022-01-10T01:31:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:31:04.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:31:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:31:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:31:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:31:04.451 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 450910944 2022-01-10T01:31:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:31:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.6499 172.21.15.139:0/450910944", 2022-01-10T01:31:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/450910944", 2022-01-10T01:31:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:31:04.452 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 34, 2022-01-10T01:31:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 78, 2022-01-10T01:31:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:31:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:31:04.453 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:31:04.454 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:31:04.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:04.456 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:04.457 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:04.464 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:31:04.465 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:31:04.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:04.466 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:04.527 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:31:04.527 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:04.548 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:04.571 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:04.591 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:04.612 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:31:04.613 INFO:tasks.cephfs.mount:Terminating background process 2022-01-10T01:31:04.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:04.613 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:04.614 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:04.622 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:31:04.623 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:31:04.624 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:31:04.624 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:31:04.624 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:04.682 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14692]: fuse finished with error 0 and tester_r 0 2022-01-10T01:31:04.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:04.690 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:04.691 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:04.698 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:31:04.699 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:31:04.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:31:04.817 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:04.866 INFO:tasks.cephfs.mount:Terminating background process 2022-01-10T01:31:04.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:04.868 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:04.868 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:04.876 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:31:04.878 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:31:04.878 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi166.front.sepia.ceph.com... 2022-01-10T01:31:04.878 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:31:04.879 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:04.894 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14175]: fuse finished with error 0 and tester_r 0 2022-01-10T01:31:04.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:04.897 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:04.897 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:04.903 INFO:teuthology.orchestra.run.smithi166.stdout:ext2/ext3 2022-01-10T01:31:04.904 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:31:05.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:31:05.024 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:05.032 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:31:05.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 Processor -- start 2022-01-10T01:31:05.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 -- start start 2022-01-10T01:31:05.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff2800aa080 0x7ff280144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff28005fdd0 0x7ff28014abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2800b6ce0 con 0x7ff2800b6900 2022-01-10T01:31:05.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2800ac550 con 0x7ff2800aa080 2022-01-10T01:31:05.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2800ac7f0 con 0x7ff28005fdd0 2022-01-10T01:31:05.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff27effd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff2800aa080 0x7ff280144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff27f7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff2800b6900 0x7ff2801447c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36098/0 (socket says 172.21.15.36:36098) 2022-01-10T01:31:05.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff27effd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff2800aa080 0x7ff280144ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38306/0 (socket says 172.21.15.36:38306) 2022-01-10T01:31:05.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff27f7fe700 1 -- 172.21.15.36:0/1509571754 learned_addr learned my addr 172.21.15.36:0/1509571754 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:05.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff27ffff700 1 --2- 172.21.15.36:0/1509571754 >> v2:172.21.15.59:3300/0 conn(0x7ff28005fdd0 0x7ff28014abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff27effd700 1 -- 172.21.15.36:0/1509571754 >> v2:172.21.15.59:3300/0 conn(0x7ff28005fdd0 msgr2=0x7ff28014abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:05.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff27effd700 1 --2- 172.21.15.36:0/1509571754 >> v2:172.21.15.59:3300/0 conn(0x7ff28005fdd0 0x7ff28014abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff27effd700 1 -- 172.21.15.36:0/1509571754 >> v1:172.21.15.36:6789/0 conn(0x7ff2800b6900 legacy=0x7ff2801447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff27effd700 1 -- 172.21.15.36:0/1509571754 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2800aca90 con 0x7ff2800aa080 2022-01-10T01:31:05.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff27effd700 1 --2- 172.21.15.36:0/1509571754 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2800aa080 0x7ff280144ed0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7ff2700032f0 tx=0x7ff2700091d0).ready entity=mon.0 client_cookie=e67d6a164d8daaeb server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:05.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff27e7fc700 1 -- 172.21.15.36:0/1509571754 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff270009ea0 con 0x7ff2800aa080 2022-01-10T01:31:05.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff27e7fc700 1 -- 172.21.15.36:0/1509571754 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27000b870 con 0x7ff2800aa080 2022-01-10T01:31:05.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff27e7fc700 1 -- 172.21.15.36:0/1509571754 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff27000b9e0 con 0x7ff2800aa080 2022-01-10T01:31:05.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 -- 172.21.15.36:0/1509571754 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2800aa080 msgr2=0x7ff280144ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 --2- 172.21.15.36:0/1509571754 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2800aa080 0x7ff280144ed0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7ff2700032f0 tx=0x7ff2700091d0).stop 2022-01-10T01:31:05.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 -- 172.21.15.36:0/1509571754 shutdown_connections 2022-01-10T01:31:05.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 --2- 172.21.15.36:0/1509571754 >> v2:172.21.15.59:3300/0 conn(0x7ff28005fdd0 0x7ff28014abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 --2- 172.21.15.36:0/1509571754 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2800aa080 0x7ff280144ed0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 -- 172.21.15.36:0/1509571754 >> 172.21.15.36:0/1509571754 conn(0x7ff2800b3480 msgr2=0x7ff2800b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:05.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 -- 172.21.15.36:0/1509571754 shutdown_connections 2022-01-10T01:31:05.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.141+0000 7ff285d7f700 1 -- 172.21.15.36:0/1509571754 wait complete. 2022-01-10T01:31:05.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff285d7f700 1 Processor -- start 2022-01-10T01:31:05.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff285d7f700 1 -- start start 2022-01-10T01:31:05.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff285d7f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28005fdd0 0x7ff280140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff285d7f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2800aa080 0x7ff280060f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff285d7f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2800b6900 0x7ff2800ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff285d7f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2800b02a0 con 0x7ff2800aa080 2022-01-10T01:31:05.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff285d7f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff280140560 con 0x7ff28005fdd0 2022-01-10T01:31:05.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff285d7f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff280140300 con 0x7ff2800b6900 2022-01-10T01:31:05.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff27effd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2800aa080 0x7ff280060f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff27effd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2800aa080 0x7ff280060f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38310/0 (socket says 172.21.15.36:38310) 2022-01-10T01:31:05.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff27effd700 1 -- 172.21.15.36:0/3869950470 learned_addr learned my addr 172.21.15.36:0/3869950470 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:05.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff27ffff700 1 --2- 172.21.15.36:0/3869950470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2800b6900 0x7ff2800ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff27f7fe700 1 --2- 172.21.15.36:0/3869950470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28005fdd0 0x7ff280140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff27effd700 1 -- 172.21.15.36:0/3869950470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2800b6900 msgr2=0x7ff2800ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff27effd700 1 --2- 172.21.15.36:0/3869950470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2800b6900 0x7ff2800ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff27effd700 1 -- 172.21.15.36:0/3869950470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28005fdd0 msgr2=0x7ff280140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff27effd700 1 --2- 172.21.15.36:0/3869950470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28005fdd0 0x7ff280140770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff27effd700 1 -- 172.21.15.36:0/3869950470 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270009470 con 0x7ff2800aa080 2022-01-10T01:31:05.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff27effd700 1 --2- 172.21.15.36:0/3869950470 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2800aa080 0x7ff280060f40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7ff280141c20 tx=0x7ff270016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:05.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff27cff9700 1 -- 172.21.15.36:0/3869950470 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff270011ea0 con 0x7ff2800aa080 2022-01-10T01:31:05.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff27cff9700 1 -- 172.21.15.36:0/3869950470 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27000b9e0 con 0x7ff2800aa080 2022-01-10T01:31:05.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff285d7f700 1 -- 172.21.15.36:0/3869950470 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28014d660 con 0x7ff2800aa080 2022-01-10T01:31:05.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff27cff9700 1 -- 172.21.15.36:0/3869950470 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff27001f5e0 con 0x7ff2800aa080 2022-01-10T01:31:05.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.145+0000 7ff285d7f700 1 -- 172.21.15.36:0/3869950470 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff280141d00 con 0x7ff2800aa080 2022-01-10T01:31:05.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.149+0000 7ff285d7f700 1 -- 172.21.15.36:0/3869950470 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff280141ec0 con 0x7ff2800aa080 2022-01-10T01:31:05.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.149+0000 7ff27cff9700 1 -- 172.21.15.36:0/3869950470 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff270026030 con 0x7ff2800aa080 2022-01-10T01:31:05.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.149+0000 7ff27cff9700 1 --2- 172.21.15.36:0/3869950470 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2600534d0 0x7ff260055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.149+0000 7ff27cff9700 1 -- 172.21.15.36:0/3869950470 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7ff27006c770 con 0x7ff2800aa080 2022-01-10T01:31:05.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.149+0000 7ff27f7fe700 1 --2- 172.21.15.36:0/3869950470 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2600534d0 0x7ff260055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.149+0000 7ff27f7fe700 1 --2- 172.21.15.36:0/3869950470 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2600534d0 0x7ff260055990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7ff27400d000 tx=0x7ff274009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:05.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.157+0000 7ff27cff9700 1 -- 172.21.15.36:0/3869950470 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2700436c0 con 0x7ff2800aa080 2022-01-10T01:31:05.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.281+0000 7ff285d7f700 1 -- 172.21.15.36:0/3869950470 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff2800acd30 con 0x7ff2800aa080 2022-01-10T01:31:05.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.285+0000 7ff27cff9700 1 -- 172.21.15.36:0/3869950470 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v78) v1 ==== 81+0+34117 (secure 0 0 0) 0x7ff270015090 con 0x7ff2800aa080 2022-01-10T01:31:05.290 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:05.290 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:31:05.291 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 78, 2022-01-10T01:31:05.291 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:31:05.291 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:31:05.291 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:30:54.647270+0000", 2022-01-10T01:31:05.292 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:31:05.292 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:31:05.292 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:31:05.292 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:31:05.292 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:31:05.293 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:31:05.293 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:31:05.293 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:31:05.293 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:31:05.294 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:05.294 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:31:05.294 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:31:05.294 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:31:05.295 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:31:05.295 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:31:05.295 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 14, 2022-01-10T01:31:05.295 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:31:05.295 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:31:05.296 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:31:05.296 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:31:05.296 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:31:05.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.297 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:31:05.297 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:31:05.297 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:31:05.297 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:05.297 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:05.298 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:05.298 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:05.298 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:05.298 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:05.299 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:05.299 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:05.299 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:31:05.299 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:31:05.300 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:31:05.300 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:31:05.300 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:31:05.300 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:05.300 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:05.301 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:05.301 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:05.301 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:05.301 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:05.302 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:05.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.302 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:31:05.302 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:05.302 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:05.303 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:05.303 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:05.303 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:05.303 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:05.304 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:05.304 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:05.304 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:05.304 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:05.304 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:05.305 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:05.305 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:05.305 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:05.305 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:05.306 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:05.306 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:05.306 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:05.306 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:05.306 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:05.307 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:05.307 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:05.307 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:05.307 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:05.308 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:05.308 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:05.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.308 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:05.308 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:05.309 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:05.309 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:05.309 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:05.309 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:05.309 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:05.310 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:05.310 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:05.310 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:05.310 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:05.310 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:31:05.311 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:31:05.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.311 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:05.311 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:31:05.312 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.312 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:31:05.312 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:31:05.313 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:31:05.313 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:05.313 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:05.313 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:05.314 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:05.314 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:05.314 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:05.314 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:05.315 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:05.315 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:31:05.315 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:31:05.315 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:31:05.316 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:31:05.316 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:31:05.316 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:05.316 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:05.316 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:05.317 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:05.317 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:05.317 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:05.317 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:05.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.318 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:31:05.318 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:05.318 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:05.318 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:05.318 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:05.319 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:05.319 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:05.319 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:05.319 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:05.319 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:05.320 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:05.320 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:05.320 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:05.320 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:05.321 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:05.321 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:05.321 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:05.321 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:05.321 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:05.322 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:05.322 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:05.322 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:05.322 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:05.323 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:05.323 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:05.323 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:05.323 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:05.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.324 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:05.324 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:05.324 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:05.324 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:05.324 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:05.325 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:05.325 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:05.325 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:05.325 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:05.325 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:05.326 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:05.326 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:31:05.326 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:05.326 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:31:05.327 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.327 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 13, 2022-01-10T01:31:05.327 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_metadata", 2022-01-10T01:31:05.328 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:30:07.078168+0000", 2022-01-10T01:31:05.328 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:05.328 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:05.328 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:05.329 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:05.329 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:05.329 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:05.329 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:05.329 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:05.330 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:31:05.330 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:31:05.330 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:31:05.330 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:31:05.330 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:31:05.331 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:05.331 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:05.331 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:05.331 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:05.332 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:05.332 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:05.332 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:05.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.332 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "77", 2022-01-10T01:31:05.333 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:05.333 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:05.333 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:05.333 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:05.334 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:05.334 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:05.334 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:05.334 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:05.334 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:05.335 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:05.335 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:05.335 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:05.335 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:05.336 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:05.336 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:05.336 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:05.336 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:05.336 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:05.337 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:05.337 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:05.337 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:05.337 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:05.337 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:05.338 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:05.338 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:05.338 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:05.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.339 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:05.339 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:05.339 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:05.339 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:05.339 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:05.340 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:05.340 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:05.340 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:05.340 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:05.341 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:05.341 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:05.341 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:31:05.341 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_bias": 4, 2022-01-10T01:31:05.341 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 16, 2022-01-10T01:31:05.342 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_priority": 5 2022-01-10T01:31:05.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.342 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:05.342 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:31:05.343 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": "cephfs" 2022-01-10T01:31:05.343 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.343 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.344 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 14, 2022-01-10T01:31:05.344 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_data", 2022-01-10T01:31:05.344 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:30:08.044365+0000", 2022-01-10T01:31:05.344 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:05.345 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:05.345 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:05.345 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:05.345 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:05.345 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:05.346 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:05.346 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:05.346 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:31:05.346 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:31:05.346 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:31:05.347 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:31:05.347 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:31:05.347 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:05.347 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:05.348 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:05.348 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:05.348 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:05.348 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:05.348 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:05.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.349 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "77", 2022-01-10T01:31:05.349 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:05.349 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:05.350 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:05.350 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:05.350 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:05.350 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:05.351 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:05.351 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:05.351 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:05.351 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:05.351 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:05.352 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:05.352 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:05.352 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:05.352 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:05.353 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:05.353 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:05.353 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:05.353 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:05.353 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:05.354 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:05.354 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:05.354 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:05.354 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:05.355 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:05.355 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:05.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.355 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:05.355 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:05.356 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:05.356 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:05.356 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:05.356 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:05.357 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:05.357 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:05.357 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:05.357 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:05.357 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:05.358 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:31:05.358 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:05.358 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:31:05.358 INFO:teuthology.orchestra.run.smithi036.stdout: "data": "cephfs" 2022-01-10T01:31:05.358 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.359 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.359 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.359 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:05.359 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:31:05.360 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.360 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:31:05.360 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:31:05.360 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:05.360 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:05.361 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:05.361 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:05.361 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:05.361 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:05.362 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:05.362 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 65, 2022-01-10T01:31:05.362 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:05.362 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:05.362 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:05.363 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.363 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.363 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.363 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:31:05.364 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:05.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.364 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.364 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:31:05.365 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:05.365 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.365 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.366 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:05.366 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.366 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.366 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:31:05.367 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:05.367 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.367 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.367 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.368 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:31:05.368 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:05.368 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.368 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.368 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.369 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:05.369 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.369 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.369 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.370 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:31:05.370 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:05.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.370 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.371 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:31:05.371 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:05.371 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.371 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.372 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:05.372 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.372 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.372 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.373 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:31:05.373 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:05.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.373 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.374 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:31:05.374 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:05.374 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.374 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.375 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:31:05.375 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:31:05.375 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:31:05.376 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:31:05.376 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:05.376 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:05.376 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:05.376 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.377 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.377 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:31:05.377 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:31:05.377 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:05.378 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:05.378 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:05.378 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:05.378 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:05.379 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:05.379 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:05.379 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 75, 2022-01-10T01:31:05.379 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:05.380 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:05.380 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:05.380 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.380 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.381 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:31:05.381 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:05.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.382 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.382 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:31:05.382 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:05.382 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.383 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.383 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.383 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:05.383 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.384 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.384 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:31:05.384 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:05.384 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.385 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.385 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:31:05.385 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:05.385 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.386 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.386 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:05.386 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.387 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.387 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:31:05.387 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:05.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.388 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.388 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:31:05.388 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:05.388 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.389 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.389 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:05.389 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.390 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.390 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:31:05.390 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:05.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.391 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.391 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:31:05.391 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:05.392 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.392 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.392 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:31:05.393 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:31:05.393 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:31:05.393 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:31:05.393 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:05.393 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:05.394 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:05.394 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.394 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:31:05.395 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:31:05.395 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:05.395 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:05.395 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:05.396 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:05.396 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:05.396 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:05.396 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:05.396 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 75, 2022-01-10T01:31:05.397 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:05.397 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:05.397 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:05.397 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.398 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.398 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:31:05.398 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:05.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.399 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.399 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:31:05.399 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:05.400 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.400 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.400 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.400 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:05.401 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.401 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.401 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.401 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:31:05.401 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:05.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.402 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.402 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:31:05.403 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:05.403 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.403 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.404 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:05.404 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.404 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.404 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:31:05.405 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:05.405 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.405 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.406 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:31:05.406 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:05.406 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.406 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.407 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:05.407 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.407 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.407 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.408 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:31:05.408 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:05.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.409 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.409 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:31:05.409 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:05.409 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.409 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.410 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:31:05.410 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:31:05.410 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:31:05.411 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:31:05.411 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:05.411 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:05.411 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:05.411 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.412 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:31:05.412 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:31:05.412 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:05.413 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:05.413 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:05.413 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:05.413 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:05.414 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:05.414 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:05.414 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 74, 2022-01-10T01:31:05.414 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:05.415 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:05.415 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:05.415 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.415 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.416 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:31:05.416 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:05.416 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.417 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.417 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:31:05.417 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:05.417 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.417 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.418 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:05.418 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.419 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.419 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:31:05.419 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:05.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.420 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.420 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:31:05.420 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:05.420 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.421 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.421 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:05.421 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.422 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.422 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:31:05.422 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:05.422 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.423 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.423 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:31:05.423 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:05.424 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.424 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.424 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:05.424 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.425 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.425 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:31:05.425 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:05.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.426 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.426 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:31:05.426 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:05.427 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.427 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.427 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:31:05.428 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:31:05.428 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:31:05.428 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:31:05.428 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:05.428 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:05.429 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:05.429 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.429 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:31:05.430 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:31:05.430 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:05.430 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:05.430 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:05.431 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:05.431 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:05.431 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:05.431 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:05.431 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 75, 2022-01-10T01:31:05.432 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:05.432 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:05.432 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:05.432 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.433 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.433 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:31:05.433 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:05.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.434 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.434 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:31:05.434 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:05.435 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.435 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.435 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:05.435 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.436 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.436 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:31:05.436 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:05.437 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.437 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.437 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:31:05.437 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:05.438 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.438 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.438 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:05.439 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.439 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.439 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:31:05.439 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:05.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.440 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.440 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:31:05.441 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:05.441 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.441 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.441 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:05.442 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.442 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.442 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.442 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:31:05.443 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:05.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.443 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.443 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:31:05.444 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:05.444 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.444 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.445 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:31:05.445 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:31:05.445 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:31:05.445 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:31:05.445 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:05.446 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:05.446 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:05.446 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.447 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:31:05.447 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:31:05.447 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:05.448 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:05.448 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:05.448 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:05.448 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:05.448 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:05.449 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:05.449 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 75, 2022-01-10T01:31:05.449 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:05.449 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:05.450 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:05.450 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.450 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.450 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:31:05.451 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:05.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.451 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.452 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:31:05.452 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:05.452 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.452 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.452 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.453 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:05.453 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.453 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.454 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:31:05.454 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:05.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.454 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.455 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:31:05.455 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:05.455 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.455 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.456 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:05.456 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.457 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.457 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:31:05.457 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:05.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.458 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.458 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:31:05.458 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:05.458 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.459 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.459 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:05.459 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.460 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.460 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:31:05.460 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:05.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.461 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.461 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:31:05.461 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:05.462 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.462 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.462 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:31:05.463 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:31:05.463 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:31:05.463 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:31:05.463 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:05.463 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:05.464 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:05.464 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.464 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.465 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:31:05.465 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:31:05.465 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:05.465 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:05.465 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:05.466 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:05.466 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:05.466 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:05.466 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:05.467 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 74, 2022-01-10T01:31:05.467 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:05.467 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:05.467 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:05.468 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.468 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.468 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:31:05.468 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:05.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.469 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.469 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:31:05.470 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:05.470 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.470 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.470 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.471 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:05.471 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.471 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.471 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:31:05.472 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:05.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.472 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.473 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:31:05.473 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:05.473 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.473 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.474 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:05.474 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.474 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.475 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:31:05.475 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:05.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.475 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.476 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:31:05.476 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:05.476 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.476 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.477 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:05.477 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.477 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.478 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:31:05.478 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:05.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.479 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.479 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:31:05.479 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:05.479 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.480 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.480 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:31:05.480 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:31:05.480 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:31:05.481 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:31:05.481 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:05.481 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:05.481 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:05.481 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.482 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:31:05.482 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:31:05.483 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:05.483 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:05.483 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:05.483 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:05.483 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:05.484 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:05.484 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:05.484 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 75, 2022-01-10T01:31:05.484 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:05.484 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:05.485 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:05.485 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.485 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.486 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:31:05.486 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:05.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.486 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.487 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:31:05.487 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:05.487 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.487 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.488 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.488 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:05.488 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.488 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.489 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:31:05.489 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:05.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.490 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.490 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:31:05.490 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:05.490 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.490 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.491 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:05.491 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.492 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.492 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:31:05.492 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:05.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.493 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.493 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:31:05.493 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:05.493 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.493 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.494 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:05.494 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:05.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.495 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:05.495 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:31:05.495 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:05.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.496 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:05.496 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:31:05.496 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:05.496 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.497 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.497 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:31:05.497 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:31:05.498 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:31:05.498 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:31:05.498 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:05.498 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:05.498 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:05.499 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:05.499 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.499 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:05.499 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:31:05.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.500 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:31:05.500 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:05.500 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:05.500 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:05.501 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:05.501 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:05.501 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:31:05.501 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:05.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.502 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:31:05.502 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:05.503 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:05.503 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:05.503 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:05.503 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:05.503 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:31:05.504 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:05.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.504 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.504 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:31:05.505 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:05.505 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:05.505 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:05.505 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:05.506 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:05.506 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:31:05.506 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:05.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.507 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:31:05.507 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:05.507 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:05.508 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:05.508 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:05.508 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:05.508 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:31:05.508 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:05.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.509 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:31:05.509 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:05.510 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:05.510 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:05.510 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:05.510 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:05.511 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:31:05.511 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:05.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.511 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:31:05.512 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:05.512 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:05.512 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:05.512 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:05.513 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:05.513 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:31:05.513 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:05.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.514 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:31:05.514 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:05.514 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:05.514 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:05.515 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:05.515 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:05.515 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:31:05.515 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:05.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:05.516 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:31:05.516 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:05.516 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:05.517 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:05.517 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:05.517 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:05.517 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:31:05.518 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:05.518 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.518 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:05.518 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:31:05.518 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:31:05.519 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:31:05.519 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:31:05.519 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": { 2022-01-10T01:31:05.519 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.139:0/1396023791": "2022-01-10T02:30:54.308570+0000" 2022-01-10T01:31:05.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.520 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:31:05.520 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:31:05.520 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:31:05.521 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:31:05.521 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:31:05.521 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:31:05.521 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:31:05.521 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:31:05.522 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:31:05.522 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:31:05.522 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:31:05.522 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:31:05.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.523 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:31:05.523 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:31:05.523 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:31:05.524 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:31:05.524 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:31:05.524 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:31:05.524 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:31:05.524 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:05.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:05.525 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:31:05.525 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:31:05.525 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:31:05.526 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:31:05.526 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:31:05.526 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:31:05.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.285+0000 7ff285d7f700 1 -- 172.21.15.36:0/3869950470 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2600534d0 msgr2=0x7ff260055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.285+0000 7ff285d7f700 1 --2- 172.21.15.36:0/3869950470 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2600534d0 0x7ff260055990 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7ff27400d000 tx=0x7ff274009040).stop 2022-01-10T01:31:05.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.285+0000 7ff285d7f700 1 -- 172.21.15.36:0/3869950470 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2800aa080 msgr2=0x7ff280060f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.285+0000 7ff285d7f700 1 --2- 172.21.15.36:0/3869950470 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2800aa080 0x7ff280060f40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7ff280141c20 tx=0x7ff270016000).stop 2022-01-10T01:31:05.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.289+0000 7ff285d7f700 1 -- 172.21.15.36:0/3869950470 shutdown_connections 2022-01-10T01:31:05.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.289+0000 7ff285d7f700 1 --2- 172.21.15.36:0/3869950470 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2600534d0 0x7ff260055990 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.289+0000 7ff285d7f700 1 --2- 172.21.15.36:0/3869950470 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2800b6900 0x7ff2800ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.289+0000 7ff285d7f700 1 --2- 172.21.15.36:0/3869950470 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2800aa080 0x7ff280060f40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.289+0000 7ff285d7f700 1 --2- 172.21.15.36:0/3869950470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff28005fdd0 0x7ff280140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.289+0000 7ff285d7f700 1 -- 172.21.15.36:0/3869950470 >> 172.21.15.36:0/3869950470 conn(0x7ff2800b3480 msgr2=0x7ff2800b5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:05.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.289+0000 7ff285d7f700 1 -- 172.21.15.36:0/3869950470 shutdown_connections 2022-01-10T01:31:05.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.289+0000 7ff285d7f700 1 -- 172.21.15.36:0/3869950470 wait complete. 2022-01-10T01:31:05.532 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:05.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e3fff700 1 Processor -- start 2022-01-10T01:31:05.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e3fff700 1 -- start start 2022-01-10T01:31:05.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e40a8ac0 0x7f52e4152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e3fff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e40a70c0 con 0x7f52e40b0010 2022-01-10T01:31:05.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e3fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e40a72f0 con 0x7f52e40b2580 2022-01-10T01:31:05.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e3fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40a7590 con 0x7f52e40a8ac0 2022-01-10T01:31:05.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e27fc700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f52e40b0010 0x7f52e40a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36114/0 (socket says 172.21.15.36:36114) 2022-01-10T01:31:05.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e27fc700 1 -- 172.21.15.36:0/238581856 learned_addr learned my addr 172.21.15.36:0/238581856 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:05.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e37fe700 1 --2- 172.21.15.36:0/238581856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e40a8ac0 0x7f52e4152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677798365 0 0) 0x7f52e40a70c0 con 0x7f52e40b0010 2022-01-10T01:31:05.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52c4003260 con 0x7f52e40b0010 2022-01-10T01:31:05.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416935806 0 0) 0x7f52e40a72f0 con 0x7f52e40b2580 2022-01-10T01:31:05.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e40a70c0 con 0x7f52e40b2580 2022-01-10T01:31:05.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3191301212 0 0) 0x7f52c4003260 con 0x7f52e40b0010 2022-01-10T01:31:05.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e40a8ac0 msgr2=0x7f52e4152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:05.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 --2- 172.21.15.36:0/238581856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e40a8ac0 0x7f52e4152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 >> v1:172.21.15.59:6789/0 conn(0x7f52e40b2580 legacy=0x7f52e414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e40a7830 con 0x7f52e40b0010 2022-01-10T01:31:05.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f52cc001660 con 0x7f52e40b0010 2022-01-10T01:31:05.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 >> v1:172.21.15.36:6789/0 conn(0x7f52e40b0010 legacy=0x7f52e40a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 --2- 172.21.15.36:0/238581856 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52c4003910 0x7f52c4003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 --2- 172.21.15.36:0/238581856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e40a8ac0 0x7f52c4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 --2- 172.21.15.36:0/238581856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52c40049f0 0x7f52c4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40a7590 con 0x7f52c4003910 2022-01-10T01:31:05.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c400b780 con 0x7f52c40049f0 2022-01-10T01:31:05.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c400b940 con 0x7f52e40a8ac0 2022-01-10T01:31:05.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e2ffd700 1 --2- 172.21.15.36:0/238581856 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52c4003910 0x7f52c4003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.641+0000 7f52e27fc700 1 --2- 172.21.15.36:0/238581856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e40a8ac0 0x7f52c4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e37fe700 1 --2- 172.21.15.36:0/238581856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52c40049f0 0x7f52c4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e2ffd700 1 -- 172.21.15.36:0/238581856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e40a8ac0 msgr2=0x7f52c4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:05.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e2ffd700 1 --2- 172.21.15.36:0/238581856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e40a8ac0 0x7f52c4004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e2ffd700 1 -- 172.21.15.36:0/238581856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52c40049f0 msgr2=0x7f52c4004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:05.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e2ffd700 1 --2- 172.21.15.36:0/238581856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52c40049f0 0x7f52c4004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e2ffd700 1 -- 172.21.15.36:0/238581856 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4003260 con 0x7f52c4003910 2022-01-10T01:31:05.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e37fe700 1 --2- 172.21.15.36:0/238581856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52c40049f0 0x7f52c4004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:05.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e2ffd700 1 --2- 172.21.15.36:0/238581856 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52c4003910 0x7f52c4003d10 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f52dc001490 tx=0x7f52dc007d80).ready entity=mon.0 client_cookie=4bb8ed7184f70b94 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:05.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52dc001780 con 0x7f52c4003910 2022-01-10T01:31:05.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc006890 con 0x7f52c4003910 2022-01-10T01:31:05.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e1ffb700 1 -- 172.21.15.36:0/238581856 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52dc006bf0 con 0x7f52c4003910 2022-01-10T01:31:05.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e3fff700 1 -- 172.21.15.36:0/238581856 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52c4003910 msgr2=0x7f52c4003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e3fff700 1 --2- 172.21.15.36:0/238581856 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52c4003910 0x7f52c4003d10 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f52dc001490 tx=0x7f52dc007d80).stop 2022-01-10T01:31:05.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e37fe700 1 -- 172.21.15.36:0/238581856 reap_dead start 2022-01-10T01:31:05.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e3fff700 1 -- 172.21.15.36:0/238581856 shutdown_connections 2022-01-10T01:31:05.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e3fff700 1 -- 172.21.15.36:0/238581856 >> 172.21.15.36:0/238581856 conn(0x7f52e4060180 msgr2=0x7f52e40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:05.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e3fff700 1 -- 172.21.15.36:0/238581856 shutdown_connections 2022-01-10T01:31:05.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e3fff700 1 -- 172.21.15.36:0/238581856 wait complete. 2022-01-10T01:31:05.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e3fff700 1 Processor -- start 2022-01-10T01:31:05.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e3fff700 1 -- start start 2022-01-10T01:31:05.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e3fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52e40aec00 0x7f52e40aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e40ab260 0x7f52e4156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e4156a80 0x7f52e4066010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e3fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40ac250 con 0x7f52e40aec00 2022-01-10T01:31:05.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e3fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40aefe0 con 0x7f52e40ab260 2022-01-10T01:31:05.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e3fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40ab770 con 0x7f52e4156a80 2022-01-10T01:31:05.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e2ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52e40aec00 0x7f52e40aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e2ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52e40aec00 0x7f52e40aabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38330/0 (socket says 172.21.15.36:38330) 2022-01-10T01:31:05.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.645+0000 7f52e2ffd700 1 -- 172.21.15.36:0/260241830 learned_addr learned my addr 172.21.15.36:0/260241830 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:05.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52e37fe700 1 --2- 172.21.15.36:0/260241830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e4156a80 0x7f52e4066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52e27fc700 1 --2- 172.21.15.36:0/260241830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e40ab260 0x7f52e4156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52e2ffd700 1 -- 172.21.15.36:0/260241830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e4156a80 msgr2=0x7f52e4066010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52e2ffd700 1 --2- 172.21.15.36:0/260241830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e4156a80 0x7f52e4066010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52e2ffd700 1 -- 172.21.15.36:0/260241830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e40ab260 msgr2=0x7f52e4156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52e2ffd700 1 --2- 172.21.15.36:0/260241830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e40ab260 0x7f52e4156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52e2ffd700 1 -- 172.21.15.36:0/260241830 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e40abd10 con 0x7f52e40aec00 2022-01-10T01:31:05.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52e2ffd700 1 --2- 172.21.15.36:0/260241830 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52e40aec00 0x7f52e40aabf0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f52dc001490 tx=0x7f52dc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:05.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52dbfff700 1 -- 172.21.15.36:0/260241830 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52dc001780 con 0x7f52e40aec00 2022-01-10T01:31:05.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52dbfff700 1 -- 172.21.15.36:0/260241830 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc00ced0 con 0x7f52e40aec00 2022-01-10T01:31:05.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52e3fff700 1 -- 172.21.15.36:0/260241830 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e40abfb0 con 0x7f52e40aec00 2022-01-10T01:31:05.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52dbfff700 1 -- 172.21.15.36:0/260241830 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52dc01e3f0 con 0x7f52e40aec00 2022-01-10T01:31:05.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52e3fff700 1 -- 172.21.15.36:0/260241830 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e40ac480 con 0x7f52e40aec00 2022-01-10T01:31:05.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52dbfff700 1 -- 172.21.15.36:0/260241830 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f52dc025030 con 0x7f52e40aec00 2022-01-10T01:31:05.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52e3fff700 1 -- 172.21.15.36:0/260241830 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e4057350 con 0x7f52e40aec00 2022-01-10T01:31:05.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52dbfff700 1 --2- 172.21.15.36:0/260241830 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f52c8053560 0x7f52c8055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52dbfff700 1 -- 172.21.15.36:0/260241830 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f52dc06ccd0 con 0x7f52e40aec00 2022-01-10T01:31:05.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.649+0000 7f52e27fc700 1 --2- 172.21.15.36:0/260241830 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f52c8053560 0x7f52c8055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.653+0000 7f52e27fc700 1 --2- 172.21.15.36:0/260241830 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f52c8053560 0x7f52c8055a20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f52cc00d000 tx=0x7f52cc007040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:05.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.657+0000 7f52dbfff700 1 -- 172.21.15.36:0/260241830 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f52dc043cc0 con 0x7f52e40aec00 2022-01-10T01:31:05.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.817+0000 7f52e3fff700 1 -- 172.21.15.36:0/260241830 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52e40698e0 con 0x7f52e40aec00 2022-01-10T01:31:05.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.817+0000 7f52dbfff700 1 -- 172.21.15.36:0/260241830 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f52dc023070 con 0x7f52e40aec00 2022-01-10T01:31:05.822 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:05.822 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":34,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3321682930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3321682930},{"type":"v1","addr":"172.21.15.59:6833","nonce":3321682930}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/635174626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":635174626},{"type":"v1","addr":"172.21.15.36:6837","nonce":635174626}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:30:08.620792+0000","modified":"2022-01-10T01:30:09.623530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":35654},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35654":{"gid":35654,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/452951292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":452951292},{"type":"v1","addr":"172.21.15.36:6835","nonce":452951292}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2022-01-10T01:31:05.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.817+0000 7f52e3fff700 1 -- 172.21.15.36:0/260241830 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f52c8053560 msgr2=0x7f52c8055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.817+0000 7f52e3fff700 1 --2- 172.21.15.36:0/260241830 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f52c8053560 0x7f52c8055a20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f52cc00d000 tx=0x7f52cc007040).stop 2022-01-10T01:31:05.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.817+0000 7f52e3fff700 1 -- 172.21.15.36:0/260241830 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52e40aec00 msgr2=0x7f52e40aabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.817+0000 7f52e3fff700 1 --2- 172.21.15.36:0/260241830 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52e40aec00 0x7f52e40aabf0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f52dc001490 tx=0x7f52dc016000).stop 2022-01-10T01:31:05.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.817+0000 7f52e3fff700 1 -- 172.21.15.36:0/260241830 shutdown_connections 2022-01-10T01:31:05.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.817+0000 7f52e3fff700 1 --2- 172.21.15.36:0/260241830 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f52c8053560 0x7f52c8055a20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.817+0000 7f52e3fff700 1 --2- 172.21.15.36:0/260241830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52e4156a80 0x7f52e4066010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.817+0000 7f52e3fff700 1 --2- 172.21.15.36:0/260241830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52e40ab260 0x7f52e4156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.817+0000 7f52e3fff700 1 --2- 172.21.15.36:0/260241830 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f52e40aec00 0x7f52e40aabf0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.817+0000 7f52e3fff700 1 -- 172.21.15.36:0/260241830 >> 172.21.15.36:0/260241830 conn(0x7f52e4060180 msgr2=0x7f52e4145980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:05.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.817+0000 7f52e3fff700 1 -- 172.21.15.36:0/260241830 shutdown_connections 2022-01-10T01:31:05.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.821+0000 7f52e3fff700 1 -- 172.21.15.36:0/260241830 wait complete. 2022-01-10T01:31:05.827 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 34 2022-01-10T01:31:05.835 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2022-01-10T01:31:05.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a90c700 1 Processor -- start 2022-01-10T01:31:05.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a90c700 1 -- start start 2022-01-10T01:31:05.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a90c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01240b0010 0x7f01240a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a90c700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01240a70c0 con 0x7f01240afbd0 2022-01-10T01:31:05.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a90c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01240a72f0 con 0x7f01240b2580 2022-01-10T01:31:05.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a90c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01240a7590 con 0x7f01240b0010 2022-01-10T01:31:05.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a10b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f01240afbd0 0x7f0124151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36136/0 (socket says 172.21.15.36:36136) 2022-01-10T01:31:05.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a10b700 1 -- 172.21.15.36:0/1263619889 learned_addr learned my addr 172.21.15.36:0/1263619889 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:05.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0129109700 1 --2- 172.21.15.36:0/1263619889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01240b0010 0x7f01240a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 -- 172.21.15.36:0/1263619889 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233062777 0 0) 0x7f01240a70c0 con 0x7f01240afbd0 2022-01-10T01:31:05.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 -- 172.21.15.36:0/1263619889 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0108003260 con 0x7f01240afbd0 2022-01-10T01:31:05.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 -- 172.21.15.36:0/1263619889 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1620298764 0 0) 0x7f0108003260 con 0x7f01240afbd0 2022-01-10T01:31:05.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 -- 172.21.15.36:0/1263619889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01240b0010 msgr2=0x7f01240a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:05.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 --2- 172.21.15.36:0/1263619889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01240b0010 0x7f01240a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 -- 172.21.15.36:0/1263619889 >> v1:172.21.15.59:6789/0 conn(0x7f01240b2580 legacy=0x7f012414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 -- 172.21.15.36:0/1263619889 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01240a7830 con 0x7f01240afbd0 2022-01-10T01:31:05.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 -- 172.21.15.36:0/1263619889 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f011c0019e0 con 0x7f01240afbd0 2022-01-10T01:31:05.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 -- 172.21.15.36:0/1263619889 >> v1:172.21.15.36:6789/0 conn(0x7f01240afbd0 legacy=0x7f0124151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 --2- 172.21.15.36:0/1263619889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0108003780 0x7f0108003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 --2- 172.21.15.36:0/1263619889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01240b0010 0x7f0108004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 --2- 172.21.15.36:0/1263619889 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f01080049f0 0x7f0108004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 -- 172.21.15.36:0/1263619889 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01240a7590 con 0x7f01080049f0 2022-01-10T01:31:05.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 -- 172.21.15.36:0/1263619889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010800b750 con 0x7f0108003780 2022-01-10T01:31:05.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 -- 172.21.15.36:0/1263619889 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010800b910 con 0x7f01240b0010 2022-01-10T01:31:05.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0129109700 1 --2- 172.21.15.36:0/1263619889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01240b0010 0x7f0108004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a10b700 1 --2- 172.21.15.36:0/1263619889 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f01080049f0 0x7f0108004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012990a700 1 --2- 172.21.15.36:0/1263619889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0108003780 0x7f0108003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a10b700 1 -- 172.21.15.36:0/1263619889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01240b0010 msgr2=0x7f0108004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:05.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a10b700 1 --2- 172.21.15.36:0/1263619889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01240b0010 0x7f0108004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a10b700 1 -- 172.21.15.36:0/1263619889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0108003780 msgr2=0x7f0108003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:05.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a10b700 1 --2- 172.21.15.36:0/1263619889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0108003780 0x7f0108003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a10b700 1 -- 172.21.15.36:0/1263619889 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01240a7830 con 0x7f01080049f0 2022-01-10T01:31:05.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012990a700 1 --2- 172.21.15.36:0/1263619889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0108003780 0x7f0108003ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:05.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0129109700 1 --2- 172.21.15.36:0/1263619889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01240b0010 0x7f0108004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:05.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f012a10b700 1 --2- 172.21.15.36:0/1263619889 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f01080049f0 0x7f0108004e70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f011c0016f0 tx=0x7f011c002210).ready entity=mon.0 client_cookie=cbe81ef5b8f3f51c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:05.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 -- 172.21.15.36:0/1263619889 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f011c00cd50 con 0x7f01080049f0 2022-01-10T01:31:05.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 -- 172.21.15.36:0/1263619889 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c005990 con 0x7f01080049f0 2022-01-10T01:31:05.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.937+0000 7f0128908700 1 -- 172.21.15.36:0/1263619889 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f011c005cf0 con 0x7f01080049f0 2022-01-10T01:31:05.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 -- 172.21.15.36:0/1263619889 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f01080049f0 msgr2=0x7f0108004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 --2- 172.21.15.36:0/1263619889 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f01080049f0 0x7f0108004e70 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f011c0016f0 tx=0x7f011c002210).stop 2022-01-10T01:31:05.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a10b700 1 -- 172.21.15.36:0/1263619889 reap_dead start 2022-01-10T01:31:05.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 -- 172.21.15.36:0/1263619889 shutdown_connections 2022-01-10T01:31:05.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 -- 172.21.15.36:0/1263619889 >> 172.21.15.36:0/1263619889 conn(0x7f0124060180 msgr2=0x7f01240b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:05.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 -- 172.21.15.36:0/1263619889 shutdown_connections 2022-01-10T01:31:05.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 -- 172.21.15.36:0/1263619889 wait complete. 2022-01-10T01:31:05.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 Processor -- start 2022-01-10T01:31:05.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 -- start start 2022-01-10T01:31:05.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0124063930 0x7f01240a9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0124159c70 0x7f012415a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f012415a5e0 0x7f01240aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0124066490 con 0x7f0124063930 2022-01-10T01:31:05.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0124063d10 con 0x7f012415a5e0 2022-01-10T01:31:05.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01240666c0 con 0x7f0124159c70 2022-01-10T01:31:05.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012990a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0124063930 0x7f01240a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012990a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0124063930 0x7f01240a9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38350/0 (socket says 172.21.15.36:38350) 2022-01-10T01:31:05.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012990a700 1 -- 172.21.15.36:0/103591572 learned_addr learned my addr 172.21.15.36:0/103591572 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:05.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f0129109700 1 --2- 172.21.15.36:0/103591572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0124159c70 0x7f012415a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a10b700 1 --2- 172.21.15.36:0/103591572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f012415a5e0 0x7f01240aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012990a700 1 -- 172.21.15.36:0/103591572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0124159c70 msgr2=0x7f012415a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012990a700 1 --2- 172.21.15.36:0/103591572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0124159c70 0x7f012415a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012990a700 1 -- 172.21.15.36:0/103591572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f012415a5e0 msgr2=0x7f01240aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:05.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012990a700 1 --2- 172.21.15.36:0/103591572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f012415a5e0 0x7f01240aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:05.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012990a700 1 -- 172.21.15.36:0/103591572 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0124066960 con 0x7f0124063930 2022-01-10T01:31:05.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012990a700 1 --2- 172.21.15.36:0/103591572 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0124063930 0x7f01240a9140 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f0120007580 tx=0x7f0120009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:05.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f011affd700 1 -- 172.21.15.36:0/103591572 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0120011780 con 0x7f0124063930 2022-01-10T01:31:05.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f011affd700 1 -- 172.21.15.36:0/103591572 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01200118e0 con 0x7f0124063930 2022-01-10T01:31:05.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 -- 172.21.15.36:0/103591572 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0124066c00 con 0x7f0124063930 2022-01-10T01:31:05.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f011affd700 1 -- 172.21.15.36:0/103591572 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0120011c40 con 0x7f0124063930 2022-01-10T01:31:05.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.941+0000 7f012a90c700 1 -- 172.21.15.36:0/103591572 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01240a9630 con 0x7f0124063930 2022-01-10T01:31:05.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.945+0000 7f011affd700 1 -- 172.21.15.36:0/103591572 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f012001a030 con 0x7f0124063930 2022-01-10T01:31:05.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.945+0000 7f012a90c700 1 -- 172.21.15.36:0/103591572 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0124057350 con 0x7f0124063930 2022-01-10T01:31:05.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.945+0000 7f011affd700 1 --2- 172.21.15.36:0/103591572 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f010c0536b0 0x7f010c055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:05.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.945+0000 7f011affd700 1 -- 172.21.15.36:0/103591572 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f012006b6a0 con 0x7f0124063930 2022-01-10T01:31:05.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.945+0000 7f0129109700 1 --2- 172.21.15.36:0/103591572 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f010c0536b0 0x7f010c055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:05.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.945+0000 7f0129109700 1 --2- 172.21.15.36:0/103591572 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f010c0536b0 0x7f010c055b70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f011400b000 tx=0x7f0114008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:05.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:05.949+0000 7f011affd700 1 -- 172.21.15.36:0/103591572 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f01200425d0 con 0x7f0124063930 2022-01-10T01:31:06.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.113+0000 7f012a90c700 1 -- 172.21.15.36:0/103591572 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f01240a8cd0 con 0x7f0124063930 2022-01-10T01:31:06.637 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:31:06.633+0000 7f0b5376f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:31:06.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.641+0000 7f011affd700 1 -- 172.21.15.36:0/103591572 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0120045bf0 con 0x7f0124063930 2022-01-10T01:31:06.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.645+0000 7f012a90c700 1 -- 172.21.15.36:0/103591572 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f010c0536b0 msgr2=0x7f010c055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:06.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.645+0000 7f012a90c700 1 --2- 172.21.15.36:0/103591572 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f010c0536b0 0x7f010c055b70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f011400b000 tx=0x7f0114008040).stop 2022-01-10T01:31:06.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.645+0000 7f012a90c700 1 -- 172.21.15.36:0/103591572 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0124063930 msgr2=0x7f01240a9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:06.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.645+0000 7f012a90c700 1 --2- 172.21.15.36:0/103591572 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0124063930 0x7f01240a9140 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f0120007580 tx=0x7f0120009040).stop 2022-01-10T01:31:06.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.645+0000 7f012a90c700 1 -- 172.21.15.36:0/103591572 shutdown_connections 2022-01-10T01:31:06.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.645+0000 7f012a90c700 1 --2- 172.21.15.36:0/103591572 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f010c0536b0 0x7f010c055b70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:06.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.645+0000 7f012a90c700 1 --2- 172.21.15.36:0/103591572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f012415a5e0 0x7f01240aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:06.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.645+0000 7f012a90c700 1 --2- 172.21.15.36:0/103591572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0124159c70 0x7f012415a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:06.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.645+0000 7f012a90c700 1 --2- 172.21.15.36:0/103591572 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0124063930 0x7f01240a9140 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:06.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.645+0000 7f012a90c700 1 -- 172.21.15.36:0/103591572 >> 172.21.15.36:0/103591572 conn(0x7f0124060180 msgr2=0x7f01240ade70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:06.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.645+0000 7f012a90c700 1 -- 172.21.15.36:0/103591572 shutdown_connections 2022-01-10T01:31:06.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.645+0000 7f012a90c700 1 -- 172.21.15.36:0/103591572 wait complete. 2022-01-10T01:31:06.652 INFO:teuthology.orchestra.run.smithi036.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2022-01-10T01:31:06.665 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:06.680 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:31:06.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.757+0000 7fe6f4937700 1 Processor -- start 2022-01-10T01:31:06.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.757+0000 7fe6f4937700 1 -- start start 2022-01-10T01:31:06.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6f4937700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe6f013d400 0x7fe6f01467e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:06.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6f4937700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f01473e0 con 0x7fe6f00b6760 2022-01-10T01:31:06.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6ee59c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe6f00b6760 0x7fe6f013ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36164/0 (socket says 172.21.15.36:36164) 2022-01-10T01:31:06.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6f4937700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f00ac550 con 0x7fe6f00aa080 2022-01-10T01:31:06.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6ee59c700 1 -- 172.21.15.36:0/2179507278 learned_addr learned my addr 172.21.15.36:0/2179507278 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:06.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6f4937700 1 -- 172.21.15.36:0/2179507278 --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f00ac7f0 con 0x7fe6f013d400 2022-01-10T01:31:06.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6edd9b700 1 --2- 172.21.15.36:0/2179507278 >> v2:172.21.15.36:3300/0 conn(0x7fe6f013d400 0x7fe6f01467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:06.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6ed59a700 1 -- 172.21.15.36:0/2179507278 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201395935 0 0) 0x7fe6f01473e0 con 0x7fe6f00b6760 2022-01-10T01:31:06.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6ed59a700 1 -- 172.21.15.36:0/2179507278 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d4003260 con 0x7fe6f00b6760 2022-01-10T01:31:06.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6ed59a700 1 -- 172.21.15.36:0/2179507278 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888763057 0 0) 0x7fe6f00ac550 con 0x7fe6f00aa080 2022-01-10T01:31:06.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6edd9b700 1 -- 172.21.15.36:0/2179507278 >> v1:172.21.15.59:6789/0 conn(0x7fe6f00aa080 legacy=0x7fe6f0146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:06.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6edd9b700 1 -- 172.21.15.36:0/2179507278 >> v1:172.21.15.36:6789/0 conn(0x7fe6f00b6760 legacy=0x7fe6f013ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:06.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6edd9b700 1 -- 172.21.15.36:0/2179507278 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f00aca90 con 0x7fe6f013d400 2022-01-10T01:31:06.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6edd9b700 1 --2- 172.21.15.36:0/2179507278 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f013d400 0x7fe6f01467e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fe6e4002f70 tx=0x7fe6e4006df0).ready entity=mon.0 client_cookie=25e9caac984b858d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:06.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6ed59a700 1 -- 172.21.15.36:0/2179507278 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e400d610 con 0x7fe6f013d400 2022-01-10T01:31:06.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6ed59a700 1 -- 172.21.15.36:0/2179507278 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e4000e90 con 0x7fe6f013d400 2022-01-10T01:31:06.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6ed59a700 1 -- 172.21.15.36:0/2179507278 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e400d960 con 0x7fe6f013d400 2022-01-10T01:31:06.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6f4937700 1 -- 172.21.15.36:0/2179507278 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f013d400 msgr2=0x7fe6f01467e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:06.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6f4937700 1 --2- 172.21.15.36:0/2179507278 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f013d400 0x7fe6f01467e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fe6e4002f70 tx=0x7fe6e4006df0).stop 2022-01-10T01:31:06.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6f4937700 1 -- 172.21.15.36:0/2179507278 shutdown_connections 2022-01-10T01:31:06.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6f4937700 1 --2- 172.21.15.36:0/2179507278 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f013d400 0x7fe6f01467e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:06.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6f4937700 1 -- 172.21.15.36:0/2179507278 >> 172.21.15.36:0/2179507278 conn(0x7fe6f00b3480 msgr2=0x7fe6f00b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:06.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6f4937700 1 -- 172.21.15.36:0/2179507278 shutdown_connections 2022-01-10T01:31:06.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.761+0000 7fe6f4937700 1 -- 172.21.15.36:0/2179507278 wait complete. 2022-01-10T01:31:06.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.765+0000 7fe6f4937700 1 Processor -- start 2022-01-10T01:31:06.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.765+0000 7fe6f4937700 1 -- start start 2022-01-10T01:31:06.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.765+0000 7fe6f4937700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6f00aa080 0x7fe6f01413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:06.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.765+0000 7fe6f4937700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6f00b6760 0x7fe6f0152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:06.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.765+0000 7fe6f4937700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f013d400 0x7fe6f0152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:06.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.765+0000 7fe6f4937700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0153330 con 0x7fe6f013d400 2022-01-10T01:31:06.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.765+0000 7fe6f4937700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0145db0 con 0x7fe6f00b6760 2022-01-10T01:31:06.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.765+0000 7fe6f4937700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0145b10 con 0x7fe6f00aa080 2022-01-10T01:31:06.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.765+0000 7fe6eed9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f013d400 0x7fe6f0152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:06.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.765+0000 7fe6eed9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f013d400 0x7fe6f0152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38380/0 (socket says 172.21.15.36:38380) 2022-01-10T01:31:06.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.765+0000 7fe6eed9d700 1 -- 172.21.15.36:0/1472164520 learned_addr learned my addr 172.21.15.36:0/1472164520 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:06.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.765+0000 7fe6edd9b700 1 --2- 172.21.15.36:0/1472164520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6f00b6760 0x7fe6f0152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:06.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.765+0000 7fe6ee59c700 1 --2- 172.21.15.36:0/1472164520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6f00aa080 0x7fe6f01413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:06.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6eed9d700 1 -- 172.21.15.36:0/1472164520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6f00aa080 msgr2=0x7fe6f01413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:06.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6eed9d700 1 --2- 172.21.15.36:0/1472164520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6f00aa080 0x7fe6f01413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:06.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6eed9d700 1 -- 172.21.15.36:0/1472164520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6f00b6760 msgr2=0x7fe6f0152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:06.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6eed9d700 1 --2- 172.21.15.36:0/1472164520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6f00b6760 0x7fe6f0152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:06.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6eed9d700 1 -- 172.21.15.36:0/1472164520 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e400b180 con 0x7fe6f013d400 2022-01-10T01:31:06.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6eed9d700 1 --2- 172.21.15.36:0/1472164520 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f013d400 0x7fe6f0152e40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7fe6e8000bc0 tx=0x7fe6e80079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:06.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6df7fe700 1 -- 172.21.15.36:0/1472164520 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e800ce00 con 0x7fe6f013d400 2022-01-10T01:31:06.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6df7fe700 1 -- 172.21.15.36:0/1472164520 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e8012400 con 0x7fe6f013d400 2022-01-10T01:31:06.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6f4937700 1 -- 172.21.15.36:0/1472164520 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f01524b0 con 0x7fe6f013d400 2022-01-10T01:31:06.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6df7fe700 1 -- 172.21.15.36:0/1472164520 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e8012760 con 0x7fe6f013d400 2022-01-10T01:31:06.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6f4937700 1 -- 172.21.15.36:0/1472164520 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f0140830 con 0x7fe6f013d400 2022-01-10T01:31:06.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6f4937700 1 -- 172.21.15.36:0/1472164520 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f00b2670 con 0x7fe6f013d400 2022-01-10T01:31:06.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6df7fe700 1 -- 172.21.15.36:0/1472164520 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe6e8019030 con 0x7fe6f013d400 2022-01-10T01:31:06.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6df7fe700 1 --2- 172.21.15.36:0/1472164520 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe6cc053680 0x7fe6cc055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:06.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6df7fe700 1 -- 172.21.15.36:0/1472164520 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6549+0+0 (secure 0 0 0) 0x7fe6e806ad80 con 0x7fe6f013d400 2022-01-10T01:31:06.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.769+0000 7fe6ee59c700 1 --2- 172.21.15.36:0/1472164520 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe6cc053680 0x7fe6cc055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:06.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.773+0000 7fe6ee59c700 1 --2- 172.21.15.36:0/1472164520 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe6cc053680 0x7fe6cc055b40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fe6e000d000 tx=0x7fe6e0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:06.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.777+0000 7fe6df7fe700 1 -- 172.21.15.36:0/1472164520 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe6e8041d10 con 0x7fe6f013d400 2022-01-10T01:31:06.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.941+0000 7fe6f4937700 1 -- 172.21.15.36:0/1472164520 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6f0152640 con 0x7fe6f013d400 2022-01-10T01:31:06.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.945+0000 7fe6df7fe700 1 -- 172.21.15.36:0/1472164520 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+2129 (secure 0 0 0) 0x7fe6e806c070 con 0x7fe6f013d400 2022-01-10T01:31:06.948 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:06.949 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":35,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3321682930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3321682930},{"type":"v1","addr":"172.21.15.59:6833","nonce":3321682930}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/635174626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":635174626},{"type":"v1","addr":"172.21.15.36:6837","nonce":635174626}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:30:08.620792+0000","modified":"2022-01-10T01:31:06.637529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2022-01-10T01:31:06.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.945+0000 7fe6f4937700 1 -- 172.21.15.36:0/1472164520 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe6cc053680 msgr2=0x7fe6cc055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:06.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.945+0000 7fe6f4937700 1 --2- 172.21.15.36:0/1472164520 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe6cc053680 0x7fe6cc055b40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fe6e000d000 tx=0x7fe6e0009040).stop 2022-01-10T01:31:06.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.945+0000 7fe6f4937700 1 -- 172.21.15.36:0/1472164520 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f013d400 msgr2=0x7fe6f0152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:06.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.945+0000 7fe6f4937700 1 --2- 172.21.15.36:0/1472164520 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f013d400 0x7fe6f0152e40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7fe6e8000bc0 tx=0x7fe6e80079e0).stop 2022-01-10T01:31:06.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.945+0000 7fe6f4937700 1 -- 172.21.15.36:0/1472164520 shutdown_connections 2022-01-10T01:31:06.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.945+0000 7fe6f4937700 1 --2- 172.21.15.36:0/1472164520 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe6cc053680 0x7fe6cc055b40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:06.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.945+0000 7fe6f4937700 1 --2- 172.21.15.36:0/1472164520 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f013d400 0x7fe6f0152e40 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:06.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.945+0000 7fe6f4937700 1 --2- 172.21.15.36:0/1472164520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6f00b6760 0x7fe6f0152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:06.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.945+0000 7fe6f4937700 1 --2- 172.21.15.36:0/1472164520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6f00aa080 0x7fe6f01413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:06.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.945+0000 7fe6f4937700 1 -- 172.21.15.36:0/1472164520 >> 172.21.15.36:0/1472164520 conn(0x7fe6f00b3480 msgr2=0x7fe6f00b5370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:06.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.945+0000 7fe6f4937700 1 -- 172.21.15.36:0/1472164520 shutdown_connections 2022-01-10T01:31:06.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:06.945+0000 7fe6f4937700 1 -- 172.21.15.36:0/1472164520 wait complete. 2022-01-10T01:31:06.953 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 35 2022-01-10T01:31:06.961 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:31:07.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a6b32700 1 Processor -- start 2022-01-10T01:31:07.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a6b32700 1 -- start start 2022-01-10T01:31:07.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a6b32700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc4a00b0010 0x7fc4a00a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:07.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a6b32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a00afbd0 0x7fc4a00a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:07.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a6b32700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a00a70c0 con 0x7fc4a00b2580 2022-01-10T01:31:07.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a6b32700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a00a72f0 con 0x7fc4a00b0010 2022-01-10T01:31:07.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a6b32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a00a7590 con 0x7fc4a00afbd0 2022-01-10T01:31:07.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a532f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc4a00b0010 0x7fc4a00a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:07.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a532f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc4a00b0010 0x7fc4a00a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38386/0 (socket says 172.21.15.36:38386) 2022-01-10T01:31:07.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a532f700 1 -- 172.21.15.36:0/4173905994 learned_addr learned my addr 172.21.15.36:0/4173905994 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:07.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a6331700 1 --2- 172.21.15.36:0/4173905994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a00afbd0 0x7fc4a00a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:07.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a532f700 1 -- 172.21.15.36:0/4173905994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a00afbd0 msgr2=0x7fc4a00a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:07.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a532f700 1 --2- 172.21.15.36:0/4173905994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a00afbd0 0x7fc4a00a88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:07.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a532f700 1 -- 172.21.15.36:0/4173905994 >> v1:172.21.15.59:6789/0 conn(0x7fc4a00b2580 legacy=0x7fc4a014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:07.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a532f700 1 -- 172.21.15.36:0/4173905994 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a00a7830 con 0x7fc4a00b0010 2022-01-10T01:31:07.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.061+0000 7fc4a6331700 1 --2- 172.21.15.36:0/4173905994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a00afbd0 0x7fc4a00a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:07.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a532f700 1 --2- 172.21.15.36:0/4173905994 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4a00b0010 0x7fc4a00a83b0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fc49c0032f0 tx=0x7fc49c009290).ready entity=mon.0 client_cookie=5d2f6e91b54c1263 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:07.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a4b2e700 1 -- 172.21.15.36:0/4173905994 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc49c00b8a0 con 0x7fc4a00b0010 2022-01-10T01:31:07.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a4b2e700 1 -- 172.21.15.36:0/4173905994 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c00ba00 con 0x7fc4a00b0010 2022-01-10T01:31:07.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a4b2e700 1 -- 172.21.15.36:0/4173905994 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc49c00bb70 con 0x7fc4a00b0010 2022-01-10T01:31:07.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 -- 172.21.15.36:0/4173905994 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4a00b0010 msgr2=0x7fc4a00a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:07.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 --2- 172.21.15.36:0/4173905994 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4a00b0010 0x7fc4a00a83b0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fc49c0032f0 tx=0x7fc49c009290).stop 2022-01-10T01:31:07.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 -- 172.21.15.36:0/4173905994 shutdown_connections 2022-01-10T01:31:07.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 --2- 172.21.15.36:0/4173905994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a00afbd0 0x7fc4a00a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:07.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 --2- 172.21.15.36:0/4173905994 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4a00b0010 0x7fc4a00a83b0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:07.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 -- 172.21.15.36:0/4173905994 >> 172.21.15.36:0/4173905994 conn(0x7fc4a0060180 msgr2=0x7fc4a00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:07.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 -- 172.21.15.36:0/4173905994 shutdown_connections 2022-01-10T01:31:07.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 -- 172.21.15.36:0/4173905994 wait complete. 2022-01-10T01:31:07.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 Processor -- start 2022-01-10T01:31:07.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 -- start start 2022-01-10T01:31:07.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00afbd0 0x7fc4a0067060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:07.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4a00b0010 0x7fc4a0063610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:07.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a00b2580 0x7fc4a0156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:07.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0156490 con 0x7fc4a00b0010 2022-01-10T01:31:07.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0063b00 con 0x7fc4a00afbd0 2022-01-10T01:31:07.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a6b32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a0154140 con 0x7fc4a00b2580 2022-01-10T01:31:07.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.065+0000 7fc4a532f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4a00b0010 0x7fc4a0063610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:07.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a532f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4a00b0010 0x7fc4a0063610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38392/0 (socket says 172.21.15.36:38392) 2022-01-10T01:31:07.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a532f700 1 -- 172.21.15.36:0/92712136 learned_addr learned my addr 172.21.15.36:0/92712136 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:07.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a6331700 1 --2- 172.21.15.36:0/92712136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a00b2580 0x7fc4a0156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:07.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a5b30700 1 --2- 172.21.15.36:0/92712136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00afbd0 0x7fc4a0067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:07.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a532f700 1 -- 172.21.15.36:0/92712136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a00b2580 msgr2=0x7fc4a0156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:07.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a532f700 1 --2- 172.21.15.36:0/92712136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a00b2580 0x7fc4a0156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:07.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a532f700 1 -- 172.21.15.36:0/92712136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00afbd0 msgr2=0x7fc4a0067060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:07.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a532f700 1 --2- 172.21.15.36:0/92712136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00afbd0 0x7fc4a0067060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:07.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a532f700 1 -- 172.21.15.36:0/92712136 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c009530 con 0x7fc4a00b0010 2022-01-10T01:31:07.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a532f700 1 --2- 172.21.15.36:0/92712136 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4a00b0010 0x7fc4a0063610 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fc4a0065bb0 tx=0x7fc49c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:07.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc48effd700 1 -- 172.21.15.36:0/92712136 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc49c00b8a0 con 0x7fc4a00b0010 2022-01-10T01:31:07.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc48effd700 1 -- 172.21.15.36:0/92712136 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c00bde0 con 0x7fc4a00b0010 2022-01-10T01:31:07.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a6b32700 1 -- 172.21.15.36:0/92712136 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a00abf80 con 0x7fc4a00b0010 2022-01-10T01:31:07.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc48effd700 1 -- 172.21.15.36:0/92712136 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc49c020620 con 0x7fc4a00b0010 2022-01-10T01:31:07.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a6b32700 1 -- 172.21.15.36:0/92712136 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a0156920 con 0x7fc4a00b0010 2022-01-10T01:31:07.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc48effd700 1 -- 172.21.15.36:0/92712136 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc49c00f070 con 0x7fc4a00b0010 2022-01-10T01:31:07.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a6b32700 1 -- 172.21.15.36:0/92712136 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a0057350 con 0x7fc4a00b0010 2022-01-10T01:31:07.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc48effd700 1 --2- 172.21.15.36:0/92712136 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc480053590 0x7fc480055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:07.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc48effd700 1 -- 172.21.15.36:0/92712136 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6549+0+0 (secure 0 0 0) 0x7fc49c06c780 con 0x7fc4a00b0010 2022-01-10T01:31:07.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a5b30700 1 --2- 172.21.15.36:0/92712136 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc480053590 0x7fc480055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:07.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.069+0000 7fc4a5b30700 1 --2- 172.21.15.36:0/92712136 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc480053590 0x7fc480055a50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fc49000d000 tx=0x7fc490007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:07.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.077+0000 7fc48effd700 1 -- 172.21.15.36:0/92712136 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc49c043710 con 0x7fc4a00b0010 2022-01-10T01:31:07.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:07.245+0000 7fc4a6b32700 1 -- 172.21.15.36:0/92712136 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc4a00698e0 con 0x7fc4a00b0010 2022-01-10T01:31:08.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.129+0000 7fc48effd700 1 -- 172.21.15.36:0/92712136 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc49c0250a0 con 0x7fc4a00b0010 2022-01-10T01:31:08.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.129+0000 7fc4a6b32700 1 -- 172.21.15.36:0/92712136 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc480053590 msgr2=0x7fc480055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:08.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.129+0000 7fc4a6b32700 1 --2- 172.21.15.36:0/92712136 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc480053590 0x7fc480055a50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fc49000d000 tx=0x7fc490007b90).stop 2022-01-10T01:31:08.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.129+0000 7fc4a6b32700 1 -- 172.21.15.36:0/92712136 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4a00b0010 msgr2=0x7fc4a0063610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:08.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.129+0000 7fc4a6b32700 1 --2- 172.21.15.36:0/92712136 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4a00b0010 0x7fc4a0063610 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fc4a0065bb0 tx=0x7fc49c016000).stop 2022-01-10T01:31:08.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.133+0000 7fc4a6b32700 1 -- 172.21.15.36:0/92712136 shutdown_connections 2022-01-10T01:31:08.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.133+0000 7fc4a6b32700 1 --2- 172.21.15.36:0/92712136 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc480053590 0x7fc480055a50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:08.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.133+0000 7fc4a6b32700 1 --2- 172.21.15.36:0/92712136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4a00b2580 0x7fc4a0156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:08.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.133+0000 7fc4a6b32700 1 --2- 172.21.15.36:0/92712136 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4a00b0010 0x7fc4a0063610 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:08.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.133+0000 7fc4a6b32700 1 --2- 172.21.15.36:0/92712136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4a00afbd0 0x7fc4a0067060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:08.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.133+0000 7fc4a6b32700 1 -- 172.21.15.36:0/92712136 >> 172.21.15.36:0/92712136 conn(0x7fc4a0060180 msgr2=0x7fc4a0148df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:08.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.133+0000 7fc4a6b32700 1 -- 172.21.15.36:0/92712136 shutdown_connections 2022-01-10T01:31:08.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.133+0000 7fc4a6b32700 1 -- 172.21.15.36:0/92712136 wait complete. 2022-01-10T01:31:08.152 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:31:08.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.265+0000 7f1eb7ba1700 1 Processor -- start 2022-01-10T01:31:08.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.265+0000 7f1eb7ba1700 1 -- start start 2022-01-10T01:31:08.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb7ba1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1eb0067300 0x7f1eb01438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:08.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb7ba1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1eb0143de0 0x7f1eb014b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:08.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb7ba1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb00aabb0 con 0x7f1eb0060100 2022-01-10T01:31:08.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb7ba1700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb00604e0 con 0x7f1eb0067300 2022-01-10T01:31:08.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb7ba1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb0066ea0 con 0x7f1eb0143de0 2022-01-10T01:31:08.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb513c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1eb0067300 0x7f1eb01438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:08.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb513c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1eb0067300 0x7f1eb01438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38398/0 (socket says 172.21.15.36:38398) 2022-01-10T01:31:08.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb513c700 1 -- 172.21.15.36:0/3043072695 learned_addr learned my addr 172.21.15.36:0/3043072695 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:08.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb613e700 1 --2- 172.21.15.36:0/3043072695 >> v2:172.21.15.59:3300/0 conn(0x7f1eb0143de0 0x7f1eb014b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:08.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb513c700 1 -- 172.21.15.36:0/3043072695 >> v2:172.21.15.59:3300/0 conn(0x7f1eb0143de0 msgr2=0x7f1eb014b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:08.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb513c700 1 --2- 172.21.15.36:0/3043072695 >> v2:172.21.15.59:3300/0 conn(0x7f1eb0143de0 0x7f1eb014b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:08.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb513c700 1 -- 172.21.15.36:0/3043072695 >> v1:172.21.15.59:6789/0 conn(0x7f1eb0060100 legacy=0x7f1eb00b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:08.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb513c700 1 -- 172.21.15.36:0/3043072695 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb00b33b0 con 0x7f1eb0067300 2022-01-10T01:31:08.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb513c700 1 --2- 172.21.15.36:0/3043072695 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1eb0067300 0x7f1eb01438f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f1eac002f70 tx=0x7f1eac006eb0).ready entity=mon.0 client_cookie=9c9a49f23872e3c7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:08.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb493b700 1 -- 172.21.15.36:0/3043072695 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eac00d5c0 con 0x7f1eb0067300 2022-01-10T01:31:08.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb493b700 1 -- 172.21.15.36:0/3043072695 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac000e90 con 0x7f1eb0067300 2022-01-10T01:31:08.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb493b700 1 -- 172.21.15.36:0/3043072695 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eac00d950 con 0x7f1eb0067300 2022-01-10T01:31:08.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/3043072695 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1eb0067300 msgr2=0x7f1eb01438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:08.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb7ba1700 1 --2- 172.21.15.36:0/3043072695 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1eb0067300 0x7f1eb01438f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f1eac002f70 tx=0x7f1eac006eb0).stop 2022-01-10T01:31:08.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/3043072695 shutdown_connections 2022-01-10T01:31:08.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb7ba1700 1 --2- 172.21.15.36:0/3043072695 >> v2:172.21.15.59:3300/0 conn(0x7f1eb0143de0 0x7f1eb014b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:08.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb7ba1700 1 --2- 172.21.15.36:0/3043072695 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1eb0067300 0x7f1eb01438f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:08.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/3043072695 >> 172.21.15.36:0/3043072695 conn(0x7f1eb005cf30 msgr2=0x7f1eb005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:08.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/3043072695 shutdown_connections 2022-01-10T01:31:08.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.269+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/3043072695 wait complete. 2022-01-10T01:31:08.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb7ba1700 1 Processor -- start 2022-01-10T01:31:08.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb7ba1700 1 -- start start 2022-01-10T01:31:08.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb7ba1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1eb0060100 0x7f1eb0148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:08.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb7ba1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1eb0067300 0x7f1eb0152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:08.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb7ba1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb0143de0 0x7f1eb0152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:08.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb7ba1700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb01534a0 con 0x7f1eb0060100 2022-01-10T01:31:08.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb7ba1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb00a3900 con 0x7f1eb0143de0 2022-01-10T01:31:08.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb7ba1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb00ab790 con 0x7f1eb0067300 2022-01-10T01:31:08.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb593d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1eb0060100 0x7f1eb0148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:08.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb593d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1eb0060100 0x7f1eb0148470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38404/0 (socket says 172.21.15.36:38404) 2022-01-10T01:31:08.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb593d700 1 -- 172.21.15.36:0/2364635515 learned_addr learned my addr 172.21.15.36:0/2364635515 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:08.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb513c700 1 --2- 172.21.15.36:0/2364635515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1eb0067300 0x7f1eb0152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:08.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb613e700 1 --2- 172.21.15.36:0/2364635515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb0143de0 0x7f1eb0152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:08.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb593d700 1 -- 172.21.15.36:0/2364635515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1eb0067300 msgr2=0x7f1eb0152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:08.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb593d700 1 --2- 172.21.15.36:0/2364635515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1eb0067300 0x7f1eb0152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:08.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb593d700 1 -- 172.21.15.36:0/2364635515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb0143de0 msgr2=0x7f1eb0152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:08.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb593d700 1 --2- 172.21.15.36:0/2364635515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb0143de0 0x7f1eb0152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:08.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb593d700 1 -- 172.21.15.36:0/2364635515 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac00b1e0 con 0x7f1eb0060100 2022-01-10T01:31:08.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb593d700 1 --2- 172.21.15.36:0/2364635515 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1eb0060100 0x7f1eb0148470 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f1eb005f1e0 tx=0x7f1ea0007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:08.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1e9effd700 1 -- 172.21.15.36:0/2364635515 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ea0012400 con 0x7f1eb0060100 2022-01-10T01:31:08.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1e9effd700 1 -- 172.21.15.36:0/2364635515 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea0012560 con 0x7f1eb0060100 2022-01-10T01:31:08.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.273+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/2364635515 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb00aba30 con 0x7f1eb0060100 2022-01-10T01:31:08.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.277+0000 7f1e9effd700 1 -- 172.21.15.36:0/2364635515 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ea00128c0 con 0x7f1eb0060100 2022-01-10T01:31:08.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.277+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/2364635515 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb01525b0 con 0x7f1eb0060100 2022-01-10T01:31:08.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.277+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/2364635515 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb0152800 con 0x7f1eb0060100 2022-01-10T01:31:08.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.277+0000 7f1e9effd700 1 -- 172.21.15.36:0/2364635515 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1ea0019030 con 0x7f1eb0060100 2022-01-10T01:31:08.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.277+0000 7f1e9effd700 1 --2- 172.21.15.36:0/2364635515 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1e90053680 0x7f1e90055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:08.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.277+0000 7f1eb513c700 1 --2- 172.21.15.36:0/2364635515 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1e90053680 0x7f1e90055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:08.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.277+0000 7f1e9effd700 1 -- 172.21.15.36:0/2364635515 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6549+0+0 (secure 0 0 0) 0x7f1ea006ae20 con 0x7f1eb0060100 2022-01-10T01:31:08.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.281+0000 7f1eb513c700 1 --2- 172.21.15.36:0/2364635515 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1e90053680 0x7f1e90055b40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f1eac01c000 tx=0x7f1eac015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:08.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.285+0000 7f1e9effd700 1 -- 172.21.15.36:0/2364635515 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1ea0041d50 con 0x7f1eb0060100 2022-01-10T01:31:08.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:08.413+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/2364635515 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1eb0057350 con 0x7f1eb0060100 2022-01-10T01:31:09.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.137+0000 7f1e9effd700 1 -- 172.21.15.36:0/2364635515 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v80) v1 ==== 185+0+0 (secure 0 0 0) 0x7f1ea0045370 con 0x7f1eb0060100 2022-01-10T01:31:09.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.141+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/2364635515 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1e90053680 msgr2=0x7f1e90055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:09.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.141+0000 7f1eb7ba1700 1 --2- 172.21.15.36:0/2364635515 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1e90053680 0x7f1e90055b40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f1eac01c000 tx=0x7f1eac015000).stop 2022-01-10T01:31:09.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.141+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/2364635515 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1eb0060100 msgr2=0x7f1eb0148470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:09.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.141+0000 7f1eb7ba1700 1 --2- 172.21.15.36:0/2364635515 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1eb0060100 0x7f1eb0148470 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f1eb005f1e0 tx=0x7f1ea0007c50).stop 2022-01-10T01:31:09.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.141+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/2364635515 shutdown_connections 2022-01-10T01:31:09.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.141+0000 7f1eb7ba1700 1 --2- 172.21.15.36:0/2364635515 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1e90053680 0x7f1e90055b40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:09.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.141+0000 7f1eb7ba1700 1 --2- 172.21.15.36:0/2364635515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb0143de0 0x7f1eb0152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:09.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.141+0000 7f1eb7ba1700 1 --2- 172.21.15.36:0/2364635515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1eb0067300 0x7f1eb0152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:09.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.141+0000 7f1eb7ba1700 1 --2- 172.21.15.36:0/2364635515 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1eb0060100 0x7f1eb0148470 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:09.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.141+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/2364635515 >> 172.21.15.36:0/2364635515 conn(0x7f1eb005cf30 msgr2=0x7f1eb01436c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:09.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.141+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/2364635515 shutdown_connections 2022-01-10T01:31:09.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.141+0000 7f1eb7ba1700 1 -- 172.21.15.36:0/2364635515 wait complete. 2022-01-10T01:31:09.150 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:31:09.160 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2022-01-10T01:31:09.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.265+0000 7fd80cc51700 1 Processor -- start 2022-01-10T01:31:09.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.265+0000 7fd80cc51700 1 -- start start 2022-01-10T01:31:09.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd80cc51700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd808061320 0x7fd808061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:09.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd80cc51700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd8080ad5c0 0x7fd8080b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:09.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd80cc51700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8080aecf0 con 0x7fd808140440 2022-01-10T01:31:09.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd80cc51700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8080b6f20 con 0x7fd8080ad5c0 2022-01-10T01:31:09.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd80cc51700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080aef20 con 0x7fd808061320 2022-01-10T01:31:09.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd806ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd8080ad5c0 0x7fd8080b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:09.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd807fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd808140440 0x7fd808146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36210/0 (socket says 172.21.15.36:36210) 2022-01-10T01:31:09.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd807fff700 1 -- 172.21.15.36:0/2205259885 learned_addr learned my addr 172.21.15.36:0/2205259885 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:09.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd8077fe700 1 --2- 172.21.15.36:0/2205259885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd808061320 0x7fd808061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:09.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd806ffd700 1 -- 172.21.15.36:0/2205259885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd808061320 msgr2=0x7fd808061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:09.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd806ffd700 1 --2- 172.21.15.36:0/2205259885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd808061320 0x7fd808061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:09.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd806ffd700 1 -- 172.21.15.36:0/2205259885 >> v1:172.21.15.36:6789/0 conn(0x7fd808140440 legacy=0x7fd808146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:09.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd8067fc700 1 -- 172.21.15.36:0/2205259885 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733296122 0 0) 0x7fd8080aecf0 con 0x7fd808140440 2022-01-10T01:31:09.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd806ffd700 1 -- 172.21.15.36:0/2205259885 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8080af1c0 con 0x7fd8080ad5c0 2022-01-10T01:31:09.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd806ffd700 1 --2- 172.21.15.36:0/2205259885 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8080ad5c0 0x7fd8080b9e60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fd7f8002f70 tx=0x7fd7f8006df0).ready entity=mon.0 client_cookie=319ec50d96bb9499 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:09.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd8067fc700 1 -- 172.21.15.36:0/2205259885 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f800d570 con 0x7fd8080ad5c0 2022-01-10T01:31:09.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd8067fc700 1 -- 172.21.15.36:0/2205259885 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f8000e90 con 0x7fd8080ad5c0 2022-01-10T01:31:09.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd8067fc700 1 -- 172.21.15.36:0/2205259885 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f800d8c0 con 0x7fd8080ad5c0 2022-01-10T01:31:09.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd80cc51700 1 -- 172.21.15.36:0/2205259885 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8080ad5c0 msgr2=0x7fd8080b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:09.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd80cc51700 1 --2- 172.21.15.36:0/2205259885 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8080ad5c0 0x7fd8080b9e60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fd7f8002f70 tx=0x7fd7f8006df0).stop 2022-01-10T01:31:09.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd80cc51700 1 -- 172.21.15.36:0/2205259885 shutdown_connections 2022-01-10T01:31:09.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd80cc51700 1 --2- 172.21.15.36:0/2205259885 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8080ad5c0 0x7fd8080b9e60 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:09.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd80cc51700 1 --2- 172.21.15.36:0/2205259885 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd808061320 0x7fd808061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:09.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd80cc51700 1 -- 172.21.15.36:0/2205259885 >> 172.21.15.36:0/2205259885 conn(0x7fd808066de0 msgr2=0x7fd8080671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:09.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd80cc51700 1 -- 172.21.15.36:0/2205259885 shutdown_connections 2022-01-10T01:31:09.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.269+0000 7fd80cc51700 1 -- 172.21.15.36:0/2205259885 wait complete. 2022-01-10T01:31:09.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd80cc51700 1 Processor -- start 2022-01-10T01:31:09.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd80cc51700 1 -- start start 2022-01-10T01:31:09.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd80cc51700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd808061320 0x7fd8080b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:09.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd80cc51700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8080ad5c0 0x7fd8080b1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:09.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd80cc51700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd808140440 0x7fd80813f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:09.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd80cc51700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8081566b0 con 0x7fd8080ad5c0 2022-01-10T01:31:09.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd80cc51700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd808156410 con 0x7fd808140440 2022-01-10T01:31:09.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd80cc51700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080b0b60 con 0x7fd808061320 2022-01-10T01:31:09.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd806ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8080ad5c0 0x7fd8080b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:09.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd806ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8080ad5c0 0x7fd8080b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38420/0 (socket says 172.21.15.36:38420) 2022-01-10T01:31:09.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd806ffd700 1 -- 172.21.15.36:0/897640186 learned_addr learned my addr 172.21.15.36:0/897640186 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:09.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd807fff700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd808140440 0x7fd80813f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:09.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd8077fe700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd808061320 0x7fd8080b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:09.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd806ffd700 1 -- 172.21.15.36:0/897640186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd808061320 msgr2=0x7fd8080b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:09.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd806ffd700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd808061320 0x7fd8080b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:09.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd806ffd700 1 -- 172.21.15.36:0/897640186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd808140440 msgr2=0x7fd80813f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:09.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd806ffd700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd808140440 0x7fd80813f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:09.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd806ffd700 1 -- 172.21.15.36:0/897640186 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f800b180 con 0x7fd8080ad5c0 2022-01-10T01:31:09.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd807fff700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd808140440 0x7fd80813f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:09.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd806ffd700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8080ad5c0 0x7fd8080b1730 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7fd7f8002f70 tx=0x7fd7f8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:09.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd804ff9700 1 -- 172.21.15.36:0/897640186 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f8016070 con 0x7fd8080ad5c0 2022-01-10T01:31:09.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd804ff9700 1 -- 172.21.15.36:0/897640186 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f80139c0 con 0x7fd8080ad5c0 2022-01-10T01:31:09.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd80cc51700 1 -- 172.21.15.36:0/897640186 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8080b1000 con 0x7fd8080ad5c0 2022-01-10T01:31:09.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd804ff9700 1 -- 172.21.15.36:0/897640186 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7f8013d20 con 0x7fd8080ad5c0 2022-01-10T01:31:09.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.273+0000 7fd80cc51700 1 -- 172.21.15.36:0/897640186 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8080aff30 con 0x7fd8080ad5c0 2022-01-10T01:31:09.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.277+0000 7fd80cc51700 1 -- 172.21.15.36:0/897640186 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8080af460 con 0x7fd8080ad5c0 2022-01-10T01:31:09.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.277+0000 7fd804ff9700 1 -- 172.21.15.36:0/897640186 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd7f8025030 con 0x7fd8080ad5c0 2022-01-10T01:31:09.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.277+0000 7fd804ff9700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd7e8053560 0x7fd7e8055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:09.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.277+0000 7fd804ff9700 1 -- 172.21.15.36:0/897640186 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6111+0+0 (secure 0 0 0) 0x7fd7f806cc30 con 0x7fd8080ad5c0 2022-01-10T01:31:09.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.277+0000 7fd8077fe700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd7e8053560 0x7fd7e8055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:09.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.281+0000 7fd8077fe700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd7e8053560 0x7fd7e8055a20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fd7fc00b000 tx=0x7fd7fc006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:09.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.281+0000 7fd804ff9700 1 -- 172.21.15.36:0/897640186 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd7f8043d80 con 0x7fd8080ad5c0 2022-01-10T01:31:09.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:09.413+0000 7fd80cc51700 1 -- 172.21.15.36:0/897640186 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd808057350 con 0x7fd8080ad5c0 2022-01-10T01:31:10.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.141+0000 7fd804ff9700 1 -- 172.21.15.36:0/897640186 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v81) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd7f8023070 con 0x7fd8080ad5c0 2022-01-10T01:31:10.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.145+0000 7fd80cc51700 1 -- 172.21.15.36:0/897640186 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd7e8053560 msgr2=0x7fd7e8055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:10.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.145+0000 7fd80cc51700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd7e8053560 0x7fd7e8055a20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fd7fc00b000 tx=0x7fd7fc006df0).stop 2022-01-10T01:31:10.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.145+0000 7fd80cc51700 1 -- 172.21.15.36:0/897640186 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8080ad5c0 msgr2=0x7fd8080b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:10.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.145+0000 7fd80cc51700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8080ad5c0 0x7fd8080b1730 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7fd7f8002f70 tx=0x7fd7f8014000).stop 2022-01-10T01:31:10.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.145+0000 7fd80cc51700 1 -- 172.21.15.36:0/897640186 shutdown_connections 2022-01-10T01:31:10.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.145+0000 7fd80cc51700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd7e8053560 0x7fd7e8055a20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.145+0000 7fd80cc51700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd808140440 0x7fd80813f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.145+0000 7fd80cc51700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8080ad5c0 0x7fd8080b1730 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.145+0000 7fd80cc51700 1 --2- 172.21.15.36:0/897640186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd808061320 0x7fd8080b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.145+0000 7fd80cc51700 1 -- 172.21.15.36:0/897640186 >> 172.21.15.36:0/897640186 conn(0x7fd808066de0 msgr2=0x7fd8080b83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:10.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.145+0000 7fd80cc51700 1 -- 172.21.15.36:0/897640186 shutdown_connections 2022-01-10T01:31:10.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.145+0000 7fd80cc51700 1 -- 172.21.15.36:0/897640186 wait complete. 2022-01-10T01:31:10.154 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' removed 2022-01-10T01:31:10.163 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2022-01-10T01:31:10.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9f65a3700 1 Processor -- start 2022-01-10T01:31:10.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9f65a3700 1 -- start start 2022-01-10T01:31:10.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9f65a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9f013e460 0x7fc9f0064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:10.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9f65a3700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f00653a0 con 0x7fc9f00b38a0 2022-01-10T01:31:10.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9f65a3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f00b30d0 con 0x7fc9f01443a0 2022-01-10T01:31:10.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9f65a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0065fd0 con 0x7fc9f013e460 2022-01-10T01:31:10.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9ef7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fc9f00b38a0 0x7fc9f00b7530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36222/0 (socket says 172.21.15.36:36222) 2022-01-10T01:31:10.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9ef7fe700 1 -- 172.21.15.36:0/1451955878 learned_addr learned my addr 172.21.15.36:0/1451955878 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:10.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9effff700 1 --2- 172.21.15.36:0/1451955878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9f013e460 0x7fc9f0064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:10.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121319446 0 0) 0x7fc9f00653a0 con 0x7fc9f00b38a0 2022-01-10T01:31:10.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9d0003260 con 0x7fc9f00b38a0 2022-01-10T01:31:10.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1086255021 0 0) 0x7fc9f00b30d0 con 0x7fc9f01443a0 2022-01-10T01:31:10.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9f00653a0 con 0x7fc9f01443a0 2022-01-10T01:31:10.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4109874798 0 0) 0x7fc9d0003260 con 0x7fc9f00b38a0 2022-01-10T01:31:10.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9f013e460 msgr2=0x7fc9f0064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:10.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 --2- 172.21.15.36:0/1451955878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9f013e460 0x7fc9f0064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 >> v1:172.21.15.59:6789/0 conn(0x7fc9f01443a0 legacy=0x7fc9f0066da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:10.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f00b7c40 con 0x7fc9f00b38a0 2022-01-10T01:31:10.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fc9e0001680 con 0x7fc9f00b38a0 2022-01-10T01:31:10.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 >> v1:172.21.15.36:6789/0 conn(0x7fc9f00b38a0 legacy=0x7fc9f00b7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:10.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 --2- 172.21.15.36:0/1451955878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9f013e460 0x7fc9d0003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:10.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 --2- 172.21.15.36:0/1451955878 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d0003e70 0x7fc9d0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:10.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 --2- 172.21.15.36:0/1451955878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9d00049f0 0x7fc9d0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:10.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d000b800 con 0x7fc9d0003e70 2022-01-10T01:31:10.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d000b970 con 0x7fc9d00049f0 2022-01-10T01:31:10.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.265+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d000bb30 con 0x7fc9f013e460 2022-01-10T01:31:10.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9ef7fe700 1 --2- 172.21.15.36:0/1451955878 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d0003e70 0x7fc9d0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:10.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9effff700 1 --2- 172.21.15.36:0/1451955878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9f013e460 0x7fc9d0003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:10.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9f4b40700 1 --2- 172.21.15.36:0/1451955878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9d00049f0 0x7fc9d0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:10.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9ef7fe700 1 -- 172.21.15.36:0/1451955878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9f013e460 msgr2=0x7fc9d0003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:10.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9ef7fe700 1 --2- 172.21.15.36:0/1451955878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9f013e460 0x7fc9d0003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9ef7fe700 1 -- 172.21.15.36:0/1451955878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9d00049f0 msgr2=0x7fc9d0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:10.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9ef7fe700 1 --2- 172.21.15.36:0/1451955878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9d00049f0 0x7fc9d0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9ef7fe700 1 -- 172.21.15.36:0/1451955878 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d0003260 con 0x7fc9d0003e70 2022-01-10T01:31:10.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9ef7fe700 1 --2- 172.21.15.36:0/1451955878 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d0003e70 0x7fc9d0004500 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fc9e0001450 tx=0x7fc9f0066710).ready entity=mon.0 client_cookie=3f85a21cbe9677d7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:10.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9e00070d0 con 0x7fc9d0003e70 2022-01-10T01:31:10.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e0007230 con 0x7fc9d0003e70 2022-01-10T01:31:10.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9eeffd700 1 -- 172.21.15.36:0/1451955878 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9e000c8c0 con 0x7fc9d0003e70 2022-01-10T01:31:10.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1451955878 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d0003e70 msgr2=0x7fc9d0004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:10.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9f65a3700 1 --2- 172.21.15.36:0/1451955878 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d0003e70 0x7fc9d0004500 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fc9e0001450 tx=0x7fc9f0066710).stop 2022-01-10T01:31:10.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9f4b40700 1 -- 172.21.15.36:0/1451955878 reap_dead start 2022-01-10T01:31:10.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1451955878 shutdown_connections 2022-01-10T01:31:10.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1451955878 >> 172.21.15.36:0/1451955878 conn(0x7fc9f00629d0 msgr2=0x7fc9f0062de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:10.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1451955878 shutdown_connections 2022-01-10T01:31:10.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.269+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1451955878 wait complete. 2022-01-10T01:31:10.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9f65a3700 1 Processor -- start 2022-01-10T01:31:10.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9f65a3700 1 -- start start 2022-01-10T01:31:10.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9f65a3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d0003e70 0x7fc9f00b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:10.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9f65a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9f00aebd0 0x7fc9f01504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:10.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9f65a3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9f00ac060 0x7fc9f00ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:10.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9f65a3700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00af030 con 0x7fc9d0003e70 2022-01-10T01:31:10.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9f65a3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00b10e0 con 0x7fc9f00ac060 2022-01-10T01:31:10.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9f65a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00af450 con 0x7fc9f00aebd0 2022-01-10T01:31:10.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9effff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d0003e70 0x7fc9f00b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:10.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9effff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d0003e70 0x7fc9f00b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38438/0 (socket says 172.21.15.36:38438) 2022-01-10T01:31:10.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9effff700 1 -- 172.21.15.36:0/1069343161 learned_addr learned my addr 172.21.15.36:0/1069343161 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:10.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9ef7fe700 1 --2- 172.21.15.36:0/1069343161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9f00aebd0 0x7fc9f01504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:10.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9f4b40700 1 --2- 172.21.15.36:0/1069343161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9f00ac060 0x7fc9f00ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:10.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9effff700 1 -- 172.21.15.36:0/1069343161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9f00aebd0 msgr2=0x7fc9f01504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:10.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9effff700 1 --2- 172.21.15.36:0/1069343161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9f00aebd0 0x7fc9f01504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9effff700 1 -- 172.21.15.36:0/1069343161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9f00ac060 msgr2=0x7fc9f00ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:10.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9effff700 1 --2- 172.21.15.36:0/1069343161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9f00ac060 0x7fc9f00ac4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9effff700 1 -- 172.21.15.36:0/1069343161 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f00af6f0 con 0x7fc9d0003e70 2022-01-10T01:31:10.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.273+0000 7fc9effff700 1 --2- 172.21.15.36:0/1069343161 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d0003e70 0x7fc9f00b0b30 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7fc9d800b000 tx=0x7fc9d8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:10.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.277+0000 7fc9ed7fa700 1 -- 172.21.15.36:0/1069343161 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d8011e70 con 0x7fc9d0003e70 2022-01-10T01:31:10.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.277+0000 7fc9ed7fa700 1 -- 172.21.15.36:0/1069343161 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d800f940 con 0x7fc9d0003e70 2022-01-10T01:31:10.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.277+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1069343161 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f00af990 con 0x7fc9d0003e70 2022-01-10T01:31:10.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.277+0000 7fc9ed7fa700 1 -- 172.21.15.36:0/1069343161 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d800fca0 con 0x7fc9d0003e70 2022-01-10T01:31:10.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.277+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1069343161 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f01509e0 con 0x7fc9d0003e70 2022-01-10T01:31:10.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.277+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1069343161 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f00ae970 con 0x7fc9d0003e70 2022-01-10T01:31:10.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.277+0000 7fc9ed7fa700 1 -- 172.21.15.36:0/1069343161 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc9d8014440 con 0x7fc9d0003e70 2022-01-10T01:31:10.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.277+0000 7fc9ed7fa700 1 --2- 172.21.15.36:0/1069343161 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9d40536b0 0x7fc9d4055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:10.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.277+0000 7fc9ed7fa700 1 -- 172.21.15.36:0/1069343161 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fc9d806bff0 con 0x7fc9d0003e70 2022-01-10T01:31:10.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.277+0000 7fc9ef7fe700 1 --2- 172.21.15.36:0/1069343161 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9d40536b0 0x7fc9d4055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:10.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.277+0000 7fc9ef7fe700 1 --2- 172.21.15.36:0/1069343161 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9d40536b0 0x7fc9d4055b70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fc9e001a000 tx=0x7fc9e0013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:10.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.285+0000 7fc9ed7fa700 1 -- 172.21.15.36:0/1069343161 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc9d8043250 con 0x7fc9d0003e70 2022-01-10T01:31:10.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.417+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1069343161 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc9f0064e60 con 0x7fc9d0003e70 2022-01-10T01:31:10.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.421+0000 7fc9ed7fa700 1 -- 172.21.15.36:0/1069343161 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc9d8018020 con 0x7fc9d0003e70 2022-01-10T01:31:10.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.425+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1069343161 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9d40536b0 msgr2=0x7fc9d4055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:10.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.425+0000 7fc9f65a3700 1 --2- 172.21.15.36:0/1069343161 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9d40536b0 0x7fc9d4055b70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fc9e001a000 tx=0x7fc9e0013000).stop 2022-01-10T01:31:10.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.425+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1069343161 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d0003e70 msgr2=0x7fc9f00b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:10.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.425+0000 7fc9f65a3700 1 --2- 172.21.15.36:0/1069343161 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d0003e70 0x7fc9f00b0b30 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7fc9d800b000 tx=0x7fc9d8006df0).stop 2022-01-10T01:31:10.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.425+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1069343161 shutdown_connections 2022-01-10T01:31:10.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.425+0000 7fc9f65a3700 1 --2- 172.21.15.36:0/1069343161 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9d40536b0 0x7fc9d4055b70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.425+0000 7fc9f65a3700 1 --2- 172.21.15.36:0/1069343161 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9f00ac060 0x7fc9f00ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.425+0000 7fc9f65a3700 1 --2- 172.21.15.36:0/1069343161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9f00aebd0 0x7fc9f01504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.425+0000 7fc9f65a3700 1 --2- 172.21.15.36:0/1069343161 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9d0003e70 0x7fc9f00b0b30 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.425+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1069343161 >> 172.21.15.36:0/1069343161 conn(0x7fc9f00629d0 msgr2=0x7fc9f013ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:10.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.425+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1069343161 shutdown_connections 2022-01-10T01:31:10.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.425+0000 7fc9f65a3700 1 -- 172.21.15.36:0/1069343161 wait complete. 2022-01-10T01:31:10.441 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2022-01-10T01:31:10.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e8530a700 1 Processor -- start 2022-01-10T01:31:10.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e8530a700 1 -- start start 2022-01-10T01:31:10.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e8530a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5e80067180 0x7f5e8005f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:10.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e8530a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5e800b1970 0x7f5e8005fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:10.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e8530a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e800a7a90 con 0x7f5e800a76b0 2022-01-10T01:31:10.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e8530a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e80147620 con 0x7f5e800b1970 2022-01-10T01:31:10.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e8530a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e801478c0 con 0x7f5e80067180 2022-01-10T01:31:10.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7effd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f5e800a76b0 0x7f5e80066a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36240/0 (socket says 172.21.15.36:36240) 2022-01-10T01:31:10.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7effd700 1 -- 172.21.15.36:0/1743579684 learned_addr learned my addr 172.21.15.36:0/1743579684 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:10.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7f7fe700 1 --2- 172.21.15.36:0/1743579684 >> v2:172.21.15.36:3300/0 conn(0x7f5e800b1970 0x7f5e8005fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:10.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7e7fc700 1 --2- 172.21.15.36:0/1743579684 >> v2:172.21.15.59:3300/0 conn(0x7f5e80067180 0x7f5e8005f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:10.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7dffb700 1 -- 172.21.15.36:0/1743579684 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166132246 0 0) 0x7f5e800a7a90 con 0x7f5e800a76b0 2022-01-10T01:31:10.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7dffb700 1 -- 172.21.15.36:0/1743579684 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e60003260 con 0x7f5e800a76b0 2022-01-10T01:31:10.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7f7fe700 1 -- 172.21.15.36:0/1743579684 >> v2:172.21.15.59:3300/0 conn(0x7f5e80067180 msgr2=0x7f5e8005f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:10.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7f7fe700 1 --2- 172.21.15.36:0/1743579684 >> v2:172.21.15.59:3300/0 conn(0x7f5e80067180 0x7f5e8005f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7f7fe700 1 -- 172.21.15.36:0/1743579684 >> v1:172.21.15.36:6789/0 conn(0x7f5e800a76b0 legacy=0x7f5e80066a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:10.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7f7fe700 1 -- 172.21.15.36:0/1743579684 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e80147b60 con 0x7f5e800b1970 2022-01-10T01:31:10.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7e7fc700 1 --2- 172.21.15.36:0/1743579684 >> v2:172.21.15.59:3300/0 conn(0x7f5e80067180 0x7f5e8005f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:10.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7f7fe700 1 --2- 172.21.15.36:0/1743579684 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e800b1970 0x7f5e8005fba0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f5e78002f70 tx=0x7f5e78006df0).ready entity=mon.0 client_cookie=d2b5759bc3a63bb8 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:10.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7dffb700 1 -- 172.21.15.36:0/1743579684 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e7800d4f0 con 0x7f5e800b1970 2022-01-10T01:31:10.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7dffb700 1 -- 172.21.15.36:0/1743579684 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e78000e90 con 0x7f5e800b1970 2022-01-10T01:31:10.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e7dffb700 1 -- 172.21.15.36:0/1743579684 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e7800d880 con 0x7f5e800b1970 2022-01-10T01:31:10.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e8530a700 1 -- 172.21.15.36:0/1743579684 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e800b1970 msgr2=0x7f5e8005fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:10.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e8530a700 1 --2- 172.21.15.36:0/1743579684 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e800b1970 0x7f5e8005fba0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f5e78002f70 tx=0x7f5e78006df0).stop 2022-01-10T01:31:10.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e8530a700 1 -- 172.21.15.36:0/1743579684 shutdown_connections 2022-01-10T01:31:10.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e8530a700 1 --2- 172.21.15.36:0/1743579684 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e800b1970 0x7f5e8005fba0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.545+0000 7f5e8530a700 1 --2- 172.21.15.36:0/1743579684 >> v2:172.21.15.59:3300/0 conn(0x7f5e80067180 0x7f5e8005f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.549+0000 7f5e8530a700 1 -- 172.21.15.36:0/1743579684 >> 172.21.15.36:0/1743579684 conn(0x7f5e800b53e0 msgr2=0x7f5e800b57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:10.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.549+0000 7f5e8530a700 1 -- 172.21.15.36:0/1743579684 shutdown_connections 2022-01-10T01:31:10.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.549+0000 7f5e8530a700 1 -- 172.21.15.36:0/1743579684 wait complete. 2022-01-10T01:31:10.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.549+0000 7f5e8530a700 1 Processor -- start 2022-01-10T01:31:10.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.549+0000 7f5e8530a700 1 -- start start 2022-01-10T01:31:10.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.549+0000 7f5e8530a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e80067180 0x7f5e800aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:10.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.549+0000 7f5e8530a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e800a76b0 0x7f5e80157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:10.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.549+0000 7f5e8530a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e800b1970 0x7f5e800ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:10.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.549+0000 7f5e8530a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e80156810 con 0x7f5e800b1970 2022-01-10T01:31:10.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.549+0000 7f5e8530a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800ab380 con 0x7f5e80067180 2022-01-10T01:31:10.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.549+0000 7f5e8530a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e800a9a40 con 0x7f5e800a76b0 2022-01-10T01:31:10.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.549+0000 7f5e7f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e800b1970 0x7f5e800ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:10.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e7effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e80067180 0x7f5e800aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:10.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e7f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e800b1970 0x7f5e800ad680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38456/0 (socket says 172.21.15.36:38456) 2022-01-10T01:31:10.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e7f7fe700 1 -- 172.21.15.36:0/1553258455 learned_addr learned my addr 172.21.15.36:0/1553258455 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:10.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e7e7fc700 1 --2- 172.21.15.36:0/1553258455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e800a76b0 0x7f5e80157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:10.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e7effd700 1 -- 172.21.15.36:0/1553258455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e800a76b0 msgr2=0x7f5e80157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:10.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e7effd700 1 --2- 172.21.15.36:0/1553258455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e800a76b0 0x7f5e80157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e7effd700 1 -- 172.21.15.36:0/1553258455 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e800b1970 msgr2=0x7f5e800ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:10.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e7effd700 1 --2- 172.21.15.36:0/1553258455 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e800b1970 0x7f5e800ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:10.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e7effd700 1 -- 172.21.15.36:0/1553258455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e70009470 con 0x7f5e80067180 2022-01-10T01:31:10.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e7effd700 1 --2- 172.21.15.36:0/1553258455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e80067180 0x7f5e800aae90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f5e68001110 tx=0x7f5e680079e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:10.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e77fff700 1 -- 172.21.15.36:0/1553258455 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e6800ce60 con 0x7f5e80067180 2022-01-10T01:31:10.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e77fff700 1 -- 172.21.15.36:0/1553258455 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e680070d0 con 0x7f5e80067180 2022-01-10T01:31:10.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e8530a700 1 -- 172.21.15.36:0/1553258455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7800b180 con 0x7f5e80067180 2022-01-10T01:31:10.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e77fff700 1 -- 172.21.15.36:0/1553258455 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e68007430 con 0x7f5e80067180 2022-01-10T01:31:10.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e8530a700 1 -- 172.21.15.36:0/1553258455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e80156ca0 con 0x7f5e80067180 2022-01-10T01:31:10.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e8530a700 1 -- 172.21.15.36:0/1553258455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e800a9c40 con 0x7f5e80067180 2022-01-10T01:31:10.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.553+0000 7f5e77fff700 1 -- 172.21.15.36:0/1553258455 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5e68010070 con 0x7f5e80067180 2022-01-10T01:31:10.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.557+0000 7f5e77fff700 1 --2- 172.21.15.36:0/1553258455 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5e64053620 0x7f5e64055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:10.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.557+0000 7f5e7e7fc700 1 --2- 172.21.15.36:0/1553258455 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5e64053620 0x7f5e64055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:10.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.557+0000 7f5e77fff700 1 -- 172.21.15.36:0/1553258455 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f5e6806ac80 con 0x7f5e80067180 2022-01-10T01:31:10.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.557+0000 7f5e7e7fc700 1 --2- 172.21.15.36:0/1553258455 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5e64053620 0x7f5e64055ae0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f5e7000b000 tx=0x7f5e700091d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:10.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.565+0000 7f5e77fff700 1 -- 172.21.15.36:0/1553258455 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5e68041f40 con 0x7f5e80067180 2022-01-10T01:31:10.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:10.733+0000 7f5e8530a700 1 -- 172.21.15.36:0/1553258455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f5e80057350 con 0x7f5e80067180 2022-01-10T01:31:11.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.145+0000 7f5e77fff700 1 -- 172.21.15.36:0/1553258455 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v296) v1 ==== 139+0+0 (secure 0 0 0) 0x7f5e68045560 con 0x7f5e80067180 2022-01-10T01:31:11.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.149+0000 7f5e8530a700 1 -- 172.21.15.36:0/1553258455 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5e64053620 msgr2=0x7f5e64055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:11.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.149+0000 7f5e8530a700 1 --2- 172.21.15.36:0/1553258455 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5e64053620 0x7f5e64055ae0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f5e7000b000 tx=0x7f5e700091d0).stop 2022-01-10T01:31:11.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.149+0000 7f5e8530a700 1 -- 172.21.15.36:0/1553258455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e80067180 msgr2=0x7f5e800aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:11.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.149+0000 7f5e8530a700 1 --2- 172.21.15.36:0/1553258455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e80067180 0x7f5e800aae90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f5e68001110 tx=0x7f5e680079e0).stop 2022-01-10T01:31:11.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.149+0000 7f5e8530a700 1 -- 172.21.15.36:0/1553258455 shutdown_connections 2022-01-10T01:31:11.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.149+0000 7f5e8530a700 1 --2- 172.21.15.36:0/1553258455 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5e64053620 0x7f5e64055ae0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:11.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.149+0000 7f5e8530a700 1 --2- 172.21.15.36:0/1553258455 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e800b1970 0x7f5e800ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:11.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.149+0000 7f5e8530a700 1 --2- 172.21.15.36:0/1553258455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e800a76b0 0x7f5e80157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:11.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.149+0000 7f5e8530a700 1 --2- 172.21.15.36:0/1553258455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e80067180 0x7f5e800aae90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:11.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.149+0000 7f5e8530a700 1 -- 172.21.15.36:0/1553258455 >> 172.21.15.36:0/1553258455 conn(0x7f5e800b53e0 msgr2=0x7f5e800b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:11.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.149+0000 7f5e8530a700 1 -- 172.21.15.36:0/1553258455 shutdown_connections 2022-01-10T01:31:11.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.149+0000 7f5e8530a700 1 -- 172.21.15.36:0/1553258455 wait complete. 2022-01-10T01:31:11.169 INFO:tasks.cephfs_test_runner:test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) ... ok 2022-01-10T01:31:11.170 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode (tasks.cephfs.test_misc.TestMisc) 2022-01-10T01:31:11.171 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2022-01-10T01:31:11.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f14385700 1 Processor -- start 2022-01-10T01:31:11.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f14385700 1 -- start start 2022-01-10T01:31:11.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f14385700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f0c0b6580 0x7f9f0c0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:11.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f14385700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c1440b0 con 0x7f9f0c0b6960 2022-01-10T01:31:11.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f14385700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c143b70 con 0x7f9f0c0b43c0 2022-01-10T01:31:11.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f14385700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c143e10 con 0x7f9f0c0b6580 2022-01-10T01:31:11.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f12922700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9f0c0b6960 0x7f9f0c12ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36256/0 (socket says 172.21.15.36:36256) 2022-01-10T01:31:11.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f12922700 1 -- 172.21.15.36:0/2190820876 learned_addr learned my addr 172.21.15.36:0/2190820876 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:11.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f12121700 1 --2- 172.21.15.36:0/2190820876 >> v2:172.21.15.59:3300/0 conn(0x7f9f0c0b6580 0x7f9f0c0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:11.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 -- 172.21.15.36:0/2190820876 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607733248 0 0) 0x7f9f0c1440b0 con 0x7f9f0c0b6960 2022-01-10T01:31:11.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 -- 172.21.15.36:0/2190820876 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ef8003260 con 0x7f9f0c0b6960 2022-01-10T01:31:11.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 -- 172.21.15.36:0/2190820876 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 537482243 0 0) 0x7f9ef8003260 con 0x7f9f0c0b6960 2022-01-10T01:31:11.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 -- 172.21.15.36:0/2190820876 >> v2:172.21.15.59:3300/0 conn(0x7f9f0c0b6580 msgr2=0x7f9f0c0b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:11.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 --2- 172.21.15.36:0/2190820876 >> v2:172.21.15.59:3300/0 conn(0x7f9f0c0b6580 0x7f9f0c0b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:11.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 -- 172.21.15.36:0/2190820876 >> v1:172.21.15.59:6789/0 conn(0x7f9f0c0b43c0 legacy=0x7f9f0c061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:11.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 -- 172.21.15.36:0/2190820876 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c0615f0 con 0x7f9f0c0b6960 2022-01-10T01:31:11.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 -- 172.21.15.36:0/2190820876 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f9f04001660 con 0x7f9f0c0b6960 2022-01-10T01:31:11.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 -- 172.21.15.36:0/2190820876 >> v1:172.21.15.36:6789/0 conn(0x7f9f0c0b6960 legacy=0x7f9f0c12ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:11.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 --2- 172.21.15.36:0/2190820876 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ef8003750 0x7f9ef8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:11.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 --2- 172.21.15.36:0/2190820876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ef8004500 0x7f9ef8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:11.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 --2- 172.21.15.36:0/2190820876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ef8004e70 0x7f9ef800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:11.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 -- 172.21.15.36:0/2190820876 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c143e10 con 0x7f9ef8003750 2022-01-10T01:31:11.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 -- 172.21.15.36:0/2190820876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef800bc70 con 0x7f9ef8004500 2022-01-10T01:31:11.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f1111f700 1 -- 172.21.15.36:0/2190820876 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef800be30 con 0x7f9ef8004e70 2022-01-10T01:31:11.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f12121700 1 --2- 172.21.15.36:0/2190820876 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ef8003750 0x7f9ef8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:11.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f11920700 1 --2- 172.21.15.36:0/2190820876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ef8004500 0x7f9ef8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:11.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.277+0000 7f9f12922700 1 --2- 172.21.15.36:0/2190820876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ef8004e70 0x7f9ef800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:11.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f12121700 1 -- 172.21.15.36:0/2190820876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ef8004e70 msgr2=0x7f9ef800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:11.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f12121700 1 --2- 172.21.15.36:0/2190820876 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ef8004e70 0x7f9ef800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:11.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f12121700 1 -- 172.21.15.36:0/2190820876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ef8004500 msgr2=0x7f9ef8004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:11.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f12121700 1 --2- 172.21.15.36:0/2190820876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ef8004500 0x7f9ef8004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:11.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f12121700 1 -- 172.21.15.36:0/2190820876 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef8003260 con 0x7f9ef8003750 2022-01-10T01:31:11.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f12922700 1 -- 172.21.15.36:0/2190820876 reap_dead start 2022-01-10T01:31:11.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f12121700 1 --2- 172.21.15.36:0/2190820876 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ef8003750 0x7f9ef8003b30 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f9efc00c000 tx=0x7f9efc0091d0).ready entity=mon.0 client_cookie=3be138f78f41dec3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:11.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f1111f700 1 -- 172.21.15.36:0/2190820876 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9efc00e7e0 con 0x7f9ef8003750 2022-01-10T01:31:11.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f1111f700 1 -- 172.21.15.36:0/2190820876 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc00e940 con 0x7f9ef8003750 2022-01-10T01:31:11.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f1111f700 1 -- 172.21.15.36:0/2190820876 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9efc00eca0 con 0x7f9ef8003750 2022-01-10T01:31:11.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f14385700 1 -- 172.21.15.36:0/2190820876 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ef8003750 msgr2=0x7f9ef8003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:11.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f14385700 1 --2- 172.21.15.36:0/2190820876 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ef8003750 0x7f9ef8003b30 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f9efc00c000 tx=0x7f9efc0091d0).stop 2022-01-10T01:31:11.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f14385700 1 -- 172.21.15.36:0/2190820876 shutdown_connections 2022-01-10T01:31:11.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f14385700 1 --2- 172.21.15.36:0/2190820876 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ef8003750 0x7f9ef8003b30 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:11.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f14385700 1 -- 172.21.15.36:0/2190820876 >> 172.21.15.36:0/2190820876 conn(0x7f9f0c05c490 msgr2=0x7f9f0c05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:11.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f14385700 1 -- 172.21.15.36:0/2190820876 shutdown_connections 2022-01-10T01:31:11.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f14385700 1 -- 172.21.15.36:0/2190820876 wait complete. 2022-01-10T01:31:11.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f14385700 1 Processor -- start 2022-01-10T01:31:11.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.281+0000 7f9f14385700 1 -- start start 2022-01-10T01:31:11.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f14385700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ef8003750 0x7f9f0c125d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:11.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f14385700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f0c0b28e0 0x7f9f0c0b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:11.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f14385700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f0c0b3250 0x7f9f0c13b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:11.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f14385700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c129ff0 con 0x7f9f0c0b28e0 2022-01-10T01:31:11.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f14385700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0b1c80 con 0x7f9f0c0b3250 2022-01-10T01:31:11.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f14385700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c126a50 con 0x7f9ef8003750 2022-01-10T01:31:11.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f11920700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f0c0b28e0 0x7f9f0c0b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:11.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f11920700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f0c0b28e0 0x7f9f0c0b2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38474/0 (socket says 172.21.15.36:38474) 2022-01-10T01:31:11.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f11920700 1 -- 172.21.15.36:0/1515895986 learned_addr learned my addr 172.21.15.36:0/1515895986 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:11.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f12121700 1 --2- 172.21.15.36:0/1515895986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ef8003750 0x7f9f0c125d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:11.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f12922700 1 --2- 172.21.15.36:0/1515895986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f0c0b3250 0x7f9f0c13b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:11.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f11920700 1 -- 172.21.15.36:0/1515895986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ef8003750 msgr2=0x7f9f0c125d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:11.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f11920700 1 --2- 172.21.15.36:0/1515895986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ef8003750 0x7f9f0c125d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:11.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f11920700 1 -- 172.21.15.36:0/1515895986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f0c0b3250 msgr2=0x7f9f0c13b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:11.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f11920700 1 --2- 172.21.15.36:0/1515895986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f0c0b3250 0x7f9f0c13b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:11.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f11920700 1 -- 172.21.15.36:0/1515895986 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c12bbd0 con 0x7f9f0c0b28e0 2022-01-10T01:31:11.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f11920700 1 --2- 172.21.15.36:0/1515895986 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f0c0b28e0 0x7f9f0c0b2d60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f9f0800d000 tx=0x7f9f08007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:11.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f037fe700 1 -- 172.21.15.36:0/1515895986 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f0800fac0 con 0x7f9f0c0b28e0 2022-01-10T01:31:11.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f037fe700 1 -- 172.21.15.36:0/1515895986 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0800fc20 con 0x7f9f0c0b28e0 2022-01-10T01:31:11.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f14385700 1 -- 172.21.15.36:0/1515895986 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c0b1ee0 con 0x7f9f0c0b28e0 2022-01-10T01:31:11.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f037fe700 1 -- 172.21.15.36:0/1515895986 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f08002e50 con 0x7f9f0c0b28e0 2022-01-10T01:31:11.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.285+0000 7f9f14385700 1 -- 172.21.15.36:0/1515895986 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c13cb90 con 0x7f9f0c0b28e0 2022-01-10T01:31:11.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.289+0000 7f9f14385700 1 -- 172.21.15.36:0/1515895986 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c061890 con 0x7f9f0c0b28e0 2022-01-10T01:31:11.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.289+0000 7f9f037fe700 1 -- 172.21.15.36:0/1515895986 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9f0801b030 con 0x7f9f0c0b28e0 2022-01-10T01:31:11.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.289+0000 7f9f037fe700 1 --2- 172.21.15.36:0/1515895986 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9eec0535f0 0x7f9eec055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:11.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.289+0000 7f9f037fe700 1 -- 172.21.15.36:0/1515895986 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f9f0806b960 con 0x7f9f0c0b28e0 2022-01-10T01:31:11.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.289+0000 7f9f12121700 1 --2- 172.21.15.36:0/1515895986 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9eec0535f0 0x7f9eec055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:11.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.289+0000 7f9f12121700 1 --2- 172.21.15.36:0/1515895986 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9eec0535f0 0x7f9eec055ab0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f9efc01e000 tx=0x7f9efc01a000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:11.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.293+0000 7f9f037fe700 1 -- 172.21.15.36:0/1515895986 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f08042c20 con 0x7f9f0c0b28e0 2022-01-10T01:31:11.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:11.465+0000 7f9f14385700 1 -- 172.21.15.36:0/1515895986 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f9f0c057350 con 0x7f9f0c0b28e0 2022-01-10T01:31:12.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.145+0000 7f9f037fe700 1 -- 172.21.15.36:0/1515895986 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v297) v1 ==== 129+0+0 (secure 0 0 0) 0x7f9f08046240 con 0x7f9f0c0b28e0 2022-01-10T01:31:12.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.149+0000 7f9f14385700 1 -- 172.21.15.36:0/1515895986 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9eec0535f0 msgr2=0x7f9eec055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:12.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.149+0000 7f9f14385700 1 --2- 172.21.15.36:0/1515895986 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9eec0535f0 0x7f9eec055ab0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f9efc01e000 tx=0x7f9efc01a000).stop 2022-01-10T01:31:12.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.149+0000 7f9f14385700 1 -- 172.21.15.36:0/1515895986 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f0c0b28e0 msgr2=0x7f9f0c0b2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:12.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.149+0000 7f9f14385700 1 --2- 172.21.15.36:0/1515895986 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f0c0b28e0 0x7f9f0c0b2d60 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f9f0800d000 tx=0x7f9f08007a00).stop 2022-01-10T01:31:12.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.149+0000 7f9f14385700 1 -- 172.21.15.36:0/1515895986 shutdown_connections 2022-01-10T01:31:12.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.149+0000 7f9f14385700 1 --2- 172.21.15.36:0/1515895986 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9eec0535f0 0x7f9eec055ab0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.149+0000 7f9f14385700 1 --2- 172.21.15.36:0/1515895986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f0c0b3250 0x7f9f0c13b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.149+0000 7f9f14385700 1 --2- 172.21.15.36:0/1515895986 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f0c0b28e0 0x7f9f0c0b2d60 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.149+0000 7f9f14385700 1 --2- 172.21.15.36:0/1515895986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ef8003750 0x7f9f0c125d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.149+0000 7f9f14385700 1 -- 172.21.15.36:0/1515895986 >> 172.21.15.36:0/1515895986 conn(0x7f9f0c05c490 msgr2=0x7f9f0c141c00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:12.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.149+0000 7f9f14385700 1 -- 172.21.15.36:0/1515895986 shutdown_connections 2022-01-10T01:31:12.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.149+0000 7f9f14385700 1 -- 172.21.15.36:0/1515895986 wait complete. 2022-01-10T01:31:12.173 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2022-01-10T01:31:12.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32f0aeb700 1 Processor -- start 2022-01-10T01:31:12.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32f0aeb700 1 -- start start 2022-01-10T01:31:12.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32f0aeb700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f32ec0ad260 0x7f32ec0ab4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:12.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32f0aeb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f32ec148120 0x7f32ec0ac100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:12.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32f0aeb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ec0ad640 con 0x7f32ec0afe60 2022-01-10T01:31:12.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32f0aeb700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ec0ab9c0 con 0x7f32ec0ad260 2022-01-10T01:31:12.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32f0aeb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ec1474c0 con 0x7f32ec148120 2022-01-10T01:31:12.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32eb7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f32ec0ad260 0x7f32ec0ab4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:12.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32eb7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f32ec0ad260 0x7f32ec0ab4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38484/0 (socket says 172.21.15.36:38484) 2022-01-10T01:31:12.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32eb7fe700 1 -- 172.21.15.36:0/2205285756 learned_addr learned my addr 172.21.15.36:0/2205285756 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:12.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32ebfff700 1 --2- 172.21.15.36:0/2205285756 >> v2:172.21.15.59:3300/0 conn(0x7f32ec148120 0x7f32ec0ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:12.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32eb7fe700 1 -- 172.21.15.36:0/2205285756 >> v2:172.21.15.59:3300/0 conn(0x7f32ec148120 msgr2=0x7f32ec0ac100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:12.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32ea7fc700 1 -- 172.21.15.36:0/2205285756 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525383743 0 0) 0x7f32ec0ad640 con 0x7f32ec0afe60 2022-01-10T01:31:12.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32eb7fe700 1 --2- 172.21.15.36:0/2205285756 >> v2:172.21.15.59:3300/0 conn(0x7f32ec148120 0x7f32ec0ac100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32eb7fe700 1 -- 172.21.15.36:0/2205285756 >> v1:172.21.15.59:6789/0 conn(0x7f32ec0afe60 legacy=0x7f32ec147a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:12.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32eb7fe700 1 -- 172.21.15.36:0/2205285756 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec0b0480 con 0x7f32ec0ad260 2022-01-10T01:31:12.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32eb7fe700 1 --2- 172.21.15.36:0/2205285756 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32ec0ad260 0x7f32ec0ab4d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f32d4002f70 tx=0x7f32d4006eb0).ready entity=mon.0 client_cookie=3de47938ce13f843 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:12.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32ea7fc700 1 -- 172.21.15.36:0/2205285756 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32d400d5c0 con 0x7f32ec0ad260 2022-01-10T01:31:12.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32ea7fc700 1 -- 172.21.15.36:0/2205285756 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d4000e90 con 0x7f32ec0ad260 2022-01-10T01:31:12.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.285+0000 7f32ea7fc700 1 -- 172.21.15.36:0/2205285756 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32d400d910 con 0x7f32ec0ad260 2022-01-10T01:31:12.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 -- 172.21.15.36:0/2205285756 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32ec0ad260 msgr2=0x7f32ec0ab4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:12.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 --2- 172.21.15.36:0/2205285756 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32ec0ad260 0x7f32ec0ab4d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f32d4002f70 tx=0x7f32d4006eb0).stop 2022-01-10T01:31:12.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 -- 172.21.15.36:0/2205285756 shutdown_connections 2022-01-10T01:31:12.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 --2- 172.21.15.36:0/2205285756 >> v2:172.21.15.59:3300/0 conn(0x7f32ec148120 0x7f32ec0ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 --2- 172.21.15.36:0/2205285756 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32ec0ad260 0x7f32ec0ab4d0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 -- 172.21.15.36:0/2205285756 >> 172.21.15.36:0/2205285756 conn(0x7f32ec061230 msgr2=0x7f32ec062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:12.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 -- 172.21.15.36:0/2205285756 shutdown_connections 2022-01-10T01:31:12.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 -- 172.21.15.36:0/2205285756 wait complete. 2022-01-10T01:31:12.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 Processor -- start 2022-01-10T01:31:12.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 -- start start 2022-01-10T01:31:12.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec0ad260 0x7f32ec0b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:12.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32ec0afe60 0x7f32ec143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:12.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32ec148120 0x7f32ec144060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:12.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec159ba0 con 0x7f32ec0afe60 2022-01-10T01:31:12.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec159e40 con 0x7f32ec148120 2022-01-10T01:31:12.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.289+0000 7f32f0aeb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec15a0e0 con 0x7f32ec0ad260 2022-01-10T01:31:12.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32eaffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32ec0afe60 0x7f32ec143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:12.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32eaffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32ec0afe60 0x7f32ec143b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38490/0 (socket says 172.21.15.36:38490) 2022-01-10T01:31:12.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32eaffd700 1 -- 172.21.15.36:0/3156340894 learned_addr learned my addr 172.21.15.36:0/3156340894 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:12.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32ebfff700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32ec148120 0x7f32ec144060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:12.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32eb7fe700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec0ad260 0x7f32ec0b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:12.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32eaffd700 1 -- 172.21.15.36:0/3156340894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec0ad260 msgr2=0x7f32ec0b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:12.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32eaffd700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec0ad260 0x7f32ec0b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32eaffd700 1 -- 172.21.15.36:0/3156340894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32ec148120 msgr2=0x7f32ec144060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:12.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32eaffd700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32ec148120 0x7f32ec144060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32eaffd700 1 -- 172.21.15.36:0/3156340894 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d400b1e0 con 0x7f32ec0afe60 2022-01-10T01:31:12.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32ebfff700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32ec148120 0x7f32ec144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:12.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32eaffd700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32ec0afe60 0x7f32ec143b70 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f32dc001250 tx=0x7f32dc007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:12.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32e8ff9700 1 -- 172.21.15.36:0/3156340894 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32dc00e4a0 con 0x7f32ec0afe60 2022-01-10T01:31:12.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32e8ff9700 1 -- 172.21.15.36:0/3156340894 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32dc00e600 con 0x7f32ec0afe60 2022-01-10T01:31:12.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32f0aeb700 1 -- 172.21.15.36:0/3156340894 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ec15a380 con 0x7f32ec0afe60 2022-01-10T01:31:12.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32e8ff9700 1 -- 172.21.15.36:0/3156340894 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32dc00e960 con 0x7f32ec0afe60 2022-01-10T01:31:12.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32f0aeb700 1 -- 172.21.15.36:0/3156340894 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ec0b44a0 con 0x7f32ec0afe60 2022-01-10T01:31:12.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32e8ff9700 1 -- 172.21.15.36:0/3156340894 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f32dc019030 con 0x7f32ec0afe60 2022-01-10T01:31:12.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.293+0000 7f32f0aeb700 1 -- 172.21.15.36:0/3156340894 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ec0b0720 con 0x7f32ec0afe60 2022-01-10T01:31:12.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.297+0000 7f32e8ff9700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f32d00534d0 0x7f32d0055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:12.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.297+0000 7f32eb7fe700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f32d00534d0 0x7f32d0055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:12.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.297+0000 7f32e8ff9700 1 -- 172.21.15.36:0/3156340894 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f32dc06ade0 con 0x7f32ec0afe60 2022-01-10T01:31:12.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.297+0000 7f32eb7fe700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f32d00534d0 0x7f32d0055990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f32d401c000 tx=0x7f32d4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:12.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.301+0000 7f32e8ff9700 1 -- 172.21.15.36:0/3156340894 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f32dc042150 con 0x7f32ec0afe60 2022-01-10T01:31:12.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.429+0000 7f32f0aeb700 1 -- 172.21.15.36:0/3156340894 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f32ec057350 con 0x7f32ec0afe60 2022-01-10T01:31:12.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.441+0000 7f32e8ff9700 1 -- 172.21.15.36:0/3156340894 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f32dc017030 con 0x7f32ec0afe60 2022-01-10T01:31:12.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.441+0000 7f32f0aeb700 1 -- 172.21.15.36:0/3156340894 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f32d00534d0 msgr2=0x7f32d0055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:12.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.441+0000 7f32f0aeb700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f32d00534d0 0x7f32d0055990 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f32d401c000 tx=0x7f32d4015000).stop 2022-01-10T01:31:12.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.441+0000 7f32f0aeb700 1 -- 172.21.15.36:0/3156340894 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32ec0afe60 msgr2=0x7f32ec143b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:12.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.441+0000 7f32f0aeb700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32ec0afe60 0x7f32ec143b70 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f32dc001250 tx=0x7f32dc007e30).stop 2022-01-10T01:31:12.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.441+0000 7f32f0aeb700 1 -- 172.21.15.36:0/3156340894 shutdown_connections 2022-01-10T01:31:12.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.441+0000 7f32f0aeb700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f32d00534d0 0x7f32d0055990 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.441+0000 7f32f0aeb700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32ec148120 0x7f32ec144060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.441+0000 7f32f0aeb700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32ec0afe60 0x7f32ec143b70 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.441+0000 7f32f0aeb700 1 --2- 172.21.15.36:0/3156340894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec0ad260 0x7f32ec0b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.441+0000 7f32f0aeb700 1 -- 172.21.15.36:0/3156340894 >> 172.21.15.36:0/3156340894 conn(0x7f32ec061230 msgr2=0x7f32ec146270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:12.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.441+0000 7f32f0aeb700 1 -- 172.21.15.36:0/3156340894 shutdown_connections 2022-01-10T01:31:12.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.441+0000 7f32f0aeb700 1 -- 172.21.15.36:0/3156340894 wait complete. 2022-01-10T01:31:12.458 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:31:12.459 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:12.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:12.502 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:12.523 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:12.545 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:31:12.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:12.546 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:12.546 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:12.574 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2022-01-10T01:31:12.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:31:12.576 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2022-01-10T01:31:12.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:12.577 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:12.577 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:12.593 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:31:12.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:31:12.595 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:31:12.595 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:31:12.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe98d96e700 1 Processor -- start 2022-01-10T01:31:12.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe98d96e700 1 -- start start 2022-01-10T01:31:12.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe98d96e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe9881483a0 0x7fe9880b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:12.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe98d96e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880a70c0 0x7fe988144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:12.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe98d96e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9880b0350 con 0x7fe9880b1db0 2022-01-10T01:31:12.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe98d96e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9880a90c0 con 0x7fe9881483a0 2022-01-10T01:31:12.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe98d96e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880b05f0 con 0x7fe9880a70c0 2022-01-10T01:31:12.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe9867fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe9881483a0 0x7fe9880b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:12.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe9867fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe9881483a0 0x7fe9880b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38496/0 (socket says 172.21.15.36:38496) 2022-01-10T01:31:12.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe9867fc700 1 -- 172.21.15.36:0/249126947 learned_addr learned my addr 172.21.15.36:0/249126947 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:12.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe9877fe700 1 --2- 172.21.15.36:0/249126947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880a70c0 0x7fe988144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:12.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe9867fc700 1 -- 172.21.15.36:0/249126947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880a70c0 msgr2=0x7fe988144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:12.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe9867fc700 1 --2- 172.21.15.36:0/249126947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880a70c0 0x7fe988144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe9867fc700 1 -- 172.21.15.36:0/249126947 >> v1:172.21.15.59:6789/0 conn(0x7fe9880b1db0 legacy=0x7fe9880b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:12.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe9867fc700 1 -- 172.21.15.36:0/249126947 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9880b0890 con 0x7fe9881483a0 2022-01-10T01:31:12.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe9867fc700 1 --2- 172.21.15.36:0/249126947 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9881483a0 0x7fe9880b0fd0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fe988147730 tx=0x7fe980009290).ready entity=mon.0 client_cookie=6f7828dfb5a7e9b0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:12.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe985ffb700 1 -- 172.21.15.36:0/249126947 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe98000b860 con 0x7fe9881483a0 2022-01-10T01:31:12.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe985ffb700 1 -- 172.21.15.36:0/249126947 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe98000b9c0 con 0x7fe9881483a0 2022-01-10T01:31:12.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe985ffb700 1 -- 172.21.15.36:0/249126947 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe98000bb30 con 0x7fe9881483a0 2022-01-10T01:31:12.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe98d96e700 1 -- 172.21.15.36:0/249126947 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9881483a0 msgr2=0x7fe9880b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:12.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe98d96e700 1 --2- 172.21.15.36:0/249126947 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9881483a0 0x7fe9880b0fd0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7fe988147730 tx=0x7fe980009290).stop 2022-01-10T01:31:12.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe98d96e700 1 -- 172.21.15.36:0/249126947 shutdown_connections 2022-01-10T01:31:12.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe98d96e700 1 --2- 172.21.15.36:0/249126947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880a70c0 0x7fe988144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe98d96e700 1 --2- 172.21.15.36:0/249126947 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9881483a0 0x7fe9880b0fd0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.701+0000 7fe98d96e700 1 -- 172.21.15.36:0/249126947 >> 172.21.15.36:0/249126947 conn(0x7fe98805f6b0 msgr2=0x7fe98805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:12.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.705+0000 7fe98d96e700 1 -- 172.21.15.36:0/249126947 shutdown_connections 2022-01-10T01:31:12.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.705+0000 7fe98d96e700 1 -- 172.21.15.36:0/249126947 wait complete. 2022-01-10T01:31:12.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.705+0000 7fe98d96e700 1 Processor -- start 2022-01-10T01:31:12.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.705+0000 7fe98d96e700 1 -- start start 2022-01-10T01:31:12.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.705+0000 7fe98d96e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9880a70c0 0x7fe9880ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:12.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.705+0000 7fe98d96e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880b1db0 0x7fe988156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:12.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.705+0000 7fe98d96e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9881483a0 0x7fe9880ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:12.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.705+0000 7fe98d96e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880ab5c0 con 0x7fe9880a70c0 2022-01-10T01:31:12.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.705+0000 7fe98d96e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880ab860 con 0x7fe9881483a0 2022-01-10T01:31:12.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.705+0000 7fe98d96e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9880abe50 con 0x7fe9880b1db0 2022-01-10T01:31:12.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.705+0000 7fe986ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9880a70c0 0x7fe9880ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:12.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.705+0000 7fe986ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9880a70c0 0x7fe9880ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38504/0 (socket says 172.21.15.36:38504) 2022-01-10T01:31:12.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.705+0000 7fe986ffd700 1 -- 172.21.15.36:0/3219822618 learned_addr learned my addr 172.21.15.36:0/3219822618 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:12.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe9877fe700 1 --2- 172.21.15.36:0/3219822618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9881483a0 0x7fe9880ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:12.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe9867fc700 1 --2- 172.21.15.36:0/3219822618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880b1db0 0x7fe988156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:12.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe986ffd700 1 -- 172.21.15.36:0/3219822618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880b1db0 msgr2=0x7fe988156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:12.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe986ffd700 1 --2- 172.21.15.36:0/3219822618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880b1db0 0x7fe988156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe986ffd700 1 -- 172.21.15.36:0/3219822618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9881483a0 msgr2=0x7fe9880ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:12.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe986ffd700 1 --2- 172.21.15.36:0/3219822618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9881483a0 0x7fe9880ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:12.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe986ffd700 1 -- 172.21.15.36:0/3219822618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe980009530 con 0x7fe9880a70c0 2022-01-10T01:31:12.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe986ffd700 1 --2- 172.21.15.36:0/3219822618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9880a70c0 0x7fe9880ae880 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fe9880b3170 tx=0x7fe970007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:12.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe97ffff700 1 -- 172.21.15.36:0/3219822618 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe970012400 con 0x7fe9880a70c0 2022-01-10T01:31:12.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe97ffff700 1 -- 172.21.15.36:0/3219822618 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe970012560 con 0x7fe9880a70c0 2022-01-10T01:31:12.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe98d96e700 1 -- 172.21.15.36:0/3219822618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9880af5a0 con 0x7fe9880a70c0 2022-01-10T01:31:12.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe97ffff700 1 -- 172.21.15.36:0/3219822618 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9700128c0 con 0x7fe9880a70c0 2022-01-10T01:31:12.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe98d96e700 1 -- 172.21.15.36:0/3219822618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9880ac7e0 con 0x7fe9880a70c0 2022-01-10T01:31:12.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe98d96e700 1 -- 172.21.15.36:0/3219822618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9880ac010 con 0x7fe9880a70c0 2022-01-10T01:31:12.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.709+0000 7fe97ffff700 1 -- 172.21.15.36:0/3219822618 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe970019030 con 0x7fe9880a70c0 2022-01-10T01:31:12.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.713+0000 7fe97ffff700 1 --2- 172.21.15.36:0/3219822618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe960053620 0x7fe960055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:12.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.713+0000 7fe97ffff700 1 -- 172.21.15.36:0/3219822618 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fe97006ab80 con 0x7fe9880a70c0 2022-01-10T01:31:12.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.713+0000 7fe9867fc700 1 --2- 172.21.15.36:0/3219822618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe960053620 0x7fe960055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:12.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.713+0000 7fe9867fc700 1 --2- 172.21.15.36:0/3219822618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe960053620 0x7fe960055ae0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fe98001b000 tx=0x7fe980016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:12.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.717+0000 7fe97ffff700 1 -- 172.21.15.36:0/3219822618 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe970041e40 con 0x7fe9880a70c0 2022-01-10T01:31:12.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.845+0000 7fe98d96e700 1 -- 172.21.15.36:0/3219822618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe988057350 con 0x7fe9880a70c0 2022-01-10T01:31:12.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.845+0000 7fe97ffff700 1 -- 172.21.15.36:0/3219822618 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v81) v1 ==== 81+0+29291 (secure 0 0 0) 0x7fe970045460 con 0x7fe9880a70c0 2022-01-10T01:31:12.852 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:12.852 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:31:12.852 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 81, 2022-01-10T01:31:12.852 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:31:12.853 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:31:12.853 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:31:10.137181+0000", 2022-01-10T01:31:12.853 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:31:12.853 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:31:12.854 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:31:12.854 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:31:12.854 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:31:12.854 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:31:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:31:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:31:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:31:12.855 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:31:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:31:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:31:12.856 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:31:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:31:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 14, 2022-01-10T01:31:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:31:12.857 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:31:12.858 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:31:12.858 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:31:12.858 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:31:12.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.858 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:31:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:31:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:31:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:12.859 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:12.860 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:12.860 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:12.860 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:12.860 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:12.861 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:12.861 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:12.861 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:31:12.861 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:31:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:31:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:31:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:31:12.862 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:12.863 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.864 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:31:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:12.865 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:12.866 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:12.867 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:12.868 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:12.869 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:12.870 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:12.871 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:12.872 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:12.873 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:31:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:31:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:31:12.874 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:31:12.875 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:31:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:31:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:12.876 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:12.877 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:12.878 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:31:12.878 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:31:12.878 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:31:12.878 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:31:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:31:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:12.879 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:12.880 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:31:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:12.881 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:12.882 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:12.883 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:12.884 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:12.885 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:12.886 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:12.887 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:12.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.887 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:12.887 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:12.887 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:12.888 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:12.889 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:31:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:31:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.890 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:31:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:31:12.891 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:31:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:12.892 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 65, 2022-01-10T01:31:12.893 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:12.894 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:12.894 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:12.894 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.894 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.894 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:31:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:31:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.896 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.898 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.898 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:31:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:31:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:12.900 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:31:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:12.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:31:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:12.903 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:12.904 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:31:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:12.905 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:31:12.906 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.907 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:31:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:31:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:31:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:31:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:12.908 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.909 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:31:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:31:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:12.910 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:12.911 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 75, 2022-01-10T01:31:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:12.912 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:31:12.913 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.914 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:31:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.915 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.916 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:31:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.917 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:31:12.918 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:12.918 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.918 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.919 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:31:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.920 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:31:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.922 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:12.922 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.922 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.922 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:31:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:31:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.924 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:31:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:31:12.925 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:31:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:31:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:12.926 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:31:12.927 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:31:12.928 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:12.928 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:12.928 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:12.928 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:12.929 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:12.929 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:12.929 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:12.929 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 75, 2022-01-10T01:31:12.929 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:12.930 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:12.930 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:12.930 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.931 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.931 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:31:12.931 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:12.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.932 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.932 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:31:12.932 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:12.932 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:12.933 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:31:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:12.934 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:31:12.935 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.936 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:31:12.937 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.938 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:31:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.940 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:31:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.941 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:31:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.942 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.943 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:31:12.943 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:31:12.943 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:31:12.944 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:31:12.944 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:12.944 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:12.944 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:12.944 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.945 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:31:12.945 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:31:12.946 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:12.946 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:12.946 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:12.946 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:12.947 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:12.947 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:12.947 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:12.947 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 74, 2022-01-10T01:31:12.947 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:12.948 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:12.948 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:12.948 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.949 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.949 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:31:12.949 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:12.949 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.949 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.950 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.950 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:31:12.950 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:12.950 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.951 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.951 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.951 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:12.951 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.951 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.952 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.952 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:31:12.952 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:12.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.953 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.953 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.953 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:31:12.953 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:12.953 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.954 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.954 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:12.954 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.955 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.955 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.955 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:31:12.955 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:12.955 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.956 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.956 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:31:12.956 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:12.957 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.957 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.957 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:12.957 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.958 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.958 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.958 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:31:12.958 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:12.959 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.959 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.959 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.959 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:31:12.959 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:12.960 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.960 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.960 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.960 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:31:12.961 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:31:12.961 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:31:12.961 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:31:12.961 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:12.961 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:12.962 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:12.962 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.962 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.962 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.963 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:31:12.963 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:31:12.963 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:12.963 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:12.963 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:12.964 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:12.964 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:12.964 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:12.964 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:12.965 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 75, 2022-01-10T01:31:12.965 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:12.965 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:12.965 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:12.965 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.966 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.966 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.966 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:31:12.966 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:12.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.967 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.967 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.967 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:31:12.967 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:12.968 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.968 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.968 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.968 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:12.968 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.969 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.969 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.969 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:31:12.969 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:12.970 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.970 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.970 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.970 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:31:12.970 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:12.971 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.971 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.971 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.971 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:12.972 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.972 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.972 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.972 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:31:12.972 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:12.973 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.973 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.973 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.973 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:31:12.974 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:12.974 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.974 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.974 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.974 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:12.975 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.975 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.975 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.975 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:31:12.978 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:12.979 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.979 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.979 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.979 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:31:12.979 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:12.980 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.980 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.980 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.980 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:31:12.981 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:31:12.981 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:31:12.981 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:31:12.981 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:12.981 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:12.982 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:12.982 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.982 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.982 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.983 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:31:12.983 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:31:12.983 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:12.983 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:12.984 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:12.984 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:12.984 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:12.984 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:12.984 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:12.985 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 75, 2022-01-10T01:31:12.985 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:12.985 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:12.985 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:12.986 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.986 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.986 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.986 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:31:12.986 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:12.987 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.987 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.987 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.987 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:31:12.988 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:12.988 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.988 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.988 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.988 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:12.989 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.989 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.989 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.989 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:31:12.989 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:12.990 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.990 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.990 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.990 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:31:12.991 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:12.991 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.991 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.991 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.991 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:12.992 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.992 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.992 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.992 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:31:12.993 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:12.993 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.993 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.993 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.993 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:31:12.994 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:12.994 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.994 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.994 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.995 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:12.995 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:12.995 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.995 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:12.995 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:31:12.996 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:12.996 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.996 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:12.996 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:12.997 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:31:12.997 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:12.997 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:12.997 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.997 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:12.998 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:31:12.998 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:31:12.998 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:31:12.998 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:31:12.999 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:12.999 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:12.999 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:12.999 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:12.999 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.000 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.000 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:31:13.000 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:31:13.000 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:13.001 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:13.001 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:13.001 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:13.001 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:13.001 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:13.002 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:13.002 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 74, 2022-01-10T01:31:13.002 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:13.002 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:13.003 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:13.003 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:13.003 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.003 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:13.003 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:31:13.004 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:13.004 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.004 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.004 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:13.004 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:31:13.005 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:13.005 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:13.005 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:13.005 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.006 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:13.006 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:13.006 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.006 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:13.007 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:31:13.007 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:13.007 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.007 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.007 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:13.008 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:31:13.008 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:13.008 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:13.008 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:13.008 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.009 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:13.009 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:13.009 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.009 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:13.010 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:31:13.010 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:13.010 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.010 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.011 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:13.011 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:31:13.011 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:13.011 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:13.011 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:13.012 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.012 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:13.012 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:13.012 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.013 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:13.013 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:31:13.013 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:13.013 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.013 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.014 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:13.014 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:31:13.014 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:13.014 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:13.015 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:13.015 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.015 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:31:13.015 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:31:13.015 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:31:13.016 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:31:13.016 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:13.016 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:13.016 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:13.017 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:13.017 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.017 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.017 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:31:13.017 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:31:13.018 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:13.018 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:13.018 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:13.018 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:13.019 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:13.019 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:13.019 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:13.019 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 75, 2022-01-10T01:31:13.019 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:13.020 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:13.020 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:13.020 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:13.020 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.020 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:13.021 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:31:13.021 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:13.021 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.021 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.022 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:13.022 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:31:13.022 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:13.022 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:13.022 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:13.023 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.023 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:13.023 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:13.023 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.024 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:13.024 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:31:13.024 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:13.024 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.024 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.025 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:13.025 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:31:13.025 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:13.025 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:13.026 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:13.026 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.026 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:13.026 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:13.026 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.027 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:13.027 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:31:13.027 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:13.027 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.028 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.028 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:13.028 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:31:13.028 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:13.029 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:13.029 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:13.029 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.029 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:13.029 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:13.030 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.030 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:13.030 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:31:13.030 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:13.031 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.031 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.031 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:13.031 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:31:13.031 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:13.032 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:13.032 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:13.032 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.032 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:31:13.032 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:31:13.033 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:31:13.033 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:31:13.033 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:13.033 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:13.034 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:13.034 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:13.034 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:13.034 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:13.034 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:31:13.035 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.035 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:31:13.035 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:13.035 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:13.036 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:13.036 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:13.036 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:13.036 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:31:13.036 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:13.037 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.037 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.037 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:31:13.037 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:13.038 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:13.038 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:13.038 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:13.038 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:13.038 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:31:13.039 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:13.039 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.039 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.039 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:31:13.040 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:13.040 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:13.040 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:13.040 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:13.040 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:13.041 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:31:13.041 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:13.041 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.041 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.042 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:31:13.042 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:13.042 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:13.042 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:13.042 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:13.043 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:13.043 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:31:13.043 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:13.043 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.044 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.044 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:31:13.044 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:13.044 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:13.044 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:13.045 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:13.045 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:13.045 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:31:13.045 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:13.046 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.046 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.046 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:31:13.046 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:13.046 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:13.047 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:13.047 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:13.047 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:13.047 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:31:13.048 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:13.048 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.048 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.048 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:31:13.048 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:13.049 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:13.049 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:13.049 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:13.049 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:13.049 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:31:13.050 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:13.050 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.050 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:13.050 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:31:13.051 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:13.051 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:13.051 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:13.051 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:13.051 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:13.052 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:31:13.052 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:13.052 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:13.052 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:13.053 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:31:13.053 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:31:13.053 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:31:13.053 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:31:13.053 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": { 2022-01-10T01:31:13.054 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.36:6835/452951292": "2022-01-11T01:31:06.119065+0000", 2022-01-10T01:31:13.054 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.36:6834/452951292": "2022-01-11T01:31:06.119065+0000", 2022-01-10T01:31:13.055 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.139:0/1396023791": "2022-01-10T02:30:54.308570+0000" 2022-01-10T01:31:13.055 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.055 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:31:13.055 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:31:13.056 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:31:13.056 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:31:13.056 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:31:13.056 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:31:13.057 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:31:13.057 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:31:13.057 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:31:13.057 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:31:13.057 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:31:13.058 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:31:13.058 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.058 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:31:13.058 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:31:13.059 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:31:13.059 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:31:13.059 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:31:13.059 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:31:13.059 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:31:13.060 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:13.060 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:13.060 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:31:13.060 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:31:13.061 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:31:13.061 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:31:13.061 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:31:13.061 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:31:13.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.849+0000 7fe98d96e700 1 -- 172.21.15.36:0/3219822618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe960053620 msgr2=0x7fe960055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.849+0000 7fe98d96e700 1 --2- 172.21.15.36:0/3219822618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe960053620 0x7fe960055ae0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fe98001b000 tx=0x7fe980016000).stop 2022-01-10T01:31:13.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.849+0000 7fe98d96e700 1 -- 172.21.15.36:0/3219822618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9880a70c0 msgr2=0x7fe9880ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.849+0000 7fe98d96e700 1 --2- 172.21.15.36:0/3219822618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9880a70c0 0x7fe9880ae880 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7fe9880b3170 tx=0x7fe970007c50).stop 2022-01-10T01:31:13.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.849+0000 7fe98d96e700 1 -- 172.21.15.36:0/3219822618 shutdown_connections 2022-01-10T01:31:13.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.849+0000 7fe98d96e700 1 --2- 172.21.15.36:0/3219822618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe960053620 0x7fe960055ae0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.849+0000 7fe98d96e700 1 --2- 172.21.15.36:0/3219822618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9881483a0 0x7fe9880ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.849+0000 7fe98d96e700 1 --2- 172.21.15.36:0/3219822618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9880b1db0 0x7fe988156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.849+0000 7fe98d96e700 1 --2- 172.21.15.36:0/3219822618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9880a70c0 0x7fe9880ae880 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.849+0000 7fe98d96e700 1 -- 172.21.15.36:0/3219822618 >> 172.21.15.36:0/3219822618 conn(0x7fe98805f6b0 msgr2=0x7fe988144c50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:13.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.849+0000 7fe98d96e700 1 -- 172.21.15.36:0/3219822618 shutdown_connections 2022-01-10T01:31:13.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:12.849+0000 7fe98d96e700 1 -- 172.21.15.36:0/3219822618 wait complete. 2022-01-10T01:31:13.067 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:13.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.177+0000 7f281b0c0700 1 Processor -- start 2022-01-10T01:31:13.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.177+0000 7f281b0c0700 1 -- start start 2022-01-10T01:31:13.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.177+0000 7f281b0c0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f28140b04a0 0x7f28140add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.177+0000 7f281b0c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28140aa120 0x7f28140ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.177+0000 7f281b0c0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28140b0880 0x7f2814143710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.177+0000 7f281b0c0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28140b2af0 con 0x7f28140b04a0 2022-01-10T01:31:13.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.177+0000 7f281b0c0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28140b2770 con 0x7f28140b0880 2022-01-10T01:31:13.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.177+0000 7f281b0c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28140b2d20 con 0x7f28140aa120 2022-01-10T01:31:13.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.177+0000 7f2818e5c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f28140b04a0 0x7f28140add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.177+0000 7f2818e5c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f28140b04a0 0x7f28140add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38510/0 (socket says 172.21.15.36:38510) 2022-01-10T01:31:13.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f2818e5c700 1 -- 172.21.15.36:0/3465116624 learned_addr learned my addr 172.21.15.36:0/3465116624 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:13.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f281965d700 1 --2- 172.21.15.36:0/3465116624 >> v2:172.21.15.59:3300/0 conn(0x7f28140b0880 0x7f2814143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f2813fff700 1 --2- 172.21.15.36:0/3465116624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28140aa120 0x7f28140ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f2818e5c700 1 -- 172.21.15.36:0/3465116624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28140aa120 msgr2=0x7f28140ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:13.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f2818e5c700 1 --2- 172.21.15.36:0/3465116624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28140aa120 0x7f28140ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f2818e5c700 1 -- 172.21.15.36:0/3465116624 >> v2:172.21.15.59:3300/0 conn(0x7f28140b0880 msgr2=0x7f2814143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:13.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f2818e5c700 1 --2- 172.21.15.36:0/3465116624 >> v2:172.21.15.59:3300/0 conn(0x7f28140b0880 0x7f2814143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f2818e5c700 1 -- 172.21.15.36:0/3465116624 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28140a9b70 con 0x7f28140b04a0 2022-01-10T01:31:13.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f2818e5c700 1 --2- 172.21.15.36:0/3465116624 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28140b04a0 0x7f28140add30 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f2808002f70 tx=0x7f2808006f40).ready entity=mon.0 client_cookie=1b5507916974023f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:13.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f28137fe700 1 -- 172.21.15.36:0/3465116624 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f280800d9a0 con 0x7f28140b04a0 2022-01-10T01:31:13.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f28137fe700 1 -- 172.21.15.36:0/3465116624 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2808000e90 con 0x7f28140b04a0 2022-01-10T01:31:13.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f28137fe700 1 -- 172.21.15.36:0/3465116624 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f280800dd30 con 0x7f28140b04a0 2022-01-10T01:31:13.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f281b0c0700 1 -- 172.21.15.36:0/3465116624 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28140b04a0 msgr2=0x7f28140add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f281b0c0700 1 --2- 172.21.15.36:0/3465116624 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28140b04a0 0x7f28140add30 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f2808002f70 tx=0x7f2808006f40).stop 2022-01-10T01:31:13.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f281b0c0700 1 -- 172.21.15.36:0/3465116624 shutdown_connections 2022-01-10T01:31:13.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f281b0c0700 1 --2- 172.21.15.36:0/3465116624 >> v2:172.21.15.59:3300/0 conn(0x7f28140b0880 0x7f2814143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f281b0c0700 1 --2- 172.21.15.36:0/3465116624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28140aa120 0x7f28140ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f281b0c0700 1 --2- 172.21.15.36:0/3465116624 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28140b04a0 0x7f28140add30 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f281b0c0700 1 -- 172.21.15.36:0/3465116624 >> 172.21.15.36:0/3465116624 conn(0x7f28140607c0 msgr2=0x7f2814060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:13.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f281b0c0700 1 -- 172.21.15.36:0/3465116624 shutdown_connections 2022-01-10T01:31:13.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.181+0000 7f281b0c0700 1 -- 172.21.15.36:0/3465116624 wait complete. 2022-01-10T01:31:13.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f281b0c0700 1 Processor -- start 2022-01-10T01:31:13.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f281b0c0700 1 -- start start 2022-01-10T01:31:13.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f281b0c0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28140aa120 0x7f281413d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f281b0c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28140b04a0 0x7f281413a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f281b0c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28140b0880 0x7f281413a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f281b0c0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2814064380 con 0x7f28140aa120 2022-01-10T01:31:13.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f281b0c0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2814155ff0 con 0x7f28140b0880 2022-01-10T01:31:13.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f281b0c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2814156290 con 0x7f28140b04a0 2022-01-10T01:31:13.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f2818e5c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28140aa120 0x7f281413d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f2818e5c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28140aa120 0x7f281413d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38514/0 (socket says 172.21.15.36:38514) 2022-01-10T01:31:13.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f2818e5c700 1 -- 172.21.15.36:0/67002896 learned_addr learned my addr 172.21.15.36:0/67002896 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:13.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f281965d700 1 --2- 172.21.15.36:0/67002896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28140b0880 0x7f281413a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f2813fff700 1 --2- 172.21.15.36:0/67002896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28140b04a0 0x7f281413a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f2818e5c700 1 -- 172.21.15.36:0/67002896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28140b04a0 msgr2=0x7f281413a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f2818e5c700 1 --2- 172.21.15.36:0/67002896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28140b04a0 0x7f281413a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f2818e5c700 1 -- 172.21.15.36:0/67002896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28140b0880 msgr2=0x7f281413a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f2818e5c700 1 --2- 172.21.15.36:0/67002896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28140b0880 0x7f281413a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f2818e5c700 1 -- 172.21.15.36:0/67002896 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280800b460 con 0x7f28140aa120 2022-01-10T01:31:13.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f2818e5c700 1 --2- 172.21.15.36:0/67002896 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28140aa120 0x7f281413d7b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f2808002f70 tx=0x7f2808006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:13.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f2811ffb700 1 -- 172.21.15.36:0/67002896 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f280801d070 con 0x7f28140aa120 2022-01-10T01:31:13.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f2811ffb700 1 -- 172.21.15.36:0/67002896 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2808010e50 con 0x7f28140aa120 2022-01-10T01:31:13.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f281b0c0700 1 -- 172.21.15.36:0/67002896 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2814156530 con 0x7f28140aa120 2022-01-10T01:31:13.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f2811ffb700 1 -- 172.21.15.36:0/67002896 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2808022600 con 0x7f28140aa120 2022-01-10T01:31:13.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f281b0c0700 1 -- 172.21.15.36:0/67002896 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2814155c70 con 0x7f28140aa120 2022-01-10T01:31:13.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.185+0000 7f281b0c0700 1 -- 172.21.15.36:0/67002896 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2814057350 con 0x7f28140aa120 2022-01-10T01:31:13.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.189+0000 7f2811ffb700 1 -- 172.21.15.36:0/67002896 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2808029070 con 0x7f28140aa120 2022-01-10T01:31:13.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.189+0000 7f2811ffb700 1 --2- 172.21.15.36:0/67002896 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f27f40534d0 0x7f27f4055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.189+0000 7f2811ffb700 1 -- 172.21.15.36:0/67002896 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f280806cb10 con 0x7f28140aa120 2022-01-10T01:31:13.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.189+0000 7f2813fff700 1 --2- 172.21.15.36:0/67002896 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f27f40534d0 0x7f27f4055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.189+0000 7f2813fff700 1 --2- 172.21.15.36:0/67002896 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f27f40534d0 0x7f27f4055990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f280000b000 tx=0x7f2800006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:13.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.193+0000 7f2811ffb700 1 -- 172.21.15.36:0/67002896 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2808043d30 con 0x7f28140aa120 2022-01-10T01:31:13.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.369+0000 7f281b0c0700 1 -- 172.21.15.36:0/67002896 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2814044650 con 0x7f28140aa120 2022-01-10T01:31:13.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.369+0000 7f2811ffb700 1 -- 172.21.15.36:0/67002896 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+1559 (secure 0 0 0) 0x7f2808047350 con 0x7f28140aa120 2022-01-10T01:31:13.373 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:13.374 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3321682930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3321682930},{"type":"v1","addr":"172.21.15.59:6833","nonce":3321682930}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/635174626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":635174626},{"type":"v1","addr":"172.21.15.36:6837","nonce":635174626}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6522,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/3291125500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3291125500},{"type":"v1","addr":"172.21.15.36:6835","nonce":3291125500}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37}],"filesystems":[]} 2022-01-10T01:31:13.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.369+0000 7f281b0c0700 1 -- 172.21.15.36:0/67002896 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f27f40534d0 msgr2=0x7f27f4055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.369+0000 7f281b0c0700 1 --2- 172.21.15.36:0/67002896 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f27f40534d0 0x7f27f4055990 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f280000b000 tx=0x7f2800006df0).stop 2022-01-10T01:31:13.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.369+0000 7f281b0c0700 1 -- 172.21.15.36:0/67002896 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28140aa120 msgr2=0x7f281413d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.369+0000 7f281b0c0700 1 --2- 172.21.15.36:0/67002896 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28140aa120 0x7f281413d7b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f2808002f70 tx=0x7f2808006f40).stop 2022-01-10T01:31:13.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.369+0000 7f281b0c0700 1 -- 172.21.15.36:0/67002896 shutdown_connections 2022-01-10T01:31:13.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.369+0000 7f281b0c0700 1 --2- 172.21.15.36:0/67002896 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f27f40534d0 0x7f27f4055990 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.369+0000 7f281b0c0700 1 --2- 172.21.15.36:0/67002896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28140b0880 0x7f281413a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.369+0000 7f281b0c0700 1 --2- 172.21.15.36:0/67002896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28140b04a0 0x7f281413a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.369+0000 7f281b0c0700 1 --2- 172.21.15.36:0/67002896 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28140aa120 0x7f281413d7b0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.369+0000 7f281b0c0700 1 -- 172.21.15.36:0/67002896 >> 172.21.15.36:0/67002896 conn(0x7f28140607c0 msgr2=0x7f28140b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:13.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.369+0000 7f281b0c0700 1 -- 172.21.15.36:0/67002896 shutdown_connections 2022-01-10T01:31:13.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.369+0000 7f281b0c0700 1 -- 172.21.15.36:0/67002896 wait complete. 2022-01-10T01:31:13.379 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 37 2022-01-10T01:31:13.386 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:13.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.489+0000 7feae208d700 1 Processor -- start 2022-01-10T01:31:13.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.489+0000 7feae208d700 1 -- start start 2022-01-10T01:31:13.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.489+0000 7feae208d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feadc139cc0 0x7feadc0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.489+0000 7feae208d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7feadc0b21c0 0x7feadc1434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.489+0000 7feae208d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feadc0ad070 con 0x7feadc13a0a0 2022-01-10T01:31:13.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.489+0000 7feae208d700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feadc0b2730 con 0x7feadc0b21c0 2022-01-10T01:31:13.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.489+0000 7feae208d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc060d40 con 0x7feadc139cc0 2022-01-10T01:31:13.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.489+0000 7feadaffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7feadc0b21c0 0x7feadc1434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feadaffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7feadc0b21c0 0x7feadc1434f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38524/0 (socket says 172.21.15.36:38524) 2022-01-10T01:31:13.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feadaffd700 1 -- 172.21.15.36:0/416707650 learned_addr learned my addr 172.21.15.36:0/416707650 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:13.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feadb7fe700 1 --2- 172.21.15.36:0/416707650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feadc139cc0 0x7feadc0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feadaffd700 1 -- 172.21.15.36:0/416707650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feadc139cc0 msgr2=0x7feadc0acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:13.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feadaffd700 1 --2- 172.21.15.36:0/416707650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feadc139cc0 0x7feadc0acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feadaffd700 1 -- 172.21.15.36:0/416707650 >> v1:172.21.15.59:6789/0 conn(0x7feadc13a0a0 legacy=0x7feadc0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feada7fc700 1 -- 172.21.15.36:0/416707650 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111286158 0 0) 0x7fead4001110 con 0x7feadc13a0a0 2022-01-10T01:31:13.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feadaffd700 1 -- 172.21.15.36:0/416707650 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feadc0b6cd0 con 0x7feadc0b21c0 2022-01-10T01:31:13.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feadaffd700 1 --2- 172.21.15.36:0/416707650 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7feadc0b21c0 0x7feadc1434f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fead0002f70 tx=0x7fead0006eb0).ready entity=mon.0 client_cookie=b2add6629af7e97 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:13.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feada7fc700 1 -- 172.21.15.36:0/416707650 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fead000d570 con 0x7feadc0b21c0 2022-01-10T01:31:13.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feada7fc700 1 -- 172.21.15.36:0/416707650 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead0000e90 con 0x7feadc0b21c0 2022-01-10T01:31:13.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feada7fc700 1 -- 172.21.15.36:0/416707650 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fead000d8c0 con 0x7feadc0b21c0 2022-01-10T01:31:13.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feae208d700 1 -- 172.21.15.36:0/416707650 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7feadc0b21c0 msgr2=0x7feadc1434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feae208d700 1 --2- 172.21.15.36:0/416707650 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7feadc0b21c0 0x7feadc1434f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fead0002f70 tx=0x7fead0006eb0).stop 2022-01-10T01:31:13.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feae208d700 1 -- 172.21.15.36:0/416707650 shutdown_connections 2022-01-10T01:31:13.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feae208d700 1 --2- 172.21.15.36:0/416707650 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7feadc0b21c0 0x7feadc1434f0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feae208d700 1 --2- 172.21.15.36:0/416707650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feadc139cc0 0x7feadc0acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feae208d700 1 -- 172.21.15.36:0/416707650 >> 172.21.15.36:0/416707650 conn(0x7feadc0b3480 msgr2=0x7feadc0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:13.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feae208d700 1 -- 172.21.15.36:0/416707650 shutdown_connections 2022-01-10T01:31:13.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feae208d700 1 -- 172.21.15.36:0/416707650 wait complete. 2022-01-10T01:31:13.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feae208d700 1 Processor -- start 2022-01-10T01:31:13.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.493+0000 7feae208d700 1 -- start start 2022-01-10T01:31:13.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feae208d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feadc0b21c0 0x7feadc13e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feae208d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7feadc139cc0 0x7feadc148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feae208d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feadc13a0a0 0x7feadc155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feae208d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc142290 con 0x7feadc139cc0 2022-01-10T01:31:13.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feae208d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feadc142530 con 0x7feadc13a0a0 2022-01-10T01:31:13.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feae208d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feadc147ad0 con 0x7feadc0b21c0 2022-01-10T01:31:13.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feadaffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7feadc139cc0 0x7feadc148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feadaffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7feadc139cc0 0x7feadc148210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38530/0 (socket says 172.21.15.36:38530) 2022-01-10T01:31:13.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feadaffd700 1 -- 172.21.15.36:0/802731928 learned_addr learned my addr 172.21.15.36:0/802731928 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:13.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feadb7fe700 1 --2- 172.21.15.36:0/802731928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feadc0b21c0 0x7feadc13e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feadbfff700 1 --2- 172.21.15.36:0/802731928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feadc13a0a0 0x7feadc155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feadaffd700 1 -- 172.21.15.36:0/802731928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feadc0b21c0 msgr2=0x7feadc13e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feadaffd700 1 --2- 172.21.15.36:0/802731928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feadc0b21c0 0x7feadc13e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feadaffd700 1 -- 172.21.15.36:0/802731928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feadc13a0a0 msgr2=0x7feadc155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feadaffd700 1 --2- 172.21.15.36:0/802731928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feadc13a0a0 0x7feadc155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feadaffd700 1 -- 172.21.15.36:0/802731928 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead000b1e0 con 0x7feadc139cc0 2022-01-10T01:31:13.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feadaffd700 1 --2- 172.21.15.36:0/802731928 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7feadc139cc0 0x7feadc148210 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7fead0002f70 tx=0x7fead0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:13.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7fead8ff9700 1 -- 172.21.15.36:0/802731928 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fead0011760 con 0x7feadc139cc0 2022-01-10T01:31:13.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7fead8ff9700 1 -- 172.21.15.36:0/802731928 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead00118c0 con 0x7feadc139cc0 2022-01-10T01:31:13.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feae208d700 1 -- 172.21.15.36:0/802731928 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc147d70 con 0x7feadc139cc0 2022-01-10T01:31:13.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7fead8ff9700 1 -- 172.21.15.36:0/802731928 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fead0011c20 con 0x7feadc139cc0 2022-01-10T01:31:13.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.497+0000 7feae208d700 1 -- 172.21.15.36:0/802731928 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feadc141e60 con 0x7feadc139cc0 2022-01-10T01:31:13.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.501+0000 7fead8ff9700 1 -- 172.21.15.36:0/802731928 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fead0025030 con 0x7feadc139cc0 2022-01-10T01:31:13.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.501+0000 7feae208d700 1 -- 172.21.15.36:0/802731928 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feadc147f00 con 0x7feadc139cc0 2022-01-10T01:31:13.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.501+0000 7fead8ff9700 1 --2- 172.21.15.36:0/802731928 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7feabc0534d0 0x7feabc055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.501+0000 7fead8ff9700 1 -- 172.21.15.36:0/802731928 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5729+0+0 (secure 0 0 0) 0x7fead006c940 con 0x7feadc139cc0 2022-01-10T01:31:13.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.501+0000 7feadb7fe700 1 --2- 172.21.15.36:0/802731928 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7feabc0534d0 0x7feabc055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.501+0000 7feadb7fe700 1 --2- 172.21.15.36:0/802731928 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7feabc0534d0 0x7feabc055990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7feacc00b000 tx=0x7feacc0091d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:13.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.509+0000 7fead8ff9700 1 -- 172.21.15.36:0/802731928 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fead0043c40 con 0x7feadc139cc0 2022-01-10T01:31:13.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.673+0000 7feae208d700 1 -- 172.21.15.36:0/802731928 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feadc060fa0 con 0x7feadc139cc0 2022-01-10T01:31:13.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.673+0000 7fead8ff9700 1 -- 172.21.15.36:0/802731928 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+1559 (secure 0 0 0) 0x7fead0047220 con 0x7feadc139cc0 2022-01-10T01:31:13.680 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:13.680 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6232,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3321682930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3321682930},{"type":"v1","addr":"172.21.15.59:6833","nonce":3321682930}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6234,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/635174626","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":635174626},{"type":"v1","addr":"172.21.15.36:6837","nonce":635174626}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6522,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/3291125500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3291125500},{"type":"v1","addr":"172.21.15.36:6835","nonce":3291125500}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":37}],"filesystems":[]} 2022-01-10T01:31:13.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.677+0000 7feae208d700 1 -- 172.21.15.36:0/802731928 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7feabc0534d0 msgr2=0x7feabc055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.677+0000 7feae208d700 1 --2- 172.21.15.36:0/802731928 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7feabc0534d0 0x7feabc055990 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7feacc00b000 tx=0x7feacc0091d0).stop 2022-01-10T01:31:13.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.677+0000 7feae208d700 1 -- 172.21.15.36:0/802731928 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7feadc139cc0 msgr2=0x7feadc148210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.677+0000 7feae208d700 1 --2- 172.21.15.36:0/802731928 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7feadc139cc0 0x7feadc148210 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7fead0002f70 tx=0x7fead0015000).stop 2022-01-10T01:31:13.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.677+0000 7feae208d700 1 -- 172.21.15.36:0/802731928 shutdown_connections 2022-01-10T01:31:13.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.677+0000 7feae208d700 1 --2- 172.21.15.36:0/802731928 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7feabc0534d0 0x7feabc055990 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.677+0000 7feae208d700 1 --2- 172.21.15.36:0/802731928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feadc13a0a0 0x7feadc155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.677+0000 7feae208d700 1 --2- 172.21.15.36:0/802731928 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7feadc139cc0 0x7feadc148210 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.677+0000 7feae208d700 1 --2- 172.21.15.36:0/802731928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feadc0b21c0 0x7feadc13e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.677+0000 7feae208d700 1 -- 172.21.15.36:0/802731928 >> 172.21.15.36:0/802731928 conn(0x7feadc0b3480 msgr2=0x7feadc0b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:13.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.677+0000 7feae208d700 1 -- 172.21.15.36:0/802731928 shutdown_connections 2022-01-10T01:31:13.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.677+0000 7feae208d700 1 -- 172.21.15.36:0/802731928 wait complete. 2022-01-10T01:31:13.689 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 37 2022-01-10T01:31:13.693 INFO:tasks.ceph.mds.a:Restarting daemon 2022-01-10T01:31:13.694 INFO:tasks.ceph.mds.a:Stopping old one... 2022-01-10T01:31:13.694 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-01-10T01:31:13.695 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:31:13.695 INFO:tasks.ceph.mds.c:Restarting daemon 2022-01-10T01:31:13.696 INFO:tasks.ceph.mds.c:Stopping old one... 2022-01-10T01:31:13.696 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-01-10T01:31:13.697 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:31:13.697 INFO:tasks.ceph.mds.b:Restarting daemon 2022-01-10T01:31:13.698 INFO:tasks.ceph.mds.b:Stopping old one... 2022-01-10T01:31:13.699 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-01-10T01:31:13.699 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:31:13.708 INFO:tasks.ceph.mds.a:Stopped 2022-01-10T01:31:13.709 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-01-10T01:31:13.711 INFO:tasks.ceph.mds.c:Stopped 2022-01-10T01:31:13.711 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-01-10T01:31:13.712 INFO:tasks.ceph.mds.a:Started 2022-01-10T01:31:13.713 DEBUG:teuthology.parallel:result is None 2022-01-10T01:31:13.715 INFO:tasks.ceph.mds.c:Started 2022-01-10T01:31:13.715 DEBUG:teuthology.parallel:result is None 2022-01-10T01:31:13.716 INFO:tasks.ceph.mds.b:Stopped 2022-01-10T01:31:13.716 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-01-10T01:31:13.761 INFO:tasks.ceph.mds.b:Started 2022-01-10T01:31:13.761 DEBUG:teuthology.parallel:result is None 2022-01-10T01:31:13.762 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2022-01-10T01:31:13.789 INFO:tasks.ceph.mds.c.smithi036.stdout:starting mds.c at 2022-01-10T01:31:13.796 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:31:13.840 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:31:13.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.849+0000 7f54dac02700 1 Processor -- start 2022-01-10T01:31:13.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54dac02700 1 -- start start 2022-01-10T01:31:13.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54dac02700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f54d40a8bf0 0x7f54d4143620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54dac02700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d40ae000 con 0x7f54d40aca70 2022-01-10T01:31:13.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54dac02700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d40b1820 con 0x7f54d40b10e0 2022-01-10T01:31:13.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54dac02700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d40b1580 con 0x7f54d40a8bf0 2022-01-10T01:31:13.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54d899e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f54d40a8bf0 0x7f54d4143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54d899e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f54d40a8bf0 0x7f54d4143620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38566/0 (socket says 172.21.15.36:38566) 2022-01-10T01:31:13.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54d899e700 1 -- 172.21.15.36:0/2196365244 learned_addr learned my addr 172.21.15.36:0/2196365244 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:13.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54d899e700 1 -- 172.21.15.36:0/2196365244 >> v1:172.21.15.59:6789/0 conn(0x7f54d40b10e0 legacy=0x7f54d40ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54d899e700 1 -- 172.21.15.36:0/2196365244 >> v1:172.21.15.36:6789/0 conn(0x7f54d40aca70 legacy=0x7f54d40ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54d899e700 1 -- 172.21.15.36:0/2196365244 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d40ae260 con 0x7f54d40a8bf0 2022-01-10T01:31:13.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54d899e700 1 --2- 172.21.15.36:0/2196365244 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f54d40a8bf0 0x7f54d4143620 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f54cc0032f0 tx=0x7f54cc00b530).ready entity=mon.0 client_cookie=eddc1dfb64fc2352 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:13.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54d37fe700 1 -- 172.21.15.36:0/2196365244 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54cc010660 con 0x7f54d40a8bf0 2022-01-10T01:31:13.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54d37fe700 1 -- 172.21.15.36:0/2196365244 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc0107c0 con 0x7f54d40a8bf0 2022-01-10T01:31:13.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.853+0000 7f54d37fe700 1 -- 172.21.15.36:0/2196365244 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54cc010b20 con 0x7f54d40a8bf0 2022-01-10T01:31:13.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 -- 172.21.15.36:0/2196365244 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f54d40a8bf0 msgr2=0x7f54d4143620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 --2- 172.21.15.36:0/2196365244 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f54d40a8bf0 0x7f54d4143620 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f54cc0032f0 tx=0x7f54cc00b530).stop 2022-01-10T01:31:13.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 -- 172.21.15.36:0/2196365244 shutdown_connections 2022-01-10T01:31:13.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 --2- 172.21.15.36:0/2196365244 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f54d40a8bf0 0x7f54d4143620 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 -- 172.21.15.36:0/2196365244 >> 172.21.15.36:0/2196365244 conn(0x7f54d40608d0 msgr2=0x7f54d4060ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:13.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 -- 172.21.15.36:0/2196365244 shutdown_connections 2022-01-10T01:31:13.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 -- 172.21.15.36:0/2196365244 wait complete. 2022-01-10T01:31:13.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 Processor -- start 2022-01-10T01:31:13.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 -- start start 2022-01-10T01:31:13.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f54d40a8bf0 0x7f54d40b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d40aca70 0x7f54d4152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54d40b10e0 0x7f54d414c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d413c0c0 con 0x7f54d40a8bf0 2022-01-10T01:31:13.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d413c360 con 0x7f54d40b10e0 2022-01-10T01:31:13.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d40b3810 con 0x7f54d40aca70 2022-01-10T01:31:13.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d919f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54d40b10e0 0x7f54d414c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d899e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f54d40a8bf0 0x7f54d40b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d919f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54d40b10e0 0x7f54d414c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:35206/0 (socket says 172.21.15.36:35206) 2022-01-10T01:31:13.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d919f700 1 -- 172.21.15.36:0/3256686742 learned_addr learned my addr 172.21.15.36:0/3256686742 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:13.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d3fff700 1 --2- 172.21.15.36:0/3256686742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d40aca70 0x7f54d4152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d899e700 1 -- 172.21.15.36:0/3256686742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d40aca70 msgr2=0x7f54d4152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d899e700 1 --2- 172.21.15.36:0/3256686742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d40aca70 0x7f54d4152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d899e700 1 -- 172.21.15.36:0/3256686742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54d40b10e0 msgr2=0x7f54d414c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:13.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d899e700 1 --2- 172.21.15.36:0/3256686742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54d40b10e0 0x7f54d414c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:13.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d899e700 1 -- 172.21.15.36:0/3256686742 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc00b7d0 con 0x7f54d40a8bf0 2022-01-10T01:31:13.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d919f700 1 --2- 172.21.15.36:0/3256686742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54d40b10e0 0x7f54d414c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:13.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d899e700 1 --2- 172.21.15.36:0/3256686742 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f54d40a8bf0 0x7f54d40b3f50 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f54cc0032f0 tx=0x7f54d40b27d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:13.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d1ffb700 1 -- 172.21.15.36:0/3256686742 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54cc01d070 con 0x7f54d40a8bf0 2022-01-10T01:31:13.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d1ffb700 1 -- 172.21.15.36:0/3256686742 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54cc010930 con 0x7f54d40a8bf0 2022-01-10T01:31:13.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 -- 172.21.15.36:0/3256686742 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d40b3ab0 con 0x7f54d40a8bf0 2022-01-10T01:31:13.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54d1ffb700 1 -- 172.21.15.36:0/3256686742 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54cc010660 con 0x7f54d40a8bf0 2022-01-10T01:31:13.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.857+0000 7f54dac02700 1 -- 172.21.15.36:0/3256686742 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d413bd50 con 0x7f54d40a8bf0 2022-01-10T01:31:13.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.861+0000 7f54dac02700 1 -- 172.21.15.36:0/3256686742 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d40b3c40 con 0x7f54d40a8bf0 2022-01-10T01:31:13.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.861+0000 7f54d1ffb700 1 -- 172.21.15.36:0/3256686742 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f54cc00f3d0 con 0x7f54d40a8bf0 2022-01-10T01:31:13.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.861+0000 7f54d1ffb700 1 --2- 172.21.15.36:0/3256686742 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f54b4053680 0x7f54b4055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:13.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.861+0000 7f54d1ffb700 1 -- 172.21.15.36:0/3256686742 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5729+0+0 (secure 0 0 0) 0x7f54cc06cc00 con 0x7f54d40a8bf0 2022-01-10T01:31:13.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.861+0000 7f54d3fff700 1 --2- 172.21.15.36:0/3256686742 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f54b4053680 0x7f54b4055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:13.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.861+0000 7f54d3fff700 1 --2- 172.21.15.36:0/3256686742 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f54b4053680 0x7f54b4055b40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f54c800d000 tx=0x7f54c8007b70).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:13.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:13.869+0000 7f54d1ffb700 1 -- 172.21.15.36:0/3256686742 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f54cc072020 con 0x7f54d40a8bf0 2022-01-10T01:31:14.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:14.005+0000 7f54dac02700 1 -- 172.21.15.36:0/3256686742 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f54d4057350 con 0x7f54d40a8bf0 2022-01-10T01:31:14.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:14.885+0000 7f54d1ffb700 1 -- 172.21.15.36:0/3256686742 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v84) v1 ==== 97+0+0 (secure 0 0 0) 0x7f54cc026070 con 0x7f54d40a8bf0 2022-01-10T01:31:14.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:14.889+0000 7f54dac02700 1 -- 172.21.15.36:0/3256686742 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f54b4053680 msgr2=0x7f54b4055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:14.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:14.889+0000 7f54dac02700 1 --2- 172.21.15.36:0/3256686742 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f54b4053680 0x7f54b4055b40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f54c800d000 tx=0x7f54c8007b70).stop 2022-01-10T01:31:14.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:14.889+0000 7f54dac02700 1 -- 172.21.15.36:0/3256686742 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f54d40a8bf0 msgr2=0x7f54d40b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:14.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:14.889+0000 7f54dac02700 1 --2- 172.21.15.36:0/3256686742 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f54d40a8bf0 0x7f54d40b3f50 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f54cc0032f0 tx=0x7f54d40b27d0).stop 2022-01-10T01:31:14.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:14.893+0000 7f54dac02700 1 -- 172.21.15.36:0/3256686742 shutdown_connections 2022-01-10T01:31:14.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:14.893+0000 7f54dac02700 1 --2- 172.21.15.36:0/3256686742 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f54b4053680 0x7f54b4055b40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:14.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:14.893+0000 7f54dac02700 1 --2- 172.21.15.36:0/3256686742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54d40b10e0 0x7f54d414c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:14.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:14.893+0000 7f54dac02700 1 --2- 172.21.15.36:0/3256686742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54d40aca70 0x7f54d4152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:14.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:14.893+0000 7f54dac02700 1 --2- 172.21.15.36:0/3256686742 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f54d40a8bf0 0x7f54d40b3f50 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:14.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:14.893+0000 7f54dac02700 1 -- 172.21.15.36:0/3256686742 >> 172.21.15.36:0/3256686742 conn(0x7f54d40608d0 msgr2=0x7f54d4060cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:14.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:14.893+0000 7f54dac02700 1 -- 172.21.15.36:0/3256686742 shutdown_connections 2022-01-10T01:31:14.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:14.893+0000 7f54dac02700 1 -- 172.21.15.36:0/3256686742 wait complete. 2022-01-10T01:31:14.899 INFO:teuthology.orchestra.run.smithi036.stderr: removed all blacklist entries 2022-01-10T01:31:14.908 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2022-01-10T01:31:14.909 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2022-01-10T01:31:15.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.057+0000 7f167b59e700 1 Processor -- start 2022-01-10T01:31:15.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.057+0000 7f167b59e700 1 -- start start 2022-01-10T01:31:15.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.057+0000 7f167b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167c061320 0x7f167c061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.057+0000 7f167b59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f167c140440 0x7f167c1408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.057+0000 7f167b59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f167c0aecf0 con 0x7f167c0ad5c0 2022-01-10T01:31:15.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.057+0000 7f167b59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f167c0b6f20 con 0x7f167c140440 2022-01-10T01:31:15.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.057+0000 7f167b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0aef20 con 0x7f167c061320 2022-01-10T01:31:15.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.057+0000 7f1679d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f167c0ad5c0 0x7f167c0b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36376/0 (socket says 172.21.15.36:36376) 2022-01-10T01:31:15.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.057+0000 7f1679d9b700 1 -- 172.21.15.36:0/2593616404 learned_addr learned my addr 172.21.15.36:0/2593616404 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:15.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167a59c700 1 --2- 172.21.15.36:0/2593616404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167c061320 0x7f167c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167ad9d700 1 --2- 172.21.15.36:0/2593616404 >> v2:172.21.15.59:3300/0 conn(0x7f167c140440 0x7f167c1408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167959a700 1 -- 172.21.15.36:0/2593616404 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626702842 0 0) 0x7f167c0aecf0 con 0x7f167c0ad5c0 2022-01-10T01:31:15.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167959a700 1 -- 172.21.15.36:0/2593616404 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1660003260 con 0x7f167c0ad5c0 2022-01-10T01:31:15.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167ad9d700 1 -- 172.21.15.36:0/2593616404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167c061320 msgr2=0x7f167c061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:15.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167ad9d700 1 --2- 172.21.15.36:0/2593616404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167c061320 0x7f167c061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167ad9d700 1 -- 172.21.15.36:0/2593616404 >> v1:172.21.15.36:6789/0 conn(0x7f167c0ad5c0 legacy=0x7f167c0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167959a700 1 -- 172.21.15.36:0/2593616404 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2880693122 0 0) 0x7f1660003260 con 0x7f167c0ad5c0 2022-01-10T01:31:15.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167ad9d700 1 -- 172.21.15.36:0/2593616404 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c0af1c0 con 0x7f167c140440 2022-01-10T01:31:15.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167ad9d700 1 --2- 172.21.15.36:0/2593616404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f167c140440 0x7f167c1408d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f16740032f0 tx=0x7f16740091d0).ready entity=mon.1 client_cookie=54bf8da804dd4817 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:15.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167959a700 1 -- 172.21.15.36:0/2593616404 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f167400b600 con 0x7f167c140440 2022-01-10T01:31:15.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167959a700 1 -- 172.21.15.36:0/2593616404 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167400b760 con 0x7f167c140440 2022-01-10T01:31:15.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167959a700 1 -- 172.21.15.36:0/2593616404 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f167400b8d0 con 0x7f167c140440 2022-01-10T01:31:15.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167b59e700 1 -- 172.21.15.36:0/2593616404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f167c140440 msgr2=0x7f167c1408d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167b59e700 1 --2- 172.21.15.36:0/2593616404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f167c140440 0x7f167c1408d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f16740032f0 tx=0x7f16740091d0).stop 2022-01-10T01:31:15.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167b59e700 1 -- 172.21.15.36:0/2593616404 shutdown_connections 2022-01-10T01:31:15.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167b59e700 1 --2- 172.21.15.36:0/2593616404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f167c140440 0x7f167c1408d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167b59e700 1 --2- 172.21.15.36:0/2593616404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167c061320 0x7f167c061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167b59e700 1 -- 172.21.15.36:0/2593616404 >> 172.21.15.36:0/2593616404 conn(0x7f167c066de0 msgr2=0x7f167c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:15.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167b59e700 1 -- 172.21.15.36:0/2593616404 shutdown_connections 2022-01-10T01:31:15.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.061+0000 7f167b59e700 1 -- 172.21.15.36:0/2593616404 wait complete. 2022-01-10T01:31:15.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.065+0000 7f167b59e700 1 Processor -- start 2022-01-10T01:31:15.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.065+0000 7f167b59e700 1 -- start start 2022-01-10T01:31:15.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.065+0000 7f167b59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f167c061320 0x7f167c0b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.065+0000 7f167b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167c0ad5c0 0x7f167c145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.065+0000 7f167b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f167c140440 0x7f167c145850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.065+0000 7f167b59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0aa410 con 0x7f167c140440 2022-01-10T01:31:15.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.065+0000 7f167b59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0b3f60 con 0x7f167c061320 2022-01-10T01:31:15.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.065+0000 7f167b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167c0aa610 con 0x7f167c0ad5c0 2022-01-10T01:31:15.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.065+0000 7f167ad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f167c140440 0x7f167c145850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.065+0000 7f1679d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167c0ad5c0 0x7f167c145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.065+0000 7f167a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f167c061320 0x7f167c0b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.065+0000 7f167a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f167c061320 0x7f167c0b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:35222/0 (socket says 172.21.15.36:35222) 2022-01-10T01:31:15.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.065+0000 7f167a59c700 1 -- 172.21.15.36:0/2278719665 learned_addr learned my addr 172.21.15.36:0/2278719665 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:15.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.065+0000 7f167ad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f167c140440 0x7f167c145850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38592/0 (socket says 172.21.15.36:38592) 2022-01-10T01:31:15.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f167a59c700 1 -- 172.21.15.36:0/2278719665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167c0ad5c0 msgr2=0x7f167c145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f167a59c700 1 --2- 172.21.15.36:0/2278719665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167c0ad5c0 0x7f167c145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f167a59c700 1 -- 172.21.15.36:0/2278719665 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f167c140440 msgr2=0x7f167c145850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f167a59c700 1 --2- 172.21.15.36:0/2278719665 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f167c140440 0x7f167c145850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f167a59c700 1 -- 172.21.15.36:0/2278719665 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1674009470 con 0x7f167c061320 2022-01-10T01:31:15.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f167ad9d700 1 --2- 172.21.15.36:0/2278719665 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f167c140440 0x7f167c145850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:15.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f167a59c700 1 --2- 172.21.15.36:0/2278719665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f167c061320 0x7f167c0b0b20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f167000c000 tx=0x7f1670006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:15.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f166b7fe700 1 -- 172.21.15.36:0/2278719665 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1670010780 con 0x7f167c061320 2022-01-10T01:31:15.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f166b7fe700 1 -- 172.21.15.36:0/2278719665 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16700108e0 con 0x7f167c061320 2022-01-10T01:31:15.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f167b59e700 1 -- 172.21.15.36:0/2278719665 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167c0aaae0 con 0x7f167c061320 2022-01-10T01:31:15.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f166b7fe700 1 -- 172.21.15.36:0/2278719665 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1670010c40 con 0x7f167c061320 2022-01-10T01:31:15.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f167b59e700 1 -- 172.21.15.36:0/2278719665 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f167c153090 con 0x7f167c061320 2022-01-10T01:31:15.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f167b59e700 1 -- 172.21.15.36:0/2278719665 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167c153250 con 0x7f167c061320 2022-01-10T01:31:15.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f166b7fe700 1 -- 172.21.15.36:0/2278719665 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f167001c460 con 0x7f167c061320 2022-01-10T01:31:15.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f166b7fe700 1 --2- 172.21.15.36:0/2278719665 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1658053590 0x7f1658055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f166b7fe700 1 -- 172.21.15.36:0/2278719665 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f167006bb80 con 0x7f167c061320 2022-01-10T01:31:15.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.069+0000 7f1679d9b700 1 --2- 172.21.15.36:0/2278719665 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1658053590 0x7f1658055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.073+0000 7f1679d9b700 1 --2- 172.21.15.36:0/2278719665 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1658053590 0x7f1658055a50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f166c00d000 tx=0x7f166c001740).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:15.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.081+0000 7f166b7fe700 1 -- 172.21.15.36:0/2278719665 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1670042d60 con 0x7f167c061320 2022-01-10T01:31:15.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.253+0000 7f167b59e700 1 -- 172.21.15.36:0/2278719665 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f167c0af460 con 0x7f167c061320 2022-01-10T01:31:15.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.253+0000 7f166b7fe700 1 -- 172.21.15.36:0/2278719665 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f167006be60 con 0x7f167c061320 2022-01-10T01:31:15.259 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:15.259 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:31:15.260 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_dump": [ 2022-01-10T01:31:15.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.260 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.a", 2022-01-10T01:31:15.261 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthuGT4IxAA5DyijS4tPjdOLn5uiLXEPg==", 2022-01-10T01:31:15.261 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.261 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:31:15.261 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:15.262 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:15.262 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:15.262 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.263 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.b", 2022-01-10T01:31:15.263 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthkvX0LRAAtz19usFvoObvouQeLFwicg==", 2022-01-10T01:31:15.264 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.264 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:31:15.264 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:15.264 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:15.265 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:15.265 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.265 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.c", 2022-01-10T01:31:15.266 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthbvUmKhAA0pVpDJO1AfsAzIHU1cAHiw==", 2022-01-10T01:31:15.266 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.266 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:31:15.267 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:15.267 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:15.267 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:15.267 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.268 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.0", 2022-01-10T01:31:15.268 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCWitthk4iKHRAAF7aFP+i24xFvXXm8j5GzVg==", 2022-01-10T01:31:15.268 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.269 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:15.269 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:15.269 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:15.269 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.270 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.1", 2022-01-10T01:31:15.270 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCZitthsKSXABAAb3IkNvlyLub89HwaPWZ1Bg==", 2022-01-10T01:31:15.270 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.271 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:15.271 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:15.271 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:15.271 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.272 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.2", 2022-01-10T01:31:15.272 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCbitthvNzhIBAAXkZ6FslnMl1gS/rOa7G+Vg==", 2022-01-10T01:31:15.273 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.273 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:15.273 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:15.273 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:15.274 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.275 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.3", 2022-01-10T01:31:15.276 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCeitth9P7EAxAA7KOCP7Rh5oN1yqCz9I6v3A==", 2022-01-10T01:31:15.276 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.277 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:15.277 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:15.277 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:15.278 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.279 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.4", 2022-01-10T01:31:15.280 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCjitth/L1UBxAAskxmSV0aE6CSvDFR8O/+SQ==", 2022-01-10T01:31:15.280 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.281 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:15.281 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:15.282 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:15.282 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.283 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.5", 2022-01-10T01:31:15.284 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQClitthMoY6JhAAeeIrCmMcm3MpDPtdLUf+2g==", 2022-01-10T01:31:15.284 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.285 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:15.285 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:15.286 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:15.286 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.288 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.6", 2022-01-10T01:31:15.288 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCoitthrUhlCxAAsYhU7Kj6HMo/kD0DezvITg==", 2022-01-10T01:31:15.288 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.289 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:15.289 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:15.290 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:15.290 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.292 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.7", 2022-01-10T01:31:15.292 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCqitthFaLrKRAAC2g1OlcV2KTtaOXsyCrIrQ==", 2022-01-10T01:31:15.292 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.293 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:15.293 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:15.294 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:15.294 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.295 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.0", 2022-01-10T01:31:15.296 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthKoa/NBAADjvHh99F8YOktGID9uyttg==", 2022-01-10T01:31:15.296 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.297 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:31:15.297 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:31:15.298 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:31:15.298 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.300 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.1", 2022-01-10T01:31:15.300 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth3x76OBAAPTrw8OUmnpEflWuB7zzaHg==", 2022-01-10T01:31:15.300 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.301 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:31:15.301 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:31:15.302 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:31:15.302 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.304 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.admin", 2022-01-10T01:31:15.304 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthf9dqChAADHRsoZKuozdsqb41ztuR7w==", 2022-01-10T01:31:15.304 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.305 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:31:15.305 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:15.306 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:15.306 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:15.307 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.308 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.x", 2022-01-10T01:31:15.308 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth39syIRAA6pOvLWw2ADy72TWZ65MIkA==", 2022-01-10T01:31:15.308 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.309 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:31:15.309 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:31:15.309 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:15.310 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:15.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:15.311 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.y", 2022-01-10T01:31:15.311 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth4novHRAACVMjo72kOB/T7Ti/CiN27w==", 2022-01-10T01:31:15.311 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:15.312 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:31:15.312 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:31:15.312 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:15.313 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.313 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:15.313 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:15.314 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:31:15.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.257+0000 7f167b59e700 1 -- 172.21.15.36:0/2278719665 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1658053590 msgr2=0x7f1658055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.257+0000 7f167b59e700 1 --2- 172.21.15.36:0/2278719665 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1658053590 0x7f1658055a50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f166c00d000 tx=0x7f166c001740).stop 2022-01-10T01:31:15.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.257+0000 7f167b59e700 1 -- 172.21.15.36:0/2278719665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f167c061320 msgr2=0x7f167c0b0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.257+0000 7f167b59e700 1 --2- 172.21.15.36:0/2278719665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f167c061320 0x7f167c0b0b20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f167000c000 tx=0x7f1670006df0).stop 2022-01-10T01:31:15.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.257+0000 7f167b59e700 1 -- 172.21.15.36:0/2278719665 shutdown_connections 2022-01-10T01:31:15.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.257+0000 7f167b59e700 1 --2- 172.21.15.36:0/2278719665 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1658053590 0x7f1658055a50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.257+0000 7f167b59e700 1 --2- 172.21.15.36:0/2278719665 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f167c140440 0x7f167c145850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.257+0000 7f167b59e700 1 --2- 172.21.15.36:0/2278719665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f167c0ad5c0 0x7f167c145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.257+0000 7f167b59e700 1 --2- 172.21.15.36:0/2278719665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f167c061320 0x7f167c0b0b20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.257+0000 7f167b59e700 1 -- 172.21.15.36:0/2278719665 >> 172.21.15.36:0/2278719665 conn(0x7f167c066de0 msgr2=0x7f167c0b77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:15.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.257+0000 7f167b59e700 1 -- 172.21.15.36:0/2278719665 shutdown_connections 2022-01-10T01:31:15.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.257+0000 7f167b59e700 1 -- 172.21.15.36:0/2278719665 wait complete. 2022-01-10T01:31:15.323 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:31:15.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f64545700 1 Processor -- start 2022-01-10T01:31:15.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f64545700 1 -- start start 2022-01-10T01:31:15.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f64545700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1f5c0affd0 0x7f1f5c1416a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f64545700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c145250 con 0x7f1f5c0b2200 2022-01-10T01:31:15.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f64545700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5c1454f0 con 0x7f1f5c0ac510 2022-01-10T01:31:15.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f64545700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5c141200 con 0x7f1f5c0affd0 2022-01-10T01:31:15.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f622e1700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f1f5c0b2200 0x7f1f5c0abe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36390/0 (socket says 172.21.15.36:36390) 2022-01-10T01:31:15.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f622e1700 1 -- 172.21.15.36:0/3238917619 learned_addr learned my addr 172.21.15.36:0/3238917619 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:15.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f61ae0700 1 --2- 172.21.15.36:0/3238917619 >> v2:172.21.15.36:3300/0 conn(0x7f1f5c0affd0 0x7f1f5c1416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 -- 172.21.15.36:0/3238917619 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294795963 0 0) 0x7f1f5c145250 con 0x7f1f5c0b2200 2022-01-10T01:31:15.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 -- 172.21.15.36:0/3238917619 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f44003260 con 0x7f1f5c0b2200 2022-01-10T01:31:15.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 -- 172.21.15.36:0/3238917619 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 7669538 0 0) 0x7f1f44003260 con 0x7f1f5c0b2200 2022-01-10T01:31:15.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 -- 172.21.15.36:0/3238917619 >> v2:172.21.15.36:3300/0 conn(0x7f1f5c0affd0 msgr2=0x7f1f5c1416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:15.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 --2- 172.21.15.36:0/3238917619 >> v2:172.21.15.36:3300/0 conn(0x7f1f5c0affd0 0x7f1f5c1416a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 -- 172.21.15.36:0/3238917619 >> v1:172.21.15.59:6789/0 conn(0x7f1f5c0ac510 legacy=0x7f1f5c14ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 -- 172.21.15.36:0/3238917619 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c0b04e0 con 0x7f1f5c0b2200 2022-01-10T01:31:15.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 -- 172.21.15.36:0/3238917619 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f1f58001660 con 0x7f1f5c0b2200 2022-01-10T01:31:15.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f61ae0700 1 --2- 172.21.15.36:0/3238917619 >> v2:172.21.15.36:3300/0 conn(0x7f1f5c0affd0 0x7f1f5c1416a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:15.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 -- 172.21.15.36:0/3238917619 >> v1:172.21.15.36:6789/0 conn(0x7f1f5c0b2200 legacy=0x7f1f5c0abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 --2- 172.21.15.36:0/3238917619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f44003750 0x7f1f44003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 --2- 172.21.15.36:0/3238917619 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f44004500 0x7f1f44004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 --2- 172.21.15.36:0/3238917619 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f44004e70 0x7f1f4400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 -- 172.21.15.36:0/3238917619 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c141200 con 0x7f1f44004500 2022-01-10T01:31:15.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 -- 172.21.15.36:0/3238917619 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4400bd20 con 0x7f1f44003750 2022-01-10T01:31:15.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f612df700 1 -- 172.21.15.36:0/3238917619 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4400bee0 con 0x7f1f44004e70 2022-01-10T01:31:15.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f61ae0700 1 --2- 172.21.15.36:0/3238917619 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f44004500 0x7f1f44004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f622e1700 1 --2- 172.21.15.36:0/3238917619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f44003750 0x7f1f44003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f62ae2700 1 --2- 172.21.15.36:0/3238917619 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f44004e70 0x7f1f4400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f61ae0700 1 -- 172.21.15.36:0/3238917619 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f44004e70 msgr2=0x7f1f4400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:15.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f61ae0700 1 --2- 172.21.15.36:0/3238917619 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f44004e70 0x7f1f4400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f61ae0700 1 -- 172.21.15.36:0/3238917619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f44003750 msgr2=0x7f1f44003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:15.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f61ae0700 1 --2- 172.21.15.36:0/3238917619 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f44003750 0x7f1f44003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f61ae0700 1 -- 172.21.15.36:0/3238917619 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f44003260 con 0x7f1f44004500 2022-01-10T01:31:15.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.429+0000 7f1f62ae2700 1 -- 172.21.15.36:0/3238917619 reap_dead start 2022-01-10T01:31:15.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.433+0000 7f1f61ae0700 1 --2- 172.21.15.36:0/3238917619 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f44004500 0x7f1f44004980 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f1f4c00c000 tx=0x7f1f4c006df0).ready entity=mon.0 client_cookie=6b3feaebb5b220d4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:15.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.433+0000 7f1f612df700 1 -- 172.21.15.36:0/3238917619 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f4c00e830 con 0x7f1f44004500 2022-01-10T01:31:15.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.433+0000 7f1f612df700 1 -- 172.21.15.36:0/3238917619 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c00e990 con 0x7f1f44004500 2022-01-10T01:31:15.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.433+0000 7f1f612df700 1 -- 172.21.15.36:0/3238917619 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f4c00ecf0 con 0x7f1f44004500 2022-01-10T01:31:15.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.433+0000 7f1f64545700 1 -- 172.21.15.36:0/3238917619 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f44004500 msgr2=0x7f1f44004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.433+0000 7f1f64545700 1 --2- 172.21.15.36:0/3238917619 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f44004500 0x7f1f44004980 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f1f4c00c000 tx=0x7f1f4c006df0).stop 2022-01-10T01:31:15.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.433+0000 7f1f64545700 1 -- 172.21.15.36:0/3238917619 shutdown_connections 2022-01-10T01:31:15.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.433+0000 7f1f64545700 1 --2- 172.21.15.36:0/3238917619 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f44004500 0x7f1f44004980 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.433+0000 7f1f64545700 1 -- 172.21.15.36:0/3238917619 >> 172.21.15.36:0/3238917619 conn(0x7f1f5c05f6b0 msgr2=0x7f1f5c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:15.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.433+0000 7f1f64545700 1 -- 172.21.15.36:0/3238917619 shutdown_connections 2022-01-10T01:31:15.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.433+0000 7f1f64545700 1 -- 172.21.15.36:0/3238917619 wait complete. 2022-01-10T01:31:15.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.433+0000 7f1f64545700 1 Processor -- start 2022-01-10T01:31:15.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.433+0000 7f1f64545700 1 -- start start 2022-01-10T01:31:15.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f64545700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f44004500 0x7f1f5c140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f64545700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c13b800 0x7f1f5c14e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f64545700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5c1524f0 0x7f1f5c14e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f64545700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c1518e0 con 0x7f1f44004500 2022-01-10T01:31:15.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f64545700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c151b10 con 0x7f1f5c1524f0 2022-01-10T01:31:15.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f64545700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c151db0 con 0x7f1f5c13b800 2022-01-10T01:31:15.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f622e1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f44004500 0x7f1f5c140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f622e1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f44004500 0x7f1f5c140670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38608/0 (socket says 172.21.15.36:38608) 2022-01-10T01:31:15.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f622e1700 1 -- 172.21.15.36:0/1671660595 learned_addr learned my addr 172.21.15.36:0/1671660595 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:15.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f61ae0700 1 --2- 172.21.15.36:0/1671660595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c13b800 0x7f1f5c14e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f62ae2700 1 --2- 172.21.15.36:0/1671660595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5c1524f0 0x7f1f5c14e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f622e1700 1 -- 172.21.15.36:0/1671660595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c13b800 msgr2=0x7f1f5c14e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f622e1700 1 --2- 172.21.15.36:0/1671660595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c13b800 0x7f1f5c14e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f622e1700 1 -- 172.21.15.36:0/1671660595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5c1524f0 msgr2=0x7f1f5c14e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f622e1700 1 --2- 172.21.15.36:0/1671660595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5c1524f0 0x7f1f5c14e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f622e1700 1 -- 172.21.15.36:0/1671660595 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c152050 con 0x7f1f44004500 2022-01-10T01:31:15.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f622e1700 1 --2- 172.21.15.36:0/1671660595 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f44004500 0x7f1f5c140670 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f1f58001110 tx=0x7f1f58001e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:15.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f4b7fe700 1 -- 172.21.15.36:0/1671660595 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f58011780 con 0x7f1f44004500 2022-01-10T01:31:15.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f4b7fe700 1 -- 172.21.15.36:0/1671660595 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f580118e0 con 0x7f1f44004500 2022-01-10T01:31:15.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f64545700 1 -- 172.21.15.36:0/1671660595 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5c0af8c0 con 0x7f1f44004500 2022-01-10T01:31:15.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f4b7fe700 1 -- 172.21.15.36:0/1671660595 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f58011c40 con 0x7f1f44004500 2022-01-10T01:31:15.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f64545700 1 -- 172.21.15.36:0/1671660595 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5c0adc80 con 0x7f1f44004500 2022-01-10T01:31:15.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f64545700 1 -- 172.21.15.36:0/1671660595 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5c1521e0 con 0x7f1f44004500 2022-01-10T01:31:15.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.437+0000 7f1f4b7fe700 1 -- 172.21.15.36:0/1671660595 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1f5801b030 con 0x7f1f44004500 2022-01-10T01:31:15.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.441+0000 7f1f4b7fe700 1 --2- 172.21.15.36:0/1671660595 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1f3c053620 0x7f1f3c055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.441+0000 7f1f4b7fe700 1 -- 172.21.15.36:0/1671660595 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f1f5806b1c0 con 0x7f1f44004500 2022-01-10T01:31:15.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.441+0000 7f1f61ae0700 1 --2- 172.21.15.36:0/1671660595 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1f3c053620 0x7f1f3c055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.441+0000 7f1f61ae0700 1 --2- 172.21.15.36:0/1671660595 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1f3c053620 0x7f1f3c055ae0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f1f4c01b000 tx=0x7f1f4c019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:15.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.449+0000 7f1f4b7fe700 1 -- 172.21.15.36:0/1671660595 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1f58042560 con 0x7f1f44004500 2022-01-10T01:31:15.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.573+0000 7f1f64545700 1 -- 172.21.15.36:0/1671660595 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f5c057350 con 0x7f1f44004500 2022-01-10T01:31:15.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.577+0000 7f1f4b7fe700 1 -- 172.21.15.36:0/1671660595 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+13415 (secure 0 0 0) 0x7f1f58019030 con 0x7f1f44004500 2022-01-10T01:31:15.581 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:15.582 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":84,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:31:14.882292+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:31:15.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.577+0000 7f1f64545700 1 -- 172.21.15.36:0/1671660595 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1f3c053620 msgr2=0x7f1f3c055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.577+0000 7f1f64545700 1 --2- 172.21.15.36:0/1671660595 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1f3c053620 0x7f1f3c055ae0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f1f4c01b000 tx=0x7f1f4c019000).stop 2022-01-10T01:31:15.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.577+0000 7f1f64545700 1 -- 172.21.15.36:0/1671660595 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f44004500 msgr2=0x7f1f5c140670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.577+0000 7f1f64545700 1 --2- 172.21.15.36:0/1671660595 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f44004500 0x7f1f5c140670 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f1f58001110 tx=0x7f1f58001e10).stop 2022-01-10T01:31:15.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.577+0000 7f1f64545700 1 -- 172.21.15.36:0/1671660595 shutdown_connections 2022-01-10T01:31:15.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.577+0000 7f1f64545700 1 --2- 172.21.15.36:0/1671660595 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1f3c053620 0x7f1f3c055ae0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.577+0000 7f1f64545700 1 --2- 172.21.15.36:0/1671660595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f5c1524f0 0x7f1f5c14e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.577+0000 7f1f64545700 1 --2- 172.21.15.36:0/1671660595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f5c13b800 0x7f1f5c14e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.577+0000 7f1f64545700 1 --2- 172.21.15.36:0/1671660595 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1f44004500 0x7f1f5c140670 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.577+0000 7f1f64545700 1 -- 172.21.15.36:0/1671660595 >> 172.21.15.36:0/1671660595 conn(0x7f1f5c05f6b0 msgr2=0x7f1f5c1447f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:15.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.577+0000 7f1f64545700 1 -- 172.21.15.36:0/1671660595 shutdown_connections 2022-01-10T01:31:15.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.577+0000 7f1f64545700 1 -- 172.21.15.36:0/1671660595 wait complete. 2022-01-10T01:31:15.594 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-01-10T01:31:15.595 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:31:15.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.689+0000 7ffaf4c7a700 1 Processor -- start 2022-01-10T01:31:15.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.689+0000 7ffaf4c7a700 1 -- start start 2022-01-10T01:31:15.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.689+0000 7ffaf4c7a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf0061320 0x7ffaf0061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.689+0000 7ffaf4c7a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ffaf00ad5c0 0x7ffaf00b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.689+0000 7ffaf4c7a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf00aecf0 con 0x7ffaf0140440 2022-01-10T01:31:15.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.689+0000 7ffaf4c7a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf00b6f20 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.689+0000 7ffaf4c7a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf00aef20 con 0x7ffaf0061320 2022-01-10T01:31:15.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaeeffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ffaf00ad5c0 0x7ffaf00b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaeeffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ffaf00ad5c0 0x7ffaf00b9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38616/0 (socket says 172.21.15.36:38616) 2022-01-10T01:31:15.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaeeffd700 1 -- 172.21.15.36:0/493853935 learned_addr learned my addr 172.21.15.36:0/493853935 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:15.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaef7fe700 1 --2- 172.21.15.36:0/493853935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf0061320 0x7ffaf0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaeeffd700 1 -- 172.21.15.36:0/493853935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf0061320 msgr2=0x7ffaf0061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:15.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaeeffd700 1 --2- 172.21.15.36:0/493853935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf0061320 0x7ffaf0061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaeeffd700 1 -- 172.21.15.36:0/493853935 >> v1:172.21.15.59:6789/0 conn(0x7ffaf0140440 legacy=0x7ffaf0146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaeeffd700 1 -- 172.21.15.36:0/493853935 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf00af1c0 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaeeffd700 1 --2- 172.21.15.36:0/493853935 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffaf00ad5c0 0x7ffaf00b9e60 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7ffae0002f70 tx=0x7ffae0006eb0).ready entity=mon.0 client_cookie=d725b1ff7afe9f88 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:15.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaee7fc700 1 -- 172.21.15.36:0/493853935 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae000d5c0 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaee7fc700 1 -- 172.21.15.36:0/493853935 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae0000e90 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaee7fc700 1 -- 172.21.15.36:0/493853935 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae000d950 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/493853935 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffaf00ad5c0 msgr2=0x7ffaf00b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaf4c7a700 1 --2- 172.21.15.36:0/493853935 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffaf00ad5c0 0x7ffaf00b9e60 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7ffae0002f70 tx=0x7ffae0006eb0).stop 2022-01-10T01:31:15.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/493853935 shutdown_connections 2022-01-10T01:31:15.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaf4c7a700 1 --2- 172.21.15.36:0/493853935 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffaf00ad5c0 0x7ffaf00b9e60 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaf4c7a700 1 --2- 172.21.15.36:0/493853935 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf0061320 0x7ffaf0061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/493853935 >> 172.21.15.36:0/493853935 conn(0x7ffaf0066de0 msgr2=0x7ffaf00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:15.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/493853935 shutdown_connections 2022-01-10T01:31:15.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.693+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/493853935 wait complete. 2022-01-10T01:31:15.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaf4c7a700 1 Processor -- start 2022-01-10T01:31:15.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaf4c7a700 1 -- start start 2022-01-10T01:31:15.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaf4c7a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaf0061320 0x7ffaf00aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaf4c7a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffaf00ad5c0 0x7ffaf0155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaf4c7a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf0140440 0x7ffaf01560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaf4c7a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf01532b0 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaf4c7a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf0152d70 con 0x7ffaf0061320 2022-01-10T01:31:15.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaf4c7a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf0153010 con 0x7ffaf0140440 2022-01-10T01:31:15.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaeeffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffaf00ad5c0 0x7ffaf0155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaeeffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffaf00ad5c0 0x7ffaf0155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38624/0 (socket says 172.21.15.36:38624) 2022-01-10T01:31:15.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaeeffd700 1 -- 172.21.15.36:0/660150686 learned_addr learned my addr 172.21.15.36:0/660150686 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:15.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaef7fe700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaf0061320 0x7ffaf00aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaeffff700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf0140440 0x7ffaf01560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaeeffd700 1 -- 172.21.15.36:0/660150686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf0140440 msgr2=0x7ffaf01560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaeeffd700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf0140440 0x7ffaf01560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaeeffd700 1 -- 172.21.15.36:0/660150686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaf0061320 msgr2=0x7ffaf00aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaeeffd700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaf0061320 0x7ffaf00aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaeeffd700 1 -- 172.21.15.36:0/660150686 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae000b1e0 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaef7fe700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaf0061320 0x7ffaf00aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:15.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaeeffd700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffaf00ad5c0 0x7ffaf0155bc0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7ffae0002f70 tx=0x7ffae0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:15.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaecff9700 1 -- 172.21.15.36:0/660150686 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae000de80 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/660150686 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf00b0c00 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaecff9700 1 -- 172.21.15.36:0/660150686 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae0011ca0 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaecff9700 1 -- 172.21.15.36:0/660150686 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffae001e460 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.697+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/660150686 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf0145ec0 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.701+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/660150686 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf00b0d90 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.701+0000 7ffaecff9700 1 -- 172.21.15.36:0/660150686 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ffae0025030 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.701+0000 7ffaecff9700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffad4053560 0x7ffad4055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.701+0000 7ffaecff9700 1 -- 172.21.15.36:0/660150686 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5600+0+0 (secure 0 0 0) 0x7ffae006cab0 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.701+0000 7ffaef7fe700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffad4053560 0x7ffad4055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.701+0000 7ffaef7fe700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffad4053560 0x7ffad4055a20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7ffad800c000 tx=0x7ffad8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:15.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.709+0000 7ffaecff9700 1 -- 172.21.15.36:0/660150686 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffae0043d60 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.837+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/660150686 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ffaf00af460 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.837+0000 7ffaecff9700 1 -- 172.21.15.36:0/660150686 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v84) v1 ==== 110+0+10 (secure 0 0 0) 0x7ffae0023070 con 0x7ffaf00ad5c0 2022-01-10T01:31:15.841 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:31:15.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.837+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/660150686 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffad4053560 msgr2=0x7ffad4055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.837+0000 7ffaf4c7a700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffad4053560 0x7ffad4055a20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7ffad800c000 tx=0x7ffad8008040).stop 2022-01-10T01:31:15.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.837+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/660150686 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffaf00ad5c0 msgr2=0x7ffaf0155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.837+0000 7ffaf4c7a700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffaf00ad5c0 0x7ffaf0155bc0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7ffae0002f70 tx=0x7ffae0015000).stop 2022-01-10T01:31:15.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.837+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/660150686 shutdown_connections 2022-01-10T01:31:15.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.837+0000 7ffaf4c7a700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffad4053560 0x7ffad4055a20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.837+0000 7ffaf4c7a700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffaf0140440 0x7ffaf01560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.837+0000 7ffaf4c7a700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffaf00ad5c0 0x7ffaf0155bc0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.837+0000 7ffaf4c7a700 1 --2- 172.21.15.36:0/660150686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaf0061320 0x7ffaf00aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.837+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/660150686 >> 172.21.15.36:0/660150686 conn(0x7ffaf0066de0 msgr2=0x7ffaf00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:15.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.837+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/660150686 shutdown_connections 2022-01-10T01:31:15.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.837+0000 7ffaf4c7a700 1 -- 172.21.15.36:0/660150686 wait complete. 2022-01-10T01:31:15.855 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:31:15.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.957+0000 7f9c173d0700 1 Processor -- start 2022-01-10T01:31:15.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c173d0700 1 -- start start 2022-01-10T01:31:15.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c173d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c100afbf0 0x7f9c100aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c173d0700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c100ac390 con 0x7f9c100b1230 2022-01-10T01:31:15.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c173d0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c100b1610 con 0x7f9c100b0990 2022-01-10T01:31:15.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c173d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100b0040 con 0x7f9c100afbf0 2022-01-10T01:31:15.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c163ce700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9c100b1230 0x7f9c10142780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36426/0 (socket says 172.21.15.36:36426) 2022-01-10T01:31:15.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c163ce700 1 -- 172.21.15.36:0/4198177692 learned_addr learned my addr 172.21.15.36:0/4198177692 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:15.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c16bcf700 1 --2- 172.21.15.36:0/4198177692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c100afbf0 0x7f9c100aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c153cc700 1 -- 172.21.15.36:0/4198177692 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341306561 0 0) 0x7f9c100ac390 con 0x7f9c100b1230 2022-01-10T01:31:15.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c153cc700 1 -- 172.21.15.36:0/4198177692 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bf8003260 con 0x7f9c100b1230 2022-01-10T01:31:15.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c153cc700 1 -- 172.21.15.36:0/4198177692 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 171930962 0 0) 0x7f9c100b1610 con 0x7f9c100b0990 2022-01-10T01:31:15.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c153cc700 1 -- 172.21.15.36:0/4198177692 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c100ac390 con 0x7f9c100b0990 2022-01-10T01:31:15.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c16bcf700 1 -- 172.21.15.36:0/4198177692 >> v1:172.21.15.59:6789/0 conn(0x7f9c100b0990 legacy=0x7f9c100ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c16bcf700 1 -- 172.21.15.36:0/4198177692 >> v1:172.21.15.36:6789/0 conn(0x7f9c100b1230 legacy=0x7f9c10142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c153cc700 1 -- 172.21.15.36:0/4198177692 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2406065487 0 0) 0x7f9bf8003260 con 0x7f9c100b1230 2022-01-10T01:31:15.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c16bcf700 1 -- 172.21.15.36:0/4198177692 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c100b02c0 con 0x7f9c100afbf0 2022-01-10T01:31:15.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c16bcf700 1 --2- 172.21.15.36:0/4198177692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c100afbf0 0x7f9c100aedf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f9c00001110 tx=0x7f9c08006df0).ready entity=mon.2 client_cookie=c36fb13525fab147 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:15.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c153cc700 1 -- 172.21.15.36:0/4198177692 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c00001660 con 0x7f9c100afbf0 2022-01-10T01:31:15.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c153cc700 1 -- 172.21.15.36:0/4198177692 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c08000e90 con 0x7f9c100afbf0 2022-01-10T01:31:15.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c153cc700 1 -- 172.21.15.36:0/4198177692 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c08012460 con 0x7f9c100afbf0 2022-01-10T01:31:15.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c173d0700 1 -- 172.21.15.36:0/4198177692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c100afbf0 msgr2=0x7f9c100aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c173d0700 1 --2- 172.21.15.36:0/4198177692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c100afbf0 0x7f9c100aedf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f9c00001110 tx=0x7f9c08006df0).stop 2022-01-10T01:31:15.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c173d0700 1 -- 172.21.15.36:0/4198177692 shutdown_connections 2022-01-10T01:31:15.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.961+0000 7f9c173d0700 1 --2- 172.21.15.36:0/4198177692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c100afbf0 0x7f9c100aedf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c173d0700 1 -- 172.21.15.36:0/4198177692 >> 172.21.15.36:0/4198177692 conn(0x7f9c10062560 msgr2=0x7f9c10062940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:15.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c173d0700 1 -- 172.21.15.36:0/4198177692 shutdown_connections 2022-01-10T01:31:15.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c173d0700 1 -- 172.21.15.36:0/4198177692 wait complete. 2022-01-10T01:31:15.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c173d0700 1 Processor -- start 2022-01-10T01:31:15.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c173d0700 1 -- start start 2022-01-10T01:31:15.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c173d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c100afbf0 0x7f9c10146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c173d0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9c100b0990 0x7f9c100a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c173d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c100b1230 0x7f9c100a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c173d0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c100b5280 con 0x7f9c100b0990 2022-01-10T01:31:15.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c173d0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c10145680 con 0x7f9c100afbf0 2022-01-10T01:31:15.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c173d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1009ea30 con 0x7f9c100b1230 2022-01-10T01:31:15.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c15bcd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9c100b0990 0x7f9c100a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c15bcd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9c100b0990 0x7f9c100a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38638/0 (socket says 172.21.15.36:38638) 2022-01-10T01:31:15.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c15bcd700 1 -- 172.21.15.36:0/2709224860 learned_addr learned my addr 172.21.15.36:0/2709224860 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:15.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c16bcf700 1 --2- 172.21.15.36:0/2709224860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c100b1230 0x7f9c100a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c163ce700 1 --2- 172.21.15.36:0/2709224860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c100afbf0 0x7f9c10146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c15bcd700 1 -- 172.21.15.36:0/2709224860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c100b1230 msgr2=0x7f9c100a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c15bcd700 1 --2- 172.21.15.36:0/2709224860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c100b1230 0x7f9c100a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c15bcd700 1 -- 172.21.15.36:0/2709224860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c100afbf0 msgr2=0x7f9c10146a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:15.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c15bcd700 1 --2- 172.21.15.36:0/2709224860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c100afbf0 0x7f9c10146a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:15.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c15bcd700 1 -- 172.21.15.36:0/2709224860 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0800b180 con 0x7f9c100b0990 2022-01-10T01:31:15.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c15bcd700 1 --2- 172.21.15.36:0/2709224860 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9c100b0990 0x7f9c100a0170 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f9c0c001490 tx=0x7f9c0c007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:15.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9bff7fe700 1 -- 172.21.15.36:0/2709224860 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c0c002310 con 0x7f9c100b0990 2022-01-10T01:31:15.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9bff7fe700 1 -- 172.21.15.36:0/2709224860 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c002470 con 0x7f9c100b0990 2022-01-10T01:31:15.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c173d0700 1 -- 172.21.15.36:0/2709224860 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1009ecd0 con 0x7f9c100b0990 2022-01-10T01:31:15.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9bff7fe700 1 -- 172.21.15.36:0/2709224860 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c0c001860 con 0x7f9c100b0990 2022-01-10T01:31:15.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.965+0000 7f9c173d0700 1 -- 172.21.15.36:0/2709224860 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c10145f60 con 0x7f9c100b0990 2022-01-10T01:31:15.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.969+0000 7f9c173d0700 1 -- 172.21.15.36:0/2709224860 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c10145d00 con 0x7f9c100b0990 2022-01-10T01:31:15.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.969+0000 7f9bff7fe700 1 -- 172.21.15.36:0/2709224860 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9c0c019030 con 0x7f9c100b0990 2022-01-10T01:31:15.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.969+0000 7f9bff7fe700 1 --2- 172.21.15.36:0/2709224860 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9bf00536b0 0x7f9bf0055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:15.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.969+0000 7f9bff7fe700 1 -- 172.21.15.36:0/2709224860 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f9c0c06af50 con 0x7f9c100b0990 2022-01-10T01:31:15.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.969+0000 7f9c163ce700 1 --2- 172.21.15.36:0/2709224860 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9bf00536b0 0x7f9bf0055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:15.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.969+0000 7f9c163ce700 1 --2- 172.21.15.36:0/2709224860 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9bf00536b0 0x7f9bf0055b70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f9c0000b000 tx=0x7f9c00000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:15.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:15.973+0000 7f9bff7fe700 1 -- 172.21.15.36:0/2709224860 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9c0c0422a0 con 0x7f9c100b0990 2022-01-10T01:31:16.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.101+0000 7f9c173d0700 1 -- 172.21.15.36:0/2709224860 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9c10145840 con 0x7f9c100b0990 2022-01-10T01:31:16.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.101+0000 7f9bff7fe700 1 -- 172.21.15.36:0/2709224860 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v84) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9c0c0458c0 con 0x7f9c100b0990 2022-01-10T01:31:16.107 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:16.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.105+0000 7f9c173d0700 1 -- 172.21.15.36:0/2709224860 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9bf00536b0 msgr2=0x7f9bf0055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:16.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.105+0000 7f9c173d0700 1 --2- 172.21.15.36:0/2709224860 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9bf00536b0 0x7f9bf0055b70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7f9c0000b000 tx=0x7f9c00000bc0).stop 2022-01-10T01:31:16.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.105+0000 7f9c173d0700 1 -- 172.21.15.36:0/2709224860 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9c100b0990 msgr2=0x7f9c100a0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:16.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.105+0000 7f9c173d0700 1 --2- 172.21.15.36:0/2709224860 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9c100b0990 0x7f9c100a0170 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f9c0c001490 tx=0x7f9c0c007e30).stop 2022-01-10T01:31:16.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.105+0000 7f9c173d0700 1 -- 172.21.15.36:0/2709224860 shutdown_connections 2022-01-10T01:31:16.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.105+0000 7f9c173d0700 1 --2- 172.21.15.36:0/2709224860 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9bf00536b0 0x7f9bf0055b70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.105+0000 7f9c173d0700 1 --2- 172.21.15.36:0/2709224860 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c100b1230 0x7f9c100a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.105+0000 7f9c173d0700 1 --2- 172.21.15.36:0/2709224860 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9c100b0990 0x7f9c100a0170 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.105+0000 7f9c173d0700 1 --2- 172.21.15.36:0/2709224860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c100afbf0 0x7f9c10146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.105+0000 7f9c173d0700 1 -- 172.21.15.36:0/2709224860 >> 172.21.15.36:0/2709224860 conn(0x7f9c10062560 msgr2=0x7f9c10141360 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:16.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.105+0000 7f9c173d0700 1 -- 172.21.15.36:0/2709224860 shutdown_connections 2022-01-10T01:31:16.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.105+0000 7f9c173d0700 1 -- 172.21.15.36:0/2709224860 wait complete. 2022-01-10T01:31:16.126 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-01-10T01:31:16.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.221+0000 7f4b811df700 1 Processor -- start 2022-01-10T01:31:16.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.221+0000 7f4b811df700 1 -- start start 2022-01-10T01:31:16.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b811df700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4b7c067300 0x7f4b7c1438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:16.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b811df700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c0aabb0 con 0x7f4b7c060100 2022-01-10T01:31:16.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b811df700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c0604e0 con 0x7f4b7c143de0 2022-01-10T01:31:16.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b811df700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c066ea0 con 0x7f4b7c067300 2022-01-10T01:31:16.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b7ad9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f4b7c060100 0x7f4b7c0b4750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36438/0 (socket says 172.21.15.36:36438) 2022-01-10T01:31:16.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b7ad9d700 1 -- 172.21.15.36:0/4109175017 learned_addr learned my addr 172.21.15.36:0/4109175017 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:16.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b7a59c700 1 --2- 172.21.15.36:0/4109175017 >> v2:172.21.15.59:3300/0 conn(0x7f4b7c067300 0x7f4b7c1438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:16.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b79d9b700 1 -- 172.21.15.36:0/4109175017 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010141172 0 0) 0x7f4b7c0aabb0 con 0x7f4b7c060100 2022-01-10T01:31:16.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b79d9b700 1 -- 172.21.15.36:0/4109175017 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b5c003260 con 0x7f4b7c060100 2022-01-10T01:31:16.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b7a59c700 1 -- 172.21.15.36:0/4109175017 >> v1:172.21.15.59:6789/0 conn(0x7f4b7c143de0 legacy=0x7f4b7c14b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:16.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b7a59c700 1 -- 172.21.15.36:0/4109175017 >> v1:172.21.15.36:6789/0 conn(0x7f4b7c060100 legacy=0x7f4b7c0b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:16.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b7a59c700 1 -- 172.21.15.36:0/4109175017 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c0b33b0 con 0x7f4b7c067300 2022-01-10T01:31:16.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b7a59c700 1 --2- 172.21.15.36:0/4109175017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b7c067300 0x7f4b7c1438f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f4b64002f70 tx=0x7f4b64006df0).ready entity=mon.1 client_cookie=fc717d990c176e4e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:16.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b79d9b700 1 -- 172.21.15.36:0/4109175017 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6400d610 con 0x7f4b7c067300 2022-01-10T01:31:16.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b79d9b700 1 -- 172.21.15.36:0/4109175017 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b64000e90 con 0x7f4b7c067300 2022-01-10T01:31:16.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b79d9b700 1 -- 172.21.15.36:0/4109175017 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6400d960 con 0x7f4b7c067300 2022-01-10T01:31:16.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b811df700 1 -- 172.21.15.36:0/4109175017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b7c067300 msgr2=0x7f4b7c1438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:16.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b811df700 1 --2- 172.21.15.36:0/4109175017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b7c067300 0x7f4b7c1438f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f4b64002f70 tx=0x7f4b64006df0).stop 2022-01-10T01:31:16.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b811df700 1 -- 172.21.15.36:0/4109175017 shutdown_connections 2022-01-10T01:31:16.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b811df700 1 --2- 172.21.15.36:0/4109175017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b7c067300 0x7f4b7c1438f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b811df700 1 -- 172.21.15.36:0/4109175017 >> 172.21.15.36:0/4109175017 conn(0x7f4b7c05cf30 msgr2=0x7f4b7c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:16.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b811df700 1 -- 172.21.15.36:0/4109175017 shutdown_connections 2022-01-10T01:31:16.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.225+0000 7f4b811df700 1 -- 172.21.15.36:0/4109175017 wait complete. 2022-01-10T01:31:16.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b811df700 1 Processor -- start 2022-01-10T01:31:16.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b811df700 1 -- start start 2022-01-10T01:31:16.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b811df700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b7c060100 0x7f4b7c0ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:16.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b811df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7c067300 0x7f4b7c1506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:16.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b811df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b7c143de0 0x7f4b7c150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:16.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b811df700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c151080 con 0x7f4b7c060100 2022-01-10T01:31:16.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b811df700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c1469d0 con 0x7f4b7c143de0 2022-01-10T01:31:16.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b811df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c146c70 con 0x7f4b7c067300 2022-01-10T01:31:16.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b7ad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b7c060100 0x7f4b7c0ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:16.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b7ad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b7c060100 0x7f4b7c0ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38652/0 (socket says 172.21.15.36:38652) 2022-01-10T01:31:16.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b7a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7c067300 0x7f4b7c1506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:16.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b7ad9d700 1 -- 172.21.15.36:0/2930043007 learned_addr learned my addr 172.21.15.36:0/2930043007 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:16.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b7b59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b7c143de0 0x7f4b7c150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:16.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b7ad9d700 1 -- 172.21.15.36:0/2930043007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7c067300 msgr2=0x7f4b7c1506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:16.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b7ad9d700 1 --2- 172.21.15.36:0/2930043007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7c067300 0x7f4b7c1506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b7ad9d700 1 -- 172.21.15.36:0/2930043007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b7c143de0 msgr2=0x7f4b7c150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:16.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b7ad9d700 1 --2- 172.21.15.36:0/2930043007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b7c143de0 0x7f4b7c150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b7ad9d700 1 -- 172.21.15.36:0/2930043007 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6400b180 con 0x7f4b7c060100 2022-01-10T01:31:16.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b7ad9d700 1 --2- 172.21.15.36:0/2930043007 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b7c060100 0x7f4b7c0ac6d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f4b74001490 tx=0x7f4b74007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:16.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b73fff700 1 -- 172.21.15.36:0/2930043007 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b74005ba0 con 0x7f4b7c060100 2022-01-10T01:31:16.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b73fff700 1 -- 172.21.15.36:0/2930043007 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b74005d00 con 0x7f4b7c060100 2022-01-10T01:31:16.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b811df700 1 -- 172.21.15.36:0/2930043007 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c146f10 con 0x7f4b7c060100 2022-01-10T01:31:16.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.229+0000 7f4b73fff700 1 -- 172.21.15.36:0/2930043007 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b740072c0 con 0x7f4b7c060100 2022-01-10T01:31:16.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.233+0000 7f4b811df700 1 -- 172.21.15.36:0/2930043007 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c0a0a60 con 0x7f4b7c060100 2022-01-10T01:31:16.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.233+0000 7f4b811df700 1 -- 172.21.15.36:0/2930043007 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c057350 con 0x7f4b7c060100 2022-01-10T01:31:16.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.233+0000 7f4b73fff700 1 -- 172.21.15.36:0/2930043007 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4b7401a070 con 0x7f4b7c060100 2022-01-10T01:31:16.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.233+0000 7f4b73fff700 1 --2- 172.21.15.36:0/2930043007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b60053680 0x7f4b60055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:16.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.233+0000 7f4b7a59c700 1 --2- 172.21.15.36:0/2930043007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b60053680 0x7f4b60055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:16.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.233+0000 7f4b73fff700 1 -- 172.21.15.36:0/2930043007 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f4b7406aab0 con 0x7f4b7c060100 2022-01-10T01:31:16.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.233+0000 7f4b7a59c700 1 --2- 172.21.15.36:0/2930043007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b60053680 0x7f4b60055b40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f4b6401a000 tx=0x7f4b64014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:16.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.241+0000 7f4b73fff700 1 -- 172.21.15.36:0/2930043007 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4b74041d60 con 0x7f4b7c060100 2022-01-10T01:31:16.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.369+0000 7f4b811df700 1 -- 172.21.15.36:0/2930043007 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4b7c150400 con 0x7f4b7c060100 2022-01-10T01:31:16.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.373+0000 7f4b73fff700 1 -- 172.21.15.36:0/2930043007 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) v1 ==== 84+0+143 (secure 0 0 0) 0x7f4b74018030 con 0x7f4b7c060100 2022-01-10T01:31:16.377 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:16.378 INFO:teuthology.orchestra.run.smithi036.stdout:[ 2022-01-10T01:31:16.378 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:16.379 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 1, 2022-01-10T01:31:16.379 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "device_health_metrics" 2022-01-10T01:31:16.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:16.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:16.381 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 2, 2022-01-10T01:31:16.382 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "rbd" 2022-01-10T01:31:16.382 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:16.382 INFO:teuthology.orchestra.run.smithi036.stdout:] 2022-01-10T01:31:16.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.373+0000 7f4b811df700 1 -- 172.21.15.36:0/2930043007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b60053680 msgr2=0x7f4b60055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:16.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.373+0000 7f4b811df700 1 --2- 172.21.15.36:0/2930043007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b60053680 0x7f4b60055b40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f4b6401a000 tx=0x7f4b64014000).stop 2022-01-10T01:31:16.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.373+0000 7f4b811df700 1 -- 172.21.15.36:0/2930043007 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b7c060100 msgr2=0x7f4b7c0ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:16.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.373+0000 7f4b811df700 1 --2- 172.21.15.36:0/2930043007 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b7c060100 0x7f4b7c0ac6d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f4b74001490 tx=0x7f4b74007e50).stop 2022-01-10T01:31:16.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.373+0000 7f4b811df700 1 -- 172.21.15.36:0/2930043007 shutdown_connections 2022-01-10T01:31:16.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.373+0000 7f4b811df700 1 --2- 172.21.15.36:0/2930043007 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4b60053680 0x7f4b60055b40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.373+0000 7f4b811df700 1 --2- 172.21.15.36:0/2930043007 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b7c143de0 0x7f4b7c150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.373+0000 7f4b811df700 1 --2- 172.21.15.36:0/2930043007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7c067300 0x7f4b7c1506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.373+0000 7f4b811df700 1 --2- 172.21.15.36:0/2930043007 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b7c060100 0x7f4b7c0ac6d0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.373+0000 7f4b811df700 1 -- 172.21.15.36:0/2930043007 >> 172.21.15.36:0/2930043007 conn(0x7f4b7c05cf30 msgr2=0x7f4b7c0ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:16.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.373+0000 7f4b811df700 1 -- 172.21.15.36:0/2930043007 shutdown_connections 2022-01-10T01:31:16.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.373+0000 7f4b811df700 1 -- 172.21.15.36:0/2930043007 wait complete. 2022-01-10T01:31:16.390 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-01-10T01:31:16.390 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:31:16.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f5a721700 1 Processor -- start 2022-01-10T01:31:16.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f5a721700 1 -- start start 2022-01-10T01:31:16.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f5a721700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f54061320 0x7f3f54061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:16.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f5a721700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3f540ad5c0 0x7f3f540b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:16.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f5a721700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f540aecf0 con 0x7f3f54140440 2022-01-10T01:31:16.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f5a721700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f540b6f20 con 0x7f3f540ad5c0 2022-01-10T01:31:16.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f5a721700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f540aef20 con 0x7f3f54061320 2022-01-10T01:31:16.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f58f1e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3f540ad5c0 0x7f3f540b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:16.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f58f1e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3f540ad5c0 0x7f3f540b9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38660/0 (socket says 172.21.15.36:38660) 2022-01-10T01:31:16.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f58f1e700 1 -- 172.21.15.36:0/1527100227 learned_addr learned my addr 172.21.15.36:0/1527100227 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:16.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f5971f700 1 --2- 172.21.15.36:0/1527100227 >> v2:172.21.15.59:3300/0 conn(0x7f3f54061320 0x7f3f54061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:16.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f58f1e700 1 -- 172.21.15.36:0/1527100227 >> v2:172.21.15.59:3300/0 conn(0x7f3f54061320 msgr2=0x7f3f54061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:16.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f58f1e700 1 --2- 172.21.15.36:0/1527100227 >> v2:172.21.15.59:3300/0 conn(0x7f3f54061320 0x7f3f54061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f58f1e700 1 -- 172.21.15.36:0/1527100227 >> v1:172.21.15.59:6789/0 conn(0x7f3f54140440 legacy=0x7f3f54146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:16.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f47fff700 1 -- 172.21.15.36:0/1527100227 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767657677 0 0) 0x7f3f540aecf0 con 0x7f3f54140440 2022-01-10T01:31:16.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f58f1e700 1 -- 172.21.15.36:0/1527100227 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f540af1c0 con 0x7f3f540ad5c0 2022-01-10T01:31:16.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f58f1e700 1 --2- 172.21.15.36:0/1527100227 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f540ad5c0 0x7f3f540b9e60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f3f540aeba0 tx=0x7f3f48006eb0).ready entity=mon.0 client_cookie=934e4c7ea5c93ab5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:16.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f47fff700 1 -- 172.21.15.36:0/1527100227 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f4800d610 con 0x7f3f540ad5c0 2022-01-10T01:31:16.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f47fff700 1 -- 172.21.15.36:0/1527100227 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f48000e90 con 0x7f3f540ad5c0 2022-01-10T01:31:16.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f47fff700 1 -- 172.21.15.36:0/1527100227 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f4800d960 con 0x7f3f540ad5c0 2022-01-10T01:31:16.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f5a721700 1 -- 172.21.15.36:0/1527100227 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f540ad5c0 msgr2=0x7f3f540b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:16.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.489+0000 7f3f5a721700 1 --2- 172.21.15.36:0/1527100227 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f540ad5c0 0x7f3f540b9e60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f3f540aeba0 tx=0x7f3f48006eb0).stop 2022-01-10T01:31:16.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5a721700 1 -- 172.21.15.36:0/1527100227 shutdown_connections 2022-01-10T01:31:16.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5a721700 1 --2- 172.21.15.36:0/1527100227 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f540ad5c0 0x7f3f540b9e60 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5a721700 1 --2- 172.21.15.36:0/1527100227 >> v2:172.21.15.59:3300/0 conn(0x7f3f54061320 0x7f3f54061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5a721700 1 -- 172.21.15.36:0/1527100227 >> 172.21.15.36:0/1527100227 conn(0x7f3f54066de0 msgr2=0x7f3f540671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:16.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5a721700 1 -- 172.21.15.36:0/1527100227 shutdown_connections 2022-01-10T01:31:16.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5a721700 1 -- 172.21.15.36:0/1527100227 wait complete. 2022-01-10T01:31:16.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5a721700 1 Processor -- start 2022-01-10T01:31:16.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5a721700 1 -- start start 2022-01-10T01:31:16.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5a721700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f54061320 0x7f3f540b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:16.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5a721700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f540ad5c0 0x7f3f540b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:16.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5a721700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f54140440 0x7f3f540b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:16.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5a721700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540b34f0 con 0x7f3f54061320 2022-01-10T01:31:16.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5a721700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540afc70 con 0x7f3f54140440 2022-01-10T01:31:16.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5a721700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540b3720 con 0x7f3f540ad5c0 2022-01-10T01:31:16.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5971f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f54061320 0x7f3f540b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:16.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5971f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f54061320 0x7f3f540b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38664/0 (socket says 172.21.15.36:38664) 2022-01-10T01:31:16.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5971f700 1 -- 172.21.15.36:0/3248737850 learned_addr learned my addr 172.21.15.36:0/3248737850 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:16.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f58f1e700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f540ad5c0 0x7f3f540b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:16.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f59f20700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f54140440 0x7f3f540b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:16.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5971f700 1 -- 172.21.15.36:0/3248737850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f540ad5c0 msgr2=0x7f3f540b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:16.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5971f700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f540ad5c0 0x7f3f540b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5971f700 1 -- 172.21.15.36:0/3248737850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f54140440 msgr2=0x7f3f540b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:16.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5971f700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f54140440 0x7f3f540b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:16.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5971f700 1 -- 172.21.15.36:0/3248737850 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4800b1e0 con 0x7f3f54061320 2022-01-10T01:31:16.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f58f1e700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f540ad5c0 0x7f3f540b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:16.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.493+0000 7f3f5971f700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f54061320 0x7f3f540b1cf0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f3f540afe00 tx=0x7f3f50006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:16.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.497+0000 7f3f467fc700 1 -- 172.21.15.36:0/3248737850 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f5000c830 con 0x7f3f54061320 2022-01-10T01:31:16.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.497+0000 7f3f467fc700 1 -- 172.21.15.36:0/3248737850 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5000c990 con 0x7f3f54061320 2022-01-10T01:31:16.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.497+0000 7f3f5a721700 1 -- 172.21.15.36:0/3248737850 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f540af9d0 con 0x7f3f54061320 2022-01-10T01:31:16.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.497+0000 7f3f467fc700 1 -- 172.21.15.36:0/3248737850 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f5000ccf0 con 0x7f3f54061320 2022-01-10T01:31:16.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.497+0000 7f3f5a721700 1 -- 172.21.15.36:0/3248737850 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f54141d10 con 0x7f3f54061320 2022-01-10T01:31:16.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.497+0000 7f3f5a721700 1 -- 172.21.15.36:0/3248737850 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f540af460 con 0x7f3f54061320 2022-01-10T01:31:16.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.497+0000 7f3f467fc700 1 -- 172.21.15.36:0/3248737850 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3f5001c460 con 0x7f3f54061320 2022-01-10T01:31:16.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.497+0000 7f3f467fc700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f3c0535f0 0x7f3f3c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:16.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.497+0000 7f3f467fc700 1 -- 172.21.15.36:0/3248737850 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f3f5006bc80 con 0x7f3f54061320 2022-01-10T01:31:16.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.497+0000 7f3f58f1e700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f3c0535f0 0x7f3f3c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:16.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.501+0000 7f3f58f1e700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f3c0535f0 0x7f3f3c055ab0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f3f4801a000 tx=0x7f3f48015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:16.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.505+0000 7f3f467fc700 1 -- 172.21.15.36:0/3248737850 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3f50046e60 con 0x7f3f54061320 2022-01-10T01:31:16.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:16.637+0000 7f3f5a721700 1 -- 172.21.15.36:0/3248737850 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f3f54057350 con 0x7f3f54061320 2022-01-10T01:31:17.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.477+0000 7f3f467fc700 1 -- 172.21.15.36:0/3248737850 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v85) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3f50042f70 con 0x7f3f54061320 2022-01-10T01:31:17.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.485+0000 7f3f5a721700 1 -- 172.21.15.36:0/3248737850 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f3c0535f0 msgr2=0x7f3f3c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:17.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.485+0000 7f3f5a721700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f3c0535f0 0x7f3f3c055ab0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f3f4801a000 tx=0x7f3f48015000).stop 2022-01-10T01:31:17.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.485+0000 7f3f5a721700 1 -- 172.21.15.36:0/3248737850 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f54061320 msgr2=0x7f3f540b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:17.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.485+0000 7f3f5a721700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f54061320 0x7f3f540b1cf0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f3f540afe00 tx=0x7f3f50006df0).stop 2022-01-10T01:31:17.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.485+0000 7f3f5a721700 1 -- 172.21.15.36:0/3248737850 shutdown_connections 2022-01-10T01:31:17.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.485+0000 7f3f5a721700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f3c0535f0 0x7f3f3c055ab0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.485+0000 7f3f5a721700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f54140440 0x7f3f540b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.485+0000 7f3f5a721700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f540ad5c0 0x7f3f540b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.485+0000 7f3f5a721700 1 --2- 172.21.15.36:0/3248737850 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f54061320 0x7f3f540b1cf0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.485+0000 7f3f5a721700 1 -- 172.21.15.36:0/3248737850 >> 172.21.15.36:0/3248737850 conn(0x7f3f54066de0 msgr2=0x7f3f54145880 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:17.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.485+0000 7f3f5a721700 1 -- 172.21.15.36:0/3248737850 shutdown_connections 2022-01-10T01:31:17.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.485+0000 7f3f5a721700 1 -- 172.21.15.36:0/3248737850 wait complete. 2022-01-10T01:31:17.492 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:31:17.503 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2022-01-10T01:31:17.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f10a4986700 1 Processor -- start 2022-01-10T01:31:17.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f10a4986700 1 -- start start 2022-01-10T01:31:17.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f10a4986700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10a00b2580 0x7f10a014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f10a4986700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a00a70c0 con 0x7f10a00a8ac0 2022-01-10T01:31:17.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f10a4986700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a00a72f0 con 0x7f10a00b0010 2022-01-10T01:31:17.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f10a4986700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a00a7590 con 0x7f10a00b2580 2022-01-10T01:31:17.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f10a00a8ac0 0x7f10a0151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36470/0 (socket says 172.21.15.36:36470) 2022-01-10T01:31:17.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109ffff700 1 -- 172.21.15.36:0/4151681331 learned_addr learned my addr 172.21.15.36:0/4151681331 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:17.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109f7fe700 1 --2- 172.21.15.36:0/4151681331 >> v2:172.21.15.59:3300/0 conn(0x7f10a00b2580 0x7f10a014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 -- 172.21.15.36:0/4151681331 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2860170147 0 0) 0x7f10a00a70c0 con 0x7f10a00a8ac0 2022-01-10T01:31:17.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 -- 172.21.15.36:0/4151681331 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1080003260 con 0x7f10a00a8ac0 2022-01-10T01:31:17.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 -- 172.21.15.36:0/4151681331 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 951504393 0 0) 0x7f1080003260 con 0x7f10a00a8ac0 2022-01-10T01:31:17.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 -- 172.21.15.36:0/4151681331 >> v2:172.21.15.59:3300/0 conn(0x7f10a00b2580 msgr2=0x7f10a014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:17.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 --2- 172.21.15.36:0/4151681331 >> v2:172.21.15.59:3300/0 conn(0x7f10a00b2580 0x7f10a014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 -- 172.21.15.36:0/4151681331 >> v1:172.21.15.59:6789/0 conn(0x7f10a00b0010 legacy=0x7f10a00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:17.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 -- 172.21.15.36:0/4151681331 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a00a7830 con 0x7f10a00a8ac0 2022-01-10T01:31:17.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 -- 172.21.15.36:0/4151681331 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f1098001660 con 0x7f10a00a8ac0 2022-01-10T01:31:17.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 -- 172.21.15.36:0/4151681331 >> v1:172.21.15.36:6789/0 conn(0x7f10a00a8ac0 legacy=0x7f10a0151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:17.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 --2- 172.21.15.36:0/4151681331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1080003750 0x7f1080003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 --2- 172.21.15.36:0/4151681331 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1080004500 0x7f1080004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 --2- 172.21.15.36:0/4151681331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1080004e70 0x7f108000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 -- 172.21.15.36:0/4151681331 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00a7590 con 0x7f1080004500 2022-01-10T01:31:17.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 -- 172.21.15.36:0/4151681331 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108000bd20 con 0x7f1080004e70 2022-01-10T01:31:17.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109e7fc700 1 -- 172.21.15.36:0/4151681331 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108000bee0 con 0x7f1080003750 2022-01-10T01:31:17.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109effd700 1 --2- 172.21.15.36:0/4151681331 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1080004500 0x7f1080004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.613+0000 7f109f7fe700 1 --2- 172.21.15.36:0/4151681331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1080003750 0x7f1080003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109ffff700 1 --2- 172.21.15.36:0/4151681331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1080004e70 0x7f108000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109effd700 1 -- 172.21.15.36:0/4151681331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1080003750 msgr2=0x7f1080003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:17.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109effd700 1 --2- 172.21.15.36:0/4151681331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1080003750 0x7f1080003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109effd700 1 -- 172.21.15.36:0/4151681331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1080004e70 msgr2=0x7f108000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:17.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109effd700 1 --2- 172.21.15.36:0/4151681331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1080004e70 0x7f108000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109effd700 1 -- 172.21.15.36:0/4151681331 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1080003260 con 0x7f1080004500 2022-01-10T01:31:17.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109ffff700 1 --2- 172.21.15.36:0/4151681331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1080004e70 0x7f108000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:17.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109ffff700 1 -- 172.21.15.36:0/4151681331 reap_dead start 2022-01-10T01:31:17.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109effd700 1 --2- 172.21.15.36:0/4151681331 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1080004500 0x7f1080004980 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f10a0061a80 tx=0x7f1088007d80).ready entity=mon.0 client_cookie=d78d64c2a97256f6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:17.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109e7fc700 1 -- 172.21.15.36:0/4151681331 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1088001620 con 0x7f1080004500 2022-01-10T01:31:17.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109e7fc700 1 -- 172.21.15.36:0/4151681331 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1088006890 con 0x7f1080004500 2022-01-10T01:31:17.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109e7fc700 1 -- 172.21.15.36:0/4151681331 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1088006bf0 con 0x7f1080004500 2022-01-10T01:31:17.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 -- 172.21.15.36:0/4151681331 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1080004500 msgr2=0x7f1080004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:17.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 --2- 172.21.15.36:0/4151681331 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1080004500 0x7f1080004980 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f10a0061a80 tx=0x7f1088007d80).stop 2022-01-10T01:31:17.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 -- 172.21.15.36:0/4151681331 shutdown_connections 2022-01-10T01:31:17.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 --2- 172.21.15.36:0/4151681331 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1080004500 0x7f1080004980 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 -- 172.21.15.36:0/4151681331 >> 172.21.15.36:0/4151681331 conn(0x7f10a0060180 msgr2=0x7f10a00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:17.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 -- 172.21.15.36:0/4151681331 shutdown_connections 2022-01-10T01:31:17.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 -- 172.21.15.36:0/4151681331 wait complete. 2022-01-10T01:31:17.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 Processor -- start 2022-01-10T01:31:17.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 -- start start 2022-01-10T01:31:17.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1080004500 0x7f10a00ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10a0063000 0x7f10a00aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f10a0066a60 0x7f10a00aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a0156750 con 0x7f10a0066a60 2022-01-10T01:31:17.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00ab590 con 0x7f1080004500 2022-01-10T01:31:17.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f10a4986700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00ab7c0 con 0x7f10a0063000 2022-01-10T01:31:17.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f10a0066a60 0x7f10a00aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f10a0066a60 0x7f10a00aa940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38686/0 (socket says 172.21.15.36:38686) 2022-01-10T01:31:17.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109ffff700 1 -- 172.21.15.36:0/1586857495 learned_addr learned my addr 172.21.15.36:0/1586857495 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:17.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109f7fe700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1080004500 0x7f10a00ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.617+0000 7f109effd700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10a0063000 0x7f10a00aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f109ffff700 1 -- 172.21.15.36:0/1586857495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10a0063000 msgr2=0x7f10a00aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:17.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f109ffff700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10a0063000 0x7f10a00aa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f109ffff700 1 -- 172.21.15.36:0/1586857495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1080004500 msgr2=0x7f10a00ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:17.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f109ffff700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1080004500 0x7f10a00ae490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f109ffff700 1 -- 172.21.15.36:0/1586857495 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a00aba60 con 0x7f10a0066a60 2022-01-10T01:31:17.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f109effd700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10a0063000 0x7f10a00aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:17.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f109ffff700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f10a0066a60 0x7f10a00aa940 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f1098001430 tx=0x7f10a00a79c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:17.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f109cff9700 1 -- 172.21.15.36:0/1586857495 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1098014620 con 0x7f10a0066a60 2022-01-10T01:31:17.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f109cff9700 1 -- 172.21.15.36:0/1586857495 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1098014780 con 0x7f10a0066a60 2022-01-10T01:31:17.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f109cff9700 1 -- 172.21.15.36:0/1586857495 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1098014ae0 con 0x7f10a0066a60 2022-01-10T01:31:17.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f10a4986700 1 -- 172.21.15.36:0/1586857495 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a014ad80 con 0x7f10a0066a60 2022-01-10T01:31:17.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f10a4986700 1 -- 172.21.15.36:0/1586857495 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a0159d20 con 0x7f10a0066a60 2022-01-10T01:31:17.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f10a4986700 1 -- 172.21.15.36:0/1586857495 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a0057350 con 0x7f10a0066a60 2022-01-10T01:31:17.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f109cff9700 1 -- 172.21.15.36:0/1586857495 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f10980133d0 con 0x7f10a0066a60 2022-01-10T01:31:17.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.621+0000 7f109cff9700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1084053680 0x7f1084055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.625+0000 7f109cff9700 1 -- 172.21.15.36:0/1586857495 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f109806b850 con 0x7f10a0066a60 2022-01-10T01:31:17.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.625+0000 7f109f7fe700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1084053680 0x7f1084055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.625+0000 7f109f7fe700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1084053680 0x7f1084055b40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f109000b000 tx=0x7f1090008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:17.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.629+0000 7f109cff9700 1 -- 172.21.15.36:0/1586857495 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f10980428c0 con 0x7f10a0066a60 2022-01-10T01:31:17.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.753+0000 7f10a4986700 1 -- 172.21.15.36:0/1586857495 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f10a00abbf0 con 0x7f10a0066a60 2022-01-10T01:31:17.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.825+0000 7f109cff9700 1 -- 172.21.15.36:0/1586857495 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v86) v1 ==== 125+0+0 (secure 0 0 0) 0x7f109801a030 con 0x7f10a0066a60 2022-01-10T01:31:17.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.829+0000 7f10a4986700 1 -- 172.21.15.36:0/1586857495 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1084053680 msgr2=0x7f1084055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:17.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.829+0000 7f10a4986700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1084053680 0x7f1084055b40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f109000b000 tx=0x7f1090008040).stop 2022-01-10T01:31:17.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.829+0000 7f10a4986700 1 -- 172.21.15.36:0/1586857495 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f10a0066a60 msgr2=0x7f10a00aa940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:17.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.829+0000 7f10a4986700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f10a0066a60 0x7f10a00aa940 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f1098001430 tx=0x7f10a00a79c0).stop 2022-01-10T01:31:17.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.829+0000 7f10a4986700 1 -- 172.21.15.36:0/1586857495 shutdown_connections 2022-01-10T01:31:17.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.829+0000 7f10a4986700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1084053680 0x7f1084055b40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.829+0000 7f10a4986700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f10a0066a60 0x7f10a00aa940 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.829+0000 7f10a4986700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10a0063000 0x7f10a00aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.829+0000 7f10a4986700 1 --2- 172.21.15.36:0/1586857495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1080004500 0x7f10a00ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.833+0000 7f10a4986700 1 -- 172.21.15.36:0/1586857495 >> 172.21.15.36:0/1586857495 conn(0x7f10a0060180 msgr2=0x7f10a00af180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:17.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.833+0000 7f10a4986700 1 -- 172.21.15.36:0/1586857495 shutdown_connections 2022-01-10T01:31:17.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.833+0000 7f10a4986700 1 -- 172.21.15.36:0/1586857495 wait complete. 2022-01-10T01:31:17.838 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' created 2022-01-10T01:31:17.849 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-10T01:31:17.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.949+0000 7fc87e171700 1 Processor -- start 2022-01-10T01:31:17.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.949+0000 7fc87e171700 1 -- start start 2022-01-10T01:31:17.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87e171700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8780a93c0 0x7fc8780af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87e171700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8780afda0 con 0x7fc8780ad320 2022-01-10T01:31:17.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87e171700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87805c610 con 0x7fc8780af2c0 2022-01-10T01:31:17.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87e171700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc878140800 con 0x7fc8780a93c0 2022-01-10T01:31:17.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87c96e700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fc8780ad320 0x7fc8780a8cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36488/0 (socket says 172.21.15.36:36488) 2022-01-10T01:31:17.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87c96e700 1 -- 172.21.15.36:0/658239093 learned_addr learned my addr 172.21.15.36:0/658239093 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:17.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87d970700 1 --2- 172.21.15.36:0/658239093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8780a93c0 0x7fc8780af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 -- 172.21.15.36:0/658239093 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967145953 0 0) 0x7fc8780afda0 con 0x7fc8780ad320 2022-01-10T01:31:17.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 -- 172.21.15.36:0/658239093 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc860003260 con 0x7fc8780ad320 2022-01-10T01:31:17.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 -- 172.21.15.36:0/658239093 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3882316787 0 0) 0x7fc860003260 con 0x7fc8780ad320 2022-01-10T01:31:17.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 -- 172.21.15.36:0/658239093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8780a93c0 msgr2=0x7fc8780af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:17.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 --2- 172.21.15.36:0/658239093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8780a93c0 0x7fc8780af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 -- 172.21.15.36:0/658239093 >> v1:172.21.15.59:6789/0 conn(0x7fc8780af2c0 legacy=0x7fc878143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:17.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 -- 172.21.15.36:0/658239093 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc878143860 con 0x7fc8780ad320 2022-01-10T01:31:17.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 -- 172.21.15.36:0/658239093 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fc868001660 con 0x7fc8780ad320 2022-01-10T01:31:17.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 -- 172.21.15.36:0/658239093 >> v1:172.21.15.36:6789/0 conn(0x7fc8780ad320 legacy=0x7fc8780a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:17.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 --2- 172.21.15.36:0/658239093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8780a93c0 0x7fc860003780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 --2- 172.21.15.36:0/658239093 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc860003cb0 0x7fc860004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 --2- 172.21.15.36:0/658239093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8600049f0 0x7fc860004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 -- 172.21.15.36:0/658239093 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc878140800 con 0x7fc860003cb0 2022-01-10T01:31:17.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 -- 172.21.15.36:0/658239093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86000b800 con 0x7fc8600049f0 2022-01-10T01:31:17.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc867fff700 1 -- 172.21.15.36:0/658239093 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86000b9c0 con 0x7fc8780a93c0 2022-01-10T01:31:17.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87c96e700 1 --2- 172.21.15.36:0/658239093 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc860003cb0 0x7fc860004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87d16f700 1 --2- 172.21.15.36:0/658239093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8780a93c0 0x7fc860003780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87d970700 1 --2- 172.21.15.36:0/658239093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8600049f0 0x7fc860004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87c96e700 1 -- 172.21.15.36:0/658239093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8780a93c0 msgr2=0x7fc860003780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:17.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87c96e700 1 --2- 172.21.15.36:0/658239093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8780a93c0 0x7fc860003780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87c96e700 1 -- 172.21.15.36:0/658239093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8600049f0 msgr2=0x7fc860004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:17.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87c96e700 1 --2- 172.21.15.36:0/658239093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8600049f0 0x7fc860004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87c96e700 1 -- 172.21.15.36:0/658239093 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc860003260 con 0x7fc860003cb0 2022-01-10T01:31:17.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.953+0000 7fc87c96e700 1 --2- 172.21.15.36:0/658239093 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc860003cb0 0x7fc860004500 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7fc868001370 tx=0x7fc8780aeea0).ready entity=mon.0 client_cookie=554cdacdfc3007a4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:17.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc867fff700 1 -- 172.21.15.36:0/658239093 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8680070d0 con 0x7fc860003cb0 2022-01-10T01:31:17.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc867fff700 1 -- 172.21.15.36:0/658239093 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc868007230 con 0x7fc860003cb0 2022-01-10T01:31:17.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc867fff700 1 -- 172.21.15.36:0/658239093 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc86800c8f0 con 0x7fc860003cb0 2022-01-10T01:31:17.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 -- 172.21.15.36:0/658239093 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc860003cb0 msgr2=0x7fc860004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:17.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 --2- 172.21.15.36:0/658239093 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc860003cb0 0x7fc860004500 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7fc868001370 tx=0x7fc8780aeea0).stop 2022-01-10T01:31:17.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87d970700 1 -- 172.21.15.36:0/658239093 reap_dead start 2022-01-10T01:31:17.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 -- 172.21.15.36:0/658239093 shutdown_connections 2022-01-10T01:31:17.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 -- 172.21.15.36:0/658239093 >> 172.21.15.36:0/658239093 conn(0x7fc878061140 msgr2=0x7fc878062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:17.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 -- 172.21.15.36:0/658239093 shutdown_connections 2022-01-10T01:31:17.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 -- 172.21.15.36:0/658239093 wait complete. 2022-01-10T01:31:17.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 Processor -- start 2022-01-10T01:31:17.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 -- start start 2022-01-10T01:31:17.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc860003cb0 0x7fc87813ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8780b5eb0 0x7fc8780644d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8780649c0 0x7fc878153ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc878067d50 con 0x7fc860003cb0 2022-01-10T01:31:17.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8780b5830 con 0x7fc8780b5eb0 2022-01-10T01:31:17.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8780b3860 con 0x7fc8780649c0 2022-01-10T01:31:17.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87d16f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc860003cb0 0x7fc87813ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87d16f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc860003cb0 0x7fc87813ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38704/0 (socket says 172.21.15.36:38704) 2022-01-10T01:31:17.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87d16f700 1 -- 172.21.15.36:0/412372951 learned_addr learned my addr 172.21.15.36:0/412372951 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:17.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87d970700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8780649c0 0x7fc878153ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87c96e700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8780b5eb0 0x7fc8780644d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87d16f700 1 -- 172.21.15.36:0/412372951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8780649c0 msgr2=0x7fc878153ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:17.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87d16f700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8780649c0 0x7fc878153ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87d16f700 1 -- 172.21.15.36:0/412372951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8780b5eb0 msgr2=0x7fc8780644d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:17.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87d16f700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8780b5eb0 0x7fc8780644d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:17.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87d16f700 1 -- 172.21.15.36:0/412372951 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8780b5a60 con 0x7fc860003cb0 2022-01-10T01:31:17.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87d970700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8780649c0 0x7fc878153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:17.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87d16f700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc860003cb0 0x7fc87813ec40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7fc874000f50 tx=0x7fc874007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:17.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc8667fc700 1 -- 172.21.15.36:0/412372951 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc874011660 con 0x7fc860003cb0 2022-01-10T01:31:17.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc8667fc700 1 -- 172.21.15.36:0/412372951 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8740117c0 con 0x7fc860003cb0 2022-01-10T01:31:17.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc87e171700 1 -- 172.21.15.36:0/412372951 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8780b3ac0 con 0x7fc860003cb0 2022-01-10T01:31:17.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.957+0000 7fc8667fc700 1 -- 172.21.15.36:0/412372951 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc874011b20 con 0x7fc860003cb0 2022-01-10T01:31:17.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.961+0000 7fc87e171700 1 -- 172.21.15.36:0/412372951 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8780b4170 con 0x7fc860003cb0 2022-01-10T01:31:17.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.961+0000 7fc87e171700 1 -- 172.21.15.36:0/412372951 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc878057350 con 0x7fc860003cb0 2022-01-10T01:31:17.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.961+0000 7fc8667fc700 1 -- 172.21.15.36:0/412372951 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc87401a030 con 0x7fc860003cb0 2022-01-10T01:31:17.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.961+0000 7fc8667fc700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc858053680 0x7fc858055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:17.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.961+0000 7fc8667fc700 1 -- 172.21.15.36:0/412372951 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6304+0+0 (secure 0 0 0) 0x7fc87406b4c0 con 0x7fc860003cb0 2022-01-10T01:31:17.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.961+0000 7fc87c96e700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc858053680 0x7fc858055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:17.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.961+0000 7fc87c96e700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc858053680 0x7fc858055b40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fc868019000 tx=0x7fc868015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:17.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:17.969+0000 7fc8667fc700 1 -- 172.21.15.36:0/412372951 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc874042600 con 0x7fc860003cb0 2022-01-10T01:31:18.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.129+0000 7fc87e171700 1 -- 172.21.15.36:0/412372951 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fc878061990 con 0x7fc860003cb0 2022-01-10T01:31:18.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.137+0000 7fc8667fc700 1 -- 172.21.15.36:0/412372951 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 15 and data pool 16 v39) v1 ==== 189+0+0 (secure 0 0 0) 0x7fc874045c20 con 0x7fc860003cb0 2022-01-10T01:31:18.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.141+0000 7fc87e171700 1 -- 172.21.15.36:0/412372951 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc858053680 msgr2=0x7fc858055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.141+0000 7fc87e171700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc858053680 0x7fc858055b40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fc868019000 tx=0x7fc868015000).stop 2022-01-10T01:31:18.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.141+0000 7fc87e171700 1 -- 172.21.15.36:0/412372951 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc860003cb0 msgr2=0x7fc87813ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.141+0000 7fc87e171700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc860003cb0 0x7fc87813ec40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7fc874000f50 tx=0x7fc874007a00).stop 2022-01-10T01:31:18.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.141+0000 7fc87e171700 1 -- 172.21.15.36:0/412372951 shutdown_connections 2022-01-10T01:31:18.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.141+0000 7fc87e171700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc858053680 0x7fc858055b40 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.141+0000 7fc87e171700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8780649c0 0x7fc878153ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.141+0000 7fc87e171700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8780b5eb0 0x7fc8780644d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.141+0000 7fc87e171700 1 --2- 172.21.15.36:0/412372951 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc860003cb0 0x7fc87813ec40 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.141+0000 7fc87e171700 1 -- 172.21.15.36:0/412372951 >> 172.21.15.36:0/412372951 conn(0x7fc878061140 msgr2=0x7fc8780b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:18.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.141+0000 7fc87e171700 1 -- 172.21.15.36:0/412372951 shutdown_connections 2022-01-10T01:31:18.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.141+0000 7fc87e171700 1 -- 172.21.15.36:0/412372951 wait complete. 2022-01-10T01:31:18.149 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 15 and data pool 16 2022-01-10T01:31:18.160 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:31:18.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.249+0000 7fd19f581700 1 Processor -- start 2022-01-10T01:31:18.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.249+0000 7fd19f581700 1 -- start start 2022-01-10T01:31:18.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19f581700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd198061320 0x7fd198061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19f581700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1980aecf0 con 0x7fd198140440 2022-01-10T01:31:18.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19f581700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1980b6f20 con 0x7fd1980ad5c0 2022-01-10T01:31:18.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19f581700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1980aef20 con 0x7fd198061320 2022-01-10T01:31:18.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19e57f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd198061320 0x7fd198061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19e57f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd198061320 0x7fd198061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:35348/0 (socket says 172.21.15.36:35348) 2022-01-10T01:31:18.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19e57f700 1 -- 172.21.15.36:0/2365282992 learned_addr learned my addr 172.21.15.36:0/2365282992 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:18.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19dd7e700 1 --1- 172.21.15.36:0/2365282992 >> v1:172.21.15.59:6789/0 conn(0x7fd1980ad5c0 0x7fd1980b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:54186/0 (socket says 172.21.15.36:54186) 2022-01-10T01:31:18.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19e57f700 1 -- 172.21.15.36:0/2365282992 >> v1:172.21.15.59:6789/0 conn(0x7fd1980ad5c0 legacy=0x7fd1980b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19e57f700 1 -- 172.21.15.36:0/2365282992 >> v1:172.21.15.36:6789/0 conn(0x7fd198140440 legacy=0x7fd198146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19e57f700 1 -- 172.21.15.36:0/2365282992 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1980af1c0 con 0x7fd198061320 2022-01-10T01:31:18.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19e57f700 1 --2- 172.21.15.36:0/2365282992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd198061320 0x7fd198061700 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fd1980aeba0 tx=0x7fd194009290).ready entity=mon.1 client_cookie=e37fb84a9e3d2087 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:18.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19d57d700 1 -- 172.21.15.36:0/2365282992 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd19400b860 con 0x7fd198061320 2022-01-10T01:31:18.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19d57d700 1 -- 172.21.15.36:0/2365282992 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19400b9c0 con 0x7fd198061320 2022-01-10T01:31:18.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19d57d700 1 -- 172.21.15.36:0/2365282992 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd19400bb30 con 0x7fd198061320 2022-01-10T01:31:18.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19f581700 1 -- 172.21.15.36:0/2365282992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd198061320 msgr2=0x7fd198061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19f581700 1 --2- 172.21.15.36:0/2365282992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd198061320 0x7fd198061700 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fd1980aeba0 tx=0x7fd194009290).stop 2022-01-10T01:31:18.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19f581700 1 -- 172.21.15.36:0/2365282992 shutdown_connections 2022-01-10T01:31:18.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19f581700 1 --2- 172.21.15.36:0/2365282992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd198061320 0x7fd198061700 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19f581700 1 -- 172.21.15.36:0/2365282992 >> 172.21.15.36:0/2365282992 conn(0x7fd198066de0 msgr2=0x7fd1980671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:18.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19f581700 1 -- 172.21.15.36:0/2365282992 shutdown_connections 2022-01-10T01:31:18.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.253+0000 7fd19f581700 1 -- 172.21.15.36:0/2365282992 wait complete. 2022-01-10T01:31:18.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19f581700 1 Processor -- start 2022-01-10T01:31:18.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19f581700 1 -- start start 2022-01-10T01:31:18.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19f581700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd198061320 0x7fd198155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19f581700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd1980ad5c0 0x7fd1981562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19f581700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd198140440 0x7fd19813e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19f581700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd198143230 con 0x7fd1980ad5c0 2022-01-10T01:31:18.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19f581700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd198142b70 con 0x7fd198061320 2022-01-10T01:31:18.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19f581700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd198141240 con 0x7fd198140440 2022-01-10T01:31:18.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19dd7e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd1980ad5c0 0x7fd1981562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19dd7e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd1980ad5c0 0x7fd1981562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38722/0 (socket says 172.21.15.36:38722) 2022-01-10T01:31:18.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19dd7e700 1 -- 172.21.15.36:0/2116938342 learned_addr learned my addr 172.21.15.36:0/2116938342 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:18.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19e57f700 1 --2- 172.21.15.36:0/2116938342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd198061320 0x7fd198155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19ed80700 1 --2- 172.21.15.36:0/2116938342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd198140440 0x7fd19813e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19dd7e700 1 -- 172.21.15.36:0/2116938342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd198140440 msgr2=0x7fd19813e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19dd7e700 1 --2- 172.21.15.36:0/2116938342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd198140440 0x7fd19813e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19dd7e700 1 -- 172.21.15.36:0/2116938342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd198061320 msgr2=0x7fd198155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19dd7e700 1 --2- 172.21.15.36:0/2116938342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd198061320 0x7fd198155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19dd7e700 1 -- 172.21.15.36:0/2116938342 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd194009530 con 0x7fd1980ad5c0 2022-01-10T01:31:18.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19dd7e700 1 --2- 172.21.15.36:0/2116938342 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd1980ad5c0 0x7fd1981562a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7fd1980af7e0 tx=0x7fd188007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:18.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd1877fe700 1 -- 172.21.15.36:0/2116938342 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1880070d0 con 0x7fd1980ad5c0 2022-01-10T01:31:18.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd1877fe700 1 -- 172.21.15.36:0/2116938342 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd188007230 con 0x7fd1980ad5c0 2022-01-10T01:31:18.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19f581700 1 -- 172.21.15.36:0/2116938342 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd198142fd0 con 0x7fd1980ad5c0 2022-01-10T01:31:18.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd1877fe700 1 -- 172.21.15.36:0/2116938342 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd188005550 con 0x7fd1980ad5c0 2022-01-10T01:31:18.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.257+0000 7fd19f581700 1 -- 172.21.15.36:0/2116938342 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd198143460 con 0x7fd1980ad5c0 2022-01-10T01:31:18.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.261+0000 7fd19f581700 1 -- 172.21.15.36:0/2116938342 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd198142ce0 con 0x7fd1980ad5c0 2022-01-10T01:31:18.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.261+0000 7fd1877fe700 1 -- 172.21.15.36:0/2116938342 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd188010070 con 0x7fd1980ad5c0 2022-01-10T01:31:18.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.261+0000 7fd1877fe700 1 --2- 172.21.15.36:0/2116938342 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd1780534d0 0x7fd178055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.261+0000 7fd1877fe700 1 -- 172.21.15.36:0/2116938342 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd18806b0c0 con 0x7fd1980ad5c0 2022-01-10T01:31:18.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.261+0000 7fd19e57f700 1 --2- 172.21.15.36:0/2116938342 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd1780534d0 0x7fd178055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.261+0000 7fd19e57f700 1 --2- 172.21.15.36:0/2116938342 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd1780534d0 0x7fd178055990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fd19401b000 tx=0x7fd194016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:18.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.265+0000 7fd1877fe700 1 -- 172.21.15.36:0/2116938342 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd188041fc0 con 0x7fd1980ad5c0 2022-01-10T01:31:18.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.389+0000 7fd19f581700 1 -- 172.21.15.36:0/2116938342 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1980af460 con 0x7fd1980ad5c0 2022-01-10T01:31:18.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.393+0000 7fd1877fe700 1 -- 172.21.15.36:0/2116938342 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16300 (secure 0 0 0) 0x7fd1880455e0 con 0x7fd1980ad5c0 2022-01-10T01:31:18.396 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:18.397 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":87,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:31:18.134447+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:31:16.698671+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2022-01-10T01:31:17.811890+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:31:18.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.393+0000 7fd19f581700 1 -- 172.21.15.36:0/2116938342 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd1780534d0 msgr2=0x7fd178055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.393+0000 7fd19f581700 1 --2- 172.21.15.36:0/2116938342 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd1780534d0 0x7fd178055990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7fd19401b000 tx=0x7fd194016000).stop 2022-01-10T01:31:18.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.393+0000 7fd19f581700 1 -- 172.21.15.36:0/2116938342 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd1980ad5c0 msgr2=0x7fd1981562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.393+0000 7fd19f581700 1 --2- 172.21.15.36:0/2116938342 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd1980ad5c0 0x7fd1981562a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7fd1980af7e0 tx=0x7fd188007be0).stop 2022-01-10T01:31:18.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.393+0000 7fd19f581700 1 -- 172.21.15.36:0/2116938342 shutdown_connections 2022-01-10T01:31:18.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.393+0000 7fd19f581700 1 --2- 172.21.15.36:0/2116938342 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd1780534d0 0x7fd178055990 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.393+0000 7fd19f581700 1 --2- 172.21.15.36:0/2116938342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd198140440 0x7fd19813e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.393+0000 7fd19f581700 1 --2- 172.21.15.36:0/2116938342 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd1980ad5c0 0x7fd1981562a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.393+0000 7fd19f581700 1 --2- 172.21.15.36:0/2116938342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd198061320 0x7fd198155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.393+0000 7fd19f581700 1 -- 172.21.15.36:0/2116938342 >> 172.21.15.36:0/2116938342 conn(0x7fd198066de0 msgr2=0x7fd1980671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:18.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.393+0000 7fd19f581700 1 -- 172.21.15.36:0/2116938342 shutdown_connections 2022-01-10T01:31:18.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.393+0000 7fd19f581700 1 -- 172.21.15.36:0/2116938342 wait complete. 2022-01-10T01:31:18.410 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:31:18.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f0210aa4700 1 Processor -- start 2022-01-10T01:31:18.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f0210aa4700 1 -- start start 2022-01-10T01:31:18.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f0210aa4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f020c0b03d0 0x7f020c146c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f0210aa4700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c0b1140 con 0x7f020c0a9190 2022-01-10T01:31:18.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f0210aa4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f020c0a9570 con 0x7f020c0b0b80 2022-01-10T01:31:18.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f0210aa4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f020c0b1370 con 0x7f020c0b03d0 2022-01-10T01:31:18.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f020bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f020c0b03d0 0x7f020c146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f020b7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f020c0a9190 0x7f020c146550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36522/0 (socket says 172.21.15.36:36522) 2022-01-10T01:31:18.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f020b7fe700 1 -- 172.21.15.36:0/417100618 learned_addr learned my addr 172.21.15.36:0/417100618 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:18.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f020bfff700 1 -- 172.21.15.36:0/417100618 >> v1:172.21.15.59:6789/0 conn(0x7f020c0b0b80 legacy=0x7f020c1401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f020bfff700 1 -- 172.21.15.36:0/417100618 >> v1:172.21.15.36:6789/0 conn(0x7f020c0a9190 legacy=0x7f020c146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f020a7fc700 1 -- 172.21.15.36:0/417100618 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738806489 0 0) 0x7f020c0b1140 con 0x7f020c0a9190 2022-01-10T01:31:18.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f020bfff700 1 -- 172.21.15.36:0/417100618 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c0b1610 con 0x7f020c0b03d0 2022-01-10T01:31:18.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f020bfff700 1 --2- 172.21.15.36:0/417100618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f020c0b03d0 0x7f020c146c60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f02040032f0 tx=0x7f02040091d0).ready entity=mon.0 client_cookie=7e878bf06fcc4f0d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:18.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f020a7fc700 1 -- 172.21.15.36:0/417100618 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0204009ea0 con 0x7f020c0b03d0 2022-01-10T01:31:18.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f020a7fc700 1 -- 172.21.15.36:0/417100618 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020400b870 con 0x7f020c0b03d0 2022-01-10T01:31:18.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.509+0000 7f020a7fc700 1 -- 172.21.15.36:0/417100618 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f020400b9e0 con 0x7f020c0b03d0 2022-01-10T01:31:18.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.513+0000 7f0210aa4700 1 -- 172.21.15.36:0/417100618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f020c0b03d0 msgr2=0x7f020c146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.513+0000 7f0210aa4700 1 --2- 172.21.15.36:0/417100618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f020c0b03d0 0x7f020c146c60 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f02040032f0 tx=0x7f02040091d0).stop 2022-01-10T01:31:18.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.513+0000 7f0210aa4700 1 -- 172.21.15.36:0/417100618 shutdown_connections 2022-01-10T01:31:18.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.513+0000 7f0210aa4700 1 --2- 172.21.15.36:0/417100618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f020c0b03d0 0x7f020c146c60 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.513+0000 7f0210aa4700 1 -- 172.21.15.36:0/417100618 >> 172.21.15.36:0/417100618 conn(0x7f020c061140 msgr2=0x7f020c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:18.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.513+0000 7f0210aa4700 1 -- 172.21.15.36:0/417100618 shutdown_connections 2022-01-10T01:31:18.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.513+0000 7f0210aa4700 1 -- 172.21.15.36:0/417100618 wait complete. 2022-01-10T01:31:18.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.513+0000 7f0210aa4700 1 Processor -- start 2022-01-10T01:31:18.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.513+0000 7f0210aa4700 1 -- start start 2022-01-10T01:31:18.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f0210aa4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c0a9190 0x7f020c0af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f0210aa4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f020c0b03d0 0x7f020c155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f0210aa4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f020c0b0b80 0x7f020c1563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f0210aa4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c144750 con 0x7f020c0b03d0 2022-01-10T01:31:18.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f0210aa4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020c1457c0 con 0x7f020c0b0b80 2022-01-10T01:31:18.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f0210aa4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020c155a80 con 0x7f020c0a9190 2022-01-10T01:31:18.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f020affd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f020c0b03d0 0x7f020c155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f020b7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c0a9190 0x7f020c0af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f020affd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f020c0b03d0 0x7f020c155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38736/0 (socket says 172.21.15.36:38736) 2022-01-10T01:31:18.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f020affd700 1 -- 172.21.15.36:0/2252268874 learned_addr learned my addr 172.21.15.36:0/2252268874 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:18.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f020bfff700 1 --2- 172.21.15.36:0/2252268874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f020c0b0b80 0x7f020c1563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f020affd700 1 -- 172.21.15.36:0/2252268874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c0a9190 msgr2=0x7f020c0af210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f020affd700 1 --2- 172.21.15.36:0/2252268874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c0a9190 0x7f020c0af210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f020affd700 1 -- 172.21.15.36:0/2252268874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f020c0b0b80 msgr2=0x7f020c1563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f020affd700 1 --2- 172.21.15.36:0/2252268874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f020c0b0b80 0x7f020c1563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f020affd700 1 -- 172.21.15.36:0/2252268874 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0204009470 con 0x7f020c0b03d0 2022-01-10T01:31:18.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f020affd700 1 --2- 172.21.15.36:0/2252268874 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f020c0b03d0 0x7f020c155ee0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f020c0b0290 tx=0x7f0200007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:18.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f0208ff9700 1 -- 172.21.15.36:0/2252268874 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0200012400 con 0x7f020c0b03d0 2022-01-10T01:31:18.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f0208ff9700 1 -- 172.21.15.36:0/2252268874 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0200012560 con 0x7f020c0b03d0 2022-01-10T01:31:18.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f0210aa4700 1 -- 172.21.15.36:0/2252268874 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c1568c0 con 0x7f020c0b03d0 2022-01-10T01:31:18.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f0208ff9700 1 -- 172.21.15.36:0/2252268874 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02000128c0 con 0x7f020c0b03d0 2022-01-10T01:31:18.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.517+0000 7f0210aa4700 1 -- 172.21.15.36:0/2252268874 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020c1459f0 con 0x7f020c0b03d0 2022-01-10T01:31:18.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.521+0000 7f0210aa4700 1 -- 172.21.15.36:0/2252268874 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020c155c40 con 0x7f020c0b03d0 2022-01-10T01:31:18.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.521+0000 7f0208ff9700 1 -- 172.21.15.36:0/2252268874 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0200019030 con 0x7f020c0b03d0 2022-01-10T01:31:18.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.521+0000 7f0208ff9700 1 --2- 172.21.15.36:0/2252268874 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f01ec053620 0x7f01ec055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.521+0000 7f0208ff9700 1 -- 172.21.15.36:0/2252268874 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f020006ad10 con 0x7f020c0b03d0 2022-01-10T01:31:18.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.521+0000 7f020b7fe700 1 --2- 172.21.15.36:0/2252268874 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f01ec053620 0x7f01ec055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.521+0000 7f020b7fe700 1 --2- 172.21.15.36:0/2252268874 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f01ec053620 0x7f01ec055ae0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f01fc00d000 tx=0x7f01fc007c00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:18.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.529+0000 7f0208ff9700 1 -- 172.21.15.36:0/2252268874 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f020c155c40 con 0x7f020c0b03d0 2022-01-10T01:31:18.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.657+0000 7f0210aa4700 1 -- 172.21.15.36:0/2252268874 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f020c155c40 con 0x7f020c0b03d0 2022-01-10T01:31:18.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.657+0000 7f0208ff9700 1 -- 172.21.15.36:0/2252268874 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16300 (secure 0 0 0) 0x7f020c155c40 con 0x7f020c0b03d0 2022-01-10T01:31:18.663 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:18.663 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":87,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:31:18.134447+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:31:16.698671+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2022-01-10T01:31:17.811890+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:31:18.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.661+0000 7f0210aa4700 1 -- 172.21.15.36:0/2252268874 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f01ec053620 msgr2=0x7f01ec055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.661+0000 7f0210aa4700 1 --2- 172.21.15.36:0/2252268874 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f01ec053620 0x7f01ec055ae0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f01fc00d000 tx=0x7f01fc007c00).stop 2022-01-10T01:31:18.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.661+0000 7f0210aa4700 1 -- 172.21.15.36:0/2252268874 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f020c0b03d0 msgr2=0x7f020c155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.661+0000 7f0210aa4700 1 --2- 172.21.15.36:0/2252268874 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f020c0b03d0 0x7f020c155ee0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f020c0b0290 tx=0x7f0200007c50).stop 2022-01-10T01:31:18.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.661+0000 7f0210aa4700 1 -- 172.21.15.36:0/2252268874 shutdown_connections 2022-01-10T01:31:18.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.661+0000 7f0210aa4700 1 --2- 172.21.15.36:0/2252268874 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f01ec053620 0x7f01ec055ae0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.661+0000 7f0210aa4700 1 --2- 172.21.15.36:0/2252268874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f020c0b0b80 0x7f020c1563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.661+0000 7f0210aa4700 1 --2- 172.21.15.36:0/2252268874 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f020c0b03d0 0x7f020c155ee0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.661+0000 7f0210aa4700 1 --2- 172.21.15.36:0/2252268874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f020c0a9190 0x7f020c0af210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.661+0000 7f0210aa4700 1 -- 172.21.15.36:0/2252268874 >> 172.21.15.36:0/2252268874 conn(0x7f020c061140 msgr2=0x7f020c143600 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:18.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.661+0000 7f0210aa4700 1 -- 172.21.15.36:0/2252268874 shutdown_connections 2022-01-10T01:31:18.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.661+0000 7f0210aa4700 1 -- 172.21.15.36:0/2252268874 wait complete. 2022-01-10T01:31:18.677 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-01-10T01:31:18.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.777+0000 7f2b7bfff700 1 Processor -- start 2022-01-10T01:31:18.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.777+0000 7f2b7bfff700 1 -- start start 2022-01-10T01:31:18.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2b7c0b2580 0x7f2b7c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7bfff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c0a70c0 con 0x7f2b7c0b0010 2022-01-10T01:31:18.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7bfff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c0a72f0 con 0x7f2b7c0a8ac0 2022-01-10T01:31:18.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7bfff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b7c0a7590 con 0x7f2b7c0b2580 2022-01-10T01:31:18.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7affd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2b7c0b2580 0x7f2b7c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7a7fc700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f2b7c0b0010 0x7f2b7c0a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36538/0 (socket says 172.21.15.36:36538) 2022-01-10T01:31:18.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7a7fc700 1 -- 172.21.15.36:0/4055409607 learned_addr learned my addr 172.21.15.36:0/4055409607 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:18.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7affd700 1 -- 172.21.15.36:0/4055409607 >> v1:172.21.15.59:6789/0 conn(0x7f2b7c0a8ac0 legacy=0x7f2b7c151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7affd700 1 -- 172.21.15.36:0/4055409607 >> v1:172.21.15.36:6789/0 conn(0x7f2b7c0b0010 legacy=0x7f2b7c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7affd700 1 -- 172.21.15.36:0/4055409607 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c0a7830 con 0x7f2b7c0b2580 2022-01-10T01:31:18.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7affd700 1 --2- 172.21.15.36:0/4055409607 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b7c0b2580 0x7f2b7c14ae40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f2b64002f70 tx=0x7f2b64006df0).ready entity=mon.0 client_cookie=3384fd03f1eae74d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:18.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b79ffb700 1 -- 172.21.15.36:0/4055409607 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b6400d610 con 0x7f2b7c0b2580 2022-01-10T01:31:18.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b79ffb700 1 -- 172.21.15.36:0/4055409607 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b64000e90 con 0x7f2b7c0b2580 2022-01-10T01:31:18.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b79ffb700 1 -- 172.21.15.36:0/4055409607 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b6400d960 con 0x7f2b7c0b2580 2022-01-10T01:31:18.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7bfff700 1 -- 172.21.15.36:0/4055409607 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b7c0b2580 msgr2=0x7f2b7c14ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7bfff700 1 --2- 172.21.15.36:0/4055409607 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b7c0b2580 0x7f2b7c14ae40 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f2b64002f70 tx=0x7f2b64006df0).stop 2022-01-10T01:31:18.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7bfff700 1 -- 172.21.15.36:0/4055409607 shutdown_connections 2022-01-10T01:31:18.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7bfff700 1 --2- 172.21.15.36:0/4055409607 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b7c0b2580 0x7f2b7c14ae40 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7bfff700 1 -- 172.21.15.36:0/4055409607 >> 172.21.15.36:0/4055409607 conn(0x7f2b7c060180 msgr2=0x7f2b7c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:18.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7bfff700 1 -- 172.21.15.36:0/4055409607 shutdown_connections 2022-01-10T01:31:18.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.781+0000 7f2b7bfff700 1 -- 172.21.15.36:0/4055409607 wait complete. 2022-01-10T01:31:18.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7bfff700 1 Processor -- start 2022-01-10T01:31:18.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7bfff700 1 -- start start 2022-01-10T01:31:18.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0a8ac0 0x7f2b7c0662c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b7c0b0010 0x7f2b7c156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b7c156e80 0x7f2b7c145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7bfff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0667b0 con 0x7f2b7c0b0010 2022-01-10T01:31:18.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7bfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0669e0 con 0x7f2b7c0a8ac0 2022-01-10T01:31:18.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7bfff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0abe50 con 0x7f2b7c156e80 2022-01-10T01:31:18.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7a7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b7c0b0010 0x7f2b7c156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7a7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b7c0b0010 0x7f2b7c156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38750/0 (socket says 172.21.15.36:38750) 2022-01-10T01:31:18.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7a7fc700 1 -- 172.21.15.36:0/2946100771 learned_addr learned my addr 172.21.15.36:0/2946100771 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:18.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7b7fe700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b7c156e80 0x7f2b7c145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7affd700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0a8ac0 0x7f2b7c0662c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7a7fc700 1 -- 172.21.15.36:0/2946100771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b7c156e80 msgr2=0x7f2b7c145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7a7fc700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b7c156e80 0x7f2b7c145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7a7fc700 1 -- 172.21.15.36:0/2946100771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0a8ac0 msgr2=0x7f2b7c0662c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:18.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7a7fc700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0a8ac0 0x7f2b7c0662c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:18.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7a7fc700 1 -- 172.21.15.36:0/2946100771 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6400b180 con 0x7f2b7c0b0010 2022-01-10T01:31:18.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7affd700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0a8ac0 0x7f2b7c0662c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:18.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7a7fc700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b7c0b0010 0x7f2b7c156990 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f2b7c06b7c0 tx=0x7f2b6c007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:18.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b73fff700 1 -- 172.21.15.36:0/2946100771 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b6c0070d0 con 0x7f2b7c0b0010 2022-01-10T01:31:18.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b73fff700 1 -- 172.21.15.36:0/2946100771 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c007230 con 0x7f2b7c0b0010 2022-01-10T01:31:18.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b73fff700 1 -- 172.21.15.36:0/2946100771 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b6c005610 con 0x7f2b7c0b0010 2022-01-10T01:31:18.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7bfff700 1 -- 172.21.15.36:0/2946100771 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7c0642b0 con 0x7f2b7c0b0010 2022-01-10T01:31:18.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.785+0000 7f2b7bfff700 1 -- 172.21.15.36:0/2946100771 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c0635a0 con 0x7f2b7c0b0010 2022-01-10T01:31:18.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.789+0000 7f2b7bfff700 1 -- 172.21.15.36:0/2946100771 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c0ac050 con 0x7f2b7c0b0010 2022-01-10T01:31:18.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.789+0000 7f2b73fff700 1 -- 172.21.15.36:0/2946100771 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2b6c010070 con 0x7f2b7c0b0010 2022-01-10T01:31:18.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.789+0000 7f2b73fff700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b60053560 0x7f2b60055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:18.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.789+0000 7f2b73fff700 1 -- 172.21.15.36:0/2946100771 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2b6c06afb0 con 0x7f2b7c0b0010 2022-01-10T01:31:18.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.789+0000 7f2b7affd700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b60053560 0x7f2b60055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:18.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.789+0000 7f2b7affd700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b60053560 0x7f2b60055a20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f2b6401a000 tx=0x7f2b64015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:18.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.797+0000 7f2b73fff700 1 -- 172.21.15.36:0/2946100771 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2b6c041fc0 con 0x7f2b7c0b0010 2022-01-10T01:31:18.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:18.961+0000 7f2b7bfff700 1 -- 172.21.15.36:0/2946100771 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2b7c157290 con 0x7f2b7c0b0010 2022-01-10T01:31:19.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.141+0000 7f2b73fff700 1 -- 172.21.15.36:0/2946100771 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v40) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2b6c018070 con 0x7f2b7c0b0010 2022-01-10T01:31:19.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.141+0000 7f2b7bfff700 1 -- 172.21.15.36:0/2946100771 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b60053560 msgr2=0x7f2b60055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.141+0000 7f2b7bfff700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b60053560 0x7f2b60055a20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f2b6401a000 tx=0x7f2b64015000).stop 2022-01-10T01:31:19.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.141+0000 7f2b7bfff700 1 -- 172.21.15.36:0/2946100771 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b7c0b0010 msgr2=0x7f2b7c156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.141+0000 7f2b7bfff700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b7c0b0010 0x7f2b7c156990 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f2b7c06b7c0 tx=0x7f2b6c007c40).stop 2022-01-10T01:31:19.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.141+0000 7f2b7bfff700 1 -- 172.21.15.36:0/2946100771 shutdown_connections 2022-01-10T01:31:19.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.141+0000 7f2b7bfff700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b60053560 0x7f2b60055a20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.141+0000 7f2b7bfff700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b7c156e80 0x7f2b7c145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.141+0000 7f2b7bfff700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b7c0b0010 0x7f2b7c156990 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.141+0000 7f2b7bfff700 1 --2- 172.21.15.36:0/2946100771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b7c0a8ac0 0x7f2b7c0662c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.141+0000 7f2b7bfff700 1 -- 172.21.15.36:0/2946100771 >> 172.21.15.36:0/2946100771 conn(0x7f2b7c060180 msgr2=0x7f2b7c067690 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:19.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.145+0000 7f2b7bfff700 1 -- 172.21.15.36:0/2946100771 shutdown_connections 2022-01-10T01:31:19.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.145+0000 7f2b7bfff700 1 -- 172.21.15.36:0/2946100771 wait complete. 2022-01-10T01:31:19.165 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:19.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.261+0000 7f328dd4b700 1 Processor -- start 2022-01-10T01:31:19.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.261+0000 7f328dd4b700 1 -- start start 2022-01-10T01:31:19.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328dd4b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f32880af2c0 0x7f32880af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328dd4b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f32880ad850 0x7f32880a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328dd4b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32880afda0 con 0x7f32880ad320 2022-01-10T01:31:19.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328dd4b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328805c610 con 0x7f32880ad850 2022-01-10T01:31:19.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328dd4b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3288140800 con 0x7f32880af2c0 2022-01-10T01:31:19.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f3287fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f32880ad320 0x7f3288143150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36552/0 (socket says 172.21.15.36:36552) 2022-01-10T01:31:19.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f3287fff700 1 -- 172.21.15.36:0/443619003 learned_addr learned my addr 172.21.15.36:0/443619003 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:19.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328d54a700 1 --2- 172.21.15.36:0/443619003 >> v2:172.21.15.36:3300/0 conn(0x7f32880ad850 0x7f32880a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328cd49700 1 --2- 172.21.15.36:0/443619003 >> v2:172.21.15.59:3300/0 conn(0x7f32880af2c0 0x7f32880af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f32877fe700 1 -- 172.21.15.36:0/443619003 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900769392 0 0) 0x7f32880afda0 con 0x7f32880ad320 2022-01-10T01:31:19.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f32877fe700 1 -- 172.21.15.36:0/443619003 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f326c003260 con 0x7f32880ad320 2022-01-10T01:31:19.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328cd49700 1 -- 172.21.15.36:0/443619003 >> v2:172.21.15.36:3300/0 conn(0x7f32880ad850 msgr2=0x7f32880a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:19.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328cd49700 1 --2- 172.21.15.36:0/443619003 >> v2:172.21.15.36:3300/0 conn(0x7f32880ad850 0x7f32880a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328cd49700 1 -- 172.21.15.36:0/443619003 >> v1:172.21.15.36:6789/0 conn(0x7f32880ad320 legacy=0x7f3288143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328cd49700 1 -- 172.21.15.36:0/443619003 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3288143860 con 0x7f32880af2c0 2022-01-10T01:31:19.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328cd49700 1 --2- 172.21.15.36:0/443619003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32880af2c0 0x7f32880af6a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f32880ad770 tx=0x7f327c006df0).ready entity=mon.1 client_cookie=f46bb2a1438e1409 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:19.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f32877fe700 1 -- 172.21.15.36:0/443619003 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f327c00d4f0 con 0x7f32880af2c0 2022-01-10T01:31:19.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f32877fe700 1 -- 172.21.15.36:0/443619003 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c000e90 con 0x7f32880af2c0 2022-01-10T01:31:19.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f32877fe700 1 -- 172.21.15.36:0/443619003 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f327c00d840 con 0x7f32880af2c0 2022-01-10T01:31:19.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328dd4b700 1 -- 172.21.15.36:0/443619003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32880af2c0 msgr2=0x7f32880af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328dd4b700 1 --2- 172.21.15.36:0/443619003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32880af2c0 0x7f32880af6a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f32880ad770 tx=0x7f327c006df0).stop 2022-01-10T01:31:19.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328dd4b700 1 -- 172.21.15.36:0/443619003 shutdown_connections 2022-01-10T01:31:19.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328dd4b700 1 --2- 172.21.15.36:0/443619003 >> v2:172.21.15.36:3300/0 conn(0x7f32880ad850 0x7f32880a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328dd4b700 1 --2- 172.21.15.36:0/443619003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32880af2c0 0x7f32880af6a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328dd4b700 1 -- 172.21.15.36:0/443619003 >> 172.21.15.36:0/443619003 conn(0x7f3288061140 msgr2=0x7f3288062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:19.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328dd4b700 1 -- 172.21.15.36:0/443619003 shutdown_connections 2022-01-10T01:31:19.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.265+0000 7f328dd4b700 1 -- 172.21.15.36:0/443619003 wait complete. 2022-01-10T01:31:19.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.269+0000 7f328dd4b700 1 Processor -- start 2022-01-10T01:31:19.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.269+0000 7f328dd4b700 1 -- start start 2022-01-10T01:31:19.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f328dd4b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32880ad320 0x7f328814fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f328dd4b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32880ad850 0x7f32880b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f328dd4b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32880af2c0 0x7f32880b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f328dd4b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328814eea0 con 0x7f32880ad850 2022-01-10T01:31:19.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f328dd4b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32880a9da0 con 0x7f32880ad320 2022-01-10T01:31:19.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f328dd4b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328814f090 con 0x7f32880af2c0 2022-01-10T01:31:19.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f3287fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32880ad850 0x7f32880b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f328cd49700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32880ad320 0x7f328814fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f328cd49700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32880ad320 0x7f328814fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:35396/0 (socket says 172.21.15.36:35396) 2022-01-10T01:31:19.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f328cd49700 1 -- 172.21.15.36:0/343645661 learned_addr learned my addr 172.21.15.36:0/343645661 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:19.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f328d54a700 1 --2- 172.21.15.36:0/343645661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32880af2c0 0x7f32880b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f3287fff700 1 -- 172.21.15.36:0/343645661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32880af2c0 msgr2=0x7f32880b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f3287fff700 1 --2- 172.21.15.36:0/343645661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32880af2c0 0x7f32880b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f3287fff700 1 -- 172.21.15.36:0/343645661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32880ad320 msgr2=0x7f328814fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f3287fff700 1 --2- 172.21.15.36:0/343645661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32880ad320 0x7f328814fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f3287fff700 1 -- 172.21.15.36:0/343645661 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c00b180 con 0x7f32880ad850 2022-01-10T01:31:19.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f3287fff700 1 --2- 172.21.15.36:0/343645661 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32880ad850 0x7f32880b1a20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f3274001110 tx=0x7f3274007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:19.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f3285ffb700 1 -- 172.21.15.36:0/343645661 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f327400ce80 con 0x7f32880ad850 2022-01-10T01:31:19.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f3285ffb700 1 -- 172.21.15.36:0/343645661 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32740070d0 con 0x7f32880ad850 2022-01-10T01:31:19.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f328dd4b700 1 -- 172.21.15.36:0/343645661 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328814f330 con 0x7f32880ad850 2022-01-10T01:31:19.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f3285ffb700 1 -- 172.21.15.36:0/343645661 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3274007430 con 0x7f32880ad850 2022-01-10T01:31:19.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.273+0000 7f328dd4b700 1 -- 172.21.15.36:0/343645661 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32880b1f90 con 0x7f32880ad850 2022-01-10T01:31:19.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.277+0000 7f328dd4b700 1 -- 172.21.15.36:0/343645661 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32880a99c0 con 0x7f32880ad850 2022-01-10T01:31:19.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.277+0000 7f3285ffb700 1 -- 172.21.15.36:0/343645661 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f327401a060 con 0x7f32880ad850 2022-01-10T01:31:19.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.277+0000 7f3285ffb700 1 --2- 172.21.15.36:0/343645661 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f32680536b0 0x7f3268055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.277+0000 7f3285ffb700 1 -- 172.21.15.36:0/343645661 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f327406b030 con 0x7f32880ad850 2022-01-10T01:31:19.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.277+0000 7f328cd49700 1 --2- 172.21.15.36:0/343645661 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f32680536b0 0x7f3268055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.277+0000 7f328cd49700 1 --2- 172.21.15.36:0/343645661 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f32680536b0 0x7f3268055b70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f327c01c000 tx=0x7f327c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:19.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.285+0000 7f3285ffb700 1 -- 172.21.15.36:0/343645661 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3274042040 con 0x7f32880ad850 2022-01-10T01:31:19.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.449+0000 7f328dd4b700 1 -- 172.21.15.36:0/343645661 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3288057350 con 0x7f32880ad850 2022-01-10T01:31:19.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.449+0000 7f3285ffb700 1 -- 172.21.15.36:0/343645661 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f3274018030 con 0x7f32880ad850 2022-01-10T01:31:19.455 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:19.456 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":40,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3902337896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3902337896},{"type":"v1","addr":"172.21.15.36:6835","nonce":3902337896}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6612,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6837/3131314479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":3131314479},{"type":"v1","addr":"172.21.15.36:6837","nonce":3131314479}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:31:18.134652+0000","modified":"2022-01-10T01:31:19.137223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6616":{"gid":6616,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3399412771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3399412771},{"type":"v1","addr":"172.21.15.59:6833","nonce":3399412771}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2022-01-10T01:31:19.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.453+0000 7f328dd4b700 1 -- 172.21.15.36:0/343645661 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f32680536b0 msgr2=0x7f3268055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.453+0000 7f328dd4b700 1 --2- 172.21.15.36:0/343645661 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f32680536b0 0x7f3268055b70 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f327c01c000 tx=0x7f327c014000).stop 2022-01-10T01:31:19.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.453+0000 7f328dd4b700 1 -- 172.21.15.36:0/343645661 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32880ad850 msgr2=0x7f32880b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.453+0000 7f328dd4b700 1 --2- 172.21.15.36:0/343645661 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32880ad850 0x7f32880b1a20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f3274001110 tx=0x7f3274007a20).stop 2022-01-10T01:31:19.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.453+0000 7f328dd4b700 1 -- 172.21.15.36:0/343645661 shutdown_connections 2022-01-10T01:31:19.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.453+0000 7f328dd4b700 1 --2- 172.21.15.36:0/343645661 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f32680536b0 0x7f3268055b70 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.453+0000 7f328dd4b700 1 --2- 172.21.15.36:0/343645661 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32880af2c0 0x7f32880b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.453+0000 7f328dd4b700 1 --2- 172.21.15.36:0/343645661 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f32880ad850 0x7f32880b1a20 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.453+0000 7f328dd4b700 1 --2- 172.21.15.36:0/343645661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32880ad320 0x7f328814fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.453+0000 7f328dd4b700 1 -- 172.21.15.36:0/343645661 >> 172.21.15.36:0/343645661 conn(0x7f3288061140 msgr2=0x7f32880a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:19.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.453+0000 7f328dd4b700 1 -- 172.21.15.36:0/343645661 shutdown_connections 2022-01-10T01:31:19.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.453+0000 7f328dd4b700 1 -- 172.21.15.36:0/343645661 wait complete. 2022-01-10T01:31:19.460 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 40 2022-01-10T01:31:19.469 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:31:19.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabeb59e700 1 Processor -- start 2022-01-10T01:31:19.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabeb59e700 1 -- start start 2022-01-10T01:31:19.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabeb59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fabec0b2580 0x7fabec14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabeb59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec0a70c0 con 0x7fabec0b0010 2022-01-10T01:31:19.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabeb59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabec0a72f0 con 0x7fabec0a8ac0 2022-01-10T01:31:19.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabeb59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabec0a7590 con 0x7fabec0b2580 2022-01-10T01:31:19.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe1d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fabec0b0010 0x7fabec0a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36564/0 (socket says 172.21.15.36:36564) 2022-01-10T01:31:19.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe1d9b700 1 -- 172.21.15.36:0/2058828453 learned_addr learned my addr 172.21.15.36:0/2058828453 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:19.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabea59c700 1 --2- 172.21.15.36:0/2058828453 >> v2:172.21.15.59:3300/0 conn(0x7fabec0b2580 0x7fabec14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 -- 172.21.15.36:0/2058828453 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813071556 0 0) 0x7fabec0a70c0 con 0x7fabec0b0010 2022-01-10T01:31:19.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 -- 172.21.15.36:0/2058828453 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabcc003260 con 0x7fabec0b0010 2022-01-10T01:31:19.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 -- 172.21.15.36:0/2058828453 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4128480873 0 0) 0x7fabcc003260 con 0x7fabec0b0010 2022-01-10T01:31:19.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 -- 172.21.15.36:0/2058828453 >> v2:172.21.15.59:3300/0 conn(0x7fabec0b2580 msgr2=0x7fabec14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:19.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 --2- 172.21.15.36:0/2058828453 >> v2:172.21.15.59:3300/0 conn(0x7fabec0b2580 0x7fabec14ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 -- 172.21.15.36:0/2058828453 >> v1:172.21.15.59:6789/0 conn(0x7fabec0a8ac0 legacy=0x7fabec151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 -- 172.21.15.36:0/2058828453 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec0a7830 con 0x7fabec0b0010 2022-01-10T01:31:19.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 -- 172.21.15.36:0/2058828453 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fabd4001660 con 0x7fabec0b0010 2022-01-10T01:31:19.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 -- 172.21.15.36:0/2058828453 >> v1:172.21.15.36:6789/0 conn(0x7fabec0b0010 legacy=0x7fabec0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 --2- 172.21.15.36:0/2058828453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabcc003750 0x7fabcc003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 --2- 172.21.15.36:0/2058828453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc004500 0x7fabcc004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 --2- 172.21.15.36:0/2058828453 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabcc004e70 0x7fabcc00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 -- 172.21.15.36:0/2058828453 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0a7590 con 0x7fabcc004e70 2022-01-10T01:31:19.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 -- 172.21.15.36:0/2058828453 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc00bd20 con 0x7fabcc004500 2022-01-10T01:31:19.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 -- 172.21.15.36:0/2058828453 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc00bee0 con 0x7fabcc003750 2022-01-10T01:31:19.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe1d9b700 1 --2- 172.21.15.36:0/2058828453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc004500 0x7fabcc004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabead9d700 1 --2- 172.21.15.36:0/2058828453 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabcc004e70 0x7fabcc00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabea59c700 1 --2- 172.21.15.36:0/2058828453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabcc003750 0x7fabcc003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabead9d700 1 -- 172.21.15.36:0/2058828453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabcc003750 msgr2=0x7fabcc003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:19.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabead9d700 1 --2- 172.21.15.36:0/2058828453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabcc003750 0x7fabcc003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabead9d700 1 -- 172.21.15.36:0/2058828453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc004500 msgr2=0x7fabcc004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:19.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabead9d700 1 --2- 172.21.15.36:0/2058828453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc004500 0x7fabcc004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabead9d700 1 -- 172.21.15.36:0/2058828453 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc003260 con 0x7fabcc004e70 2022-01-10T01:31:19.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe1d9b700 1 --2- 172.21.15.36:0/2058828453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc004500 0x7fabcc004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:19.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabea59c700 1 --2- 172.21.15.36:0/2058828453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabcc003750 0x7fabcc003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:19.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabead9d700 1 -- 172.21.15.36:0/2058828453 reap_dead start 2022-01-10T01:31:19.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabead9d700 1 --2- 172.21.15.36:0/2058828453 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabcc004e70 0x7fabcc00b750 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7fabec061a80 tx=0x7fabe4007d80).ready entity=mon.0 client_cookie=7724538f074416ca server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:19.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 -- 172.21.15.36:0/2058828453 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabe4001620 con 0x7fabcc004e70 2022-01-10T01:31:19.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 -- 172.21.15.36:0/2058828453 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe4006890 con 0x7fabcc004e70 2022-01-10T01:31:19.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.569+0000 7fabe9d9b700 1 -- 172.21.15.36:0/2058828453 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabe4006bf0 con 0x7fabcc004e70 2022-01-10T01:31:19.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 -- 172.21.15.36:0/2058828453 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabcc004e70 msgr2=0x7fabcc00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 --2- 172.21.15.36:0/2058828453 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabcc004e70 0x7fabcc00b750 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7fabec061a80 tx=0x7fabe4007d80).stop 2022-01-10T01:31:19.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 -- 172.21.15.36:0/2058828453 shutdown_connections 2022-01-10T01:31:19.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 --2- 172.21.15.36:0/2058828453 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabcc004e70 0x7fabcc00b750 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 -- 172.21.15.36:0/2058828453 >> 172.21.15.36:0/2058828453 conn(0x7fabec060180 msgr2=0x7fabec0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:19.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 -- 172.21.15.36:0/2058828453 shutdown_connections 2022-01-10T01:31:19.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 -- 172.21.15.36:0/2058828453 wait complete. 2022-01-10T01:31:19.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 Processor -- start 2022-01-10T01:31:19.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 -- start start 2022-01-10T01:31:19.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc004e70 0x7fabec065fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabec066980 0x7fabec1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabec0ab790 0x7fabec153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0664d0 con 0x7fabec0ab790 2022-01-10T01:31:19.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec156ba0 con 0x7fabcc004e70 2022-01-10T01:31:19.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec066700 con 0x7fabec066980 2022-01-10T01:31:19.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabead9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabec0ab790 0x7fabec153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabead9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabec0ab790 0x7fabec153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38782/0 (socket says 172.21.15.36:38782) 2022-01-10T01:31:19.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabead9d700 1 -- 172.21.15.36:0/37180678 learned_addr learned my addr 172.21.15.36:0/37180678 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:19.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabe1d9b700 1 --2- 172.21.15.36:0/37180678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabec066980 0x7fabec1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabea59c700 1 --2- 172.21.15.36:0/37180678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc004e70 0x7fabec065fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabead9d700 1 -- 172.21.15.36:0/37180678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabec066980 msgr2=0x7fabec1566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabead9d700 1 --2- 172.21.15.36:0/37180678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabec066980 0x7fabec1566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabead9d700 1 -- 172.21.15.36:0/37180678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc004e70 msgr2=0x7fabec065fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabead9d700 1 --2- 172.21.15.36:0/37180678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc004e70 0x7fabec065fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabead9d700 1 -- 172.21.15.36:0/37180678 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec064610 con 0x7fabec0ab790 2022-01-10T01:31:19.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabead9d700 1 --2- 172.21.15.36:0/37180678 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabec0ab790 0x7fabec153960 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7fabec061a80 tx=0x7fabe4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:19.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabe3fff700 1 -- 172.21.15.36:0/37180678 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabe4001620 con 0x7fabec0ab790 2022-01-10T01:31:19.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabe3fff700 1 -- 172.21.15.36:0/37180678 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe401d600 con 0x7fabec0ab790 2022-01-10T01:31:19.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 -- 172.21.15.36:0/37180678 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec0ac0d0 con 0x7fabec0ab790 2022-01-10T01:31:19.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabe3fff700 1 -- 172.21.15.36:0/37180678 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabe401d960 con 0x7fabec0ab790 2022-01-10T01:31:19.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.573+0000 7fabeb59e700 1 -- 172.21.15.36:0/37180678 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec0aab60 con 0x7fabec0ab790 2022-01-10T01:31:19.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.577+0000 7fabeb59e700 1 -- 172.21.15.36:0/37180678 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabec0ac260 con 0x7fabec0ab790 2022-01-10T01:31:19.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.577+0000 7fabe3fff700 1 -- 172.21.15.36:0/37180678 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fabe401b040 con 0x7fabec0ab790 2022-01-10T01:31:19.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.577+0000 7fabe3fff700 1 --2- 172.21.15.36:0/37180678 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fabd0053680 0x7fabd0055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.577+0000 7fabe3fff700 1 -- 172.21.15.36:0/37180678 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fabe406c4b0 con 0x7fabec0ab790 2022-01-10T01:31:19.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.577+0000 7fabea59c700 1 --2- 172.21.15.36:0/37180678 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fabd0053680 0x7fabd0055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.577+0000 7fabea59c700 1 --2- 172.21.15.36:0/37180678 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fabd0053680 0x7fabd0055b40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fabdc00b000 tx=0x7fabdc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:19.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.581+0000 7fabe3fff700 1 -- 172.21.15.36:0/37180678 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fabe40434c0 con 0x7fabec0ab790 2022-01-10T01:31:19.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.709+0000 7fabeb59e700 1 -- 172.21.15.36:0/37180678 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabec057350 con 0x7fabec0ab790 2022-01-10T01:31:19.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.713+0000 7fabe3fff700 1 -- 172.21.15.36:0/37180678 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16287 (secure 0 0 0) 0x7fabe4046ae0 con 0x7fabec0ab790 2022-01-10T01:31:19.717 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:19.717 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":88,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:31:19.137928+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:31:16.698671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2022-01-10T01:31:17.811890+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:31:19.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.713+0000 7fabeb59e700 1 -- 172.21.15.36:0/37180678 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fabd0053680 msgr2=0x7fabd0055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.713+0000 7fabeb59e700 1 --2- 172.21.15.36:0/37180678 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fabd0053680 0x7fabd0055b40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fabdc00b000 tx=0x7fabdc008040).stop 2022-01-10T01:31:19.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.713+0000 7fabeb59e700 1 -- 172.21.15.36:0/37180678 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabec0ab790 msgr2=0x7fabec153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.713+0000 7fabeb59e700 1 --2- 172.21.15.36:0/37180678 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabec0ab790 0x7fabec153960 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7fabec061a80 tx=0x7fabe4016000).stop 2022-01-10T01:31:19.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.713+0000 7fabeb59e700 1 -- 172.21.15.36:0/37180678 shutdown_connections 2022-01-10T01:31:19.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.713+0000 7fabeb59e700 1 --2- 172.21.15.36:0/37180678 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fabd0053680 0x7fabd0055b40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.713+0000 7fabeb59e700 1 --2- 172.21.15.36:0/37180678 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabec0ab790 0x7fabec153960 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.713+0000 7fabeb59e700 1 --2- 172.21.15.36:0/37180678 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabec066980 0x7fabec1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.713+0000 7fabeb59e700 1 --2- 172.21.15.36:0/37180678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabcc004e70 0x7fabec065fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.713+0000 7fabeb59e700 1 -- 172.21.15.36:0/37180678 >> 172.21.15.36:0/37180678 conn(0x7fabec060180 msgr2=0x7fabec0ad230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:19.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.713+0000 7fabeb59e700 1 -- 172.21.15.36:0/37180678 shutdown_connections 2022-01-10T01:31:19.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.713+0000 7fabeb59e700 1 -- 172.21.15.36:0/37180678 wait complete. 2022-01-10T01:31:19.730 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:31:19.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.841+0000 7fd76c711700 1 Processor -- start 2022-01-10T01:31:19.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.841+0000 7fd76c711700 1 -- start start 2022-01-10T01:31:19.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.841+0000 7fd76c711700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd7640b6580 0x7fd7640b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.841+0000 7fd76c711700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7640b43c0 0x7fd7640b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.841+0000 7fd76c711700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7641440b0 con 0x7fd764061d30 2022-01-10T01:31:19.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.841+0000 7fd76c711700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7640b6e50 con 0x7fd7640b6580 2022-01-10T01:31:19.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.841+0000 7fd76c711700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd764143b70 con 0x7fd7640b43c0 2022-01-10T01:31:19.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.841+0000 7fd76a4ad700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd7640b6580 0x7fd7640b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76acae700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd764061d30 0x7fd7641466c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36586/0 (socket says 172.21.15.36:36586) 2022-01-10T01:31:19.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76acae700 1 -- 172.21.15.36:0/1120594140 learned_addr learned my addr 172.21.15.36:0/1120594140 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:19.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd769cac700 1 --2- 172.21.15.36:0/1120594140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7640b43c0 0x7fd7640b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd7694ab700 1 -- 172.21.15.36:0/1120594140 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550664535 0 0) 0x7fd7641440b0 con 0x7fd764061d30 2022-01-10T01:31:19.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd7694ab700 1 -- 172.21.15.36:0/1120594140 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd74c003260 con 0x7fd764061d30 2022-01-10T01:31:19.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76a4ad700 1 -- 172.21.15.36:0/1120594140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7640b43c0 msgr2=0x7fd7640b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:19.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76a4ad700 1 --2- 172.21.15.36:0/1120594140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7640b43c0 0x7fd7640b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76a4ad700 1 -- 172.21.15.36:0/1120594140 >> v1:172.21.15.36:6789/0 conn(0x7fd764061d30 legacy=0x7fd7641466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76a4ad700 1 -- 172.21.15.36:0/1120594140 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd764143e10 con 0x7fd7640b6580 2022-01-10T01:31:19.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76a4ad700 1 --2- 172.21.15.36:0/1120594140 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7640b6580 0x7fd7640b5bf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7fd760002f70 tx=0x7fd760006df0).ready entity=mon.0 client_cookie=efd28fee12882cee server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:19.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd7694ab700 1 -- 172.21.15.36:0/1120594140 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd76000d4a0 con 0x7fd7640b6580 2022-01-10T01:31:19.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd7694ab700 1 -- 172.21.15.36:0/1120594140 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd760000e90 con 0x7fd7640b6580 2022-01-10T01:31:19.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd7694ab700 1 -- 172.21.15.36:0/1120594140 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd76000d7f0 con 0x7fd7640b6580 2022-01-10T01:31:19.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76c711700 1 -- 172.21.15.36:0/1120594140 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7640b6580 msgr2=0x7fd7640b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76c711700 1 --2- 172.21.15.36:0/1120594140 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7640b6580 0x7fd7640b5bf0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7fd760002f70 tx=0x7fd760006df0).stop 2022-01-10T01:31:19.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76c711700 1 -- 172.21.15.36:0/1120594140 shutdown_connections 2022-01-10T01:31:19.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76c711700 1 --2- 172.21.15.36:0/1120594140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7640b43c0 0x7fd7640b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76c711700 1 --2- 172.21.15.36:0/1120594140 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd7640b6580 0x7fd7640b5bf0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76c711700 1 -- 172.21.15.36:0/1120594140 >> 172.21.15.36:0/1120594140 conn(0x7fd76405c490 msgr2=0x7fd76405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:19.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76c711700 1 -- 172.21.15.36:0/1120594140 shutdown_connections 2022-01-10T01:31:19.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.845+0000 7fd76c711700 1 -- 172.21.15.36:0/1120594140 wait complete. 2022-01-10T01:31:19.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76c711700 1 Processor -- start 2022-01-10T01:31:19.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76c711700 1 -- start start 2022-01-10T01:31:19.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76c711700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd764061d30 0x7fd764128680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76c711700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7640b43c0 0x7fd7640b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76c711700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7640b6580 0x7fd7640b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76c711700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640aee30 con 0x7fd764061d30 2022-01-10T01:31:19.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76c711700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640af0d0 con 0x7fd7640b43c0 2022-01-10T01:31:19.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76c711700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640af370 con 0x7fd7640b6580 2022-01-10T01:31:19.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76a4ad700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd764061d30 0x7fd764128680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76a4ad700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd764061d30 0x7fd764128680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38796/0 (socket says 172.21.15.36:38796) 2022-01-10T01:31:19.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76a4ad700 1 -- 172.21.15.36:0/3063470385 learned_addr learned my addr 172.21.15.36:0/3063470385 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:19.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76acae700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7640b6580 0x7fd7640b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd769cac700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7640b43c0 0x7fd7640b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76a4ad700 1 -- 172.21.15.36:0/3063470385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7640b6580 msgr2=0x7fd7640b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76a4ad700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7640b6580 0x7fd7640b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76a4ad700 1 -- 172.21.15.36:0/3063470385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7640b43c0 msgr2=0x7fd7640b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:19.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76a4ad700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7640b43c0 0x7fd7640b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:19.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76a4ad700 1 -- 172.21.15.36:0/3063470385 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76000b180 con 0x7fd764061d30 2022-01-10T01:31:19.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76acae700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7640b6580 0x7fd7640b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:19.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76a4ad700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd764061d30 0x7fd764128680 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7fd760002f70 tx=0x7fd760014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:19.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd7577fe700 1 -- 172.21.15.36:0/3063470385 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd760013ac0 con 0x7fd764061d30 2022-01-10T01:31:19.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd7577fe700 1 -- 172.21.15.36:0/3063470385 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd760013c20 con 0x7fd764061d30 2022-01-10T01:31:19.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76c711700 1 -- 172.21.15.36:0/3063470385 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7640b21b0 con 0x7fd764061d30 2022-01-10T01:31:19.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd7577fe700 1 -- 172.21.15.36:0/3063470385 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd76001e400 con 0x7fd764061d30 2022-01-10T01:31:19.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.849+0000 7fd76c711700 1 -- 172.21.15.36:0/3063470385 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7640af7b0 con 0x7fd764061d30 2022-01-10T01:31:19.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.853+0000 7fd7577fe700 1 -- 172.21.15.36:0/3063470385 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd76001c070 con 0x7fd764061d30 2022-01-10T01:31:19.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.853+0000 7fd76c711700 1 -- 172.21.15.36:0/3063470385 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7640af530 con 0x7fd764061d30 2022-01-10T01:31:19.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.853+0000 7fd7577fe700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd744053620 0x7fd744055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:19.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.853+0000 7fd7577fe700 1 -- 172.21.15.36:0/3063470385 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd76006c630 con 0x7fd764061d30 2022-01-10T01:31:19.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.853+0000 7fd769cac700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd744053620 0x7fd744055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:19.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.853+0000 7fd769cac700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd744053620 0x7fd744055ae0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fd75800b000 tx=0x7fd758006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:19.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:19.857+0000 7fd7577fe700 1 -- 172.21.15.36:0/3063470385 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd7600434b0 con 0x7fd764061d30 2022-01-10T01:31:20.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.029+0000 7fd76c711700 1 -- 172.21.15.36:0/3063470385 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fd7640615f0 con 0x7fd764061d30 2022-01-10T01:31:20.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.033+0000 7fd7577fe700 1 -- 172.21.15.36:0/3063470385 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7fd760023020 con 0x7fd764061d30 2022-01-10T01:31:20.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.037+0000 7fd76c711700 1 -- 172.21.15.36:0/3063470385 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd744053620 msgr2=0x7fd744055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:20.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.037+0000 7fd76c711700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd744053620 0x7fd744055ae0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fd75800b000 tx=0x7fd758006df0).stop 2022-01-10T01:31:20.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.037+0000 7fd76c711700 1 -- 172.21.15.36:0/3063470385 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd764061d30 msgr2=0x7fd764128680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:20.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.037+0000 7fd76c711700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd764061d30 0x7fd764128680 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7fd760002f70 tx=0x7fd760014000).stop 2022-01-10T01:31:20.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.037+0000 7fd76c711700 1 -- 172.21.15.36:0/3063470385 shutdown_connections 2022-01-10T01:31:20.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.037+0000 7fd76c711700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd744053620 0x7fd744055ae0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.037+0000 7fd76c711700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd7640b6580 0x7fd7640b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.037+0000 7fd76c711700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7640b43c0 0x7fd7640b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.037+0000 7fd76c711700 1 --2- 172.21.15.36:0/3063470385 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd764061d30 0x7fd764128680 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.037+0000 7fd76c711700 1 -- 172.21.15.36:0/3063470385 >> 172.21.15.36:0/3063470385 conn(0x7fd76405c490 msgr2=0x7fd764145110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:20.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.037+0000 7fd76c711700 1 -- 172.21.15.36:0/3063470385 shutdown_connections 2022-01-10T01:31:20.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.037+0000 7fd76c711700 1 -- 172.21.15.36:0/3063470385 wait complete. 2022-01-10T01:31:20.049 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.0 2022-01-10T01:31:20.059 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:31:20.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.169+0000 7f02a7327700 1 Processor -- start 2022-01-10T01:31:20.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.169+0000 7f02a7327700 1 -- start start 2022-01-10T01:31:20.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a7327700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02a0061320 0x7f02a0061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:20.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a7327700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f02a00ad5c0 0x7f02a00b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:20.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a7327700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a00aecf0 con 0x7f02a0140440 2022-01-10T01:31:20.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a7327700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a00b6f20 con 0x7f02a00ad5c0 2022-01-10T01:31:20.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a7327700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a00aef20 con 0x7f02a0061320 2022-01-10T01:31:20.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a5b24700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f02a00ad5c0 0x7f02a00b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:20.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a5b24700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f02a00ad5c0 0x7f02a00b9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38808/0 (socket says 172.21.15.36:38808) 2022-01-10T01:31:20.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a5b24700 1 -- 172.21.15.36:0/333962419 learned_addr learned my addr 172.21.15.36:0/333962419 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:20.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a6325700 1 --2- 172.21.15.36:0/333962419 >> v2:172.21.15.59:3300/0 conn(0x7f02a0061320 0x7f02a0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:20.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a5b24700 1 -- 172.21.15.36:0/333962419 >> v2:172.21.15.59:3300/0 conn(0x7f02a0061320 msgr2=0x7f02a0061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:20.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a5b24700 1 --2- 172.21.15.36:0/333962419 >> v2:172.21.15.59:3300/0 conn(0x7f02a0061320 0x7f02a0061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a5b24700 1 -- 172.21.15.36:0/333962419 >> v1:172.21.15.59:6789/0 conn(0x7f02a0140440 legacy=0x7f02a0146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:20.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a5b24700 1 -- 172.21.15.36:0/333962419 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a00af1c0 con 0x7f02a00ad5c0 2022-01-10T01:31:20.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a6325700 1 --2- 172.21.15.36:0/333962419 >> v2:172.21.15.59:3300/0 conn(0x7f02a0061320 0x7f02a0061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:20.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a5b24700 1 --2- 172.21.15.36:0/333962419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02a00ad5c0 0x7f02a00b9e60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f02a00aeba0 tx=0x7f0294006eb0).ready entity=mon.0 client_cookie=556c80bbb73ec891 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:20.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a5323700 1 -- 172.21.15.36:0/333962419 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029400d610 con 0x7f02a00ad5c0 2022-01-10T01:31:20.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a5323700 1 -- 172.21.15.36:0/333962419 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0294000e90 con 0x7f02a00ad5c0 2022-01-10T01:31:20.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a5323700 1 -- 172.21.15.36:0/333962419 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029400d960 con 0x7f02a00ad5c0 2022-01-10T01:31:20.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a7327700 1 -- 172.21.15.36:0/333962419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02a00ad5c0 msgr2=0x7f02a00b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:20.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a7327700 1 --2- 172.21.15.36:0/333962419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02a00ad5c0 0x7f02a00b9e60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f02a00aeba0 tx=0x7f0294006eb0).stop 2022-01-10T01:31:20.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a7327700 1 -- 172.21.15.36:0/333962419 shutdown_connections 2022-01-10T01:31:20.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a7327700 1 --2- 172.21.15.36:0/333962419 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02a00ad5c0 0x7f02a00b9e60 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a7327700 1 --2- 172.21.15.36:0/333962419 >> v2:172.21.15.59:3300/0 conn(0x7f02a0061320 0x7f02a0061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a7327700 1 -- 172.21.15.36:0/333962419 >> 172.21.15.36:0/333962419 conn(0x7f02a0066de0 msgr2=0x7f02a00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:20.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a7327700 1 -- 172.21.15.36:0/333962419 shutdown_connections 2022-01-10T01:31:20.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.173+0000 7f02a7327700 1 -- 172.21.15.36:0/333962419 wait complete. 2022-01-10T01:31:20.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.177+0000 7f02a7327700 1 Processor -- start 2022-01-10T01:31:20.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.177+0000 7f02a7327700 1 -- start start 2022-01-10T01:31:20.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a7327700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02a0061320 0x7f02a013fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:20.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a7327700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02a00ad5c0 0x7f02a01524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:20.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a7327700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02a0140440 0x7f02a01529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:20.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a7327700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0155ab0 con 0x7f02a00ad5c0 2022-01-10T01:31:20.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a7327700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0155d50 con 0x7f02a0140440 2022-01-10T01:31:20.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a7327700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0155ff0 con 0x7f02a0061320 2022-01-10T01:31:20.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a5b24700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02a00ad5c0 0x7f02a01524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:20.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a5b24700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02a00ad5c0 0x7f02a01524e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38812/0 (socket says 172.21.15.36:38812) 2022-01-10T01:31:20.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a5b24700 1 -- 172.21.15.36:0/1499624439 learned_addr learned my addr 172.21.15.36:0/1499624439 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:20.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a6325700 1 --2- 172.21.15.36:0/1499624439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02a0061320 0x7f02a013fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:20.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a6b26700 1 --2- 172.21.15.36:0/1499624439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02a0140440 0x7f02a01529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:20.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a5b24700 1 -- 172.21.15.36:0/1499624439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02a0061320 msgr2=0x7f02a013fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:20.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a5b24700 1 --2- 172.21.15.36:0/1499624439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02a0061320 0x7f02a013fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a5b24700 1 -- 172.21.15.36:0/1499624439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02a0140440 msgr2=0x7f02a01529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:20.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a5b24700 1 --2- 172.21.15.36:0/1499624439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02a0140440 0x7f02a01529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a5b24700 1 -- 172.21.15.36:0/1499624439 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029400b1e0 con 0x7f02a00ad5c0 2022-01-10T01:31:20.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a5b24700 1 --2- 172.21.15.36:0/1499624439 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02a00ad5c0 0x7f02a01524e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f02a00aeba0 tx=0x7f0294015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:20.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02937fe700 1 -- 172.21.15.36:0/1499624439 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029400d290 con 0x7f02a00ad5c0 2022-01-10T01:31:20.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02937fe700 1 -- 172.21.15.36:0/1499624439 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0294002f50 con 0x7f02a00ad5c0 2022-01-10T01:31:20.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a7327700 1 -- 172.21.15.36:0/1499624439 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a0156290 con 0x7f02a00ad5c0 2022-01-10T01:31:20.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02937fe700 1 -- 172.21.15.36:0/1499624439 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0294011b80 con 0x7f02a00ad5c0 2022-01-10T01:31:20.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.181+0000 7f02a7327700 1 -- 172.21.15.36:0/1499624439 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a0143790 con 0x7f02a00ad5c0 2022-01-10T01:31:20.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.185+0000 7f02a7327700 1 -- 172.21.15.36:0/1499624439 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a0156420 con 0x7f02a00ad5c0 2022-01-10T01:31:20.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.185+0000 7f02937fe700 1 -- 172.21.15.36:0/1499624439 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0294025030 con 0x7f02a00ad5c0 2022-01-10T01:31:20.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.185+0000 7f02937fe700 1 --2- 172.21.15.36:0/1499624439 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0280053560 0x7f0280055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:20.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.185+0000 7f02937fe700 1 -- 172.21.15.36:0/1499624439 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f029406cb80 con 0x7f02a00ad5c0 2022-01-10T01:31:20.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.185+0000 7f02a6325700 1 --2- 172.21.15.36:0/1499624439 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0280053560 0x7f0280055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:20.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.185+0000 7f02a6325700 1 --2- 172.21.15.36:0/1499624439 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0280053560 0x7f0280055a20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f029c00c000 tx=0x7f029c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:20.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.193+0000 7f02937fe700 1 -- 172.21.15.36:0/1499624439 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0294043b90 con 0x7f02a00ad5c0 2022-01-10T01:31:20.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.365+0000 7f02a7327700 1 -- 172.21.15.36:0/1499624439 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f02a00af460 con 0x7f02a00ad5c0 2022-01-10T01:31:20.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.373+0000 7f02937fe700 1 -- 172.21.15.36:0/1499624439 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0294023020 con 0x7f02a00ad5c0 2022-01-10T01:31:20.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.377+0000 7f02a7327700 1 -- 172.21.15.36:0/1499624439 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0280053560 msgr2=0x7f0280055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:20.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.377+0000 7f02a7327700 1 --2- 172.21.15.36:0/1499624439 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0280053560 0x7f0280055a20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f029c00c000 tx=0x7f029c008040).stop 2022-01-10T01:31:20.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.377+0000 7f02a7327700 1 -- 172.21.15.36:0/1499624439 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02a00ad5c0 msgr2=0x7f02a01524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:20.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.377+0000 7f02a7327700 1 --2- 172.21.15.36:0/1499624439 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02a00ad5c0 0x7f02a01524e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f02a00aeba0 tx=0x7f0294015000).stop 2022-01-10T01:31:20.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.377+0000 7f02a7327700 1 -- 172.21.15.36:0/1499624439 shutdown_connections 2022-01-10T01:31:20.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.377+0000 7f02a7327700 1 --2- 172.21.15.36:0/1499624439 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0280053560 0x7f0280055a20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.377+0000 7f02a7327700 1 --2- 172.21.15.36:0/1499624439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02a0140440 0x7f02a01529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.377+0000 7f02a7327700 1 --2- 172.21.15.36:0/1499624439 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02a00ad5c0 0x7f02a01524e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.377+0000 7f02a7327700 1 --2- 172.21.15.36:0/1499624439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02a0061320 0x7f02a013fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.377+0000 7f02a7327700 1 -- 172.21.15.36:0/1499624439 >> 172.21.15.36:0/1499624439 conn(0x7f02a0066de0 msgr2=0x7f02a00b7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:20.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.377+0000 7f02a7327700 1 -- 172.21.15.36:0/1499624439 shutdown_connections 2022-01-10T01:31:20.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.377+0000 7f02a7327700 1 -- 172.21.15.36:0/1499624439 wait complete. 2022-01-10T01:31:20.384 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.1 2022-01-10T01:31:20.393 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:20.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.489+0000 7f072e4d5700 1 Processor -- start 2022-01-10T01:31:20.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.489+0000 7f072e4d5700 1 -- start start 2022-01-10T01:31:20.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f072e4d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0728066e50 0x7f07280af840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:20.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f072e4d5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f07280affd0 0x7f07280ae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:20.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f072e4d5700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07280acf10 con 0x7f07280aea10 2022-01-10T01:31:20.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f072e4d5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07280ad1b0 con 0x7f07280affd0 2022-01-10T01:31:20.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f072e4d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07280af3a0 con 0x7f0728066e50 2022-01-10T01:31:20.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f072ca72700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f07280aea10 0x7f0728146a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36614/0 (socket says 172.21.15.36:36614) 2022-01-10T01:31:20.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f072ca72700 1 -- 172.21.15.36:0/794083646 learned_addr learned my addr 172.21.15.36:0/794083646 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:20.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f0727fff700 1 --2- 172.21.15.36:0/794083646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0728066e50 0x7f07280af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:20.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f07277fe700 1 --2- 172.21.15.36:0/794083646 >> v2:172.21.15.59:3300/0 conn(0x7f07280affd0 0x7f07280ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:20.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f0726ffd700 1 -- 172.21.15.36:0/794083646 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554703854 0 0) 0x7f07280acf10 con 0x7f07280aea10 2022-01-10T01:31:20.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f0727fff700 1 -- 172.21.15.36:0/794083646 >> v2:172.21.15.59:3300/0 conn(0x7f07280affd0 msgr2=0x7f07280ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:20.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f0727fff700 1 --2- 172.21.15.36:0/794083646 >> v2:172.21.15.59:3300/0 conn(0x7f07280affd0 0x7f07280ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f0727fff700 1 -- 172.21.15.36:0/794083646 >> v1:172.21.15.36:6789/0 conn(0x7f07280aea10 legacy=0x7f0728146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:20.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f0727fff700 1 -- 172.21.15.36:0/794083646 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07280acb90 con 0x7f0728066e50 2022-01-10T01:31:20.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f07277fe700 1 --2- 172.21.15.36:0/794083646 >> v2:172.21.15.59:3300/0 conn(0x7f07280affd0 0x7f07280ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:20.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f0727fff700 1 --2- 172.21.15.36:0/794083646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0728066e50 0x7f07280af840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f07200032f0 tx=0x7f07200091d0).ready entity=mon.2 client_cookie=31ee6da0f105ca0e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:20.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f0726ffd700 1 -- 172.21.15.36:0/794083646 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072000b6c0 con 0x7f0728066e50 2022-01-10T01:31:20.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f0726ffd700 1 -- 172.21.15.36:0/794083646 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072000b820 con 0x7f0728066e50 2022-01-10T01:31:20.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f0726ffd700 1 -- 172.21.15.36:0/794083646 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072000b990 con 0x7f0728066e50 2022-01-10T01:31:20.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.493+0000 7f072e4d5700 1 -- 172.21.15.36:0/794083646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0728066e50 msgr2=0x7f07280af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:20.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.497+0000 7f072e4d5700 1 --2- 172.21.15.36:0/794083646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0728066e50 0x7f07280af840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f07200032f0 tx=0x7f07200091d0).stop 2022-01-10T01:31:20.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.497+0000 7f072e4d5700 1 -- 172.21.15.36:0/794083646 shutdown_connections 2022-01-10T01:31:20.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.497+0000 7f072e4d5700 1 --2- 172.21.15.36:0/794083646 >> v2:172.21.15.59:3300/0 conn(0x7f07280affd0 0x7f07280ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.497+0000 7f072e4d5700 1 --2- 172.21.15.36:0/794083646 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0728066e50 0x7f07280af840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.497+0000 7f072e4d5700 1 -- 172.21.15.36:0/794083646 >> 172.21.15.36:0/794083646 conn(0x7f07280608d0 msgr2=0x7f0728060ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:20.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.497+0000 7f072e4d5700 1 -- 172.21.15.36:0/794083646 shutdown_connections 2022-01-10T01:31:20.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.497+0000 7f072e4d5700 1 -- 172.21.15.36:0/794083646 wait complete. 2022-01-10T01:31:20.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.497+0000 7f072e4d5700 1 Processor -- start 2022-01-10T01:31:20.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.497+0000 7f072e4d5700 1 -- start start 2022-01-10T01:31:20.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f072e4d5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0728066e50 0x7f07280b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:20.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f072e4d5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07280aea10 0x7f0728156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:20.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f072e4d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07280affd0 0x7f0728157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:20.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f072e4d5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07281578f0 con 0x7f0728066e50 2022-01-10T01:31:20.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f072e4d5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0728064910 con 0x7f07280aea10 2022-01-10T01:31:20.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f072e4d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0728064bb0 con 0x7f07280affd0 2022-01-10T01:31:20.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f0727fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0728066e50 0x7f07280b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:20.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f0727fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0728066e50 0x7f07280b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38824/0 (socket says 172.21.15.36:38824) 2022-01-10T01:31:20.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f0727fff700 1 -- 172.21.15.36:0/618622323 learned_addr learned my addr 172.21.15.36:0/618622323 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:20.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f07277fe700 1 --2- 172.21.15.36:0/618622323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07280aea10 0x7f0728156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:20.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f072ca72700 1 --2- 172.21.15.36:0/618622323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07280affd0 0x7f0728157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:20.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f0727fff700 1 -- 172.21.15.36:0/618622323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07280affd0 msgr2=0x7f0728157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:20.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f0727fff700 1 --2- 172.21.15.36:0/618622323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07280affd0 0x7f0728157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f0727fff700 1 -- 172.21.15.36:0/618622323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07280aea10 msgr2=0x7f0728156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:20.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f0727fff700 1 --2- 172.21.15.36:0/618622323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07280aea10 0x7f0728156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f0727fff700 1 -- 172.21.15.36:0/618622323 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071800b180 con 0x7f0728066e50 2022-01-10T01:31:20.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f0727fff700 1 --2- 172.21.15.36:0/618622323 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0728066e50 0x7f07280b48b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f07200032f0 tx=0x7f0720016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:20.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f07257fa700 1 -- 172.21.15.36:0/618622323 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072000b990 con 0x7f0728066e50 2022-01-10T01:31:20.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f072e4d5700 1 -- 172.21.15.36:0/618622323 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0720009470 con 0x7f0728066e50 2022-01-10T01:31:20.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f07257fa700 1 -- 172.21.15.36:0/618622323 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0720021630 con 0x7f0728066e50 2022-01-10T01:31:20.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f072e4d5700 1 -- 172.21.15.36:0/618622323 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0728156a00 con 0x7f0728066e50 2022-01-10T01:31:20.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f07257fa700 1 -- 172.21.15.36:0/618622323 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f072000b6c0 con 0x7f0728066e50 2022-01-10T01:31:20.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f072e4d5700 1 -- 172.21.15.36:0/618622323 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0728057350 con 0x7f0728066e50 2022-01-10T01:31:20.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f07257fa700 1 -- 172.21.15.36:0/618622323 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0720027020 con 0x7f0728066e50 2022-01-10T01:31:20.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f07257fa700 1 --2- 172.21.15.36:0/618622323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07080536b0 0x7f0708055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:20.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f07257fa700 1 -- 172.21.15.36:0/618622323 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f072006ce70 con 0x7f0728066e50 2022-01-10T01:31:20.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.501+0000 7f07277fe700 1 --2- 172.21.15.36:0/618622323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07080536b0 0x7f0708055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:20.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.505+0000 7f07277fe700 1 --2- 172.21.15.36:0/618622323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07080536b0 0x7f0708055b70 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f071800b000 tx=0x7f0718006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:20.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.509+0000 7f07257fa700 1 -- 172.21.15.36:0/618622323 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0720043de0 con 0x7f0728066e50 2022-01-10T01:31:20.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.669+0000 7f072e4d5700 1 -- 172.21.15.36:0/618622323 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07280b0e90 con 0x7f0728066e50 2022-01-10T01:31:20.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.673+0000 7f07257fa700 1 -- 172.21.15.36:0/618622323 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f0720015020 con 0x7f0728066e50 2022-01-10T01:31:20.677 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:20.677 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":40,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3902337896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3902337896},{"type":"v1","addr":"172.21.15.36:6835","nonce":3902337896}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6612,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6837/3131314479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":3131314479},{"type":"v1","addr":"172.21.15.36:6837","nonce":3131314479}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:31:18.134652+0000","modified":"2022-01-10T01:31:19.137223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6616":{"gid":6616,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3399412771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3399412771},{"type":"v1","addr":"172.21.15.59:6833","nonce":3399412771}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2022-01-10T01:31:20.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.673+0000 7f072e4d5700 1 -- 172.21.15.36:0/618622323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07080536b0 msgr2=0x7f0708055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:20.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.673+0000 7f072e4d5700 1 --2- 172.21.15.36:0/618622323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07080536b0 0x7f0708055b70 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f071800b000 tx=0x7f0718006df0).stop 2022-01-10T01:31:20.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.673+0000 7f072e4d5700 1 -- 172.21.15.36:0/618622323 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0728066e50 msgr2=0x7f07280b48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:20.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.673+0000 7f072e4d5700 1 --2- 172.21.15.36:0/618622323 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0728066e50 0x7f07280b48b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f07200032f0 tx=0x7f0720016000).stop 2022-01-10T01:31:20.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.673+0000 7f072e4d5700 1 -- 172.21.15.36:0/618622323 shutdown_connections 2022-01-10T01:31:20.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.673+0000 7f072e4d5700 1 --2- 172.21.15.36:0/618622323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07080536b0 0x7f0708055b70 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.673+0000 7f072e4d5700 1 --2- 172.21.15.36:0/618622323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07280affd0 0x7f0728157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.673+0000 7f072e4d5700 1 --2- 172.21.15.36:0/618622323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07280aea10 0x7f0728156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.673+0000 7f072e4d5700 1 --2- 172.21.15.36:0/618622323 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0728066e50 0x7f07280b48b0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:20.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.673+0000 7f072e4d5700 1 -- 172.21.15.36:0/618622323 >> 172.21.15.36:0/618622323 conn(0x7f07280608d0 msgr2=0x7f0728060cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:20.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.673+0000 7f072e4d5700 1 -- 172.21.15.36:0/618622323 shutdown_connections 2022-01-10T01:31:20.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:20.673+0000 7f072e4d5700 1 -- 172.21.15.36:0/618622323 wait complete. 2022-01-10T01:31:20.683 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 40 2022-01-10T01:31:20.998 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:31:18.134652+0000', 'modified': '2022-01-10T01:31:19.137223+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6616}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6616': {'gid': 6616, 'name': 'b', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/3399412771', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 3399412771}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 3399412771}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:31:20.999 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:31:20.999 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:31:21.121 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":6616,"want_state":"up:active","state":"up:active","rank_uptime":2.972863909,"mdsmap_epoch":40,"osdmap_epoch":89,"osdmap_epoch_barrier":87,"uptime":7.2683421170000004} 2022-01-10T01:31:21.121 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 6616, "mdsmap_epoch": 40, "osdmap_epoch": 89, "osdmap_epoch_barrier": 87, "rank_uptime": 2.972863909, "state": "up:active", "uptime": 7.268342117, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:31:21.122 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:31:21.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.229+0000 7f04f908e700 1 Processor -- start 2022-01-10T01:31:21.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.229+0000 7f04f908e700 1 -- start start 2022-01-10T01:31:21.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f908e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f40601a0 0x7f04f40b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f908e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04f405c560 0x7f04f40a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f908e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f40aa4a0 con 0x7f04f40af3c0 2022-01-10T01:31:21.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f908e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f40b1450 con 0x7f04f405c560 2022-01-10T01:31:21.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f908e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f40af7a0 con 0x7f04f40601a0 2022-01-10T01:31:21.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f3fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f04f40af3c0 0x7f04f4144450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36626/0 (socket says 172.21.15.36:36626) 2022-01-10T01:31:21.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f3fff700 1 -- 172.21.15.36:0/4158208959 learned_addr learned my addr 172.21.15.36:0/4158208959 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:21.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04ebfff700 1 --2- 172.21.15.36:0/4158208959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f40601a0 0x7f04f40b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f888d700 1 --2- 172.21.15.36:0/4158208959 >> v2:172.21.15.59:3300/0 conn(0x7f04f405c560 0x7f04f40a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f37fe700 1 -- 172.21.15.36:0/4158208959 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110976612 0 0) 0x7f04f40aa4a0 con 0x7f04f40af3c0 2022-01-10T01:31:21.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f37fe700 1 -- 172.21.15.36:0/4158208959 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04d4003260 con 0x7f04f40af3c0 2022-01-10T01:31:21.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f888d700 1 -- 172.21.15.36:0/4158208959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f40601a0 msgr2=0x7f04f40b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:21.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f888d700 1 --2- 172.21.15.36:0/4158208959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f40601a0 0x7f04f40b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f888d700 1 -- 172.21.15.36:0/4158208959 >> v1:172.21.15.36:6789/0 conn(0x7f04f40af3c0 legacy=0x7f04f4144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f888d700 1 -- 172.21.15.36:0/4158208959 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f405fb80 con 0x7f04f405c560 2022-01-10T01:31:21.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f888d700 1 --2- 172.21.15.36:0/4158208959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f405c560 0x7f04f40a8bf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f04ec0032f0 tx=0x7f04ec0091d0).ready entity=mon.1 client_cookie=61ce45e953681ceb server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:21.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f37fe700 1 -- 172.21.15.36:0/4158208959 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04ec00b600 con 0x7f04f405c560 2022-01-10T01:31:21.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f37fe700 1 -- 172.21.15.36:0/4158208959 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04ec00b760 con 0x7f04f405c560 2022-01-10T01:31:21.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.233+0000 7f04f37fe700 1 -- 172.21.15.36:0/4158208959 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04ec00b8d0 con 0x7f04f405c560 2022-01-10T01:31:21.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.237+0000 7f04f908e700 1 -- 172.21.15.36:0/4158208959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f405c560 msgr2=0x7f04f40a8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.237+0000 7f04f908e700 1 --2- 172.21.15.36:0/4158208959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f405c560 0x7f04f40a8bf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f04ec0032f0 tx=0x7f04ec0091d0).stop 2022-01-10T01:31:21.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.237+0000 7f04f908e700 1 -- 172.21.15.36:0/4158208959 shutdown_connections 2022-01-10T01:31:21.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.237+0000 7f04f908e700 1 --2- 172.21.15.36:0/4158208959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f405c560 0x7f04f40a8bf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.237+0000 7f04f908e700 1 --2- 172.21.15.36:0/4158208959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f40601a0 0x7f04f40b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.237+0000 7f04f908e700 1 -- 172.21.15.36:0/4158208959 >> 172.21.15.36:0/4158208959 conn(0x7f04f4061140 msgr2=0x7f04f4062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:21.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.237+0000 7f04f908e700 1 -- 172.21.15.36:0/4158208959 shutdown_connections 2022-01-10T01:31:21.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.237+0000 7f04f908e700 1 -- 172.21.15.36:0/4158208959 wait complete. 2022-01-10T01:31:21.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.237+0000 7f04f908e700 1 Processor -- start 2022-01-10T01:31:21.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.237+0000 7f04f908e700 1 -- start start 2022-01-10T01:31:21.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f908e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f405c560 0x7f04f4147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f908e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f40601a0 0x7f04f4064eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f908e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04f40af3c0 0x7f04f40653a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f908e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f4065890 con 0x7f04f40af3c0 2022-01-10T01:31:21.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f908e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f4144480 con 0x7f04f40601a0 2022-01-10T01:31:21.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f908e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f4144720 con 0x7f04f405c560 2022-01-10T01:31:21.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f888d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04f40af3c0 0x7f04f40653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f888d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04f40af3c0 0x7f04f40653a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38842/0 (socket says 172.21.15.36:38842) 2022-01-10T01:31:21.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f888d700 1 -- 172.21.15.36:0/326857429 learned_addr learned my addr 172.21.15.36:0/326857429 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:21.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04ebfff700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f40601a0 0x7f04f4064eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f3fff700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f405c560 0x7f04f4147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04ebfff700 1 -- 172.21.15.36:0/326857429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f405c560 msgr2=0x7f04f4147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04ebfff700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f405c560 0x7f04f4147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04ebfff700 1 -- 172.21.15.36:0/326857429 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04f40af3c0 msgr2=0x7f04f40653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04ebfff700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04f40af3c0 0x7f04f40653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04ebfff700 1 -- 172.21.15.36:0/326857429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ec009470 con 0x7f04f40601a0 2022-01-10T01:31:21.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f888d700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04f40af3c0 0x7f04f40653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:21.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04ebfff700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f40601a0 0x7f04f4064eb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f04dc00c000 tx=0x7f04dc006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:21.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f1ffb700 1 -- 172.21.15.36:0/326857429 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04dc010780 con 0x7f04f40601a0 2022-01-10T01:31:21.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f1ffb700 1 -- 172.21.15.36:0/326857429 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04dc0108e0 con 0x7f04f40601a0 2022-01-10T01:31:21.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f908e700 1 -- 172.21.15.36:0/326857429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f405f6b0 con 0x7f04f40601a0 2022-01-10T01:31:21.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f1ffb700 1 -- 172.21.15.36:0/326857429 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04dc010c40 con 0x7f04f40601a0 2022-01-10T01:31:21.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.241+0000 7f04f908e700 1 -- 172.21.15.36:0/326857429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f4144c60 con 0x7f04f40601a0 2022-01-10T01:31:21.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.245+0000 7f04f908e700 1 -- 172.21.15.36:0/326857429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f4144e20 con 0x7f04f40601a0 2022-01-10T01:31:21.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.245+0000 7f04f1ffb700 1 -- 172.21.15.36:0/326857429 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f04dc01c460 con 0x7f04f40601a0 2022-01-10T01:31:21.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.245+0000 7f04f1ffb700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04d8053680 0x7f04d8055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.245+0000 7f04f1ffb700 1 -- 172.21.15.36:0/326857429 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f04dc06bcf0 con 0x7f04f40601a0 2022-01-10T01:31:21.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.245+0000 7f04f3fff700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04d8053680 0x7f04d8055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.245+0000 7f04f3fff700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04d8053680 0x7f04d8055b40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f04e400d000 tx=0x7f04e4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:21.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.257+0000 7f04f1ffb700 1 -- 172.21.15.36:0/326857429 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f04dc042ca0 con 0x7f04f40601a0 2022-01-10T01:31:21.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.389+0000 7f04f908e700 1 -- 172.21.15.36:0/326857429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04f405f8e0 con 0x7f04f40601a0 2022-01-10T01:31:21.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.393+0000 7f04f1ffb700 1 -- 172.21.15.36:0/326857429 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f04dc0462c0 con 0x7f04f40601a0 2022-01-10T01:31:21.397 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:21.397 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":89,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:31:20.489200+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:31:16.698671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2022-01-10T01:31:17.811890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:31:21.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.397+0000 7f04f908e700 1 -- 172.21.15.36:0/326857429 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04d8053680 msgr2=0x7f04d8055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.397+0000 7f04f908e700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04d8053680 0x7f04d8055b40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f04e400d000 tx=0x7f04e4009040).stop 2022-01-10T01:31:21.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.397+0000 7f04f908e700 1 -- 172.21.15.36:0/326857429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f40601a0 msgr2=0x7f04f4064eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.397+0000 7f04f908e700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f40601a0 0x7f04f4064eb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f04dc00c000 tx=0x7f04dc006df0).stop 2022-01-10T01:31:21.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.397+0000 7f04f908e700 1 -- 172.21.15.36:0/326857429 shutdown_connections 2022-01-10T01:31:21.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.397+0000 7f04f908e700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04d8053680 0x7f04d8055b40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.397+0000 7f04f908e700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04f40af3c0 0x7f04f40653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.397+0000 7f04f908e700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04f40601a0 0x7f04f4064eb0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.397+0000 7f04f908e700 1 --2- 172.21.15.36:0/326857429 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04f405c560 0x7f04f4147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.397+0000 7f04f908e700 1 -- 172.21.15.36:0/326857429 >> 172.21.15.36:0/326857429 conn(0x7f04f4061140 msgr2=0x7f04f40abee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:21.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.397+0000 7f04f908e700 1 -- 172.21.15.36:0/326857429 shutdown_connections 2022-01-10T01:31:21.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.397+0000 7f04f908e700 1 -- 172.21.15.36:0/326857429 wait complete. 2022-01-10T01:31:21.415 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:31:16.698671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:31:17.811890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:31:21.416 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:31:21.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d96d7700 1 Processor -- start 2022-01-10T01:31:21.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d96d7700 1 -- start start 2022-01-10T01:31:21.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d96d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d4061320 0x7fb2d4061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d96d7700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb2d40ad5c0 0x7fb2d40b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d96d7700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d40aecf0 con 0x7fb2d4140440 2022-01-10T01:31:21.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d96d7700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d40b6f20 con 0x7fb2d40ad5c0 2022-01-10T01:31:21.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d96d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40aef20 con 0x7fb2d4061320 2022-01-10T01:31:21.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d37fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb2d40ad5c0 0x7fb2d40b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d8ed6700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fb2d4140440 0x7fb2d4146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36644/0 (socket says 172.21.15.36:36644) 2022-01-10T01:31:21.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d8ed6700 1 -- 172.21.15.36:0/2790445541 learned_addr learned my addr 172.21.15.36:0/2790445541 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:21.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d3fff700 1 --2- 172.21.15.36:0/2790445541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d4061320 0x7fb2d4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d2ffd700 1 -- 172.21.15.36:0/2790445541 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962179487 0 0) 0x7fb2d40aecf0 con 0x7fb2d4140440 2022-01-10T01:31:21.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d2ffd700 1 -- 172.21.15.36:0/2790445541 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c0003260 con 0x7fb2d4140440 2022-01-10T01:31:21.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d37fe700 1 -- 172.21.15.36:0/2790445541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d4061320 msgr2=0x7fb2d4061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:21.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d37fe700 1 --2- 172.21.15.36:0/2790445541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d4061320 0x7fb2d4061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d2ffd700 1 -- 172.21.15.36:0/2790445541 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 186578074 0 0) 0x7fb2c0003260 con 0x7fb2d4140440 2022-01-10T01:31:21.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d37fe700 1 -- 172.21.15.36:0/2790445541 >> v1:172.21.15.36:6789/0 conn(0x7fb2d4140440 legacy=0x7fb2d4146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.521+0000 7fb2d37fe700 1 -- 172.21.15.36:0/2790445541 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d40af1c0 con 0x7fb2d40ad5c0 2022-01-10T01:31:21.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.525+0000 7fb2d37fe700 1 --2- 172.21.15.36:0/2790445541 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40ad5c0 0x7fb2d40b9e60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7fb2cc001b80 tx=0x7fb2c4006df0).ready entity=mon.0 client_cookie=264321afe9a5776c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:21.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.525+0000 7fb2d2ffd700 1 -- 172.21.15.36:0/2790445541 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2cc0019e0 con 0x7fb2d40ad5c0 2022-01-10T01:31:21.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.525+0000 7fb2d2ffd700 1 -- 172.21.15.36:0/2790445541 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c4000e90 con 0x7fb2d40ad5c0 2022-01-10T01:31:21.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.525+0000 7fb2d2ffd700 1 -- 172.21.15.36:0/2790445541 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c4012460 con 0x7fb2d40ad5c0 2022-01-10T01:31:21.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.525+0000 7fb2d96d7700 1 -- 172.21.15.36:0/2790445541 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40ad5c0 msgr2=0x7fb2d40b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.525+0000 7fb2d96d7700 1 --2- 172.21.15.36:0/2790445541 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40ad5c0 0x7fb2d40b9e60 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7fb2cc001b80 tx=0x7fb2c4006df0).stop 2022-01-10T01:31:21.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.525+0000 7fb2d96d7700 1 -- 172.21.15.36:0/2790445541 shutdown_connections 2022-01-10T01:31:21.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.525+0000 7fb2d96d7700 1 --2- 172.21.15.36:0/2790445541 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40ad5c0 0x7fb2d40b9e60 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.525+0000 7fb2d96d7700 1 --2- 172.21.15.36:0/2790445541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d4061320 0x7fb2d4061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.525+0000 7fb2d96d7700 1 -- 172.21.15.36:0/2790445541 >> 172.21.15.36:0/2790445541 conn(0x7fb2d4066de0 msgr2=0x7fb2d40671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:21.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.525+0000 7fb2d96d7700 1 -- 172.21.15.36:0/2790445541 shutdown_connections 2022-01-10T01:31:21.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.525+0000 7fb2d96d7700 1 -- 172.21.15.36:0/2790445541 wait complete. 2022-01-10T01:31:21.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.525+0000 7fb2d96d7700 1 Processor -- start 2022-01-10T01:31:21.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.525+0000 7fb2d96d7700 1 -- start start 2022-01-10T01:31:21.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d96d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d4061320 0x7fb2d4145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d96d7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d40ad5c0 0x7fb2d4140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d96d7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d4140440 0x7fb2d4141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d96d7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d409e8b0 con 0x7fb2d4140440 2022-01-10T01:31:21.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d96d7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d4142c90 con 0x7fb2d40ad5c0 2022-01-10T01:31:21.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d96d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d4152d40 con 0x7fb2d4061320 2022-01-10T01:31:21.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d8ed6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d4140440 0x7fb2d4141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d8ed6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d4140440 0x7fb2d4141360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38856/0 (socket says 172.21.15.36:38856) 2022-01-10T01:31:21.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d8ed6700 1 -- 172.21.15.36:0/112909353 learned_addr learned my addr 172.21.15.36:0/112909353 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:21.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d37fe700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d40ad5c0 0x7fb2d4140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d3fff700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d4061320 0x7fb2d4145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d8ed6700 1 -- 172.21.15.36:0/112909353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d4061320 msgr2=0x7fb2d4145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d8ed6700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d4061320 0x7fb2d4145620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d8ed6700 1 -- 172.21.15.36:0/112909353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d40ad5c0 msgr2=0x7fb2d4140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d8ed6700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d40ad5c0 0x7fb2d4140e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d8ed6700 1 -- 172.21.15.36:0/112909353 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c400b180 con 0x7fb2d4140440 2022-01-10T01:31:21.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d3fff700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d4061320 0x7fb2d4145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:31:21.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d8ed6700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d4140440 0x7fb2d4141360 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fb2cc000f40 tx=0x7fb2cc001aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:21.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d17fa700 1 -- 172.21.15.36:0/112909353 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2cc004ab0 con 0x7fb2d4140440 2022-01-10T01:31:21.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d17fa700 1 -- 172.21.15.36:0/112909353 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc004c10 con 0x7fb2d4140440 2022-01-10T01:31:21.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d96d7700 1 -- 172.21.15.36:0/112909353 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d4152fe0 con 0x7fb2d4140440 2022-01-10T01:31:21.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d17fa700 1 -- 172.21.15.36:0/112909353 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2cc007170 con 0x7fb2d4140440 2022-01-10T01:31:21.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d96d7700 1 -- 172.21.15.36:0/112909353 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d41425a0 con 0x7fb2d4140440 2022-01-10T01:31:21.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.529+0000 7fb2d96d7700 1 -- 172.21.15.36:0/112909353 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d409ea20 con 0x7fb2d4140440 2022-01-10T01:31:21.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.533+0000 7fb2d17fa700 1 -- 172.21.15.36:0/112909353 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb2cc01b070 con 0x7fb2d4140440 2022-01-10T01:31:21.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.533+0000 7fb2d17fa700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2b4053560 0x7fb2b4055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.533+0000 7fb2d17fa700 1 -- 172.21.15.36:0/112909353 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb2cc06b520 con 0x7fb2d4140440 2022-01-10T01:31:21.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.533+0000 7fb2d3fff700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2b4053560 0x7fb2b4055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.533+0000 7fb2d3fff700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2b4053560 0x7fb2b4055a20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fb2c800b000 tx=0x7fb2c8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:21.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.537+0000 7fb2d17fa700 1 -- 172.21.15.36:0/112909353 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2d409ea20 con 0x7fb2d4140440 2022-01-10T01:31:21.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.665+0000 7fb2d96d7700 1 -- 172.21.15.36:0/112909353 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb2d409e9f0 con 0x7fb2d4140440 2022-01-10T01:31:21.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.665+0000 7fb2d17fa700 1 -- 172.21.15.36:0/112909353 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v89) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb2cc042490 con 0x7fb2d4140440 2022-01-10T01:31:21.672 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:31:21.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.665+0000 7fb2d96d7700 1 -- 172.21.15.36:0/112909353 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2b4053560 msgr2=0x7fb2b4055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.665+0000 7fb2d96d7700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2b4053560 0x7fb2b4055a20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fb2c800b000 tx=0x7fb2c8008040).stop 2022-01-10T01:31:21.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.665+0000 7fb2d96d7700 1 -- 172.21.15.36:0/112909353 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d4140440 msgr2=0x7fb2d4141360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.665+0000 7fb2d96d7700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d4140440 0x7fb2d4141360 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fb2cc000f40 tx=0x7fb2cc001aa0).stop 2022-01-10T01:31:21.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.665+0000 7fb2d96d7700 1 -- 172.21.15.36:0/112909353 shutdown_connections 2022-01-10T01:31:21.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.665+0000 7fb2d96d7700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2b4053560 0x7fb2b4055a20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.665+0000 7fb2d96d7700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d4140440 0x7fb2d4141360 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.665+0000 7fb2d96d7700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d40ad5c0 0x7fb2d4140e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.665+0000 7fb2d96d7700 1 --2- 172.21.15.36:0/112909353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d4061320 0x7fb2d4145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.665+0000 7fb2d96d7700 1 -- 172.21.15.36:0/112909353 >> 172.21.15.36:0/112909353 conn(0x7fb2d4066de0 msgr2=0x7fb2d40b7510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:21.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.665+0000 7fb2d96d7700 1 -- 172.21.15.36:0/112909353 shutdown_connections 2022-01-10T01:31:21.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.669+0000 7fb2d96d7700 1 -- 172.21.15.36:0/112909353 wait complete. 2022-01-10T01:31:21.685 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:31:21.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.793+0000 7fb67359e700 1 Processor -- start 2022-01-10T01:31:21.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.793+0000 7fb67359e700 1 -- start start 2022-01-10T01:31:21.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.793+0000 7fb67359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6740b4710 0x7fb67413fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.793+0000 7fb67359e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb6741439a0 0x7fb674140290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.793+0000 7fb67359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6740b6910 con 0x7fb674061680 2022-01-10T01:31:21.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.793+0000 7fb67359e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6740b9680 con 0x7fb6741439a0 2022-01-10T01:31:21.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.793+0000 7fb67359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6740b6bb0 con 0x7fb6740b4710 2022-01-10T01:31:21.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.793+0000 7fb672d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb6741439a0 0x7fb674140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.793+0000 7fb672d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb6741439a0 0x7fb674140290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38864/0 (socket says 172.21.15.36:38864) 2022-01-10T01:31:21.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.793+0000 7fb672d9d700 1 -- 172.21.15.36:0/3532474070 learned_addr learned my addr 172.21.15.36:0/3532474070 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:21.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.793+0000 7fb671d9b700 1 --2- 172.21.15.36:0/3532474070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6740b4710 0x7fb67413fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb67159a700 1 -- 172.21.15.36:0/3532474070 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560668870 0 0) 0x7fb6740b6910 con 0x7fb674061680 2022-01-10T01:31:21.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb672d9d700 1 -- 172.21.15.36:0/3532474070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6740b4710 msgr2=0x7fb67413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:21.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb672d9d700 1 --2- 172.21.15.36:0/3532474070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6740b4710 0x7fb67413fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb672d9d700 1 -- 172.21.15.36:0/3532474070 >> v1:172.21.15.59:6789/0 conn(0x7fb674061680 legacy=0x7fb6740b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb672d9d700 1 -- 172.21.15.36:0/3532474070 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6740b6e50 con 0x7fb6741439a0 2022-01-10T01:31:21.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb671d9b700 1 --2- 172.21.15.36:0/3532474070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6740b4710 0x7fb67413fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:21.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb672d9d700 1 --2- 172.21.15.36:0/3532474070 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6741439a0 0x7fb674140290 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fb66c0032f0 tx=0x7fb66c009290).ready entity=mon.0 client_cookie=e58c0a3c83bba895 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:21.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb67159a700 1 -- 172.21.15.36:0/3532474070 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb66c00b8a0 con 0x7fb6741439a0 2022-01-10T01:31:21.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb67159a700 1 -- 172.21.15.36:0/3532474070 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66c00ba00 con 0x7fb6741439a0 2022-01-10T01:31:21.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb67159a700 1 -- 172.21.15.36:0/3532474070 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb66c00bb70 con 0x7fb6741439a0 2022-01-10T01:31:21.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb67359e700 1 -- 172.21.15.36:0/3532474070 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6741439a0 msgr2=0x7fb674140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb67359e700 1 --2- 172.21.15.36:0/3532474070 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6741439a0 0x7fb674140290 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fb66c0032f0 tx=0x7fb66c009290).stop 2022-01-10T01:31:21.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb67359e700 1 -- 172.21.15.36:0/3532474070 shutdown_connections 2022-01-10T01:31:21.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb67359e700 1 --2- 172.21.15.36:0/3532474070 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6741439a0 0x7fb674140290 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb67359e700 1 --2- 172.21.15.36:0/3532474070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6740b4710 0x7fb67413fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb67359e700 1 -- 172.21.15.36:0/3532474070 >> 172.21.15.36:0/3532474070 conn(0x7fb67406adf0 msgr2=0x7fb67405f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:21.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb67359e700 1 -- 172.21.15.36:0/3532474070 shutdown_connections 2022-01-10T01:31:21.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb67359e700 1 -- 172.21.15.36:0/3532474070 wait complete. 2022-01-10T01:31:21.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb67359e700 1 Processor -- start 2022-01-10T01:31:21.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.797+0000 7fb67359e700 1 -- start start 2022-01-10T01:31:21.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb674061680 0x7fb674146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6741439a0 0x7fb6741441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb674152d20 0x7fb6740b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6740b8850 con 0x7fb674061680 2022-01-10T01:31:21.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6740b8af0 con 0x7fb6741439a0 2022-01-10T01:31:21.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6740b8d90 con 0x7fb674152d20 2022-01-10T01:31:21.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb674061680 0x7fb674146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb674061680 0x7fb674146520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38866/0 (socket says 172.21.15.36:38866) 2022-01-10T01:31:21.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67259c700 1 -- 172.21.15.36:0/492795635 learned_addr learned my addr 172.21.15.36:0/492795635 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:21.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb671d9b700 1 --2- 172.21.15.36:0/492795635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6741439a0 0x7fb6741441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb672d9d700 1 --2- 172.21.15.36:0/492795635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb674152d20 0x7fb6740b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67259c700 1 -- 172.21.15.36:0/492795635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb674152d20 msgr2=0x7fb6740b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67259c700 1 --2- 172.21.15.36:0/492795635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb674152d20 0x7fb6740b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67259c700 1 -- 172.21.15.36:0/492795635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6741439a0 msgr2=0x7fb6741441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67259c700 1 --2- 172.21.15.36:0/492795635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6741439a0 0x7fb6741441d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67259c700 1 -- 172.21.15.36:0/492795635 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66800b180 con 0x7fb674061680 2022-01-10T01:31:21.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67259c700 1 --2- 172.21.15.36:0/492795635 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb674061680 0x7fb674146520 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fb664000ed0 tx=0x7fb664007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:21.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb6637fe700 1 -- 172.21.15.36:0/492795635 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb66400ce20 con 0x7fb674061680 2022-01-10T01:31:21.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb6637fe700 1 -- 172.21.15.36:0/492795635 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb66400f470 con 0x7fb674061680 2022-01-10T01:31:21.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67359e700 1 -- 172.21.15.36:0/492795635 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c009530 con 0x7fb674061680 2022-01-10T01:31:21.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb6637fe700 1 -- 172.21.15.36:0/492795635 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb66400f7d0 con 0x7fb674061680 2022-01-10T01:31:21.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67359e700 1 -- 172.21.15.36:0/492795635 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6740b07f0 con 0x7fb674061680 2022-01-10T01:31:21.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb67359e700 1 -- 172.21.15.36:0/492795635 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6741470e0 con 0x7fb674061680 2022-01-10T01:31:21.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb6637fe700 1 -- 172.21.15.36:0/492795635 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb664019030 con 0x7fb674061680 2022-01-10T01:31:21.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb6637fe700 1 --2- 172.21.15.36:0/492795635 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb650053590 0x7fb650055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:21.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.801+0000 7fb6637fe700 1 -- 172.21.15.36:0/492795635 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb66406ae90 con 0x7fb674061680 2022-01-10T01:31:21.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.805+0000 7fb671d9b700 1 --2- 172.21.15.36:0/492795635 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb650053590 0x7fb650055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:21.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.805+0000 7fb671d9b700 1 --2- 172.21.15.36:0/492795635 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb650053590 0x7fb650055a50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fb66800b000 tx=0x7fb668008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:21.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.813+0000 7fb6637fe700 1 -- 172.21.15.36:0/492795635 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb6741470e0 con 0x7fb674061680 2022-01-10T01:31:21.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.941+0000 7fb67359e700 1 -- 172.21.15.36:0/492795635 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb6741470e0 con 0x7fb674061680 2022-01-10T01:31:21.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.941+0000 7fb6637fe700 1 -- 172.21.15.36:0/492795635 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v89) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb6741470e0 con 0x7fb674061680 2022-01-10T01:31:21.947 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:21.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.945+0000 7fb67359e700 1 -- 172.21.15.36:0/492795635 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb650053590 msgr2=0x7fb650055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.945+0000 7fb67359e700 1 --2- 172.21.15.36:0/492795635 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb650053590 0x7fb650055a50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fb66800b000 tx=0x7fb668008040).stop 2022-01-10T01:31:21.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.945+0000 7fb67359e700 1 -- 172.21.15.36:0/492795635 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb674061680 msgr2=0x7fb674146520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:21.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.945+0000 7fb67359e700 1 --2- 172.21.15.36:0/492795635 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb674061680 0x7fb674146520 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fb664000ed0 tx=0x7fb664007ac0).stop 2022-01-10T01:31:21.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.945+0000 7fb67359e700 1 -- 172.21.15.36:0/492795635 shutdown_connections 2022-01-10T01:31:21.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.945+0000 7fb67359e700 1 --2- 172.21.15.36:0/492795635 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb650053590 0x7fb650055a50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.945+0000 7fb67359e700 1 --2- 172.21.15.36:0/492795635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb674152d20 0x7fb6740b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.945+0000 7fb67359e700 1 --2- 172.21.15.36:0/492795635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6741439a0 0x7fb6741441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.945+0000 7fb67359e700 1 --2- 172.21.15.36:0/492795635 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb674061680 0x7fb674146520 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:21.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.945+0000 7fb67359e700 1 -- 172.21.15.36:0/492795635 >> 172.21.15.36:0/492795635 conn(0x7fb67406adf0 msgr2=0x7fb6740b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:21.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.945+0000 7fb67359e700 1 -- 172.21.15.36:0/492795635 shutdown_connections 2022-01-10T01:31:21.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:21.945+0000 7fb67359e700 1 -- 172.21.15.36:0/492795635 wait complete. 2022-01-10T01:31:21.960 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:31:22.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b36340700 1 Processor -- start 2022-01-10T01:31:22.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b36340700 1 -- start start 2022-01-10T01:31:22.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b36340700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b300b2580 0x7f9b3014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b36340700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b300b0010 0x7f9b3014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b36340700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b300a70c0 con 0x7f9b300afbd0 2022-01-10T01:31:22.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b36340700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b300a72f0 con 0x7f9b300b0010 2022-01-10T01:31:22.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b36340700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b300a7590 con 0x7f9b300b2580 2022-01-10T01:31:22.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b34b3d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b300b0010 0x7f9b3014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b3533e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b300b2580 0x7f9b3014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b35b3f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9b300afbd0 0x7f9b300a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:54346/0 (socket says 172.21.15.36:54346) 2022-01-10T01:31:22.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b35b3f700 1 -- 172.21.15.36:0/3119058331 learned_addr learned my addr 172.21.15.36:0/3119058331 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:22.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b34b3d700 1 -- 172.21.15.36:0/3119058331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b300b2580 msgr2=0x7f9b3014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:22.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b34b3d700 1 --2- 172.21.15.36:0/3119058331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b300b2580 0x7f9b3014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b34b3d700 1 -- 172.21.15.36:0/3119058331 >> v1:172.21.15.59:6789/0 conn(0x7f9b300afbd0 legacy=0x7f9b300a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.065+0000 7f9b34b3d700 1 -- 172.21.15.36:0/3119058331 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b300a7830 con 0x7f9b300b0010 2022-01-10T01:31:22.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b34b3d700 1 --2- 172.21.15.36:0/3119058331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b300b0010 0x7f9b3014b330 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f9b2c0032f0 tx=0x7f9b2c0091d0).ready entity=mon.1 client_cookie=e31034616d808215 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:22.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b27fff700 1 -- 172.21.15.36:0/3119058331 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b2c00b6c0 con 0x7f9b300b0010 2022-01-10T01:31:22.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b27fff700 1 -- 172.21.15.36:0/3119058331 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c00b820 con 0x7f9b300b0010 2022-01-10T01:31:22.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b27fff700 1 -- 172.21.15.36:0/3119058331 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b2c00b990 con 0x7f9b300b0010 2022-01-10T01:31:22.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 -- 172.21.15.36:0/3119058331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b300b0010 msgr2=0x7f9b3014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 --2- 172.21.15.36:0/3119058331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b300b0010 0x7f9b3014b330 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f9b2c0032f0 tx=0x7f9b2c0091d0).stop 2022-01-10T01:31:22.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 -- 172.21.15.36:0/3119058331 shutdown_connections 2022-01-10T01:31:22.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 --2- 172.21.15.36:0/3119058331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b300b0010 0x7f9b3014b330 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 --2- 172.21.15.36:0/3119058331 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b300b2580 0x7f9b3014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 -- 172.21.15.36:0/3119058331 >> 172.21.15.36:0/3119058331 conn(0x7f9b30060180 msgr2=0x7f9b300b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:22.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 -- 172.21.15.36:0/3119058331 shutdown_connections 2022-01-10T01:31:22.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 -- 172.21.15.36:0/3119058331 wait complete. 2022-01-10T01:31:22.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 Processor -- start 2022-01-10T01:31:22.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 -- start start 2022-01-10T01:31:22.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b300afbd0 0x7f9b3005ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b300b0010 0x7f9b30063000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b300b2580 0x7f9b30159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b300ab3e0 con 0x7f9b300afbd0 2022-01-10T01:31:22.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b300abf20 con 0x7f9b300b2580 2022-01-10T01:31:22.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.069+0000 7f9b36340700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b300ac1c0 con 0x7f9b300b0010 2022-01-10T01:31:22.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b3533e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b300afbd0 0x7f9b3005ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b35b3f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b300b2580 0x7f9b30159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b3533e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b300afbd0 0x7f9b3005ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38882/0 (socket says 172.21.15.36:38882) 2022-01-10T01:31:22.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b35b3f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b300b2580 0x7f9b30159ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:35518/0 (socket says 172.21.15.36:35518) 2022-01-10T01:31:22.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b34b3d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b300b0010 0x7f9b30063000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b35b3f700 1 -- 172.21.15.36:0/2256301892 learned_addr learned my addr 172.21.15.36:0/2256301892 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:22.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b35b3f700 1 -- 172.21.15.36:0/2256301892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b300b0010 msgr2=0x7f9b30063000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b35b3f700 1 --2- 172.21.15.36:0/2256301892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b300b0010 0x7f9b30063000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b35b3f700 1 -- 172.21.15.36:0/2256301892 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b300afbd0 msgr2=0x7f9b3005ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b35b3f700 1 --2- 172.21.15.36:0/2256301892 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b300afbd0 0x7f9b3005ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b35b3f700 1 -- 172.21.15.36:0/2256301892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c009470 con 0x7f9b300b2580 2022-01-10T01:31:22.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b35b3f700 1 --2- 172.21.15.36:0/2256301892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b300b2580 0x7f9b30159ba0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f9b30061a80 tx=0x7f9b28007b80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:22.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b267fc700 1 -- 172.21.15.36:0/2256301892 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b280070d0 con 0x7f9b300b2580 2022-01-10T01:31:22.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b267fc700 1 -- 172.21.15.36:0/2256301892 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b28007230 con 0x7f9b300b2580 2022-01-10T01:31:22.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b36340700 1 -- 172.21.15.36:0/2256301892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b300ac460 con 0x7f9b300b2580 2022-01-10T01:31:22.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b267fc700 1 -- 172.21.15.36:0/2256301892 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b28005610 con 0x7f9b300b2580 2022-01-10T01:31:22.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b36340700 1 -- 172.21.15.36:0/2256301892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b300634f0 con 0x7f9b300b2580 2022-01-10T01:31:22.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b36340700 1 -- 172.21.15.36:0/2256301892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b30057350 con 0x7f9b300b2580 2022-01-10T01:31:22.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.073+0000 7f9b267fc700 1 -- 172.21.15.36:0/2256301892 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9b2801a070 con 0x7f9b300b2580 2022-01-10T01:31:22.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.077+0000 7f9b267fc700 1 --2- 172.21.15.36:0/2256301892 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9b18053560 0x7f9b18055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.077+0000 7f9b267fc700 1 -- 172.21.15.36:0/2256301892 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9b2806aa10 con 0x7f9b300b2580 2022-01-10T01:31:22.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.077+0000 7f9b3533e700 1 --2- 172.21.15.36:0/2256301892 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9b18053560 0x7f9b18055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.077+0000 7f9b3533e700 1 --2- 172.21.15.36:0/2256301892 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9b18053560 0x7f9b18055a20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f9b2000b000 tx=0x7f9b20006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:22.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.085+0000 7f9b267fc700 1 -- 172.21.15.36:0/2256301892 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9b28041910 con 0x7f9b300b2580 2022-01-10T01:31:22.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.213+0000 7f9b36340700 1 -- 172.21.15.36:0/2256301892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b300698e0 con 0x7f9b300b2580 2022-01-10T01:31:22.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.213+0000 7f9b267fc700 1 -- 172.21.15.36:0/2256301892 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9b28044f30 con 0x7f9b300b2580 2022-01-10T01:31:22.218 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:22.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.213+0000 7f9b36340700 1 -- 172.21.15.36:0/2256301892 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9b18053560 msgr2=0x7f9b18055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.213+0000 7f9b36340700 1 --2- 172.21.15.36:0/2256301892 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9b18053560 0x7f9b18055a20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f9b2000b000 tx=0x7f9b20006df0).stop 2022-01-10T01:31:22.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.213+0000 7f9b36340700 1 -- 172.21.15.36:0/2256301892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b300b2580 msgr2=0x7f9b30159ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.213+0000 7f9b36340700 1 --2- 172.21.15.36:0/2256301892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b300b2580 0x7f9b30159ba0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f9b30061a80 tx=0x7f9b28007b80).stop 2022-01-10T01:31:22.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.213+0000 7f9b36340700 1 -- 172.21.15.36:0/2256301892 shutdown_connections 2022-01-10T01:31:22.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.213+0000 7f9b36340700 1 --2- 172.21.15.36:0/2256301892 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9b18053560 0x7f9b18055a20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.213+0000 7f9b36340700 1 --2- 172.21.15.36:0/2256301892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b300b2580 0x7f9b30159ba0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.213+0000 7f9b36340700 1 --2- 172.21.15.36:0/2256301892 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b300b0010 0x7f9b30063000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.213+0000 7f9b36340700 1 --2- 172.21.15.36:0/2256301892 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9b300afbd0 0x7f9b3005ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.213+0000 7f9b36340700 1 -- 172.21.15.36:0/2256301892 >> 172.21.15.36:0/2256301892 conn(0x7f9b30060180 msgr2=0x7f9b300aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:22.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.213+0000 7f9b36340700 1 -- 172.21.15.36:0/2256301892 shutdown_connections 2022-01-10T01:31:22.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.213+0000 7f9b36340700 1 -- 172.21.15.36:0/2256301892 wait complete. 2022-01-10T01:31:22.232 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:31:22.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faef5ecf700 1 Processor -- start 2022-01-10T01:31:22.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faef5ecf700 1 -- start start 2022-01-10T01:31:22.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faef5ecf700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faef0060100 0x7faef0064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faef5ecf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faef00b38d0 0x7faef0065200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faef5ecf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef00604e0 con 0x7faef0144440 2022-01-10T01:31:22.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faef5ecf700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef00656f0 con 0x7faef0060100 2022-01-10T01:31:22.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faef5ecf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef0065c80 con 0x7faef00b38d0 2022-01-10T01:31:22.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faeef7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faef0060100 0x7faef0064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faeeffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faef00b38d0 0x7faef0065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faeef7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faef0060100 0x7faef0064d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38888/0 (socket says 172.21.15.36:38888) 2022-01-10T01:31:22.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faeef7fe700 1 -- 172.21.15.36:0/1001142226 learned_addr learned my addr 172.21.15.36:0/1001142226 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:22.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faeee7fc700 1 -- 172.21.15.36:0/1001142226 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266659437 0 0) 0x7faef00604e0 con 0x7faef0144440 2022-01-10T01:31:22.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faeee7fc700 1 -- 172.21.15.36:0/1001142226 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faedc003260 con 0x7faef0144440 2022-01-10T01:31:22.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faeeffff700 1 -- 172.21.15.36:0/1001142226 >> v2:172.21.15.36:3300/0 conn(0x7faef0060100 msgr2=0x7faef0064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:22.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faeeffff700 1 --2- 172.21.15.36:0/1001142226 >> v2:172.21.15.36:3300/0 conn(0x7faef0060100 0x7faef0064d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faeeffff700 1 -- 172.21.15.36:0/1001142226 >> v1:172.21.15.59:6789/0 conn(0x7faef0144440 legacy=0x7faef0144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.337+0000 7faeeffff700 1 -- 172.21.15.36:0/1001142226 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef00b23b0 con 0x7faef00b38d0 2022-01-10T01:31:22.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.341+0000 7faeeffff700 1 --2- 172.21.15.36:0/1001142226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faef00b38d0 0x7faef0065200 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7faee80032f0 tx=0x7faee80091d0).ready entity=mon.1 client_cookie=31622f0a04746cd8 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:22.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.341+0000 7faeee7fc700 1 -- 172.21.15.36:0/1001142226 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faee800b600 con 0x7faef00b38d0 2022-01-10T01:31:22.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.341+0000 7faeee7fc700 1 -- 172.21.15.36:0/1001142226 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee800b760 con 0x7faef00b38d0 2022-01-10T01:31:22.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.341+0000 7faeee7fc700 1 -- 172.21.15.36:0/1001142226 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faee800b8d0 con 0x7faef00b38d0 2022-01-10T01:31:22.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.341+0000 7faef5ecf700 1 -- 172.21.15.36:0/1001142226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faef00b38d0 msgr2=0x7faef0065200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.341+0000 7faef5ecf700 1 --2- 172.21.15.36:0/1001142226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faef00b38d0 0x7faef0065200 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7faee80032f0 tx=0x7faee80091d0).stop 2022-01-10T01:31:22.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.341+0000 7faef5ecf700 1 -- 172.21.15.36:0/1001142226 shutdown_connections 2022-01-10T01:31:22.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.341+0000 7faef5ecf700 1 --2- 172.21.15.36:0/1001142226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faef00b38d0 0x7faef0065200 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.341+0000 7faef5ecf700 1 --2- 172.21.15.36:0/1001142226 >> v2:172.21.15.36:3300/0 conn(0x7faef0060100 0x7faef0064d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.341+0000 7faef5ecf700 1 -- 172.21.15.36:0/1001142226 >> 172.21.15.36:0/1001142226 conn(0x7faef005cf60 msgr2=0x7faef005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:22.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.341+0000 7faef5ecf700 1 -- 172.21.15.36:0/1001142226 shutdown_connections 2022-01-10T01:31:22.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.341+0000 7faef5ecf700 1 -- 172.21.15.36:0/1001142226 wait complete. 2022-01-10T01:31:22.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faef5ecf700 1 Processor -- start 2022-01-10T01:31:22.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faef5ecf700 1 -- start start 2022-01-10T01:31:22.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faef5ecf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faef0060100 0x7faef00b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faef5ecf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faef00b38d0 0x7faef0062090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faef5ecf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faef00b5fc0 0x7faef00b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faef5ecf700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef0061270 con 0x7faef0060100 2022-01-10T01:31:22.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faef5ecf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef00b5620 con 0x7faef00b38d0 2022-01-10T01:31:22.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faef5ecf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef00614a0 con 0x7faef00b5fc0 2022-01-10T01:31:22.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faeef7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faef0060100 0x7faef00b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faeef7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faef0060100 0x7faef00b1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38894/0 (socket says 172.21.15.36:38894) 2022-01-10T01:31:22.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faeef7fe700 1 -- 172.21.15.36:0/2195183628 learned_addr learned my addr 172.21.15.36:0/2195183628 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:22.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faeeeffd700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faef00b38d0 0x7faef0062090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faeeffff700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faef00b5fc0 0x7faef00b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faeef7fe700 1 -- 172.21.15.36:0/2195183628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faef00b5fc0 msgr2=0x7faef00b6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faeef7fe700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faef00b5fc0 0x7faef00b6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faeef7fe700 1 -- 172.21.15.36:0/2195183628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faef00b38d0 msgr2=0x7faef0062090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faeef7fe700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faef00b38d0 0x7faef0062090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faeef7fe700 1 -- 172.21.15.36:0/2195183628 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee8009470 con 0x7faef0060100 2022-01-10T01:31:22.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faeeeffd700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faef00b38d0 0x7faef0062090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:31:22.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.345+0000 7faeef7fe700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faef0060100 0x7faef00b1410 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7faee000c000 tx=0x7faee0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:22.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.349+0000 7faeecff9700 1 -- 172.21.15.36:0/2195183628 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faee00136e0 con 0x7faef0060100 2022-01-10T01:31:22.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.349+0000 7faeecff9700 1 -- 172.21.15.36:0/2195183628 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee0013840 con 0x7faef0060100 2022-01-10T01:31:22.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.349+0000 7faef5ecf700 1 -- 172.21.15.36:0/2195183628 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef00b5880 con 0x7faef0060100 2022-01-10T01:31:22.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.349+0000 7faeecff9700 1 -- 172.21.15.36:0/2195183628 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faee0013ba0 con 0x7faef0060100 2022-01-10T01:31:22.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.349+0000 7faef5ecf700 1 -- 172.21.15.36:0/2195183628 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef0060ee0 con 0x7faef0060100 2022-01-10T01:31:22.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.349+0000 7faef5ecf700 1 -- 172.21.15.36:0/2195183628 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef0057350 con 0x7faef0060100 2022-01-10T01:31:22.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.349+0000 7faeecff9700 1 -- 172.21.15.36:0/2195183628 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7faee0023070 con 0x7faef0060100 2022-01-10T01:31:22.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.349+0000 7faeecff9700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faed0053500 0x7faed00559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.349+0000 7faeecff9700 1 -- 172.21.15.36:0/2195183628 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7faee006bde0 con 0x7faef0060100 2022-01-10T01:31:22.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.349+0000 7faeeeffd700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faed0053500 0x7faed00559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.349+0000 7faeeeffd700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faed0053500 0x7faed00559c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7faee4008000 tx=0x7faee4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:22.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.357+0000 7faeecff9700 1 -- 172.21.15.36:0/2195183628 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faee0042d50 con 0x7faef0060100 2022-01-10T01:31:22.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.481+0000 7faef5ecf700 1 -- 172.21.15.36:0/2195183628 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faef0065420 con 0x7faef0060100 2022-01-10T01:31:22.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.485+0000 7faeecff9700 1 -- 172.21.15.36:0/2195183628 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+10 (secure 0 0 0) 0x7faee0046370 con 0x7faef0060100 2022-01-10T01:31:22.488 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:22.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.485+0000 7faef5ecf700 1 -- 172.21.15.36:0/2195183628 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faed0053500 msgr2=0x7faed00559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.485+0000 7faef5ecf700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faed0053500 0x7faed00559c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7faee4008000 tx=0x7faee4009040).stop 2022-01-10T01:31:22.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.485+0000 7faef5ecf700 1 -- 172.21.15.36:0/2195183628 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faef0060100 msgr2=0x7faef00b1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.485+0000 7faef5ecf700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faef0060100 0x7faef00b1410 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7faee000c000 tx=0x7faee0008040).stop 2022-01-10T01:31:22.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.485+0000 7faef5ecf700 1 -- 172.21.15.36:0/2195183628 shutdown_connections 2022-01-10T01:31:22.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.485+0000 7faef5ecf700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faed0053500 0x7faed00559c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.485+0000 7faef5ecf700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faef00b5fc0 0x7faef00b6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.485+0000 7faef5ecf700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faef00b38d0 0x7faef0062090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.485+0000 7faef5ecf700 1 --2- 172.21.15.36:0/2195183628 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faef0060100 0x7faef00b1410 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.485+0000 7faef5ecf700 1 -- 172.21.15.36:0/2195183628 >> 172.21.15.36:0/2195183628 conn(0x7faef005cf60 msgr2=0x7faef0144900 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:22.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.485+0000 7faef5ecf700 1 -- 172.21.15.36:0/2195183628 shutdown_connections 2022-01-10T01:31:22.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.485+0000 7faef5ecf700 1 -- 172.21.15.36:0/2195183628 wait complete. 2022-01-10T01:31:22.502 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:31:22.503 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:22.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa8a5c44700 1 Processor -- start 2022-01-10T01:31:22.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa8a5c44700 1 -- start start 2022-01-10T01:31:22.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa8a5c44700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa8a00b1a30 0x7fa8a00669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa8a5c44700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa8a0140cb0 0x7fa8a013e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa8a5c44700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a005f750 con 0x7fa8a00665f0 2022-01-10T01:31:22.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa8a5c44700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a00b14a0 con 0x7fa8a00b1a30 2022-01-10T01:31:22.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa8a5c44700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a005f980 con 0x7fa8a0140cb0 2022-01-10T01:31:22.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa89ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa8a00b1a30 0x7fa8a00669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa89ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa8a00b1a30 0x7fa8a00669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38904/0 (socket says 172.21.15.36:38904) 2022-01-10T01:31:22.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa89ffff700 1 -- 172.21.15.36:0/628120983 learned_addr learned my addr 172.21.15.36:0/628120983 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:22.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa8a5443700 1 --2- 172.21.15.36:0/628120983 >> v2:172.21.15.59:3300/0 conn(0x7fa8a0140cb0 0x7fa8a013e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa89ffff700 1 -- 172.21.15.36:0/628120983 >> v2:172.21.15.59:3300/0 conn(0x7fa8a0140cb0 msgr2=0x7fa8a013e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:22.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa89ffff700 1 --2- 172.21.15.36:0/628120983 >> v2:172.21.15.59:3300/0 conn(0x7fa8a0140cb0 0x7fa8a013e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa89ffff700 1 -- 172.21.15.36:0/628120983 >> v1:172.21.15.59:6789/0 conn(0x7fa8a00665f0 legacy=0x7fa8a005fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa89ffff700 1 -- 172.21.15.36:0/628120983 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00b1740 con 0x7fa8a00b1a30 2022-01-10T01:31:22.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa89ffff700 1 --2- 172.21.15.36:0/628120983 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8a00b1a30 0x7fa8a00669d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fa88c002f70 tx=0x7fa88c006eb0).ready entity=mon.0 client_cookie=8fe5558af3133a53 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:22.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa89f7fe700 1 -- 172.21.15.36:0/628120983 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa88c00d5c0 con 0x7fa8a00b1a30 2022-01-10T01:31:22.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.601+0000 7fa89f7fe700 1 -- 172.21.15.36:0/628120983 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c000e90 con 0x7fa8a00b1a30 2022-01-10T01:31:22.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.605+0000 7fa89f7fe700 1 -- 172.21.15.36:0/628120983 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa88c00d950 con 0x7fa8a00b1a30 2022-01-10T01:31:22.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.605+0000 7fa8a5c44700 1 -- 172.21.15.36:0/628120983 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8a00b1a30 msgr2=0x7fa8a00669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.605+0000 7fa8a5c44700 1 --2- 172.21.15.36:0/628120983 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8a00b1a30 0x7fa8a00669d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fa88c002f70 tx=0x7fa88c006eb0).stop 2022-01-10T01:31:22.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.605+0000 7fa8a5c44700 1 -- 172.21.15.36:0/628120983 shutdown_connections 2022-01-10T01:31:22.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.605+0000 7fa8a5c44700 1 --2- 172.21.15.36:0/628120983 >> v2:172.21.15.59:3300/0 conn(0x7fa8a0140cb0 0x7fa8a013e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.605+0000 7fa8a5c44700 1 --2- 172.21.15.36:0/628120983 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8a00b1a30 0x7fa8a00669d0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.605+0000 7fa8a5c44700 1 -- 172.21.15.36:0/628120983 >> 172.21.15.36:0/628120983 conn(0x7fa8a00636e0 msgr2=0x7fa8a0063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:22.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.605+0000 7fa8a5c44700 1 -- 172.21.15.36:0/628120983 shutdown_connections 2022-01-10T01:31:22.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.605+0000 7fa8a5c44700 1 -- 172.21.15.36:0/628120983 wait complete. 2022-01-10T01:31:22.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.605+0000 7fa8a5c44700 1 Processor -- start 2022-01-10T01:31:22.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.605+0000 7fa8a5c44700 1 -- start start 2022-01-10T01:31:22.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5c44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a00665f0 0x7fa8a00afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5c44700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8a00b1a30 0x7fa8a0155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5c44700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8a0140cb0 0x7fa8a00643e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5c44700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a014fd70 con 0x7fa8a0140cb0 2022-01-10T01:31:22.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5c44700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a0065db0 con 0x7fa8a00b1a30 2022-01-10T01:31:22.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5c44700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a0155610 con 0x7fa8a00665f0 2022-01-10T01:31:22.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5443700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8a0140cb0 0x7fa8a00643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5443700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8a0140cb0 0x7fa8a00643e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38912/0 (socket says 172.21.15.36:38912) 2022-01-10T01:31:22.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5443700 1 -- 172.21.15.36:0/2536441837 learned_addr learned my addr 172.21.15.36:0/2536441837 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:22.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a4c42700 1 --2- 172.21.15.36:0/2536441837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a00665f0 0x7fa8a00afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa89ffff700 1 --2- 172.21.15.36:0/2536441837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8a00b1a30 0x7fa8a0155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5443700 1 -- 172.21.15.36:0/2536441837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a00665f0 msgr2=0x7fa8a00afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5443700 1 --2- 172.21.15.36:0/2536441837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a00665f0 0x7fa8a00afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5443700 1 -- 172.21.15.36:0/2536441837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8a00b1a30 msgr2=0x7fa8a0155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5443700 1 --2- 172.21.15.36:0/2536441837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8a00b1a30 0x7fa8a0155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5443700 1 -- 172.21.15.36:0/2536441837 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c00b1e0 con 0x7fa8a0140cb0 2022-01-10T01:31:22.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5443700 1 --2- 172.21.15.36:0/2536441837 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8a0140cb0 0x7fa8a00643e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fa8a0066550 tx=0x7fa8980091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:22.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa89dffb700 1 -- 172.21.15.36:0/2536441837 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa898012600 con 0x7fa8a0140cb0 2022-01-10T01:31:22.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa89dffb700 1 -- 172.21.15.36:0/2536441837 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898012760 con 0x7fa8a0140cb0 2022-01-10T01:31:22.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5c44700 1 -- 172.21.15.36:0/2536441837 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a0065fe0 con 0x7fa8a0140cb0 2022-01-10T01:31:22.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa89dffb700 1 -- 172.21.15.36:0/2536441837 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa898012ac0 con 0x7fa8a0140cb0 2022-01-10T01:31:22.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5c44700 1 -- 172.21.15.36:0/2536441837 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a0155840 con 0x7fa8a0140cb0 2022-01-10T01:31:22.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.609+0000 7fa8a5c44700 1 -- 172.21.15.36:0/2536441837 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a0155a00 con 0x7fa8a0140cb0 2022-01-10T01:31:22.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.613+0000 7fa89dffb700 1 -- 172.21.15.36:0/2536441837 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa898022070 con 0x7fa8a0140cb0 2022-01-10T01:31:22.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.613+0000 7fa89dffb700 1 --2- 172.21.15.36:0/2536441837 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa880053560 0x7fa880055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:22.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.613+0000 7fa89dffb700 1 -- 172.21.15.36:0/2536441837 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa89806bfd0 con 0x7fa8a0140cb0 2022-01-10T01:31:22.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.613+0000 7fa8a4c42700 1 --2- 172.21.15.36:0/2536441837 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa880053560 0x7fa880055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:22.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.613+0000 7fa8a4c42700 1 --2- 172.21.15.36:0/2536441837 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa880053560 0x7fa880055a20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fa89400d000 tx=0x7fa894007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:22.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.617+0000 7fa89dffb700 1 -- 172.21.15.36:0/2536441837 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa898042fe0 con 0x7fa8a0140cb0 2022-01-10T01:31:22.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.781+0000 7fa8a5c44700 1 -- 172.21.15.36:0/2536441837 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8a0065640 con 0x7fa8a0140cb0 2022-01-10T01:31:22.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.781+0000 7fa89dffb700 1 -- 172.21.15.36:0/2536441837 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fa898016070 con 0x7fa8a0140cb0 2022-01-10T01:31:22.787 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:22.787 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":40,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3902337896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3902337896},{"type":"v1","addr":"172.21.15.36:6835","nonce":3902337896}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6612,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6837/3131314479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":3131314479},{"type":"v1","addr":"172.21.15.36:6837","nonce":3131314479}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:31:18.134652+0000","modified":"2022-01-10T01:31:19.137223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6616":{"gid":6616,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3399412771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3399412771},{"type":"v1","addr":"172.21.15.59:6833","nonce":3399412771}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2022-01-10T01:31:22.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.781+0000 7fa8a5c44700 1 -- 172.21.15.36:0/2536441837 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa880053560 msgr2=0x7fa880055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.781+0000 7fa8a5c44700 1 --2- 172.21.15.36:0/2536441837 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa880053560 0x7fa880055a20 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fa89400d000 tx=0x7fa894007b90).stop 2022-01-10T01:31:22.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.781+0000 7fa8a5c44700 1 -- 172.21.15.36:0/2536441837 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8a0140cb0 msgr2=0x7fa8a00643e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:22.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.781+0000 7fa8a5c44700 1 --2- 172.21.15.36:0/2536441837 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8a0140cb0 0x7fa8a00643e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fa8a0066550 tx=0x7fa8980091d0).stop 2022-01-10T01:31:22.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.781+0000 7fa8a5c44700 1 -- 172.21.15.36:0/2536441837 shutdown_connections 2022-01-10T01:31:22.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.781+0000 7fa8a5c44700 1 --2- 172.21.15.36:0/2536441837 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa880053560 0x7fa880055a20 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.781+0000 7fa8a5c44700 1 --2- 172.21.15.36:0/2536441837 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8a0140cb0 0x7fa8a00643e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.781+0000 7fa8a5c44700 1 --2- 172.21.15.36:0/2536441837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8a00b1a30 0x7fa8a0155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.781+0000 7fa8a5c44700 1 --2- 172.21.15.36:0/2536441837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8a00665f0 0x7fa8a00afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:22.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.781+0000 7fa8a5c44700 1 -- 172.21.15.36:0/2536441837 >> 172.21.15.36:0/2536441837 conn(0x7fa8a00636e0 msgr2=0x7fa8a013e560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:22.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.781+0000 7fa8a5c44700 1 -- 172.21.15.36:0/2536441837 shutdown_connections 2022-01-10T01:31:22.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:22.781+0000 7fa8a5c44700 1 -- 172.21.15.36:0/2536441837 wait complete. 2022-01-10T01:31:22.793 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 40 2022-01-10T01:31:23.101 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:31:18.134652+0000', 'modified': '2022-01-10T01:31:19.137223+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6616}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6616': {'gid': 6616, 'name': 'b', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/3399412771', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 3399412771}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 3399412771}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:31:23.101 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:31:23.102 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:31:23.218 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":6616,"want_state":"up:active","state":"up:active","rank_uptime":5.0701803840000004,"mdsmap_epoch":40,"osdmap_epoch":89,"osdmap_epoch_barrier":87,"uptime":9.3656417419999993} 2022-01-10T01:31:23.218 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 6616, "mdsmap_epoch": 40, "osdmap_epoch": 89, "osdmap_epoch_barrier": 87, "rank_uptime": 5.070180384, "state": "up:active", "uptime": 9.365641742, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:31:23.219 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:31:23.220 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:31:23.220 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:31:23.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:23.221 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:23.229 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:31:23.248 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:31:23.249 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:31:23.307 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:31:23.308 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:31:23.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:23.309 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:31:23.314 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:31:23.315 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:23.320 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:31:23.337 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:31:23.338 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:31:23.394 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:31:23.395 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:31:23.395 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14774]: starting ceph client 2022-01-10T01:31:23.396 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:31:23.390+0000 7f8bd35a6080 -1 init, newargv = 0x5567d1ad9d10 newargc=9 2022-01-10T01:31:23.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:23.397 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:31:23.404 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14774]: starting fuse 2022-01-10T01:31:24.504 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:31:24.523 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:31:24.523 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:31:24.579 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:31:24.580 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:31:24.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:24.582 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:31:24.587 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:31:24.588 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:31:24.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:24.589 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:31:24.589 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:31:24.590 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:31:24.590 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:31:24.591 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:31:24.591 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:31:24.592 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:31:24.592 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:31:24.593 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:31:24.593 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:31:24.593 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:31:24.594 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:31:24.594 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:31:24.595 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:31:24.595 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:31:24.596 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:31:24.596 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:31:24.597 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:31:24.597 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:31:24.598 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:31:24.598 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:31:24.598 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:31:24.599 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:31:24.642 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.14774.asok 2022-01-10T01:31:24.648 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14774.asok 2022-01-10T01:31:24.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:24.649 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14774.asok status 2022-01-10T01:31:24.737 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:31:24.737 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:31:24.737 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:31:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:31:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:31:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:31:24.738 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:31:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "14774", 2022-01-10T01:31:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:31:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:31:24.739 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:31:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:31:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 6777, 2022-01-10T01:31:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:31:24.740 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:31:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:31:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 6777 2022-01-10T01:31:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:31:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:31:24.741 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:31:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:31:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2781871426 2022-01-10T01:31:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:31:24.742 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:31:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:31:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:31:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:31:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2781871426 2022-01-10T01:31:24.743 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:31:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.6777 172.21.15.139:0/2781871426", 2022-01-10T01:31:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/2781871426", 2022-01-10T01:31:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:31:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 40, 2022-01-10T01:31:24.744 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 89, 2022-01-10T01:31:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:31:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:31:24.745 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:31:24.745 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:31:24.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:24.747 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:24.747 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:24.754 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:31:24.755 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:31:24.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:24.756 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:24.771 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:31:24.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff3095ac700 1 Processor -- start 2022-01-10T01:31:24.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff3095ac700 1 -- start start 2022-01-10T01:31:24.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff3095ac700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff304067300 0x7ff3041438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:24.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff3095ac700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3040aabb0 con 0x7ff304060100 2022-01-10T01:31:24.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff3095ac700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3040604e0 con 0x7ff304143de0 2022-01-10T01:31:24.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff3095ac700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff304066ea0 con 0x7ff304067300 2022-01-10T01:31:24.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff3027fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff304067300 0x7ff3041438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:24.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff3027fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff304067300 0x7ff3041438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38920/0 (socket says 172.21.15.36:38920) 2022-01-10T01:31:24.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff3027fc700 1 -- 172.21.15.36:0/1791610199 learned_addr learned my addr 172.21.15.36:0/1791610199 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:24.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff302ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff304060100 0x7ff3040b4750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36710/0 (socket says 172.21.15.36:36710) 2022-01-10T01:31:24.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff3027fc700 1 -- 172.21.15.36:0/1791610199 >> v1:172.21.15.59:6789/0 conn(0x7ff304143de0 legacy=0x7ff30414b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:24.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff3027fc700 1 -- 172.21.15.36:0/1791610199 >> v1:172.21.15.36:6789/0 conn(0x7ff304060100 legacy=0x7ff3040b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:24.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff3027fc700 1 -- 172.21.15.36:0/1791610199 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3040b33b0 con 0x7ff304067300 2022-01-10T01:31:24.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff3027fc700 1 --2- 172.21.15.36:0/1791610199 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff304067300 0x7ff3041438f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7ff2ec002f70 tx=0x7ff2ec006eb0).ready entity=mon.0 client_cookie=d7410d048279b93 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:24.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff301ffb700 1 -- 172.21.15.36:0/1791610199 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2ec00d660 con 0x7ff304067300 2022-01-10T01:31:24.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff301ffb700 1 -- 172.21.15.36:0/1791610199 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec000e90 con 0x7ff304067300 2022-01-10T01:31:24.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.881+0000 7ff301ffb700 1 -- 172.21.15.36:0/1791610199 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2ec00d9f0 con 0x7ff304067300 2022-01-10T01:31:24.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.885+0000 7ff3095ac700 1 -- 172.21.15.36:0/1791610199 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff304067300 msgr2=0x7ff3041438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:24.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.885+0000 7ff3095ac700 1 --2- 172.21.15.36:0/1791610199 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff304067300 0x7ff3041438f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7ff2ec002f70 tx=0x7ff2ec006eb0).stop 2022-01-10T01:31:24.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.885+0000 7ff3095ac700 1 -- 172.21.15.36:0/1791610199 shutdown_connections 2022-01-10T01:31:24.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.885+0000 7ff3095ac700 1 --2- 172.21.15.36:0/1791610199 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff304067300 0x7ff3041438f0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:24.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.885+0000 7ff3095ac700 1 -- 172.21.15.36:0/1791610199 >> 172.21.15.36:0/1791610199 conn(0x7ff30405cf30 msgr2=0x7ff30405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:24.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.885+0000 7ff3095ac700 1 -- 172.21.15.36:0/1791610199 shutdown_connections 2022-01-10T01:31:24.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.885+0000 7ff3095ac700 1 -- 172.21.15.36:0/1791610199 wait complete. 2022-01-10T01:31:24.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.885+0000 7ff3095ac700 1 Processor -- start 2022-01-10T01:31:24.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.885+0000 7ff3095ac700 1 -- start start 2022-01-10T01:31:24.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3095ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff304060100 0x7ff3040b6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:24.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3095ac700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff304067300 0x7ff304153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:24.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3095ac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff304143de0 0x7ff304154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:24.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3095ac700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30409f840 con 0x7ff304067300 2022-01-10T01:31:24.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3095ac700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff304154850 con 0x7ff304143de0 2022-01-10T01:31:24.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3095ac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040ac090 con 0x7ff304060100 2022-01-10T01:31:24.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3027fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff304067300 0x7ff304153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:24.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3027fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff304067300 0x7ff304153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38924/0 (socket says 172.21.15.36:38924) 2022-01-10T01:31:24.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3027fc700 1 -- 172.21.15.36:0/2474098631 learned_addr learned my addr 172.21.15.36:0/2474098631 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:24.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff302ffd700 1 --2- 172.21.15.36:0/2474098631 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff304060100 0x7ff3040b6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:24.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3037fe700 1 --2- 172.21.15.36:0/2474098631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff304143de0 0x7ff304154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:24.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3027fc700 1 -- 172.21.15.36:0/2474098631 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff304060100 msgr2=0x7ff3040b6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:24.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3027fc700 1 --2- 172.21.15.36:0/2474098631 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff304060100 0x7ff3040b6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:24.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3027fc700 1 -- 172.21.15.36:0/2474098631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff304143de0 msgr2=0x7ff304154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:24.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3027fc700 1 --2- 172.21.15.36:0/2474098631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff304143de0 0x7ff304154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:24.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3027fc700 1 -- 172.21.15.36:0/2474098631 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec00b1e0 con 0x7ff304067300 2022-01-10T01:31:24.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3027fc700 1 --2- 172.21.15.36:0/2474098631 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff304067300 0x7ff304153e70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7ff2ec002f70 tx=0x7ff2ec015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:24.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff2fbfff700 1 -- 172.21.15.36:0/2474098631 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2ec0068b0 con 0x7ff304067300 2022-01-10T01:31:24.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff2fbfff700 1 -- 172.21.15.36:0/2474098631 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ec011ae0 con 0x7ff304067300 2022-01-10T01:31:24.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3095ac700 1 -- 172.21.15.36:0/2474098631 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3040ac330 con 0x7ff304067300 2022-01-10T01:31:24.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff2fbfff700 1 -- 172.21.15.36:0/2474098631 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2ec011e40 con 0x7ff304067300 2022-01-10T01:31:24.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.889+0000 7ff3095ac700 1 -- 172.21.15.36:0/2474098631 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3041539d0 con 0x7ff304067300 2022-01-10T01:31:24.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.893+0000 7ff3095ac700 1 -- 172.21.15.36:0/2474098631 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff304153b90 con 0x7ff304067300 2022-01-10T01:31:24.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.893+0000 7ff2fbfff700 1 -- 172.21.15.36:0/2474098631 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff2ec025030 con 0x7ff304067300 2022-01-10T01:31:24.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.893+0000 7ff2fbfff700 1 --2- 172.21.15.36:0/2474098631 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2e80535f0 0x7ff2e8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:24.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.893+0000 7ff2fbfff700 1 -- 172.21.15.36:0/2474098631 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff2ec06cc70 con 0x7ff304067300 2022-01-10T01:31:24.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.893+0000 7ff302ffd700 1 --2- 172.21.15.36:0/2474098631 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2e80535f0 0x7ff2e8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:24.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.893+0000 7ff302ffd700 1 --2- 172.21.15.36:0/2474098631 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2e80535f0 0x7ff2e8055ab0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7ff2f400d000 tx=0x7ff2f4007f90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:24.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:24.897+0000 7ff2fbfff700 1 -- 172.21.15.36:0/2474098631 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2ec043cc0 con 0x7ff304067300 2022-01-10T01:31:25.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.029+0000 7ff3095ac700 1 -- 172.21.15.36:0/2474098631 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff304057350 con 0x7ff304067300 2022-01-10T01:31:25.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.029+0000 7ff2fbfff700 1 -- 172.21.15.36:0/2474098631 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16274 (secure 0 0 0) 0x7ff2ec0472a0 con 0x7ff304067300 2022-01-10T01:31:25.035 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:25.036 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":89,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:31:20.489200+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:31:16.698671+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2022-01-10T01:31:17.811890+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:31:25.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.033+0000 7ff3095ac700 1 -- 172.21.15.36:0/2474098631 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2e80535f0 msgr2=0x7ff2e8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.033+0000 7ff3095ac700 1 --2- 172.21.15.36:0/2474098631 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2e80535f0 0x7ff2e8055ab0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7ff2f400d000 tx=0x7ff2f4007f90).stop 2022-01-10T01:31:25.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.033+0000 7ff3095ac700 1 -- 172.21.15.36:0/2474098631 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff304067300 msgr2=0x7ff304153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.033+0000 7ff3095ac700 1 --2- 172.21.15.36:0/2474098631 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff304067300 0x7ff304153e70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7ff2ec002f70 tx=0x7ff2ec015000).stop 2022-01-10T01:31:25.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.033+0000 7ff3095ac700 1 -- 172.21.15.36:0/2474098631 shutdown_connections 2022-01-10T01:31:25.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.033+0000 7ff3095ac700 1 --2- 172.21.15.36:0/2474098631 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2e80535f0 0x7ff2e8055ab0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.033+0000 7ff3095ac700 1 --2- 172.21.15.36:0/2474098631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff304143de0 0x7ff304154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.033+0000 7ff3095ac700 1 --2- 172.21.15.36:0/2474098631 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff304067300 0x7ff304153e70 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.033+0000 7ff3095ac700 1 --2- 172.21.15.36:0/2474098631 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff304060100 0x7ff3040b6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.033+0000 7ff3095ac700 1 -- 172.21.15.36:0/2474098631 >> 172.21.15.36:0/2474098631 conn(0x7ff30405cf30 msgr2=0x7ff3041436c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:25.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.033+0000 7ff3095ac700 1 -- 172.21.15.36:0/2474098631 shutdown_connections 2022-01-10T01:31:25.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.033+0000 7ff3095ac700 1 -- 172.21.15.36:0/2474098631 wait complete. 2022-01-10T01:31:25.049 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:31:16.698671+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:31:17.811890+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:31:25.050 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:31:25.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f737d527700 1 Processor -- start 2022-01-10T01:31:25.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f737d527700 1 -- start start 2022-01-10T01:31:25.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f737d527700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f73780665f0 0x7f73780669d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f737d527700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f73780b1a30 0x7f737805fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f737d527700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737805f750 con 0x7f7378140cb0 2022-01-10T01:31:25.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f737d527700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73780b14a0 con 0x7f73780665f0 2022-01-10T01:31:25.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f737d527700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737805f980 con 0x7f73780b1a30 2022-01-10T01:31:25.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f7377fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f73780665f0 0x7f73780669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f7377fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f73780665f0 0x7f73780669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38930/0 (socket says 172.21.15.36:38930) 2022-01-10T01:31:25.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f7377fff700 1 -- 172.21.15.36:0/2762159840 learned_addr learned my addr 172.21.15.36:0/2762159840 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:25.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f73777fe700 1 --2- 172.21.15.36:0/2762159840 >> v2:172.21.15.59:3300/0 conn(0x7f73780b1a30 0x7f737805fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f7377fff700 1 -- 172.21.15.36:0/2762159840 >> v2:172.21.15.59:3300/0 conn(0x7f73780b1a30 msgr2=0x7f737805fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:25.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f7377fff700 1 --2- 172.21.15.36:0/2762159840 >> v2:172.21.15.59:3300/0 conn(0x7f73780b1a30 0x7f737805fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f7377fff700 1 -- 172.21.15.36:0/2762159840 >> v1:172.21.15.59:6789/0 conn(0x7f7378140cb0 legacy=0x7f737813e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f7377fff700 1 -- 172.21.15.36:0/2762159840 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7378060310 con 0x7f73780665f0 2022-01-10T01:31:25.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f73777fe700 1 --2- 172.21.15.36:0/2762159840 >> v2:172.21.15.59:3300/0 conn(0x7f73780b1a30 0x7f737805fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:25.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.157+0000 7f7377fff700 1 --2- 172.21.15.36:0/2762159840 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73780665f0 0x7f73780669d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f7368002f70 tx=0x7f7368006eb0).ready entity=mon.0 client_cookie=28440856f3ef9ac0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:25.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.161+0000 7f7376ffd700 1 -- 172.21.15.36:0/2762159840 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f736800d610 con 0x7f73780665f0 2022-01-10T01:31:25.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.161+0000 7f7376ffd700 1 -- 172.21.15.36:0/2762159840 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7368000e90 con 0x7f73780665f0 2022-01-10T01:31:25.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.161+0000 7f7376ffd700 1 -- 172.21.15.36:0/2762159840 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f736800d9a0 con 0x7f73780665f0 2022-01-10T01:31:25.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.161+0000 7f737d527700 1 -- 172.21.15.36:0/2762159840 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73780665f0 msgr2=0x7f73780669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.161+0000 7f737d527700 1 --2- 172.21.15.36:0/2762159840 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73780665f0 0x7f73780669d0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f7368002f70 tx=0x7f7368006eb0).stop 2022-01-10T01:31:25.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.161+0000 7f737d527700 1 -- 172.21.15.36:0/2762159840 shutdown_connections 2022-01-10T01:31:25.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.161+0000 7f737d527700 1 --2- 172.21.15.36:0/2762159840 >> v2:172.21.15.59:3300/0 conn(0x7f73780b1a30 0x7f737805fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.161+0000 7f737d527700 1 --2- 172.21.15.36:0/2762159840 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73780665f0 0x7f73780669d0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.161+0000 7f737d527700 1 -- 172.21.15.36:0/2762159840 >> 172.21.15.36:0/2762159840 conn(0x7f73780636e0 msgr2=0x7f7378063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:25.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.161+0000 7f737d527700 1 -- 172.21.15.36:0/2762159840 shutdown_connections 2022-01-10T01:31:25.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.161+0000 7f737d527700 1 -- 172.21.15.36:0/2762159840 wait complete. 2022-01-10T01:31:25.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.161+0000 7f737d527700 1 Processor -- start 2022-01-10T01:31:25.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.161+0000 7f737d527700 1 -- start start 2022-01-10T01:31:25.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f737d527700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73780665f0 0x7f73780ae9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f737d527700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73780b1a30 0x7f7378153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f737d527700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7378140cb0 0x7f7378143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f737d527700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737814ff10 con 0x7f73780b1a30 2022-01-10T01:31:25.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f737d527700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7378154380 con 0x7f7378140cb0 2022-01-10T01:31:25.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f737d527700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73780af010 con 0x7f73780665f0 2022-01-10T01:31:25.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f73777fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73780b1a30 0x7f7378153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f73777fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73780b1a30 0x7f7378153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38938/0 (socket says 172.21.15.36:38938) 2022-01-10T01:31:25.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f73777fe700 1 -- 172.21.15.36:0/743396106 learned_addr learned my addr 172.21.15.36:0/743396106 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:25.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f7377fff700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73780665f0 0x7f73780ae9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f737cd26700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7378140cb0 0x7f7378143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f73777fe700 1 -- 172.21.15.36:0/743396106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73780665f0 msgr2=0x7f73780ae9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f73777fe700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73780665f0 0x7f73780ae9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f73777fe700 1 -- 172.21.15.36:0/743396106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7378140cb0 msgr2=0x7f7378143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f73777fe700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7378140cb0 0x7f7378143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f73777fe700 1 -- 172.21.15.36:0/743396106 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736800b1e0 con 0x7f73780b1a30 2022-01-10T01:31:25.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f737cd26700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7378140cb0 0x7f7378143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:25.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f73777fe700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73780b1a30 0x7f7378153e90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f73780add20 tx=0x7f736c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:25.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f73757fa700 1 -- 172.21.15.36:0/743396106 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f736c011780 con 0x7f73780b1a30 2022-01-10T01:31:25.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f73757fa700 1 -- 172.21.15.36:0/743396106 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c0118e0 con 0x7f73780b1a30 2022-01-10T01:31:25.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f737d527700 1 -- 172.21.15.36:0/743396106 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73780af2b0 con 0x7f73780b1a30 2022-01-10T01:31:25.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f73757fa700 1 -- 172.21.15.36:0/743396106 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f736c011c40 con 0x7f73780b1a30 2022-01-10T01:31:25.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f737d527700 1 -- 172.21.15.36:0/743396106 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73780aa3c0 con 0x7f73780b1a30 2022-01-10T01:31:25.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.165+0000 7f737d527700 1 -- 172.21.15.36:0/743396106 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73780b1740 con 0x7f73780b1a30 2022-01-10T01:31:25.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.169+0000 7f73757fa700 1 -- 172.21.15.36:0/743396106 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f736c012420 con 0x7f73780b1a30 2022-01-10T01:31:25.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.169+0000 7f73757fa700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73580534d0 0x7f7358055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.169+0000 7f73757fa700 1 -- 172.21.15.36:0/743396106 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f736c06b920 con 0x7f73780b1a30 2022-01-10T01:31:25.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.169+0000 7f7377fff700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73580534d0 0x7f7358055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.169+0000 7f7377fff700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73580534d0 0x7f7358055990 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f736801c000 tx=0x7f7368015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:25.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.173+0000 7f73757fa700 1 -- 172.21.15.36:0/743396106 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f736c0428d0 con 0x7f73780b1a30 2022-01-10T01:31:25.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.301+0000 7f737d527700 1 -- 172.21.15.36:0/743396106 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7378057350 con 0x7f73780b1a30 2022-01-10T01:31:25.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.305+0000 7f73757fa700 1 -- 172.21.15.36:0/743396106 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v89) v1 ==== 110+0+10 (secure 0 0 0) 0x7f736c045ef0 con 0x7f73780b1a30 2022-01-10T01:31:25.309 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:31:25.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.309+0000 7f737d527700 1 -- 172.21.15.36:0/743396106 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73580534d0 msgr2=0x7f7358055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.309+0000 7f737d527700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73580534d0 0x7f7358055990 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f736801c000 tx=0x7f7368015000).stop 2022-01-10T01:31:25.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.309+0000 7f737d527700 1 -- 172.21.15.36:0/743396106 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73780b1a30 msgr2=0x7f7378153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.309+0000 7f737d527700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73780b1a30 0x7f7378153e90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f73780add20 tx=0x7f736c008040).stop 2022-01-10T01:31:25.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.309+0000 7f737d527700 1 -- 172.21.15.36:0/743396106 shutdown_connections 2022-01-10T01:31:25.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.309+0000 7f737d527700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73580534d0 0x7f7358055990 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.309+0000 7f737d527700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7378140cb0 0x7f7378143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.309+0000 7f737d527700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73780b1a30 0x7f7378153e90 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.309+0000 7f737d527700 1 --2- 172.21.15.36:0/743396106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73780665f0 0x7f73780ae9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.309+0000 7f737d527700 1 -- 172.21.15.36:0/743396106 >> 172.21.15.36:0/743396106 conn(0x7f73780636e0 msgr2=0x7f737813fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:25.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.309+0000 7f737d527700 1 -- 172.21.15.36:0/743396106 shutdown_connections 2022-01-10T01:31:25.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.309+0000 7f737d527700 1 -- 172.21.15.36:0/743396106 wait complete. 2022-01-10T01:31:25.328 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:31:25.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.429+0000 7f78d894f700 1 Processor -- start 2022-01-10T01:31:25.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.429+0000 7f78d894f700 1 -- start start 2022-01-10T01:31:25.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d894f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f78d40aff10 0x7f78d405f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d894f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f78d40ac9b0 0x7f78d414af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d894f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d4061360 con 0x7f78d414ab80 2022-01-10T01:31:25.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d894f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d414b5e0 con 0x7f78d40aff10 2022-01-10T01:31:25.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d894f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d414b880 con 0x7f78d40ac9b0 2022-01-10T01:31:25.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d1d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f78d40aff10 0x7f78d405f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d2d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f78d40ac9b0 0x7f78d414af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d259c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f78d414ab80 0x7f78d40af1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:54414/0 (socket says 172.21.15.36:54414) 2022-01-10T01:31:25.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d259c700 1 -- 172.21.15.36:0/1758102912 learned_addr learned my addr 172.21.15.36:0/1758102912 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:25.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d1d9b700 1 -- 172.21.15.36:0/1758102912 >> v2:172.21.15.59:3300/0 conn(0x7f78d40ac9b0 msgr2=0x7f78d414af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:25.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d1d9b700 1 --2- 172.21.15.36:0/1758102912 >> v2:172.21.15.59:3300/0 conn(0x7f78d40ac9b0 0x7f78d414af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d1d9b700 1 -- 172.21.15.36:0/1758102912 >> v1:172.21.15.59:6789/0 conn(0x7f78d414ab80 legacy=0x7f78d40af1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d1d9b700 1 -- 172.21.15.36:0/1758102912 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d40aed20 con 0x7f78d40aff10 2022-01-10T01:31:25.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d1d9b700 1 --2- 172.21.15.36:0/1758102912 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78d40aff10 0x7f78d405f6b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f78bc002f70 tx=0x7f78bc006df0).ready entity=mon.0 client_cookie=c997eff985bb69e5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:25.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d159a700 1 -- 172.21.15.36:0/1758102912 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78bc00d570 con 0x7f78d40aff10 2022-01-10T01:31:25.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d159a700 1 -- 172.21.15.36:0/1758102912 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78bc000e90 con 0x7f78d40aff10 2022-01-10T01:31:25.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d159a700 1 -- 172.21.15.36:0/1758102912 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78bc00d8c0 con 0x7f78d40aff10 2022-01-10T01:31:25.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d894f700 1 -- 172.21.15.36:0/1758102912 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78d40aff10 msgr2=0x7f78d405f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d894f700 1 --2- 172.21.15.36:0/1758102912 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78d40aff10 0x7f78d405f6b0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f78bc002f70 tx=0x7f78bc006df0).stop 2022-01-10T01:31:25.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d894f700 1 -- 172.21.15.36:0/1758102912 shutdown_connections 2022-01-10T01:31:25.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d894f700 1 --2- 172.21.15.36:0/1758102912 >> v2:172.21.15.59:3300/0 conn(0x7f78d40ac9b0 0x7f78d414af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d894f700 1 --2- 172.21.15.36:0/1758102912 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78d40aff10 0x7f78d405f6b0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d894f700 1 -- 172.21.15.36:0/1758102912 >> 172.21.15.36:0/1758102912 conn(0x7f78d40b5570 msgr2=0x7f78d40b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:25.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d894f700 1 -- 172.21.15.36:0/1758102912 shutdown_connections 2022-01-10T01:31:25.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.433+0000 7f78d894f700 1 -- 172.21.15.36:0/1758102912 wait complete. 2022-01-10T01:31:25.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d894f700 1 Processor -- start 2022-01-10T01:31:25.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d894f700 1 -- start start 2022-01-10T01:31:25.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d894f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d40ac9b0 0x7f78d413fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d894f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78d40aff10 0x7f78d413b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d894f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78d414ab80 0x7f78d413bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d894f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d4142fd0 con 0x7f78d40aff10 2022-01-10T01:31:25.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d894f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d4141ba0 con 0x7f78d40ac9b0 2022-01-10T01:31:25.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d894f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d4143200 con 0x7f78d414ab80 2022-01-10T01:31:25.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d1d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78d40aff10 0x7f78d413b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d40ac9b0 0x7f78d413fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d2d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78d414ab80 0x7f78d413bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d1d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78d40aff10 0x7f78d413b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38954/0 (socket says 172.21.15.36:38954) 2022-01-10T01:31:25.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d1d9b700 1 -- 172.21.15.36:0/3688803373 learned_addr learned my addr 172.21.15.36:0/3688803373 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:25.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d1d9b700 1 -- 172.21.15.36:0/3688803373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78d414ab80 msgr2=0x7f78d413bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d1d9b700 1 --2- 172.21.15.36:0/3688803373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78d414ab80 0x7f78d413bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d1d9b700 1 -- 172.21.15.36:0/3688803373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d40ac9b0 msgr2=0x7f78d413fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d1d9b700 1 --2- 172.21.15.36:0/3688803373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d40ac9b0 0x7f78d413fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d1d9b700 1 -- 172.21.15.36:0/3688803373 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc00b180 con 0x7f78d40aff10 2022-01-10T01:31:25.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d2d9d700 1 --2- 172.21.15.36:0/3688803373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78d414ab80 0x7f78d413bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:25.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d259c700 1 --2- 172.21.15.36:0/3688803373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d40ac9b0 0x7f78d413fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:25.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.437+0000 7f78d1d9b700 1 --2- 172.21.15.36:0/3688803373 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78d40aff10 0x7f78d413b700 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f78bc002f70 tx=0x7f78bc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:25.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.441+0000 7f78cb7fe700 1 -- 172.21.15.36:0/3688803373 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78bc00dea0 con 0x7f78d40aff10 2022-01-10T01:31:25.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.441+0000 7f78cb7fe700 1 -- 172.21.15.36:0/3688803373 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78bc013e90 con 0x7f78d40aff10 2022-01-10T01:31:25.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.441+0000 7f78d894f700 1 -- 172.21.15.36:0/3688803373 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d41434a0 con 0x7f78d40aff10 2022-01-10T01:31:25.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.441+0000 7f78cb7fe700 1 -- 172.21.15.36:0/3688803373 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78bc01e5f0 con 0x7f78d40aff10 2022-01-10T01:31:25.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.441+0000 7f78d894f700 1 -- 172.21.15.36:0/3688803373 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d41439e0 con 0x7f78d40aff10 2022-01-10T01:31:25.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.441+0000 7f78d894f700 1 -- 172.21.15.36:0/3688803373 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d40af8d0 con 0x7f78d40aff10 2022-01-10T01:31:25.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.441+0000 7f78cb7fe700 1 -- 172.21.15.36:0/3688803373 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f78bc025030 con 0x7f78d40aff10 2022-01-10T01:31:25.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.441+0000 7f78cb7fe700 1 --2- 172.21.15.36:0/3688803373 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f78b8053680 0x7f78b8055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.441+0000 7f78cb7fe700 1 -- 172.21.15.36:0/3688803373 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f78bc06c880 con 0x7f78d40aff10 2022-01-10T01:31:25.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.441+0000 7f78d259c700 1 --2- 172.21.15.36:0/3688803373 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f78b8053680 0x7f78b8055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.445+0000 7f78d259c700 1 --2- 172.21.15.36:0/3688803373 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f78b8053680 0x7f78b8055b40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f78c400d000 tx=0x7f78c4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:25.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.449+0000 7f78cb7fe700 1 -- 172.21.15.36:0/3688803373 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f78bc043780 con 0x7f78d40aff10 2022-01-10T01:31:25.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.577+0000 7f78d894f700 1 -- 172.21.15.36:0/3688803373 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f78d4057350 con 0x7f78d40aff10 2022-01-10T01:31:25.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.577+0000 7f78cb7fe700 1 -- 172.21.15.36:0/3688803373 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v89) v1 ==== 92+0+10 (secure 0 0 0) 0x7f78bc0230a0 con 0x7f78d40aff10 2022-01-10T01:31:25.584 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:25.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.581+0000 7f78d894f700 1 -- 172.21.15.36:0/3688803373 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f78b8053680 msgr2=0x7f78b8055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.581+0000 7f78d894f700 1 --2- 172.21.15.36:0/3688803373 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f78b8053680 0x7f78b8055b40 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f78c400d000 tx=0x7f78c4009040).stop 2022-01-10T01:31:25.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.581+0000 7f78d894f700 1 -- 172.21.15.36:0/3688803373 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78d40aff10 msgr2=0x7f78d413b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.581+0000 7f78d894f700 1 --2- 172.21.15.36:0/3688803373 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78d40aff10 0x7f78d413b700 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f78bc002f70 tx=0x7f78bc014000).stop 2022-01-10T01:31:25.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.581+0000 7f78d894f700 1 -- 172.21.15.36:0/3688803373 shutdown_connections 2022-01-10T01:31:25.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.581+0000 7f78d894f700 1 --2- 172.21.15.36:0/3688803373 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f78b8053680 0x7f78b8055b40 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.581+0000 7f78d894f700 1 --2- 172.21.15.36:0/3688803373 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78d414ab80 0x7f78d413bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.581+0000 7f78d894f700 1 --2- 172.21.15.36:0/3688803373 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f78d40aff10 0x7f78d413b700 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.581+0000 7f78d894f700 1 --2- 172.21.15.36:0/3688803373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78d40ac9b0 0x7f78d413fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.581+0000 7f78d894f700 1 -- 172.21.15.36:0/3688803373 >> 172.21.15.36:0/3688803373 conn(0x7f78d40b5570 msgr2=0x7f78d413c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:25.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.581+0000 7f78d894f700 1 -- 172.21.15.36:0/3688803373 shutdown_connections 2022-01-10T01:31:25.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.581+0000 7f78d894f700 1 -- 172.21.15.36:0/3688803373 wait complete. 2022-01-10T01:31:25.603 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:31:25.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.701+0000 7f2ce231a700 1 Processor -- start 2022-01-10T01:31:25.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce231a700 1 -- start start 2022-01-10T01:31:25.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce231a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2cdc0ad5c0 0x7f2cdc061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce231a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2cdc140440 0x7f2cdc1408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce231a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cdc0aecf0 con 0x7f2cdc061320 2022-01-10T01:31:25.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce231a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cdc0b6f20 con 0x7f2cdc0ad5c0 2022-01-10T01:31:25.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce231a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc0aef20 con 0x7f2cdc140440 2022-01-10T01:31:25.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce0b17700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2cdc0ad5c0 0x7f2cdc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce1318700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f2cdc061320 0x7f2cdc0b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36752/0 (socket says 172.21.15.36:36752) 2022-01-10T01:31:25.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce1318700 1 -- 172.21.15.36:0/2548332690 learned_addr learned my addr 172.21.15.36:0/2548332690 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:25.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce0b17700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2cdc0ad5c0 0x7f2cdc061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38960/0 (socket says 172.21.15.36:38960) 2022-01-10T01:31:25.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce1b19700 1 --2- 172.21.15.36:0/2548332690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2cdc140440 0x7f2cdc1408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce0b17700 1 -- 172.21.15.36:0/2548332690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2cdc140440 msgr2=0x7f2cdc1408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:25.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce0b17700 1 --2- 172.21.15.36:0/2548332690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2cdc140440 0x7f2cdc1408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce0b17700 1 -- 172.21.15.36:0/2548332690 >> v1:172.21.15.36:6789/0 conn(0x7f2cdc061320 legacy=0x7f2cdc0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ccffff700 1 -- 172.21.15.36:0/2548332690 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362010989 0 0) 0x7f2cdc0aecf0 con 0x7f2cdc061320 2022-01-10T01:31:25.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce0b17700 1 -- 172.21.15.36:0/2548332690 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc0af1c0 con 0x7f2cdc0ad5c0 2022-01-10T01:31:25.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce1b19700 1 --2- 172.21.15.36:0/2548332690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2cdc140440 0x7f2cdc1408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:25.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce0b17700 1 --2- 172.21.15.36:0/2548332690 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2cdc0ad5c0 0x7f2cdc061700 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f2cd0002f70 tx=0x7f2cd0006df0).ready entity=mon.0 client_cookie=6648ab8b40cb6857 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:25.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ccffff700 1 -- 172.21.15.36:0/2548332690 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cd000d570 con 0x7f2cdc0ad5c0 2022-01-10T01:31:25.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ccffff700 1 -- 172.21.15.36:0/2548332690 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd0000e90 con 0x7f2cdc0ad5c0 2022-01-10T01:31:25.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ccffff700 1 -- 172.21.15.36:0/2548332690 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cd000d8c0 con 0x7f2cdc0ad5c0 2022-01-10T01:31:25.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce231a700 1 -- 172.21.15.36:0/2548332690 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2cdc0ad5c0 msgr2=0x7f2cdc061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce231a700 1 --2- 172.21.15.36:0/2548332690 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2cdc0ad5c0 0x7f2cdc061700 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f2cd0002f70 tx=0x7f2cd0006df0).stop 2022-01-10T01:31:25.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.705+0000 7f2ce231a700 1 -- 172.21.15.36:0/2548332690 shutdown_connections 2022-01-10T01:31:25.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.709+0000 7f2ce231a700 1 --2- 172.21.15.36:0/2548332690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2cdc140440 0x7f2cdc1408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.709+0000 7f2ce231a700 1 --2- 172.21.15.36:0/2548332690 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2cdc0ad5c0 0x7f2cdc061700 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.709+0000 7f2ce231a700 1 -- 172.21.15.36:0/2548332690 >> 172.21.15.36:0/2548332690 conn(0x7f2cdc066de0 msgr2=0x7f2cdc0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:25.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.709+0000 7f2ce231a700 1 -- 172.21.15.36:0/2548332690 shutdown_connections 2022-01-10T01:31:25.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.709+0000 7f2ce231a700 1 -- 172.21.15.36:0/2548332690 wait complete. 2022-01-10T01:31:25.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.709+0000 7f2ce231a700 1 Processor -- start 2022-01-10T01:31:25.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.709+0000 7f2ce231a700 1 -- start start 2022-01-10T01:31:25.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce231a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2cdc061320 0x7f2cdc152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce231a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2cdc0ad5c0 0x7f2cdc0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce231a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cdc140440 0x7f2cdc0abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce231a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc1531e0 con 0x7f2cdc061320 2022-01-10T01:31:25.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce231a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc0aab70 con 0x7f2cdc140440 2022-01-10T01:31:25.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce231a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc0b0ec0 con 0x7f2cdc0ad5c0 2022-01-10T01:31:25.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce1318700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2cdc061320 0x7f2cdc152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce1318700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2cdc061320 0x7f2cdc152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38964/0 (socket says 172.21.15.36:38964) 2022-01-10T01:31:25.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce1318700 1 -- 172.21.15.36:0/1522804754 learned_addr learned my addr 172.21.15.36:0/1522804754 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:25.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce1b19700 1 --2- 172.21.15.36:0/1522804754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cdc140440 0x7f2cdc0abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce0b17700 1 --2- 172.21.15.36:0/1522804754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2cdc0ad5c0 0x7f2cdc0b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce1318700 1 -- 172.21.15.36:0/1522804754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2cdc0ad5c0 msgr2=0x7f2cdc0b05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce1318700 1 --2- 172.21.15.36:0/1522804754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2cdc0ad5c0 0x7f2cdc0b05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce1318700 1 -- 172.21.15.36:0/1522804754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cdc140440 msgr2=0x7f2cdc0abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce1318700 1 --2- 172.21.15.36:0/1522804754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cdc140440 0x7f2cdc0abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce1318700 1 -- 172.21.15.36:0/1522804754 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd000b180 con 0x7f2cdc061320 2022-01-10T01:31:25.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce1318700 1 --2- 172.21.15.36:0/1522804754 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2cdc061320 0x7f2cdc152cf0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f2cd8000ed0 tx=0x7f2cd8007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:25.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2cce7fc700 1 -- 172.21.15.36:0/1522804754 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cd80070d0 con 0x7f2cdc061320 2022-01-10T01:31:25.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2cce7fc700 1 -- 172.21.15.36:0/1522804754 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd8007230 con 0x7f2cdc061320 2022-01-10T01:31:25.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce231a700 1 -- 172.21.15.36:0/1522804754 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cdc0aa390 con 0x7f2cdc061320 2022-01-10T01:31:25.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2cce7fc700 1 -- 172.21.15.36:0/1522804754 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cd8005610 con 0x7f2cdc061320 2022-01-10T01:31:25.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.713+0000 7f2ce231a700 1 -- 172.21.15.36:0/1522804754 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cdc0aa8d0 con 0x7f2cdc061320 2022-01-10T01:31:25.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.717+0000 7f2ce231a700 1 -- 172.21.15.36:0/1522804754 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cdc144350 con 0x7f2cdc061320 2022-01-10T01:31:25.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.717+0000 7f2cce7fc700 1 -- 172.21.15.36:0/1522804754 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2cd801a060 con 0x7f2cdc061320 2022-01-10T01:31:25.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.717+0000 7f2cce7fc700 1 --2- 172.21.15.36:0/1522804754 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2cc4053500 0x7f2cc40559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.717+0000 7f2cce7fc700 1 -- 172.21.15.36:0/1522804754 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2cd806af10 con 0x7f2cdc061320 2022-01-10T01:31:25.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.717+0000 7f2ce0b17700 1 --2- 172.21.15.36:0/1522804754 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2cc4053500 0x7f2cc40559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.717+0000 7f2ce0b17700 1 --2- 172.21.15.36:0/1522804754 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2cc4053500 0x7f2cc40559c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f2cd001c000 tx=0x7f2cd0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:25.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.721+0000 7f2cce7fc700 1 -- 172.21.15.36:0/1522804754 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2cd8041e10 con 0x7f2cdc061320 2022-01-10T01:31:25.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.849+0000 7f2ce231a700 1 -- 172.21.15.36:0/1522804754 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2cdc0af460 con 0x7f2cdc061320 2022-01-10T01:31:25.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.849+0000 7f2cce7fc700 1 -- 172.21.15.36:0/1522804754 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+10 (secure 0 0 0) 0x7f2cd8018020 con 0x7f2cdc061320 2022-01-10T01:31:25.854 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:25.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.853+0000 7f2ce231a700 1 -- 172.21.15.36:0/1522804754 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2cc4053500 msgr2=0x7f2cc40559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.853+0000 7f2ce231a700 1 --2- 172.21.15.36:0/1522804754 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2cc4053500 0x7f2cc40559c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f2cd001c000 tx=0x7f2cd0015000).stop 2022-01-10T01:31:25.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.853+0000 7f2ce231a700 1 -- 172.21.15.36:0/1522804754 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2cdc061320 msgr2=0x7f2cdc152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.853+0000 7f2ce231a700 1 --2- 172.21.15.36:0/1522804754 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2cdc061320 0x7f2cdc152cf0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f2cd8000ed0 tx=0x7f2cd8007ac0).stop 2022-01-10T01:31:25.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.853+0000 7f2ce231a700 1 -- 172.21.15.36:0/1522804754 shutdown_connections 2022-01-10T01:31:25.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.853+0000 7f2ce231a700 1 --2- 172.21.15.36:0/1522804754 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2cc4053500 0x7f2cc40559c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.853+0000 7f2ce231a700 1 --2- 172.21.15.36:0/1522804754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cdc140440 0x7f2cdc0abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.853+0000 7f2ce231a700 1 --2- 172.21.15.36:0/1522804754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2cdc0ad5c0 0x7f2cdc0b05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.853+0000 7f2ce231a700 1 --2- 172.21.15.36:0/1522804754 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2cdc061320 0x7f2cdc152cf0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.853+0000 7f2ce231a700 1 -- 172.21.15.36:0/1522804754 >> 172.21.15.36:0/1522804754 conn(0x7f2cdc066de0 msgr2=0x7f2cdc149210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:25.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.853+0000 7f2ce231a700 1 -- 172.21.15.36:0/1522804754 shutdown_connections 2022-01-10T01:31:25.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.853+0000 7f2ce231a700 1 -- 172.21.15.36:0/1522804754 wait complete. 2022-01-10T01:31:25.871 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:31:25.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.973+0000 7f9eb67c9700 1 Processor -- start 2022-01-10T01:31:25.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.973+0000 7f9eb67c9700 1 -- start start 2022-01-10T01:31:25.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.973+0000 7f9eb67c9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9eb0146950 0x7f9eb0140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.973+0000 7f9eb67c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb00b4180 0x7f9eb0140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.973+0000 7f9eb67c9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb0143b60 con 0x7f9eb00b4690 2022-01-10T01:31:25.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eb67c9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb0147510 con 0x7f9eb0146950 2022-01-10T01:31:25.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eb67c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb0143e00 con 0x7f9eb00b4180 2022-01-10T01:31:25.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb00b4180 0x7f9eb0140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9eb0146950 0x7f9eb0140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb00b4180 0x7f9eb0140720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:45256/0 (socket says 172.21.15.36:45256) 2022-01-10T01:31:25.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eb4d66700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9eb00b4690 0x7f9eb00b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:54446/0 (socket says 172.21.15.36:54446) 2022-01-10T01:31:25.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaf7fe700 1 -- 172.21.15.36:0/37441654 learned_addr learned my addr 172.21.15.36:0/37441654 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:25.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9eb0146950 0x7f9eb0140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:35606/0 (socket says 172.21.15.36:35606) 2022-01-10T01:31:25.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaffff700 1 -- 172.21.15.36:0/37441654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb00b4180 msgr2=0x7f9eb0140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:25.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaffff700 1 --2- 172.21.15.36:0/37441654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb00b4180 0x7f9eb0140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaffff700 1 -- 172.21.15.36:0/37441654 >> v1:172.21.15.59:6789/0 conn(0x7f9eb00b4690 legacy=0x7f9eb00b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaeffd700 1 -- 172.21.15.36:0/37441654 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1610222768 0 0) 0x7f9eb0143b60 con 0x7f9eb00b4690 2022-01-10T01:31:25.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaffff700 1 -- 172.21.15.36:0/37441654 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb00b0c90 con 0x7f9eb0146950 2022-01-10T01:31:25.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaf7fe700 1 --2- 172.21.15.36:0/37441654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb00b4180 0x7f9eb0140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:25.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaffff700 1 --2- 172.21.15.36:0/37441654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb0146950 0x7f9eb0140230 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f9ea4002f70 tx=0x7f9ea4006df0).ready entity=mon.1 client_cookie=73c4a3b7169fb6e4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:25.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaeffd700 1 -- 172.21.15.36:0/37441654 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ea400d570 con 0x7f9eb0146950 2022-01-10T01:31:25.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaeffd700 1 -- 172.21.15.36:0/37441654 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea4000e90 con 0x7f9eb0146950 2022-01-10T01:31:25.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eaeffd700 1 -- 172.21.15.36:0/37441654 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ea400d8c0 con 0x7f9eb0146950 2022-01-10T01:31:25.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eb67c9700 1 -- 172.21.15.36:0/37441654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb0146950 msgr2=0x7f9eb0140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eb67c9700 1 --2- 172.21.15.36:0/37441654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb0146950 0x7f9eb0140230 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f9ea4002f70 tx=0x7f9ea4006df0).stop 2022-01-10T01:31:25.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eb67c9700 1 -- 172.21.15.36:0/37441654 shutdown_connections 2022-01-10T01:31:25.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eb67c9700 1 --2- 172.21.15.36:0/37441654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb00b4180 0x7f9eb0140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eb67c9700 1 --2- 172.21.15.36:0/37441654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb0146950 0x7f9eb0140230 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eb67c9700 1 -- 172.21.15.36:0/37441654 >> 172.21.15.36:0/37441654 conn(0x7f9eb005c490 msgr2=0x7f9eb005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:25.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eb67c9700 1 -- 172.21.15.36:0/37441654 shutdown_connections 2022-01-10T01:31:25.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.977+0000 7f9eb67c9700 1 -- 172.21.15.36:0/37441654 wait complete. 2022-01-10T01:31:25.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.981+0000 7f9eb67c9700 1 Processor -- start 2022-01-10T01:31:25.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.981+0000 7f9eb67c9700 1 -- start start 2022-01-10T01:31:25.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.981+0000 7f9eb67c9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb00b4180 0x7f9eb00b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.981+0000 7f9eb67c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb00b4690 0x7f9eb0141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.981+0000 7f9eb67c9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9eb0146950 0x7f9eb0152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.981+0000 7f9eb67c9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00b8e50 con 0x7f9eb0146950 2022-01-10T01:31:25.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.981+0000 7f9eb67c9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb0140f80 con 0x7f9eb00b4180 2022-01-10T01:31:25.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.981+0000 7f9eb67c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb01411e0 con 0x7f9eb00b4690 2022-01-10T01:31:25.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9eb4d66700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9eb0146950 0x7f9eb0152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9eb4d66700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9eb0146950 0x7f9eb0152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38982/0 (socket says 172.21.15.36:38982) 2022-01-10T01:31:25.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9eaffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb00b4180 0x7f9eb00b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9eb4d66700 1 -- 172.21.15.36:0/1074929438 learned_addr learned my addr 172.21.15.36:0/1074929438 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:25.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9eaf7fe700 1 --2- 172.21.15.36:0/1074929438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb00b4690 0x7f9eb0141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9eb4d66700 1 -- 172.21.15.36:0/1074929438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb00b4690 msgr2=0x7f9eb0141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9eb4d66700 1 --2- 172.21.15.36:0/1074929438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb00b4690 0x7f9eb0141920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9eb4d66700 1 -- 172.21.15.36:0/1074929438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb00b4180 msgr2=0x7f9eb00b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:25.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9eb4d66700 1 --2- 172.21.15.36:0/1074929438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb00b4180 0x7f9eb00b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:25.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9eb4d66700 1 -- 172.21.15.36:0/1074929438 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea000b1e0 con 0x7f9eb0146950 2022-01-10T01:31:25.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9eb4d66700 1 --2- 172.21.15.36:0/1074929438 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9eb0146950 0x7f9eb0152290 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f9ea8001250 tx=0x7f9ea8007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:25.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9ead7fa700 1 -- 172.21.15.36:0/1074929438 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ea8005bb0 con 0x7f9eb0146950 2022-01-10T01:31:25.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9ead7fa700 1 -- 172.21.15.36:0/1074929438 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea8005d10 con 0x7f9eb0146950 2022-01-10T01:31:25.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9eb67c9700 1 -- 172.21.15.36:0/1074929438 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea400b180 con 0x7f9eb0146950 2022-01-10T01:31:25.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9ead7fa700 1 -- 172.21.15.36:0/1074929438 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ea80072c0 con 0x7f9eb0146950 2022-01-10T01:31:25.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9eb67c9700 1 -- 172.21.15.36:0/1074929438 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb0142dc0 con 0x7f9eb0146950 2022-01-10T01:31:25.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.985+0000 7f9eb67c9700 1 -- 172.21.15.36:0/1074929438 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb01423b0 con 0x7f9eb0146950 2022-01-10T01:31:25.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.989+0000 7f9ead7fa700 1 -- 172.21.15.36:0/1074929438 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9ea8010070 con 0x7f9eb0146950 2022-01-10T01:31:25.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.989+0000 7f9ead7fa700 1 --2- 172.21.15.36:0/1074929438 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e900535f0 0x7f9e90055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:25.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.989+0000 7f9ead7fa700 1 -- 172.21.15.36:0/1074929438 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9ea806b6e0 con 0x7f9eb0146950 2022-01-10T01:31:25.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.989+0000 7f9eaffff700 1 --2- 172.21.15.36:0/1074929438 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e900535f0 0x7f9e90055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:25.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.989+0000 7f9eaffff700 1 --2- 172.21.15.36:0/1074929438 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e900535f0 0x7f9e90055ab0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f9ea401a000 tx=0x7f9ea4014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:26.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:25.997+0000 7f9ead7fa700 1 -- 172.21.15.36:0/1074929438 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ea80425e0 con 0x7f9eb0146950 2022-01-10T01:31:26.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.121+0000 7f9eb67c9700 1 -- 172.21.15.36:0/1074929438 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9eb0057350 con 0x7f9eb0146950 2022-01-10T01:31:26.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.125+0000 7f9ead7fa700 1 -- 172.21.15.36:0/1074929438 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9ea8045c00 con 0x7f9eb0146950 2022-01-10T01:31:26.129 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:26.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.125+0000 7f9eb67c9700 1 -- 172.21.15.36:0/1074929438 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e900535f0 msgr2=0x7f9e90055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:26.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.125+0000 7f9eb67c9700 1 --2- 172.21.15.36:0/1074929438 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e900535f0 0x7f9e90055ab0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f9ea401a000 tx=0x7f9ea4014000).stop 2022-01-10T01:31:26.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.125+0000 7f9eb67c9700 1 -- 172.21.15.36:0/1074929438 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9eb0146950 msgr2=0x7f9eb0152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:26.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.125+0000 7f9eb67c9700 1 --2- 172.21.15.36:0/1074929438 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9eb0146950 0x7f9eb0152290 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f9ea8001250 tx=0x7f9ea8007db0).stop 2022-01-10T01:31:26.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.125+0000 7f9eb67c9700 1 -- 172.21.15.36:0/1074929438 shutdown_connections 2022-01-10T01:31:26.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.125+0000 7f9eb67c9700 1 --2- 172.21.15.36:0/1074929438 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e900535f0 0x7f9e90055ab0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:26.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.125+0000 7f9eb67c9700 1 --2- 172.21.15.36:0/1074929438 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9eb0146950 0x7f9eb0152290 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:26.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.125+0000 7f9eb67c9700 1 --2- 172.21.15.36:0/1074929438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9eb00b4690 0x7f9eb0141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:26.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.125+0000 7f9eb67c9700 1 --2- 172.21.15.36:0/1074929438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9eb00b4180 0x7f9eb00b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:26.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.125+0000 7f9eb67c9700 1 -- 172.21.15.36:0/1074929438 >> 172.21.15.36:0/1074929438 conn(0x7f9eb005c490 msgr2=0x7f9eb01449b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:26.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.125+0000 7f9eb67c9700 1 -- 172.21.15.36:0/1074929438 shutdown_connections 2022-01-10T01:31:26.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.125+0000 7f9eb67c9700 1 -- 172.21.15.36:0/1074929438 wait complete. 2022-01-10T01:31:26.147 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:31:26.147 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:26.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.245+0000 7f6531455700 1 Processor -- start 2022-01-10T01:31:26.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.245+0000 7f6531455700 1 -- start start 2022-01-10T01:31:26.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.245+0000 7f6531455700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f652c0a8ac0 0x7f652c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:26.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.245+0000 7f6531455700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652c0a70c0 con 0x7f652c0b0010 2022-01-10T01:31:26.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.245+0000 7f6531455700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652c0a72f0 con 0x7f652c0b2580 2022-01-10T01:31:26.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.245+0000 7f6531455700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652c0a7590 con 0x7f652c0a8ac0 2022-01-10T01:31:26.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.245+0000 7f652b7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f652c0b0010 0x7f652c0a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36780/0 (socket says 172.21.15.36:36780) 2022-01-10T01:31:26.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.245+0000 7f652b7fe700 1 -- 172.21.15.36:0/2756058783 learned_addr learned my addr 172.21.15.36:0/2756058783 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:26.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.245+0000 7f6530c54700 1 --2- 172.21.15.36:0/2756058783 >> v2:172.21.15.36:3300/0 conn(0x7f652c0a8ac0 0x7f652c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:26.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.245+0000 7f652affd700 1 -- 172.21.15.36:0/2756058783 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 970054409 0 0) 0x7f652c0a70c0 con 0x7f652c0b0010 2022-01-10T01:31:26.255 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.245+0000 7f652affd700 1 -- 172.21.15.36:0/2756058783 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6518003260 con 0x7f652c0b0010 2022-01-10T01:31:26.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.245+0000 7f6530c54700 1 -- 172.21.15.36:0/2756058783 >> v1:172.21.15.59:6789/0 conn(0x7f652c0b2580 legacy=0x7f652c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:26.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.245+0000 7f6530c54700 1 -- 172.21.15.36:0/2756058783 >> v1:172.21.15.36:6789/0 conn(0x7f652c0b0010 legacy=0x7f652c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:26.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.245+0000 7f6530c54700 1 -- 172.21.15.36:0/2756058783 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c0a7830 con 0x7f652c0a8ac0 2022-01-10T01:31:26.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6530c54700 1 --2- 172.21.15.36:0/2756058783 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f652c0a8ac0 0x7f652c152be0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f65240032f0 tx=0x7f65240091d0).ready entity=mon.0 client_cookie=1ca27fcf6e607f81 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:26.256 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f652affd700 1 -- 172.21.15.36:0/2756058783 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f652400b6c0 con 0x7f652c0a8ac0 2022-01-10T01:31:26.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f652affd700 1 -- 172.21.15.36:0/2756058783 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652400b820 con 0x7f652c0a8ac0 2022-01-10T01:31:26.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f652affd700 1 -- 172.21.15.36:0/2756058783 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f652400b990 con 0x7f652c0a8ac0 2022-01-10T01:31:26.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 -- 172.21.15.36:0/2756058783 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f652c0a8ac0 msgr2=0x7f652c152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:26.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 --2- 172.21.15.36:0/2756058783 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f652c0a8ac0 0x7f652c152be0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f65240032f0 tx=0x7f65240091d0).stop 2022-01-10T01:31:26.257 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 -- 172.21.15.36:0/2756058783 shutdown_connections 2022-01-10T01:31:26.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 --2- 172.21.15.36:0/2756058783 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f652c0a8ac0 0x7f652c152be0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:26.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 -- 172.21.15.36:0/2756058783 >> 172.21.15.36:0/2756058783 conn(0x7f652c060180 msgr2=0x7f652c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:26.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 -- 172.21.15.36:0/2756058783 shutdown_connections 2022-01-10T01:31:26.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 -- 172.21.15.36:0/2756058783 wait complete. 2022-01-10T01:31:26.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 Processor -- start 2022-01-10T01:31:26.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 -- start start 2022-01-10T01:31:26.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652c0a8ac0 0x7f652c0aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:26.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f652c0b0010 0x7f652c0aaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:26.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652c0b2580 0x7f652c0b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:26.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c0ac000 con 0x7f652c0b0010 2022-01-10T01:31:26.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c0b3680 con 0x7f652c0b2580 2022-01-10T01:31:26.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6531455700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652c0ac1e0 con 0x7f652c0a8ac0 2022-01-10T01:31:26.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f652b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f652c0b0010 0x7f652c0aaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:26.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f652b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f652c0b0010 0x7f652c0aaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:38992/0 (socket says 172.21.15.36:38992) 2022-01-10T01:31:26.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f652b7fe700 1 -- 172.21.15.36:0/2970155288 learned_addr learned my addr 172.21.15.36:0/2970155288 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:26.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f6530c54700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652c0b2580 0x7f652c0b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:26.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.249+0000 7f652bfff700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652c0a8ac0 0x7f652c0aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:26.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f652b7fe700 1 -- 172.21.15.36:0/2970155288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652c0a8ac0 msgr2=0x7f652c0aa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:26.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f652b7fe700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652c0a8ac0 0x7f652c0aa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:26.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f652b7fe700 1 -- 172.21.15.36:0/2970155288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652c0b2580 msgr2=0x7f652c0b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:26.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f652b7fe700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652c0b2580 0x7f652c0b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:26.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f652b7fe700 1 -- 172.21.15.36:0/2970155288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6524009470 con 0x7f652c0b0010 2022-01-10T01:31:26.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f6530c54700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652c0b2580 0x7f652c0b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:26.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f652bfff700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652c0a8ac0 0x7f652c0aa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:31:26.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f652b7fe700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f652c0b0010 0x7f652c0aaad0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f651c001110 tx=0x7f651c007a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:26.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f65297fa700 1 -- 172.21.15.36:0/2970155288 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f651c0070d0 con 0x7f652c0b0010 2022-01-10T01:31:26.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f65297fa700 1 -- 172.21.15.36:0/2970155288 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651c007230 con 0x7f652c0b0010 2022-01-10T01:31:26.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f6531455700 1 -- 172.21.15.36:0/2970155288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652c0ab370 con 0x7f652c0b0010 2022-01-10T01:31:26.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f65297fa700 1 -- 172.21.15.36:0/2970155288 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f651c005610 con 0x7f652c0b0010 2022-01-10T01:31:26.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f6531455700 1 -- 172.21.15.36:0/2970155288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652c0aafc0 con 0x7f652c0b0010 2022-01-10T01:31:26.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f6531455700 1 -- 172.21.15.36:0/2970155288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652c057350 con 0x7f652c0b0010 2022-01-10T01:31:26.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f65297fa700 1 -- 172.21.15.36:0/2970155288 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f651c01a060 con 0x7f652c0b0010 2022-01-10T01:31:26.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f65297fa700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f650c0535f0 0x7f650c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:26.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f65297fa700 1 -- 172.21.15.36:0/2970155288 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f651c06b2b0 con 0x7f652c0b0010 2022-01-10T01:31:26.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.253+0000 7f652bfff700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f650c0535f0 0x7f650c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:26.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.257+0000 7f652bfff700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f650c0535f0 0x7f650c055ab0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f6520008000 tx=0x7f6520009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:26.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.257+0000 7f65297fa700 1 -- 172.21.15.36:0/2970155288 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f651c0422c0 con 0x7f652c0b0010 2022-01-10T01:31:26.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.421+0000 7f6531455700 1 -- 172.21.15.36:0/2970155288 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f652c0698e0 con 0x7f652c0b0010 2022-01-10T01:31:26.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.421+0000 7f65297fa700 1 -- 172.21.15.36:0/2970155288 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f651c018070 con 0x7f652c0b0010 2022-01-10T01:31:26.425 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:26.426 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":40,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3902337896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3902337896},{"type":"v1","addr":"172.21.15.36:6835","nonce":3902337896}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6612,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6837/3131314479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":3131314479},{"type":"v1","addr":"172.21.15.36:6837","nonce":3131314479}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:31:18.134652+0000","modified":"2022-01-10T01:31:19.137223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6616":{"gid":6616,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3399412771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3399412771},{"type":"v1","addr":"172.21.15.59:6833","nonce":3399412771}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2022-01-10T01:31:26.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.421+0000 7f6531455700 1 -- 172.21.15.36:0/2970155288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f650c0535f0 msgr2=0x7f650c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:26.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.421+0000 7f6531455700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f650c0535f0 0x7f650c055ab0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f6520008000 tx=0x7f6520009040).stop 2022-01-10T01:31:26.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.421+0000 7f6531455700 1 -- 172.21.15.36:0/2970155288 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f652c0b0010 msgr2=0x7f652c0aaad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:26.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.421+0000 7f6531455700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f652c0b0010 0x7f652c0aaad0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f651c001110 tx=0x7f651c007a80).stop 2022-01-10T01:31:26.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.421+0000 7f6531455700 1 -- 172.21.15.36:0/2970155288 shutdown_connections 2022-01-10T01:31:26.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.421+0000 7f6531455700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f650c0535f0 0x7f650c055ab0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:26.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.421+0000 7f6531455700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f652c0b2580 0x7f652c0b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:26.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.421+0000 7f6531455700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f652c0b0010 0x7f652c0aaad0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:26.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.421+0000 7f6531455700 1 --2- 172.21.15.36:0/2970155288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f652c0a8ac0 0x7f652c0aa5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:26.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.421+0000 7f6531455700 1 -- 172.21.15.36:0/2970155288 >> 172.21.15.36:0/2970155288 conn(0x7f652c060180 msgr2=0x7f652c05cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:26.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.421+0000 7f6531455700 1 -- 172.21.15.36:0/2970155288 shutdown_connections 2022-01-10T01:31:26.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:26.421+0000 7f6531455700 1 -- 172.21.15.36:0/2970155288 wait complete. 2022-01-10T01:31:26.431 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 40 2022-01-10T01:31:26.740 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:31:18.134652+0000', 'modified': '2022-01-10T01:31:19.137223+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6616}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6616': {'gid': 6616, 'name': 'b', 'rank': 0, 'incarnation': 39, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/3399412771', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 3399412771}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 3399412771}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:31:26.741 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:31:26.741 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:31:26.864 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":6616,"want_state":"up:active","state":"up:active","rank_uptime":8.7095040160000003,"mdsmap_epoch":40,"osdmap_epoch":89,"osdmap_epoch_barrier":87,"uptime":13.004974554} 2022-01-10T01:31:26.865 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 6616, "mdsmap_epoch": 40, "osdmap_epoch": 89, "osdmap_epoch_barrier": 87, "rank_uptime": 8.709504016, "state": "up:active", "uptime": 13.004974554, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:31:26.866 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:31:26.866 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2022-01-10T01:31:26.867 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi166.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2022-01-10T01:31:26.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:26.868 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:26.876 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:31:26.894 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:31:26.894 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:31:26.905 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:31:26.906 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:31:26.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:26.908 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:31:26.956 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:31:26.957 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:26.960 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:31:26.977 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:31:26.978 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:31:27.038 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:31:27.039 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:2022-01-10T01:31:27.036+0000 7fdb06d06080 -1 init, newargv = 0x55cfb633bb60 newargc=9 2022-01-10T01:31:27.039 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14270]: starting ceph client 2022-01-10T01:31:27.040 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:31:27.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:27.041 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:31:27.049 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14270]: starting fuse 2022-01-10T01:31:28.148 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:31:28.167 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:31:28.167 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:31:28.225 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:31:28.226 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:31:28.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:28.228 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:31:28.235 INFO:teuthology.orchestra.run.smithi166.stdout:52 2022-01-10T01:31:28.235 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:31:28.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:28.236 DEBUG:teuthology.orchestra.run.smithi166:> sudo python3 -c ' 2022-01-10T01:31:28.237 DEBUG:teuthology.orchestra.run.smithi166:> import glob 2022-01-10T01:31:28.237 DEBUG:teuthology.orchestra.run.smithi166:> import re 2022-01-10T01:31:28.238 DEBUG:teuthology.orchestra.run.smithi166:> import os 2022-01-10T01:31:28.238 DEBUG:teuthology.orchestra.run.smithi166:> import subprocess 2022-01-10T01:31:28.239 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:31:28.239 DEBUG:teuthology.orchestra.run.smithi166:> def find_socket(client_name): 2022-01-10T01:31:28.240 DEBUG:teuthology.orchestra.run.smithi166:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2022-01-10T01:31:28.240 DEBUG:teuthology.orchestra.run.smithi166:> files = glob.glob(asok_path) 2022-01-10T01:31:28.241 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:31:28.241 DEBUG:teuthology.orchestra.run.smithi166:> # Given a non-glob path, it better be there 2022-01-10T01:31:28.242 DEBUG:teuthology.orchestra.run.smithi166:> if "*" not in asok_path: 2022-01-10T01:31:28.242 DEBUG:teuthology.orchestra.run.smithi166:> assert(len(files) == 1) 2022-01-10T01:31:28.242 DEBUG:teuthology.orchestra.run.smithi166:> return files[0] 2022-01-10T01:31:28.243 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:31:28.243 DEBUG:teuthology.orchestra.run.smithi166:> for f in files: 2022-01-10T01:31:28.244 DEBUG:teuthology.orchestra.run.smithi166:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:31:28.244 DEBUG:teuthology.orchestra.run.smithi166:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:31:28.245 DEBUG:teuthology.orchestra.run.smithi166:> return f 2022-01-10T01:31:28.245 DEBUG:teuthology.orchestra.run.smithi166:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:31:28.246 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:31:28.246 DEBUG:teuthology.orchestra.run.smithi166:> print(find_socket("client.1")) 2022-01-10T01:31:28.246 DEBUG:teuthology.orchestra.run.smithi166:> ' 2022-01-10T01:31:28.290 INFO:teuthology.orchestra.run.smithi166.stdout:/var/run/ceph/ceph-client.1.14270.asok 2022-01-10T01:31:28.295 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14270.asok 2022-01-10T01:31:28.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:28.296 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14270.asok status 2022-01-10T01:31:28.387 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2022-01-10T01:31:28.387 INFO:teuthology.orchestra.run.smithi166.stdout: "metadata": { 2022-01-10T01:31:28.388 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:31:28.388 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:31:28.388 INFO:teuthology.orchestra.run.smithi166.stdout: "entity_id": "1", 2022-01-10T01:31:28.388 INFO:teuthology.orchestra.run.smithi166.stdout: "hostname": "smithi166", 2022-01-10T01:31:28.389 INFO:teuthology.orchestra.run.smithi166.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2022-01-10T01:31:28.389 INFO:teuthology.orchestra.run.smithi166.stdout: "pid": "14270", 2022-01-10T01:31:28.389 INFO:teuthology.orchestra.run.smithi166.stdout: "root": "/" 2022-01-10T01:31:28.389 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:31:28.390 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_count": 0, 2022-01-10T01:31:28.390 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_pinned_count": 0, 2022-01-10T01:31:28.390 INFO:teuthology.orchestra.run.smithi166.stdout: "id": 6825, 2022-01-10T01:31:28.390 INFO:teuthology.orchestra.run.smithi166.stdout: "inst": { 2022-01-10T01:31:28.391 INFO:teuthology.orchestra.run.smithi166.stdout: "name": { 2022-01-10T01:31:28.391 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "client", 2022-01-10T01:31:28.391 INFO:teuthology.orchestra.run.smithi166.stdout: "num": 6825 2022-01-10T01:31:28.392 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:31:28.392 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:31:28.392 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:31:28.392 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:31:28.393 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 1521190756 2022-01-10T01:31:28.393 INFO:teuthology.orchestra.run.smithi166.stdout: } 2022-01-10T01:31:28.393 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:31:28.393 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:31:28.394 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:31:28.394 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:31:28.394 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 1521190756 2022-01-10T01:31:28.394 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:31:28.395 INFO:teuthology.orchestra.run.smithi166.stdout: "inst_str": "client.6825 172.21.15.166:0/1521190756", 2022-01-10T01:31:28.395 INFO:teuthology.orchestra.run.smithi166.stdout: "addr_str": "172.21.15.166:0/1521190756", 2022-01-10T01:31:28.395 INFO:teuthology.orchestra.run.smithi166.stdout: "inode_count": 1, 2022-01-10T01:31:28.395 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_epoch": 40, 2022-01-10T01:31:28.395 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch": 89, 2022-01-10T01:31:28.396 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:31:28.396 INFO:teuthology.orchestra.run.smithi166.stdout: "blacklisted": false, 2022-01-10T01:31:28.396 INFO:teuthology.orchestra.run.smithi166.stdout: "fs_name": "cephfs" 2022-01-10T01:31:28.396 INFO:teuthology.orchestra.run.smithi166.stdout:} 2022-01-10T01:31:28.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:28.398 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:28.399 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:28.407 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:31:28.408 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:31:28.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:28.409 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:28.468 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:28.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.576+0000 7fe455f56700 1 Processor -- start 2022-01-10T01:31:28.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.576+0000 7fe455f56700 1 -- start start 2022-01-10T01:31:28.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.576+0000 7fe455f56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4500ad5c0 0x7fe450061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:28.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.576+0000 7fe455f56700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4500aecf0 con 0x7fe450140440 2022-01-10T01:31:28.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.576+0000 7fe455f56700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4500b6f20 con 0x7fe450061320 2022-01-10T01:31:28.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.576+0000 7fe455f56700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4500aef20 con 0x7fe4500ad5c0 2022-01-10T01:31:28.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.576+0000 7fe455755700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe450140440 0x7fe450146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36798/0 (socket says 172.21.15.36:36798) 2022-01-10T01:31:28.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.576+0000 7fe455755700 1 -- 172.21.15.36:0/2310983076 learned_addr learned my addr 172.21.15.36:0/2310983076 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:28.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.576+0000 7fe44ffff700 1 --2- 172.21.15.36:0/2310983076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4500ad5c0 0x7fe450061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:28.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.576+0000 7fe44f7fe700 1 -- 172.21.15.36:0/2310983076 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576464029 0 0) 0x7fe4500aecf0 con 0x7fe450140440 2022-01-10T01:31:28.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.576+0000 7fe44f7fe700 1 -- 172.21.15.36:0/2310983076 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe43c003260 con 0x7fe450140440 2022-01-10T01:31:28.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe44f7fe700 1 -- 172.21.15.36:0/2310983076 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55108740 0 0) 0x7fe4500b6f20 con 0x7fe450061320 2022-01-10T01:31:28.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe44ffff700 1 -- 172.21.15.36:0/2310983076 >> v1:172.21.15.59:6789/0 conn(0x7fe450061320 legacy=0x7fe4500b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:28.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe44ffff700 1 -- 172.21.15.36:0/2310983076 >> v1:172.21.15.36:6789/0 conn(0x7fe450140440 legacy=0x7fe450146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:28.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe44ffff700 1 -- 172.21.15.36:0/2310983076 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4500af1c0 con 0x7fe4500ad5c0 2022-01-10T01:31:28.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe44ffff700 1 --2- 172.21.15.36:0/2310983076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4500ad5c0 0x7fe450061700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe440002f70 tx=0x7fe440006df0).ready entity=mon.2 client_cookie=7cdf34a3d076ebbd server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:28.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe44f7fe700 1 -- 172.21.15.36:0/2310983076 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe44000d570 con 0x7fe4500ad5c0 2022-01-10T01:31:28.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe44f7fe700 1 -- 172.21.15.36:0/2310983076 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe440000e90 con 0x7fe4500ad5c0 2022-01-10T01:31:28.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe44f7fe700 1 -- 172.21.15.36:0/2310983076 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe44000d8c0 con 0x7fe4500ad5c0 2022-01-10T01:31:28.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe455f56700 1 -- 172.21.15.36:0/2310983076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4500ad5c0 msgr2=0x7fe450061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:28.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe455f56700 1 --2- 172.21.15.36:0/2310983076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4500ad5c0 0x7fe450061700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fe440002f70 tx=0x7fe440006df0).stop 2022-01-10T01:31:28.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe455f56700 1 -- 172.21.15.36:0/2310983076 shutdown_connections 2022-01-10T01:31:28.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe455f56700 1 --2- 172.21.15.36:0/2310983076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4500ad5c0 0x7fe450061700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:28.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe455f56700 1 -- 172.21.15.36:0/2310983076 >> 172.21.15.36:0/2310983076 conn(0x7fe450066de0 msgr2=0x7fe4500671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:28.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe455f56700 1 -- 172.21.15.36:0/2310983076 shutdown_connections 2022-01-10T01:31:28.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe455f56700 1 -- 172.21.15.36:0/2310983076 wait complete. 2022-01-10T01:31:28.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe455f56700 1 Processor -- start 2022-01-10T01:31:28.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.580+0000 7fe455f56700 1 -- start start 2022-01-10T01:31:28.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe455f56700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe450061320 0x7fe4500ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:28.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe455f56700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4500ad5c0 0x7fe4500aab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:28.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe455f56700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe450140440 0x7fe450148a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:28.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe455f56700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4500abac0 con 0x7fe4500ad5c0 2022-01-10T01:31:28.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe455f56700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4500ab050 con 0x7fe450140440 2022-01-10T01:31:28.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe455f56700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe450152ef0 con 0x7fe450061320 2022-01-10T01:31:28.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe44ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4500ad5c0 0x7fe4500aab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:28.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe44ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4500ad5c0 0x7fe4500aab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39008/0 (socket says 172.21.15.36:39008) 2022-01-10T01:31:28.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe44ffff700 1 -- 172.21.15.36:0/466086238 learned_addr learned my addr 172.21.15.36:0/466086238 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:28.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe454f54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe450061320 0x7fe4500ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:28.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe455755700 1 --2- 172.21.15.36:0/466086238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe450140440 0x7fe450148a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:28.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe44ffff700 1 -- 172.21.15.36:0/466086238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe450061320 msgr2=0x7fe4500ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:28.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe44ffff700 1 --2- 172.21.15.36:0/466086238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe450061320 0x7fe4500ac2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:28.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe44ffff700 1 -- 172.21.15.36:0/466086238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe450140440 msgr2=0x7fe450148a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:28.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe44ffff700 1 --2- 172.21.15.36:0/466086238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe450140440 0x7fe450148a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:28.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe44ffff700 1 -- 172.21.15.36:0/466086238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44000b180 con 0x7fe4500ad5c0 2022-01-10T01:31:28.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe454f54700 1 --2- 172.21.15.36:0/466086238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe450061320 0x7fe4500ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:28.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe44ffff700 1 --2- 172.21.15.36:0/466086238 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4500ad5c0 0x7fe4500aab60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7fe440002f70 tx=0x7fe440014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:28.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe44dffb700 1 -- 172.21.15.36:0/466086238 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe440016070 con 0x7fe4500ad5c0 2022-01-10T01:31:28.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe44dffb700 1 -- 172.21.15.36:0/466086238 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4400137d0 con 0x7fe4500ad5c0 2022-01-10T01:31:28.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe455f56700 1 -- 172.21.15.36:0/466086238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4500ab820 con 0x7fe4500ad5c0 2022-01-10T01:31:28.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe44dffb700 1 -- 172.21.15.36:0/466086238 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe440013b30 con 0x7fe4500ad5c0 2022-01-10T01:31:28.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.584+0000 7fe455f56700 1 -- 172.21.15.36:0/466086238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe450148f20 con 0x7fe4500ad5c0 2022-01-10T01:31:28.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.588+0000 7fe455f56700 1 -- 172.21.15.36:0/466086238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe450152d20 con 0x7fe4500ad5c0 2022-01-10T01:31:28.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.588+0000 7fe44dffb700 1 -- 172.21.15.36:0/466086238 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe44000f030 con 0x7fe4500ad5c0 2022-01-10T01:31:28.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.588+0000 7fe44dffb700 1 --2- 172.21.15.36:0/466086238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe4300534d0 0x7fe430055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:28.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.588+0000 7fe44dffb700 1 -- 172.21.15.36:0/466086238 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe44006c5f0 con 0x7fe4500ad5c0 2022-01-10T01:31:28.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.588+0000 7fe454f54700 1 --2- 172.21.15.36:0/466086238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe4300534d0 0x7fe430055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:28.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.588+0000 7fe454f54700 1 --2- 172.21.15.36:0/466086238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe4300534d0 0x7fe430055990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fe44400d000 tx=0x7fe444009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:28.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.596+0000 7fe44dffb700 1 -- 172.21.15.36:0/466086238 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe440043600 con 0x7fe4500ad5c0 2022-01-10T01:31:28.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.776+0000 7fe455f56700 1 -- 172.21.15.36:0/466086238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe450057350 con 0x7fe4500ad5c0 2022-01-10T01:31:28.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.776+0000 7fe44dffb700 1 -- 172.21.15.36:0/466086238 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fe440023090 con 0x7fe4500ad5c0 2022-01-10T01:31:28.783 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:28.784 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":40,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3902337896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3902337896},{"type":"v1","addr":"172.21.15.36:6835","nonce":3902337896}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6612,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6837/3131314479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":3131314479},{"type":"v1","addr":"172.21.15.36:6837","nonce":3131314479}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:31:18.134652+0000","modified":"2022-01-10T01:31:19.137223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6616":{"gid":6616,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3399412771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3399412771},{"type":"v1","addr":"172.21.15.59:6833","nonce":3399412771}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2022-01-10T01:31:28.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.780+0000 7fe455f56700 1 -- 172.21.15.36:0/466086238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe4300534d0 msgr2=0x7fe430055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:28.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.780+0000 7fe455f56700 1 --2- 172.21.15.36:0/466086238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe4300534d0 0x7fe430055990 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fe44400d000 tx=0x7fe444009040).stop 2022-01-10T01:31:28.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.780+0000 7fe455f56700 1 -- 172.21.15.36:0/466086238 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4500ad5c0 msgr2=0x7fe4500aab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:28.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.780+0000 7fe455f56700 1 --2- 172.21.15.36:0/466086238 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4500ad5c0 0x7fe4500aab60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7fe440002f70 tx=0x7fe440014000).stop 2022-01-10T01:31:28.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.780+0000 7fe455f56700 1 -- 172.21.15.36:0/466086238 shutdown_connections 2022-01-10T01:31:28.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.780+0000 7fe455f56700 1 --2- 172.21.15.36:0/466086238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe4300534d0 0x7fe430055990 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:28.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.780+0000 7fe455f56700 1 --2- 172.21.15.36:0/466086238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe450140440 0x7fe450148a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:28.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.780+0000 7fe455f56700 1 --2- 172.21.15.36:0/466086238 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4500ad5c0 0x7fe4500aab60 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:28.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.780+0000 7fe455f56700 1 --2- 172.21.15.36:0/466086238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe450061320 0x7fe4500ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:28.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.780+0000 7fe455f56700 1 -- 172.21.15.36:0/466086238 >> 172.21.15.36:0/466086238 conn(0x7fe450066de0 msgr2=0x7fe450146650 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:28.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.780+0000 7fe455f56700 1 -- 172.21.15.36:0/466086238 shutdown_connections 2022-01-10T01:31:28.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:28.780+0000 7fe455f56700 1 -- 172.21.15.36:0/466086238 wait complete. 2022-01-10T01:31:28.789 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 40 2022-01-10T01:31:28.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump inode 1 2022-01-10T01:31:28.916 INFO:teuthology.orchestra.run.smithi059.stdout:{"path":"/","ino":1,"rdev":0,"ctime":"2022-01-10T01:31:28.466469+0000","btime":"2022-01-10T01:31:18.141406+0000","mode":17407,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":16,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":0,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2022-01-10T01:31:18.141406+0000","atime":"0.000000","time_warp_seq":0,"change_attr":2,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2022-01-10T01:31:28.466469+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2022-01-10T01:31:18.141406+0000"},"version":4,"file_data_version":0,"xattr_version":1,"backtrace_version":3,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent"],"client_caps":[{"client_id":6777,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2},{"client_id":6825,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2}],"loner":-1,"want_loner":-1,"mds_caps_wanted":[]} 2022-01-10T01:31:28.917 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "2022-01-10T01:31:18.141406+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "0.000000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 3, "btime": "2022-01-10T01:31:18.141406+0000", "change_attr": 2, "client_caps": [ { "client_id": 6777, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" }, { "client_id": 6825, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" } ], "client_ranges": [], "ctime": "2022-01-10T01:31:28.466469+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 0, "ino": 1, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 16, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 17407, "mtime": "2022-01-10T01:31:18.141406+0000", "nestlock": {}, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/", "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2022-01-10T01:31:28.466469+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "uid": 0, "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2022-01-10T01:31:28.917 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:31:28.918 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:28.940 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:28.958 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:28.979 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:29.000 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:31:29.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:29.001 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:29.001 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:29.031 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:31:29.032 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:31:29.032 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:31:29.033 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:31:29.033 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:29.047 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14774]: fuse finished with error 0 and tester_r 0 2022-01-10T01:31:29.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:29.050 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:29.051 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:29.057 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:31:29.058 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:31:29.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:31:29.177 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:29.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:29.227 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:29.227 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:29.236 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:31:29.237 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:31:29.237 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi166.front.sepia.ceph.com... 2022-01-10T01:31:29.238 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:31:29.238 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:29.293 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14270]: fuse finished with error 0 and tester_r 0 2022-01-10T01:31:29.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:29.296 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:29.296 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:29.304 INFO:teuthology.orchestra.run.smithi166.stdout:ext2/ext3 2022-01-10T01:31:29.305 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:31:29.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:31:29.424 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:29.473 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:31:29.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.576+0000 7fad228e3700 1 Processor -- start 2022-01-10T01:31:29.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.576+0000 7fad228e3700 1 -- start start 2022-01-10T01:31:29.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.576+0000 7fad228e3700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fad1c0b6900 0x7fad1c0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:29.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.576+0000 7fad228e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad1c0aa5d0 0x7fad1c13c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:29.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.576+0000 7fad228e3700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad1c0b6ce0 con 0x7fad1c060910 2022-01-10T01:31:29.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.576+0000 7fad228e3700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1c0611e0 con 0x7fad1c0b6900 2022-01-10T01:31:29.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.576+0000 7fad228e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c061480 con 0x7fad1c0aa5d0 2022-01-10T01:31:29.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.576+0000 7fad1bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fad1c0b6900 0x7fad1c0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:29.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.576+0000 7fad1b7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fad1c060910 0x7fad1c0a9ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36808/0 (socket says 172.21.15.36:36808) 2022-01-10T01:31:29.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.576+0000 7fad1b7fe700 1 -- 172.21.15.36:0/2375235677 learned_addr learned my addr 172.21.15.36:0/2375235677 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:29.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad20e80700 1 --2- 172.21.15.36:0/2375235677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad1c0aa5d0 0x7fad1c13c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:29.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad1bfff700 1 -- 172.21.15.36:0/2375235677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad1c0aa5d0 msgr2=0x7fad1c13c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:29.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad1bfff700 1 --2- 172.21.15.36:0/2375235677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad1c0aa5d0 0x7fad1c13c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:29.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad1bfff700 1 -- 172.21.15.36:0/2375235677 >> v1:172.21.15.36:6789/0 conn(0x7fad1c060910 legacy=0x7fad1c0a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:29.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad1bfff700 1 -- 172.21.15.36:0/2375235677 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c061720 con 0x7fad1c0b6900 2022-01-10T01:31:29.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad1affd700 1 -- 172.21.15.36:0/2375235677 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998955387 0 0) 0x7fad1c0b6ce0 con 0x7fad1c060910 2022-01-10T01:31:29.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad1bfff700 1 --2- 172.21.15.36:0/2375235677 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad1c0b6900 0x7fad1c0acd50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fad10002f70 tx=0x7fad10006df0).ready entity=mon.0 client_cookie=8ab9eabebcdfb068 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:29.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad1affd700 1 -- 172.21.15.36:0/2375235677 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad1000d570 con 0x7fad1c0b6900 2022-01-10T01:31:29.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad1affd700 1 -- 172.21.15.36:0/2375235677 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad10000e90 con 0x7fad1c0b6900 2022-01-10T01:31:29.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad1affd700 1 -- 172.21.15.36:0/2375235677 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad1000d8c0 con 0x7fad1c0b6900 2022-01-10T01:31:29.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad228e3700 1 -- 172.21.15.36:0/2375235677 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad1c0b6900 msgr2=0x7fad1c0acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:29.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad228e3700 1 --2- 172.21.15.36:0/2375235677 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad1c0b6900 0x7fad1c0acd50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fad10002f70 tx=0x7fad10006df0).stop 2022-01-10T01:31:29.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad228e3700 1 -- 172.21.15.36:0/2375235677 shutdown_connections 2022-01-10T01:31:29.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad228e3700 1 --2- 172.21.15.36:0/2375235677 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad1c0aa5d0 0x7fad1c13c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:29.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad228e3700 1 --2- 172.21.15.36:0/2375235677 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad1c0b6900 0x7fad1c0acd50 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:29.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad228e3700 1 -- 172.21.15.36:0/2375235677 >> 172.21.15.36:0/2375235677 conn(0x7fad1c0b3480 msgr2=0x7fad1c0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:29.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad228e3700 1 -- 172.21.15.36:0/2375235677 shutdown_connections 2022-01-10T01:31:29.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.580+0000 7fad228e3700 1 -- 172.21.15.36:0/2375235677 wait complete. 2022-01-10T01:31:29.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad228e3700 1 Processor -- start 2022-01-10T01:31:29.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad228e3700 1 -- start start 2022-01-10T01:31:29.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad228e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c060910 0x7fad1c140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:29.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad228e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad1c0aa5d0 0x7fad1c152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:29.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad228e3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad1c0b6900 0x7fad1c13e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:29.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad228e3700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c13dd10 con 0x7fad1c0b6900 2022-01-10T01:31:29.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad228e3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c13ece0 con 0x7fad1c060910 2022-01-10T01:31:29.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad228e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c1432a0 con 0x7fad1c0aa5d0 2022-01-10T01:31:29.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad20e80700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad1c0b6900 0x7fad1c13e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:29.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad20e80700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad1c0b6900 0x7fad1c13e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39024/0 (socket says 172.21.15.36:39024) 2022-01-10T01:31:29.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad20e80700 1 -- 172.21.15.36:0/1068399378 learned_addr learned my addr 172.21.15.36:0/1068399378 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:29.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad1bfff700 1 --2- 172.21.15.36:0/1068399378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c060910 0x7fad1c140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:29.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad1b7fe700 1 --2- 172.21.15.36:0/1068399378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad1c0aa5d0 0x7fad1c152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:29.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad20e80700 1 -- 172.21.15.36:0/1068399378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad1c0aa5d0 msgr2=0x7fad1c152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:29.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad20e80700 1 --2- 172.21.15.36:0/1068399378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad1c0aa5d0 0x7fad1c152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:29.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad20e80700 1 -- 172.21.15.36:0/1068399378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c060910 msgr2=0x7fad1c140ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:29.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad20e80700 1 --2- 172.21.15.36:0/1068399378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c060910 0x7fad1c140ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:29.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad20e80700 1 -- 172.21.15.36:0/1068399378 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1000b180 con 0x7fad1c0b6900 2022-01-10T01:31:29.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad20e80700 1 --2- 172.21.15.36:0/1068399378 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad1c0b6900 0x7fad1c13e330 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7fad1c13de50 tx=0x7fad1400a370).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:29.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad197fa700 1 -- 172.21.15.36:0/1068399378 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad1400eee0 con 0x7fad1c0b6900 2022-01-10T01:31:29.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad197fa700 1 -- 172.21.15.36:0/1068399378 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1400c950 con 0x7fad1c0b6900 2022-01-10T01:31:29.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad228e3700 1 -- 172.21.15.36:0/1068399378 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1c13d610 con 0x7fad1c0b6900 2022-01-10T01:31:29.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad197fa700 1 -- 172.21.15.36:0/1068399378 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad1400ccb0 con 0x7fad1c0b6900 2022-01-10T01:31:29.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.584+0000 7fad228e3700 1 -- 172.21.15.36:0/1068399378 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1c153330 con 0x7fad1c0b6900 2022-01-10T01:31:29.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.588+0000 7fad197fa700 1 -- 172.21.15.36:0/1068399378 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fad14021070 con 0x7fad1c0b6900 2022-01-10T01:31:29.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.588+0000 7fad228e3700 1 -- 172.21.15.36:0/1068399378 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1c13da00 con 0x7fad1c0b6900 2022-01-10T01:31:29.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.588+0000 7fad197fa700 1 --2- 172.21.15.36:0/1068399378 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7facfc053680 0x7facfc055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:29.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.588+0000 7fad197fa700 1 -- 172.21.15.36:0/1068399378 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fad1406bdd0 con 0x7fad1c0b6900 2022-01-10T01:31:29.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.588+0000 7fad1bfff700 1 --2- 172.21.15.36:0/1068399378 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7facfc053680 0x7facfc055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:29.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.588+0000 7fad1bfff700 1 --2- 172.21.15.36:0/1068399378 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7facfc053680 0x7facfc055b40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fad10018000 tx=0x7fad10014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:29.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.596+0000 7fad197fa700 1 -- 172.21.15.36:0/1068399378 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fad14042de0 con 0x7fad1c0b6900 2022-01-10T01:31:29.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.724+0000 7fad228e3700 1 -- 172.21.15.36:0/1068399378 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fad1c0619c0 con 0x7fad1c0b6900 2022-01-10T01:31:29.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.724+0000 7fad197fa700 1 -- 172.21.15.36:0/1068399378 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v89) v1 ==== 81+0+34040 (secure 0 0 0) 0x7fad14015070 con 0x7fad1c0b6900 2022-01-10T01:31:29.732 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:29.732 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:31:29.732 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 89, 2022-01-10T01:31:29.733 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:31:29.733 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:31:29.733 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:31:20.489200+0000", 2022-01-10T01:31:29.733 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:31:29.734 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:31:29.734 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:31:29.734 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:31:29.734 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:31:29.735 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:31:29.735 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:31:29.735 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:31:29.735 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:31:29.735 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:29.736 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:31:29.736 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:31:29.736 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:31:29.736 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:31:29.737 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:31:29.737 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 16, 2022-01-10T01:31:29.737 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:31:29.737 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:31:29.737 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:31:29.738 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:31:29.738 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:31:29.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.738 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:31:29.739 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:31:29.739 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:31:29.739 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:29.739 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:29.740 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:29.740 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:29.740 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:29.740 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:29.740 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:29.741 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:29.741 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:31:29.741 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:31:29.741 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:31:29.741 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:31:29.742 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:31:29.742 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:29.742 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:29.742 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:29.743 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:29.743 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:29.743 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:29.743 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:29.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.744 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:31:29.744 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:29.744 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:29.744 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:29.744 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:29.745 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:29.745 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:29.745 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:29.745 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:29.746 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:29.746 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:29.746 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:29.746 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:29.746 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:29.747 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:29.747 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:29.747 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:29.747 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:29.747 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:29.748 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:29.748 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:29.748 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:29.748 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:29.749 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:29.749 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:29.749 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:29.749 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:29.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.750 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:29.750 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:29.750 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:29.750 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:29.750 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:29.751 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:29.751 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:29.751 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:29.751 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:29.752 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:29.752 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:29.752 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:31:29.752 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:31:29.752 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.753 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:29.753 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:31:29.753 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.753 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.753 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.754 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:31:29.754 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:31:29.754 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:31:29.754 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:29.755 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:29.755 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:29.755 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:29.755 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:29.755 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:29.756 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:29.756 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:29.756 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:31:29.756 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:31:29.757 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:31:29.757 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:31:29.757 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:31:29.757 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:29.757 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:29.758 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:29.758 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:29.758 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:29.758 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:29.759 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:29.759 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.759 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:31:29.759 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:29.759 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:29.760 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:29.760 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:29.760 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:29.760 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:29.761 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:29.761 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:29.761 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:29.761 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:29.761 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:29.762 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:29.762 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:29.762 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:29.762 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:29.763 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:29.763 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:29.763 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:29.763 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:29.763 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:29.764 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:29.764 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:29.764 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:29.764 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:29.764 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:29.765 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:29.765 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.765 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:29.765 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:29.766 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:29.766 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:29.766 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:29.766 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:29.767 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:29.767 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:29.767 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:29.767 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:29.768 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:29.768 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:31:29.768 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:29.768 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:31:29.768 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.769 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.769 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 15, 2022-01-10T01:31:29.769 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_metadata", 2022-01-10T01:31:29.770 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:31:16.698671+0000", 2022-01-10T01:31:29.770 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:29.770 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:29.770 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:29.771 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:29.771 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:29.771 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:29.771 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:29.771 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:29.772 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:31:29.772 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:31:29.772 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:31:29.772 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:31:29.772 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:31:29.773 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:29.773 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:29.773 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:29.773 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:29.774 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:29.774 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:29.774 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:29.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.774 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "88", 2022-01-10T01:31:29.775 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:29.775 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:29.775 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:29.775 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:29.776 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:29.776 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:29.776 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:29.776 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:29.776 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:29.777 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:29.777 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:29.777 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:29.777 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:29.778 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:29.778 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:29.778 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:29.778 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:29.778 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:29.779 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:29.779 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:29.779 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:29.779 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:29.780 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:29.780 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:29.780 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:29.780 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:29.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.781 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:29.781 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:29.781 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:29.781 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:29.781 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:29.782 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:29.782 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:29.782 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:29.782 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:29.783 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:29.783 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:29.783 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:31:29.783 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_bias": 4, 2022-01-10T01:31:29.784 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 16, 2022-01-10T01:31:29.784 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_priority": 5 2022-01-10T01:31:29.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.784 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:29.784 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:31:29.785 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": "cephfs" 2022-01-10T01:31:29.785 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.785 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.786 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.786 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 16, 2022-01-10T01:31:29.786 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_data", 2022-01-10T01:31:29.786 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:31:17.811890+0000", 2022-01-10T01:31:29.786 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:29.787 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:29.787 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:29.787 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:29.787 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:29.788 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:29.788 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:29.788 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:29.788 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:31:29.788 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:31:29.789 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:31:29.789 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:31:29.789 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:31:29.789 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:29.789 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:29.790 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:29.790 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:29.790 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:29.790 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:29.790 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:29.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.791 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "89", 2022-01-10T01:31:29.791 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:29.791 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:29.792 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:29.792 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:29.792 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:29.792 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:29.792 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:29.793 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:29.793 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:29.793 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:29.793 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:29.793 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:29.794 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:29.794 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:29.794 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:29.794 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:29.795 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:29.795 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:29.795 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:29.795 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:29.796 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:29.796 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:29.796 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:29.796 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:29.796 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:29.797 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:29.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.797 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:29.797 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:29.797 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:29.798 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:29.798 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:29.798 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:29.798 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:29.799 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:29.799 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:29.799 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:29.799 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:29.799 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:31:29.800 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:29.800 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:31:29.800 INFO:teuthology.orchestra.run.smithi036.stdout: "data": "cephfs" 2022-01-10T01:31:29.800 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.800 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.801 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.801 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:29.801 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:31:29.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.802 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:31:29.802 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:31:29.802 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:29.802 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:29.802 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:29.803 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:29.803 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:29.803 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:29.803 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:29.803 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 87, 2022-01-10T01:31:29.804 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:29.804 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:29.804 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:29.804 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.805 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.805 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:31:29.805 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:29.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.806 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.806 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.806 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:31:29.806 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:29.806 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.807 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.807 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.807 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:29.807 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.807 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.808 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.808 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:31:29.808 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:29.808 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.809 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.809 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:31:29.809 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:29.809 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.810 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.810 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.810 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:29.810 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.810 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.811 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.811 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:31:29.811 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:29.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.812 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.812 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:31:29.812 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:29.812 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.813 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.813 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.813 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:29.813 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.814 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.814 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:31:29.814 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:29.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.815 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.815 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:31:29.815 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:29.815 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.816 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.816 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.816 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:31:29.816 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:31:29.816 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:31:29.817 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:31:29.817 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:29.817 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:29.817 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:29.818 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.818 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.818 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:31:29.818 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:31:29.819 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:29.819 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:29.819 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:29.819 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:29.820 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:29.820 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:29.820 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:29.820 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 85, 2022-01-10T01:31:29.821 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:29.821 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:29.821 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:29.821 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.821 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.822 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.822 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:31:29.822 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:29.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.823 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.823 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:31:29.823 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:29.824 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.824 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.824 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.824 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:29.824 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.825 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.825 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.825 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:31:29.825 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:29.825 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.826 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.826 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:31:29.826 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:29.826 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.827 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.827 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:29.827 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.828 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.828 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.828 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:31:29.828 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:29.828 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.829 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.829 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.829 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:31:29.829 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:29.830 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.830 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.830 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.830 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:29.830 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.831 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.831 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:31:29.831 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:29.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.832 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.832 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.832 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:31:29.832 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:29.833 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.833 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.833 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:31:29.833 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:31:29.834 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:31:29.834 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:31:29.834 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:29.834 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:29.834 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:29.835 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.835 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.835 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.835 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:31:29.836 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:31:29.836 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:29.836 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:29.836 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:29.836 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:29.837 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:29.837 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:29.837 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:29.837 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 75, 2022-01-10T01:31:29.837 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:29.838 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:29.838 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:29.838 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.838 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.839 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.839 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:31:29.839 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:29.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.839 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.840 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.840 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:31:29.840 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:29.840 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.840 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.841 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:29.841 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.841 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.842 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:31:29.842 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:29.842 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.842 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.843 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.843 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:31:29.843 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:29.843 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.843 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.844 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:29.844 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.844 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.844 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.844 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:31:29.845 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:29.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.845 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.846 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:31:29.846 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:29.846 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.846 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.847 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:29.847 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.847 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.847 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.848 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:31:29.848 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:29.848 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.848 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.849 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:31:29.849 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:29.849 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.849 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.850 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.850 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:31:29.850 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:31:29.850 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:31:29.850 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:31:29.851 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:29.851 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:29.851 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:29.851 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.852 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:31:29.852 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:31:29.852 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:29.853 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:29.853 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:29.853 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:29.853 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:29.854 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:29.854 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:29.854 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 86, 2022-01-10T01:31:29.854 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:29.854 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:29.855 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:29.855 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.855 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.856 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:31:29.856 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:29.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.856 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.857 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:31:29.857 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:29.857 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.857 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.858 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:29.858 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.858 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.858 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.859 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:31:29.859 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:29.859 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.859 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.860 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:31:29.860 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:29.860 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.860 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.861 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:29.861 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.861 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.861 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.861 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:31:29.862 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:29.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.862 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.863 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:31:29.863 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:29.863 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.863 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.863 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.864 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:29.864 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.864 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.865 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:31:29.865 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:29.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.865 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.866 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:31:29.866 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:29.866 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.866 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.867 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:31:29.867 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:31:29.867 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:31:29.867 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:31:29.868 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:29.868 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:29.868 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:29.868 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.869 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:31:29.869 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:31:29.869 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:29.870 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:29.870 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:29.870 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:29.870 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:29.870 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:29.871 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:29.871 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 86, 2022-01-10T01:31:29.871 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:29.871 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:29.872 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:29.872 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.872 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.872 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:31:29.873 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:29.873 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.873 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.873 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:31:29.874 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:29.874 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.874 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.875 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:29.875 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.875 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.875 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.875 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:31:29.876 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:29.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.876 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.877 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:31:29.877 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:29.877 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.877 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.877 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.878 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:29.878 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.878 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.878 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:31:29.879 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:29.879 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.879 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.880 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:31:29.880 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:29.880 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.880 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.881 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.881 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:29.881 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.881 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.881 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.882 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:31:29.882 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:29.882 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.882 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.883 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:31:29.883 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:29.883 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.883 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.884 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:31:29.884 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:31:29.884 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:31:29.884 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:31:29.885 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:29.885 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:29.885 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:29.885 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.885 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.886 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:31:29.886 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:31:29.886 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:29.886 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:29.887 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:29.887 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:29.887 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:29.887 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:29.888 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:29.888 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 86, 2022-01-10T01:31:29.888 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:29.888 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:29.888 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:29.889 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.889 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.889 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:31:29.889 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:29.890 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.890 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.890 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.890 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:31:29.890 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:29.891 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.891 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.891 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:29.892 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.892 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.892 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:31:29.892 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:29.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.893 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.893 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:31:29.893 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:29.894 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.894 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.894 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:29.895 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.895 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.895 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.895 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:31:29.895 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:29.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.896 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.896 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.896 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:31:29.897 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:29.897 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.897 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.897 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.897 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:29.898 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.898 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.898 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.898 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:31:29.899 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:29.899 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.899 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.899 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.899 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:31:29.900 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:29.900 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.900 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.900 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.900 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:31:29.901 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:31:29.901 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:31:29.901 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:31:29.901 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:29.902 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:29.902 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:29.902 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.902 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.903 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:31:29.903 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:31:29.903 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:29.904 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:29.904 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:29.905 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:29.905 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:29.905 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:29.905 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:29.906 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 86, 2022-01-10T01:31:29.906 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:29.906 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:29.906 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:29.907 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.907 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.907 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:31:29.908 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:29.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.908 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.908 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:31:29.909 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:29.909 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.909 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.910 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:29.910 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.910 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.910 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:31:29.911 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:29.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.911 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.912 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:31:29.912 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:29.912 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.912 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.912 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.913 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:29.913 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.913 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.913 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.913 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:31:29.914 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:29.914 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.914 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.914 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.915 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:31:29.915 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:29.915 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.915 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.915 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.916 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:29.916 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.916 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.917 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:31:29.917 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:29.917 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.917 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.917 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.918 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:31:29.918 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:29.918 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.918 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.919 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.919 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:31:29.919 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:31:29.919 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:31:29.920 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:31:29.920 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:29.920 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:29.920 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:29.921 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.921 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:31:29.921 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:31:29.922 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:29.922 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:29.922 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:29.922 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:29.923 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:29.923 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:29.923 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:29.923 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 75, 2022-01-10T01:31:29.924 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:29.924 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:29.924 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:29.924 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.924 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.925 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.925 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:31:29.925 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:29.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.926 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.926 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:31:29.926 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:29.926 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.928 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.928 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:29.929 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.929 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.929 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.929 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:31:29.930 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:29.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.930 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.931 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:31:29.931 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:29.931 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.931 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.931 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.932 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:29.932 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.932 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.932 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.933 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:31:29.933 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:29.933 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.933 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.934 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:31:29.934 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:29.934 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.934 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.935 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.935 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:29.935 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:29.935 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.936 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:29.936 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:31:29.936 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:29.937 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.937 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.937 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:29.937 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:31:29.938 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:29.938 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.938 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.938 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.938 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:31:29.939 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:31:29.939 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:31:29.939 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:31:29.939 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:29.940 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:29.940 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:29.940 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:29.940 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.940 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:29.941 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:31:29.941 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.941 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:31:29.941 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:29.942 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:29.942 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:29.942 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:29.942 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:29.942 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:31:29.943 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:29.943 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.943 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.943 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:31:29.944 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:29.944 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:29.944 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:29.944 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:29.944 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:29.945 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:31:29.945 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:29.945 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.945 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.945 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:31:29.946 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:29.946 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:29.946 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:29.946 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:29.947 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:29.947 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:31:29.947 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:29.947 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.948 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.948 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:31:29.948 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:29.948 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:29.948 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:29.949 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:29.949 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:29.949 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:31:29.949 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:29.950 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.950 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.950 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:31:29.950 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:29.950 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:29.951 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:29.951 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:29.951 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:29.951 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:31:29.951 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:29.952 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.952 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.952 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:31:29.952 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:29.953 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:29.953 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:29.953 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:29.953 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:29.953 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:31:29.954 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:29.954 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.954 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.954 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:31:29.955 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:29.955 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:29.955 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:29.955 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:29.955 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:29.956 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:31:29.956 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:29.956 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:29.957 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:31:29.957 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:29.957 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:29.957 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:29.957 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:29.958 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:29.958 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:31:29.958 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:29.959 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.959 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:29.959 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:31:29.960 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:31:29.960 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:31:29.960 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:31:29.961 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2022-01-10T01:31:29.961 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:31:29.961 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:31:29.961 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:31:29.962 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:31:29.962 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:31:29.962 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:31:29.962 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:31:29.963 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:31:29.963 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:31:29.963 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:31:29.963 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:31:29.963 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:31:29.964 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.964 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:31:29.964 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:31:29.964 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:31:29.965 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:31:29.965 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:31:29.965 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:31:29.965 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:31:29.965 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:29.966 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:29.966 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:31:29.966 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:31:29.966 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:31:29.967 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:31:29.967 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:31:29.967 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:31:29.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.728+0000 7fad228e3700 1 -- 172.21.15.36:0/1068399378 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7facfc053680 msgr2=0x7facfc055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:29.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.728+0000 7fad228e3700 1 --2- 172.21.15.36:0/1068399378 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7facfc053680 0x7facfc055b40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fad10018000 tx=0x7fad10014000).stop 2022-01-10T01:31:29.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.728+0000 7fad228e3700 1 -- 172.21.15.36:0/1068399378 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad1c0b6900 msgr2=0x7fad1c13e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:29.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.728+0000 7fad228e3700 1 --2- 172.21.15.36:0/1068399378 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad1c0b6900 0x7fad1c13e330 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7fad1c13de50 tx=0x7fad1400a370).stop 2022-01-10T01:31:29.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.728+0000 7fad228e3700 1 -- 172.21.15.36:0/1068399378 shutdown_connections 2022-01-10T01:31:29.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.728+0000 7fad228e3700 1 --2- 172.21.15.36:0/1068399378 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7facfc053680 0x7facfc055b40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:29.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.728+0000 7fad228e3700 1 --2- 172.21.15.36:0/1068399378 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad1c0b6900 0x7fad1c13e330 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:29.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.728+0000 7fad228e3700 1 --2- 172.21.15.36:0/1068399378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad1c0aa5d0 0x7fad1c152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:29.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.728+0000 7fad228e3700 1 --2- 172.21.15.36:0/1068399378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad1c060910 0x7fad1c140ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:29.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.728+0000 7fad228e3700 1 -- 172.21.15.36:0/1068399378 >> 172.21.15.36:0/1068399378 conn(0x7fad1c0b3480 msgr2=0x7fad1c0b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:29.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.728+0000 7fad228e3700 1 -- 172.21.15.36:0/1068399378 shutdown_connections 2022-01-10T01:31:29.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:29.728+0000 7fad228e3700 1 -- 172.21.15.36:0/1068399378 wait complete. 2022-01-10T01:31:29.973 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:30.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.084+0000 7fb71ea99700 1 Processor -- start 2022-01-10T01:31:30.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.084+0000 7fb71ea99700 1 -- start start 2022-01-10T01:31:30.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.084+0000 7fb71ea99700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7180b2580 0x7fb71814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.084+0000 7fb71ea99700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb7180b0010 0x7fb71814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.084+0000 7fb71ea99700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7180a70c0 con 0x7fb7180afbd0 2022-01-10T01:31:30.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.084+0000 7fb71ea99700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7180a72f0 con 0x7fb7180b0010 2022-01-10T01:31:30.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.084+0000 7fb71ea99700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7180a7590 con 0x7fb7180b2580 2022-01-10T01:31:30.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.084+0000 7fb71d296700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb7180b0010 0x7fb71814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.084+0000 7fb71d296700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb7180b0010 0x7fb71814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39028/0 (socket says 172.21.15.36:39028) 2022-01-10T01:31:30.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.084+0000 7fb71d296700 1 -- 172.21.15.36:0/1668422280 learned_addr learned my addr 172.21.15.36:0/1668422280 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:30.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.084+0000 7fb71da97700 1 --2- 172.21.15.36:0/1668422280 >> v2:172.21.15.59:3300/0 conn(0x7fb7180b2580 0x7fb71814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71d296700 1 -- 172.21.15.36:0/1668422280 >> v2:172.21.15.59:3300/0 conn(0x7fb7180b2580 msgr2=0x7fb71814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:30.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71d296700 1 --2- 172.21.15.36:0/1668422280 >> v2:172.21.15.59:3300/0 conn(0x7fb7180b2580 0x7fb71814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71d296700 1 -- 172.21.15.36:0/1668422280 >> v1:172.21.15.59:6789/0 conn(0x7fb7180afbd0 legacy=0x7fb7180a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71d296700 1 -- 172.21.15.36:0/1668422280 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7180a7830 con 0x7fb7180b0010 2022-01-10T01:31:30.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71da97700 1 --2- 172.21.15.36:0/1668422280 >> v2:172.21.15.59:3300/0 conn(0x7fb7180b2580 0x7fb71814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:30.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71d296700 1 --2- 172.21.15.36:0/1668422280 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180b0010 0x7fb71814b330 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7fb7140032f0 tx=0x7fb714009290).ready entity=mon.0 client_cookie=7bfc579b77c7acdf server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:30.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ca95700 1 -- 172.21.15.36:0/1668422280 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb71400b870 con 0x7fb7180b0010 2022-01-10T01:31:30.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ca95700 1 -- 172.21.15.36:0/1668422280 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71400b9d0 con 0x7fb7180b0010 2022-01-10T01:31:30.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ca95700 1 -- 172.21.15.36:0/1668422280 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb71400bb40 con 0x7fb7180b0010 2022-01-10T01:31:30.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ea99700 1 -- 172.21.15.36:0/1668422280 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180b0010 msgr2=0x7fb71814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ea99700 1 --2- 172.21.15.36:0/1668422280 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180b0010 0x7fb71814b330 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7fb7140032f0 tx=0x7fb714009290).stop 2022-01-10T01:31:30.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ea99700 1 -- 172.21.15.36:0/1668422280 shutdown_connections 2022-01-10T01:31:30.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ea99700 1 --2- 172.21.15.36:0/1668422280 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180b0010 0x7fb71814b330 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ea99700 1 --2- 172.21.15.36:0/1668422280 >> v2:172.21.15.59:3300/0 conn(0x7fb7180b2580 0x7fb71814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ea99700 1 -- 172.21.15.36:0/1668422280 >> 172.21.15.36:0/1668422280 conn(0x7fb718060180 msgr2=0x7fb7180b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:30.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ea99700 1 -- 172.21.15.36:0/1668422280 shutdown_connections 2022-01-10T01:31:30.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ea99700 1 -- 172.21.15.36:0/1668422280 wait complete. 2022-01-10T01:31:30.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ea99700 1 Processor -- start 2022-01-10T01:31:30.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ea99700 1 -- start start 2022-01-10T01:31:30.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ea99700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180afbd0 0x7fb718066080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ea99700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7180b2580 0x7fb7180ab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.088+0000 7fb71ea99700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb718066a20 0x7fb718063ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71ea99700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb718063690 con 0x7fb7180afbd0 2022-01-10T01:31:30.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71ea99700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb718157100 con 0x7fb718066a20 2022-01-10T01:31:30.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71ea99700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7181575d0 con 0x7fb7180b2580 2022-01-10T01:31:30.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71da97700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180afbd0 0x7fb718066080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71da97700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180afbd0 0x7fb718066080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39036/0 (socket says 172.21.15.36:39036) 2022-01-10T01:31:30.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71da97700 1 -- 172.21.15.36:0/316828328 learned_addr learned my addr 172.21.15.36:0/316828328 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:30.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71d296700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7180b2580 0x7fb7180ab7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71e298700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb718066a20 0x7fb718063ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71e298700 1 -- 172.21.15.36:0/316828328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7180b2580 msgr2=0x7fb7180ab7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71e298700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7180b2580 0x7fb7180ab7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71e298700 1 -- 172.21.15.36:0/316828328 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180afbd0 msgr2=0x7fb718066080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71e298700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180afbd0 0x7fb718066080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71e298700 1 -- 172.21.15.36:0/316828328 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb714009530 con 0x7fb718066a20 2022-01-10T01:31:30.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71da97700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180afbd0 0x7fb718066080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:30.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71d296700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7180b2580 0x7fb7180ab7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:30.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71e298700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb718066a20 0x7fb718063ef0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fb7180637d0 tx=0x7fb710007af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:30.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb706ffd700 1 -- 172.21.15.36:0/316828328 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb71000ccf0 con 0x7fb718066a20 2022-01-10T01:31:30.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb706ffd700 1 -- 172.21.15.36:0/316828328 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71000ce50 con 0x7fb718066a20 2022-01-10T01:31:30.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71ea99700 1 -- 172.21.15.36:0/316828328 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb718157330 con 0x7fb718066a20 2022-01-10T01:31:30.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb706ffd700 1 -- 172.21.15.36:0/316828328 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7100125f0 con 0x7fb718066a20 2022-01-10T01:31:30.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71ea99700 1 -- 172.21.15.36:0/316828328 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7180aac10 con 0x7fb718066a20 2022-01-10T01:31:30.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.092+0000 7fb71ea99700 1 -- 172.21.15.36:0/316828328 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb718066710 con 0x7fb718066a20 2022-01-10T01:31:30.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.096+0000 7fb706ffd700 1 -- 172.21.15.36:0/316828328 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb710019030 con 0x7fb718066a20 2022-01-10T01:31:30.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.096+0000 7fb706ffd700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6f8053620 0x7fb6f8055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.096+0000 7fb706ffd700 1 -- 172.21.15.36:0/316828328 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb71006ad20 con 0x7fb718066a20 2022-01-10T01:31:30.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.096+0000 7fb71da97700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6f8053620 0x7fb6f8055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.096+0000 7fb71da97700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6f8053620 0x7fb6f8055ae0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fb708008000 tx=0x7fb708008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:30.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.104+0000 7fb706ffd700 1 -- 172.21.15.36:0/316828328 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb71006f070 con 0x7fb718066a20 2022-01-10T01:31:30.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.272+0000 7fb71ea99700 1 -- 172.21.15.36:0/316828328 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb718057350 con 0x7fb718066a20 2022-01-10T01:31:30.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.272+0000 7fb706ffd700 1 -- 172.21.15.36:0/316828328 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fb710017070 con 0x7fb718066a20 2022-01-10T01:31:30.278 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:30.279 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":40,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3902337896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3902337896},{"type":"v1","addr":"172.21.15.36:6835","nonce":3902337896}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6612,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6837/3131314479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":3131314479},{"type":"v1","addr":"172.21.15.36:6837","nonce":3131314479}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:31:18.134652+0000","modified":"2022-01-10T01:31:19.137223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6616},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6616":{"gid":6616,"name":"b","rank":0,"incarnation":39,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3399412771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3399412771},{"type":"v1","addr":"172.21.15.59:6833","nonce":3399412771}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2022-01-10T01:31:30.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.276+0000 7fb71ea99700 1 -- 172.21.15.36:0/316828328 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6f8053620 msgr2=0x7fb6f8055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.276+0000 7fb71ea99700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6f8053620 0x7fb6f8055ae0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fb708008000 tx=0x7fb708008040).stop 2022-01-10T01:31:30.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.276+0000 7fb71ea99700 1 -- 172.21.15.36:0/316828328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb718066a20 msgr2=0x7fb718063ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.276+0000 7fb71ea99700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb718066a20 0x7fb718063ef0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fb7180637d0 tx=0x7fb710007af0).stop 2022-01-10T01:31:30.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.276+0000 7fb71ea99700 1 -- 172.21.15.36:0/316828328 shutdown_connections 2022-01-10T01:31:30.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.276+0000 7fb71ea99700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6f8053620 0x7fb6f8055ae0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.276+0000 7fb71ea99700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb718066a20 0x7fb718063ef0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.276+0000 7fb71ea99700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7180b2580 0x7fb7180ab7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.276+0000 7fb71ea99700 1 --2- 172.21.15.36:0/316828328 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb7180afbd0 0x7fb718066080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.276+0000 7fb71ea99700 1 -- 172.21.15.36:0/316828328 >> 172.21.15.36:0/316828328 conn(0x7fb718060180 msgr2=0x7fb7181486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:30.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.276+0000 7fb71ea99700 1 -- 172.21.15.36:0/316828328 shutdown_connections 2022-01-10T01:31:30.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.276+0000 7fb71ea99700 1 -- 172.21.15.36:0/316828328 wait complete. 2022-01-10T01:31:30.284 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 40 2022-01-10T01:31:30.292 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2022-01-10T01:31:30.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.392+0000 7f058097e700 1 Processor -- start 2022-01-10T01:31:30.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f058097e700 1 -- start start 2022-01-10T01:31:30.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f058097e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f057c0b0010 0x7f057c0a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f058097e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057c0a70c0 con 0x7f057c0b2580 2022-01-10T01:31:30.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f058097e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057c0a72f0 con 0x7f057c0afbd0 2022-01-10T01:31:30.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f058097e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057c0a7590 con 0x7f057c0b0010 2022-01-10T01:31:30.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f057ad9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f057c0b2580 0x7f057c14ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36838/0 (socket says 172.21.15.36:36838) 2022-01-10T01:31:30.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f057ad9d700 1 -- 172.21.15.36:0/2291320738 learned_addr learned my addr 172.21.15.36:0/2291320738 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:30.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f057a59c700 1 --2- 172.21.15.36:0/2291320738 >> v2:172.21.15.59:3300/0 conn(0x7f057c0b0010 0x7f057c0a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f0579d9b700 1 -- 172.21.15.36:0/2291320738 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655879716 0 0) 0x7f057c0a70c0 con 0x7f057c0b2580 2022-01-10T01:31:30.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f0579d9b700 1 -- 172.21.15.36:0/2291320738 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0560003260 con 0x7f057c0b2580 2022-01-10T01:31:30.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f057a59c700 1 -- 172.21.15.36:0/2291320738 >> v1:172.21.15.59:6789/0 conn(0x7f057c0afbd0 legacy=0x7f057c151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f057a59c700 1 -- 172.21.15.36:0/2291320738 >> v1:172.21.15.36:6789/0 conn(0x7f057c0b2580 legacy=0x7f057c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f0579d9b700 1 -- 172.21.15.36:0/2291320738 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2186790741 0 0) 0x7f0560003260 con 0x7f057c0b2580 2022-01-10T01:31:30.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f057a59c700 1 -- 172.21.15.36:0/2291320738 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c0a7830 con 0x7f057c0b0010 2022-01-10T01:31:30.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f057a59c700 1 --2- 172.21.15.36:0/2291320738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f057c0b0010 0x7f057c0a83b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f0570001800 tx=0x7f056c006df0).ready entity=mon.1 client_cookie=8e524adbc01a537a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:30.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f0579d9b700 1 -- 172.21.15.36:0/2291320738 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0570001660 con 0x7f057c0b0010 2022-01-10T01:31:30.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f0579d9b700 1 -- 172.21.15.36:0/2291320738 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c000e90 con 0x7f057c0b0010 2022-01-10T01:31:30.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f0579d9b700 1 -- 172.21.15.36:0/2291320738 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f056c00d4f0 con 0x7f057c0b0010 2022-01-10T01:31:30.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f058097e700 1 -- 172.21.15.36:0/2291320738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f057c0b0010 msgr2=0x7f057c0a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.396+0000 7f058097e700 1 --2- 172.21.15.36:0/2291320738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f057c0b0010 0x7f057c0a83b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f0570001800 tx=0x7f056c006df0).stop 2022-01-10T01:31:30.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.400+0000 7f058097e700 1 -- 172.21.15.36:0/2291320738 shutdown_connections 2022-01-10T01:31:30.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.400+0000 7f058097e700 1 --2- 172.21.15.36:0/2291320738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f057c0b0010 0x7f057c0a83b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.400+0000 7f058097e700 1 -- 172.21.15.36:0/2291320738 >> 172.21.15.36:0/2291320738 conn(0x7f057c060180 msgr2=0x7f057c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:30.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.400+0000 7f058097e700 1 -- 172.21.15.36:0/2291320738 shutdown_connections 2022-01-10T01:31:30.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.400+0000 7f058097e700 1 -- 172.21.15.36:0/2291320738 wait complete. 2022-01-10T01:31:30.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.400+0000 7f058097e700 1 Processor -- start 2022-01-10T01:31:30.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.400+0000 7f058097e700 1 -- start start 2022-01-10T01:31:30.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f058097e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f057c0afbd0 0x7f057c0b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f058097e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f057c0b0010 0x7f057c156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f058097e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f057c0b2580 0x7f057c15a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f058097e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c1492b0 con 0x7f057c0b2580 2022-01-10T01:31:30.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f058097e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c159cf0 con 0x7f057c0b0010 2022-01-10T01:31:30.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f058097e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057c156b10 con 0x7f057c0afbd0 2022-01-10T01:31:30.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f057b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f057c0b2580 0x7f057c15a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f057b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f057c0b2580 0x7f057c15a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39050/0 (socket says 172.21.15.36:39050) 2022-01-10T01:31:30.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f057b59e700 1 -- 172.21.15.36:0/2050888510 learned_addr learned my addr 172.21.15.36:0/2050888510 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:30.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f057a59c700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f057c0b0010 0x7f057c156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f057ad9d700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f057c0afbd0 0x7f057c0b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f057b59e700 1 -- 172.21.15.36:0/2050888510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f057c0afbd0 msgr2=0x7f057c0b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f057b59e700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f057c0afbd0 0x7f057c0b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f057b59e700 1 -- 172.21.15.36:0/2050888510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f057c0b0010 msgr2=0x7f057c156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f057b59e700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f057c0b0010 0x7f057c156620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f057b59e700 1 -- 172.21.15.36:0/2050888510 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c00b180 con 0x7f057c0b2580 2022-01-10T01:31:30.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f057ad9d700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f057c0afbd0 0x7f057c0b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:30.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f057b59e700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f057c0b2580 0x7f057c15a430 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f057c061a80 tx=0x7f0574007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:30.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f056bfff700 1 -- 172.21.15.36:0/2050888510 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f057400f470 con 0x7f057c0b2580 2022-01-10T01:31:30.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f056bfff700 1 -- 172.21.15.36:0/2050888510 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057400f5d0 con 0x7f057c0b2580 2022-01-10T01:31:30.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f058097e700 1 -- 172.21.15.36:0/2050888510 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057c15a920 con 0x7f057c0b2580 2022-01-10T01:31:30.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f056bfff700 1 -- 172.21.15.36:0/2050888510 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f057400f930 con 0x7f057c0b2580 2022-01-10T01:31:30.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f058097e700 1 -- 172.21.15.36:0/2050888510 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057c0ac160 con 0x7f057c0b2580 2022-01-10T01:31:30.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.404+0000 7f058097e700 1 -- 172.21.15.36:0/2050888510 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057c1494b0 con 0x7f057c0b2580 2022-01-10T01:31:30.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.408+0000 7f056bfff700 1 -- 172.21.15.36:0/2050888510 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0574019030 con 0x7f057c0b2580 2022-01-10T01:31:30.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.408+0000 7f056bfff700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f05580535f0 0x7f0558055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.408+0000 7f056bfff700 1 -- 172.21.15.36:0/2050888510 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f057406b3b0 con 0x7f057c0b2580 2022-01-10T01:31:30.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.408+0000 7f057ad9d700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f05580535f0 0x7f0558055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.408+0000 7f057ad9d700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f05580535f0 0x7f0558055ab0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f057000b000 tx=0x7f0570000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:30.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.416+0000 7f056bfff700 1 -- 172.21.15.36:0/2050888510 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f05740422b0 con 0x7f057c0b2580 2022-01-10T01:31:30.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.580+0000 7f058097e700 1 -- 172.21.15.36:0/2050888510 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f057c057350 con 0x7f057c0b2580 2022-01-10T01:31:30.638 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:31:30.632+0000 7f0b5376f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:31:30.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.648+0000 7f056bfff700 1 -- 172.21.15.36:0/2050888510 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7f05740458d0 con 0x7f057c0b2580 2022-01-10T01:31:30.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.648+0000 7f058097e700 1 -- 172.21.15.36:0/2050888510 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f05580535f0 msgr2=0x7f0558055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.648+0000 7f058097e700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f05580535f0 0x7f0558055ab0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f057000b000 tx=0x7f0570000bc0).stop 2022-01-10T01:31:30.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.648+0000 7f058097e700 1 -- 172.21.15.36:0/2050888510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f057c0b2580 msgr2=0x7f057c15a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.648+0000 7f058097e700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f057c0b2580 0x7f057c15a430 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f057c061a80 tx=0x7f0574007f10).stop 2022-01-10T01:31:30.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.652+0000 7f058097e700 1 -- 172.21.15.36:0/2050888510 shutdown_connections 2022-01-10T01:31:30.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.652+0000 7f058097e700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f05580535f0 0x7f0558055ab0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.652+0000 7f058097e700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f057c0b2580 0x7f057c15a430 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.652+0000 7f058097e700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f057c0b0010 0x7f057c156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.652+0000 7f058097e700 1 --2- 172.21.15.36:0/2050888510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f057c0afbd0 0x7f057c0b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.652+0000 7f058097e700 1 -- 172.21.15.36:0/2050888510 >> 172.21.15.36:0/2050888510 conn(0x7f057c060180 msgr2=0x7f057c0673a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:30.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.652+0000 7f058097e700 1 -- 172.21.15.36:0/2050888510 shutdown_connections 2022-01-10T01:31:30.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.652+0000 7f058097e700 1 -- 172.21.15.36:0/2050888510 wait complete. 2022-01-10T01:31:30.659 INFO:teuthology.orchestra.run.smithi036.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2022-01-10T01:31:30.671 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:30.682 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:31:30.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f28628f4700 1 Processor -- start 2022-01-10T01:31:30.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f28628f4700 1 -- start start 2022-01-10T01:31:30.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f28628f4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f285c0b1db0 0x7f285c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f28628f4700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285c0b0350 con 0x7f285c1483a0 2022-01-10T01:31:30.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f28628f4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285c0b05f0 con 0x7f285c0a70c0 2022-01-10T01:31:30.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f28628f4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285c0a90c0 con 0x7f285c0b1db0 2022-01-10T01:31:30.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f285b7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f285c1483a0 0x7f285c0b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36854/0 (socket says 172.21.15.36:36854) 2022-01-10T01:31:30.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f285b7fe700 1 -- 172.21.15.36:0/3588106890 learned_addr learned my addr 172.21.15.36:0/3588106890 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:30.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f285bfff700 1 --2- 172.21.15.36:0/3588106890 >> v2:172.21.15.59:3300/0 conn(0x7f285c0b1db0 0x7f285c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f285affd700 1 -- 172.21.15.36:0/3588106890 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4057906787 0 0) 0x7f285c0b0350 con 0x7f285c1483a0 2022-01-10T01:31:30.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f285affd700 1 -- 172.21.15.36:0/3588106890 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2840003260 con 0x7f285c1483a0 2022-01-10T01:31:30.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f285bfff700 1 -- 172.21.15.36:0/3588106890 >> v1:172.21.15.59:6789/0 conn(0x7f285c0a70c0 legacy=0x7f285c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f285bfff700 1 -- 172.21.15.36:0/3588106890 >> v1:172.21.15.36:6789/0 conn(0x7f285c1483a0 legacy=0x7f285c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f285bfff700 1 -- 172.21.15.36:0/3588106890 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c0b0890 con 0x7f285c0b1db0 2022-01-10T01:31:30.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f285bfff700 1 --2- 172.21.15.36:0/3588106890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c0b1db0 0x7f285c0b0fd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f285c147730 tx=0x7f284c0091d0).ready entity=mon.1 client_cookie=d5324d235e06e1f0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:30.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f285affd700 1 -- 172.21.15.36:0/3588106890 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f284c00b680 con 0x7f285c0b1db0 2022-01-10T01:31:30.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f285affd700 1 -- 172.21.15.36:0/3588106890 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c00b7e0 con 0x7f285c0b1db0 2022-01-10T01:31:30.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f285affd700 1 -- 172.21.15.36:0/3588106890 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f284c00b950 con 0x7f285c0b1db0 2022-01-10T01:31:30.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f28628f4700 1 -- 172.21.15.36:0/3588106890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c0b1db0 msgr2=0x7f285c0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.772+0000 7f28628f4700 1 --2- 172.21.15.36:0/3588106890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c0b1db0 0x7f285c0b0fd0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f285c147730 tx=0x7f284c0091d0).stop 2022-01-10T01:31:30.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f28628f4700 1 -- 172.21.15.36:0/3588106890 shutdown_connections 2022-01-10T01:31:30.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f28628f4700 1 --2- 172.21.15.36:0/3588106890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c0b1db0 0x7f285c0b0fd0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f28628f4700 1 -- 172.21.15.36:0/3588106890 >> 172.21.15.36:0/3588106890 conn(0x7f285c05f6b0 msgr2=0x7f285c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:30.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f28628f4700 1 -- 172.21.15.36:0/3588106890 shutdown_connections 2022-01-10T01:31:30.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f28628f4700 1 -- 172.21.15.36:0/3588106890 wait complete. 2022-01-10T01:31:30.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f28628f4700 1 Processor -- start 2022-01-10T01:31:30.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f28628f4700 1 -- start start 2022-01-10T01:31:30.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f28628f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285c0a70c0 0x7f285c149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f28628f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c0b1db0 0x7f285c14b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f28628f4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f285c1483a0 0x7f285c0aba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f28628f4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c14b7a0 con 0x7f285c1483a0 2022-01-10T01:31:30.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f28628f4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0ab070 con 0x7f285c0b1db0 2022-01-10T01:31:30.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f28628f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c0ab310 con 0x7f285c0a70c0 2022-01-10T01:31:30.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f2860e91700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f285c1483a0 0x7f285c0aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f2860e91700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f285c1483a0 0x7f285c0aba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39066/0 (socket says 172.21.15.36:39066) 2022-01-10T01:31:30.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f2860e91700 1 -- 172.21.15.36:0/134716484 learned_addr learned my addr 172.21.15.36:0/134716484 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:30.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f285bfff700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285c0a70c0 0x7f285c149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f285b7fe700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c0b1db0 0x7f285c14b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f2860e91700 1 -- 172.21.15.36:0/134716484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285c0a70c0 msgr2=0x7f285c149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f2860e91700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285c0a70c0 0x7f285c149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f2860e91700 1 -- 172.21.15.36:0/134716484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c0b1db0 msgr2=0x7f285c14b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f2860e91700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c0b1db0 0x7f285c14b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f2860e91700 1 -- 172.21.15.36:0/134716484 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c009470 con 0x7f285c1483a0 2022-01-10T01:31:30.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.776+0000 7f285b7fe700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c0b1db0 0x7f285c14b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:30.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.780+0000 7f2860e91700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f285c1483a0 0x7f285c0aba50 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f285c0b3170 tx=0x7f2854007bc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:30.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.780+0000 7f28597fa700 1 -- 172.21.15.36:0/134716484 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2854012400 con 0x7f285c1483a0 2022-01-10T01:31:30.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.780+0000 7f28597fa700 1 -- 172.21.15.36:0/134716484 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2854012560 con 0x7f285c1483a0 2022-01-10T01:31:30.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.780+0000 7f28628f4700 1 -- 172.21.15.36:0/134716484 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c0ab5b0 con 0x7f285c1483a0 2022-01-10T01:31:30.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.780+0000 7f28597fa700 1 -- 172.21.15.36:0/134716484 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28540128c0 con 0x7f285c1483a0 2022-01-10T01:31:30.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.780+0000 7f28628f4700 1 -- 172.21.15.36:0/134716484 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285c14a790 con 0x7f285c1483a0 2022-01-10T01:31:30.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.780+0000 7f28628f4700 1 -- 172.21.15.36:0/134716484 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c0ab740 con 0x7f285c1483a0 2022-01-10T01:31:30.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.780+0000 7f28597fa700 1 -- 172.21.15.36:0/134716484 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2854019030 con 0x7f285c1483a0 2022-01-10T01:31:30.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.780+0000 7f28597fa700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2834053620 0x7f2834055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:30.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.780+0000 7f28597fa700 1 -- 172.21.15.36:0/134716484 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f285406ada0 con 0x7f285c1483a0 2022-01-10T01:31:30.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.784+0000 7f285bfff700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2834053620 0x7f2834055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:30.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.784+0000 7f285bfff700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2834053620 0x7f2834055ae0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f284c01b000 tx=0x7f284c016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:30.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.788+0000 7f28597fa700 1 -- 172.21.15.36:0/134716484 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2854041d00 con 0x7f285c1483a0 2022-01-10T01:31:30.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.956+0000 7f28628f4700 1 -- 172.21.15.36:0/134716484 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f285c0b0b30 con 0x7f285c1483a0 2022-01-10T01:31:30.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.960+0000 7f28597fa700 1 -- 172.21.15.36:0/134716484 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2132 (secure 0 0 0) 0x7f2854045320 con 0x7f285c1483a0 2022-01-10T01:31:30.965 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:30.965 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":41,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3902337896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3902337896},{"type":"v1","addr":"172.21.15.36:6835","nonce":3902337896}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6612,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6837/3131314479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":3131314479},{"type":"v1","addr":"172.21.15.36:6837","nonce":3131314479}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:31:18.134652+0000","modified":"2022-01-10T01:31:30.637905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2022-01-10T01:31:30.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.960+0000 7f28628f4700 1 -- 172.21.15.36:0/134716484 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2834053620 msgr2=0x7f2834055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.960+0000 7f28628f4700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2834053620 0x7f2834055ae0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f284c01b000 tx=0x7f284c016000).stop 2022-01-10T01:31:30.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.960+0000 7f28628f4700 1 -- 172.21.15.36:0/134716484 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f285c1483a0 msgr2=0x7f285c0aba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:30.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.960+0000 7f28628f4700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f285c1483a0 0x7f285c0aba50 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f285c0b3170 tx=0x7f2854007bc0).stop 2022-01-10T01:31:30.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.960+0000 7f28628f4700 1 -- 172.21.15.36:0/134716484 shutdown_connections 2022-01-10T01:31:30.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.960+0000 7f28628f4700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2834053620 0x7f2834055ae0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.960+0000 7f28628f4700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f285c1483a0 0x7f285c0aba50 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.960+0000 7f28628f4700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c0b1db0 0x7f285c14b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.960+0000 7f28628f4700 1 --2- 172.21.15.36:0/134716484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f285c0a70c0 0x7f285c149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:30.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.960+0000 7f28628f4700 1 -- 172.21.15.36:0/134716484 >> 172.21.15.36:0/134716484 conn(0x7f285c05f6b0 msgr2=0x7f285c144890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:30.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.960+0000 7f28628f4700 1 -- 172.21.15.36:0/134716484 shutdown_connections 2022-01-10T01:31:30.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:30.960+0000 7f28628f4700 1 -- 172.21.15.36:0/134716484 wait complete. 2022-01-10T01:31:30.971 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 41 2022-01-10T01:31:30.978 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:31:31.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15b59e700 1 Processor -- start 2022-01-10T01:31:31.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15b59e700 1 -- start start 2022-01-10T01:31:31.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff15c061700 0x7ff15c146520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:31.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15b59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15c0aecf0 con 0x7ff15c0ad5c0 2022-01-10T01:31:31.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15b59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15c0b6f20 con 0x7ff15c061320 2022-01-10T01:31:31.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c0aef20 con 0x7ff15c061700 2022-01-10T01:31:31.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff159d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff15c0ad5c0 0x7ff15c140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36866/0 (socket says 172.21.15.36:36866) 2022-01-10T01:31:31.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff159d9b700 1 -- 172.21.15.36:0/3886152559 learned_addr learned my addr 172.21.15.36:0/3886152559 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:31.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15ad9d700 1 --2- 172.21.15.36:0/3886152559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff15c061700 0x7ff15c146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:31.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15959a700 1 -- 172.21.15.36:0/3886152559 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287125709 0 0) 0x7ff15c0aecf0 con 0x7ff15c0ad5c0 2022-01-10T01:31:31.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15959a700 1 -- 172.21.15.36:0/3886152559 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff140003260 con 0x7ff15c0ad5c0 2022-01-10T01:31:31.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15959a700 1 -- 172.21.15.36:0/3886152559 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450190453 0 0) 0x7ff15c0b6f20 con 0x7ff15c061320 2022-01-10T01:31:31.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15959a700 1 -- 172.21.15.36:0/3886152559 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff15c0aecf0 con 0x7ff15c061320 2022-01-10T01:31:31.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15ad9d700 1 -- 172.21.15.36:0/3886152559 >> v1:172.21.15.59:6789/0 conn(0x7ff15c061320 legacy=0x7ff15c0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:31.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15ad9d700 1 -- 172.21.15.36:0/3886152559 >> v1:172.21.15.36:6789/0 conn(0x7ff15c0ad5c0 legacy=0x7ff15c140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:31.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15ad9d700 1 -- 172.21.15.36:0/3886152559 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c0af1c0 con 0x7ff15c061700 2022-01-10T01:31:31.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.080+0000 7ff15ad9d700 1 --2- 172.21.15.36:0/3886152559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff15c061700 0x7ff15c146520 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff154002f70 tx=0x7ff154006df0).ready entity=mon.2 client_cookie=c06fed7066de4841 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:31.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15959a700 1 -- 172.21.15.36:0/3886152559 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff15400d5c0 con 0x7ff15c061700 2022-01-10T01:31:31.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15959a700 1 -- 172.21.15.36:0/3886152559 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff154000e90 con 0x7ff15c061700 2022-01-10T01:31:31.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15959a700 1 -- 172.21.15.36:0/3886152559 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff15400d910 con 0x7ff15c061700 2022-01-10T01:31:31.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 -- 172.21.15.36:0/3886152559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff15c061700 msgr2=0x7ff15c146520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:31.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 --2- 172.21.15.36:0/3886152559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff15c061700 0x7ff15c146520 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7ff154002f70 tx=0x7ff154006df0).stop 2022-01-10T01:31:31.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 -- 172.21.15.36:0/3886152559 shutdown_connections 2022-01-10T01:31:31.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 --2- 172.21.15.36:0/3886152559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff15c061700 0x7ff15c146520 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:31.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 -- 172.21.15.36:0/3886152559 >> 172.21.15.36:0/3886152559 conn(0x7ff15c066de0 msgr2=0x7ff15c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:31.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 -- 172.21.15.36:0/3886152559 shutdown_connections 2022-01-10T01:31:31.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 -- 172.21.15.36:0/3886152559 wait complete. 2022-01-10T01:31:31.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 Processor -- start 2022-01-10T01:31:31.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 -- start start 2022-01-10T01:31:31.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff15c061320 0x7ff15c0b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:31.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff15c061700 0x7ff15c0abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:31.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff15c0ad5c0 0x7ff15c0ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:31.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c0acd60 con 0x7ff15c061320 2022-01-10T01:31:31.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c0acb00 con 0x7ff15c0ad5c0 2022-01-10T01:31:31.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c0b1c30 con 0x7ff15c061700 2022-01-10T01:31:31.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15a59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff15c061320 0x7ff15c0b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:31.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15a59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff15c061320 0x7ff15c0b8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39076/0 (socket says 172.21.15.36:39076) 2022-01-10T01:31:31.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff15a59c700 1 -- 172.21.15.36:0/2476071453 learned_addr learned my addr 172.21.15.36:0/2476071453 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:31.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.084+0000 7ff159d9b700 1 --2- 172.21.15.36:0/2476071453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff15c061700 0x7ff15c0abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:31.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff15ad9d700 1 --2- 172.21.15.36:0/2476071453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff15c0ad5c0 0x7ff15c0ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:31.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff15a59c700 1 -- 172.21.15.36:0/2476071453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff15c061700 msgr2=0x7ff15c0abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:31.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff15a59c700 1 --2- 172.21.15.36:0/2476071453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff15c061700 0x7ff15c0abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:31.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff15a59c700 1 -- 172.21.15.36:0/2476071453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff15c0ad5c0 msgr2=0x7ff15c0ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:31.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff15a59c700 1 --2- 172.21.15.36:0/2476071453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff15c0ad5c0 0x7ff15c0ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:31.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff15a59c700 1 -- 172.21.15.36:0/2476071453 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15400b180 con 0x7ff15c061320 2022-01-10T01:31:31.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff15a59c700 1 --2- 172.21.15.36:0/2476071453 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff15c061320 0x7ff15c0b8ba0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7ff14c001110 tx=0x7ff14c007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:31.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff14b7fe700 1 -- 172.21.15.36:0/2476071453 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff14c00ce50 con 0x7ff15c061320 2022-01-10T01:31:31.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff14b7fe700 1 -- 172.21.15.36:0/2476071453 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c00f470 con 0x7ff15c061320 2022-01-10T01:31:31.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff15b59e700 1 -- 172.21.15.36:0/2476071453 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15c0b1ed0 con 0x7ff15c061320 2022-01-10T01:31:31.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff14b7fe700 1 -- 172.21.15.36:0/2476071453 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff14c00f7d0 con 0x7ff15c061320 2022-01-10T01:31:31.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff15b59e700 1 -- 172.21.15.36:0/2476071453 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15c0aa480 con 0x7ff15c061320 2022-01-10T01:31:31.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff15b59e700 1 -- 172.21.15.36:0/2476071453 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15c0af460 con 0x7ff15c061320 2022-01-10T01:31:31.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff14b7fe700 1 -- 172.21.15.36:0/2476071453 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff14c019030 con 0x7ff15c061320 2022-01-10T01:31:31.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff14b7fe700 1 --2- 172.21.15.36:0/2476071453 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff138053680 0x7ff138055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:31.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff14b7fe700 1 -- 172.21.15.36:0/2476071453 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6506+0+0 (secure 0 0 0) 0x7ff14c06af00 con 0x7ff15c061320 2022-01-10T01:31:31.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff159d9b700 1 --2- 172.21.15.36:0/2476071453 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff138053680 0x7ff138055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:31.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.088+0000 7ff159d9b700 1 --2- 172.21.15.36:0/2476071453 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff138053680 0x7ff138055b40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7ff15000d000 tx=0x7ff150009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:31.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.092+0000 7ff14b7fe700 1 -- 172.21.15.36:0/2476071453 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff14c041ec0 con 0x7ff15c061320 2022-01-10T01:31:31.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.256+0000 7ff15b59e700 1 -- 172.21.15.36:0/2476071453 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff15c057350 con 0x7ff15c061320 2022-01-10T01:31:31.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.652+0000 7ff14b7fe700 1 -- 172.21.15.36:0/2476071453 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff14c0454e0 con 0x7ff15c061320 2022-01-10T01:31:31.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.656+0000 7ff15b59e700 1 -- 172.21.15.36:0/2476071453 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff138053680 msgr2=0x7ff138055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:31.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.656+0000 7ff15b59e700 1 --2- 172.21.15.36:0/2476071453 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff138053680 0x7ff138055b40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7ff15000d000 tx=0x7ff150009040).stop 2022-01-10T01:31:31.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.656+0000 7ff15b59e700 1 -- 172.21.15.36:0/2476071453 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff15c061320 msgr2=0x7ff15c0b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:31.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.656+0000 7ff15b59e700 1 --2- 172.21.15.36:0/2476071453 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff15c061320 0x7ff15c0b8ba0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7ff14c001110 tx=0x7ff14c007ae0).stop 2022-01-10T01:31:31.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.656+0000 7ff15b59e700 1 -- 172.21.15.36:0/2476071453 shutdown_connections 2022-01-10T01:31:31.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.656+0000 7ff15b59e700 1 --2- 172.21.15.36:0/2476071453 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff138053680 0x7ff138055b40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:31.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.656+0000 7ff15b59e700 1 --2- 172.21.15.36:0/2476071453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff15c0ad5c0 0x7ff15c0ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:31.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.656+0000 7ff15b59e700 1 --2- 172.21.15.36:0/2476071453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff15c061700 0x7ff15c0abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:31.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.656+0000 7ff15b59e700 1 --2- 172.21.15.36:0/2476071453 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff15c061320 0x7ff15c0b8ba0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:31.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.656+0000 7ff15b59e700 1 -- 172.21.15.36:0/2476071453 >> 172.21.15.36:0/2476071453 conn(0x7ff15c066de0 msgr2=0x7ff15c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:31.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.656+0000 7ff15b59e700 1 -- 172.21.15.36:0/2476071453 shutdown_connections 2022-01-10T01:31:31.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.656+0000 7ff15b59e700 1 -- 172.21.15.36:0/2476071453 wait complete. 2022-01-10T01:31:31.677 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:31:31.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.784+0000 7fbbfabbb700 1 Processor -- start 2022-01-10T01:31:31.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.784+0000 7fbbfabbb700 1 -- start start 2022-01-10T01:31:31.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.784+0000 7fbbfabbb700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbbf40b0b80 0x7fbbf4146c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:31.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.784+0000 7fbbfabbb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbf40b03d0 0x7fbbf41401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:31.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.784+0000 7fbbfabbb700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf40b1140 con 0x7fbbf40a9190 2022-01-10T01:31:31.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.784+0000 7fbbfabbb700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf40a9570 con 0x7fbbf40b0b80 2022-01-10T01:31:31.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.784+0000 7fbbfabbb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40b1370 con 0x7fbbf40b03d0 2022-01-10T01:31:31.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.784+0000 7fbbf9bb9700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fbbf40a9190 0x7fbbf4146550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36878/0 (socket says 172.21.15.36:36878) 2022-01-10T01:31:31.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.784+0000 7fbbf9bb9700 1 -- 172.21.15.36:0/846471183 learned_addr learned my addr 172.21.15.36:0/846471183 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:31.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.784+0000 7fbbf93b8700 1 --2- 172.21.15.36:0/846471183 >> v2:172.21.15.36:3300/0 conn(0x7fbbf40b0b80 0x7fbbf4146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:31.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbfa3ba700 1 --2- 172.21.15.36:0/846471183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbf40b03d0 0x7fbbf41401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:31.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbf8bb7700 1 -- 172.21.15.36:0/846471183 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402331569 0 0) 0x7fbbf40b1140 con 0x7fbbf40a9190 2022-01-10T01:31:31.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbf8bb7700 1 -- 172.21.15.36:0/846471183 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbdc003260 con 0x7fbbf40a9190 2022-01-10T01:31:31.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbf93b8700 1 -- 172.21.15.36:0/846471183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbf40b03d0 msgr2=0x7fbbf41401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:31.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbf93b8700 1 --2- 172.21.15.36:0/846471183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbf40b03d0 0x7fbbf41401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:31.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbf93b8700 1 -- 172.21.15.36:0/846471183 >> v1:172.21.15.36:6789/0 conn(0x7fbbf40a9190 legacy=0x7fbbf4146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:31.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbf93b8700 1 -- 172.21.15.36:0/846471183 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40b1610 con 0x7fbbf40b0b80 2022-01-10T01:31:31.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbfa3ba700 1 --2- 172.21.15.36:0/846471183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbf40b03d0 0x7fbbf41401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:31.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbf93b8700 1 --2- 172.21.15.36:0/846471183 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbf40b0b80 0x7fbbf4146c60 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7fbbe4002f70 tx=0x7fbbe4006df0).ready entity=mon.0 client_cookie=5a94fb366b9ee4c4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:31.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbf8bb7700 1 -- 172.21.15.36:0/846471183 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbe400d4a0 con 0x7fbbf40b0b80 2022-01-10T01:31:31.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbf8bb7700 1 -- 172.21.15.36:0/846471183 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4000e90 con 0x7fbbf40b0b80 2022-01-10T01:31:31.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbf8bb7700 1 -- 172.21.15.36:0/846471183 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbe400d7f0 con 0x7fbbf40b0b80 2022-01-10T01:31:31.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbfabbb700 1 -- 172.21.15.36:0/846471183 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbf40b0b80 msgr2=0x7fbbf4146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:31.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbfabbb700 1 --2- 172.21.15.36:0/846471183 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbf40b0b80 0x7fbbf4146c60 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7fbbe4002f70 tx=0x7fbbe4006df0).stop 2022-01-10T01:31:31.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbfabbb700 1 -- 172.21.15.36:0/846471183 shutdown_connections 2022-01-10T01:31:31.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbfabbb700 1 --2- 172.21.15.36:0/846471183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbf40b03d0 0x7fbbf41401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:31.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbfabbb700 1 --2- 172.21.15.36:0/846471183 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbf40b0b80 0x7fbbf4146c60 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:31.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbfabbb700 1 -- 172.21.15.36:0/846471183 >> 172.21.15.36:0/846471183 conn(0x7fbbf4061140 msgr2=0x7fbbf4062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:31.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbfabbb700 1 -- 172.21.15.36:0/846471183 shutdown_connections 2022-01-10T01:31:31.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.788+0000 7fbbfabbb700 1 -- 172.21.15.36:0/846471183 wait complete. 2022-01-10T01:31:31.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbfabbb700 1 Processor -- start 2022-01-10T01:31:31.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbfabbb700 1 -- start start 2022-01-10T01:31:31.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbfabbb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbf40a9190 0x7fbbf413f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:31.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbfabbb700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbf40b03d0 0x7fbbf4144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:31.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbfabbb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbf40b0b80 0x7fbbf40b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:31.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbfabbb700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40b49c0 con 0x7fbbf40b03d0 2022-01-10T01:31:31.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbfabbb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf4155a00 con 0x7fbbf40b0b80 2022-01-10T01:31:31.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbfabbb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf4155ca0 con 0x7fbbf40a9190 2022-01-10T01:31:31.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbf93b8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbf40b03d0 0x7fbbf4144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:31.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbf93b8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbf40b03d0 0x7fbbf4144b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39092/0 (socket says 172.21.15.36:39092) 2022-01-10T01:31:31.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbf93b8700 1 -- 172.21.15.36:0/1115225454 learned_addr learned my addr 172.21.15.36:0/1115225454 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:31.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbf9bb9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbf40a9190 0x7fbbf413f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:31.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbfa3ba700 1 --2- 172.21.15.36:0/1115225454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbf40b0b80 0x7fbbf40b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:31.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbf93b8700 1 -- 172.21.15.36:0/1115225454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbf40a9190 msgr2=0x7fbbf413f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:31.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbf93b8700 1 --2- 172.21.15.36:0/1115225454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbf40a9190 0x7fbbf413f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:31.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbf93b8700 1 -- 172.21.15.36:0/1115225454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbf40b0b80 msgr2=0x7fbbf40b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:31.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbf93b8700 1 --2- 172.21.15.36:0/1115225454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbf40b0b80 0x7fbbf40b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:31.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.792+0000 7fbbf93b8700 1 -- 172.21.15.36:0/1115225454 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec009470 con 0x7fbbf40b03d0 2022-01-10T01:31:31.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.796+0000 7fbbf93b8700 1 --2- 172.21.15.36:0/1115225454 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbf40b03d0 0x7fbbf4144b00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7fbbe4002f70 tx=0x7fbbe4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:31.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.796+0000 7fbbe2ffd700 1 -- 172.21.15.36:0/1115225454 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbe40139c0 con 0x7fbbf40b03d0 2022-01-10T01:31:31.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.796+0000 7fbbe2ffd700 1 -- 172.21.15.36:0/1115225454 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4013b20 con 0x7fbbf40b03d0 2022-01-10T01:31:31.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.796+0000 7fbbe2ffd700 1 -- 172.21.15.36:0/1115225454 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbe4013e80 con 0x7fbbf40b03d0 2022-01-10T01:31:31.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.796+0000 7fbbfabbb700 1 -- 172.21.15.36:0/1115225454 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe400b180 con 0x7fbbf40b03d0 2022-01-10T01:31:31.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.796+0000 7fbbfabbb700 1 -- 172.21.15.36:0/1115225454 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf41419e0 con 0x7fbbf40b03d0 2022-01-10T01:31:31.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.796+0000 7fbbfabbb700 1 -- 172.21.15.36:0/1115225454 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf40b4bc0 con 0x7fbbf40b03d0 2022-01-10T01:31:31.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.796+0000 7fbbe2ffd700 1 -- 172.21.15.36:0/1115225454 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbbe401c070 con 0x7fbbf40b03d0 2022-01-10T01:31:31.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.796+0000 7fbbe2ffd700 1 --2- 172.21.15.36:0/1115225454 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbd40534d0 0x7fbbd4055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:31.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.796+0000 7fbbe2ffd700 1 -- 172.21.15.36:0/1115225454 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fbbe406c640 con 0x7fbbf40b03d0 2022-01-10T01:31:31.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.796+0000 7fbbf9bb9700 1 --2- 172.21.15.36:0/1115225454 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbd40534d0 0x7fbbd4055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:31.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.796+0000 7fbbf9bb9700 1 --2- 172.21.15.36:0/1115225454 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbd40534d0 0x7fbbd4055990 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fbbf000d000 tx=0x7fbbf0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:31.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.800+0000 7fbbe2ffd700 1 -- 172.21.15.36:0/1115225454 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbbe4043640 con 0x7fbbf40b03d0 2022-01-10T01:31:31.818 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:31:31.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:31:31.823 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:31:31.825 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:31:31.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:31.924+0000 7fbbfabbb700 1 -- 172.21.15.36:0/1115225454 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbbf4155e60 con 0x7fbbf40b03d0 2022-01-10T01:31:32.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.664+0000 7fbbe2ffd700 1 -- 172.21.15.36:0/1115225454 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) v1 ==== 185+0+0 (secure 0 0 0) 0x7fbbe4023020 con 0x7fbbf40b03d0 2022-01-10T01:31:32.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.668+0000 7fbbfabbb700 1 -- 172.21.15.36:0/1115225454 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbd40534d0 msgr2=0x7fbbd4055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:32.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.668+0000 7fbbfabbb700 1 --2- 172.21.15.36:0/1115225454 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbd40534d0 0x7fbbd4055990 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fbbf000d000 tx=0x7fbbf0009040).stop 2022-01-10T01:31:32.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.668+0000 7fbbfabbb700 1 -- 172.21.15.36:0/1115225454 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbf40b03d0 msgr2=0x7fbbf4144b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:32.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.668+0000 7fbbfabbb700 1 --2- 172.21.15.36:0/1115225454 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbf40b03d0 0x7fbbf4144b00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7fbbe4002f70 tx=0x7fbbe4014000).stop 2022-01-10T01:31:32.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.668+0000 7fbbfabbb700 1 -- 172.21.15.36:0/1115225454 shutdown_connections 2022-01-10T01:31:32.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.668+0000 7fbbfabbb700 1 --2- 172.21.15.36:0/1115225454 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbd40534d0 0x7fbbd4055990 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:32.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.668+0000 7fbbfabbb700 1 --2- 172.21.15.36:0/1115225454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbf40b0b80 0x7fbbf40b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:32.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.668+0000 7fbbfabbb700 1 --2- 172.21.15.36:0/1115225454 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbbf40b03d0 0x7fbbf4144b00 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:32.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.668+0000 7fbbfabbb700 1 --2- 172.21.15.36:0/1115225454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbf40a9190 0x7fbbf413f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:32.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.668+0000 7fbbfabbb700 1 -- 172.21.15.36:0/1115225454 >> 172.21.15.36:0/1115225454 conn(0x7fbbf4061140 msgr2=0x7fbbf413cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:32.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.668+0000 7fbbfabbb700 1 -- 172.21.15.36:0/1115225454 shutdown_connections 2022-01-10T01:31:32.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.668+0000 7fbbfabbb700 1 -- 172.21.15.36:0/1115225454 wait complete. 2022-01-10T01:31:32.677 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:31:32.690 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2022-01-10T01:31:32.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.796+0000 7f364e006700 1 Processor -- start 2022-01-10T01:31:32.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.796+0000 7f364e006700 1 -- start start 2022-01-10T01:31:32.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f364e006700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36480601a0 0x7f36480b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:32.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f364e006700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f364805c560 0x7f36480a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:32.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f364e006700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36480aa4a0 con 0x7f36480af3c0 2022-01-10T01:31:32.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f364e006700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36480b1450 con 0x7f364805c560 2022-01-10T01:31:32.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f364e006700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36480af7a0 con 0x7f36480601a0 2022-01-10T01:31:32.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f364d805700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f364805c560 0x7f36480a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:32.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f364d805700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f364805c560 0x7f36480a8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39102/0 (socket says 172.21.15.36:39102) 2022-01-10T01:31:32.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f364d805700 1 -- 172.21.15.36:0/1364542658 learned_addr learned my addr 172.21.15.36:0/1364542658 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:32.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f364c803700 1 --2- 172.21.15.36:0/1364542658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36480601a0 0x7f36480b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:32.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f3637fff700 1 -- 172.21.15.36:0/1364542658 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2451666425 0 0) 0x7f36480aa4a0 con 0x7f36480af3c0 2022-01-10T01:31:32.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f364d805700 1 -- 172.21.15.36:0/1364542658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36480601a0 msgr2=0x7f36480b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:32.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f364d805700 1 --2- 172.21.15.36:0/1364542658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36480601a0 0x7f36480b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:32.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f364d805700 1 -- 172.21.15.36:0/1364542658 >> v1:172.21.15.59:6789/0 conn(0x7f36480af3c0 legacy=0x7f3648144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:32.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f364d805700 1 -- 172.21.15.36:0/1364542658 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364805fb80 con 0x7f364805c560 2022-01-10T01:31:32.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f364d805700 1 --2- 172.21.15.36:0/1364542658 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f364805c560 0x7f36480a8bf0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f36400032f0 tx=0x7f3640009290).ready entity=mon.0 client_cookie=fbd2377d5d2fa7c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:32.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f3637fff700 1 -- 172.21.15.36:0/1364542658 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f364000b8a0 con 0x7f364805c560 2022-01-10T01:31:32.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f3637fff700 1 -- 172.21.15.36:0/1364542658 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364000ba00 con 0x7f364805c560 2022-01-10T01:31:32.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.800+0000 7f3637fff700 1 -- 172.21.15.36:0/1364542658 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f364000bb70 con 0x7f364805c560 2022-01-10T01:31:32.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.804+0000 7f364e006700 1 -- 172.21.15.36:0/1364542658 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f364805c560 msgr2=0x7f36480a8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:32.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.804+0000 7f364e006700 1 --2- 172.21.15.36:0/1364542658 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f364805c560 0x7f36480a8bf0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f36400032f0 tx=0x7f3640009290).stop 2022-01-10T01:31:32.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.804+0000 7f364e006700 1 -- 172.21.15.36:0/1364542658 shutdown_connections 2022-01-10T01:31:32.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.804+0000 7f364e006700 1 --2- 172.21.15.36:0/1364542658 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f364805c560 0x7f36480a8bf0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:32.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.804+0000 7f364e006700 1 --2- 172.21.15.36:0/1364542658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36480601a0 0x7f36480b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:32.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.804+0000 7f364e006700 1 -- 172.21.15.36:0/1364542658 >> 172.21.15.36:0/1364542658 conn(0x7f3648061140 msgr2=0x7f3648062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:32.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.804+0000 7f364e006700 1 -- 172.21.15.36:0/1364542658 shutdown_connections 2022-01-10T01:31:32.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.804+0000 7f364e006700 1 -- 172.21.15.36:0/1364542658 wait complete. 2022-01-10T01:31:32.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.804+0000 7f364e006700 1 Processor -- start 2022-01-10T01:31:32.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.804+0000 7f364e006700 1 -- start start 2022-01-10T01:31:32.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364e006700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f364805c560 0x7f3648143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:32.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364e006700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36480601a0 0x7f3648065210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:32.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364e006700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f36480af3c0 0x7f3648153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:32.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364e006700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3648065ad0 con 0x7f36480af3c0 2022-01-10T01:31:32.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364e006700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36480639e0 con 0x7f36480601a0 2022-01-10T01:31:32.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364e006700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3648143210 con 0x7f364805c560 2022-01-10T01:31:32.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364d805700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f36480af3c0 0x7f3648153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:32.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364d805700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f36480af3c0 0x7f3648153830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39108/0 (socket says 172.21.15.36:39108) 2022-01-10T01:31:32.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364d805700 1 -- 172.21.15.36:0/2557446464 learned_addr learned my addr 172.21.15.36:0/2557446464 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:32.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364d004700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f364805c560 0x7f3648143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:32.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364c803700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36480601a0 0x7f3648065210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:32.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364d805700 1 -- 172.21.15.36:0/2557446464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f364805c560 msgr2=0x7f3648143900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:32.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364d805700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f364805c560 0x7f3648143900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:32.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364d805700 1 -- 172.21.15.36:0/2557446464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36480601a0 msgr2=0x7f3648065210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:32.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364d805700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36480601a0 0x7f3648065210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:32.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364d805700 1 -- 172.21.15.36:0/2557446464 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640009530 con 0x7f36480af3c0 2022-01-10T01:31:32.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364c803700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36480601a0 0x7f3648065210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:32.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364d805700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f36480af3c0 0x7f3648153830 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f36400032f0 tx=0x7f3640016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:32.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f36367fc700 1 -- 172.21.15.36:0/2557446464 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f364000b8a0 con 0x7f36480af3c0 2022-01-10T01:31:32.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f36367fc700 1 -- 172.21.15.36:0/2557446464 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3640021630 con 0x7f36480af3c0 2022-01-10T01:31:32.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364e006700 1 -- 172.21.15.36:0/2557446464 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364805f6b0 con 0x7f36480af3c0 2022-01-10T01:31:32.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f36367fc700 1 -- 172.21.15.36:0/2557446464 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3640021990 con 0x7f36480af3c0 2022-01-10T01:31:32.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364e006700 1 -- 172.21.15.36:0/2557446464 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3648143df0 con 0x7f36480af3c0 2022-01-10T01:31:32.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.808+0000 7f364e006700 1 -- 172.21.15.36:0/2557446464 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36480658a0 con 0x7f36480af3c0 2022-01-10T01:31:32.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.812+0000 7f36367fc700 1 -- 172.21.15.36:0/2557446464 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3640027020 con 0x7f36480af3c0 2022-01-10T01:31:32.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.812+0000 7f36367fc700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3628053620 0x7f3628055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:32.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.812+0000 7f36367fc700 1 -- 172.21.15.36:0/2557446464 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f364006cc70 con 0x7f36480af3c0 2022-01-10T01:31:32.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.812+0000 7f364d004700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3628053620 0x7f3628055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:32.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.812+0000 7f364d004700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3628053620 0x7f3628055ae0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f364400d000 tx=0x7f3644007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:32.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.820+0000 7f36367fc700 1 -- 172.21.15.36:0/2557446464 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3640043de0 con 0x7f36480af3c0 2022-01-10T01:31:32.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:32.944+0000 7f364e006700 1 -- 172.21.15.36:0/2557446464 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3648142f10 con 0x7f36480af3c0 2022-01-10T01:31:33.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.668+0000 7f36367fc700 1 -- 172.21.15.36:0/2557446464 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3640015070 con 0x7f36480af3c0 2022-01-10T01:31:33.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.672+0000 7f364e006700 1 -- 172.21.15.36:0/2557446464 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3628053620 msgr2=0x7f3628055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:33.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.672+0000 7f364e006700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3628053620 0x7f3628055ae0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f364400d000 tx=0x7f3644007b90).stop 2022-01-10T01:31:33.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.672+0000 7f364e006700 1 -- 172.21.15.36:0/2557446464 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f36480af3c0 msgr2=0x7f3648153830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:33.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.672+0000 7f364e006700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f36480af3c0 0x7f3648153830 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f36400032f0 tx=0x7f3640016000).stop 2022-01-10T01:31:33.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.672+0000 7f364e006700 1 -- 172.21.15.36:0/2557446464 shutdown_connections 2022-01-10T01:31:33.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.672+0000 7f364e006700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3628053620 0x7f3628055ae0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:33.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.672+0000 7f364e006700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f36480af3c0 0x7f3648153830 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:33.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.672+0000 7f364e006700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36480601a0 0x7f3648065210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:33.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.672+0000 7f364e006700 1 --2- 172.21.15.36:0/2557446464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f364805c560 0x7f3648143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:33.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.672+0000 7f364e006700 1 -- 172.21.15.36:0/2557446464 >> 172.21.15.36:0/2557446464 conn(0x7f3648061140 msgr2=0x7f36480a8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:33.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.672+0000 7f364e006700 1 -- 172.21.15.36:0/2557446464 shutdown_connections 2022-01-10T01:31:33.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.672+0000 7f364e006700 1 -- 172.21.15.36:0/2557446464 wait complete. 2022-01-10T01:31:33.682 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' removed 2022-01-10T01:31:33.692 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2022-01-10T01:31:33.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 Processor -- start 2022-01-10T01:31:33.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 -- start start 2022-01-10T01:31:33.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb80638d0 0x7f4cb8061ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:33.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4cb80b17b0 0x7f4cb813df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:33.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb80b0f40 con 0x7f4cb813e420 2022-01-10T01:31:33.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb8063cb0 con 0x7f4cb80b17b0 2022-01-10T01:31:33.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8060070 con 0x7f4cb80638d0 2022-01-10T01:31:33.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cb6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4cb80b17b0 0x7f4cb813df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:33.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cb77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb80638d0 0x7f4cb8061ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:33.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cb6ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4cb80b17b0 0x7f4cb813df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:35748/0 (socket says 172.21.15.36:35748) 2022-01-10T01:31:33.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cb6ffd700 1 -- 172.21.15.36:0/1638142116 learned_addr learned my addr 172.21.15.36:0/1638142116 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:33.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cb7fff700 1 --1- 172.21.15.36:0/1638142116 >> v1:172.21.15.59:6789/0 conn(0x7f4cb813e420 0x7f4cb8141330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:54586/0 (socket says 172.21.15.36:54586) 2022-01-10T01:31:33.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cb6ffd700 1 -- 172.21.15.36:0/1638142116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb80638d0 msgr2=0x7f4cb8061ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:33.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cb6ffd700 1 --2- 172.21.15.36:0/1638142116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb80638d0 0x7f4cb8061ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:33.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cb6ffd700 1 -- 172.21.15.36:0/1638142116 >> v1:172.21.15.59:6789/0 conn(0x7f4cb813e420 legacy=0x7f4cb8141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:33.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cb6ffd700 1 -- 172.21.15.36:0/1638142116 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb80b1170 con 0x7f4cb80b17b0 2022-01-10T01:31:33.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cb6ffd700 1 --2- 172.21.15.36:0/1638142116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb80b17b0 0x7f4cb813df30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f4cac002f70 tx=0x7f4cac006eb0).ready entity=mon.1 client_cookie=d8a04eec26bd448f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:33.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cb67fc700 1 -- 172.21.15.36:0/1638142116 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cac00d570 con 0x7f4cb80b17b0 2022-01-10T01:31:33.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cb67fc700 1 -- 172.21.15.36:0/1638142116 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cac000e90 con 0x7f4cb80b17b0 2022-01-10T01:31:33.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cb67fc700 1 -- 172.21.15.36:0/1638142116 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cac00d900 con 0x7f4cb80b17b0 2022-01-10T01:31:33.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 -- 172.21.15.36:0/1638142116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb80b17b0 msgr2=0x7f4cb813df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:33.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 --2- 172.21.15.36:0/1638142116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb80b17b0 0x7f4cb813df30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f4cac002f70 tx=0x7f4cac006eb0).stop 2022-01-10T01:31:33.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 -- 172.21.15.36:0/1638142116 shutdown_connections 2022-01-10T01:31:33.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 --2- 172.21.15.36:0/1638142116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb80b17b0 0x7f4cb813df30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:33.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 --2- 172.21.15.36:0/1638142116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb80638d0 0x7f4cb8061ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:33.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 -- 172.21.15.36:0/1638142116 >> 172.21.15.36:0/1638142116 conn(0x7f4cb805c490 msgr2=0x7f4cb805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:33.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 -- 172.21.15.36:0/1638142116 shutdown_connections 2022-01-10T01:31:33.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.796+0000 7f4cbcca1700 1 -- 172.21.15.36:0/1638142116 wait complete. 2022-01-10T01:31:33.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cbcca1700 1 Processor -- start 2022-01-10T01:31:33.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cbcca1700 1 -- start start 2022-01-10T01:31:33.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cbcca1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb80638d0 0x7f4cb8134670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:33.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cbcca1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cb80b17b0 0x7f4cb80b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:33.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cbcca1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb813e420 0x7f4cb80b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:33.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cbcca1700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb813f6e0 con 0x7f4cb80b17b0 2022-01-10T01:31:33.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cbcca1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb813ed30 con 0x7f4cb80638d0 2022-01-10T01:31:33.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cbcca1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8147570 con 0x7f4cb813e420 2022-01-10T01:31:33.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cb6ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cb80b17b0 0x7f4cb80b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:33.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cb77fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb80638d0 0x7f4cb8134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:33.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cb6ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cb80b17b0 0x7f4cb80b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39120/0 (socket says 172.21.15.36:39120) 2022-01-10T01:31:33.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cb6ffd700 1 -- 172.21.15.36:0/106890903 learned_addr learned my addr 172.21.15.36:0/106890903 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:33.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cb7fff700 1 --2- 172.21.15.36:0/106890903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb813e420 0x7f4cb80b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:33.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cb77fe700 1 -- 172.21.15.36:0/106890903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb813e420 msgr2=0x7f4cb80b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:33.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cb77fe700 1 --2- 172.21.15.36:0/106890903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb813e420 0x7f4cb80b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:33.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cb77fe700 1 -- 172.21.15.36:0/106890903 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cb80b17b0 msgr2=0x7f4cb80b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:33.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cb77fe700 1 --2- 172.21.15.36:0/106890903 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cb80b17b0 0x7f4cb80b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:33.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cb77fe700 1 -- 172.21.15.36:0/106890903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac00b1e0 con 0x7f4cb80638d0 2022-01-10T01:31:33.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cb77fe700 1 --2- 172.21.15.36:0/106890903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb80638d0 0x7f4cb8134670 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f4ca800c000 tx=0x7f4ca8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:33.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cb4ff9700 1 -- 172.21.15.36:0/106890903 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ca8010780 con 0x7f4cb80638d0 2022-01-10T01:31:33.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cb4ff9700 1 -- 172.21.15.36:0/106890903 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca80108e0 con 0x7f4cb80638d0 2022-01-10T01:31:33.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cb4ff9700 1 -- 172.21.15.36:0/106890903 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ca8010c40 con 0x7f4cb80638d0 2022-01-10T01:31:33.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.800+0000 7f4cbcca1700 1 -- 172.21.15.36:0/106890903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb8147810 con 0x7f4cb80638d0 2022-01-10T01:31:33.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.804+0000 7f4cbcca1700 1 -- 172.21.15.36:0/106890903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb8140bd0 con 0x7f4cb80638d0 2022-01-10T01:31:33.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.804+0000 7f4cbcca1700 1 -- 172.21.15.36:0/106890903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb80b1410 con 0x7f4cb80638d0 2022-01-10T01:31:33.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.804+0000 7f4cb4ff9700 1 -- 172.21.15.36:0/106890903 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4ca801b410 con 0x7f4cb80638d0 2022-01-10T01:31:33.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.804+0000 7f4cb4ff9700 1 --2- 172.21.15.36:0/106890903 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4c98053590 0x7f4c98055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:33.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.804+0000 7f4cb4ff9700 1 -- 172.21.15.36:0/106890903 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f4ca806b7e0 con 0x7f4cb80638d0 2022-01-10T01:31:33.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.804+0000 7f4cb6ffd700 1 --2- 172.21.15.36:0/106890903 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4c98053590 0x7f4c98055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:33.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.804+0000 7f4cb6ffd700 1 --2- 172.21.15.36:0/106890903 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4c98053590 0x7f4c98055a50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f4cac01c000 tx=0x7f4cac015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:33.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.812+0000 7f4cb4ff9700 1 -- 172.21.15.36:0/106890903 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4ca8042a70 con 0x7f4cb80638d0 2022-01-10T01:31:33.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.940+0000 7f4cbcca1700 1 -- 172.21.15.36:0/106890903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4cb8057350 con 0x7f4cb80638d0 2022-01-10T01:31:33.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.948+0000 7f4cb4ff9700 1 -- 172.21.15.36:0/106890903 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4ca8046090 con 0x7f4cb80638d0 2022-01-10T01:31:33.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.952+0000 7f4cbcca1700 1 -- 172.21.15.36:0/106890903 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4c98053590 msgr2=0x7f4c98055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:33.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.952+0000 7f4cbcca1700 1 --2- 172.21.15.36:0/106890903 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4c98053590 0x7f4c98055a50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f4cac01c000 tx=0x7f4cac015000).stop 2022-01-10T01:31:33.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.952+0000 7f4cbcca1700 1 -- 172.21.15.36:0/106890903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb80638d0 msgr2=0x7f4cb8134670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:33.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.952+0000 7f4cbcca1700 1 --2- 172.21.15.36:0/106890903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb80638d0 0x7f4cb8134670 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f4ca800c000 tx=0x7f4ca8006df0).stop 2022-01-10T01:31:33.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.952+0000 7f4cbcca1700 1 -- 172.21.15.36:0/106890903 shutdown_connections 2022-01-10T01:31:33.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.952+0000 7f4cbcca1700 1 --2- 172.21.15.36:0/106890903 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4c98053590 0x7f4c98055a50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:33.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.952+0000 7f4cbcca1700 1 --2- 172.21.15.36:0/106890903 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cb813e420 0x7f4cb80b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:33.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.952+0000 7f4cbcca1700 1 --2- 172.21.15.36:0/106890903 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cb80b17b0 0x7f4cb80b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:33.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.952+0000 7f4cbcca1700 1 --2- 172.21.15.36:0/106890903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cb80638d0 0x7f4cb8134670 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:33.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.952+0000 7f4cbcca1700 1 -- 172.21.15.36:0/106890903 >> 172.21.15.36:0/106890903 conn(0x7f4cb805c490 msgr2=0x7f4cb813b180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:33.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.952+0000 7f4cbcca1700 1 -- 172.21.15.36:0/106890903 shutdown_connections 2022-01-10T01:31:33.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:33.952+0000 7f4cbcca1700 1 -- 172.21.15.36:0/106890903 wait complete. 2022-01-10T01:31:33.972 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2022-01-10T01:31:34.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.064+0000 7f8084e3f700 1 Processor -- start 2022-01-10T01:31:34.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.064+0000 7f8084e3f700 1 -- start start 2022-01-10T01:31:34.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.064+0000 7f8084e3f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8080061320 0x7f8080061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:34.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.064+0000 7f8084e3f700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80800aecf0 con 0x7f8080140440 2022-01-10T01:31:34.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.064+0000 7f8084e3f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80800b6f20 con 0x7f80800ad5c0 2022-01-10T01:31:34.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.064+0000 7f8084e3f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80800aef20 con 0x7f8080061320 2022-01-10T01:31:34.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.064+0000 7f807ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f8080140440 0x7f8080146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36924/0 (socket says 172.21.15.36:36924) 2022-01-10T01:31:34.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.064+0000 7f807ffff700 1 -- 172.21.15.36:0/4229424863 learned_addr learned my addr 172.21.15.36:0/4229424863 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:34.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.064+0000 7f807f7fe700 1 --2- 172.21.15.36:0/4229424863 >> v2:172.21.15.59:3300/0 conn(0x7f8080061320 0x7f8080061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:34.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f807e7fc700 1 -- 172.21.15.36:0/4229424863 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905324448 0 0) 0x7f80800aecf0 con 0x7f8080140440 2022-01-10T01:31:34.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f807e7fc700 1 -- 172.21.15.36:0/4229424863 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f806c003260 con 0x7f8080140440 2022-01-10T01:31:34.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f807e7fc700 1 -- 172.21.15.36:0/4229424863 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538723635 0 0) 0x7f80800b6f20 con 0x7f80800ad5c0 2022-01-10T01:31:34.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f807e7fc700 1 -- 172.21.15.36:0/4229424863 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80800aecf0 con 0x7f80800ad5c0 2022-01-10T01:31:34.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f807f7fe700 1 -- 172.21.15.36:0/4229424863 >> v1:172.21.15.59:6789/0 conn(0x7f80800ad5c0 legacy=0x7f80800b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:34.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f807f7fe700 1 -- 172.21.15.36:0/4229424863 >> v1:172.21.15.36:6789/0 conn(0x7f8080140440 legacy=0x7f8080146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:34.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f807f7fe700 1 -- 172.21.15.36:0/4229424863 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80800af1c0 con 0x7f8080061320 2022-01-10T01:31:34.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f807f7fe700 1 --2- 172.21.15.36:0/4229424863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8080061320 0x7f8080061700 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f80800aeba0 tx=0x7f8070006df0).ready entity=mon.1 client_cookie=95599b4e06623349 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:34.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f807e7fc700 1 -- 172.21.15.36:0/4229424863 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f807000d610 con 0x7f8080061320 2022-01-10T01:31:34.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f807e7fc700 1 -- 172.21.15.36:0/4229424863 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8070000e90 con 0x7f8080061320 2022-01-10T01:31:34.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f807e7fc700 1 -- 172.21.15.36:0/4229424863 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f807000d960 con 0x7f8080061320 2022-01-10T01:31:34.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f8084e3f700 1 -- 172.21.15.36:0/4229424863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8080061320 msgr2=0x7f8080061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:34.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f8084e3f700 1 --2- 172.21.15.36:0/4229424863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8080061320 0x7f8080061700 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f80800aeba0 tx=0x7f8070006df0).stop 2022-01-10T01:31:34.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f8084e3f700 1 -- 172.21.15.36:0/4229424863 shutdown_connections 2022-01-10T01:31:34.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f8084e3f700 1 --2- 172.21.15.36:0/4229424863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8080061320 0x7f8080061700 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:34.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f8084e3f700 1 -- 172.21.15.36:0/4229424863 >> 172.21.15.36:0/4229424863 conn(0x7f8080066de0 msgr2=0x7f80800671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:34.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f8084e3f700 1 -- 172.21.15.36:0/4229424863 shutdown_connections 2022-01-10T01:31:34.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.068+0000 7f8084e3f700 1 -- 172.21.15.36:0/4229424863 wait complete. 2022-01-10T01:31:34.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f8084e3f700 1 Processor -- start 2022-01-10T01:31:34.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f8084e3f700 1 -- start start 2022-01-10T01:31:34.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f8084e3f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8080061320 0x7f80800b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:34.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f8084e3f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f80800ad5c0 0x7f80800ab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:34.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f8084e3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8080140440 0x7f8080140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:34.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f8084e3f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8080152e50 con 0x7f80800ad5c0 2022-01-10T01:31:34.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f8084e3f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80800ad400 con 0x7f8080061320 2022-01-10T01:31:34.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f8084e3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8080153080 con 0x7f8080140440 2022-01-10T01:31:34.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f807effd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f80800ad5c0 0x7f80800ab7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:34.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f807effd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f80800ad5c0 0x7f80800ab7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39134/0 (socket says 172.21.15.36:39134) 2022-01-10T01:31:34.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f807effd700 1 -- 172.21.15.36:0/4236382735 learned_addr learned my addr 172.21.15.36:0/4236382735 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:34.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f807f7fe700 1 --2- 172.21.15.36:0/4236382735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8080061320 0x7f80800b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:34.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f807ffff700 1 --2- 172.21.15.36:0/4236382735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8080140440 0x7f8080140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:34.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f807effd700 1 -- 172.21.15.36:0/4236382735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8080140440 msgr2=0x7f8080140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:34.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f807effd700 1 --2- 172.21.15.36:0/4236382735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8080140440 0x7f8080140e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:34.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f807effd700 1 -- 172.21.15.36:0/4236382735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8080061320 msgr2=0x7f80800b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:34.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f807effd700 1 --2- 172.21.15.36:0/4236382735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8080061320 0x7f80800b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:34.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f807effd700 1 -- 172.21.15.36:0/4236382735 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807000b180 con 0x7f80800ad5c0 2022-01-10T01:31:34.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f807effd700 1 --2- 172.21.15.36:0/4236382735 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f80800ad5c0 0x7f80800ab7d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f8074001110 tx=0x7f8074007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:34.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f807cff9700 1 -- 172.21.15.36:0/4236382735 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f807400ce30 con 0x7f80800ad5c0 2022-01-10T01:31:34.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f807cff9700 1 -- 172.21.15.36:0/4236382735 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807400f470 con 0x7f80800ad5c0 2022-01-10T01:31:34.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f807cff9700 1 -- 172.21.15.36:0/4236382735 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f807400f7d0 con 0x7f80800ad5c0 2022-01-10T01:31:34.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f8084e3f700 1 -- 172.21.15.36:0/4236382735 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8080153320 con 0x7f80800ad5c0 2022-01-10T01:31:34.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.072+0000 7f8084e3f700 1 -- 172.21.15.36:0/4236382735 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80800b0cd0 con 0x7f80800ad5c0 2022-01-10T01:31:34.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.076+0000 7f8084e3f700 1 -- 172.21.15.36:0/4236382735 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8058003410 con 0x7f80800ad5c0 2022-01-10T01:31:34.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.076+0000 7f807cff9700 1 -- 172.21.15.36:0/4236382735 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8074019030 con 0x7f80800ad5c0 2022-01-10T01:31:34.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.076+0000 7f807cff9700 1 --2- 172.21.15.36:0/4236382735 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f80600535f0 0x7f8060055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:34.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.076+0000 7f807cff9700 1 -- 172.21.15.36:0/4236382735 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f807406ab80 con 0x7f80800ad5c0 2022-01-10T01:31:34.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.076+0000 7f807f7fe700 1 --2- 172.21.15.36:0/4236382735 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f80600535f0 0x7f8060055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:34.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.076+0000 7f807f7fe700 1 --2- 172.21.15.36:0/4236382735 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f80600535f0 0x7f8060055ab0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f8070018000 tx=0x7f8070014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:34.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.080+0000 7f807cff9700 1 -- 172.21.15.36:0/4236382735 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8074041e70 con 0x7f80800ad5c0 2022-01-10T01:31:34.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.244+0000 7f8084e3f700 1 -- 172.21.15.36:0/4236382735 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f8058003c40 con 0x7f80800ad5c0 2022-01-10T01:31:34.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.672+0000 7f807cff9700 1 -- 172.21.15.36:0/4236382735 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v317) v1 ==== 126+0+0 (secure 0 0 0) 0x7f8074007b50 con 0x7f80800ad5c0 2022-01-10T01:31:34.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.676+0000 7f8084e3f700 1 -- 172.21.15.36:0/4236382735 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f80600535f0 msgr2=0x7f8060055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:34.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.676+0000 7f8084e3f700 1 --2- 172.21.15.36:0/4236382735 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f80600535f0 0x7f8060055ab0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f8070018000 tx=0x7f8070014000).stop 2022-01-10T01:31:34.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.676+0000 7f8084e3f700 1 -- 172.21.15.36:0/4236382735 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f80800ad5c0 msgr2=0x7f80800ab7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:34.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.676+0000 7f8084e3f700 1 --2- 172.21.15.36:0/4236382735 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f80800ad5c0 0x7f80800ab7d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f8074001110 tx=0x7f8074007a30).stop 2022-01-10T01:31:34.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.676+0000 7f8084e3f700 1 -- 172.21.15.36:0/4236382735 shutdown_connections 2022-01-10T01:31:34.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.676+0000 7f8084e3f700 1 --2- 172.21.15.36:0/4236382735 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f80600535f0 0x7f8060055ab0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:34.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.676+0000 7f8084e3f700 1 --2- 172.21.15.36:0/4236382735 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8080140440 0x7f8080140e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:34.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.676+0000 7f8084e3f700 1 --2- 172.21.15.36:0/4236382735 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f80800ad5c0 0x7f80800ab7d0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:34.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.676+0000 7f8084e3f700 1 --2- 172.21.15.36:0/4236382735 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8080061320 0x7f80800b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:34.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.676+0000 7f8084e3f700 1 -- 172.21.15.36:0/4236382735 >> 172.21.15.36:0/4236382735 conn(0x7f8080066de0 msgr2=0x7f8080146280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:34.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.676+0000 7f8084e3f700 1 -- 172.21.15.36:0/4236382735 shutdown_connections 2022-01-10T01:31:34.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.676+0000 7f8084e3f700 1 -- 172.21.15.36:0/4236382735 wait complete. 2022-01-10T01:31:34.696 INFO:tasks.cephfs_test_runner:test_dump_inode (tasks.cephfs.test_misc.TestMisc) ... ok 2022-01-10T01:31:34.696 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) 2022-01-10T01:31:34.697 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2022-01-10T01:31:34.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.804+0000 7f4c24475700 1 Processor -- start 2022-01-10T01:31:34.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.804+0000 7f4c24475700 1 -- start start 2022-01-10T01:31:34.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.804+0000 7f4c24475700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c1c0af960 0x7f4c1c0b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:34.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.804+0000 7f4c24475700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c1c0b04f0 0x7f4c1c0b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:34.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.804+0000 7f4c24475700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4c1c0b25b0 0x7f4c1c05f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:34.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.804+0000 7f4c24475700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0af460 con 0x7f4c1c0b25b0 2022-01-10T01:31:34.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.804+0000 7f4c24475700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0ad5a0 con 0x7f4c1c0af960 2022-01-10T01:31:34.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.804+0000 7f4c24475700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0ad060 con 0x7f4c1c0b04f0 2022-01-10T01:31:34.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c22a12700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4c1c0b25b0 0x7f4c1c05f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:34.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c22211700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c1c0af960 0x7f4c1c0b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:34.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c21a10700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c1c0b04f0 0x7f4c1c0b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:34.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c22a12700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4c1c0b25b0 0x7f4c1c05f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39144/0 (socket says 172.21.15.36:39144) 2022-01-10T01:31:34.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c21a10700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c1c0b04f0 0x7f4c1c0b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:45424/0 (socket says 172.21.15.36:45424) 2022-01-10T01:31:34.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c22a12700 1 -- 172.21.15.36:0/768753648 learned_addr learned my addr 172.21.15.36:0/768753648 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:34.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c22a12700 1 -- 172.21.15.36:0/768753648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c1c0b04f0 msgr2=0x7f4c1c0b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:34.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c22a12700 1 --2- 172.21.15.36:0/768753648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c1c0b04f0 0x7f4c1c0b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:34.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c22a12700 1 -- 172.21.15.36:0/768753648 >> v2:172.21.15.59:3300/0 conn(0x7f4c1c0af960 msgr2=0x7f4c1c0b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:34.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c22a12700 1 --2- 172.21.15.36:0/768753648 >> v2:172.21.15.59:3300/0 conn(0x7f4c1c0af960 0x7f4c1c0b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:34.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c22a12700 1 -- 172.21.15.36:0/768753648 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0ad300 con 0x7f4c1c0b25b0 2022-01-10T01:31:34.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c22a12700 1 --2- 172.21.15.36:0/768753648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c1c0b25b0 0x7f4c1c05f6b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f4c140032f0 tx=0x7f4c1400d730).ready entity=mon.0 client_cookie=df7e2cf0ab7bc667 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:34.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c2120f700 1 -- 172.21.15.36:0/768753648 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c14012070 con 0x7f4c1c0b25b0 2022-01-10T01:31:34.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c2120f700 1 -- 172.21.15.36:0/768753648 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1400faa0 con 0x7f4c1c0b25b0 2022-01-10T01:31:34.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c2120f700 1 -- 172.21.15.36:0/768753648 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c1400fe00 con 0x7f4c1c0b25b0 2022-01-10T01:31:34.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c24475700 1 -- 172.21.15.36:0/768753648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c1c0b25b0 msgr2=0x7f4c1c05f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:34.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c24475700 1 --2- 172.21.15.36:0/768753648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c1c0b25b0 0x7f4c1c05f6b0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f4c140032f0 tx=0x7f4c1400d730).stop 2022-01-10T01:31:34.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c24475700 1 -- 172.21.15.36:0/768753648 shutdown_connections 2022-01-10T01:31:34.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c24475700 1 --2- 172.21.15.36:0/768753648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c1c0b25b0 0x7f4c1c05f6b0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:34.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c24475700 1 --2- 172.21.15.36:0/768753648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c1c0b04f0 0x7f4c1c0b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:34.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c24475700 1 --2- 172.21.15.36:0/768753648 >> v2:172.21.15.59:3300/0 conn(0x7f4c1c0af960 0x7f4c1c0b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:34.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c24475700 1 -- 172.21.15.36:0/768753648 >> 172.21.15.36:0/768753648 conn(0x7f4c1c05cd20 msgr2=0x7f4c1c062fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:34.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c24475700 1 -- 172.21.15.36:0/768753648 shutdown_connections 2022-01-10T01:31:34.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c24475700 1 -- 172.21.15.36:0/768753648 wait complete. 2022-01-10T01:31:34.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c24475700 1 Processor -- start 2022-01-10T01:31:34.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.808+0000 7f4c24475700 1 -- start start 2022-01-10T01:31:34.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c24475700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c1c0af960 0x7f4c1c0a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:34.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c24475700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c1c0b04f0 0x7f4c1c0a8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:34.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c24475700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c1c0b25b0 0x7f4c1c065b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:34.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c24475700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0a9c90 con 0x7f4c1c0af960 2022-01-10T01:31:34.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c24475700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0a8c80 con 0x7f4c1c0b04f0 2022-01-10T01:31:34.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c24475700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0a6e80 con 0x7f4c1c0b25b0 2022-01-10T01:31:34.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c22211700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c1c0af960 0x7f4c1c0a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:34.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c22211700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c1c0af960 0x7f4c1c0a5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39146/0 (socket says 172.21.15.36:39146) 2022-01-10T01:31:34.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c22211700 1 -- 172.21.15.36:0/2282298319 learned_addr learned my addr 172.21.15.36:0/2282298319 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:34.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c22a12700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c1c0b25b0 0x7f4c1c065b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:34.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c21a10700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c1c0b04f0 0x7f4c1c0a8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:34.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c22211700 1 -- 172.21.15.36:0/2282298319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c1c0b25b0 msgr2=0x7f4c1c065b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:34.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c22211700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c1c0b25b0 0x7f4c1c065b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:34.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c22211700 1 -- 172.21.15.36:0/2282298319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c1c0b04f0 msgr2=0x7f4c1c0a8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:34.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c22211700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c1c0b04f0 0x7f4c1c0a8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:34.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c22211700 1 -- 172.21.15.36:0/2282298319 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1400d9d0 con 0x7f4c1c0af960 2022-01-10T01:31:34.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c21a10700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c1c0b04f0 0x7f4c1c0a8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:34.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c22211700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c1c0af960 0x7f4c1c0a5aa0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f4c18006940 tx=0x7f4c18008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:34.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c0b7fe700 1 -- 172.21.15.36:0/2282298319 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c1800cbd0 con 0x7f4c1c0af960 2022-01-10T01:31:34.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c0b7fe700 1 -- 172.21.15.36:0/2282298319 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1800cd30 con 0x7f4c1c0af960 2022-01-10T01:31:34.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c24475700 1 -- 172.21.15.36:0/2282298319 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c0a73d0 con 0x7f4c1c0af960 2022-01-10T01:31:34.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c0b7fe700 1 -- 172.21.15.36:0/2282298319 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c1800cea0 con 0x7f4c1c0af960 2022-01-10T01:31:34.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.812+0000 7f4c24475700 1 -- 172.21.15.36:0/2282298319 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c0a8830 con 0x7f4c1c0af960 2022-01-10T01:31:34.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.816+0000 7f4c24475700 1 -- 172.21.15.36:0/2282298319 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c0a6940 con 0x7f4c1c0af960 2022-01-10T01:31:34.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.816+0000 7f4c0b7fe700 1 -- 172.21.15.36:0/2282298319 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4c18020070 con 0x7f4c1c0af960 2022-01-10T01:31:34.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.816+0000 7f4c0b7fe700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bfc053620 0x7f4bfc055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:34.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.816+0000 7f4c0b7fe700 1 -- 172.21.15.36:0/2282298319 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f4c1806bf10 con 0x7f4c1c0af960 2022-01-10T01:31:34.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.816+0000 7f4c21a10700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bfc053620 0x7f4bfc055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:34.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.816+0000 7f4c21a10700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bfc053620 0x7f4bfc055ae0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f4c0c00b000 tx=0x7f4c0c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:34.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.824+0000 7f4c0b7fe700 1 -- 172.21.15.36:0/2282298319 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c18043200 con 0x7f4c1c0af960 2022-01-10T01:31:35.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:34.996+0000 7f4c24475700 1 -- 172.21.15.36:0/2282298319 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7f4c1c0b16a0 con 0x7f4c1c0af960 2022-01-10T01:31:35.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.672+0000 7f4c0b7fe700 1 -- 172.21.15.36:0/2282298319 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v318) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4c18046820 con 0x7f4c1c0af960 2022-01-10T01:31:35.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.676+0000 7f4c24475700 1 -- 172.21.15.36:0/2282298319 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bfc053620 msgr2=0x7f4bfc055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:35.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.676+0000 7f4c24475700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bfc053620 0x7f4bfc055ae0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f4c0c00b000 tx=0x7f4c0c008040).stop 2022-01-10T01:31:35.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.676+0000 7f4c24475700 1 -- 172.21.15.36:0/2282298319 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c1c0af960 msgr2=0x7f4c1c0a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:35.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.676+0000 7f4c24475700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c1c0af960 0x7f4c1c0a5aa0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f4c18006940 tx=0x7f4c18008040).stop 2022-01-10T01:31:35.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.676+0000 7f4c24475700 1 -- 172.21.15.36:0/2282298319 shutdown_connections 2022-01-10T01:31:35.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.676+0000 7f4c24475700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4bfc053620 0x7f4bfc055ae0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:35.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.676+0000 7f4c24475700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c1c0b25b0 0x7f4c1c065b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:35.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.676+0000 7f4c24475700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c1c0b04f0 0x7f4c1c0a8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:35.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.676+0000 7f4c24475700 1 --2- 172.21.15.36:0/2282298319 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c1c0af960 0x7f4c1c0a5aa0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:35.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.676+0000 7f4c24475700 1 -- 172.21.15.36:0/2282298319 >> 172.21.15.36:0/2282298319 conn(0x7f4c1c05cd20 msgr2=0x7f4c1c0b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:35.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.676+0000 7f4c24475700 1 -- 172.21.15.36:0/2282298319 shutdown_connections 2022-01-10T01:31:35.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.676+0000 7f4c24475700 1 -- 172.21.15.36:0/2282298319 wait complete. 2022-01-10T01:31:35.700 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2022-01-10T01:31:35.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c9bd3700 1 Processor -- start 2022-01-10T01:31:35.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c9bd3700 1 -- start start 2022-01-10T01:31:35.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c9bd3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c4061b80 0x7f67c40b1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:35.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c9bd3700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c414ad80 con 0x7f67c40b39d0 2022-01-10T01:31:35.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c9bd3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c414b020 con 0x7f67c414b760 2022-01-10T01:31:35.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c9bd3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c414ab90 con 0x7f67c4061b80 2022-01-10T01:31:35.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c2ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f67c40b39d0 0x7f67c4144710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36950/0 (socket says 172.21.15.36:36950) 2022-01-10T01:31:35.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c2ffd700 1 -- 172.21.15.36:0/1973871086 learned_addr learned my addr 172.21.15.36:0/1973871086 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:35.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c37fe700 1 --2- 172.21.15.36:0/1973871086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c4061b80 0x7f67c40b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:35.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c27fc700 1 -- 172.21.15.36:0/1973871086 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547058464 0 0) 0x7f67c414ad80 con 0x7f67c40b39d0 2022-01-10T01:31:35.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c27fc700 1 -- 172.21.15.36:0/1973871086 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67a4003260 con 0x7f67c40b39d0 2022-01-10T01:31:35.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c37fe700 1 -- 172.21.15.36:0/1973871086 >> v1:172.21.15.59:6789/0 conn(0x7f67c414b760 legacy=0x7f67c4151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:35.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c37fe700 1 -- 172.21.15.36:0/1973871086 >> v1:172.21.15.36:6789/0 conn(0x7f67c40b39d0 legacy=0x7f67c4144710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:35.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c37fe700 1 -- 172.21.15.36:0/1973871086 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c414b2c0 con 0x7f67c4061b80 2022-01-10T01:31:35.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c37fe700 1 --2- 172.21.15.36:0/1973871086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c4061b80 0x7f67c40b1100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f67ac002f70 tx=0x7f67ac006df0).ready entity=mon.2 client_cookie=c521ee6a58d28356 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:35.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c27fc700 1 -- 172.21.15.36:0/1973871086 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67ac00d570 con 0x7f67c4061b80 2022-01-10T01:31:35.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c27fc700 1 -- 172.21.15.36:0/1973871086 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac000e90 con 0x7f67c4061b80 2022-01-10T01:31:35.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.812+0000 7f67c27fc700 1 -- 172.21.15.36:0/1973871086 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67ac00d8c0 con 0x7f67c4061b80 2022-01-10T01:31:35.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.816+0000 7f67c9bd3700 1 -- 172.21.15.36:0/1973871086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c4061b80 msgr2=0x7f67c40b1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:35.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.816+0000 7f67c9bd3700 1 --2- 172.21.15.36:0/1973871086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c4061b80 0x7f67c40b1100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f67ac002f70 tx=0x7f67ac006df0).stop 2022-01-10T01:31:35.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.816+0000 7f67c9bd3700 1 -- 172.21.15.36:0/1973871086 shutdown_connections 2022-01-10T01:31:35.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.816+0000 7f67c9bd3700 1 --2- 172.21.15.36:0/1973871086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c4061b80 0x7f67c40b1100 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:35.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.816+0000 7f67c9bd3700 1 -- 172.21.15.36:0/1973871086 >> 172.21.15.36:0/1973871086 conn(0x7f67c40639b0 msgr2=0x7f67c4063d90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:35.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.816+0000 7f67c9bd3700 1 -- 172.21.15.36:0/1973871086 shutdown_connections 2022-01-10T01:31:35.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.816+0000 7f67c9bd3700 1 -- 172.21.15.36:0/1973871086 wait complete. 2022-01-10T01:31:35.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.816+0000 7f67c9bd3700 1 Processor -- start 2022-01-10T01:31:35.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.816+0000 7f67c9bd3700 1 -- start start 2022-01-10T01:31:35.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c9bd3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67c4061b80 0x7f67c4146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:35.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c9bd3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c40b39d0 0x7f67c4066bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:35.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c9bd3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67c414b760 0x7f67c40670a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:35.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c9bd3700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c40b4930 con 0x7f67c4061b80 2022-01-10T01:31:35.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c9bd3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c40b5840 con 0x7f67c414b760 2022-01-10T01:31:35.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c9bd3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4067590 con 0x7f67c40b39d0 2022-01-10T01:31:35.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c37fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67c4061b80 0x7f67c4146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:35.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c37fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67c4061b80 0x7f67c4146c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39160/0 (socket says 172.21.15.36:39160) 2022-01-10T01:31:35.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c37fe700 1 -- 172.21.15.36:0/2952485531 learned_addr learned my addr 172.21.15.36:0/2952485531 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:35.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c3fff700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67c414b760 0x7f67c40670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:35.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c2ffd700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c40b39d0 0x7f67c4066bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:35.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c37fe700 1 -- 172.21.15.36:0/2952485531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c40b39d0 msgr2=0x7f67c4066bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:35.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c37fe700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c40b39d0 0x7f67c4066bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:35.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c37fe700 1 -- 172.21.15.36:0/2952485531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67c414b760 msgr2=0x7f67c40670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:35.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c37fe700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67c414b760 0x7f67c40670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:35.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c37fe700 1 -- 172.21.15.36:0/2952485531 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac00b180 con 0x7f67c4061b80 2022-01-10T01:31:35.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c2ffd700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c40b39d0 0x7f67c4066bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:35.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c37fe700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67c4061b80 0x7f67c4146c10 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f67ac002f70 tx=0x7f67ac014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:35.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c0ff9700 1 -- 172.21.15.36:0/2952485531 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67ac00dea0 con 0x7f67c4061b80 2022-01-10T01:31:35.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c0ff9700 1 -- 172.21.15.36:0/2952485531 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac013e90 con 0x7f67c4061b80 2022-01-10T01:31:35.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c9bd3700 1 -- 172.21.15.36:0/2952485531 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c415ac30 con 0x7f67c4061b80 2022-01-10T01:31:35.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c0ff9700 1 -- 172.21.15.36:0/2952485531 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67ac01e5f0 con 0x7f67c4061b80 2022-01-10T01:31:35.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c9bd3700 1 -- 172.21.15.36:0/2952485531 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c414a620 con 0x7f67c4061b80 2022-01-10T01:31:35.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.820+0000 7f67c9bd3700 1 -- 172.21.15.36:0/2952485531 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c4057350 con 0x7f67c4061b80 2022-01-10T01:31:35.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.824+0000 7f67c0ff9700 1 -- 172.21.15.36:0/2952485531 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f67ac01c070 con 0x7f67c4061b80 2022-01-10T01:31:35.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.824+0000 7f67c0ff9700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f67a8053680 0x7f67a8055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:35.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.824+0000 7f67c0ff9700 1 -- 172.21.15.36:0/2952485531 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f67ac06c390 con 0x7f67c4061b80 2022-01-10T01:31:35.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.824+0000 7f67c2ffd700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f67a8053680 0x7f67a8055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:35.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.824+0000 7f67c2ffd700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f67a8053680 0x7f67a8055b40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f67b400b000 tx=0x7f67b4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:35.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.828+0000 7f67c0ff9700 1 -- 172.21.15.36:0/2952485531 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f67ac0435e0 con 0x7f67c4061b80 2022-01-10T01:31:35.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.952+0000 7f67c9bd3700 1 -- 172.21.15.36:0/2952485531 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f67c4067c70 con 0x7f67c4061b80 2022-01-10T01:31:35.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.956+0000 7f67c0ff9700 1 -- 172.21.15.36:0/2952485531 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f67ac023020 con 0x7f67c4061b80 2022-01-10T01:31:35.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.960+0000 7f67c9bd3700 1 -- 172.21.15.36:0/2952485531 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f67a8053680 msgr2=0x7f67a8055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:35.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.960+0000 7f67c9bd3700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f67a8053680 0x7f67a8055b40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f67b400b000 tx=0x7f67b4009040).stop 2022-01-10T01:31:35.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.960+0000 7f67c9bd3700 1 -- 172.21.15.36:0/2952485531 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67c4061b80 msgr2=0x7f67c4146c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:35.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.960+0000 7f67c9bd3700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67c4061b80 0x7f67c4146c10 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f67ac002f70 tx=0x7f67ac014000).stop 2022-01-10T01:31:35.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.960+0000 7f67c9bd3700 1 -- 172.21.15.36:0/2952485531 shutdown_connections 2022-01-10T01:31:35.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.960+0000 7f67c9bd3700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f67a8053680 0x7f67a8055b40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:35.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.960+0000 7f67c9bd3700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67c414b760 0x7f67c40670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:35.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.960+0000 7f67c9bd3700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c40b39d0 0x7f67c4066bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:35.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.960+0000 7f67c9bd3700 1 --2- 172.21.15.36:0/2952485531 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67c4061b80 0x7f67c4146c10 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:35.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.960+0000 7f67c9bd3700 1 -- 172.21.15.36:0/2952485531 >> 172.21.15.36:0/2952485531 conn(0x7f67c40639b0 msgr2=0x7f67c4144940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:35.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.960+0000 7f67c9bd3700 1 -- 172.21.15.36:0/2952485531 shutdown_connections 2022-01-10T01:31:35.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:35.960+0000 7f67c9bd3700 1 -- 172.21.15.36:0/2952485531 wait complete. 2022-01-10T01:31:35.976 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:31:35.976 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:35.996 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:36.018 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:36.039 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:36.059 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:31:36.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:36.060 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:36.061 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:36.086 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2022-01-10T01:31:36.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:31:36.087 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2022-01-10T01:31:36.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:36.088 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:36.089 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:36.108 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:31:36.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:31:36.110 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:31:36.111 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:31:36.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb214d2700 1 Processor -- start 2022-01-10T01:31:36.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb214d2700 1 -- start start 2022-01-10T01:31:36.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb214d2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb1c0b2580 0x7fdb1c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:36.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb214d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0b0010 0x7fdb1c14b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:36.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb214d2700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1c0a70c0 con 0x7fdb1c0afbd0 2022-01-10T01:31:36.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb214d2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c0a72f0 con 0x7fdb1c0b2580 2022-01-10T01:31:36.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb214d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c0a7590 con 0x7fdb1c0b0010 2022-01-10T01:31:36.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb20cd1700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fdb1c0afbd0 0x7fdb1c0a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:36966/0 (socket says 172.21.15.36:36966) 2022-01-10T01:31:36.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb20cd1700 1 -- 172.21.15.36:0/4236866442 learned_addr learned my addr 172.21.15.36:0/4236866442 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:36.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb1b7fe700 1 --2- 172.21.15.36:0/4236866442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0b0010 0x7fdb1c14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:36.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb1bfff700 1 --2- 172.21.15.36:0/4236866442 >> v2:172.21.15.59:3300/0 conn(0x7fdb1c0b2580 0x7fdb1c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:36.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb1affd700 1 -- 172.21.15.36:0/4236866442 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328984108 0 0) 0x7fdb1c0a70c0 con 0x7fdb1c0afbd0 2022-01-10T01:31:36.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb1affd700 1 -- 172.21.15.36:0/4236866442 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb08003260 con 0x7fdb1c0afbd0 2022-01-10T01:31:36.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb1b7fe700 1 -- 172.21.15.36:0/4236866442 >> v2:172.21.15.59:3300/0 conn(0x7fdb1c0b2580 msgr2=0x7fdb1c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:36.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb1b7fe700 1 --2- 172.21.15.36:0/4236866442 >> v2:172.21.15.59:3300/0 conn(0x7fdb1c0b2580 0x7fdb1c14ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb1b7fe700 1 -- 172.21.15.36:0/4236866442 >> v1:172.21.15.36:6789/0 conn(0x7fdb1c0afbd0 legacy=0x7fdb1c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:36.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb1b7fe700 1 -- 172.21.15.36:0/4236866442 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c0a7830 con 0x7fdb1c0b0010 2022-01-10T01:31:36.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb1b7fe700 1 --2- 172.21.15.36:0/4236866442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0b0010 0x7fdb1c14b330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fdb0c0032f0 tx=0x7fdb0c0091d0).ready entity=mon.2 client_cookie=f0bbd82a35edc335 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:36.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb1affd700 1 -- 172.21.15.36:0/4236866442 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb0c00b600 con 0x7fdb1c0b0010 2022-01-10T01:31:36.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb1affd700 1 -- 172.21.15.36:0/4236866442 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c00b760 con 0x7fdb1c0b0010 2022-01-10T01:31:36.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.220+0000 7fdb1affd700 1 -- 172.21.15.36:0/4236866442 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb0c00b8d0 con 0x7fdb1c0b0010 2022-01-10T01:31:36.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.224+0000 7fdb214d2700 1 -- 172.21.15.36:0/4236866442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0b0010 msgr2=0x7fdb1c14b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:36.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.224+0000 7fdb214d2700 1 --2- 172.21.15.36:0/4236866442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0b0010 0x7fdb1c14b330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fdb0c0032f0 tx=0x7fdb0c0091d0).stop 2022-01-10T01:31:36.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.224+0000 7fdb214d2700 1 -- 172.21.15.36:0/4236866442 shutdown_connections 2022-01-10T01:31:36.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.224+0000 7fdb214d2700 1 --2- 172.21.15.36:0/4236866442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0b0010 0x7fdb1c14b330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.224+0000 7fdb214d2700 1 --2- 172.21.15.36:0/4236866442 >> v2:172.21.15.59:3300/0 conn(0x7fdb1c0b2580 0x7fdb1c14ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.224+0000 7fdb214d2700 1 -- 172.21.15.36:0/4236866442 >> 172.21.15.36:0/4236866442 conn(0x7fdb1c060180 msgr2=0x7fdb1c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:36.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.224+0000 7fdb214d2700 1 -- 172.21.15.36:0/4236866442 shutdown_connections 2022-01-10T01:31:36.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.224+0000 7fdb214d2700 1 -- 172.21.15.36:0/4236866442 wait complete. 2022-01-10T01:31:36.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.224+0000 7fdb214d2700 1 Processor -- start 2022-01-10T01:31:36.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.224+0000 7fdb214d2700 1 -- start start 2022-01-10T01:31:36.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb214d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c0afbd0 0x7fdb1c05cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:36.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb214d2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb1c0b0010 0x7fdb1c0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:36.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb214d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0b2580 0x7fdb1c0b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:36.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb214d2700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c143ed0 con 0x7fdb1c0b0010 2022-01-10T01:31:36.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb214d2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c1445d0 con 0x7fdb1c0afbd0 2022-01-10T01:31:36.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb214d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c0b3d90 con 0x7fdb1c0b2580 2022-01-10T01:31:36.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb1b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb1c0b0010 0x7fdb1c0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:36.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb1bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c0afbd0 0x7fdb1c05cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:36.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb1b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb1c0b0010 0x7fdb1c0b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39178/0 (socket says 172.21.15.36:39178) 2022-01-10T01:31:36.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb1b7fe700 1 -- 172.21.15.36:0/4112536213 learned_addr learned my addr 172.21.15.36:0/4112536213 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:36.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb20cd1700 1 --2- 172.21.15.36:0/4112536213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0b2580 0x7fdb1c0b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:36.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb1b7fe700 1 -- 172.21.15.36:0/4112536213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0b2580 msgr2=0x7fdb1c0b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:36.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb1b7fe700 1 --2- 172.21.15.36:0/4112536213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0b2580 0x7fdb1c0b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb1b7fe700 1 -- 172.21.15.36:0/4112536213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c0afbd0 msgr2=0x7fdb1c05cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:36.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb1b7fe700 1 --2- 172.21.15.36:0/4112536213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c0afbd0 0x7fdb1c05cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb1b7fe700 1 -- 172.21.15.36:0/4112536213 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c009470 con 0x7fdb1c0b0010 2022-01-10T01:31:36.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb1b7fe700 1 --2- 172.21.15.36:0/4112536213 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb1c0b0010 0x7fdb1c0b4510 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7fdb0c0032f0 tx=0x7fdb0c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:36.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb197fa700 1 -- 172.21.15.36:0/4112536213 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb0c011b60 con 0x7fdb1c0b0010 2022-01-10T01:31:36.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb197fa700 1 -- 172.21.15.36:0/4112536213 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c011cc0 con 0x7fdb1c0b0010 2022-01-10T01:31:36.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb197fa700 1 -- 172.21.15.36:0/4112536213 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb0c01f5e0 con 0x7fdb1c0b0010 2022-01-10T01:31:36.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb214d2700 1 -- 172.21.15.36:0/4112536213 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1c0b4030 con 0x7fdb1c0b0010 2022-01-10T01:31:36.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb214d2700 1 -- 172.21.15.36:0/4112536213 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c0aa0a0 con 0x7fdb1c0b0010 2022-01-10T01:31:36.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb197fa700 1 -- 172.21.15.36:0/4112536213 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fdb0c026030 con 0x7fdb1c0b0010 2022-01-10T01:31:36.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.228+0000 7fdb214d2700 1 -- 172.21.15.36:0/4112536213 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c144790 con 0x7fdb1c0b0010 2022-01-10T01:31:36.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.232+0000 7fdb197fa700 1 --2- 172.21.15.36:0/4112536213 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdafc053680 0x7fdafc055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:36.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.232+0000 7fdb197fa700 1 -- 172.21.15.36:0/4112536213 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fdb0c06c260 con 0x7fdb1c0b0010 2022-01-10T01:31:36.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.232+0000 7fdb1bfff700 1 --2- 172.21.15.36:0/4112536213 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdafc053680 0x7fdafc055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:36.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.232+0000 7fdb1bfff700 1 --2- 172.21.15.36:0/4112536213 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdafc053680 0x7fdafc055b40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fdb1000b000 tx=0x7fdb10006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:36.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.236+0000 7fdb197fa700 1 -- 172.21.15.36:0/4112536213 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdb0c043550 con 0x7fdb1c0b0010 2022-01-10T01:31:36.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.364+0000 7fdb214d2700 1 -- 172.21.15.36:0/4112536213 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fdb1c057350 con 0x7fdb1c0b0010 2022-01-10T01:31:36.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.368+0000 7fdb197fa700 1 -- 172.21.15.36:0/4112536213 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v92) v1 ==== 81+0+29220 (secure 0 0 0) 0x7fdb0c046b70 con 0x7fdb1c0b0010 2022-01-10T01:31:36.374 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:36.374 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:31:36.374 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 92, 2022-01-10T01:31:36.374 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:31:36.375 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:31:36.375 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:31:33.665944+0000", 2022-01-10T01:31:36.375 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:31:36.375 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:31:36.376 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:31:36.376 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:31:36.376 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:31:36.376 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:31:36.377 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:31:36.377 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:31:36.377 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:31:36.377 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:36.378 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:31:36.378 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:31:36.378 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:31:36.378 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:31:36.379 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:31:36.379 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 16, 2022-01-10T01:31:36.379 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:31:36.379 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:31:36.380 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:31:36.380 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:31:36.380 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:31:36.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.381 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:31:36.381 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:31:36.381 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:31:36.382 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:36.382 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:36.382 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:36.382 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:36.383 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:36.383 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:36.383 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:36.384 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:36.384 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:31:36.384 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:31:36.384 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:31:36.385 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:31:36.385 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:31:36.385 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:36.386 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:36.386 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:36.386 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:36.386 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:36.387 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:36.387 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:36.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.388 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:31:36.388 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:36.388 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:36.388 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:36.389 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:36.389 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:36.389 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:36.389 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:36.390 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:36.390 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:36.390 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:36.390 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:36.391 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:36.391 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:36.391 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:36.391 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:36.392 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:36.392 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:36.392 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:36.392 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:36.392 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:36.393 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:36.393 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:36.393 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:36.393 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:36.394 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:36.394 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:36.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.394 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:36.395 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:36.395 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:36.395 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:36.395 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:36.396 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:36.396 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:36.396 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:36.396 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:36.396 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:36.397 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:36.397 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:31:36.397 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:31:36.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.398 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:36.398 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:31:36.398 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.398 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.399 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:31:36.399 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:31:36.399 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:31:36.399 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:36.400 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:36.400 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:36.400 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:36.400 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:36.401 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:36.401 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:36.401 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:36.401 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:31:36.401 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:31:36.402 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:31:36.402 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:31:36.402 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:31:36.402 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:36.403 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:36.403 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:36.403 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:36.403 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:36.403 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:36.404 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:36.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.404 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:31:36.404 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:36.405 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:36.405 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:36.405 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:36.405 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:36.405 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:36.406 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:36.406 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:36.406 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:36.406 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:36.407 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:36.407 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:36.407 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:36.407 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:36.408 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:36.408 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:36.408 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:36.408 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:36.408 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:36.409 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:36.409 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:36.409 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:36.409 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:36.410 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:36.410 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:36.410 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:36.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.411 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:36.411 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:36.411 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:36.411 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:36.412 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:36.412 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:36.412 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:36.412 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:36.412 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:36.413 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:36.413 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:36.413 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:31:36.413 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:36.414 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:31:36.414 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.414 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.414 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:36.415 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:31:36.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.415 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:31:36.415 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:31:36.416 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:36.416 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:36.416 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:36.416 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:36.416 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:36.417 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:36.417 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:36.417 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 87, 2022-01-10T01:31:36.417 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:36.418 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:36.418 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:36.418 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.419 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.419 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:31:36.419 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:36.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.420 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.420 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:31:36.420 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:36.420 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.421 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.421 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:36.421 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.422 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.422 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:31:36.422 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:36.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.423 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.423 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:31:36.424 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:36.424 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.424 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.424 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:36.425 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.425 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.425 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:31:36.426 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:36.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.426 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.427 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:31:36.427 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:36.427 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.427 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.427 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.428 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:36.428 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.428 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.429 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:31:36.429 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:36.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.430 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.430 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:31:36.430 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:36.431 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.431 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.431 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:31:36.432 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:31:36.432 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:31:36.432 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:31:36.432 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:36.432 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:36.433 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:36.433 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.433 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.434 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:31:36.434 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:31:36.434 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:36.434 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:36.435 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:36.435 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:36.435 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:36.435 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:36.436 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:36.436 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 85, 2022-01-10T01:31:36.436 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:36.436 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:36.436 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:36.437 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.437 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.437 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:31:36.438 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:36.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.438 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.438 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:31:36.439 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:36.439 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.439 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.439 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.440 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:36.440 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.440 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.440 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:31:36.441 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:36.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.441 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.442 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:31:36.442 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:36.442 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.442 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.442 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.443 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:36.443 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.443 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.444 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:31:36.444 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:36.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.445 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.445 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:31:36.445 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:36.445 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.445 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.446 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:36.446 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.447 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.447 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:31:36.447 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:36.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.448 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.448 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.448 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:31:36.448 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:36.449 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.449 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.449 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:31:36.449 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:31:36.450 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:31:36.450 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:31:36.450 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:36.450 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:36.451 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:36.451 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.452 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:31:36.452 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:31:36.452 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:36.452 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:36.452 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:36.453 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:36.453 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:36.453 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:36.453 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:36.454 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 75, 2022-01-10T01:31:36.454 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:36.454 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:36.454 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:36.454 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.455 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:31:36.455 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:36.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.456 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.456 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:31:36.456 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:36.457 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.457 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.457 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:36.458 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.458 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.458 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:31:36.458 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:36.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.459 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.459 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:31:36.460 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:36.460 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.460 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.460 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.461 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:31:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.462 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:31:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.464 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:31:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.465 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:31:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.466 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:31:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:31:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:31:36.467 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:31:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:31:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:31:36.469 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:36.470 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 86, 2022-01-10T01:31:36.471 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.472 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:31:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:31:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:36.474 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:31:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:36.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:31:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:36.477 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.478 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.478 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:36.478 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:31:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:36.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:31:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:36.480 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:36.481 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:31:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:36.482 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.483 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:31:36.484 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:36.484 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.484 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:31:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:31:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:31:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:31:36.485 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.486 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:31:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:31:36.487 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:36.488 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 86, 2022-01-10T01:31:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:36.489 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.490 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:31:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.491 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.492 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:31:36.492 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:36.492 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.492 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.493 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:36.493 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.493 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.494 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:31:36.494 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:36.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.495 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.495 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:31:36.495 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:36.495 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.496 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.496 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:36.496 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.497 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.497 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:31:36.497 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:36.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.498 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.498 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:31:36.498 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:36.499 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.499 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.499 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:36.499 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.500 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.500 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.500 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:31:36.500 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:36.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.501 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.501 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:31:36.502 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:36.502 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.502 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.503 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:31:36.503 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:31:36.503 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:31:36.503 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:31:36.504 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:36.504 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:36.504 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:36.504 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:31:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:31:36.505 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:36.506 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:36.507 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:36.507 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:36.507 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 86, 2022-01-10T01:31:36.507 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:36.507 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:36.508 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:36.508 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.508 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:31:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.509 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.510 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:31:36.510 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:36.510 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.510 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:31:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:31:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:36.513 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:36.514 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:31:36.515 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.516 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:31:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.517 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.518 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:31:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.519 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:31:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.521 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:31:36.521 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:31:36.521 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:31:36.521 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:31:36.521 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.522 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:31:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:31:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:36.523 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:36.524 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 86, 2022-01-10T01:31:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:36.525 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.526 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:31:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.527 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:31:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.529 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:31:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.530 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:31:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.532 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:36.532 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.532 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.532 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:31:36.533 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:36.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.533 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:31:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.534 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.535 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:31:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.536 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:31:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.537 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:31:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:31:36.538 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:31:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:31:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:36.539 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:31:36.540 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:31:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:36.541 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 75, 2022-01-10T01:31:36.542 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.543 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:31:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.544 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:31:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:36.545 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.546 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:31:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:36.547 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:31:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:36.548 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:36.549 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:31:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:36.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:31:36.551 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.552 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:31:36.553 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:36.554 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:31:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.555 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:31:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:31:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:31:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:31:36.556 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:36.557 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:31:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:31:36.558 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:36.559 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:31:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.560 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:31:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:36.561 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:31:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:36.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:31:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:36.563 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:31:36.564 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:31:36.565 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:36.566 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:31:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.567 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:31:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:36.568 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:31:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:31:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:36.570 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:31:36.571 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:31:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:36.572 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:36.573 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:31:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:31:36.574 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:36.575 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:31:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:36.576 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:31:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:31:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:31:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:31:36.577 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": { 2022-01-10T01:31:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.59:6833/3399412771": "2022-01-11T01:31:30.587450+0000", 2022-01-10T01:31:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.59:6832/3399412771": "2022-01-11T01:31:30.587450+0000" 2022-01-10T01:31:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.578 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:31:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:31:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:31:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:31:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:31:36.579 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:31:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:31:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:31:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:31:36.580 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:31:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:31:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:31:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.581 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:31:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:31:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:31:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:31:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:31:36.582 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:31:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:31:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:36.583 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:31:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:31:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:31:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:31:36.584 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:31:36.585 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:31:36.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.368+0000 7fdb214d2700 1 -- 172.21.15.36:0/4112536213 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdafc053680 msgr2=0x7fdafc055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:36.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.368+0000 7fdb214d2700 1 --2- 172.21.15.36:0/4112536213 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdafc053680 0x7fdafc055b40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7fdb1000b000 tx=0x7fdb10006df0).stop 2022-01-10T01:31:36.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.368+0000 7fdb214d2700 1 -- 172.21.15.36:0/4112536213 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb1c0b0010 msgr2=0x7fdb1c0b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:36.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.368+0000 7fdb214d2700 1 --2- 172.21.15.36:0/4112536213 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb1c0b0010 0x7fdb1c0b4510 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7fdb0c0032f0 tx=0x7fdb0c016000).stop 2022-01-10T01:31:36.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.368+0000 7fdb214d2700 1 -- 172.21.15.36:0/4112536213 shutdown_connections 2022-01-10T01:31:36.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.368+0000 7fdb214d2700 1 --2- 172.21.15.36:0/4112536213 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdafc053680 0x7fdafc055b40 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.368+0000 7fdb214d2700 1 --2- 172.21.15.36:0/4112536213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb1c0b2580 0x7fdb1c0b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.368+0000 7fdb214d2700 1 --2- 172.21.15.36:0/4112536213 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdb1c0b0010 0x7fdb1c0b4510 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.368+0000 7fdb214d2700 1 --2- 172.21.15.36:0/4112536213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb1c0afbd0 0x7fdb1c05cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.368+0000 7fdb214d2700 1 -- 172.21.15.36:0/4112536213 >> 172.21.15.36:0/4112536213 conn(0x7fdb1c060180 msgr2=0x7fdb1c1486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:36.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.368+0000 7fdb214d2700 1 -- 172.21.15.36:0/4112536213 shutdown_connections 2022-01-10T01:31:36.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.368+0000 7fdb214d2700 1 -- 172.21.15.36:0/4112536213 wait complete. 2022-01-10T01:31:36.590 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:36.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.696+0000 7f0fbedac700 1 Processor -- start 2022-01-10T01:31:36.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.696+0000 7f0fbedac700 1 -- start start 2022-01-10T01:31:36.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.696+0000 7f0fbedac700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0fb80b2580 0x7f0fb8140050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:36.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.696+0000 7f0fbedac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b00e0 0x7f0fb8140540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:36.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.696+0000 7f0fbedac700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb8067880 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.696+0000 7f0fbedac700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb80ad5b0 con 0x7f0fb80b2580 2022-01-10T01:31:36.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.696+0000 7f0fbedac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb8067b20 con 0x7f0fb80b00e0 2022-01-10T01:31:36.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbddaa700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0fb80b2580 0x7f0fb8140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:36.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbddaa700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0fb80b2580 0x7f0fb8140050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39184/0 (socket says 172.21.15.36:39184) 2022-01-10T01:31:36.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbddaa700 1 -- 172.21.15.36:0/1865500521 learned_addr learned my addr 172.21.15.36:0/1865500521 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:36.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbd5a9700 1 --2- 172.21.15.36:0/1865500521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b00e0 0x7f0fb8140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:36.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbddaa700 1 -- 172.21.15.36:0/1865500521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b00e0 msgr2=0x7f0fb8140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:36.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbddaa700 1 --2- 172.21.15.36:0/1865500521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b00e0 0x7f0fb8140540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbcda8700 1 -- 172.21.15.36:0/1865500521 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193178501 0 0) 0x7f0fb8067880 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbddaa700 1 -- 172.21.15.36:0/1865500521 >> v1:172.21.15.59:6789/0 conn(0x7f0fb80ac6f0 legacy=0x7f0fb8142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:36.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbddaa700 1 -- 172.21.15.36:0/1865500521 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb8146fd0 con 0x7f0fb80b2580 2022-01-10T01:31:36.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbddaa700 1 --2- 172.21.15.36:0/1865500521 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80b2580 0x7f0fb8140050 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f0fa8002f70 tx=0x7f0fa8006eb0).ready entity=mon.0 client_cookie=63657b09a94d1b72 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:36.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbcda8700 1 -- 172.21.15.36:0/1865500521 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fa800d570 con 0x7f0fb80b2580 2022-01-10T01:31:36.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbcda8700 1 -- 172.21.15.36:0/1865500521 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa8000e90 con 0x7f0fb80b2580 2022-01-10T01:31:36.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbcda8700 1 -- 172.21.15.36:0/1865500521 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fa800d8c0 con 0x7f0fb80b2580 2022-01-10T01:31:36.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbedac700 1 -- 172.21.15.36:0/1865500521 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80b2580 msgr2=0x7f0fb8140050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:36.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbedac700 1 --2- 172.21.15.36:0/1865500521 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80b2580 0x7f0fb8140050 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f0fa8002f70 tx=0x7f0fa8006eb0).stop 2022-01-10T01:31:36.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbedac700 1 -- 172.21.15.36:0/1865500521 shutdown_connections 2022-01-10T01:31:36.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbedac700 1 --2- 172.21.15.36:0/1865500521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b00e0 0x7f0fb8140540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbedac700 1 --2- 172.21.15.36:0/1865500521 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80b2580 0x7f0fb8140050 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbedac700 1 -- 172.21.15.36:0/1865500521 >> 172.21.15.36:0/1865500521 conn(0x7f0fb8060180 msgr2=0x7f0fb80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:36.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbedac700 1 -- 172.21.15.36:0/1865500521 shutdown_connections 2022-01-10T01:31:36.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.700+0000 7f0fbedac700 1 -- 172.21.15.36:0/1865500521 wait complete. 2022-01-10T01:31:36.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbedac700 1 Processor -- start 2022-01-10T01:31:36.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbedac700 1 -- start start 2022-01-10T01:31:36.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbedac700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80ac6f0 0x7f0fb8155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:36.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbedac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b00e0 0x7f0fb80b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:36.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbedac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b2580 0x7f0fb809f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:36.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbedac700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb80aaa80 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbedac700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb80ab740 con 0x7f0fb80b2580 2022-01-10T01:31:36.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbedac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb80ac0f0 con 0x7f0fb80b00e0 2022-01-10T01:31:36.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbddaa700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80ac6f0 0x7f0fb8155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:36.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbddaa700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80ac6f0 0x7f0fb8155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39188/0 (socket says 172.21.15.36:39188) 2022-01-10T01:31:36.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbddaa700 1 -- 172.21.15.36:0/1388848204 learned_addr learned my addr 172.21.15.36:0/1388848204 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:36.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbe5ab700 1 --2- 172.21.15.36:0/1388848204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b2580 0x7f0fb809f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:36.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbd5a9700 1 --2- 172.21.15.36:0/1388848204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b00e0 0x7f0fb80b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:36.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbddaa700 1 -- 172.21.15.36:0/1388848204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b00e0 msgr2=0x7f0fb80b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:36.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbddaa700 1 --2- 172.21.15.36:0/1388848204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b00e0 0x7f0fb80b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbddaa700 1 -- 172.21.15.36:0/1388848204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b2580 msgr2=0x7f0fb809f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:36.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbddaa700 1 --2- 172.21.15.36:0/1388848204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b2580 0x7f0fb809f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbddaa700 1 -- 172.21.15.36:0/1388848204 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa800b1e0 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbddaa700 1 --2- 172.21.15.36:0/1388848204 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80ac6f0 0x7f0fb8155fa0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f0fa8002f70 tx=0x7f0fa8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:36.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fa6ffd700 1 -- 172.21.15.36:0/1388848204 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fa8011690 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fa6ffd700 1 -- 172.21.15.36:0/1388848204 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa80117f0 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fa6ffd700 1 -- 172.21.15.36:0/1388848204 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fa8011b50 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbedac700 1 -- 172.21.15.36:0/1388848204 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb80a9510 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.704+0000 7f0fbedac700 1 -- 172.21.15.36:0/1388848204 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb80ab930 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.708+0000 7f0fbedac700 1 -- 172.21.15.36:0/1388848204 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb80a92e0 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.708+0000 7f0fa6ffd700 1 -- 172.21.15.36:0/1388848204 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0fa801a040 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.708+0000 7f0fa6ffd700 1 --2- 172.21.15.36:0/1388848204 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f98053620 0x7f0f98055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:36.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.708+0000 7f0fa6ffd700 1 -- 172.21.15.36:0/1388848204 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f0fa806c3f0 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.708+0000 7f0fbd5a9700 1 --2- 172.21.15.36:0/1388848204 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f98053620 0x7f0f98055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:36.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.708+0000 7f0fbd5a9700 1 --2- 172.21.15.36:0/1388848204 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f98053620 0x7f0f98055ae0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f0fb400b000 tx=0x7f0fb4006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:36.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.712+0000 7f0fa6ffd700 1 -- 172.21.15.36:0/1388848204 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0fa8043680 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.876+0000 7f0fbedac700 1 -- 172.21.15.36:0/1388848204 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fb80abaf0 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.880+0000 7f0fa6ffd700 1 -- 172.21.15.36:0/1388848204 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+1563 (secure 0 0 0) 0x7f0fa8023020 con 0x7f0fb80ac6f0 2022-01-10T01:31:36.885 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:36.885 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3902337896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3902337896},{"type":"v1","addr":"172.21.15.36:6835","nonce":3902337896}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6612,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6837/3131314479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":3131314479},{"type":"v1","addr":"172.21.15.36:6837","nonce":3131314479}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39},{"gid":36083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/3114266369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3114266369},{"type":"v1","addr":"172.21.15.59:6833","nonce":3114266369}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[]} 2022-01-10T01:31:36.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.880+0000 7f0fbedac700 1 -- 172.21.15.36:0/1388848204 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f98053620 msgr2=0x7f0f98055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:36.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.880+0000 7f0fbedac700 1 --2- 172.21.15.36:0/1388848204 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f98053620 0x7f0f98055ae0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f0fb400b000 tx=0x7f0fb4006df0).stop 2022-01-10T01:31:36.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.880+0000 7f0fbedac700 1 -- 172.21.15.36:0/1388848204 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80ac6f0 msgr2=0x7f0fb8155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:36.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.880+0000 7f0fbedac700 1 --2- 172.21.15.36:0/1388848204 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80ac6f0 0x7f0fb8155fa0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f0fa8002f70 tx=0x7f0fa8015000).stop 2022-01-10T01:31:36.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.880+0000 7f0fbedac700 1 -- 172.21.15.36:0/1388848204 shutdown_connections 2022-01-10T01:31:36.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.880+0000 7f0fbedac700 1 --2- 172.21.15.36:0/1388848204 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f98053620 0x7f0f98055ae0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.880+0000 7f0fbedac700 1 --2- 172.21.15.36:0/1388848204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b2580 0x7f0fb809f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.880+0000 7f0fbedac700 1 --2- 172.21.15.36:0/1388848204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b00e0 0x7f0fb80b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.880+0000 7f0fbedac700 1 --2- 172.21.15.36:0/1388848204 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80ac6f0 0x7f0fb8155fa0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:36.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.880+0000 7f0fbedac700 1 -- 172.21.15.36:0/1388848204 >> 172.21.15.36:0/1388848204 conn(0x7f0fb8060180 msgr2=0x7f0fb8140280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:36.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.880+0000 7f0fbedac700 1 -- 172.21.15.36:0/1388848204 shutdown_connections 2022-01-10T01:31:36.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.880+0000 7f0fbedac700 1 -- 172.21.15.36:0/1388848204 wait complete. 2022-01-10T01:31:36.890 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 43 2022-01-10T01:31:36.897 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:37.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 Processor -- start 2022-01-10T01:31:37.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 -- start start 2022-01-10T01:31:37.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62880b2580 0x7f628814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:37.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f62880a8ac0 0x7f628814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:37.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62880a70c0 con 0x7f62880b0010 2022-01-10T01:31:37.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62880a72f0 con 0x7f62880a8ac0 2022-01-10T01:31:37.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62880a7590 con 0x7f62880b2580 2022-01-10T01:31:37.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628eb47700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f62880a8ac0 0x7f628814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:37.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628eb47700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f62880a8ac0 0x7f628814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39200/0 (socket says 172.21.15.36:39200) 2022-01-10T01:31:37.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628eb47700 1 -- 172.21.15.36:0/1170539959 learned_addr learned my addr 172.21.15.36:0/1170539959 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:37.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628e346700 1 --2- 172.21.15.36:0/1170539959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62880b2580 0x7f628814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:37.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628eb47700 1 -- 172.21.15.36:0/1170539959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62880b2580 msgr2=0x7f628814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:37.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628eb47700 1 --2- 172.21.15.36:0/1170539959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62880b2580 0x7f628814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:37.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628eb47700 1 -- 172.21.15.36:0/1170539959 >> v1:172.21.15.36:6789/0 conn(0x7f62880b0010 legacy=0x7f62880a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:37.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628eb47700 1 -- 172.21.15.36:0/1170539959 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62880a7830 con 0x7f62880a8ac0 2022-01-10T01:31:37.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628d344700 1 -- 172.21.15.36:0/1170539959 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638465355 0 0) 0x7f62880a70c0 con 0x7f62880b0010 2022-01-10T01:31:37.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628e346700 1 --2- 172.21.15.36:0/1170539959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62880b2580 0x7f628814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:37.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628eb47700 1 --2- 172.21.15.36:0/1170539959 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62880a8ac0 0x7f628814b330 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f62800032f0 tx=0x7f6280009290).ready entity=mon.0 client_cookie=8fc9226d7cc3d7f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:37.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628d344700 1 -- 172.21.15.36:0/1170539959 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f628000b8a0 con 0x7f62880a8ac0 2022-01-10T01:31:37.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628d344700 1 -- 172.21.15.36:0/1170539959 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628000ba00 con 0x7f62880a8ac0 2022-01-10T01:31:37.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628d344700 1 -- 172.21.15.36:0/1170539959 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f628000bb70 con 0x7f62880a8ac0 2022-01-10T01:31:37.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 -- 172.21.15.36:0/1170539959 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62880a8ac0 msgr2=0x7f628814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:37.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 --2- 172.21.15.36:0/1170539959 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62880a8ac0 0x7f628814b330 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f62800032f0 tx=0x7f6280009290).stop 2022-01-10T01:31:37.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 -- 172.21.15.36:0/1170539959 shutdown_connections 2022-01-10T01:31:37.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 --2- 172.21.15.36:0/1170539959 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62880a8ac0 0x7f628814b330 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:37.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 --2- 172.21.15.36:0/1170539959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62880b2580 0x7f628814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:37.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 -- 172.21.15.36:0/1170539959 >> 172.21.15.36:0/1170539959 conn(0x7f6288060180 msgr2=0x7f62880b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:37.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 -- 172.21.15.36:0/1170539959 shutdown_connections 2022-01-10T01:31:37.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:36.996+0000 7f628f348700 1 -- 172.21.15.36:0/1170539959 wait complete. 2022-01-10T01:31:37.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628f348700 1 Processor -- start 2022-01-10T01:31:37.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628f348700 1 -- start start 2022-01-10T01:31:37.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628f348700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62880a8ac0 0x7f62880abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:37.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628f348700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62880b0010 0x7f6288144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:37.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628f348700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62880b2580 0x7f6288067420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:37.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628f348700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6288144820 con 0x7f62880b2580 2022-01-10T01:31:37.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628f348700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62880a9440 con 0x7f62880a8ac0 2022-01-10T01:31:37.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628f348700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62880a91e0 con 0x7f62880b0010 2022-01-10T01:31:37.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628eb47700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62880b2580 0x7f6288067420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:37.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628eb47700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62880b2580 0x7f6288067420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39206/0 (socket says 172.21.15.36:39206) 2022-01-10T01:31:37.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628eb47700 1 -- 172.21.15.36:0/2805263826 learned_addr learned my addr 172.21.15.36:0/2805263826 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:37.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628e346700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62880a8ac0 0x7f62880abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:37.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628db45700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62880b0010 0x7f6288144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:37.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628eb47700 1 -- 172.21.15.36:0/2805263826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62880b0010 msgr2=0x7f6288144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:37.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628eb47700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62880b0010 0x7f6288144e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:37.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628eb47700 1 -- 172.21.15.36:0/2805263826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62880a8ac0 msgr2=0x7f62880abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:37.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628eb47700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62880a8ac0 0x7f62880abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:37.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628eb47700 1 -- 172.21.15.36:0/2805263826 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6280009530 con 0x7f62880b2580 2022-01-10T01:31:37.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628db45700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62880b0010 0x7f6288144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:37.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628eb47700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62880b2580 0x7f6288067420 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f62800032f0 tx=0x7f6280016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:37.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f62777fe700 1 -- 172.21.15.36:0/2805263826 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f628000b8a0 con 0x7f62880b2580 2022-01-10T01:31:37.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f62777fe700 1 -- 172.21.15.36:0/2805263826 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628000bb70 con 0x7f62880b2580 2022-01-10T01:31:37.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628f348700 1 -- 172.21.15.36:0/2805263826 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6288144580 con 0x7f62880b2580 2022-01-10T01:31:37.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f62777fe700 1 -- 172.21.15.36:0/2805263826 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6280020620 con 0x7f62880b2580 2022-01-10T01:31:37.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.000+0000 7f628f348700 1 -- 172.21.15.36:0/2805263826 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62880a9f10 con 0x7f62880b2580 2022-01-10T01:31:37.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.004+0000 7f628f348700 1 -- 172.21.15.36:0/2805263826 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6288057350 con 0x7f62880b2580 2022-01-10T01:31:37.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.004+0000 7f62777fe700 1 -- 172.21.15.36:0/2805263826 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6280028070 con 0x7f62880b2580 2022-01-10T01:31:37.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.004+0000 7f62777fe700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f62680535f0 0x7f6268055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:37.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.004+0000 7f62777fe700 1 -- 172.21.15.36:0/2805263826 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f628006c1e0 con 0x7f62880b2580 2022-01-10T01:31:37.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.004+0000 7f628e346700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f62680535f0 0x7f6268055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:37.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.004+0000 7f628e346700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f62680535f0 0x7f6268055ab0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f627800c000 tx=0x7f6278008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:37.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.012+0000 7f62777fe700 1 -- 172.21.15.36:0/2805263826 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f62800434d0 con 0x7f62880b2580 2022-01-10T01:31:37.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.176+0000 7f628f348700 1 -- 172.21.15.36:0/2805263826 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62880b2160 con 0x7f62880b2580 2022-01-10T01:31:37.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.176+0000 7f62777fe700 1 -- 172.21.15.36:0/2805263826 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+1563 (secure 0 0 0) 0x7f6280015020 con 0x7f62880b2580 2022-01-10T01:31:37.182 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:37.182 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3902337896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3902337896},{"type":"v1","addr":"172.21.15.36:6835","nonce":3902337896}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6612,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6837/3131314479","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":3131314479},{"type":"v1","addr":"172.21.15.36:6837","nonce":3131314479}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39},{"gid":36083,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/3114266369","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3114266369},{"type":"v1","addr":"172.21.15.59:6833","nonce":3114266369}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":43}],"filesystems":[]} 2022-01-10T01:31:37.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.176+0000 7f628f348700 1 -- 172.21.15.36:0/2805263826 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f62680535f0 msgr2=0x7f6268055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:37.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.176+0000 7f628f348700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f62680535f0 0x7f6268055ab0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f627800c000 tx=0x7f6278008040).stop 2022-01-10T01:31:37.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.176+0000 7f628f348700 1 -- 172.21.15.36:0/2805263826 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62880b2580 msgr2=0x7f6288067420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:37.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.176+0000 7f628f348700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62880b2580 0x7f6288067420 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f62800032f0 tx=0x7f6280016000).stop 2022-01-10T01:31:37.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.176+0000 7f628f348700 1 -- 172.21.15.36:0/2805263826 shutdown_connections 2022-01-10T01:31:37.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.176+0000 7f628f348700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f62680535f0 0x7f6268055ab0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:37.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.176+0000 7f628f348700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f62880b2580 0x7f6288067420 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:37.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.176+0000 7f628f348700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62880b0010 0x7f6288144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:37.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.176+0000 7f628f348700 1 --2- 172.21.15.36:0/2805263826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62880a8ac0 0x7f62880abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:37.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.176+0000 7f628f348700 1 -- 172.21.15.36:0/2805263826 >> 172.21.15.36:0/2805263826 conn(0x7f6288060180 msgr2=0x7f6288149380 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:37.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.176+0000 7f628f348700 1 -- 172.21.15.36:0/2805263826 shutdown_connections 2022-01-10T01:31:37.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.180+0000 7f628f348700 1 -- 172.21.15.36:0/2805263826 wait complete. 2022-01-10T01:31:37.187 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 43 2022-01-10T01:31:37.195 INFO:tasks.ceph.mds.a:Restarting daemon 2022-01-10T01:31:37.195 INFO:tasks.ceph.mds.a:Stopping old one... 2022-01-10T01:31:37.195 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-01-10T01:31:37.196 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:31:37.196 INFO:tasks.ceph.mds.c:Restarting daemon 2022-01-10T01:31:37.196 INFO:tasks.ceph.mds.c:Stopping old one... 2022-01-10T01:31:37.197 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-01-10T01:31:37.197 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:31:37.197 INFO:tasks.ceph.mds.b:Restarting daemon 2022-01-10T01:31:37.197 INFO:tasks.ceph.mds.b:Stopping old one... 2022-01-10T01:31:37.198 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-01-10T01:31:37.198 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:31:37.208 INFO:tasks.ceph.mds.a:Stopped 2022-01-10T01:31:37.208 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-01-10T01:31:37.210 INFO:tasks.ceph.mds.c:Stopped 2022-01-10T01:31:37.210 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-01-10T01:31:37.214 INFO:tasks.ceph.mds.b:Stopped 2022-01-10T01:31:37.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-01-10T01:31:37.217 INFO:tasks.ceph.mds.b:Started 2022-01-10T01:31:37.217 DEBUG:teuthology.parallel:result is None 2022-01-10T01:31:37.253 INFO:tasks.ceph.mds.a:Started 2022-01-10T01:31:37.254 DEBUG:teuthology.parallel:result is None 2022-01-10T01:31:37.255 INFO:tasks.ceph.mds.c:Started 2022-01-10T01:31:37.255 DEBUG:teuthology.parallel:result is None 2022-01-10T01:31:37.256 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2022-01-10T01:31:37.293 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:31:37.322 INFO:tasks.ceph.mds.c.smithi036.stdout:starting mds.c at 2022-01-10T01:31:37.324 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:31:37.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.352+0000 7f196006b700 1 Processor -- start 2022-01-10T01:31:37.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.352+0000 7f196006b700 1 -- start start 2022-01-10T01:31:37.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.352+0000 7f196006b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19580b10e0 0x7f19580ae700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:37.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.352+0000 7f196006b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f19580aca70 0x7f19580ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:37.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.352+0000 7f196006b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19580ae000 con 0x7f19580a8bf0 2022-01-10T01:31:37.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.352+0000 7f196006b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19580b1820 con 0x7f19580aca70 2022-01-10T01:31:37.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.352+0000 7f196006b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19580b1580 con 0x7f19580b10e0 2022-01-10T01:31:37.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.352+0000 7f195de07700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f19580a8bf0 0x7f1958143620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37028/0 (socket says 172.21.15.36:37028) 2022-01-10T01:31:37.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.352+0000 7f195de07700 1 -- 172.21.15.36:0/760567538 learned_addr learned my addr 172.21.15.36:0/760567538 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:37.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.352+0000 7f195e608700 1 --2- 172.21.15.36:0/760567538 >> v2:172.21.15.36:3300/0 conn(0x7f19580aca70 0x7f19580ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:37.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f195d606700 1 --2- 172.21.15.36:0/760567538 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19580b10e0 0x7f19580ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:37.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f195ce05700 1 -- 172.21.15.36:0/760567538 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974199957 0 0) 0x7f19580ae000 con 0x7f19580a8bf0 2022-01-10T01:31:37.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f195ce05700 1 -- 172.21.15.36:0/760567538 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1940003260 con 0x7f19580a8bf0 2022-01-10T01:31:37.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f195e608700 1 -- 172.21.15.36:0/760567538 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19580b10e0 msgr2=0x7f19580ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:37.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f195e608700 1 --2- 172.21.15.36:0/760567538 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19580b10e0 0x7f19580ae700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:37.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f195e608700 1 -- 172.21.15.36:0/760567538 >> v1:172.21.15.36:6789/0 conn(0x7f19580a8bf0 legacy=0x7f1958143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:37.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f195e608700 1 -- 172.21.15.36:0/760567538 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19580ae260 con 0x7f19580aca70 2022-01-10T01:31:37.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f195e608700 1 --2- 172.21.15.36:0/760567538 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19580aca70 0x7f19580ad5f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f19500032f0 tx=0x7f19500091d0).ready entity=mon.0 client_cookie=14d930592a85dbc3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:37.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f195ce05700 1 -- 172.21.15.36:0/760567538 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f195000b600 con 0x7f19580aca70 2022-01-10T01:31:37.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f195ce05700 1 -- 172.21.15.36:0/760567538 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195000b760 con 0x7f19580aca70 2022-01-10T01:31:37.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f195ce05700 1 -- 172.21.15.36:0/760567538 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f195000b8d0 con 0x7f19580aca70 2022-01-10T01:31:37.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f196006b700 1 -- 172.21.15.36:0/760567538 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19580aca70 msgr2=0x7f19580ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:37.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f196006b700 1 --2- 172.21.15.36:0/760567538 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19580aca70 0x7f19580ad5f0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f19500032f0 tx=0x7f19500091d0).stop 2022-01-10T01:31:37.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f196006b700 1 -- 172.21.15.36:0/760567538 shutdown_connections 2022-01-10T01:31:37.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f196006b700 1 --2- 172.21.15.36:0/760567538 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19580aca70 0x7f19580ad5f0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:37.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f196006b700 1 --2- 172.21.15.36:0/760567538 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19580b10e0 0x7f19580ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:37.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f196006b700 1 -- 172.21.15.36:0/760567538 >> 172.21.15.36:0/760567538 conn(0x7f19580608d0 msgr2=0x7f1958060ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:37.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f196006b700 1 -- 172.21.15.36:0/760567538 shutdown_connections 2022-01-10T01:31:37.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f196006b700 1 -- 172.21.15.36:0/760567538 wait complete. 2022-01-10T01:31:37.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f196006b700 1 Processor -- start 2022-01-10T01:31:37.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.356+0000 7f196006b700 1 -- start start 2022-01-10T01:31:37.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f196006b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19580a8bf0 0x7f1958062b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:37.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f196006b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19580aca70 0x7f195814f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:37.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f196006b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19580b10e0 0x7f195814f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:37.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f196006b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19580b3780 con 0x7f19580a8bf0 2022-01-10T01:31:37.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f196006b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19581536f0 con 0x7f19580b10e0 2022-01-10T01:31:37.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f196006b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1958064310 con 0x7f19580aca70 2022-01-10T01:31:37.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f195de07700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19580a8bf0 0x7f1958062b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:37.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f195de07700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19580a8bf0 0x7f1958062b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39240/0 (socket says 172.21.15.36:39240) 2022-01-10T01:31:37.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f195de07700 1 -- 172.21.15.36:0/194052076 learned_addr learned my addr 172.21.15.36:0/194052076 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:37.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f195d606700 1 --2- 172.21.15.36:0/194052076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19580aca70 0x7f195814f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:37.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f195e608700 1 --2- 172.21.15.36:0/194052076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19580b10e0 0x7f195814f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:37.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f195de07700 1 -- 172.21.15.36:0/194052076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19580aca70 msgr2=0x7f195814f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:37.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f195de07700 1 --2- 172.21.15.36:0/194052076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19580aca70 0x7f195814f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:37.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f195de07700 1 -- 172.21.15.36:0/194052076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19580b10e0 msgr2=0x7f195814f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:37.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f195de07700 1 --2- 172.21.15.36:0/194052076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19580b10e0 0x7f195814f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:37.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f195de07700 1 -- 172.21.15.36:0/194052076 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1950009470 con 0x7f19580a8bf0 2022-01-10T01:31:37.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f195de07700 1 --2- 172.21.15.36:0/194052076 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19580a8bf0 0x7f1958062b00 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f1948001110 tx=0x7f1948007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:37.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f1946ffd700 1 -- 172.21.15.36:0/194052076 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19480070d0 con 0x7f19580a8bf0 2022-01-10T01:31:37.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f1946ffd700 1 -- 172.21.15.36:0/194052076 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1948007230 con 0x7f19580a8bf0 2022-01-10T01:31:37.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f196006b700 1 -- 172.21.15.36:0/194052076 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19580645b0 con 0x7f19580a8bf0 2022-01-10T01:31:37.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f1946ffd700 1 -- 172.21.15.36:0/194052076 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1948005610 con 0x7f19580a8bf0 2022-01-10T01:31:37.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.360+0000 7f196006b700 1 -- 172.21.15.36:0/194052076 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19581532d0 con 0x7f19580a8bf0 2022-01-10T01:31:37.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.364+0000 7f1946ffd700 1 -- 172.21.15.36:0/194052076 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1948005770 con 0x7f19580a8bf0 2022-01-10T01:31:37.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.364+0000 7f196006b700 1 -- 172.21.15.36:0/194052076 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19580aa3c0 con 0x7f19580a8bf0 2022-01-10T01:31:37.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.364+0000 7f1946ffd700 1 --2- 172.21.15.36:0/194052076 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f19380534d0 0x7f1938055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:37.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.364+0000 7f1946ffd700 1 -- 172.21.15.36:0/194052076 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f194806d330 con 0x7f19580a8bf0 2022-01-10T01:31:37.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.364+0000 7f195d606700 1 --2- 172.21.15.36:0/194052076 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f19380534d0 0x7f1938055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:37.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.364+0000 7f195d606700 1 --2- 172.21.15.36:0/194052076 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f19380534d0 0x7f1938055990 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f195400b000 tx=0x7f1954006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:37.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.368+0000 7f1946ffd700 1 -- 172.21.15.36:0/194052076 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1948044520 con 0x7f19580a8bf0 2022-01-10T01:31:37.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:37.504+0000 7f196006b700 1 -- 172.21.15.36:0/194052076 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f19581538b0 con 0x7f19580a8bf0 2022-01-10T01:31:38.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.348+0000 7f1946ffd700 1 -- 172.21.15.36:0/194052076 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v96) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1948047b40 con 0x7f19580a8bf0 2022-01-10T01:31:38.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.352+0000 7f196006b700 1 -- 172.21.15.36:0/194052076 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f19380534d0 msgr2=0x7f1938055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.352+0000 7f196006b700 1 --2- 172.21.15.36:0/194052076 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f19380534d0 0x7f1938055990 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f195400b000 tx=0x7f1954006df0).stop 2022-01-10T01:31:38.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.352+0000 7f196006b700 1 -- 172.21.15.36:0/194052076 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19580a8bf0 msgr2=0x7f1958062b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.352+0000 7f196006b700 1 --2- 172.21.15.36:0/194052076 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19580a8bf0 0x7f1958062b00 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f1948001110 tx=0x7f1948007aa0).stop 2022-01-10T01:31:38.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.352+0000 7f196006b700 1 -- 172.21.15.36:0/194052076 shutdown_connections 2022-01-10T01:31:38.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.352+0000 7f196006b700 1 --2- 172.21.15.36:0/194052076 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f19380534d0 0x7f1938055990 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.352+0000 7f196006b700 1 --2- 172.21.15.36:0/194052076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19580b10e0 0x7f195814f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.352+0000 7f196006b700 1 --2- 172.21.15.36:0/194052076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19580aca70 0x7f195814f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.352+0000 7f196006b700 1 --2- 172.21.15.36:0/194052076 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f19580a8bf0 0x7f1958062b00 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.352+0000 7f196006b700 1 -- 172.21.15.36:0/194052076 >> 172.21.15.36:0/194052076 conn(0x7f19580608d0 msgr2=0x7f19580ae440 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:38.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.352+0000 7f196006b700 1 -- 172.21.15.36:0/194052076 shutdown_connections 2022-01-10T01:31:38.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.352+0000 7f196006b700 1 -- 172.21.15.36:0/194052076 wait complete. 2022-01-10T01:31:38.363 INFO:teuthology.orchestra.run.smithi036.stderr: removed all blacklist entries 2022-01-10T01:31:38.375 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2022-01-10T01:31:38.376 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2022-01-10T01:31:38.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f115cebf700 1 Processor -- start 2022-01-10T01:31:38.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f115cebf700 1 -- start start 2022-01-10T01:31:38.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f115cebf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11580ad5c0 0x7f1158061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:38.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f115cebf700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11580aecf0 con 0x7f1158061320 2022-01-10T01:31:38.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f115cebf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11580b6f20 con 0x7f1158140440 2022-01-10T01:31:38.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f115cebf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11580aef20 con 0x7f11580ad5c0 2022-01-10T01:31:38.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f11577fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f1158061320 0x7f11580b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37046/0 (socket says 172.21.15.36:37046) 2022-01-10T01:31:38.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f11577fe700 1 -- 172.21.15.36:0/3631592736 learned_addr learned my addr 172.21.15.36:0/3631592736 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:38.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f114ffff700 1 --2- 172.21.15.36:0/3631592736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11580ad5c0 0x7f1158061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:38.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f1156ffd700 1 -- 172.21.15.36:0/3631592736 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526352208 0 0) 0x7f11580aecf0 con 0x7f1158061320 2022-01-10T01:31:38.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f1156ffd700 1 -- 172.21.15.36:0/3631592736 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1138003260 con 0x7f1158061320 2022-01-10T01:31:38.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f1156ffd700 1 -- 172.21.15.36:0/3631592736 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485061423 0 0) 0x7f11580b6f20 con 0x7f1158140440 2022-01-10T01:31:38.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f114ffff700 1 -- 172.21.15.36:0/3631592736 >> v1:172.21.15.59:6789/0 conn(0x7f1158140440 legacy=0x7f1158146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f114ffff700 1 -- 172.21.15.36:0/3631592736 >> v1:172.21.15.36:6789/0 conn(0x7f1158061320 legacy=0x7f11580b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f114ffff700 1 -- 172.21.15.36:0/3631592736 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11580af1c0 con 0x7f11580ad5c0 2022-01-10T01:31:38.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f114ffff700 1 --2- 172.21.15.36:0/3631592736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11580ad5c0 0x7f1158061700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f1148001800 tx=0x7f1140006df0).ready entity=mon.2 client_cookie=fd700d99195d50f9 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:38.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f1156ffd700 1 -- 172.21.15.36:0/3631592736 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1148001660 con 0x7f11580ad5c0 2022-01-10T01:31:38.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f1156ffd700 1 -- 172.21.15.36:0/3631592736 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1140000e90 con 0x7f11580ad5c0 2022-01-10T01:31:38.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f1156ffd700 1 -- 172.21.15.36:0/3631592736 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f114000d4a0 con 0x7f11580ad5c0 2022-01-10T01:31:38.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f115cebf700 1 -- 172.21.15.36:0/3631592736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11580ad5c0 msgr2=0x7f1158061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.484+0000 7f115cebf700 1 --2- 172.21.15.36:0/3631592736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11580ad5c0 0x7f1158061700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f1148001800 tx=0x7f1140006df0).stop 2022-01-10T01:31:38.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 -- 172.21.15.36:0/3631592736 shutdown_connections 2022-01-10T01:31:38.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 --2- 172.21.15.36:0/3631592736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11580ad5c0 0x7f1158061700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 -- 172.21.15.36:0/3631592736 >> 172.21.15.36:0/3631592736 conn(0x7f1158066de0 msgr2=0x7f11580671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:38.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 -- 172.21.15.36:0/3631592736 shutdown_connections 2022-01-10T01:31:38.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 -- 172.21.15.36:0/3631592736 wait complete. 2022-01-10T01:31:38.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 Processor -- start 2022-01-10T01:31:38.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 -- start start 2022-01-10T01:31:38.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1158061320 0x7f1158142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:38.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11580ad5c0 0x7f1158152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:38.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1158140440 0x7f1158156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:38.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11580b0790 con 0x7f11580ad5c0 2022-01-10T01:31:38.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158152740 con 0x7f1158140440 2022-01-10T01:31:38.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11580b04f0 con 0x7f1158061320 2022-01-10T01:31:38.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f114ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11580ad5c0 0x7f1158152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:38.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f114ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11580ad5c0 0x7f1158152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39262/0 (socket says 172.21.15.36:39262) 2022-01-10T01:31:38.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f1157fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1158140440 0x7f1158156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:38.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f114ffff700 1 -- 172.21.15.36:0/690587084 learned_addr learned my addr 172.21.15.36:0/690587084 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:38.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f11577fe700 1 --2- 172.21.15.36:0/690587084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1158061320 0x7f1158142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:38.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f114ffff700 1 -- 172.21.15.36:0/690587084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1158061320 msgr2=0x7f1158142540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f114ffff700 1 --2- 172.21.15.36:0/690587084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1158061320 0x7f1158142540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f114ffff700 1 -- 172.21.15.36:0/690587084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1158140440 msgr2=0x7f1158156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f114ffff700 1 --2- 172.21.15.36:0/690587084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1158140440 0x7f1158156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f114ffff700 1 -- 172.21.15.36:0/690587084 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114000b180 con 0x7f11580ad5c0 2022-01-10T01:31:38.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f114ffff700 1 --2- 172.21.15.36:0/690587084 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11580ad5c0 0x7f1158152250 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f1148001800 tx=0x7f11580af350).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:38.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f11557fa700 1 -- 172.21.15.36:0/690587084 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1140012960 con 0x7f11580ad5c0 2022-01-10T01:31:38.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f11557fa700 1 -- 172.21.15.36:0/690587084 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1140012ac0 con 0x7f11580ad5c0 2022-01-10T01:31:38.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 -- 172.21.15.36:0/690587084 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1158155930 con 0x7f11580ad5c0 2022-01-10T01:31:38.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f11557fa700 1 -- 172.21.15.36:0/690587084 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1140012e20 con 0x7f11580ad5c0 2022-01-10T01:31:38.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.488+0000 7f115cebf700 1 -- 172.21.15.36:0/690587084 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11580b3df0 con 0x7f11580ad5c0 2022-01-10T01:31:38.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.492+0000 7f115cebf700 1 -- 172.21.15.36:0/690587084 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11580b0260 con 0x7f11580ad5c0 2022-01-10T01:31:38.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.492+0000 7f11557fa700 1 -- 172.21.15.36:0/690587084 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1140024030 con 0x7f11580ad5c0 2022-01-10T01:31:38.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.492+0000 7f11557fa700 1 --2- 172.21.15.36:0/690587084 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f113c053680 0x7f113c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:38.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.492+0000 7f11577fe700 1 --2- 172.21.15.36:0/690587084 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f113c053680 0x7f113c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:38.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.492+0000 7f11557fa700 1 -- 172.21.15.36:0/690587084 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f114006bfb0 con 0x7f11580ad5c0 2022-01-10T01:31:38.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.492+0000 7f11577fe700 1 --2- 172.21.15.36:0/690587084 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f113c053680 0x7f113c055b40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f114800d000 tx=0x7f1148000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:38.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.500+0000 7f11557fa700 1 -- 172.21.15.36:0/690587084 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f11400431f0 con 0x7f11580ad5c0 2022-01-10T01:31:38.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.668+0000 7f115cebf700 1 -- 172.21.15.36:0/690587084 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f11580af460 con 0x7f11580ad5c0 2022-01-10T01:31:38.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.668+0000 7f11557fa700 1 -- 172.21.15.36:0/690587084 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f1140022070 con 0x7f11580ad5c0 2022-01-10T01:31:38.674 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:38.674 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:31:38.675 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_dump": [ 2022-01-10T01:31:38.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.675 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.a", 2022-01-10T01:31:38.676 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthuGT4IxAA5DyijS4tPjdOLn5uiLXEPg==", 2022-01-10T01:31:38.676 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.676 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:31:38.676 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:38.677 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:38.677 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:38.677 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.678 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.b", 2022-01-10T01:31:38.678 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthkvX0LRAAtz19usFvoObvouQeLFwicg==", 2022-01-10T01:31:38.678 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.678 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:31:38.679 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:38.679 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:38.679 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:38.679 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.680 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.680 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.c", 2022-01-10T01:31:38.680 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthbvUmKhAA0pVpDJO1AfsAzIHU1cAHiw==", 2022-01-10T01:31:38.680 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.681 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:31:38.681 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:38.681 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:38.681 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:38.682 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.682 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.0", 2022-01-10T01:31:38.683 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCWitthk4iKHRAAF7aFP+i24xFvXXm8j5GzVg==", 2022-01-10T01:31:38.683 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.683 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:38.683 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:38.683 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:38.684 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.684 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.684 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.684 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.1", 2022-01-10T01:31:38.684 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCZitthsKSXABAAb3IkNvlyLub89HwaPWZ1Bg==", 2022-01-10T01:31:38.685 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.685 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:38.685 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:38.685 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:38.686 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.686 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.2", 2022-01-10T01:31:38.687 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCbitthvNzhIBAAXkZ6FslnMl1gS/rOa7G+Vg==", 2022-01-10T01:31:38.687 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.687 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:38.688 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:38.688 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:38.688 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.689 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.3", 2022-01-10T01:31:38.689 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCeitth9P7EAxAA7KOCP7Rh5oN1yqCz9I6v3A==", 2022-01-10T01:31:38.689 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.690 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:38.690 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:38.690 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:38.691 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.691 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.691 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.691 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.4", 2022-01-10T01:31:38.692 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCjitth/L1UBxAAskxmSV0aE6CSvDFR8O/+SQ==", 2022-01-10T01:31:38.692 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.692 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:38.692 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:38.693 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:38.693 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.693 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.693 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.5", 2022-01-10T01:31:38.694 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQClitthMoY6JhAAeeIrCmMcm3MpDPtdLUf+2g==", 2022-01-10T01:31:38.694 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.694 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:38.694 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:38.695 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:38.695 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.695 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.6", 2022-01-10T01:31:38.696 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCoitthrUhlCxAAsYhU7Kj6HMo/kD0DezvITg==", 2022-01-10T01:31:38.696 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.696 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:38.696 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:38.697 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:38.697 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.697 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.698 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.7", 2022-01-10T01:31:38.698 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCqitthFaLrKRAAC2g1OlcV2KTtaOXsyCrIrQ==", 2022-01-10T01:31:38.698 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.699 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:38.699 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:38.699 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:38.699 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.700 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.700 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.0", 2022-01-10T01:31:38.700 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthKoa/NBAADjvHh99F8YOktGID9uyttg==", 2022-01-10T01:31:38.701 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.701 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:31:38.701 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:31:38.701 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:31:38.701 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.702 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.702 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.1", 2022-01-10T01:31:38.702 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth3x76OBAAPTrw8OUmnpEflWuB7zzaHg==", 2022-01-10T01:31:38.703 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.703 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:31:38.703 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:31:38.703 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:31:38.704 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.704 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.704 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.704 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.admin", 2022-01-10T01:31:38.704 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthf9dqChAADHRsoZKuozdsqb41ztuR7w==", 2022-01-10T01:31:38.705 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.705 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:31:38.705 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:31:38.705 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:31:38.706 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:38.706 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.706 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.707 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.x", 2022-01-10T01:31:38.707 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth39syIRAA6pOvLWw2ADy72TWZ65MIkA==", 2022-01-10T01:31:38.707 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.707 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:31:38.708 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:31:38.708 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:38.708 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.708 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:38.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:38.709 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.y", 2022-01-10T01:31:38.709 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth4novHRAACVMjo72kOB/T7Ti/CiN27w==", 2022-01-10T01:31:38.709 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:31:38.710 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:31:38.710 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:31:38.710 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:31:38.710 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.711 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:38.711 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:38.711 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:31:38.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.668+0000 7f115cebf700 1 -- 172.21.15.36:0/690587084 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f113c053680 msgr2=0x7f113c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.668+0000 7f115cebf700 1 --2- 172.21.15.36:0/690587084 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f113c053680 0x7f113c055b40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f114800d000 tx=0x7f1148000bc0).stop 2022-01-10T01:31:38.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.668+0000 7f115cebf700 1 -- 172.21.15.36:0/690587084 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11580ad5c0 msgr2=0x7f1158152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.668+0000 7f115cebf700 1 --2- 172.21.15.36:0/690587084 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11580ad5c0 0x7f1158152250 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f1148001800 tx=0x7f11580af350).stop 2022-01-10T01:31:38.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.668+0000 7f115cebf700 1 -- 172.21.15.36:0/690587084 shutdown_connections 2022-01-10T01:31:38.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.668+0000 7f115cebf700 1 --2- 172.21.15.36:0/690587084 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f113c053680 0x7f113c055b40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.668+0000 7f115cebf700 1 --2- 172.21.15.36:0/690587084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1158140440 0x7f1158156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.668+0000 7f115cebf700 1 --2- 172.21.15.36:0/690587084 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f11580ad5c0 0x7f1158152250 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.668+0000 7f115cebf700 1 --2- 172.21.15.36:0/690587084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1158061320 0x7f1158142540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.668+0000 7f115cebf700 1 -- 172.21.15.36:0/690587084 >> 172.21.15.36:0/690587084 conn(0x7f1158066de0 msgr2=0x7f1158146650 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:38.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.668+0000 7f115cebf700 1 -- 172.21.15.36:0/690587084 shutdown_connections 2022-01-10T01:31:38.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.668+0000 7f115cebf700 1 -- 172.21.15.36:0/690587084 wait complete. 2022-01-10T01:31:38.717 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:31:38.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.816+0000 7f55414c9700 1 Processor -- start 2022-01-10T01:31:38.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.816+0000 7f55414c9700 1 -- start start 2022-01-10T01:31:38.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f55414c9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f553c0b0010 0x7f553c0a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:38.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f55414c9700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553c0a70c0 con 0x7f553c0b2580 2022-01-10T01:31:38.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f55414c9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553c0a72f0 con 0x7f553c0afbd0 2022-01-10T01:31:38.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f55414c9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553c0a7590 con 0x7f553c0b0010 2022-01-10T01:31:38.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f553bfff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f553c0b2580 0x7f553c14ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37062/0 (socket says 172.21.15.36:37062) 2022-01-10T01:31:38.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f553bfff700 1 -- 172.21.15.36:0/1212339012 learned_addr learned my addr 172.21.15.36:0/1212339012 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:38.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f553b7fe700 1 --2- 172.21.15.36:0/1212339012 >> v2:172.21.15.59:3300/0 conn(0x7f553c0b0010 0x7f553c0a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:38.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f553affd700 1 -- 172.21.15.36:0/1212339012 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818238798 0 0) 0x7f553c0a70c0 con 0x7f553c0b2580 2022-01-10T01:31:38.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f553b7fe700 1 -- 172.21.15.36:0/1212339012 >> v1:172.21.15.59:6789/0 conn(0x7f553c0afbd0 legacy=0x7f553c151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f553b7fe700 1 -- 172.21.15.36:0/1212339012 >> v1:172.21.15.36:6789/0 conn(0x7f553c0b2580 legacy=0x7f553c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f553b7fe700 1 -- 172.21.15.36:0/1212339012 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c0a7830 con 0x7f553c0b0010 2022-01-10T01:31:38.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f553b7fe700 1 --2- 172.21.15.36:0/1212339012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c0b0010 0x7f553c0a83b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f552c0032f0 tx=0x7f552c0091d0).ready entity=mon.1 client_cookie=1a329365740be85d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:38.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f553affd700 1 -- 172.21.15.36:0/1212339012 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f552c009ea0 con 0x7f553c0b0010 2022-01-10T01:31:38.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f553affd700 1 -- 172.21.15.36:0/1212339012 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c00b8a0 con 0x7f553c0b0010 2022-01-10T01:31:38.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f553affd700 1 -- 172.21.15.36:0/1212339012 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f552c00ba10 con 0x7f553c0b0010 2022-01-10T01:31:38.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f55414c9700 1 -- 172.21.15.36:0/1212339012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c0b0010 msgr2=0x7f553c0a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f55414c9700 1 --2- 172.21.15.36:0/1212339012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c0b0010 0x7f553c0a83b0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f552c0032f0 tx=0x7f552c0091d0).stop 2022-01-10T01:31:38.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f55414c9700 1 -- 172.21.15.36:0/1212339012 shutdown_connections 2022-01-10T01:31:38.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f55414c9700 1 --2- 172.21.15.36:0/1212339012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c0b0010 0x7f553c0a83b0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f55414c9700 1 -- 172.21.15.36:0/1212339012 >> 172.21.15.36:0/1212339012 conn(0x7f553c060180 msgr2=0x7f553c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:38.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f55414c9700 1 -- 172.21.15.36:0/1212339012 shutdown_connections 2022-01-10T01:31:38.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.820+0000 7f55414c9700 1 -- 172.21.15.36:0/1212339012 wait complete. 2022-01-10T01:31:38.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f55414c9700 1 Processor -- start 2022-01-10T01:31:38.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f55414c9700 1 -- start start 2022-01-10T01:31:38.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f55414c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f553c0afbd0 0x7f553c0af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:38.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f55414c9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f553c0b0010 0x7f553c0b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:38.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f55414c9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c0b2580 0x7f553c0b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:38.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f55414c9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c0a9140 con 0x7f553c0b0010 2022-01-10T01:31:38.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f55414c9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c067320 con 0x7f553c0b2580 2022-01-10T01:31:38.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f55414c9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c0a9370 con 0x7f553c0afbd0 2022-01-10T01:31:38.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f553b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f553c0b0010 0x7f553c0b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:38.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f553bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f553c0afbd0 0x7f553c0af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:38.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f5540cc8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c0b2580 0x7f553c0b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:38.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f553b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f553c0b0010 0x7f553c0b3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39276/0 (socket says 172.21.15.36:39276) 2022-01-10T01:31:38.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f553b7fe700 1 -- 172.21.15.36:0/4233592984 learned_addr learned my addr 172.21.15.36:0/4233592984 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:38.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f553b7fe700 1 -- 172.21.15.36:0/4233592984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f553c0afbd0 msgr2=0x7f553c0af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f553b7fe700 1 --2- 172.21.15.36:0/4233592984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f553c0afbd0 0x7f553c0af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f553b7fe700 1 -- 172.21.15.36:0/4233592984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c0b2580 msgr2=0x7f553c0b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f553b7fe700 1 --2- 172.21.15.36:0/4233592984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c0b2580 0x7f553c0b3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f553b7fe700 1 -- 172.21.15.36:0/4233592984 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c009470 con 0x7f553c0b0010 2022-01-10T01:31:38.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f553b7fe700 1 --2- 172.21.15.36:0/4233592984 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f553c0b0010 0x7f553c0b3650 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f552c0032f0 tx=0x7f552c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:38.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f55397fa700 1 -- 172.21.15.36:0/4233592984 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f552c009ea0 con 0x7f553c0b0010 2022-01-10T01:31:38.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f55414c9700 1 -- 172.21.15.36:0/4233592984 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553c0a9610 con 0x7f553c0b0010 2022-01-10T01:31:38.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f55397fa700 1 -- 172.21.15.36:0/4233592984 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c01f3f0 con 0x7f553c0b0010 2022-01-10T01:31:38.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f55414c9700 1 -- 172.21.15.36:0/4233592984 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c05ccd0 con 0x7f553c0b0010 2022-01-10T01:31:38.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.824+0000 7f55397fa700 1 -- 172.21.15.36:0/4233592984 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f552c011ea0 con 0x7f553c0b0010 2022-01-10T01:31:38.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.828+0000 7f55414c9700 1 -- 172.21.15.36:0/4233592984 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c0aa150 con 0x7f553c0b0010 2022-01-10T01:31:38.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.828+0000 7f55397fa700 1 -- 172.21.15.36:0/4233592984 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f552c00f070 con 0x7f553c0b0010 2022-01-10T01:31:38.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.828+0000 7f55397fa700 1 --2- 172.21.15.36:0/4233592984 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f551c053560 0x7f551c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:38.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.828+0000 7f55397fa700 1 -- 172.21.15.36:0/4233592984 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f552c06c160 con 0x7f553c0b0010 2022-01-10T01:31:38.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.828+0000 7f553bfff700 1 --2- 172.21.15.36:0/4233592984 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f551c053560 0x7f551c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:38.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.828+0000 7f553bfff700 1 --2- 172.21.15.36:0/4233592984 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f551c053560 0x7f551c055a20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f553000d000 tx=0x7f5530007c00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:38.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.836+0000 7f55397fa700 1 -- 172.21.15.36:0/4233592984 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f552c043410 con 0x7f553c0b0010 2022-01-10T01:31:38.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.964+0000 7f55414c9700 1 -- 172.21.15.36:0/4233592984 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f553c057350 con 0x7f553c0b0010 2022-01-10T01:31:38.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.968+0000 7f55397fa700 1 -- 172.21.15.36:0/4233592984 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+13415 (secure 0 0 0) 0x7f552c015090 con 0x7f553c0b0010 2022-01-10T01:31:38.975 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:38.975 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":96,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:31:38.344363+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:31:38.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.968+0000 7f55414c9700 1 -- 172.21.15.36:0/4233592984 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f551c053560 msgr2=0x7f551c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.968+0000 7f55414c9700 1 --2- 172.21.15.36:0/4233592984 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f551c053560 0x7f551c055a20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f553000d000 tx=0x7f5530007c00).stop 2022-01-10T01:31:38.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.968+0000 7f55414c9700 1 -- 172.21.15.36:0/4233592984 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f553c0b0010 msgr2=0x7f553c0b3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:38.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.968+0000 7f55414c9700 1 --2- 172.21.15.36:0/4233592984 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f553c0b0010 0x7f553c0b3650 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7f552c0032f0 tx=0x7f552c016000).stop 2022-01-10T01:31:38.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.972+0000 7f55414c9700 1 -- 172.21.15.36:0/4233592984 shutdown_connections 2022-01-10T01:31:38.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.972+0000 7f55414c9700 1 --2- 172.21.15.36:0/4233592984 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f551c053560 0x7f551c055a20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.972+0000 7f55414c9700 1 --2- 172.21.15.36:0/4233592984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c0b2580 0x7f553c0b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.972+0000 7f55414c9700 1 --2- 172.21.15.36:0/4233592984 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f553c0b0010 0x7f553c0b3650 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.972+0000 7f55414c9700 1 --2- 172.21.15.36:0/4233592984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f553c0afbd0 0x7f553c0af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:38.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.972+0000 7f55414c9700 1 -- 172.21.15.36:0/4233592984 >> 172.21.15.36:0/4233592984 conn(0x7f553c060180 msgr2=0x7f553c14a890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:38.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.972+0000 7f55414c9700 1 -- 172.21.15.36:0/4233592984 shutdown_connections 2022-01-10T01:31:38.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:38.972+0000 7f55414c9700 1 -- 172.21.15.36:0/4233592984 wait complete. 2022-01-10T01:31:38.987 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-01-10T01:31:38.988 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:31:39.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.088+0000 7fd484abd700 1 Processor -- start 2022-01-10T01:31:39.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd484abd700 1 -- start start 2022-01-10T01:31:39.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd484abd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4800b2720 0x7fd48013e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd484abd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd480141790 0x7fd48013e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd484abd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4800aaa90 con 0x7fd4800b0ff0 2022-01-10T01:31:39.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd484abd700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd480141c20 con 0x7fd480141790 2022-01-10T01:31:39.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd484abd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd480140c90 con 0x7fd4800b2720 2022-01-10T01:31:39.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd47ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd480141790 0x7fd48013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd47ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd480141790 0x7fd48013e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39282/0 (socket says 172.21.15.36:39282) 2022-01-10T01:31:39.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd47ffff700 1 -- 172.21.15.36:0/1064228384 learned_addr learned my addr 172.21.15.36:0/1064228384 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:39.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd47f7fe700 1 --2- 172.21.15.36:0/1064228384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4800b2720 0x7fd48013e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd47ffff700 1 -- 172.21.15.36:0/1064228384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4800b2720 msgr2=0x7fd48013e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:39.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd47ffff700 1 --2- 172.21.15.36:0/1064228384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4800b2720 0x7fd48013e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd47ffff700 1 -- 172.21.15.36:0/1064228384 >> v1:172.21.15.59:6789/0 conn(0x7fd4800b0ff0 legacy=0x7fd480141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd47ffff700 1 -- 172.21.15.36:0/1064228384 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4800b2b00 con 0x7fd480141790 2022-01-10T01:31:39.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd47ffff700 1 --2- 172.21.15.36:0/1064228384 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd480141790 0x7fd48013e520 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7fd4780032f0 tx=0x7fd478009290).ready entity=mon.0 client_cookie=5c69c19154a0cdf3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:39.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd47effd700 1 -- 172.21.15.36:0/1064228384 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd47800b8a0 con 0x7fd480141790 2022-01-10T01:31:39.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd47effd700 1 -- 172.21.15.36:0/1064228384 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47800ba00 con 0x7fd480141790 2022-01-10T01:31:39.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd47effd700 1 -- 172.21.15.36:0/1064228384 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd47800bb70 con 0x7fd480141790 2022-01-10T01:31:39.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd484abd700 1 -- 172.21.15.36:0/1064228384 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd480141790 msgr2=0x7fd48013e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd484abd700 1 --2- 172.21.15.36:0/1064228384 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd480141790 0x7fd48013e520 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7fd4780032f0 tx=0x7fd478009290).stop 2022-01-10T01:31:39.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd484abd700 1 -- 172.21.15.36:0/1064228384 shutdown_connections 2022-01-10T01:31:39.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd484abd700 1 --2- 172.21.15.36:0/1064228384 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd480141790 0x7fd48013e520 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd484abd700 1 --2- 172.21.15.36:0/1064228384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4800b2720 0x7fd48013e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd484abd700 1 -- 172.21.15.36:0/1064228384 >> 172.21.15.36:0/1064228384 conn(0x7fd480060180 msgr2=0x7fd4800b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:39.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd484abd700 1 -- 172.21.15.36:0/1064228384 shutdown_connections 2022-01-10T01:31:39.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.092+0000 7fd484abd700 1 -- 172.21.15.36:0/1064228384 wait complete. 2022-01-10T01:31:39.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd484abd700 1 Processor -- start 2022-01-10T01:31:39.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd484abd700 1 -- start start 2022-01-10T01:31:39.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd484abd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4800b0ff0 0x7fd4800b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd484abd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4800b2720 0x7fd480142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd484abd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd480141790 0x7fd4800b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd484abd700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48013c870 con 0x7fd4800b0ff0 2022-01-10T01:31:39.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd484abd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd480143c60 con 0x7fd4800b2720 2022-01-10T01:31:39.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd484abd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd480143f00 con 0x7fd480141790 2022-01-10T01:31:39.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd47f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4800b0ff0 0x7fd4800b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd47f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4800b0ff0 0x7fd4800b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39286/0 (socket says 172.21.15.36:39286) 2022-01-10T01:31:39.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd47f7fe700 1 -- 172.21.15.36:0/913467226 learned_addr learned my addr 172.21.15.36:0/913467226 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:39.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd477fff700 1 --2- 172.21.15.36:0/913467226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4800b2720 0x7fd480142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd47ffff700 1 --2- 172.21.15.36:0/913467226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd480141790 0x7fd4800b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd47f7fe700 1 -- 172.21.15.36:0/913467226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd480141790 msgr2=0x7fd4800b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd47f7fe700 1 --2- 172.21.15.36:0/913467226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd480141790 0x7fd4800b35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd47f7fe700 1 -- 172.21.15.36:0/913467226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4800b2720 msgr2=0x7fd480142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd47f7fe700 1 --2- 172.21.15.36:0/913467226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4800b2720 0x7fd480142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.096+0000 7fd47f7fe700 1 -- 172.21.15.36:0/913467226 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd478009530 con 0x7fd4800b0ff0 2022-01-10T01:31:39.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.100+0000 7fd47f7fe700 1 --2- 172.21.15.36:0/913467226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4800b0ff0 0x7fd4800b4990 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fd4700030b0 tx=0x7fd470008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:39.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.100+0000 7fd47d7fa700 1 -- 172.21.15.36:0/913467226 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd470011780 con 0x7fd4800b0ff0 2022-01-10T01:31:39.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.100+0000 7fd47d7fa700 1 -- 172.21.15.36:0/913467226 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4700118e0 con 0x7fd4800b0ff0 2022-01-10T01:31:39.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.100+0000 7fd484abd700 1 -- 172.21.15.36:0/913467226 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4801441a0 con 0x7fd4800b0ff0 2022-01-10T01:31:39.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.100+0000 7fd47d7fa700 1 -- 172.21.15.36:0/913467226 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd470011c40 con 0x7fd4800b0ff0 2022-01-10T01:31:39.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.100+0000 7fd484abd700 1 -- 172.21.15.36:0/913467226 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48014fef0 con 0x7fd4800b0ff0 2022-01-10T01:31:39.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.100+0000 7fd484abd700 1 -- 172.21.15.36:0/913467226 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd480057350 con 0x7fd4800b0ff0 2022-01-10T01:31:39.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.100+0000 7fd47d7fa700 1 -- 172.21.15.36:0/913467226 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd470012420 con 0x7fd4800b0ff0 2022-01-10T01:31:39.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.104+0000 7fd47d7fa700 1 --2- 172.21.15.36:0/913467226 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd464053620 0x7fd464055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.104+0000 7fd477fff700 1 --2- 172.21.15.36:0/913467226 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd464053620 0x7fd464055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.104+0000 7fd47d7fa700 1 -- 172.21.15.36:0/913467226 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fd47006b5d0 con 0x7fd4800b0ff0 2022-01-10T01:31:39.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.104+0000 7fd477fff700 1 --2- 172.21.15.36:0/913467226 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd464053620 0x7fd464055ae0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fd46800d000 tx=0x7fd468007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:39.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.108+0000 7fd47d7fa700 1 -- 172.21.15.36:0/913467226 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd4700427b0 con 0x7fd4800b0ff0 2022-01-10T01:31:39.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.236+0000 7fd484abd700 1 -- 172.21.15.36:0/913467226 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd4800698e0 con 0x7fd4800b0ff0 2022-01-10T01:31:39.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.236+0000 7fd47d7fa700 1 -- 172.21.15.36:0/913467226 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v96) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd470045dd0 con 0x7fd4800b0ff0 2022-01-10T01:31:39.242 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:31:39.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.240+0000 7fd484abd700 1 -- 172.21.15.36:0/913467226 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd464053620 msgr2=0x7fd464055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.240+0000 7fd484abd700 1 --2- 172.21.15.36:0/913467226 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd464053620 0x7fd464055ae0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7fd46800d000 tx=0x7fd468007b90).stop 2022-01-10T01:31:39.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.240+0000 7fd484abd700 1 -- 172.21.15.36:0/913467226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4800b0ff0 msgr2=0x7fd4800b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.240+0000 7fd484abd700 1 --2- 172.21.15.36:0/913467226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4800b0ff0 0x7fd4800b4990 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fd4700030b0 tx=0x7fd470008040).stop 2022-01-10T01:31:39.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.240+0000 7fd484abd700 1 -- 172.21.15.36:0/913467226 shutdown_connections 2022-01-10T01:31:39.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.240+0000 7fd484abd700 1 --2- 172.21.15.36:0/913467226 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd464053620 0x7fd464055ae0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.240+0000 7fd484abd700 1 --2- 172.21.15.36:0/913467226 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd480141790 0x7fd4800b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.240+0000 7fd484abd700 1 --2- 172.21.15.36:0/913467226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4800b2720 0x7fd480142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.240+0000 7fd484abd700 1 --2- 172.21.15.36:0/913467226 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd4800b0ff0 0x7fd4800b4990 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.240+0000 7fd484abd700 1 -- 172.21.15.36:0/913467226 >> 172.21.15.36:0/913467226 conn(0x7fd480060180 msgr2=0x7fd4800aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:39.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.240+0000 7fd484abd700 1 -- 172.21.15.36:0/913467226 shutdown_connections 2022-01-10T01:31:39.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.240+0000 7fd484abd700 1 -- 172.21.15.36:0/913467226 wait complete. 2022-01-10T01:31:39.260 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:31:39.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.356+0000 7f61cb59e700 1 Processor -- start 2022-01-10T01:31:39.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.356+0000 7f61cb59e700 1 -- start start 2022-01-10T01:31:39.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61cb59e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f61cc0b4710 0x7f61cc13fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61cb59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc0b6910 con 0x7f61cc1439a0 2022-01-10T01:31:39.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61cb59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc0b6bb0 con 0x7f61cc061680 2022-01-10T01:31:39.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61cb59e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61cc0b9680 con 0x7f61cc0b4710 2022-01-10T01:31:39.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61c9d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f61cc0b4710 0x7f61cc13fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61cad9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f61cc1439a0 0x7f61cc140290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37092/0 (socket says 172.21.15.36:37092) 2022-01-10T01:31:39.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61c9d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f61cc0b4710 0x7f61cc13fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39296/0 (socket says 172.21.15.36:39296) 2022-01-10T01:31:39.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61cad9d700 1 -- 172.21.15.36:0/1808800967 learned_addr learned my addr 172.21.15.36:0/1808800967 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:39.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61c9d9b700 1 -- 172.21.15.36:0/1808800967 >> v1:172.21.15.59:6789/0 conn(0x7f61cc061680 legacy=0x7f61cc0b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61c9d9b700 1 -- 172.21.15.36:0/1808800967 >> v1:172.21.15.36:6789/0 conn(0x7f61cc1439a0 legacy=0x7f61cc140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61c9d9b700 1 -- 172.21.15.36:0/1808800967 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc0b6e50 con 0x7f61cc0b4710 2022-01-10T01:31:39.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61c9d9b700 1 --2- 172.21.15.36:0/1808800967 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61cc0b4710 0x7f61cc13fda0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f61b4002f70 tx=0x7f61b4006df0).ready entity=mon.0 client_cookie=fbde7ac0a7241348 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:39.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61c959a700 1 -- 172.21.15.36:0/1808800967 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61b400d610 con 0x7f61cc0b4710 2022-01-10T01:31:39.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61c959a700 1 -- 172.21.15.36:0/1808800967 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b4000e90 con 0x7f61cc0b4710 2022-01-10T01:31:39.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61c959a700 1 -- 172.21.15.36:0/1808800967 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61b400d960 con 0x7f61cc0b4710 2022-01-10T01:31:39.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61cb59e700 1 -- 172.21.15.36:0/1808800967 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61cc0b4710 msgr2=0x7f61cc13fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61cb59e700 1 --2- 172.21.15.36:0/1808800967 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61cc0b4710 0x7f61cc13fda0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f61b4002f70 tx=0x7f61b4006df0).stop 2022-01-10T01:31:39.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61cb59e700 1 -- 172.21.15.36:0/1808800967 shutdown_connections 2022-01-10T01:31:39.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61cb59e700 1 --2- 172.21.15.36:0/1808800967 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61cc0b4710 0x7f61cc13fda0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61cb59e700 1 -- 172.21.15.36:0/1808800967 >> 172.21.15.36:0/1808800967 conn(0x7f61cc06adf0 msgr2=0x7f61cc05f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:39.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61cb59e700 1 -- 172.21.15.36:0/1808800967 shutdown_connections 2022-01-10T01:31:39.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.360+0000 7f61cb59e700 1 -- 172.21.15.36:0/1808800967 wait complete. 2022-01-10T01:31:39.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61cb59e700 1 Processor -- start 2022-01-10T01:31:39.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61cb59e700 1 -- start start 2022-01-10T01:31:39.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61cb59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61cc061680 0x7f61cc113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61cb59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61cc1439a0 0x7f61cc0ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61cb59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61cc1527d0 0x7f61cc156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61cb59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc0b0a60 con 0x7f61cc1439a0 2022-01-10T01:31:39.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61cb59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc0b07c0 con 0x7f61cc1527d0 2022-01-10T01:31:39.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61cb59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc155e30 con 0x7f61cc061680 2022-01-10T01:31:39.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61c9d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61cc1439a0 0x7f61cc0ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61c9d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61cc1439a0 0x7f61cc0ad9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39300/0 (socket says 172.21.15.36:39300) 2022-01-10T01:31:39.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61c9d9b700 1 -- 172.21.15.36:0/1982322260 learned_addr learned my addr 172.21.15.36:0/1982322260 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:39.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61cad9d700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61cc1527d0 0x7f61cc156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61ca59c700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61cc061680 0x7f61cc113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61c9d9b700 1 -- 172.21.15.36:0/1982322260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61cc061680 msgr2=0x7f61cc113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61c9d9b700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61cc061680 0x7f61cc113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61c9d9b700 1 -- 172.21.15.36:0/1982322260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61cc1527d0 msgr2=0x7f61cc156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61c9d9b700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61cc1527d0 0x7f61cc156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61c9d9b700 1 -- 172.21.15.36:0/1982322260 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b400b180 con 0x7f61cc1439a0 2022-01-10T01:31:39.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61cad9d700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61cc1527d0 0x7f61cc156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:39.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61c9d9b700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61cc1439a0 0x7f61cc0ad9e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f61b4002f70 tx=0x7f61b4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:39.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61c37fe700 1 -- 172.21.15.36:0/1982322260 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61b400d990 con 0x7f61cc1439a0 2022-01-10T01:31:39.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61c37fe700 1 -- 172.21.15.36:0/1982322260 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b4011c30 con 0x7f61cc1439a0 2022-01-10T01:31:39.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61cb59e700 1 -- 172.21.15.36:0/1982322260 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc1560d0 con 0x7f61cc1439a0 2022-01-10T01:31:39.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61c37fe700 1 -- 172.21.15.36:0/1982322260 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61b401e460 con 0x7f61cc1439a0 2022-01-10T01:31:39.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.364+0000 7f61cb59e700 1 -- 172.21.15.36:0/1982322260 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc1165f0 con 0x7f61cc1439a0 2022-01-10T01:31:39.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.368+0000 7f61cb59e700 1 -- 172.21.15.36:0/1982322260 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61cc0b6350 con 0x7f61cc1439a0 2022-01-10T01:31:39.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.368+0000 7f61c37fe700 1 -- 172.21.15.36:0/1982322260 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f61b4025030 con 0x7f61cc1439a0 2022-01-10T01:31:39.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.368+0000 7f61c37fe700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f61b00535f0 0x7f61b0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.368+0000 7f61c37fe700 1 -- 172.21.15.36:0/1982322260 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f61b406cce0 con 0x7f61cc1439a0 2022-01-10T01:31:39.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.368+0000 7f61ca59c700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f61b00535f0 0x7f61b0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.368+0000 7f61ca59c700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f61b00535f0 0x7f61b0055ab0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f61bc00d000 tx=0x7f61bc007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:39.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.376+0000 7f61c37fe700 1 -- 172.21.15.36:0/1982322260 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f61b4043ea0 con 0x7f61cc1439a0 2022-01-10T01:31:39.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.500+0000 7f61cb59e700 1 -- 172.21.15.36:0/1982322260 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f61cc156260 con 0x7f61cc1439a0 2022-01-10T01:31:39.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.500+0000 7f61c37fe700 1 -- 172.21.15.36:0/1982322260 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v96) v1 ==== 92+0+10 (secure 0 0 0) 0x7f61b4023020 con 0x7f61cc1439a0 2022-01-10T01:31:39.508 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:39.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.504+0000 7f61cb59e700 1 -- 172.21.15.36:0/1982322260 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f61b00535f0 msgr2=0x7f61b0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.504+0000 7f61cb59e700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f61b00535f0 0x7f61b0055ab0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f61bc00d000 tx=0x7f61bc007b90).stop 2022-01-10T01:31:39.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.504+0000 7f61cb59e700 1 -- 172.21.15.36:0/1982322260 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61cc1439a0 msgr2=0x7f61cc0ad9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.504+0000 7f61cb59e700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61cc1439a0 0x7f61cc0ad9e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f61b4002f70 tx=0x7f61b4015000).stop 2022-01-10T01:31:39.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.504+0000 7f61cb59e700 1 -- 172.21.15.36:0/1982322260 shutdown_connections 2022-01-10T01:31:39.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.504+0000 7f61cb59e700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f61b00535f0 0x7f61b0055ab0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.504+0000 7f61cb59e700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61cc1527d0 0x7f61cc156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.504+0000 7f61cb59e700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61cc1439a0 0x7f61cc0ad9e0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.504+0000 7f61cb59e700 1 --2- 172.21.15.36:0/1982322260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61cc061680 0x7f61cc113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.504+0000 7f61cb59e700 1 -- 172.21.15.36:0/1982322260 >> 172.21.15.36:0/1982322260 conn(0x7f61cc06adf0 msgr2=0x7f61cc141870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:39.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.504+0000 7f61cb59e700 1 -- 172.21.15.36:0/1982322260 shutdown_connections 2022-01-10T01:31:39.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.504+0000 7f61cb59e700 1 -- 172.21.15.36:0/1982322260 wait complete. 2022-01-10T01:31:39.521 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-01-10T01:31:39.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f5917fff700 1 Processor -- start 2022-01-10T01:31:39.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f5917fff700 1 -- start start 2022-01-10T01:31:39.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f5917fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f59180b2580 0x7f591814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f5917fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59180a8ac0 0x7f591814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f5917fff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59180a70c0 con 0x7f59180b0010 2022-01-10T01:31:39.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f5917fff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59180a72f0 con 0x7f59180b2580 2022-01-10T01:31:39.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f5917fff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59180a7590 con 0x7f59180a8ac0 2022-01-10T01:31:39.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f590ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f59180b0010 0x7f59180a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37102/0 (socket says 172.21.15.36:37102) 2022-01-10T01:31:39.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f590ffff700 1 -- 172.21.15.36:0/1003184188 learned_addr learned my addr 172.21.15.36:0/1003184188 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:39.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f5916ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f59180b2580 0x7f591814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f59177fe700 1 --2- 172.21.15.36:0/1003184188 >> v2:172.21.15.59:3300/0 conn(0x7f59180a8ac0 0x7f591814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f59167fc700 1 -- 172.21.15.36:0/1003184188 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635968912 0 0) 0x7f59180a70c0 con 0x7f59180b0010 2022-01-10T01:31:39.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f5916ffd700 1 -- 172.21.15.36:0/1003184188 >> v2:172.21.15.59:3300/0 conn(0x7f59180a8ac0 msgr2=0x7f591814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:39.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f5916ffd700 1 --2- 172.21.15.36:0/1003184188 >> v2:172.21.15.59:3300/0 conn(0x7f59180a8ac0 0x7f591814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f5916ffd700 1 -- 172.21.15.36:0/1003184188 >> v1:172.21.15.36:6789/0 conn(0x7f59180b0010 legacy=0x7f59180a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f5916ffd700 1 -- 172.21.15.36:0/1003184188 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59180a7830 con 0x7f59180b2580 2022-01-10T01:31:39.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.620+0000 7f5916ffd700 1 --2- 172.21.15.36:0/1003184188 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59180b2580 0x7f591814ae40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f5908002f70 tx=0x7f5908006df0).ready entity=mon.0 client_cookie=e25f4bdcb3617d93 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:39.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f59167fc700 1 -- 172.21.15.36:0/1003184188 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f590800d570 con 0x7f59180b2580 2022-01-10T01:31:39.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f59167fc700 1 -- 172.21.15.36:0/1003184188 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5908000e90 con 0x7f59180b2580 2022-01-10T01:31:39.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f59167fc700 1 -- 172.21.15.36:0/1003184188 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f590800d8c0 con 0x7f59180b2580 2022-01-10T01:31:39.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 -- 172.21.15.36:0/1003184188 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59180b2580 msgr2=0x7f591814ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 --2- 172.21.15.36:0/1003184188 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59180b2580 0x7f591814ae40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f5908002f70 tx=0x7f5908006df0).stop 2022-01-10T01:31:39.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 -- 172.21.15.36:0/1003184188 shutdown_connections 2022-01-10T01:31:39.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 --2- 172.21.15.36:0/1003184188 >> v2:172.21.15.59:3300/0 conn(0x7f59180a8ac0 0x7f591814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 --2- 172.21.15.36:0/1003184188 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59180b2580 0x7f591814ae40 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 -- 172.21.15.36:0/1003184188 >> 172.21.15.36:0/1003184188 conn(0x7f5918060180 msgr2=0x7f59180b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:39.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 -- 172.21.15.36:0/1003184188 shutdown_connections 2022-01-10T01:31:39.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 -- 172.21.15.36:0/1003184188 wait complete. 2022-01-10T01:31:39.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 Processor -- start 2022-01-10T01:31:39.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 -- start start 2022-01-10T01:31:39.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59180a8ac0 0x7f59180a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59180b0010 0x7f59180b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59180b2580 0x7f59180b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59180b3e70 con 0x7f59180a8ac0 2022-01-10T01:31:39.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59180b3bd0 con 0x7f59180b2580 2022-01-10T01:31:39.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5917fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59180b3120 con 0x7f59180b0010 2022-01-10T01:31:39.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.624+0000 7f5916ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59180a8ac0 0x7f59180a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.640 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5916ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59180a8ac0 0x7f59180a9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39314/0 (socket says 172.21.15.36:39314) 2022-01-10T01:31:39.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5916ffd700 1 -- 172.21.15.36:0/704131585 learned_addr learned my addr 172.21.15.36:0/704131585 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:39.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f590ffff700 1 --2- 172.21.15.36:0/704131585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59180b0010 0x7f59180b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f59177fe700 1 --2- 172.21.15.36:0/704131585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59180b2580 0x7f59180b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.641 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5916ffd700 1 -- 172.21.15.36:0/704131585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59180b0010 msgr2=0x7f59180b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5916ffd700 1 --2- 172.21.15.36:0/704131585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59180b0010 0x7f59180b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5916ffd700 1 -- 172.21.15.36:0/704131585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59180b2580 msgr2=0x7f59180b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5916ffd700 1 --2- 172.21.15.36:0/704131585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59180b2580 0x7f59180b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5916ffd700 1 -- 172.21.15.36:0/704131585 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590800b180 con 0x7f59180a8ac0 2022-01-10T01:31:39.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5916ffd700 1 --2- 172.21.15.36:0/704131585 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59180a8ac0 0x7f59180a9fe0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f5908002f70 tx=0x7f5908014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:39.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5914ff9700 1 -- 172.21.15.36:0/704131585 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5908016070 con 0x7f59180a8ac0 2022-01-10T01:31:39.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5914ff9700 1 -- 172.21.15.36:0/704131585 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590800de10 con 0x7f59180a8ac0 2022-01-10T01:31:39.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5917fff700 1 -- 172.21.15.36:0/704131585 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59180b33c0 con 0x7f59180a8ac0 2022-01-10T01:31:39.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5914ff9700 1 -- 172.21.15.36:0/704131585 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5908013de0 con 0x7f59180a8ac0 2022-01-10T01:31:39.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5917fff700 1 -- 172.21.15.36:0/704131585 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59180b4870 con 0x7f59180a8ac0 2022-01-10T01:31:39.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5917fff700 1 -- 172.21.15.36:0/704131585 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5918057350 con 0x7f59180a8ac0 2022-01-10T01:31:39.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5914ff9700 1 -- 172.21.15.36:0/704131585 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5908025030 con 0x7f59180a8ac0 2022-01-10T01:31:39.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5914ff9700 1 --2- 172.21.15.36:0/704131585 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f58fc0535f0 0x7f58fc055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f5914ff9700 1 -- 172.21.15.36:0/704131585 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f590806c4f0 con 0x7f59180a8ac0 2022-01-10T01:31:39.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.628+0000 7f590ffff700 1 --2- 172.21.15.36:0/704131585 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f58fc0535f0 0x7f58fc055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.632+0000 7f590ffff700 1 --2- 172.21.15.36:0/704131585 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f58fc0535f0 0x7f58fc055ab0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f590000d000 tx=0x7f5900007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:39.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.636+0000 7f5914ff9700 1 -- 172.21.15.36:0/704131585 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5908043840 con 0x7f59180a8ac0 2022-01-10T01:31:39.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.764+0000 7f5917fff700 1 -- 172.21.15.36:0/704131585 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f59180b3550 con 0x7f59180a8ac0 2022-01-10T01:31:39.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.764+0000 7f5914ff9700 1 -- 172.21.15.36:0/704131585 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v96) v1 ==== 84+0+143 (secure 0 0 0) 0x7f59080230a0 con 0x7f59180a8ac0 2022-01-10T01:31:39.771 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:39.771 INFO:teuthology.orchestra.run.smithi036.stdout:[ 2022-01-10T01:31:39.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:39.772 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 1, 2022-01-10T01:31:39.772 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "device_health_metrics" 2022-01-10T01:31:39.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:39.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:39.773 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 2, 2022-01-10T01:31:39.773 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "rbd" 2022-01-10T01:31:39.773 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:39.773 INFO:teuthology.orchestra.run.smithi036.stdout:] 2022-01-10T01:31:39.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.768+0000 7f5917fff700 1 -- 172.21.15.36:0/704131585 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f58fc0535f0 msgr2=0x7f58fc055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.768+0000 7f5917fff700 1 --2- 172.21.15.36:0/704131585 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f58fc0535f0 0x7f58fc055ab0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f590000d000 tx=0x7f5900007a00).stop 2022-01-10T01:31:39.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.768+0000 7f5917fff700 1 -- 172.21.15.36:0/704131585 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59180a8ac0 msgr2=0x7f59180a9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.768+0000 7f5917fff700 1 --2- 172.21.15.36:0/704131585 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59180a8ac0 0x7f59180a9fe0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f5908002f70 tx=0x7f5908014000).stop 2022-01-10T01:31:39.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.768+0000 7f5917fff700 1 -- 172.21.15.36:0/704131585 shutdown_connections 2022-01-10T01:31:39.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.768+0000 7f5917fff700 1 --2- 172.21.15.36:0/704131585 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f58fc0535f0 0x7f58fc055ab0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.768+0000 7f5917fff700 1 --2- 172.21.15.36:0/704131585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59180b2580 0x7f59180b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.768+0000 7f5917fff700 1 --2- 172.21.15.36:0/704131585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59180b0010 0x7f59180b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.768+0000 7f5917fff700 1 --2- 172.21.15.36:0/704131585 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59180a8ac0 0x7f59180a9fe0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.768+0000 7f5917fff700 1 -- 172.21.15.36:0/704131585 >> 172.21.15.36:0/704131585 conn(0x7f5918060180 msgr2=0x7f5918149bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:39.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.768+0000 7f5917fff700 1 -- 172.21.15.36:0/704131585 shutdown_connections 2022-01-10T01:31:39.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.768+0000 7f5917fff700 1 -- 172.21.15.36:0/704131585 wait complete. 2022-01-10T01:31:39.784 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-01-10T01:31:39.784 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:31:39.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.888+0000 7f597759e700 1 Processor -- start 2022-01-10T01:31:39.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.888+0000 7f597759e700 1 -- start start 2022-01-10T01:31:39.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5978061320 0x7f5978061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59780ad5c0 0x7f59780b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597759e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59780aecf0 con 0x7f5978140440 2022-01-10T01:31:39.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59780b6f20 con 0x7f5978061320 2022-01-10T01:31:39.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59780aef20 con 0x7f59780ad5c0 2022-01-10T01:31:39.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f5976d9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f5978140440 0x7f5978146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37120/0 (socket says 172.21.15.36:37120) 2022-01-10T01:31:39.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f5976d9d700 1 -- 172.21.15.36:0/3058905978 learned_addr learned my addr 172.21.15.36:0/3058905978 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:39.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597659c700 1 --2- 172.21.15.36:0/3058905978 >> v2:172.21.15.59:3300/0 conn(0x7f5978061320 0x7f5978061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f5975d9b700 1 --2- 172.21.15.36:0/3058905978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59780ad5c0 0x7f59780b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597659c700 1 -- 172.21.15.36:0/3058905978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59780ad5c0 msgr2=0x7f59780b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:39.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597659c700 1 --2- 172.21.15.36:0/3058905978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59780ad5c0 0x7f59780b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597659c700 1 -- 172.21.15.36:0/3058905978 >> v1:172.21.15.36:6789/0 conn(0x7f5978140440 legacy=0x7f5978146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597659c700 1 -- 172.21.15.36:0/3058905978 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59780af1c0 con 0x7f5978061320 2022-01-10T01:31:39.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597659c700 1 --2- 172.21.15.36:0/3058905978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5978061320 0x7f5978061700 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f5960002f70 tx=0x7f5960006df0).ready entity=mon.1 client_cookie=e72a6f9a0963cfc5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:39.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597559a700 1 -- 172.21.15.36:0/3058905978 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596000d570 con 0x7f5978061320 2022-01-10T01:31:39.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597559a700 1 -- 172.21.15.36:0/3058905978 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5960000e90 con 0x7f5978061320 2022-01-10T01:31:39.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597559a700 1 -- 172.21.15.36:0/3058905978 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f596000d8c0 con 0x7f5978061320 2022-01-10T01:31:39.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597759e700 1 -- 172.21.15.36:0/3058905978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5978061320 msgr2=0x7f5978061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597759e700 1 --2- 172.21.15.36:0/3058905978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5978061320 0x7f5978061700 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f5960002f70 tx=0x7f5960006df0).stop 2022-01-10T01:31:39.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597759e700 1 -- 172.21.15.36:0/3058905978 shutdown_connections 2022-01-10T01:31:39.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597759e700 1 --2- 172.21.15.36:0/3058905978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59780ad5c0 0x7f59780b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597759e700 1 --2- 172.21.15.36:0/3058905978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5978061320 0x7f5978061700 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597759e700 1 -- 172.21.15.36:0/3058905978 >> 172.21.15.36:0/3058905978 conn(0x7f5978066de0 msgr2=0x7f59780671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:39.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597759e700 1 -- 172.21.15.36:0/3058905978 shutdown_connections 2022-01-10T01:31:39.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.892+0000 7f597759e700 1 -- 172.21.15.36:0/3058905978 wait complete. 2022-01-10T01:31:39.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f597759e700 1 Processor -- start 2022-01-10T01:31:39.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f597759e700 1 -- start start 2022-01-10T01:31:39.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f597759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978061320 0x7f59780acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f597759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59780ad5c0 0x7f5978141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f597759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5978140440 0x7f597813e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f597759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59780a0420 con 0x7f5978140440 2022-01-10T01:31:39.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f597759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59780a1780 con 0x7f59780ad5c0 2022-01-10T01:31:39.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f597759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59780b2b90 con 0x7f5978061320 2022-01-10T01:31:39.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f5976d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5978140440 0x7f597813e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f5975d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59780ad5c0 0x7f5978141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f5975d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59780ad5c0 0x7f5978141380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:35964/0 (socket says 172.21.15.36:35964) 2022-01-10T01:31:39.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f5976d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5978140440 0x7f597813e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39332/0 (socket says 172.21.15.36:39332) 2022-01-10T01:31:39.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f5975d9b700 1 -- 172.21.15.36:0/56179567 learned_addr learned my addr 172.21.15.36:0/56179567 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:39.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f597659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978061320 0x7f59780acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f5975d9b700 1 -- 172.21.15.36:0/56179567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978061320 msgr2=0x7f59780acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f5975d9b700 1 --2- 172.21.15.36:0/56179567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978061320 0x7f59780acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f5975d9b700 1 -- 172.21.15.36:0/56179567 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5978140440 msgr2=0x7f597813e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:39.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f5975d9b700 1 --2- 172.21.15.36:0/56179567 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5978140440 0x7f597813e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:39.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f5975d9b700 1 -- 172.21.15.36:0/56179567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596000b180 con 0x7f59780ad5c0 2022-01-10T01:31:39.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f5975d9b700 1 --2- 172.21.15.36:0/56179567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59780ad5c0 0x7f5978141380 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f596800c000 tx=0x7f5968006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:39.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f596f7fe700 1 -- 172.21.15.36:0/56179567 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5968010780 con 0x7f59780ad5c0 2022-01-10T01:31:39.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f596f7fe700 1 -- 172.21.15.36:0/56179567 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59680108e0 con 0x7f59780ad5c0 2022-01-10T01:31:39.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f597759e700 1 -- 172.21.15.36:0/56179567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59780b2e30 con 0x7f59780ad5c0 2022-01-10T01:31:39.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f596f7fe700 1 -- 172.21.15.36:0/56179567 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5968010c40 con 0x7f59780ad5c0 2022-01-10T01:31:39.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.896+0000 7f597759e700 1 -- 172.21.15.36:0/56179567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59780b2880 con 0x7f59780ad5c0 2022-01-10T01:31:39.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.900+0000 7f597759e700 1 -- 172.21.15.36:0/56179567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59780af460 con 0x7f59780ad5c0 2022-01-10T01:31:39.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.900+0000 7f596f7fe700 1 -- 172.21.15.36:0/56179567 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f596801c460 con 0x7f59780ad5c0 2022-01-10T01:31:39.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.900+0000 7f596f7fe700 1 --2- 172.21.15.36:0/56179567 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f595c053500 0x7f595c0559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:39.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.900+0000 7f596f7fe700 1 -- 172.21.15.36:0/56179567 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f596806ba20 con 0x7f59780ad5c0 2022-01-10T01:31:39.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.900+0000 7f597659c700 1 --2- 172.21.15.36:0/56179567 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f595c053500 0x7f595c0559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:39.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.900+0000 7f597659c700 1 --2- 172.21.15.36:0/56179567 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f595c053500 0x7f595c0559c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f596001a000 tx=0x7f5960014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:39.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:39.908+0000 7f596f7fe700 1 -- 172.21.15.36:0/56179567 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5968042d10 con 0x7f59780ad5c0 2022-01-10T01:31:40.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:40.036+0000 7f597759e700 1 -- 172.21.15.36:0/56179567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f5978057350 con 0x7f59780ad5c0 2022-01-10T01:31:40.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:40.980+0000 7f596f7fe700 1 -- 172.21.15.36:0/56179567 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v97) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5968046330 con 0x7f59780ad5c0 2022-01-10T01:31:40.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:40.988+0000 7f597759e700 1 -- 172.21.15.36:0/56179567 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f595c053500 msgr2=0x7f595c0559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:40.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:40.988+0000 7f597759e700 1 --2- 172.21.15.36:0/56179567 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f595c053500 0x7f595c0559c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f596001a000 tx=0x7f5960014000).stop 2022-01-10T01:31:40.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:40.988+0000 7f597759e700 1 -- 172.21.15.36:0/56179567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59780ad5c0 msgr2=0x7f5978141380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:40.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:40.988+0000 7f597759e700 1 --2- 172.21.15.36:0/56179567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59780ad5c0 0x7f5978141380 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f596800c000 tx=0x7f5968006df0).stop 2022-01-10T01:31:40.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:40.988+0000 7f597759e700 1 -- 172.21.15.36:0/56179567 shutdown_connections 2022-01-10T01:31:40.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:40.988+0000 7f597759e700 1 --2- 172.21.15.36:0/56179567 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f595c053500 0x7f595c0559c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:40.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:40.988+0000 7f597759e700 1 --2- 172.21.15.36:0/56179567 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5978140440 0x7f597813e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:40.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:40.988+0000 7f597759e700 1 --2- 172.21.15.36:0/56179567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59780ad5c0 0x7f5978141380 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:40.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:40.988+0000 7f597759e700 1 --2- 172.21.15.36:0/56179567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5978061320 0x7f59780acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:40.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:40.988+0000 7f597759e700 1 -- 172.21.15.36:0/56179567 >> 172.21.15.36:0/56179567 conn(0x7f5978066de0 msgr2=0x7f597813fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:40.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:40.988+0000 7f597759e700 1 -- 172.21.15.36:0/56179567 shutdown_connections 2022-01-10T01:31:40.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:40.988+0000 7f597759e700 1 -- 172.21.15.36:0/56179567 wait complete. 2022-01-10T01:31:40.998 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:31:41.006 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2022-01-10T01:31:41.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87aff8b700 1 Processor -- start 2022-01-10T01:31:41.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87aff8b700 1 -- start start 2022-01-10T01:31:41.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87aff8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87a8146950 0x7f87a8140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:41.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87aff8b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87a80b4180 0x7f87a8140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:41.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87aff8b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a8143b60 con 0x7f87a80b4690 2022-01-10T01:31:41.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87aff8b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a8147510 con 0x7f87a80b4180 2022-01-10T01:31:41.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87aff8b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8143e00 con 0x7f87a8146950 2022-01-10T01:31:41.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87ae528700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f87a80b4690 0x7f87a80b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37134/0 (socket says 172.21.15.36:37134) 2022-01-10T01:31:41.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87ae528700 1 -- 172.21.15.36:0/1015250529 learned_addr learned my addr 172.21.15.36:0/1015250529 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:41.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87ad526700 1 --2- 172.21.15.36:0/1015250529 >> v2:172.21.15.59:3300/0 conn(0x7f87a80b4180 0x7f87a8140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:41.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87add27700 1 --2- 172.21.15.36:0/1015250529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87a8146950 0x7f87a8140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:41.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 -- 172.21.15.36:0/1015250529 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290811873 0 0) 0x7f87a8143b60 con 0x7f87a80b4690 2022-01-10T01:31:41.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 -- 172.21.15.36:0/1015250529 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8790003260 con 0x7f87a80b4690 2022-01-10T01:31:41.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 -- 172.21.15.36:0/1015250529 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 417029705 0 0) 0x7f8790003260 con 0x7f87a80b4690 2022-01-10T01:31:41.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 -- 172.21.15.36:0/1015250529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87a8146950 msgr2=0x7f87a8140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:41.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 --2- 172.21.15.36:0/1015250529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87a8146950 0x7f87a8140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:41.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 -- 172.21.15.36:0/1015250529 >> v2:172.21.15.59:3300/0 conn(0x7f87a80b4180 msgr2=0x7f87a8140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:41.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 --2- 172.21.15.36:0/1015250529 >> v2:172.21.15.59:3300/0 conn(0x7f87a80b4180 0x7f87a8140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:41.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 -- 172.21.15.36:0/1015250529 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a80b0c90 con 0x7f87a80b4690 2022-01-10T01:31:41.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 -- 172.21.15.36:0/1015250529 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f87a00019e0 con 0x7f87a80b4690 2022-01-10T01:31:41.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 -- 172.21.15.36:0/1015250529 >> v1:172.21.15.36:6789/0 conn(0x7f87a80b4690 legacy=0x7f87a80b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:41.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 --2- 172.21.15.36:0/1015250529 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8790003750 0x7f8790003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:41.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 --2- 172.21.15.36:0/1015250529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87a8146950 0x7f8790004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:41.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 --2- 172.21.15.36:0/1015250529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87900049f0 0x7f8790004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:41.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 -- 172.21.15.36:0/1015250529 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8147510 con 0x7f8790003750 2022-01-10T01:31:41.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 -- 172.21.15.36:0/1015250529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8143e00 con 0x7f87900049f0 2022-01-10T01:31:41.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87acd25700 1 -- 172.21.15.36:0/1015250529 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879000b750 con 0x7f87a8146950 2022-01-10T01:31:41.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87add27700 1 --2- 172.21.15.36:0/1015250529 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8790003750 0x7f8790003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:41.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87ad526700 1 --2- 172.21.15.36:0/1015250529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87a8146950 0x7f8790004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:41.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.116+0000 7f87ae528700 1 --2- 172.21.15.36:0/1015250529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87900049f0 0x7f8790004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:41.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87add27700 1 -- 172.21.15.36:0/1015250529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87a8146950 msgr2=0x7f8790004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:41.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87add27700 1 --2- 172.21.15.36:0/1015250529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87a8146950 0x7f8790004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:41.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87add27700 1 -- 172.21.15.36:0/1015250529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87900049f0 msgr2=0x7f8790004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:41.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87add27700 1 --2- 172.21.15.36:0/1015250529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87900049f0 0x7f8790004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:41.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87add27700 1 -- 172.21.15.36:0/1015250529 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8790003260 con 0x7f8790003750 2022-01-10T01:31:41.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87add27700 1 --2- 172.21.15.36:0/1015250529 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8790003750 0x7f8790003b70 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f87a400c000 tx=0x7f87a4006df0).ready entity=mon.0 client_cookie=2906936bb9574cf4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:41.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87acd25700 1 -- 172.21.15.36:0/1015250529 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87a400e830 con 0x7f8790003750 2022-01-10T01:31:41.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87acd25700 1 -- 172.21.15.36:0/1015250529 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a400e990 con 0x7f8790003750 2022-01-10T01:31:41.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87acd25700 1 -- 172.21.15.36:0/1015250529 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87a400ecf0 con 0x7f8790003750 2022-01-10T01:31:41.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87aff8b700 1 -- 172.21.15.36:0/1015250529 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8790003750 msgr2=0x7f8790003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:41.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87aff8b700 1 --2- 172.21.15.36:0/1015250529 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8790003750 0x7f8790003b70 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f87a400c000 tx=0x7f87a4006df0).stop 2022-01-10T01:31:41.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87ae528700 1 -- 172.21.15.36:0/1015250529 reap_dead start 2022-01-10T01:31:41.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87aff8b700 1 -- 172.21.15.36:0/1015250529 shutdown_connections 2022-01-10T01:31:41.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87aff8b700 1 -- 172.21.15.36:0/1015250529 >> 172.21.15.36:0/1015250529 conn(0x7f87a805c490 msgr2=0x7f87a805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:41.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87aff8b700 1 -- 172.21.15.36:0/1015250529 shutdown_connections 2022-01-10T01:31:41.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87aff8b700 1 -- 172.21.15.36:0/1015250529 wait complete. 2022-01-10T01:31:41.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.120+0000 7f87aff8b700 1 Processor -- start 2022-01-10T01:31:41.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87aff8b700 1 -- start start 2022-01-10T01:31:41.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87aff8b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8790003750 0x7f87a8144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:41.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87aff8b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87a81421a0 0x7f87a81429f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:41.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87aff8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87a80b7fb0 0x7f87a81558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:41.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87aff8b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8145e20 con 0x7f87a81421a0 2022-01-10T01:31:41.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87aff8b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a813a720 con 0x7f8790003750 2022-01-10T01:31:41.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87aff8b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a81446b0 con 0x7f87a80b7fb0 2022-01-10T01:31:41.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87ad526700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87a81421a0 0x7f87a81429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:41.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87ad526700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87a81421a0 0x7f87a81429f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39350/0 (socket says 172.21.15.36:39350) 2022-01-10T01:31:41.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87ad526700 1 -- 172.21.15.36:0/538704311 learned_addr learned my addr 172.21.15.36:0/538704311 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:41.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87add27700 1 --2- 172.21.15.36:0/538704311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8790003750 0x7f87a8144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:41.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87ae528700 1 --2- 172.21.15.36:0/538704311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87a80b7fb0 0x7f87a81558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:41.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87ad526700 1 -- 172.21.15.36:0/538704311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87a80b7fb0 msgr2=0x7f87a81558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:41.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87ad526700 1 --2- 172.21.15.36:0/538704311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87a80b7fb0 0x7f87a81558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:41.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87ad526700 1 -- 172.21.15.36:0/538704311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8790003750 msgr2=0x7f87a8144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:41.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87ad526700 1 --2- 172.21.15.36:0/538704311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8790003750 0x7f87a8144a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:41.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87ad526700 1 -- 172.21.15.36:0/538704311 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a80b8ab0 con 0x7f87a81421a0 2022-01-10T01:31:41.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87ad526700 1 --2- 172.21.15.36:0/538704311 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87a81421a0 0x7f87a81429f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f87a80b7b80 tx=0x7f8798006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:41.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f8796ffd700 1 -- 172.21.15.36:0/538704311 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f879800f940 con 0x7f87a81421a0 2022-01-10T01:31:41.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f8796ffd700 1 -- 172.21.15.36:0/538704311 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8798000e90 con 0x7f87a81421a0 2022-01-10T01:31:41.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87aff8b700 1 -- 172.21.15.36:0/538704311 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a80b8d50 con 0x7f87a81421a0 2022-01-10T01:31:41.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f8796ffd700 1 -- 172.21.15.36:0/538704311 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f879800fc90 con 0x7f87a81421a0 2022-01-10T01:31:41.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.124+0000 7f87aff8b700 1 -- 172.21.15.36:0/538704311 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a8138330 con 0x7f87a81421a0 2022-01-10T01:31:41.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.128+0000 7f87aff8b700 1 -- 172.21.15.36:0/538704311 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a8057350 con 0x7f87a81421a0 2022-01-10T01:31:41.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.128+0000 7f8796ffd700 1 -- 172.21.15.36:0/538704311 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f879801d460 con 0x7f87a81421a0 2022-01-10T01:31:41.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.128+0000 7f8796ffd700 1 --2- 172.21.15.36:0/538704311 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8788053620 0x7f8788055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:41.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.128+0000 7f8796ffd700 1 -- 172.21.15.36:0/538704311 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f879806c0d0 con 0x7f87a81421a0 2022-01-10T01:31:41.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.128+0000 7f87add27700 1 --2- 172.21.15.36:0/538704311 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8788053620 0x7f8788055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:41.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.132+0000 7f87add27700 1 --2- 172.21.15.36:0/538704311 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8788053620 0x7f8788055ae0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f87a401a000 tx=0x7f87a4019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:41.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.136+0000 7f8796ffd700 1 -- 172.21.15.36:0/538704311 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8798043140 con 0x7f87a81421a0 2022-01-10T01:31:41.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.268+0000 7f87aff8b700 1 -- 172.21.15.36:0/538704311 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f87a80b7c30 con 0x7f87a81421a0 2022-01-10T01:31:41.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.988+0000 7f8796ffd700 1 -- 172.21.15.36:0/538704311 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v98) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8798018030 con 0x7f87a81421a0 2022-01-10T01:31:41.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.992+0000 7f87aff8b700 1 -- 172.21.15.36:0/538704311 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8788053620 msgr2=0x7f8788055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:41.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.992+0000 7f87aff8b700 1 --2- 172.21.15.36:0/538704311 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8788053620 0x7f8788055ae0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f87a401a000 tx=0x7f87a4019000).stop 2022-01-10T01:31:41.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.992+0000 7f87aff8b700 1 -- 172.21.15.36:0/538704311 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87a81421a0 msgr2=0x7f87a81429f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.992+0000 7f87aff8b700 1 --2- 172.21.15.36:0/538704311 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87a81421a0 0x7f87a81429f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f87a80b7b80 tx=0x7f8798006df0).stop 2022-01-10T01:31:42.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.992+0000 7f87aff8b700 1 -- 172.21.15.36:0/538704311 shutdown_connections 2022-01-10T01:31:42.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.992+0000 7f87aff8b700 1 --2- 172.21.15.36:0/538704311 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8788053620 0x7f8788055ae0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.992+0000 7f87aff8b700 1 --2- 172.21.15.36:0/538704311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87a80b7fb0 0x7f87a81558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.992+0000 7f87aff8b700 1 --2- 172.21.15.36:0/538704311 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f87a81421a0 0x7f87a81429f0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.992+0000 7f87aff8b700 1 --2- 172.21.15.36:0/538704311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8790003750 0x7f87a8144a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.992+0000 7f87aff8b700 1 -- 172.21.15.36:0/538704311 >> 172.21.15.36:0/538704311 conn(0x7f87a805c490 msgr2=0x7f87a813b160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:42.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.996+0000 7f87aff8b700 1 -- 172.21.15.36:0/538704311 shutdown_connections 2022-01-10T01:31:42.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:41.996+0000 7f87aff8b700 1 -- 172.21.15.36:0/538704311 wait complete. 2022-01-10T01:31:42.003 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' created 2022-01-10T01:31:42.013 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-10T01:31:42.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe6318d700 1 Processor -- start 2022-01-10T01:31:42.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe6318d700 1 -- start start 2022-01-10T01:31:42.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe6318d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe5c060100 0x7fbe5c061650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe6318d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe5c066ce0 0x7fbe5c065df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe6318d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c0604e0 con 0x7fbe5c065970 2022-01-10T01:31:42.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe6318d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c067120 con 0x7fbe5c066ce0 2022-01-10T01:31:42.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe6318d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c060c70 con 0x7fbe5c060100 2022-01-10T01:31:42.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe60f29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe5c060100 0x7fbe5c061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe5bfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbe5c065970 0x7fbe5c0665d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:54826/0 (socket says 172.21.15.36:54826) 2022-01-10T01:31:42.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe5bfff700 1 -- 172.21.15.36:0/3461300600 learned_addr learned my addr 172.21.15.36:0/3461300600 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:42.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe6172a700 1 --2- 172.21.15.36:0/3461300600 >> v2:172.21.15.59:3300/0 conn(0x7fbe5c066ce0 0x7fbe5c065df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe6172a700 1 -- 172.21.15.36:0/3461300600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe5c060100 msgr2=0x7fbe5c061650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:42.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe6172a700 1 --2- 172.21.15.36:0/3461300600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe5c060100 0x7fbe5c061650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe5b7fe700 1 -- 172.21.15.36:0/3461300600 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355452409 0 0) 0x7fbe5c0604e0 con 0x7fbe5c065970 2022-01-10T01:31:42.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe6172a700 1 -- 172.21.15.36:0/3461300600 >> v1:172.21.15.59:6789/0 conn(0x7fbe5c065970 legacy=0x7fbe5c0665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe6172a700 1 -- 172.21.15.36:0/3461300600 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c060f10 con 0x7fbe5c066ce0 2022-01-10T01:31:42.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.112+0000 7fbe60f29700 1 --2- 172.21.15.36:0/3461300600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe5c060100 0x7fbe5c061650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:42.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.116+0000 7fbe6172a700 1 --2- 172.21.15.36:0/3461300600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe5c066ce0 0x7fbe5c065df0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fbe540032f0 tx=0x7fbe540091d0).ready entity=mon.1 client_cookie=88b0ba7bf285b399 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:42.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.116+0000 7fbe5b7fe700 1 -- 172.21.15.36:0/3461300600 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5400b6c0 con 0x7fbe5c066ce0 2022-01-10T01:31:42.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.116+0000 7fbe5b7fe700 1 -- 172.21.15.36:0/3461300600 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5400b820 con 0x7fbe5c066ce0 2022-01-10T01:31:42.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.116+0000 7fbe5b7fe700 1 -- 172.21.15.36:0/3461300600 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5400b990 con 0x7fbe5c066ce0 2022-01-10T01:31:42.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.116+0000 7fbe6318d700 1 -- 172.21.15.36:0/3461300600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe5c066ce0 msgr2=0x7fbe5c065df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.116+0000 7fbe6318d700 1 --2- 172.21.15.36:0/3461300600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe5c066ce0 0x7fbe5c065df0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fbe540032f0 tx=0x7fbe540091d0).stop 2022-01-10T01:31:42.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.116+0000 7fbe6318d700 1 -- 172.21.15.36:0/3461300600 shutdown_connections 2022-01-10T01:31:42.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.116+0000 7fbe6318d700 1 --2- 172.21.15.36:0/3461300600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe5c066ce0 0x7fbe5c065df0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.116+0000 7fbe6318d700 1 --2- 172.21.15.36:0/3461300600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe5c060100 0x7fbe5c061650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.116+0000 7fbe6318d700 1 -- 172.21.15.36:0/3461300600 >> 172.21.15.36:0/3461300600 conn(0x7fbe5c05cf30 msgr2=0x7fbe5c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:42.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.116+0000 7fbe6318d700 1 -- 172.21.15.36:0/3461300600 shutdown_connections 2022-01-10T01:31:42.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.116+0000 7fbe6318d700 1 -- 172.21.15.36:0/3461300600 wait complete. 2022-01-10T01:31:42.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.116+0000 7fbe6318d700 1 Processor -- start 2022-01-10T01:31:42.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.116+0000 7fbe6318d700 1 -- start start 2022-01-10T01:31:42.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6318d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe5c060100 0x7fbe5c147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6318d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe5c065970 0x7fbe5c13f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6318d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe5c066ce0 0x7fbe5c13fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6318d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c0a95f0 con 0x7fbe5c066ce0 2022-01-10T01:31:42.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6318d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c0a8c10 con 0x7fbe5c065970 2022-01-10T01:31:42.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6318d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c0a8eb0 con 0x7fbe5c060100 2022-01-10T01:31:42.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6172a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe5c066ce0 0x7fbe5c13fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe5bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe5c065970 0x7fbe5c13f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe60f29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe5c060100 0x7fbe5c147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6172a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe5c066ce0 0x7fbe5c13fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39366/0 (socket says 172.21.15.36:39366) 2022-01-10T01:31:42.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6172a700 1 -- 172.21.15.36:0/3742595846 learned_addr learned my addr 172.21.15.36:0/3742595846 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:42.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6172a700 1 -- 172.21.15.36:0/3742595846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe5c060100 msgr2=0x7fbe5c147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6172a700 1 --2- 172.21.15.36:0/3742595846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe5c060100 0x7fbe5c147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6172a700 1 -- 172.21.15.36:0/3742595846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe5c065970 msgr2=0x7fbe5c13f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6172a700 1 --2- 172.21.15.36:0/3742595846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe5c065970 0x7fbe5c13f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6172a700 1 -- 172.21.15.36:0/3742595846 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5000b180 con 0x7fbe5c066ce0 2022-01-10T01:31:42.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe60f29700 1 --2- 172.21.15.36:0/3742595846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe5c060100 0x7fbe5c147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:42.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe5bfff700 1 --2- 172.21.15.36:0/3742595846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe5c065970 0x7fbe5c13f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:42.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6172a700 1 --2- 172.21.15.36:0/3742595846 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe5c066ce0 0x7fbe5c13fd30 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7fbe540032f0 tx=0x7fbe54016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:42.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe59ffb700 1 -- 172.21.15.36:0/3742595846 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5400b990 con 0x7fbe5c066ce0 2022-01-10T01:31:42.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe59ffb700 1 -- 172.21.15.36:0/3742595846 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe540205e0 con 0x7fbe5c066ce0 2022-01-10T01:31:42.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6318d700 1 -- 172.21.15.36:0/3742595846 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe54009470 con 0x7fbe5c066ce0 2022-01-10T01:31:42.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe59ffb700 1 -- 172.21.15.36:0/3742595846 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5400b6c0 con 0x7fbe5c066ce0 2022-01-10T01:31:42.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.120+0000 7fbe6318d700 1 -- 172.21.15.36:0/3742595846 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c0a4280 con 0x7fbe5c066ce0 2022-01-10T01:31:42.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.124+0000 7fbe6318d700 1 -- 172.21.15.36:0/3742595846 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c0611b0 con 0x7fbe5c066ce0 2022-01-10T01:31:42.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.124+0000 7fbe59ffb700 1 -- 172.21.15.36:0/3742595846 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbe5401e070 con 0x7fbe5c066ce0 2022-01-10T01:31:42.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.124+0000 7fbe59ffb700 1 --2- 172.21.15.36:0/3742595846 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe3c053680 0x7fbe3c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.124+0000 7fbe59ffb700 1 -- 172.21.15.36:0/3742595846 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6304+0+0 (secure 0 0 0) 0x7fbe5406cf60 con 0x7fbe5c066ce0 2022-01-10T01:31:42.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.124+0000 7fbe60f29700 1 --2- 172.21.15.36:0/3742595846 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe3c053680 0x7fbe3c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.124+0000 7fbe60f29700 1 --2- 172.21.15.36:0/3742595846 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe3c053680 0x7fbe3c055b40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fbe5000b000 tx=0x7fbe50006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:42.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.132+0000 7fbe59ffb700 1 -- 172.21.15.36:0/3742595846 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbe54043ee0 con 0x7fbe5c066ce0 2022-01-10T01:31:42.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.296+0000 7fbe6318d700 1 -- 172.21.15.36:0/3742595846 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fbe5c057350 con 0x7fbe5c066ce0 2022-01-10T01:31:42.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.312+0000 7fbe59ffb700 1 -- 172.21.15.36:0/3742595846 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 17 and data pool 18 v45) v1 ==== 189+0+0 (secure 0 0 0) 0x7fbe5402e020 con 0x7fbe5c066ce0 2022-01-10T01:31:42.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.316+0000 7fbe6318d700 1 -- 172.21.15.36:0/3742595846 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe3c053680 msgr2=0x7fbe3c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.316+0000 7fbe6318d700 1 --2- 172.21.15.36:0/3742595846 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe3c053680 0x7fbe3c055b40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7fbe5000b000 tx=0x7fbe50006df0).stop 2022-01-10T01:31:42.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.316+0000 7fbe6318d700 1 -- 172.21.15.36:0/3742595846 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe5c066ce0 msgr2=0x7fbe5c13fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.316+0000 7fbe6318d700 1 --2- 172.21.15.36:0/3742595846 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe5c066ce0 0x7fbe5c13fd30 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7fbe540032f0 tx=0x7fbe54016000).stop 2022-01-10T01:31:42.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.316+0000 7fbe6318d700 1 -- 172.21.15.36:0/3742595846 shutdown_connections 2022-01-10T01:31:42.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.316+0000 7fbe6318d700 1 --2- 172.21.15.36:0/3742595846 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe3c053680 0x7fbe3c055b40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.316+0000 7fbe6318d700 1 --2- 172.21.15.36:0/3742595846 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe5c066ce0 0x7fbe5c13fd30 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.316+0000 7fbe6318d700 1 --2- 172.21.15.36:0/3742595846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe5c065970 0x7fbe5c13f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.316+0000 7fbe6318d700 1 --2- 172.21.15.36:0/3742595846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe5c060100 0x7fbe5c147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.316+0000 7fbe6318d700 1 -- 172.21.15.36:0/3742595846 >> 172.21.15.36:0/3742595846 conn(0x7fbe5c05cf30 msgr2=0x7fbe5c0b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:42.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.316+0000 7fbe6318d700 1 -- 172.21.15.36:0/3742595846 shutdown_connections 2022-01-10T01:31:42.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.316+0000 7fbe6318d700 1 -- 172.21.15.36:0/3742595846 wait complete. 2022-01-10T01:31:42.325 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 17 and data pool 18 2022-01-10T01:31:42.338 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:31:42.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.424+0000 7fe848ed8700 1 Processor -- start 2022-01-10T01:31:42.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.424+0000 7fe848ed8700 1 -- start start 2022-01-10T01:31:42.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe848ed8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe8440b02e0 0x7fe84414b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe848ed8700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8440add80 con 0x7fe8440b1260 2022-01-10T01:31:42.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe848ed8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8440ae020 con 0x7fe8440b2580 2022-01-10T01:31:42.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe848ed8700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8440a9390 con 0x7fe8440b02e0 2022-01-10T01:31:42.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe83bfff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe8440b1260 0x7fe8440afbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37172/0 (socket says 172.21.15.36:37172) 2022-01-10T01:31:42.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe83bfff700 1 -- 172.21.15.36:0/4200944325 learned_addr learned my addr 172.21.15.36:0/4200944325 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:42.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe843fff700 1 --2- 172.21.15.36:0/4200944325 >> v2:172.21.15.36:3300/0 conn(0x7fe8440b02e0 0x7fe84414b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 -- 172.21.15.36:0/4200944325 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7945407 0 0) 0x7fe8440add80 con 0x7fe8440b1260 2022-01-10T01:31:42.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 -- 172.21.15.36:0/4200944325 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe824003260 con 0x7fe8440b1260 2022-01-10T01:31:42.441 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 -- 172.21.15.36:0/4200944325 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1807578153 0 0) 0x7fe824003260 con 0x7fe8440b1260 2022-01-10T01:31:42.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 -- 172.21.15.36:0/4200944325 >> v2:172.21.15.36:3300/0 conn(0x7fe8440b02e0 msgr2=0x7fe84414b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:42.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 --2- 172.21.15.36:0/4200944325 >> v2:172.21.15.36:3300/0 conn(0x7fe8440b02e0 0x7fe84414b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 -- 172.21.15.36:0/4200944325 >> v1:172.21.15.59:6789/0 conn(0x7fe8440b2580 legacy=0x7fe8440abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 -- 172.21.15.36:0/4200944325 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8440a9830 con 0x7fe8440b1260 2022-01-10T01:31:42.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 -- 172.21.15.36:0/4200944325 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fe82c001660 con 0x7fe8440b1260 2022-01-10T01:31:42.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 -- 172.21.15.36:0/4200944325 >> v1:172.21.15.36:6789/0 conn(0x7fe8440b1260 legacy=0x7fe8440afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 --2- 172.21.15.36:0/4200944325 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe824003750 0x7fe824003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 --2- 172.21.15.36:0/4200944325 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8240040b0 0x7fe824004560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 --2- 172.21.15.36:0/4200944325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe824004d10 0x7fe82400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 -- 172.21.15.36:0/4200944325 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440a9390 con 0x7fe824003750 2022-01-10T01:31:42.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 -- 172.21.15.36:0/4200944325 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82400bc40 con 0x7fe824004d10 2022-01-10T01:31:42.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 -- 172.21.15.36:0/4200944325 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82400bdb0 con 0x7fe8240040b0 2022-01-10T01:31:42.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe8437fe700 1 --2- 172.21.15.36:0/4200944325 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe824003750 0x7fe824003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe843fff700 1 --2- 172.21.15.36:0/4200944325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe824004d10 0x7fe82400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe8437fe700 1 -- 172.21.15.36:0/4200944325 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8240040b0 msgr2=0x7fe824004560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:42.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe8437fe700 1 --2- 172.21.15.36:0/4200944325 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8240040b0 0x7fe824004560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-01-10T01:31:42.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe8437fe700 1 -- 172.21.15.36:0/4200944325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe824004d10 msgr2=0x7fe82400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:42.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe8437fe700 1 --2- 172.21.15.36:0/4200944325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe824004d10 0x7fe82400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe8437fe700 1 -- 172.21.15.36:0/4200944325 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe824003260 con 0x7fe824003750 2022-01-10T01:31:42.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe843fff700 1 --2- 172.21.15.36:0/4200944325 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe824004d10 0x7fe82400b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:31:42.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe843fff700 1 -- 172.21.15.36:0/4200944325 reap_dead start 2022-01-10T01:31:42.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe8437fe700 1 --2- 172.21.15.36:0/4200944325 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe824003750 0x7fe824003b30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fe834001020 tx=0x7fe8340079e0).ready entity=mon.0 client_cookie=5983d4fc561a28e8 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:42.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 -- 172.21.15.36:0/4200944325 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe834007cf0 con 0x7fe824003750 2022-01-10T01:31:42.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 -- 172.21.15.36:0/4200944325 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe834007030 con 0x7fe824003750 2022-01-10T01:31:42.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe842ffd700 1 -- 172.21.15.36:0/4200944325 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe834007390 con 0x7fe824003750 2022-01-10T01:31:42.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe848ed8700 1 -- 172.21.15.36:0/4200944325 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe824003750 msgr2=0x7fe824003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe848ed8700 1 --2- 172.21.15.36:0/4200944325 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe824003750 0x7fe824003b30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7fe834001020 tx=0x7fe8340079e0).stop 2022-01-10T01:31:42.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe848ed8700 1 -- 172.21.15.36:0/4200944325 shutdown_connections 2022-01-10T01:31:42.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe848ed8700 1 --2- 172.21.15.36:0/4200944325 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe824003750 0x7fe824003b30 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe848ed8700 1 -- 172.21.15.36:0/4200944325 >> 172.21.15.36:0/4200944325 conn(0x7fe844060180 msgr2=0x7fe8440b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:42.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe848ed8700 1 -- 172.21.15.36:0/4200944325 shutdown_connections 2022-01-10T01:31:42.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.428+0000 7fe848ed8700 1 -- 172.21.15.36:0/4200944325 wait complete. 2022-01-10T01:31:42.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.432+0000 7fe848ed8700 1 Processor -- start 2022-01-10T01:31:42.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.432+0000 7fe848ed8700 1 -- start start 2022-01-10T01:31:42.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.432+0000 7fe848ed8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe824003750 0x7fe844066bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.432+0000 7fe848ed8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8440aa500 0x7fe8440aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.432+0000 7fe848ed8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe844132310 0x7fe844132790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.432+0000 7fe848ed8700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844065ad0 con 0x7fe844132310 2022-01-10T01:31:42.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.432+0000 7fe848ed8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844063000 con 0x7fe8440aa500 2022-01-10T01:31:42.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.432+0000 7fe848ed8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8440abb10 con 0x7fe824003750 2022-01-10T01:31:42.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe843fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe844132310 0x7fe844132790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe83bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8440aa500 0x7fe8440aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe843fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe844132310 0x7fe844132790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39394/0 (socket says 172.21.15.36:39394) 2022-01-10T01:31:42.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe843fff700 1 -- 172.21.15.36:0/2512939851 learned_addr learned my addr 172.21.15.36:0/2512939851 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:42.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe8437fe700 1 --2- 172.21.15.36:0/2512939851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe824003750 0x7fe844066bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe843fff700 1 -- 172.21.15.36:0/2512939851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe824003750 msgr2=0x7fe844066bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe843fff700 1 --2- 172.21.15.36:0/2512939851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe824003750 0x7fe844066bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe843fff700 1 -- 172.21.15.36:0/2512939851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8440aa500 msgr2=0x7fe8440aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe843fff700 1 --2- 172.21.15.36:0/2512939851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8440aa500 0x7fe8440aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe843fff700 1 -- 172.21.15.36:0/2512939851 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe844063230 con 0x7fe844132310 2022-01-10T01:31:42.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe83bfff700 1 --2- 172.21.15.36:0/2512939851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8440aa500 0x7fe8440aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:42.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe843fff700 1 --2- 172.21.15.36:0/2512939851 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe844132310 0x7fe844132790 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fe83c00b000 tx=0x7fe83c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:42.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe8417fa700 1 -- 172.21.15.36:0/2512939851 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe83c0127a0 con 0x7fe844132310 2022-01-10T01:31:42.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe8417fa700 1 -- 172.21.15.36:0/2512939851 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c012900 con 0x7fe844132310 2022-01-10T01:31:42.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe848ed8700 1 -- 172.21.15.36:0/2512939851 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8440ac1b0 con 0x7fe844132310 2022-01-10T01:31:42.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe8417fa700 1 -- 172.21.15.36:0/2512939851 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe83c012c60 con 0x7fe844132310 2022-01-10T01:31:42.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe848ed8700 1 -- 172.21.15.36:0/2512939851 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8440ab550 con 0x7fe844132310 2022-01-10T01:31:42.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.436+0000 7fe848ed8700 1 -- 172.21.15.36:0/2512939851 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8440aaff0 con 0x7fe844132310 2022-01-10T01:31:42.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.440+0000 7fe8417fa700 1 -- 172.21.15.36:0/2512939851 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe83c01c030 con 0x7fe844132310 2022-01-10T01:31:42.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.440+0000 7fe8417fa700 1 --2- 172.21.15.36:0/2512939851 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe828053500 0x7fe8280559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.440+0000 7fe8417fa700 1 -- 172.21.15.36:0/2512939851 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe83c06bc60 con 0x7fe844132310 2022-01-10T01:31:42.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.440+0000 7fe8437fe700 1 --2- 172.21.15.36:0/2512939851 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe828053500 0x7fe8280559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.440+0000 7fe8437fe700 1 --2- 172.21.15.36:0/2512939851 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe828053500 0x7fe8280559c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fe83401b000 tx=0x7fe834015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:42.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.448+0000 7fe8417fa700 1 -- 172.21.15.36:0/2512939851 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe83c042b60 con 0x7fe844132310 2022-01-10T01:31:42.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.576+0000 7fe848ed8700 1 -- 172.21.15.36:0/2512939851 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe844057350 con 0x7fe844132310 2022-01-10T01:31:42.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.576+0000 7fe8417fa700 1 -- 172.21.15.36:0/2512939851 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+16287 (secure 0 0 0) 0x7fe83c046180 con 0x7fe844132310 2022-01-10T01:31:42.583 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:42.583 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":99,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:31:42.304673+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:31:40.098588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2022-01-10T01:31:41.321500+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:31:42.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.580+0000 7fe848ed8700 1 -- 172.21.15.36:0/2512939851 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe828053500 msgr2=0x7fe8280559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.580+0000 7fe848ed8700 1 --2- 172.21.15.36:0/2512939851 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe828053500 0x7fe8280559c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7fe83401b000 tx=0x7fe834015000).stop 2022-01-10T01:31:42.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.580+0000 7fe848ed8700 1 -- 172.21.15.36:0/2512939851 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe844132310 msgr2=0x7fe844132790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.580+0000 7fe848ed8700 1 --2- 172.21.15.36:0/2512939851 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe844132310 0x7fe844132790 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7fe83c00b000 tx=0x7fe83c008040).stop 2022-01-10T01:31:42.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.580+0000 7fe848ed8700 1 -- 172.21.15.36:0/2512939851 shutdown_connections 2022-01-10T01:31:42.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.580+0000 7fe848ed8700 1 --2- 172.21.15.36:0/2512939851 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe828053500 0x7fe8280559c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.580+0000 7fe848ed8700 1 --2- 172.21.15.36:0/2512939851 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe844132310 0x7fe844132790 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.580+0000 7fe848ed8700 1 --2- 172.21.15.36:0/2512939851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8440aa500 0x7fe8440aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.580+0000 7fe848ed8700 1 --2- 172.21.15.36:0/2512939851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe824003750 0x7fe844066bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.580+0000 7fe848ed8700 1 -- 172.21.15.36:0/2512939851 >> 172.21.15.36:0/2512939851 conn(0x7fe844060180 msgr2=0x7fe8440b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:42.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.580+0000 7fe848ed8700 1 -- 172.21.15.36:0/2512939851 shutdown_connections 2022-01-10T01:31:42.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.580+0000 7fe848ed8700 1 -- 172.21.15.36:0/2512939851 wait complete. 2022-01-10T01:31:42.602 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:31:42.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f54418af700 1 Processor -- start 2022-01-10T01:31:42.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f54418af700 1 -- start start 2022-01-10T01:31:42.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f54418af700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f543c0b2580 0x7f543c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f54418af700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c0a70c0 con 0x7f543c0a8ac0 2022-01-10T01:31:42.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f54418af700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c0a72f0 con 0x7f543c0b0010 2022-01-10T01:31:42.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f54418af700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c0a7590 con 0x7f543c0b2580 2022-01-10T01:31:42.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f54408ad700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f543c0b2580 0x7f543c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f54410ae700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f543c0a8ac0 0x7f543c151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37196/0 (socket says 172.21.15.36:37196) 2022-01-10T01:31:42.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f54410ae700 1 -- 172.21.15.36:0/3541864311 learned_addr learned my addr 172.21.15.36:0/3541864311 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:42.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f54408ad700 1 -- 172.21.15.36:0/3541864311 >> v1:172.21.15.59:6789/0 conn(0x7f543c0b0010 legacy=0x7f543c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f54408ad700 1 -- 172.21.15.36:0/3541864311 >> v1:172.21.15.36:6789/0 conn(0x7f543c0a8ac0 legacy=0x7f543c151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f54408ad700 1 -- 172.21.15.36:0/3541864311 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c0a7830 con 0x7f543c0b2580 2022-01-10T01:31:42.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f54408ad700 1 --2- 172.21.15.36:0/3541864311 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f543c0b2580 0x7f543c14ae40 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f5430002f70 tx=0x7f5430006df0).ready entity=mon.0 client_cookie=4dafec127aa90b22 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:42.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f543b7fe700 1 -- 172.21.15.36:0/3541864311 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f543000d610 con 0x7f543c0b2580 2022-01-10T01:31:42.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f543b7fe700 1 -- 172.21.15.36:0/3541864311 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5430000e90 con 0x7f543c0b2580 2022-01-10T01:31:42.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.700+0000 7f543b7fe700 1 -- 172.21.15.36:0/3541864311 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f543000d960 con 0x7f543c0b2580 2022-01-10T01:31:42.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 -- 172.21.15.36:0/3541864311 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f543c0b2580 msgr2=0x7f543c14ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 --2- 172.21.15.36:0/3541864311 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f543c0b2580 0x7f543c14ae40 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f5430002f70 tx=0x7f5430006df0).stop 2022-01-10T01:31:42.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 -- 172.21.15.36:0/3541864311 shutdown_connections 2022-01-10T01:31:42.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 --2- 172.21.15.36:0/3541864311 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f543c0b2580 0x7f543c14ae40 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 -- 172.21.15.36:0/3541864311 >> 172.21.15.36:0/3541864311 conn(0x7f543c060180 msgr2=0x7f543c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:42.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 -- 172.21.15.36:0/3541864311 shutdown_connections 2022-01-10T01:31:42.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 -- 172.21.15.36:0/3541864311 wait complete. 2022-01-10T01:31:42.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 Processor -- start 2022-01-10T01:31:42.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 -- start start 2022-01-10T01:31:42.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f543c0a8ac0 0x7f543c066050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f543c0b0010 0x7f543c157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f543c0b2580 0x7f543c159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c0649e0 con 0x7f543c0a8ac0 2022-01-10T01:31:42.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c066540 con 0x7f543c0b2580 2022-01-10T01:31:42.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.704+0000 7f54418af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c066770 con 0x7f543c0b0010 2022-01-10T01:31:42.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f54408ad700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f543c0a8ac0 0x7f543c066050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f54408ad700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f543c0a8ac0 0x7f543c066050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39404/0 (socket says 172.21.15.36:39404) 2022-01-10T01:31:42.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f54408ad700 1 -- 172.21.15.36:0/1277768048 learned_addr learned my addr 172.21.15.36:0/1277768048 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:42.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f54410ae700 1 --2- 172.21.15.36:0/1277768048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f543c0b2580 0x7f543c159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f543bfff700 1 --2- 172.21.15.36:0/1277768048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f543c0b0010 0x7f543c157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f54408ad700 1 -- 172.21.15.36:0/1277768048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f543c0b0010 msgr2=0x7f543c157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f54408ad700 1 --2- 172.21.15.36:0/1277768048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f543c0b0010 0x7f543c157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f54408ad700 1 -- 172.21.15.36:0/1277768048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f543c0b2580 msgr2=0x7f543c159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f54408ad700 1 --2- 172.21.15.36:0/1277768048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f543c0b2580 0x7f543c159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f54408ad700 1 -- 172.21.15.36:0/1277768048 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543000b180 con 0x7f543c0a8ac0 2022-01-10T01:31:42.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f54408ad700 1 --2- 172.21.15.36:0/1277768048 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f543c0a8ac0 0x7f543c066050 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f5430002f70 tx=0x7f5430015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:42.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f5439ffb700 1 -- 172.21.15.36:0/1277768048 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f543000de70 con 0x7f543c0a8ac0 2022-01-10T01:31:42.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f5439ffb700 1 -- 172.21.15.36:0/1277768048 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5430011b40 con 0x7f543c0a8ac0 2022-01-10T01:31:42.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f54418af700 1 -- 172.21.15.36:0/1277768048 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c066a10 con 0x7f543c0a8ac0 2022-01-10T01:31:42.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f5439ffb700 1 -- 172.21.15.36:0/1277768048 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5430011ea0 con 0x7f543c0a8ac0 2022-01-10T01:31:42.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f54418af700 1 -- 172.21.15.36:0/1277768048 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c157620 con 0x7f543c0a8ac0 2022-01-10T01:31:42.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f54418af700 1 -- 172.21.15.36:0/1277768048 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c057350 con 0x7f543c0a8ac0 2022-01-10T01:31:42.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.708+0000 7f5439ffb700 1 -- 172.21.15.36:0/1277768048 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5430025030 con 0x7f543c0a8ac0 2022-01-10T01:31:42.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.712+0000 7f5439ffb700 1 --2- 172.21.15.36:0/1277768048 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f541c0536b0 0x7f541c055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.712+0000 7f5439ffb700 1 -- 172.21.15.36:0/1277768048 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f543006cee0 con 0x7f543c0a8ac0 2022-01-10T01:31:42.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.712+0000 7f543bfff700 1 --2- 172.21.15.36:0/1277768048 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f541c0536b0 0x7f541c055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.712+0000 7f543bfff700 1 --2- 172.21.15.36:0/1277768048 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f541c0536b0 0x7f541c055b70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f542800d000 tx=0x7f5428000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:42.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.716+0000 7f5439ffb700 1 -- 172.21.15.36:0/1277768048 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5430043de0 con 0x7f543c0a8ac0 2022-01-10T01:31:42.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.840+0000 7f54418af700 1 -- 172.21.15.36:0/1277768048 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f543c0af240 con 0x7f543c0a8ac0 2022-01-10T01:31:42.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.844+0000 7f5439ffb700 1 -- 172.21.15.36:0/1277768048 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f5430023020 con 0x7f543c0a8ac0 2022-01-10T01:31:42.849 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:42.849 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":99,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:31:42.304673+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:31:40.098588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2022-01-10T01:31:41.321500+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:31:42.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.844+0000 7f54418af700 1 -- 172.21.15.36:0/1277768048 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f541c0536b0 msgr2=0x7f541c055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.844+0000 7f54418af700 1 --2- 172.21.15.36:0/1277768048 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f541c0536b0 0x7f541c055b70 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f542800d000 tx=0x7f5428000bc0).stop 2022-01-10T01:31:42.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.844+0000 7f54418af700 1 -- 172.21.15.36:0/1277768048 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f543c0a8ac0 msgr2=0x7f543c066050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.844+0000 7f54418af700 1 --2- 172.21.15.36:0/1277768048 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f543c0a8ac0 0x7f543c066050 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f5430002f70 tx=0x7f5430015000).stop 2022-01-10T01:31:42.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.844+0000 7f54418af700 1 -- 172.21.15.36:0/1277768048 shutdown_connections 2022-01-10T01:31:42.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.844+0000 7f54418af700 1 --2- 172.21.15.36:0/1277768048 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f541c0536b0 0x7f541c055b70 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.844+0000 7f54418af700 1 --2- 172.21.15.36:0/1277768048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f543c0b2580 0x7f543c159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.844+0000 7f54418af700 1 --2- 172.21.15.36:0/1277768048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f543c0b0010 0x7f543c157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.844+0000 7f54418af700 1 --2- 172.21.15.36:0/1277768048 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f543c0a8ac0 0x7f543c066050 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.844+0000 7f54418af700 1 -- 172.21.15.36:0/1277768048 >> 172.21.15.36:0/1277768048 conn(0x7f543c060180 msgr2=0x7f543c067550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:42.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.844+0000 7f54418af700 1 -- 172.21.15.36:0/1277768048 shutdown_connections 2022-01-10T01:31:42.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.844+0000 7f54418af700 1 -- 172.21.15.36:0/1277768048 wait complete. 2022-01-10T01:31:42.863 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-01-10T01:31:42.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.964+0000 7fa5426b0700 1 Processor -- start 2022-01-10T01:31:42.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.964+0000 7fa5426b0700 1 -- start start 2022-01-10T01:31:42.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5426b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa53c0b7370 0x7fa53c0b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5426b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c0b3060 0x7fa53c13e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5426b0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53c0b2380 con 0x7fa53c13e710 2022-01-10T01:31:42.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5426b0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa53c144250 con 0x7fa53c0b7370 2022-01-10T01:31:42.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5426b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0b3570 con 0x7fa53c0b3060 2022-01-10T01:31:42.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5416ae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa53c0b7370 0x7fa53c0b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa540ead700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c0b3060 0x7fa53c13e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa540ead700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c0b3060 0x7fa53c13e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:45694/0 (socket says 172.21.15.36:45694) 2022-01-10T01:31:42.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa540ead700 1 -- 172.21.15.36:0/4073741639 learned_addr learned my addr 172.21.15.36:0/4073741639 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:42.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa527fff700 1 -- 172.21.15.36:0/4073741639 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215979613 0 0) 0x7fa53c0b2380 con 0x7fa53c13e710 2022-01-10T01:31:42.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa527fff700 1 -- 172.21.15.36:0/4073741639 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa520003260 con 0x7fa53c13e710 2022-01-10T01:31:42.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa540ead700 1 -- 172.21.15.36:0/4073741639 >> v2:172.21.15.59:3300/0 conn(0x7fa53c0b7370 msgr2=0x7fa53c0b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:42.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa540ead700 1 --2- 172.21.15.36:0/4073741639 >> v2:172.21.15.59:3300/0 conn(0x7fa53c0b7370 0x7fa53c0b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa540ead700 1 -- 172.21.15.36:0/4073741639 >> v1:172.21.15.59:6789/0 conn(0x7fa53c13e710 legacy=0x7fa53c064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa540ead700 1 -- 172.21.15.36:0/4073741639 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c0b25b0 con 0x7fa53c0b3060 2022-01-10T01:31:42.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5416ae700 1 --2- 172.21.15.36:0/4073741639 >> v2:172.21.15.59:3300/0 conn(0x7fa53c0b7370 0x7fa53c0b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:42.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa540ead700 1 --2- 172.21.15.36:0/4073741639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c0b3060 0x7fa53c13e220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa530002f70 tx=0x7fa530006eb0).ready entity=mon.2 client_cookie=e3e10d7b88f7d415 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:42.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa527fff700 1 -- 172.21.15.36:0/4073741639 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa53000d5c0 con 0x7fa53c0b3060 2022-01-10T01:31:42.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa527fff700 1 -- 172.21.15.36:0/4073741639 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa530000e90 con 0x7fa53c0b3060 2022-01-10T01:31:42.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa527fff700 1 -- 172.21.15.36:0/4073741639 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa53000d950 con 0x7fa53c0b3060 2022-01-10T01:31:42.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5426b0700 1 -- 172.21.15.36:0/4073741639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c0b3060 msgr2=0x7fa53c13e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5426b0700 1 --2- 172.21.15.36:0/4073741639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c0b3060 0x7fa53c13e220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa530002f70 tx=0x7fa530006eb0).stop 2022-01-10T01:31:42.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5426b0700 1 -- 172.21.15.36:0/4073741639 shutdown_connections 2022-01-10T01:31:42.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5426b0700 1 --2- 172.21.15.36:0/4073741639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c0b3060 0x7fa53c13e220 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5426b0700 1 --2- 172.21.15.36:0/4073741639 >> v2:172.21.15.59:3300/0 conn(0x7fa53c0b7370 0x7fa53c0b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5426b0700 1 -- 172.21.15.36:0/4073741639 >> 172.21.15.36:0/4073741639 conn(0x7fa53c05f6b0 msgr2=0x7fa53c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:42.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5426b0700 1 -- 172.21.15.36:0/4073741639 shutdown_connections 2022-01-10T01:31:42.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.968+0000 7fa5426b0700 1 -- 172.21.15.36:0/4073741639 wait complete. 2022-01-10T01:31:42.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5426b0700 1 Processor -- start 2022-01-10T01:31:42.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5426b0700 1 -- start start 2022-01-10T01:31:42.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5426b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c0b3060 0x7fa53c0ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5426b0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa53c0b7370 0x7fa53c140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5426b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c13e710 0x7fa53c140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5426b0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c1414b0 con 0x7fa53c0b7370 2022-01-10T01:31:42.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5426b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c13f510 con 0x7fa53c0b3060 2022-01-10T01:31:42.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5426b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c1407e0 con 0x7fa53c13e710 2022-01-10T01:31:42.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa540ead700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa53c0b7370 0x7fa53c140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa540ead700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa53c0b7370 0x7fa53c140ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39422/0 (socket says 172.21.15.36:39422) 2022-01-10T01:31:42.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa540ead700 1 -- 172.21.15.36:0/2881574966 learned_addr learned my addr 172.21.15.36:0/2881574966 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:42.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5416ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c0b3060 0x7fa53c0ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa541eaf700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c13e710 0x7fa53c140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:42.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5416ae700 1 -- 172.21.15.36:0/2881574966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c13e710 msgr2=0x7fa53c140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5416ae700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c13e710 0x7fa53c140fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5416ae700 1 -- 172.21.15.36:0/2881574966 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa53c0b7370 msgr2=0x7fa53c140ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:42.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5416ae700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa53c0b7370 0x7fa53c140ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:42.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5416ae700 1 -- 172.21.15.36:0/2881574966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53800b120 con 0x7fa53c0b3060 2022-01-10T01:31:42.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa541eaf700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c13e710 0x7fa53c140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:42.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa540ead700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa53c0b7370 0x7fa53c140ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:42.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5416ae700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c0b3060 0x7fa53c0ac2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fa53800c000 tx=0x7fa538008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:42.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa52effd700 1 -- 172.21.15.36:0/2881574966 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa538012600 con 0x7fa53c0b3060 2022-01-10T01:31:42.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa52effd700 1 -- 172.21.15.36:0/2881574966 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa538012760 con 0x7fa53c0b3060 2022-01-10T01:31:42.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5426b0700 1 -- 172.21.15.36:0/2881574966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53000b1e0 con 0x7fa53c0b3060 2022-01-10T01:31:42.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa52effd700 1 -- 172.21.15.36:0/2881574966 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa538012ac0 con 0x7fa53c0b3060 2022-01-10T01:31:42.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.972+0000 7fa5426b0700 1 -- 172.21.15.36:0/2881574966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c140540 con 0x7fa53c0b3060 2022-01-10T01:31:42.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.976+0000 7fa5426b0700 1 -- 172.21.15.36:0/2881574966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53c1509f0 con 0x7fa53c0b3060 2022-01-10T01:31:42.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.976+0000 7fa52effd700 1 -- 172.21.15.36:0/2881574966 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa538022070 con 0x7fa53c0b3060 2022-01-10T01:31:42.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.976+0000 7fa52effd700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa518053620 0x7fa518055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:42.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.976+0000 7fa52effd700 1 -- 172.21.15.36:0/2881574966 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa53806bd40 con 0x7fa53c0b3060 2022-01-10T01:31:42.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.976+0000 7fa540ead700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa518053620 0x7fa518055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:43.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.976+0000 7fa540ead700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa518053620 0x7fa518055ae0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fa53001c000 tx=0x7fa530015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:43.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:42.988+0000 7fa52effd700 1 -- 172.21.15.36:0/2881574966 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa538042cf0 con 0x7fa53c0b3060 2022-01-10T01:31:43.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.152+0000 7fa5426b0700 1 -- 172.21.15.36:0/2881574966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa53c057350 con 0x7fa53c0b3060 2022-01-10T01:31:43.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.312+0000 7fa52effd700 1 -- 172.21.15.36:0/2881574966 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa538046310 con 0x7fa53c0b3060 2022-01-10T01:31:43.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.316+0000 7fa5426b0700 1 -- 172.21.15.36:0/2881574966 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa518053620 msgr2=0x7fa518055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:43.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.316+0000 7fa5426b0700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa518053620 0x7fa518055ae0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fa53001c000 tx=0x7fa530015000).stop 2022-01-10T01:31:43.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.316+0000 7fa5426b0700 1 -- 172.21.15.36:0/2881574966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c0b3060 msgr2=0x7fa53c0ac2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:43.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.316+0000 7fa5426b0700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c0b3060 0x7fa53c0ac2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fa53800c000 tx=0x7fa538008040).stop 2022-01-10T01:31:43.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.316+0000 7fa5426b0700 1 -- 172.21.15.36:0/2881574966 shutdown_connections 2022-01-10T01:31:43.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.316+0000 7fa5426b0700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa518053620 0x7fa518055ae0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.316+0000 7fa5426b0700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa53c13e710 0x7fa53c140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.316+0000 7fa5426b0700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa53c0b7370 0x7fa53c140ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.316+0000 7fa5426b0700 1 --2- 172.21.15.36:0/2881574966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c0b3060 0x7fa53c0ac2f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.316+0000 7fa5426b0700 1 -- 172.21.15.36:0/2881574966 >> 172.21.15.36:0/2881574966 conn(0x7fa53c05f6b0 msgr2=0x7fa53c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:43.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.316+0000 7fa5426b0700 1 -- 172.21.15.36:0/2881574966 shutdown_connections 2022-01-10T01:31:43.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.316+0000 7fa5426b0700 1 -- 172.21.15.36:0/2881574966 wait complete. 2022-01-10T01:31:43.339 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:43.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8b1ac4700 1 Processor -- start 2022-01-10T01:31:43.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8b1ac4700 1 -- start start 2022-01-10T01:31:43.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8b1ac4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe8ac0b1db0 0x7fe8ac0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:43.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8b1ac4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8ac1483a0 0x7fe8ac0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:43.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8b1ac4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac0b0350 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8b1ac4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ac0a90c0 con 0x7fe8ac0b1db0 2022-01-10T01:31:43.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8b1ac4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac0b05f0 con 0x7fe8ac1483a0 2022-01-10T01:31:43.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8ab7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe8ac0b1db0 0x7fe8ac0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:43.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8ab7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe8ac0b1db0 0x7fe8ac0b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39426/0 (socket says 172.21.15.36:39426) 2022-01-10T01:31:43.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8abfff700 1 --1- 172.21.15.36:0/305877889 >> v1:172.21.15.59:6789/0 conn(0x7fe8ac0a70c0 0x7fe8ac144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:54900/0 (socket says 172.21.15.36:54900) 2022-01-10T01:31:43.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8ab7fe700 1 -- 172.21.15.36:0/305877889 learned_addr learned my addr 172.21.15.36:0/305877889 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:43.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8aaffd700 1 --2- 172.21.15.36:0/305877889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8ac1483a0 0x7fe8ac0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:43.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8ab7fe700 1 -- 172.21.15.36:0/305877889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8ac1483a0 msgr2=0x7fe8ac0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:43.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8ab7fe700 1 --2- 172.21.15.36:0/305877889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8ac1483a0 0x7fe8ac0b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8ab7fe700 1 -- 172.21.15.36:0/305877889 >> v1:172.21.15.59:6789/0 conn(0x7fe8ac0a70c0 legacy=0x7fe8ac144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:43.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8aa7fc700 1 -- 172.21.15.36:0/305877889 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777439889 0 0) 0x7fe8ac0b0350 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8ab7fe700 1 -- 172.21.15.36:0/305877889 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac0b0890 con 0x7fe8ac0b1db0 2022-01-10T01:31:43.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.444+0000 7fe8ab7fe700 1 --2- 172.21.15.36:0/305877889 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8ac0b1db0 0x7fe8ac0b0fd0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7fe8a0002f70 tx=0x7fe8a0006eb0).ready entity=mon.0 client_cookie=5c7c1353b9c2f7bf server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:43.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.448+0000 7fe8aa7fc700 1 -- 172.21.15.36:0/305877889 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8a000d570 con 0x7fe8ac0b1db0 2022-01-10T01:31:43.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.448+0000 7fe8aa7fc700 1 -- 172.21.15.36:0/305877889 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a0000e90 con 0x7fe8ac0b1db0 2022-01-10T01:31:43.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.448+0000 7fe8aa7fc700 1 -- 172.21.15.36:0/305877889 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8a000d8c0 con 0x7fe8ac0b1db0 2022-01-10T01:31:43.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.448+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/305877889 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8ac0b1db0 msgr2=0x7fe8ac0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:43.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.448+0000 7fe8b1ac4700 1 --2- 172.21.15.36:0/305877889 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8ac0b1db0 0x7fe8ac0b0fd0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7fe8a0002f70 tx=0x7fe8a0006eb0).stop 2022-01-10T01:31:43.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.448+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/305877889 shutdown_connections 2022-01-10T01:31:43.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.448+0000 7fe8b1ac4700 1 --2- 172.21.15.36:0/305877889 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8ac1483a0 0x7fe8ac0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.448+0000 7fe8b1ac4700 1 --2- 172.21.15.36:0/305877889 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8ac0b1db0 0x7fe8ac0b0fd0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.448+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/305877889 >> 172.21.15.36:0/305877889 conn(0x7fe8ac05f6b0 msgr2=0x7fe8ac05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:43.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.448+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/305877889 shutdown_connections 2022-01-10T01:31:43.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.448+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/305877889 wait complete. 2022-01-10T01:31:43.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.448+0000 7fe8b1ac4700 1 Processor -- start 2022-01-10T01:31:43.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.448+0000 7fe8b1ac4700 1 -- start start 2022-01-10T01:31:43.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8b1ac4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8ac0a70c0 0x7fe8ac14e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:43.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8b1ac4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8ac0b1db0 0x7fe8ac13d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:43.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8b1ac4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac1483a0 0x7fe8ac156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:43.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8b1ac4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac14ee40 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8b1ac4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac159ee0 con 0x7fe8ac1483a0 2022-01-10T01:31:43.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8b1ac4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac15a180 con 0x7fe8ac0b1db0 2022-01-10T01:31:43.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8ab7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8ac0a70c0 0x7fe8ac14e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:43.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8ab7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8ac0a70c0 0x7fe8ac14e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39434/0 (socket says 172.21.15.36:39434) 2022-01-10T01:31:43.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8aaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8ac0b1db0 0x7fe8ac13d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:43.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8ab7fe700 1 -- 172.21.15.36:0/805797954 learned_addr learned my addr 172.21.15.36:0/805797954 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:43.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8abfff700 1 --2- 172.21.15.36:0/805797954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac1483a0 0x7fe8ac156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:43.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8ab7fe700 1 -- 172.21.15.36:0/805797954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8ac0b1db0 msgr2=0x7fe8ac13d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:43.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8ab7fe700 1 --2- 172.21.15.36:0/805797954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8ac0b1db0 0x7fe8ac13d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8ab7fe700 1 -- 172.21.15.36:0/805797954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac1483a0 msgr2=0x7fe8ac156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:43.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8ab7fe700 1 --2- 172.21.15.36:0/805797954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac1483a0 0x7fe8ac156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8ab7fe700 1 -- 172.21.15.36:0/805797954 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a000b1e0 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8ab7fe700 1 --2- 172.21.15.36:0/805797954 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8ac0a70c0 0x7fe8ac14e400 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7fe8a0002f70 tx=0x7fe8a0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:43.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8a8ff9700 1 -- 172.21.15.36:0/805797954 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8a0011690 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8a8ff9700 1 -- 172.21.15.36:0/805797954 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a00117f0 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8a8ff9700 1 -- 172.21.15.36:0/805797954 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8a0011b50 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/805797954 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac15a420 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/805797954 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac15ab60 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/805797954 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac13e390 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.452+0000 7fe8a8ff9700 1 -- 172.21.15.36:0/805797954 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe8a0025030 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.456+0000 7fe8a8ff9700 1 --2- 172.21.15.36:0/805797954 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe88c053620 0x7fe88c055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:43.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.456+0000 7fe8a8ff9700 1 -- 172.21.15.36:0/805797954 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe8a006cbf0 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.456+0000 7fe8aaffd700 1 --2- 172.21.15.36:0/805797954 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe88c053620 0x7fe88c055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:43.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.456+0000 7fe8aaffd700 1 --2- 172.21.15.36:0/805797954 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe88c053620 0x7fe88c055ae0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fe89c00b000 tx=0x7fe89c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:43.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.460+0000 7fe8a8ff9700 1 -- 172.21.15.36:0/805797954 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe8ac13e390 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.624+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/805797954 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8ac13e390 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.624+0000 7fe8a8ff9700 1 -- 172.21.15.36:0/805797954 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fe8ac13e390 con 0x7fe8ac0a70c0 2022-01-10T01:31:43.631 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:43.631 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":46,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6933,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4213696854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4213696854},{"type":"v1","addr":"172.21.15.59:6833","nonce":4213696854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44},{"gid":6945,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/4101368080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":4101368080},{"type":"v1","addr":"172.21.15.36:6835","nonce":4101368080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:31:42.305072+0000","modified":"2022-01-10T01:31:43.308110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6948},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6948":{"gid":6948,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/2977677722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":2977677722},{"type":"v1","addr":"172.21.15.36:6837","nonce":2977677722}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2022-01-10T01:31:43.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.628+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/805797954 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe88c053620 msgr2=0x7fe88c055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:43.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.628+0000 7fe8b1ac4700 1 --2- 172.21.15.36:0/805797954 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe88c053620 0x7fe88c055ae0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fe89c00b000 tx=0x7fe89c006df0).stop 2022-01-10T01:31:43.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.628+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/805797954 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8ac0a70c0 msgr2=0x7fe8ac14e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:43.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.628+0000 7fe8b1ac4700 1 --2- 172.21.15.36:0/805797954 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8ac0a70c0 0x7fe8ac14e400 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7fe8a0002f70 tx=0x7fe8a0015000).stop 2022-01-10T01:31:43.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.628+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/805797954 shutdown_connections 2022-01-10T01:31:43.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.628+0000 7fe8b1ac4700 1 --2- 172.21.15.36:0/805797954 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe88c053620 0x7fe88c055ae0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.628+0000 7fe8b1ac4700 1 --2- 172.21.15.36:0/805797954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8ac1483a0 0x7fe8ac156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.628+0000 7fe8b1ac4700 1 --2- 172.21.15.36:0/805797954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8ac0b1db0 0x7fe8ac13d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.628+0000 7fe8b1ac4700 1 --2- 172.21.15.36:0/805797954 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8ac0a70c0 0x7fe8ac14e400 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.628+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/805797954 >> 172.21.15.36:0/805797954 conn(0x7fe8ac05f6b0 msgr2=0x7fe8ac0aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:43.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.628+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/805797954 shutdown_connections 2022-01-10T01:31:43.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.628+0000 7fe8b1ac4700 1 -- 172.21.15.36:0/805797954 wait complete. 2022-01-10T01:31:43.637 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 46 2022-01-10T01:31:43.650 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:31:43.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.748+0000 7fbfc759e700 1 Processor -- start 2022-01-10T01:31:43.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.748+0000 7fbfc759e700 1 -- start start 2022-01-10T01:31:43.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.748+0000 7fbfc759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc80b2580 0x7fbfc814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:43.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.748+0000 7fbfc759e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbfc80b0010 0x7fbfc814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:43.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.748+0000 7fbfc759e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc80a70c0 con 0x7fbfc80afbd0 2022-01-10T01:31:43.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.748+0000 7fbfc759e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc80a72f0 con 0x7fbfc80b0010 2022-01-10T01:31:43.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.748+0000 7fbfc759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc80a7590 con 0x7fbfc80b2580 2022-01-10T01:31:43.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.748+0000 7fbfbdd9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbfc80b0010 0x7fbfc814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:43.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.748+0000 7fbfbdd9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbfc80b0010 0x7fbfc814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39440/0 (socket says 172.21.15.36:39440) 2022-01-10T01:31:43.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfbdd9b700 1 -- 172.21.15.36:0/3782158877 learned_addr learned my addr 172.21.15.36:0/3782158877 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:43.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc659c700 1 --2- 172.21.15.36:0/3782158877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc80b2580 0x7fbfc814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:43.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc5d9b700 1 -- 172.21.15.36:0/3782158877 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163739233 0 0) 0x7fbfc80a70c0 con 0x7fbfc80afbd0 2022-01-10T01:31:43.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc5d9b700 1 -- 172.21.15.36:0/3782158877 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfa8003260 con 0x7fbfc80afbd0 2022-01-10T01:31:43.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfbdd9b700 1 -- 172.21.15.36:0/3782158877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc80b2580 msgr2=0x7fbfc814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:43.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfbdd9b700 1 --2- 172.21.15.36:0/3782158877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc80b2580 0x7fbfc814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfbdd9b700 1 -- 172.21.15.36:0/3782158877 >> v1:172.21.15.59:6789/0 conn(0x7fbfc80afbd0 legacy=0x7fbfc80a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:43.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfbdd9b700 1 -- 172.21.15.36:0/3782158877 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc80a7830 con 0x7fbfc80b0010 2022-01-10T01:31:43.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc659c700 1 --2- 172.21.15.36:0/3782158877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc80b2580 0x7fbfc814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:43.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfbdd9b700 1 --2- 172.21.15.36:0/3782158877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfc80b0010 0x7fbfc814b330 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fbfb0002f70 tx=0x7fbfb0006eb0).ready entity=mon.0 client_cookie=7738a8e474d0057 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:43.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc5d9b700 1 -- 172.21.15.36:0/3782158877 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfb000d5c0 con 0x7fbfc80b0010 2022-01-10T01:31:43.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc5d9b700 1 -- 172.21.15.36:0/3782158877 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb0000e90 con 0x7fbfc80b0010 2022-01-10T01:31:43.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc5d9b700 1 -- 172.21.15.36:0/3782158877 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfb000d950 con 0x7fbfc80b0010 2022-01-10T01:31:43.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc759e700 1 -- 172.21.15.36:0/3782158877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfc80b0010 msgr2=0x7fbfc814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:43.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc759e700 1 --2- 172.21.15.36:0/3782158877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfc80b0010 0x7fbfc814b330 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7fbfb0002f70 tx=0x7fbfb0006eb0).stop 2022-01-10T01:31:43.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc759e700 1 -- 172.21.15.36:0/3782158877 shutdown_connections 2022-01-10T01:31:43.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc759e700 1 --2- 172.21.15.36:0/3782158877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfc80b0010 0x7fbfc814b330 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc759e700 1 --2- 172.21.15.36:0/3782158877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc80b2580 0x7fbfc814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc759e700 1 -- 172.21.15.36:0/3782158877 >> 172.21.15.36:0/3782158877 conn(0x7fbfc8060180 msgr2=0x7fbfc80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:43.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc759e700 1 -- 172.21.15.36:0/3782158877 shutdown_connections 2022-01-10T01:31:43.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.752+0000 7fbfc759e700 1 -- 172.21.15.36:0/3782158877 wait complete. 2022-01-10T01:31:43.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfc759e700 1 Processor -- start 2022-01-10T01:31:43.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfc759e700 1 -- start start 2022-01-10T01:31:43.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfc759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc80afbd0 0x7fbfc8143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:43.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfc759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfc80b0010 0x7fbfc8141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:43.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfc759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc80b2580 0x7fbfc8141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:43.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfc759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc814d070 con 0x7fbfc80b0010 2022-01-10T01:31:43.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfc759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc81573e0 con 0x7fbfc80afbd0 2022-01-10T01:31:43.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfc759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc8141f70 con 0x7fbfc80b2580 2022-01-10T01:31:43.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfbdd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfc80b0010 0x7fbfc8141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:43.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfbdd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfc80b0010 0x7fbfc8141590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39448/0 (socket says 172.21.15.36:39448) 2022-01-10T01:31:43.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfbdd9b700 1 -- 172.21.15.36:0/3251956428 learned_addr learned my addr 172.21.15.36:0/3251956428 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:43.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfc659c700 1 --2- 172.21.15.36:0/3251956428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc80afbd0 0x7fbfc8143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:43.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfc6d9d700 1 --2- 172.21.15.36:0/3251956428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc80b2580 0x7fbfc8141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:43.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfbdd9b700 1 -- 172.21.15.36:0/3251956428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc80b2580 msgr2=0x7fbfc8141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:43.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfbdd9b700 1 --2- 172.21.15.36:0/3251956428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc80b2580 0x7fbfc8141a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfbdd9b700 1 -- 172.21.15.36:0/3251956428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc80afbd0 msgr2=0x7fbfc8143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:43.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfbdd9b700 1 --2- 172.21.15.36:0/3251956428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc80afbd0 0x7fbfc8143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfbdd9b700 1 -- 172.21.15.36:0/3251956428 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb800b180 con 0x7fbfc80b0010 2022-01-10T01:31:43.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfbdd9b700 1 --2- 172.21.15.36:0/3251956428 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfc80b0010 0x7fbfc8141590 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fbfb0002f70 tx=0x7fbfb0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:43.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfbffff700 1 -- 172.21.15.36:0/3251956428 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfb000dea0 con 0x7fbfc80b0010 2022-01-10T01:31:43.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfbffff700 1 -- 172.21.15.36:0/3251956428 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb0011c30 con 0x7fbfc80b0010 2022-01-10T01:31:43.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfbffff700 1 -- 172.21.15.36:0/3251956428 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbfb001e460 con 0x7fbfc80b0010 2022-01-10T01:31:43.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfc759e700 1 -- 172.21.15.36:0/3251956428 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb000b1e0 con 0x7fbfc80b0010 2022-01-10T01:31:43.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.756+0000 7fbfc759e700 1 -- 172.21.15.36:0/3251956428 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc8156ea0 con 0x7fbfc80b0010 2022-01-10T01:31:43.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.760+0000 7fbfc759e700 1 -- 172.21.15.36:0/3251956428 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc8057350 con 0x7fbfc80b0010 2022-01-10T01:31:43.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.760+0000 7fbfbffff700 1 -- 172.21.15.36:0/3251956428 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbfb001a040 con 0x7fbfc80b0010 2022-01-10T01:31:43.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.760+0000 7fbfbffff700 1 --2- 172.21.15.36:0/3251956428 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbfac053680 0x7fbfac055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:43.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.760+0000 7fbfbffff700 1 -- 172.21.15.36:0/3251956428 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbfb006c9a0 con 0x7fbfc80b0010 2022-01-10T01:31:43.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.760+0000 7fbfc659c700 1 --2- 172.21.15.36:0/3251956428 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbfac053680 0x7fbfac055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:43.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.760+0000 7fbfc659c700 1 --2- 172.21.15.36:0/3251956428 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbfac053680 0x7fbfac055b40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fbfb800b000 tx=0x7fbfb8006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:43.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.764+0000 7fbfbffff700 1 -- 172.21.15.36:0/3251956428 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbfb0043a30 con 0x7fbfc80b0010 2022-01-10T01:31:43.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.888+0000 7fbfc759e700 1 -- 172.21.15.36:0/3251956428 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfc80698e0 con 0x7fbfc80b0010 2022-01-10T01:31:43.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.888+0000 7fbfbffff700 1 -- 172.21.15.36:0/3251956428 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16276 (secure 0 0 0) 0x7fbfb0023020 con 0x7fbfc80b0010 2022-01-10T01:31:43.895 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:43.895 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":100,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:31:43.308928+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:31:40.098588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2022-01-10T01:31:41.321500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:31:43.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.892+0000 7fbfc759e700 1 -- 172.21.15.36:0/3251956428 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbfac053680 msgr2=0x7fbfac055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:43.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.892+0000 7fbfc759e700 1 --2- 172.21.15.36:0/3251956428 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbfac053680 0x7fbfac055b40 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fbfb800b000 tx=0x7fbfb8006df0).stop 2022-01-10T01:31:43.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.892+0000 7fbfc759e700 1 -- 172.21.15.36:0/3251956428 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfc80b0010 msgr2=0x7fbfc8141590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:43.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.892+0000 7fbfc759e700 1 --2- 172.21.15.36:0/3251956428 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfc80b0010 0x7fbfc8141590 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7fbfb0002f70 tx=0x7fbfb0015000).stop 2022-01-10T01:31:43.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.892+0000 7fbfc759e700 1 -- 172.21.15.36:0/3251956428 shutdown_connections 2022-01-10T01:31:43.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.892+0000 7fbfc759e700 1 --2- 172.21.15.36:0/3251956428 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbfac053680 0x7fbfac055b40 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.892+0000 7fbfc759e700 1 --2- 172.21.15.36:0/3251956428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbfc80b2580 0x7fbfc8141a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.892+0000 7fbfc759e700 1 --2- 172.21.15.36:0/3251956428 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbfc80b0010 0x7fbfc8141590 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.892+0000 7fbfc759e700 1 --2- 172.21.15.36:0/3251956428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbfc80afbd0 0x7fbfc8143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:43.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.892+0000 7fbfc759e700 1 -- 172.21.15.36:0/3251956428 >> 172.21.15.36:0/3251956428 conn(0x7fbfc8060180 msgr2=0x7fbfc8144b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:43.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.892+0000 7fbfc759e700 1 -- 172.21.15.36:0/3251956428 shutdown_connections 2022-01-10T01:31:43.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:43.892+0000 7fbfc759e700 1 -- 172.21.15.36:0/3251956428 wait complete. 2022-01-10T01:31:43.908 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:31:44.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 Processor -- start 2022-01-10T01:31:44.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 -- start start 2022-01-10T01:31:44.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80ad5c0 0x7f56a8061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f56a8140440 0x7f56a81408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a80aecf0 con 0x7f56a8061320 2022-01-10T01:31:44.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a80b6f20 con 0x7f56a8140440 2022-01-10T01:31:44.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a80aef20 con 0x7f56a80ad5c0 2022-01-10T01:31:44.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56ae660700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f56a8140440 0x7f56a81408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56ae660700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f56a8140440 0x7f56a81408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39458/0 (socket says 172.21.15.36:39458) 2022-01-10T01:31:44.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56ae660700 1 -- 172.21.15.36:0/3092948020 learned_addr learned my addr 172.21.15.36:0/3092948020 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:44.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56ad65e700 1 --2- 172.21.15.36:0/3092948020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80ad5c0 0x7f56a8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56ae660700 1 -- 172.21.15.36:0/3092948020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80ad5c0 msgr2=0x7f56a8061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:44.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56ae660700 1 --2- 172.21.15.36:0/3092948020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80ad5c0 0x7f56a8061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56ae660700 1 -- 172.21.15.36:0/3092948020 >> v1:172.21.15.59:6789/0 conn(0x7f56a8061320 legacy=0x7f56a80b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56ae660700 1 -- 172.21.15.36:0/3092948020 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a80af1c0 con 0x7f56a8140440 2022-01-10T01:31:44.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56ae660700 1 --2- 172.21.15.36:0/3092948020 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56a8140440 0x7f56a81408f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f56a00032f0 tx=0x7f56a0009290).ready entity=mon.0 client_cookie=d611f84b9343d465 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:44.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56ace5d700 1 -- 172.21.15.36:0/3092948020 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56a000b8a0 con 0x7f56a8140440 2022-01-10T01:31:44.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56ace5d700 1 -- 172.21.15.36:0/3092948020 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a000ba00 con 0x7f56a8140440 2022-01-10T01:31:44.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56ace5d700 1 -- 172.21.15.36:0/3092948020 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56a000bb70 con 0x7f56a8140440 2022-01-10T01:31:44.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 -- 172.21.15.36:0/3092948020 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56a8140440 msgr2=0x7f56a81408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 --2- 172.21.15.36:0/3092948020 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56a8140440 0x7f56a81408f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f56a00032f0 tx=0x7f56a0009290).stop 2022-01-10T01:31:44.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 -- 172.21.15.36:0/3092948020 shutdown_connections 2022-01-10T01:31:44.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 --2- 172.21.15.36:0/3092948020 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56a8140440 0x7f56a81408f0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 --2- 172.21.15.36:0/3092948020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a80ad5c0 0x7f56a8061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 -- 172.21.15.36:0/3092948020 >> 172.21.15.36:0/3092948020 conn(0x7f56a8066de0 msgr2=0x7f56a80671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:44.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 -- 172.21.15.36:0/3092948020 shutdown_connections 2022-01-10T01:31:44.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.012+0000 7f56aee61700 1 -- 172.21.15.36:0/3092948020 wait complete. 2022-01-10T01:31:44.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56aee61700 1 Processor -- start 2022-01-10T01:31:44.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56aee61700 1 -- start start 2022-01-10T01:31:44.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56aee61700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a8061320 0x7f56a8141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56aee61700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56a80ad5c0 0x7f56a8145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56aee61700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a8140440 0x7f56a81458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56aee61700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a80b0160 con 0x7f56a80ad5c0 2022-01-10T01:31:44.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56aee61700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a81563c0 con 0x7f56a8140440 2022-01-10T01:31:44.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56aee61700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a8156660 con 0x7f56a8061320 2022-01-10T01:31:44.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56ad65e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56a80ad5c0 0x7f56a8145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56ad65e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56a80ad5c0 0x7f56a8145400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39460/0 (socket says 172.21.15.36:39460) 2022-01-10T01:31:44.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56ad65e700 1 -- 172.21.15.36:0/1397921977 learned_addr learned my addr 172.21.15.36:0/1397921977 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:44.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56ade5f700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a8061320 0x7f56a8141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56ae660700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a8140440 0x7f56a81458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56ad65e700 1 -- 172.21.15.36:0/1397921977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a8061320 msgr2=0x7f56a8141980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56ad65e700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a8061320 0x7f56a8141980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56ad65e700 1 -- 172.21.15.36:0/1397921977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a8140440 msgr2=0x7f56a81458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56ad65e700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a8140440 0x7f56a81458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56ad65e700 1 -- 172.21.15.36:0/1397921977 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a0009530 con 0x7f56a80ad5c0 2022-01-10T01:31:44.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56ade5f700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a8061320 0x7f56a8141980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:44.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f56ad65e700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56a80ad5c0 0x7f56a8145400 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f569800c000 tx=0x7f5698006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:44.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.016+0000 7f5696ffd700 1 -- 172.21.15.36:0/1397921977 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5698010780 con 0x7f56a80ad5c0 2022-01-10T01:31:44.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.020+0000 7f5696ffd700 1 -- 172.21.15.36:0/1397921977 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56980108e0 con 0x7f56a80ad5c0 2022-01-10T01:31:44.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.020+0000 7f56aee61700 1 -- 172.21.15.36:0/1397921977 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a80b0560 con 0x7f56a80ad5c0 2022-01-10T01:31:44.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.020+0000 7f5696ffd700 1 -- 172.21.15.36:0/1397921977 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5698010c40 con 0x7f56a80ad5c0 2022-01-10T01:31:44.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.020+0000 7f56aee61700 1 -- 172.21.15.36:0/1397921977 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a80b0a90 con 0x7f56a80ad5c0 2022-01-10T01:31:44.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.020+0000 7f5696ffd700 1 -- 172.21.15.36:0/1397921977 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f569801c460 con 0x7f56a80ad5c0 2022-01-10T01:31:44.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.020+0000 7f56aee61700 1 -- 172.21.15.36:0/1397921977 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a8156200 con 0x7f56a80ad5c0 2022-01-10T01:31:44.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.020+0000 7f5696ffd700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f56880535f0 0x7f5688055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.020+0000 7f5696ffd700 1 -- 172.21.15.36:0/1397921977 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f569806bfc0 con 0x7f56a80ad5c0 2022-01-10T01:31:44.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.020+0000 7f56ade5f700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f56880535f0 0x7f5688055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.020+0000 7f56ade5f700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f56880535f0 0x7f5688055ab0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f56a400b000 tx=0x7f56a4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:44.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.024+0000 7f5696ffd700 1 -- 172.21.15.36:0/1397921977 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5698046e60 con 0x7f56a80ad5c0 2022-01-10T01:31:44.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.192+0000 7f56aee61700 1 -- 172.21.15.36:0/1397921977 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f56a80af460 con 0x7f56a80ad5c0 2022-01-10T01:31:44.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.200+0000 7f5696ffd700 1 -- 172.21.15.36:0/1397921977 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5698042f70 con 0x7f56a80ad5c0 2022-01-10T01:31:44.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.204+0000 7f56aee61700 1 -- 172.21.15.36:0/1397921977 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f56880535f0 msgr2=0x7f5688055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.204+0000 7f56aee61700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f56880535f0 0x7f5688055ab0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f56a400b000 tx=0x7f56a4009040).stop 2022-01-10T01:31:44.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.204+0000 7f56aee61700 1 -- 172.21.15.36:0/1397921977 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56a80ad5c0 msgr2=0x7f56a8145400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.204+0000 7f56aee61700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56a80ad5c0 0x7f56a8145400 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f569800c000 tx=0x7f5698006df0).stop 2022-01-10T01:31:44.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.204+0000 7f56aee61700 1 -- 172.21.15.36:0/1397921977 shutdown_connections 2022-01-10T01:31:44.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.204+0000 7f56aee61700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f56880535f0 0x7f5688055ab0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.204+0000 7f56aee61700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56a8140440 0x7f56a81458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.204+0000 7f56aee61700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56a80ad5c0 0x7f56a8145400 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.204+0000 7f56aee61700 1 --2- 172.21.15.36:0/1397921977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56a8061320 0x7f56a8141980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.204+0000 7f56aee61700 1 -- 172.21.15.36:0/1397921977 >> 172.21.15.36:0/1397921977 conn(0x7f56a8066de0 msgr2=0x7f56a80b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:44.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.204+0000 7f56aee61700 1 -- 172.21.15.36:0/1397921977 shutdown_connections 2022-01-10T01:31:44.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.204+0000 7f56aee61700 1 -- 172.21.15.36:0/1397921977 wait complete. 2022-01-10T01:31:44.215 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.0 2022-01-10T01:31:44.224 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:31:44.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.332+0000 7f9df6f33700 1 Processor -- start 2022-01-10T01:31:44.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.332+0000 7f9df6f33700 1 -- start start 2022-01-10T01:31:44.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6f33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df00b3040 0x7f9df0065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6f33700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9df00a9c10 0x7f9df00607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6f33700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df0066ea0 con 0x7f9df0143320 2022-01-10T01:31:44.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6f33700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df00648e0 con 0x7f9df00a9c10 2022-01-10T01:31:44.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6f33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df0061dd0 con 0x7f9df00b3040 2022-01-10T01:31:44.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6732700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9df0143320 0x7f9df01437b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37266/0 (socket says 172.21.15.36:37266) 2022-01-10T01:31:44.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6732700 1 -- 172.21.15.36:0/321988823 learned_addr learned my addr 172.21.15.36:0/321988823 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:44.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df5f31700 1 --2- 172.21.15.36:0/321988823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df00b3040 0x7f9df0065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df5730700 1 --2- 172.21.15.36:0/321988823 >> v2:172.21.15.59:3300/0 conn(0x7f9df00a9c10 0x7f9df00607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df4f2f700 1 -- 172.21.15.36:0/321988823 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 173534275 0 0) 0x7f9df0066ea0 con 0x7f9df0143320 2022-01-10T01:31:44.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df4f2f700 1 -- 172.21.15.36:0/321988823 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dd8003260 con 0x7f9df0143320 2022-01-10T01:31:44.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df4f2f700 1 -- 172.21.15.36:0/321988823 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2247984017 0 0) 0x7f9dd8003260 con 0x7f9df0143320 2022-01-10T01:31:44.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df5f31700 1 -- 172.21.15.36:0/321988823 >> v2:172.21.15.59:3300/0 conn(0x7f9df00a9c10 msgr2=0x7f9df00607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:44.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df5f31700 1 --2- 172.21.15.36:0/321988823 >> v2:172.21.15.59:3300/0 conn(0x7f9df00a9c10 0x7f9df00607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df5f31700 1 -- 172.21.15.36:0/321988823 >> v1:172.21.15.36:6789/0 conn(0x7f9df0143320 legacy=0x7f9df01437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df5f31700 1 -- 172.21.15.36:0/321988823 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df00b3420 con 0x7f9df00b3040 2022-01-10T01:31:44.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df5f31700 1 --2- 172.21.15.36:0/321988823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df00b3040 0x7f9df0065e90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f9de8001b80 tx=0x7f9dec006df0).ready entity=mon.2 client_cookie=2406f992fbbb05bf server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:44.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df4f2f700 1 -- 172.21.15.36:0/321988823 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9de80019e0 con 0x7f9df00b3040 2022-01-10T01:31:44.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df4f2f700 1 -- 172.21.15.36:0/321988823 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec000e90 con 0x7f9df00b3040 2022-01-10T01:31:44.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df4f2f700 1 -- 172.21.15.36:0/321988823 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dec012460 con 0x7f9df00b3040 2022-01-10T01:31:44.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6f33700 1 -- 172.21.15.36:0/321988823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df00b3040 msgr2=0x7f9df0065e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6f33700 1 --2- 172.21.15.36:0/321988823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df00b3040 0x7f9df0065e90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f9de8001b80 tx=0x7f9dec006df0).stop 2022-01-10T01:31:44.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6f33700 1 -- 172.21.15.36:0/321988823 shutdown_connections 2022-01-10T01:31:44.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6f33700 1 --2- 172.21.15.36:0/321988823 >> v2:172.21.15.59:3300/0 conn(0x7f9df00a9c10 0x7f9df00607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6f33700 1 --2- 172.21.15.36:0/321988823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df00b3040 0x7f9df0065e90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6f33700 1 -- 172.21.15.36:0/321988823 >> 172.21.15.36:0/321988823 conn(0x7f9df00636e0 msgr2=0x7f9df0063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:44.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6f33700 1 -- 172.21.15.36:0/321988823 shutdown_connections 2022-01-10T01:31:44.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.336+0000 7f9df6f33700 1 -- 172.21.15.36:0/321988823 wait complete. 2022-01-10T01:31:44.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.340+0000 7f9df6f33700 1 Processor -- start 2022-01-10T01:31:44.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.340+0000 7f9df6f33700 1 -- start start 2022-01-10T01:31:44.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df6f33700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9df00a9c10 0x7f9df00ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df6f33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df00b3040 0x7f9df00acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df6f33700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9df0143320 0x7f9df0142760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df6f33700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df00adb10 con 0x7f9df00a9c10 2022-01-10T01:31:44.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df6f33700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df0152c50 con 0x7f9df0143320 2022-01-10T01:31:44.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df6f33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df0152ef0 con 0x7f9df00b3040 2022-01-10T01:31:44.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df5f31700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9df00a9c10 0x7f9df00ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df5f31700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9df00a9c10 0x7f9df00ae4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39474/0 (socket says 172.21.15.36:39474) 2022-01-10T01:31:44.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df5f31700 1 -- 172.21.15.36:0/2522302648 learned_addr learned my addr 172.21.15.36:0/2522302648 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:44.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df5730700 1 --2- 172.21.15.36:0/2522302648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df00b3040 0x7f9df00acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df6732700 1 --2- 172.21.15.36:0/2522302648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9df0143320 0x7f9df0142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df5f31700 1 -- 172.21.15.36:0/2522302648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df00b3040 msgr2=0x7f9df00acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df5f31700 1 --2- 172.21.15.36:0/2522302648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df00b3040 0x7f9df00acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df5f31700 1 -- 172.21.15.36:0/2522302648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9df0143320 msgr2=0x7f9df0142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df5f31700 1 --2- 172.21.15.36:0/2522302648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9df0143320 0x7f9df0142760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df5f31700 1 -- 172.21.15.36:0/2522302648 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec00b180 con 0x7f9df00a9c10 2022-01-10T01:31:44.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df5f31700 1 --2- 172.21.15.36:0/2522302648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9df00a9c10 0x7f9df00ae4b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f9de8001b80 tx=0x7f9dec014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:44.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9ddeffd700 1 -- 172.21.15.36:0/2522302648 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dec00d9a0 con 0x7f9df00a9c10 2022-01-10T01:31:44.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9ddeffd700 1 -- 172.21.15.36:0/2522302648 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec00db00 con 0x7f9df00a9c10 2022-01-10T01:31:44.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9ddeffd700 1 -- 172.21.15.36:0/2522302648 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9dec00de60 con 0x7f9df00a9c10 2022-01-10T01:31:44.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df6f33700 1 -- 172.21.15.36:0/2522302648 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df00aecd0 con 0x7f9df00a9c10 2022-01-10T01:31:44.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df6f33700 1 -- 172.21.15.36:0/2522302648 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df00ae110 con 0x7f9df00a9c10 2022-01-10T01:31:44.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9ddeffd700 1 -- 172.21.15.36:0/2522302648 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9dec01c070 con 0x7f9df00a9c10 2022-01-10T01:31:44.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.344+0000 7f9df6f33700 1 -- 172.21.15.36:0/2522302648 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df0066960 con 0x7f9df00a9c10 2022-01-10T01:31:44.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.348+0000 7f9ddeffd700 1 --2- 172.21.15.36:0/2522302648 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9dd00534d0 0x7f9dd0055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.348+0000 7f9ddeffd700 1 -- 172.21.15.36:0/2522302648 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9dec06c4f0 con 0x7f9df00a9c10 2022-01-10T01:31:44.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.348+0000 7f9df5730700 1 --2- 172.21.15.36:0/2522302648 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9dd00534d0 0x7f9dd0055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.348+0000 7f9df5730700 1 --2- 172.21.15.36:0/2522302648 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9dd00534d0 0x7f9dd0055990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f9de000b000 tx=0x7f9de0006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:44.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.352+0000 7f9ddeffd700 1 -- 172.21.15.36:0/2522302648 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9dec043430 con 0x7f9df00a9c10 2022-01-10T01:31:44.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.516+0000 7f9df6f33700 1 -- 172.21.15.36:0/2522302648 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9df0057350 con 0x7f9df00a9c10 2022-01-10T01:31:44.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.524+0000 7f9ddeffd700 1 -- 172.21.15.36:0/2522302648 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9dec0230e0 con 0x7f9df00a9c10 2022-01-10T01:31:44.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.524+0000 7f9df6f33700 1 -- 172.21.15.36:0/2522302648 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9dd00534d0 msgr2=0x7f9dd0055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.524+0000 7f9df6f33700 1 --2- 172.21.15.36:0/2522302648 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9dd00534d0 0x7f9dd0055990 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f9de000b000 tx=0x7f9de0006df0).stop 2022-01-10T01:31:44.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.524+0000 7f9df6f33700 1 -- 172.21.15.36:0/2522302648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9df00a9c10 msgr2=0x7f9df00ae4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.524+0000 7f9df6f33700 1 --2- 172.21.15.36:0/2522302648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9df00a9c10 0x7f9df00ae4b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f9de8001b80 tx=0x7f9dec014000).stop 2022-01-10T01:31:44.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.524+0000 7f9df6f33700 1 -- 172.21.15.36:0/2522302648 shutdown_connections 2022-01-10T01:31:44.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.524+0000 7f9df6f33700 1 --2- 172.21.15.36:0/2522302648 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9dd00534d0 0x7f9dd0055990 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.524+0000 7f9df6f33700 1 --2- 172.21.15.36:0/2522302648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9df0143320 0x7f9df0142760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.524+0000 7f9df6f33700 1 --2- 172.21.15.36:0/2522302648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df00b3040 0x7f9df00acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.524+0000 7f9df6f33700 1 --2- 172.21.15.36:0/2522302648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9df00a9c10 0x7f9df00ae4b0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.524+0000 7f9df6f33700 1 -- 172.21.15.36:0/2522302648 >> 172.21.15.36:0/2522302648 conn(0x7f9df00636e0 msgr2=0x7f9df0065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:44.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.528+0000 7f9df6f33700 1 -- 172.21.15.36:0/2522302648 shutdown_connections 2022-01-10T01:31:44.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.528+0000 7f9df6f33700 1 -- 172.21.15.36:0/2522302648 wait complete. 2022-01-10T01:31:44.536 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.1 2022-01-10T01:31:44.546 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:44.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd912296700 1 Processor -- start 2022-01-10T01:31:44.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd912296700 1 -- start start 2022-01-10T01:31:44.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd912296700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd90c0b0010 0x7fd90c0a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd912296700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd90c0afbd0 0x7fd90c0a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd912296700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90c0a70c0 con 0x7fd90c0b2580 2022-01-10T01:31:44.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd912296700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd90c0a72f0 con 0x7fd90c0afbd0 2022-01-10T01:31:44.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd912296700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c0a7590 con 0x7fd90c0b0010 2022-01-10T01:31:44.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd911294700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd90c0b2580 0x7fd90c14ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37276/0 (socket says 172.21.15.36:37276) 2022-01-10T01:31:44.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd911a95700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd90c0afbd0 0x7fd90c0a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd911294700 1 -- 172.21.15.36:0/2050300593 learned_addr learned my addr 172.21.15.36:0/2050300593 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:44.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd910a93700 1 --2- 172.21.15.36:0/2050300593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd90c0b0010 0x7fd90c0a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd903fff700 1 -- 172.21.15.36:0/2050300593 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428574691 0 0) 0x7fd90c0a70c0 con 0x7fd90c0b2580 2022-01-10T01:31:44.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd903fff700 1 -- 172.21.15.36:0/2050300593 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f0003260 con 0x7fd90c0b2580 2022-01-10T01:31:44.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd911a95700 1 -- 172.21.15.36:0/2050300593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd90c0b0010 msgr2=0x7fd90c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:44.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd911a95700 1 --2- 172.21.15.36:0/2050300593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd90c0b0010 0x7fd90c0a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd911a95700 1 -- 172.21.15.36:0/2050300593 >> v1:172.21.15.36:6789/0 conn(0x7fd90c0b2580 legacy=0x7fd90c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.644+0000 7fd911a95700 1 -- 172.21.15.36:0/2050300593 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c0a7830 con 0x7fd90c0afbd0 2022-01-10T01:31:44.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd911a95700 1 --2- 172.21.15.36:0/2050300593 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd90c0afbd0 0x7fd90c0a88a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7fd904002f70 tx=0x7fd904006df0).ready entity=mon.0 client_cookie=cfee193bf1c0651e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:44.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd903fff700 1 -- 172.21.15.36:0/2050300593 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd90400d4a0 con 0x7fd90c0afbd0 2022-01-10T01:31:44.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd903fff700 1 -- 172.21.15.36:0/2050300593 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd904000e90 con 0x7fd90c0afbd0 2022-01-10T01:31:44.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd903fff700 1 -- 172.21.15.36:0/2050300593 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd90400d7f0 con 0x7fd90c0afbd0 2022-01-10T01:31:44.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 -- 172.21.15.36:0/2050300593 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd90c0afbd0 msgr2=0x7fd90c0a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 --2- 172.21.15.36:0/2050300593 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd90c0afbd0 0x7fd90c0a88a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7fd904002f70 tx=0x7fd904006df0).stop 2022-01-10T01:31:44.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 -- 172.21.15.36:0/2050300593 shutdown_connections 2022-01-10T01:31:44.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 --2- 172.21.15.36:0/2050300593 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd90c0afbd0 0x7fd90c0a88a0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 --2- 172.21.15.36:0/2050300593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd90c0b0010 0x7fd90c0a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 -- 172.21.15.36:0/2050300593 >> 172.21.15.36:0/2050300593 conn(0x7fd90c060180 msgr2=0x7fd90c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:44.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 -- 172.21.15.36:0/2050300593 shutdown_connections 2022-01-10T01:31:44.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 -- 172.21.15.36:0/2050300593 wait complete. 2022-01-10T01:31:44.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 Processor -- start 2022-01-10T01:31:44.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 -- start start 2022-01-10T01:31:44.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd90c0afbd0 0x7fd90c156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd90c0b0010 0x7fd90c1421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd90c0b2580 0x7fd90c13f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c156420 con 0x7fd90c0afbd0 2022-01-10T01:31:44.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c13f900 con 0x7fd90c0b2580 2022-01-10T01:31:44.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.648+0000 7fd912296700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c156680 con 0x7fd90c0b0010 2022-01-10T01:31:44.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd911294700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd90c0afbd0 0x7fd90c156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd911294700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd90c0afbd0 0x7fd90c156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39488/0 (socket says 172.21.15.36:39488) 2022-01-10T01:31:44.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd911294700 1 -- 172.21.15.36:0/4087985785 learned_addr learned my addr 172.21.15.36:0/4087985785 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:44.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd910a93700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd90c0b0010 0x7fd90c1421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd911a95700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd90c0b2580 0x7fd90c13f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd911294700 1 -- 172.21.15.36:0/4087985785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd90c0b0010 msgr2=0x7fd90c1421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd911294700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd90c0b0010 0x7fd90c1421a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd911294700 1 -- 172.21.15.36:0/4087985785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd90c0b2580 msgr2=0x7fd90c13f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd911294700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd90c0b2580 0x7fd90c13f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd911294700 1 -- 172.21.15.36:0/4087985785 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90400b180 con 0x7fd90c0afbd0 2022-01-10T01:31:44.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd911a95700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd90c0b2580 0x7fd90c13f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:44.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd911294700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd90c0afbd0 0x7fd90c156dc0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7fd8fc001110 tx=0x7fd8fc007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:44.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd9027fc700 1 -- 172.21.15.36:0/4087985785 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8fc00ce80 con 0x7fd90c0afbd0 2022-01-10T01:31:44.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd9027fc700 1 -- 172.21.15.36:0/4087985785 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc0070d0 con 0x7fd90c0afbd0 2022-01-10T01:31:44.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd912296700 1 -- 172.21.15.36:0/4087985785 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90c156920 con 0x7fd90c0afbd0 2022-01-10T01:31:44.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd9027fc700 1 -- 172.21.15.36:0/4087985785 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8fc007430 con 0x7fd90c0afbd0 2022-01-10T01:31:44.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd912296700 1 -- 172.21.15.36:0/4087985785 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90c0ac3e0 con 0x7fd90c0afbd0 2022-01-10T01:31:44.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd9027fc700 1 -- 172.21.15.36:0/4087985785 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd8fc010070 con 0x7fd90c0afbd0 2022-01-10T01:31:44.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd912296700 1 -- 172.21.15.36:0/4087985785 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90c057350 con 0x7fd90c0afbd0 2022-01-10T01:31:44.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd9027fc700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8f40535f0 0x7fd8f4055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:44.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd910a93700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8f40535f0 0x7fd8f4055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:44.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.652+0000 7fd9027fc700 1 -- 172.21.15.36:0/4087985785 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd8fc06b020 con 0x7fd90c0afbd0 2022-01-10T01:31:44.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.656+0000 7fd910a93700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8f40535f0 0x7fd8f4055ab0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fd90800b000 tx=0x7fd9080091d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:44.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.660+0000 7fd9027fc700 1 -- 172.21.15.36:0/4087985785 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8fc042030 con 0x7fd90c0afbd0 2022-01-10T01:31:44.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.824+0000 7fd912296700 1 -- 172.21.15.36:0/4087985785 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd90c156ab0 con 0x7fd90c0afbd0 2022-01-10T01:31:44.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.824+0000 7fd9027fc700 1 -- 172.21.15.36:0/4087985785 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fd8fc045650 con 0x7fd90c0afbd0 2022-01-10T01:31:44.831 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:44.831 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":46,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6933,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4213696854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4213696854},{"type":"v1","addr":"172.21.15.59:6833","nonce":4213696854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44},{"gid":6945,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/4101368080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":4101368080},{"type":"v1","addr":"172.21.15.36:6835","nonce":4101368080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:31:42.305072+0000","modified":"2022-01-10T01:31:43.308110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6948},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6948":{"gid":6948,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/2977677722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":2977677722},{"type":"v1","addr":"172.21.15.36:6837","nonce":2977677722}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2022-01-10T01:31:44.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.828+0000 7fd912296700 1 -- 172.21.15.36:0/4087985785 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8f40535f0 msgr2=0x7fd8f4055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.828+0000 7fd912296700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8f40535f0 0x7fd8f4055ab0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7fd90800b000 tx=0x7fd9080091d0).stop 2022-01-10T01:31:44.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.828+0000 7fd912296700 1 -- 172.21.15.36:0/4087985785 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd90c0afbd0 msgr2=0x7fd90c156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:44.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.828+0000 7fd912296700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd90c0afbd0 0x7fd90c156dc0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7fd8fc001110 tx=0x7fd8fc007aa0).stop 2022-01-10T01:31:44.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.828+0000 7fd912296700 1 -- 172.21.15.36:0/4087985785 shutdown_connections 2022-01-10T01:31:44.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.828+0000 7fd912296700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8f40535f0 0x7fd8f4055ab0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.828+0000 7fd912296700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd90c0b2580 0x7fd90c13f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.828+0000 7fd912296700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd90c0b0010 0x7fd90c1421a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.828+0000 7fd912296700 1 --2- 172.21.15.36:0/4087985785 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd90c0afbd0 0x7fd90c156dc0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:44.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.828+0000 7fd912296700 1 -- 172.21.15.36:0/4087985785 >> 172.21.15.36:0/4087985785 conn(0x7fd90c060180 msgr2=0x7fd90c067380 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:44.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.828+0000 7fd912296700 1 -- 172.21.15.36:0/4087985785 shutdown_connections 2022-01-10T01:31:44.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:44.828+0000 7fd912296700 1 -- 172.21.15.36:0/4087985785 wait complete. 2022-01-10T01:31:44.836 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 46 2022-01-10T01:31:45.147 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:31:42.305072+0000', 'modified': '2022-01-10T01:31:43.308110+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6948}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6948': {'gid': 6948, 'name': 'a', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6837/2977677722', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6836', 'nonce': 2977677722}, {'type': 'v1', 'addr': '172.21.15.36:6837', 'nonce': 2977677722}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:31:45.148 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:31:45.149 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-10T01:31:45.268 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":6948,"want_state":"up:active","state":"up:active","rank_uptime":2.9495235750000002,"mdsmap_epoch":46,"osdmap_epoch":100,"osdmap_epoch_barrier":99,"uptime":7.9317843330000004} 2022-01-10T01:31:45.269 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 6948, "mdsmap_epoch": 46, "osdmap_epoch": 100, "osdmap_epoch_barrier": 99, "rank_uptime": 2.949523575, "state": "up:active", "uptime": 7.931784333, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:31:45.270 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:31:45.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 Processor -- start 2022-01-10T01:31:45.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 -- start start 2022-01-10T01:31:45.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7febd80b04a0 0x7febd80add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7febd80aa120 0x7febd80ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd80b0880 0x7febd8143710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd80b2af0 con 0x7febd80b04a0 2022-01-10T01:31:45.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd80b2770 con 0x7febd80aa120 2022-01-10T01:31:45.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd80b2d20 con 0x7febd80b0880 2022-01-10T01:31:45.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febd659c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7febd80b04a0 0x7febd80add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febd659c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7febd80b04a0 0x7febd80add30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39496/0 (socket says 172.21.15.36:39496) 2022-01-10T01:31:45.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febd659c700 1 -- 172.21.15.36:0/738476873 learned_addr learned my addr 172.21.15.36:0/738476873 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:45.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febd5d9b700 1 --2- 172.21.15.36:0/738476873 >> v2:172.21.15.59:3300/0 conn(0x7febd80aa120 0x7febd80ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febd6d9d700 1 --2- 172.21.15.36:0/738476873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd80b0880 0x7febd8143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febd659c700 1 -- 172.21.15.36:0/738476873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd80b0880 msgr2=0x7febd8143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:45.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febd659c700 1 --2- 172.21.15.36:0/738476873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd80b0880 0x7febd8143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febd659c700 1 -- 172.21.15.36:0/738476873 >> v2:172.21.15.59:3300/0 conn(0x7febd80aa120 msgr2=0x7febd80ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:45.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febd659c700 1 --2- 172.21.15.36:0/738476873 >> v2:172.21.15.59:3300/0 conn(0x7febd80aa120 0x7febd80ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febd659c700 1 -- 172.21.15.36:0/738476873 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd80a9b70 con 0x7febd80b04a0 2022-01-10T01:31:45.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febd659c700 1 --2- 172.21.15.36:0/738476873 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7febd80b04a0 0x7febd80add30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7febc8002f70 tx=0x7febc8006eb0).ready entity=mon.0 client_cookie=bf7450eddd0c005f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:45.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febd559a700 1 -- 172.21.15.36:0/738476873 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc800d570 con 0x7febd80b04a0 2022-01-10T01:31:45.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febd559a700 1 -- 172.21.15.36:0/738476873 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc8000e90 con 0x7febd80b04a0 2022-01-10T01:31:45.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febd559a700 1 -- 172.21.15.36:0/738476873 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febc800d900 con 0x7febd80b04a0 2022-01-10T01:31:45.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 -- 172.21.15.36:0/738476873 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7febd80b04a0 msgr2=0x7febd80add30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 --2- 172.21.15.36:0/738476873 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7febd80b04a0 0x7febd80add30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7febc8002f70 tx=0x7febc8006eb0).stop 2022-01-10T01:31:45.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 -- 172.21.15.36:0/738476873 shutdown_connections 2022-01-10T01:31:45.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 --2- 172.21.15.36:0/738476873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd80b0880 0x7febd8143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 --2- 172.21.15.36:0/738476873 >> v2:172.21.15.59:3300/0 conn(0x7febd80aa120 0x7febd80ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 --2- 172.21.15.36:0/738476873 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7febd80b04a0 0x7febd80add30 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 -- 172.21.15.36:0/738476873 >> 172.21.15.36:0/738476873 conn(0x7febd80607c0 msgr2=0x7febd8060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:45.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 -- 172.21.15.36:0/738476873 shutdown_connections 2022-01-10T01:31:45.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.372+0000 7febdcad6700 1 -- 172.21.15.36:0/738476873 wait complete. 2022-01-10T01:31:45.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febdcad6700 1 Processor -- start 2022-01-10T01:31:45.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febdcad6700 1 -- start start 2022-01-10T01:31:45.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febdcad6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7febd80aa120 0x7febd8066a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febdcad6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd80b04a0 0x7febd8152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febdcad6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd80b0880 0x7febd8152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febdcad6700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd80651e0 con 0x7febd80aa120 2022-01-10T01:31:45.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febdcad6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd8065410 con 0x7febd80b04a0 2022-01-10T01:31:45.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febdcad6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd80656b0 con 0x7febd80b0880 2022-01-10T01:31:45.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febd659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7febd80aa120 0x7febd8066a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febd659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7febd80aa120 0x7febd8066a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39504/0 (socket says 172.21.15.36:39504) 2022-01-10T01:31:45.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febd659c700 1 -- 172.21.15.36:0/2197119956 learned_addr learned my addr 172.21.15.36:0/2197119956 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:45.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febd5d9b700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd80b04a0 0x7febd8152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febd6d9d700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd80b0880 0x7febd8152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febd5d9b700 1 -- 172.21.15.36:0/2197119956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd80b0880 msgr2=0x7febd8152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febd5d9b700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd80b0880 0x7febd8152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febd5d9b700 1 -- 172.21.15.36:0/2197119956 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7febd80aa120 msgr2=0x7febd8066a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febd5d9b700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7febd80aa120 0x7febd8066a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febd5d9b700 1 -- 172.21.15.36:0/2197119956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc800b1e0 con 0x7febd80b04a0 2022-01-10T01:31:45.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febd659c700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7febd80aa120 0x7febd8066a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:45.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febd5d9b700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd80b04a0 0x7febd8152580 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7febcc00c000 tx=0x7febcc006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:45.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febc77fe700 1 -- 172.21.15.36:0/2197119956 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febcc011750 con 0x7febd80b04a0 2022-01-10T01:31:45.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febc77fe700 1 -- 172.21.15.36:0/2197119956 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febcc0118b0 con 0x7febd80b04a0 2022-01-10T01:31:45.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febdcad6700 1 -- 172.21.15.36:0/2197119956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd80647a0 con 0x7febd80b04a0 2022-01-10T01:31:45.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febc77fe700 1 -- 172.21.15.36:0/2197119956 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7febcc011c10 con 0x7febd80b04a0 2022-01-10T01:31:45.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.376+0000 7febdcad6700 1 -- 172.21.15.36:0/2197119956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd8152f60 con 0x7febd80b04a0 2022-01-10T01:31:45.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.380+0000 7febdcad6700 1 -- 172.21.15.36:0/2197119956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd8057350 con 0x7febd80b04a0 2022-01-10T01:31:45.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.380+0000 7febc77fe700 1 -- 172.21.15.36:0/2197119956 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7febcc011d70 con 0x7febd80b04a0 2022-01-10T01:31:45.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.380+0000 7febc77fe700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7febb40535f0 0x7febb4055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.380+0000 7febc77fe700 1 -- 172.21.15.36:0/2197119956 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7febcc06ba20 con 0x7febd80b04a0 2022-01-10T01:31:45.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.380+0000 7febd659c700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7febb40535f0 0x7febb4055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.380+0000 7febd659c700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7febb40535f0 0x7febb4055ab0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7febc801c000 tx=0x7febc8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:45.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.388+0000 7febc77fe700 1 -- 172.21.15.36:0/2197119956 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7febcc042a30 con 0x7febd80b04a0 2022-01-10T01:31:45.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.516+0000 7febdcad6700 1 -- 172.21.15.36:0/2197119956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febd8044650 con 0x7febd80b04a0 2022-01-10T01:31:45.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.520+0000 7febc77fe700 1 -- 172.21.15.36:0/2197119956 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16276 (secure 0 0 0) 0x7febcc00f240 con 0x7febd80b04a0 2022-01-10T01:31:45.525 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:45.526 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":100,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:31:43.308928+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:31:40.098588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2022-01-10T01:31:41.321500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:31:45.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.520+0000 7febdcad6700 1 -- 172.21.15.36:0/2197119956 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7febb40535f0 msgr2=0x7febb4055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.520+0000 7febdcad6700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7febb40535f0 0x7febb4055ab0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7febc801c000 tx=0x7febc8015000).stop 2022-01-10T01:31:45.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.520+0000 7febdcad6700 1 -- 172.21.15.36:0/2197119956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd80b04a0 msgr2=0x7febd8152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.520+0000 7febdcad6700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd80b04a0 0x7febd8152580 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7febcc00c000 tx=0x7febcc006df0).stop 2022-01-10T01:31:45.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.524+0000 7febdcad6700 1 -- 172.21.15.36:0/2197119956 shutdown_connections 2022-01-10T01:31:45.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.524+0000 7febdcad6700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7febb40535f0 0x7febb4055ab0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.524+0000 7febdcad6700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febd80b0880 0x7febd8152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.524+0000 7febdcad6700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febd80b04a0 0x7febd8152580 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.524+0000 7febdcad6700 1 --2- 172.21.15.36:0/2197119956 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7febd80aa120 0x7febd8066a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.524+0000 7febdcad6700 1 -- 172.21.15.36:0/2197119956 >> 172.21.15.36:0/2197119956 conn(0x7febd80607c0 msgr2=0x7febd80b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:45.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.524+0000 7febdcad6700 1 -- 172.21.15.36:0/2197119956 shutdown_connections 2022-01-10T01:31:45.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.524+0000 7febdcad6700 1 -- 172.21.15.36:0/2197119956 wait complete. 2022-01-10T01:31:45.543 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:31:40.098588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:31:41.321500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:31:45.544 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:31:45.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.644+0000 7fe4bffff700 1 Processor -- start 2022-01-10T01:31:45.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.644+0000 7fe4bffff700 1 -- start start 2022-01-10T01:31:45.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.644+0000 7fe4bffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4c0061320 0x7fe4c0061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.644+0000 7fe4bffff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c00aecf0 con 0x7fe4c00ad5c0 2022-01-10T01:31:45.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.644+0000 7fe4bffff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c00b6f20 con 0x7fe4c0140440 2022-01-10T01:31:45.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.644+0000 7fe4bffff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00aef20 con 0x7fe4c0061320 2022-01-10T01:31:45.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4be7fc700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe4c00ad5c0 0x7fe4c00b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37308/0 (socket says 172.21.15.36:37308) 2022-01-10T01:31:45.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4be7fc700 1 -- 172.21.15.36:0/2539663994 learned_addr learned my addr 172.21.15.36:0/2539663994 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:45.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4beffd700 1 --2- 172.21.15.36:0/2539663994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4c0061320 0x7fe4c0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906121688 0 0) 0x7fe4c00aecf0 con 0x7fe4c00ad5c0 2022-01-10T01:31:45.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4a4003260 con 0x7fe4c00ad5c0 2022-01-10T01:31:45.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931682532 0 0) 0x7fe4c00b6f20 con 0x7fe4c0140440 2022-01-10T01:31:45.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c00aecf0 con 0x7fe4c0140440 2022-01-10T01:31:45.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3804328412 0 0) 0x7fe4a4003260 con 0x7fe4c00ad5c0 2022-01-10T01:31:45.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4c0061320 msgr2=0x7fe4c0061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:45.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 --2- 172.21.15.36:0/2539663994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4c0061320 0x7fe4c0061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 >> v1:172.21.15.59:6789/0 conn(0x7fe4c0140440 legacy=0x7fe4c0146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c00af1c0 con 0x7fe4c00ad5c0 2022-01-10T01:31:45.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fe4b0001660 con 0x7fe4c00ad5c0 2022-01-10T01:31:45.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 >> v1:172.21.15.36:6789/0 conn(0x7fe4c00ad5c0 legacy=0x7fe4c00b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 --2- 172.21.15.36:0/2539663994 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4a4003910 0x7fe4a4003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 --2- 172.21.15.36:0/2539663994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a4004500 0x7fe4a4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 --2- 172.21.15.36:0/2539663994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4c0061320 0x7fe4a4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00aef20 con 0x7fe4a4003910 2022-01-10T01:31:45.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a400b780 con 0x7fe4a4004500 2022-01-10T01:31:45.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a400b940 con 0x7fe4c0061320 2022-01-10T01:31:45.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4beffd700 1 --2- 172.21.15.36:0/2539663994 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4a4003910 0x7fe4a4003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4be7fc700 1 --2- 172.21.15.36:0/2539663994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a4004500 0x7fe4a4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bf7fe700 1 --2- 172.21.15.36:0/2539663994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4c0061320 0x7fe4a4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4beffd700 1 -- 172.21.15.36:0/2539663994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4c0061320 msgr2=0x7fe4a4004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:45.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4beffd700 1 --2- 172.21.15.36:0/2539663994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4c0061320 0x7fe4a4004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4beffd700 1 -- 172.21.15.36:0/2539663994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a4004500 msgr2=0x7fe4a4004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:45.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4beffd700 1 --2- 172.21.15.36:0/2539663994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4a4004500 0x7fe4a4004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4beffd700 1 -- 172.21.15.36:0/2539663994 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a4003260 con 0x7fe4a4003910 2022-01-10T01:31:45.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bf7fe700 1 --2- 172.21.15.36:0/2539663994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4c0061320 0x7fe4a4004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:45.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4beffd700 1 --2- 172.21.15.36:0/2539663994 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4a4003910 0x7fe4a4003d10 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fe4b400c000 tx=0x7fe4b4006df0).ready entity=mon.0 client_cookie=90fc4f56058a511f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:45.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4b400e830 con 0x7fe4a4003910 2022-01-10T01:31:45.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b400e990 con 0x7fe4a4003910 2022-01-10T01:31:45.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bdffb700 1 -- 172.21.15.36:0/2539663994 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4b400ecf0 con 0x7fe4a4003910 2022-01-10T01:31:45.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bffff700 1 -- 172.21.15.36:0/2539663994 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4a4003910 msgr2=0x7fe4a4003d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bffff700 1 --2- 172.21.15.36:0/2539663994 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4a4003910 0x7fe4a4003d10 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7fe4b400c000 tx=0x7fe4b4006df0).stop 2022-01-10T01:31:45.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bf7fe700 1 -- 172.21.15.36:0/2539663994 reap_dead start 2022-01-10T01:31:45.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bffff700 1 -- 172.21.15.36:0/2539663994 shutdown_connections 2022-01-10T01:31:45.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bffff700 1 -- 172.21.15.36:0/2539663994 >> 172.21.15.36:0/2539663994 conn(0x7fe4c0066de0 msgr2=0x7fe4c00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:45.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bffff700 1 -- 172.21.15.36:0/2539663994 shutdown_connections 2022-01-10T01:31:45.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.648+0000 7fe4bffff700 1 -- 172.21.15.36:0/2539663994 wait complete. 2022-01-10T01:31:45.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.652+0000 7fe4bffff700 1 Processor -- start 2022-01-10T01:31:45.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.652+0000 7fe4bffff700 1 -- start start 2022-01-10T01:31:45.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.652+0000 7fe4bffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4c00b7dd0 0x7fe4c00b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.652+0000 7fe4bffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4c01527d0 0x7fe4c00b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.652+0000 7fe4bffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4c00b0f40 0x7fe4c00ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.652+0000 7fe4bffff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00b81b0 con 0x7fe4c01527d0 2022-01-10T01:31:45.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.652+0000 7fe4bffff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c0152ce0 con 0x7fe4c00b0f40 2022-01-10T01:31:45.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.652+0000 7fe4bffff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c0152f80 con 0x7fe4c00b7dd0 2022-01-10T01:31:45.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.652+0000 7fe4be7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4c01527d0 0x7fe4c00b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.652+0000 7fe4be7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4c01527d0 0x7fe4c00b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39524/0 (socket says 172.21.15.36:39524) 2022-01-10T01:31:45.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.652+0000 7fe4be7fc700 1 -- 172.21.15.36:0/2529942540 learned_addr learned my addr 172.21.15.36:0/2529942540 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:45.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.652+0000 7fe4beffd700 1 --2- 172.21.15.36:0/2529942540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4c00b7dd0 0x7fe4c00b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.652+0000 7fe4bf7fe700 1 --2- 172.21.15.36:0/2529942540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4c00b0f40 0x7fe4c00ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.656+0000 7fe4be7fc700 1 -- 172.21.15.36:0/2529942540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4c00b7dd0 msgr2=0x7fe4c00b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.656+0000 7fe4be7fc700 1 --2- 172.21.15.36:0/2529942540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4c00b7dd0 0x7fe4c00b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.656+0000 7fe4be7fc700 1 -- 172.21.15.36:0/2529942540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4c00b0f40 msgr2=0x7fe4c00ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.656+0000 7fe4be7fc700 1 --2- 172.21.15.36:0/2529942540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4c00b0f40 0x7fe4c00ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.656+0000 7fe4be7fc700 1 -- 172.21.15.36:0/2529942540 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c0153220 con 0x7fe4c01527d0 2022-01-10T01:31:45.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.656+0000 7fe4be7fc700 1 --2- 172.21.15.36:0/2529942540 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4c01527d0 0x7fe4c00b0a50 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fe4b00011d0 tx=0x7fe4c00af350).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:45.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.656+0000 7fe4affff700 1 -- 172.21.15.36:0/2529942540 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4b0011780 con 0x7fe4c01527d0 2022-01-10T01:31:45.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.656+0000 7fe4bffff700 1 -- 172.21.15.36:0/2529942540 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c00af930 con 0x7fe4c01527d0 2022-01-10T01:31:45.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.656+0000 7fe4affff700 1 -- 172.21.15.36:0/2529942540 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b00118e0 con 0x7fe4c01527d0 2022-01-10T01:31:45.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.656+0000 7fe4affff700 1 -- 172.21.15.36:0/2529942540 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4b0011c40 con 0x7fe4c01527d0 2022-01-10T01:31:45.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.656+0000 7fe4bffff700 1 -- 172.21.15.36:0/2529942540 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c0155f40 con 0x7fe4c01527d0 2022-01-10T01:31:45.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.656+0000 7fe4bffff700 1 -- 172.21.15.36:0/2529942540 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c00af460 con 0x7fe4c01527d0 2022-01-10T01:31:45.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.656+0000 7fe4affff700 1 -- 172.21.15.36:0/2529942540 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe4b001b030 con 0x7fe4c01527d0 2022-01-10T01:31:45.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.656+0000 7fe4affff700 1 --2- 172.21.15.36:0/2529942540 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe49c053680 0x7fe49c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.660+0000 7fe4affff700 1 -- 172.21.15.36:0/2529942540 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe4b006b600 con 0x7fe4c01527d0 2022-01-10T01:31:45.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.660+0000 7fe4beffd700 1 --2- 172.21.15.36:0/2529942540 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe49c053680 0x7fe49c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.660+0000 7fe4beffd700 1 --2- 172.21.15.36:0/2529942540 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe49c053680 0x7fe49c055b40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fe4b401d000 tx=0x7fe4b4019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:45.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.664+0000 7fe4affff700 1 -- 172.21.15.36:0/2529942540 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe4b0042570 con 0x7fe4c01527d0 2022-01-10T01:31:45.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.792+0000 7fe4bffff700 1 -- 172.21.15.36:0/2529942540 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe4c0057350 con 0x7fe4c01527d0 2022-01-10T01:31:45.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.792+0000 7fe4affff700 1 -- 172.21.15.36:0/2529942540 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v100) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe4b0019030 con 0x7fe4c01527d0 2022-01-10T01:31:45.800 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:31:45.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.796+0000 7fe4bffff700 1 -- 172.21.15.36:0/2529942540 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe49c053680 msgr2=0x7fe49c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.796+0000 7fe4bffff700 1 --2- 172.21.15.36:0/2529942540 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe49c053680 0x7fe49c055b40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fe4b401d000 tx=0x7fe4b4019000).stop 2022-01-10T01:31:45.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.796+0000 7fe4bffff700 1 -- 172.21.15.36:0/2529942540 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4c01527d0 msgr2=0x7fe4c00b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.796+0000 7fe4bffff700 1 --2- 172.21.15.36:0/2529942540 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4c01527d0 0x7fe4c00b0a50 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fe4b00011d0 tx=0x7fe4c00af350).stop 2022-01-10T01:31:45.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.796+0000 7fe4bffff700 1 -- 172.21.15.36:0/2529942540 shutdown_connections 2022-01-10T01:31:45.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.796+0000 7fe4bffff700 1 --2- 172.21.15.36:0/2529942540 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe49c053680 0x7fe49c055b40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.796+0000 7fe4bffff700 1 --2- 172.21.15.36:0/2529942540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4c00b0f40 0x7fe4c00ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.796+0000 7fe4bffff700 1 --2- 172.21.15.36:0/2529942540 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4c01527d0 0x7fe4c00b0a50 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.796+0000 7fe4bffff700 1 --2- 172.21.15.36:0/2529942540 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4c00b7dd0 0x7fe4c00b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.796+0000 7fe4bffff700 1 -- 172.21.15.36:0/2529942540 >> 172.21.15.36:0/2529942540 conn(0x7fe4c0066de0 msgr2=0x7fe4c0140e70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:45.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.796+0000 7fe4bffff700 1 -- 172.21.15.36:0/2529942540 shutdown_connections 2022-01-10T01:31:45.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.796+0000 7fe4bffff700 1 -- 172.21.15.36:0/2529942540 wait complete. 2022-01-10T01:31:45.813 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:31:45.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.916+0000 7f7840dab700 1 Processor -- start 2022-01-10T01:31:45.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.916+0000 7f7840dab700 1 -- start start 2022-01-10T01:31:45.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f7840dab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f783c061d20 0x7f783c1445a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f7840dab700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f783c062100 con 0x7f783c0b3ac0 2022-01-10T01:31:45.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f7840dab700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f783c144a90 con 0x7f783c0b2520 2022-01-10T01:31:45.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f7840dab700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f783c0b11e0 con 0x7f783c061d20 2022-01-10T01:31:45.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f7839d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f783c0b3ac0 0x7f783c05ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37328/0 (socket says 172.21.15.36:37328) 2022-01-10T01:31:45.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f7839d9b700 1 -- 172.21.15.36:0/3976218781 learned_addr learned my addr 172.21.15.36:0/3976218781 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:45.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783a59c700 1 --2- 172.21.15.36:0/3976218781 >> v2:172.21.15.59:3300/0 conn(0x7f783c061d20 0x7f783c1445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745921483 0 0) 0x7f783c062100 con 0x7f783c0b3ac0 2022-01-10T01:31:45.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7820003260 con 0x7f783c0b3ac0 2022-01-10T01:31:45.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596403357 0 0) 0x7f783c144a90 con 0x7f783c0b2520 2022-01-10T01:31:45.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f783c062100 con 0x7f783c0b2520 2022-01-10T01:31:45.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 127539348 0 0) 0x7f7820003260 con 0x7f783c0b3ac0 2022-01-10T01:31:45.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 >> v2:172.21.15.59:3300/0 conn(0x7f783c061d20 msgr2=0x7f783c1445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:45.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 --2- 172.21.15.36:0/3976218781 >> v2:172.21.15.59:3300/0 conn(0x7f783c061d20 0x7f783c1445a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 >> v1:172.21.15.59:6789/0 conn(0x7f783c0b2520 legacy=0x7f783c13dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c0b2ca0 con 0x7f783c0b3ac0 2022-01-10T01:31:45.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f782c001660 con 0x7f783c0b3ac0 2022-01-10T01:31:45.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 >> v1:172.21.15.36:6789/0 conn(0x7f783c0b3ac0 legacy=0x7f783c05ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 --2- 172.21.15.36:0/3976218781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78200038e0 0x7f7820003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 --2- 172.21.15.36:0/3976218781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7820004500 0x7f7820004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 --2- 172.21.15.36:0/3976218781 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7820004e70 0x7f782000fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c0b11e0 con 0x7f7820004e70 2022-01-10T01:31:45.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7820010100 con 0x7f7820004500 2022-01-10T01:31:45.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78200102c0 con 0x7f78200038e0 2022-01-10T01:31:45.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783ad9d700 1 --2- 172.21.15.36:0/3976218781 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7820004e70 0x7f782000fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f7839d9b700 1 --2- 172.21.15.36:0/3976218781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7820004500 0x7f7820004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783a59c700 1 --2- 172.21.15.36:0/3976218781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78200038e0 0x7f7820003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783ad9d700 1 -- 172.21.15.36:0/3976218781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78200038e0 msgr2=0x7f7820003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:45.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783ad9d700 1 --2- 172.21.15.36:0/3976218781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78200038e0 0x7f7820003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783ad9d700 1 -- 172.21.15.36:0/3976218781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7820004500 msgr2=0x7f7820004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:45.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783ad9d700 1 --2- 172.21.15.36:0/3976218781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7820004500 0x7f7820004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783ad9d700 1 -- 172.21.15.36:0/3976218781 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7820003260 con 0x7f7820004e70 2022-01-10T01:31:45.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783ad9d700 1 -- 172.21.15.36:0/3976218781 reap_dead start 2022-01-10T01:31:45.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783ad9d700 1 --2- 172.21.15.36:0/3976218781 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7820004e70 0x7f782000fb60 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f7834001490 tx=0x7f7834007d80).ready entity=mon.0 client_cookie=98c64b2021c5c126 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:45.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7834006890 con 0x7f7820004e70 2022-01-10T01:31:45.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78340069f0 con 0x7f7820004e70 2022-01-10T01:31:45.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.920+0000 7f783959a700 1 -- 172.21.15.36:0/3976218781 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7834006d50 con 0x7f7820004e70 2022-01-10T01:31:45.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 -- 172.21.15.36:0/3976218781 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7820004e70 msgr2=0x7f782000fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 --2- 172.21.15.36:0/3976218781 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7820004e70 0x7f782000fb60 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7f7834001490 tx=0x7f7834007d80).stop 2022-01-10T01:31:45.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 -- 172.21.15.36:0/3976218781 shutdown_connections 2022-01-10T01:31:45.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 --2- 172.21.15.36:0/3976218781 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7820004e70 0x7f782000fb60 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 -- 172.21.15.36:0/3976218781 >> 172.21.15.36:0/3976218781 conn(0x7f783c0639b0 msgr2=0x7f783c063d90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:45.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 -- 172.21.15.36:0/3976218781 shutdown_connections 2022-01-10T01:31:45.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 -- 172.21.15.36:0/3976218781 wait complete. 2022-01-10T01:31:45.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 Processor -- start 2022-01-10T01:31:45.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 -- start start 2022-01-10T01:31:45.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7820004e70 0x7f783c0b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f783c134660 0x7f783c13ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f783c14e480 0x7f783c14e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c14e090 con 0x7f783c134660 2022-01-10T01:31:45.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c136b80 con 0x7f783c14e480 2022-01-10T01:31:45.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f783c136e20 con 0x7f7820004e70 2022-01-10T01:31:45.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7839d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f783c134660 0x7f783c13ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7839d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f783c134660 0x7f783c13ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39544/0 (socket says 172.21.15.36:39544) 2022-01-10T01:31:45.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7839d9b700 1 -- 172.21.15.36:0/3916556460 learned_addr learned my addr 172.21.15.36:0/3916556460 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:45.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f783a59c700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7820004e70 0x7f783c0b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f783ad9d700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f783c14e480 0x7f783c14e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7839d9b700 1 -- 172.21.15.36:0/3916556460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7820004e70 msgr2=0x7f783c0b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7839d9b700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7820004e70 0x7f783c0b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7839d9b700 1 -- 172.21.15.36:0/3916556460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f783c14e480 msgr2=0x7f783c14e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:45.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7839d9b700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f783c14e480 0x7f783c14e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:45.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7839d9b700 1 -- 172.21.15.36:0/3916556460 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c0b5e50 con 0x7f783c134660 2022-01-10T01:31:45.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f783ad9d700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f783c14e480 0x7f783c14e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:31:45.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7839d9b700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f783c134660 0x7f783c13ced0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f782c001840 tx=0x7f783c0b2e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:45.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f782b7fe700 1 -- 172.21.15.36:0/3916556460 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f782c011850 con 0x7f783c134660 2022-01-10T01:31:45.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f782b7fe700 1 -- 172.21.15.36:0/3916556460 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782c0119b0 con 0x7f783c134660 2022-01-10T01:31:45.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 -- 172.21.15.36:0/3916556460 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783c134b70 con 0x7f783c134660 2022-01-10T01:31:45.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f782b7fe700 1 -- 172.21.15.36:0/3916556460 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f782c011d10 con 0x7f783c134660 2022-01-10T01:31:45.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.924+0000 7f7840dab700 1 -- 172.21.15.36:0/3916556460 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783c14f010 con 0x7f783c134660 2022-01-10T01:31:45.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.928+0000 7f7840dab700 1 -- 172.21.15.36:0/3916556460 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783c137020 con 0x7f783c134660 2022-01-10T01:31:45.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.928+0000 7f782b7fe700 1 -- 172.21.15.36:0/3916556460 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f782c01b030 con 0x7f783c134660 2022-01-10T01:31:45.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.928+0000 7f782b7fe700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7818053500 0x7f78180559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:45.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.928+0000 7f782b7fe700 1 -- 172.21.15.36:0/3916556460 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f782c06b450 con 0x7f783c134660 2022-01-10T01:31:45.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.928+0000 7f783a59c700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7818053500 0x7f78180559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:45.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.928+0000 7f783a59c700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7818053500 0x7f78180559c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f783000b000 tx=0x7f7830008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:45.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:45.936+0000 7f782b7fe700 1 -- 172.21.15.36:0/3916556460 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f782c068e90 con 0x7f783c134660 2022-01-10T01:31:46.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.064+0000 7f7840dab700 1 -- 172.21.15.36:0/3916556460 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f783c05f830 con 0x7f783c134660 2022-01-10T01:31:46.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.064+0000 7f782b7fe700 1 -- 172.21.15.36:0/3916556460 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v100) v1 ==== 92+0+10 (secure 0 0 0) 0x7f782c019030 con 0x7f783c134660 2022-01-10T01:31:46.072 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:46.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.068+0000 7f7840dab700 1 -- 172.21.15.36:0/3916556460 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7818053500 msgr2=0x7f78180559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.068+0000 7f7840dab700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7818053500 0x7f78180559c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f783000b000 tx=0x7f7830008040).stop 2022-01-10T01:31:46.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.068+0000 7f7840dab700 1 -- 172.21.15.36:0/3916556460 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f783c134660 msgr2=0x7f783c13ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.068+0000 7f7840dab700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f783c134660 0x7f783c13ced0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f782c001840 tx=0x7f783c0b2e30).stop 2022-01-10T01:31:46.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.068+0000 7f7840dab700 1 -- 172.21.15.36:0/3916556460 shutdown_connections 2022-01-10T01:31:46.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.068+0000 7f7840dab700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7818053500 0x7f78180559c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.068+0000 7f7840dab700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f783c14e480 0x7f783c14e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.068+0000 7f7840dab700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f783c134660 0x7f783c13ced0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.068+0000 7f7840dab700 1 --2- 172.21.15.36:0/3916556460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7820004e70 0x7f783c0b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.068+0000 7f7840dab700 1 -- 172.21.15.36:0/3916556460 >> 172.21.15.36:0/3916556460 conn(0x7f783c0639b0 msgr2=0x7f783c13dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:46.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.068+0000 7f7840dab700 1 -- 172.21.15.36:0/3916556460 shutdown_connections 2022-01-10T01:31:46.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.068+0000 7f7840dab700 1 -- 172.21.15.36:0/3916556460 wait complete. 2022-01-10T01:31:46.085 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:31:46.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0273fff700 1 Processor -- start 2022-01-10T01:31:46.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0273fff700 1 -- start start 2022-01-10T01:31:46.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0273fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02740b2580 0x7f027414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0273fff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02740a70c0 con 0x7f02740a8ac0 2022-01-10T01:31:46.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0273fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02740a72f0 con 0x7f02740b0010 2022-01-10T01:31:46.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0273fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02740a7590 con 0x7f02740b2580 2022-01-10T01:31:46.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f02737fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f02740a8ac0 0x7f0274151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37348/0 (socket says 172.21.15.36:37348) 2022-01-10T01:31:46.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f02737fe700 1 -- 172.21.15.36:0/496567168 learned_addr learned my addr 172.21.15.36:0/496567168 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:46.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0272ffd700 1 --2- 172.21.15.36:0/496567168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02740b2580 0x7f027414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 -- 172.21.15.36:0/496567168 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428757988 0 0) 0x7f02740a70c0 con 0x7f02740a8ac0 2022-01-10T01:31:46.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 -- 172.21.15.36:0/496567168 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0254003260 con 0x7f02740a8ac0 2022-01-10T01:31:46.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 -- 172.21.15.36:0/496567168 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3232825056 0 0) 0x7f0254003260 con 0x7f02740a8ac0 2022-01-10T01:31:46.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 -- 172.21.15.36:0/496567168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02740b2580 msgr2=0x7f027414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:46.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 --2- 172.21.15.36:0/496567168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02740b2580 0x7f027414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 -- 172.21.15.36:0/496567168 >> v1:172.21.15.59:6789/0 conn(0x7f02740b0010 legacy=0x7f02740a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 -- 172.21.15.36:0/496567168 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740a7830 con 0x7f02740a8ac0 2022-01-10T01:31:46.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 -- 172.21.15.36:0/496567168 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f026c0019e0 con 0x7f02740a8ac0 2022-01-10T01:31:46.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 -- 172.21.15.36:0/496567168 >> v1:172.21.15.36:6789/0 conn(0x7f02740a8ac0 legacy=0x7f0274151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 --2- 172.21.15.36:0/496567168 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0254003780 0x7f0254003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 --2- 172.21.15.36:0/496567168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0254004500 0x7f0254004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 --2- 172.21.15.36:0/496567168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02740b2580 0x7f0254004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 -- 172.21.15.36:0/496567168 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02740a7590 con 0x7f0254003780 2022-01-10T01:31:46.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 -- 172.21.15.36:0/496567168 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025400b750 con 0x7f0254004500 2022-01-10T01:31:46.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0271ffb700 1 -- 172.21.15.36:0/496567168 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025400b8c0 con 0x7f02740b2580 2022-01-10T01:31:46.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0272ffd700 1 --2- 172.21.15.36:0/496567168 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0254003780 0x7f0254003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f02727fc700 1 --2- 172.21.15.36:0/496567168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0254004500 0x7f0254004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f02737fe700 1 --2- 172.21.15.36:0/496567168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02740b2580 0x7f0254004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0272ffd700 1 -- 172.21.15.36:0/496567168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02740b2580 msgr2=0x7f0254004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:46.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0272ffd700 1 --2- 172.21.15.36:0/496567168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02740b2580 0x7f0254004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0272ffd700 1 -- 172.21.15.36:0/496567168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0254004500 msgr2=0x7f0254004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:46.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0272ffd700 1 --2- 172.21.15.36:0/496567168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0254004500 0x7f0254004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.192+0000 7f0272ffd700 1 -- 172.21.15.36:0/496567168 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0254003260 con 0x7f0254003780 2022-01-10T01:31:46.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.196+0000 7f0272ffd700 1 --2- 172.21.15.36:0/496567168 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0254003780 0x7f0254003b60 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f025c00c000 tx=0x7f025c006df0).ready entity=mon.0 client_cookie=3483c6279c7e3715 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:46.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.196+0000 7f0271ffb700 1 -- 172.21.15.36:0/496567168 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f025c00e7d0 con 0x7f0254003780 2022-01-10T01:31:46.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.196+0000 7f0271ffb700 1 -- 172.21.15.36:0/496567168 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c00e930 con 0x7f0254003780 2022-01-10T01:31:46.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.196+0000 7f0271ffb700 1 -- 172.21.15.36:0/496567168 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f025c00ec90 con 0x7f0254003780 2022-01-10T01:31:46.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.196+0000 7f0273fff700 1 -- 172.21.15.36:0/496567168 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0254003780 msgr2=0x7f0254003b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.196+0000 7f0273fff700 1 --2- 172.21.15.36:0/496567168 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0254003780 0x7f0254003b60 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f025c00c000 tx=0x7f025c006df0).stop 2022-01-10T01:31:46.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.196+0000 7f02737fe700 1 -- 172.21.15.36:0/496567168 reap_dead start 2022-01-10T01:31:46.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.196+0000 7f0273fff700 1 -- 172.21.15.36:0/496567168 shutdown_connections 2022-01-10T01:31:46.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.196+0000 7f0273fff700 1 -- 172.21.15.36:0/496567168 >> 172.21.15.36:0/496567168 conn(0x7f0274060180 msgr2=0x7f02740b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:46.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.196+0000 7f0273fff700 1 -- 172.21.15.36:0/496567168 shutdown_connections 2022-01-10T01:31:46.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.196+0000 7f0273fff700 1 -- 172.21.15.36:0/496567168 wait complete. 2022-01-10T01:31:46.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0273fff700 1 Processor -- start 2022-01-10T01:31:46.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0273fff700 1 -- start start 2022-01-10T01:31:46.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0273fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0254003780 0x7f02741486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0273fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0274148bb0 0x7f0274066870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0273fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02740b5bd0 0x7f0274066d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0272ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0254003780 0x7f02741486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0272ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0254003780 0x7f02741486c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39562/0 (socket says 172.21.15.36:39562) 2022-01-10T01:31:46.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0272ffd700 1 -- 172.21.15.36:0/933045702 learned_addr learned my addr 172.21.15.36:0/933045702 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:46.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0273fff700 1 -- 172.21.15.36:0/933045702 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02740656c0 con 0x7f0254003780 2022-01-10T01:31:46.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0273fff700 1 -- 172.21.15.36:0/933045702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0274064ce0 con 0x7f02740b5bd0 2022-01-10T01:31:46.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0273fff700 1 -- 172.21.15.36:0/933045702 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0274064f80 con 0x7f0274148bb0 2022-01-10T01:31:46.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f02727fc700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0274148bb0 0x7f0274066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f02737fe700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02740b5bd0 0x7f0274066d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0272ffd700 1 -- 172.21.15.36:0/933045702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0274148bb0 msgr2=0x7f0274066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0272ffd700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0274148bb0 0x7f0274066870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0272ffd700 1 -- 172.21.15.36:0/933045702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02740b5bd0 msgr2=0x7f0274066d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0272ffd700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02740b5bd0 0x7f0274066d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0272ffd700 1 -- 172.21.15.36:0/933045702 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0274067250 con 0x7f0254003780 2022-01-10T01:31:46.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f02737fe700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02740b5bd0 0x7f0274066d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:46.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.200+0000 7f0272ffd700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0254003780 0x7f02741486c0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f025c00c000 tx=0x7f025c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:46.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.204+0000 7f026bfff700 1 -- 172.21.15.36:0/933045702 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f025c01b820 con 0x7f0254003780 2022-01-10T01:31:46.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.204+0000 7f026bfff700 1 -- 172.21.15.36:0/933045702 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c000e90 con 0x7f0254003780 2022-01-10T01:31:46.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.204+0000 7f0273fff700 1 -- 172.21.15.36:0/933045702 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02740b4ac0 con 0x7f0254003780 2022-01-10T01:31:46.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.204+0000 7f0273fff700 1 -- 172.21.15.36:0/933045702 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02740b5960 con 0x7f0254003780 2022-01-10T01:31:46.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.204+0000 7f026bfff700 1 -- 172.21.15.36:0/933045702 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f025c01bb70 con 0x7f0254003780 2022-01-10T01:31:46.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.204+0000 7f0273fff700 1 -- 172.21.15.36:0/933045702 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0274057350 con 0x7f0254003780 2022-01-10T01:31:46.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.204+0000 7f026bfff700 1 -- 172.21.15.36:0/933045702 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f025c01bcd0 con 0x7f0254003780 2022-01-10T01:31:46.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.204+0000 7f026bfff700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02580535f0 0x7f0258055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.204+0000 7f026bfff700 1 -- 172.21.15.36:0/933045702 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f025c06cf40 con 0x7f0254003780 2022-01-10T01:31:46.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.204+0000 7f02727fc700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02580535f0 0x7f0258055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.208+0000 7f02727fc700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02580535f0 0x7f0258055ab0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f026400d000 tx=0x7f0264007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:46.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.212+0000 7f026bfff700 1 -- 172.21.15.36:0/933045702 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f025c043f00 con 0x7f0254003780 2022-01-10T01:31:46.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.336+0000 7f0273fff700 1 -- 172.21.15.36:0/933045702 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f02740698e0 con 0x7f0254003780 2022-01-10T01:31:46.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.336+0000 7f026bfff700 1 -- 172.21.15.36:0/933045702 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) v1 ==== 104+0+10 (secure 0 0 0) 0x7f025c047520 con 0x7f0254003780 2022-01-10T01:31:46.345 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:46.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.340+0000 7f0273fff700 1 -- 172.21.15.36:0/933045702 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02580535f0 msgr2=0x7f0258055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.340+0000 7f0273fff700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02580535f0 0x7f0258055ab0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f026400d000 tx=0x7f0264007a00).stop 2022-01-10T01:31:46.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.340+0000 7f0273fff700 1 -- 172.21.15.36:0/933045702 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0254003780 msgr2=0x7f02741486c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.340+0000 7f0273fff700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0254003780 0x7f02741486c0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f025c00c000 tx=0x7f025c019000).stop 2022-01-10T01:31:46.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.340+0000 7f0273fff700 1 -- 172.21.15.36:0/933045702 shutdown_connections 2022-01-10T01:31:46.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.340+0000 7f0273fff700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02580535f0 0x7f0258055ab0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.340+0000 7f0273fff700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02740b5bd0 0x7f0274066d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.340+0000 7f0273fff700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0274148bb0 0x7f0274066870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.340+0000 7f0273fff700 1 --2- 172.21.15.36:0/933045702 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0254003780 0x7f02741486c0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.340+0000 7f0273fff700 1 -- 172.21.15.36:0/933045702 >> 172.21.15.36:0/933045702 conn(0x7f0274060180 msgr2=0x7f027405c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:46.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.340+0000 7f0273fff700 1 -- 172.21.15.36:0/933045702 shutdown_connections 2022-01-10T01:31:46.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.340+0000 7f0273fff700 1 -- 172.21.15.36:0/933045702 wait complete. 2022-01-10T01:31:46.358 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:31:46.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb683fff700 1 Processor -- start 2022-01-10T01:31:46.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb683fff700 1 -- start start 2022-01-10T01:31:46.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb683fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6840b2580 0x7fb68414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb683fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb6840a8ac0 0x7fb68414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb683fff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6840a70c0 con 0x7fb6840b0010 2022-01-10T01:31:46.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb683fff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6840a72f0 con 0x7fb6840a8ac0 2022-01-10T01:31:46.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb683fff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6840a7590 con 0x7fb6840b2580 2022-01-10T01:31:46.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb6837fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb6840a8ac0 0x7fb68414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb6827fc700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fb6840b0010 0x7fb6840a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37366/0 (socket says 172.21.15.36:37366) 2022-01-10T01:31:46.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb6837fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb6840a8ac0 0x7fb68414b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39570/0 (socket says 172.21.15.36:39570) 2022-01-10T01:31:46.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb6827fc700 1 -- 172.21.15.36:0/856872522 learned_addr learned my addr 172.21.15.36:0/856872522 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:46.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb682ffd700 1 --2- 172.21.15.36:0/856872522 >> v2:172.21.15.59:3300/0 conn(0x7fb6840b2580 0x7fb68414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb6837fe700 1 -- 172.21.15.36:0/856872522 >> v2:172.21.15.59:3300/0 conn(0x7fb6840b2580 msgr2=0x7fb68414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:46.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb6837fe700 1 --2- 172.21.15.36:0/856872522 >> v2:172.21.15.59:3300/0 conn(0x7fb6840b2580 0x7fb68414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb6837fe700 1 -- 172.21.15.36:0/856872522 >> v1:172.21.15.36:6789/0 conn(0x7fb6840b0010 legacy=0x7fb6840a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb681ffb700 1 -- 172.21.15.36:0/856872522 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142917006 0 0) 0x7fb6840a70c0 con 0x7fb6840b0010 2022-01-10T01:31:46.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb6837fe700 1 -- 172.21.15.36:0/856872522 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840a7830 con 0x7fb6840a8ac0 2022-01-10T01:31:46.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.460+0000 7fb682ffd700 1 --2- 172.21.15.36:0/856872522 >> v2:172.21.15.59:3300/0 conn(0x7fb6840b2580 0x7fb68414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:46.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb6837fe700 1 --2- 172.21.15.36:0/856872522 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6840a8ac0 0x7fb68414b330 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7fb67c0032f0 tx=0x7fb67c0091d0).ready entity=mon.0 client_cookie=d59d0ee09e0699ff server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:46.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb681ffb700 1 -- 172.21.15.36:0/856872522 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb67c009ea0 con 0x7fb6840a8ac0 2022-01-10T01:31:46.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb681ffb700 1 -- 172.21.15.36:0/856872522 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c00b870 con 0x7fb6840a8ac0 2022-01-10T01:31:46.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb681ffb700 1 -- 172.21.15.36:0/856872522 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb67c00b9e0 con 0x7fb6840a8ac0 2022-01-10T01:31:46.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 -- 172.21.15.36:0/856872522 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6840a8ac0 msgr2=0x7fb68414b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 --2- 172.21.15.36:0/856872522 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6840a8ac0 0x7fb68414b330 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7fb67c0032f0 tx=0x7fb67c0091d0).stop 2022-01-10T01:31:46.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 -- 172.21.15.36:0/856872522 shutdown_connections 2022-01-10T01:31:46.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 --2- 172.21.15.36:0/856872522 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6840a8ac0 0x7fb68414b330 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 --2- 172.21.15.36:0/856872522 >> v2:172.21.15.59:3300/0 conn(0x7fb6840b2580 0x7fb68414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 -- 172.21.15.36:0/856872522 >> 172.21.15.36:0/856872522 conn(0x7fb684060180 msgr2=0x7fb6840b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:46.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 -- 172.21.15.36:0/856872522 shutdown_connections 2022-01-10T01:31:46.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 -- 172.21.15.36:0/856872522 wait complete. 2022-01-10T01:31:46.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 Processor -- start 2022-01-10T01:31:46.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 -- start start 2022-01-10T01:31:46.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6840a8ac0 0x7fb6840a9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6840b0010 0x7fb684063a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6840b2580 0x7fb6841597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840ab4d0 con 0x7fb6840b2580 2022-01-10T01:31:46.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840b5ef0 con 0x7fb6840b0010 2022-01-10T01:31:46.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.464+0000 7fb683fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840ab700 con 0x7fb6840a8ac0 2022-01-10T01:31:46.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb6837fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6840b2580 0x7fb6841597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb6837fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6840b2580 0x7fb6841597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39578/0 (socket says 172.21.15.36:39578) 2022-01-10T01:31:46.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb6837fe700 1 -- 172.21.15.36:0/2939539259 learned_addr learned my addr 172.21.15.36:0/2939539259 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:46.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb6827fc700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6840b0010 0x7fb684063a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb682ffd700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6840a8ac0 0x7fb6840a9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb6837fe700 1 -- 172.21.15.36:0/2939539259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6840a8ac0 msgr2=0x7fb6840a9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb6837fe700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6840a8ac0 0x7fb6840a9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb6837fe700 1 -- 172.21.15.36:0/2939539259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6840b0010 msgr2=0x7fb684063a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb6837fe700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6840b0010 0x7fb684063a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb6837fe700 1 -- 172.21.15.36:0/2939539259 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c009470 con 0x7fb6840b2580 2022-01-10T01:31:46.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb6827fc700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6840b0010 0x7fb684063a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:46.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb6837fe700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6840b2580 0x7fb6841597e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7fb67c0032f0 tx=0x7fb67c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:46.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb67bfff700 1 -- 172.21.15.36:0/2939539259 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb67c00b9e0 con 0x7fb6840b2580 2022-01-10T01:31:46.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb67bfff700 1 -- 172.21.15.36:0/2939539259 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c0107a0 con 0x7fb6840b2580 2022-01-10T01:31:46.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb683fff700 1 -- 172.21.15.36:0/2939539259 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6840a9260 con 0x7fb6840b2580 2022-01-10T01:31:46.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb67bfff700 1 -- 172.21.15.36:0/2939539259 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb67c009ea0 con 0x7fb6840b2580 2022-01-10T01:31:46.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb683fff700 1 -- 172.21.15.36:0/2939539259 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6840b5330 con 0x7fb6840b2580 2022-01-10T01:31:46.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb683fff700 1 -- 172.21.15.36:0/2939539259 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb684057350 con 0x7fb6840b2580 2022-01-10T01:31:46.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb67bfff700 1 -- 172.21.15.36:0/2939539259 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb67c027020 con 0x7fb6840b2580 2022-01-10T01:31:46.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.468+0000 7fb67bfff700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6680536b0 0x7fb668055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.472+0000 7fb67bfff700 1 -- 172.21.15.36:0/2939539259 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb67c06d040 con 0x7fb6840b2580 2022-01-10T01:31:46.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.472+0000 7fb682ffd700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6680536b0 0x7fb668055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.472+0000 7fb682ffd700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6680536b0 0x7fb668055b70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fb67400c000 tx=0x7fb674008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:46.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.476+0000 7fb67bfff700 1 -- 172.21.15.36:0/2939539259 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb67c043fb0 con 0x7fb6840b2580 2022-01-10T01:31:46.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.600+0000 7fb683fff700 1 -- 172.21.15.36:0/2939539259 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb6840698e0 con 0x7fb6840b2580 2022-01-10T01:31:46.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.604+0000 7fb67bfff700 1 -- 172.21.15.36:0/2939539259 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb67c015020 con 0x7fb6840b2580 2022-01-10T01:31:46.609 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:46.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.604+0000 7fb683fff700 1 -- 172.21.15.36:0/2939539259 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6680536b0 msgr2=0x7fb668055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.604+0000 7fb683fff700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6680536b0 0x7fb668055b70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fb67400c000 tx=0x7fb674008040).stop 2022-01-10T01:31:46.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.604+0000 7fb683fff700 1 -- 172.21.15.36:0/2939539259 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6840b2580 msgr2=0x7fb6841597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.604+0000 7fb683fff700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6840b2580 0x7fb6841597e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7fb67c0032f0 tx=0x7fb67c016000).stop 2022-01-10T01:31:46.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.608+0000 7fb683fff700 1 -- 172.21.15.36:0/2939539259 shutdown_connections 2022-01-10T01:31:46.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.608+0000 7fb683fff700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb6680536b0 0x7fb668055b70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.608+0000 7fb683fff700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb6840b2580 0x7fb6841597e0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.608+0000 7fb683fff700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6840b0010 0x7fb684063a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.608+0000 7fb683fff700 1 --2- 172.21.15.36:0/2939539259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6840a8ac0 0x7fb6840a9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.608+0000 7fb683fff700 1 -- 172.21.15.36:0/2939539259 >> 172.21.15.36:0/2939539259 conn(0x7fb684060180 msgr2=0x7fb68414afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:46.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.608+0000 7fb683fff700 1 -- 172.21.15.36:0/2939539259 shutdown_connections 2022-01-10T01:31:46.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.608+0000 7fb683fff700 1 -- 172.21.15.36:0/2939539259 wait complete. 2022-01-10T01:31:46.626 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:31:46.627 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:46.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.724+0000 7f0ba30bd700 1 Processor -- start 2022-01-10T01:31:46.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.724+0000 7f0ba30bd700 1 -- start start 2022-01-10T01:31:46.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b9c0b2580 0x7f0b9c0abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0b9c0b1260 0x7f0b9c0ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c0add80 con 0x7f0b9c0b1790 2022-01-10T01:31:46.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9c0ae020 con 0x7f0b9c0b1260 2022-01-10T01:31:46.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9c0a9390 con 0x7f0b9c0b2580 2022-01-10T01:31:46.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba18ba700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0b9c0b1260 0x7f0b9c0ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba18ba700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0b9c0b1260 0x7f0b9c0ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39586/0 (socket says 172.21.15.36:39586) 2022-01-10T01:31:46.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba18ba700 1 -- 172.21.15.36:0/2104501897 learned_addr learned my addr 172.21.15.36:0/2104501897 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:46.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba20bb700 1 --2- 172.21.15.36:0/2104501897 >> v2:172.21.15.59:3300/0 conn(0x7f0b9c0b2580 0x7f0b9c0abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba18ba700 1 -- 172.21.15.36:0/2104501897 >> v2:172.21.15.59:3300/0 conn(0x7f0b9c0b2580 msgr2=0x7f0b9c0abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:46.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba18ba700 1 --2- 172.21.15.36:0/2104501897 >> v2:172.21.15.59:3300/0 conn(0x7f0b9c0b2580 0x7f0b9c0abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba18ba700 1 -- 172.21.15.36:0/2104501897 >> v1:172.21.15.36:6789/0 conn(0x7f0b9c0b1790 legacy=0x7f0b9c0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba18ba700 1 -- 172.21.15.36:0/2104501897 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c0a9830 con 0x7f0b9c0b1260 2022-01-10T01:31:46.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba18ba700 1 --2- 172.21.15.36:0/2104501897 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b9c0b1260 0x7f0b9c0ac000 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f0b8c002f70 tx=0x7f0b8c006eb0).ready entity=mon.0 client_cookie=518c1c74c5117311 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:46.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba10b9700 1 -- 172.21.15.36:0/2104501897 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b8c00d610 con 0x7f0b9c0b1260 2022-01-10T01:31:46.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba10b9700 1 -- 172.21.15.36:0/2104501897 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c000e90 con 0x7f0b9c0b1260 2022-01-10T01:31:46.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba10b9700 1 -- 172.21.15.36:0/2104501897 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b8c00d9a0 con 0x7f0b9c0b1260 2022-01-10T01:31:46.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2104501897 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b9c0b1260 msgr2=0x7f0b9c0ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 --2- 172.21.15.36:0/2104501897 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b9c0b1260 0x7f0b9c0ac000 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f0b8c002f70 tx=0x7f0b8c006eb0).stop 2022-01-10T01:31:46.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2104501897 shutdown_connections 2022-01-10T01:31:46.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 --2- 172.21.15.36:0/2104501897 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b9c0b1260 0x7f0b9c0ac000 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 --2- 172.21.15.36:0/2104501897 >> v2:172.21.15.59:3300/0 conn(0x7f0b9c0b2580 0x7f0b9c0abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2104501897 >> 172.21.15.36:0/2104501897 conn(0x7f0b9c060180 msgr2=0x7f0b9c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:46.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2104501897 shutdown_connections 2022-01-10T01:31:46.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2104501897 wait complete. 2022-01-10T01:31:46.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 Processor -- start 2022-01-10T01:31:46.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.728+0000 7f0ba30bd700 1 -- start start 2022-01-10T01:31:46.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba30bd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b9c0b1260 0x7f0b9c063f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba30bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b9c0b1790 0x7f0b9c064560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba30bd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9c0b2580 0x7f0b9c064a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba30bd700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c143e00 con 0x7f0b9c0b1260 2022-01-10T01:31:46.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba30bd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c063380 con 0x7f0b9c0b2580 2022-01-10T01:31:46.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba30bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c067390 con 0x7f0b9c0b1790 2022-01-10T01:31:46.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba20bb700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b9c0b1260 0x7f0b9c063f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba20bb700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b9c0b1260 0x7f0b9c063f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39588/0 (socket says 172.21.15.36:39588) 2022-01-10T01:31:46.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba20bb700 1 -- 172.21.15.36:0/2977894991 learned_addr learned my addr 172.21.15.36:0/2977894991 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:46.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba28bc700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9c0b2580 0x7f0b9c064a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba18ba700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b9c0b1790 0x7f0b9c064560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba20bb700 1 -- 172.21.15.36:0/2977894991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b9c0b1790 msgr2=0x7f0b9c064560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba20bb700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b9c0b1790 0x7f0b9c064560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba20bb700 1 -- 172.21.15.36:0/2977894991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9c0b2580 msgr2=0x7f0b9c064a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba20bb700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9c0b2580 0x7f0b9c064a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba20bb700 1 -- 172.21.15.36:0/2977894991 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c00b1e0 con 0x7f0b9c0b1260 2022-01-10T01:31:46.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba28bc700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9c0b2580 0x7f0b9c064a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:46.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba20bb700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b9c0b1260 0x7f0b9c063f40 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f0b9c0668d0 tx=0x7f0b98008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:46.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0b8b7fe700 1 -- 172.21.15.36:0/2977894991 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b98011780 con 0x7f0b9c0b1260 2022-01-10T01:31:46.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0b8b7fe700 1 -- 172.21.15.36:0/2977894991 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b980118e0 con 0x7f0b9c0b1260 2022-01-10T01:31:46.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2977894991 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9c137dd0 con 0x7f0b9c0b1260 2022-01-10T01:31:46.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0b8b7fe700 1 -- 172.21.15.36:0/2977894991 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0b98011c40 con 0x7f0b9c0b1260 2022-01-10T01:31:46.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2977894991 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9c066c50 con 0x7f0b9c0b1260 2022-01-10T01:31:46.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2977894991 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9c067090 con 0x7f0b9c0b1260 2022-01-10T01:31:46.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0b8b7fe700 1 -- 172.21.15.36:0/2977894991 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0b98012420 con 0x7f0b9c0b1260 2022-01-10T01:31:46.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.732+0000 7f0b8b7fe700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0b7c0536b0 0x7f0b7c055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:46.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.736+0000 7f0b8b7fe700 1 -- 172.21.15.36:0/2977894991 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0b9806ba10 con 0x7f0b9c0b1260 2022-01-10T01:31:46.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.736+0000 7f0ba18ba700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0b7c0536b0 0x7f0b7c055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:46.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.736+0000 7f0ba18ba700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0b7c0536b0 0x7f0b7c055b70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f0b8c01a000 tx=0x7f0b8c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:46.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.740+0000 7f0b8b7fe700 1 -- 172.21.15.36:0/2977894991 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0b98042920 con 0x7f0b9c0b1260 2022-01-10T01:31:46.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.900+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2977894991 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b9c057350 con 0x7f0b9c0b1260 2022-01-10T01:31:46.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.900+0000 7f0b8b7fe700 1 -- 172.21.15.36:0/2977894991 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f0b98045f40 con 0x7f0b9c0b1260 2022-01-10T01:31:46.907 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:46.907 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":46,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6933,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4213696854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4213696854},{"type":"v1","addr":"172.21.15.59:6833","nonce":4213696854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44},{"gid":6945,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/4101368080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":4101368080},{"type":"v1","addr":"172.21.15.36:6835","nonce":4101368080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:31:42.305072+0000","modified":"2022-01-10T01:31:43.308110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6948},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6948":{"gid":6948,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/2977677722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":2977677722},{"type":"v1","addr":"172.21.15.36:6837","nonce":2977677722}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2022-01-10T01:31:46.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.904+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2977894991 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0b7c0536b0 msgr2=0x7f0b7c055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.904+0000 7f0ba30bd700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0b7c0536b0 0x7f0b7c055b70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f0b8c01a000 tx=0x7f0b8c015000).stop 2022-01-10T01:31:46.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.904+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2977894991 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b9c0b1260 msgr2=0x7f0b9c063f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:46.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.904+0000 7f0ba30bd700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b9c0b1260 0x7f0b9c063f40 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f0b9c0668d0 tx=0x7f0b98008040).stop 2022-01-10T01:31:46.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.904+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2977894991 shutdown_connections 2022-01-10T01:31:46.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.904+0000 7f0ba30bd700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0b7c0536b0 0x7f0b7c055b70 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.904+0000 7f0ba30bd700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b9c0b2580 0x7f0b9c064a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.904+0000 7f0ba30bd700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0b9c0b1790 0x7f0b9c064560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.904+0000 7f0ba30bd700 1 --2- 172.21.15.36:0/2977894991 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0b9c0b1260 0x7f0b9c063f40 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:46.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.904+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2977894991 >> 172.21.15.36:0/2977894991 conn(0x7f0b9c060180 msgr2=0x7f0b9c05ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:46.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.904+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2977894991 shutdown_connections 2022-01-10T01:31:46.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:46.904+0000 7f0ba30bd700 1 -- 172.21.15.36:0/2977894991 wait complete. 2022-01-10T01:31:46.912 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 46 2022-01-10T01:31:47.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:31:42.305072+0000', 'modified': '2022-01-10T01:31:43.308110+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6948}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6948': {'gid': 6948, 'name': 'a', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6837/2977677722', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6836', 'nonce': 2977677722}, {'type': 'v1', 'addr': '172.21.15.36:6837', 'nonce': 2977677722}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:31:47.225 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:31:47.226 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-10T01:31:47.339 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":6948,"want_state":"up:active","state":"up:active","rank_uptime":5.0208270219999998,"mdsmap_epoch":46,"osdmap_epoch":100,"osdmap_epoch_barrier":99,"uptime":10.003082143} 2022-01-10T01:31:47.340 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 6948, "mdsmap_epoch": 46, "osdmap_epoch": 100, "osdmap_epoch_barrier": 99, "rank_uptime": 5.020827022, "state": "up:active", "uptime": 10.003082143, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:31:47.340 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:31:47.341 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:31:47.341 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:31:47.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:47.342 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:47.350 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:31:47.409 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:31:47.410 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:31:47.420 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:31:47.421 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:31:47.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:47.423 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:31:47.429 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:31:47.429 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:47.474 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:31:47.494 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:31:47.495 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:31:47.507 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:31:47.508 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:31:47.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:47.509 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:31:47.549 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:31:47.549+0000 7efcf8ec4080 -1 init, newargv = 0x55cd1b999ca0 newargc=9ceph-fuse[14862]: starting ceph client 2022-01-10T01:31:47.550 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr: 2022-01-10T01:31:47.560 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14862]: starting fuse 2022-01-10T01:31:48.656 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:31:48.675 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:31:48.676 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:31:48.735 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:31:48.736 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:31:48.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:48.737 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:31:48.744 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:31:48.745 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:31:48.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:48.746 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:31:48.746 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:31:48.747 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:31:48.747 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:31:48.748 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:31:48.748 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:31:48.748 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:31:48.749 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:31:48.749 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:31:48.749 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:31:48.750 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:31:48.750 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:31:48.751 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:31:48.752 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:31:48.752 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:31:48.752 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:31:48.753 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:31:48.753 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:31:48.754 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:31:48.754 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:31:48.754 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:31:48.755 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:31:48.755 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:31:48.798 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.14862.asok 2022-01-10T01:31:48.802 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14862.asok 2022-01-10T01:31:48.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:48.804 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14862.asok status 2022-01-10T01:31:48.890 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:31:48.890 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:31:48.891 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:31:48.891 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:31:48.891 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:31:48.891 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:31:48.891 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:31:48.892 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "14862", 2022-01-10T01:31:48.892 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:31:48.892 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:31:48.893 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:31:48.893 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:31:48.893 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 7096, 2022-01-10T01:31:48.893 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:31:48.893 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:31:48.894 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:31:48.894 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 7096 2022-01-10T01:31:48.894 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:31:48.894 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:31:48.895 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:31:48.895 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:31:48.895 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 3466479267 2022-01-10T01:31:48.895 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:31:48.895 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:31:48.896 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:31:48.896 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:31:48.896 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:31:48.896 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 3466479267 2022-01-10T01:31:48.896 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:31:48.897 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.7096 172.21.15.139:0/3466479267", 2022-01-10T01:31:48.897 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/3466479267", 2022-01-10T01:31:48.897 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:31:48.897 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 46, 2022-01-10T01:31:48.898 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 100, 2022-01-10T01:31:48.898 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:31:48.898 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:31:48.898 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:31:48.898 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:31:48.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:48.900 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:48.901 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:48.908 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:31:48.909 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:31:48.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:48.910 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:48.927 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:31:49.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300a090700 1 Processor -- start 2022-01-10T01:31:49.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300a090700 1 -- start start 2022-01-10T01:31:49.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300a090700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30040b3000 0x7f3004060b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300a090700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3004061000 0x7f3004066c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300a090700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3004065330 con 0x7f30040b25a0 2022-01-10T01:31:49.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300a090700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3004062000 con 0x7f3004061000 2022-01-10T01:31:49.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300a090700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3004061470 con 0x7f30040b3000 2022-01-10T01:31:49.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300988f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3004061000 0x7f3004066c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300888d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f30040b25a0 0x7f3004066520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37392/0 (socket says 172.21.15.36:37392) 2022-01-10T01:31:49.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300888d700 1 -- 172.21.15.36:0/1745018193 learned_addr learned my addr 172.21.15.36:0/1745018193 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:49.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300908e700 1 --2- 172.21.15.36:0/1745018193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30040b3000 0x7f3004060b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300988f700 1 -- 172.21.15.36:0/1745018193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30040b3000 msgr2=0x7f3004060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:49.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300988f700 1 --2- 172.21.15.36:0/1745018193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30040b3000 0x7f3004060b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300988f700 1 -- 172.21.15.36:0/1745018193 >> v1:172.21.15.36:6789/0 conn(0x7f30040b25a0 legacy=0x7f3004066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.032+0000 7f300988f700 1 -- 172.21.15.36:0/1745018193 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30040b33e0 con 0x7f3004061000 2022-01-10T01:31:49.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.036+0000 7f300988f700 1 --2- 172.21.15.36:0/1745018193 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3004061000 0x7f3004066c30 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f2ffc0032f0 tx=0x7f2ffc0091d0).ready entity=mon.0 client_cookie=8d5b319c86c1c947 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:49.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.036+0000 7f2ffbfff700 1 -- 172.21.15.36:0/1745018193 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ffc00b6c0 con 0x7f3004061000 2022-01-10T01:31:49.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.036+0000 7f2ffbfff700 1 -- 172.21.15.36:0/1745018193 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ffc00b820 con 0x7f3004061000 2022-01-10T01:31:49.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.036+0000 7f2ffbfff700 1 -- 172.21.15.36:0/1745018193 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ffc00b990 con 0x7f3004061000 2022-01-10T01:31:49.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.036+0000 7f300a090700 1 -- 172.21.15.36:0/1745018193 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3004061000 msgr2=0x7f3004066c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.036+0000 7f300a090700 1 --2- 172.21.15.36:0/1745018193 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3004061000 0x7f3004066c30 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f2ffc0032f0 tx=0x7f2ffc0091d0).stop 2022-01-10T01:31:49.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.036+0000 7f300a090700 1 -- 172.21.15.36:0/1745018193 shutdown_connections 2022-01-10T01:31:49.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.036+0000 7f300a090700 1 --2- 172.21.15.36:0/1745018193 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3004061000 0x7f3004066c30 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.036+0000 7f300a090700 1 --2- 172.21.15.36:0/1745018193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30040b3000 0x7f3004060b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.051 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.036+0000 7f300a090700 1 -- 172.21.15.36:0/1745018193 >> 172.21.15.36:0/1745018193 conn(0x7f30040636e0 msgr2=0x7f3004063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:49.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.036+0000 7f300a090700 1 -- 172.21.15.36:0/1745018193 shutdown_connections 2022-01-10T01:31:49.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.036+0000 7f300a090700 1 -- 172.21.15.36:0/1745018193 wait complete. 2022-01-10T01:31:49.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.036+0000 7f300a090700 1 Processor -- start 2022-01-10T01:31:49.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.036+0000 7f300a090700 1 -- start start 2022-01-10T01:31:49.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300a090700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3004061000 0x7f30040b6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300a090700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30040b25a0 0x7f30040aa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300a090700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f30040b3000 0x7f30040b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300a090700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30040b02b0 con 0x7f30040b3000 2022-01-10T01:31:49.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300a090700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30040ab8f0 con 0x7f3004061000 2022-01-10T01:31:49.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300a090700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30040abb90 con 0x7f30040b25a0 2022-01-10T01:31:49.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300988f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f30040b3000 0x7f30040b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300988f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f30040b3000 0x7f30040b0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39606/0 (socket says 172.21.15.36:39606) 2022-01-10T01:31:49.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300988f700 1 -- 172.21.15.36:0/911236898 learned_addr learned my addr 172.21.15.36:0/911236898 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:49.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300908e700 1 --2- 172.21.15.36:0/911236898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3004061000 0x7f30040b6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300888d700 1 --2- 172.21.15.36:0/911236898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30040b25a0 0x7f30040aa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300988f700 1 -- 172.21.15.36:0/911236898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30040b25a0 msgr2=0x7f30040aa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300988f700 1 --2- 172.21.15.36:0/911236898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30040b25a0 0x7f30040aa1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300988f700 1 -- 172.21.15.36:0/911236898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3004061000 msgr2=0x7f30040b6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300988f700 1 --2- 172.21.15.36:0/911236898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3004061000 0x7f30040b6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300988f700 1 -- 172.21.15.36:0/911236898 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc009470 con 0x7f30040b3000 2022-01-10T01:31:49.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300988f700 1 --2- 172.21.15.36:0/911236898 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f30040b3000 0x7f30040b0960 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f2ffc0032f0 tx=0x7f2ffc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:49.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f2ffa7fc700 1 -- 172.21.15.36:0/911236898 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ffc011e20 con 0x7f30040b3000 2022-01-10T01:31:49.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f2ffa7fc700 1 -- 172.21.15.36:0/911236898 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ffc021440 con 0x7f30040b3000 2022-01-10T01:31:49.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300a090700 1 -- 172.21.15.36:0/911236898 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30040abe30 con 0x7f30040b3000 2022-01-10T01:31:49.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f2ffa7fc700 1 -- 172.21.15.36:0/911236898 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ffc0217a0 con 0x7f30040b3000 2022-01-10T01:31:49.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300a090700 1 -- 172.21.15.36:0/911236898 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3004067020 con 0x7f30040b3000 2022-01-10T01:31:49.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f300a090700 1 -- 172.21.15.36:0/911236898 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30040abfc0 con 0x7f30040b3000 2022-01-10T01:31:49.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.040+0000 7f2ffa7fc700 1 -- 172.21.15.36:0/911236898 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2ffc027020 con 0x7f30040b3000 2022-01-10T01:31:49.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.044+0000 7f2ffa7fc700 1 --2- 172.21.15.36:0/911236898 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2fec053620 0x7f2fec055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.044+0000 7f300908e700 1 --2- 172.21.15.36:0/911236898 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2fec053620 0x7f2fec055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.044+0000 7f2ffa7fc700 1 -- 172.21.15.36:0/911236898 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2ffc06cf20 con 0x7f30040b3000 2022-01-10T01:31:49.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.044+0000 7f300908e700 1 --2- 172.21.15.36:0/911236898 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2fec053620 0x7f2fec055ae0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f2ff400b000 tx=0x7f2ff4006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:49.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.048+0000 7f2ffa7fc700 1 -- 172.21.15.36:0/911236898 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2ffc043f30 con 0x7f30040b3000 2022-01-10T01:31:49.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.176+0000 7f300a090700 1 -- 172.21.15.36:0/911236898 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30040b0ff0 con 0x7f30040b3000 2022-01-10T01:31:49.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.176+0000 7f2ffa7fc700 1 -- 172.21.15.36:0/911236898 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16276 (secure 0 0 0) 0x7f2ffc015090 con 0x7f30040b3000 2022-01-10T01:31:49.184 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:49.184 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":100,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:31:43.308928+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:31:40.098588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2022-01-10T01:31:41.321500+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:31:49.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.180+0000 7f300a090700 1 -- 172.21.15.36:0/911236898 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2fec053620 msgr2=0x7f2fec055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.180+0000 7f300a090700 1 --2- 172.21.15.36:0/911236898 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2fec053620 0x7f2fec055ae0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f2ff400b000 tx=0x7f2ff4006df0).stop 2022-01-10T01:31:49.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.180+0000 7f300a090700 1 -- 172.21.15.36:0/911236898 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f30040b3000 msgr2=0x7f30040b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.180+0000 7f300a090700 1 --2- 172.21.15.36:0/911236898 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f30040b3000 0x7f30040b0960 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f2ffc0032f0 tx=0x7f2ffc016000).stop 2022-01-10T01:31:49.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.180+0000 7f300a090700 1 -- 172.21.15.36:0/911236898 shutdown_connections 2022-01-10T01:31:49.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.180+0000 7f300a090700 1 --2- 172.21.15.36:0/911236898 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2fec053620 0x7f2fec055ae0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.180+0000 7f300a090700 1 --2- 172.21.15.36:0/911236898 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f30040b3000 0x7f30040b0960 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.180+0000 7f300a090700 1 --2- 172.21.15.36:0/911236898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30040b25a0 0x7f30040aa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.180+0000 7f300a090700 1 --2- 172.21.15.36:0/911236898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3004061000 0x7f30040b6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.180+0000 7f300a090700 1 -- 172.21.15.36:0/911236898 >> 172.21.15.36:0/911236898 conn(0x7f30040636e0 msgr2=0x7f3004066380 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:49.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.180+0000 7f300a090700 1 -- 172.21.15.36:0/911236898 shutdown_connections 2022-01-10T01:31:49.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.180+0000 7f300a090700 1 -- 172.21.15.36:0/911236898 wait complete. 2022-01-10T01:31:49.197 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:31:40.098588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:31:41.321500+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:31:49.198 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:31:49.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.300+0000 7f02b925b700 1 Processor -- start 2022-01-10T01:31:49.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.300+0000 7f02b925b700 1 -- start start 2022-01-10T01:31:49.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.300+0000 7f02b925b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b40b3040 0x7f02b4065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.300+0000 7f02b925b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02b40a9c10 0x7f02b40607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.300+0000 7f02b925b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b4066ea0 con 0x7f02b4143320 2022-01-10T01:31:49.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.300+0000 7f02b925b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b40648e0 con 0x7f02b40a9c10 2022-01-10T01:31:49.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.300+0000 7f02b925b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b4061dd0 con 0x7f02b40b3040 2022-01-10T01:31:49.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.300+0000 7f02b8a5a700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f02b4143320 0x7f02b41437b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37408/0 (socket says 172.21.15.36:37408) 2022-01-10T01:31:49.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.300+0000 7f02b8a5a700 1 -- 172.21.15.36:0/3123321710 learned_addr learned my addr 172.21.15.36:0/3123321710 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:49.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.300+0000 7f02b3fff700 1 --2- 172.21.15.36:0/3123321710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b40b3040 0x7f02b4065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.300+0000 7f02b37fe700 1 --2- 172.21.15.36:0/3123321710 >> v2:172.21.15.59:3300/0 conn(0x7f02b40a9c10 0x7f02b40607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.300+0000 7f02b2ffd700 1 -- 172.21.15.36:0/3123321710 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499164467 0 0) 0x7f02b4066ea0 con 0x7f02b4143320 2022-01-10T01:31:49.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.300+0000 7f02b2ffd700 1 -- 172.21.15.36:0/3123321710 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a0003260 con 0x7f02b4143320 2022-01-10T01:31:49.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b3fff700 1 -- 172.21.15.36:0/3123321710 >> v2:172.21.15.59:3300/0 conn(0x7f02b40a9c10 msgr2=0x7f02b40607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:49.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b3fff700 1 --2- 172.21.15.36:0/3123321710 >> v2:172.21.15.59:3300/0 conn(0x7f02b40a9c10 0x7f02b40607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b3fff700 1 -- 172.21.15.36:0/3123321710 >> v1:172.21.15.36:6789/0 conn(0x7f02b4143320 legacy=0x7f02b41437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b3fff700 1 -- 172.21.15.36:0/3123321710 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b40b3420 con 0x7f02b40b3040 2022-01-10T01:31:49.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b3fff700 1 --2- 172.21.15.36:0/3123321710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b40b3040 0x7f02b4065e90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f02a4002f70 tx=0x7f02a4006df0).ready entity=mon.2 client_cookie=2447cb1bb9b070f6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:49.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b2ffd700 1 -- 172.21.15.36:0/3123321710 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02a400d4a0 con 0x7f02b40b3040 2022-01-10T01:31:49.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b2ffd700 1 -- 172.21.15.36:0/3123321710 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a4000e90 con 0x7f02b40b3040 2022-01-10T01:31:49.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b2ffd700 1 -- 172.21.15.36:0/3123321710 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02a400d830 con 0x7f02b40b3040 2022-01-10T01:31:49.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b925b700 1 -- 172.21.15.36:0/3123321710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b40b3040 msgr2=0x7f02b4065e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b925b700 1 --2- 172.21.15.36:0/3123321710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b40b3040 0x7f02b4065e90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f02a4002f70 tx=0x7f02a4006df0).stop 2022-01-10T01:31:49.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b925b700 1 -- 172.21.15.36:0/3123321710 shutdown_connections 2022-01-10T01:31:49.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b925b700 1 --2- 172.21.15.36:0/3123321710 >> v2:172.21.15.59:3300/0 conn(0x7f02b40a9c10 0x7f02b40607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b925b700 1 --2- 172.21.15.36:0/3123321710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b40b3040 0x7f02b4065e90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b925b700 1 -- 172.21.15.36:0/3123321710 >> 172.21.15.36:0/3123321710 conn(0x7f02b40636e0 msgr2=0x7f02b4063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:49.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b925b700 1 -- 172.21.15.36:0/3123321710 shutdown_connections 2022-01-10T01:31:49.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b925b700 1 -- 172.21.15.36:0/3123321710 wait complete. 2022-01-10T01:31:49.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b925b700 1 Processor -- start 2022-01-10T01:31:49.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.304+0000 7f02b925b700 1 -- start start 2022-01-10T01:31:49.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b925b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02b40a9c10 0x7f02b4145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b925b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b40b3040 0x7f02b40ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b925b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02b4143320 0x7f02b40aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b925b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40ac300 con 0x7f02b4143320 2022-01-10T01:31:49.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b925b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40ad270 con 0x7f02b40a9c10 2022-01-10T01:31:49.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b925b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b40ac510 con 0x7f02b40b3040 2022-01-10T01:31:49.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b8a5a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02b4143320 0x7f02b40aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b8a5a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02b4143320 0x7f02b40aba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39618/0 (socket says 172.21.15.36:39618) 2022-01-10T01:31:49.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b8a5a700 1 -- 172.21.15.36:0/3280090205 learned_addr learned my addr 172.21.15.36:0/3280090205 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:49.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b3fff700 1 --2- 172.21.15.36:0/3280090205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02b40a9c10 0x7f02b4145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b37fe700 1 --2- 172.21.15.36:0/3280090205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b40b3040 0x7f02b40ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b8a5a700 1 -- 172.21.15.36:0/3280090205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b40b3040 msgr2=0x7f02b40ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b8a5a700 1 --2- 172.21.15.36:0/3280090205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b40b3040 0x7f02b40ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b8a5a700 1 -- 172.21.15.36:0/3280090205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02b40a9c10 msgr2=0x7f02b4145180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b8a5a700 1 --2- 172.21.15.36:0/3280090205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02b40a9c10 0x7f02b4145180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b8a5a700 1 -- 172.21.15.36:0/3280090205 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a400b180 con 0x7f02b4143320 2022-01-10T01:31:49.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b8a5a700 1 --2- 172.21.15.36:0/3280090205 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02b4143320 0x7f02b40aba00 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f02ac001490 tx=0x7f02ac007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:49.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b17fa700 1 -- 172.21.15.36:0/3280090205 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02ac005ba0 con 0x7f02b4143320 2022-01-10T01:31:49.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b17fa700 1 -- 172.21.15.36:0/3280090205 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac005d00 con 0x7f02b4143320 2022-01-10T01:31:49.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b925b700 1 -- 172.21.15.36:0/3280090205 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b41501b0 con 0x7f02b4143320 2022-01-10T01:31:49.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b17fa700 1 -- 172.21.15.36:0/3280090205 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02ac0072c0 con 0x7f02b4143320 2022-01-10T01:31:49.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b925b700 1 -- 172.21.15.36:0/3280090205 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b414fee0 con 0x7f02b4143320 2022-01-10T01:31:49.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.308+0000 7f02b925b700 1 -- 172.21.15.36:0/3280090205 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b40ab270 con 0x7f02b4143320 2022-01-10T01:31:49.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.312+0000 7f02b17fa700 1 -- 172.21.15.36:0/3280090205 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f02ac010070 con 0x7f02b4143320 2022-01-10T01:31:49.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.312+0000 7f02b17fa700 1 --2- 172.21.15.36:0/3280090205 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02940534d0 0x7f0294055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.312+0000 7f02b17fa700 1 -- 172.21.15.36:0/3280090205 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f02ac06b580 con 0x7f02b4143320 2022-01-10T01:31:49.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.312+0000 7f02b3fff700 1 --2- 172.21.15.36:0/3280090205 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02940534d0 0x7f0294055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.312+0000 7f02b3fff700 1 --2- 172.21.15.36:0/3280090205 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02940534d0 0x7f0294055990 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f02a401a000 tx=0x7f02a4014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:49.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.316+0000 7f02b17fa700 1 -- 172.21.15.36:0/3280090205 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f02b40ab270 con 0x7f02b4143320 2022-01-10T01:31:49.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.440+0000 7f02b925b700 1 -- 172.21.15.36:0/3280090205 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f02b40ab270 con 0x7f02b4143320 2022-01-10T01:31:49.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.440+0000 7f02b17fa700 1 -- 172.21.15.36:0/3280090205 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v100) v1 ==== 110+0+10 (secure 0 0 0) 0x7f02b40ab270 con 0x7f02b4143320 2022-01-10T01:31:49.449 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:31:49.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.444+0000 7f02b925b700 1 -- 172.21.15.36:0/3280090205 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02940534d0 msgr2=0x7f0294055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.444+0000 7f02b925b700 1 --2- 172.21.15.36:0/3280090205 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02940534d0 0x7f0294055990 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f02a401a000 tx=0x7f02a4014000).stop 2022-01-10T01:31:49.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.444+0000 7f02b925b700 1 -- 172.21.15.36:0/3280090205 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02b4143320 msgr2=0x7f02b40aba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.444+0000 7f02b925b700 1 --2- 172.21.15.36:0/3280090205 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02b4143320 0x7f02b40aba00 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f02ac001490 tx=0x7f02ac007e00).stop 2022-01-10T01:31:49.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.444+0000 7f02b925b700 1 -- 172.21.15.36:0/3280090205 shutdown_connections 2022-01-10T01:31:49.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.444+0000 7f02b925b700 1 --2- 172.21.15.36:0/3280090205 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f02940534d0 0x7f0294055990 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.444+0000 7f02b925b700 1 --2- 172.21.15.36:0/3280090205 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f02b4143320 0x7f02b40aba00 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.444+0000 7f02b925b700 1 --2- 172.21.15.36:0/3280090205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f02b40b3040 0x7f02b40ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.444+0000 7f02b925b700 1 --2- 172.21.15.36:0/3280090205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02b40a9c10 0x7f02b4145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.444+0000 7f02b925b700 1 -- 172.21.15.36:0/3280090205 >> 172.21.15.36:0/3280090205 conn(0x7f02b40636e0 msgr2=0x7f02b4065db0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:49.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.444+0000 7f02b925b700 1 -- 172.21.15.36:0/3280090205 shutdown_connections 2022-01-10T01:31:49.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.444+0000 7f02b925b700 1 -- 172.21.15.36:0/3280090205 wait complete. 2022-01-10T01:31:49.461 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:31:49.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 Processor -- start 2022-01-10T01:31:49.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 -- start start 2022-01-10T01:31:49.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1800aad80 0x7fc180067300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc1800ab160 0x7fc180064800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc180064cf0 0x7fc1800b7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc180065960 con 0x7fc1800ab160 2022-01-10T01:31:49.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1800b3ce0 con 0x7fc1800aad80 2022-01-10T01:31:49.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc180066e60 con 0x7fc180064cf0 2022-01-10T01:31:49.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc176ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc1800ab160 0x7fc180064800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc176ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc1800ab160 0x7fc180064800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39628/0 (socket says 172.21.15.36:39628) 2022-01-10T01:31:49.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc17ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc180064cf0 0x7fc1800b7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc176ffd700 1 -- 172.21.15.36:0/309678551 learned_addr learned my addr 172.21.15.36:0/309678551 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:49.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc17f7fe700 1 --2- 172.21.15.36:0/309678551 >> v2:172.21.15.59:3300/0 conn(0x7fc1800aad80 0x7fc180067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc176ffd700 1 -- 172.21.15.36:0/309678551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc180064cf0 msgr2=0x7fc1800b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:49.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc176ffd700 1 --2- 172.21.15.36:0/309678551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc180064cf0 0x7fc1800b7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc176ffd700 1 -- 172.21.15.36:0/309678551 >> v2:172.21.15.59:3300/0 conn(0x7fc1800aad80 msgr2=0x7fc180067300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:49.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc176ffd700 1 --2- 172.21.15.36:0/309678551 >> v2:172.21.15.59:3300/0 conn(0x7fc1800aad80 0x7fc180067300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc176ffd700 1 -- 172.21.15.36:0/309678551 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1800655e0 con 0x7fc1800ab160 2022-01-10T01:31:49.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc176ffd700 1 --2- 172.21.15.36:0/309678551 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1800ab160 0x7fc180064800 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7fc168002f70 tx=0x7fc168006e50).ready entity=mon.0 client_cookie=89225a2fb816b870 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:49.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc17effd700 1 -- 172.21.15.36:0/309678551 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16800d570 con 0x7fc1800ab160 2022-01-10T01:31:49.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc17effd700 1 -- 172.21.15.36:0/309678551 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc168000e90 con 0x7fc1800ab160 2022-01-10T01:31:49.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc17effd700 1 -- 172.21.15.36:0/309678551 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16800d900 con 0x7fc1800ab160 2022-01-10T01:31:49.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 -- 172.21.15.36:0/309678551 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1800ab160 msgr2=0x7fc180064800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 --2- 172.21.15.36:0/309678551 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1800ab160 0x7fc180064800 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7fc168002f70 tx=0x7fc168006e50).stop 2022-01-10T01:31:49.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 -- 172.21.15.36:0/309678551 shutdown_connections 2022-01-10T01:31:49.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 --2- 172.21.15.36:0/309678551 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc180064cf0 0x7fc1800b7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 --2- 172.21.15.36:0/309678551 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1800ab160 0x7fc180064800 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 --2- 172.21.15.36:0/309678551 >> v2:172.21.15.59:3300/0 conn(0x7fc1800aad80 0x7fc180067300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 -- 172.21.15.36:0/309678551 >> 172.21.15.36:0/309678551 conn(0x7fc180062be0 msgr2=0x7fc18005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:49.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 -- 172.21.15.36:0/309678551 shutdown_connections 2022-01-10T01:31:49.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 -- 172.21.15.36:0/309678551 wait complete. 2022-01-10T01:31:49.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 Processor -- start 2022-01-10T01:31:49.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.568+0000 7fc184ce7700 1 -- start start 2022-01-10T01:31:49.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc184ce7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1800aad80 0x7fc1800afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc184ce7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1800ab160 0x7fc1800af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc184ce7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc180140cd0 0x7fc180141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc184ce7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1800abdd0 con 0x7fc180140cd0 2022-01-10T01:31:49.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc184ce7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1800ad130 con 0x7fc1800ab160 2022-01-10T01:31:49.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc184ce7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1801501f0 con 0x7fc1800aad80 2022-01-10T01:31:49.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc17ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc180140cd0 0x7fc180141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc17ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc180140cd0 0x7fc180141160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39634/0 (socket says 172.21.15.36:39634) 2022-01-10T01:31:49.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc17ffff700 1 -- 172.21.15.36:0/1035896380 learned_addr learned my addr 172.21.15.36:0/1035896380 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:49.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc17f7fe700 1 --2- 172.21.15.36:0/1035896380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1800aad80 0x7fc1800afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc176ffd700 1 --2- 172.21.15.36:0/1035896380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1800ab160 0x7fc1800af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc17ffff700 1 -- 172.21.15.36:0/1035896380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1800aad80 msgr2=0x7fc1800afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc17ffff700 1 --2- 172.21.15.36:0/1035896380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1800aad80 0x7fc1800afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc17ffff700 1 -- 172.21.15.36:0/1035896380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1800ab160 msgr2=0x7fc1800af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc17ffff700 1 --2- 172.21.15.36:0/1035896380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1800ab160 0x7fc1800af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc17ffff700 1 -- 172.21.15.36:0/1035896380 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16800b1e0 con 0x7fc180140cd0 2022-01-10T01:31:49.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc17ffff700 1 --2- 172.21.15.36:0/1035896380 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc180140cd0 0x7fc180141160 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7fc17800c000 tx=0x7fc1780091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:49.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc17d7fa700 1 -- 172.21.15.36:0/1035896380 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc17800c670 con 0x7fc180140cd0 2022-01-10T01:31:49.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc17d7fa700 1 -- 172.21.15.36:0/1035896380 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17800c7d0 con 0x7fc180140cd0 2022-01-10T01:31:49.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc184ce7700 1 -- 172.21.15.36:0/1035896380 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc180150490 con 0x7fc180140cd0 2022-01-10T01:31:49.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc17d7fa700 1 -- 172.21.15.36:0/1035896380 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc17800cb30 con 0x7fc180140cd0 2022-01-10T01:31:49.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.572+0000 7fc184ce7700 1 -- 172.21.15.36:0/1035896380 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1801509d0 con 0x7fc180140cd0 2022-01-10T01:31:49.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.576+0000 7fc184ce7700 1 -- 172.21.15.36:0/1035896380 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1800af8e0 con 0x7fc180140cd0 2022-01-10T01:31:49.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.576+0000 7fc17d7fa700 1 -- 172.21.15.36:0/1035896380 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc178022070 con 0x7fc180140cd0 2022-01-10T01:31:49.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.576+0000 7fc17d7fa700 1 --2- 172.21.15.36:0/1035896380 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc1640534d0 0x7fc164055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.576+0000 7fc17d7fa700 1 -- 172.21.15.36:0/1035896380 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc17806c110 con 0x7fc180140cd0 2022-01-10T01:31:49.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.576+0000 7fc17f7fe700 1 --2- 172.21.15.36:0/1035896380 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc1640534d0 0x7fc164055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.576+0000 7fc17f7fe700 1 --2- 172.21.15.36:0/1035896380 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc1640534d0 0x7fc164055990 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fc17000b000 tx=0x7fc170006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:49.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.588+0000 7fc17d7fa700 1 -- 172.21.15.36:0/1035896380 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc1780430c0 con 0x7fc180140cd0 2022-01-10T01:31:49.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.712+0000 7fc184ce7700 1 -- 172.21.15.36:0/1035896380 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc180057350 con 0x7fc180140cd0 2022-01-10T01:31:49.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.712+0000 7fc17d7fa700 1 -- 172.21.15.36:0/1035896380 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v100) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc178016070 con 0x7fc180140cd0 2022-01-10T01:31:49.719 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:49.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.712+0000 7fc184ce7700 1 -- 172.21.15.36:0/1035896380 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc1640534d0 msgr2=0x7fc164055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.712+0000 7fc184ce7700 1 --2- 172.21.15.36:0/1035896380 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc1640534d0 0x7fc164055990 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7fc17000b000 tx=0x7fc170006df0).stop 2022-01-10T01:31:49.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.712+0000 7fc184ce7700 1 -- 172.21.15.36:0/1035896380 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc180140cd0 msgr2=0x7fc180141160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.712+0000 7fc184ce7700 1 --2- 172.21.15.36:0/1035896380 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc180140cd0 0x7fc180141160 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7fc17800c000 tx=0x7fc1780091d0).stop 2022-01-10T01:31:49.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.712+0000 7fc184ce7700 1 -- 172.21.15.36:0/1035896380 shutdown_connections 2022-01-10T01:31:49.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.712+0000 7fc184ce7700 1 --2- 172.21.15.36:0/1035896380 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc1640534d0 0x7fc164055990 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.712+0000 7fc184ce7700 1 --2- 172.21.15.36:0/1035896380 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc180140cd0 0x7fc180141160 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.712+0000 7fc184ce7700 1 --2- 172.21.15.36:0/1035896380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1800ab160 0x7fc1800af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.712+0000 7fc184ce7700 1 --2- 172.21.15.36:0/1035896380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1800aad80 0x7fc1800afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.712+0000 7fc184ce7700 1 -- 172.21.15.36:0/1035896380 >> 172.21.15.36:0/1035896380 conn(0x7fc180062be0 msgr2=0x7fc1801423d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:49.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.716+0000 7fc184ce7700 1 -- 172.21.15.36:0/1035896380 shutdown_connections 2022-01-10T01:31:49.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.716+0000 7fc184ce7700 1 -- 172.21.15.36:0/1035896380 wait complete. 2022-01-10T01:31:49.732 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:31:49.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 Processor -- start 2022-01-10T01:31:49.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- start start 2022-01-10T01:31:49.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fac1c0a9ec0 0x7fac1c0abd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1c144d20 con 0x7fac1c144940 2022-01-10T01:31:49.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac1c144f80 con 0x7fac1c0b0f80 2022-01-10T01:31:49.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac1c0ac200 con 0x7fac1c0a9ec0 2022-01-10T01:31:49.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac21ec8700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fac1c144940 0x7fac1c0b0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37432/0 (socket says 172.21.15.36:37432) 2022-01-10T01:31:49.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac226c9700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fac1c0a9ec0 0x7fac1c0abd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac21ec8700 1 -- 172.21.15.36:0/4102083382 learned_addr learned my addr 172.21.15.36:0/4102083382 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:49.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac226c9700 1 -- 172.21.15.36:0/4102083382 >> v1:172.21.15.59:6789/0 conn(0x7fac1c0b0f80 legacy=0x7fac1c13e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac226c9700 1 -- 172.21.15.36:0/4102083382 >> v1:172.21.15.36:6789/0 conn(0x7fac1c144940 legacy=0x7fac1c0b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac20ec6700 1 -- 172.21.15.36:0/4102083382 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266641635 0 0) 0x7fac1c144d20 con 0x7fac1c144940 2022-01-10T01:31:49.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac226c9700 1 -- 172.21.15.36:0/4102083382 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c145220 con 0x7fac1c0a9ec0 2022-01-10T01:31:49.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac226c9700 1 --2- 172.21.15.36:0/4102083382 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac1c0a9ec0 0x7fac1c0abd10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fac140032f0 tx=0x7fac140091d0).ready entity=mon.0 client_cookie=dd733874f935a476 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:49.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac20ec6700 1 -- 172.21.15.36:0/4102083382 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac14009ea0 con 0x7fac1c0a9ec0 2022-01-10T01:31:49.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac20ec6700 1 -- 172.21.15.36:0/4102083382 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1400b8a0 con 0x7fac1c0a9ec0 2022-01-10T01:31:49.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac20ec6700 1 -- 172.21.15.36:0/4102083382 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac1400ba10 con 0x7fac1c0a9ec0 2022-01-10T01:31:49.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- 172.21.15.36:0/4102083382 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac1c0a9ec0 msgr2=0x7fac1c0abd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 --2- 172.21.15.36:0/4102083382 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac1c0a9ec0 0x7fac1c0abd10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7fac140032f0 tx=0x7fac140091d0).stop 2022-01-10T01:31:49.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- 172.21.15.36:0/4102083382 shutdown_connections 2022-01-10T01:31:49.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 --2- 172.21.15.36:0/4102083382 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac1c0a9ec0 0x7fac1c0abd10 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- 172.21.15.36:0/4102083382 >> 172.21.15.36:0/4102083382 conn(0x7fac1c0b2970 msgr2=0x7fac1c0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:49.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- 172.21.15.36:0/4102083382 shutdown_connections 2022-01-10T01:31:49.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- 172.21.15.36:0/4102083382 wait complete. 2022-01-10T01:31:49.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 Processor -- start 2022-01-10T01:31:49.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- start start 2022-01-10T01:31:49.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1c0a9ec0 0x7fac1c13cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac1c0b0f80 0x7fac1c139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1c144940 0x7fac1c05f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c0b4040 con 0x7fac1c0b0f80 2022-01-10T01:31:49.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c060ce0 con 0x7fac1c0a9ec0 2022-01-10T01:31:49.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c0616f0 con 0x7fac1c144940 2022-01-10T01:31:49.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac216c7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac1c0b0f80 0x7fac1c139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac216c7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac1c0b0f80 0x7fac1c139eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39644/0 (socket says 172.21.15.36:39644) 2022-01-10T01:31:49.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac216c7700 1 -- 172.21.15.36:0/1764106042 learned_addr learned my addr 172.21.15.36:0/1764106042 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:49.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac226c9700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1c144940 0x7fac1c05f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac21ec8700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1c0a9ec0 0x7fac1c13cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac216c7700 1 -- 172.21.15.36:0/1764106042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1c144940 msgr2=0x7fac1c05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac216c7700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1c144940 0x7fac1c05f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac216c7700 1 -- 172.21.15.36:0/1764106042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1c0a9ec0 msgr2=0x7fac1c13cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac216c7700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1c0a9ec0 0x7fac1c13cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac216c7700 1 -- 172.21.15.36:0/1764106042 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac14009470 con 0x7fac1c0b0f80 2022-01-10T01:31:49.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac21ec8700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1c0a9ec0 0x7fac1c13cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:31:49.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac216c7700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac1c0b0f80 0x7fac1c139eb0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7fac1c061880 tx=0x7fac0c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:49.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac0affd700 1 -- 172.21.15.36:0/1764106042 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac0c00ce20 con 0x7fac1c0b0f80 2022-01-10T01:31:49.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac0affd700 1 -- 172.21.15.36:0/1764106042 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c00f470 con 0x7fac1c0b0f80 2022-01-10T01:31:49.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- 172.21.15.36:0/1764106042 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1c0b3ba0 con 0x7fac1c0b0f80 2022-01-10T01:31:49.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac0affd700 1 -- 172.21.15.36:0/1764106042 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac0c00f7d0 con 0x7fac1c0b0f80 2022-01-10T01:31:49.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.840+0000 7fac2412c700 1 -- 172.21.15.36:0/1764106042 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1c13d0a0 con 0x7fac1c0b0f80 2022-01-10T01:31:49.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.844+0000 7fac2412c700 1 -- 172.21.15.36:0/1764106042 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1c060ea0 con 0x7fac1c0b0f80 2022-01-10T01:31:49.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.844+0000 7fac0affd700 1 -- 172.21.15.36:0/1764106042 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fac0c019030 con 0x7fac1c0b0f80 2022-01-10T01:31:49.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.844+0000 7fac0affd700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fabfc053680 0x7fabfc055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:49.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.844+0000 7fac0affd700 1 -- 172.21.15.36:0/1764106042 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fac0c06afb0 con 0x7fac1c0b0f80 2022-01-10T01:31:49.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.844+0000 7fac21ec8700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fabfc053680 0x7fabfc055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:49.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.844+0000 7fac21ec8700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fabfc053680 0x7fabfc055b40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fac18008000 tx=0x7fac18009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:49.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.856+0000 7fac0affd700 1 -- 172.21.15.36:0/1764106042 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fac0c041f20 con 0x7fac1c0b0f80 2022-01-10T01:31:49.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.976+0000 7fac2412c700 1 -- 172.21.15.36:0/1764106042 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fac1c0b3d30 con 0x7fac1c0b0f80 2022-01-10T01:31:49.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.976+0000 7fac0affd700 1 -- 172.21.15.36:0/1764106042 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) v1 ==== 104+0+10 (secure 0 0 0) 0x7fac0c045540 con 0x7fac1c0b0f80 2022-01-10T01:31:49.984 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:49.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.980+0000 7fac2412c700 1 -- 172.21.15.36:0/1764106042 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fabfc053680 msgr2=0x7fabfc055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.980+0000 7fac2412c700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fabfc053680 0x7fabfc055b40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fac18008000 tx=0x7fac18009040).stop 2022-01-10T01:31:49.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.980+0000 7fac2412c700 1 -- 172.21.15.36:0/1764106042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac1c0b0f80 msgr2=0x7fac1c139eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:49.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.980+0000 7fac2412c700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac1c0b0f80 0x7fac1c139eb0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7fac1c061880 tx=0x7fac0c007c50).stop 2022-01-10T01:31:49.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.980+0000 7fac2412c700 1 -- 172.21.15.36:0/1764106042 shutdown_connections 2022-01-10T01:31:49.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.980+0000 7fac2412c700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fabfc053680 0x7fabfc055b40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.980+0000 7fac2412c700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac1c144940 0x7fac1c05f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.980+0000 7fac2412c700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fac1c0b0f80 0x7fac1c139eb0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.980+0000 7fac2412c700 1 --2- 172.21.15.36:0/1764106042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac1c0a9ec0 0x7fac1c13cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:49.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.980+0000 7fac2412c700 1 -- 172.21.15.36:0/1764106042 >> 172.21.15.36:0/1764106042 conn(0x7fac1c0b2970 msgr2=0x7fac1c147080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:49.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.980+0000 7fac2412c700 1 -- 172.21.15.36:0/1764106042 shutdown_connections 2022-01-10T01:31:49.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:49.980+0000 7fac2412c700 1 -- 172.21.15.36:0/1764106042 wait complete. 2022-01-10T01:31:49.998 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:31:50.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d20d45700 1 Processor -- start 2022-01-10T01:31:50.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d20d45700 1 -- start start 2022-01-10T01:31:50.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d20d45700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d1c061320 0x7f1d1c061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d20d45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d1c0ad5c0 0x7f1d1c0b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d20d45700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1c0aecf0 con 0x7f1d1c140440 2022-01-10T01:31:50.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d20d45700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c0b6f20 con 0x7f1d1c061320 2022-01-10T01:31:50.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d20d45700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0aef20 con 0x7f1d1c0ad5c0 2022-01-10T01:31:50.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1bfff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f1d1c140440 0x7f1d1c146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37450/0 (socket says 172.21.15.36:37450) 2022-01-10T01:31:50.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1bfff700 1 -- 172.21.15.36:0/186026998 learned_addr learned my addr 172.21.15.36:0/186026998 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:50.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1affd700 1 --2- 172.21.15.36:0/186026998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d1c0ad5c0 0x7f1d1c0b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1b7fe700 1 --2- 172.21.15.36:0/186026998 >> v2:172.21.15.59:3300/0 conn(0x7f1d1c061320 0x7f1d1c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 -- 172.21.15.36:0/186026998 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687394296 0 0) 0x7f1d1c0aecf0 con 0x7f1d1c140440 2022-01-10T01:31:50.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 -- 172.21.15.36:0/186026998 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d08003260 con 0x7f1d1c140440 2022-01-10T01:31:50.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 -- 172.21.15.36:0/186026998 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1385879422 0 0) 0x7f1d08003260 con 0x7f1d1c140440 2022-01-10T01:31:50.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 -- 172.21.15.36:0/186026998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d1c0ad5c0 msgr2=0x7f1d1c0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:50.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 --2- 172.21.15.36:0/186026998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d1c0ad5c0 0x7f1d1c0b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 -- 172.21.15.36:0/186026998 >> v2:172.21.15.59:3300/0 conn(0x7f1d1c061320 msgr2=0x7f1d1c061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:50.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 --2- 172.21.15.36:0/186026998 >> v2:172.21.15.59:3300/0 conn(0x7f1d1c061320 0x7f1d1c061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 -- 172.21.15.36:0/186026998 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c0af1c0 con 0x7f1d1c140440 2022-01-10T01:31:50.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 -- 172.21.15.36:0/186026998 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f1d140019e0 con 0x7f1d1c140440 2022-01-10T01:31:50.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 -- 172.21.15.36:0/186026998 >> v1:172.21.15.36:6789/0 conn(0x7f1d1c140440 legacy=0x7f1d1c146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:50.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 --2- 172.21.15.36:0/186026998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d1c0ad5c0 0x7f1d08003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 --2- 172.21.15.36:0/186026998 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d08003c80 0x7f1d08004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 --2- 172.21.15.36:0/186026998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d080049f0 0x7f1d08004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 -- 172.21.15.36:0/186026998 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0b6f20 con 0x7f1d08003c80 2022-01-10T01:31:50.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 -- 172.21.15.36:0/186026998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0aef20 con 0x7f1d080049f0 2022-01-10T01:31:50.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 -- 172.21.15.36:0/186026998 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0800b750 con 0x7f1d1c0ad5c0 2022-01-10T01:31:50.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1affd700 1 --2- 172.21.15.36:0/186026998 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d08003c80 0x7f1d08004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1bfff700 1 --2- 172.21.15.36:0/186026998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d080049f0 0x7f1d08004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1b7fe700 1 --2- 172.21.15.36:0/186026998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d1c0ad5c0 0x7f1d08003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1affd700 1 -- 172.21.15.36:0/186026998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d1c0ad5c0 msgr2=0x7f1d08003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:50.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1affd700 1 --2- 172.21.15.36:0/186026998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d1c0ad5c0 0x7f1d08003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1affd700 1 -- 172.21.15.36:0/186026998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d080049f0 msgr2=0x7f1d08004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:50.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1affd700 1 --2- 172.21.15.36:0/186026998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d080049f0 0x7f1d08004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1affd700 1 -- 172.21.15.36:0/186026998 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d08003260 con 0x7f1d08003c80 2022-01-10T01:31:50.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1affd700 1 --2- 172.21.15.36:0/186026998 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d08003c80 0x7f1d08004500 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f1d080054d0 tx=0x7f1d10006df0).ready entity=mon.0 client_cookie=cacf8cfdd5281bf2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:50.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 -- 172.21.15.36:0/186026998 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d1000e830 con 0x7f1d08003c80 2022-01-10T01:31:50.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 -- 172.21.15.36:0/186026998 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1000be90 con 0x7f1d08003c80 2022-01-10T01:31:50.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.108+0000 7f1d1a7fc700 1 -- 172.21.15.36:0/186026998 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d1000eb80 con 0x7f1d08003c80 2022-01-10T01:31:50.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.116+0000 7f1d20d45700 1 -- 172.21.15.36:0/186026998 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d08003c80 msgr2=0x7f1d08004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:50.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.116+0000 7f1d20d45700 1 --2- 172.21.15.36:0/186026998 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d08003c80 0x7f1d08004500 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f1d080054d0 tx=0x7f1d10006df0).stop 2022-01-10T01:31:50.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.116+0000 7f1d1bfff700 1 -- 172.21.15.36:0/186026998 reap_dead start 2022-01-10T01:31:50.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.116+0000 7f1d20d45700 1 -- 172.21.15.36:0/186026998 shutdown_connections 2022-01-10T01:31:50.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.116+0000 7f1d20d45700 1 -- 172.21.15.36:0/186026998 >> 172.21.15.36:0/186026998 conn(0x7f1d1c066de0 msgr2=0x7f1d1c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:50.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.116+0000 7f1d20d45700 1 -- 172.21.15.36:0/186026998 shutdown_connections 2022-01-10T01:31:50.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.116+0000 7f1d20d45700 1 -- 172.21.15.36:0/186026998 wait complete. 2022-01-10T01:31:50.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.116+0000 7f1d20d45700 1 Processor -- start 2022-01-10T01:31:50.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.116+0000 7f1d20d45700 1 -- start start 2022-01-10T01:31:50.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d20d45700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d08003c80 0x7f1d1c0aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d20d45700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d1c0b1bb0 0x7f1d1c0b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d20d45700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d1c0b36f0 0x7f1d1c152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d20d45700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0b10b0 con 0x7f1d08003c80 2022-01-10T01:31:50.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d20d45700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c143e90 con 0x7f1d1c0b1bb0 2022-01-10T01:31:50.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d20d45700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0b14f0 con 0x7f1d1c0b36f0 2022-01-10T01:31:50.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d1b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d08003c80 0x7f1d1c0aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d1b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d08003c80 0x7f1d1c0aca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39666/0 (socket says 172.21.15.36:39666) 2022-01-10T01:31:50.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d1b7fe700 1 -- 172.21.15.36:0/2014115506 learned_addr learned my addr 172.21.15.36:0/2014115506 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:50.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d1affd700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d1c0b1bb0 0x7f1d1c0b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d1bfff700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d1c0b36f0 0x7f1d1c152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d1b7fe700 1 -- 172.21.15.36:0/2014115506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d1c0b36f0 msgr2=0x7f1d1c152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:50.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d1b7fe700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d1c0b36f0 0x7f1d1c152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d1b7fe700 1 -- 172.21.15.36:0/2014115506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d1c0b1bb0 msgr2=0x7f1d1c0b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:50.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d1b7fe700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d1c0b1bb0 0x7f1d1c0b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d1b7fe700 1 -- 172.21.15.36:0/2014115506 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c0b1950 con 0x7f1d08003c80 2022-01-10T01:31:50.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d1affd700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d1c0b1bb0 0x7f1d1c0b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:50.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d1bfff700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d1c0b36f0 0x7f1d1c152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:50.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d1b7fe700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d08003c80 0x7f1d1c0aca00 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f1d0c00b000 tx=0x7f1d0c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:50.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d18ff9700 1 -- 172.21.15.36:0/2014115506 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d0c00e6c0 con 0x7f1d08003c80 2022-01-10T01:31:50.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d18ff9700 1 -- 172.21.15.36:0/2014115506 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0c00e820 con 0x7f1d08003c80 2022-01-10T01:31:50.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d20d45700 1 -- 172.21.15.36:0/2014115506 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1c0ac450 con 0x7f1d08003c80 2022-01-10T01:31:50.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d18ff9700 1 -- 172.21.15.36:0/2014115506 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d0c00eb80 con 0x7f1d08003c80 2022-01-10T01:31:50.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d20d45700 1 -- 172.21.15.36:0/2014115506 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1c0b3b70 con 0x7f1d08003c80 2022-01-10T01:31:50.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.120+0000 7f1d20d45700 1 -- 172.21.15.36:0/2014115506 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1c0af460 con 0x7f1d08003c80 2022-01-10T01:31:50.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.124+0000 7f1d18ff9700 1 -- 172.21.15.36:0/2014115506 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1d0c024070 con 0x7f1d08003c80 2022-01-10T01:31:50.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.124+0000 7f1d18ff9700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1cfc0534d0 0x7f1cfc055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.124+0000 7f1d18ff9700 1 -- 172.21.15.36:0/2014115506 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1d0c06c4b0 con 0x7f1d08003c80 2022-01-10T01:31:50.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.124+0000 7f1d1affd700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1cfc0534d0 0x7f1cfc055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.124+0000 7f1d1affd700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1cfc0534d0 0x7f1cfc055990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f1d1001b000 tx=0x7f1d10019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:50.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.128+0000 7f1d18ff9700 1 -- 172.21.15.36:0/2014115506 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d0c0433b0 con 0x7f1d08003c80 2022-01-10T01:31:50.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.264+0000 7f1d20d45700 1 -- 172.21.15.36:0/2014115506 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d1c057350 con 0x7f1d08003c80 2022-01-10T01:31:50.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.264+0000 7f1d18ff9700 1 -- 172.21.15.36:0/2014115506 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1d0c0469d0 con 0x7f1d08003c80 2022-01-10T01:31:50.266 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:31:50.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.264+0000 7f1d20d45700 1 -- 172.21.15.36:0/2014115506 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1cfc0534d0 msgr2=0x7f1cfc055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:50.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.264+0000 7f1d20d45700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1cfc0534d0 0x7f1cfc055990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f1d1001b000 tx=0x7f1d10019000).stop 2022-01-10T01:31:50.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.264+0000 7f1d20d45700 1 -- 172.21.15.36:0/2014115506 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d08003c80 msgr2=0x7f1d1c0aca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:50.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.264+0000 7f1d20d45700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d08003c80 0x7f1d1c0aca00 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f1d0c00b000 tx=0x7f1d0c008040).stop 2022-01-10T01:31:50.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.264+0000 7f1d20d45700 1 -- 172.21.15.36:0/2014115506 shutdown_connections 2022-01-10T01:31:50.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.264+0000 7f1d20d45700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1cfc0534d0 0x7f1cfc055990 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.264+0000 7f1d20d45700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d1c0b36f0 0x7f1d1c152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.264+0000 7f1d20d45700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d1c0b1bb0 0x7f1d1c0b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.264+0000 7f1d20d45700 1 --2- 172.21.15.36:0/2014115506 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d08003c80 0x7f1d1c0aca00 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.264+0000 7f1d20d45700 1 -- 172.21.15.36:0/2014115506 >> 172.21.15.36:0/2014115506 conn(0x7f1d1c066de0 msgr2=0x7f1d1c1413e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:50.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.264+0000 7f1d20d45700 1 -- 172.21.15.36:0/2014115506 shutdown_connections 2022-01-10T01:31:50.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.264+0000 7f1d20d45700 1 -- 172.21.15.36:0/2014115506 wait complete. 2022-01-10T01:31:50.280 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:31:50.280 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:50.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 Processor -- start 2022-01-10T01:31:50.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 -- start start 2022-01-10T01:31:50.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7880b1db0 0x7fc7880b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc7880a70c0 0x7fc788144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7880b0350 con 0x7fc7881483a0 2022-01-10T01:31:50.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7880a90c0 con 0x7fc7880a70c0 2022-01-10T01:31:50.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880b05f0 con 0x7fc7880b1db0 2022-01-10T01:31:50.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc78df95700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7880b1db0 0x7fc7880b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc78e796700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc7880a70c0 0x7fc788144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc78d794700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc7881483a0 0x7fc7880b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:55144/0 (socket says 172.21.15.36:55144) 2022-01-10T01:31:50.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc78d794700 1 -- 172.21.15.36:0/2858194666 learned_addr learned my addr 172.21.15.36:0/2858194666 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:50.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc78cf93700 1 -- 172.21.15.36:0/2858194666 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210638024 0 0) 0x7fc7880b0350 con 0x7fc7881483a0 2022-01-10T01:31:50.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc78df95700 1 -- 172.21.15.36:0/2858194666 >> v2:172.21.15.59:3300/0 conn(0x7fc7880a70c0 msgr2=0x7fc788144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:50.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc78df95700 1 --2- 172.21.15.36:0/2858194666 >> v2:172.21.15.59:3300/0 conn(0x7fc7880a70c0 0x7fc788144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc78df95700 1 -- 172.21.15.36:0/2858194666 >> v1:172.21.15.59:6789/0 conn(0x7fc7881483a0 legacy=0x7fc7880b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:50.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc78df95700 1 -- 172.21.15.36:0/2858194666 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7880b0890 con 0x7fc7880b1db0 2022-01-10T01:31:50.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc78df95700 1 --2- 172.21.15.36:0/2858194666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7880b1db0 0x7fc7880b0fd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fc784002f70 tx=0x7fc784006df0).ready entity=mon.2 client_cookie=f0510510ed06f28e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:50.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc78cf93700 1 -- 172.21.15.36:0/2858194666 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc78400d570 con 0x7fc7880b1db0 2022-01-10T01:31:50.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc78cf93700 1 -- 172.21.15.36:0/2858194666 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc784000e90 con 0x7fc7880b1db0 2022-01-10T01:31:50.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc78cf93700 1 -- 172.21.15.36:0/2858194666 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc78400d8c0 con 0x7fc7880b1db0 2022-01-10T01:31:50.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 -- 172.21.15.36:0/2858194666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7880b1db0 msgr2=0x7fc7880b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:50.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 --2- 172.21.15.36:0/2858194666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7880b1db0 0x7fc7880b0fd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fc784002f70 tx=0x7fc784006df0).stop 2022-01-10T01:31:50.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 -- 172.21.15.36:0/2858194666 shutdown_connections 2022-01-10T01:31:50.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 --2- 172.21.15.36:0/2858194666 >> v2:172.21.15.59:3300/0 conn(0x7fc7880a70c0 0x7fc788144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 --2- 172.21.15.36:0/2858194666 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7880b1db0 0x7fc7880b0fd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 -- 172.21.15.36:0/2858194666 >> 172.21.15.36:0/2858194666 conn(0x7fc78805f6b0 msgr2=0x7fc78805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:50.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 -- 172.21.15.36:0/2858194666 shutdown_connections 2022-01-10T01:31:50.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.384+0000 7fc7901f9700 1 -- 172.21.15.36:0/2858194666 wait complete. 2022-01-10T01:31:50.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc7901f9700 1 Processor -- start 2022-01-10T01:31:50.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc7901f9700 1 -- start start 2022-01-10T01:31:50.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc7901f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7880a70c0 0x7fc78814af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc7901f9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc7880b1db0 0x7fc788156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc7901f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7881483a0 0x7fc788157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc7901f9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78814b890 con 0x7fc7880b1db0 2022-01-10T01:31:50.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc7901f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc788156a20 con 0x7fc7881483a0 2022-01-10T01:31:50.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc7901f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc788064580 con 0x7fc7880a70c0 2022-01-10T01:31:50.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc78d794700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc7880b1db0 0x7fc788156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc78d794700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc7880b1db0 0x7fc788156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39680/0 (socket says 172.21.15.36:39680) 2022-01-10T01:31:50.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc78d794700 1 -- 172.21.15.36:0/498730347 learned_addr learned my addr 172.21.15.36:0/498730347 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:50.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc78df95700 1 --2- 172.21.15.36:0/498730347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7880a70c0 0x7fc78814af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc78e796700 1 --2- 172.21.15.36:0/498730347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7881483a0 0x7fc788157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc78d794700 1 -- 172.21.15.36:0/498730347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7880a70c0 msgr2=0x7fc78814af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:50.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc78d794700 1 --2- 172.21.15.36:0/498730347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7880a70c0 0x7fc78814af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc78d794700 1 -- 172.21.15.36:0/498730347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7881483a0 msgr2=0x7fc788157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:50.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc78d794700 1 --2- 172.21.15.36:0/498730347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7881483a0 0x7fc788157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc78d794700 1 -- 172.21.15.36:0/498730347 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78400b180 con 0x7fc7880b1db0 2022-01-10T01:31:50.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc78d794700 1 --2- 172.21.15.36:0/498730347 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc7880b1db0 0x7fc788156e10 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7fc780001250 tx=0x7fc7800013f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:50.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc77effd700 1 -- 172.21.15.36:0/498730347 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc780005ba0 con 0x7fc7880b1db0 2022-01-10T01:31:50.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc77effd700 1 -- 172.21.15.36:0/498730347 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc780005d00 con 0x7fc7880b1db0 2022-01-10T01:31:50.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc7901f9700 1 -- 172.21.15.36:0/498730347 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc788064820 con 0x7fc7880b1db0 2022-01-10T01:31:50.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc77effd700 1 -- 172.21.15.36:0/498730347 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc7800072c0 con 0x7fc7880b1db0 2022-01-10T01:31:50.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.388+0000 7fc7901f9700 1 -- 172.21.15.36:0/498730347 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc788064200 con 0x7fc7880b1db0 2022-01-10T01:31:50.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.392+0000 7fc7901f9700 1 -- 172.21.15.36:0/498730347 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc788057350 con 0x7fc7880b1db0 2022-01-10T01:31:50.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.392+0000 7fc77effd700 1 -- 172.21.15.36:0/498730347 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc78001a060 con 0x7fc7880b1db0 2022-01-10T01:31:50.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.392+0000 7fc77effd700 1 --2- 172.21.15.36:0/498730347 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc7680535f0 0x7fc768055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:50.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.392+0000 7fc77effd700 1 -- 172.21.15.36:0/498730347 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc78006b590 con 0x7fc7880b1db0 2022-01-10T01:31:50.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.392+0000 7fc78df95700 1 --2- 172.21.15.36:0/498730347 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc7680535f0 0x7fc768055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:50.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.392+0000 7fc78df95700 1 --2- 172.21.15.36:0/498730347 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc7680535f0 0x7fc768055ab0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fc78401a000 tx=0x7fc784014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:50.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.400+0000 7fc77effd700 1 -- 172.21.15.36:0/498730347 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc780042520 con 0x7fc7880b1db0 2022-01-10T01:31:50.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.556+0000 7fc7901f9700 1 -- 172.21.15.36:0/498730347 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7880b3c30 con 0x7fc7880b1db0 2022-01-10T01:31:50.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.556+0000 7fc77effd700 1 -- 172.21.15.36:0/498730347 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fc780018070 con 0x7fc7880b1db0 2022-01-10T01:31:50.560 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:50.561 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":46,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6933,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4213696854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4213696854},{"type":"v1","addr":"172.21.15.59:6833","nonce":4213696854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44},{"gid":6945,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/4101368080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":4101368080},{"type":"v1","addr":"172.21.15.36:6835","nonce":4101368080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:31:42.305072+0000","modified":"2022-01-10T01:31:43.308110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6948},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6948":{"gid":6948,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/2977677722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":2977677722},{"type":"v1","addr":"172.21.15.36:6837","nonce":2977677722}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2022-01-10T01:31:50.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.560+0000 7fc7901f9700 1 -- 172.21.15.36:0/498730347 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc7680535f0 msgr2=0x7fc768055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:50.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.560+0000 7fc7901f9700 1 --2- 172.21.15.36:0/498730347 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc7680535f0 0x7fc768055ab0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fc78401a000 tx=0x7fc784014000).stop 2022-01-10T01:31:50.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.560+0000 7fc7901f9700 1 -- 172.21.15.36:0/498730347 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc7880b1db0 msgr2=0x7fc788156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:50.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.560+0000 7fc7901f9700 1 --2- 172.21.15.36:0/498730347 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc7880b1db0 0x7fc788156e10 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7fc780001250 tx=0x7fc7800013f0).stop 2022-01-10T01:31:50.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.560+0000 7fc7901f9700 1 -- 172.21.15.36:0/498730347 shutdown_connections 2022-01-10T01:31:50.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.560+0000 7fc7901f9700 1 --2- 172.21.15.36:0/498730347 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc7680535f0 0x7fc768055ab0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.560+0000 7fc7901f9700 1 --2- 172.21.15.36:0/498730347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7881483a0 0x7fc788157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.560+0000 7fc7901f9700 1 --2- 172.21.15.36:0/498730347 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc7880b1db0 0x7fc788156e10 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.560+0000 7fc7901f9700 1 --2- 172.21.15.36:0/498730347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7880a70c0 0x7fc78814af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:50.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.560+0000 7fc7901f9700 1 -- 172.21.15.36:0/498730347 >> 172.21.15.36:0/498730347 conn(0x7fc78805f6b0 msgr2=0x7fc7880a7540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:50.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.560+0000 7fc7901f9700 1 -- 172.21.15.36:0/498730347 shutdown_connections 2022-01-10T01:31:50.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:50.560+0000 7fc7901f9700 1 -- 172.21.15.36:0/498730347 wait complete. 2022-01-10T01:31:50.567 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 46 2022-01-10T01:31:50.879 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:31:42.305072+0000', 'modified': '2022-01-10T01:31:43.308110+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6948}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6948': {'gid': 6948, 'name': 'a', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6837/2977677722', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6836', 'nonce': 2977677722}, {'type': 'v1', 'addr': '172.21.15.36:6837', 'nonce': 2977677722}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:31:50.880 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:31:50.880 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-10T01:31:50.996 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":6948,"want_state":"up:active","state":"up:active","rank_uptime":8.6783518480000001,"mdsmap_epoch":46,"osdmap_epoch":100,"osdmap_epoch_barrier":99,"uptime":13.660612845999999} 2022-01-10T01:31:50.997 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 6948, "mdsmap_epoch": 46, "osdmap_epoch": 100, "osdmap_epoch_barrier": 99, "rank_uptime": 8.678351848, "state": "up:active", "uptime": 13.660612846, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:31:50.998 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:31:50.998 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2022-01-10T01:31:50.998 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi166.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2022-01-10T01:31:50.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:50.999 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:51.008 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:31:51.067 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:31:51.067 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:31:51.082 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:31:51.083 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:31:51.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:51.085 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:31:51.132 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:31:51.133 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:51.135 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:31:51.155 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:31:51.155 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:31:51.214 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:2022-01-10T01:31:51.208+0000 7f54d9b44080 -1 init, newargv = 0x55c1306a4dd0 newargc=9 2022-01-10T01:31:51.215 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14355]: starting ceph client 2022-01-10T01:31:51.219 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:31:51.221 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:31:51.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:51.223 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:31:51.226 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14355]: starting fuse 2022-01-10T01:31:51.232 INFO:teuthology.orchestra.run.smithi166.stdout:52 2022-01-10T01:31:51.233 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:31:51.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:51.234 DEBUG:teuthology.orchestra.run.smithi166:> sudo python3 -c ' 2022-01-10T01:31:51.234 DEBUG:teuthology.orchestra.run.smithi166:> import glob 2022-01-10T01:31:51.235 DEBUG:teuthology.orchestra.run.smithi166:> import re 2022-01-10T01:31:51.235 DEBUG:teuthology.orchestra.run.smithi166:> import os 2022-01-10T01:31:51.236 DEBUG:teuthology.orchestra.run.smithi166:> import subprocess 2022-01-10T01:31:51.236 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:31:51.236 DEBUG:teuthology.orchestra.run.smithi166:> def find_socket(client_name): 2022-01-10T01:31:51.237 DEBUG:teuthology.orchestra.run.smithi166:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2022-01-10T01:31:51.237 DEBUG:teuthology.orchestra.run.smithi166:> files = glob.glob(asok_path) 2022-01-10T01:31:51.238 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:31:51.238 DEBUG:teuthology.orchestra.run.smithi166:> # Given a non-glob path, it better be there 2022-01-10T01:31:51.238 DEBUG:teuthology.orchestra.run.smithi166:> if "*" not in asok_path: 2022-01-10T01:31:51.239 DEBUG:teuthology.orchestra.run.smithi166:> assert(len(files) == 1) 2022-01-10T01:31:51.239 DEBUG:teuthology.orchestra.run.smithi166:> return files[0] 2022-01-10T01:31:51.240 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:31:51.240 DEBUG:teuthology.orchestra.run.smithi166:> for f in files: 2022-01-10T01:31:51.240 DEBUG:teuthology.orchestra.run.smithi166:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:31:51.241 DEBUG:teuthology.orchestra.run.smithi166:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:31:51.241 DEBUG:teuthology.orchestra.run.smithi166:> return f 2022-01-10T01:31:51.242 DEBUG:teuthology.orchestra.run.smithi166:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:31:51.242 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:31:51.242 DEBUG:teuthology.orchestra.run.smithi166:> print(find_socket("client.1")) 2022-01-10T01:31:51.243 DEBUG:teuthology.orchestra.run.smithi166:> ' 2022-01-10T01:31:51.319 INFO:teuthology.orchestra.run.smithi166.stdout:/var/run/ceph/ceph-client.1.14355.asok 2022-01-10T01:31:51.324 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14355.asok 2022-01-10T01:31:51.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:51.325 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14355.asok status 2022-01-10T01:31:51.413 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2022-01-10T01:31:51.414 INFO:teuthology.orchestra.run.smithi166.stdout: "metadata": { 2022-01-10T01:31:51.414 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:31:51.414 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:31:51.414 INFO:teuthology.orchestra.run.smithi166.stdout: "entity_id": "1", 2022-01-10T01:31:51.415 INFO:teuthology.orchestra.run.smithi166.stdout: "hostname": "smithi166", 2022-01-10T01:31:51.415 INFO:teuthology.orchestra.run.smithi166.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2022-01-10T01:31:51.415 INFO:teuthology.orchestra.run.smithi166.stdout: "pid": "14355", 2022-01-10T01:31:51.415 INFO:teuthology.orchestra.run.smithi166.stdout: "root": "/" 2022-01-10T01:31:51.416 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:31:51.416 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_count": 0, 2022-01-10T01:31:51.416 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_pinned_count": 0, 2022-01-10T01:31:51.416 INFO:teuthology.orchestra.run.smithi166.stdout: "id": 36314, 2022-01-10T01:31:51.417 INFO:teuthology.orchestra.run.smithi166.stdout: "inst": { 2022-01-10T01:31:51.417 INFO:teuthology.orchestra.run.smithi166.stdout: "name": { 2022-01-10T01:31:51.417 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "client", 2022-01-10T01:31:51.417 INFO:teuthology.orchestra.run.smithi166.stdout: "num": 36314 2022-01-10T01:31:51.417 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:31:51.418 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:31:51.418 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:31:51.418 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:31:51.418 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 710318725 2022-01-10T01:31:51.419 INFO:teuthology.orchestra.run.smithi166.stdout: } 2022-01-10T01:31:51.419 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:31:51.419 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:31:51.419 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:31:51.419 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:31:51.420 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 710318725 2022-01-10T01:31:51.420 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:31:51.420 INFO:teuthology.orchestra.run.smithi166.stdout: "inst_str": "client.36314 172.21.15.166:0/710318725", 2022-01-10T01:31:51.420 INFO:teuthology.orchestra.run.smithi166.stdout: "addr_str": "172.21.15.166:0/710318725", 2022-01-10T01:31:51.421 INFO:teuthology.orchestra.run.smithi166.stdout: "inode_count": 1, 2022-01-10T01:31:51.421 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_epoch": 46, 2022-01-10T01:31:51.421 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch": 100, 2022-01-10T01:31:51.421 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:31:51.421 INFO:teuthology.orchestra.run.smithi166.stdout: "blacklisted": false, 2022-01-10T01:31:51.422 INFO:teuthology.orchestra.run.smithi166.stdout: "fs_name": "cephfs" 2022-01-10T01:31:51.422 INFO:teuthology.orchestra.run.smithi166.stdout:} 2022-01-10T01:31:51.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:51.424 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:51.424 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:51.432 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:31:51.433 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:31:51.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:51.434 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:51.491 INFO:teuthology.orchestra.run:Running command with timeout 10800 2022-01-10T01:31:51.492 DEBUG:teuthology.orchestra.run.smithi139:> cd /home/ubuntu/cephtest/mnt.0 && sudo mkdir -p foo 2022-01-10T01:31:51.522 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-01-10T01:31:51.523 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:31:51.523 DEBUG:teuthology.orchestra.run.smithi139:> import stat 2022-01-10T01:31:51.523 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:31:51.524 DEBUG:teuthology.orchestra.run.smithi139:> print(os.stat("/home/ubuntu/cephtest/mnt.0/foo").st_ino) 2022-01-10T01:31:51.524 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:31:51.642 INFO:teuthology.orchestra.run.smithi139.stdout:1099511627776 2022-01-10T01:31:51.835 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:51.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f1794994700 1 Processor -- start 2022-01-10T01:31:51.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f1794994700 1 -- start start 2022-01-10T01:31:51.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f1794994700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17900b0010 0x7f17900a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:51.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f1794994700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f17900afbd0 0x7f17900a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:51.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f1794994700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17900a70c0 con 0x7f17900b2580 2022-01-10T01:31:51.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f1794994700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17900a72f0 con 0x7f17900afbd0 2022-01-10T01:31:51.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f1794994700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17900a7590 con 0x7f17900b0010 2022-01-10T01:31:51.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f178ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f17900afbd0 0x7f17900a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:51.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f178ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f17900afbd0 0x7f17900a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39690/0 (socket says 172.21.15.36:39690) 2022-01-10T01:31:51.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f178ffff700 1 -- 172.21.15.36:0/2185856943 learned_addr learned my addr 172.21.15.36:0/2185856943 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:51.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f178effd700 1 --2- 172.21.15.36:0/2185856943 >> v2:172.21.15.59:3300/0 conn(0x7f17900b0010 0x7f17900a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:51.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f178ffff700 1 -- 172.21.15.36:0/2185856943 >> v2:172.21.15.59:3300/0 conn(0x7f17900b0010 msgr2=0x7f17900a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:51.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f178ffff700 1 --2- 172.21.15.36:0/2185856943 >> v2:172.21.15.59:3300/0 conn(0x7f17900b0010 0x7f17900a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:51.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f178ffff700 1 -- 172.21.15.36:0/2185856943 >> v1:172.21.15.36:6789/0 conn(0x7f17900b2580 legacy=0x7f179014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:51.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f178ffff700 1 -- 172.21.15.36:0/2185856943 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17900a7830 con 0x7f17900afbd0 2022-01-10T01:31:51.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f178ffff700 1 --2- 172.21.15.36:0/2185856943 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17900afbd0 0x7f17900a88a0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f1788002f70 tx=0x7f1788006eb0).ready entity=mon.0 client_cookie=35fd9bfbe221c586 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:51.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f178e7fc700 1 -- 172.21.15.36:0/2185856943 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f178800d5c0 con 0x7f17900afbd0 2022-01-10T01:31:51.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f178e7fc700 1 -- 172.21.15.36:0/2185856943 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1788000e90 con 0x7f17900afbd0 2022-01-10T01:31:51.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f178e7fc700 1 -- 172.21.15.36:0/2185856943 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f178800d950 con 0x7f17900afbd0 2022-01-10T01:31:51.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f1794994700 1 -- 172.21.15.36:0/2185856943 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17900afbd0 msgr2=0x7f17900a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:51.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.944+0000 7f1794994700 1 --2- 172.21.15.36:0/2185856943 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17900afbd0 0x7f17900a88a0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f1788002f70 tx=0x7f1788006eb0).stop 2022-01-10T01:31:51.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 -- 172.21.15.36:0/2185856943 shutdown_connections 2022-01-10T01:31:51.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 --2- 172.21.15.36:0/2185856943 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17900afbd0 0x7f17900a88a0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:51.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 --2- 172.21.15.36:0/2185856943 >> v2:172.21.15.59:3300/0 conn(0x7f17900b0010 0x7f17900a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:51.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 -- 172.21.15.36:0/2185856943 >> 172.21.15.36:0/2185856943 conn(0x7f1790060180 msgr2=0x7f17900b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:51.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 -- 172.21.15.36:0/2185856943 shutdown_connections 2022-01-10T01:31:51.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 -- 172.21.15.36:0/2185856943 wait complete. 2022-01-10T01:31:51.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 Processor -- start 2022-01-10T01:31:51.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 -- start start 2022-01-10T01:31:51.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17900afbd0 0x7f179014a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:51.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17900b0010 0x7f1790064dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:51.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17900b2580 0x7f17900652b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:51.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17900ac520 con 0x7f17900afbd0 2022-01-10T01:31:51.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1790063180 con 0x7f17900b2580 2022-01-10T01:31:51.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1790063420 con 0x7f17900b0010 2022-01-10T01:31:51.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f178f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17900afbd0 0x7f179014a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:51.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f178f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17900afbd0 0x7f179014a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39692/0 (socket says 172.21.15.36:39692) 2022-01-10T01:31:51.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f178f7fe700 1 -- 172.21.15.36:0/367109719 learned_addr learned my addr 172.21.15.36:0/367109719 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:51.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f178effd700 1 --2- 172.21.15.36:0/367109719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17900b0010 0x7f1790064dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:51.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f178ffff700 1 --2- 172.21.15.36:0/367109719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17900b2580 0x7f17900652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:51.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f178f7fe700 1 -- 172.21.15.36:0/367109719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17900b0010 msgr2=0x7f1790064dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:51.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f178f7fe700 1 --2- 172.21.15.36:0/367109719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17900b0010 0x7f1790064dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:51.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f178f7fe700 1 -- 172.21.15.36:0/367109719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17900b2580 msgr2=0x7f17900652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:51.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f178f7fe700 1 --2- 172.21.15.36:0/367109719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17900b2580 0x7f17900652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:51.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f178f7fe700 1 -- 172.21.15.36:0/367109719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178800b1e0 con 0x7f17900afbd0 2022-01-10T01:31:51.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f178f7fe700 1 --2- 172.21.15.36:0/367109719 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17900afbd0 0x7f179014a640 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f179006b7c0 tx=0x7f1784007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:51.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f178cff9700 1 -- 172.21.15.36:0/367109719 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f178400ce30 con 0x7f17900afbd0 2022-01-10T01:31:51.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f178cff9700 1 -- 172.21.15.36:0/367109719 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178400f470 con 0x7f17900afbd0 2022-01-10T01:31:51.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 -- 172.21.15.36:0/367109719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1790156690 con 0x7f17900afbd0 2022-01-10T01:31:51.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f178cff9700 1 -- 172.21.15.36:0/367109719 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f178400f7d0 con 0x7f17900afbd0 2022-01-10T01:31:51.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.948+0000 7f1794994700 1 -- 172.21.15.36:0/367109719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1790154200 con 0x7f17900afbd0 2022-01-10T01:31:51.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.952+0000 7f178cff9700 1 -- 172.21.15.36:0/367109719 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1784019030 con 0x7f17900afbd0 2022-01-10T01:31:51.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.952+0000 7f1794994700 1 -- 172.21.15.36:0/367109719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1790057350 con 0x7f17900afbd0 2022-01-10T01:31:51.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.952+0000 7f178cff9700 1 --2- 172.21.15.36:0/367109719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1770053620 0x7f1770055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:51.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.952+0000 7f178cff9700 1 -- 172.21.15.36:0/367109719 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f178406ae10 con 0x7f17900afbd0 2022-01-10T01:31:51.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.952+0000 7f178effd700 1 --2- 172.21.15.36:0/367109719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1770053620 0x7f1770055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:51.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.952+0000 7f178effd700 1 --2- 172.21.15.36:0/367109719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1770053620 0x7f1770055ae0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f178000b000 tx=0x7f1780008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:51.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:51.960+0000 7f178cff9700 1 -- 172.21.15.36:0/367109719 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1784041e20 con 0x7f17900afbd0 2022-01-10T01:31:52.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.124+0000 7f1794994700 1 -- 172.21.15.36:0/367109719 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17900698e0 con 0x7f17900afbd0 2022-01-10T01:31:52.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.128+0000 7f178cff9700 1 -- 172.21.15.36:0/367109719 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f1784045440 con 0x7f17900afbd0 2022-01-10T01:31:52.129 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:52.130 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":46,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6933,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4213696854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4213696854},{"type":"v1","addr":"172.21.15.59:6833","nonce":4213696854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44},{"gid":6945,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/4101368080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":4101368080},{"type":"v1","addr":"172.21.15.36:6835","nonce":4101368080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:31:42.305072+0000","modified":"2022-01-10T01:31:43.308110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6948},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6948":{"gid":6948,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/2977677722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":2977677722},{"type":"v1","addr":"172.21.15.36:6837","nonce":2977677722}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2022-01-10T01:31:52.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.132+0000 7f1794994700 1 -- 172.21.15.36:0/367109719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1770053620 msgr2=0x7f1770055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:52.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.132+0000 7f1794994700 1 --2- 172.21.15.36:0/367109719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1770053620 0x7f1770055ae0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f178000b000 tx=0x7f1780008040).stop 2022-01-10T01:31:52.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.132+0000 7f1794994700 1 -- 172.21.15.36:0/367109719 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17900afbd0 msgr2=0x7f179014a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:52.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.132+0000 7f1794994700 1 --2- 172.21.15.36:0/367109719 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17900afbd0 0x7f179014a640 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f179006b7c0 tx=0x7f1784007c50).stop 2022-01-10T01:31:52.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.132+0000 7f1794994700 1 -- 172.21.15.36:0/367109719 shutdown_connections 2022-01-10T01:31:52.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.132+0000 7f1794994700 1 --2- 172.21.15.36:0/367109719 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1770053620 0x7f1770055ae0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:52.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.132+0000 7f1794994700 1 --2- 172.21.15.36:0/367109719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17900b2580 0x7f17900652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:52.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.132+0000 7f1794994700 1 --2- 172.21.15.36:0/367109719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17900b0010 0x7f1790064dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:52.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.132+0000 7f1794994700 1 --2- 172.21.15.36:0/367109719 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17900afbd0 0x7f179014a640 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:52.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.132+0000 7f1794994700 1 -- 172.21.15.36:0/367109719 >> 172.21.15.36:0/367109719 conn(0x7f1790060180 msgr2=0x7f1790148b50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:52.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.132+0000 7f1794994700 1 -- 172.21.15.36:0/367109719 shutdown_connections 2022-01-10T01:31:52.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.132+0000 7f1794994700 1 -- 172.21.15.36:0/367109719 wait complete. 2022-01-10T01:31:52.137 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 46 2022-01-10T01:31:52.149 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json dump inode 0x10000000000 2022-01-10T01:31:52.259 INFO:teuthology.orchestra.run.smithi036.stdout:{"path":"/foo","ino":1099511627776,"rdev":0,"ctime":"2022-01-10T01:31:51.514520+0000","btime":"2022-01-10T01:31:51.514520+0000","mode":16877,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2022-01-10T01:31:51.514520+0000","atime":"2022-01-10T01:31:51.514520+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":7096,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":7096,"want_loner":7096,"mds_caps_wanted":[]} 2022-01-10T01:31:52.260 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2022-01-10T01:31:51.514520+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "backtrace_version": 2, "btime": "2022-01-10T01:31:51.514520+0000", "change_attr": 0, "client_caps": [ { "client_id": 7096, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2022-01-10T01:31:51.514520+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 0, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 7096, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2022-01-10T01:31:51.514520+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/foo", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 0, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 7096, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "xattrs": [] } 2022-01-10T01:31:52.261 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:31:52.261 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:52.281 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:52.302 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:52.324 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:31:52.345 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:31:52.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:52.346 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:52.346 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:52.375 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:31:52.377 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:31:52.377 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:31:52.378 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:31:52.379 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:52.394 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14862]: fuse finished with error 0 and tester_r 0 2022-01-10T01:31:52.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:52.397 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:52.397 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:52.405 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:31:52.406 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:31:52.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:31:52.523 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:31:52.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:52.536 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:52.536 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:52.546 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:31:52.548 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:31:52.548 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi166.front.sepia.ceph.com... 2022-01-10T01:31:52.549 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:31:52.549 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:52.622 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14355]: fuse finished with error 0 and tester_r 0 2022-01-10T01:31:52.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:31:52.632 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:31:52.632 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:52.684 INFO:teuthology.orchestra.run.smithi166.stdout:ext2/ext3 2022-01-10T01:31:52.686 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:31:52.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:31:52.805 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:31:52.818 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:31:52.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.928+0000 7f357e824700 1 Processor -- start 2022-01-10T01:31:52.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.928+0000 7f357e824700 1 -- start start 2022-01-10T01:31:52.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f357805c7d0 0x7f35780b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:52.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f357813f390 0x7f35780aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:52.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357805cbb0 con 0x7f357805d0b0 2022-01-10T01:31:52.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35780ad540 con 0x7f357805c7d0 2022-01-10T01:31:52.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3578067d70 con 0x7f357813f390 2022-01-10T01:31:52.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357d822700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f357805c7d0 0x7f35780b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:52.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e023700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f357813f390 0x7f35780aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:52.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357d822700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f357805c7d0 0x7f35780b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39702/0 (socket says 172.21.15.36:39702) 2022-01-10T01:31:52.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357d021700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f357805d0b0 0x7f35780ace30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:55170/0 (socket says 172.21.15.36:55170) 2022-01-10T01:31:52.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357d822700 1 -- 172.21.15.36:0/2803994692 learned_addr learned my addr 172.21.15.36:0/2803994692 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:52.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357c820700 1 -- 172.21.15.36:0/2803994692 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092526615 0 0) 0x7f357805cbb0 con 0x7f357805d0b0 2022-01-10T01:31:52.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357d822700 1 -- 172.21.15.36:0/2803994692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f357813f390 msgr2=0x7f35780aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:52.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357d822700 1 --2- 172.21.15.36:0/2803994692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f357813f390 0x7f35780aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:52.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357d822700 1 -- 172.21.15.36:0/2803994692 >> v1:172.21.15.59:6789/0 conn(0x7f357805d0b0 legacy=0x7f35780ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:52.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357d822700 1 -- 172.21.15.36:0/2803994692 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35780b1790 con 0x7f357805c7d0 2022-01-10T01:31:52.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357d822700 1 --2- 172.21.15.36:0/2803994692 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f357805c7d0 0x7f35780b10f0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f3574002f70 tx=0x7f3574006eb0).ready entity=mon.0 client_cookie=18a1983b4f9cce9e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:52.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357c820700 1 -- 172.21.15.36:0/2803994692 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f357400d570 con 0x7f357805c7d0 2022-01-10T01:31:52.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357c820700 1 -- 172.21.15.36:0/2803994692 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3574000e90 con 0x7f357805c7d0 2022-01-10T01:31:52.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357c820700 1 -- 172.21.15.36:0/2803994692 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f357400d8c0 con 0x7f357805c7d0 2022-01-10T01:31:52.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 -- 172.21.15.36:0/2803994692 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f357805c7d0 msgr2=0x7f35780b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:52.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 --2- 172.21.15.36:0/2803994692 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f357805c7d0 0x7f35780b10f0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f3574002f70 tx=0x7f3574006eb0).stop 2022-01-10T01:31:52.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 -- 172.21.15.36:0/2803994692 shutdown_connections 2022-01-10T01:31:52.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 --2- 172.21.15.36:0/2803994692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f357813f390 0x7f35780aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:52.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 --2- 172.21.15.36:0/2803994692 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f357805c7d0 0x7f35780b10f0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:52.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 -- 172.21.15.36:0/2803994692 >> 172.21.15.36:0/2803994692 conn(0x7f3578060180 msgr2=0x7f35780b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:52.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 -- 172.21.15.36:0/2803994692 shutdown_connections 2022-01-10T01:31:52.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 -- 172.21.15.36:0/2803994692 wait complete. 2022-01-10T01:31:52.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 Processor -- start 2022-01-10T01:31:52.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.932+0000 7f357e824700 1 -- start start 2022-01-10T01:31:52.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357e824700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f357805c7d0 0x7f3578136b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:52.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357e824700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f357805d0b0 0x7f3578137030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:52.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357e824700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f357813f390 0x7f3578152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:52.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357e824700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3578137520 con 0x7f357805d0b0 2022-01-10T01:31:52.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357e824700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35780aba60 con 0x7f357813f390 2022-01-10T01:31:52.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357e824700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3578153120 con 0x7f357805c7d0 2022-01-10T01:31:52.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357d021700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f357805d0b0 0x7f3578137030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:52.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357d021700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f357805d0b0 0x7f3578137030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39706/0 (socket says 172.21.15.36:39706) 2022-01-10T01:31:52.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357d021700 1 -- 172.21.15.36:0/3038704382 learned_addr learned my addr 172.21.15.36:0/3038704382 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:52.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357e023700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f357813f390 0x7f3578152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:52.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357d822700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f357805c7d0 0x7f3578136b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:52.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357d021700 1 -- 172.21.15.36:0/3038704382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f357805c7d0 msgr2=0x7f3578136b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:52.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357d021700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f357805c7d0 0x7f3578136b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:52.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357d021700 1 -- 172.21.15.36:0/3038704382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f357813f390 msgr2=0x7f3578152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:52.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357d021700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f357813f390 0x7f3578152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:52.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357d021700 1 -- 172.21.15.36:0/3038704382 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357400b1e0 con 0x7f357805d0b0 2022-01-10T01:31:52.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357d822700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f357805c7d0 0x7f3578136b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:31:52.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357d021700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f357805d0b0 0x7f3578137030 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f3578137660 tx=0x7f3568007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:52.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f3566ffd700 1 -- 172.21.15.36:0/3038704382 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f356800ce40 con 0x7f357805d0b0 2022-01-10T01:31:52.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f3566ffd700 1 -- 172.21.15.36:0/3038704382 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3568007170 con 0x7f357805d0b0 2022-01-10T01:31:52.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357e824700 1 -- 172.21.15.36:0/3038704382 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35780abc90 con 0x7f357805d0b0 2022-01-10T01:31:52.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f3566ffd700 1 -- 172.21.15.36:0/3038704382 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3568004730 con 0x7f357805d0b0 2022-01-10T01:31:52.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357e824700 1 -- 172.21.15.36:0/3038704382 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35780b2dd0 con 0x7f357805d0b0 2022-01-10T01:31:52.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f357e824700 1 -- 172.21.15.36:0/3038704382 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35780b1a30 con 0x7f357805d0b0 2022-01-10T01:31:52.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.936+0000 7f3566ffd700 1 -- 172.21.15.36:0/3038704382 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3568004890 con 0x7f357805d0b0 2022-01-10T01:31:52.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.940+0000 7f3566ffd700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3558053680 0x7f3558055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:52.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.940+0000 7f3566ffd700 1 -- 172.21.15.36:0/3038704382 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f356806b470 con 0x7f357805d0b0 2022-01-10T01:31:52.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.940+0000 7f357d822700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3558053680 0x7f3558055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:52.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.940+0000 7f357d822700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3558053680 0x7f3558055b40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f3574017000 tx=0x7f3574015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:52.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:52.944+0000 7f3566ffd700 1 -- 172.21.15.36:0/3038704382 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3568042420 con 0x7f357805d0b0 2022-01-10T01:31:53.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.072+0000 7f357e824700 1 -- 172.21.15.36:0/3038704382 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3578153290 con 0x7f357805d0b0 2022-01-10T01:31:53.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.076+0000 7f3566ffd700 1 -- 172.21.15.36:0/3038704382 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v100) v1 ==== 81+0+34042 (secure 0 0 0) 0x7f3578153290 con 0x7f357805d0b0 2022-01-10T01:31:53.080 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:53.080 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:31:53.081 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 100, 2022-01-10T01:31:53.081 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:31:53.081 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:31:53.081 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:31:43.308928+0000", 2022-01-10T01:31:53.082 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:31:53.082 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:31:53.082 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:31:53.082 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:31:53.083 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:31:53.083 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:31:53.083 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:31:53.083 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:31:53.084 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:31:53.084 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:53.084 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:31:53.084 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:31:53.084 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:31:53.085 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:31:53.085 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:31:53.085 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 18, 2022-01-10T01:31:53.085 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:31:53.086 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:31:53.086 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:31:53.086 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:31:53.086 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:31:53.086 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.087 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:31:53.087 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:31:53.087 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:31:53.087 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:53.088 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:53.088 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:53.088 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:53.088 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:53.089 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:53.089 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:53.089 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:53.089 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:31:53.090 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:31:53.090 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:31:53.090 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:31:53.090 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:31:53.091 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:53.091 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:53.091 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:53.091 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:53.092 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:53.092 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:53.092 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:53.093 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.093 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:31:53.093 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:53.093 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:53.094 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:53.094 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:53.094 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:53.094 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:53.095 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:53.095 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:53.095 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:53.095 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:53.096 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:53.096 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:53.096 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:53.096 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:53.096 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:53.097 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:53.097 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:53.097 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:53.097 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:53.098 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:53.098 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:53.098 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:53.098 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:53.099 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:53.099 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:53.099 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:53.099 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.099 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:53.100 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:53.100 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:53.100 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:53.100 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:53.101 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:53.101 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:53.101 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:53.101 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:53.101 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:53.102 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:53.102 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:31:53.102 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:31:53.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.103 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:53.103 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:31:53.103 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.103 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.104 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.104 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:31:53.104 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:31:53.105 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:31:53.105 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:53.105 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:53.106 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:53.106 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:53.106 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:53.106 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:53.107 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:53.107 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:53.107 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:31:53.107 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:31:53.108 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:31:53.108 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:31:53.108 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:31:53.108 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:53.109 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:53.109 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:53.109 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:53.109 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:53.110 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:53.110 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:53.110 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.110 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:31:53.111 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:53.111 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:53.111 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:53.111 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:53.111 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:53.112 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:53.112 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:53.112 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:53.112 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:53.113 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:53.113 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:53.113 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:53.113 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:53.114 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:53.114 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:53.114 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:53.114 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:53.115 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:53.115 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:53.115 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:53.115 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:53.116 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:53.116 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:53.116 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:53.116 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:53.117 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:53.117 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.117 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:53.118 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:53.118 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:53.118 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:53.118 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:53.119 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:53.119 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:53.119 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:53.119 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:53.120 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:53.120 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:53.120 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:31:53.120 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:53.121 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:31:53.121 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.121 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.121 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.122 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 17, 2022-01-10T01:31:53.122 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_metadata", 2022-01-10T01:31:53.122 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:31:40.098588+0000", 2022-01-10T01:31:53.122 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:53.123 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:53.123 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:53.123 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:53.123 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:53.124 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:53.124 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:53.124 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:53.124 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:31:53.125 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:31:53.125 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:31:53.125 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:31:53.125 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:31:53.126 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:53.126 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:53.126 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:53.126 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:53.127 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:53.127 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:53.127 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:53.128 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.128 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "99", 2022-01-10T01:31:53.128 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:53.128 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:53.129 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:53.129 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:53.129 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:53.130 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:53.130 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:53.130 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:53.131 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:53.131 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:53.131 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:53.132 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:53.132 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:53.132 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:53.133 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:53.133 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:53.133 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:53.134 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:53.134 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:53.134 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:53.134 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:53.134 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:53.135 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:53.135 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:53.135 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:53.135 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:53.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.136 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:53.136 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:53.136 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:53.137 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:53.137 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:53.137 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:53.137 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:53.138 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:53.138 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:53.138 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:53.138 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:53.138 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:31:53.139 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_bias": 4, 2022-01-10T01:31:53.139 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 16, 2022-01-10T01:31:53.139 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_priority": 5 2022-01-10T01:31:53.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.140 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:53.140 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:31:53.140 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": "cephfs" 2022-01-10T01:31:53.140 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.141 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.141 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.142 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 18, 2022-01-10T01:31:53.142 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_data", 2022-01-10T01:31:53.142 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:31:41.321500+0000", 2022-01-10T01:31:53.143 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:31:53.143 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:31:53.143 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:31:53.143 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:31:53.144 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:31:53.144 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:31:53.144 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:31:53.145 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:31:53.145 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:31:53.145 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:31:53.145 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:31:53.145 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:31:53.146 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:31:53.146 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:31:53.146 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:31:53.146 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:31:53.147 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:31:53.147 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:31:53.147 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:31:53.148 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:31:53.148 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.148 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "100", 2022-01-10T01:31:53.148 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:31:53.148 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:31:53.149 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:31:53.149 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:31:53.149 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:31:53.149 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:31:53.150 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:31:53.150 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:31:53.150 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:31:53.150 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:31:53.151 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:31:53.151 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:31:53.151 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:31:53.151 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:31:53.152 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:31:53.152 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:31:53.152 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:31:53.152 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:31:53.153 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:31:53.153 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:31:53.153 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:31:53.154 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:31:53.154 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:31:53.154 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:31:53.155 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:31:53.155 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:31:53.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.155 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:31:53.155 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:31:53.156 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:31:53.156 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:31:53.156 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:31:53.157 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:31:53.157 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:31:53.157 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:31:53.157 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:31:53.158 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:31:53.158 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:31:53.158 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:31:53.158 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:31:53.159 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:31:53.159 INFO:teuthology.orchestra.run.smithi036.stdout: "data": "cephfs" 2022-01-10T01:31:53.159 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.159 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.160 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.160 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:53.160 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:31:53.160 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.161 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:31:53.161 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:31:53.161 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:53.161 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:53.162 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:53.162 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:53.162 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:53.162 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:53.163 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:53.163 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 98, 2022-01-10T01:31:53.163 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:53.164 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:53.164 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:53.164 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.165 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.165 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.165 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:31:53.165 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:53.166 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.166 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.166 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.166 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:31:53.167 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:53.167 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.167 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.168 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.168 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:53.168 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.168 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.169 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:31:53.169 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:53.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.170 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.170 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:31:53.170 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:53.170 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.171 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.171 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.171 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:53.171 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.172 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.172 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:31:53.172 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:53.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.173 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.173 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:31:53.174 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:53.174 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.174 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.174 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:53.175 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.175 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.175 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.175 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:31:53.176 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:53.176 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.176 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.177 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:31:53.177 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:31:53.177 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.178 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.178 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:31:53.178 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:31:53.179 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:31:53.179 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:31:53.179 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:53.179 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:53.180 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:53.180 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.181 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:31:53.181 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:31:53.181 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:53.181 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:53.182 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:53.182 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:53.182 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:53.182 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:53.183 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:53.183 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 97, 2022-01-10T01:31:53.183 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:53.183 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:53.184 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:53.184 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.184 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.185 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:31:53.185 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:53.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.185 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.186 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:31:53.186 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:53.186 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.186 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.187 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:53.187 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.188 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.188 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:31:53.188 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:53.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.189 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.190 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:31:53.190 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:53.190 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.191 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.191 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:53.191 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.192 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.192 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:31:53.192 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:53.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.193 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.193 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:31:53.193 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:53.194 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.194 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.194 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:53.195 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.195 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.195 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:31:53.196 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:53.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.196 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.197 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:31:53.197 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:31:53.197 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.197 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.198 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:31:53.198 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:31:53.198 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:31:53.199 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:31:53.199 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:53.199 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:53.199 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:53.200 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.200 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:31:53.201 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:31:53.201 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:53.201 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:53.202 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:53.202 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:53.202 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:53.203 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:53.203 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:53.203 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 98, 2022-01-10T01:31:53.203 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:53.204 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:53.204 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:53.204 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.204 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.205 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:31:53.205 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:53.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.206 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.206 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:31:53.206 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:53.206 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.207 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.207 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:53.207 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.208 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.208 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:31:53.208 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:53.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.209 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.209 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:31:53.210 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:53.210 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.210 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.211 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:53.211 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.211 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.211 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:31:53.212 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:53.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.212 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.213 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:31:53.213 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:53.213 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.213 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.214 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.214 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:53.214 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.215 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.215 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:31:53.215 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:53.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.216 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.216 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:31:53.217 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:31:53.217 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.217 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.218 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:31:53.218 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:31:53.218 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:31:53.218 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:31:53.219 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:53.219 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:53.219 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:53.219 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.220 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:31:53.220 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:31:53.220 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:53.221 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:53.221 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:53.221 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:53.221 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:53.222 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:53.222 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:53.222 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 86, 2022-01-10T01:31:53.222 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:53.223 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:53.223 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:53.223 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.224 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.224 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:31:53.224 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:53.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.224 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.225 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.225 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:31:53.225 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:53.226 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.226 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.227 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:53.227 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.227 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.228 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:31:53.228 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:53.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.229 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.229 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:31:53.229 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:53.229 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.230 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.230 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:53.230 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.231 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.231 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:31:53.231 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:53.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.232 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.232 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.232 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:31:53.232 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:53.233 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.233 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.233 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:53.233 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.234 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.234 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:31:53.234 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:53.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.235 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.235 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:31:53.236 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:31:53.236 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.236 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.236 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:31:53.237 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:31:53.237 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:31:53.237 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:31:53.238 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:53.238 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:53.238 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:53.239 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.239 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:31:53.240 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:31:53.240 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:53.240 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:53.240 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:53.241 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:53.241 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:53.241 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:53.241 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:53.242 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 98, 2022-01-10T01:31:53.242 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:53.242 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:53.242 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:53.243 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.243 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.243 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:31:53.244 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:53.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.244 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.244 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:31:53.245 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:53.245 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.245 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.245 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.246 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:53.246 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.246 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.247 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:31:53.247 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:53.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.248 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.248 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:31:53.248 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:53.248 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.249 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.249 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:53.249 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.250 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.250 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:31:53.251 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:53.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.251 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.252 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:31:53.252 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:53.252 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.252 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.253 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.253 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:53.253 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.254 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.254 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:31:53.254 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:53.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.255 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.255 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:31:53.255 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:31:53.256 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.256 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.256 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:31:53.256 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:31:53.257 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:31:53.257 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:31:53.257 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:53.257 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:53.258 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:53.258 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.259 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:31:53.259 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:31:53.259 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:53.259 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:53.260 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:53.260 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:53.260 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:53.260 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:53.260 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:53.261 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 98, 2022-01-10T01:31:53.261 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:53.261 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:53.261 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:53.262 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.262 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.263 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:31:53.263 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:53.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.264 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.264 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:31:53.264 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:53.265 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.265 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.265 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:53.265 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.266 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.266 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:31:53.266 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:53.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.267 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.267 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:31:53.268 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:53.268 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.268 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.269 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:53.269 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.269 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.270 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:31:53.270 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:53.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.270 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.271 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.271 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:31:53.271 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:53.271 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.272 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.272 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:53.272 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.273 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.273 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:31:53.273 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:53.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.274 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.274 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:31:53.275 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:31:53.275 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.275 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.276 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:31:53.276 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:31:53.277 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:31:53.277 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:31:53.277 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:53.277 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:53.277 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:53.278 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.278 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:31:53.279 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:31:53.279 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:53.279 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:53.280 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:53.280 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:53.280 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:53.280 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:53.280 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:53.281 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 98, 2022-01-10T01:31:53.281 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:53.281 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:53.281 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:53.282 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.282 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.282 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:31:53.283 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:53.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.283 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.284 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:31:53.284 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:53.284 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.284 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.285 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:53.285 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.285 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.286 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:31:53.286 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:53.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.286 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.287 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.287 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:31:53.287 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:53.288 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.288 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.288 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:53.289 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.289 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.290 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:31:53.290 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:53.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.291 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.291 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:31:53.291 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:53.291 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.291 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.292 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:53.292 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.293 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.293 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:31:53.293 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:53.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.294 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.294 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:31:53.294 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:31:53.295 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.295 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.295 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:31:53.295 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:31:53.296 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:31:53.296 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:31:53.296 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:53.296 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:53.297 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:53.297 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.298 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:31:53.298 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:31:53.298 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:31:53.299 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:31:53.299 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:31:53.299 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:31:53.300 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:31:53.300 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:31:53.300 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:31:53.301 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 98, 2022-01-10T01:31:53.301 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:31:53.301 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:31:53.301 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:31:53.302 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.302 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.303 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:31:53.303 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:53.303 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.304 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.304 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:31:53.304 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:53.304 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.304 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.305 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:31:53.305 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.306 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.306 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:31:53.306 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:53.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.307 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.307 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:31:53.307 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:53.308 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.308 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.308 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:31:53.309 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.309 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.309 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:31:53.310 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:53.310 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.310 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.311 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:31:53.311 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:53.311 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.312 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.312 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:31:53.312 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:31:53.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.313 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:31:53.313 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:31:53.313 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:53.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.314 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:31:53.314 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:31:53.314 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:31:53.315 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.315 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.315 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:31:53.315 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:31:53.316 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:31:53.316 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:31:53.316 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:31:53.316 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:31:53.317 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:31:53.317 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:31:53.317 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.317 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:53.318 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:31:53.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.318 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:31:53.318 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:53.319 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:53.319 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:53.319 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:53.319 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:53.320 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:31:53.320 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:53.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.321 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:31:53.321 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:53.321 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:53.321 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:53.321 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:53.322 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:53.322 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:31:53.322 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:53.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.323 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.323 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:31:53.323 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:53.323 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:53.324 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:53.324 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:53.324 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:53.324 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:31:53.324 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:53.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.325 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:31:53.325 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:53.326 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:53.326 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:53.326 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:53.326 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:53.327 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:31:53.327 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:53.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.328 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:31:53.328 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:53.328 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:53.328 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:53.328 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:53.329 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:53.329 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:31:53.329 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:53.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.330 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:31:53.330 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:53.330 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:53.331 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:53.331 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:53.331 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:53.331 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:31:53.332 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:53.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.332 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:31:53.332 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:53.333 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:53.333 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:53.333 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:53.333 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:53.334 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:31:53.334 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:53.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:31:53.335 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:31:53.335 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:31:53.335 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:31:53.336 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:31:53.336 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:31:53.336 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:31:53.336 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:31:53.336 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:31:53.337 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.337 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:31:53.337 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:31:53.337 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:31:53.338 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:31:53.338 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:31:53.338 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2022-01-10T01:31:53.339 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:31:53.339 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:31:53.339 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:31:53.339 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:31:53.340 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:31:53.340 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:31:53.340 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:31:53.340 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:31:53.340 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:31:53.341 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:31:53.341 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:31:53.341 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:31:53.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.342 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:31:53.342 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:31:53.342 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:31:53.342 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:31:53.343 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:31:53.343 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:31:53.343 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:31:53.344 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:31:53.344 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:31:53.344 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:31:53.344 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:31:53.345 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:31:53.345 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:31:53.345 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:31:53.345 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:31:53.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.080+0000 7f357e824700 1 -- 172.21.15.36:0/3038704382 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3558053680 msgr2=0x7f3558055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:53.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.080+0000 7f357e824700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3558053680 0x7f3558055b40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f3574017000 tx=0x7f3574015000).stop 2022-01-10T01:31:53.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.080+0000 7f357e824700 1 -- 172.21.15.36:0/3038704382 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f357805d0b0 msgr2=0x7f3578137030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:53.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.080+0000 7f357e824700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f357805d0b0 0x7f3578137030 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f3578137660 tx=0x7f3568007ab0).stop 2022-01-10T01:31:53.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.080+0000 7f357e824700 1 -- 172.21.15.36:0/3038704382 shutdown_connections 2022-01-10T01:31:53.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.080+0000 7f357e824700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3558053680 0x7f3558055b40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.080+0000 7f357e824700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f357813f390 0x7f3578152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.080+0000 7f357e824700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f357805d0b0 0x7f3578137030 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.080+0000 7f357e824700 1 --2- 172.21.15.36:0/3038704382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f357805c7d0 0x7f3578136b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.080+0000 7f357e824700 1 -- 172.21.15.36:0/3038704382 >> 172.21.15.36:0/3038704382 conn(0x7f3578060180 msgr2=0x7f35780af960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:53.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.080+0000 7f357e824700 1 -- 172.21.15.36:0/3038704382 shutdown_connections 2022-01-10T01:31:53.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.080+0000 7f357e824700 1 -- 172.21.15.36:0/3038704382 wait complete. 2022-01-10T01:31:53.351 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:53.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.460+0000 7f13388f4700 1 Processor -- start 2022-01-10T01:31:53.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.460+0000 7f13388f4700 1 -- start start 2022-01-10T01:31:53.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f13388f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13340b6580 0x7f13340b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:53.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f13388f4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f13340b6960 0x7f133412ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:53.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f13388f4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13341440b0 con 0x7f13340b43c0 2022-01-10T01:31:53.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f13388f4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1334143b70 con 0x7f13340b6960 2022-01-10T01:31:53.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f13388f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1334143e10 con 0x7f13340b6580 2022-01-10T01:31:53.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f1332d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f13340b6960 0x7f133412ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:53.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f1332d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f13340b6960 0x7f133412ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39718/0 (socket says 172.21.15.36:39718) 2022-01-10T01:31:53.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f1332d9d700 1 -- 172.21.15.36:0/1633513648 learned_addr learned my addr 172.21.15.36:0/1633513648 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:53.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f133259c700 1 --2- 172.21.15.36:0/1633513648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13340b6580 0x7f13340b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:53.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f1332d9d700 1 -- 172.21.15.36:0/1633513648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13340b6580 msgr2=0x7f13340b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:53.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f1332d9d700 1 --2- 172.21.15.36:0/1633513648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13340b6580 0x7f13340b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f1332d9d700 1 -- 172.21.15.36:0/1633513648 >> v1:172.21.15.59:6789/0 conn(0x7f13340b43c0 legacy=0x7f1334061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:53.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f1331d9b700 1 -- 172.21.15.36:0/1633513648 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650108898 0 0) 0x7f13341440b0 con 0x7f13340b43c0 2022-01-10T01:31:53.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f1332d9d700 1 -- 172.21.15.36:0/1633513648 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13340615f0 con 0x7f13340b6960 2022-01-10T01:31:53.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f1332d9d700 1 --2- 172.21.15.36:0/1633513648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13340b6960 0x7f133412ba00 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f132c0032f0 tx=0x7f132c009290).ready entity=mon.0 client_cookie=beacaa38f9073040 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:53.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f1331d9b700 1 -- 172.21.15.36:0/1633513648 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f132c00b8a0 con 0x7f13340b6960 2022-01-10T01:31:53.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f1331d9b700 1 -- 172.21.15.36:0/1633513648 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c00ba00 con 0x7f13340b6960 2022-01-10T01:31:53.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f1331d9b700 1 -- 172.21.15.36:0/1633513648 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f132c00bb70 con 0x7f13340b6960 2022-01-10T01:31:53.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f13388f4700 1 -- 172.21.15.36:0/1633513648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13340b6960 msgr2=0x7f133412ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:53.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f13388f4700 1 --2- 172.21.15.36:0/1633513648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13340b6960 0x7f133412ba00 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f132c0032f0 tx=0x7f132c009290).stop 2022-01-10T01:31:53.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f13388f4700 1 -- 172.21.15.36:0/1633513648 shutdown_connections 2022-01-10T01:31:53.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f13388f4700 1 --2- 172.21.15.36:0/1633513648 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13340b6960 0x7f133412ba00 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.464+0000 7f13388f4700 1 --2- 172.21.15.36:0/1633513648 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13340b6580 0x7f13340b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f13388f4700 1 -- 172.21.15.36:0/1633513648 >> 172.21.15.36:0/1633513648 conn(0x7f133405c490 msgr2=0x7f133405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:53.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f13388f4700 1 -- 172.21.15.36:0/1633513648 shutdown_connections 2022-01-10T01:31:53.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f13388f4700 1 -- 172.21.15.36:0/1633513648 wait complete. 2022-01-10T01:31:53.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f13388f4700 1 Processor -- start 2022-01-10T01:31:53.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f13388f4700 1 -- start start 2022-01-10T01:31:53.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f13388f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13340b43c0 0x7f13340b9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:53.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f13388f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13340b6580 0x7f13340af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:53.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f13388f4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13340b6960 0x7f13340af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:53.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f13388f4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13340ae120 con 0x7f13340b6960 2022-01-10T01:31:53.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f13388f4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133414a740 con 0x7f13340b6580 2022-01-10T01:31:53.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f13388f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1334149f60 con 0x7f13340b43c0 2022-01-10T01:31:53.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f1332d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13340b6960 0x7f13340af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:53.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f133259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13340b43c0 0x7f13340b9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:53.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f132bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13340b6580 0x7f13340af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:53.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f1332d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13340b6960 0x7f13340af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39724/0 (socket says 172.21.15.36:39724) 2022-01-10T01:31:53.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f133259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13340b43c0 0x7f13340b9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:46002/0 (socket says 172.21.15.36:46002) 2022-01-10T01:31:53.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.468+0000 7f1332d9d700 1 -- 172.21.15.36:0/4285014904 learned_addr learned my addr 172.21.15.36:0/4285014904 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:53.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f1332d9d700 1 -- 172.21.15.36:0/4285014904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13340b43c0 msgr2=0x7f13340b9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:53.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f1332d9d700 1 --2- 172.21.15.36:0/4285014904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13340b43c0 0x7f13340b9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f1332d9d700 1 -- 172.21.15.36:0/4285014904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13340b6580 msgr2=0x7f13340af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:53.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f1332d9d700 1 --2- 172.21.15.36:0/4285014904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13340b6580 0x7f13340af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f1332d9d700 1 -- 172.21.15.36:0/4285014904 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c009530 con 0x7f13340b6960 2022-01-10T01:31:53.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f132bfff700 1 --2- 172.21.15.36:0/4285014904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13340b6580 0x7f13340af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:53.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f133259c700 1 --2- 172.21.15.36:0/4285014904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13340b43c0 0x7f13340b9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:31:53.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f1332d9d700 1 --2- 172.21.15.36:0/4285014904 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13340b6960 0x7f13340af710 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f13340aef40 tx=0x7f132c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:53.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f132b7fe700 1 -- 172.21.15.36:0/4285014904 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f132c00b8a0 con 0x7f13340b6960 2022-01-10T01:31:53.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f132b7fe700 1 -- 172.21.15.36:0/4285014904 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c021630 con 0x7f13340b6960 2022-01-10T01:31:53.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f132b7fe700 1 -- 172.21.15.36:0/4285014904 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f132c021990 con 0x7f13340b6960 2022-01-10T01:31:53.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f13388f4700 1 -- 172.21.15.36:0/4285014904 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133414a200 con 0x7f13340b6960 2022-01-10T01:31:53.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f13388f4700 1 -- 172.21.15.36:0/4285014904 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13340b8b70 con 0x7f13340b6960 2022-01-10T01:31:53.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f13388f4700 1 -- 172.21.15.36:0/4285014904 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13340aef80 con 0x7f13340b6960 2022-01-10T01:31:53.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f132b7fe700 1 -- 172.21.15.36:0/4285014904 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f132c027020 con 0x7f13340b6960 2022-01-10T01:31:53.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f132b7fe700 1 --2- 172.21.15.36:0/4285014904 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1318053680 0x7f1318055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:53.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f132b7fe700 1 -- 172.21.15.36:0/4285014904 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f132c06ccf0 con 0x7f13340b6960 2022-01-10T01:31:53.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.472+0000 7f133259c700 1 --2- 172.21.15.36:0/4285014904 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1318053680 0x7f1318055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:53.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.476+0000 7f133259c700 1 --2- 172.21.15.36:0/4285014904 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1318053680 0x7f1318055b40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f132400b000 tx=0x7f1324006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:53.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.480+0000 7f132b7fe700 1 -- 172.21.15.36:0/4285014904 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f13340aef80 con 0x7f13340b6960 2022-01-10T01:31:53.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.648+0000 7f13388f4700 1 -- 172.21.15.36:0/4285014904 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13340aef80 con 0x7f13340b6960 2022-01-10T01:31:53.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.648+0000 7f132b7fe700 1 -- 172.21.15.36:0/4285014904 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f13340aef80 con 0x7f13340b6960 2022-01-10T01:31:53.650 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:53.651 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":46,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6933,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4213696854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4213696854},{"type":"v1","addr":"172.21.15.59:6833","nonce":4213696854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44},{"gid":6945,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/4101368080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":4101368080},{"type":"v1","addr":"172.21.15.36:6835","nonce":4101368080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:31:42.305072+0000","modified":"2022-01-10T01:31:43.308110+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6948},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6948":{"gid":6948,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/2977677722","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":2977677722},{"type":"v1","addr":"172.21.15.36:6837","nonce":2977677722}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2022-01-10T01:31:53.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.648+0000 7f13388f4700 1 -- 172.21.15.36:0/4285014904 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1318053680 msgr2=0x7f1318055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:53.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.648+0000 7f13388f4700 1 --2- 172.21.15.36:0/4285014904 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1318053680 0x7f1318055b40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f132400b000 tx=0x7f1324006df0).stop 2022-01-10T01:31:53.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.648+0000 7f13388f4700 1 -- 172.21.15.36:0/4285014904 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13340b6960 msgr2=0x7f13340af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:53.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.648+0000 7f13388f4700 1 --2- 172.21.15.36:0/4285014904 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13340b6960 0x7f13340af710 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f13340aef40 tx=0x7f132c016000).stop 2022-01-10T01:31:53.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.652+0000 7f13388f4700 1 -- 172.21.15.36:0/4285014904 shutdown_connections 2022-01-10T01:31:53.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.652+0000 7f13388f4700 1 --2- 172.21.15.36:0/4285014904 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1318053680 0x7f1318055b40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.652+0000 7f13388f4700 1 --2- 172.21.15.36:0/4285014904 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13340b6960 0x7f13340af710 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.652+0000 7f13388f4700 1 --2- 172.21.15.36:0/4285014904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13340b6580 0x7f13340af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.652+0000 7f13388f4700 1 --2- 172.21.15.36:0/4285014904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13340b43c0 0x7f13340b9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.652+0000 7f13388f4700 1 -- 172.21.15.36:0/4285014904 >> 172.21.15.36:0/4285014904 conn(0x7f133405c490 msgr2=0x7f1334143160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:53.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.652+0000 7f13388f4700 1 -- 172.21.15.36:0/4285014904 shutdown_connections 2022-01-10T01:31:53.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.652+0000 7f13388f4700 1 -- 172.21.15.36:0/4285014904 wait complete. 2022-01-10T01:31:53.655 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 46 2022-01-10T01:31:53.664 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2022-01-10T01:31:53.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83f2495700 1 Processor -- start 2022-01-10T01:31:53.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83f2495700 1 -- start start 2022-01-10T01:31:53.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83f2495700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83ec148860 0x7f83ec14ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:53.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83f2495700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ec066ea0 con 0x7f83ec0a9c10 2022-01-10T01:31:53.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83f2495700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ec0b3420 con 0x7f83ec0b3040 2022-01-10T01:31:53.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83f2495700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ec0648e0 con 0x7f83ec148860 2022-01-10T01:31:53.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83f0c92700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f83ec0a9c10 0x7f83ec0607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37524/0 (socket says 172.21.15.36:37524) 2022-01-10T01:31:53.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83f0c92700 1 -- 172.21.15.36:0/3006633719 learned_addr learned my addr 172.21.15.36:0/3006633719 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:53.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83f1c94700 1 --2- 172.21.15.36:0/3006633719 >> v2:172.21.15.59:3300/0 conn(0x7f83ec148860 0x7f83ec14ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:53.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83dffff700 1 -- 172.21.15.36:0/3006633719 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081054148 0 0) 0x7f83ec066ea0 con 0x7f83ec0a9c10 2022-01-10T01:31:53.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83dffff700 1 -- 172.21.15.36:0/3006633719 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d0003260 con 0x7f83ec0a9c10 2022-01-10T01:31:53.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83dffff700 1 -- 172.21.15.36:0/3006633719 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613152811 0 0) 0x7f83ec0b3420 con 0x7f83ec0b3040 2022-01-10T01:31:53.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83dffff700 1 -- 172.21.15.36:0/3006633719 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83ec066ea0 con 0x7f83ec0b3040 2022-01-10T01:31:53.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83f1c94700 1 -- 172.21.15.36:0/3006633719 >> v1:172.21.15.59:6789/0 conn(0x7f83ec0b3040 legacy=0x7f83ec065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:53.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83f1c94700 1 -- 172.21.15.36:0/3006633719 >> v1:172.21.15.36:6789/0 conn(0x7f83ec0a9c10 legacy=0x7f83ec0607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:53.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83f1c94700 1 -- 172.21.15.36:0/3006633719 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec066960 con 0x7f83ec148860 2022-01-10T01:31:53.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83f1c94700 1 --2- 172.21.15.36:0/3006633719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83ec148860 0x7f83ec14ac50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f83e8002f70 tx=0x7f83e8006df0).ready entity=mon.1 client_cookie=bc835928349a4dc4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:53.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83dffff700 1 -- 172.21.15.36:0/3006633719 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e800d540 con 0x7f83ec148860 2022-01-10T01:31:53.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83dffff700 1 -- 172.21.15.36:0/3006633719 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e8000e90 con 0x7f83ec148860 2022-01-10T01:31:53.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.772+0000 7f83dffff700 1 -- 172.21.15.36:0/3006633719 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e800d890 con 0x7f83ec148860 2022-01-10T01:31:53.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 -- 172.21.15.36:0/3006633719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83ec148860 msgr2=0x7f83ec14ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:53.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 --2- 172.21.15.36:0/3006633719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83ec148860 0x7f83ec14ac50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f83e8002f70 tx=0x7f83e8006df0).stop 2022-01-10T01:31:53.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 -- 172.21.15.36:0/3006633719 shutdown_connections 2022-01-10T01:31:53.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 --2- 172.21.15.36:0/3006633719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83ec148860 0x7f83ec14ac50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 -- 172.21.15.36:0/3006633719 >> 172.21.15.36:0/3006633719 conn(0x7f83ec0636e0 msgr2=0x7f83ec063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:53.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 -- 172.21.15.36:0/3006633719 shutdown_connections 2022-01-10T01:31:53.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 -- 172.21.15.36:0/3006633719 wait complete. 2022-01-10T01:31:53.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 Processor -- start 2022-01-10T01:31:53.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 -- start start 2022-01-10T01:31:53.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83ec0a9c10 0x7f83ec0ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:53.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83ec0b3040 0x7f83ec13cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:53.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83ec148860 0x7f83ec155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:53.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec141af0 con 0x7f83ec0a9c10 2022-01-10T01:31:53.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec1429c0 con 0x7f83ec148860 2022-01-10T01:31:53.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f2495700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec141d50 con 0x7f83ec0b3040 2022-01-10T01:31:53.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f1493700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83ec0a9c10 0x7f83ec0ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:53.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f1493700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83ec0a9c10 0x7f83ec0ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39734/0 (socket says 172.21.15.36:39734) 2022-01-10T01:31:53.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f1493700 1 -- 172.21.15.36:0/3507627126 learned_addr learned my addr 172.21.15.36:0/3507627126 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:53.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f0c92700 1 --2- 172.21.15.36:0/3507627126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83ec0b3040 0x7f83ec13cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:53.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.776+0000 7f83f1c94700 1 --2- 172.21.15.36:0/3507627126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83ec148860 0x7f83ec155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:53.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83f1493700 1 -- 172.21.15.36:0/3507627126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83ec0b3040 msgr2=0x7f83ec13cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:53.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83f1493700 1 --2- 172.21.15.36:0/3507627126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83ec0b3040 0x7f83ec13cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83f1493700 1 -- 172.21.15.36:0/3507627126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83ec148860 msgr2=0x7f83ec155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:53.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83f1493700 1 --2- 172.21.15.36:0/3507627126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83ec148860 0x7f83ec155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:53.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83f1493700 1 -- 172.21.15.36:0/3507627126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e800b180 con 0x7f83ec0a9c10 2022-01-10T01:31:53.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83f1493700 1 --2- 172.21.15.36:0/3507627126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83ec0a9c10 0x7f83ec0ae990 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f83e0001110 tx=0x7f83e0007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:53.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83de7fc700 1 -- 172.21.15.36:0/3507627126 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e000f470 con 0x7f83ec0a9c10 2022-01-10T01:31:53.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83de7fc700 1 -- 172.21.15.36:0/3507627126 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e000f5d0 con 0x7f83ec0a9c10 2022-01-10T01:31:53.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83f2495700 1 -- 172.21.15.36:0/3507627126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ec141ff0 con 0x7f83ec0a9c10 2022-01-10T01:31:53.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83de7fc700 1 -- 172.21.15.36:0/3507627126 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e000f930 con 0x7f83ec0a9c10 2022-01-10T01:31:53.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83f2495700 1 -- 172.21.15.36:0/3507627126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ec1415e0 con 0x7f83ec0a9c10 2022-01-10T01:31:53.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83de7fc700 1 -- 172.21.15.36:0/3507627126 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f83e0019030 con 0x7f83ec0a9c10 2022-01-10T01:31:53.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83f2495700 1 -- 172.21.15.36:0/3507627126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ec142180 con 0x7f83ec0a9c10 2022-01-10T01:31:53.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83de7fc700 1 --2- 172.21.15.36:0/3507627126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f83d40534d0 0x7f83d4055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:53.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83f0c92700 1 --2- 172.21.15.36:0/3507627126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f83d40534d0 0x7f83d4055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:53.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83de7fc700 1 -- 172.21.15.36:0/3507627126 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f83e006b080 con 0x7f83ec0a9c10 2022-01-10T01:31:53.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.780+0000 7f83f0c92700 1 --2- 172.21.15.36:0/3507627126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f83d40534d0 0x7f83d4055990 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f83e400b000 tx=0x7f83e4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:53.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.784+0000 7f83de7fc700 1 -- 172.21.15.36:0/3507627126 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f83ec142180 con 0x7f83ec0a9c10 2022-01-10T01:31:53.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:53.948+0000 7f83f2495700 1 -- 172.21.15.36:0/3507627126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f83ec142180 con 0x7f83ec0a9c10 2022-01-10T01:31:54.655 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:31:54.652+0000 7f0b5376f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:31:54.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.664+0000 7f83de7fc700 1 -- 172.21.15.36:0/3507627126 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) v1 ==== 161+0+0 (secure 0 0 0) 0x7f83ec142180 con 0x7f83ec0a9c10 2022-01-10T01:31:54.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.668+0000 7f83f2495700 1 -- 172.21.15.36:0/3507627126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f83d40534d0 msgr2=0x7f83d4055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:54.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.668+0000 7f83f2495700 1 --2- 172.21.15.36:0/3507627126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f83d40534d0 0x7f83d4055990 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f83e400b000 tx=0x7f83e4009040).stop 2022-01-10T01:31:54.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.668+0000 7f83f2495700 1 -- 172.21.15.36:0/3507627126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83ec0a9c10 msgr2=0x7f83ec0ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:54.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.668+0000 7f83f2495700 1 --2- 172.21.15.36:0/3507627126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83ec0a9c10 0x7f83ec0ae990 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f83e0001110 tx=0x7f83e0007ae0).stop 2022-01-10T01:31:54.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.668+0000 7f83f2495700 1 -- 172.21.15.36:0/3507627126 shutdown_connections 2022-01-10T01:31:54.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.668+0000 7f83f2495700 1 --2- 172.21.15.36:0/3507627126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f83d40534d0 0x7f83d4055990 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:54.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.668+0000 7f83f2495700 1 --2- 172.21.15.36:0/3507627126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83ec148860 0x7f83ec155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:54.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.668+0000 7f83f2495700 1 --2- 172.21.15.36:0/3507627126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83ec0b3040 0x7f83ec13cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:54.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.668+0000 7f83f2495700 1 --2- 172.21.15.36:0/3507627126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f83ec0a9c10 0x7f83ec0ae990 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:54.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.668+0000 7f83f2495700 1 -- 172.21.15.36:0/3507627126 >> 172.21.15.36:0/3507627126 conn(0x7f83ec0636e0 msgr2=0x7f83ec063ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:54.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.668+0000 7f83f2495700 1 -- 172.21.15.36:0/3507627126 shutdown_connections 2022-01-10T01:31:54.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.668+0000 7f83f2495700 1 -- 172.21.15.36:0/3507627126 wait complete. 2022-01-10T01:31:54.674 INFO:teuthology.orchestra.run.smithi036.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2022-01-10T01:31:54.686 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:31:54.695 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:31:54.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.784+0000 7f6e5759e700 1 Processor -- start 2022-01-10T01:31:54.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.784+0000 7f6e5759e700 1 -- start start 2022-01-10T01:31:54.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e5759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e580b0710 0x7f6e58142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:54.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e5759e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e58143920 con 0x7f6e580b30d0 2022-01-10T01:31:54.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e5759e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e580b0af0 con 0x7f6e580ace70 2022-01-10T01:31:54.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e5759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e580ae680 con 0x7f6e580b0710 2022-01-10T01:31:54.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e4ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f6e580b30d0 0x7f6e58143210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37550/0 (socket says 172.21.15.36:37550) 2022-01-10T01:31:54.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e4ffff700 1 -- 172.21.15.36:0/2732514227 learned_addr learned my addr 172.21.15.36:0/2732514227 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:54.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e5659c700 1 --2- 172.21.15.36:0/2732514227 >> v2:172.21.15.59:3300/0 conn(0x7f6e580b0710 0x7f6e58142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:54.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e55d9b700 1 -- 172.21.15.36:0/2732514227 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794134757 0 0) 0x7f6e58143920 con 0x7f6e580b30d0 2022-01-10T01:31:54.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e55d9b700 1 -- 172.21.15.36:0/2732514227 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e38003260 con 0x7f6e580b30d0 2022-01-10T01:31:54.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e55d9b700 1 -- 172.21.15.36:0/2732514227 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831472896 0 0) 0x7f6e580b0af0 con 0x7f6e580ace70 2022-01-10T01:31:54.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e55d9b700 1 -- 172.21.15.36:0/2732514227 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e58143920 con 0x7f6e580ace70 2022-01-10T01:31:54.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e55d9b700 1 -- 172.21.15.36:0/2732514227 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3677352227 0 0) 0x7f6e38003260 con 0x7f6e580b30d0 2022-01-10T01:31:54.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e5659c700 1 -- 172.21.15.36:0/2732514227 >> v1:172.21.15.59:6789/0 conn(0x7f6e580ace70 legacy=0x7f6e5813f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:54.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e5659c700 1 -- 172.21.15.36:0/2732514227 >> v1:172.21.15.36:6789/0 conn(0x7f6e580b30d0 legacy=0x7f6e58143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:54.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e5659c700 1 -- 172.21.15.36:0/2732514227 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e580ae920 con 0x7f6e580b0710 2022-01-10T01:31:54.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e5659c700 1 --2- 172.21.15.36:0/2732514227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e580b0710 0x7f6e58142d20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f6e40001110 tx=0x7f6e48006df0).ready entity=mon.1 client_cookie=24929a059731fee7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:54.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e55d9b700 1 -- 172.21.15.36:0/2732514227 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e40001660 con 0x7f6e580b0710 2022-01-10T01:31:54.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e55d9b700 1 -- 172.21.15.36:0/2732514227 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e48000e90 con 0x7f6e580b0710 2022-01-10T01:31:54.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.788+0000 7f6e55d9b700 1 -- 172.21.15.36:0/2732514227 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e48012460 con 0x7f6e580b0710 2022-01-10T01:31:54.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.792+0000 7f6e5759e700 1 -- 172.21.15.36:0/2732514227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e580b0710 msgr2=0x7f6e58142d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:54.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.792+0000 7f6e5759e700 1 --2- 172.21.15.36:0/2732514227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e580b0710 0x7f6e58142d20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f6e40001110 tx=0x7f6e48006df0).stop 2022-01-10T01:31:54.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.792+0000 7f6e5759e700 1 -- 172.21.15.36:0/2732514227 shutdown_connections 2022-01-10T01:31:54.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.792+0000 7f6e5759e700 1 --2- 172.21.15.36:0/2732514227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e580b0710 0x7f6e58142d20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:54.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.792+0000 7f6e5759e700 1 -- 172.21.15.36:0/2732514227 >> 172.21.15.36:0/2732514227 conn(0x7f6e58061140 msgr2=0x7f6e58062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:54.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.792+0000 7f6e5759e700 1 -- 172.21.15.36:0/2732514227 shutdown_connections 2022-01-10T01:31:54.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.792+0000 7f6e5759e700 1 -- 172.21.15.36:0/2732514227 wait complete. 2022-01-10T01:31:54.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.792+0000 7f6e5759e700 1 Processor -- start 2022-01-10T01:31:54.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.792+0000 7f6e5759e700 1 -- start start 2022-01-10T01:31:54.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6e580ace70 0x7f6e580abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:54.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e580b0710 0x7f6e58152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:54.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e580b30d0 0x7f6e58152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:54.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58065470 con 0x7f6e580ace70 2022-01-10T01:31:54.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e58064f30 con 0x7f6e580b0710 2022-01-10T01:31:54.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580651d0 con 0x7f6e580b30d0 2022-01-10T01:31:54.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6e580ace70 0x7f6e580abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:54.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6e580ace70 0x7f6e580abc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39760/0 (socket says 172.21.15.36:39760) 2022-01-10T01:31:54.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5659c700 1 -- 172.21.15.36:0/2531600606 learned_addr learned my addr 172.21.15.36:0/2531600606 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:54.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e4ffff700 1 --2- 172.21.15.36:0/2531600606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e580b0710 0x7f6e58152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:54.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e56d9d700 1 --2- 172.21.15.36:0/2531600606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e580b30d0 0x7f6e58152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:54.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5659c700 1 -- 172.21.15.36:0/2531600606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e580b30d0 msgr2=0x7f6e58152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:54.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5659c700 1 --2- 172.21.15.36:0/2531600606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e580b30d0 0x7f6e58152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:54.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5659c700 1 -- 172.21.15.36:0/2531600606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e580b0710 msgr2=0x7f6e58152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:54.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5659c700 1 --2- 172.21.15.36:0/2531600606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e580b0710 0x7f6e58152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:54.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5659c700 1 -- 172.21.15.36:0/2531600606 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4800b180 con 0x7f6e580ace70 2022-01-10T01:31:54.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5659c700 1 --2- 172.21.15.36:0/2531600606 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6e580ace70 0x7f6e580abc90 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f6e40001110 tx=0x7f6e48014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:54.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e4f7fe700 1 -- 172.21.15.36:0/2531600606 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e48016030 con 0x7f6e580ace70 2022-01-10T01:31:54.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5759e700 1 -- 172.21.15.36:0/2531600606 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e580a8d00 con 0x7f6e580ace70 2022-01-10T01:31:54.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e4f7fe700 1 -- 172.21.15.36:0/2531600606 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4800be90 con 0x7f6e580ace70 2022-01-10T01:31:54.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e4f7fe700 1 -- 172.21.15.36:0/2531600606 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e4800dd40 con 0x7f6e580ace70 2022-01-10T01:31:54.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.796+0000 7f6e5759e700 1 -- 172.21.15.36:0/2531600606 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e58153410 con 0x7f6e580ace70 2022-01-10T01:31:54.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.800+0000 7f6e4f7fe700 1 -- 172.21.15.36:0/2531600606 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6e48024020 con 0x7f6e580ace70 2022-01-10T01:31:54.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.800+0000 7f6e5759e700 1 -- 172.21.15.36:0/2531600606 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e58057350 con 0x7f6e580ace70 2022-01-10T01:31:54.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.800+0000 7f6e4f7fe700 1 --2- 172.21.15.36:0/2531600606 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e3c053620 0x7f6e3c055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:54.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.800+0000 7f6e4f7fe700 1 -- 172.21.15.36:0/2531600606 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f6e48017070 con 0x7f6e580ace70 2022-01-10T01:31:54.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.800+0000 7f6e4ffff700 1 --2- 172.21.15.36:0/2531600606 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e3c053620 0x7f6e3c055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:54.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.800+0000 7f6e4ffff700 1 --2- 172.21.15.36:0/2531600606 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e3c053620 0x7f6e3c055ae0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f6e4000d000 tx=0x7f6e40000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:54.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.808+0000 7f6e4f7fe700 1 -- 172.21.15.36:0/2531600606 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6e480437f0 con 0x7f6e580ace70 2022-01-10T01:31:54.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.972+0000 7f6e5759e700 1 -- 172.21.15.36:0/2531600606 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e580b2c70 con 0x7f6e580ace70 2022-01-10T01:31:54.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.972+0000 7f6e4f7fe700 1 -- 172.21.15.36:0/2531600606 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f6e48046e10 con 0x7f6e580ace70 2022-01-10T01:31:54.973 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:31:54.974 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":47,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6933,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4213696854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4213696854},{"type":"v1","addr":"172.21.15.59:6833","nonce":4213696854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44},{"gid":6945,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/4101368080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":4101368080},{"type":"v1","addr":"172.21.15.36:6835","nonce":4101368080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:31:42.305072+0000","modified":"2022-01-10T01:31:54.654522+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":101,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2022-01-10T01:31:54.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.972+0000 7f6e5759e700 1 -- 172.21.15.36:0/2531600606 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e3c053620 msgr2=0x7f6e3c055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:54.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.972+0000 7f6e5759e700 1 --2- 172.21.15.36:0/2531600606 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e3c053620 0x7f6e3c055ae0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f6e4000d000 tx=0x7f6e40000bc0).stop 2022-01-10T01:31:54.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.972+0000 7f6e5759e700 1 -- 172.21.15.36:0/2531600606 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6e580ace70 msgr2=0x7f6e580abc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:54.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.972+0000 7f6e5759e700 1 --2- 172.21.15.36:0/2531600606 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6e580ace70 0x7f6e580abc90 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f6e40001110 tx=0x7f6e48014000).stop 2022-01-10T01:31:54.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.972+0000 7f6e5759e700 1 -- 172.21.15.36:0/2531600606 shutdown_connections 2022-01-10T01:31:54.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.972+0000 7f6e5759e700 1 --2- 172.21.15.36:0/2531600606 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e3c053620 0x7f6e3c055ae0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:54.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.972+0000 7f6e5759e700 1 --2- 172.21.15.36:0/2531600606 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e580b30d0 0x7f6e58152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:54.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.972+0000 7f6e5759e700 1 --2- 172.21.15.36:0/2531600606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e580b0710 0x7f6e58152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:54.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.972+0000 7f6e5759e700 1 --2- 172.21.15.36:0/2531600606 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6e580ace70 0x7f6e580abc90 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:54.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.972+0000 7f6e5759e700 1 -- 172.21.15.36:0/2531600606 >> 172.21.15.36:0/2531600606 conn(0x7f6e58061140 msgr2=0x7f6e58142c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:54.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.972+0000 7f6e5759e700 1 -- 172.21.15.36:0/2531600606 shutdown_connections 2022-01-10T01:31:54.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:54.972+0000 7f6e5759e700 1 -- 172.21.15.36:0/2531600606 wait complete. 2022-01-10T01:31:54.981 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 47 2022-01-10T01:31:54.986 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:31:55.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9ed669700 1 Processor -- start 2022-01-10T01:31:55.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9ed669700 1 -- start start 2022-01-10T01:31:55.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9ed669700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9e80ad5c0 0x7fc9e8061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:55.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9ed669700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e80aecf0 con 0x7fc9e8140440 2022-01-10T01:31:55.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9ed669700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9e80b6f20 con 0x7fc9e8061320 2022-01-10T01:31:55.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9ed669700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e80aef20 con 0x7fc9e80ad5c0 2022-01-10T01:31:55.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9ece68700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fc9e8140440 0x7fc9e8146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37566/0 (socket says 172.21.15.36:37566) 2022-01-10T01:31:55.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9ece68700 1 -- 172.21.15.36:0/82627502 learned_addr learned my addr 172.21.15.36:0/82627502 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:55.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9e77fe700 1 --2- 172.21.15.36:0/82627502 >> v2:172.21.15.59:3300/0 conn(0x7fc9e80ad5c0 0x7fc9e8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:55.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9e6ffd700 1 -- 172.21.15.36:0/82627502 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1171087635 0 0) 0x7fc9e80aecf0 con 0x7fc9e8140440 2022-01-10T01:31:55.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9e6ffd700 1 -- 172.21.15.36:0/82627502 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9d4003260 con 0x7fc9e8140440 2022-01-10T01:31:55.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9e77fe700 1 -- 172.21.15.36:0/82627502 >> v1:172.21.15.59:6789/0 conn(0x7fc9e8061320 legacy=0x7fc9e80b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:55.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9e77fe700 1 -- 172.21.15.36:0/82627502 >> v1:172.21.15.36:6789/0 conn(0x7fc9e8140440 legacy=0x7fc9e8146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:55.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9e77fe700 1 -- 172.21.15.36:0/82627502 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e80af1c0 con 0x7fc9e80ad5c0 2022-01-10T01:31:55.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9e77fe700 1 --2- 172.21.15.36:0/82627502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ad5c0 0x7fc9e8061700 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fc9d8002f70 tx=0x7fc9d8006df0).ready entity=mon.1 client_cookie=c080bf718731c142 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:55.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9e6ffd700 1 -- 172.21.15.36:0/82627502 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d800d610 con 0x7fc9e80ad5c0 2022-01-10T01:31:55.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9e6ffd700 1 -- 172.21.15.36:0/82627502 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d8000e90 con 0x7fc9e80ad5c0 2022-01-10T01:31:55.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.092+0000 7fc9e6ffd700 1 -- 172.21.15.36:0/82627502 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d800d960 con 0x7fc9e80ad5c0 2022-01-10T01:31:55.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 -- 172.21.15.36:0/82627502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ad5c0 msgr2=0x7fc9e8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:55.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 --2- 172.21.15.36:0/82627502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ad5c0 0x7fc9e8061700 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fc9d8002f70 tx=0x7fc9d8006df0).stop 2022-01-10T01:31:55.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 -- 172.21.15.36:0/82627502 shutdown_connections 2022-01-10T01:31:55.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 --2- 172.21.15.36:0/82627502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ad5c0 0x7fc9e8061700 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:55.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 -- 172.21.15.36:0/82627502 >> 172.21.15.36:0/82627502 conn(0x7fc9e8066de0 msgr2=0x7fc9e80671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:55.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 -- 172.21.15.36:0/82627502 shutdown_connections 2022-01-10T01:31:55.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 -- 172.21.15.36:0/82627502 wait complete. 2022-01-10T01:31:55.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 Processor -- start 2022-01-10T01:31:55.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 -- start start 2022-01-10T01:31:55.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e8061320 0x7fc9e8152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:55.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ad5c0 0x7fc9e80ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:55.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9e8140440 0x7fc9e8155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:55.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8152380 con 0x7fc9e8140440 2022-01-10T01:31:55.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8152570 con 0x7fc9e80ad5c0 2022-01-10T01:31:55.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ed669700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8152810 con 0x7fc9e8061320 2022-01-10T01:31:55.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ece68700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9e8140440 0x7fc9e8155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:55.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ece68700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9e8140440 0x7fc9e8155950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39778/0 (socket says 172.21.15.36:39778) 2022-01-10T01:31:55.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ece68700 1 -- 172.21.15.36:0/56398189 learned_addr learned my addr 172.21.15.36:0/56398189 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:55.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9e77fe700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ad5c0 0x7fc9e80ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:55.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9e7fff700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e8061320 0x7fc9e8152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:55.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ece68700 1 -- 172.21.15.36:0/56398189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e8061320 msgr2=0x7fc9e8152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:55.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ece68700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e8061320 0x7fc9e8152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:55.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ece68700 1 -- 172.21.15.36:0/56398189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ad5c0 msgr2=0x7fc9e80ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:55.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ece68700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ad5c0 0x7fc9e80ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:55.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ece68700 1 -- 172.21.15.36:0/56398189 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d800b180 con 0x7fc9e8140440 2022-01-10T01:31:55.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9e7fff700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e8061320 0x7fc9e8152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:55.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.096+0000 7fc9ece68700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9e8140440 0x7fc9e8155950 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7fc9e0001490 tx=0x7fc9e0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:55.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.100+0000 7fc9e57fa700 1 -- 172.21.15.36:0/56398189 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9e0005ba0 con 0x7fc9e8140440 2022-01-10T01:31:55.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.100+0000 7fc9e57fa700 1 -- 172.21.15.36:0/56398189 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e0005d00 con 0x7fc9e8140440 2022-01-10T01:31:55.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.100+0000 7fc9e57fa700 1 -- 172.21.15.36:0/56398189 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9e00072c0 con 0x7fc9e8140440 2022-01-10T01:31:55.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.100+0000 7fc9ed669700 1 -- 172.21.15.36:0/56398189 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e8152ab0 con 0x7fc9e8140440 2022-01-10T01:31:55.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.100+0000 7fc9ed669700 1 -- 172.21.15.36:0/56398189 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e8142f70 con 0x7fc9e8140440 2022-01-10T01:31:55.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.100+0000 7fc9ed669700 1 -- 172.21.15.36:0/56398189 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e809f3f0 con 0x7fc9e8140440 2022-01-10T01:31:55.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.100+0000 7fc9e57fa700 1 -- 172.21.15.36:0/56398189 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc9e0010070 con 0x7fc9e8140440 2022-01-10T01:31:55.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.100+0000 7fc9e57fa700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9c8053560 0x7fc9c8055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:55.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.100+0000 7fc9e57fa700 1 -- 172.21.15.36:0/56398189 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fc9e006b4e0 con 0x7fc9e8140440 2022-01-10T01:31:55.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.100+0000 7fc9e7fff700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9c8053560 0x7fc9c8055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:55.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.100+0000 7fc9e7fff700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9c8053560 0x7fc9c8055a20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fc9dc00b000 tx=0x7fc9dc009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:55.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.108+0000 7fc9e57fa700 1 -- 172.21.15.36:0/56398189 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc9e0042400 con 0x7fc9e8140440 2022-01-10T01:31:55.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.276+0000 7fc9ed669700 1 -- 172.21.15.36:0/56398189 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc9e80af460 con 0x7fc9e8140440 2022-01-10T01:31:55.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.668+0000 7fc9e57fa700 1 -- 172.21.15.36:0/56398189 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v48) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc9e0045a20 con 0x7fc9e8140440 2022-01-10T01:31:55.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.672+0000 7fc9ed669700 1 -- 172.21.15.36:0/56398189 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9c8053560 msgr2=0x7fc9c8055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:55.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.672+0000 7fc9ed669700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9c8053560 0x7fc9c8055a20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fc9dc00b000 tx=0x7fc9dc009040).stop 2022-01-10T01:31:55.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.672+0000 7fc9ed669700 1 -- 172.21.15.36:0/56398189 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9e8140440 msgr2=0x7fc9e8155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:55.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.672+0000 7fc9ed669700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9e8140440 0x7fc9e8155950 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7fc9e0001490 tx=0x7fc9e0007e00).stop 2022-01-10T01:31:55.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.672+0000 7fc9ed669700 1 -- 172.21.15.36:0/56398189 shutdown_connections 2022-01-10T01:31:55.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.672+0000 7fc9ed669700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9c8053560 0x7fc9c8055a20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:55.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.672+0000 7fc9ed669700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9e8140440 0x7fc9e8155950 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:55.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.672+0000 7fc9ed669700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ad5c0 0x7fc9e80ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:55.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.672+0000 7fc9ed669700 1 --2- 172.21.15.36:0/56398189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9e8061320 0x7fc9e8152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:55.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.672+0000 7fc9ed669700 1 -- 172.21.15.36:0/56398189 >> 172.21.15.36:0/56398189 conn(0x7fc9e8066de0 msgr2=0x7fc9e8146220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:55.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.672+0000 7fc9ed669700 1 -- 172.21.15.36:0/56398189 shutdown_connections 2022-01-10T01:31:55.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.672+0000 7fc9ed669700 1 -- 172.21.15.36:0/56398189 wait complete. 2022-01-10T01:31:55.690 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:31:55.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.804+0000 7f12c359e700 1 Processor -- start 2022-01-10T01:31:55.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.804+0000 7f12c359e700 1 -- start start 2022-01-10T01:31:55.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c359e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f12c40b3040 0x7f12c4065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:55.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f12c4140140 0x7f12c41405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:55.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c4066ea0 con 0x7f12c40a9c10 2022-01-10T01:31:55.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c359e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c40648e0 con 0x7f12c40b3040 2022-01-10T01:31:55.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c359e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c4061dd0 con 0x7f12c4140140 2022-01-10T01:31:55.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c259c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f12c40b3040 0x7f12c4065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:55.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c259c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f12c40b3040 0x7f12c4065e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39784/0 (socket says 172.21.15.36:39784) 2022-01-10T01:31:55.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c259c700 1 -- 172.21.15.36:0/231549434 learned_addr learned my addr 172.21.15.36:0/231549434 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:55.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c2d9d700 1 --2- 172.21.15.36:0/231549434 >> v2:172.21.15.59:3300/0 conn(0x7f12c4140140 0x7f12c41405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:55.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c259c700 1 -- 172.21.15.36:0/231549434 >> v2:172.21.15.59:3300/0 conn(0x7f12c4140140 msgr2=0x7f12c41405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:55.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c259c700 1 --2- 172.21.15.36:0/231549434 >> v2:172.21.15.59:3300/0 conn(0x7f12c4140140 0x7f12c41405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:55.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c259c700 1 -- 172.21.15.36:0/231549434 >> v1:172.21.15.59:6789/0 conn(0x7f12c40a9c10 legacy=0x7f12c40607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:55.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c259c700 1 -- 172.21.15.36:0/231549434 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c40b3420 con 0x7f12c40b3040 2022-01-10T01:31:55.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c2d9d700 1 --2- 172.21.15.36:0/231549434 >> v2:172.21.15.59:3300/0 conn(0x7f12c4140140 0x7f12c41405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:31:55.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c259c700 1 --2- 172.21.15.36:0/231549434 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f12c40b3040 0x7f12c4065e90 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f12c4062440 tx=0x7f12b4006eb0).ready entity=mon.0 client_cookie=8e4038a87b90f7aa server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:55.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c1d9b700 1 -- 172.21.15.36:0/231549434 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12b400d610 con 0x7f12c40b3040 2022-01-10T01:31:55.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c1d9b700 1 -- 172.21.15.36:0/231549434 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b4000e90 con 0x7f12c40b3040 2022-01-10T01:31:55.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c1d9b700 1 -- 172.21.15.36:0/231549434 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12b400d960 con 0x7f12c40b3040 2022-01-10T01:31:55.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c359e700 1 -- 172.21.15.36:0/231549434 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f12c40b3040 msgr2=0x7f12c4065e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:55.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c359e700 1 --2- 172.21.15.36:0/231549434 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f12c40b3040 0x7f12c4065e90 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f12c4062440 tx=0x7f12b4006eb0).stop 2022-01-10T01:31:55.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c359e700 1 -- 172.21.15.36:0/231549434 shutdown_connections 2022-01-10T01:31:55.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c359e700 1 --2- 172.21.15.36:0/231549434 >> v2:172.21.15.59:3300/0 conn(0x7f12c4140140 0x7f12c41405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:55.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c359e700 1 --2- 172.21.15.36:0/231549434 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f12c40b3040 0x7f12c4065e90 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:55.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c359e700 1 -- 172.21.15.36:0/231549434 >> 172.21.15.36:0/231549434 conn(0x7f12c40636e0 msgr2=0x7f12c4063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:55.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c359e700 1 -- 172.21.15.36:0/231549434 shutdown_connections 2022-01-10T01:31:55.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.808+0000 7f12c359e700 1 -- 172.21.15.36:0/231549434 wait complete. 2022-01-10T01:31:55.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.812+0000 7f12c359e700 1 Processor -- start 2022-01-10T01:31:55.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.812+0000 7f12c359e700 1 -- start start 2022-01-10T01:31:55.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12c40a9c10 0x7f12c4137db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:55.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12c40b3040 0x7f12c412cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:55.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f12c4140140 0x7f12c412d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:55.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c412dcf0 con 0x7f12c4140140 2022-01-10T01:31:55.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c412df90 con 0x7f12c40b3040 2022-01-10T01:31:55.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c40ab390 con 0x7f12c40a9c10 2022-01-10T01:31:55.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c2d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f12c4140140 0x7f12c412d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:55.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c2d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f12c4140140 0x7f12c412d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39794/0 (socket says 172.21.15.36:39794) 2022-01-10T01:31:55.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c2d9d700 1 -- 172.21.15.36:0/3938076868 learned_addr learned my addr 172.21.15.36:0/3938076868 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:55.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c259c700 1 --2- 172.21.15.36:0/3938076868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12c40a9c10 0x7f12c4137db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:55.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12bbfff700 1 --2- 172.21.15.36:0/3938076868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12c40b3040 0x7f12c412cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:55.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c2d9d700 1 -- 172.21.15.36:0/3938076868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12c40a9c10 msgr2=0x7f12c4137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:55.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c2d9d700 1 --2- 172.21.15.36:0/3938076868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12c40a9c10 0x7f12c4137db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:55.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c2d9d700 1 -- 172.21.15.36:0/3938076868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12c40b3040 msgr2=0x7f12c412cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:55.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c2d9d700 1 --2- 172.21.15.36:0/3938076868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12c40b3040 0x7f12c412cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:55.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c2d9d700 1 -- 172.21.15.36:0/3938076868 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b400b1e0 con 0x7f12c4140140 2022-01-10T01:31:55.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c2d9d700 1 --2- 172.21.15.36:0/3938076868 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f12c4140140 0x7f12c412d440 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f12bc006cc0 tx=0x7f12bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:55.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12bb7fe700 1 -- 172.21.15.36:0/3938076868 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12bc00f710 con 0x7f12c4140140 2022-01-10T01:31:55.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12bb7fe700 1 -- 172.21.15.36:0/3938076868 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc00f870 con 0x7f12c4140140 2022-01-10T01:31:55.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c359e700 1 -- 172.21.15.36:0/3938076868 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c40ab630 con 0x7f12c4140140 2022-01-10T01:31:55.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12bb7fe700 1 -- 172.21.15.36:0/3938076868 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12bc00fbd0 con 0x7f12c4140140 2022-01-10T01:31:55.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c359e700 1 -- 172.21.15.36:0/3938076868 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c4138640 con 0x7f12c4140140 2022-01-10T01:31:55.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12c359e700 1 -- 172.21.15.36:0/3938076868 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c4066960 con 0x7f12c4140140 2022-01-10T01:31:55.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.816+0000 7f12bb7fe700 1 -- 172.21.15.36:0/3938076868 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f12bc01a030 con 0x7f12c4140140 2022-01-10T01:31:55.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.820+0000 7f12bb7fe700 1 --2- 172.21.15.36:0/3938076868 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f12a80536b0 0x7f12a8055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:55.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.820+0000 7f12bb7fe700 1 -- 172.21.15.36:0/3938076868 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f12bc06bb30 con 0x7f12c4140140 2022-01-10T01:31:55.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.820+0000 7f12c259c700 1 --2- 172.21.15.36:0/3938076868 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f12a80536b0 0x7f12a8055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:55.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.820+0000 7f12c259c700 1 --2- 172.21.15.36:0/3938076868 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f12a80536b0 0x7f12a8055b70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f12b401b000 tx=0x7f12b4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:55.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.828+0000 7f12bb7fe700 1 -- 172.21.15.36:0/3938076868 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f12bc0429e0 con 0x7f12c4140140 2022-01-10T01:31:55.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:55.960+0000 7f12c359e700 1 -- 172.21.15.36:0/3938076868 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f12c4057350 con 0x7f12c4140140 2022-01-10T01:31:56.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.676+0000 7f12bb7fe700 1 -- 172.21.15.36:0/3938076868 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v102) v1 ==== 185+0+0 (secure 0 0 0) 0x7f12bc046000 con 0x7f12c4140140 2022-01-10T01:31:56.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.680+0000 7f12c359e700 1 -- 172.21.15.36:0/3938076868 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f12a80536b0 msgr2=0x7f12a8055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:56.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.680+0000 7f12c359e700 1 --2- 172.21.15.36:0/3938076868 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f12a80536b0 0x7f12a8055b70 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f12b401b000 tx=0x7f12b4015000).stop 2022-01-10T01:31:56.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.680+0000 7f12c359e700 1 -- 172.21.15.36:0/3938076868 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f12c4140140 msgr2=0x7f12c412d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:56.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.680+0000 7f12c359e700 1 --2- 172.21.15.36:0/3938076868 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f12c4140140 0x7f12c412d440 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f12bc006cc0 tx=0x7f12bc008040).stop 2022-01-10T01:31:56.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.680+0000 7f12c359e700 1 -- 172.21.15.36:0/3938076868 shutdown_connections 2022-01-10T01:31:56.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.680+0000 7f12c359e700 1 --2- 172.21.15.36:0/3938076868 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f12a80536b0 0x7f12a8055b70 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:56.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.680+0000 7f12c359e700 1 --2- 172.21.15.36:0/3938076868 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f12c4140140 0x7f12c412d440 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:56.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.680+0000 7f12c359e700 1 --2- 172.21.15.36:0/3938076868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12c40b3040 0x7f12c412cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:56.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.680+0000 7f12c359e700 1 --2- 172.21.15.36:0/3938076868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12c40a9c10 0x7f12c4137db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:56.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.680+0000 7f12c359e700 1 -- 172.21.15.36:0/3938076868 >> 172.21.15.36:0/3938076868 conn(0x7f12c40636e0 msgr2=0x7f12c40b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:56.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.680+0000 7f12c359e700 1 -- 172.21.15.36:0/3938076868 shutdown_connections 2022-01-10T01:31:56.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.680+0000 7f12c359e700 1 -- 172.21.15.36:0/3938076868 wait complete. 2022-01-10T01:31:56.685 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:31:56.695 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2022-01-10T01:31:56.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.800+0000 7f8a233cb700 1 Processor -- start 2022-01-10T01:31:56.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.800+0000 7f8a233cb700 1 -- start start 2022-01-10T01:31:56.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8a1c0a9c10 0x7f8a1c0607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:56.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8a1c140140 0x7f8a1c140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:56.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1c066ea0 con 0x7f8a1c0b3040 2022-01-10T01:31:56.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c0648e0 con 0x7f8a1c140140 2022-01-10T01:31:56.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c061dd0 con 0x7f8a1c0a9c10 2022-01-10T01:31:56.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a22bca700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8a1c140140 0x7f8a1c140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:56.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a22bca700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8a1c140140 0x7f8a1c140590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39802/0 (socket says 172.21.15.36:39802) 2022-01-10T01:31:56.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a22bca700 1 -- 172.21.15.36:0/4015810672 learned_addr learned my addr 172.21.15.36:0/4015810672 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:56.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a21bc8700 1 --2- 172.21.15.36:0/4015810672 >> v2:172.21.15.59:3300/0 conn(0x7f8a1c0a9c10 0x7f8a1c0607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:56.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a22bca700 1 -- 172.21.15.36:0/4015810672 >> v2:172.21.15.59:3300/0 conn(0x7f8a1c0a9c10 msgr2=0x7f8a1c0607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:56.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a213c7700 1 -- 172.21.15.36:0/4015810672 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291925486 0 0) 0x7f8a1c066ea0 con 0x7f8a1c0b3040 2022-01-10T01:31:56.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a22bca700 1 --2- 172.21.15.36:0/4015810672 >> v2:172.21.15.59:3300/0 conn(0x7f8a1c0a9c10 0x7f8a1c0607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:56.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a22bca700 1 -- 172.21.15.36:0/4015810672 >> v1:172.21.15.59:6789/0 conn(0x7f8a1c0b3040 legacy=0x7f8a1c065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:56.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a22bca700 1 -- 172.21.15.36:0/4015810672 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c0b3420 con 0x7f8a1c140140 2022-01-10T01:31:56.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a22bca700 1 --2- 172.21.15.36:0/4015810672 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a1c140140 0x7f8a1c140590 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f8a140032f0 tx=0x7f8a14009290).ready entity=mon.0 client_cookie=1f7f5c474709a521 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:56.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a213c7700 1 -- 172.21.15.36:0/4015810672 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a1400b870 con 0x7f8a1c140140 2022-01-10T01:31:56.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a213c7700 1 -- 172.21.15.36:0/4015810672 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1400b9d0 con 0x7f8a1c140140 2022-01-10T01:31:56.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a213c7700 1 -- 172.21.15.36:0/4015810672 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a1400bb40 con 0x7f8a1c140140 2022-01-10T01:31:56.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 -- 172.21.15.36:0/4015810672 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a1c140140 msgr2=0x7f8a1c140590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:56.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 --2- 172.21.15.36:0/4015810672 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a1c140140 0x7f8a1c140590 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7f8a140032f0 tx=0x7f8a14009290).stop 2022-01-10T01:31:56.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 -- 172.21.15.36:0/4015810672 shutdown_connections 2022-01-10T01:31:56.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 --2- 172.21.15.36:0/4015810672 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a1c140140 0x7f8a1c140590 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:56.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 --2- 172.21.15.36:0/4015810672 >> v2:172.21.15.59:3300/0 conn(0x7f8a1c0a9c10 0x7f8a1c0607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:56.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 -- 172.21.15.36:0/4015810672 >> 172.21.15.36:0/4015810672 conn(0x7f8a1c0636e0 msgr2=0x7f8a1c063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:56.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 -- 172.21.15.36:0/4015810672 shutdown_connections 2022-01-10T01:31:56.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 -- 172.21.15.36:0/4015810672 wait complete. 2022-01-10T01:31:56.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 Processor -- start 2022-01-10T01:31:56.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.804+0000 7f8a233cb700 1 -- start start 2022-01-10T01:31:56.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a233cb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a1c0a9c10 0x7f8a1c145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:56.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a233cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a1c0b3040 0x7f8a1c0ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:56.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a233cb700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a1c140140 0x7f8a1c0add70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:56.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a233cb700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0aa260 con 0x7f8a1c140140 2022-01-10T01:31:56.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a233cb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c146e00 con 0x7f8a1c0a9c10 2022-01-10T01:31:56.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a233cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0acf70 con 0x7f8a1c0b3040 2022-01-10T01:31:56.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a22bca700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a1c140140 0x7f8a1c0add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:56.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a22bca700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a1c140140 0x7f8a1c0add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39808/0 (socket says 172.21.15.36:39808) 2022-01-10T01:31:56.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a22bca700 1 -- 172.21.15.36:0/1435360054 learned_addr learned my addr 172.21.15.36:0/1435360054 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:56.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a223c9700 1 --2- 172.21.15.36:0/1435360054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a1c0a9c10 0x7f8a1c145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:56.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a21bc8700 1 --2- 172.21.15.36:0/1435360054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a1c0b3040 0x7f8a1c0ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:56.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a22bca700 1 -- 172.21.15.36:0/1435360054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a1c0b3040 msgr2=0x7f8a1c0ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:56.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a22bca700 1 --2- 172.21.15.36:0/1435360054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a1c0b3040 0x7f8a1c0ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:56.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a22bca700 1 -- 172.21.15.36:0/1435360054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a1c0a9c10 msgr2=0x7f8a1c145b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:56.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a22bca700 1 --2- 172.21.15.36:0/1435360054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a1c0a9c10 0x7f8a1c145b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:56.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a22bca700 1 -- 172.21.15.36:0/1435360054 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14009530 con 0x7f8a1c140140 2022-01-10T01:31:56.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a22bca700 1 --2- 172.21.15.36:0/1435360054 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a1c140140 0x7f8a1c0add70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f8a140032f0 tx=0x7f8a14016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:56.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a0b7fe700 1 -- 172.21.15.36:0/1435360054 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a1400b870 con 0x7f8a1c140140 2022-01-10T01:31:56.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a0b7fe700 1 -- 172.21.15.36:0/1435360054 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a14021630 con 0x7f8a1c140140 2022-01-10T01:31:56.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a233cb700 1 -- 172.21.15.36:0/1435360054 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1c0aa490 con 0x7f8a1c140140 2022-01-10T01:31:56.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a0b7fe700 1 -- 172.21.15.36:0/1435360054 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a14021990 con 0x7f8a1c140140 2022-01-10T01:31:56.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a233cb700 1 -- 172.21.15.36:0/1435360054 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1c0ad210 con 0x7f8a1c140140 2022-01-10T01:31:56.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.808+0000 7f8a233cb700 1 -- 172.21.15.36:0/1435360054 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1c066960 con 0x7f8a1c140140 2022-01-10T01:31:56.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.812+0000 7f8a0b7fe700 1 -- 172.21.15.36:0/1435360054 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8a14027020 con 0x7f8a1c140140 2022-01-10T01:31:56.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.812+0000 7f8a0b7fe700 1 --2- 172.21.15.36:0/1435360054 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f89fc0534d0 0x7f89fc055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:56.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.812+0000 7f8a0b7fe700 1 -- 172.21.15.36:0/1435360054 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f8a1406cb60 con 0x7f8a1c140140 2022-01-10T01:31:56.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.812+0000 7f8a223c9700 1 --2- 172.21.15.36:0/1435360054 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f89fc0534d0 0x7f89fc055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:56.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.812+0000 7f8a223c9700 1 --2- 172.21.15.36:0/1435360054 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f89fc0534d0 0x7f89fc055990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f8a1800d000 tx=0x7f8a18007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:56.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.816+0000 7f8a0b7fe700 1 -- 172.21.15.36:0/1435360054 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8a14043cd0 con 0x7f8a1c140140 2022-01-10T01:31:56.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:56.944+0000 7f8a233cb700 1 -- 172.21.15.36:0/1435360054 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8a1c057350 con 0x7f8a1c140140 2022-01-10T01:31:57.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.688+0000 7f8a0b7fe700 1 -- 172.21.15.36:0/1435360054 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v103) v1 ==== 173+0+0 (secure 0 0 0) 0x7f8a14015020 con 0x7f8a1c140140 2022-01-10T01:31:57.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.692+0000 7f8a233cb700 1 -- 172.21.15.36:0/1435360054 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f89fc0534d0 msgr2=0x7f89fc055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:57.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.692+0000 7f8a233cb700 1 --2- 172.21.15.36:0/1435360054 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f89fc0534d0 0x7f89fc055990 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f8a1800d000 tx=0x7f8a18007a00).stop 2022-01-10T01:31:57.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.692+0000 7f8a233cb700 1 -- 172.21.15.36:0/1435360054 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a1c140140 msgr2=0x7f8a1c0add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:57.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.692+0000 7f8a233cb700 1 --2- 172.21.15.36:0/1435360054 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a1c140140 0x7f8a1c0add70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f8a140032f0 tx=0x7f8a14016000).stop 2022-01-10T01:31:57.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.692+0000 7f8a233cb700 1 -- 172.21.15.36:0/1435360054 shutdown_connections 2022-01-10T01:31:57.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.692+0000 7f8a233cb700 1 --2- 172.21.15.36:0/1435360054 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f89fc0534d0 0x7f89fc055990 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:57.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.692+0000 7f8a233cb700 1 --2- 172.21.15.36:0/1435360054 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a1c140140 0x7f8a1c0add70 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:57.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.692+0000 7f8a233cb700 1 --2- 172.21.15.36:0/1435360054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a1c0b3040 0x7f8a1c0ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:57.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.692+0000 7f8a233cb700 1 --2- 172.21.15.36:0/1435360054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a1c0a9c10 0x7f8a1c145b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:57.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.692+0000 7f8a233cb700 1 -- 172.21.15.36:0/1435360054 >> 172.21.15.36:0/1435360054 conn(0x7f8a1c0636e0 msgr2=0x7f8a1c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:57.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.692+0000 7f8a233cb700 1 -- 172.21.15.36:0/1435360054 shutdown_connections 2022-01-10T01:31:57.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.692+0000 7f8a233cb700 1 -- 172.21.15.36:0/1435360054 wait complete. 2022-01-10T01:31:57.699 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' removed 2022-01-10T01:31:57.710 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2022-01-10T01:31:57.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.812+0000 7f6bff59e700 1 Processor -- start 2022-01-10T01:31:57.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.812+0000 7f6bff59e700 1 -- start start 2022-01-10T01:31:57.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.812+0000 7f6bff59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c000b0610 0x7f6c000af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:57.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.812+0000 7f6bff59e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f6c001475a0 0x7f6c000acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:57.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.812+0000 7f6bff59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c001479f0 con 0x7f6c000b54a0 2022-01-10T01:31:57.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.812+0000 7f6bff59e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c001452e0 con 0x7f6c001475a0 2022-01-10T01:31:57.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.812+0000 7f6bff59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c000adff0 con 0x7f6c000b0610 2022-01-10T01:31:57.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bfed9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f6c001475a0 0x7f6c000acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:57.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bfed9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f6c001475a0 0x7f6c000acc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39816/0 (socket says 172.21.15.36:39816) 2022-01-10T01:31:57.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bfed9d700 1 -- 172.21.15.36:0/2614497609 learned_addr learned my addr 172.21.15.36:0/2614497609 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:57.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bfdd9b700 1 --2- 172.21.15.36:0/2614497609 >> v2:172.21.15.59:3300/0 conn(0x7f6c000b0610 0x7f6c000af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:57.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bfed9d700 1 -- 172.21.15.36:0/2614497609 >> v2:172.21.15.59:3300/0 conn(0x7f6c000b0610 msgr2=0x7f6c000af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:57.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bfed9d700 1 --2- 172.21.15.36:0/2614497609 >> v2:172.21.15.59:3300/0 conn(0x7f6c000b0610 0x7f6c000af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:57.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bfed9d700 1 -- 172.21.15.36:0/2614497609 >> v1:172.21.15.59:6789/0 conn(0x7f6c000b54a0 legacy=0x7f6c000675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:57.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bfed9d700 1 -- 172.21.15.36:0/2614497609 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c000b5880 con 0x7f6c001475a0 2022-01-10T01:31:57.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bfed9d700 1 --2- 172.21.15.36:0/2614497609 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c001475a0 0x7f6c000acc60 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f6bf0002f70 tx=0x7f6bf0006eb0).ready entity=mon.0 client_cookie=d3ef2b00a62861d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:57.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bfd59a700 1 -- 172.21.15.36:0/2614497609 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bf000d610 con 0x7f6c001475a0 2022-01-10T01:31:57.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bfd59a700 1 -- 172.21.15.36:0/2614497609 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf0000e90 con 0x7f6c001475a0 2022-01-10T01:31:57.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bfd59a700 1 -- 172.21.15.36:0/2614497609 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bf000d9a0 con 0x7f6c001475a0 2022-01-10T01:31:57.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bff59e700 1 -- 172.21.15.36:0/2614497609 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c001475a0 msgr2=0x7f6c000acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:57.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bff59e700 1 --2- 172.21.15.36:0/2614497609 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c001475a0 0x7f6c000acc60 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7f6bf0002f70 tx=0x7f6bf0006eb0).stop 2022-01-10T01:31:57.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bff59e700 1 -- 172.21.15.36:0/2614497609 shutdown_connections 2022-01-10T01:31:57.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bff59e700 1 --2- 172.21.15.36:0/2614497609 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c001475a0 0x7f6c000acc60 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:57.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bff59e700 1 --2- 172.21.15.36:0/2614497609 >> v2:172.21.15.59:3300/0 conn(0x7f6c000b0610 0x7f6c000af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:57.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bff59e700 1 -- 172.21.15.36:0/2614497609 >> 172.21.15.36:0/2614497609 conn(0x7f6c00062560 msgr2=0x7f6c00062940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:57.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bff59e700 1 -- 172.21.15.36:0/2614497609 shutdown_connections 2022-01-10T01:31:57.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.816+0000 7f6bff59e700 1 -- 172.21.15.36:0/2614497609 wait complete. 2022-01-10T01:31:57.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.820+0000 7f6bff59e700 1 Processor -- start 2022-01-10T01:31:57.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.820+0000 7f6bff59e700 1 -- start start 2022-01-10T01:31:57.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.820+0000 7f6bff59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c000b0610 0x7f6c00145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:57.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.820+0000 7f6bff59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c000b54a0 0x7f6c0015a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:57.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.820+0000 7f6bff59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c001475a0 0x7f6c0015a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:57.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.820+0000 7f6bff59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c00065250 con 0x7f6c000b0610 2022-01-10T01:31:57.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.820+0000 7f6bff59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0015aa50 con 0x7f6c000b54a0 2022-01-10T01:31:57.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.820+0000 7f6bff59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c000b4a00 con 0x7f6c001475a0 2022-01-10T01:31:57.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.820+0000 7f6bfe59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c000b0610 0x7f6c00145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:57.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.820+0000 7f6bfe59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c000b0610 0x7f6c00145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39818/0 (socket says 172.21.15.36:39818) 2022-01-10T01:31:57.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.820+0000 7f6bfe59c700 1 -- 172.21.15.36:0/2012947558 learned_addr learned my addr 172.21.15.36:0/2012947558 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:57.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.820+0000 7f6bfed9d700 1 --2- 172.21.15.36:0/2012947558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c001475a0 0x7f6c0015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:57.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.820+0000 7f6bfdd9b700 1 --2- 172.21.15.36:0/2012947558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c000b54a0 0x7f6c0015a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:57.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bfe59c700 1 -- 172.21.15.36:0/2012947558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c001475a0 msgr2=0x7f6c0015a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:57.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bfe59c700 1 --2- 172.21.15.36:0/2012947558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c001475a0 0x7f6c0015a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:57.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bfe59c700 1 -- 172.21.15.36:0/2012947558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c000b54a0 msgr2=0x7f6c0015a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:57.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bfe59c700 1 --2- 172.21.15.36:0/2012947558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c000b54a0 0x7f6c0015a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:57.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bfe59c700 1 -- 172.21.15.36:0/2012947558 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf000b1e0 con 0x7f6c000b0610 2022-01-10T01:31:57.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bfe59c700 1 --2- 172.21.15.36:0/2012947558 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c000b0610 0x7f6c00145b30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f6c00069d90 tx=0x7f6bf80014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:57.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bf77fe700 1 -- 172.21.15.36:0/2012947558 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bf800e4a0 con 0x7f6c000b0610 2022-01-10T01:31:57.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bf77fe700 1 -- 172.21.15.36:0/2012947558 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf800e600 con 0x7f6c000b0610 2022-01-10T01:31:57.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bff59e700 1 -- 172.21.15.36:0/2012947558 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c00146700 con 0x7f6c000b0610 2022-01-10T01:31:57.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bf77fe700 1 -- 172.21.15.36:0/2012947558 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bf800e960 con 0x7f6c000b0610 2022-01-10T01:31:57.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bff59e700 1 -- 172.21.15.36:0/2012947558 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c00066b90 con 0x7f6c000b0610 2022-01-10T01:31:57.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bff59e700 1 -- 172.21.15.36:0/2012947558 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c000b4bc0 con 0x7f6c000b0610 2022-01-10T01:31:57.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bf77fe700 1 -- 172.21.15.36:0/2012947558 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6bf8019030 con 0x7f6c000b0610 2022-01-10T01:31:57.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bf77fe700 1 --2- 172.21.15.36:0/2012947558 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6be40536b0 0x7f6be4055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:57.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bf77fe700 1 -- 172.21.15.36:0/2012947558 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f6bf806ade0 con 0x7f6c000b0610 2022-01-10T01:31:57.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bfdd9b700 1 --2- 172.21.15.36:0/2012947558 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6be40536b0 0x7f6be4055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:57.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.824+0000 7f6bfdd9b700 1 --2- 172.21.15.36:0/2012947558 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6be40536b0 0x7f6be4055b70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f6be800c000 tx=0x7f6be8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:57.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.832+0000 7f6bf77fe700 1 -- 172.21.15.36:0/2012947558 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6bf80420d0 con 0x7f6c000b0610 2022-01-10T01:31:57.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.960+0000 7f6bff59e700 1 -- 172.21.15.36:0/2012947558 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6c0005f240 con 0x7f6c000b0610 2022-01-10T01:31:57.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.968+0000 7f6bf77fe700 1 -- 172.21.15.36:0/2012947558 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6bf80456f0 con 0x7f6c000b0610 2022-01-10T01:31:57.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.968+0000 7f6bff59e700 1 -- 172.21.15.36:0/2012947558 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6be40536b0 msgr2=0x7f6be4055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:57.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.968+0000 7f6bff59e700 1 --2- 172.21.15.36:0/2012947558 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6be40536b0 0x7f6be4055b70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f6be800c000 tx=0x7f6be8008040).stop 2022-01-10T01:31:57.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.968+0000 7f6bff59e700 1 -- 172.21.15.36:0/2012947558 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c000b0610 msgr2=0x7f6c00145b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:57.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.968+0000 7f6bff59e700 1 --2- 172.21.15.36:0/2012947558 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c000b0610 0x7f6c00145b30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7f6c00069d90 tx=0x7f6bf80014a0).stop 2022-01-10T01:31:57.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.968+0000 7f6bff59e700 1 -- 172.21.15.36:0/2012947558 shutdown_connections 2022-01-10T01:31:57.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.968+0000 7f6bff59e700 1 --2- 172.21.15.36:0/2012947558 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6be40536b0 0x7f6be4055b70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:57.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.968+0000 7f6bff59e700 1 --2- 172.21.15.36:0/2012947558 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c001475a0 0x7f6c0015a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:57.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.968+0000 7f6bff59e700 1 --2- 172.21.15.36:0/2012947558 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c000b54a0 0x7f6c0015a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:57.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.968+0000 7f6bff59e700 1 --2- 172.21.15.36:0/2012947558 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6c000b0610 0x7f6c00145b30 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:57.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.968+0000 7f6bff59e700 1 -- 172.21.15.36:0/2012947558 >> 172.21.15.36:0/2012947558 conn(0x7f6c00062560 msgr2=0x7f6c00144680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:57.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.968+0000 7f6bff59e700 1 -- 172.21.15.36:0/2012947558 shutdown_connections 2022-01-10T01:31:57.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:57.968+0000 7f6bff59e700 1 -- 172.21.15.36:0/2012947558 wait complete. 2022-01-10T01:31:57.983 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2022-01-10T01:31:58.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f8205fe8700 1 Processor -- start 2022-01-10T01:31:58.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f8205fe8700 1 -- start start 2022-01-10T01:31:58.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f8205fe8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f82000b54a0 0x7f82000af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:58.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f8205fe8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82000b0610 0x7f82001475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:58.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f8205fe8700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82000b5880 con 0x7f82000675a0 2022-01-10T01:31:58.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f8205fe8700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82001452e0 con 0x7f82000b54a0 2022-01-10T01:31:58.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f8205fe8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82000adff0 con 0x7f82000b0610 2022-01-10T01:31:58.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f82057e7700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f82000675a0 0x7f82000acc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37624/0 (socket says 172.21.15.36:37624) 2022-01-10T01:31:58.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f82057e7700 1 -- 172.21.15.36:0/273829529 learned_addr learned my addr 172.21.15.36:0/273829529 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:31:58.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f8204fe6700 1 --2- 172.21.15.36:0/273829529 >> v2:172.21.15.36:3300/0 conn(0x7f82000b54a0 0x7f82000af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:58.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f81fffff700 1 --2- 172.21.15.36:0/273829529 >> v2:172.21.15.59:3300/0 conn(0x7f82000b0610 0x7f82001475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:58.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f81ff7fe700 1 -- 172.21.15.36:0/273829529 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433637585 0 0) 0x7f82000b5880 con 0x7f82000675a0 2022-01-10T01:31:58.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f81ff7fe700 1 -- 172.21.15.36:0/273829529 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e0003260 con 0x7f82000675a0 2022-01-10T01:31:58.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f8204fe6700 1 -- 172.21.15.36:0/273829529 >> v2:172.21.15.59:3300/0 conn(0x7f82000b0610 msgr2=0x7f82001475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:58.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f8204fe6700 1 --2- 172.21.15.36:0/273829529 >> v2:172.21.15.59:3300/0 conn(0x7f82000b0610 0x7f82001475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:58.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f81ff7fe700 1 -- 172.21.15.36:0/273829529 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2096949804 0 0) 0x7f81e0003260 con 0x7f82000675a0 2022-01-10T01:31:58.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f8204fe6700 1 -- 172.21.15.36:0/273829529 >> v1:172.21.15.36:6789/0 conn(0x7f82000675a0 legacy=0x7f82000acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:58.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f8204fe6700 1 -- 172.21.15.36:0/273829529 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82000ac800 con 0x7f82000b54a0 2022-01-10T01:31:58.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.088+0000 7f8204fe6700 1 --2- 172.21.15.36:0/273829529 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82000b54a0 0x7f82000af550 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f81f8001800 tx=0x7f81e8006df0).ready entity=mon.0 client_cookie=cf2518f35c8135db server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:58.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.092+0000 7f81ff7fe700 1 -- 172.21.15.36:0/273829529 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81f8001660 con 0x7f82000b54a0 2022-01-10T01:31:58.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.092+0000 7f81ff7fe700 1 -- 172.21.15.36:0/273829529 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e8000e90 con 0x7f82000b54a0 2022-01-10T01:31:58.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.092+0000 7f81ff7fe700 1 -- 172.21.15.36:0/273829529 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e8012460 con 0x7f82000b54a0 2022-01-10T01:31:58.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.092+0000 7f8205fe8700 1 -- 172.21.15.36:0/273829529 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82000b54a0 msgr2=0x7f82000af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:58.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.092+0000 7f8205fe8700 1 --2- 172.21.15.36:0/273829529 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82000b54a0 0x7f82000af550 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f81f8001800 tx=0x7f81e8006df0).stop 2022-01-10T01:31:58.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.092+0000 7f8205fe8700 1 -- 172.21.15.36:0/273829529 shutdown_connections 2022-01-10T01:31:58.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.092+0000 7f8205fe8700 1 --2- 172.21.15.36:0/273829529 >> v2:172.21.15.59:3300/0 conn(0x7f82000b0610 0x7f82001475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:58.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.092+0000 7f8205fe8700 1 --2- 172.21.15.36:0/273829529 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82000b54a0 0x7f82000af550 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:58.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.092+0000 7f8205fe8700 1 -- 172.21.15.36:0/273829529 >> 172.21.15.36:0/273829529 conn(0x7f8200062560 msgr2=0x7f8200062940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:58.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.092+0000 7f8205fe8700 1 -- 172.21.15.36:0/273829529 shutdown_connections 2022-01-10T01:31:58.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.092+0000 7f8205fe8700 1 -- 172.21.15.36:0/273829529 wait complete. 2022-01-10T01:31:58.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.092+0000 7f8205fe8700 1 Processor -- start 2022-01-10T01:31:58.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.092+0000 7f8205fe8700 1 -- start start 2022-01-10T01:31:58.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f8205fe8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82000675a0 0x7f8200149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:58.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f8205fe8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82000b0610 0x7f8200142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:58.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f8205fe8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82000b54a0 0x7f8200142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:58.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f8205fe8700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8200065570 con 0x7f82000b0610 2022-01-10T01:31:58.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f8205fe8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000631f0 con 0x7f82000675a0 2022-01-10T01:31:58.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f8205fe8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82000a8640 con 0x7f82000b54a0 2022-01-10T01:31:58.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f81fffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82000b0610 0x7f8200142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:58.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f81fffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82000b0610 0x7f8200142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39832/0 (socket says 172.21.15.36:39832) 2022-01-10T01:31:58.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f81fffff700 1 -- 172.21.15.36:0/2094545065 learned_addr learned my addr 172.21.15.36:0/2094545065 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:58.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f8204fe6700 1 --2- 172.21.15.36:0/2094545065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82000675a0 0x7f8200149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:58.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f82057e7700 1 --2- 172.21.15.36:0/2094545065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82000b54a0 0x7f8200142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:58.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f81fffff700 1 -- 172.21.15.36:0/2094545065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82000b54a0 msgr2=0x7f8200142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:58.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f81fffff700 1 --2- 172.21.15.36:0/2094545065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82000b54a0 0x7f8200142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:58.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f81fffff700 1 -- 172.21.15.36:0/2094545065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82000675a0 msgr2=0x7f8200149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:58.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f81fffff700 1 --2- 172.21.15.36:0/2094545065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82000675a0 0x7f8200149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:58.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f81fffff700 1 -- 172.21.15.36:0/2094545065 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e800b180 con 0x7f82000b0610 2022-01-10T01:31:58.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f81fffff700 1 --2- 172.21.15.36:0/2094545065 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82000b0610 0x7f8200142550 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f81f000c000 tx=0x7f81f00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:58.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f81fdffb700 1 -- 172.21.15.36:0/2094545065 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81f000c850 con 0x7f82000b0610 2022-01-10T01:31:58.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f81fdffb700 1 -- 172.21.15.36:0/2094545065 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f000c9b0 con 0x7f82000b0610 2022-01-10T01:31:58.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f8205fe8700 1 -- 172.21.15.36:0/2094545065 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82000a88e0 con 0x7f82000b0610 2022-01-10T01:31:58.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f81fdffb700 1 -- 172.21.15.36:0/2094545065 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81f000cd10 con 0x7f82000b0610 2022-01-10T01:31:58.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f8205fe8700 1 -- 172.21.15.36:0/2094545065 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8200156b90 con 0x7f82000b0610 2022-01-10T01:31:58.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f8205fe8700 1 -- 172.21.15.36:0/2094545065 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8200156d50 con 0x7f82000b0610 2022-01-10T01:31:58.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.096+0000 7f81fdffb700 1 -- 172.21.15.36:0/2094545065 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f81f0022070 con 0x7f82000b0610 2022-01-10T01:31:58.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.100+0000 7f81fdffb700 1 --2- 172.21.15.36:0/2094545065 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81e40535f0 0x7f81e4055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:58.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.100+0000 7f81fdffb700 1 -- 172.21.15.36:0/2094545065 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f81f006bec0 con 0x7f82000b0610 2022-01-10T01:31:58.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.100+0000 7f8204fe6700 1 --2- 172.21.15.36:0/2094545065 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81e40535f0 0x7f81e4055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:58.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.100+0000 7f8204fe6700 1 --2- 172.21.15.36:0/2094545065 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81e40535f0 0x7f81e4055ab0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f81e8018000 tx=0x7f81e8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:58.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.104+0000 7f81fdffb700 1 -- 172.21.15.36:0/2094545065 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f81f00431b0 con 0x7f82000b0610 2022-01-10T01:31:58.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.272+0000 7f8205fe8700 1 -- 172.21.15.36:0/2094545065 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7f82000b14f0 con 0x7f82000b0610 2022-01-10T01:31:58.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.692+0000 7f81fdffb700 1 -- 172.21.15.36:0/2094545065 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v339) v1 ==== 138+0+0 (secure 0 0 0) 0x7f81f00467d0 con 0x7f82000b0610 2022-01-10T01:31:58.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.696+0000 7f8205fe8700 1 -- 172.21.15.36:0/2094545065 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81e40535f0 msgr2=0x7f81e4055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:58.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.696+0000 7f8205fe8700 1 --2- 172.21.15.36:0/2094545065 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81e40535f0 0x7f81e4055ab0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f81e8018000 tx=0x7f81e8014000).stop 2022-01-10T01:31:58.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.696+0000 7f8205fe8700 1 -- 172.21.15.36:0/2094545065 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82000b0610 msgr2=0x7f8200142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:58.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.696+0000 7f8205fe8700 1 --2- 172.21.15.36:0/2094545065 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82000b0610 0x7f8200142550 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f81f000c000 tx=0x7f81f00091d0).stop 2022-01-10T01:31:58.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.696+0000 7f8205fe8700 1 -- 172.21.15.36:0/2094545065 shutdown_connections 2022-01-10T01:31:58.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.696+0000 7f8205fe8700 1 --2- 172.21.15.36:0/2094545065 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81e40535f0 0x7f81e4055ab0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:58.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.696+0000 7f8205fe8700 1 --2- 172.21.15.36:0/2094545065 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82000b54a0 0x7f8200142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:58.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.696+0000 7f8205fe8700 1 --2- 172.21.15.36:0/2094545065 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f82000b0610 0x7f8200142550 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:58.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.696+0000 7f8205fe8700 1 --2- 172.21.15.36:0/2094545065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82000675a0 0x7f8200149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:58.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.696+0000 7f8205fe8700 1 -- 172.21.15.36:0/2094545065 >> 172.21.15.36:0/2094545065 conn(0x7f8200062560 msgr2=0x7f8200143970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:58.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.696+0000 7f8205fe8700 1 -- 172.21.15.36:0/2094545065 shutdown_connections 2022-01-10T01:31:58.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.696+0000 7f8205fe8700 1 -- 172.21.15.36:0/2094545065 wait complete. 2022-01-10T01:31:58.714 INFO:tasks.cephfs_test_runner:test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) ... ok 2022-01-10T01:31:58.714 INFO:tasks.cephfs_test_runner:Starting test: test_filtered_df (tasks.cephfs.test_misc.TestMisc) 2022-01-10T01:31:58.715 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2022-01-10T01:31:58.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09c175a700 1 Processor -- start 2022-01-10T01:31:58.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09c175a700 1 -- start start 2022-01-10T01:31:58.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09c175a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09bc0b1db0 0x7f09bc0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:58.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09c175a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f09bc1483a0 0x7f09bc0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:58.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09c175a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc0b0350 con 0x7f09bc0a70c0 2022-01-10T01:31:58.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09c175a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc0a90c0 con 0x7f09bc1483a0 2022-01-10T01:31:58.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09c175a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc0b05f0 con 0x7f09bc0b1db0 2022-01-10T01:31:58.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09ba7fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f09bc1483a0 0x7f09bc0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:58.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09ba7fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f09bc1483a0 0x7f09bc0b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39844/0 (socket says 172.21.15.36:39844) 2022-01-10T01:31:58.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09baffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09bc0b1db0 0x7f09bc0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:58.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09ba7fc700 1 -- 172.21.15.36:0/2623582716 learned_addr learned my addr 172.21.15.36:0/2623582716 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:58.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09baffd700 1 -- 172.21.15.36:0/2623582716 >> v2:172.21.15.36:3300/0 conn(0x7f09bc1483a0 msgr2=0x7f09bc0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:58.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09baffd700 1 --2- 172.21.15.36:0/2623582716 >> v2:172.21.15.36:3300/0 conn(0x7f09bc1483a0 0x7f09bc0b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:58.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09baffd700 1 -- 172.21.15.36:0/2623582716 >> v1:172.21.15.59:6789/0 conn(0x7f09bc0a70c0 legacy=0x7f09bc144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:58.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09baffd700 1 -- 172.21.15.36:0/2623582716 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc0b0890 con 0x7f09bc0b1db0 2022-01-10T01:31:58.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09baffd700 1 --2- 172.21.15.36:0/2623582716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc0b1db0 0x7f09bc0b0fd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f09bc147730 tx=0x7f09ac0091d0).ready entity=mon.1 client_cookie=5a18bf0e34ed08b5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:58.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09b9ffb700 1 -- 172.21.15.36:0/2623582716 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09ac00b680 con 0x7f09bc0b1db0 2022-01-10T01:31:58.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09b9ffb700 1 -- 172.21.15.36:0/2623582716 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac00b7e0 con 0x7f09bc0b1db0 2022-01-10T01:31:58.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.820+0000 7f09b9ffb700 1 -- 172.21.15.36:0/2623582716 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09ac00b950 con 0x7f09bc0b1db0 2022-01-10T01:31:58.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.824+0000 7f09c175a700 1 -- 172.21.15.36:0/2623582716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc0b1db0 msgr2=0x7f09bc0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:58.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.824+0000 7f09c175a700 1 --2- 172.21.15.36:0/2623582716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc0b1db0 0x7f09bc0b0fd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7f09bc147730 tx=0x7f09ac0091d0).stop 2022-01-10T01:31:58.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.824+0000 7f09c175a700 1 -- 172.21.15.36:0/2623582716 shutdown_connections 2022-01-10T01:31:58.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.824+0000 7f09c175a700 1 --2- 172.21.15.36:0/2623582716 >> v2:172.21.15.36:3300/0 conn(0x7f09bc1483a0 0x7f09bc0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:58.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.824+0000 7f09c175a700 1 --2- 172.21.15.36:0/2623582716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc0b1db0 0x7f09bc0b0fd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:58.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.824+0000 7f09c175a700 1 -- 172.21.15.36:0/2623582716 >> 172.21.15.36:0/2623582716 conn(0x7f09bc05f6b0 msgr2=0x7f09bc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:58.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.824+0000 7f09c175a700 1 -- 172.21.15.36:0/2623582716 shutdown_connections 2022-01-10T01:31:58.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.824+0000 7f09c175a700 1 -- 172.21.15.36:0/2623582716 wait complete. 2022-01-10T01:31:58.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.824+0000 7f09c175a700 1 Processor -- start 2022-01-10T01:31:58.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.824+0000 7f09c175a700 1 -- start start 2022-01-10T01:31:58.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09c175a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc0a70c0 0x7f09bc0af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:58.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09c175a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09bc0b1db0 0x7f09bc143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:58.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09c175a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc1483a0 0x7f09bc143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:58.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09c175a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc14aba0 con 0x7f09bc0b1db0 2022-01-10T01:31:58.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09c175a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc149f00 con 0x7f09bc1483a0 2022-01-10T01:31:58.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09c175a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc14a1a0 con 0x7f09bc0a70c0 2022-01-10T01:31:58.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09ba7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09bc0b1db0 0x7f09bc143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:58.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09ba7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09bc0b1db0 0x7f09bc143840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39848/0 (socket says 172.21.15.36:39848) 2022-01-10T01:31:58.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09ba7fc700 1 -- 172.21.15.36:0/250915881 learned_addr learned my addr 172.21.15.36:0/250915881 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:58.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09baffd700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc0a70c0 0x7f09bc0af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:58.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09ba7fc700 1 -- 172.21.15.36:0/250915881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc0a70c0 msgr2=0x7f09bc0af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:58.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09ba7fc700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc0a70c0 0x7f09bc0af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:58.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09ba7fc700 1 -- 172.21.15.36:0/250915881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc1483a0 msgr2=0x7f09bc143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:58.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09bb7fe700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc1483a0 0x7f09bc143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:58.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09ba7fc700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc1483a0 0x7f09bc143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:58.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09ba7fc700 1 -- 172.21.15.36:0/250915881 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac009470 con 0x7f09bc0b1db0 2022-01-10T01:31:58.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09bb7fe700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc1483a0 0x7f09bc143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:31:58.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09ba7fc700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09bc0b1db0 0x7f09bc143840 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f09a400c000 tx=0x7f09a4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:58.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09b3fff700 1 -- 172.21.15.36:0/250915881 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09a4013610 con 0x7f09bc0b1db0 2022-01-10T01:31:58.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09c175a700 1 -- 172.21.15.36:0/250915881 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09bc154940 con 0x7f09bc0b1db0 2022-01-10T01:31:58.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09b3fff700 1 -- 172.21.15.36:0/250915881 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a4013770 con 0x7f09bc0b1db0 2022-01-10T01:31:58.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09b3fff700 1 -- 172.21.15.36:0/250915881 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f09a4013ad0 con 0x7f09bc0b1db0 2022-01-10T01:31:58.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.828+0000 7f09c175a700 1 -- 172.21.15.36:0/250915881 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc14a690 con 0x7f09bc0b1db0 2022-01-10T01:31:58.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.832+0000 7f09c175a700 1 -- 172.21.15.36:0/250915881 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09bc14bad0 con 0x7f09bc0b1db0 2022-01-10T01:31:58.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.832+0000 7f09b3fff700 1 -- 172.21.15.36:0/250915881 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f09a4023070 con 0x7f09bc0b1db0 2022-01-10T01:31:58.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.832+0000 7f09b3fff700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0994053560 0x7f0994055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:58.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.832+0000 7f09b3fff700 1 -- 172.21.15.36:0/250915881 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f09a406bba0 con 0x7f09bc0b1db0 2022-01-10T01:31:58.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.832+0000 7f09baffd700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0994053560 0x7f0994055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:58.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.832+0000 7f09baffd700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0994053560 0x7f0994055a20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f09ac019000 tx=0x7f09ac016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:58.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:58.836+0000 7f09b3fff700 1 -- 172.21.15.36:0/250915881 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f09bc14bad0 con 0x7f09bc0b1db0 2022-01-10T01:31:59.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.004+0000 7f09c175a700 1 -- 172.21.15.36:0/250915881 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f09bc14bad0 con 0x7f09bc0b1db0 2022-01-10T01:31:59.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.696+0000 7f09b3fff700 1 -- 172.21.15.36:0/250915881 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v340) v1 ==== 130+0+0 (secure 0 0 0) 0x7f09bc14bad0 con 0x7f09bc0b1db0 2022-01-10T01:31:59.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.700+0000 7f09c175a700 1 -- 172.21.15.36:0/250915881 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0994053560 msgr2=0x7f0994055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:59.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.700+0000 7f09c175a700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0994053560 0x7f0994055a20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f09ac019000 tx=0x7f09ac016000).stop 2022-01-10T01:31:59.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.700+0000 7f09c175a700 1 -- 172.21.15.36:0/250915881 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09bc0b1db0 msgr2=0x7f09bc143840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:59.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.700+0000 7f09c175a700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09bc0b1db0 0x7f09bc143840 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f09a400c000 tx=0x7f09a4008040).stop 2022-01-10T01:31:59.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.700+0000 7f09c175a700 1 -- 172.21.15.36:0/250915881 shutdown_connections 2022-01-10T01:31:59.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.700+0000 7f09c175a700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0994053560 0x7f0994055a20 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:59.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.700+0000 7f09c175a700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc1483a0 0x7f09bc143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:59.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.700+0000 7f09c175a700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f09bc0b1db0 0x7f09bc143840 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:59.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.700+0000 7f09c175a700 1 --2- 172.21.15.36:0/250915881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09bc0a70c0 0x7f09bc0af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:59.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.700+0000 7f09c175a700 1 -- 172.21.15.36:0/250915881 >> 172.21.15.36:0/250915881 conn(0x7f09bc05f6b0 msgr2=0x7f09bc0b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:59.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.700+0000 7f09c175a700 1 -- 172.21.15.36:0/250915881 shutdown_connections 2022-01-10T01:31:59.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.700+0000 7f09c175a700 1 -- 172.21.15.36:0/250915881 wait complete. 2022-01-10T01:31:59.718 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2022-01-10T01:31:59.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.828+0000 7f3d5c662700 1 Processor -- start 2022-01-10T01:31:59.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.828+0000 7f3d5c662700 1 -- start start 2022-01-10T01:31:59.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5c662700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d540b6560 0x7f3d540b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:59.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5c662700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d540b5990 0x7f3d540b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:59.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5c662700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d54143f60 con 0x7f3d5405fc00 2022-01-10T01:31:59.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5c662700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d540ba6b0 con 0x7f3d540b5990 2022-01-10T01:31:59.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5c662700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5405ffe0 con 0x7f3d540b6560 2022-01-10T01:31:59.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d59bfd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d540b6560 0x7f3d540b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:59.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5abff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d540b5990 0x7f3d540b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:59.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d59bfd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d540b6560 0x7f3d540b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:46138/0 (socket says 172.21.15.36:46138) 2022-01-10T01:31:59.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5abff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d540b5990 0x7f3d540b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:36492/0 (socket says 172.21.15.36:36492) 2022-01-10T01:31:59.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5a3fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3d5405fc00 0x7f3d540b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:55324/0 (socket says 172.21.15.36:55324) 2022-01-10T01:31:59.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d59bfd700 1 -- 172.21.15.36:0/2662220161 learned_addr learned my addr 172.21.15.36:0/2662220161 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:59.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d59bfd700 1 -- 172.21.15.36:0/2662220161 >> v2:172.21.15.59:3300/0 conn(0x7f3d540b5990 msgr2=0x7f3d540b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:31:59.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d59bfd700 1 --2- 172.21.15.36:0/2662220161 >> v2:172.21.15.59:3300/0 conn(0x7f3d540b5990 0x7f3d540b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:59.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d59bfd700 1 -- 172.21.15.36:0/2662220161 >> v1:172.21.15.59:6789/0 conn(0x7f3d5405fc00 legacy=0x7f3d540b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:59.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d59bfd700 1 -- 172.21.15.36:0/2662220161 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d54143a50 con 0x7f3d540b6560 2022-01-10T01:31:59.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d59bfd700 1 --2- 172.21.15.36:0/2662220161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d540b6560 0x7f3d540b41b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3d48002f70 tx=0x7f3d48006eb0).ready entity=mon.2 client_cookie=4f529c56b3e2cc77 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:59.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d593fc700 1 -- 172.21.15.36:0/2662220161 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d4800d570 con 0x7f3d540b6560 2022-01-10T01:31:59.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d593fc700 1 -- 172.21.15.36:0/2662220161 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d48000e90 con 0x7f3d540b6560 2022-01-10T01:31:59.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d593fc700 1 -- 172.21.15.36:0/2662220161 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d4800d900 con 0x7f3d540b6560 2022-01-10T01:31:59.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5c662700 1 -- 172.21.15.36:0/2662220161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d540b6560 msgr2=0x7f3d540b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:59.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5c662700 1 --2- 172.21.15.36:0/2662220161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d540b6560 0x7f3d540b41b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3d48002f70 tx=0x7f3d48006eb0).stop 2022-01-10T01:31:59.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5c662700 1 -- 172.21.15.36:0/2662220161 shutdown_connections 2022-01-10T01:31:59.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5c662700 1 --2- 172.21.15.36:0/2662220161 >> v2:172.21.15.59:3300/0 conn(0x7f3d540b5990 0x7f3d540b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:59.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5c662700 1 --2- 172.21.15.36:0/2662220161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d540b6560 0x7f3d540b41b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:59.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5c662700 1 -- 172.21.15.36:0/2662220161 >> 172.21.15.36:0/2662220161 conn(0x7f3d540623a0 msgr2=0x7f3d54066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:59.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5c662700 1 -- 172.21.15.36:0/2662220161 shutdown_connections 2022-01-10T01:31:59.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.832+0000 7f3d5c662700 1 -- 172.21.15.36:0/2662220161 wait complete. 2022-01-10T01:31:59.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5c662700 1 Processor -- start 2022-01-10T01:31:59.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5c662700 1 -- start start 2022-01-10T01:31:59.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5c662700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d5405fc00 0x7f3d54144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:59.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5c662700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d540b5990 0x7f3d540aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:59.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5c662700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d540b6560 0x7f3d54152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:59.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5c662700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d540b0420 con 0x7f3d5405fc00 2022-01-10T01:31:59.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5c662700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d541491f0 con 0x7f3d540b5990 2022-01-10T01:31:59.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5c662700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d54149420 con 0x7f3d540b6560 2022-01-10T01:31:59.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5a3fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d5405fc00 0x7f3d54144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:59.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5a3fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d5405fc00 0x7f3d54144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39860/0 (socket says 172.21.15.36:39860) 2022-01-10T01:31:59.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5a3fe700 1 -- 172.21.15.36:0/4284890425 learned_addr learned my addr 172.21.15.36:0/4284890425 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:31:59.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5abff700 1 --2- 172.21.15.36:0/4284890425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d540b6560 0x7f3d54152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:59.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d59bfd700 1 --2- 172.21.15.36:0/4284890425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d540b5990 0x7f3d540aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:59.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5a3fe700 1 -- 172.21.15.36:0/4284890425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d540b6560 msgr2=0x7f3d54152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:59.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5a3fe700 1 --2- 172.21.15.36:0/4284890425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d540b6560 0x7f3d54152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:59.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5a3fe700 1 -- 172.21.15.36:0/4284890425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d540b5990 msgr2=0x7f3d540aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:59.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5a3fe700 1 --2- 172.21.15.36:0/4284890425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d540b5990 0x7f3d540aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:59.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5a3fe700 1 -- 172.21.15.36:0/4284890425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4800b1e0 con 0x7f3d5405fc00 2022-01-10T01:31:59.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5a3fe700 1 --2- 172.21.15.36:0/4284890425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d5405fc00 0x7f3d54144950 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f3d540616a0 tx=0x7f3d50007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:59.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d477fe700 1 -- 172.21.15.36:0/4284890425 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d500070d0 con 0x7f3d5405fc00 2022-01-10T01:31:59.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d477fe700 1 -- 172.21.15.36:0/4284890425 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50007230 con 0x7f3d5405fc00 2022-01-10T01:31:59.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5c662700 1 -- 172.21.15.36:0/4284890425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d541496c0 con 0x7f3d5405fc00 2022-01-10T01:31:59.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d477fe700 1 -- 172.21.15.36:0/4284890425 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d50005550 con 0x7f3d5405fc00 2022-01-10T01:31:59.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.836+0000 7f3d5c662700 1 -- 172.21.15.36:0/4284890425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d541461c0 con 0x7f3d5405fc00 2022-01-10T01:31:59.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.840+0000 7f3d477fe700 1 -- 172.21.15.36:0/4284890425 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3d50010070 con 0x7f3d5405fc00 2022-01-10T01:31:59.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.840+0000 7f3d5c662700 1 -- 172.21.15.36:0/4284890425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d54143cc0 con 0x7f3d5405fc00 2022-01-10T01:31:59.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.840+0000 7f3d477fe700 1 --2- 172.21.15.36:0/4284890425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d34053590 0x7f3d34055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:31:59.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.840+0000 7f3d477fe700 1 -- 172.21.15.36:0/4284890425 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f3d5006ac20 con 0x7f3d5405fc00 2022-01-10T01:31:59.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.840+0000 7f3d59bfd700 1 --2- 172.21.15.36:0/4284890425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d34053590 0x7f3d34055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:31:59.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.840+0000 7f3d59bfd700 1 --2- 172.21.15.36:0/4284890425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d34053590 0x7f3d34055a50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f3d4801c000 tx=0x7f3d48015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:31:59.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.848+0000 7f3d477fe700 1 -- 172.21.15.36:0/4284890425 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3d50041f10 con 0x7f3d5405fc00 2022-01-10T01:31:59.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.976+0000 7f3d5c662700 1 -- 172.21.15.36:0/4284890425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3d54057350 con 0x7f3d5405fc00 2022-01-10T01:31:59.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.984+0000 7f3d477fe700 1 -- 172.21.15.36:0/4284890425 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3d50045530 con 0x7f3d5405fc00 2022-01-10T01:31:59.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.988+0000 7f3d5c662700 1 -- 172.21.15.36:0/4284890425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d34053590 msgr2=0x7f3d34055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:59.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.988+0000 7f3d5c662700 1 --2- 172.21.15.36:0/4284890425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d34053590 0x7f3d34055a50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f3d4801c000 tx=0x7f3d48015000).stop 2022-01-10T01:31:59.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.988+0000 7f3d5c662700 1 -- 172.21.15.36:0/4284890425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d5405fc00 msgr2=0x7f3d54144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:31:59.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.988+0000 7f3d5c662700 1 --2- 172.21.15.36:0/4284890425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d5405fc00 0x7f3d54144950 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7f3d540616a0 tx=0x7f3d50007c40).stop 2022-01-10T01:31:59.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.988+0000 7f3d5c662700 1 -- 172.21.15.36:0/4284890425 shutdown_connections 2022-01-10T01:31:59.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.988+0000 7f3d5c662700 1 --2- 172.21.15.36:0/4284890425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d34053590 0x7f3d34055a50 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:59.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.988+0000 7f3d5c662700 1 --2- 172.21.15.36:0/4284890425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d540b6560 0x7f3d54152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:59.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.988+0000 7f3d5c662700 1 --2- 172.21.15.36:0/4284890425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d540b5990 0x7f3d540aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:59.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.988+0000 7f3d5c662700 1 --2- 172.21.15.36:0/4284890425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d5405fc00 0x7f3d54144950 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:31:59.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.988+0000 7f3d5c662700 1 -- 172.21.15.36:0/4284890425 >> 172.21.15.36:0/4284890425 conn(0x7f3d540623a0 msgr2=0x7f3d54140010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:31:59.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.988+0000 7f3d5c662700 1 -- 172.21.15.36:0/4284890425 shutdown_connections 2022-01-10T01:31:59.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:31:59.988+0000 7f3d5c662700 1 -- 172.21.15.36:0/4284890425 wait complete. 2022-01-10T01:32:00.000 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:32:00.001 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:32:00.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:32:00.041 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:32:00.061 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:32:00.081 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:32:00.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:00.082 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:00.083 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:00.090 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2022-01-10T01:32:00.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:32:00.091 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2022-01-10T01:32:00.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:00.092 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:00.092 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:00.099 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:32:00.099 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:32:00.100 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:32:00.101 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:32:00.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 Processor -- start 2022-01-10T01:32:00.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 -- start start 2022-01-10T01:32:00.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f15c0139ae0 0x7f15c0142db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:00.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15c01432a0 0x7f15c00ab530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:00.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c00b1c50 0x7f15c00aba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:00.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c00b3010 con 0x7f15c0139ae0 2022-01-10T01:32:00.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c00af320 con 0x7f15c01432a0 2022-01-10T01:32:00.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c00ac470 con 0x7f15c00b1c50 2022-01-10T01:32:00.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15bffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f15c0139ae0 0x7f15c0142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:00.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15bf7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15c01432a0 0x7f15c00ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:00.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c4a62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c00b1c50 0x7f15c00aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:00.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15bffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f15c0139ae0 0x7f15c0142db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39870/0 (socket says 172.21.15.36:39870) 2022-01-10T01:32:00.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15bffff700 1 -- 172.21.15.36:0/299028170 learned_addr learned my addr 172.21.15.36:0/299028170 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:00.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15bf7fe700 1 -- 172.21.15.36:0/299028170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c00b1c50 msgr2=0x7f15c00aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:00.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15bf7fe700 1 --2- 172.21.15.36:0/299028170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c00b1c50 0x7f15c00aba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15bf7fe700 1 -- 172.21.15.36:0/299028170 >> v2:172.21.15.36:3300/0 conn(0x7f15c0139ae0 msgr2=0x7f15c0142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:00.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15bf7fe700 1 --2- 172.21.15.36:0/299028170 >> v2:172.21.15.36:3300/0 conn(0x7f15c0139ae0 0x7f15c0142db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15bf7fe700 1 -- 172.21.15.36:0/299028170 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c0143730 con 0x7f15c01432a0 2022-01-10T01:32:00.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15bf7fe700 1 --2- 172.21.15.36:0/299028170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c01432a0 0x7f15c00ab530 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f15b4002f70 tx=0x7f15b4006df0).ready entity=mon.1 client_cookie=45d5b15d09892a1d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:00.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15beffd700 1 -- 172.21.15.36:0/299028170 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b400d4a0 con 0x7f15c01432a0 2022-01-10T01:32:00.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15beffd700 1 -- 172.21.15.36:0/299028170 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b4000e90 con 0x7f15c01432a0 2022-01-10T01:32:00.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15beffd700 1 -- 172.21.15.36:0/299028170 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b400d7f0 con 0x7f15c01432a0 2022-01-10T01:32:00.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 -- 172.21.15.36:0/299028170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c01432a0 msgr2=0x7f15c00ab530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:00.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 --2- 172.21.15.36:0/299028170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c01432a0 0x7f15c00ab530 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f15b4002f70 tx=0x7f15b4006df0).stop 2022-01-10T01:32:00.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 -- 172.21.15.36:0/299028170 shutdown_connections 2022-01-10T01:32:00.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 --2- 172.21.15.36:0/299028170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c00b1c50 0x7f15c00aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 --2- 172.21.15.36:0/299028170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c01432a0 0x7f15c00ab530 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 --2- 172.21.15.36:0/299028170 >> v2:172.21.15.36:3300/0 conn(0x7f15c0139ae0 0x7f15c0142db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 -- 172.21.15.36:0/299028170 >> 172.21.15.36:0/299028170 conn(0x7f15c005f6b0 msgr2=0x7f15c005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:00.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 -- 172.21.15.36:0/299028170 shutdown_connections 2022-01-10T01:32:00.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.208+0000 7f15c64c5700 1 -- 172.21.15.36:0/299028170 wait complete. 2022-01-10T01:32:00.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15c64c5700 1 Processor -- start 2022-01-10T01:32:00.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15c64c5700 1 -- start start 2022-01-10T01:32:00.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15c64c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c00b1c50 0x7f15c013c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:00.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15c64c5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15c013e200 0x7f15c013e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:00.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15c64c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c0155d00 0x7f15c0156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:00.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15c64c5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c013eb70 con 0x7f15c013e200 2022-01-10T01:32:00.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15c64c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c01529a0 con 0x7f15c00b1c50 2022-01-10T01:32:00.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15c64c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c0152c40 con 0x7f15c0155d00 2022-01-10T01:32:00.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15bf7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15c013e200 0x7f15c013e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:00.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15bf7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15c013e200 0x7f15c013e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39876/0 (socket says 172.21.15.36:39876) 2022-01-10T01:32:00.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15bf7fe700 1 -- 172.21.15.36:0/4209528715 learned_addr learned my addr 172.21.15.36:0/4209528715 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:00.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15bffff700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c00b1c50 0x7f15c013c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:00.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15c4a62700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c0155d00 0x7f15c0156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:00.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15bf7fe700 1 -- 172.21.15.36:0/4209528715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c0155d00 msgr2=0x7f15c0156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:00.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15bf7fe700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c0155d00 0x7f15c0156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15bf7fe700 1 -- 172.21.15.36:0/4209528715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c00b1c50 msgr2=0x7f15c013c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:00.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15bf7fe700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c00b1c50 0x7f15c013c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15bf7fe700 1 -- 172.21.15.36:0/4209528715 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b400b180 con 0x7f15c013e200 2022-01-10T01:32:00.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15c4a62700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c0155d00 0x7f15c0156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:00.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15bffff700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c00b1c50 0x7f15c013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:00.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15bf7fe700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15c013e200 0x7f15c013e680 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f15b4002f70 tx=0x7f15b4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:00.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15bd7fa700 1 -- 172.21.15.36:0/4209528715 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b4013d50 con 0x7f15c013e200 2022-01-10T01:32:00.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15bd7fa700 1 -- 172.21.15.36:0/4209528715 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b401e400 con 0x7f15c013e200 2022-01-10T01:32:00.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15bd7fa700 1 -- 172.21.15.36:0/4209528715 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15b401e760 con 0x7f15c013e200 2022-01-10T01:32:00.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15c64c5700 1 -- 172.21.15.36:0/4209528715 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c0152ee0 con 0x7f15c013e200 2022-01-10T01:32:00.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.212+0000 7f15c64c5700 1 -- 172.21.15.36:0/4209528715 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c0156670 con 0x7f15c013e200 2022-01-10T01:32:00.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.216+0000 7f15c64c5700 1 -- 172.21.15.36:0/4209528715 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c01439d0 con 0x7f15c013e200 2022-01-10T01:32:00.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.216+0000 7f15bd7fa700 1 -- 172.21.15.36:0/4209528715 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f15b401c070 con 0x7f15c013e200 2022-01-10T01:32:00.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.216+0000 7f15bd7fa700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15a0053590 0x7f15a0055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:00.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.216+0000 7f15bd7fa700 1 -- 172.21.15.36:0/4209528715 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f15b406c0e0 con 0x7f15c013e200 2022-01-10T01:32:00.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.216+0000 7f15bffff700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15a0053590 0x7f15a0055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:00.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.216+0000 7f15bffff700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15a0053590 0x7f15a0055a50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f15b0008000 tx=0x7f15b0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:00.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.224+0000 7f15bd7fa700 1 -- 172.21.15.36:0/4209528715 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f15b40433d0 con 0x7f15c013e200 2022-01-10T01:32:00.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.352+0000 7f15c64c5700 1 -- 172.21.15.36:0/4209528715 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f15c0057350 con 0x7f15c013e200 2022-01-10T01:32:00.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.352+0000 7f15bd7fa700 1 -- 172.21.15.36:0/4209528715 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v103) v1 ==== 81+0+29221 (secure 0 0 0) 0x7f15b4023020 con 0x7f15c013e200 2022-01-10T01:32:00.357 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:00.357 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:32:00.358 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 103, 2022-01-10T01:32:00.358 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:32:00.358 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:32:00.358 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:31:57.682423+0000", 2022-01-10T01:32:00.359 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:32:00.359 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:32:00.359 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:32:00.359 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:32:00.359 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:32:00.360 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:32:00.360 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:32:00.360 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:32:00.360 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:32:00.361 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:32:00.361 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:32:00.361 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:32:00.361 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:32:00.362 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:32:00.362 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:32:00.362 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 18, 2022-01-10T01:32:00.362 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:32:00.363 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:32:00.363 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:32:00.363 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:32:00.363 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:32:00.364 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.364 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:32:00.364 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:32:00.365 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:32:00.365 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:32:00.366 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:32:00.366 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:32:00.367 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:32:00.367 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:32:00.368 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:32:00.368 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:32:00.368 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:32:00.369 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:32:00.369 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:32:00.369 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:32:00.369 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:32:00.370 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:32:00.370 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:32:00.370 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:32:00.370 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:32:00.371 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:32:00.371 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:32:00.371 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:32:00.371 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:32:00.371 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.372 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:32:00.372 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:32:00.372 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:32:00.372 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:32:00.373 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:32:00.373 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:32:00.373 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:32:00.373 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:32:00.373 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:32:00.374 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:32:00.374 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:32:00.374 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:32:00.374 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:32:00.375 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:32:00.375 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:32:00.375 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:32:00.375 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:32:00.375 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:32:00.376 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:32:00.376 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:32:00.376 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:32:00.376 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:32:00.377 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:32:00.377 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:32:00.377 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:32:00.377 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:32:00.378 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:32:00.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.378 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:32:00.379 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:32:00.379 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:32:00.379 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:32:00.379 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:32:00.380 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:32:00.380 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:32:00.380 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:32:00.380 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:32:00.381 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:32:00.381 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:32:00.381 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:32:00.381 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:32:00.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.382 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:32:00.382 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:32:00.382 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.382 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.383 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.383 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:32:00.383 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:32:00.383 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:32:00.384 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:32:00.384 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:32:00.384 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:32:00.384 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:32:00.385 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:32:00.385 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:32:00.385 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:32:00.385 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:32:00.386 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:32:00.386 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:32:00.386 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:32:00.387 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:32:00.387 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:32:00.387 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:32:00.387 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:32:00.388 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:32:00.388 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:32:00.388 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:32:00.388 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:32:00.388 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:32:00.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.390 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:32:00.390 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:32:00.390 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:32:00.390 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:32:00.391 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:32:00.391 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:32:00.391 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:32:00.391 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:32:00.391 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:32:00.392 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:32:00.392 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:32:00.392 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:32:00.392 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:32:00.392 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:32:00.393 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:32:00.393 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:32:00.393 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:32:00.393 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:32:00.394 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:32:00.394 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:32:00.394 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:32:00.394 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:32:00.395 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:32:00.395 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:32:00.395 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:32:00.396 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:32:00.396 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:32:00.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.397 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:32:00.397 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:32:00.397 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:32:00.398 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:32:00.398 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:32:00.399 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:32:00.399 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:32:00.399 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:32:00.400 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:32:00.400 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:32:00.400 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:32:00.401 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:32:00.401 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:32:00.401 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:32:00.402 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.402 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.402 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:32:00.403 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:32:00.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.404 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:32:00.404 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:32:00.404 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:00.405 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:00.405 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:00.405 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:00.406 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:00.406 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:00.406 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:00.407 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 98, 2022-01-10T01:32:00.407 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:00.407 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:00.407 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:00.407 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.408 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.408 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:32:00.408 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:00.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.410 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.410 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:32:00.410 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:00.411 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.411 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.411 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.412 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:00.412 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.412 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.413 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:32:00.413 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:00.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.413 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.413 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.414 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:32:00.414 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:00.414 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.414 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.415 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:00.416 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.416 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.416 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.417 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:32:00.417 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:00.418 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.418 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.418 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.419 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:32:00.419 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:00.419 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.419 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.420 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.420 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:00.420 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.421 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.421 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:32:00.421 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:00.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.421 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.422 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.422 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:32:00.422 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:00.422 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.423 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.423 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:32:00.423 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:32:00.423 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:32:00.424 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:32:00.424 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:00.424 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:00.424 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:00.425 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.425 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.425 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:32:00.426 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:32:00.426 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:00.426 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:00.427 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:00.427 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:00.427 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:00.427 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:00.428 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:00.428 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 97, 2022-01-10T01:32:00.428 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:00.428 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:00.428 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:00.429 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.429 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.429 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:32:00.430 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:00.430 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.430 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.430 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.431 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:32:00.431 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:00.431 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.431 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.432 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:00.432 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.432 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.432 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.433 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:32:00.433 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:00.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.434 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.434 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:32:00.434 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:00.434 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.435 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.435 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.435 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:00.435 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.436 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.436 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.436 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:32:00.436 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:00.436 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.437 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.437 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:32:00.437 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:00.438 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.438 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.438 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:00.439 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.439 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.439 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.439 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:32:00.440 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:00.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.440 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.441 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:32:00.441 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:00.441 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.441 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.442 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:32:00.442 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:32:00.442 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:32:00.442 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:32:00.442 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:00.443 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:00.443 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:00.443 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.444 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:32:00.444 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:32:00.444 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:00.445 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:00.445 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:00.447 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:00.447 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:00.447 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:00.447 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:00.448 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 98, 2022-01-10T01:32:00.448 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:00.448 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:00.448 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:00.449 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.449 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.449 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.449 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:32:00.449 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:00.450 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.450 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.450 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.450 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:32:00.451 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:00.451 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.451 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.452 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:00.452 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.452 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.452 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.452 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:32:00.453 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:00.453 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.453 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.453 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.454 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:32:00.454 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:00.454 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.454 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.454 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.455 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:00.455 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.456 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:32:00.456 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:00.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.456 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.456 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.457 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:32:00.457 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:00.457 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.457 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.457 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.458 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:00.458 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.458 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.459 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:32:00.459 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:00.459 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.459 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.459 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.460 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:32:00.460 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:00.460 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.460 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.461 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.461 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:32:00.461 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:32:00.461 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:32:00.461 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:32:00.462 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:00.462 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:00.462 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:00.462 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.463 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.463 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:32:00.463 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:32:00.463 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:00.464 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:00.464 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:00.464 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:00.464 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:00.465 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:00.465 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:00.465 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 86, 2022-01-10T01:32:00.465 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:00.466 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:00.466 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:00.466 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.466 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.467 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.467 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:32:00.467 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:00.467 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.467 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.468 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.468 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:32:00.468 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:00.468 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.469 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.469 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.469 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:00.469 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.469 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.470 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.470 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:32:00.470 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:00.471 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.471 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.472 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:32:00.472 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:00.472 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.472 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.473 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:00.473 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.473 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.473 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.474 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:32:00.474 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:00.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.474 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.475 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:32:00.475 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:00.475 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.475 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.476 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.476 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:00.476 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.476 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.476 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.477 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:32:00.477 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:00.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.478 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.478 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:32:00.478 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:00.478 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.479 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.479 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.479 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:32:00.479 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:32:00.480 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:32:00.480 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:32:00.480 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:00.480 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:00.480 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:00.481 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.481 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:32:00.482 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:32:00.482 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:00.482 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:00.482 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:00.483 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:00.483 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:00.483 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:00.483 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:00.484 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 98, 2022-01-10T01:32:00.484 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:00.484 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:00.484 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:00.484 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.485 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.485 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:32:00.485 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:00.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.486 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.486 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.486 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:32:00.486 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:00.487 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.487 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.487 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.487 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:00.488 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.488 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.488 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.488 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:32:00.488 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:00.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.489 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.489 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:32:00.490 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:00.490 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.490 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.490 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:00.491 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.491 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.491 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:32:00.492 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:00.492 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.492 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.492 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:32:00.492 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:00.493 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.493 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.493 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:00.494 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.494 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.494 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.494 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:32:00.494 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:00.495 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.495 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.495 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:32:00.495 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:00.496 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.496 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.496 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:32:00.497 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:32:00.497 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:32:00.497 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:32:00.497 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:00.497 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:00.498 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:00.498 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.499 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:32:00.499 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:32:00.499 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:00.499 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:00.499 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:00.500 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:00.500 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:00.500 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:00.500 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:00.500 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 98, 2022-01-10T01:32:00.501 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:00.501 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:00.501 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:00.501 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.502 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.502 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:32:00.502 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:00.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.503 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.503 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.503 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:32:00.503 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:00.504 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.504 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.504 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.504 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:00.505 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.505 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.505 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:32:00.505 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:00.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.506 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.506 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.506 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:32:00.507 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:00.507 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.507 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.507 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.507 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:00.508 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.508 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.508 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:32:00.508 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:00.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.509 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.509 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.509 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:32:00.510 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:00.510 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.510 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.510 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:00.511 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.511 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.511 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:32:00.512 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:00.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.512 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.512 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:32:00.513 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:00.513 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.513 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.514 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:32:00.514 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:32:00.514 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:32:00.514 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:32:00.514 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:00.515 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:00.515 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:00.515 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.516 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:32:00.516 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:32:00.516 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:00.516 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:00.516 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:00.517 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:00.517 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:00.517 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:00.517 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:00.518 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 98, 2022-01-10T01:32:00.518 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:00.518 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:00.518 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:00.518 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.519 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.519 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:32:00.519 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:00.520 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.520 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.520 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:32:00.520 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:00.521 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.521 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.521 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:00.521 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.522 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.522 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.522 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:32:00.522 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:00.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.523 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.523 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:32:00.523 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:00.524 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.524 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.524 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:00.525 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.525 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.525 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:32:00.525 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:00.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.526 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.526 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:32:00.527 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:00.527 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.527 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.527 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:00.528 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.528 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.528 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:32:00.529 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:00.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.529 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.529 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.530 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:32:00.530 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:00.530 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.530 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.531 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:32:00.531 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:32:00.531 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:32:00.531 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:32:00.532 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:00.532 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:00.532 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:00.532 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.533 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:32:00.533 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:32:00.533 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:00.534 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:00.534 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:00.534 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:00.534 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:00.534 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:00.535 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:00.535 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 98, 2022-01-10T01:32:00.535 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:00.535 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:00.536 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:00.536 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.536 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.536 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:32:00.537 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:00.537 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.537 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.537 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.538 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:32:00.538 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:00.538 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.538 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.539 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:00.539 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.539 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.540 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:32:00.540 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:00.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.540 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.541 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:32:00.541 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:00.541 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.541 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.542 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:00.542 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.542 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.543 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:32:00.543 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:00.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.544 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.544 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:32:00.544 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:00.544 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.544 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.545 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:00.545 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:00.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.546 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:00.546 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:32:00.546 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:00.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.547 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:00.547 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:32:00.547 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:00.547 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.548 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.548 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:32:00.548 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:32:00.549 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:32:00.549 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:32:00.549 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:00.549 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:00.549 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:00.550 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:00.550 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.550 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:32:00.550 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:32:00.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.551 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:32:00.551 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:00.551 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:00.552 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:00.552 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:00.552 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:00.552 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:32:00.552 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:00.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.553 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:32:00.553 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:00.554 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:00.554 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:00.554 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:00.554 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:00.555 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:32:00.555 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:00.555 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.555 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:32:00.556 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:00.556 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:00.556 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:00.556 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:00.557 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:00.557 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:32:00.557 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:00.557 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.558 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:32:00.558 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:00.558 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:00.558 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:00.559 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:00.559 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:00.559 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:32:00.559 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:00.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.560 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:32:00.560 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:00.560 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:00.561 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:00.561 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:00.561 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:00.561 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:32:00.562 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:00.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.562 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.562 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:32:00.563 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:00.563 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:00.563 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:00.563 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:00.564 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:00.564 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:32:00.564 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:00.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.565 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:32:00.565 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:00.565 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:00.565 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:00.566 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:00.566 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:00.566 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:32:00.566 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:00.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:00.567 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:32:00.567 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:00.567 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:00.568 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:00.568 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:00.568 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:00.568 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:32:00.569 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:00.569 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.569 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:32:00.569 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:32:00.569 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:32:00.570 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:32:00.570 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:32:00.570 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": { 2022-01-10T01:32:00.570 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.36:6837/2977677722": "2022-01-11T01:31:53.949640+0000", 2022-01-10T01:32:00.571 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.36:6836/2977677722": "2022-01-11T01:31:53.949640+0000" 2022-01-10T01:32:00.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.571 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:32:00.571 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:32:00.571 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:32:00.572 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:32:00.572 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:32:00.572 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:32:00.572 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:32:00.573 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:32:00.573 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:32:00.573 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:32:00.573 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:32:00.573 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:32:00.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.574 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:32:00.574 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:32:00.574 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:32:00.575 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:32:00.575 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:32:00.575 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:32:00.575 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:32:00.575 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:00.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:00.576 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:32:00.576 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:32:00.576 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:32:00.577 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:32:00.577 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:32:00.577 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:32:00.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.356+0000 7f15c64c5700 1 -- 172.21.15.36:0/4209528715 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15a0053590 msgr2=0x7f15a0055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:00.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.356+0000 7f15c64c5700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15a0053590 0x7f15a0055a50 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f15b0008000 tx=0x7f15b0008040).stop 2022-01-10T01:32:00.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.356+0000 7f15c64c5700 1 -- 172.21.15.36:0/4209528715 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15c013e200 msgr2=0x7f15c013e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:00.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.356+0000 7f15c64c5700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15c013e200 0x7f15c013e680 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f15b4002f70 tx=0x7f15b4014000).stop 2022-01-10T01:32:00.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.356+0000 7f15c64c5700 1 -- 172.21.15.36:0/4209528715 shutdown_connections 2022-01-10T01:32:00.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.356+0000 7f15c64c5700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15a0053590 0x7f15a0055a50 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.356+0000 7f15c64c5700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c0155d00 0x7f15c0156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.356+0000 7f15c64c5700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15c013e200 0x7f15c013e680 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.356+0000 7f15c64c5700 1 --2- 172.21.15.36:0/4209528715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c00b1c50 0x7f15c013c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.356+0000 7f15c64c5700 1 -- 172.21.15.36:0/4209528715 >> 172.21.15.36:0/4209528715 conn(0x7f15c005f6b0 msgr2=0x7f15c00ad6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:00.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.356+0000 7f15c64c5700 1 -- 172.21.15.36:0/4209528715 shutdown_connections 2022-01-10T01:32:00.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.356+0000 7f15c64c5700 1 -- 172.21.15.36:0/4209528715 wait complete. 2022-01-10T01:32:00.583 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:32:00.695 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.692+0000 7f0dc2c5d700 1 Processor -- start 2022-01-10T01:32:00.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.692+0000 7f0dc2c5d700 1 -- start start 2022-01-10T01:32:00.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0dbc061320 0x7f0dbc061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:00.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0dbc0ad5c0 0x7f0dbc0b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:00.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dbc140440 0x7f0dbc1408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:00.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dbc0aecf0 con 0x7f0dbc0ad5c0 2022-01-10T01:32:00.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b6f20 con 0x7f0dbc061320 2022-01-10T01:32:00.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0aef20 con 0x7f0dbc140440 2022-01-10T01:32:00.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc145a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0dbc0ad5c0 0x7f0dbc0b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:00.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc145a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0dbc0ad5c0 0x7f0dbc0b9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39884/0 (socket says 172.21.15.36:39884) 2022-01-10T01:32:00.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc145a700 1 -- 172.21.15.36:0/2128216821 learned_addr learned my addr 172.21.15.36:0/2128216821 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:00.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc245c700 1 --2- 172.21.15.36:0/2128216821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dbc140440 0x7f0dbc1408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:00.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc1c5b700 1 --2- 172.21.15.36:0/2128216821 >> v2:172.21.15.59:3300/0 conn(0x7f0dbc061320 0x7f0dbc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:00.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc145a700 1 -- 172.21.15.36:0/2128216821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dbc140440 msgr2=0x7f0dbc1408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:00.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc145a700 1 --2- 172.21.15.36:0/2128216821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dbc140440 0x7f0dbc1408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc145a700 1 -- 172.21.15.36:0/2128216821 >> v2:172.21.15.59:3300/0 conn(0x7f0dbc061320 msgr2=0x7f0dbc061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:00.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc145a700 1 --2- 172.21.15.36:0/2128216821 >> v2:172.21.15.59:3300/0 conn(0x7f0dbc061320 0x7f0dbc061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc145a700 1 -- 172.21.15.36:0/2128216821 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc0af1c0 con 0x7f0dbc0ad5c0 2022-01-10T01:32:00.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc145a700 1 --2- 172.21.15.36:0/2128216821 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0dbc0ad5c0 0x7f0dbc0b9e60 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f0dbc0aeba0 tx=0x7f0dac006eb0).ready entity=mon.0 client_cookie=9afa4151dbc64237 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:00.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc0c59700 1 -- 172.21.15.36:0/2128216821 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dac00e610 con 0x7f0dbc0ad5c0 2022-01-10T01:32:00.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc0c59700 1 -- 172.21.15.36:0/2128216821 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac000e90 con 0x7f0dbc0ad5c0 2022-01-10T01:32:00.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc0c59700 1 -- 172.21.15.36:0/2128216821 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0dac00e9a0 con 0x7f0dbc0ad5c0 2022-01-10T01:32:00.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/2128216821 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0dbc0ad5c0 msgr2=0x7f0dbc0b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:00.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 --2- 172.21.15.36:0/2128216821 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0dbc0ad5c0 0x7f0dbc0b9e60 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f0dbc0aeba0 tx=0x7f0dac006eb0).stop 2022-01-10T01:32:00.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/2128216821 shutdown_connections 2022-01-10T01:32:00.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 --2- 172.21.15.36:0/2128216821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dbc140440 0x7f0dbc1408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 --2- 172.21.15.36:0/2128216821 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0dbc0ad5c0 0x7f0dbc0b9e60 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 --2- 172.21.15.36:0/2128216821 >> v2:172.21.15.59:3300/0 conn(0x7f0dbc061320 0x7f0dbc061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/2128216821 >> 172.21.15.36:0/2128216821 conn(0x7f0dbc066de0 msgr2=0x7f0dbc0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:00.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/2128216821 shutdown_connections 2022-01-10T01:32:00.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.696+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/2128216821 wait complete. 2022-01-10T01:32:00.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.700+0000 7f0dc2c5d700 1 Processor -- start 2022-01-10T01:32:00.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.700+0000 7f0dc2c5d700 1 -- start start 2022-01-10T01:32:00.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.700+0000 7f0dc2c5d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dbc061320 0x7f0dbc1522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:00.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.700+0000 7f0dc2c5d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dbc0ad5c0 0x7f0dbc1417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:00.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.700+0000 7f0dc2c5d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0dbc140440 0x7f0dbc0b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:00.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.700+0000 7f0dc2c5d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b2b80 con 0x7f0dbc140440 2022-01-10T01:32:00.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc2c5d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b0410 con 0x7f0dbc061320 2022-01-10T01:32:00.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc2c5d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc1563a0 con 0x7f0dbc0ad5c0 2022-01-10T01:32:00.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc245c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0dbc140440 0x7f0dbc0b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:00.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc245c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0dbc140440 0x7f0dbc0b33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39892/0 (socket says 172.21.15.36:39892) 2022-01-10T01:32:00.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc245c700 1 -- 172.21.15.36:0/855803433 learned_addr learned my addr 172.21.15.36:0/855803433 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:00.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc145a700 1 --2- 172.21.15.36:0/855803433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dbc0ad5c0 0x7f0dbc1417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:00.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc1c5b700 1 --2- 172.21.15.36:0/855803433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dbc061320 0x7f0dbc1522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:00.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc245c700 1 -- 172.21.15.36:0/855803433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dbc0ad5c0 msgr2=0x7f0dbc1417f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:00.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc245c700 1 --2- 172.21.15.36:0/855803433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dbc0ad5c0 0x7f0dbc1417f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc245c700 1 -- 172.21.15.36:0/855803433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dbc061320 msgr2=0x7f0dbc1522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:00.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc245c700 1 --2- 172.21.15.36:0/855803433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dbc061320 0x7f0dbc1522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc245c700 1 -- 172.21.15.36:0/855803433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac00b1e0 con 0x7f0dbc140440 2022-01-10T01:32:00.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc245c700 1 --2- 172.21.15.36:0/855803433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0dbc140440 0x7f0dbc0b33c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f0dbc1562c0 tx=0x7f0db40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:00.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0daaffd700 1 -- 172.21.15.36:0/855803433 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0db400ee70 con 0x7f0dbc140440 2022-01-10T01:32:00.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0daaffd700 1 -- 172.21.15.36:0/855803433 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db400c7f0 con 0x7f0dbc140440 2022-01-10T01:32:00.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0daaffd700 1 -- 172.21.15.36:0/855803433 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0db400cb50 con 0x7f0dbc140440 2022-01-10T01:32:00.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/855803433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dbc0afc70 con 0x7f0dbc140440 2022-01-10T01:32:00.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/855803433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc0af9d0 con 0x7f0dbc140440 2022-01-10T01:32:00.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/855803433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dbc0af460 con 0x7f0dbc140440 2022-01-10T01:32:00.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0daaffd700 1 -- 172.21.15.36:0/855803433 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0db4022070 con 0x7f0dbc140440 2022-01-10T01:32:00.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.704+0000 7f0daaffd700 1 --2- 172.21.15.36:0/855803433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0d9c0534d0 0x7f0d9c055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:00.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.708+0000 7f0daaffd700 1 -- 172.21.15.36:0/855803433 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f0db406bcc0 con 0x7f0dbc140440 2022-01-10T01:32:00.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.708+0000 7f0dc1c5b700 1 --2- 172.21.15.36:0/855803433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0d9c0534d0 0x7f0d9c055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:00.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.708+0000 7f0dc1c5b700 1 --2- 172.21.15.36:0/855803433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0d9c0534d0 0x7f0d9c055990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f0db800b000 tx=0x7f0db8006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:00.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.716+0000 7f0daaffd700 1 -- 172.21.15.36:0/855803433 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0db4042fb0 con 0x7f0dbc140440 2022-01-10T01:32:00.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.880+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/855803433 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0dbc057350 con 0x7f0dbc140440 2022-01-10T01:32:00.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.880+0000 7f0daaffd700 1 -- 172.21.15.36:0/855803433 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f0db4016020 con 0x7f0dbc140440 2022-01-10T01:32:00.883 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:00.883 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":48,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6933,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4213696854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4213696854},{"type":"v1","addr":"172.21.15.59:6833","nonce":4213696854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44},{"gid":6945,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/4101368080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":4101368080},{"type":"v1","addr":"172.21.15.36:6835","nonce":4101368080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44},{"gid":7171,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/3529640928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":3529640928},{"type":"v1","addr":"172.21.15.36:6837","nonce":3529640928}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[]} 2022-01-10T01:32:00.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.884+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/855803433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0d9c0534d0 msgr2=0x7f0d9c055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:00.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.884+0000 7f0dc2c5d700 1 --2- 172.21.15.36:0/855803433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0d9c0534d0 0x7f0d9c055990 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f0db800b000 tx=0x7f0db8006df0).stop 2022-01-10T01:32:00.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.884+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/855803433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0dbc140440 msgr2=0x7f0dbc0b33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:00.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.884+0000 7f0dc2c5d700 1 --2- 172.21.15.36:0/855803433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0dbc140440 0x7f0dbc0b33c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f0dbc1562c0 tx=0x7f0db40091d0).stop 2022-01-10T01:32:00.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.884+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/855803433 shutdown_connections 2022-01-10T01:32:00.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.884+0000 7f0dc2c5d700 1 --2- 172.21.15.36:0/855803433 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0d9c0534d0 0x7f0d9c055990 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.884+0000 7f0dc2c5d700 1 --2- 172.21.15.36:0/855803433 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0dbc140440 0x7f0dbc0b33c0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.884+0000 7f0dc2c5d700 1 --2- 172.21.15.36:0/855803433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0dbc0ad5c0 0x7f0dbc1417f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.884+0000 7f0dc2c5d700 1 --2- 172.21.15.36:0/855803433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dbc061320 0x7f0dbc1522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:00.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.884+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/855803433 >> 172.21.15.36:0/855803433 conn(0x7f0dbc066de0 msgr2=0x7f0dbc144350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:00.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.884+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/855803433 shutdown_connections 2022-01-10T01:32:00.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:00.884+0000 7f0dc2c5d700 1 -- 172.21.15.36:0/855803433 wait complete. 2022-01-10T01:32:00.888 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 48 2022-01-10T01:32:00.896 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:32:01.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 Processor -- start 2022-01-10T01:32:01.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 -- start start 2022-01-10T01:32:01.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7940b6900 0x7fa7941447c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:01.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa7940aa080 0x7fa794144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:01.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa79405fdd0 0x7fa79414abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:01.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7940b6ce0 con 0x7fa7940aa080 2022-01-10T01:32:01.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7940ac550 con 0x7fa79405fdd0 2022-01-10T01:32:01.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940ac7f0 con 0x7fa7940b6900 2022-01-10T01:32:01.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa798f06700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa7940aa080 0x7fa794144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:01.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa798f06700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa7940aa080 0x7fa794144cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39898/0 (socket says 172.21.15.36:39898) 2022-01-10T01:32:01.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa798f06700 1 -- 172.21.15.36:0/3586119469 learned_addr learned my addr 172.21.15.36:0/3586119469 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:01.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa799707700 1 --2- 172.21.15.36:0/3586119469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7940b6900 0x7fa7941447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:01.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa799f08700 1 --2- 172.21.15.36:0/3586119469 >> v2:172.21.15.59:3300/0 conn(0x7fa79405fdd0 0x7fa79414abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:01.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa798f06700 1 -- 172.21.15.36:0/3586119469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7940b6900 msgr2=0x7fa7941447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:01.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa798f06700 1 --2- 172.21.15.36:0/3586119469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7940b6900 0x7fa7941447c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa798f06700 1 -- 172.21.15.36:0/3586119469 >> v2:172.21.15.59:3300/0 conn(0x7fa79405fdd0 msgr2=0x7fa79414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:01.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa798f06700 1 --2- 172.21.15.36:0/3586119469 >> v2:172.21.15.59:3300/0 conn(0x7fa79405fdd0 0x7fa79414abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa798f06700 1 -- 172.21.15.36:0/3586119469 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7940aca90 con 0x7fa7940aa080 2022-01-10T01:32:01.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa798f06700 1 --2- 172.21.15.36:0/3586119469 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7940aa080 0x7fa794144cb0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7fa788002f70 tx=0x7fa788006eb0).ready entity=mon.0 client_cookie=bacd744021e368f3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:01.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa787fff700 1 -- 172.21.15.36:0/3586119469 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa78800d570 con 0x7fa7940aa080 2022-01-10T01:32:01.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa787fff700 1 -- 172.21.15.36:0/3586119469 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa788000e90 con 0x7fa7940aa080 2022-01-10T01:32:01.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa787fff700 1 -- 172.21.15.36:0/3586119469 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa78800d900 con 0x7fa7940aa080 2022-01-10T01:32:01.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 -- 172.21.15.36:0/3586119469 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7940aa080 msgr2=0x7fa794144cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:01.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 --2- 172.21.15.36:0/3586119469 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7940aa080 0x7fa794144cb0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7fa788002f70 tx=0x7fa788006eb0).stop 2022-01-10T01:32:01.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 -- 172.21.15.36:0/3586119469 shutdown_connections 2022-01-10T01:32:01.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 --2- 172.21.15.36:0/3586119469 >> v2:172.21.15.59:3300/0 conn(0x7fa79405fdd0 0x7fa79414abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 --2- 172.21.15.36:0/3586119469 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7940aa080 0x7fa794144cb0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 --2- 172.21.15.36:0/3586119469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7940b6900 0x7fa7941447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.000+0000 7fa79b96b700 1 -- 172.21.15.36:0/3586119469 >> 172.21.15.36:0/3586119469 conn(0x7fa7940b3480 msgr2=0x7fa7940b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:01.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa79b96b700 1 -- 172.21.15.36:0/3586119469 shutdown_connections 2022-01-10T01:32:01.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa79b96b700 1 -- 172.21.15.36:0/3586119469 wait complete. 2022-01-10T01:32:01.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa79b96b700 1 Processor -- start 2022-01-10T01:32:01.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa79b96b700 1 -- start start 2022-01-10T01:32:01.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa79b96b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa79405fdd0 0x7fa79414ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:01.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa79b96b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7940aa080 0x7fa794063030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:01.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa79b96b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7940b6900 0x7fa79414c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:01.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa79b96b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa794146260 con 0x7fa7940aa080 2022-01-10T01:32:01.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa79b96b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79414a070 con 0x7fa7940b6900 2022-01-10T01:32:01.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa79b96b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa794148170 con 0x7fa79405fdd0 2022-01-10T01:32:01.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa798f06700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7940aa080 0x7fa794063030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:01.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa798f06700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7940aa080 0x7fa794063030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39904/0 (socket says 172.21.15.36:39904) 2022-01-10T01:32:01.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa798f06700 1 -- 172.21.15.36:0/3336902652 learned_addr learned my addr 172.21.15.36:0/3336902652 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:01.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa799707700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa79405fdd0 0x7fa79414ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:01.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa799f08700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7940b6900 0x7fa79414c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:01.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa799f08700 1 -- 172.21.15.36:0/3336902652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa79405fdd0 msgr2=0x7fa79414ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:01.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa799f08700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa79405fdd0 0x7fa79414ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa799f08700 1 -- 172.21.15.36:0/3336902652 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7940aa080 msgr2=0x7fa794063030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:01.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa799f08700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7940aa080 0x7fa794063030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa799f08700 1 -- 172.21.15.36:0/3336902652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78800b1e0 con 0x7fa7940b6900 2022-01-10T01:32:01.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa798f06700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7940aa080 0x7fa794063030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:01.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.004+0000 7fa799f08700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7940b6900 0x7fa79414c1f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fa7941463a0 tx=0x7fa78c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:01.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.008+0000 7fa786ffd700 1 -- 172.21.15.36:0/3336902652 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa78c011750 con 0x7fa7940b6900 2022-01-10T01:32:01.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.008+0000 7fa786ffd700 1 -- 172.21.15.36:0/3336902652 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c0118b0 con 0x7fa7940b6900 2022-01-10T01:32:01.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.008+0000 7fa79b96b700 1 -- 172.21.15.36:0/3336902652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa794148410 con 0x7fa7940b6900 2022-01-10T01:32:01.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.008+0000 7fa786ffd700 1 -- 172.21.15.36:0/3336902652 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa78c011c10 con 0x7fa7940b6900 2022-01-10T01:32:01.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.008+0000 7fa79b96b700 1 -- 172.21.15.36:0/3336902652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa794156720 con 0x7fa7940b6900 2022-01-10T01:32:01.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.008+0000 7fa79b96b700 1 -- 172.21.15.36:0/3336902652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7941485a0 con 0x7fa7940b6900 2022-01-10T01:32:01.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.008+0000 7fa786ffd700 1 -- 172.21.15.36:0/3336902652 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa78c011d70 con 0x7fa7940b6900 2022-01-10T01:32:01.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.008+0000 7fa786ffd700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa770053500 0x7fa7700559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:01.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.008+0000 7fa786ffd700 1 -- 172.21.15.36:0/3336902652 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fa78c06b950 con 0x7fa7940b6900 2022-01-10T01:32:01.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.008+0000 7fa799707700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa770053500 0x7fa7700559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:01.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.008+0000 7fa799707700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa770053500 0x7fa7700559c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fa79000b000 tx=0x7fa7900091d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:01.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.020+0000 7fa786ffd700 1 -- 172.21.15.36:0/3336902652 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa78c042be0 con 0x7fa7940b6900 2022-01-10T01:32:01.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.184+0000 7fa79b96b700 1 -- 172.21.15.36:0/3336902652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7940acd30 con 0x7fa7940b6900 2022-01-10T01:32:01.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.184+0000 7fa786ffd700 1 -- 172.21.15.36:0/3336902652 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+1562 (secure 0 0 0) 0x7fa78c046200 con 0x7fa7940b6900 2022-01-10T01:32:01.188 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:01.188 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":48,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6933,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4213696854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4213696854},{"type":"v1","addr":"172.21.15.59:6833","nonce":4213696854}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44},{"gid":6945,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/4101368080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":4101368080},{"type":"v1","addr":"172.21.15.36:6835","nonce":4101368080}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44},{"gid":7171,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/3529640928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":3529640928},{"type":"v1","addr":"172.21.15.36:6837","nonce":3529640928}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":48}],"filesystems":[]} 2022-01-10T01:32:01.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.188+0000 7fa79b96b700 1 -- 172.21.15.36:0/3336902652 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa770053500 msgr2=0x7fa7700559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:01.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.188+0000 7fa79b96b700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa770053500 0x7fa7700559c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fa79000b000 tx=0x7fa7900091d0).stop 2022-01-10T01:32:01.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.188+0000 7fa79b96b700 1 -- 172.21.15.36:0/3336902652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7940b6900 msgr2=0x7fa79414c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:01.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.188+0000 7fa79b96b700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7940b6900 0x7fa79414c1f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fa7941463a0 tx=0x7fa78c006df0).stop 2022-01-10T01:32:01.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.188+0000 7fa79b96b700 1 -- 172.21.15.36:0/3336902652 shutdown_connections 2022-01-10T01:32:01.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.188+0000 7fa79b96b700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa770053500 0x7fa7700559c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.188+0000 7fa79b96b700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7940b6900 0x7fa79414c1f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.188+0000 7fa79b96b700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7940aa080 0x7fa794063030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.188+0000 7fa79b96b700 1 --2- 172.21.15.36:0/3336902652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa79405fdd0 0x7fa79414ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.188+0000 7fa79b96b700 1 -- 172.21.15.36:0/3336902652 >> 172.21.15.36:0/3336902652 conn(0x7fa7940b3480 msgr2=0x7fa79414ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:01.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.188+0000 7fa79b96b700 1 -- 172.21.15.36:0/3336902652 shutdown_connections 2022-01-10T01:32:01.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.188+0000 7fa79b96b700 1 -- 172.21.15.36:0/3336902652 wait complete. 2022-01-10T01:32:01.193 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 48 2022-01-10T01:32:01.204 INFO:tasks.ceph.mds.a:Restarting daemon 2022-01-10T01:32:01.205 INFO:tasks.ceph.mds.a:Stopping old one... 2022-01-10T01:32:01.205 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-01-10T01:32:01.206 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:32:01.206 INFO:tasks.ceph.mds.c:Restarting daemon 2022-01-10T01:32:01.206 INFO:tasks.ceph.mds.c:Stopping old one... 2022-01-10T01:32:01.207 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-01-10T01:32:01.207 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:32:01.207 INFO:tasks.ceph.mds.b:Restarting daemon 2022-01-10T01:32:01.207 INFO:tasks.ceph.mds.b:Stopping old one... 2022-01-10T01:32:01.208 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-01-10T01:32:01.208 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:32:01.217 INFO:tasks.ceph.mds.c:Stopped 2022-01-10T01:32:01.218 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-01-10T01:32:01.222 INFO:tasks.ceph.mds.a:Stopped 2022-01-10T01:32:01.222 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-01-10T01:32:01.224 INFO:tasks.ceph.mds.b:Stopped 2022-01-10T01:32:01.224 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-01-10T01:32:01.227 INFO:tasks.ceph.mds.b:Started 2022-01-10T01:32:01.227 DEBUG:teuthology.parallel:result is None 2022-01-10T01:32:01.265 INFO:tasks.ceph.mds.c:Started 2022-01-10T01:32:01.266 DEBUG:teuthology.parallel:result is None 2022-01-10T01:32:01.267 INFO:tasks.ceph.mds.a:Started 2022-01-10T01:32:01.267 DEBUG:teuthology.parallel:result is None 2022-01-10T01:32:01.268 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2022-01-10T01:32:01.299 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:32:01.338 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:32:01.338 INFO:tasks.ceph.mds.c.smithi036.stdout:starting mds.c at 2022-01-10T01:32:01.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.372+0000 7fdf1f605700 1 Processor -- start 2022-01-10T01:32:01.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.372+0000 7fdf1f605700 1 -- start start 2022-01-10T01:32:01.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1f605700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fdf180b55c0 0x7fdf180b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:01.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1f605700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf180ab760 0x7fdf180ac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:01.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1f605700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf180b0350 con 0x7fdf180ac520 2022-01-10T01:32:01.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1f605700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf181410f0 con 0x7fdf180b55c0 2022-01-10T01:32:01.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1f605700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf180b05f0 con 0x7fdf180ab760 2022-01-10T01:32:01.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1d3a1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fdf180b55c0 0x7fdf180b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:01.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1d3a1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fdf180b55c0 0x7fdf180b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39934/0 (socket says 172.21.15.36:39934) 2022-01-10T01:32:01.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1d3a1700 1 -- 172.21.15.36:0/1243345518 learned_addr learned my addr 172.21.15.36:0/1243345518 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:01.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1cba0700 1 --2- 172.21.15.36:0/1243345518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf180ab760 0x7fdf180ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:01.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1d3a1700 1 -- 172.21.15.36:0/1243345518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf180ab760 msgr2=0x7fdf180ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:01.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1d3a1700 1 --2- 172.21.15.36:0/1243345518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf180ab760 0x7fdf180ac030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1d3a1700 1 -- 172.21.15.36:0/1243345518 >> v1:172.21.15.36:6789/0 conn(0x7fdf180ac520 legacy=0x7fdf18141780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:01.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1d3a1700 1 -- 172.21.15.36:0/1243345518 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf181412e0 con 0x7fdf180b55c0 2022-01-10T01:32:01.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1cba0700 1 --2- 172.21.15.36:0/1243345518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf180ab760 0x7fdf180ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:32:01.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1d3a1700 1 --2- 172.21.15.36:0/1243345518 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdf180b55c0 0x7fdf180b59a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fdf100032f0 tx=0x7fdf10009290).ready entity=mon.0 client_cookie=fb7035f81a119762 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:01.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf07fff700 1 -- 172.21.15.36:0/1243345518 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf1000b8a0 con 0x7fdf180b55c0 2022-01-10T01:32:01.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf07fff700 1 -- 172.21.15.36:0/1243345518 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1000ba00 con 0x7fdf180b55c0 2022-01-10T01:32:01.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf07fff700 1 -- 172.21.15.36:0/1243345518 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf1000bb70 con 0x7fdf180b55c0 2022-01-10T01:32:01.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1f605700 1 -- 172.21.15.36:0/1243345518 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdf180b55c0 msgr2=0x7fdf180b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:01.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1f605700 1 --2- 172.21.15.36:0/1243345518 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdf180b55c0 0x7fdf180b59a0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fdf100032f0 tx=0x7fdf10009290).stop 2022-01-10T01:32:01.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1f605700 1 -- 172.21.15.36:0/1243345518 shutdown_connections 2022-01-10T01:32:01.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1f605700 1 --2- 172.21.15.36:0/1243345518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf180ab760 0x7fdf180ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1f605700 1 --2- 172.21.15.36:0/1243345518 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdf180b55c0 0x7fdf180b59a0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1f605700 1 -- 172.21.15.36:0/1243345518 >> 172.21.15.36:0/1243345518 conn(0x7fdf180608d0 msgr2=0x7fdf18060ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:01.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1f605700 1 -- 172.21.15.36:0/1243345518 shutdown_connections 2022-01-10T01:32:01.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.376+0000 7fdf1f605700 1 -- 172.21.15.36:0/1243345518 wait complete. 2022-01-10T01:32:01.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1f605700 1 Processor -- start 2022-01-10T01:32:01.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1f605700 1 -- start start 2022-01-10T01:32:01.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1f605700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdf180ab760 0x7fdf180b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:01.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1f605700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf180ac520 0x7fdf18153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:01.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1f605700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf180b55c0 0x7fdf18154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:01.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1f605700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf18153970 con 0x7fdf180ab760 2022-01-10T01:32:01.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1f605700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf180636d0 con 0x7fdf180ac520 2022-01-10T01:32:01.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1f605700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf18063970 con 0x7fdf180b55c0 2022-01-10T01:32:01.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1d3a1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdf180ab760 0x7fdf180b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:01.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1d3a1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdf180ab760 0x7fdf180b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39940/0 (socket says 172.21.15.36:39940) 2022-01-10T01:32:01.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1d3a1700 1 -- 172.21.15.36:0/990686862 learned_addr learned my addr 172.21.15.36:0/990686862 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:01.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1cba0700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf180ac520 0x7fdf18153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:01.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1d3a1700 1 -- 172.21.15.36:0/990686862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf180b55c0 msgr2=0x7fdf18154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:01.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1dba2700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf180b55c0 0x7fdf18154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:01.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1d3a1700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf180b55c0 0x7fdf18154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1d3a1700 1 -- 172.21.15.36:0/990686862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf180ac520 msgr2=0x7fdf18153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:01.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1d3a1700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf180ac520 0x7fdf18153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:01.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1d3a1700 1 -- 172.21.15.36:0/990686862 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf10009530 con 0x7fdf180ab760 2022-01-10T01:32:01.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1cba0700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf180ac520 0x7fdf18153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:32:01.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1dba2700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf180b55c0 0x7fdf18154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:32:01.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1d3a1700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdf180ab760 0x7fdf180b1d60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7fdf100032f0 tx=0x7fdf10016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:01.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf067fc700 1 -- 172.21.15.36:0/990686862 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf10021630 con 0x7fdf180ab760 2022-01-10T01:32:01.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf067fc700 1 -- 172.21.15.36:0/990686862 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf10021790 con 0x7fdf180ab760 2022-01-10T01:32:01.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1f605700 1 -- 172.21.15.36:0/990686862 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf18063c10 con 0x7fdf180ab760 2022-01-10T01:32:01.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf067fc700 1 -- 172.21.15.36:0/990686862 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdf10021af0 con 0x7fdf180ab760 2022-01-10T01:32:01.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.380+0000 7fdf1f605700 1 -- 172.21.15.36:0/990686862 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf180674e0 con 0x7fdf180ab760 2022-01-10T01:32:01.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.384+0000 7fdf1f605700 1 -- 172.21.15.36:0/990686862 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf18153ac0 con 0x7fdf180ab760 2022-01-10T01:32:01.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.384+0000 7fdf067fc700 1 -- 172.21.15.36:0/990686862 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fdf10027020 con 0x7fdf180ab760 2022-01-10T01:32:01.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.384+0000 7fdf067fc700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdef8053560 0x7fdef8055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:01.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.384+0000 7fdf067fc700 1 -- 172.21.15.36:0/990686862 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fdf1006d150 con 0x7fdf180ab760 2022-01-10T01:32:01.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.384+0000 7fdf1cba0700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdef8053560 0x7fdef8055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:01.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.384+0000 7fdf1cba0700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdef8053560 0x7fdef8055a20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fdf08008000 tx=0x7fdf08008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:01.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.392+0000 7fdf067fc700 1 -- 172.21.15.36:0/990686862 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdf18153ac0 con 0x7fdf180ab760 2022-01-10T01:32:01.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:01.532+0000 7fdf1f605700 1 -- 172.21.15.36:0/990686862 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fdf18063da0 con 0x7fdf180ab760 2022-01-10T01:32:01.893 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:32:01.896 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:32:01.899 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:32:01.901 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:32:02.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.368+0000 7fdf067fc700 1 -- 172.21.15.36:0/990686862 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v105) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdf10015070 con 0x7fdf180ab760 2022-01-10T01:32:02.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.372+0000 7fdf1f605700 1 -- 172.21.15.36:0/990686862 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdef8053560 msgr2=0x7fdef8055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:02.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.372+0000 7fdf1f605700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdef8053560 0x7fdef8055a20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fdf08008000 tx=0x7fdf08008040).stop 2022-01-10T01:32:02.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.372+0000 7fdf1f605700 1 -- 172.21.15.36:0/990686862 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdf180ab760 msgr2=0x7fdf180b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:02.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.372+0000 7fdf1f605700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdf180ab760 0x7fdf180b1d60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7fdf100032f0 tx=0x7fdf10016000).stop 2022-01-10T01:32:02.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.372+0000 7fdf1f605700 1 -- 172.21.15.36:0/990686862 shutdown_connections 2022-01-10T01:32:02.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.372+0000 7fdf1f605700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdef8053560 0x7fdef8055a20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.372+0000 7fdf1f605700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf180b55c0 0x7fdf18154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.372+0000 7fdf1f605700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf180ac520 0x7fdf18153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.372+0000 7fdf1f605700 1 --2- 172.21.15.36:0/990686862 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdf180ab760 0x7fdf180b1d60 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.372+0000 7fdf1f605700 1 -- 172.21.15.36:0/990686862 >> 172.21.15.36:0/990686862 conn(0x7fdf180608d0 msgr2=0x7fdf1813cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:02.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.372+0000 7fdf1f605700 1 -- 172.21.15.36:0/990686862 shutdown_connections 2022-01-10T01:32:02.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.372+0000 7fdf1f605700 1 -- 172.21.15.36:0/990686862 wait complete. 2022-01-10T01:32:02.377 INFO:teuthology.orchestra.run.smithi036.stderr: removed all blacklist entries 2022-01-10T01:32:02.387 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2022-01-10T01:32:02.387 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2022-01-10T01:32:02.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b4a2b3700 1 Processor -- start 2022-01-10T01:32:02.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b4a2b3700 1 -- start start 2022-01-10T01:32:02.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b4a2b3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7b440b0fd0 0x7f7b44144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:02.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b4a2b3700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b440b0350 con 0x7f7b441483a0 2022-01-10T01:32:02.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b4a2b3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b440b05f0 con 0x7f7b440b1db0 2022-01-10T01:32:02.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b4a2b3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b440a90c0 con 0x7f7b440b0fd0 2022-01-10T01:32:02.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b437fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f7b441483a0 0x7f7b440a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37746/0 (socket says 172.21.15.36:37746) 2022-01-10T01:32:02.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b437fe700 1 -- 172.21.15.36:0/3672072154 learned_addr learned my addr 172.21.15.36:0/3672072154 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:02.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b48850700 1 --2- 172.21.15.36:0/3672072154 >> v2:172.21.15.59:3300/0 conn(0x7f7b440b0fd0 0x7f7b44144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:02.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b42ffd700 1 -- 172.21.15.36:0/3672072154 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173587189 0 0) 0x7f7b440b0350 con 0x7f7b441483a0 2022-01-10T01:32:02.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b42ffd700 1 -- 172.21.15.36:0/3672072154 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b30003260 con 0x7f7b441483a0 2022-01-10T01:32:02.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b42ffd700 1 -- 172.21.15.36:0/3672072154 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373695287 0 0) 0x7f7b440b05f0 con 0x7f7b440b1db0 2022-01-10T01:32:02.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b42ffd700 1 -- 172.21.15.36:0/3672072154 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b440b0350 con 0x7f7b440b1db0 2022-01-10T01:32:02.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b48850700 1 -- 172.21.15.36:0/3672072154 >> v1:172.21.15.59:6789/0 conn(0x7f7b440b1db0 legacy=0x7f7b440b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:02.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b48850700 1 -- 172.21.15.36:0/3672072154 >> v1:172.21.15.36:6789/0 conn(0x7f7b441483a0 legacy=0x7f7b440a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:02.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b48850700 1 -- 172.21.15.36:0/3672072154 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b440b0890 con 0x7f7b440b0fd0 2022-01-10T01:32:02.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b48850700 1 --2- 172.21.15.36:0/3672072154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b440b0fd0 0x7f7b44144720 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f7b44147730 tx=0x7f7b3c0091d0).ready entity=mon.1 client_cookie=39cd476940e25f96 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:02.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b42ffd700 1 -- 172.21.15.36:0/3672072154 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b3c00b600 con 0x7f7b440b0fd0 2022-01-10T01:32:02.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b42ffd700 1 -- 172.21.15.36:0/3672072154 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c00b760 con 0x7f7b440b0fd0 2022-01-10T01:32:02.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b42ffd700 1 -- 172.21.15.36:0/3672072154 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b3c00b8d0 con 0x7f7b440b0fd0 2022-01-10T01:32:02.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3672072154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b440b0fd0 msgr2=0x7f7b44144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:02.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.492+0000 7f7b4a2b3700 1 --2- 172.21.15.36:0/3672072154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b440b0fd0 0x7f7b44144720 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f7b44147730 tx=0x7f7b3c0091d0).stop 2022-01-10T01:32:02.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3672072154 shutdown_connections 2022-01-10T01:32:02.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b4a2b3700 1 --2- 172.21.15.36:0/3672072154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b440b0fd0 0x7f7b44144720 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3672072154 >> 172.21.15.36:0/3672072154 conn(0x7f7b4405f6b0 msgr2=0x7f7b4405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:02.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3672072154 shutdown_connections 2022-01-10T01:32:02.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3672072154 wait complete. 2022-01-10T01:32:02.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b4a2b3700 1 Processor -- start 2022-01-10T01:32:02.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b4a2b3700 1 -- start start 2022-01-10T01:32:02.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b4a2b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b440b0fd0 0x7f7b440ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:02.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b4a2b3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7b440b1db0 0x7f7b4414a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:02.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b4a2b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b441483a0 0x7f7b441568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:02.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b4a2b3700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b44149df0 con 0x7f7b440b1db0 2022-01-10T01:32:02.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b4a2b3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b440aaeb0 con 0x7f7b441483a0 2022-01-10T01:32:02.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b4a2b3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4414b7f0 con 0x7f7b440b0fd0 2022-01-10T01:32:02.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b437fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7b440b1db0 0x7f7b4414a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:02.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b437fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7b440b1db0 0x7f7b4414a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39958/0 (socket says 172.21.15.36:39958) 2022-01-10T01:32:02.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b437fe700 1 -- 172.21.15.36:0/3725714759 learned_addr learned my addr 172.21.15.36:0/3725714759 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:02.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b48850700 1 --2- 172.21.15.36:0/3725714759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b441483a0 0x7f7b441568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:02.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b43fff700 1 --2- 172.21.15.36:0/3725714759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b440b0fd0 0x7f7b440ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:02.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b437fe700 1 -- 172.21.15.36:0/3725714759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b440b0fd0 msgr2=0x7f7b440ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:02.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b437fe700 1 --2- 172.21.15.36:0/3725714759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b440b0fd0 0x7f7b440ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b437fe700 1 -- 172.21.15.36:0/3725714759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b441483a0 msgr2=0x7f7b441568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:02.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b437fe700 1 --2- 172.21.15.36:0/3725714759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b441483a0 0x7f7b441568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.496+0000 7f7b437fe700 1 -- 172.21.15.36:0/3725714759 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c009470 con 0x7f7b440b1db0 2022-01-10T01:32:02.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.500+0000 7f7b437fe700 1 --2- 172.21.15.36:0/3725714759 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7b440b1db0 0x7f7b4414a510 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f7b38001110 tx=0x7f7b38007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:02.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.500+0000 7f7b417fa700 1 -- 172.21.15.36:0/3725714759 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b3800ce90 con 0x7f7b440b1db0 2022-01-10T01:32:02.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.500+0000 7f7b417fa700 1 -- 172.21.15.36:0/3725714759 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b380070d0 con 0x7f7b440b1db0 2022-01-10T01:32:02.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.500+0000 7f7b417fa700 1 -- 172.21.15.36:0/3725714759 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b38007430 con 0x7f7b440b1db0 2022-01-10T01:32:02.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.500+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3725714759 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4414a050 con 0x7f7b440b1db0 2022-01-10T01:32:02.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.500+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3725714759 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4414aa00 con 0x7f7b440b1db0 2022-01-10T01:32:02.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.500+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3725714759 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b440ab070 con 0x7f7b440b1db0 2022-01-10T01:32:02.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.500+0000 7f7b417fa700 1 -- 172.21.15.36:0/3725714759 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7b38010070 con 0x7f7b440b1db0 2022-01-10T01:32:02.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.500+0000 7f7b417fa700 1 --2- 172.21.15.36:0/3725714759 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7b240535f0 0x7f7b24055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:02.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.500+0000 7f7b417fa700 1 -- 172.21.15.36:0/3725714759 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f7b3806ad80 con 0x7f7b440b1db0 2022-01-10T01:32:02.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.500+0000 7f7b43fff700 1 --2- 172.21.15.36:0/3725714759 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7b240535f0 0x7f7b24055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:02.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.504+0000 7f7b43fff700 1 --2- 172.21.15.36:0/3725714759 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7b240535f0 0x7f7b24055ab0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f7b3400d000 tx=0x7f7b34007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:02.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.508+0000 7f7b417fa700 1 -- 172.21.15.36:0/3725714759 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b440ab070 con 0x7f7b440b1db0 2022-01-10T01:32:02.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.676+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3725714759 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7b440ab020 con 0x7f7b440b1db0 2022-01-10T01:32:02.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.676+0000 7f7b417fa700 1 -- 172.21.15.36:0/3725714759 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f7b3806c070 con 0x7f7b440b1db0 2022-01-10T01:32:02.711 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:02.712 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:32:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_dump": [ 2022-01-10T01:32:02.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.a", 2022-01-10T01:32:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthuGT4IxAA5DyijS4tPjdOLn5uiLXEPg==", 2022-01-10T01:32:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.713 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:32:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:02.714 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.b", 2022-01-10T01:32:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthkvX0LRAAtz19usFvoObvouQeLFwicg==", 2022-01-10T01:32:02.715 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:32:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:02.716 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.717 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.c", 2022-01-10T01:32:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthbvUmKhAA0pVpDJO1AfsAzIHU1cAHiw==", 2022-01-10T01:32:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:32:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:02.718 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.719 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.0", 2022-01-10T01:32:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCWitthk4iKHRAAF7aFP+i24xFvXXm8j5GzVg==", 2022-01-10T01:32:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.720 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:02.721 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.1", 2022-01-10T01:32:02.722 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCZitthsKSXABAAb3IkNvlyLub89HwaPWZ1Bg==", 2022-01-10T01:32:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:02.723 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.2", 2022-01-10T01:32:02.724 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCbitthvNzhIBAAXkZ6FslnMl1gS/rOa7G+Vg==", 2022-01-10T01:32:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:02.725 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.726 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.3", 2022-01-10T01:32:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCeitth9P7EAxAA7KOCP7Rh5oN1yqCz9I6v3A==", 2022-01-10T01:32:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:02.727 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.728 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.4", 2022-01-10T01:32:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCjitth/L1UBxAAskxmSV0aE6CSvDFR8O/+SQ==", 2022-01-10T01:32:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.729 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.730 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.5", 2022-01-10T01:32:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQClitthMoY6JhAAeeIrCmMcm3MpDPtdLUf+2g==", 2022-01-10T01:32:02.731 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.6", 2022-01-10T01:32:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCoitthrUhlCxAAsYhU7Kj6HMo/kD0DezvITg==", 2022-01-10T01:32:02.733 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:02.734 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.735 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.7", 2022-01-10T01:32:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCqitthFaLrKRAAC2g1OlcV2KTtaOXsyCrIrQ==", 2022-01-10T01:32:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:02.736 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:02.737 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:02.737 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.738 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.0", 2022-01-10T01:32:02.738 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthKoa/NBAADjvHh99F8YOktGID9uyttg==", 2022-01-10T01:32:02.738 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.738 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:32:02.739 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:32:02.739 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:32:02.739 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.739 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.739 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.740 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.1", 2022-01-10T01:32:02.740 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth3x76OBAAPTrw8OUmnpEflWuB7zzaHg==", 2022-01-10T01:32:02.740 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.740 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:32:02.741 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:32:02.741 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:32:02.741 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.741 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.742 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.742 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.admin", 2022-01-10T01:32:02.742 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthf9dqChAADHRsoZKuozdsqb41ztuR7w==", 2022-01-10T01:32:02.742 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.743 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:32:02.743 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:02.743 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:02.743 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:02.744 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.744 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.744 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.x", 2022-01-10T01:32:02.745 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth39syIRAA6pOvLWw2ADy72TWZ65MIkA==", 2022-01-10T01:32:02.745 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.745 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:32:02.745 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:32:02.745 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:02.746 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:02.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:02.746 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.y", 2022-01-10T01:32:02.747 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth4novHRAACVMjo72kOB/T7Ti/CiN27w==", 2022-01-10T01:32:02.747 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:02.747 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:32:02.747 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:32:02.747 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:02.748 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.748 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:02.748 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:02.748 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:32:02.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.680+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3725714759 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7b240535f0 msgr2=0x7f7b24055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:02.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.680+0000 7f7b4a2b3700 1 --2- 172.21.15.36:0/3725714759 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7b240535f0 0x7f7b24055ab0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f7b3400d000 tx=0x7f7b34007a00).stop 2022-01-10T01:32:02.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.680+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3725714759 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7b440b1db0 msgr2=0x7f7b4414a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:02.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.680+0000 7f7b4a2b3700 1 --2- 172.21.15.36:0/3725714759 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7b440b1db0 0x7f7b4414a510 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f7b38001110 tx=0x7f7b38007af0).stop 2022-01-10T01:32:02.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.680+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3725714759 shutdown_connections 2022-01-10T01:32:02.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.680+0000 7f7b4a2b3700 1 --2- 172.21.15.36:0/3725714759 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7b240535f0 0x7f7b24055ab0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.680+0000 7f7b4a2b3700 1 --2- 172.21.15.36:0/3725714759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b441483a0 0x7f7b441568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.680+0000 7f7b4a2b3700 1 --2- 172.21.15.36:0/3725714759 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7b440b1db0 0x7f7b4414a510 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.680+0000 7f7b4a2b3700 1 --2- 172.21.15.36:0/3725714759 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b440b0fd0 0x7f7b440ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.680+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3725714759 >> 172.21.15.36:0/3725714759 conn(0x7f7b4405f6b0 msgr2=0x7f7b440b3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:02.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.680+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3725714759 shutdown_connections 2022-01-10T01:32:02.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.680+0000 7f7b4a2b3700 1 -- 172.21.15.36:0/3725714759 wait complete. 2022-01-10T01:32:02.754 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:32:02.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.856+0000 7f2bab841700 1 Processor -- start 2022-01-10T01:32:02.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.856+0000 7f2bab841700 1 -- start start 2022-01-10T01:32:02.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2bab841700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ba40b65c0 0x7f2ba40b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:02.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2bab841700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba4060d70 0x7f2ba41450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:02.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2bab841700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba40acc90 con 0x7f2ba40ac5f0 2022-01-10T01:32:02.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2bab841700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba40aca80 con 0x7f2ba40b65c0 2022-01-10T01:32:02.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2bab841700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40ae560 con 0x7f2ba4060d70 2022-01-10T01:32:02.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2ba95dd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ba40b65c0 0x7f2ba40b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:02.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2ba95dd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ba40b65c0 0x7f2ba40b69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:36598/0 (socket says 172.21.15.36:36598) 2022-01-10T01:32:02.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2ba9dde700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2ba40ac5f0 0x7f2ba4141000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:55438/0 (socket says 172.21.15.36:55438) 2022-01-10T01:32:02.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2ba8ddc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba4060d70 0x7f2ba41450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:02.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2ba95dd700 1 -- 172.21.15.36:0/3742620260 learned_addr learned my addr 172.21.15.36:0/3742620260 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:02.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2ba95dd700 1 -- 172.21.15.36:0/3742620260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba4060d70 msgr2=0x7f2ba41450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:02.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2ba95dd700 1 --2- 172.21.15.36:0/3742620260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba4060d70 0x7f2ba41450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2ba95dd700 1 -- 172.21.15.36:0/3742620260 >> v1:172.21.15.59:6789/0 conn(0x7f2ba40ac5f0 legacy=0x7f2ba4141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:02.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2ba95dd700 1 -- 172.21.15.36:0/3742620260 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba41446e0 con 0x7f2ba40b65c0 2022-01-10T01:32:02.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2ba95dd700 1 --2- 172.21.15.36:0/3742620260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba40b65c0 0x7f2ba40b69a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f2ba40ad9e0 tx=0x7f2b9c009290).ready entity=mon.1 client_cookie=5f39e36f261f3502 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:02.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2ba3fff700 1 -- 172.21.15.36:0/3742620260 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9c00b860 con 0x7f2ba40b65c0 2022-01-10T01:32:02.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2ba3fff700 1 -- 172.21.15.36:0/3742620260 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c00b9c0 con 0x7f2ba40b65c0 2022-01-10T01:32:02.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2ba3fff700 1 -- 172.21.15.36:0/3742620260 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b9c00bb30 con 0x7f2ba40b65c0 2022-01-10T01:32:02.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2bab841700 1 -- 172.21.15.36:0/3742620260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba40b65c0 msgr2=0x7f2ba40b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:02.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2bab841700 1 --2- 172.21.15.36:0/3742620260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba40b65c0 0x7f2ba40b69a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f2ba40ad9e0 tx=0x7f2b9c009290).stop 2022-01-10T01:32:02.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2bab841700 1 -- 172.21.15.36:0/3742620260 shutdown_connections 2022-01-10T01:32:02.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2bab841700 1 --2- 172.21.15.36:0/3742620260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba4060d70 0x7f2ba41450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2bab841700 1 --2- 172.21.15.36:0/3742620260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba40b65c0 0x7f2ba40b69a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2bab841700 1 -- 172.21.15.36:0/3742620260 >> 172.21.15.36:0/3742620260 conn(0x7f2ba40b3480 msgr2=0x7f2ba40b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:02.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.860+0000 7f2bab841700 1 -- 172.21.15.36:0/3742620260 shutdown_connections 2022-01-10T01:32:02.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2bab841700 1 -- 172.21.15.36:0/3742620260 wait complete. 2022-01-10T01:32:02.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2bab841700 1 Processor -- start 2022-01-10T01:32:02.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2bab841700 1 -- start start 2022-01-10T01:32:02.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2bab841700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba4060d70 0x7f2ba413efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:02.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2bab841700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ba40ac5f0 0x7f2ba40b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:02.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2bab841700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba40b65c0 0x7f2ba40b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:02.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2bab841700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba413e800 con 0x7f2ba40ac5f0 2022-01-10T01:32:02.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2bab841700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40aec10 con 0x7f2ba40b65c0 2022-01-10T01:32:02.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2bab841700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba40aeeb0 con 0x7f2ba4060d70 2022-01-10T01:32:02.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2ba8ddc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ba40ac5f0 0x7f2ba40b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:02.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2ba8ddc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ba40ac5f0 0x7f2ba40b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39972/0 (socket says 172.21.15.36:39972) 2022-01-10T01:32:02.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2ba8ddc700 1 -- 172.21.15.36:0/261395520 learned_addr learned my addr 172.21.15.36:0/261395520 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:02.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2ba95dd700 1 --2- 172.21.15.36:0/261395520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba4060d70 0x7f2ba413efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:02.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2ba9dde700 1 --2- 172.21.15.36:0/261395520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba40b65c0 0x7f2ba40b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:02.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2ba8ddc700 1 -- 172.21.15.36:0/261395520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba4060d70 msgr2=0x7f2ba413efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:02.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2ba8ddc700 1 --2- 172.21.15.36:0/261395520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba4060d70 0x7f2ba413efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2ba8ddc700 1 -- 172.21.15.36:0/261395520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba40b65c0 msgr2=0x7f2ba40b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:02.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2ba8ddc700 1 --2- 172.21.15.36:0/261395520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba40b65c0 0x7f2ba40b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:02.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2ba8ddc700 1 -- 172.21.15.36:0/261395520 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c009530 con 0x7f2ba40ac5f0 2022-01-10T01:32:02.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2ba8ddc700 1 --2- 172.21.15.36:0/261395520 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ba40ac5f0 0x7f2ba40b1030 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f2b9800c000 tx=0x7f2b98006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:02.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2ba27fc700 1 -- 172.21.15.36:0/261395520 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b98011750 con 0x7f2ba40ac5f0 2022-01-10T01:32:02.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2ba27fc700 1 -- 172.21.15.36:0/261395520 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b980118b0 con 0x7f2ba40ac5f0 2022-01-10T01:32:02.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2bab841700 1 -- 172.21.15.36:0/261395520 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba413d7a0 con 0x7f2ba40ac5f0 2022-01-10T01:32:02.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.864+0000 7f2ba27fc700 1 -- 172.21.15.36:0/261395520 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b98011c10 con 0x7f2ba40ac5f0 2022-01-10T01:32:02.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.868+0000 7f2bab841700 1 -- 172.21.15.36:0/261395520 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba40af570 con 0x7f2ba40ac5f0 2022-01-10T01:32:02.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.868+0000 7f2bab841700 1 -- 172.21.15.36:0/261395520 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba413ea00 con 0x7f2ba40ac5f0 2022-01-10T01:32:02.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.868+0000 7f2ba27fc700 1 -- 172.21.15.36:0/261395520 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2b98011d70 con 0x7f2ba40ac5f0 2022-01-10T01:32:02.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.868+0000 7f2ba27fc700 1 --2- 172.21.15.36:0/261395520 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b84053560 0x7f2b84055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:02.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.868+0000 7f2ba27fc700 1 -- 172.21.15.36:0/261395520 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f2b9806bba0 con 0x7f2ba40ac5f0 2022-01-10T01:32:02.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.868+0000 7f2ba95dd700 1 --2- 172.21.15.36:0/261395520 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b84053560 0x7f2b84055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:02.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.868+0000 7f2ba95dd700 1 --2- 172.21.15.36:0/261395520 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b84053560 0x7f2b84055a20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f2b9c01b000 tx=0x7f2b9c016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:02.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:02.876+0000 7f2ba27fc700 1 -- 172.21.15.36:0/261395520 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2b98042e90 con 0x7f2ba40ac5f0 2022-01-10T01:32:03.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.000+0000 7f2bab841700 1 -- 172.21.15.36:0/261395520 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ba4144980 con 0x7f2ba40ac5f0 2022-01-10T01:32:03.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.004+0000 7f2ba27fc700 1 -- 172.21.15.36:0/261395520 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+13416 (secure 0 0 0) 0x7f2b980464b0 con 0x7f2ba40ac5f0 2022-01-10T01:32:03.005 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:03.006 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":105,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:32:02.360181+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":98,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:32:03.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.004+0000 7f2bab841700 1 -- 172.21.15.36:0/261395520 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b84053560 msgr2=0x7f2b84055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.004+0000 7f2bab841700 1 --2- 172.21.15.36:0/261395520 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b84053560 0x7f2b84055a20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f2b9c01b000 tx=0x7f2b9c016000).stop 2022-01-10T01:32:03.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.004+0000 7f2bab841700 1 -- 172.21.15.36:0/261395520 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ba40ac5f0 msgr2=0x7f2ba40b1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.004+0000 7f2bab841700 1 --2- 172.21.15.36:0/261395520 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ba40ac5f0 0x7f2ba40b1030 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f2b9800c000 tx=0x7f2b98006df0).stop 2022-01-10T01:32:03.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.004+0000 7f2bab841700 1 -- 172.21.15.36:0/261395520 shutdown_connections 2022-01-10T01:32:03.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.004+0000 7f2bab841700 1 --2- 172.21.15.36:0/261395520 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b84053560 0x7f2b84055a20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.004+0000 7f2bab841700 1 --2- 172.21.15.36:0/261395520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ba40b65c0 0x7f2ba40b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.004+0000 7f2bab841700 1 --2- 172.21.15.36:0/261395520 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2ba40ac5f0 0x7f2ba40b1030 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.004+0000 7f2bab841700 1 --2- 172.21.15.36:0/261395520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ba4060d70 0x7f2ba413efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.004+0000 7f2bab841700 1 -- 172.21.15.36:0/261395520 >> 172.21.15.36:0/261395520 conn(0x7f2ba40b3480 msgr2=0x7f2ba41415d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:03.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.004+0000 7f2bab841700 1 -- 172.21.15.36:0/261395520 shutdown_connections 2022-01-10T01:32:03.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.004+0000 7f2bab841700 1 -- 172.21.15.36:0/261395520 wait complete. 2022-01-10T01:32:03.019 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-01-10T01:32:03.019 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:32:03.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.128+0000 7f5ef1d1a700 1 Processor -- start 2022-01-10T01:32:03.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.128+0000 7f5ef1d1a700 1 -- start start 2022-01-10T01:32:03.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5ef1d1a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5eec0b0010 0x7f5eec0a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5ef1d1a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eec0a70c0 con 0x7f5eec0afbd0 2022-01-10T01:32:03.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5ef1d1a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eec0a72f0 con 0x7f5eec0b2580 2022-01-10T01:32:03.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5ef1d1a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eec0a7590 con 0x7f5eec0b0010 2022-01-10T01:32:03.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5eebfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5eec0b0010 0x7f5eec0a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5eebfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5eec0b0010 0x7f5eec0a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39980/0 (socket says 172.21.15.36:39980) 2022-01-10T01:32:03.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5eebfff700 1 -- 172.21.15.36:0/2476062083 learned_addr learned my addr 172.21.15.36:0/2476062083 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:03.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5ef1519700 1 --1- 172.21.15.36:0/2476062083 >> v1:172.21.15.36:6789/0 conn(0x7f5eec0afbd0 0x7f5eec151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37776/0 (socket says 172.21.15.36:37776) 2022-01-10T01:32:03.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5eebfff700 1 -- 172.21.15.36:0/2476062083 >> v1:172.21.15.59:6789/0 conn(0x7f5eec0b2580 legacy=0x7f5eec14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5eebfff700 1 -- 172.21.15.36:0/2476062083 >> v1:172.21.15.36:6789/0 conn(0x7f5eec0afbd0 legacy=0x7f5eec151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5eebfff700 1 -- 172.21.15.36:0/2476062083 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec0a7830 con 0x7f5eec0b0010 2022-01-10T01:32:03.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5eebfff700 1 --2- 172.21.15.36:0/2476062083 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5eec0b0010 0x7f5eec0a83b0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f5edc002f70 tx=0x7f5edc006eb0).ready entity=mon.0 client_cookie=959743a1a557962b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:03.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5eeb7fe700 1 -- 172.21.15.36:0/2476062083 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5edc00d660 con 0x7f5eec0b0010 2022-01-10T01:32:03.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5eeb7fe700 1 -- 172.21.15.36:0/2476062083 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5edc000e90 con 0x7f5eec0b0010 2022-01-10T01:32:03.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5eeb7fe700 1 -- 172.21.15.36:0/2476062083 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5edc00d9f0 con 0x7f5eec0b0010 2022-01-10T01:32:03.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/2476062083 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5eec0b0010 msgr2=0x7f5eec0a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5ef1d1a700 1 --2- 172.21.15.36:0/2476062083 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5eec0b0010 0x7f5eec0a83b0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f5edc002f70 tx=0x7f5edc006eb0).stop 2022-01-10T01:32:03.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/2476062083 shutdown_connections 2022-01-10T01:32:03.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5ef1d1a700 1 --2- 172.21.15.36:0/2476062083 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5eec0b0010 0x7f5eec0a83b0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/2476062083 >> 172.21.15.36:0/2476062083 conn(0x7f5eec060180 msgr2=0x7f5eec0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:03.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/2476062083 shutdown_connections 2022-01-10T01:32:03.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.132+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/2476062083 wait complete. 2022-01-10T01:32:03.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef1d1a700 1 Processor -- start 2022-01-10T01:32:03.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef1d1a700 1 -- start start 2022-01-10T01:32:03.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef1d1a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5eec0afbd0 0x7f5eec0ae320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef1d1a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eec0b0010 0x7f5eec156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef1d1a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eec0b2580 0x7f5eec156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef1d1a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec0b3d60 con 0x7f5eec0afbd0 2022-01-10T01:32:03.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef1d1a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec1566d0 con 0x7f5eec0b0010 2022-01-10T01:32:03.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef1d1a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec0666e0 con 0x7f5eec0b2580 2022-01-10T01:32:03.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef0d18700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5eec0afbd0 0x7f5eec0ae320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef0d18700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5eec0afbd0 0x7f5eec0ae320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:39984/0 (socket says 172.21.15.36:39984) 2022-01-10T01:32:03.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef0d18700 1 -- 172.21.15.36:0/1526609308 learned_addr learned my addr 172.21.15.36:0/1526609308 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:03.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef1519700 1 --2- 172.21.15.36:0/1526609308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eec0b2580 0x7f5eec156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5eebfff700 1 --2- 172.21.15.36:0/1526609308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eec0b0010 0x7f5eec156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef0d18700 1 -- 172.21.15.36:0/1526609308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eec0b2580 msgr2=0x7f5eec156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef0d18700 1 --2- 172.21.15.36:0/1526609308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eec0b2580 0x7f5eec156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef0d18700 1 -- 172.21.15.36:0/1526609308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eec0b0010 msgr2=0x7f5eec156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef0d18700 1 --2- 172.21.15.36:0/1526609308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eec0b0010 0x7f5eec156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef0d18700 1 -- 172.21.15.36:0/1526609308 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc00b1e0 con 0x7f5eec0afbd0 2022-01-10T01:32:03.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef0d18700 1 --2- 172.21.15.36:0/1526609308 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5eec0afbd0 0x7f5eec0ae320 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f5eec061a80 tx=0x7f5ee0007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:03.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ee9ffb700 1 -- 172.21.15.36:0/1526609308 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ee0012400 con 0x7f5eec0afbd0 2022-01-10T01:32:03.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ee9ffb700 1 -- 172.21.15.36:0/1526609308 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee0012560 con 0x7f5eec0afbd0 2022-01-10T01:32:03.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ee9ffb700 1 -- 172.21.15.36:0/1526609308 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ee00128c0 con 0x7f5eec0afbd0 2022-01-10T01:32:03.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/1526609308 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eec0b5490 con 0x7f5eec0afbd0 2022-01-10T01:32:03.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.136+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/1526609308 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eec0b56c0 con 0x7f5eec0afbd0 2022-01-10T01:32:03.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.140+0000 7f5ee9ffb700 1 -- 172.21.15.36:0/1526609308 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5ee0019030 con 0x7f5eec0afbd0 2022-01-10T01:32:03.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.140+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/1526609308 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eec0b0730 con 0x7f5eec0afbd0 2022-01-10T01:32:03.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.140+0000 7f5ee9ffb700 1 --2- 172.21.15.36:0/1526609308 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ecc0535f0 0x7f5ecc055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.140+0000 7f5eebfff700 1 --2- 172.21.15.36:0/1526609308 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ecc0535f0 0x7f5ecc055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.140+0000 7f5ee9ffb700 1 -- 172.21.15.36:0/1526609308 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f5ee006ab00 con 0x7f5eec0afbd0 2022-01-10T01:32:03.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.140+0000 7f5eebfff700 1 --2- 172.21.15.36:0/1526609308 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ecc0535f0 0x7f5ecc055ab0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f5edc01c000 tx=0x7f5edc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:03.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.144+0000 7f5ee9ffb700 1 -- 172.21.15.36:0/1526609308 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ee006ce60 con 0x7f5eec0afbd0 2022-01-10T01:32:03.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.272+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/1526609308 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5eec057350 con 0x7f5eec0afbd0 2022-01-10T01:32:03.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.276+0000 7f5ee9ffb700 1 -- 172.21.15.36:0/1526609308 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v105) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5ee0041cc0 con 0x7f5eec0afbd0 2022-01-10T01:32:03.277 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:32:03.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.276+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/1526609308 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ecc0535f0 msgr2=0x7f5ecc055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.276+0000 7f5ef1d1a700 1 --2- 172.21.15.36:0/1526609308 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ecc0535f0 0x7f5ecc055ab0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f5edc01c000 tx=0x7f5edc015000).stop 2022-01-10T01:32:03.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.276+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/1526609308 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5eec0afbd0 msgr2=0x7f5eec0ae320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.276+0000 7f5ef1d1a700 1 --2- 172.21.15.36:0/1526609308 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5eec0afbd0 0x7f5eec0ae320 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f5eec061a80 tx=0x7f5ee0007c50).stop 2022-01-10T01:32:03.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.276+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/1526609308 shutdown_connections 2022-01-10T01:32:03.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.276+0000 7f5ef1d1a700 1 --2- 172.21.15.36:0/1526609308 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ecc0535f0 0x7f5ecc055ab0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.276+0000 7f5ef1d1a700 1 --2- 172.21.15.36:0/1526609308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eec0b2580 0x7f5eec156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.276+0000 7f5ef1d1a700 1 --2- 172.21.15.36:0/1526609308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eec0b0010 0x7f5eec156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.276+0000 7f5ef1d1a700 1 --2- 172.21.15.36:0/1526609308 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5eec0afbd0 0x7f5eec0ae320 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.276+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/1526609308 >> 172.21.15.36:0/1526609308 conn(0x7f5eec060180 msgr2=0x7f5eec0675b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:03.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.276+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/1526609308 shutdown_connections 2022-01-10T01:32:03.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.276+0000 7f5ef1d1a700 1 -- 172.21.15.36:0/1526609308 wait complete. 2022-01-10T01:32:03.291 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:32:03.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.396+0000 7fa68b59e700 1 Processor -- start 2022-01-10T01:32:03.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.396+0000 7fa68b59e700 1 -- start start 2022-01-10T01:32:03.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa68b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa68c0637a0 0x7fa68c0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa68b59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c143d30 con 0x7fa68c0ad910 2022-01-10T01:32:03.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa68b59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c0adf90 con 0x7fa68c0b5300 2022-01-10T01:32:03.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa68b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0ae230 con 0x7fa68c0637a0 2022-01-10T01:32:03.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa683fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa68c0ad910 0x7fa68c067000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37786/0 (socket says 172.21.15.36:37786) 2022-01-10T01:32:03.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa683fff700 1 -- 172.21.15.36:0/756910923 learned_addr learned my addr 172.21.15.36:0/756910923 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:03.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa68ad9d700 1 --2- 172.21.15.36:0/756910923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa68c0637a0 0x7fa68c0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa689d9b700 1 -- 172.21.15.36:0/756910923 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032966022 0 0) 0x7fa68c143d30 con 0x7fa68c0ad910 2022-01-10T01:32:03.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa689d9b700 1 -- 172.21.15.36:0/756910923 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa670003260 con 0x7fa68c0ad910 2022-01-10T01:32:03.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa689d9b700 1 -- 172.21.15.36:0/756910923 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880141722 0 0) 0x7fa68c0adf90 con 0x7fa68c0b5300 2022-01-10T01:32:03.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa689d9b700 1 -- 172.21.15.36:0/756910923 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa68c143d30 con 0x7fa68c0b5300 2022-01-10T01:32:03.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa68ad9d700 1 -- 172.21.15.36:0/756910923 >> v1:172.21.15.59:6789/0 conn(0x7fa68c0b5300 legacy=0x7fa68c143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa68ad9d700 1 -- 172.21.15.36:0/756910923 >> v1:172.21.15.36:6789/0 conn(0x7fa68c0ad910 legacy=0x7fa68c067000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa68ad9d700 1 -- 172.21.15.36:0/756910923 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c0ae4d0 con 0x7fa68c0637a0 2022-01-10T01:32:03.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa68ad9d700 1 --2- 172.21.15.36:0/756910923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa68c0637a0 0x7fa68c0b1690 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fa6840032f0 tx=0x7fa6840091d0).ready entity=mon.2 client_cookie=cd89ce616e74f001 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:03.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa689d9b700 1 -- 172.21.15.36:0/756910923 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa68400b640 con 0x7fa68c0637a0 2022-01-10T01:32:03.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa689d9b700 1 -- 172.21.15.36:0/756910923 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68400b7a0 con 0x7fa68c0637a0 2022-01-10T01:32:03.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.400+0000 7fa689d9b700 1 -- 172.21.15.36:0/756910923 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa68400b910 con 0x7fa68c0637a0 2022-01-10T01:32:03.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.404+0000 7fa68b59e700 1 -- 172.21.15.36:0/756910923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa68c0637a0 msgr2=0x7fa68c0b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.404+0000 7fa68b59e700 1 --2- 172.21.15.36:0/756910923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa68c0637a0 0x7fa68c0b1690 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fa6840032f0 tx=0x7fa6840091d0).stop 2022-01-10T01:32:03.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.404+0000 7fa68b59e700 1 -- 172.21.15.36:0/756910923 shutdown_connections 2022-01-10T01:32:03.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.404+0000 7fa68b59e700 1 --2- 172.21.15.36:0/756910923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa68c0637a0 0x7fa68c0b1690 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.404+0000 7fa68b59e700 1 -- 172.21.15.36:0/756910923 >> 172.21.15.36:0/756910923 conn(0x7fa68c062560 msgr2=0x7fa68c062940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:03.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.404+0000 7fa68b59e700 1 -- 172.21.15.36:0/756910923 shutdown_connections 2022-01-10T01:32:03.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.404+0000 7fa68b59e700 1 -- 172.21.15.36:0/756910923 wait complete. 2022-01-10T01:32:03.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.404+0000 7fa68b59e700 1 Processor -- start 2022-01-10T01:32:03.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.404+0000 7fa68b59e700 1 -- start start 2022-01-10T01:32:03.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa68b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa68c0637a0 0x7fa68c0a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa68b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa68c0ad910 0x7fa68c14e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa68b59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa68c0b5300 0x7fa68c14e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa68b59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c14ec10 con 0x7fa68c0ad910 2022-01-10T01:32:03.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa68b59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c065840 con 0x7fa68c0b5300 2022-01-10T01:32:03.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa68b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c09f640 con 0x7fa68c0637a0 2022-01-10T01:32:03.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa683fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa68c0ad910 0x7fa68c14e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa683fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa68c0ad910 0x7fa68c14e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40000/0 (socket says 172.21.15.36:40000) 2022-01-10T01:32:03.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa683fff700 1 -- 172.21.15.36:0/671567653 learned_addr learned my addr 172.21.15.36:0/671567653 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:03.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa68a59c700 1 --2- 172.21.15.36:0/671567653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa68c0637a0 0x7fa68c0a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa68ad9d700 1 --2- 172.21.15.36:0/671567653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa68c0b5300 0x7fa68c14e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa683fff700 1 -- 172.21.15.36:0/671567653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa68c0637a0 msgr2=0x7fa68c0a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa683fff700 1 --2- 172.21.15.36:0/671567653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa68c0637a0 0x7fa68c0a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa683fff700 1 -- 172.21.15.36:0/671567653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa68c0b5300 msgr2=0x7fa68c14e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa683fff700 1 --2- 172.21.15.36:0/671567653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa68c0b5300 0x7fa68c14e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa683fff700 1 -- 172.21.15.36:0/671567653 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa684009470 con 0x7fa68c0ad910 2022-01-10T01:32:03.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa683fff700 1 --2- 172.21.15.36:0/671567653 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa68c0ad910 0x7fa68c14e230 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fa6740010d0 tx=0x7fa674007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:03.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa6837fe700 1 -- 172.21.15.36:0/671567653 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6740070d0 con 0x7fa68c0ad910 2022-01-10T01:32:03.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa6837fe700 1 -- 172.21.15.36:0/671567653 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa674007230 con 0x7fa68c0ad910 2022-01-10T01:32:03.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa68b59e700 1 -- 172.21.15.36:0/671567653 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c0a03a0 con 0x7fa68c0ad910 2022-01-10T01:32:03.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa6837fe700 1 -- 172.21.15.36:0/671567653 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa674005610 con 0x7fa68c0ad910 2022-01-10T01:32:03.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa68b59e700 1 -- 172.21.15.36:0/671567653 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c09f330 con 0x7fa68c0ad910 2022-01-10T01:32:03.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa68b59e700 1 -- 172.21.15.36:0/671567653 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68c057350 con 0x7fa68c0ad910 2022-01-10T01:32:03.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.408+0000 7fa6837fe700 1 -- 172.21.15.36:0/671567653 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa674010070 con 0x7fa68c0ad910 2022-01-10T01:32:03.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.412+0000 7fa6837fe700 1 --2- 172.21.15.36:0/671567653 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6640535f0 0x7fa664055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.412+0000 7fa6837fe700 1 -- 172.21.15.36:0/671567653 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fa67406ad80 con 0x7fa68c0ad910 2022-01-10T01:32:03.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.412+0000 7fa68a59c700 1 --2- 172.21.15.36:0/671567653 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6640535f0 0x7fa664055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.412+0000 7fa68a59c700 1 --2- 172.21.15.36:0/671567653 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6640535f0 0x7fa664055ab0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fa67c00d000 tx=0x7fa67c007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:03.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.416+0000 7fa6837fe700 1 -- 172.21.15.36:0/671567653 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa674041fc0 con 0x7fa68c0ad910 2022-01-10T01:32:03.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.540+0000 7fa68b59e700 1 -- 172.21.15.36:0/671567653 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa68c060e90 con 0x7fa68c0ad910 2022-01-10T01:32:03.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.544+0000 7fa6837fe700 1 -- 172.21.15.36:0/671567653 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v105) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa6740455e0 con 0x7fa68c0ad910 2022-01-10T01:32:03.546 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:32:03.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.544+0000 7fa68b59e700 1 -- 172.21.15.36:0/671567653 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6640535f0 msgr2=0x7fa664055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.544+0000 7fa68b59e700 1 --2- 172.21.15.36:0/671567653 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6640535f0 0x7fa664055ab0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fa67c00d000 tx=0x7fa67c007a00).stop 2022-01-10T01:32:03.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.544+0000 7fa68b59e700 1 -- 172.21.15.36:0/671567653 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa68c0ad910 msgr2=0x7fa68c14e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.544+0000 7fa68b59e700 1 --2- 172.21.15.36:0/671567653 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa68c0ad910 0x7fa68c14e230 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fa6740010d0 tx=0x7fa674007b00).stop 2022-01-10T01:32:03.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.544+0000 7fa68b59e700 1 -- 172.21.15.36:0/671567653 shutdown_connections 2022-01-10T01:32:03.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.544+0000 7fa68b59e700 1 --2- 172.21.15.36:0/671567653 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6640535f0 0x7fa664055ab0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.544+0000 7fa68b59e700 1 --2- 172.21.15.36:0/671567653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa68c0b5300 0x7fa68c14e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.544+0000 7fa68b59e700 1 --2- 172.21.15.36:0/671567653 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa68c0ad910 0x7fa68c14e230 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.544+0000 7fa68b59e700 1 --2- 172.21.15.36:0/671567653 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa68c0637a0 0x7fa68c0a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.544+0000 7fa68b59e700 1 -- 172.21.15.36:0/671567653 >> 172.21.15.36:0/671567653 conn(0x7fa68c062560 msgr2=0x7fa68c0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:03.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.544+0000 7fa68b59e700 1 -- 172.21.15.36:0/671567653 shutdown_connections 2022-01-10T01:32:03.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.544+0000 7fa68b59e700 1 -- 172.21.15.36:0/671567653 wait complete. 2022-01-10T01:32:03.559 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-01-10T01:32:03.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52f04d700 1 Processor -- start 2022-01-10T01:32:03.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52f04d700 1 -- start start 2022-01-10T01:32:03.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52f04d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5280b2720 0x7ff52813e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52f04d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff5280b0ff0 0x7ff52813e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52f04d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5280aaa90 con 0x7ff528141080 2022-01-10T01:32:03.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52f04d700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff528141c20 con 0x7ff5280b0ff0 2022-01-10T01:32:03.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52f04d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff528140c90 con 0x7ff5280b2720 2022-01-10T01:32:03.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52d84a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff5280b0ff0 0x7ff52813e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52d84a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff5280b0ff0 0x7ff52813e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40006/0 (socket says 172.21.15.36:40006) 2022-01-10T01:32:03.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52d84a700 1 -- 172.21.15.36:0/3523597453 learned_addr learned my addr 172.21.15.36:0/3523597453 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:03.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52e04b700 1 --2- 172.21.15.36:0/3523597453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5280b2720 0x7ff52813e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52d84a700 1 -- 172.21.15.36:0/3523597453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5280b2720 msgr2=0x7ff52813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:03.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52d84a700 1 --2- 172.21.15.36:0/3523597453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5280b2720 0x7ff52813e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52d84a700 1 -- 172.21.15.36:0/3523597453 >> v1:172.21.15.59:6789/0 conn(0x7ff528141080 legacy=0x7ff528141510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.660+0000 7ff52d84a700 1 -- 172.21.15.36:0/3523597453 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5280b2b00 con 0x7ff5280b0ff0 2022-01-10T01:32:03.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52d84a700 1 --2- 172.21.15.36:0/3523597453 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5280b0ff0 0x7ff52813e520 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7ff518002f70 tx=0x7ff518006eb0).ready entity=mon.0 client_cookie=3dc3c0570602e0cd server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:03.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52d049700 1 -- 172.21.15.36:0/3523597453 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff51800d5c0 con 0x7ff5280b0ff0 2022-01-10T01:32:03.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52d049700 1 -- 172.21.15.36:0/3523597453 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff518000e90 con 0x7ff5280b0ff0 2022-01-10T01:32:03.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52d049700 1 -- 172.21.15.36:0/3523597453 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff51800d950 con 0x7ff5280b0ff0 2022-01-10T01:32:03.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 -- 172.21.15.36:0/3523597453 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5280b0ff0 msgr2=0x7ff52813e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 --2- 172.21.15.36:0/3523597453 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5280b0ff0 0x7ff52813e520 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7ff518002f70 tx=0x7ff518006eb0).stop 2022-01-10T01:32:03.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 -- 172.21.15.36:0/3523597453 shutdown_connections 2022-01-10T01:32:03.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 --2- 172.21.15.36:0/3523597453 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5280b0ff0 0x7ff52813e520 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 --2- 172.21.15.36:0/3523597453 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5280b2720 0x7ff52813e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 -- 172.21.15.36:0/3523597453 >> 172.21.15.36:0/3523597453 conn(0x7ff528060180 msgr2=0x7ff5280b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:03.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 -- 172.21.15.36:0/3523597453 shutdown_connections 2022-01-10T01:32:03.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 -- 172.21.15.36:0/3523597453 wait complete. 2022-01-10T01:32:03.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 Processor -- start 2022-01-10T01:32:03.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 -- start start 2022-01-10T01:32:03.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5280b0ff0 0x7ff5281396a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5280b2720 0x7ff52813b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528141080 0x7ff52813bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff528145ac0 con 0x7ff5280b2720 2022-01-10T01:32:03.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5281535f0 con 0x7ff528141080 2022-01-10T01:32:03.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52f04d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52813ae40 con 0x7ff5280b0ff0 2022-01-10T01:32:03.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.664+0000 7ff52d84a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5280b2720 0x7ff52813b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff52d84a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5280b2720 0x7ff52813b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40012/0 (socket says 172.21.15.36:40012) 2022-01-10T01:32:03.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff52d84a700 1 -- 172.21.15.36:0/3634400431 learned_addr learned my addr 172.21.15.36:0/3634400431 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:03.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff52e04b700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5280b0ff0 0x7ff5281396a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff52e84c700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528141080 0x7ff52813bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff52d84a700 1 -- 172.21.15.36:0/3634400431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5280b0ff0 msgr2=0x7ff5281396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff52d84a700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5280b0ff0 0x7ff5281396a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff52d84a700 1 -- 172.21.15.36:0/3634400431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528141080 msgr2=0x7ff52813bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff52d84a700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528141080 0x7ff52813bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff52d84a700 1 -- 172.21.15.36:0/3634400431 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51800b1e0 con 0x7ff5280b2720 2022-01-10T01:32:03.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff52e04b700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5280b0ff0 0x7ff5281396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:03.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff52d84a700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5280b2720 0x7ff52813b800 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7ff52813b520 tx=0x7ff518015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:03.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff5177fe700 1 -- 172.21.15.36:0/3634400431 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff518011760 con 0x7ff5280b2720 2022-01-10T01:32:03.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff5177fe700 1 -- 172.21.15.36:0/3634400431 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5180118c0 con 0x7ff5280b2720 2022-01-10T01:32:03.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff52f04d700 1 -- 172.21.15.36:0/3634400431 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52813a3c0 con 0x7ff5280b2720 2022-01-10T01:32:03.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff5177fe700 1 -- 172.21.15.36:0/3634400431 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff518011c20 con 0x7ff5280b2720 2022-01-10T01:32:03.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff52f04d700 1 -- 172.21.15.36:0/3634400431 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52813a900 con 0x7ff5280b2720 2022-01-10T01:32:03.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff52f04d700 1 -- 172.21.15.36:0/3634400431 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff528057350 con 0x7ff5280b2720 2022-01-10T01:32:03.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.668+0000 7ff5177fe700 1 -- 172.21.15.36:0/3634400431 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff518025030 con 0x7ff5280b2720 2022-01-10T01:32:03.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.672+0000 7ff5177fe700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff5080535f0 0x7ff508055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.672+0000 7ff5177fe700 1 -- 172.21.15.36:0/3634400431 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5600+0+0 (secure 0 0 0) 0x7ff51806c920 con 0x7ff5280b2720 2022-01-10T01:32:03.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.672+0000 7ff52e04b700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff5080535f0 0x7ff508055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.672+0000 7ff52e04b700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff5080535f0 0x7ff508055ab0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7ff52400c000 tx=0x7ff524008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:03.685 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.676+0000 7ff5177fe700 1 -- 172.21.15.36:0/3634400431 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff518043c70 con 0x7ff5280b2720 2022-01-10T01:32:03.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.799+0000 7ff52f04d700 1 -- 172.21.15.36:0/3634400431 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff5280008d0 con 0x7ff5280b2720 2022-01-10T01:32:03.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.799+0000 7ff5177fe700 1 -- 172.21.15.36:0/3634400431 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v105) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff518023070 con 0x7ff5280b2720 2022-01-10T01:32:03.803 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:03.803 INFO:teuthology.orchestra.run.smithi036.stdout:[ 2022-01-10T01:32:03.803 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:03.803 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 1, 2022-01-10T01:32:03.804 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "device_health_metrics" 2022-01-10T01:32:03.804 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:03.804 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:03.805 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 2, 2022-01-10T01:32:03.805 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "rbd" 2022-01-10T01:32:03.805 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:03.805 INFO:teuthology.orchestra.run.smithi036.stdout:] 2022-01-10T01:32:03.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.799+0000 7ff52f04d700 1 -- 172.21.15.36:0/3634400431 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff5080535f0 msgr2=0x7ff508055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.799+0000 7ff52f04d700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff5080535f0 0x7ff508055ab0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7ff52400c000 tx=0x7ff524008040).stop 2022-01-10T01:32:03.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.799+0000 7ff52f04d700 1 -- 172.21.15.36:0/3634400431 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5280b2720 msgr2=0x7ff52813b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.799+0000 7ff52f04d700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5280b2720 0x7ff52813b800 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7ff52813b520 tx=0x7ff518015000).stop 2022-01-10T01:32:03.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.799+0000 7ff52f04d700 1 -- 172.21.15.36:0/3634400431 shutdown_connections 2022-01-10T01:32:03.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.799+0000 7ff52f04d700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff5080535f0 0x7ff508055ab0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.799+0000 7ff52f04d700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff528141080 0x7ff52813bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.799+0000 7ff52f04d700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5280b2720 0x7ff52813b800 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.799+0000 7ff52f04d700 1 --2- 172.21.15.36:0/3634400431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5280b0ff0 0x7ff5281396a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.799+0000 7ff52f04d700 1 -- 172.21.15.36:0/3634400431 >> 172.21.15.36:0/3634400431 conn(0x7ff528060180 msgr2=0x7ff5280b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:03.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.799+0000 7ff52f04d700 1 -- 172.21.15.36:0/3634400431 shutdown_connections 2022-01-10T01:32:03.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.799+0000 7ff52f04d700 1 -- 172.21.15.36:0/3634400431 wait complete. 2022-01-10T01:32:03.816 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-01-10T01:32:03.816 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:32:03.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb46d5700 1 Processor -- start 2022-01-10T01:32:03.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb46d5700 1 -- start start 2022-01-10T01:32:03.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb46d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fac0a9ec0 0x7f3fac0aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb46d5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3fac0603d0 0x7f3fac13ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb46d5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fac061990 con 0x7f3fac13d1c0 2022-01-10T01:32:03.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb46d5700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fac061c30 con 0x7f3fac0603d0 2022-01-10T01:32:03.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb46d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac060b90 con 0x7f3fac0a9ec0 2022-01-10T01:32:03.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb1c70700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3fac0603d0 0x7f3fac13ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb1c70700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3fac0603d0 0x7f3fac13ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40024/0 (socket says 172.21.15.36:40024) 2022-01-10T01:32:03.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb1c70700 1 -- 172.21.15.36:0/2964396317 learned_addr learned my addr 172.21.15.36:0/2964396317 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:03.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb2471700 1 --2- 172.21.15.36:0/2964396317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fac0a9ec0 0x7f3fac0aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb146f700 1 -- 172.21.15.36:0/2964396317 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149767889 0 0) 0x7f3fac061990 con 0x7f3fac13d1c0 2022-01-10T01:32:03.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb146f700 1 -- 172.21.15.36:0/2964396317 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f94003260 con 0x7f3fac13d1c0 2022-01-10T01:32:03.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb1c70700 1 -- 172.21.15.36:0/2964396317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fac0a9ec0 msgr2=0x7f3fac0aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:03.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb1c70700 1 --2- 172.21.15.36:0/2964396317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fac0a9ec0 0x7f3fac0aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb1c70700 1 -- 172.21.15.36:0/2964396317 >> v1:172.21.15.59:6789/0 conn(0x7f3fac13d1c0 legacy=0x7f3fac13f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb1c70700 1 -- 172.21.15.36:0/2964396317 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac060e30 con 0x7f3fac0603d0 2022-01-10T01:32:03.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb1c70700 1 --2- 172.21.15.36:0/2964396317 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fac0603d0 0x7f3fac13ccd0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f3fac05f870 tx=0x7f3fa8006eb0).ready entity=mon.0 client_cookie=bcc0a3cd239c2b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:03.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb146f700 1 -- 172.21.15.36:0/2964396317 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa800d5c0 con 0x7f3fac0603d0 2022-01-10T01:32:03.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb146f700 1 -- 172.21.15.36:0/2964396317 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa8000e90 con 0x7f3fac0603d0 2022-01-10T01:32:03.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb146f700 1 -- 172.21.15.36:0/2964396317 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa800d950 con 0x7f3fac0603d0 2022-01-10T01:32:03.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb46d5700 1 -- 172.21.15.36:0/2964396317 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fac0603d0 msgr2=0x7f3fac13ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.931+0000 7f3fb46d5700 1 --2- 172.21.15.36:0/2964396317 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fac0603d0 0x7f3fac13ccd0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f3fac05f870 tx=0x7f3fa8006eb0).stop 2022-01-10T01:32:03.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb46d5700 1 -- 172.21.15.36:0/2964396317 shutdown_connections 2022-01-10T01:32:03.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb46d5700 1 --2- 172.21.15.36:0/2964396317 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fac0603d0 0x7f3fac13ccd0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb46d5700 1 --2- 172.21.15.36:0/2964396317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fac0a9ec0 0x7f3fac0aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb46d5700 1 -- 172.21.15.36:0/2964396317 >> 172.21.15.36:0/2964396317 conn(0x7f3fac0b2970 msgr2=0x7f3fac0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:03.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb46d5700 1 -- 172.21.15.36:0/2964396317 shutdown_connections 2022-01-10T01:32:03.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb46d5700 1 -- 172.21.15.36:0/2964396317 wait complete. 2022-01-10T01:32:03.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb46d5700 1 Processor -- start 2022-01-10T01:32:03.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb46d5700 1 -- start start 2022-01-10T01:32:03.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb46d5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fac0603d0 0x7f3fac13ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb46d5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fac0a9ec0 0x7f3fac0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb46d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fac13d1c0 0x7f3fac0ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb46d5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac0adb90 con 0x7f3fac0a9ec0 2022-01-10T01:32:03.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb46d5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac13eaf0 con 0x7f3fac0603d0 2022-01-10T01:32:03.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb46d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fac1437f0 con 0x7f3fac13d1c0 2022-01-10T01:32:03.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb1c70700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fac0a9ec0 0x7f3fac0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb1c70700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fac0a9ec0 0x7f3fac0ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40028/0 (socket says 172.21.15.36:40028) 2022-01-10T01:32:03.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb1c70700 1 -- 172.21.15.36:0/4175046927 learned_addr learned my addr 172.21.15.36:0/4175046927 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:03.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb2471700 1 --2- 172.21.15.36:0/4175046927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fac0603d0 0x7f3fac13ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb2c72700 1 --2- 172.21.15.36:0/4175046927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fac13d1c0 0x7f3fac0ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb1c70700 1 -- 172.21.15.36:0/4175046927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fac13d1c0 msgr2=0x7f3fac0ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb1c70700 1 --2- 172.21.15.36:0/4175046927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fac13d1c0 0x7f3fac0ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb1c70700 1 -- 172.21.15.36:0/4175046927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fac0603d0 msgr2=0x7f3fac13ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:03.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb1c70700 1 --2- 172.21.15.36:0/4175046927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fac0603d0 0x7f3fac13ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:03.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.935+0000 7f3fb1c70700 1 -- 172.21.15.36:0/4175046927 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa800b1e0 con 0x7f3fac0a9ec0 2022-01-10T01:32:03.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.939+0000 7f3fb1c70700 1 --2- 172.21.15.36:0/4175046927 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fac0a9ec0 0x7f3fac0ad1b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f3fac05f870 tx=0x7f3fa8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:03.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.939+0000 7f3f9b7fe700 1 -- 172.21.15.36:0/4175046927 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa800de00 con 0x7f3fac0a9ec0 2022-01-10T01:32:03.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.939+0000 7f3f9b7fe700 1 -- 172.21.15.36:0/4175046927 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa8011b80 con 0x7f3fac0a9ec0 2022-01-10T01:32:03.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.939+0000 7f3fb46d5700 1 -- 172.21.15.36:0/4175046927 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fac13f4e0 con 0x7f3fac0a9ec0 2022-01-10T01:32:03.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.939+0000 7f3f9b7fe700 1 -- 172.21.15.36:0/4175046927 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa801e460 con 0x7f3fac0a9ec0 2022-01-10T01:32:03.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.939+0000 7f3fb46d5700 1 -- 172.21.15.36:0/4175046927 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fac13fa70 con 0x7f3fac0a9ec0 2022-01-10T01:32:03.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.939+0000 7f3fb46d5700 1 -- 172.21.15.36:0/4175046927 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fac0610d0 con 0x7f3fac0a9ec0 2022-01-10T01:32:03.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.939+0000 7f3f9b7fe700 1 -- 172.21.15.36:0/4175046927 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3fa801a040 con 0x7f3fac0a9ec0 2022-01-10T01:32:03.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.939+0000 7f3f9b7fe700 1 --2- 172.21.15.36:0/4175046927 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f8c0534d0 0x7f3f8c055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:03.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.939+0000 7f3f9b7fe700 1 -- 172.21.15.36:0/4175046927 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f3fa806c7a0 con 0x7f3fac0a9ec0 2022-01-10T01:32:03.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.939+0000 7f3fb2471700 1 --2- 172.21.15.36:0/4175046927 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f8c0534d0 0x7f3f8c055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:03.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.939+0000 7f3fb2471700 1 --2- 172.21.15.36:0/4175046927 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f8c0534d0 0x7f3f8c055990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f3fa400b000 tx=0x7f3fa40091d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:03.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:03.947+0000 7f3f9b7fe700 1 -- 172.21.15.36:0/4175046927 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3fa8043af0 con 0x7f3fac0a9ec0 2022-01-10T01:32:04.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:04.075+0000 7f3fb46d5700 1 -- 172.21.15.36:0/4175046927 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f3fac057350 con 0x7f3fac0a9ec0 2022-01-10T01:32:05.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.007+0000 7f3f9b7fe700 1 -- 172.21.15.36:0/4175046927 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v106) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3fa8047110 con 0x7f3fac0a9ec0 2022-01-10T01:32:05.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.011+0000 7f3fb46d5700 1 -- 172.21.15.36:0/4175046927 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f8c0534d0 msgr2=0x7f3f8c055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.011+0000 7f3fb46d5700 1 --2- 172.21.15.36:0/4175046927 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f8c0534d0 0x7f3f8c055990 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f3fa400b000 tx=0x7f3fa40091d0).stop 2022-01-10T01:32:05.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.011+0000 7f3fb46d5700 1 -- 172.21.15.36:0/4175046927 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fac0a9ec0 msgr2=0x7f3fac0ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.011+0000 7f3fb46d5700 1 --2- 172.21.15.36:0/4175046927 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fac0a9ec0 0x7f3fac0ad1b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f3fac05f870 tx=0x7f3fa8015000).stop 2022-01-10T01:32:05.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.011+0000 7f3fb46d5700 1 -- 172.21.15.36:0/4175046927 shutdown_connections 2022-01-10T01:32:05.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.011+0000 7f3fb46d5700 1 --2- 172.21.15.36:0/4175046927 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f8c0534d0 0x7f3f8c055990 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.011+0000 7f3fb46d5700 1 --2- 172.21.15.36:0/4175046927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fac13d1c0 0x7f3fac0ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.011+0000 7f3fb46d5700 1 --2- 172.21.15.36:0/4175046927 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3fac0a9ec0 0x7f3fac0ad1b0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.011+0000 7f3fb46d5700 1 --2- 172.21.15.36:0/4175046927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fac0603d0 0x7f3fac13ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.011+0000 7f3fb46d5700 1 -- 172.21.15.36:0/4175046927 >> 172.21.15.36:0/4175046927 conn(0x7f3fac0b2970 msgr2=0x7f3fac0b5400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:05.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.011+0000 7f3fb46d5700 1 -- 172.21.15.36:0/4175046927 shutdown_connections 2022-01-10T01:32:05.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.011+0000 7f3fb46d5700 1 -- 172.21.15.36:0/4175046927 wait complete. 2022-01-10T01:32:05.018 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:32:05.028 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2022-01-10T01:32:05.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff37b212700 1 Processor -- start 2022-01-10T01:32:05.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff37b212700 1 -- start start 2022-01-10T01:32:05.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff37b212700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff37405fdc0 0x7ff3740610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff37b212700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff3740601a0 0x7ff374147520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff37b212700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3740b29e0 con 0x7ff3740b3730 2022-01-10T01:32:05.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff37b212700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3740b2740 con 0x7ff3740601a0 2022-01-10T01:32:05.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff37b212700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff374060970 con 0x7ff37405fdc0 2022-01-10T01:32:05.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff3797af700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff3740601a0 0x7ff374147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff3797af700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff3740601a0 0x7ff374147520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40038/0 (socket says 172.21.15.36:40038) 2022-01-10T01:32:05.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff3797af700 1 -- 172.21.15.36:0/1868986302 learned_addr learned my addr 172.21.15.36:0/1868986302 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:05.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff378fae700 1 --2- 172.21.15.36:0/1868986302 >> v2:172.21.15.59:3300/0 conn(0x7ff37405fdc0 0x7ff3740610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff3797af700 1 -- 172.21.15.36:0/1868986302 >> v2:172.21.15.59:3300/0 conn(0x7ff37405fdc0 msgr2=0x7ff3740610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:05.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff3797af700 1 --2- 172.21.15.36:0/1868986302 >> v2:172.21.15.59:3300/0 conn(0x7ff37405fdc0 0x7ff3740610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff3797af700 1 -- 172.21.15.36:0/1868986302 >> v1:172.21.15.59:6789/0 conn(0x7ff3740b3730 legacy=0x7ff3740aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff3797af700 1 -- 172.21.15.36:0/1868986302 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374060c10 con 0x7ff3740601a0 2022-01-10T01:32:05.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff378fae700 1 --2- 172.21.15.36:0/1868986302 >> v2:172.21.15.59:3300/0 conn(0x7ff37405fdc0 0x7ff3740610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:05.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff3797af700 1 --2- 172.21.15.36:0/1868986302 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3740601a0 0x7ff374147520 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7ff36c0032f0 tx=0x7ff36c009290).ready entity=mon.0 client_cookie=4003493f2f6fb178 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:05.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff3737fe700 1 -- 172.21.15.36:0/1868986302 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff36c00b870 con 0x7ff3740601a0 2022-01-10T01:32:05.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff3737fe700 1 -- 172.21.15.36:0/1868986302 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c00b9d0 con 0x7ff3740601a0 2022-01-10T01:32:05.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.135+0000 7ff3737fe700 1 -- 172.21.15.36:0/1868986302 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff36c00bb40 con 0x7ff3740601a0 2022-01-10T01:32:05.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.139+0000 7ff37b212700 1 -- 172.21.15.36:0/1868986302 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3740601a0 msgr2=0x7ff374147520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.139+0000 7ff37b212700 1 --2- 172.21.15.36:0/1868986302 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3740601a0 0x7ff374147520 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7ff36c0032f0 tx=0x7ff36c009290).stop 2022-01-10T01:32:05.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.139+0000 7ff37b212700 1 -- 172.21.15.36:0/1868986302 shutdown_connections 2022-01-10T01:32:05.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.139+0000 7ff37b212700 1 --2- 172.21.15.36:0/1868986302 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3740601a0 0x7ff374147520 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.139+0000 7ff37b212700 1 --2- 172.21.15.36:0/1868986302 >> v2:172.21.15.59:3300/0 conn(0x7ff37405fdc0 0x7ff3740610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.139+0000 7ff37b212700 1 -- 172.21.15.36:0/1868986302 >> 172.21.15.36:0/1868986302 conn(0x7ff37405cf60 msgr2=0x7ff37405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:05.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.139+0000 7ff37b212700 1 -- 172.21.15.36:0/1868986302 shutdown_connections 2022-01-10T01:32:05.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.139+0000 7ff37b212700 1 -- 172.21.15.36:0/1868986302 wait complete. 2022-01-10T01:32:05.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.139+0000 7ff37b212700 1 Processor -- start 2022-01-10T01:32:05.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.139+0000 7ff37b212700 1 -- start start 2022-01-10T01:32:05.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff37b212700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff37405fdc0 0x7ff3740adc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff37b212700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3740601a0 0x7ff374140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff37b212700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3740b3730 0x7ff374156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff37b212700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740aedc0 con 0x7ff3740b3730 2022-01-10T01:32:05.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff37b212700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff374156750 con 0x7ff37405fdc0 2022-01-10T01:32:05.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff37b212700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3741425b0 con 0x7ff3740601a0 2022-01-10T01:32:05.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff3797af700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3740b3730 0x7ff374156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff3797af700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3740b3730 0x7ff374156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40044/0 (socket says 172.21.15.36:40044) 2022-01-10T01:32:05.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff378fae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff37405fdc0 0x7ff3740adc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff3797af700 1 -- 172.21.15.36:0/2936000441 learned_addr learned my addr 172.21.15.36:0/2936000441 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:05.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff373fff700 1 --2- 172.21.15.36:0/2936000441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3740601a0 0x7ff374140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff3797af700 1 -- 172.21.15.36:0/2936000441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3740601a0 msgr2=0x7ff374140d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff3797af700 1 --2- 172.21.15.36:0/2936000441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3740601a0 0x7ff374140d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff3797af700 1 -- 172.21.15.36:0/2936000441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff37405fdc0 msgr2=0x7ff3740adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff3797af700 1 --2- 172.21.15.36:0/2936000441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff37405fdc0 0x7ff3740adc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff3797af700 1 -- 172.21.15.36:0/2936000441 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c009530 con 0x7ff3740b3730 2022-01-10T01:32:05.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff3797af700 1 --2- 172.21.15.36:0/2936000441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3740b3730 0x7ff374156de0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7ff36c0032f0 tx=0x7ff36c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:05.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff371ffb700 1 -- 172.21.15.36:0/2936000441 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff36c00b870 con 0x7ff3740b3730 2022-01-10T01:32:05.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff371ffb700 1 -- 172.21.15.36:0/2936000441 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c00bdb0 con 0x7ff3740b3730 2022-01-10T01:32:05.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff37b212700 1 -- 172.21.15.36:0/2936000441 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff374156940 con 0x7ff3740b3730 2022-01-10T01:32:05.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff371ffb700 1 -- 172.21.15.36:0/2936000441 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff36c020610 con 0x7ff3740b3730 2022-01-10T01:32:05.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.143+0000 7ff37b212700 1 -- 172.21.15.36:0/2936000441 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3740ac110 con 0x7ff3740b3730 2022-01-10T01:32:05.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.147+0000 7ff37b212700 1 -- 172.21.15.36:0/2936000441 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3741427b0 con 0x7ff3740b3730 2022-01-10T01:32:05.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.147+0000 7ff371ffb700 1 -- 172.21.15.36:0/2936000441 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff36c00f070 con 0x7ff3740b3730 2022-01-10T01:32:05.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.147+0000 7ff371ffb700 1 --2- 172.21.15.36:0/2936000441 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff3540534d0 0x7ff354055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.147+0000 7ff371ffb700 1 -- 172.21.15.36:0/2936000441 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5954+0+0 (secure 0 0 0) 0x7ff36c06c560 con 0x7ff3740b3730 2022-01-10T01:32:05.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.147+0000 7ff378fae700 1 --2- 172.21.15.36:0/2936000441 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff3540534d0 0x7ff354055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.147+0000 7ff378fae700 1 --2- 172.21.15.36:0/2936000441 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff3540534d0 0x7ff354055990 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7ff36400c000 tx=0x7ff364008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:05.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.155+0000 7ff371ffb700 1 -- 172.21.15.36:0/2936000441 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff36c043630 con 0x7ff3740b3730 2022-01-10T01:32:05.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.275+0000 7ff37b212700 1 -- 172.21.15.36:0/2936000441 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7ff374156ad0 con 0x7ff3740b3730 2022-01-10T01:32:05.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.335+0000 7ff371ffb700 1 -- 172.21.15.36:0/2936000441 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v107) v1 ==== 125+0+0 (secure 0 0 0) 0x7ff36c015020 con 0x7ff3740b3730 2022-01-10T01:32:05.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.343+0000 7ff37b212700 1 -- 172.21.15.36:0/2936000441 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff3540534d0 msgr2=0x7ff354055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.343+0000 7ff37b212700 1 --2- 172.21.15.36:0/2936000441 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff3540534d0 0x7ff354055990 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7ff36400c000 tx=0x7ff364008040).stop 2022-01-10T01:32:05.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.343+0000 7ff37b212700 1 -- 172.21.15.36:0/2936000441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3740b3730 msgr2=0x7ff374156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.343+0000 7ff37b212700 1 --2- 172.21.15.36:0/2936000441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3740b3730 0x7ff374156de0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7ff36c0032f0 tx=0x7ff36c016000).stop 2022-01-10T01:32:05.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.343+0000 7ff37b212700 1 -- 172.21.15.36:0/2936000441 shutdown_connections 2022-01-10T01:32:05.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.343+0000 7ff37b212700 1 --2- 172.21.15.36:0/2936000441 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff3540534d0 0x7ff354055990 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.343+0000 7ff37b212700 1 --2- 172.21.15.36:0/2936000441 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3740b3730 0x7ff374156de0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.343+0000 7ff37b212700 1 --2- 172.21.15.36:0/2936000441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff3740601a0 0x7ff374140d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.343+0000 7ff37b212700 1 --2- 172.21.15.36:0/2936000441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff37405fdc0 0x7ff3740adc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.343+0000 7ff37b212700 1 -- 172.21.15.36:0/2936000441 >> 172.21.15.36:0/2936000441 conn(0x7ff37405cf60 msgr2=0x7ff374144220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:05.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.343+0000 7ff37b212700 1 -- 172.21.15.36:0/2936000441 shutdown_connections 2022-01-10T01:32:05.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.343+0000 7ff37b212700 1 -- 172.21.15.36:0/2936000441 wait complete. 2022-01-10T01:32:05.348 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' created 2022-01-10T01:32:05.360 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-10T01:32:05.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.455+0000 7fcd8ee40700 1 Processor -- start 2022-01-10T01:32:05.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.455+0000 7fcd8ee40700 1 -- start start 2022-01-10T01:32:05.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.455+0000 7fcd8ee40700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd88061700 0x7fcd88146520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.455+0000 7fcd8ee40700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd880aecf0 con 0x7fcd880ad5c0 2022-01-10T01:32:05.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.455+0000 7fcd8ee40700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd880b6f20 con 0x7fcd88061320 2022-01-10T01:32:05.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.455+0000 7fcd8ee40700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd880aef20 con 0x7fcd88061700 2022-01-10T01:32:05.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.455+0000 7fcd8d63d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fcd880ad5c0 0x7fcd88140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37844/0 (socket says 172.21.15.36:37844) 2022-01-10T01:32:05.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8d63d700 1 -- 172.21.15.36:0/2162912580 learned_addr learned my addr 172.21.15.36:0/2162912580 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:05.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8e63f700 1 --2- 172.21.15.36:0/2162912580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd88061700 0x7fcd88146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8ce3c700 1 -- 172.21.15.36:0/2162912580 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605581180 0 0) 0x7fcd880aecf0 con 0x7fcd880ad5c0 2022-01-10T01:32:05.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8ce3c700 1 -- 172.21.15.36:0/2162912580 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd70003260 con 0x7fcd880ad5c0 2022-01-10T01:32:05.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8ce3c700 1 -- 172.21.15.36:0/2162912580 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946006649 0 0) 0x7fcd880b6f20 con 0x7fcd88061320 2022-01-10T01:32:05.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8ce3c700 1 -- 172.21.15.36:0/2162912580 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd880aecf0 con 0x7fcd88061320 2022-01-10T01:32:05.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8e63f700 1 -- 172.21.15.36:0/2162912580 >> v1:172.21.15.59:6789/0 conn(0x7fcd88061320 legacy=0x7fcd880b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8e63f700 1 -- 172.21.15.36:0/2162912580 >> v1:172.21.15.36:6789/0 conn(0x7fcd880ad5c0 legacy=0x7fcd88140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8e63f700 1 -- 172.21.15.36:0/2162912580 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd880af1c0 con 0x7fcd88061700 2022-01-10T01:32:05.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8e63f700 1 --2- 172.21.15.36:0/2162912580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd88061700 0x7fcd88146520 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fcd800032f0 tx=0x7fcd800091d0).ready entity=mon.2 client_cookie=d334eeb12374fb4c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:05.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8ce3c700 1 -- 172.21.15.36:0/2162912580 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8000b640 con 0x7fcd88061700 2022-01-10T01:32:05.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8ce3c700 1 -- 172.21.15.36:0/2162912580 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8000b7a0 con 0x7fcd88061700 2022-01-10T01:32:05.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8ce3c700 1 -- 172.21.15.36:0/2162912580 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd8000b910 con 0x7fcd88061700 2022-01-10T01:32:05.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8ee40700 1 -- 172.21.15.36:0/2162912580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd88061700 msgr2=0x7fcd88146520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8ee40700 1 --2- 172.21.15.36:0/2162912580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd88061700 0x7fcd88146520 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fcd800032f0 tx=0x7fcd800091d0).stop 2022-01-10T01:32:05.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8ee40700 1 -- 172.21.15.36:0/2162912580 shutdown_connections 2022-01-10T01:32:05.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8ee40700 1 --2- 172.21.15.36:0/2162912580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd88061700 0x7fcd88146520 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8ee40700 1 -- 172.21.15.36:0/2162912580 >> 172.21.15.36:0/2162912580 conn(0x7fcd88066de0 msgr2=0x7fcd880671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:05.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8ee40700 1 -- 172.21.15.36:0/2162912580 shutdown_connections 2022-01-10T01:32:05.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.459+0000 7fcd8ee40700 1 -- 172.21.15.36:0/2162912580 wait complete. 2022-01-10T01:32:05.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.463+0000 7fcd8ee40700 1 Processor -- start 2022-01-10T01:32:05.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.463+0000 7fcd8ee40700 1 -- start start 2022-01-10T01:32:05.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.463+0000 7fcd8ee40700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcd88061320 0x7fcd880b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.463+0000 7fcd8ee40700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd88061700 0x7fcd880b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.463+0000 7fcd8ee40700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd880ad5c0 0x7fcd880b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.463+0000 7fcd8ee40700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd880b16d0 con 0x7fcd88061320 2022-01-10T01:32:05.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.463+0000 7fcd8ee40700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd880b2b20 con 0x7fcd88061700 2022-01-10T01:32:05.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.463+0000 7fcd8ee40700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd880b3a00 con 0x7fcd880ad5c0 2022-01-10T01:32:05.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.463+0000 7fcd8de3e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcd88061320 0x7fcd880b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.463+0000 7fcd8de3e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcd88061320 0x7fcd880b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40054/0 (socket says 172.21.15.36:40054) 2022-01-10T01:32:05.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.463+0000 7fcd8de3e700 1 -- 172.21.15.36:0/322525946 learned_addr learned my addr 172.21.15.36:0/322525946 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:05.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.463+0000 7fcd8d63d700 1 --2- 172.21.15.36:0/322525946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd88061700 0x7fcd880b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.463+0000 7fcd8e63f700 1 --2- 172.21.15.36:0/322525946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd880ad5c0 0x7fcd880b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd8de3e700 1 -- 172.21.15.36:0/322525946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd880ad5c0 msgr2=0x7fcd880b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd8de3e700 1 --2- 172.21.15.36:0/322525946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd880ad5c0 0x7fcd880b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd8de3e700 1 -- 172.21.15.36:0/322525946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd88061700 msgr2=0x7fcd880b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd8de3e700 1 --2- 172.21.15.36:0/322525946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd88061700 0x7fcd880b2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd8de3e700 1 -- 172.21.15.36:0/322525946 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd80009470 con 0x7fcd88061320 2022-01-10T01:32:05.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd8de3e700 1 --2- 172.21.15.36:0/322525946 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcd88061320 0x7fcd880b1c70 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fcd84001110 tx=0x7fcd84007ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:05.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd76ffd700 1 -- 172.21.15.36:0/322525946 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd84012400 con 0x7fcd88061320 2022-01-10T01:32:05.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd76ffd700 1 -- 172.21.15.36:0/322525946 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd84012560 con 0x7fcd88061320 2022-01-10T01:32:05.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd8ee40700 1 -- 172.21.15.36:0/322525946 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd880b1900 con 0x7fcd88061320 2022-01-10T01:32:05.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd76ffd700 1 -- 172.21.15.36:0/322525946 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd840128c0 con 0x7fcd88061320 2022-01-10T01:32:05.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd8ee40700 1 -- 172.21.15.36:0/322525946 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd880b2160 con 0x7fcd88061320 2022-01-10T01:32:05.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd8ee40700 1 -- 172.21.15.36:0/322525946 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd880af460 con 0x7fcd88061320 2022-01-10T01:32:05.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd76ffd700 1 -- 172.21.15.36:0/322525946 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fcd84019030 con 0x7fcd88061320 2022-01-10T01:32:05.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd76ffd700 1 --2- 172.21.15.36:0/322525946 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcd68053680 0x7fcd68055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd76ffd700 1 -- 172.21.15.36:0/322525946 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6304+0+0 (secure 0 0 0) 0x7fcd8406aef0 con 0x7fcd88061320 2022-01-10T01:32:05.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.467+0000 7fcd8d63d700 1 --2- 172.21.15.36:0/322525946 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcd68053680 0x7fcd68055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.471+0000 7fcd8d63d700 1 --2- 172.21.15.36:0/322525946 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcd68053680 0x7fcd68055b40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fcd7800d000 tx=0x7fcd78009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:05.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.475+0000 7fcd76ffd700 1 -- 172.21.15.36:0/322525946 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcd84041e70 con 0x7fcd88061320 2022-01-10T01:32:05.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.639+0000 7fcd8ee40700 1 -- 172.21.15.36:0/322525946 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fcd88057350 con 0x7fcd88061320 2022-01-10T01:32:05.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.655+0000 7fcd76ffd700 1 -- 172.21.15.36:0/322525946 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 19 and data pool 20 v50) v1 ==== 189+0+0 (secure 0 0 0) 0x7fcd84045490 con 0x7fcd88061320 2022-01-10T01:32:05.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.659+0000 7fcd8ee40700 1 -- 172.21.15.36:0/322525946 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcd68053680 msgr2=0x7fcd68055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.659+0000 7fcd8ee40700 1 --2- 172.21.15.36:0/322525946 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcd68053680 0x7fcd68055b40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fcd7800d000 tx=0x7fcd78009040).stop 2022-01-10T01:32:05.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.659+0000 7fcd8ee40700 1 -- 172.21.15.36:0/322525946 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcd88061320 msgr2=0x7fcd880b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.659+0000 7fcd8ee40700 1 --2- 172.21.15.36:0/322525946 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcd88061320 0x7fcd880b1c70 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fcd84001110 tx=0x7fcd84007ae0).stop 2022-01-10T01:32:05.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.659+0000 7fcd8ee40700 1 -- 172.21.15.36:0/322525946 shutdown_connections 2022-01-10T01:32:05.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.659+0000 7fcd8ee40700 1 --2- 172.21.15.36:0/322525946 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcd68053680 0x7fcd68055b40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.659+0000 7fcd8ee40700 1 --2- 172.21.15.36:0/322525946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcd880ad5c0 0x7fcd880b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.659+0000 7fcd8ee40700 1 --2- 172.21.15.36:0/322525946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd88061700 0x7fcd880b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.659+0000 7fcd8ee40700 1 --2- 172.21.15.36:0/322525946 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcd88061320 0x7fcd880b1c70 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.659+0000 7fcd8ee40700 1 -- 172.21.15.36:0/322525946 >> 172.21.15.36:0/322525946 conn(0x7fcd88066de0 msgr2=0x7fcd88141250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:05.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.659+0000 7fcd8ee40700 1 -- 172.21.15.36:0/322525946 shutdown_connections 2022-01-10T01:32:05.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.659+0000 7fcd8ee40700 1 -- 172.21.15.36:0/322525946 wait complete. 2022-01-10T01:32:05.665 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 19 and data pool 20 2022-01-10T01:32:05.681 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:32:05.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41d16ea700 1 Processor -- start 2022-01-10T01:32:05.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41d16ea700 1 -- start start 2022-01-10T01:32:05.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41d16ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41cc061320 0x7f41cc061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41d16ea700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41cc0aecf0 con 0x7f41cc0ad5c0 2022-01-10T01:32:05.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41d16ea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41cc0b6f20 con 0x7f41cc140440 2022-01-10T01:32:05.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41d16ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0aef20 con 0x7f41cc061320 2022-01-10T01:32:05.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41c37fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f41cc0ad5c0 0x7f41cc0b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37858/0 (socket says 172.21.15.36:37858) 2022-01-10T01:32:05.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41c37fe700 1 -- 172.21.15.36:0/287095593 learned_addr learned my addr 172.21.15.36:0/287095593 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:05.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cbfff700 1 --2- 172.21.15.36:0/287095593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41cc061320 0x7f41cc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 -- 172.21.15.36:0/287095593 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684707189 0 0) 0x7f41cc0aecf0 con 0x7f41cc0ad5c0 2022-01-10T01:32:05.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 -- 172.21.15.36:0/287095593 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41ac003260 con 0x7f41cc0ad5c0 2022-01-10T01:32:05.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 -- 172.21.15.36:0/287095593 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1697737322 0 0) 0x7f41ac003260 con 0x7f41cc0ad5c0 2022-01-10T01:32:05.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 -- 172.21.15.36:0/287095593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41cc061320 msgr2=0x7f41cc061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:05.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 --2- 172.21.15.36:0/287095593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41cc061320 0x7f41cc061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 -- 172.21.15.36:0/287095593 >> v1:172.21.15.59:6789/0 conn(0x7f41cc140440 legacy=0x7f41cc146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 -- 172.21.15.36:0/287095593 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc0af1c0 con 0x7f41cc0ad5c0 2022-01-10T01:32:05.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 -- 172.21.15.36:0/287095593 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f41b4001660 con 0x7f41cc0ad5c0 2022-01-10T01:32:05.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 -- 172.21.15.36:0/287095593 >> v1:172.21.15.36:6789/0 conn(0x7f41cc0ad5c0 legacy=0x7f41cc0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 --2- 172.21.15.36:0/287095593 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41ac003780 0x7f41ac003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 --2- 172.21.15.36:0/287095593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41ac004500 0x7f41ac004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 --2- 172.21.15.36:0/287095593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41cc061320 0x7f41ac004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 -- 172.21.15.36:0/287095593 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0aef20 con 0x7f41ac003780 2022-01-10T01:32:05.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 -- 172.21.15.36:0/287095593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac00b780 con 0x7f41ac004500 2022-01-10T01:32:05.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 -- 172.21.15.36:0/287095593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac00b940 con 0x7f41cc061320 2022-01-10T01:32:05.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cbfff700 1 --2- 172.21.15.36:0/287095593 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41ac003780 0x7f41ac003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41c37fe700 1 --2- 172.21.15.36:0/287095593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41ac004500 0x7f41ac004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41d0ee9700 1 --2- 172.21.15.36:0/287095593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41cc061320 0x7f41ac004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cbfff700 1 -- 172.21.15.36:0/287095593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41cc061320 msgr2=0x7f41ac004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:05.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cbfff700 1 --2- 172.21.15.36:0/287095593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41cc061320 0x7f41ac004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cbfff700 1 -- 172.21.15.36:0/287095593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41ac004500 msgr2=0x7f41ac004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:05.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cbfff700 1 --2- 172.21.15.36:0/287095593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41ac004500 0x7f41ac004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cbfff700 1 -- 172.21.15.36:0/287095593 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac003260 con 0x7f41ac003780 2022-01-10T01:32:05.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41d0ee9700 1 --2- 172.21.15.36:0/287095593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41cc061320 0x7f41ac004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:05.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cbfff700 1 --2- 172.21.15.36:0/287095593 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41ac003780 0x7f41ac003ba0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f41bc00c000 tx=0x7f41bc006df0).ready entity=mon.0 client_cookie=40c32da418c7666f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:05.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 -- 172.21.15.36:0/287095593 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41bc00e830 con 0x7f41ac003780 2022-01-10T01:32:05.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 -- 172.21.15.36:0/287095593 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc00e990 con 0x7f41ac003780 2022-01-10T01:32:05.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.771+0000 7f41cb7fe700 1 -- 172.21.15.36:0/287095593 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41bc00ecf0 con 0x7f41ac003780 2022-01-10T01:32:05.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.775+0000 7f41d16ea700 1 -- 172.21.15.36:0/287095593 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41ac003780 msgr2=0x7f41ac003ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.775+0000 7f41d16ea700 1 --2- 172.21.15.36:0/287095593 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41ac003780 0x7f41ac003ba0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f41bc00c000 tx=0x7f41bc006df0).stop 2022-01-10T01:32:05.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.775+0000 7f41d0ee9700 1 -- 172.21.15.36:0/287095593 reap_dead start 2022-01-10T01:32:05.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.775+0000 7f41d16ea700 1 -- 172.21.15.36:0/287095593 shutdown_connections 2022-01-10T01:32:05.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.775+0000 7f41d16ea700 1 -- 172.21.15.36:0/287095593 >> 172.21.15.36:0/287095593 conn(0x7f41cc066de0 msgr2=0x7f41cc0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:05.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.775+0000 7f41d16ea700 1 -- 172.21.15.36:0/287095593 shutdown_connections 2022-01-10T01:32:05.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.775+0000 7f41d16ea700 1 -- 172.21.15.36:0/287095593 wait complete. 2022-01-10T01:32:05.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.775+0000 7f41d16ea700 1 Processor -- start 2022-01-10T01:32:05.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.775+0000 7f41d16ea700 1 -- start start 2022-01-10T01:32:05.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41d16ea700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41ac003780 0x7f41cc146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41d16ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41cc0b10f0 0x7f41cc09eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41d16ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41cc156230 0x7f41cc0ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41d16ea700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc09efa0 con 0x7f41ac003780 2022-01-10T01:32:05.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41d16ea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc09f230 con 0x7f41cc156230 2022-01-10T01:32:05.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41d16ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc09f4d0 con 0x7f41cc0b10f0 2022-01-10T01:32:05.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41cbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41ac003780 0x7f41cc146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41cbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41ac003780 0x7f41cc146dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40074/0 (socket says 172.21.15.36:40074) 2022-01-10T01:32:05.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41cbfff700 1 -- 172.21.15.36:0/2730552344 learned_addr learned my addr 172.21.15.36:0/2730552344 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:05.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41c37fe700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41cc0b10f0 0x7f41cc09eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41d0ee9700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41cc156230 0x7f41cc0ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41cbfff700 1 -- 172.21.15.36:0/2730552344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41cc0b10f0 msgr2=0x7f41cc09eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41cbfff700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41cc0b10f0 0x7f41cc09eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41cbfff700 1 -- 172.21.15.36:0/2730552344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41cc156230 msgr2=0x7f41cc0ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41cbfff700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41cc156230 0x7f41cc0ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41cbfff700 1 -- 172.21.15.36:0/2730552344 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc155af0 con 0x7f41ac003780 2022-01-10T01:32:05.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41d0ee9700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41cc156230 0x7f41cc0ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:05.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41cbfff700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41ac003780 0x7f41cc146dc0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f41bc00c000 tx=0x7f41bc019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:05.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41c9ffb700 1 -- 172.21.15.36:0/2730552344 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41bc01b820 con 0x7f41ac003780 2022-01-10T01:32:05.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41c9ffb700 1 -- 172.21.15.36:0/2730552344 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc000e90 con 0x7f41ac003780 2022-01-10T01:32:05.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41d16ea700 1 -- 172.21.15.36:0/2730552344 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41cc155d90 con 0x7f41ac003780 2022-01-10T01:32:05.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41c9ffb700 1 -- 172.21.15.36:0/2730552344 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41bc01bb70 con 0x7f41ac003780 2022-01-10T01:32:05.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41d16ea700 1 -- 172.21.15.36:0/2730552344 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41cc156860 con 0x7f41ac003780 2022-01-10T01:32:05.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.779+0000 7f41d16ea700 1 -- 172.21.15.36:0/2730552344 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41cc155f20 con 0x7f41ac003780 2022-01-10T01:32:05.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.783+0000 7f41c9ffb700 1 -- 172.21.15.36:0/2730552344 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f41bc01bcd0 con 0x7f41ac003780 2022-01-10T01:32:05.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.783+0000 7f41c9ffb700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41b0053560 0x7f41b0055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:05.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.783+0000 7f41c9ffb700 1 -- 172.21.15.36:0/2730552344 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f41bc06cd00 con 0x7f41ac003780 2022-01-10T01:32:05.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.783+0000 7f41c37fe700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41b0053560 0x7f41b0055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:05.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.783+0000 7f41c37fe700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41b0053560 0x7f41b0055a20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f41b4005000 tx=0x7f41cc0af350).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:05.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.791+0000 7f41c9ffb700 1 -- 172.21.15.36:0/2730552344 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f41bc070030 con 0x7f41ac003780 2022-01-10T01:32:05.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.919+0000 7f41d16ea700 1 -- 172.21.15.36:0/2730552344 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41cc0af460 con 0x7f41ac003780 2022-01-10T01:32:05.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.919+0000 7f41c9ffb700 1 -- 172.21.15.36:0/2730552344 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16311 (secure 0 0 0) 0x7f41bc043d10 con 0x7f41ac003780 2022-01-10T01:32:05.924 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:05.925 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":109,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:32:05.645694+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:32:04.130397+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2022-01-10T01:32:05.331515+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:32:05.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.923+0000 7f41d16ea700 1 -- 172.21.15.36:0/2730552344 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41b0053560 msgr2=0x7f41b0055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.923+0000 7f41d16ea700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41b0053560 0x7f41b0055a20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f41b4005000 tx=0x7f41cc0af350).stop 2022-01-10T01:32:05.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.923+0000 7f41d16ea700 1 -- 172.21.15.36:0/2730552344 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41ac003780 msgr2=0x7f41cc146dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:05.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.923+0000 7f41d16ea700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41ac003780 0x7f41cc146dc0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f41bc00c000 tx=0x7f41bc019000).stop 2022-01-10T01:32:05.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.923+0000 7f41d16ea700 1 -- 172.21.15.36:0/2730552344 shutdown_connections 2022-01-10T01:32:05.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.923+0000 7f41d16ea700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41b0053560 0x7f41b0055a20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.923+0000 7f41d16ea700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41cc156230 0x7f41cc0ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.923+0000 7f41d16ea700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41cc0b10f0 0x7f41cc09eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.923+0000 7f41d16ea700 1 --2- 172.21.15.36:0/2730552344 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41ac003780 0x7f41cc146dc0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:05.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.923+0000 7f41d16ea700 1 -- 172.21.15.36:0/2730552344 >> 172.21.15.36:0/2730552344 conn(0x7f41cc066de0 msgr2=0x7f41cc05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:05.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.923+0000 7f41d16ea700 1 -- 172.21.15.36:0/2730552344 shutdown_connections 2022-01-10T01:32:05.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:05.923+0000 7f41d16ea700 1 -- 172.21.15.36:0/2730552344 wait complete. 2022-01-10T01:32:05.942 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:32:06.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.039+0000 7f0378e63700 1 Processor -- start 2022-01-10T01:32:06.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.039+0000 7f0378e63700 1 -- start start 2022-01-10T01:32:06.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.039+0000 7f0378e63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03740b2580 0x7f037414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.039+0000 7f0378e63700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f03740a8ac0 0x7f037414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.052 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.039+0000 7f0378e63700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03740a70c0 con 0x7f03740b0010 2022-01-10T01:32:06.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0378e63700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03740a72f0 con 0x7f03740a8ac0 2022-01-10T01:32:06.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0378e63700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03740a7590 con 0x7f03740b2580 2022-01-10T01:32:06.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0372ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f03740b0010 0x7f03740a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37876/0 (socket says 172.21.15.36:37876) 2022-01-10T01:32:06.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0372ffd700 1 -- 172.21.15.36:0/1940425574 learned_addr learned my addr 172.21.15.36:0/1940425574 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:06.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0373fff700 1 --2- 172.21.15.36:0/1940425574 >> v2:172.21.15.36:3300/0 conn(0x7f03740a8ac0 0x7f037414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f03737fe700 1 --2- 172.21.15.36:0/1940425574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03740b2580 0x7f037414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f03727fc700 1 -- 172.21.15.36:0/1940425574 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847433483 0 0) 0x7f03740a70c0 con 0x7f03740b0010 2022-01-10T01:32:06.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f03727fc700 1 -- 172.21.15.36:0/1940425574 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0360003260 con 0x7f03740b0010 2022-01-10T01:32:06.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0373fff700 1 -- 172.21.15.36:0/1940425574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03740b2580 msgr2=0x7f037414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:06.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0373fff700 1 --2- 172.21.15.36:0/1940425574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03740b2580 0x7f037414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0373fff700 1 -- 172.21.15.36:0/1940425574 >> v1:172.21.15.36:6789/0 conn(0x7f03740b0010 legacy=0x7f03740a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0373fff700 1 -- 172.21.15.36:0/1940425574 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03740a7830 con 0x7f03740a8ac0 2022-01-10T01:32:06.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f03737fe700 1 --2- 172.21.15.36:0/1940425574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03740b2580 0x7f037414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:06.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0373fff700 1 --2- 172.21.15.36:0/1940425574 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03740a8ac0 0x7f037414b330 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f036c0032f0 tx=0x7f036c0091d0).ready entity=mon.0 client_cookie=acba9154e64f3ff0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:06.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f03727fc700 1 -- 172.21.15.36:0/1940425574 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f036c00b6c0 con 0x7f03740a8ac0 2022-01-10T01:32:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f03727fc700 1 -- 172.21.15.36:0/1940425574 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c00b820 con 0x7f03740a8ac0 2022-01-10T01:32:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f03727fc700 1 -- 172.21.15.36:0/1940425574 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f036c00b990 con 0x7f03740a8ac0 2022-01-10T01:32:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0378e63700 1 -- 172.21.15.36:0/1940425574 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03740a8ac0 msgr2=0x7f037414b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0378e63700 1 --2- 172.21.15.36:0/1940425574 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03740a8ac0 0x7f037414b330 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f036c0032f0 tx=0x7f036c0091d0).stop 2022-01-10T01:32:06.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0378e63700 1 -- 172.21.15.36:0/1940425574 shutdown_connections 2022-01-10T01:32:06.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0378e63700 1 --2- 172.21.15.36:0/1940425574 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03740a8ac0 0x7f037414b330 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0378e63700 1 --2- 172.21.15.36:0/1940425574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03740b2580 0x7f037414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0378e63700 1 -- 172.21.15.36:0/1940425574 >> 172.21.15.36:0/1940425574 conn(0x7f0374060180 msgr2=0x7f03740b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:06.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0378e63700 1 -- 172.21.15.36:0/1940425574 shutdown_connections 2022-01-10T01:32:06.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0378e63700 1 -- 172.21.15.36:0/1940425574 wait complete. 2022-01-10T01:32:06.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0378e63700 1 Processor -- start 2022-01-10T01:32:06.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.043+0000 7f0378e63700 1 -- start start 2022-01-10T01:32:06.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0378e63700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03740a8ac0 0x7f03740ab510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0378e63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03740b0010 0x7f03740b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0378e63700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03740b2580 0x7f03740aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0378e63700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03740abfb0 con 0x7f03740b2580 2022-01-10T01:32:06.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0378e63700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0374156f80 con 0x7f03740a8ac0 2022-01-10T01:32:06.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0378e63700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03740ac1e0 con 0x7f03740b0010 2022-01-10T01:32:06.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0373fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03740b2580 0x7f03740aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0373fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03740b2580 0x7f03740aa750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40092/0 (socket says 172.21.15.36:40092) 2022-01-10T01:32:06.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0373fff700 1 -- 172.21.15.36:0/1130739579 learned_addr learned my addr 172.21.15.36:0/1130739579 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:06.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f03737fe700 1 --2- 172.21.15.36:0/1130739579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03740a8ac0 0x7f03740ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0372ffd700 1 --2- 172.21.15.36:0/1130739579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03740b0010 0x7f03740b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0373fff700 1 -- 172.21.15.36:0/1130739579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03740b0010 msgr2=0x7f03740b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0373fff700 1 --2- 172.21.15.36:0/1130739579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03740b0010 0x7f03740b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0373fff700 1 -- 172.21.15.36:0/1130739579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03740a8ac0 msgr2=0x7f03740ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0373fff700 1 --2- 172.21.15.36:0/1130739579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03740a8ac0 0x7f03740ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0373fff700 1 -- 172.21.15.36:0/1130739579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c009470 con 0x7f03740b2580 2022-01-10T01:32:06.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0373fff700 1 --2- 172.21.15.36:0/1130739579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03740b2580 0x7f03740aa750 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f036c0032f0 tx=0x7f036c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:06.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0370ff9700 1 -- 172.21.15.36:0/1130739579 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f036c006ea0 con 0x7f03740b2580 2022-01-10T01:32:06.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0370ff9700 1 -- 172.21.15.36:0/1130739579 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c00b030 con 0x7f03740b2580 2022-01-10T01:32:06.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0378e63700 1 -- 172.21.15.36:0/1130739579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03740ac480 con 0x7f03740b2580 2022-01-10T01:32:06.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0370ff9700 1 -- 172.21.15.36:0/1130739579 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f036c00b990 con 0x7f03740b2580 2022-01-10T01:32:06.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0378e63700 1 -- 172.21.15.36:0/1130739579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03740aac40 con 0x7f03740b2580 2022-01-10T01:32:06.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.047+0000 7f0378e63700 1 -- 172.21.15.36:0/1130739579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0374057350 con 0x7f03740b2580 2022-01-10T01:32:06.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.051+0000 7f0370ff9700 1 -- 172.21.15.36:0/1130739579 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f036c00f070 con 0x7f03740b2580 2022-01-10T01:32:06.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.051+0000 7f0370ff9700 1 --2- 172.21.15.36:0/1130739579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f03540536b0 0x7f0354055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.051+0000 7f0370ff9700 1 -- 172.21.15.36:0/1130739579 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f036c06cd00 con 0x7f03740b2580 2022-01-10T01:32:06.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.051+0000 7f03737fe700 1 --2- 172.21.15.36:0/1130739579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f03540536b0 0x7f0354055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.051+0000 7f03737fe700 1 --2- 172.21.15.36:0/1130739579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f03540536b0 0x7f0354055b70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f036800c000 tx=0x7f0368008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:06.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.055+0000 7f0370ff9700 1 -- 172.21.15.36:0/1130739579 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f036c070030 con 0x7f03740b2580 2022-01-10T01:32:06.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.179+0000 7f0378e63700 1 -- 172.21.15.36:0/1130739579 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03740698e0 con 0x7f03740b2580 2022-01-10T01:32:06.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.179+0000 7f0370ff9700 1 -- 172.21.15.36:0/1130739579 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16311 (secure 0 0 0) 0x7f036c015070 con 0x7f03740b2580 2022-01-10T01:32:06.183 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:06.183 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":109,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:32:05.645694+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:32:04.130397+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2022-01-10T01:32:05.331515+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:32:06.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.179+0000 7f0378e63700 1 -- 172.21.15.36:0/1130739579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f03540536b0 msgr2=0x7f0354055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.179+0000 7f0378e63700 1 --2- 172.21.15.36:0/1130739579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f03540536b0 0x7f0354055b70 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f036800c000 tx=0x7f0368008040).stop 2022-01-10T01:32:06.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.179+0000 7f0378e63700 1 -- 172.21.15.36:0/1130739579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03740b2580 msgr2=0x7f03740aa750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.179+0000 7f0378e63700 1 --2- 172.21.15.36:0/1130739579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03740b2580 0x7f03740aa750 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f036c0032f0 tx=0x7f036c016000).stop 2022-01-10T01:32:06.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.183+0000 7f0378e63700 1 -- 172.21.15.36:0/1130739579 shutdown_connections 2022-01-10T01:32:06.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.183+0000 7f0378e63700 1 --2- 172.21.15.36:0/1130739579 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f03540536b0 0x7f0354055b70 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.183+0000 7f0378e63700 1 --2- 172.21.15.36:0/1130739579 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f03740b2580 0x7f03740aa750 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.183+0000 7f0378e63700 1 --2- 172.21.15.36:0/1130739579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03740b0010 0x7f03740b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.183+0000 7f0378e63700 1 --2- 172.21.15.36:0/1130739579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03740a8ac0 0x7f03740ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.183+0000 7f0378e63700 1 -- 172.21.15.36:0/1130739579 >> 172.21.15.36:0/1130739579 conn(0x7f0374060180 msgr2=0x7f03741488b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:06.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.183+0000 7f0378e63700 1 -- 172.21.15.36:0/1130739579 shutdown_connections 2022-01-10T01:32:06.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.183+0000 7f0378e63700 1 -- 172.21.15.36:0/1130739579 wait complete. 2022-01-10T01:32:06.196 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-01-10T01:32:06.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f89775bd700 1 Processor -- start 2022-01-10T01:32:06.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f89775bd700 1 -- start start 2022-01-10T01:32:06.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f89775bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8970146950 0x7f8970140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f89775bd700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8970143b60 con 0x7f89700b4180 2022-01-10T01:32:06.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f89775bd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8970143e00 con 0x7f89700b4690 2022-01-10T01:32:06.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f89775bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8970147510 con 0x7f8970146950 2022-01-10T01:32:06.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8974b58700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f89700b4180 0x7f8970140720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37890/0 (socket says 172.21.15.36:37890) 2022-01-10T01:32:06.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8974b58700 1 -- 172.21.15.36:0/768907792 learned_addr learned my addr 172.21.15.36:0/768907792 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:06.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8975359700 1 --2- 172.21.15.36:0/768907792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8970146950 0x7f8970140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420281333 0 0) 0x7f8970143b60 con 0x7f89700b4180 2022-01-10T01:32:06.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8954003260 con 0x7f89700b4180 2022-01-10T01:32:06.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356070839 0 0) 0x7f8970143e00 con 0x7f89700b4690 2022-01-10T01:32:06.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8970143b60 con 0x7f89700b4690 2022-01-10T01:32:06.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1505699340 0 0) 0x7f8954003260 con 0x7f89700b4180 2022-01-10T01:32:06.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8970146950 msgr2=0x7f8970140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:06.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 --2- 172.21.15.36:0/768907792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8970146950 0x7f8970140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 >> v1:172.21.15.59:6789/0 conn(0x7f89700b4690 legacy=0x7f89700b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89700b0c90 con 0x7f89700b4180 2022-01-10T01:32:06.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f8964001660 con 0x7f89700b4180 2022-01-10T01:32:06.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 >> v1:172.21.15.36:6789/0 conn(0x7f89700b4180 legacy=0x7f8970140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 --2- 172.21.15.36:0/768907792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8954003910 0x7f8954003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 --2- 172.21.15.36:0/768907792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8954004500 0x7f8954004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 --2- 172.21.15.36:0/768907792 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8954004e70 0x7f895400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8970147510 con 0x7f8954004e70 2022-01-10T01:32:06.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895400bc40 con 0x7f8954003910 2022-01-10T01:32:06.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895400be00 con 0x7f8954004500 2022-01-10T01:32:06.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8975b5a700 1 --2- 172.21.15.36:0/768907792 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8954004e70 0x7f895400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8974b58700 1 --2- 172.21.15.36:0/768907792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8954004500 0x7f8954004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8975359700 1 --2- 172.21.15.36:0/768907792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8970146950 0x7f8970140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:06.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8975b5a700 1 -- 172.21.15.36:0/768907792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8954004500 msgr2=0x7f8954004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:06.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8975b5a700 1 --2- 172.21.15.36:0/768907792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8954004500 0x7f8954004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8975b5a700 1 -- 172.21.15.36:0/768907792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8954003910 msgr2=0x7f8954003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:06.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8975b5a700 1 --2- 172.21.15.36:0/768907792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8954003910 0x7f8954003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-01-10T01:32:06.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8975b5a700 1 -- 172.21.15.36:0/768907792 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8954003260 con 0x7f8954004e70 2022-01-10T01:32:06.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.303+0000 7f8975b5a700 1 --2- 172.21.15.36:0/768907792 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8954004e70 0x7f895400b750 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f8968001490 tx=0x7f8968007d60).ready entity=mon.0 client_cookie=6413f04aa1bb43ef server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:06.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8968006890 con 0x7f8954004e70 2022-01-10T01:32:06.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89680069f0 con 0x7f8954004e70 2022-01-10T01:32:06.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f8963fff700 1 -- 172.21.15.36:0/768907792 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8968006d50 con 0x7f8954004e70 2022-01-10T01:32:06.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f89775bd700 1 -- 172.21.15.36:0/768907792 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8954004e70 msgr2=0x7f895400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f89775bd700 1 --2- 172.21.15.36:0/768907792 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8954004e70 0x7f895400b750 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7f8968001490 tx=0x7f8968007d60).stop 2022-01-10T01:32:06.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f8975b5a700 1 -- 172.21.15.36:0/768907792 reap_dead start 2022-01-10T01:32:06.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f89775bd700 1 -- 172.21.15.36:0/768907792 shutdown_connections 2022-01-10T01:32:06.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f89775bd700 1 -- 172.21.15.36:0/768907792 >> 172.21.15.36:0/768907792 conn(0x7f897005c490 msgr2=0x7f897005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:06.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f89775bd700 1 -- 172.21.15.36:0/768907792 shutdown_connections 2022-01-10T01:32:06.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f89775bd700 1 -- 172.21.15.36:0/768907792 wait complete. 2022-01-10T01:32:06.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f89775bd700 1 Processor -- start 2022-01-10T01:32:06.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f89775bd700 1 -- start start 2022-01-10T01:32:06.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f89775bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8954004e70 0x7f8970155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f89775bd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89700b73c0 0x7f89700ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f89775bd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89700af780 0x7f897013cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f89775bd700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89700ae650 con 0x7f89700b73c0 2022-01-10T01:32:06.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f89775bd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89701561d0 con 0x7f89700af780 2022-01-10T01:32:06.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f89775bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8970156400 con 0x7f8954004e70 2022-01-10T01:32:06.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f8974b58700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89700b73c0 0x7f89700ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f8974b58700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89700b73c0 0x7f89700ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40110/0 (socket says 172.21.15.36:40110) 2022-01-10T01:32:06.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f8974b58700 1 -- 172.21.15.36:0/336781851 learned_addr learned my addr 172.21.15.36:0/336781851 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:06.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f8975359700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8954004e70 0x7f8970155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.307+0000 7f8975b5a700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89700af780 0x7f897013cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f8974b58700 1 -- 172.21.15.36:0/336781851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8954004e70 msgr2=0x7f8970155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f8974b58700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8954004e70 0x7f8970155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f8974b58700 1 -- 172.21.15.36:0/336781851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89700af780 msgr2=0x7f897013cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f8974b58700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89700af780 0x7f897013cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f8974b58700 1 -- 172.21.15.36:0/336781851 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89701566a0 con 0x7f89700b73c0 2022-01-10T01:32:06.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f8975359700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8954004e70 0x7f8970155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:06.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f8974b58700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89700b73c0 0x7f89700ad5f0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f89700ae790 tx=0x7f8970143040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:06.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f89627fc700 1 -- 172.21.15.36:0/336781851 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89640116b0 con 0x7f89700b73c0 2022-01-10T01:32:06.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f89627fc700 1 -- 172.21.15.36:0/336781851 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8964011810 con 0x7f89700b73c0 2022-01-10T01:32:06.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f89775bd700 1 -- 172.21.15.36:0/336781851 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89700ae1b0 con 0x7f89700b73c0 2022-01-10T01:32:06.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f89627fc700 1 -- 172.21.15.36:0/336781851 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8964011b70 con 0x7f89700b73c0 2022-01-10T01:32:06.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f89775bd700 1 -- 172.21.15.36:0/336781851 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f897014ff40 con 0x7f89700b73c0 2022-01-10T01:32:06.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f89775bd700 1 -- 172.21.15.36:0/336781851 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89700ae340 con 0x7f89700b73c0 2022-01-10T01:32:06.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f89627fc700 1 -- 172.21.15.36:0/336781851 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f896401b030 con 0x7f89700b73c0 2022-01-10T01:32:06.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f89627fc700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8958053590 0x7f8958055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f89627fc700 1 -- 172.21.15.36:0/336781851 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f896406b430 con 0x7f89700b73c0 2022-01-10T01:32:06.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f8975359700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8958053590 0x7f8958055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.311+0000 7f8975359700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8958053590 0x7f8958055a50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f896c00b000 tx=0x7f896c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:06.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.319+0000 7f89627fc700 1 -- 172.21.15.36:0/336781851 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8964042440 con 0x7f89700b73c0 2022-01-10T01:32:06.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.487+0000 7f89775bd700 1 -- 172.21.15.36:0/336781851 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8970156830 con 0x7f89700b73c0 2022-01-10T01:32:06.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.659+0000 7f89627fc700 1 -- 172.21.15.36:0/336781851 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v51) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8964019030 con 0x7f89700b73c0 2022-01-10T01:32:06.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.663+0000 7f89775bd700 1 -- 172.21.15.36:0/336781851 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8958053590 msgr2=0x7f8958055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.663+0000 7f89775bd700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8958053590 0x7f8958055a50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f896c00b000 tx=0x7f896c008040).stop 2022-01-10T01:32:06.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.663+0000 7f89775bd700 1 -- 172.21.15.36:0/336781851 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89700b73c0 msgr2=0x7f89700ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.663+0000 7f89775bd700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89700b73c0 0x7f89700ad5f0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f89700ae790 tx=0x7f8970143040).stop 2022-01-10T01:32:06.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.663+0000 7f89775bd700 1 -- 172.21.15.36:0/336781851 shutdown_connections 2022-01-10T01:32:06.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.663+0000 7f89775bd700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8958053590 0x7f8958055a50 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.663+0000 7f89775bd700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89700af780 0x7f897013cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.663+0000 7f89775bd700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89700b73c0 0x7f89700ad5f0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.663+0000 7f89775bd700 1 --2- 172.21.15.36:0/336781851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8954004e70 0x7f8970155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.663+0000 7f89775bd700 1 -- 172.21.15.36:0/336781851 >> 172.21.15.36:0/336781851 conn(0x7f897005c490 msgr2=0x7f8970145c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:06.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.663+0000 7f89775bd700 1 -- 172.21.15.36:0/336781851 shutdown_connections 2022-01-10T01:32:06.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.663+0000 7f89775bd700 1 -- 172.21.15.36:0/336781851 wait complete. 2022-01-10T01:32:06.680 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:32:06.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81d22c700 1 Processor -- start 2022-01-10T01:32:06.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81d22c700 1 -- start start 2022-01-10T01:32:06.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81d22c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa8180b36e0 0x7fa8180b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81d22c700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8180aa290 con 0x7fa8180af070 2022-01-10T01:32:06.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81d22c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa818148170 con 0x7fa8180a9eb0 2022-01-10T01:32:06.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81d22c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8180ae300 con 0x7fa8180b36e0 2022-01-10T01:32:06.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81659c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa8180b36e0 0x7fa8180b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81659c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa8180b36e0 0x7fa8180b3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40118/0 (socket says 172.21.15.36:40118) 2022-01-10T01:32:06.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81659c700 1 -- 172.21.15.36:0/3216327571 learned_addr learned my addr 172.21.15.36:0/3216327571 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:06.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81659c700 1 -- 172.21.15.36:0/3216327571 >> v1:172.21.15.59:6789/0 conn(0x7fa8180a9eb0 legacy=0x7fa81814b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81659c700 1 -- 172.21.15.36:0/3216327571 >> v1:172.21.15.36:6789/0 conn(0x7fa8180af070 legacy=0x7fa818144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81659c700 1 -- 172.21.15.36:0/3216327571 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa818148410 con 0x7fa8180b36e0 2022-01-10T01:32:06.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81659c700 1 --2- 172.21.15.36:0/3216327571 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8180b36e0 0x7fa8180b3130 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7fa8100032f0 tx=0x7fa810009290).ready entity=mon.0 client_cookie=fbc318401bd1d887 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:06.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa815d9b700 1 -- 172.21.15.36:0/3216327571 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa81000b8a0 con 0x7fa8180b36e0 2022-01-10T01:32:06.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa815d9b700 1 -- 172.21.15.36:0/3216327571 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81000ba00 con 0x7fa8180b36e0 2022-01-10T01:32:06.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa815d9b700 1 -- 172.21.15.36:0/3216327571 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa81000bb70 con 0x7fa8180b36e0 2022-01-10T01:32:06.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81d22c700 1 -- 172.21.15.36:0/3216327571 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8180b36e0 msgr2=0x7fa8180b3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81d22c700 1 --2- 172.21.15.36:0/3216327571 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8180b36e0 0x7fa8180b3130 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7fa8100032f0 tx=0x7fa810009290).stop 2022-01-10T01:32:06.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81d22c700 1 -- 172.21.15.36:0/3216327571 shutdown_connections 2022-01-10T01:32:06.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81d22c700 1 --2- 172.21.15.36:0/3216327571 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8180b36e0 0x7fa8180b3130 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81d22c700 1 -- 172.21.15.36:0/3216327571 >> 172.21.15.36:0/3216327571 conn(0x7fa8180607c0 msgr2=0x7fa818060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:06.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81d22c700 1 -- 172.21.15.36:0/3216327571 shutdown_connections 2022-01-10T01:32:06.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.787+0000 7fa81d22c700 1 -- 172.21.15.36:0/3216327571 wait complete. 2022-01-10T01:32:06.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.791+0000 7fa81d22c700 1 Processor -- start 2022-01-10T01:32:06.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.791+0000 7fa81d22c700 1 -- start start 2022-01-10T01:32:06.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.791+0000 7fa81d22c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8180a9eb0 0x7fa81815aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.791+0000 7fa81d22c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8180af070 0x7fa8180af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.791+0000 7fa81d22c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8180b36e0 0x7fa818156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.791+0000 7fa81d22c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8180b62d0 con 0x7fa8180a9eb0 2022-01-10T01:32:06.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.791+0000 7fa81d22c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81815a1c0 con 0x7fa8180b36e0 2022-01-10T01:32:06.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.791+0000 7fa81d22c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81815a460 con 0x7fa8180af070 2022-01-10T01:32:06.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.791+0000 7fa816d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8180a9eb0 0x7fa81815aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.791+0000 7fa816d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8180a9eb0 0x7fa81815aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40122/0 (socket says 172.21.15.36:40122) 2022-01-10T01:32:06.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.791+0000 7fa816d9d700 1 -- 172.21.15.36:0/30430681 learned_addr learned my addr 172.21.15.36:0/30430681 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:06.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.791+0000 7fa81759e700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8180b36e0 0x7fa818156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa81659c700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8180af070 0x7fa8180af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa816d9d700 1 -- 172.21.15.36:0/30430681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8180af070 msgr2=0x7fa8180af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa816d9d700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8180af070 0x7fa8180af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa816d9d700 1 -- 172.21.15.36:0/30430681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8180b36e0 msgr2=0x7fa818156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa816d9d700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8180b36e0 0x7fa818156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa816d9d700 1 -- 172.21.15.36:0/30430681 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa810009530 con 0x7fa8180a9eb0 2022-01-10T01:32:06.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa81759e700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8180b36e0 0x7fa818156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:06.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa816d9d700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8180a9eb0 0x7fa81815aba0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7fa8180ad990 tx=0x7fa800007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:06.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa80ffff700 1 -- 172.21.15.36:0/30430681 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa80000ce30 con 0x7fa8180a9eb0 2022-01-10T01:32:06.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa80ffff700 1 -- 172.21.15.36:0/30430681 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa800007240 con 0x7fa8180a9eb0 2022-01-10T01:32:06.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa81d22c700 1 -- 172.21.15.36:0/30430681 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8180afdd0 con 0x7fa8180a9eb0 2022-01-10T01:32:06.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa80ffff700 1 -- 172.21.15.36:0/30430681 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa800006700 con 0x7fa8180a9eb0 2022-01-10T01:32:06.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa81d22c700 1 -- 172.21.15.36:0/30430681 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8180b5f30 con 0x7fa8180a9eb0 2022-01-10T01:32:06.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa81d22c700 1 -- 172.21.15.36:0/30430681 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81814ae20 con 0x7fa8180a9eb0 2022-01-10T01:32:06.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.795+0000 7fa80ffff700 1 -- 172.21.15.36:0/30430681 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa800010030 con 0x7fa8180a9eb0 2022-01-10T01:32:06.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.799+0000 7fa80ffff700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa7fc0536b0 0x7fa7fc055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:06.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.799+0000 7fa81659c700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa7fc0536b0 0x7fa7fc055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:06.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.799+0000 7fa80ffff700 1 -- 172.21.15.36:0/30430681 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa80006b690 con 0x7fa8180a9eb0 2022-01-10T01:32:06.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.799+0000 7fa81659c700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa7fc0536b0 0x7fa7fc055b70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fa81001a000 tx=0x7fa810016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:06.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.803+0000 7fa80ffff700 1 -- 172.21.15.36:0/30430681 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa800042640 con 0x7fa8180a9eb0 2022-01-10T01:32:06.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.967+0000 7fa81d22c700 1 -- 172.21.15.36:0/30430681 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa818057350 con 0x7fa8180a9eb0 2022-01-10T01:32:06.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.967+0000 7fa80ffff700 1 -- 172.21.15.36:0/30430681 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2484 (secure 0 0 0) 0x7fa800045c60 con 0x7fa8180a9eb0 2022-01-10T01:32:06.970 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:06.971 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6836/13281616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":13281616},{"type":"v1","addr":"172.21.15.36:6836","nonce":13281616}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/2168511464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":2168511464},{"type":"v1","addr":"172.21.15.36:6837","nonce":2168511464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:32:05.646058+0000","modified":"2022-01-10T01:32:06.654528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7264":{"gid":7264,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/696360653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":696360653},{"type":"v1","addr":"172.21.15.59:6833","nonce":696360653}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2022-01-10T01:32:06.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.967+0000 7fa81d22c700 1 -- 172.21.15.36:0/30430681 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa7fc0536b0 msgr2=0x7fa7fc055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.967+0000 7fa81d22c700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa7fc0536b0 0x7fa7fc055b70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fa81001a000 tx=0x7fa810016000).stop 2022-01-10T01:32:06.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.967+0000 7fa81d22c700 1 -- 172.21.15.36:0/30430681 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8180a9eb0 msgr2=0x7fa81815aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:06.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.967+0000 7fa81d22c700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8180a9eb0 0x7fa81815aba0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7fa8180ad990 tx=0x7fa800007c10).stop 2022-01-10T01:32:06.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.967+0000 7fa81d22c700 1 -- 172.21.15.36:0/30430681 shutdown_connections 2022-01-10T01:32:06.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.967+0000 7fa81d22c700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa7fc0536b0 0x7fa7fc055b70 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.967+0000 7fa81d22c700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8180b36e0 0x7fa818156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.967+0000 7fa81d22c700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8180af070 0x7fa8180af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.967+0000 7fa81d22c700 1 --2- 172.21.15.36:0/30430681 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa8180a9eb0 0x7fa81815aba0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:06.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.967+0000 7fa81d22c700 1 -- 172.21.15.36:0/30430681 >> 172.21.15.36:0/30430681 conn(0x7fa8180607c0 msgr2=0x7fa818060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:06.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.967+0000 7fa81d22c700 1 -- 172.21.15.36:0/30430681 shutdown_connections 2022-01-10T01:32:06.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:06.967+0000 7fa81d22c700 1 -- 172.21.15.36:0/30430681 wait complete. 2022-01-10T01:32:06.975 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 51 2022-01-10T01:32:06.982 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:32:07.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb12359e700 1 Processor -- start 2022-01-10T01:32:07.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb12359e700 1 -- start start 2022-01-10T01:32:07.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb12359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb124064980 0x7fb124144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb12359e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb124067110 0x7fb124141130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb12359e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb124066500 con 0x7fb1240b3550 2022-01-10T01:32:07.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb12359e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1240b3ea0 con 0x7fb124067110 2022-01-10T01:32:07.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb12359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb124140d40 con 0x7fb124064980 2022-01-10T01:32:07.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb122d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb124067110 0x7fb124141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb122d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb124067110 0x7fb124141130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40134/0 (socket says 172.21.15.36:40134) 2022-01-10T01:32:07.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb122d9d700 1 -- 172.21.15.36:0/1603361673 learned_addr learned my addr 172.21.15.36:0/1603361673 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:07.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb12259c700 1 --2- 172.21.15.36:0/1603361673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb124064980 0x7fb124144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb122d9d700 1 -- 172.21.15.36:0/1603361673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb124064980 msgr2=0x7fb124144ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:07.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb122d9d700 1 --2- 172.21.15.36:0/1603361673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb124064980 0x7fb124144ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb122d9d700 1 -- 172.21.15.36:0/1603361673 >> v1:172.21.15.36:6789/0 conn(0x7fb1240b3550 legacy=0x7fb124066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.079+0000 7fb122d9d700 1 -- 172.21.15.36:0/1603361673 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1240b46c0 con 0x7fb124067110 2022-01-10T01:32:07.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb122d9d700 1 --2- 172.21.15.36:0/1603361673 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb124067110 0x7fb124141130 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7fb11c0032f0 tx=0x7fb11c009290).ready entity=mon.0 client_cookie=4332b06d5cf01208 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:07.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12159a700 1 -- 172.21.15.36:0/1603361673 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb11c00b8a0 con 0x7fb124067110 2022-01-10T01:32:07.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12159a700 1 -- 172.21.15.36:0/1603361673 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c00ba00 con 0x7fb124067110 2022-01-10T01:32:07.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12159a700 1 -- 172.21.15.36:0/1603361673 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb11c00bb70 con 0x7fb124067110 2022-01-10T01:32:07.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 -- 172.21.15.36:0/1603361673 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb124067110 msgr2=0x7fb124141130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 --2- 172.21.15.36:0/1603361673 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb124067110 0x7fb124141130 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7fb11c0032f0 tx=0x7fb11c009290).stop 2022-01-10T01:32:07.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 -- 172.21.15.36:0/1603361673 shutdown_connections 2022-01-10T01:32:07.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 --2- 172.21.15.36:0/1603361673 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb124067110 0x7fb124141130 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 --2- 172.21.15.36:0/1603361673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb124064980 0x7fb124144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 -- 172.21.15.36:0/1603361673 >> 172.21.15.36:0/1603361673 conn(0x7fb12405f6b0 msgr2=0x7fb12405fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:07.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 -- 172.21.15.36:0/1603361673 shutdown_connections 2022-01-10T01:32:07.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 -- 172.21.15.36:0/1603361673 wait complete. 2022-01-10T01:32:07.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 Processor -- start 2022-01-10T01:32:07.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 -- start start 2022-01-10T01:32:07.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb124064980 0x7fb12405ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb124067110 0x7fb12413b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1240b3550 0x7fb1240af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12405d1c0 con 0x7fb124064980 2022-01-10T01:32:07.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1240b0990 con 0x7fb1240b3550 2022-01-10T01:32:07.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.083+0000 7fb12359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1240b0c30 con 0x7fb124067110 2022-01-10T01:32:07.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb12259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb124064980 0x7fb12405ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb12259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb124064980 0x7fb12405ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40136/0 (socket says 172.21.15.36:40136) 2022-01-10T01:32:07.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb12259c700 1 -- 172.21.15.36:0/2123218317 learned_addr learned my addr 172.21.15.36:0/2123218317 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:07.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb121d9b700 1 --2- 172.21.15.36:0/2123218317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb124067110 0x7fb12413b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb122d9d700 1 --2- 172.21.15.36:0/2123218317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1240b3550 0x7fb1240af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb12259c700 1 -- 172.21.15.36:0/2123218317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb124067110 msgr2=0x7fb12413b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb12259c700 1 --2- 172.21.15.36:0/2123218317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb124067110 0x7fb12413b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb12259c700 1 -- 172.21.15.36:0/2123218317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1240b3550 msgr2=0x7fb1240af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb12259c700 1 --2- 172.21.15.36:0/2123218317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1240b3550 0x7fb1240af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb12259c700 1 -- 172.21.15.36:0/2123218317 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c009530 con 0x7fb124064980 2022-01-10T01:32:07.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb12259c700 1 --2- 172.21.15.36:0/2123218317 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb124064980 0x7fb12405ccd0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fb1180030b0 tx=0x7fb118008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:07.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb1137fe700 1 -- 172.21.15.36:0/2123218317 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb118011780 con 0x7fb124064980 2022-01-10T01:32:07.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb1137fe700 1 -- 172.21.15.36:0/2123218317 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1180118e0 con 0x7fb124064980 2022-01-10T01:32:07.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb12359e700 1 -- 172.21.15.36:0/2123218317 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb124151030 con 0x7fb124064980 2022-01-10T01:32:07.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb1137fe700 1 -- 172.21.15.36:0/2123218317 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb118011c40 con 0x7fb124064980 2022-01-10T01:32:07.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb12359e700 1 -- 172.21.15.36:0/2123218317 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12413bae0 con 0x7fb124064980 2022-01-10T01:32:07.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb12359e700 1 -- 172.21.15.36:0/2123218317 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1240b1300 con 0x7fb124064980 2022-01-10T01:32:07.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb1137fe700 1 -- 172.21.15.36:0/2123218317 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb11801c460 con 0x7fb124064980 2022-01-10T01:32:07.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb1137fe700 1 --2- 172.21.15.36:0/2123218317 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb100053500 0x7fb1000559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.087+0000 7fb1137fe700 1 -- 172.21.15.36:0/2123218317 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb11806bd60 con 0x7fb124064980 2022-01-10T01:32:07.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.091+0000 7fb121d9b700 1 --2- 172.21.15.36:0/2123218317 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb100053500 0x7fb1000559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.091+0000 7fb121d9b700 1 --2- 172.21.15.36:0/2123218317 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb100053500 0x7fb1000559c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fb11400d000 tx=0x7fb114007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:07.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.099+0000 7fb1137fe700 1 -- 172.21.15.36:0/2123218317 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb1240b1300 con 0x7fb124064980 2022-01-10T01:32:07.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.231+0000 7fb12359e700 1 -- 172.21.15.36:0/2123218317 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1240b48f0 con 0x7fb124064980 2022-01-10T01:32:07.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.231+0000 7fb1137fe700 1 -- 172.21.15.36:0/2123218317 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fb118042d10 con 0x7fb124064980 2022-01-10T01:32:07.236 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:07.237 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":110,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:32:06.655202+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:32:04.130397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2022-01-10T01:32:05.331515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:32:07.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.235+0000 7fb12359e700 1 -- 172.21.15.36:0/2123218317 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb100053500 msgr2=0x7fb1000559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.235+0000 7fb12359e700 1 --2- 172.21.15.36:0/2123218317 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb100053500 0x7fb1000559c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fb11400d000 tx=0x7fb114007b90).stop 2022-01-10T01:32:07.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.235+0000 7fb12359e700 1 -- 172.21.15.36:0/2123218317 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb124064980 msgr2=0x7fb12405ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.235+0000 7fb12359e700 1 --2- 172.21.15.36:0/2123218317 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb124064980 0x7fb12405ccd0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fb1180030b0 tx=0x7fb118008040).stop 2022-01-10T01:32:07.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.235+0000 7fb12359e700 1 -- 172.21.15.36:0/2123218317 shutdown_connections 2022-01-10T01:32:07.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.235+0000 7fb12359e700 1 --2- 172.21.15.36:0/2123218317 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb100053500 0x7fb1000559c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.235+0000 7fb12359e700 1 --2- 172.21.15.36:0/2123218317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1240b3550 0x7fb1240af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.235+0000 7fb12359e700 1 --2- 172.21.15.36:0/2123218317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb124067110 0x7fb12413b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.235+0000 7fb12359e700 1 --2- 172.21.15.36:0/2123218317 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb124064980 0x7fb12405ccd0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.235+0000 7fb12359e700 1 -- 172.21.15.36:0/2123218317 >> 172.21.15.36:0/2123218317 conn(0x7fb12405f6b0 msgr2=0x7fb124144000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:07.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.235+0000 7fb12359e700 1 -- 172.21.15.36:0/2123218317 shutdown_connections 2022-01-10T01:32:07.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.235+0000 7fb12359e700 1 -- 172.21.15.36:0/2123218317 wait complete. 2022-01-10T01:32:07.250 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:32:07.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff326f9c700 1 Processor -- start 2022-01-10T01:32:07.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff326f9c700 1 -- start start 2022-01-10T01:32:07.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff326f9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff320140cf0 0x7ff3200ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff326f9c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3200a8c70 0x7ff3200aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff326f9c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3200af090 con 0x7ff3200b1280 2022-01-10T01:32:07.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff326f9c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff320140310 con 0x7ff3200a8c70 2022-01-10T01:32:07.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff326f9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3201405b0 con 0x7ff320140cf0 2022-01-10T01:32:07.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff325539700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3200a8c70 0x7ff3200aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff31ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff320140cf0 0x7ff3200ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff325539700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff3200a8c70 0x7ff3200aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:36782/0 (socket says 172.21.15.36:36782) 2022-01-10T01:32:07.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff325539700 1 -- 172.21.15.36:0/2030262973 learned_addr learned my addr 172.21.15.36:0/2030262973 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:07.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff325539700 1 -- 172.21.15.36:0/2030262973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff320140cf0 msgr2=0x7ff3200ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:07.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff325539700 1 --2- 172.21.15.36:0/2030262973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff320140cf0 0x7ff3200ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff325539700 1 -- 172.21.15.36:0/2030262973 >> v1:172.21.15.59:6789/0 conn(0x7ff3200b1280 legacy=0x7ff3200b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff325539700 1 -- 172.21.15.36:0/2030262973 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff320140850 con 0x7ff3200a8c70 2022-01-10T01:32:07.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff31ffff700 1 --2- 172.21.15.36:0/2030262973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff320140cf0 0x7ff3200ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:07.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff325539700 1 --2- 172.21.15.36:0/2030262973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3200a8c70 0x7ff3200aeba0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7ff3180032f0 tx=0x7ff318009290).ready entity=mon.1 client_cookie=a148d45fe3bcf4bb server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:07.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff31f7fe700 1 -- 172.21.15.36:0/2030262973 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff31800b8a0 con 0x7ff3200a8c70 2022-01-10T01:32:07.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff31f7fe700 1 -- 172.21.15.36:0/2030262973 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31800ba00 con 0x7ff3200a8c70 2022-01-10T01:32:07.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.363+0000 7ff31f7fe700 1 -- 172.21.15.36:0/2030262973 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff31800bb70 con 0x7ff3200a8c70 2022-01-10T01:32:07.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 -- 172.21.15.36:0/2030262973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3200a8c70 msgr2=0x7ff3200aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 --2- 172.21.15.36:0/2030262973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3200a8c70 0x7ff3200aeba0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7ff3180032f0 tx=0x7ff318009290).stop 2022-01-10T01:32:07.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 -- 172.21.15.36:0/2030262973 shutdown_connections 2022-01-10T01:32:07.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 --2- 172.21.15.36:0/2030262973 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3200a8c70 0x7ff3200aeba0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 --2- 172.21.15.36:0/2030262973 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff320140cf0 0x7ff3200ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 -- 172.21.15.36:0/2030262973 >> 172.21.15.36:0/2030262973 conn(0x7ff32005f6b0 msgr2=0x7ff32005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:07.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 -- 172.21.15.36:0/2030262973 shutdown_connections 2022-01-10T01:32:07.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 -- 172.21.15.36:0/2030262973 wait complete. 2022-01-10T01:32:07.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 Processor -- start 2022-01-10T01:32:07.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 -- start start 2022-01-10T01:32:07.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3200a8c70 0x7ff320066f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3200b1280 0x7ff3200abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff320140cf0 0x7ff3200ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200aa400 con 0x7ff3200b1280 2022-01-10T01:32:07.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3200b32d0 con 0x7ff3200a8c70 2022-01-10T01:32:07.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff326f9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff320145f80 con 0x7ff320140cf0 2022-01-10T01:32:07.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff31ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3200b1280 0x7ff3200abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff324d38700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3200a8c70 0x7ff320066f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff31ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3200b1280 0x7ff3200abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40152/0 (socket says 172.21.15.36:40152) 2022-01-10T01:32:07.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff31ffff700 1 -- 172.21.15.36:0/1904144084 learned_addr learned my addr 172.21.15.36:0/1904144084 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:07.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff325539700 1 --2- 172.21.15.36:0/1904144084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff320140cf0 0x7ff3200ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff324d38700 1 -- 172.21.15.36:0/1904144084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff320140cf0 msgr2=0x7ff3200ac0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff324d38700 1 --2- 172.21.15.36:0/1904144084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff320140cf0 0x7ff3200ac0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff324d38700 1 -- 172.21.15.36:0/1904144084 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3200b1280 msgr2=0x7ff3200abbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.367+0000 7ff324d38700 1 --2- 172.21.15.36:0/1904144084 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3200b1280 0x7ff3200abbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.371+0000 7ff324d38700 1 -- 172.21.15.36:0/1904144084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30800b180 con 0x7ff3200a8c70 2022-01-10T01:32:07.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.371+0000 7ff324d38700 1 --2- 172.21.15.36:0/1904144084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3200a8c70 0x7ff320066f10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7ff3201410d0 tx=0x7ff310007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:07.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.371+0000 7ff31dffb700 1 -- 172.21.15.36:0/1904144084 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff310012400 con 0x7ff3200a8c70 2022-01-10T01:32:07.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.371+0000 7ff326f9c700 1 -- 172.21.15.36:0/1904144084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff318009530 con 0x7ff3200a8c70 2022-01-10T01:32:07.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.371+0000 7ff31dffb700 1 -- 172.21.15.36:0/1904144084 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff310012560 con 0x7ff3200a8c70 2022-01-10T01:32:07.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.371+0000 7ff31dffb700 1 -- 172.21.15.36:0/1904144084 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3100128c0 con 0x7ff3200a8c70 2022-01-10T01:32:07.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.371+0000 7ff326f9c700 1 -- 172.21.15.36:0/1904144084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3200aa9f0 con 0x7ff3200a8c70 2022-01-10T01:32:07.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.371+0000 7ff326f9c700 1 -- 172.21.15.36:0/1904144084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3200b35e0 con 0x7ff3200a8c70 2022-01-10T01:32:07.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.371+0000 7ff31dffb700 1 -- 172.21.15.36:0/1904144084 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff310019030 con 0x7ff3200a8c70 2022-01-10T01:32:07.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.371+0000 7ff31dffb700 1 --2- 172.21.15.36:0/1904144084 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff3040535f0 0x7ff304055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.371+0000 7ff31dffb700 1 -- 172.21.15.36:0/1904144084 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff31006ad70 con 0x7ff3200a8c70 2022-01-10T01:32:07.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.371+0000 7ff31ffff700 1 --2- 172.21.15.36:0/1904144084 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff3040535f0 0x7ff304055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.371+0000 7ff31ffff700 1 --2- 172.21.15.36:0/1904144084 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff3040535f0 0x7ff304055ab0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7ff30800b000 tx=0x7ff308006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:07.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.379+0000 7ff31dffb700 1 -- 172.21.15.36:0/1904144084 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff310041ce0 con 0x7ff3200a8c70 2022-01-10T01:32:07.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.555+0000 7ff326f9c700 1 -- 172.21.15.36:0/1904144084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff320140000 con 0x7ff3200a8c70 2022-01-10T01:32:07.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.563+0000 7ff31dffb700 1 -- 172.21.15.36:0/1904144084 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v27) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff310045300 con 0x7ff3200a8c70 2022-01-10T01:32:07.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.567+0000 7ff326f9c700 1 -- 172.21.15.36:0/1904144084 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff3040535f0 msgr2=0x7ff304055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.567+0000 7ff326f9c700 1 --2- 172.21.15.36:0/1904144084 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff3040535f0 0x7ff304055ab0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7ff30800b000 tx=0x7ff308006df0).stop 2022-01-10T01:32:07.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.567+0000 7ff326f9c700 1 -- 172.21.15.36:0/1904144084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3200a8c70 msgr2=0x7ff320066f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.567+0000 7ff326f9c700 1 --2- 172.21.15.36:0/1904144084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3200a8c70 0x7ff320066f10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7ff3201410d0 tx=0x7ff310007b90).stop 2022-01-10T01:32:07.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.567+0000 7ff326f9c700 1 -- 172.21.15.36:0/1904144084 shutdown_connections 2022-01-10T01:32:07.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.567+0000 7ff326f9c700 1 --2- 172.21.15.36:0/1904144084 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff3040535f0 0x7ff304055ab0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.567+0000 7ff326f9c700 1 --2- 172.21.15.36:0/1904144084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff320140cf0 0x7ff3200ac0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.567+0000 7ff326f9c700 1 --2- 172.21.15.36:0/1904144084 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff3200b1280 0x7ff3200abbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.567+0000 7ff326f9c700 1 --2- 172.21.15.36:0/1904144084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff3200a8c70 0x7ff320066f10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.567+0000 7ff326f9c700 1 -- 172.21.15.36:0/1904144084 >> 172.21.15.36:0/1904144084 conn(0x7ff32005f6b0 msgr2=0x7ff32013e100 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:07.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.567+0000 7ff326f9c700 1 -- 172.21.15.36:0/1904144084 shutdown_connections 2022-01-10T01:32:07.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.567+0000 7ff326f9c700 1 -- 172.21.15.36:0/1904144084 wait complete. 2022-01-10T01:32:07.574 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.0 2022-01-10T01:32:07.583 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:32:07.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.699+0000 7fa70c8b6700 1 Processor -- start 2022-01-10T01:32:07.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.699+0000 7fa70c8b6700 1 -- start start 2022-01-10T01:32:07.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70c8b6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7080b3060 0x7fa7080b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70c8b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7080aac20 0x7fa708064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70c8b6700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7080b2380 con 0x7fa7080b7370 2022-01-10T01:32:07.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70c8b6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa708144250 con 0x7fa7080b3060 2022-01-10T01:32:07.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70c8b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7080b3570 con 0x7fa7080aac20 2022-01-10T01:32:07.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa706d9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa7080b7370 0x7fa70813e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37952/0 (socket says 172.21.15.36:37952) 2022-01-10T01:32:07.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa706d9d700 1 -- 172.21.15.36:0/599314029 learned_addr learned my addr 172.21.15.36:0/599314029 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:07.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa6fe59c700 1 --2- 172.21.15.36:0/599314029 >> v2:172.21.15.59:3300/0 conn(0x7fa7080b3060 0x7fa7080b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70759e700 1 --2- 172.21.15.36:0/599314029 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7080aac20 0x7fa708064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70659c700 1 -- 172.21.15.36:0/599314029 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863020115 0 0) 0x7fa7080b2380 con 0x7fa7080b7370 2022-01-10T01:32:07.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70659c700 1 -- 172.21.15.36:0/599314029 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e8003260 con 0x7fa7080b7370 2022-01-10T01:32:07.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70659c700 1 -- 172.21.15.36:0/599314029 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 304358711 0 0) 0x7fa6e8003260 con 0x7fa7080b7370 2022-01-10T01:32:07.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70759e700 1 -- 172.21.15.36:0/599314029 >> v2:172.21.15.59:3300/0 conn(0x7fa7080b3060 msgr2=0x7fa7080b7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:07.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70759e700 1 --2- 172.21.15.36:0/599314029 >> v2:172.21.15.59:3300/0 conn(0x7fa7080b3060 0x7fa7080b7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70759e700 1 -- 172.21.15.36:0/599314029 >> v1:172.21.15.36:6789/0 conn(0x7fa7080b7370 legacy=0x7fa70813e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70759e700 1 -- 172.21.15.36:0/599314029 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7080b25b0 con 0x7fa7080aac20 2022-01-10T01:32:07.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa6fe59c700 1 --2- 172.21.15.36:0/599314029 >> v2:172.21.15.59:3300/0 conn(0x7fa7080b3060 0x7fa7080b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:07.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70759e700 1 --2- 172.21.15.36:0/599314029 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7080aac20 0x7fa708064ba0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fa6f80019a0 tx=0x7fa7000091d0).ready entity=mon.2 client_cookie=5ced8ff26d561984 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:07.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70659c700 1 -- 172.21.15.36:0/599314029 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6f8001800 con 0x7fa7080aac20 2022-01-10T01:32:07.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70659c700 1 -- 172.21.15.36:0/599314029 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70000f510 con 0x7fa7080aac20 2022-01-10T01:32:07.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70659c700 1 -- 172.21.15.36:0/599314029 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa70000f680 con 0x7fa7080aac20 2022-01-10T01:32:07.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70c8b6700 1 -- 172.21.15.36:0/599314029 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7080aac20 msgr2=0x7fa708064ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70c8b6700 1 --2- 172.21.15.36:0/599314029 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7080aac20 0x7fa708064ba0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fa6f80019a0 tx=0x7fa7000091d0).stop 2022-01-10T01:32:07.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70c8b6700 1 -- 172.21.15.36:0/599314029 shutdown_connections 2022-01-10T01:32:07.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70c8b6700 1 --2- 172.21.15.36:0/599314029 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7080aac20 0x7fa708064ba0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70c8b6700 1 --2- 172.21.15.36:0/599314029 >> v2:172.21.15.59:3300/0 conn(0x7fa7080b3060 0x7fa7080b7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70c8b6700 1 -- 172.21.15.36:0/599314029 >> 172.21.15.36:0/599314029 conn(0x7fa70805f6b0 msgr2=0x7fa70805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:07.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70c8b6700 1 -- 172.21.15.36:0/599314029 shutdown_connections 2022-01-10T01:32:07.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.703+0000 7fa70c8b6700 1 -- 172.21.15.36:0/599314029 wait complete. 2022-01-10T01:32:07.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.707+0000 7fa70c8b6700 1 Processor -- start 2022-01-10T01:32:07.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.707+0000 7fa70c8b6700 1 -- start start 2022-01-10T01:32:07.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.707+0000 7fa70c8b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7080aac20 0x7fa708060f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.707+0000 7fa70c8b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7080b3060 0x7fa7080ab670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.707+0000 7fa70c8b6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7080b7370 0x7fa70813d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.707+0000 7fa70c8b6700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa708062530 con 0x7fa7080b7370 2022-01-10T01:32:07.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.707+0000 7fa70c8b6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7080ae2f0 con 0x7fa7080b3060 2022-01-10T01:32:07.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.707+0000 7fa70c8b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa708061980 con 0x7fa7080aac20 2022-01-10T01:32:07.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa70759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7080b7370 0x7fa70813d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa70759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7080b7370 0x7fa70813d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40168/0 (socket says 172.21.15.36:40168) 2022-01-10T01:32:07.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa70759e700 1 -- 172.21.15.36:0/3006635979 learned_addr learned my addr 172.21.15.36:0/3006635979 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:07.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa706d9d700 1 --2- 172.21.15.36:0/3006635979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7080aac20 0x7fa708060f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa6fe59c700 1 --2- 172.21.15.36:0/3006635979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7080b3060 0x7fa7080ab670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa70759e700 1 -- 172.21.15.36:0/3006635979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7080aac20 msgr2=0x7fa708060f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa70759e700 1 --2- 172.21.15.36:0/3006635979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7080aac20 0x7fa708060f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa70759e700 1 -- 172.21.15.36:0/3006635979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7080b3060 msgr2=0x7fa7080ab670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa70759e700 1 --2- 172.21.15.36:0/3006635979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7080b3060 0x7fa7080ab670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa70759e700 1 -- 172.21.15.36:0/3006635979 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f000b180 con 0x7fa7080b7370 2022-01-10T01:32:07.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa70759e700 1 --2- 172.21.15.36:0/3006635979 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7080b7370 0x7fa70813d210 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fa6f80019a0 tx=0x7fa700016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:07.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa704d99700 1 -- 172.21.15.36:0/3006635979 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7000032f0 con 0x7fa7080b7370 2022-01-10T01:32:07.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa704d99700 1 -- 172.21.15.36:0/3006635979 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa700011b80 con 0x7fa7080b7370 2022-01-10T01:32:07.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa70c8b6700 1 -- 172.21.15.36:0/3006635979 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa700009470 con 0x7fa7080b7370 2022-01-10T01:32:07.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa704d99700 1 -- 172.21.15.36:0/3006635979 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa700021480 con 0x7fa7080b7370 2022-01-10T01:32:07.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa70c8b6700 1 -- 172.21.15.36:0/3006635979 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa708061460 con 0x7fa7080b7370 2022-01-10T01:32:07.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.711+0000 7fa70c8b6700 1 -- 172.21.15.36:0/3006635979 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa708060c60 con 0x7fa7080b7370 2022-01-10T01:32:07.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.715+0000 7fa704d99700 1 -- 172.21.15.36:0/3006635979 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa70000f070 con 0x7fa7080b7370 2022-01-10T01:32:07.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.715+0000 7fa704d99700 1 --2- 172.21.15.36:0/3006635979 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6ec053620 0x7fa6ec055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:07.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.715+0000 7fa704d99700 1 -- 172.21.15.36:0/3006635979 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa70006cd10 con 0x7fa7080b7370 2022-01-10T01:32:07.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.715+0000 7fa706d9d700 1 --2- 172.21.15.36:0/3006635979 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6ec053620 0x7fa6ec055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:07.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.715+0000 7fa706d9d700 1 --2- 172.21.15.36:0/3006635979 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6ec053620 0x7fa6ec055ae0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fa6f800d000 tx=0x7fa6f8002ea0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:07.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.723+0000 7fa704d99700 1 -- 172.21.15.36:0/3006635979 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa700043ca0 con 0x7fa7080b7370 2022-01-10T01:32:07.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.891+0000 7fa70c8b6700 1 -- 172.21.15.36:0/3006635979 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa708057350 con 0x7fa7080b7370 2022-01-10T01:32:07.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.899+0000 7fa704d99700 1 -- 172.21.15.36:0/3006635979 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa700015070 con 0x7fa7080b7370 2022-01-10T01:32:07.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.899+0000 7fa70c8b6700 1 -- 172.21.15.36:0/3006635979 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6ec053620 msgr2=0x7fa6ec055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.899+0000 7fa70c8b6700 1 --2- 172.21.15.36:0/3006635979 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6ec053620 0x7fa6ec055ae0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fa6f800d000 tx=0x7fa6f8002ea0).stop 2022-01-10T01:32:07.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.899+0000 7fa70c8b6700 1 -- 172.21.15.36:0/3006635979 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7080b7370 msgr2=0x7fa70813d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:07.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.899+0000 7fa70c8b6700 1 --2- 172.21.15.36:0/3006635979 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7080b7370 0x7fa70813d210 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fa6f80019a0 tx=0x7fa700016000).stop 2022-01-10T01:32:07.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.899+0000 7fa70c8b6700 1 -- 172.21.15.36:0/3006635979 shutdown_connections 2022-01-10T01:32:07.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.899+0000 7fa70c8b6700 1 --2- 172.21.15.36:0/3006635979 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa6ec053620 0x7fa6ec055ae0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.899+0000 7fa70c8b6700 1 --2- 172.21.15.36:0/3006635979 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa7080b7370 0x7fa70813d210 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.899+0000 7fa70c8b6700 1 --2- 172.21.15.36:0/3006635979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7080b3060 0x7fa7080ab670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.899+0000 7fa70c8b6700 1 --2- 172.21.15.36:0/3006635979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7080aac20 0x7fa708060f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:07.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.899+0000 7fa70c8b6700 1 -- 172.21.15.36:0/3006635979 >> 172.21.15.36:0/3006635979 conn(0x7fa70805f6b0 msgr2=0x7fa708140510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:07.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.903+0000 7fa70c8b6700 1 -- 172.21.15.36:0/3006635979 shutdown_connections 2022-01-10T01:32:07.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:07.903+0000 7fa70c8b6700 1 -- 172.21.15.36:0/3006635979 wait complete. 2022-01-10T01:32:07.908 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.1 2022-01-10T01:32:07.920 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:32:08.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.015+0000 7fc3dc887700 1 Processor -- start 2022-01-10T01:32:08.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.015+0000 7fc3dc887700 1 -- start start 2022-01-10T01:32:08.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.015+0000 7fc3dc887700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d80b2580 0x7fc3d8140050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:08.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.015+0000 7fc3dc887700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc3d80b00e0 0x7fc3d8140540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:08.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.015+0000 7fc3dc887700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc3d80ac6f0 0x7fc3d8142e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:08.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.015+0000 7fc3dc887700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d80ad5b0 con 0x7fc3d80b00e0 2022-01-10T01:32:08.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.015+0000 7fc3dc887700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d8067880 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.015+0000 7fc3dc887700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d8067b20 con 0x7fc3d80b2580 2022-01-10T01:32:08.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.015+0000 7fc3ceffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc3d80b00e0 0x7fc3d8140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:08.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.015+0000 7fc3d7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc3d80ac6f0 0x7fc3d8142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:08.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.015+0000 7fc3ceffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc3d80b00e0 0x7fc3d8140540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40176/0 (socket says 172.21.15.36:40176) 2022-01-10T01:32:08.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.015+0000 7fc3ceffd700 1 -- 172.21.15.36:0/700068823 learned_addr learned my addr 172.21.15.36:0/700068823 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:08.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.015+0000 7fc3d7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc3d80ac6f0 0x7fc3d8142e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:36808/0 (socket says 172.21.15.36:36808) 2022-01-10T01:32:08.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.019+0000 7fc3d77fe700 1 --2- 172.21.15.36:0/700068823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d80b2580 0x7fc3d8140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:08.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.019+0000 7fc3d7fff700 1 -- 172.21.15.36:0/700068823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d80b2580 msgr2=0x7fc3d8140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:08.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.019+0000 7fc3d7fff700 1 --2- 172.21.15.36:0/700068823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d80b2580 0x7fc3d8140050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.019+0000 7fc3d7fff700 1 -- 172.21.15.36:0/700068823 >> v2:172.21.15.36:3300/0 conn(0x7fc3d80b00e0 msgr2=0x7fc3d8140540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:08.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.019+0000 7fc3d7fff700 1 --2- 172.21.15.36:0/700068823 >> v2:172.21.15.36:3300/0 conn(0x7fc3d80b00e0 0x7fc3d8140540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.019+0000 7fc3d7fff700 1 -- 172.21.15.36:0/700068823 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d8146fd0 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.019+0000 7fc3ceffd700 1 --2- 172.21.15.36:0/700068823 >> v2:172.21.15.36:3300/0 conn(0x7fc3d80b00e0 0x7fc3d8140540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:08.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.019+0000 7fc3d7fff700 1 --2- 172.21.15.36:0/700068823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d80ac6f0 0x7fc3d8142e70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fc3d00032f0 tx=0x7fc3d00091d0).ready entity=mon.1 client_cookie=fdbd36ba2bb717d2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:08.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.023+0000 7fc3d6ffd700 1 -- 172.21.15.36:0/700068823 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3d000b600 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.023+0000 7fc3d6ffd700 1 -- 172.21.15.36:0/700068823 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d000b760 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.023+0000 7fc3d6ffd700 1 -- 172.21.15.36:0/700068823 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3d000b910 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.023+0000 7fc3dc887700 1 -- 172.21.15.36:0/700068823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d80ac6f0 msgr2=0x7fc3d8142e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:08.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.023+0000 7fc3dc887700 1 --2- 172.21.15.36:0/700068823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d80ac6f0 0x7fc3d8142e70 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fc3d00032f0 tx=0x7fc3d00091d0).stop 2022-01-10T01:32:08.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.023+0000 7fc3dc887700 1 -- 172.21.15.36:0/700068823 shutdown_connections 2022-01-10T01:32:08.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.023+0000 7fc3dc887700 1 --2- 172.21.15.36:0/700068823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d80ac6f0 0x7fc3d8142e70 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.023+0000 7fc3dc887700 1 --2- 172.21.15.36:0/700068823 >> v2:172.21.15.36:3300/0 conn(0x7fc3d80b00e0 0x7fc3d8140540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.023+0000 7fc3dc887700 1 --2- 172.21.15.36:0/700068823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d80b2580 0x7fc3d8140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.023+0000 7fc3dc887700 1 -- 172.21.15.36:0/700068823 >> 172.21.15.36:0/700068823 conn(0x7fc3d8060180 msgr2=0x7fc3d80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:08.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.023+0000 7fc3dc887700 1 -- 172.21.15.36:0/700068823 shutdown_connections 2022-01-10T01:32:08.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.023+0000 7fc3dc887700 1 -- 172.21.15.36:0/700068823 wait complete. 2022-01-10T01:32:08.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.023+0000 7fc3dc887700 1 Processor -- start 2022-01-10T01:32:08.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.023+0000 7fc3dc887700 1 -- start start 2022-01-10T01:32:08.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3dc887700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3d80ac6f0 0x7fc3d809f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:08.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3dc887700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d80b00e0 0x7fc3d809ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:08.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3dc887700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d80b2580 0x7fc3d8140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:08.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3dc887700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d809fe60 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3dc887700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d8153220 con 0x7fc3d80b00e0 2022-01-10T01:32:08.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3dc887700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d809fbc0 con 0x7fc3d80b2580 2022-01-10T01:32:08.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d77fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3d80ac6f0 0x7fc3d809f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:08.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d77fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3d80ac6f0 0x7fc3d809f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40178/0 (socket says 172.21.15.36:40178) 2022-01-10T01:32:08.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d77fe700 1 -- 172.21.15.36:0/2159422524 learned_addr learned my addr 172.21.15.36:0/2159422524 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:08.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d7fff700 1 --2- 172.21.15.36:0/2159422524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d80b2580 0x7fc3d8140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:08.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3ceffd700 1 --2- 172.21.15.36:0/2159422524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d80b00e0 0x7fc3d809ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:08.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d77fe700 1 -- 172.21.15.36:0/2159422524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d80b2580 msgr2=0x7fc3d8140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:08.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d77fe700 1 --2- 172.21.15.36:0/2159422524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d80b2580 0x7fc3d8140d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d77fe700 1 -- 172.21.15.36:0/2159422524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d80b00e0 msgr2=0x7fc3d809ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:08.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d77fe700 1 --2- 172.21.15.36:0/2159422524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d80b00e0 0x7fc3d809ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d77fe700 1 -- 172.21.15.36:0/2159422524 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c000b1e0 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d77fe700 1 --2- 172.21.15.36:0/2159422524 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3d80ac6f0 0x7fc3d809f510 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7fc3c800c000 tx=0x7fc3c8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:08.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d57fa700 1 -- 172.21.15.36:0/2159422524 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3c8010780 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d57fa700 1 -- 172.21.15.36:0/2159422524 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c80108e0 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3dc887700 1 -- 172.21.15.36:0/2159422524 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d0009470 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d57fa700 1 -- 172.21.15.36:0/2159422524 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3c8010c40 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3dc887700 1 -- 172.21.15.36:0/2159422524 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d81429a0 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3dc887700 1 -- 172.21.15.36:0/2159422524 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d8057350 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d57fa700 1 -- 172.21.15.36:0/2159422524 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc3c801c460 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d57fa700 1 --2- 172.21.15.36:0/2159422524 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc3bc053560 0x7fc3bc055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:08.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3d57fa700 1 -- 172.21.15.36:0/2159422524 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc3c806bf20 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.027+0000 7fc3ceffd700 1 --2- 172.21.15.36:0/2159422524 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc3bc053560 0x7fc3bc055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:08.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.031+0000 7fc3ceffd700 1 --2- 172.21.15.36:0/2159422524 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc3bc053560 0x7fc3bc055a20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fc3c000b000 tx=0x7fc3c0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:08.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.031+0000 7fc3d57fa700 1 -- 172.21.15.36:0/2159422524 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc3c8042ed0 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.191+0000 7fc3dc887700 1 -- 172.21.15.36:0/2159422524 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3d80b1a20 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.191+0000 7fc3d57fa700 1 -- 172.21.15.36:0/2159422524 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2484 (secure 0 0 0) 0x7fc3c80464f0 con 0x7fc3d80ac6f0 2022-01-10T01:32:08.196 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:08.196 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6836/13281616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":13281616},{"type":"v1","addr":"172.21.15.36:6836","nonce":13281616}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/2168511464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":2168511464},{"type":"v1","addr":"172.21.15.36:6837","nonce":2168511464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:32:05.646058+0000","modified":"2022-01-10T01:32:06.654528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7264":{"gid":7264,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/696360653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":696360653},{"type":"v1","addr":"172.21.15.59:6833","nonce":696360653}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2022-01-10T01:32:08.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.195+0000 7fc3dc887700 1 -- 172.21.15.36:0/2159422524 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc3bc053560 msgr2=0x7fc3bc055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:08.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.195+0000 7fc3dc887700 1 --2- 172.21.15.36:0/2159422524 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc3bc053560 0x7fc3bc055a20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fc3c000b000 tx=0x7fc3c0008040).stop 2022-01-10T01:32:08.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.195+0000 7fc3dc887700 1 -- 172.21.15.36:0/2159422524 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3d80ac6f0 msgr2=0x7fc3d809f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:08.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.195+0000 7fc3dc887700 1 --2- 172.21.15.36:0/2159422524 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3d80ac6f0 0x7fc3d809f510 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7fc3c800c000 tx=0x7fc3c8006df0).stop 2022-01-10T01:32:08.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.195+0000 7fc3dc887700 1 -- 172.21.15.36:0/2159422524 shutdown_connections 2022-01-10T01:32:08.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.195+0000 7fc3dc887700 1 --2- 172.21.15.36:0/2159422524 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc3bc053560 0x7fc3bc055a20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.195+0000 7fc3dc887700 1 --2- 172.21.15.36:0/2159422524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3d80b2580 0x7fc3d8140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.195+0000 7fc3dc887700 1 --2- 172.21.15.36:0/2159422524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3d80b00e0 0x7fc3d809ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.195+0000 7fc3dc887700 1 --2- 172.21.15.36:0/2159422524 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3d80ac6f0 0x7fc3d809f510 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.195+0000 7fc3dc887700 1 -- 172.21.15.36:0/2159422524 >> 172.21.15.36:0/2159422524 conn(0x7fc3d8060180 msgr2=0x7fc3d80add80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:08.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.195+0000 7fc3dc887700 1 -- 172.21.15.36:0/2159422524 shutdown_connections 2022-01-10T01:32:08.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.195+0000 7fc3dc887700 1 -- 172.21.15.36:0/2159422524 wait complete. 2022-01-10T01:32:08.201 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 51 2022-01-10T01:32:08.512 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:32:05.646058+0000', 'modified': '2022-01-10T01:32:06.654528+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7264': {'gid': 7264, 'name': 'b', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/696360653', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 696360653}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 696360653}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:32:08.513 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:32:08.514 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:32:08.633 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":7264,"want_state":"up:active","state":"up:active","rank_uptime":2.9675271240000001,"mdsmap_epoch":51,"osdmap_epoch":110,"osdmap_epoch_barrier":109,"uptime":7.3211892020000002} 2022-01-10T01:32:08.633 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 7264, "mdsmap_epoch": 51, "osdmap_epoch": 110, "osdmap_epoch_barrier": 109, "rank_uptime": 2.967527124, "state": "up:active", "uptime": 7.321189202, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:32:08.634 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:32:08.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.739+0000 7f7e4e684700 1 Processor -- start 2022-01-10T01:32:08.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.739+0000 7f7e4e684700 1 -- start start 2022-01-10T01:32:08.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.739+0000 7f7e4e684700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e480b6380 0x7f7e48140370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:08.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.739+0000 7f7e4e684700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e480b2910 0x7f7e48140860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:08.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.739+0000 7f7e4e684700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7e480612f0 0x7f7e480b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:08.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.739+0000 7f7e4e684700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e48061fb0 con 0x7f7e480612f0 2022-01-10T01:32:08.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.739+0000 7f7e4e684700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e48065520 con 0x7f7e480b2910 2022-01-10T01:32:08.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.739+0000 7f7e4e684700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e48146660 con 0x7f7e480b6380 2022-01-10T01:32:08.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.739+0000 7f7e4de83700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7e480612f0 0x7f7e480b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:08.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.739+0000 7f7e4de83700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7e480612f0 0x7f7e480b0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40190/0 (socket says 172.21.15.36:40190) 2022-01-10T01:32:08.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.739+0000 7f7e4de83700 1 -- 172.21.15.36:0/369793374 learned_addr learned my addr 172.21.15.36:0/369793374 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:08.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.739+0000 7f7e4ce81700 1 --2- 172.21.15.36:0/369793374 >> v2:172.21.15.59:3300/0 conn(0x7f7e480b2910 0x7f7e48140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:08.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.739+0000 7f7e4d682700 1 --2- 172.21.15.36:0/369793374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e480b6380 0x7f7e48140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:08.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4d682700 1 -- 172.21.15.36:0/369793374 >> v2:172.21.15.59:3300/0 conn(0x7f7e480b2910 msgr2=0x7f7e48140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:08.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4d682700 1 --2- 172.21.15.36:0/369793374 >> v2:172.21.15.59:3300/0 conn(0x7f7e480b2910 0x7f7e48140860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4d682700 1 -- 172.21.15.36:0/369793374 >> v2:172.21.15.36:3300/0 conn(0x7f7e480612f0 msgr2=0x7f7e480b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:08.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4d682700 1 --2- 172.21.15.36:0/369793374 >> v2:172.21.15.36:3300/0 conn(0x7f7e480612f0 0x7f7e480b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4d682700 1 -- 172.21.15.36:0/369793374 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e48147510 con 0x7f7e480b6380 2022-01-10T01:32:08.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4de83700 1 --2- 172.21.15.36:0/369793374 >> v2:172.21.15.36:3300/0 conn(0x7f7e480612f0 0x7f7e480b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:08.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4d682700 1 --2- 172.21.15.36:0/369793374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e480b6380 0x7f7e48140370 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f7e38002f70 tx=0x7f7e38006df0).ready entity=mon.2 client_cookie=7452c9d0fd3608fa server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:08.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e3ffff700 1 -- 172.21.15.36:0/369793374 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e3800d4a0 con 0x7f7e480b6380 2022-01-10T01:32:08.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e3ffff700 1 -- 172.21.15.36:0/369793374 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e38000e90 con 0x7f7e480b6380 2022-01-10T01:32:08.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e3ffff700 1 -- 172.21.15.36:0/369793374 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e3800d7f0 con 0x7f7e480b6380 2022-01-10T01:32:08.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4e684700 1 -- 172.21.15.36:0/369793374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e480b6380 msgr2=0x7f7e48140370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:08.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4e684700 1 --2- 172.21.15.36:0/369793374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e480b6380 0x7f7e48140370 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f7e38002f70 tx=0x7f7e38006df0).stop 2022-01-10T01:32:08.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4e684700 1 -- 172.21.15.36:0/369793374 shutdown_connections 2022-01-10T01:32:08.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4e684700 1 --2- 172.21.15.36:0/369793374 >> v2:172.21.15.36:3300/0 conn(0x7f7e480612f0 0x7f7e480b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4e684700 1 --2- 172.21.15.36:0/369793374 >> v2:172.21.15.59:3300/0 conn(0x7f7e480b2910 0x7f7e48140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4e684700 1 --2- 172.21.15.36:0/369793374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e480b6380 0x7f7e48140370 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4e684700 1 -- 172.21.15.36:0/369793374 >> 172.21.15.36:0/369793374 conn(0x7f7e48063670 msgr2=0x7f7e48063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:08.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4e684700 1 -- 172.21.15.36:0/369793374 shutdown_connections 2022-01-10T01:32:08.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4e684700 1 -- 172.21.15.36:0/369793374 wait complete. 2022-01-10T01:32:08.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4e684700 1 Processor -- start 2022-01-10T01:32:08.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.743+0000 7f7e4e684700 1 -- start start 2022-01-10T01:32:08.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4e684700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e480612f0 0x7f7e4813f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:08.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4e684700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e480b2910 0x7f7e48143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:08.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4e684700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7e480b6380 0x7f7e48152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:08.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4e684700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e48060d80 con 0x7f7e480b6380 2022-01-10T01:32:08.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4e684700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e48146480 con 0x7f7e480b2910 2022-01-10T01:32:08.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4e684700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e48146220 con 0x7f7e480612f0 2022-01-10T01:32:08.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4de83700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7e480b6380 0x7f7e48152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:08.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4de83700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7e480b6380 0x7f7e48152130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40196/0 (socket says 172.21.15.36:40196) 2022-01-10T01:32:08.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4de83700 1 -- 172.21.15.36:0/2089987978 learned_addr learned my addr 172.21.15.36:0/2089987978 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:08.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4ce81700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e480b2910 0x7f7e48143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:08.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4d682700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e480612f0 0x7f7e4813f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:08.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4de83700 1 -- 172.21.15.36:0/2089987978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e480612f0 msgr2=0x7f7e4813f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:08.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4de83700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e480612f0 0x7f7e4813f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4de83700 1 -- 172.21.15.36:0/2089987978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e480b2910 msgr2=0x7f7e48143750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:08.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4de83700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e480b2910 0x7f7e48143750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4de83700 1 -- 172.21.15.36:0/2089987978 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e40009530 con 0x7f7e480b6380 2022-01-10T01:32:08.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4d682700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e480612f0 0x7f7e4813f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:08.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4ce81700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e480b2910 0x7f7e48143750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:08.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4de83700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7e480b6380 0x7f7e48152130 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f7e48060ec0 tx=0x7f7e40009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:08.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e3e7fc700 1 -- 172.21.15.36:0/2089987978 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e4000c8a0 con 0x7f7e480b6380 2022-01-10T01:32:08.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e3e7fc700 1 -- 172.21.15.36:0/2089987978 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4000ca00 con 0x7f7e480b6380 2022-01-10T01:32:08.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4e684700 1 -- 172.21.15.36:0/2089987978 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3800b180 con 0x7f7e480b6380 2022-01-10T01:32:08.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e3e7fc700 1 -- 172.21.15.36:0/2089987978 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e4000cd60 con 0x7f7e480b6380 2022-01-10T01:32:08.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.747+0000 7f7e4e684700 1 -- 172.21.15.36:0/2089987978 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e481432b0 con 0x7f7e480b6380 2022-01-10T01:32:08.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.751+0000 7f7e4e684700 1 -- 172.21.15.36:0/2089987978 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e48143470 con 0x7f7e480b6380 2022-01-10T01:32:08.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.751+0000 7f7e3e7fc700 1 -- 172.21.15.36:0/2089987978 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7e40022070 con 0x7f7e480b6380 2022-01-10T01:32:08.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.751+0000 7f7e3e7fc700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7e300535f0 0x7f7e30055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:08.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.751+0000 7f7e3e7fc700 1 -- 172.21.15.36:0/2089987978 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7e4006c290 con 0x7f7e480b6380 2022-01-10T01:32:08.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.751+0000 7f7e4d682700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7e300535f0 0x7f7e30055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:08.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.751+0000 7f7e4d682700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7e300535f0 0x7f7e30055ab0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f7e3801a000 tx=0x7f7e38014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:08.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.755+0000 7f7e3e7fc700 1 -- 172.21.15.36:0/2089987978 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7e400432a0 con 0x7f7e480b6380 2022-01-10T01:32:08.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.883+0000 7f7e4e684700 1 -- 172.21.15.36:0/2089987978 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e48146890 con 0x7f7e480b6380 2022-01-10T01:32:08.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.887+0000 7f7e3e7fc700 1 -- 172.21.15.36:0/2089987978 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f7e40016020 con 0x7f7e480b6380 2022-01-10T01:32:08.891 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:08.891 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":110,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:32:06.655202+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:32:04.130397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2022-01-10T01:32:05.331515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:32:08.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.887+0000 7f7e4e684700 1 -- 172.21.15.36:0/2089987978 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7e300535f0 msgr2=0x7f7e30055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:08.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.887+0000 7f7e4e684700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7e300535f0 0x7f7e30055ab0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f7e3801a000 tx=0x7f7e38014000).stop 2022-01-10T01:32:08.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.887+0000 7f7e4e684700 1 -- 172.21.15.36:0/2089987978 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7e480b6380 msgr2=0x7f7e48152130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:08.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.887+0000 7f7e4e684700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7e480b6380 0x7f7e48152130 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7f7e48060ec0 tx=0x7f7e40009290).stop 2022-01-10T01:32:08.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.887+0000 7f7e4e684700 1 -- 172.21.15.36:0/2089987978 shutdown_connections 2022-01-10T01:32:08.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.887+0000 7f7e4e684700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7e300535f0 0x7f7e30055ab0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.887+0000 7f7e4e684700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7e480b6380 0x7f7e48152130 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.887+0000 7f7e4e684700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e480b2910 0x7f7e48143750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.887+0000 7f7e4e684700 1 --2- 172.21.15.36:0/2089987978 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e480612f0 0x7f7e4813f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:08.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.887+0000 7f7e4e684700 1 -- 172.21.15.36:0/2089987978 >> 172.21.15.36:0/2089987978 conn(0x7f7e48063670 msgr2=0x7f7e48148820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:08.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.887+0000 7f7e4e684700 1 -- 172.21.15.36:0/2089987978 shutdown_connections 2022-01-10T01:32:08.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:08.887+0000 7f7e4e684700 1 -- 172.21.15.36:0/2089987978 wait complete. 2022-01-10T01:32:08.905 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:32:04.130397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:32:05.331515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:32:08.906 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:32:09.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.011+0000 7f41c720f700 1 Processor -- start 2022-01-10T01:32:09.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.011+0000 7f41c720f700 1 -- start start 2022-01-10T01:32:09.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c720f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f41c00a9c10 0x7f41c00607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c720f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41c0140140 0x7f41c0140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c720f700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c0066ea0 con 0x7f41c00b3040 2022-01-10T01:32:09.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c720f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c00648e0 con 0x7f41c00a9c10 2022-01-10T01:32:09.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c720f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c0061dd0 con 0x7f41c0140140 2022-01-10T01:32:09.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c5a0c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f41c00a9c10 0x7f41c00607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c620d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f41c00b3040 0x7f41c0065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:37994/0 (socket says 172.21.15.36:37994) 2022-01-10T01:32:09.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c5a0c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f41c00a9c10 0x7f41c00607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40202/0 (socket says 172.21.15.36:40202) 2022-01-10T01:32:09.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c620d700 1 -- 172.21.15.36:0/3828050417 learned_addr learned my addr 172.21.15.36:0/3828050417 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:09.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c6a0e700 1 --2- 172.21.15.36:0/3828050417 >> v2:172.21.15.59:3300/0 conn(0x7f41c0140140 0x7f41c0140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c5a0c700 1 -- 172.21.15.36:0/3828050417 >> v2:172.21.15.59:3300/0 conn(0x7f41c0140140 msgr2=0x7f41c0140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:09.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c5a0c700 1 --2- 172.21.15.36:0/3828050417 >> v2:172.21.15.59:3300/0 conn(0x7f41c0140140 0x7f41c0140590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c5a0c700 1 -- 172.21.15.36:0/3828050417 >> v1:172.21.15.36:6789/0 conn(0x7f41c00b3040 legacy=0x7f41c0065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c5a0c700 1 -- 172.21.15.36:0/3828050417 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c00b3420 con 0x7f41c00a9c10 2022-01-10T01:32:09.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c520b700 1 -- 172.21.15.36:0/3828050417 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958472562 0 0) 0x7f41c0066ea0 con 0x7f41c00b3040 2022-01-10T01:32:09.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c5a0c700 1 --2- 172.21.15.36:0/3828050417 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41c00a9c10 0x7f41c00607c0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f41b4002f70 tx=0x7f41b4006df0).ready entity=mon.0 client_cookie=11ee3d33982f5f6e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:09.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c520b700 1 -- 172.21.15.36:0/3828050417 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41b400d570 con 0x7f41c00a9c10 2022-01-10T01:32:09.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c520b700 1 -- 172.21.15.36:0/3828050417 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b4000e90 con 0x7f41c00a9c10 2022-01-10T01:32:09.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c520b700 1 -- 172.21.15.36:0/3828050417 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41b400d8c0 con 0x7f41c00a9c10 2022-01-10T01:32:09.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c720f700 1 -- 172.21.15.36:0/3828050417 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41c00a9c10 msgr2=0x7f41c00607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c720f700 1 --2- 172.21.15.36:0/3828050417 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41c00a9c10 0x7f41c00607c0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f41b4002f70 tx=0x7f41b4006df0).stop 2022-01-10T01:32:09.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c720f700 1 -- 172.21.15.36:0/3828050417 shutdown_connections 2022-01-10T01:32:09.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c720f700 1 --2- 172.21.15.36:0/3828050417 >> v2:172.21.15.59:3300/0 conn(0x7f41c0140140 0x7f41c0140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c720f700 1 --2- 172.21.15.36:0/3828050417 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41c00a9c10 0x7f41c00607c0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c720f700 1 -- 172.21.15.36:0/3828050417 >> 172.21.15.36:0/3828050417 conn(0x7f41c00636e0 msgr2=0x7f41c0063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:09.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c720f700 1 -- 172.21.15.36:0/3828050417 shutdown_connections 2022-01-10T01:32:09.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.015+0000 7f41c720f700 1 -- 172.21.15.36:0/3828050417 wait complete. 2022-01-10T01:32:09.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.019+0000 7f41c720f700 1 Processor -- start 2022-01-10T01:32:09.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.019+0000 7f41c720f700 1 -- start start 2022-01-10T01:32:09.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c720f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c00a9c10 0x7f41c0145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c720f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41c00b3040 0x7f41c0152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c720f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41c0140140 0x7f41c0152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c720f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c00b0700 con 0x7f41c0140140 2022-01-10T01:32:09.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c720f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c00a97c0 con 0x7f41c00a9c10 2022-01-10T01:32:09.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c720f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c00b0460 con 0x7f41c00b3040 2022-01-10T01:32:09.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c6a0e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41c0140140 0x7f41c0152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c6a0e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41c0140140 0x7f41c0152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40210/0 (socket says 172.21.15.36:40210) 2022-01-10T01:32:09.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c6a0e700 1 -- 172.21.15.36:0/747504330 learned_addr learned my addr 172.21.15.36:0/747504330 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:09.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c5a0c700 1 --2- 172.21.15.36:0/747504330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41c00b3040 0x7f41c0152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c620d700 1 --2- 172.21.15.36:0/747504330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c00a9c10 0x7f41c0145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c6a0e700 1 -- 172.21.15.36:0/747504330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41c00b3040 msgr2=0x7f41c0152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c6a0e700 1 --2- 172.21.15.36:0/747504330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41c00b3040 0x7f41c0152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c6a0e700 1 -- 172.21.15.36:0/747504330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c00a9c10 msgr2=0x7f41c0145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c6a0e700 1 --2- 172.21.15.36:0/747504330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c00a9c10 0x7f41c0145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c6a0e700 1 -- 172.21.15.36:0/747504330 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b400b180 con 0x7f41c0140140 2022-01-10T01:32:09.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c6a0e700 1 --2- 172.21.15.36:0/747504330 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41c0140140 0x7f41c0152770 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f41b8006e00 tx=0x7f41b80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:09.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41bf7fe700 1 -- 172.21.15.36:0/747504330 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41b8011980 con 0x7f41c0140140 2022-01-10T01:32:09.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41bf7fe700 1 -- 172.21.15.36:0/747504330 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b8011ae0 con 0x7f41c0140140 2022-01-10T01:32:09.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c720f700 1 -- 172.21.15.36:0/747504330 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c00ac9a0 con 0x7f41c0140140 2022-01-10T01:32:09.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41bf7fe700 1 -- 172.21.15.36:0/747504330 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41b8011e40 con 0x7f41c0140140 2022-01-10T01:32:09.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c720f700 1 -- 172.21.15.36:0/747504330 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c00b0150 con 0x7f41c0140140 2022-01-10T01:32:09.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41c720f700 1 -- 172.21.15.36:0/747504330 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c0066960 con 0x7f41c0140140 2022-01-10T01:32:09.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.023+0000 7f41bf7fe700 1 -- 172.21.15.36:0/747504330 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f41b801a470 con 0x7f41c0140140 2022-01-10T01:32:09.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.027+0000 7f41bf7fe700 1 --2- 172.21.15.36:0/747504330 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41a00535f0 0x7f41a0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.027+0000 7f41bf7fe700 1 -- 172.21.15.36:0/747504330 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f41b806e0f0 con 0x7f41c0140140 2022-01-10T01:32:09.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.027+0000 7f41c620d700 1 --2- 172.21.15.36:0/747504330 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41a00535f0 0x7f41a0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.027+0000 7f41c620d700 1 --2- 172.21.15.36:0/747504330 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41a00535f0 0x7f41a0055ab0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f41b000d000 tx=0x7f41b0007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:09.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.035+0000 7f41bf7fe700 1 -- 172.21.15.36:0/747504330 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f41b8045000 con 0x7f41c0140140 2022-01-10T01:32:09.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.159+0000 7f41c720f700 1 -- 172.21.15.36:0/747504330 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f41c0057350 con 0x7f41c0140140 2022-01-10T01:32:09.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.159+0000 7f41bf7fe700 1 -- 172.21.15.36:0/747504330 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v110) v1 ==== 110+0+10 (secure 0 0 0) 0x7f41b8048620 con 0x7f41c0140140 2022-01-10T01:32:09.163 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:32:09.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.163+0000 7f41c720f700 1 -- 172.21.15.36:0/747504330 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41a00535f0 msgr2=0x7f41a0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.163+0000 7f41c720f700 1 --2- 172.21.15.36:0/747504330 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41a00535f0 0x7f41a0055ab0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f41b000d000 tx=0x7f41b0007a00).stop 2022-01-10T01:32:09.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.163+0000 7f41c720f700 1 -- 172.21.15.36:0/747504330 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41c0140140 msgr2=0x7f41c0152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.163+0000 7f41c720f700 1 --2- 172.21.15.36:0/747504330 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41c0140140 0x7f41c0152770 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f41b8006e00 tx=0x7f41b80091d0).stop 2022-01-10T01:32:09.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.163+0000 7f41c720f700 1 -- 172.21.15.36:0/747504330 shutdown_connections 2022-01-10T01:32:09.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.163+0000 7f41c720f700 1 --2- 172.21.15.36:0/747504330 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41a00535f0 0x7f41a0055ab0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.163+0000 7f41c720f700 1 --2- 172.21.15.36:0/747504330 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41c0140140 0x7f41c0152770 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.163+0000 7f41c720f700 1 --2- 172.21.15.36:0/747504330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41c00b3040 0x7f41c0152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.163+0000 7f41c720f700 1 --2- 172.21.15.36:0/747504330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c00a9c10 0x7f41c0145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.163+0000 7f41c720f700 1 -- 172.21.15.36:0/747504330 >> 172.21.15.36:0/747504330 conn(0x7f41c00636e0 msgr2=0x7f41c0143160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:09.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.163+0000 7f41c720f700 1 -- 172.21.15.36:0/747504330 shutdown_connections 2022-01-10T01:32:09.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.163+0000 7f41c720f700 1 -- 172.21.15.36:0/747504330 wait complete. 2022-01-10T01:32:09.177 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:32:09.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8ef451700 1 Processor -- start 2022-01-10T01:32:09.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8ef451700 1 -- start start 2022-01-10T01:32:09.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8ef451700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe8e805fc00 0x7fe8e80b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8ef451700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8e80b5990 0x7fe8e80b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8ef451700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e8143f60 con 0x7fe8e80b6560 2022-01-10T01:32:09.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8ef451700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e80ba6b0 con 0x7fe8e805fc00 2022-01-10T01:32:09.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8ef451700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e805ffe0 con 0x7fe8e80b5990 2022-01-10T01:32:09.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8ed1ed700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe8e805fc00 0x7fe8e80b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8ed1ed700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe8e805fc00 0x7fe8e80b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40214/0 (socket says 172.21.15.36:40214) 2022-01-10T01:32:09.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8ed1ed700 1 -- 172.21.15.36:0/2333123687 learned_addr learned my addr 172.21.15.36:0/2333123687 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:09.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8ed9ee700 1 --2- 172.21.15.36:0/2333123687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8e80b5990 0x7fe8e80b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8dbfff700 1 -- 172.21.15.36:0/2333123687 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4175632864 0 0) 0x7fe8e8143f60 con 0x7fe8e80b6560 2022-01-10T01:32:09.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8ed1ed700 1 -- 172.21.15.36:0/2333123687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8e80b5990 msgr2=0x7fe8e80b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:09.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8ed1ed700 1 --2- 172.21.15.36:0/2333123687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8e80b5990 0x7fe8e80b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.283+0000 7fe8ed1ed700 1 -- 172.21.15.36:0/2333123687 >> v1:172.21.15.59:6789/0 conn(0x7fe8e80b6560 legacy=0x7fe8e80b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8ed1ed700 1 -- 172.21.15.36:0/2333123687 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e8143a50 con 0x7fe8e805fc00 2022-01-10T01:32:09.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8ed1ed700 1 --2- 172.21.15.36:0/2333123687 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8e805fc00 0x7fe8e80b41b0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fe8dc002f70 tx=0x7fe8dc006eb0).ready entity=mon.0 client_cookie=cdb8707cd8e3dea4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:09.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8dbfff700 1 -- 172.21.15.36:0/2333123687 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8dc00d570 con 0x7fe8e805fc00 2022-01-10T01:32:09.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8dbfff700 1 -- 172.21.15.36:0/2333123687 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc000e90 con 0x7fe8e805fc00 2022-01-10T01:32:09.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8dbfff700 1 -- 172.21.15.36:0/2333123687 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8dc00d8c0 con 0x7fe8e805fc00 2022-01-10T01:32:09.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8ef451700 1 -- 172.21.15.36:0/2333123687 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8e805fc00 msgr2=0x7fe8e80b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8ef451700 1 --2- 172.21.15.36:0/2333123687 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8e805fc00 0x7fe8e80b41b0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7fe8dc002f70 tx=0x7fe8dc006eb0).stop 2022-01-10T01:32:09.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8ef451700 1 -- 172.21.15.36:0/2333123687 shutdown_connections 2022-01-10T01:32:09.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8ef451700 1 --2- 172.21.15.36:0/2333123687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8e80b5990 0x7fe8e80b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8ef451700 1 --2- 172.21.15.36:0/2333123687 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8e805fc00 0x7fe8e80b41b0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8ef451700 1 -- 172.21.15.36:0/2333123687 >> 172.21.15.36:0/2333123687 conn(0x7fe8e80623a0 msgr2=0x7fe8e8066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:09.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8ef451700 1 -- 172.21.15.36:0/2333123687 shutdown_connections 2022-01-10T01:32:09.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8ef451700 1 -- 172.21.15.36:0/2333123687 wait complete. 2022-01-10T01:32:09.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8ef451700 1 Processor -- start 2022-01-10T01:32:09.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.287+0000 7fe8ef451700 1 -- start start 2022-01-10T01:32:09.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ef451700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e805fc00 0x7fe8e80b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ef451700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8e80b5990 0x7fe8e813f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ef451700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8e80b6560 0x7fe8e813fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ef451700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80ad930 con 0x7fe8e80b6560 2022-01-10T01:32:09.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ef451700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e813e660 con 0x7fe8e805fc00 2022-01-10T01:32:09.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ef451700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e813e900 con 0x7fe8e80b5990 2022-01-10T01:32:09.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ed9ee700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8e80b6560 0x7fe8e813fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ed9ee700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8e80b6560 0x7fe8e813fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40224/0 (socket says 172.21.15.36:40224) 2022-01-10T01:32:09.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ed9ee700 1 -- 172.21.15.36:0/4229861799 learned_addr learned my addr 172.21.15.36:0/4229861799 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:09.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ed1ed700 1 --2- 172.21.15.36:0/4229861799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e805fc00 0x7fe8e80b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ec9ec700 1 --2- 172.21.15.36:0/4229861799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8e80b5990 0x7fe8e813f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ed9ee700 1 -- 172.21.15.36:0/4229861799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8e80b5990 msgr2=0x7fe8e813f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ed9ee700 1 --2- 172.21.15.36:0/4229861799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8e80b5990 0x7fe8e813f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ed9ee700 1 -- 172.21.15.36:0/4229861799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e805fc00 msgr2=0x7fe8e80b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ed9ee700 1 --2- 172.21.15.36:0/4229861799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e805fc00 0x7fe8e80b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ed9ee700 1 -- 172.21.15.36:0/4229861799 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc00b1e0 con 0x7fe8e80b6560 2022-01-10T01:32:09.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ed9ee700 1 --2- 172.21.15.36:0/4229861799 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8e80b6560 0x7fe8e813fb10 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7fe8e0006e00 tx=0x7fe8e00091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:09.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8da7fc700 1 -- 172.21.15.36:0/4229861799 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8e000c640 con 0x7fe8e80b6560 2022-01-10T01:32:09.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8da7fc700 1 -- 172.21.15.36:0/4229861799 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e000c7a0 con 0x7fe8e80b6560 2022-01-10T01:32:09.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ef451700 1 -- 172.21.15.36:0/4229861799 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e813eba0 con 0x7fe8e80b6560 2022-01-10T01:32:09.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8da7fc700 1 -- 172.21.15.36:0/4229861799 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8e000cb00 con 0x7fe8e80b6560 2022-01-10T01:32:09.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ef451700 1 -- 172.21.15.36:0/4229861799 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e80afb50 con 0x7fe8e80b6560 2022-01-10T01:32:09.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.291+0000 7fe8ef451700 1 -- 172.21.15.36:0/4229861799 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e8143cc0 con 0x7fe8e80b6560 2022-01-10T01:32:09.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.295+0000 7fe8da7fc700 1 -- 172.21.15.36:0/4229861799 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe8e0022070 con 0x7fe8e80b6560 2022-01-10T01:32:09.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.295+0000 7fe8da7fc700 1 --2- 172.21.15.36:0/4229861799 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe8d0053620 0x7fe8d0055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.295+0000 7fe8da7fc700 1 -- 172.21.15.36:0/4229861799 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe8e006c0c0 con 0x7fe8e80b6560 2022-01-10T01:32:09.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.295+0000 7fe8ed1ed700 1 --2- 172.21.15.36:0/4229861799 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe8d0053620 0x7fe8d0055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.295+0000 7fe8ed1ed700 1 --2- 172.21.15.36:0/4229861799 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe8d0053620 0x7fe8d0055ae0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fe8dc01c000 tx=0x7fe8dc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:09.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.299+0000 7fe8da7fc700 1 -- 172.21.15.36:0/4229861799 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe8e00430d0 con 0x7fe8e80b6560 2022-01-10T01:32:09.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.423+0000 7fe8ef451700 1 -- 172.21.15.36:0/4229861799 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe8e8057350 con 0x7fe8e80b6560 2022-01-10T01:32:09.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.423+0000 7fe8da7fc700 1 -- 172.21.15.36:0/4229861799 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe8e00466f0 con 0x7fe8e80b6560 2022-01-10T01:32:09.429 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:32:09.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.427+0000 7fe8ef451700 1 -- 172.21.15.36:0/4229861799 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe8d0053620 msgr2=0x7fe8d0055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.427+0000 7fe8ef451700 1 --2- 172.21.15.36:0/4229861799 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe8d0053620 0x7fe8d0055ae0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fe8dc01c000 tx=0x7fe8dc015000).stop 2022-01-10T01:32:09.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.427+0000 7fe8ef451700 1 -- 172.21.15.36:0/4229861799 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8e80b6560 msgr2=0x7fe8e813fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.427+0000 7fe8ef451700 1 --2- 172.21.15.36:0/4229861799 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8e80b6560 0x7fe8e813fb10 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7fe8e0006e00 tx=0x7fe8e00091d0).stop 2022-01-10T01:32:09.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.427+0000 7fe8ef451700 1 -- 172.21.15.36:0/4229861799 shutdown_connections 2022-01-10T01:32:09.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.427+0000 7fe8ef451700 1 --2- 172.21.15.36:0/4229861799 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe8d0053620 0x7fe8d0055ae0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.427+0000 7fe8ef451700 1 --2- 172.21.15.36:0/4229861799 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe8e80b6560 0x7fe8e813fb10 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.427+0000 7fe8ef451700 1 --2- 172.21.15.36:0/4229861799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8e80b5990 0x7fe8e813f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.427+0000 7fe8ef451700 1 --2- 172.21.15.36:0/4229861799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e805fc00 0x7fe8e80b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.427+0000 7fe8ef451700 1 -- 172.21.15.36:0/4229861799 >> 172.21.15.36:0/4229861799 conn(0x7fe8e80623a0 msgr2=0x7fe8e8142870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:09.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.427+0000 7fe8ef451700 1 -- 172.21.15.36:0/4229861799 shutdown_connections 2022-01-10T01:32:09.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.427+0000 7fe8ef451700 1 -- 172.21.15.36:0/4229861799 wait complete. 2022-01-10T01:32:09.442 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:32:09.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f617cc1d700 1 Processor -- start 2022-01-10T01:32:09.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f617cc1d700 1 -- start start 2022-01-10T01:32:09.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f617cc1d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61780b4060 0x7f6178061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f617cc1d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6178142e60 0x7f6178143310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f617cc1d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61780b5f50 con 0x7f61780b6290 2022-01-10T01:32:09.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f617cc1d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61780b1f70 con 0x7f61780b4060 2022-01-10T01:32:09.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f617cc1d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61780b2210 con 0x7f6178142e60 2022-01-10T01:32:09.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f6176ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61780b4060 0x7f6178061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f61777fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f61780b6290 0x7f6178061470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:55698/0 (socket says 172.21.15.36:55698) 2022-01-10T01:32:09.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f61777fe700 1 -- 172.21.15.36:0/2047743360 learned_addr learned my addr 172.21.15.36:0/2047743360 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:09.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f6177fff700 1 --2- 172.21.15.36:0/2047743360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6178142e60 0x7f6178143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f6176ffd700 1 -- 172.21.15.36:0/2047743360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6178142e60 msgr2=0x7f6178143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:09.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f6176ffd700 1 --2- 172.21.15.36:0/2047743360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6178142e60 0x7f6178143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f6176ffd700 1 -- 172.21.15.36:0/2047743360 >> v1:172.21.15.59:6789/0 conn(0x7f61780b6290 legacy=0x7f6178061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f61767fc700 1 -- 172.21.15.36:0/2047743360 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117943135 0 0) 0x7f6168001110 con 0x7f61780b6290 2022-01-10T01:32:09.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f6176ffd700 1 -- 172.21.15.36:0/2047743360 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61780b24b0 con 0x7f61780b4060 2022-01-10T01:32:09.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f6177fff700 1 --2- 172.21.15.36:0/2047743360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6178142e60 0x7f6178143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:09.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f6176ffd700 1 --2- 172.21.15.36:0/2047743360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61780b4060 0x7f6178061b80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f616c002f70 tx=0x7f616c006df0).ready entity=mon.1 client_cookie=acd8e9aff64b5b5d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:09.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f61767fc700 1 -- 172.21.15.36:0/2047743360 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f616c00d570 con 0x7f61780b4060 2022-01-10T01:32:09.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f61767fc700 1 -- 172.21.15.36:0/2047743360 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616c000e90 con 0x7f61780b4060 2022-01-10T01:32:09.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.551+0000 7f61767fc700 1 -- 172.21.15.36:0/2047743360 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f616c00d8c0 con 0x7f61780b4060 2022-01-10T01:32:09.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 -- 172.21.15.36:0/2047743360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61780b4060 msgr2=0x7f6178061b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 --2- 172.21.15.36:0/2047743360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61780b4060 0x7f6178061b80 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f616c002f70 tx=0x7f616c006df0).stop 2022-01-10T01:32:09.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 -- 172.21.15.36:0/2047743360 shutdown_connections 2022-01-10T01:32:09.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 --2- 172.21.15.36:0/2047743360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6178142e60 0x7f6178143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 --2- 172.21.15.36:0/2047743360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61780b4060 0x7f6178061b80 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 -- 172.21.15.36:0/2047743360 >> 172.21.15.36:0/2047743360 conn(0x7f617805c490 msgr2=0x7f617805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:09.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 -- 172.21.15.36:0/2047743360 shutdown_connections 2022-01-10T01:32:09.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 -- 172.21.15.36:0/2047743360 wait complete. 2022-01-10T01:32:09.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 Processor -- start 2022-01-10T01:32:09.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 -- start start 2022-01-10T01:32:09.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61780b4060 0x7f61780b9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61780b6290 0x7f617812ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6178142e60 0x7f617812b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617813f2a0 con 0x7f61780b4060 2022-01-10T01:32:09.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617813f970 con 0x7f6178142e60 2022-01-10T01:32:09.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f617cc1d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617813fbb0 con 0x7f61780b6290 2022-01-10T01:32:09.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f61777fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61780b4060 0x7f61780b9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f61777fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61780b4060 0x7f61780b9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40234/0 (socket says 172.21.15.36:40234) 2022-01-10T01:32:09.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f61777fe700 1 -- 172.21.15.36:0/4281827655 learned_addr learned my addr 172.21.15.36:0/4281827655 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:09.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f6177fff700 1 --2- 172.21.15.36:0/4281827655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6178142e60 0x7f617812b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.555+0000 7f6176ffd700 1 --2- 172.21.15.36:0/4281827655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61780b6290 0x7f617812ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.559+0000 7f61777fe700 1 -- 172.21.15.36:0/4281827655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61780b6290 msgr2=0x7f617812ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.559+0000 7f61777fe700 1 --2- 172.21.15.36:0/4281827655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61780b6290 0x7f617812ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.559+0000 7f61777fe700 1 -- 172.21.15.36:0/4281827655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6178142e60 msgr2=0x7f617812b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.559+0000 7f61777fe700 1 --2- 172.21.15.36:0/4281827655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6178142e60 0x7f617812b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.559+0000 7f61777fe700 1 -- 172.21.15.36:0/4281827655 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170009470 con 0x7f61780b4060 2022-01-10T01:32:09.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.559+0000 7f61777fe700 1 --2- 172.21.15.36:0/4281827655 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61780b4060 0x7f61780b9de0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f6168000ed0 tx=0x7f6168007920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:09.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.559+0000 7f6174ff9700 1 -- 172.21.15.36:0/4281827655 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f616800ce40 con 0x7f61780b4060 2022-01-10T01:32:09.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.559+0000 7f6174ff9700 1 -- 172.21.15.36:0/4281827655 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61680072e0 con 0x7f61780b4060 2022-01-10T01:32:09.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.559+0000 7f617cc1d700 1 -- 172.21.15.36:0/4281827655 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c00b180 con 0x7f61780b4060 2022-01-10T01:32:09.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.559+0000 7f6174ff9700 1 -- 172.21.15.36:0/4281827655 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6168005800 con 0x7f61780b4060 2022-01-10T01:32:09.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.559+0000 7f617cc1d700 1 -- 172.21.15.36:0/4281827655 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61781400f0 con 0x7f61780b4060 2022-01-10T01:32:09.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.559+0000 7f617cc1d700 1 -- 172.21.15.36:0/4281827655 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61780b2750 con 0x7f61780b4060 2022-01-10T01:32:09.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.559+0000 7f6174ff9700 1 -- 172.21.15.36:0/4281827655 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f616801a060 con 0x7f61780b4060 2022-01-10T01:32:09.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.563+0000 7f6174ff9700 1 --2- 172.21.15.36:0/4281827655 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f61580535f0 0x7f6158055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.563+0000 7f6176ffd700 1 --2- 172.21.15.36:0/4281827655 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f61580535f0 0x7f6158055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.563+0000 7f6174ff9700 1 -- 172.21.15.36:0/4281827655 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f616806b090 con 0x7f61780b4060 2022-01-10T01:32:09.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.563+0000 7f6176ffd700 1 --2- 172.21.15.36:0/4281827655 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f61580535f0 0x7f6158055ab0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f616c01a000 tx=0x7f616c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:09.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.567+0000 7f6174ff9700 1 -- 172.21.15.36:0/4281827655 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f61680420a0 con 0x7f61780b4060 2022-01-10T01:32:09.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.695+0000 7f617cc1d700 1 -- 172.21.15.36:0/4281827655 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61780b5f50 con 0x7f61780b4060 2022-01-10T01:32:09.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.695+0000 7f6174ff9700 1 -- 172.21.15.36:0/4281827655 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+10 (secure 0 0 0) 0x7f61780b5f50 con 0x7f61780b4060 2022-01-10T01:32:09.699 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:32:09.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.695+0000 7f617cc1d700 1 -- 172.21.15.36:0/4281827655 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f61580535f0 msgr2=0x7f6158055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.695+0000 7f617cc1d700 1 --2- 172.21.15.36:0/4281827655 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f61580535f0 0x7f6158055ab0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f616c01a000 tx=0x7f616c014000).stop 2022-01-10T01:32:09.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.695+0000 7f617cc1d700 1 -- 172.21.15.36:0/4281827655 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61780b4060 msgr2=0x7f61780b9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.695+0000 7f617cc1d700 1 --2- 172.21.15.36:0/4281827655 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61780b4060 0x7f61780b9de0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f6168000ed0 tx=0x7f6168007920).stop 2022-01-10T01:32:09.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.695+0000 7f617cc1d700 1 -- 172.21.15.36:0/4281827655 shutdown_connections 2022-01-10T01:32:09.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.695+0000 7f617cc1d700 1 --2- 172.21.15.36:0/4281827655 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f61580535f0 0x7f6158055ab0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.695+0000 7f617cc1d700 1 --2- 172.21.15.36:0/4281827655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6178142e60 0x7f617812b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.695+0000 7f617cc1d700 1 --2- 172.21.15.36:0/4281827655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61780b6290 0x7f617812ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.695+0000 7f617cc1d700 1 --2- 172.21.15.36:0/4281827655 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61780b4060 0x7f61780b9de0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.695+0000 7f617cc1d700 1 -- 172.21.15.36:0/4281827655 >> 172.21.15.36:0/4281827655 conn(0x7f617805c490 msgr2=0x7f617812c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:09.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.699+0000 7f617cc1d700 1 -- 172.21.15.36:0/4281827655 shutdown_connections 2022-01-10T01:32:09.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.699+0000 7f617cc1d700 1 -- 172.21.15.36:0/4281827655 wait complete. 2022-01-10T01:32:09.712 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:32:09.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.819+0000 7f00889c3700 1 Processor -- start 2022-01-10T01:32:09.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.819+0000 7f00889c3700 1 -- start start 2022-01-10T01:32:09.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00889c3700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f00840b2720 0x7f008413e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00889c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0084141790 0x7f008413e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00889c3700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00840aaa90 con 0x7f00840b0ff0 2022-01-10T01:32:09.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00889c3700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0084141c20 con 0x7f00840b2720 2022-01-10T01:32:09.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00889c3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0084140c90 con 0x7f0084141790 2022-01-10T01:32:09.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f0082ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f00840b0ff0 0x7f0084141080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38036/0 (socket says 172.21.15.36:38036) 2022-01-10T01:32:09.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00837fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f00840b2720 0x7f008413e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f0082ffd700 1 -- 172.21.15.36:0/3320375015 learned_addr learned my addr 172.21.15.36:0/3320375015 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:09.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f0083fff700 1 --2- 172.21.15.36:0/3320375015 >> v2:172.21.15.59:3300/0 conn(0x7f0084141790 0x7f008413e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00827fc700 1 -- 172.21.15.36:0/3320375015 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232980457 0 0) 0x7f0074001490 con 0x7f00840b0ff0 2022-01-10T01:32:09.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00827fc700 1 -- 172.21.15.36:0/3320375015 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0070003260 con 0x7f00840b0ff0 2022-01-10T01:32:09.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00837fe700 1 -- 172.21.15.36:0/3320375015 >> v2:172.21.15.59:3300/0 conn(0x7f0084141790 msgr2=0x7f008413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:09.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00837fe700 1 --2- 172.21.15.36:0/3320375015 >> v2:172.21.15.59:3300/0 conn(0x7f0084141790 0x7f008413e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00837fe700 1 -- 172.21.15.36:0/3320375015 >> v1:172.21.15.36:6789/0 conn(0x7f00840b0ff0 legacy=0x7f0084141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00837fe700 1 -- 172.21.15.36:0/3320375015 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00840b2b00 con 0x7f00840b2720 2022-01-10T01:32:09.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f0083fff700 1 --2- 172.21.15.36:0/3320375015 >> v2:172.21.15.59:3300/0 conn(0x7f0084141790 0x7f008413e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:09.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00837fe700 1 --2- 172.21.15.36:0/3320375015 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00840b2720 0x7f008413e030 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f0078002f70 tx=0x7f0078006df0).ready entity=mon.0 client_cookie=f5459bc604d926f5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:09.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00827fc700 1 -- 172.21.15.36:0/3320375015 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007800d4f0 con 0x7f00840b2720 2022-01-10T01:32:09.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00827fc700 1 -- 172.21.15.36:0/3320375015 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0078000e90 con 0x7f00840b2720 2022-01-10T01:32:09.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00827fc700 1 -- 172.21.15.36:0/3320375015 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007800d840 con 0x7f00840b2720 2022-01-10T01:32:09.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00889c3700 1 -- 172.21.15.36:0/3320375015 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00840b2720 msgr2=0x7f008413e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00889c3700 1 --2- 172.21.15.36:0/3320375015 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00840b2720 0x7f008413e030 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f0078002f70 tx=0x7f0078006df0).stop 2022-01-10T01:32:09.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00889c3700 1 -- 172.21.15.36:0/3320375015 shutdown_connections 2022-01-10T01:32:09.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00889c3700 1 --2- 172.21.15.36:0/3320375015 >> v2:172.21.15.59:3300/0 conn(0x7f0084141790 0x7f008413e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00889c3700 1 --2- 172.21.15.36:0/3320375015 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00840b2720 0x7f008413e030 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00889c3700 1 -- 172.21.15.36:0/3320375015 >> 172.21.15.36:0/3320375015 conn(0x7f0084060180 msgr2=0x7f00840b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:09.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00889c3700 1 -- 172.21.15.36:0/3320375015 shutdown_connections 2022-01-10T01:32:09.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.823+0000 7f00889c3700 1 -- 172.21.15.36:0/3320375015 wait complete. 2022-01-10T01:32:09.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f00889c3700 1 Processor -- start 2022-01-10T01:32:09.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f00889c3700 1 -- start start 2022-01-10T01:32:09.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f00889c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00840b0ff0 0x7f0084150080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f00889c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840b2720 0x7f0084153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f00889c3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0084141790 0x7f0084143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f00889c3700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084142a30 con 0x7f0084141790 2022-01-10T01:32:09.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f00889c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00841537d0 con 0x7f00840b2720 2022-01-10T01:32:09.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f00889c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0084153a70 con 0x7f00840b0ff0 2022-01-10T01:32:09.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f0083fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0084141790 0x7f0084143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f0083fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0084141790 0x7f0084143590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40252/0 (socket says 172.21.15.36:40252) 2022-01-10T01:32:09.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f0083fff700 1 -- 172.21.15.36:0/4139764645 learned_addr learned my addr 172.21.15.36:0/4139764645 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:09.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f0082ffd700 1 --2- 172.21.15.36:0/4139764645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840b2720 0x7f0084153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f00837fe700 1 --2- 172.21.15.36:0/4139764645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00840b0ff0 0x7f0084150080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f0083fff700 1 -- 172.21.15.36:0/4139764645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00840b0ff0 msgr2=0x7f0084150080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f0083fff700 1 --2- 172.21.15.36:0/4139764645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00840b0ff0 0x7f0084150080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f0083fff700 1 -- 172.21.15.36:0/4139764645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840b2720 msgr2=0x7f0084153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f0083fff700 1 --2- 172.21.15.36:0/4139764645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840b2720 0x7f0084153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f0083fff700 1 -- 172.21.15.36:0/4139764645 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c00b180 con 0x7f0084141790 2022-01-10T01:32:09.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f0083fff700 1 --2- 172.21.15.36:0/4139764645 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0084141790 0x7f0084143590 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f007c00c000 tx=0x7f007c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:09.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f0080ff9700 1 -- 172.21.15.36:0/4139764645 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007c010780 con 0x7f0084141790 2022-01-10T01:32:09.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f0080ff9700 1 -- 172.21.15.36:0/4139764645 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007c0108e0 con 0x7f0084141790 2022-01-10T01:32:09.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f00889c3700 1 -- 172.21.15.36:0/4139764645 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007800b180 con 0x7f0084141790 2022-01-10T01:32:09.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f0080ff9700 1 -- 172.21.15.36:0/4139764645 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f007c010c40 con 0x7f0084141790 2022-01-10T01:32:09.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.827+0000 7f00889c3700 1 -- 172.21.15.36:0/4139764645 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00840b4940 con 0x7f0084141790 2022-01-10T01:32:09.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.831+0000 7f00889c3700 1 -- 172.21.15.36:0/4139764645 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0084142c30 con 0x7f0084141790 2022-01-10T01:32:09.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.831+0000 7f0080ff9700 1 -- 172.21.15.36:0/4139764645 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f007c01c460 con 0x7f0084141790 2022-01-10T01:32:09.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.831+0000 7f0080ff9700 1 --2- 172.21.15.36:0/4139764645 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0064053560 0x7f0064055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:09.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.831+0000 7f0080ff9700 1 -- 172.21.15.36:0/4139764645 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f007c06bee0 con 0x7f0084141790 2022-01-10T01:32:09.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.831+0000 7f00837fe700 1 --2- 172.21.15.36:0/4139764645 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0064053560 0x7f0064055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:09.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.831+0000 7f00837fe700 1 --2- 172.21.15.36:0/4139764645 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0064053560 0x7f0064055a20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f007801a000 tx=0x7f0078014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:09.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.835+0000 7f0080ff9700 1 -- 172.21.15.36:0/4139764645 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f007c042e90 con 0x7f0084141790 2022-01-10T01:32:09.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.959+0000 7f00889c3700 1 -- 172.21.15.36:0/4139764645 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0084153c40 con 0x7f0084141790 2022-01-10T01:32:09.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.963+0000 7f0080ff9700 1 -- 172.21.15.36:0/4139764645 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+10 (secure 0 0 0) 0x7f007c0464b0 con 0x7f0084141790 2022-01-10T01:32:09.966 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:32:09.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.963+0000 7f00889c3700 1 -- 172.21.15.36:0/4139764645 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0064053560 msgr2=0x7f0064055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.963+0000 7f00889c3700 1 --2- 172.21.15.36:0/4139764645 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0064053560 0x7f0064055a20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f007801a000 tx=0x7f0078014000).stop 2022-01-10T01:32:09.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.963+0000 7f00889c3700 1 -- 172.21.15.36:0/4139764645 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0084141790 msgr2=0x7f0084143590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:09.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.963+0000 7f00889c3700 1 --2- 172.21.15.36:0/4139764645 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0084141790 0x7f0084143590 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f007c00c000 tx=0x7f007c006df0).stop 2022-01-10T01:32:09.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.963+0000 7f00889c3700 1 -- 172.21.15.36:0/4139764645 shutdown_connections 2022-01-10T01:32:09.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.963+0000 7f00889c3700 1 --2- 172.21.15.36:0/4139764645 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0064053560 0x7f0064055a20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.963+0000 7f00889c3700 1 --2- 172.21.15.36:0/4139764645 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0084141790 0x7f0084143590 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.963+0000 7f00889c3700 1 --2- 172.21.15.36:0/4139764645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840b2720 0x7f0084153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.963+0000 7f00889c3700 1 --2- 172.21.15.36:0/4139764645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00840b0ff0 0x7f0084150080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:09.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.963+0000 7f00889c3700 1 -- 172.21.15.36:0/4139764645 >> 172.21.15.36:0/4139764645 conn(0x7f0084060180 msgr2=0x7f00840b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:09.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.963+0000 7f00889c3700 1 -- 172.21.15.36:0/4139764645 shutdown_connections 2022-01-10T01:32:09.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:09.963+0000 7f00889c3700 1 -- 172.21.15.36:0/4139764645 wait complete. 2022-01-10T01:32:09.979 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:32:09.979 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:32:10.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.083+0000 7fa053469700 1 Processor -- start 2022-01-10T01:32:10.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.083+0000 7fa053469700 1 -- start start 2022-01-10T01:32:10.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.083+0000 7fa053469700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04c0b2580 0x7fa04c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:10.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.083+0000 7fa053469700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c0a70c0 con 0x7fa04c0b0010 2022-01-10T01:32:10.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.083+0000 7fa053469700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c0a72f0 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.083+0000 7fa053469700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c0a7590 con 0x7fa04c0b2580 2022-01-10T01:32:10.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.083+0000 7fa051c66700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa04c0b0010 0x7fa04c0a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38054/0 (socket says 172.21.15.36:38054) 2022-01-10T01:32:10.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.083+0000 7fa051c66700 1 -- 172.21.15.36:0/1858865385 learned_addr learned my addr 172.21.15.36:0/1858865385 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:10.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.083+0000 7fa052467700 1 --2- 172.21.15.36:0/1858865385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04c0b2580 0x7fa04c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:10.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa051465700 1 -- 172.21.15.36:0/1858865385 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815508059 0 0) 0x7fa04c0a72f0 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa051465700 1 -- 172.21.15.36:0/1858865385 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa038003260 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa051465700 1 -- 172.21.15.36:0/1858865385 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2904569028 0 0) 0x7fa04c0a70c0 con 0x7fa04c0b0010 2022-01-10T01:32:10.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa051465700 1 -- 172.21.15.36:0/1858865385 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa04c0a72f0 con 0x7fa04c0b0010 2022-01-10T01:32:10.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa052467700 1 -- 172.21.15.36:0/1858865385 >> v1:172.21.15.59:6789/0 conn(0x7fa04c0a8ac0 legacy=0x7fa04c151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:10.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa052467700 1 -- 172.21.15.36:0/1858865385 >> v1:172.21.15.36:6789/0 conn(0x7fa04c0b0010 legacy=0x7fa04c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:10.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa052467700 1 -- 172.21.15.36:0/1858865385 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c0a7830 con 0x7fa04c0b2580 2022-01-10T01:32:10.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa052467700 1 --2- 172.21.15.36:0/1858865385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04c0b2580 0x7fa04c14ae40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fa0440032f0 tx=0x7fa0440091d0).ready entity=mon.2 client_cookie=a6220ed5f3728376 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:10.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa051465700 1 -- 172.21.15.36:0/1858865385 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04400b640 con 0x7fa04c0b2580 2022-01-10T01:32:10.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa051465700 1 -- 172.21.15.36:0/1858865385 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04400b7a0 con 0x7fa04c0b2580 2022-01-10T01:32:10.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa051465700 1 -- 172.21.15.36:0/1858865385 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04400b910 con 0x7fa04c0b2580 2022-01-10T01:32:10.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 -- 172.21.15.36:0/1858865385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04c0b2580 msgr2=0x7fa04c14ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:10.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 --2- 172.21.15.36:0/1858865385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04c0b2580 0x7fa04c14ae40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fa0440032f0 tx=0x7fa0440091d0).stop 2022-01-10T01:32:10.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 -- 172.21.15.36:0/1858865385 shutdown_connections 2022-01-10T01:32:10.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 --2- 172.21.15.36:0/1858865385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04c0b2580 0x7fa04c14ae40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:10.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 -- 172.21.15.36:0/1858865385 >> 172.21.15.36:0/1858865385 conn(0x7fa04c060180 msgr2=0x7fa04c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:10.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 -- 172.21.15.36:0/1858865385 shutdown_connections 2022-01-10T01:32:10.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 -- 172.21.15.36:0/1858865385 wait complete. 2022-01-10T01:32:10.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 Processor -- start 2022-01-10T01:32:10.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 -- start start 2022-01-10T01:32:10.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa04c0a8ac0 0x7fa04c067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:10.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04c0b0010 0x7fa04c141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:10.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04c0b2580 0x7fa04c141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:10.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c14d4a0 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c14ca40 con 0x7fa04c0b0010 2022-01-10T01:32:10.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.087+0000 7fa053469700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c14c6a0 con 0x7fa04c0b2580 2022-01-10T01:32:10.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa052467700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa04c0a8ac0 0x7fa04c067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:10.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa052467700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa04c0a8ac0 0x7fa04c067780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40262/0 (socket says 172.21.15.36:40262) 2022-01-10T01:32:10.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa052467700 1 -- 172.21.15.36:0/3631298036 learned_addr learned my addr 172.21.15.36:0/3631298036 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:10.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa052c68700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04c0b2580 0x7fa04c141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:10.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa051c66700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04c0b0010 0x7fa04c141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:10.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa052467700 1 -- 172.21.15.36:0/3631298036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04c0b2580 msgr2=0x7fa04c141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:10.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa052467700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04c0b2580 0x7fa04c141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:10.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa052467700 1 -- 172.21.15.36:0/3631298036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04c0b0010 msgr2=0x7fa04c141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:10.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa052467700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04c0b0010 0x7fa04c141450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:10.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa052467700 1 -- 172.21.15.36:0/3631298036 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa044009470 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa051c66700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04c0b0010 0x7fa04c141450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:10.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa052467700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa04c0a8ac0 0x7fa04c067780 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7fa04c14c970 tx=0x7fa044016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:10.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa04b7fe700 1 -- 172.21.15.36:0/3631298036 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04400b910 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa04b7fe700 1 -- 172.21.15.36:0/3631298036 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04401f3f0 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa053469700 1 -- 172.21.15.36:0/3631298036 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04c14cc70 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa04b7fe700 1 -- 172.21.15.36:0/3631298036 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa04400b640 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa053469700 1 -- 172.21.15.36:0/3631298036 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04c0aeed0 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa053469700 1 -- 172.21.15.36:0/3631298036 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c057350 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.091+0000 7fa04b7fe700 1 -- 172.21.15.36:0/3631298036 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa04400f070 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.095+0000 7fa04b7fe700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa02c053620 0x7fa02c055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:10.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.095+0000 7fa04b7fe700 1 -- 172.21.15.36:0/3631298036 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa04406c4d0 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.095+0000 7fa051c66700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa02c053620 0x7fa02c055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:10.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.095+0000 7fa051c66700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa02c053620 0x7fa02c055ae0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fa04000b000 tx=0x7fa040009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:10.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.103+0000 7fa04b7fe700 1 -- 172.21.15.36:0/3631298036 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa0440434e0 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.271+0000 7fa053469700 1 -- 172.21.15.36:0/3631298036 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa04c0698e0 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.271+0000 7fa04b7fe700 1 -- 172.21.15.36:0/3631298036 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2484 (secure 0 0 0) 0x7fa044015090 con 0x7fa04c0a8ac0 2022-01-10T01:32:10.274 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:10.274 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6836/13281616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":13281616},{"type":"v1","addr":"172.21.15.36:6836","nonce":13281616}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/2168511464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":2168511464},{"type":"v1","addr":"172.21.15.36:6837","nonce":2168511464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:32:05.646058+0000","modified":"2022-01-10T01:32:06.654528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7264":{"gid":7264,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/696360653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":696360653},{"type":"v1","addr":"172.21.15.59:6833","nonce":696360653}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2022-01-10T01:32:10.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.271+0000 7fa053469700 1 -- 172.21.15.36:0/3631298036 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa02c053620 msgr2=0x7fa02c055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:10.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.271+0000 7fa053469700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa02c053620 0x7fa02c055ae0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fa04000b000 tx=0x7fa040009040).stop 2022-01-10T01:32:10.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.271+0000 7fa053469700 1 -- 172.21.15.36:0/3631298036 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa04c0a8ac0 msgr2=0x7fa04c067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:10.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.271+0000 7fa053469700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa04c0a8ac0 0x7fa04c067780 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7fa04c14c970 tx=0x7fa044016000).stop 2022-01-10T01:32:10.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.271+0000 7fa053469700 1 -- 172.21.15.36:0/3631298036 shutdown_connections 2022-01-10T01:32:10.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.271+0000 7fa053469700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa02c053620 0x7fa02c055ae0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:10.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.271+0000 7fa053469700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa04c0b2580 0x7fa04c141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:10.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.271+0000 7fa053469700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa04c0b0010 0x7fa04c141450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:10.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.271+0000 7fa053469700 1 --2- 172.21.15.36:0/3631298036 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa04c0a8ac0 0x7fa04c067780 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:10.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.271+0000 7fa053469700 1 -- 172.21.15.36:0/3631298036 >> 172.21.15.36:0/3631298036 conn(0x7fa04c060180 msgr2=0x7fa04c1486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:10.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.271+0000 7fa053469700 1 -- 172.21.15.36:0/3631298036 shutdown_connections 2022-01-10T01:32:10.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:10.271+0000 7fa053469700 1 -- 172.21.15.36:0/3631298036 wait complete. 2022-01-10T01:32:10.279 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 51 2022-01-10T01:32:10.589 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:32:05.646058+0000', 'modified': '2022-01-10T01:32:06.654528+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7264': {'gid': 7264, 'name': 'b', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/696360653', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 696360653}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 696360653}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:32:10.590 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:32:10.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:32:10.707 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":7264,"want_state":"up:active","state":"up:active","rank_uptime":5.041867291,"mdsmap_epoch":51,"osdmap_epoch":110,"osdmap_epoch_barrier":109,"uptime":9.3955266460000004} 2022-01-10T01:32:10.708 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 7264, "mdsmap_epoch": 51, "osdmap_epoch": 110, "osdmap_epoch_barrier": 109, "rank_uptime": 5.041867291, "state": "up:active", "uptime": 9.395526646, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:32:10.708 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:32:10.709 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:32:10.709 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:32:10.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:10.710 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:10.719 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:32:10.777 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:32:10.777 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:32:10.787 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:32:10.788 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:32:10.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:10.790 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:32:10.795 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:32:10.796 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:10.798 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:32:10.817 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:32:10.817 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:32:10.876 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:32:10.877 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14964]: starting ceph client 2022-01-10T01:32:10.878 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:32:10.877+0000 7f5c07211080 -1 init, newargv = 0x5602eb47e390 newargc=9 2022-01-10T01:32:10.878 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:32:10.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:10.879 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:32:10.888 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14964]: starting fuse 2022-01-10T01:32:11.988 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:32:12.007 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:32:12.008 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:32:12.062 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:32:12.063 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:32:12.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:12.065 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:32:12.070 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:32:12.071 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:32:12.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:12.072 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:32:12.072 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:32:12.072 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:32:12.073 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:32:12.073 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:32:12.074 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:32:12.074 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:32:12.074 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:32:12.075 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:32:12.075 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:32:12.076 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:32:12.076 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:32:12.076 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:32:12.077 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:32:12.077 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:32:12.078 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:32:12.078 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:32:12.078 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:32:12.079 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:32:12.079 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:32:12.080 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:32:12.080 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:32:12.080 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:32:12.158 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.14964.asok 2022-01-10T01:32:12.163 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14964.asok 2022-01-10T01:32:12.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:12.164 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14964.asok status 2022-01-10T01:32:12.250 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:32:12.251 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:32:12.251 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:32:12.252 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:32:12.252 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:32:12.252 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:32:12.252 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:32:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "14964", 2022-01-10T01:32:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:32:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:32:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:32:12.253 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:32:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 7429, 2022-01-10T01:32:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:32:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:32:12.254 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:32:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 7429 2022-01-10T01:32:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:32:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:32:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:32:12.255 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:32:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2501561641 2022-01-10T01:32:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:32:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:32:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:32:12.256 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:32:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:32:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 2501561641 2022-01-10T01:32:12.257 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:32:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.7429 172.21.15.139:0/2501561641", 2022-01-10T01:32:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/2501561641", 2022-01-10T01:32:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:32:12.258 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 51, 2022-01-10T01:32:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 110, 2022-01-10T01:32:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:32:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:32:12.259 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:32:12.259 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:32:12.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:12.261 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:12.262 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:12.269 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:32:12.270 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:32:12.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:12.271 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:12.331 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:32:12.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ee91e700 1 Processor -- start 2022-01-10T01:32:12.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ee91e700 1 -- start start 2022-01-10T01:32:12.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ee91e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f24e8060100 0x7f24e80b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:12.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ee91e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24e80b4c40 0x7f24e814b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:12.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ee91e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e80aabb0 con 0x7f24e8067300 2022-01-10T01:32:12.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ee91e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e80604e0 con 0x7f24e8060100 2022-01-10T01:32:12.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ee91e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e8066ea0 con 0x7f24e80b4c40 2022-01-10T01:32:12.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24e7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f24e8060100 0x7f24e80b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:12.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24e7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f24e8060100 0x7f24e80b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40272/0 (socket says 172.21.15.36:40272) 2022-01-10T01:32:12.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24e7fff700 1 -- 172.21.15.36:0/1060759954 learned_addr learned my addr 172.21.15.36:0/1060759954 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:12.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ecebb700 1 --2- 172.21.15.36:0/1060759954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24e80b4c40 0x7f24e814b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:12.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24e6ffd700 1 -- 172.21.15.36:0/1060759954 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969517690 0 0) 0x7f24e80aabb0 con 0x7f24e8067300 2022-01-10T01:32:12.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24e6ffd700 1 -- 172.21.15.36:0/1060759954 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24cc003260 con 0x7f24e8067300 2022-01-10T01:32:12.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ecebb700 1 -- 172.21.15.36:0/1060759954 >> v2:172.21.15.36:3300/0 conn(0x7f24e8060100 msgr2=0x7f24e80b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:12.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ecebb700 1 --2- 172.21.15.36:0/1060759954 >> v2:172.21.15.36:3300/0 conn(0x7f24e8060100 0x7f24e80b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ecebb700 1 -- 172.21.15.36:0/1060759954 >> v1:172.21.15.59:6789/0 conn(0x7f24e8067300 legacy=0x7f24e81438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:12.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ecebb700 1 -- 172.21.15.36:0/1060759954 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e80b33b0 con 0x7f24e80b4c40 2022-01-10T01:32:12.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24e7fff700 1 --2- 172.21.15.36:0/1060759954 >> v2:172.21.15.36:3300/0 conn(0x7f24e8060100 0x7f24e80b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:12.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ecebb700 1 --2- 172.21.15.36:0/1060759954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24e80b4c40 0x7f24e814b850 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f24e0002f70 tx=0x7f24e0006df0).ready entity=mon.2 client_cookie=9f5dfda329f86ac7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:12.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24e6ffd700 1 -- 172.21.15.36:0/1060759954 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24e000d4a0 con 0x7f24e80b4c40 2022-01-10T01:32:12.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24e6ffd700 1 -- 172.21.15.36:0/1060759954 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e0000e90 con 0x7f24e80b4c40 2022-01-10T01:32:12.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24e6ffd700 1 -- 172.21.15.36:0/1060759954 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24e000d7f0 con 0x7f24e80b4c40 2022-01-10T01:32:12.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ee91e700 1 -- 172.21.15.36:0/1060759954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24e80b4c40 msgr2=0x7f24e814b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:12.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.443+0000 7f24ee91e700 1 --2- 172.21.15.36:0/1060759954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24e80b4c40 0x7f24e814b850 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f24e0002f70 tx=0x7f24e0006df0).stop 2022-01-10T01:32:12.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.447+0000 7f24ee91e700 1 -- 172.21.15.36:0/1060759954 shutdown_connections 2022-01-10T01:32:12.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.447+0000 7f24ee91e700 1 --2- 172.21.15.36:0/1060759954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24e80b4c40 0x7f24e814b850 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.447+0000 7f24ee91e700 1 --2- 172.21.15.36:0/1060759954 >> v2:172.21.15.36:3300/0 conn(0x7f24e8060100 0x7f24e80b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.447+0000 7f24ee91e700 1 -- 172.21.15.36:0/1060759954 >> 172.21.15.36:0/1060759954 conn(0x7f24e805cf30 msgr2=0x7f24e805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:12.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.447+0000 7f24ee91e700 1 -- 172.21.15.36:0/1060759954 shutdown_connections 2022-01-10T01:32:12.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.447+0000 7f24ee91e700 1 -- 172.21.15.36:0/1060759954 wait complete. 2022-01-10T01:32:12.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.447+0000 7f24ee91e700 1 Processor -- start 2022-01-10T01:32:12.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.447+0000 7f24ee91e700 1 -- start start 2022-01-10T01:32:12.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.447+0000 7f24ee91e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24e8060100 0x7f24e80b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:12.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24ee91e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e8067300 0x7f24e81501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:12.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24ee91e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24e80b4c40 0x7f24e81506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:12.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24ee91e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e809f210 con 0x7f24e8060100 2022-01-10T01:32:12.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24ee91e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e8150b90 con 0x7f24e8067300 2022-01-10T01:32:12.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24ee91e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e80ad310 con 0x7f24e80b4c40 2022-01-10T01:32:12.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24e8060100 0x7f24e80b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:12.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24e8060100 0x7f24e80b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40276/0 (socket says 172.21.15.36:40276) 2022-01-10T01:32:12.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e7fff700 1 -- 172.21.15.36:0/649716854 learned_addr learned my addr 172.21.15.36:0/649716854 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:12.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e77fe700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e8067300 0x7f24e81501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:12.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24ecebb700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24e80b4c40 0x7f24e81506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:12.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e7fff700 1 -- 172.21.15.36:0/649716854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24e80b4c40 msgr2=0x7f24e81506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:12.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e7fff700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24e80b4c40 0x7f24e81506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e7fff700 1 -- 172.21.15.36:0/649716854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e8067300 msgr2=0x7f24e81501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:12.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e7fff700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e8067300 0x7f24e81501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e7fff700 1 -- 172.21.15.36:0/649716854 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d000b1e0 con 0x7f24e8060100 2022-01-10T01:32:12.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e77fe700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e8067300 0x7f24e81501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:32:12.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24ecebb700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24e80b4c40 0x7f24e81506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:32:12.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e7fff700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24e8060100 0x7f24e80b02d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f24d000c000 tx=0x7f24d0006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:12.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e57fa700 1 -- 172.21.15.36:0/649716854 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24d000c6a0 con 0x7f24e8060100 2022-01-10T01:32:12.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e57fa700 1 -- 172.21.15.36:0/649716854 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d000c800 con 0x7f24e8060100 2022-01-10T01:32:12.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24ee91e700 1 -- 172.21.15.36:0/649716854 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e000b180 con 0x7f24e8060100 2022-01-10T01:32:12.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e57fa700 1 -- 172.21.15.36:0/649716854 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24d000cb60 con 0x7f24e8060100 2022-01-10T01:32:12.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24ee91e700 1 -- 172.21.15.36:0/649716854 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e80ad540 con 0x7f24e8060100 2022-01-10T01:32:12.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24ee91e700 1 -- 172.21.15.36:0/649716854 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e8057350 con 0x7f24e8060100 2022-01-10T01:32:12.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.451+0000 7f24e57fa700 1 -- 172.21.15.36:0/649716854 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f24d0022070 con 0x7f24e8060100 2022-01-10T01:32:12.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.455+0000 7f24e57fa700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24c0053620 0x7f24c0055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:12.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.455+0000 7f24e77fe700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24c0053620 0x7f24c0055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:12.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.455+0000 7f24e57fa700 1 -- 172.21.15.36:0/649716854 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f24d006c020 con 0x7f24e8060100 2022-01-10T01:32:12.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.455+0000 7f24e77fe700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24c0053620 0x7f24c0055ae0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f24d8008000 tx=0x7f24d8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:12.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.459+0000 7f24e57fa700 1 -- 172.21.15.36:0/649716854 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f24d0043030 con 0x7f24e8060100 2022-01-10T01:32:12.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.587+0000 7f24ee91e700 1 -- 172.21.15.36:0/649716854 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24e80a06e0 con 0x7f24e8060100 2022-01-10T01:32:12.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.591+0000 7f24e57fa700 1 -- 172.21.15.36:0/649716854 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f24d0046650 con 0x7f24e8060100 2022-01-10T01:32:12.593 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:12.594 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":110,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:32:06.655202+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:32:04.130397+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2022-01-10T01:32:05.331515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:32:12.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.591+0000 7f24ee91e700 1 -- 172.21.15.36:0/649716854 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24c0053620 msgr2=0x7f24c0055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:12.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.591+0000 7f24ee91e700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24c0053620 0x7f24c0055ae0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f24d8008000 tx=0x7f24d8009040).stop 2022-01-10T01:32:12.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.591+0000 7f24ee91e700 1 -- 172.21.15.36:0/649716854 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24e8060100 msgr2=0x7f24e80b02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:12.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.591+0000 7f24ee91e700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24e8060100 0x7f24e80b02d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7f24d000c000 tx=0x7f24d0006eb0).stop 2022-01-10T01:32:12.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.591+0000 7f24ee91e700 1 -- 172.21.15.36:0/649716854 shutdown_connections 2022-01-10T01:32:12.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.591+0000 7f24ee91e700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24c0053620 0x7f24c0055ae0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.591+0000 7f24ee91e700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f24e80b4c40 0x7f24e81506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.591+0000 7f24ee91e700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24e8067300 0x7f24e81501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.591+0000 7f24ee91e700 1 --2- 172.21.15.36:0/649716854 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f24e8060100 0x7f24e80b02d0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.591+0000 7f24ee91e700 1 -- 172.21.15.36:0/649716854 >> 172.21.15.36:0/649716854 conn(0x7f24e805cf30 msgr2=0x7f24e8064870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:12.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.591+0000 7f24ee91e700 1 -- 172.21.15.36:0/649716854 shutdown_connections 2022-01-10T01:32:12.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.591+0000 7f24ee91e700 1 -- 172.21.15.36:0/649716854 wait complete. 2022-01-10T01:32:12.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:32:04.130397+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:32:05.331515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:32:12.608 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:32:12.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.715+0000 7f516759e700 1 Processor -- start 2022-01-10T01:32:12.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.715+0000 7f516759e700 1 -- start start 2022-01-10T01:32:12.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f516759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51680b25a0 0x7f5168066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:12.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f516759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5168066a10 0x7f516814d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:12.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f516759e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5168065330 con 0x7f51680b3000 2022-01-10T01:32:12.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f516759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5168062000 con 0x7f5168066a10 2022-01-10T01:32:12.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f516759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51680b33e0 con 0x7f51680b25a0 2022-01-10T01:32:12.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f515ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51680b25a0 0x7f5168066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:12.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f5166d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5168066a10 0x7f516814d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:12.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f5166d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5168066a10 0x7f516814d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:36922/0 (socket says 172.21.15.36:36922) 2022-01-10T01:32:12.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f515ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51680b25a0 0x7f5168066520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:46568/0 (socket says 172.21.15.36:46568) 2022-01-10T01:32:12.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f5166d9d700 1 -- 172.21.15.36:0/1465072924 learned_addr learned my addr 172.21.15.36:0/1465072924 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:12.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f516659c700 1 --1- 172.21.15.36:0/1465072924 >> v1:172.21.15.59:6789/0 conn(0x7f51680b3000 0x7f5168060b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:55754/0 (socket says 172.21.15.36:55754) 2022-01-10T01:32:12.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f515ffff700 1 -- 172.21.15.36:0/1465072924 >> v2:172.21.15.59:3300/0 conn(0x7f5168066a10 msgr2=0x7f516814d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:12.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f515ffff700 1 --2- 172.21.15.36:0/1465072924 >> v2:172.21.15.59:3300/0 conn(0x7f5168066a10 0x7f516814d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f515ffff700 1 -- 172.21.15.36:0/1465072924 >> v1:172.21.15.59:6789/0 conn(0x7f51680b3000 legacy=0x7f5168060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:12.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f515ffff700 1 -- 172.21.15.36:0/1465072924 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516805fa60 con 0x7f51680b25a0 2022-01-10T01:32:12.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f5166d9d700 1 --2- 172.21.15.36:0/1465072924 >> v2:172.21.15.59:3300/0 conn(0x7f5168066a10 0x7f516814d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:12.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f515ffff700 1 --2- 172.21.15.36:0/1465072924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51680b25a0 0x7f5168066520 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f5150002f70 tx=0x7f5150006df0).ready entity=mon.2 client_cookie=3a2fc8944574b769 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:12.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f5165d9b700 1 -- 172.21.15.36:0/1465072924 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f515000d570 con 0x7f51680b25a0 2022-01-10T01:32:12.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f5165d9b700 1 -- 172.21.15.36:0/1465072924 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5150000e90 con 0x7f51680b25a0 2022-01-10T01:32:12.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.719+0000 7f5165d9b700 1 -- 172.21.15.36:0/1465072924 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f515000d8c0 con 0x7f51680b25a0 2022-01-10T01:32:12.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 -- 172.21.15.36:0/1465072924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51680b25a0 msgr2=0x7f5168066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:12.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 --2- 172.21.15.36:0/1465072924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51680b25a0 0x7f5168066520 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f5150002f70 tx=0x7f5150006df0).stop 2022-01-10T01:32:12.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 -- 172.21.15.36:0/1465072924 shutdown_connections 2022-01-10T01:32:12.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 --2- 172.21.15.36:0/1465072924 >> v2:172.21.15.59:3300/0 conn(0x7f5168066a10 0x7f516814d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 --2- 172.21.15.36:0/1465072924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51680b25a0 0x7f5168066520 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 -- 172.21.15.36:0/1465072924 >> 172.21.15.36:0/1465072924 conn(0x7f51680636e0 msgr2=0x7f5168063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:12.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 -- 172.21.15.36:0/1465072924 shutdown_connections 2022-01-10T01:32:12.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 -- 172.21.15.36:0/1465072924 wait complete. 2022-01-10T01:32:12.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 Processor -- start 2022-01-10T01:32:12.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 -- start start 2022-01-10T01:32:12.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5168066a10 0x7f51680b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:12.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51680b25a0 0x7f5168141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:12.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51680b3000 0x7f5168141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:12.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51680af940 con 0x7f51680b3000 2022-01-10T01:32:12.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51680af610 con 0x7f51680b25a0 2022-01-10T01:32:12.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51680ae480 con 0x7f5168066a10 2022-01-10T01:32:12.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f5166d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51680b3000 0x7f5168141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:12.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f515ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51680b25a0 0x7f5168141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:12.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f5166d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51680b3000 0x7f5168141a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40294/0 (socket says 172.21.15.36:40294) 2022-01-10T01:32:12.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f5166d9d700 1 -- 172.21.15.36:0/525290597 learned_addr learned my addr 172.21.15.36:0/525290597 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:12.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.723+0000 7f516659c700 1 --2- 172.21.15.36:0/525290597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5168066a10 0x7f51680b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:12.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f515ffff700 1 -- 172.21.15.36:0/525290597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5168066a10 msgr2=0x7f51680b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:12.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f515ffff700 1 --2- 172.21.15.36:0/525290597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5168066a10 0x7f51680b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f515ffff700 1 -- 172.21.15.36:0/525290597 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51680b3000 msgr2=0x7f5168141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:12.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f515ffff700 1 --2- 172.21.15.36:0/525290597 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51680b3000 0x7f5168141a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f515ffff700 1 -- 172.21.15.36:0/525290597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5160009530 con 0x7f51680b25a0 2022-01-10T01:32:12.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f5166d9d700 1 --2- 172.21.15.36:0/525290597 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51680b3000 0x7f5168141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:12.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f515ffff700 1 --2- 172.21.15.36:0/525290597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51680b25a0 0x7f5168141540 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f5168152590 tx=0x7f5150014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:12.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f515f7fe700 1 -- 172.21.15.36:0/525290597 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5150013d60 con 0x7f51680b25a0 2022-01-10T01:32:12.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f515f7fe700 1 -- 172.21.15.36:0/525290597 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515001e400 con 0x7f51680b25a0 2022-01-10T01:32:12.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f516759e700 1 -- 172.21.15.36:0/525290597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515000b180 con 0x7f51680b25a0 2022-01-10T01:32:12.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f515f7fe700 1 -- 172.21.15.36:0/525290597 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f515001e760 con 0x7f51680b25a0 2022-01-10T01:32:12.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f516759e700 1 -- 172.21.15.36:0/525290597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5168141f20 con 0x7f51680b25a0 2022-01-10T01:32:12.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f515f7fe700 1 -- 172.21.15.36:0/525290597 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5150025030 con 0x7f51680b25a0 2022-01-10T01:32:12.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f516759e700 1 -- 172.21.15.36:0/525290597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516805fd00 con 0x7f51680b25a0 2022-01-10T01:32:12.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f515f7fe700 1 --2- 172.21.15.36:0/525290597 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f514c053680 0x7f514c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:12.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f515f7fe700 1 -- 172.21.15.36:0/525290597 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f515006c620 con 0x7f51680b25a0 2022-01-10T01:32:12.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.727+0000 7f516659c700 1 --2- 172.21.15.36:0/525290597 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f514c053680 0x7f514c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:12.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.731+0000 7f516659c700 1 --2- 172.21.15.36:0/525290597 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f514c053680 0x7f514c055b40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f515800d000 tx=0x7f5158007b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:12.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.735+0000 7f515f7fe700 1 -- 172.21.15.36:0/525290597 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5150043670 con 0x7f51680b25a0 2022-01-10T01:32:12.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.867+0000 7f516759e700 1 -- 172.21.15.36:0/525290597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5168057350 con 0x7f51680b25a0 2022-01-10T01:32:12.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.867+0000 7f515f7fe700 1 -- 172.21.15.36:0/525290597 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v110) v1 ==== 110+0+10 (secure 0 0 0) 0x7f51500230b0 con 0x7f51680b25a0 2022-01-10T01:32:12.872 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:32:12.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.871+0000 7f516759e700 1 -- 172.21.15.36:0/525290597 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f514c053680 msgr2=0x7f514c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:12.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.871+0000 7f516759e700 1 --2- 172.21.15.36:0/525290597 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f514c053680 0x7f514c055b40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f515800d000 tx=0x7f5158007b80).stop 2022-01-10T01:32:12.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.871+0000 7f516759e700 1 -- 172.21.15.36:0/525290597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51680b25a0 msgr2=0x7f5168141540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:12.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.871+0000 7f516759e700 1 --2- 172.21.15.36:0/525290597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51680b25a0 0x7f5168141540 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f5168152590 tx=0x7f5150014000).stop 2022-01-10T01:32:12.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.871+0000 7f516759e700 1 -- 172.21.15.36:0/525290597 shutdown_connections 2022-01-10T01:32:12.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.871+0000 7f516759e700 1 --2- 172.21.15.36:0/525290597 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f514c053680 0x7f514c055b40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.871+0000 7f516759e700 1 --2- 172.21.15.36:0/525290597 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51680b3000 0x7f5168141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.871+0000 7f516759e700 1 --2- 172.21.15.36:0/525290597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51680b25a0 0x7f5168141540 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.871+0000 7f516759e700 1 --2- 172.21.15.36:0/525290597 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5168066a10 0x7f51680b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:12.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.871+0000 7f516759e700 1 -- 172.21.15.36:0/525290597 >> 172.21.15.36:0/525290597 conn(0x7f51680636e0 msgr2=0x7f51681429f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:12.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.871+0000 7f516759e700 1 -- 172.21.15.36:0/525290597 shutdown_connections 2022-01-10T01:32:12.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.871+0000 7f516759e700 1 -- 172.21.15.36:0/525290597 wait complete. 2022-01-10T01:32:12.886 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:32:12.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.991+0000 7f7ba626a700 1 Processor -- start 2022-01-10T01:32:12.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.991+0000 7f7ba626a700 1 -- start start 2022-01-10T01:32:12.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7ba626a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba0060bd0 0x7f7ba005f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:12.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7ba626a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba0141140 con 0x7f7ba00af630 2022-01-10T01:32:12.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7ba626a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba00ac2a0 con 0x7f7ba00aed60 2022-01-10T01:32:12.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7ba626a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00ac000 con 0x7f7ba0060bd0 2022-01-10T01:32:12.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7ba4807700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f7ba00af630 0x7f7ba013e3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38096/0 (socket says 172.21.15.36:38096) 2022-01-10T01:32:12.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7ba4807700 1 -- 172.21.15.36:0/3622890674 learned_addr learned my addr 172.21.15.36:0/3622890674 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:12.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7b9f7fe700 1 --2- 172.21.15.36:0/3622890674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba0060bd0 0x7f7ba005f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7b9effd700 1 -- 172.21.15.36:0/3622890674 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889061274 0 0) 0x7f7ba0141140 con 0x7f7ba00af630 2022-01-10T01:32:13.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7b9effd700 1 -- 172.21.15.36:0/3622890674 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b8c003260 con 0x7f7ba00af630 2022-01-10T01:32:13.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7b9f7fe700 1 -- 172.21.15.36:0/3622890674 >> v1:172.21.15.59:6789/0 conn(0x7f7ba00aed60 legacy=0x7f7ba0141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7b9effd700 1 -- 172.21.15.36:0/3622890674 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2351371134 0 0) 0x7f7ba00ac2a0 con 0x7f7ba00aed60 2022-01-10T01:32:13.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7b9f7fe700 1 -- 172.21.15.36:0/3622890674 >> v1:172.21.15.36:6789/0 conn(0x7f7ba00af630 legacy=0x7f7ba013e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7b9f7fe700 1 -- 172.21.15.36:0/3622890674 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba01413a0 con 0x7f7ba0060bd0 2022-01-10T01:32:13.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7b9f7fe700 1 --2- 172.21.15.36:0/3622890674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba0060bd0 0x7f7ba005f6b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f7b900032f0 tx=0x7f7b900091d0).ready entity=mon.2 client_cookie=7bce4ecedbf87c13 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:13.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7b9effd700 1 -- 172.21.15.36:0/3622890674 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b9000b6c0 con 0x7f7ba0060bd0 2022-01-10T01:32:13.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7b9effd700 1 -- 172.21.15.36:0/3622890674 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9000b820 con 0x7f7ba0060bd0 2022-01-10T01:32:13.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7b9effd700 1 -- 172.21.15.36:0/3622890674 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b9000b990 con 0x7f7ba0060bd0 2022-01-10T01:32:13.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7ba626a700 1 -- 172.21.15.36:0/3622890674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba0060bd0 msgr2=0x7f7ba005f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7ba626a700 1 --2- 172.21.15.36:0/3622890674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba0060bd0 0x7f7ba005f6b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f7b900032f0 tx=0x7f7b900091d0).stop 2022-01-10T01:32:13.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7ba626a700 1 -- 172.21.15.36:0/3622890674 shutdown_connections 2022-01-10T01:32:13.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7ba626a700 1 --2- 172.21.15.36:0/3622890674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba0060bd0 0x7f7ba005f6b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7ba626a700 1 -- 172.21.15.36:0/3622890674 >> 172.21.15.36:0/3622890674 conn(0x7f7ba00b5570 msgr2=0x7f7ba00b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:13.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7ba626a700 1 -- 172.21.15.36:0/3622890674 shutdown_connections 2022-01-10T01:32:13.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.995+0000 7f7ba626a700 1 -- 172.21.15.36:0/3622890674 wait complete. 2022-01-10T01:32:13.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7ba626a700 1 Processor -- start 2022-01-10T01:32:13.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7ba626a700 1 -- start start 2022-01-10T01:32:13.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7ba626a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba0060bd0 0x7f7ba013c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7ba626a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7ba00aed60 0x7f7ba00ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7ba626a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba00af630 0x7f7ba01527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7ba626a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba01523e0 con 0x7f7ba00aed60 2022-01-10T01:32:13.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7ba626a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0146020 con 0x7f7ba0060bd0 2022-01-10T01:32:13.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7ba626a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0145d10 con 0x7f7ba00af630 2022-01-10T01:32:13.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7b9f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7ba00aed60 0x7f7ba00ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7b9f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7ba00aed60 0x7f7ba00ae570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40306/0 (socket says 172.21.15.36:40306) 2022-01-10T01:32:13.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7b9f7fe700 1 -- 172.21.15.36:0/3233293027 learned_addr learned my addr 172.21.15.36:0/3233293027 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:13.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7ba4807700 1 --2- 172.21.15.36:0/3233293027 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba00af630 0x7f7ba01527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7b9ffff700 1 --2- 172.21.15.36:0/3233293027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba0060bd0 0x7f7ba013c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7b9f7fe700 1 -- 172.21.15.36:0/3233293027 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba00af630 msgr2=0x7f7ba01527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7b9f7fe700 1 --2- 172.21.15.36:0/3233293027 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba00af630 0x7f7ba01527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7b9f7fe700 1 -- 172.21.15.36:0/3233293027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba0060bd0 msgr2=0x7f7ba013c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7b9f7fe700 1 --2- 172.21.15.36:0/3233293027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba0060bd0 0x7f7ba013c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7b9f7fe700 1 -- 172.21.15.36:0/3233293027 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b90009470 con 0x7f7ba00aed60 2022-01-10T01:32:13.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:12.999+0000 7f7b9f7fe700 1 --2- 172.21.15.36:0/3233293027 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7ba00aed60 0x7f7ba00ae570 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f7b900032f0 tx=0x7f7b90016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:13.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.003+0000 7f7b9d7fa700 1 -- 172.21.15.36:0/3233293027 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b9000b990 con 0x7f7ba00aed60 2022-01-10T01:32:13.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.003+0000 7f7b9d7fa700 1 -- 172.21.15.36:0/3233293027 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b90011e60 con 0x7f7ba00aed60 2022-01-10T01:32:13.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.003+0000 7f7ba626a700 1 -- 172.21.15.36:0/3233293027 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba00ad850 con 0x7f7ba00aed60 2022-01-10T01:32:13.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.003+0000 7f7b9d7fa700 1 -- 172.21.15.36:0/3233293027 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b9000b6c0 con 0x7f7ba00aed60 2022-01-10T01:32:13.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.003+0000 7f7ba626a700 1 -- 172.21.15.36:0/3233293027 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba00add90 con 0x7f7ba00aed60 2022-01-10T01:32:13.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.003+0000 7f7ba626a700 1 -- 172.21.15.36:0/3233293027 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba0057350 con 0x7f7ba00aed60 2022-01-10T01:32:13.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.003+0000 7f7b9d7fa700 1 -- 172.21.15.36:0/3233293027 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7b90026030 con 0x7f7ba00aed60 2022-01-10T01:32:13.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.003+0000 7f7b9d7fa700 1 --2- 172.21.15.36:0/3233293027 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7b800534d0 0x7f7b80055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.003+0000 7f7b9ffff700 1 --2- 172.21.15.36:0/3233293027 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7b800534d0 0x7f7b80055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.003+0000 7f7b9d7fa700 1 -- 172.21.15.36:0/3233293027 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7b9006c5c0 con 0x7f7ba00aed60 2022-01-10T01:32:13.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.003+0000 7f7b9ffff700 1 --2- 172.21.15.36:0/3233293027 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7b800534d0 0x7f7b80055990 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f7b9400d000 tx=0x7f7b940079b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:13.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.011+0000 7f7b9d7fa700 1 -- 172.21.15.36:0/3233293027 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7b90047000 con 0x7f7ba00aed60 2022-01-10T01:32:13.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.139+0000 7f7ba626a700 1 -- 172.21.15.36:0/3233293027 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7ba0064880 con 0x7f7ba00aed60 2022-01-10T01:32:13.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.139+0000 7f7b9d7fa700 1 -- 172.21.15.36:0/3233293027 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7b900150a0 con 0x7f7ba00aed60 2022-01-10T01:32:13.144 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:32:13.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.143+0000 7f7ba626a700 1 -- 172.21.15.36:0/3233293027 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7b800534d0 msgr2=0x7f7b80055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.143+0000 7f7ba626a700 1 --2- 172.21.15.36:0/3233293027 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7b800534d0 0x7f7b80055990 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f7b9400d000 tx=0x7f7b940079b0).stop 2022-01-10T01:32:13.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.143+0000 7f7ba626a700 1 -- 172.21.15.36:0/3233293027 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7ba00aed60 msgr2=0x7f7ba00ae570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.143+0000 7f7ba626a700 1 --2- 172.21.15.36:0/3233293027 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7ba00aed60 0x7f7ba00ae570 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f7b900032f0 tx=0x7f7b90016000).stop 2022-01-10T01:32:13.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.143+0000 7f7ba626a700 1 -- 172.21.15.36:0/3233293027 shutdown_connections 2022-01-10T01:32:13.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.143+0000 7f7ba626a700 1 --2- 172.21.15.36:0/3233293027 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7b800534d0 0x7f7b80055990 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.143+0000 7f7ba626a700 1 --2- 172.21.15.36:0/3233293027 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ba00af630 0x7f7ba01527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.143+0000 7f7ba626a700 1 --2- 172.21.15.36:0/3233293027 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7ba00aed60 0x7f7ba00ae570 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.143+0000 7f7ba626a700 1 --2- 172.21.15.36:0/3233293027 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ba0060bd0 0x7f7ba013c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.143+0000 7f7ba626a700 1 -- 172.21.15.36:0/3233293027 >> 172.21.15.36:0/3233293027 conn(0x7f7ba00b5570 msgr2=0x7f7ba013cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:13.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.143+0000 7f7ba626a700 1 -- 172.21.15.36:0/3233293027 shutdown_connections 2022-01-10T01:32:13.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.143+0000 7f7ba626a700 1 -- 172.21.15.36:0/3233293027 wait complete. 2022-01-10T01:32:13.157 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:32:13.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.267+0000 7f0abbfff700 1 Processor -- start 2022-01-10T01:32:13.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.267+0000 7f0abbfff700 1 -- start start 2022-01-10T01:32:13.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.267+0000 7f0abbfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0abc061320 0x7f0abc061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.267+0000 7f0abbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0abc0ad5c0 0x7f0abc0b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.267+0000 7f0abbfff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc0aecf0 con 0x7f0abc140440 2022-01-10T01:32:13.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.267+0000 7f0abbfff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0abc0b6f20 con 0x7f0abc061320 2022-01-10T01:32:13.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.267+0000 7f0abbfff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0abc0aef20 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.267+0000 7f0abb7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f0abc140440 0x7f0abc146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38110/0 (socket says 172.21.15.36:38110) 2022-01-10T01:32:13.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.267+0000 7f0abaffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0abc061320 0x7f0abc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.267+0000 7f0abb7fe700 1 -- 172.21.15.36:0/4006532390 learned_addr learned my addr 172.21.15.36:0/4006532390 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:13.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.267+0000 7f0ab27fc700 1 --2- 172.21.15.36:0/4006532390 >> v2:172.21.15.59:3300/0 conn(0x7f0abc0ad5c0 0x7f0abc0b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0aba7fc700 1 -- 172.21.15.36:0/4006532390 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232538224 0 0) 0x7f0abc0aecf0 con 0x7f0abc140440 2022-01-10T01:32:13.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0aba7fc700 1 -- 172.21.15.36:0/4006532390 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa0003260 con 0x7f0abc140440 2022-01-10T01:32:13.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0ab27fc700 1 -- 172.21.15.36:0/4006532390 >> v2:172.21.15.36:3300/0 conn(0x7f0abc061320 msgr2=0x7f0abc061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:13.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0ab27fc700 1 --2- 172.21.15.36:0/4006532390 >> v2:172.21.15.36:3300/0 conn(0x7f0abc061320 0x7f0abc061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0ab27fc700 1 -- 172.21.15.36:0/4006532390 >> v1:172.21.15.36:6789/0 conn(0x7f0abc140440 legacy=0x7f0abc146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0ab27fc700 1 -- 172.21.15.36:0/4006532390 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc0af1c0 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0ab27fc700 1 --2- 172.21.15.36:0/4006532390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0abc0ad5c0 0x7f0abc0b9e60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f0abc0aeba0 tx=0x7f0aa4006df0).ready entity=mon.1 client_cookie=13beff8671f80649 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:13.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0aba7fc700 1 -- 172.21.15.36:0/4006532390 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0aa400d4f0 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0aba7fc700 1 -- 172.21.15.36:0/4006532390 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa4000e90 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0aba7fc700 1 -- 172.21.15.36:0/4006532390 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0aa400d840 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0abbfff700 1 -- 172.21.15.36:0/4006532390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0abc0ad5c0 msgr2=0x7f0abc0b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0abbfff700 1 --2- 172.21.15.36:0/4006532390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0abc0ad5c0 0x7f0abc0b9e60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f0abc0aeba0 tx=0x7f0aa4006df0).stop 2022-01-10T01:32:13.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0abbfff700 1 -- 172.21.15.36:0/4006532390 shutdown_connections 2022-01-10T01:32:13.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0abbfff700 1 --2- 172.21.15.36:0/4006532390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0abc0ad5c0 0x7f0abc0b9e60 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0abbfff700 1 --2- 172.21.15.36:0/4006532390 >> v2:172.21.15.36:3300/0 conn(0x7f0abc061320 0x7f0abc061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0abbfff700 1 -- 172.21.15.36:0/4006532390 >> 172.21.15.36:0/4006532390 conn(0x7f0abc066de0 msgr2=0x7f0abc0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:13.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0abbfff700 1 -- 172.21.15.36:0/4006532390 shutdown_connections 2022-01-10T01:32:13.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.271+0000 7f0abbfff700 1 -- 172.21.15.36:0/4006532390 wait complete. 2022-01-10T01:32:13.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0abbfff700 1 Processor -- start 2022-01-10T01:32:13.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0abbfff700 1 -- start start 2022-01-10T01:32:13.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0abbfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0abc061320 0x7f0abc09f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0abbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0abc0ad5c0 0x7f0abc0ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0abbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0abc140440 0x7f0abc0aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0abbfff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0acf70 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0abbfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0b3a00 con 0x7f0abc061320 2022-01-10T01:32:13.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0abbfff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0a00c0 con 0x7f0abc140440 2022-01-10T01:32:13.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0ab27fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0abc0ad5c0 0x7f0abc0ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0ab27fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0abc0ad5c0 0x7f0abc0ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40320/0 (socket says 172.21.15.36:40320) 2022-01-10T01:32:13.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0ab27fc700 1 -- 172.21.15.36:0/3024441322 learned_addr learned my addr 172.21.15.36:0/3024441322 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:13.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0abaffd700 1 --2- 172.21.15.36:0/3024441322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0abc061320 0x7f0abc09f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0abb7fe700 1 --2- 172.21.15.36:0/3024441322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0abc140440 0x7f0abc0aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0ab27fc700 1 -- 172.21.15.36:0/3024441322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0abc140440 msgr2=0x7f0abc0aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0ab27fc700 1 --2- 172.21.15.36:0/3024441322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0abc140440 0x7f0abc0aca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0ab27fc700 1 -- 172.21.15.36:0/3024441322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0abc061320 msgr2=0x7f0abc09f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0ab27fc700 1 --2- 172.21.15.36:0/3024441322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0abc061320 0x7f0abc09f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.275+0000 7f0ab27fc700 1 -- 172.21.15.36:0/3024441322 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa400b180 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.279+0000 7f0ab27fc700 1 --2- 172.21.15.36:0/3024441322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0abc0ad5c0 0x7f0abc0ac590 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f0abc0ad0b0 tx=0x7f0aa4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:13.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.279+0000 7f0ab8ff9700 1 -- 172.21.15.36:0/3024441322 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0aa4013e50 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.279+0000 7f0ab8ff9700 1 -- 172.21.15.36:0/3024441322 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa4002f70 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.279+0000 7f0abbfff700 1 -- 172.21.15.36:0/3024441322 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc0a0360 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.279+0000 7f0ab8ff9700 1 -- 172.21.15.36:0/3024441322 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0aa401e5f0 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.279+0000 7f0abbfff700 1 -- 172.21.15.36:0/3024441322 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc09f0f0 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.279+0000 7f0abbfff700 1 -- 172.21.15.36:0/3024441322 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0abc09ee30 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.279+0000 7f0ab8ff9700 1 -- 172.21.15.36:0/3024441322 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0aa4025030 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.279+0000 7f0ab8ff9700 1 --2- 172.21.15.36:0/3024441322 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0a94053500 0x7f0a940559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.279+0000 7f0abaffd700 1 --2- 172.21.15.36:0/3024441322 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0a94053500 0x7f0a940559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.279+0000 7f0ab8ff9700 1 -- 172.21.15.36:0/3024441322 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0aa406c700 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.283+0000 7f0abaffd700 1 --2- 172.21.15.36:0/3024441322 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0a94053500 0x7f0a940559c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f0aac00b000 tx=0x7f0aac006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:13.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.287+0000 7f0ab8ff9700 1 -- 172.21.15.36:0/3024441322 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0abc09ee30 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.419+0000 7f0abbfff700 1 -- 172.21.15.36:0/3024441322 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0abc09ee30 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.419+0000 7f0ab8ff9700 1 -- 172.21.15.36:0/3024441322 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+10 (secure 0 0 0) 0x7f0abc09ee30 con 0x7f0abc0ad5c0 2022-01-10T01:32:13.424 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:32:13.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.423+0000 7f0abbfff700 1 -- 172.21.15.36:0/3024441322 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0a94053500 msgr2=0x7f0a940559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.423+0000 7f0abbfff700 1 --2- 172.21.15.36:0/3024441322 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0a94053500 0x7f0a940559c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f0aac00b000 tx=0x7f0aac006df0).stop 2022-01-10T01:32:13.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.423+0000 7f0abbfff700 1 -- 172.21.15.36:0/3024441322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0abc0ad5c0 msgr2=0x7f0abc0ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.423+0000 7f0abbfff700 1 --2- 172.21.15.36:0/3024441322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0abc0ad5c0 0x7f0abc0ac590 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f0abc0ad0b0 tx=0x7f0aa4014000).stop 2022-01-10T01:32:13.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.423+0000 7f0abbfff700 1 -- 172.21.15.36:0/3024441322 shutdown_connections 2022-01-10T01:32:13.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.423+0000 7f0abbfff700 1 --2- 172.21.15.36:0/3024441322 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0a94053500 0x7f0a940559c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.423+0000 7f0abbfff700 1 --2- 172.21.15.36:0/3024441322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0abc140440 0x7f0abc0aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.423+0000 7f0abbfff700 1 --2- 172.21.15.36:0/3024441322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0abc0ad5c0 0x7f0abc0ac590 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.423+0000 7f0abbfff700 1 --2- 172.21.15.36:0/3024441322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0abc061320 0x7f0abc09f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.423+0000 7f0abbfff700 1 -- 172.21.15.36:0/3024441322 >> 172.21.15.36:0/3024441322 conn(0x7f0abc066de0 msgr2=0x7f0abc142900 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:13.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.423+0000 7f0abbfff700 1 -- 172.21.15.36:0/3024441322 shutdown_connections 2022-01-10T01:32:13.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.423+0000 7f0abbfff700 1 -- 172.21.15.36:0/3024441322 wait complete. 2022-01-10T01:32:13.437 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:32:13.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.543+0000 7f15e3386700 1 Processor -- start 2022-01-10T01:32:13.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.543+0000 7f15e3386700 1 -- start start 2022-01-10T01:32:13.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e3386700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15dc060100 0x7f15dc064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e3386700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15dc0b38d0 0x7f15dc065200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e3386700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15dc0604e0 con 0x7f15dc144440 2022-01-10T01:32:13.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e3386700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15dc0656f0 con 0x7f15dc0b38d0 2022-01-10T01:32:13.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e3386700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc065c80 con 0x7f15dc060100 2022-01-10T01:32:13.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e0921700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f15dc144440 0x7f15dc144970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38120/0 (socket says 172.21.15.36:38120) 2022-01-10T01:32:13.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e0921700 1 -- 172.21.15.36:0/3096228145 learned_addr learned my addr 172.21.15.36:0/3096228145 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:13.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e1923700 1 --2- 172.21.15.36:0/3096228145 >> v2:172.21.15.59:3300/0 conn(0x7f15dc0b38d0 0x7f15dc065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e1122700 1 --2- 172.21.15.36:0/3096228145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15dc060100 0x7f15dc064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15cffff700 1 -- 172.21.15.36:0/3096228145 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271817025 0 0) 0x7f15dc0604e0 con 0x7f15dc144440 2022-01-10T01:32:13.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15cffff700 1 -- 172.21.15.36:0/3096228145 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c0003260 con 0x7f15dc144440 2022-01-10T01:32:13.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e1923700 1 -- 172.21.15.36:0/3096228145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15dc060100 msgr2=0x7f15dc064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:13.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e1923700 1 --2- 172.21.15.36:0/3096228145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15dc060100 0x7f15dc064d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e1923700 1 -- 172.21.15.36:0/3096228145 >> v1:172.21.15.36:6789/0 conn(0x7f15dc144440 legacy=0x7f15dc144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15cffff700 1 -- 172.21.15.36:0/3096228145 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 868012849 0 0) 0x7f15c0003260 con 0x7f15dc144440 2022-01-10T01:32:13.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e1923700 1 -- 172.21.15.36:0/3096228145 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc0b23b0 con 0x7f15dc0b38d0 2022-01-10T01:32:13.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e1923700 1 --2- 172.21.15.36:0/3096228145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15dc0b38d0 0x7f15dc065200 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f15d40032f0 tx=0x7f15d40091d0).ready entity=mon.1 client_cookie=8a60ff8322cc3e5a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:13.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15cffff700 1 -- 172.21.15.36:0/3096228145 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d400b600 con 0x7f15dc0b38d0 2022-01-10T01:32:13.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15cffff700 1 -- 172.21.15.36:0/3096228145 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d400b760 con 0x7f15dc0b38d0 2022-01-10T01:32:13.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15cffff700 1 -- 172.21.15.36:0/3096228145 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d400b8d0 con 0x7f15dc0b38d0 2022-01-10T01:32:13.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e3386700 1 -- 172.21.15.36:0/3096228145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15dc0b38d0 msgr2=0x7f15dc065200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e3386700 1 --2- 172.21.15.36:0/3096228145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15dc0b38d0 0x7f15dc065200 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f15d40032f0 tx=0x7f15d40091d0).stop 2022-01-10T01:32:13.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e3386700 1 -- 172.21.15.36:0/3096228145 shutdown_connections 2022-01-10T01:32:13.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e3386700 1 --2- 172.21.15.36:0/3096228145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15dc0b38d0 0x7f15dc065200 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e3386700 1 --2- 172.21.15.36:0/3096228145 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15dc060100 0x7f15dc064d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e3386700 1 -- 172.21.15.36:0/3096228145 >> 172.21.15.36:0/3096228145 conn(0x7f15dc05cf60 msgr2=0x7f15dc05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:13.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e3386700 1 -- 172.21.15.36:0/3096228145 shutdown_connections 2022-01-10T01:32:13.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.547+0000 7f15e3386700 1 -- 172.21.15.36:0/3096228145 wait complete. 2022-01-10T01:32:13.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e3386700 1 Processor -- start 2022-01-10T01:32:13.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e3386700 1 -- start start 2022-01-10T01:32:13.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e3386700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15dc060100 0x7f15dc1416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e3386700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15dc0b38d0 0x7f15dc1509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e3386700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15dc0b1790 0x7f15dc150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e3386700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc0abf70 con 0x7f15dc060100 2022-01-10T01:32:13.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e3386700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc13c590 con 0x7f15dc0b1790 2022-01-10T01:32:13.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e3386700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc13c050 con 0x7f15dc0b38d0 2022-01-10T01:32:13.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e1122700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15dc060100 0x7f15dc1416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e0921700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15dc0b38d0 0x7f15dc1509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e1923700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15dc0b1790 0x7f15dc150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e1122700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15dc060100 0x7f15dc1416b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40334/0 (socket says 172.21.15.36:40334) 2022-01-10T01:32:13.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e1923700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15dc0b1790 0x7f15dc150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:36970/0 (socket says 172.21.15.36:36970) 2022-01-10T01:32:13.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e1122700 1 -- 172.21.15.36:0/3871521751 learned_addr learned my addr 172.21.15.36:0/3871521751 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:13.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e1122700 1 -- 172.21.15.36:0/3871521751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15dc0b38d0 msgr2=0x7f15dc1509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e1122700 1 --2- 172.21.15.36:0/3871521751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15dc0b38d0 0x7f15dc1509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e1122700 1 -- 172.21.15.36:0/3871521751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15dc0b1790 msgr2=0x7f15dc150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e1122700 1 --2- 172.21.15.36:0/3871521751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15dc0b1790 0x7f15dc150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e1122700 1 -- 172.21.15.36:0/3871521751 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d4009470 con 0x7f15dc060100 2022-01-10T01:32:13.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e1923700 1 --2- 172.21.15.36:0/3871521751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15dc0b1790 0x7f15dc150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:13.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e0921700 1 --2- 172.21.15.36:0/3871521751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15dc0b38d0 0x7f15dc1509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:13.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15e1122700 1 --2- 172.21.15.36:0/3871521751 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15dc060100 0x7f15dc1416b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f15dc0b1030 tx=0x7f15d0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:13.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.551+0000 7f15ce7fc700 1 -- 172.21.15.36:0/3871521751 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d0010780 con 0x7f15dc060100 2022-01-10T01:32:13.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.555+0000 7f15ce7fc700 1 -- 172.21.15.36:0/3871521751 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d00108e0 con 0x7f15dc060100 2022-01-10T01:32:13.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.555+0000 7f15e3386700 1 -- 172.21.15.36:0/3871521751 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15dc13c2f0 con 0x7f15dc060100 2022-01-10T01:32:13.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.555+0000 7f15ce7fc700 1 -- 172.21.15.36:0/3871521751 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15d0010c40 con 0x7f15dc060100 2022-01-10T01:32:13.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.555+0000 7f15e3386700 1 -- 172.21.15.36:0/3871521751 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15dc13b830 con 0x7f15dc060100 2022-01-10T01:32:13.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.555+0000 7f15ce7fc700 1 -- 172.21.15.36:0/3871521751 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f15d001c460 con 0x7f15dc060100 2022-01-10T01:32:13.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.555+0000 7f15e3386700 1 -- 172.21.15.36:0/3871521751 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15dc057350 con 0x7f15dc060100 2022-01-10T01:32:13.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.555+0000 7f15ce7fc700 1 --2- 172.21.15.36:0/3871521751 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15c4053560 0x7f15c4055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.555+0000 7f15ce7fc700 1 -- 172.21.15.36:0/3871521751 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f15d006bf40 con 0x7f15dc060100 2022-01-10T01:32:13.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.555+0000 7f15e0921700 1 --2- 172.21.15.36:0/3871521751 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15c4053560 0x7f15c4055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.555+0000 7f15e0921700 1 --2- 172.21.15.36:0/3871521751 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15c4053560 0x7f15c4055a20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f15d800d000 tx=0x7f15d80079c0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:13.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.563+0000 7f15ce7fc700 1 -- 172.21.15.36:0/3871521751 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f15d0042d60 con 0x7f15dc060100 2022-01-10T01:32:13.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.691+0000 7f15e3386700 1 -- 172.21.15.36:0/3871521751 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15dc13b590 con 0x7f15dc060100 2022-01-10T01:32:13.694 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.691+0000 7f15ce7fc700 1 -- 172.21.15.36:0/3871521751 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+10 (secure 0 0 0) 0x7f15d0046380 con 0x7f15dc060100 2022-01-10T01:32:13.695 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:32:13.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.695+0000 7f15e3386700 1 -- 172.21.15.36:0/3871521751 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15c4053560 msgr2=0x7f15c4055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.695+0000 7f15e3386700 1 --2- 172.21.15.36:0/3871521751 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15c4053560 0x7f15c4055a20 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f15d800d000 tx=0x7f15d80079c0).stop 2022-01-10T01:32:13.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.695+0000 7f15e3386700 1 -- 172.21.15.36:0/3871521751 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15dc060100 msgr2=0x7f15dc1416b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.695+0000 7f15e3386700 1 --2- 172.21.15.36:0/3871521751 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15dc060100 0x7f15dc1416b0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f15dc0b1030 tx=0x7f15d0006df0).stop 2022-01-10T01:32:13.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.695+0000 7f15e3386700 1 -- 172.21.15.36:0/3871521751 shutdown_connections 2022-01-10T01:32:13.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.695+0000 7f15e3386700 1 --2- 172.21.15.36:0/3871521751 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15c4053560 0x7f15c4055a20 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.695+0000 7f15e3386700 1 --2- 172.21.15.36:0/3871521751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15dc0b1790 0x7f15dc150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.695+0000 7f15e3386700 1 --2- 172.21.15.36:0/3871521751 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15dc0b38d0 0x7f15dc1509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.695+0000 7f15e3386700 1 --2- 172.21.15.36:0/3871521751 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15dc060100 0x7f15dc1416b0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.695+0000 7f15e3386700 1 -- 172.21.15.36:0/3871521751 >> 172.21.15.36:0/3871521751 conn(0x7f15dc05cf60 msgr2=0x7f15dc05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:13.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.695+0000 7f15e3386700 1 -- 172.21.15.36:0/3871521751 shutdown_connections 2022-01-10T01:32:13.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.695+0000 7f15e3386700 1 -- 172.21.15.36:0/3871521751 wait complete. 2022-01-10T01:32:13.712 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:32:13.713 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:32:13.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.811+0000 7f4e28d7f700 1 Processor -- start 2022-01-10T01:32:13.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.811+0000 7f4e28d7f700 1 -- start start 2022-01-10T01:32:13.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e28d7f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4e241483a0 0x7f4e240b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e28d7f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4e240a70c0 0x7f4e24144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e28d7f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e240b0350 con 0x7f4e240b1db0 2022-01-10T01:32:13.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e28d7f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e240a90c0 con 0x7f4e241483a0 2022-01-10T01:32:13.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e28d7f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e240b05f0 con 0x7f4e240a70c0 2022-01-10T01:32:13.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e21d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4e241483a0 0x7f4e240b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e21d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4e241483a0 0x7f4e240b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40340/0 (socket says 172.21.15.36:40340) 2022-01-10T01:32:13.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e21d9b700 1 -- 172.21.15.36:0/1113360739 learned_addr learned my addr 172.21.15.36:0/1113360739 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:13.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e22d9d700 1 --2- 172.21.15.36:0/1113360739 >> v2:172.21.15.59:3300/0 conn(0x7f4e240a70c0 0x7f4e24144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e21d9b700 1 -- 172.21.15.36:0/1113360739 >> v2:172.21.15.59:3300/0 conn(0x7f4e240a70c0 msgr2=0x7f4e24144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:13.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e21d9b700 1 --2- 172.21.15.36:0/1113360739 >> v2:172.21.15.59:3300/0 conn(0x7f4e240a70c0 0x7f4e24144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e21d9b700 1 -- 172.21.15.36:0/1113360739 >> v1:172.21.15.59:6789/0 conn(0x7f4e240b1db0 legacy=0x7f4e240b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e21d9b700 1 -- 172.21.15.36:0/1113360739 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e240b0890 con 0x7f4e241483a0 2022-01-10T01:32:13.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e21d9b700 1 --2- 172.21.15.36:0/1113360739 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4e241483a0 0x7f4e240b0fd0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f4e24147730 tx=0x7f4e14006eb0).ready entity=mon.0 client_cookie=f0927ce1004304f1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:13.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e2159a700 1 -- 172.21.15.36:0/1113360739 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1400d610 con 0x7f4e241483a0 2022-01-10T01:32:13.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e2159a700 1 -- 172.21.15.36:0/1113360739 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e14000e90 con 0x7f4e241483a0 2022-01-10T01:32:13.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e2159a700 1 -- 172.21.15.36:0/1113360739 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1400d9a0 con 0x7f4e241483a0 2022-01-10T01:32:13.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1113360739 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4e241483a0 msgr2=0x7f4e240b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e28d7f700 1 --2- 172.21.15.36:0/1113360739 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4e241483a0 0x7f4e240b0fd0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f4e24147730 tx=0x7f4e14006eb0).stop 2022-01-10T01:32:13.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1113360739 shutdown_connections 2022-01-10T01:32:13.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e28d7f700 1 --2- 172.21.15.36:0/1113360739 >> v2:172.21.15.59:3300/0 conn(0x7f4e240a70c0 0x7f4e24144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e28d7f700 1 --2- 172.21.15.36:0/1113360739 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4e241483a0 0x7f4e240b0fd0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1113360739 >> 172.21.15.36:0/1113360739 conn(0x7f4e2405f6b0 msgr2=0x7f4e2405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:13.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1113360739 shutdown_connections 2022-01-10T01:32:13.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.815+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1113360739 wait complete. 2022-01-10T01:32:13.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e28d7f700 1 Processor -- start 2022-01-10T01:32:13.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e28d7f700 1 -- start start 2022-01-10T01:32:13.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e28d7f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4e240a70c0 0x7f4e240a9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e28d7f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e240b1db0 0x7f4e2414b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e28d7f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e241483a0 0x7f4e240abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e28d7f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2414b840 con 0x7f4e240a70c0 2022-01-10T01:32:13.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e28d7f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2414ba60 con 0x7f4e241483a0 2022-01-10T01:32:13.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e28d7f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2414aac0 con 0x7f4e240b1db0 2022-01-10T01:32:13.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e2259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4e240a70c0 0x7f4e240a9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e2259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4e240a70c0 0x7f4e240a9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40346/0 (socket says 172.21.15.36:40346) 2022-01-10T01:32:13.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e2259c700 1 -- 172.21.15.36:0/1239775517 learned_addr learned my addr 172.21.15.36:0/1239775517 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:13.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e22d9d700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e241483a0 0x7f4e240abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e21d9b700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e240b1db0 0x7f4e2414b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e2259c700 1 -- 172.21.15.36:0/1239775517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e240b1db0 msgr2=0x7f4e2414b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e2259c700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e240b1db0 0x7f4e2414b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e2259c700 1 -- 172.21.15.36:0/1239775517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e241483a0 msgr2=0x7f4e240abdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e2259c700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e241483a0 0x7f4e240abdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e2259c700 1 -- 172.21.15.36:0/1239775517 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1400b1e0 con 0x7f4e240a70c0 2022-01-10T01:32:13.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e22d9d700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e241483a0 0x7f4e240abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:13.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e2259c700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4e240a70c0 0x7f4e240a9780 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f4e2414b980 tx=0x7f4e18007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:13.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e137fe700 1 -- 172.21.15.36:0/1239775517 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1800ce20 con 0x7f4e240a70c0 2022-01-10T01:32:13.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e137fe700 1 -- 172.21.15.36:0/1239775517 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1800f470 con 0x7f4e240a70c0 2022-01-10T01:32:13.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1239775517 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2414a0e0 con 0x7f4e240a70c0 2022-01-10T01:32:13.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e137fe700 1 -- 172.21.15.36:0/1239775517 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1800f7d0 con 0x7f4e240a70c0 2022-01-10T01:32:13.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1239775517 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e2414a620 con 0x7f4e240a70c0 2022-01-10T01:32:13.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.819+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1239775517 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e240b0b30 con 0x7f4e240a70c0 2022-01-10T01:32:13.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.823+0000 7f4e137fe700 1 -- 172.21.15.36:0/1239775517 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4e18019030 con 0x7f4e240a70c0 2022-01-10T01:32:13.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.823+0000 7f4e137fe700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4e000536b0 0x7f4e00055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:13.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.823+0000 7f4e137fe700 1 -- 172.21.15.36:0/1239775517 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4e1806b320 con 0x7f4e240a70c0 2022-01-10T01:32:13.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.823+0000 7f4e21d9b700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4e000536b0 0x7f4e00055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:13.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.823+0000 7f4e21d9b700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4e000536b0 0x7f4e00055b70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f4e1401a000 tx=0x7f4e14015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:13.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.827+0000 7f4e137fe700 1 -- 172.21.15.36:0/1239775517 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4e180422d0 con 0x7f4e240a70c0 2022-01-10T01:32:13.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.987+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1239775517 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e24057350 con 0x7f4e240a70c0 2022-01-10T01:32:13.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.991+0000 7f4e137fe700 1 -- 172.21.15.36:0/1239775517 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2484 (secure 0 0 0) 0x7f4e180458f0 con 0x7f4e240a70c0 2022-01-10T01:32:13.993 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:13.993 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6836/13281616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":13281616},{"type":"v1","addr":"172.21.15.36:6836","nonce":13281616}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/2168511464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":2168511464},{"type":"v1","addr":"172.21.15.36:6837","nonce":2168511464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:32:05.646058+0000","modified":"2022-01-10T01:32:06.654528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7264":{"gid":7264,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/696360653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":696360653},{"type":"v1","addr":"172.21.15.59:6833","nonce":696360653}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2022-01-10T01:32:13.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.991+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1239775517 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4e000536b0 msgr2=0x7f4e00055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.991+0000 7f4e28d7f700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4e000536b0 0x7f4e00055b70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f4e1401a000 tx=0x7f4e14015000).stop 2022-01-10T01:32:13.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.991+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1239775517 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4e240a70c0 msgr2=0x7f4e240a9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:13.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.991+0000 7f4e28d7f700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4e240a70c0 0x7f4e240a9780 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f4e2414b980 tx=0x7f4e18007c50).stop 2022-01-10T01:32:13.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.991+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1239775517 shutdown_connections 2022-01-10T01:32:13.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.991+0000 7f4e28d7f700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4e000536b0 0x7f4e00055b70 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.991+0000 7f4e28d7f700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e241483a0 0x7f4e240abdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.991+0000 7f4e28d7f700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e240b1db0 0x7f4e2414b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.991+0000 7f4e28d7f700 1 --2- 172.21.15.36:0/1239775517 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4e240a70c0 0x7f4e240a9780 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:13.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.991+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1239775517 >> 172.21.15.36:0/1239775517 conn(0x7f4e2405f6b0 msgr2=0x7f4e24144830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:13.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.991+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1239775517 shutdown_connections 2022-01-10T01:32:13.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:13.991+0000 7f4e28d7f700 1 -- 172.21.15.36:0/1239775517 wait complete. 2022-01-10T01:32:13.998 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 51 2022-01-10T01:32:14.308 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:32:05.646058+0000', 'modified': '2022-01-10T01:32:06.654528+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7264}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7264': {'gid': 7264, 'name': 'b', 'rank': 0, 'incarnation': 50, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/696360653', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 696360653}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 696360653}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:32:14.309 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:32:14.309 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:32:14.425 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":7264,"want_state":"up:active","state":"up:active","rank_uptime":8.7603093679999997,"mdsmap_epoch":51,"osdmap_epoch":110,"osdmap_epoch_barrier":109,"uptime":13.113971526} 2022-01-10T01:32:14.426 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 7264, "mdsmap_epoch": 51, "osdmap_epoch": 110, "osdmap_epoch_barrier": 109, "rank_uptime": 8.760309368, "state": "up:active", "uptime": 13.113971526, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:32:14.426 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:32:14.427 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2022-01-10T01:32:14.427 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi166.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2022-01-10T01:32:14.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:14.428 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:14.437 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:32:14.453 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:32:14.454 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:32:14.509 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:32:14.510 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:32:14.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:14.512 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:32:14.516 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:32:14.517 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:14.520 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:32:14.537 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:32:14.537 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:32:14.592 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:2022-01-10T01:32:14.591+0000 7fb1f3371080 -1 init, newargv = 0x55b085194eb0 newargc=9ceph-fuse[14445 2022-01-10T01:32:14.593 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:]: starting ceph client 2022-01-10T01:32:14.598 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:32:14.599 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:32:14.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:14.600 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:32:14.603 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14445]: starting fuse 2022-01-10T01:32:14.607 INFO:teuthology.orchestra.run.smithi166.stdout:52 2022-01-10T01:32:14.608 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:32:14.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:14.609 DEBUG:teuthology.orchestra.run.smithi166:> sudo python3 -c ' 2022-01-10T01:32:14.609 DEBUG:teuthology.orchestra.run.smithi166:> import glob 2022-01-10T01:32:14.610 DEBUG:teuthology.orchestra.run.smithi166:> import re 2022-01-10T01:32:14.610 DEBUG:teuthology.orchestra.run.smithi166:> import os 2022-01-10T01:32:14.611 DEBUG:teuthology.orchestra.run.smithi166:> import subprocess 2022-01-10T01:32:14.611 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:32:14.611 DEBUG:teuthology.orchestra.run.smithi166:> def find_socket(client_name): 2022-01-10T01:32:14.612 DEBUG:teuthology.orchestra.run.smithi166:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2022-01-10T01:32:14.612 DEBUG:teuthology.orchestra.run.smithi166:> files = glob.glob(asok_path) 2022-01-10T01:32:14.613 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:32:14.613 DEBUG:teuthology.orchestra.run.smithi166:> # Given a non-glob path, it better be there 2022-01-10T01:32:14.614 DEBUG:teuthology.orchestra.run.smithi166:> if "*" not in asok_path: 2022-01-10T01:32:14.614 DEBUG:teuthology.orchestra.run.smithi166:> assert(len(files) == 1) 2022-01-10T01:32:14.614 DEBUG:teuthology.orchestra.run.smithi166:> return files[0] 2022-01-10T01:32:14.615 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:32:14.615 DEBUG:teuthology.orchestra.run.smithi166:> for f in files: 2022-01-10T01:32:14.616 DEBUG:teuthology.orchestra.run.smithi166:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:32:14.616 DEBUG:teuthology.orchestra.run.smithi166:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:32:14.617 DEBUG:teuthology.orchestra.run.smithi166:> return f 2022-01-10T01:32:14.617 DEBUG:teuthology.orchestra.run.smithi166:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:32:14.618 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:32:14.618 DEBUG:teuthology.orchestra.run.smithi166:> print(find_socket("client.1")) 2022-01-10T01:32:14.618 DEBUG:teuthology.orchestra.run.smithi166:> ' 2022-01-10T01:32:14.661 INFO:teuthology.orchestra.run.smithi166.stdout:/var/run/ceph/ceph-client.1.14445.asok 2022-01-10T01:32:14.666 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14445.asok 2022-01-10T01:32:14.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:14.667 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14445.asok status 2022-01-10T01:32:14.804 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2022-01-10T01:32:14.805 INFO:teuthology.orchestra.run.smithi166.stdout: "metadata": { 2022-01-10T01:32:14.805 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:32:14.805 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:32:14.805 INFO:teuthology.orchestra.run.smithi166.stdout: "entity_id": "1", 2022-01-10T01:32:14.806 INFO:teuthology.orchestra.run.smithi166.stdout: "hostname": "smithi166", 2022-01-10T01:32:14.806 INFO:teuthology.orchestra.run.smithi166.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2022-01-10T01:32:14.806 INFO:teuthology.orchestra.run.smithi166.stdout: "pid": "14445", 2022-01-10T01:32:14.806 INFO:teuthology.orchestra.run.smithi166.stdout: "root": "/" 2022-01-10T01:32:14.807 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:32:14.807 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_count": 0, 2022-01-10T01:32:14.807 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_pinned_count": 0, 2022-01-10T01:32:14.807 INFO:teuthology.orchestra.run.smithi166.stdout: "id": 7461, 2022-01-10T01:32:14.808 INFO:teuthology.orchestra.run.smithi166.stdout: "inst": { 2022-01-10T01:32:14.808 INFO:teuthology.orchestra.run.smithi166.stdout: "name": { 2022-01-10T01:32:14.808 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "client", 2022-01-10T01:32:14.808 INFO:teuthology.orchestra.run.smithi166.stdout: "num": 7461 2022-01-10T01:32:14.808 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:32:14.809 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:32:14.809 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:32:14.809 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:32:14.809 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 1262345993 2022-01-10T01:32:14.810 INFO:teuthology.orchestra.run.smithi166.stdout: } 2022-01-10T01:32:14.810 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:32:14.810 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:32:14.810 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:32:14.811 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:32:14.811 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 1262345993 2022-01-10T01:32:14.811 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:32:14.811 INFO:teuthology.orchestra.run.smithi166.stdout: "inst_str": "client.7461 172.21.15.166:0/1262345993", 2022-01-10T01:32:14.811 INFO:teuthology.orchestra.run.smithi166.stdout: "addr_str": "172.21.15.166:0/1262345993", 2022-01-10T01:32:14.812 INFO:teuthology.orchestra.run.smithi166.stdout: "inode_count": 1, 2022-01-10T01:32:14.812 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_epoch": 51, 2022-01-10T01:32:14.812 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch": 110, 2022-01-10T01:32:14.812 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:32:14.813 INFO:teuthology.orchestra.run.smithi166.stdout: "blacklisted": false, 2022-01-10T01:32:14.813 INFO:teuthology.orchestra.run.smithi166.stdout: "fs_name": "cephfs" 2022-01-10T01:32:14.813 INFO:teuthology.orchestra.run.smithi166.stdout:} 2022-01-10T01:32:14.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:14.815 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:14.815 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:14.822 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:32:14.824 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:32:14.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:14.825 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:14.884 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2022-01-10T01:32:14.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.991+0000 7fcf1afa1700 1 Processor -- start 2022-01-10T01:32:14.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.991+0000 7fcf1afa1700 1 -- start start 2022-01-10T01:32:15.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fcf140b2580 0x7fcf1414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf140b0010 0x7fcf1414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf140afbd0 0x7fcf140a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf140a70c0 con 0x7fcf140b2580 2022-01-10T01:32:15.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf140a72f0 con 0x7fcf140b0010 2022-01-10T01:32:15.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf140a7590 con 0x7fcf140afbd0 2022-01-10T01:32:15.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf19f9f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fcf140b2580 0x7fcf1414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf19f9f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fcf140b2580 0x7fcf1414ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40356/0 (socket says 172.21.15.36:40356) 2022-01-10T01:32:15.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf19f9f700 1 -- 172.21.15.36:0/2986243728 learned_addr learned my addr 172.21.15.36:0/2986243728 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:15.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1979e700 1 --2- 172.21.15.36:0/2986243728 >> v2:172.21.15.59:3300/0 conn(0x7fcf140b0010 0x7fcf1414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1a7a0700 1 --2- 172.21.15.36:0/2986243728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf140afbd0 0x7fcf140a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf19f9f700 1 -- 172.21.15.36:0/2986243728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf140afbd0 msgr2=0x7fcf140a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:15.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf19f9f700 1 --2- 172.21.15.36:0/2986243728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf140afbd0 0x7fcf140a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf19f9f700 1 -- 172.21.15.36:0/2986243728 >> v2:172.21.15.59:3300/0 conn(0x7fcf140b0010 msgr2=0x7fcf1414b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:15.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf19f9f700 1 --2- 172.21.15.36:0/2986243728 >> v2:172.21.15.59:3300/0 conn(0x7fcf140b0010 0x7fcf1414b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf19f9f700 1 -- 172.21.15.36:0/2986243728 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf140a7830 con 0x7fcf140b2580 2022-01-10T01:32:15.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1979e700 1 --2- 172.21.15.36:0/2986243728 >> v2:172.21.15.59:3300/0 conn(0x7fcf140b0010 0x7fcf1414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:15.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf19f9f700 1 --2- 172.21.15.36:0/2986243728 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf140b2580 0x7fcf1414ae40 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7fcf10002f70 tx=0x7fcf10006eb0).ready entity=mon.0 client_cookie=79f0e2b983aa48b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:15.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf18f9d700 1 -- 172.21.15.36:0/2986243728 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1000d570 con 0x7fcf140b2580 2022-01-10T01:32:15.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf18f9d700 1 -- 172.21.15.36:0/2986243728 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf10000e90 con 0x7fcf140b2580 2022-01-10T01:32:15.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf18f9d700 1 -- 172.21.15.36:0/2986243728 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf1000d900 con 0x7fcf140b2580 2022-01-10T01:32:15.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 -- 172.21.15.36:0/2986243728 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf140b2580 msgr2=0x7fcf1414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 --2- 172.21.15.36:0/2986243728 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf140b2580 0x7fcf1414ae40 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7fcf10002f70 tx=0x7fcf10006eb0).stop 2022-01-10T01:32:15.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 -- 172.21.15.36:0/2986243728 shutdown_connections 2022-01-10T01:32:15.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 --2- 172.21.15.36:0/2986243728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf140afbd0 0x7fcf140a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 --2- 172.21.15.36:0/2986243728 >> v2:172.21.15.59:3300/0 conn(0x7fcf140b0010 0x7fcf1414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 --2- 172.21.15.36:0/2986243728 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf140b2580 0x7fcf1414ae40 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 -- 172.21.15.36:0/2986243728 >> 172.21.15.36:0/2986243728 conn(0x7fcf14060180 msgr2=0x7fcf140b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:15.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 -- 172.21.15.36:0/2986243728 shutdown_connections 2022-01-10T01:32:15.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.995+0000 7fcf1afa1700 1 -- 172.21.15.36:0/2986243728 wait complete. 2022-01-10T01:32:15.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.999+0000 7fcf1afa1700 1 Processor -- start 2022-01-10T01:32:15.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.999+0000 7fcf1afa1700 1 -- start start 2022-01-10T01:32:15.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.999+0000 7fcf1afa1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf140afbd0 0x7fcf14149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.999+0000 7fcf1afa1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf140b0010 0x7fcf140a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.999+0000 7fcf1afa1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf140b2580 0x7fcf140a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.999+0000 7fcf1afa1700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf140b5420 con 0x7fcf140b2580 2022-01-10T01:32:15.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.999+0000 7fcf1afa1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf140b4d60 con 0x7fcf140afbd0 2022-01-10T01:32:15.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:14.999+0000 7fcf1afa1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf140b3640 con 0x7fcf140b0010 2022-01-10T01:32:15.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf1a7a0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf140b2580 0x7fcf140a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf19f9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf140afbd0 0x7fcf14149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf1979e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf140b0010 0x7fcf140a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf1a7a0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf140b2580 0x7fcf140a9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40364/0 (socket says 172.21.15.36:40364) 2022-01-10T01:32:15.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf19f9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf140afbd0 0x7fcf14149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:36994/0 (socket says 172.21.15.36:36994) 2022-01-10T01:32:15.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf1a7a0700 1 -- 172.21.15.36:0/1304973359 learned_addr learned my addr 172.21.15.36:0/1304973359 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:15.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf1a7a0700 1 -- 172.21.15.36:0/1304973359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf140b0010 msgr2=0x7fcf140a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf1a7a0700 1 --2- 172.21.15.36:0/1304973359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf140b0010 0x7fcf140a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf1a7a0700 1 -- 172.21.15.36:0/1304973359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf140afbd0 msgr2=0x7fcf14149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf1a7a0700 1 --2- 172.21.15.36:0/1304973359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf140afbd0 0x7fcf14149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf1a7a0700 1 -- 172.21.15.36:0/1304973359 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0400b180 con 0x7fcf140b2580 2022-01-10T01:32:15.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf1a7a0700 1 --2- 172.21.15.36:0/1304973359 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf140b2580 0x7fcf140a9c90 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7fcf140b4ea0 tx=0x7fcf0c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:15.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf02ffd700 1 -- 172.21.15.36:0/1304973359 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0c00c640 con 0x7fcf140b2580 2022-01-10T01:32:15.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf02ffd700 1 -- 172.21.15.36:0/1304973359 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c00c7a0 con 0x7fcf140b2580 2022-01-10T01:32:15.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf1afa1700 1 -- 172.21.15.36:0/1304973359 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1000b1e0 con 0x7fcf140b2580 2022-01-10T01:32:15.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf02ffd700 1 -- 172.21.15.36:0/1304973359 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0c00cb00 con 0x7fcf140b2580 2022-01-10T01:32:15.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf1afa1700 1 -- 172.21.15.36:0/1304973359 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf140b3870 con 0x7fcf140b2580 2022-01-10T01:32:15.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf1afa1700 1 -- 172.21.15.36:0/1304973359 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf140b5120 con 0x7fcf140b2580 2022-01-10T01:32:15.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf02ffd700 1 -- 172.21.15.36:0/1304973359 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fcf0c022070 con 0x7fcf140b2580 2022-01-10T01:32:15.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf02ffd700 1 --2- 172.21.15.36:0/1304973359 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcef4053680 0x7fcef4055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf02ffd700 1 -- 172.21.15.36:0/1304973359 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fcf0c06bf90 con 0x7fcf140b2580 2022-01-10T01:32:15.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.003+0000 7fcf19f9f700 1 --2- 172.21.15.36:0/1304973359 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcef4053680 0x7fcef4055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.007+0000 7fcf19f9f700 1 --2- 172.21.15.36:0/1304973359 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcef4053680 0x7fcef4055b40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fcf1001c000 tx=0x7fcf10015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:15.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.007+0000 7fcf02ffd700 1 -- 172.21.15.36:0/1304973359 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcf0c042fa0 con 0x7fcf140b2580 2022-01-10T01:32:15.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.179+0000 7fcf1afa1700 1 -- 172.21.15.36:0/1304973359 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fcf140b3ba0 con 0x7fcf140b2580 2022-01-10T01:32:15.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.179+0000 7fcf02ffd700 1 -- 172.21.15.36:0/1304973359 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1936 (secure 0 0 0) 0x7fcf0c0465c0 con 0x7fcf140b2580 2022-01-10T01:32:15.183 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:15.183 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:32:15.183 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:15.184 INFO:teuthology.orchestra.run.smithi036.stdout: "total_bytes": 773094113280, 2022-01-10T01:32:15.184 INFO:teuthology.orchestra.run.smithi036.stdout: "total_avail_bytes": 764493045760, 2022-01-10T01:32:15.184 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_bytes": 11132928, 2022-01-10T01:32:15.184 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_raw_bytes": 8601067520, 2022-01-10T01:32:15.185 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_raw_ratio": 0.011125511489808559, 2022-01-10T01:32:15.185 INFO:teuthology.orchestra.run.smithi036.stdout: "num_osds": 8, 2022-01-10T01:32:15.185 INFO:teuthology.orchestra.run.smithi036.stdout: "num_per_pool_osds": 8, 2022-01-10T01:32:15.185 INFO:teuthology.orchestra.run.smithi036.stdout: "num_per_pool_omap_osds": 8 2022-01-10T01:32:15.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:15.186 INFO:teuthology.orchestra.run.smithi036.stdout: "stats_by_class": { 2022-01-10T01:32:15.186 INFO:teuthology.orchestra.run.smithi036.stdout: "ssd": { 2022-01-10T01:32:15.186 INFO:teuthology.orchestra.run.smithi036.stdout: "total_bytes": 773094113280, 2022-01-10T01:32:15.187 INFO:teuthology.orchestra.run.smithi036.stdout: "total_avail_bytes": 764493045760, 2022-01-10T01:32:15.187 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_bytes": 11132928, 2022-01-10T01:32:15.187 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_raw_bytes": 8601067520, 2022-01-10T01:32:15.187 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_raw_ratio": 0.011125511489808559 2022-01-10T01:32:15.187 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:15.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:15.188 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:32:15.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:15.188 INFO:teuthology.orchestra.run.smithi036.stdout: "name": "device_health_metrics", 2022-01-10T01:32:15.189 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 1, 2022-01-10T01:32:15.189 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:15.189 INFO:teuthology.orchestra.run.smithi036.stdout: "stored": 0, 2022-01-10T01:32:15.189 INFO:teuthology.orchestra.run.smithi036.stdout: "objects": 2, 2022-01-10T01:32:15.190 INFO:teuthology.orchestra.run.smithi036.stdout: "kb_used": 0, 2022-01-10T01:32:15.190 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes_used": 0, 2022-01-10T01:32:15.190 INFO:teuthology.orchestra.run.smithi036.stdout: "percent_used": 0, 2022-01-10T01:32:15.190 INFO:teuthology.orchestra.run.smithi036.stdout: "max_avail": 362919100416 2022-01-10T01:32:15.191 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:15.191 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:15.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:15.191 INFO:teuthology.orchestra.run.smithi036.stdout: "name": "rbd", 2022-01-10T01:32:15.192 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 2, 2022-01-10T01:32:15.192 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:15.192 INFO:teuthology.orchestra.run.smithi036.stdout: "stored": 0, 2022-01-10T01:32:15.192 INFO:teuthology.orchestra.run.smithi036.stdout: "objects": 0, 2022-01-10T01:32:15.192 INFO:teuthology.orchestra.run.smithi036.stdout: "kb_used": 0, 2022-01-10T01:32:15.193 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes_used": 0, 2022-01-10T01:32:15.193 INFO:teuthology.orchestra.run.smithi036.stdout: "percent_used": 0, 2022-01-10T01:32:15.193 INFO:teuthology.orchestra.run.smithi036.stdout: "max_avail": 362919100416 2022-01-10T01:32:15.193 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:15.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:15.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:15.194 INFO:teuthology.orchestra.run.smithi036.stdout: "name": "cephfs_metadata", 2022-01-10T01:32:15.194 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 19, 2022-01-10T01:32:15.195 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:15.195 INFO:teuthology.orchestra.run.smithi036.stdout: "stored": 2516, 2022-01-10T01:32:15.195 INFO:teuthology.orchestra.run.smithi036.stdout: "objects": 22, 2022-01-10T01:32:15.195 INFO:teuthology.orchestra.run.smithi036.stdout: "kb_used": 64, 2022-01-10T01:32:15.196 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes_used": 65536, 2022-01-10T01:32:15.196 INFO:teuthology.orchestra.run.smithi036.stdout: "percent_used": 9.0290086518507451e-08, 2022-01-10T01:32:15.196 INFO:teuthology.orchestra.run.smithi036.stdout: "max_avail": 362919100416 2022-01-10T01:32:15.197 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:15.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:15.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:15.197 INFO:teuthology.orchestra.run.smithi036.stdout: "name": "cephfs_data", 2022-01-10T01:32:15.197 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 20, 2022-01-10T01:32:15.198 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:15.198 INFO:teuthology.orchestra.run.smithi036.stdout: "stored": 0, 2022-01-10T01:32:15.198 INFO:teuthology.orchestra.run.smithi036.stdout: "objects": 0, 2022-01-10T01:32:15.198 INFO:teuthology.orchestra.run.smithi036.stdout: "kb_used": 0, 2022-01-10T01:32:15.199 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes_used": 0, 2022-01-10T01:32:15.199 INFO:teuthology.orchestra.run.smithi036.stdout: "percent_used": 0, 2022-01-10T01:32:15.199 INFO:teuthology.orchestra.run.smithi036.stdout: "max_avail": 362919100416 2022-01-10T01:32:15.199 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:15.200 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:15.200 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:15.200 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:32:15.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.183+0000 7fcf1afa1700 1 -- 172.21.15.36:0/1304973359 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcef4053680 msgr2=0x7fcef4055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.183+0000 7fcf1afa1700 1 --2- 172.21.15.36:0/1304973359 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcef4053680 0x7fcef4055b40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7fcf1001c000 tx=0x7fcf10015000).stop 2022-01-10T01:32:15.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.183+0000 7fcf1afa1700 1 -- 172.21.15.36:0/1304973359 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf140b2580 msgr2=0x7fcf140a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.183+0000 7fcf1afa1700 1 --2- 172.21.15.36:0/1304973359 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf140b2580 0x7fcf140a9c90 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7fcf140b4ea0 tx=0x7fcf0c0091d0).stop 2022-01-10T01:32:15.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.183+0000 7fcf1afa1700 1 -- 172.21.15.36:0/1304973359 shutdown_connections 2022-01-10T01:32:15.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.183+0000 7fcf1afa1700 1 --2- 172.21.15.36:0/1304973359 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcef4053680 0x7fcef4055b40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.183+0000 7fcf1afa1700 1 --2- 172.21.15.36:0/1304973359 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcf140b2580 0x7fcf140a9c90 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.183+0000 7fcf1afa1700 1 --2- 172.21.15.36:0/1304973359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf140b0010 0x7fcf140a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.183+0000 7fcf1afa1700 1 --2- 172.21.15.36:0/1304973359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf140afbd0 0x7fcf14149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.183+0000 7fcf1afa1700 1 -- 172.21.15.36:0/1304973359 >> 172.21.15.36:0/1304973359 conn(0x7fcf14060180 msgr2=0x7fcf1414b990 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:15.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.183+0000 7fcf1afa1700 1 -- 172.21.15.36:0/1304973359 shutdown_connections 2022-01-10T01:32:15.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.183+0000 7fcf1afa1700 1 -- 172.21.15.36:0/1304973359 wait complete. 2022-01-10T01:32:15.205 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data size -f json-pretty 2022-01-10T01:32:15.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1d0536700 1 Processor -- start 2022-01-10T01:32:15.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1d0536700 1 -- start start 2022-01-10T01:32:15.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1d0536700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff1c80a9c10 0x7ff1c80b0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1d0536700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c8143920 con 0x7ff1c80b3710 2022-01-10T01:32:15.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1d0536700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c8143bc0 con 0x7ff1c80b05b0 2022-01-10T01:32:15.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1d0536700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c8143e60 con 0x7ff1c80a9c10 2022-01-10T01:32:15.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1cead3700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff1c80a9c10 0x7ff1c80b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1cead3700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff1c80a9c10 0x7ff1c80b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40372/0 (socket says 172.21.15.36:40372) 2022-01-10T01:32:15.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1cead3700 1 -- 172.21.15.36:0/2100243360 learned_addr learned my addr 172.21.15.36:0/2100243360 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:15.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1cead3700 1 -- 172.21.15.36:0/2100243360 >> v1:172.21.15.59:6789/0 conn(0x7ff1c80b05b0 legacy=0x7ff1c813d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1cead3700 1 -- 172.21.15.36:0/2100243360 >> v1:172.21.15.36:6789/0 conn(0x7ff1c80b3710 legacy=0x7ff1c80b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1cd2d0700 1 -- 172.21.15.36:0/2100243360 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1562182491 0 0) 0x7ff1c8143920 con 0x7ff1c80b3710 2022-01-10T01:32:15.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1cead3700 1 -- 172.21.15.36:0/2100243360 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c8144100 con 0x7ff1c80a9c10 2022-01-10T01:32:15.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1cead3700 1 --2- 172.21.15.36:0/2100243360 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1c80a9c10 0x7ff1c80b0990 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7ff1c0002f70 tx=0x7ff1c0006eb0).ready entity=mon.0 client_cookie=6048cbf09568b007 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:15.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1cd2d0700 1 -- 172.21.15.36:0/2100243360 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1c000d660 con 0x7ff1c80a9c10 2022-01-10T01:32:15.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1cd2d0700 1 -- 172.21.15.36:0/2100243360 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c0000e90 con 0x7ff1c80a9c10 2022-01-10T01:32:15.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.311+0000 7ff1cd2d0700 1 -- 172.21.15.36:0/2100243360 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1c000d9b0 con 0x7ff1c80a9c10 2022-01-10T01:32:15.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.315+0000 7ff1d0536700 1 -- 172.21.15.36:0/2100243360 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1c80a9c10 msgr2=0x7ff1c80b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.315+0000 7ff1d0536700 1 --2- 172.21.15.36:0/2100243360 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1c80a9c10 0x7ff1c80b0990 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7ff1c0002f70 tx=0x7ff1c0006eb0).stop 2022-01-10T01:32:15.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.315+0000 7ff1d0536700 1 -- 172.21.15.36:0/2100243360 shutdown_connections 2022-01-10T01:32:15.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.315+0000 7ff1d0536700 1 --2- 172.21.15.36:0/2100243360 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1c80a9c10 0x7ff1c80b0990 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.315+0000 7ff1d0536700 1 -- 172.21.15.36:0/2100243360 >> 172.21.15.36:0/2100243360 conn(0x7ff1c80607c0 msgr2=0x7ff1c8060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:15.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.315+0000 7ff1d0536700 1 -- 172.21.15.36:0/2100243360 shutdown_connections 2022-01-10T01:32:15.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.315+0000 7ff1d0536700 1 -- 172.21.15.36:0/2100243360 wait complete. 2022-01-10T01:32:15.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.315+0000 7ff1d0536700 1 Processor -- start 2022-01-10T01:32:15.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.315+0000 7ff1d0536700 1 -- start start 2022-01-10T01:32:15.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1d0536700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c80a9c10 0x7ff1c813be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1d0536700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1c80b05b0 0x7ff1c814f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1d0536700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1c80b3710 0x7ff1c814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1d0536700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c8066860 con 0x7ff1c80b3710 2022-01-10T01:32:15.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1d0536700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80b72e0 con 0x7ff1c80a9c10 2022-01-10T01:32:15.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1d0536700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c814f530 con 0x7ff1c80b05b0 2022-01-10T01:32:15.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1cead3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1c80b3710 0x7ff1c814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1cead3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1c80b3710 0x7ff1c814fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40376/0 (socket says 172.21.15.36:40376) 2022-01-10T01:32:15.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1cead3700 1 -- 172.21.15.36:0/878579839 learned_addr learned my addr 172.21.15.36:0/878579839 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:15.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1ce2d2700 1 --2- 172.21.15.36:0/878579839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c80a9c10 0x7ff1c813be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1cdad1700 1 --2- 172.21.15.36:0/878579839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1c80b05b0 0x7ff1c814f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1cead3700 1 -- 172.21.15.36:0/878579839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1c80b05b0 msgr2=0x7ff1c814f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1cead3700 1 --2- 172.21.15.36:0/878579839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1c80b05b0 0x7ff1c814f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1cead3700 1 -- 172.21.15.36:0/878579839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c80a9c10 msgr2=0x7ff1c813be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1cead3700 1 --2- 172.21.15.36:0/878579839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c80a9c10 0x7ff1c813be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1cead3700 1 -- 172.21.15.36:0/878579839 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c000b1e0 con 0x7ff1c80b3710 2022-01-10T01:32:15.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1cead3700 1 --2- 172.21.15.36:0/878579839 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1c80b3710 0x7ff1c814fec0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7ff1c0002f70 tx=0x7ff1c0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:15.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1bb7fe700 1 -- 172.21.15.36:0/878579839 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1c00117e0 con 0x7ff1c80b3710 2022-01-10T01:32:15.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1bb7fe700 1 -- 172.21.15.36:0/878579839 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c0011940 con 0x7ff1c80b3710 2022-01-10T01:32:15.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1bb7fe700 1 -- 172.21.15.36:0/878579839 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1c0011ca0 con 0x7ff1c80b3710 2022-01-10T01:32:15.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1d0536700 1 -- 172.21.15.36:0/878579839 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c81427e0 con 0x7ff1c80b3710 2022-01-10T01:32:15.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1d0536700 1 -- 172.21.15.36:0/878579839 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c80b64c0 con 0x7ff1c80b3710 2022-01-10T01:32:15.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1d0536700 1 -- 172.21.15.36:0/878579839 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c814f6f0 con 0x7ff1c80b3710 2022-01-10T01:32:15.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.319+0000 7ff1bb7fe700 1 -- 172.21.15.36:0/878579839 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff1c0025030 con 0x7ff1c80b3710 2022-01-10T01:32:15.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.323+0000 7ff1bb7fe700 1 --2- 172.21.15.36:0/878579839 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff1a80534d0 0x7ff1a8055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.323+0000 7ff1bb7fe700 1 -- 172.21.15.36:0/878579839 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff1c006cdb0 con 0x7ff1c80b3710 2022-01-10T01:32:15.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.323+0000 7ff1ce2d2700 1 --2- 172.21.15.36:0/878579839 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff1a80534d0 0x7ff1a8055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.323+0000 7ff1ce2d2700 1 --2- 172.21.15.36:0/878579839 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff1a80534d0 0x7ff1a8055990 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7ff1c400d000 tx=0x7ff1c4007f10).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:15.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.327+0000 7ff1bb7fe700 1 -- 172.21.15.36:0/878579839 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff1c0071070 con 0x7ff1c80b3710 2022-01-10T01:32:15.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.455+0000 7ff1d0536700 1 -- 172.21.15.36:0/878579839 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"} v 0) v1 -- 0x7ff1c80b74a0 con 0x7ff1c80b3710 2022-01-10T01:32:15.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.455+0000 7ff1bb7fe700 1 -- 172.21.15.36:0/878579839 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"}]=0 v110) v1 ==== 123+0+64 (secure 0 0 0) 0x7ff1c0023020 con 0x7ff1c80b3710 2022-01-10T01:32:15.460 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:15.461 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:32:15.461 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": "cephfs_data", 2022-01-10T01:32:15.461 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_id": 20, 2022-01-10T01:32:15.461 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2 2022-01-10T01:32:15.462 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:32:15.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.459+0000 7ff1d0536700 1 -- 172.21.15.36:0/878579839 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff1a80534d0 msgr2=0x7ff1a8055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.459+0000 7ff1d0536700 1 --2- 172.21.15.36:0/878579839 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff1a80534d0 0x7ff1a8055990 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7ff1c400d000 tx=0x7ff1c4007f10).stop 2022-01-10T01:32:15.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.459+0000 7ff1d0536700 1 -- 172.21.15.36:0/878579839 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1c80b3710 msgr2=0x7ff1c814fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.459+0000 7ff1d0536700 1 --2- 172.21.15.36:0/878579839 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1c80b3710 0x7ff1c814fec0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7ff1c0002f70 tx=0x7ff1c0015000).stop 2022-01-10T01:32:15.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.459+0000 7ff1d0536700 1 -- 172.21.15.36:0/878579839 shutdown_connections 2022-01-10T01:32:15.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.459+0000 7ff1d0536700 1 --2- 172.21.15.36:0/878579839 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff1a80534d0 0x7ff1a8055990 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.459+0000 7ff1d0536700 1 --2- 172.21.15.36:0/878579839 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1c80b3710 0x7ff1c814fec0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.459+0000 7ff1d0536700 1 --2- 172.21.15.36:0/878579839 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1c80b05b0 0x7ff1c814f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.459+0000 7ff1d0536700 1 --2- 172.21.15.36:0/878579839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1c80a9c10 0x7ff1c813be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.459+0000 7ff1d0536700 1 -- 172.21.15.36:0/878579839 >> 172.21.15.36:0/878579839 conn(0x7ff1c80607c0 msgr2=0x7ff1c813cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:15.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.459+0000 7ff1d0536700 1 -- 172.21.15.36:0/878579839 shutdown_connections 2022-01-10T01:32:15.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.459+0000 7ff1d0536700 1 -- 172.21.15.36:0/878579839 wait complete. 2022-01-10T01:32:15.473 INFO:teuthology.orchestra.run:Running command with timeout 10800 2022-01-10T01:32:15.474 DEBUG:teuthology.orchestra.run.smithi139:> cd /home/ubuntu/cephtest/mnt.0 && sudo df . 2022-01-10T01:32:15.512 INFO:teuthology.orchestra.run.smithi139.stdout:Filesystem 1K-blocks Used Available Use% Mounted on 2022-01-10T01:32:15.513 INFO:teuthology.orchestra.run.smithi139.stdout:ceph-fuse 354410496 0 354410496 0% /home/ubuntu/cephtest/mnt.0 2022-01-10T01:32:15.514 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:32:15.514 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:32:15.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:32:15.557 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:32:15.579 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:32:15.600 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:32:15.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:15.601 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:15.601 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:15.611 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:32:15.611 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:32:15.612 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:32:15.613 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:32:15.613 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:15.628 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[14964]: fuse finished with error 0 and tester_r 0 2022-01-10T01:32:15.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:15.630 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:15.630 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:15.721 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:32:15.723 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:32:15.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:32:15.724 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:15.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:15.732 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:15.732 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:15.741 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:32:15.742 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:32:15.742 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi166.front.sepia.ceph.com... 2022-01-10T01:32:15.743 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:32:15.743 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:15.758 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14445]: fuse finished with error 0 and tester_r 0 2022-01-10T01:32:15.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:15.760 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:15.761 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:15.836 INFO:teuthology.orchestra.run.smithi166.stdout:ext2/ext3 2022-01-10T01:32:15.837 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:32:15.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:32:15.838 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:15.845 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:32:15.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.951+0000 7f795ff16700 1 Processor -- start 2022-01-10T01:32:15.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.951+0000 7f795ff16700 1 -- start start 2022-01-10T01:32:15.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ff16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7958060100 0x7f7958061650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ff16700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7958065970 0x7f7958065df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ff16700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79580604e0 con 0x7f79580665d0 2022-01-10T01:32:15.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ff16700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7958067120 con 0x7f7958065970 2022-01-10T01:32:15.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ff16700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7958060c70 con 0x7f7958060100 2022-01-10T01:32:15.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795e4b3700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f79580665d0 0x7f7958066a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38180/0 (socket says 172.21.15.36:38180) 2022-01-10T01:32:15.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795e4b3700 1 -- 172.21.15.36:0/2089698801 learned_addr learned my addr 172.21.15.36:0/2089698801 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:15.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795d4b1700 1 --2- 172.21.15.36:0/2089698801 >> v2:172.21.15.59:3300/0 conn(0x7f7958065970 0x7f7958065df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795dcb2700 1 --2- 172.21.15.36:0/2089698801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7958060100 0x7f7958061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ccb0700 1 -- 172.21.15.36:0/2089698801 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139291936 0 0) 0x7f79580604e0 con 0x7f79580665d0 2022-01-10T01:32:15.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ccb0700 1 -- 172.21.15.36:0/2089698801 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7940003260 con 0x7f79580665d0 2022-01-10T01:32:15.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795d4b1700 1 -- 172.21.15.36:0/2089698801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7958060100 msgr2=0x7f7958061650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:15.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795d4b1700 1 --2- 172.21.15.36:0/2089698801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7958060100 0x7f7958061650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795d4b1700 1 -- 172.21.15.36:0/2089698801 >> v1:172.21.15.36:6789/0 conn(0x7f79580665d0 legacy=0x7f7958066a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795d4b1700 1 -- 172.21.15.36:0/2089698801 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7958060f10 con 0x7f7958065970 2022-01-10T01:32:15.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795d4b1700 1 --2- 172.21.15.36:0/2089698801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7958065970 0x7f7958065df0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f7954002f70 tx=0x7f7954006df0).ready entity=mon.1 client_cookie=c9164bdc0946e059 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:15.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ccb0700 1 -- 172.21.15.36:0/2089698801 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f795400d4a0 con 0x7f7958065970 2022-01-10T01:32:15.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ccb0700 1 -- 172.21.15.36:0/2089698801 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7954000e90 con 0x7f7958065970 2022-01-10T01:32:15.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ccb0700 1 -- 172.21.15.36:0/2089698801 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f795400d7f0 con 0x7f7958065970 2022-01-10T01:32:15.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ff16700 1 -- 172.21.15.36:0/2089698801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7958065970 msgr2=0x7f7958065df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ff16700 1 --2- 172.21.15.36:0/2089698801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7958065970 0x7f7958065df0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f7954002f70 tx=0x7f7954006df0).stop 2022-01-10T01:32:15.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ff16700 1 -- 172.21.15.36:0/2089698801 shutdown_connections 2022-01-10T01:32:15.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ff16700 1 --2- 172.21.15.36:0/2089698801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7958065970 0x7f7958065df0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ff16700 1 --2- 172.21.15.36:0/2089698801 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7958060100 0x7f7958061650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ff16700 1 -- 172.21.15.36:0/2089698801 >> 172.21.15.36:0/2089698801 conn(0x7f795805cf30 msgr2=0x7f795805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:15.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ff16700 1 -- 172.21.15.36:0/2089698801 shutdown_connections 2022-01-10T01:32:15.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.955+0000 7f795ff16700 1 -- 172.21.15.36:0/2089698801 wait complete. 2022-01-10T01:32:15.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795ff16700 1 Processor -- start 2022-01-10T01:32:15.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795ff16700 1 -- start start 2022-01-10T01:32:15.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795ff16700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7958060100 0x7f7958146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795ff16700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7958065970 0x7f795813f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795ff16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79580665d0 0x7f795813fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795ff16700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79580a54f0 con 0x7f7958065970 2022-01-10T01:32:15.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795ff16700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79580a5790 con 0x7f7958060100 2022-01-10T01:32:15.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795ff16700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79580a5a30 con 0x7f79580665d0 2022-01-10T01:32:15.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795d4b1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7958065970 0x7f795813f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795d4b1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7958065970 0x7f795813f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40390/0 (socket says 172.21.15.36:40390) 2022-01-10T01:32:15.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795d4b1700 1 -- 172.21.15.36:0/798547713 learned_addr learned my addr 172.21.15.36:0/798547713 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:15.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795e4b3700 1 --2- 172.21.15.36:0/798547713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79580665d0 0x7f795813fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795dcb2700 1 --2- 172.21.15.36:0/798547713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7958060100 0x7f7958146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795d4b1700 1 -- 172.21.15.36:0/798547713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79580665d0 msgr2=0x7f795813fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795d4b1700 1 --2- 172.21.15.36:0/798547713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79580665d0 0x7f795813fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795d4b1700 1 -- 172.21.15.36:0/798547713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7958060100 msgr2=0x7f7958146dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:15.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795d4b1700 1 --2- 172.21.15.36:0/798547713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7958060100 0x7f7958146dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:15.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795d4b1700 1 -- 172.21.15.36:0/798547713 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795400b180 con 0x7f7958065970 2022-01-10T01:32:15.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795d4b1700 1 --2- 172.21.15.36:0/798547713 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7958065970 0x7f795813f7b0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f7954002f70 tx=0x7f7954014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:15.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f7946ffd700 1 -- 172.21.15.36:0/798547713 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79540139c0 con 0x7f7958065970 2022-01-10T01:32:15.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f7946ffd700 1 -- 172.21.15.36:0/798547713 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7954013b20 con 0x7f7958065970 2022-01-10T01:32:15.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.959+0000 7f795ff16700 1 -- 172.21.15.36:0/798547713 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79580a9440 con 0x7f7958065970 2022-01-10T01:32:15.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.963+0000 7f7946ffd700 1 -- 172.21.15.36:0/798547713 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7954013e80 con 0x7f7958065970 2022-01-10T01:32:15.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.963+0000 7f795ff16700 1 -- 172.21.15.36:0/798547713 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79580a4020 con 0x7f7958065970 2022-01-10T01:32:15.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.963+0000 7f795ff16700 1 -- 172.21.15.36:0/798547713 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7958155bd0 con 0x7f7958065970 2022-01-10T01:32:15.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.963+0000 7f7946ffd700 1 -- 172.21.15.36:0/798547713 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7954025030 con 0x7f7958065970 2022-01-10T01:32:15.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.963+0000 7f7946ffd700 1 --2- 172.21.15.36:0/798547713 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7938053590 0x7f7938055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:15.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.963+0000 7f795dcb2700 1 --2- 172.21.15.36:0/798547713 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7938053590 0x7f7938055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:15.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.963+0000 7f7946ffd700 1 -- 172.21.15.36:0/798547713 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f795406c6e0 con 0x7f7958065970 2022-01-10T01:32:15.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.963+0000 7f795dcb2700 1 --2- 172.21.15.36:0/798547713 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7938053590 0x7f7938055a50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f794800b000 tx=0x7f7948006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:15.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:15.967+0000 7f7946ffd700 1 -- 172.21.15.36:0/798547713 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f79540435e0 con 0x7f7958065970 2022-01-10T01:32:16.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.095+0000 7f795ff16700 1 -- 172.21.15.36:0/798547713 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f79580611b0 con 0x7f7958065970 2022-01-10T01:32:16.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.095+0000 7f7946ffd700 1 -- 172.21.15.36:0/798547713 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+34051 (secure 0 0 0) 0x7f7954023090 con 0x7f7958065970 2022-01-10T01:32:16.100 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:16.101 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:32:16.101 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 110, 2022-01-10T01:32:16.101 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:32:16.101 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:32:16.102 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:32:06.655202+0000", 2022-01-10T01:32:16.102 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:32:16.102 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:32:16.102 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:32:16.103 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:32:16.103 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:32:16.103 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:32:16.103 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:32:16.104 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:32:16.104 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:32:16.104 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:32:16.104 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:32:16.105 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:32:16.105 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:32:16.105 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:32:16.105 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:32:16.106 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 20, 2022-01-10T01:32:16.106 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:32:16.106 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:32:16.106 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:32:16.106 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:32:16.107 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:32:16.107 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.107 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:32:16.107 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:32:16.108 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:32:16.108 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:32:16.108 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:32:16.108 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:32:16.109 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:32:16.109 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:32:16.109 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:32:16.109 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:32:16.109 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:32:16.110 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:32:16.110 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:32:16.110 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:32:16.111 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:32:16.111 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:32:16.111 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:32:16.111 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:32:16.112 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:32:16.112 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:32:16.112 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:32:16.112 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:32:16.113 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:32:16.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.113 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:32:16.113 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:32:16.113 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:32:16.114 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:32:16.114 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:32:16.114 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:32:16.114 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:32:16.115 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:32:16.115 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:32:16.115 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:32:16.115 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:32:16.116 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:32:16.116 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:32:16.116 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:32:16.116 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:32:16.116 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:32:16.117 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:32:16.117 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:32:16.117 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:32:16.117 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:32:16.117 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:32:16.118 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:32:16.118 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:32:16.118 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:32:16.119 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:32:16.119 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:32:16.119 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:32:16.119 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.120 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:32:16.120 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:32:16.120 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:32:16.120 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:32:16.121 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:32:16.121 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:32:16.121 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:32:16.121 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:32:16.122 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:32:16.122 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:32:16.122 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:32:16.122 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:32:16.123 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:32:16.123 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.123 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:32:16.123 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:32:16.123 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.124 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.124 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:32:16.124 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:32:16.125 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:32:16.125 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:32:16.125 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:32:16.125 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:32:16.125 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:32:16.126 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:32:16.126 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:32:16.126 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:32:16.126 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:32:16.127 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:32:16.127 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:32:16.127 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:32:16.127 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:32:16.128 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:32:16.128 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:32:16.128 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:32:16.128 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:32:16.128 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:32:16.129 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:32:16.129 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:32:16.129 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:32:16.129 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.130 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:32:16.130 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:32:16.130 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:32:16.130 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:32:16.130 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:32:16.131 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:32:16.131 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:32:16.131 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:32:16.131 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:32:16.132 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:32:16.132 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:32:16.132 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:32:16.132 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:32:16.133 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:32:16.133 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:32:16.133 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:32:16.133 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:32:16.133 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:32:16.134 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:32:16.134 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:32:16.134 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:32:16.134 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:32:16.135 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:32:16.135 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:32:16.135 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:32:16.135 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:32:16.135 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:32:16.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.136 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:32:16.136 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:32:16.136 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:32:16.137 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:32:16.137 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:32:16.137 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:32:16.137 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:32:16.137 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:32:16.138 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:32:16.138 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:32:16.138 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:32:16.138 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:32:16.138 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:32:16.139 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:32:16.139 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.139 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.139 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 19, 2022-01-10T01:32:16.140 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_metadata", 2022-01-10T01:32:16.140 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:32:04.130397+0000", 2022-01-10T01:32:16.140 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:32:16.140 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:32:16.141 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:32:16.141 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:32:16.141 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:32:16.141 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:32:16.141 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:32:16.142 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:32:16.142 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:32:16.142 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:32:16.142 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:32:16.143 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:32:16.143 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:32:16.143 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:32:16.143 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:32:16.143 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:32:16.144 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:32:16.144 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:32:16.144 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:32:16.144 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:32:16.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.145 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "110", 2022-01-10T01:32:16.145 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:32:16.145 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:32:16.145 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:32:16.146 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:32:16.146 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:32:16.146 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:32:16.146 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:32:16.146 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:32:16.147 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:32:16.147 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:32:16.147 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:32:16.147 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:32:16.148 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:32:16.148 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:32:16.148 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:32:16.148 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:32:16.148 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:32:16.149 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:32:16.149 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:32:16.149 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:32:16.149 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:32:16.149 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:32:16.150 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:32:16.150 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:32:16.150 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:32:16.150 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:32:16.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.151 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:32:16.151 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:32:16.151 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:32:16.151 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:32:16.152 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:32:16.152 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:32:16.152 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:32:16.152 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:32:16.152 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:32:16.153 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:32:16.153 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:32:16.153 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:32:16.153 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_bias": 4, 2022-01-10T01:32:16.154 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 16, 2022-01-10T01:32:16.154 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_priority": 5 2022-01-10T01:32:16.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.154 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:32:16.154 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:32:16.155 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": "cephfs" 2022-01-10T01:32:16.155 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.155 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.156 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 20, 2022-01-10T01:32:16.156 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_data", 2022-01-10T01:32:16.156 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:32:05.331515+0000", 2022-01-10T01:32:16.156 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:32:16.157 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:32:16.157 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:32:16.157 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:32:16.157 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:32:16.157 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:32:16.158 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:32:16.158 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:32:16.158 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:32:16.158 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:32:16.159 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:32:16.159 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:32:16.159 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:32:16.159 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:32:16.159 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:32:16.160 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:32:16.160 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:32:16.160 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:32:16.160 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:32:16.160 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:32:16.161 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.161 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "110", 2022-01-10T01:32:16.161 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:32:16.161 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:32:16.162 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:32:16.162 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:32:16.162 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:32:16.162 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:32:16.162 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:32:16.163 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:32:16.163 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:32:16.163 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:32:16.163 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:32:16.163 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:32:16.164 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:32:16.164 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:32:16.164 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:32:16.164 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:32:16.165 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:32:16.165 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:32:16.165 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:32:16.165 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:32:16.165 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:32:16.166 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:32:16.166 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:32:16.166 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:32:16.166 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:32:16.167 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:32:16.167 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.167 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:32:16.168 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:32:16.168 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:32:16.168 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:32:16.169 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:32:16.169 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:32:16.169 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:32:16.169 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:32:16.169 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:32:16.170 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:32:16.170 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:32:16.170 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:32:16.170 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:32:16.171 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:32:16.171 INFO:teuthology.orchestra.run.smithi036.stdout: "data": "cephfs" 2022-01-10T01:32:16.171 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.171 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.172 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.172 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:32:16.172 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:32:16.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.173 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:32:16.173 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:32:16.173 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:16.173 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:16.173 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:16.174 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:16.174 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:16.174 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:16.174 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:16.175 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 107, 2022-01-10T01:32:16.175 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:16.175 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:16.175 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:16.176 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.176 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.176 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:32:16.177 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:16.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.177 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.178 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:32:16.178 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:16.178 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.179 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.179 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:16.180 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.180 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.181 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:32:16.181 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:16.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.182 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.183 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:32:16.183 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:16.184 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.184 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.184 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.185 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:16.185 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.186 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.186 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:32:16.187 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:16.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.188 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.188 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:32:16.189 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:16.189 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.189 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.190 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:16.190 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.191 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.191 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.191 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:32:16.192 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:16.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.193 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.193 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.193 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:32:16.193 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:16.194 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.194 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.194 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:32:16.195 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:32:16.195 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:32:16.195 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:32:16.195 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:16.196 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:16.196 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:16.196 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.197 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:32:16.197 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:32:16.197 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:16.197 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:16.198 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:16.198 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:16.198 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:16.199 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:16.199 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:16.200 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 106, 2022-01-10T01:32:16.200 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:16.200 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:16.201 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:16.201 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.201 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.201 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.202 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:32:16.202 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:16.202 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.203 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.203 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:32:16.203 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:16.203 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.204 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.204 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.204 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:16.204 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.205 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.205 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:32:16.205 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:16.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.206 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.206 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:32:16.206 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:16.206 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.207 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.207 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:16.207 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.208 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.208 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:32:16.208 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:16.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.209 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.209 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.209 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:32:16.209 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:16.210 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.210 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.210 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:16.211 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.211 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.211 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:32:16.211 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:16.212 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.212 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.212 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:32:16.213 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:16.213 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.213 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.213 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:32:16.214 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:32:16.214 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:32:16.214 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:32:16.214 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:16.215 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:16.215 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:16.215 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.216 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:32:16.216 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:32:16.216 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:16.216 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:16.217 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:16.217 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:16.217 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:16.217 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:16.218 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:16.218 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 107, 2022-01-10T01:32:16.218 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:16.218 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:16.219 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:16.219 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.219 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.220 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:32:16.220 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:16.220 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.220 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.220 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.221 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:32:16.221 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:16.221 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.221 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.222 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:16.222 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.223 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.223 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:32:16.223 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:16.223 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.223 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.224 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.224 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:32:16.224 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:16.224 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.225 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.225 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:16.225 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.226 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.226 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:32:16.226 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:16.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.227 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.227 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:32:16.227 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:16.228 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.228 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.228 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:16.229 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.229 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.229 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.229 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:32:16.229 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:16.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.230 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.230 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:32:16.231 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:16.231 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.231 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.232 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:32:16.232 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:32:16.232 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:32:16.232 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:32:16.233 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:16.233 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:16.233 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:16.233 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.234 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:32:16.234 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:32:16.234 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:16.235 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:16.235 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:16.235 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:16.235 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:16.236 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:16.236 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:16.236 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 107, 2022-01-10T01:32:16.236 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:16.236 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:16.237 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:16.237 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.237 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.238 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:32:16.238 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:16.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.238 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.239 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:32:16.239 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:16.239 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.239 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.240 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:16.240 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.240 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.241 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:32:16.241 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:16.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.242 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.242 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:32:16.242 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:16.242 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.243 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.243 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:16.243 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.244 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.244 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:32:16.244 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:16.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.245 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.245 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:32:16.245 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:16.245 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.246 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.246 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:16.246 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.247 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.247 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.247 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:32:16.247 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:16.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.248 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.248 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:32:16.249 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:16.249 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.249 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.249 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:32:16.250 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:32:16.250 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:32:16.250 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:32:16.250 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:16.251 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:16.251 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:16.251 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.252 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.252 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:32:16.252 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:32:16.252 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:16.252 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:16.253 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:16.253 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:16.253 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:16.253 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:16.254 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:16.254 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 106, 2022-01-10T01:32:16.254 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:16.254 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:16.255 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:16.255 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.255 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.256 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:32:16.256 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:16.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.257 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.257 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:32:16.257 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:16.257 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.258 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.258 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:16.258 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.259 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.259 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.259 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:32:16.259 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:16.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.260 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.260 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:32:16.260 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:16.261 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.261 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.261 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:16.262 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.262 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.262 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.262 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:32:16.263 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:16.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.264 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.264 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:32:16.264 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:16.264 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.264 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.265 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:16.265 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.266 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.266 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:32:16.266 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:16.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.267 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.267 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:32:16.267 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:16.268 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.268 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.269 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:32:16.269 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:32:16.270 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:32:16.270 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:32:16.270 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:16.271 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:16.271 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:16.272 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.273 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:32:16.273 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:32:16.274 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:16.274 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:16.275 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:16.275 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:16.276 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:16.276 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:16.276 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:16.277 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 107, 2022-01-10T01:32:16.278 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:16.278 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:16.279 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:16.279 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.279 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.280 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:32:16.280 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:16.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.281 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.281 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:32:16.282 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:16.282 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.282 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.282 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:16.283 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.283 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.284 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:32:16.284 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:16.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.285 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.285 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:32:16.285 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:16.285 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.286 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.286 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:16.286 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.287 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.287 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:32:16.287 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:16.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.288 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.288 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:32:16.288 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:16.289 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.289 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.289 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:16.290 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.290 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.290 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:32:16.291 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:16.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.291 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.292 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:32:16.292 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:16.292 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.292 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.293 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:32:16.293 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:32:16.293 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:32:16.294 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:32:16.294 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:16.294 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:16.295 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:16.295 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.295 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.295 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:32:16.296 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:32:16.296 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:16.296 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:16.296 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:16.297 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:16.297 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:16.297 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:16.298 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:16.298 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 107, 2022-01-10T01:32:16.298 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:16.298 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:16.299 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:16.299 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.299 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.300 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:32:16.300 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:16.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.300 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.301 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.301 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:32:16.301 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:16.302 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.302 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.303 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:16.303 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.303 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.303 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.303 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:32:16.304 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:16.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.305 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.305 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:32:16.305 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:16.305 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.306 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.306 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:16.306 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.307 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.307 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.307 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:32:16.307 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:16.308 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.308 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.308 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.308 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:32:16.309 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:16.309 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.309 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.310 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:16.310 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.310 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.310 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:32:16.311 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:16.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.311 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.312 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:32:16.312 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:16.312 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.312 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.313 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:32:16.313 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:32:16.313 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:32:16.314 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:32:16.314 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:16.314 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:16.314 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:16.315 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.316 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:32:16.316 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:32:16.316 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:16.316 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:16.317 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:16.317 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:16.317 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:16.317 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:16.318 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:16.318 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 107, 2022-01-10T01:32:16.318 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:16.318 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:16.319 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:16.319 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.319 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.320 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:32:16.320 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:16.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.320 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.320 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.321 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:32:16.321 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:16.321 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.321 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.322 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:16.322 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.323 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.323 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:32:16.323 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:16.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.324 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.324 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.324 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:32:16.324 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:16.325 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.325 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.326 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:16.326 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.327 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.327 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:32:16.328 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:16.328 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.329 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.329 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:32:16.329 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:16.329 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.330 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.332 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:16.333 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:16.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.333 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:16.333 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:32:16.334 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:16.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.334 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.334 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:16.335 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:32:16.335 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:16.335 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.335 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.336 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:32:16.336 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:32:16.336 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:32:16.337 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:32:16.337 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:16.337 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:16.337 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:16.338 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:16.338 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.338 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:32:16.339 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:32:16.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.339 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:32:16.340 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:16.340 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:16.341 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:16.341 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:16.341 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:16.342 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:32:16.342 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:16.342 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.343 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:32:16.343 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:16.343 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:16.344 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:16.344 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:16.344 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:16.344 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:32:16.344 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:16.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.345 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.345 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:32:16.345 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:16.346 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:16.346 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:16.346 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:16.347 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:16.347 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:32:16.347 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:16.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.348 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:32:16.348 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:16.348 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:16.348 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:16.349 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:16.349 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:16.349 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:32:16.349 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:16.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.350 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:32:16.350 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:16.351 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:16.351 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:16.351 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:16.351 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:16.351 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:32:16.352 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:16.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.353 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:32:16.353 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:16.353 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:16.353 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:16.354 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:16.354 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:16.354 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:32:16.354 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:16.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.355 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:32:16.355 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:16.355 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:16.356 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:16.356 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:16.356 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:16.356 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:32:16.357 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:16.357 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.357 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:16.357 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:32:16.358 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:16.358 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:16.358 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:16.358 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:16.359 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:16.359 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:32:16.359 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:16.359 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.360 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:32:16.360 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:32:16.360 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:32:16.360 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:32:16.360 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:32:16.361 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2022-01-10T01:32:16.361 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:32:16.361 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:32:16.361 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:32:16.362 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:32:16.362 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:32:16.362 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:32:16.363 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:32:16.363 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:32:16.363 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:32:16.363 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:32:16.364 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:32:16.364 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:32:16.364 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.364 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:32:16.364 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:32:16.365 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:32:16.365 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:32:16.365 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:32:16.365 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:32:16.365 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:32:16.366 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:16.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:16.366 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:32:16.367 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:32:16.367 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:32:16.367 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:32:16.367 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:32:16.368 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:32:16.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.099+0000 7f795ff16700 1 -- 172.21.15.36:0/798547713 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7938053590 msgr2=0x7f7938055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:16.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.099+0000 7f795ff16700 1 --2- 172.21.15.36:0/798547713 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7938053590 0x7f7938055a50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f794800b000 tx=0x7f7948006df0).stop 2022-01-10T01:32:16.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.099+0000 7f795ff16700 1 -- 172.21.15.36:0/798547713 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7958065970 msgr2=0x7f795813f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:16.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.099+0000 7f795ff16700 1 --2- 172.21.15.36:0/798547713 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7958065970 0x7f795813f7b0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f7954002f70 tx=0x7f7954014000).stop 2022-01-10T01:32:16.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.099+0000 7f795ff16700 1 -- 172.21.15.36:0/798547713 shutdown_connections 2022-01-10T01:32:16.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.099+0000 7f795ff16700 1 --2- 172.21.15.36:0/798547713 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7938053590 0x7f7938055a50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.099+0000 7f795ff16700 1 --2- 172.21.15.36:0/798547713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79580665d0 0x7f795813fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.099+0000 7f795ff16700 1 --2- 172.21.15.36:0/798547713 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7958065970 0x7f795813f7b0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.099+0000 7f795ff16700 1 --2- 172.21.15.36:0/798547713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7958060100 0x7f7958146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.099+0000 7f795ff16700 1 -- 172.21.15.36:0/798547713 >> 172.21.15.36:0/798547713 conn(0x7f795805cf30 msgr2=0x7f7958066a10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:16.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.099+0000 7f795ff16700 1 -- 172.21.15.36:0/798547713 shutdown_connections 2022-01-10T01:32:16.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.099+0000 7f795ff16700 1 -- 172.21.15.36:0/798547713 wait complete. 2022-01-10T01:32:16.374 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:32:16.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.479+0000 7fe525ea8700 1 Processor -- start 2022-01-10T01:32:16.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.479+0000 7fe525ea8700 1 -- start start 2022-01-10T01:32:16.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.479+0000 7fe525ea8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe520060100 0x7fe5200b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:16.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.479+0000 7fe525ea8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5200b4c40 0x7fe52014b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:16.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.479+0000 7fe525ea8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5200aabb0 con 0x7fe520067300 2022-01-10T01:32:16.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.479+0000 7fe525ea8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5200604e0 con 0x7fe520060100 2022-01-10T01:32:16.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.479+0000 7fe525ea8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe520066ea0 con 0x7fe5200b4c40 2022-01-10T01:32:16.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.479+0000 7fe51effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe520067300 0x7fe5201438f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:55866/0 (socket says 172.21.15.36:55866) 2022-01-10T01:32:16.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.479+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5200b4c40 0x7fe52014b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:16.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.479+0000 7fe51effd700 1 -- 172.21.15.36:0/3160734698 learned_addr learned my addr 172.21.15.36:0/3160734698 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:16.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.479+0000 7fe51f7fe700 1 --2- 172.21.15.36:0/3160734698 >> v2:172.21.15.59:3300/0 conn(0x7fe520060100 0x7fe5200b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:16.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe51e7fc700 1 -- 172.21.15.36:0/3160734698 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470592365 0 0) 0x7fe5200aabb0 con 0x7fe520067300 2022-01-10T01:32:16.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe51ffff700 1 -- 172.21.15.36:0/3160734698 >> v2:172.21.15.59:3300/0 conn(0x7fe520060100 msgr2=0x7fe5200b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:16.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe51ffff700 1 --2- 172.21.15.36:0/3160734698 >> v2:172.21.15.59:3300/0 conn(0x7fe520060100 0x7fe5200b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe51ffff700 1 -- 172.21.15.36:0/3160734698 >> v1:172.21.15.59:6789/0 conn(0x7fe520067300 legacy=0x7fe5201438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:16.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe51ffff700 1 -- 172.21.15.36:0/3160734698 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5200b33b0 con 0x7fe5200b4c40 2022-01-10T01:32:16.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe51ffff700 1 --2- 172.21.15.36:0/3160734698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5200b4c40 0x7fe52014b850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fe518002f70 tx=0x7fe518006df0).ready entity=mon.2 client_cookie=84a6b0a9a498211b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:16.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe51e7fc700 1 -- 172.21.15.36:0/3160734698 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe51800d570 con 0x7fe5200b4c40 2022-01-10T01:32:16.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe51e7fc700 1 -- 172.21.15.36:0/3160734698 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe518000e90 con 0x7fe5200b4c40 2022-01-10T01:32:16.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe51e7fc700 1 -- 172.21.15.36:0/3160734698 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe51800d8c0 con 0x7fe5200b4c40 2022-01-10T01:32:16.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe525ea8700 1 -- 172.21.15.36:0/3160734698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5200b4c40 msgr2=0x7fe52014b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:16.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe525ea8700 1 --2- 172.21.15.36:0/3160734698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5200b4c40 0x7fe52014b850 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fe518002f70 tx=0x7fe518006df0).stop 2022-01-10T01:32:16.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe525ea8700 1 -- 172.21.15.36:0/3160734698 shutdown_connections 2022-01-10T01:32:16.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe525ea8700 1 --2- 172.21.15.36:0/3160734698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5200b4c40 0x7fe52014b850 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe525ea8700 1 --2- 172.21.15.36:0/3160734698 >> v2:172.21.15.59:3300/0 conn(0x7fe520060100 0x7fe5200b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe525ea8700 1 -- 172.21.15.36:0/3160734698 >> 172.21.15.36:0/3160734698 conn(0x7fe52005cf30 msgr2=0x7fe52005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:16.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe525ea8700 1 -- 172.21.15.36:0/3160734698 shutdown_connections 2022-01-10T01:32:16.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.483+0000 7fe525ea8700 1 -- 172.21.15.36:0/3160734698 wait complete. 2022-01-10T01:32:16.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe525ea8700 1 Processor -- start 2022-01-10T01:32:16.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe525ea8700 1 -- start start 2022-01-10T01:32:16.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe525ea8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe520060100 0x7fe5200ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:16.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe525ea8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe520067300 0x7fe5200b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:16.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe525ea8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5200b4c40 0x7fe5200adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:16.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe525ea8700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200a4ee0 con 0x7fe520060100 2022-01-10T01:32:16.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe525ea8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200acfd0 con 0x7fe520067300 2022-01-10T01:32:16.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe525ea8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200ad270 con 0x7fe5200b4c40 2022-01-10T01:32:16.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe51f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe520060100 0x7fe5200ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:16.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe51f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe520060100 0x7fe5200ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40402/0 (socket says 172.21.15.36:40402) 2022-01-10T01:32:16.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe51f7fe700 1 -- 172.21.15.36:0/738949984 learned_addr learned my addr 172.21.15.36:0/738949984 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:16.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe51effd700 1 --2- 172.21.15.36:0/738949984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe520067300 0x7fe5200b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:16.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe51ffff700 1 --2- 172.21.15.36:0/738949984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5200b4c40 0x7fe5200adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:16.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe51f7fe700 1 -- 172.21.15.36:0/738949984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5200b4c40 msgr2=0x7fe5200adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:16.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe51f7fe700 1 --2- 172.21.15.36:0/738949984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5200b4c40 0x7fe5200adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe51f7fe700 1 -- 172.21.15.36:0/738949984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe520067300 msgr2=0x7fe5200b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:16.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe51f7fe700 1 --2- 172.21.15.36:0/738949984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe520067300 0x7fe5200b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe51f7fe700 1 -- 172.21.15.36:0/738949984 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51800b180 con 0x7fe520060100 2022-01-10T01:32:16.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe51f7fe700 1 --2- 172.21.15.36:0/738949984 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe520060100 0x7fe5200ad860 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7fe51400c000 tx=0x7fe514006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:16.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe51cff9700 1 -- 172.21.15.36:0/738949984 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe514010780 con 0x7fe520060100 2022-01-10T01:32:16.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe51cff9700 1 -- 172.21.15.36:0/738949984 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5140108e0 con 0x7fe520060100 2022-01-10T01:32:16.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.487+0000 7fe51cff9700 1 -- 172.21.15.36:0/738949984 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe514010c40 con 0x7fe520060100 2022-01-10T01:32:16.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.491+0000 7fe525ea8700 1 -- 172.21.15.36:0/738949984 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5200ac6c0 con 0x7fe520060100 2022-01-10T01:32:16.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.491+0000 7fe525ea8700 1 -- 172.21.15.36:0/738949984 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5200a2cc0 con 0x7fe520060100 2022-01-10T01:32:16.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.491+0000 7fe525ea8700 1 -- 172.21.15.36:0/738949984 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5200a2fa0 con 0x7fe520060100 2022-01-10T01:32:16.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.491+0000 7fe51cff9700 1 -- 172.21.15.36:0/738949984 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe51401c460 con 0x7fe520060100 2022-01-10T01:32:16.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.491+0000 7fe51cff9700 1 --2- 172.21.15.36:0/738949984 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe500053680 0x7fe500055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:16.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.491+0000 7fe51cff9700 1 -- 172.21.15.36:0/738949984 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe51406bdb0 con 0x7fe520060100 2022-01-10T01:32:16.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.491+0000 7fe51effd700 1 --2- 172.21.15.36:0/738949984 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe500053680 0x7fe500055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:16.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.495+0000 7fe51effd700 1 --2- 172.21.15.36:0/738949984 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe500053680 0x7fe500055b40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fe51000d000 tx=0x7fe510007d80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:16.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.499+0000 7fe51cff9700 1 -- 172.21.15.36:0/738949984 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe514042d60 con 0x7fe520060100 2022-01-10T01:32:16.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.663+0000 7fe525ea8700 1 -- 172.21.15.36:0/738949984 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5200ac850 con 0x7fe520060100 2022-01-10T01:32:16.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.663+0000 7fe51cff9700 1 -- 172.21.15.36:0/738949984 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+2484 (secure 0 0 0) 0x7fe514046380 con 0x7fe520060100 2022-01-10T01:32:16.669 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:16.669 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":51,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6836/13281616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":13281616},{"type":"v1","addr":"172.21.15.36:6836","nonce":13281616}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/2168511464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":2168511464},{"type":"v1","addr":"172.21.15.36:6837","nonce":2168511464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:32:05.646058+0000","modified":"2022-01-10T01:32:06.654528+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7264},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7264":{"gid":7264,"name":"b","rank":0,"incarnation":50,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/696360653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":696360653},{"type":"v1","addr":"172.21.15.59:6833","nonce":696360653}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2022-01-10T01:32:16.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.667+0000 7fe525ea8700 1 -- 172.21.15.36:0/738949984 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe500053680 msgr2=0x7fe500055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:16.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.667+0000 7fe525ea8700 1 --2- 172.21.15.36:0/738949984 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe500053680 0x7fe500055b40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fe51000d000 tx=0x7fe510007d80).stop 2022-01-10T01:32:16.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.667+0000 7fe525ea8700 1 -- 172.21.15.36:0/738949984 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe520060100 msgr2=0x7fe5200ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:16.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.667+0000 7fe525ea8700 1 --2- 172.21.15.36:0/738949984 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe520060100 0x7fe5200ad860 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7fe51400c000 tx=0x7fe514006df0).stop 2022-01-10T01:32:16.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.667+0000 7fe525ea8700 1 -- 172.21.15.36:0/738949984 shutdown_connections 2022-01-10T01:32:16.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.667+0000 7fe525ea8700 1 --2- 172.21.15.36:0/738949984 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe500053680 0x7fe500055b40 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.667+0000 7fe525ea8700 1 --2- 172.21.15.36:0/738949984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5200b4c40 0x7fe5200adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.667+0000 7fe525ea8700 1 --2- 172.21.15.36:0/738949984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe520067300 0x7fe5200b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.667+0000 7fe525ea8700 1 --2- 172.21.15.36:0/738949984 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe520060100 0x7fe5200ad860 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.667+0000 7fe525ea8700 1 -- 172.21.15.36:0/738949984 >> 172.21.15.36:0/738949984 conn(0x7fe52005cf30 msgr2=0x7fe52005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:16.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.667+0000 7fe525ea8700 1 -- 172.21.15.36:0/738949984 shutdown_connections 2022-01-10T01:32:16.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.667+0000 7fe525ea8700 1 -- 172.21.15.36:0/738949984 wait complete. 2022-01-10T01:32:16.675 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 51 2022-01-10T01:32:16.686 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2022-01-10T01:32:16.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.783+0000 7f3bc6e5e700 1 Processor -- start 2022-01-10T01:32:16.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.783+0000 7f3bc6e5e700 1 -- start start 2022-01-10T01:32:16.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc6e5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bc00b2580 0x7f3bc00abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:16.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc6e5e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3bc00b02e0 0x7f3bc00ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:16.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc6e5e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc00add80 con 0x7f3bc00b1260 2022-01-10T01:32:16.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc6e5e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc00ae020 con 0x7f3bc00b02e0 2022-01-10T01:32:16.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc6e5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc00a9390 con 0x7f3bc00b2580 2022-01-10T01:32:16.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc565b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f3bc00b1260 0x7f3bc00afbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38204/0 (socket says 172.21.15.36:38204) 2022-01-10T01:32:16.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc565b700 1 -- 172.21.15.36:0/1930615983 learned_addr learned my addr 172.21.15.36:0/1930615983 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:16.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc665d700 1 --2- 172.21.15.36:0/1930615983 >> v2:172.21.15.36:3300/0 conn(0x7f3bc00b02e0 0x7f3bc00ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:16.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc5e5c700 1 --2- 172.21.15.36:0/1930615983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bc00b2580 0x7f3bc00abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:16.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc4e5a700 1 -- 172.21.15.36:0/1930615983 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876966139 0 0) 0x7f3bc00add80 con 0x7f3bc00b1260 2022-01-10T01:32:16.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc4e5a700 1 -- 172.21.15.36:0/1930615983 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ba8003260 con 0x7f3bc00b1260 2022-01-10T01:32:16.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc665d700 1 -- 172.21.15.36:0/1930615983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bc00b2580 msgr2=0x7f3bc00abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:16.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc665d700 1 --2- 172.21.15.36:0/1930615983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bc00b2580 0x7f3bc00abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc665d700 1 -- 172.21.15.36:0/1930615983 >> v1:172.21.15.36:6789/0 conn(0x7f3bc00b1260 legacy=0x7f3bc00afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:16.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc665d700 1 -- 172.21.15.36:0/1930615983 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc00a9830 con 0x7f3bc00b02e0 2022-01-10T01:32:16.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc665d700 1 --2- 172.21.15.36:0/1930615983 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3bc00b02e0 0x7f3bc00ac000 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f3bb80032f0 tx=0x7f3bb80091d0).ready entity=mon.0 client_cookie=927e8b6119eb1a7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:16.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc4e5a700 1 -- 172.21.15.36:0/1930615983 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bb800b600 con 0x7f3bc00b02e0 2022-01-10T01:32:16.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc4e5a700 1 -- 172.21.15.36:0/1930615983 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb800b760 con 0x7f3bc00b02e0 2022-01-10T01:32:16.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc4e5a700 1 -- 172.21.15.36:0/1930615983 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bb800b8d0 con 0x7f3bc00b02e0 2022-01-10T01:32:16.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/1930615983 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3bc00b02e0 msgr2=0x7f3bc00ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:16.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc6e5e700 1 --2- 172.21.15.36:0/1930615983 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3bc00b02e0 0x7f3bc00ac000 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f3bb80032f0 tx=0x7f3bb80091d0).stop 2022-01-10T01:32:16.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/1930615983 shutdown_connections 2022-01-10T01:32:16.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc6e5e700 1 --2- 172.21.15.36:0/1930615983 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3bc00b02e0 0x7f3bc00ac000 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc6e5e700 1 --2- 172.21.15.36:0/1930615983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bc00b2580 0x7f3bc00abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/1930615983 >> 172.21.15.36:0/1930615983 conn(0x7f3bc0060180 msgr2=0x7f3bc00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:16.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/1930615983 shutdown_connections 2022-01-10T01:32:16.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.787+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/1930615983 wait complete. 2022-01-10T01:32:16.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc6e5e700 1 Processor -- start 2022-01-10T01:32:16.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc6e5e700 1 -- start start 2022-01-10T01:32:16.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc6e5e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3bc00b02e0 0x7f3bc0066460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:16.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc6e5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc00b1260 0x7f3bc013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:16.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc6e5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bc00b2580 0x7f3bc013c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:16.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc6e5e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc0066af0 con 0x7f3bc00b02e0 2022-01-10T01:32:16.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc6e5e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc0066f50 con 0x7f3bc00b1260 2022-01-10T01:32:16.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc6e5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc0144360 con 0x7f3bc00b2580 2022-01-10T01:32:16.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc5e5c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3bc00b02e0 0x7f3bc0066460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:16.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc5e5c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3bc00b02e0 0x7f3bc0066460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40416/0 (socket says 172.21.15.36:40416) 2022-01-10T01:32:16.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc5e5c700 1 -- 172.21.15.36:0/3812171946 learned_addr learned my addr 172.21.15.36:0/3812171946 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:16.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc665d700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bc00b2580 0x7f3bc013c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:16.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc565b700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc00b1260 0x7f3bc013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:16.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc5e5c700 1 -- 172.21.15.36:0/3812171946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bc00b2580 msgr2=0x7f3bc013c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:16.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc5e5c700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bc00b2580 0x7f3bc013c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc5e5c700 1 -- 172.21.15.36:0/3812171946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc00b1260 msgr2=0x7f3bc013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:16.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc5e5c700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc00b1260 0x7f3bc013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:16.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc5e5c700 1 -- 172.21.15.36:0/3812171946 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb8009470 con 0x7f3bc00b02e0 2022-01-10T01:32:16.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc565b700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc00b1260 0x7f3bc013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:32:16.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc5e5c700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3bc00b02e0 0x7f3bc0066460 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f3bbc00c000 tx=0x7f3bbc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:16.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3baeffd700 1 -- 172.21.15.36:0/3812171946 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bbc00c830 con 0x7f3bc00b02e0 2022-01-10T01:32:16.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/3812171946 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc01426e0 con 0x7f3bc00b02e0 2022-01-10T01:32:16.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3baeffd700 1 -- 172.21.15.36:0/3812171946 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc00c990 con 0x7f3bc00b02e0 2022-01-10T01:32:16.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3baeffd700 1 -- 172.21.15.36:0/3812171946 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bbc00ccf0 con 0x7f3bc00b02e0 2022-01-10T01:32:16.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/3812171946 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc013c710 con 0x7f3bc00b02e0 2022-01-10T01:32:16.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.791+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/3812171946 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc0057350 con 0x7f3bc00b02e0 2022-01-10T01:32:16.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.795+0000 7f3baeffd700 1 -- 172.21.15.36:0/3812171946 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3bbc01c460 con 0x7f3bc00b02e0 2022-01-10T01:32:16.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.795+0000 7f3baeffd700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ba00535f0 0x7f3ba0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:16.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.795+0000 7f3baeffd700 1 -- 172.21.15.36:0/3812171946 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3bbc06bfe0 con 0x7f3bc00b02e0 2022-01-10T01:32:16.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.795+0000 7f3bc565b700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ba00535f0 0x7f3ba0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:16.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.795+0000 7f3bc565b700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ba00535f0 0x7f3ba0055ab0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f3bb0008000 tx=0x7f3bb0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:16.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.799+0000 7f3baeffd700 1 -- 172.21.15.36:0/3812171946 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3bbc042ef0 con 0x7f3bc00b02e0 2022-01-10T01:32:16.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:16.967+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/3812171946 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3bc00698e0 con 0x7f3bc00b02e0 2022-01-10T01:32:17.655 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:32:17.651+0000 7f0b5376f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:32:17.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.667+0000 7f3baeffd700 1 -- 172.21.15.36:0/3812171946 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3bbc046510 con 0x7f3bc00b02e0 2022-01-10T01:32:17.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.671+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/3812171946 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ba00535f0 msgr2=0x7f3ba0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:17.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.671+0000 7f3bc6e5e700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ba00535f0 0x7f3ba0055ab0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f3bb0008000 tx=0x7f3bb0009040).stop 2022-01-10T01:32:17.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.671+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/3812171946 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3bc00b02e0 msgr2=0x7f3bc0066460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:17.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.671+0000 7f3bc6e5e700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3bc00b02e0 0x7f3bc0066460 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f3bbc00c000 tx=0x7f3bbc006df0).stop 2022-01-10T01:32:17.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.671+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/3812171946 shutdown_connections 2022-01-10T01:32:17.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.671+0000 7f3bc6e5e700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ba00535f0 0x7f3ba0055ab0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:17.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.671+0000 7f3bc6e5e700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bc00b2580 0x7f3bc013c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:17.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.671+0000 7f3bc6e5e700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bc00b1260 0x7f3bc013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:17.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.671+0000 7f3bc6e5e700 1 --2- 172.21.15.36:0/3812171946 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3bc00b02e0 0x7f3bc0066460 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:17.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.671+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/3812171946 >> 172.21.15.36:0/3812171946 conn(0x7f3bc0060180 msgr2=0x7f3bc00ab9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:17.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.671+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/3812171946 shutdown_connections 2022-01-10T01:32:17.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.671+0000 7f3bc6e5e700 1 -- 172.21.15.36:0/3812171946 wait complete. 2022-01-10T01:32:17.679 INFO:teuthology.orchestra.run.smithi036.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2022-01-10T01:32:17.690 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:32:17.698 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:32:17.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 Processor -- start 2022-01-10T01:32:17.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 -- start start 2022-01-10T01:32:17.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed900b18f0 0x7fed900b2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:17.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed900a9c10 0x7fed90147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:17.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed900b33e0 con 0x7fed900b3000 2022-01-10T01:32:17.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed900b27f0 con 0x7fed900a9c10 2022-01-10T01:32:17.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed900b0c70 con 0x7fed900b18f0 2022-01-10T01:32:17.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed9514e700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fed900b3000 0x7fed90065510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38220/0 (socket says 172.21.15.36:38220) 2022-01-10T01:32:17.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed9514e700 1 -- 172.21.15.36:0/1465336332 learned_addr learned my addr 172.21.15.36:0/1465336332 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:17.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed9594f700 1 --2- 172.21.15.36:0/1465336332 >> v2:172.21.15.59:3300/0 conn(0x7fed900a9c10 0x7fed90147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:17.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed9494d700 1 --2- 172.21.15.36:0/1465336332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed900b18f0 0x7fed900b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:17.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed7ffff700 1 -- 172.21.15.36:0/1465336332 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287227970 0 0) 0x7fed900b33e0 con 0x7fed900b3000 2022-01-10T01:32:17.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed7ffff700 1 -- 172.21.15.36:0/1465336332 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed78003260 con 0x7fed900b3000 2022-01-10T01:32:17.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed9594f700 1 -- 172.21.15.36:0/1465336332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed900b18f0 msgr2=0x7fed900b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:17.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed9594f700 1 --2- 172.21.15.36:0/1465336332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed900b18f0 0x7fed900b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:17.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed9594f700 1 -- 172.21.15.36:0/1465336332 >> v1:172.21.15.36:6789/0 conn(0x7fed900b3000 legacy=0x7fed90065510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:17.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed9594f700 1 -- 172.21.15.36:0/1465336332 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed900b0f10 con 0x7fed900a9c10 2022-01-10T01:32:17.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed9494d700 1 --2- 172.21.15.36:0/1465336332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed900b18f0 0x7fed900b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:17.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed9594f700 1 --2- 172.21.15.36:0/1465336332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed900a9c10 0x7fed90147ca0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fed880032f0 tx=0x7fed880091d0).ready entity=mon.1 client_cookie=3df006c63ada4bb6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:17.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed7ffff700 1 -- 172.21.15.36:0/1465336332 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8800b600 con 0x7fed900a9c10 2022-01-10T01:32:17.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed7ffff700 1 -- 172.21.15.36:0/1465336332 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8800b760 con 0x7fed900a9c10 2022-01-10T01:32:17.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed7ffff700 1 -- 172.21.15.36:0/1465336332 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8800b8d0 con 0x7fed900a9c10 2022-01-10T01:32:17.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 -- 172.21.15.36:0/1465336332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed900a9c10 msgr2=0x7fed90147ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:17.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 --2- 172.21.15.36:0/1465336332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed900a9c10 0x7fed90147ca0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fed880032f0 tx=0x7fed880091d0).stop 2022-01-10T01:32:17.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 -- 172.21.15.36:0/1465336332 shutdown_connections 2022-01-10T01:32:17.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 --2- 172.21.15.36:0/1465336332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed900a9c10 0x7fed90147ca0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:17.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 --2- 172.21.15.36:0/1465336332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed900b18f0 0x7fed900b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:17.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 -- 172.21.15.36:0/1465336332 >> 172.21.15.36:0/1465336332 conn(0x7fed900636e0 msgr2=0x7fed90063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:17.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 -- 172.21.15.36:0/1465336332 shutdown_connections 2022-01-10T01:32:17.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.795+0000 7fed96150700 1 -- 172.21.15.36:0/1465336332 wait complete. 2022-01-10T01:32:17.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed96150700 1 Processor -- start 2022-01-10T01:32:17.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed96150700 1 -- start start 2022-01-10T01:32:17.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed96150700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed900a9c10 0x7fed90144240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:17.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed96150700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed900b18f0 0x7fed90156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:17.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed96150700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed900b3000 0x7fed90156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:17.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed96150700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed90141e70 con 0x7fed900b3000 2022-01-10T01:32:17.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed96150700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed901438a0 con 0x7fed900a9c10 2022-01-10T01:32:17.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed96150700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed90143ad0 con 0x7fed900b18f0 2022-01-10T01:32:17.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed9594f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed900b3000 0x7fed90156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:17.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed9594f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed900b3000 0x7fed90156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40434/0 (socket says 172.21.15.36:40434) 2022-01-10T01:32:17.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed9594f700 1 -- 172.21.15.36:0/3096841050 learned_addr learned my addr 172.21.15.36:0/3096841050 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:17.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed9494d700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed900b18f0 0x7fed90156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:17.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed9514e700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed900a9c10 0x7fed90144240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:17.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed9594f700 1 -- 172.21.15.36:0/3096841050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed900b18f0 msgr2=0x7fed90156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:17.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed9594f700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed900b18f0 0x7fed90156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:17.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed9594f700 1 -- 172.21.15.36:0/3096841050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed900a9c10 msgr2=0x7fed90144240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:17.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed9594f700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed900a9c10 0x7fed90144240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:17.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed9594f700 1 -- 172.21.15.36:0/3096841050 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8000b180 con 0x7fed900b3000 2022-01-10T01:32:17.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed9494d700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed900b18f0 0x7fed90156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:17.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed9594f700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed900b3000 0x7fed90156fd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7fed9014bf90 tx=0x7fed88016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:17.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.799+0000 7fed7e7fc700 1 -- 172.21.15.36:0/3096841050 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8800b8d0 con 0x7fed900b3000 2022-01-10T01:32:17.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.803+0000 7fed7e7fc700 1 -- 172.21.15.36:0/3096841050 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed88021630 con 0x7fed900b3000 2022-01-10T01:32:17.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.803+0000 7fed7e7fc700 1 -- 172.21.15.36:0/3096841050 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8800b600 con 0x7fed900b3000 2022-01-10T01:32:17.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.803+0000 7fed96150700 1 -- 172.21.15.36:0/3096841050 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed88009470 con 0x7fed900b3000 2022-01-10T01:32:17.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.803+0000 7fed96150700 1 -- 172.21.15.36:0/3096841050 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9015a5c0 con 0x7fed900b3000 2022-01-10T01:32:17.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.803+0000 7fed96150700 1 -- 172.21.15.36:0/3096841050 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed90057350 con 0x7fed900b3000 2022-01-10T01:32:17.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.803+0000 7fed7e7fc700 1 -- 172.21.15.36:0/3096841050 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fed88027020 con 0x7fed900b3000 2022-01-10T01:32:17.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.803+0000 7fed7e7fc700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed70053500 0x7fed700559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:17.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.803+0000 7fed7e7fc700 1 -- 172.21.15.36:0/3096841050 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fed8806cf60 con 0x7fed900b3000 2022-01-10T01:32:17.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.803+0000 7fed9514e700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed70053500 0x7fed700559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:17.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.803+0000 7fed9514e700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed70053500 0x7fed700559c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fed8c00d000 tx=0x7fed8c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:17.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.811+0000 7fed7e7fc700 1 -- 172.21.15.36:0/3096841050 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fed88043f20 con 0x7fed900b3000 2022-01-10T01:32:17.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.979+0000 7fed96150700 1 -- 172.21.15.36:0/3096841050 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed900698e0 con 0x7fed900b3000 2022-01-10T01:32:17.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.979+0000 7fed7e7fc700 1 -- 172.21.15.36:0/3096841050 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+2127 (secure 0 0 0) 0x7fed88047540 con 0x7fed900b3000 2022-01-10T01:32:17.983 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:17.983 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":52,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6836/13281616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":13281616},{"type":"v1","addr":"172.21.15.36:6836","nonce":13281616}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/2168511464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":2168511464},{"type":"v1","addr":"172.21.15.36:6837","nonce":2168511464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49}],"filesystems":[{"mdsmap":{"epoch":52,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:32:05.646058+0000","modified":"2022-01-10T01:32:17.655089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2022-01-10T01:32:17.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.979+0000 7fed96150700 1 -- 172.21.15.36:0/3096841050 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed70053500 msgr2=0x7fed700559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:17.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.979+0000 7fed96150700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed70053500 0x7fed700559c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fed8c00d000 tx=0x7fed8c009040).stop 2022-01-10T01:32:17.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.979+0000 7fed96150700 1 -- 172.21.15.36:0/3096841050 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed900b3000 msgr2=0x7fed90156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:17.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.979+0000 7fed96150700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed900b3000 0x7fed90156fd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7fed9014bf90 tx=0x7fed88016000).stop 2022-01-10T01:32:17.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.979+0000 7fed96150700 1 -- 172.21.15.36:0/3096841050 shutdown_connections 2022-01-10T01:32:17.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.979+0000 7fed96150700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed70053500 0x7fed700559c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:17.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.979+0000 7fed96150700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed900b3000 0x7fed90156fd0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:17.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.979+0000 7fed96150700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed900b18f0 0x7fed90156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:17.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.979+0000 7fed96150700 1 --2- 172.21.15.36:0/3096841050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed900a9c10 0x7fed90144240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:17.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.979+0000 7fed96150700 1 -- 172.21.15.36:0/3096841050 >> 172.21.15.36:0/3096841050 conn(0x7fed900636e0 msgr2=0x7fed90063ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:17.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.979+0000 7fed96150700 1 -- 172.21.15.36:0/3096841050 shutdown_connections 2022-01-10T01:32:17.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:17.979+0000 7fed96150700 1 -- 172.21.15.36:0/3096841050 wait complete. 2022-01-10T01:32:17.988 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 52 2022-01-10T01:32:17.996 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:32:18.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.099+0000 7fb2d9958700 1 Processor -- start 2022-01-10T01:32:18.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.099+0000 7fb2d9958700 1 -- start start 2022-01-10T01:32:18.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d9958700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb2d40a9c10 0x7fb2d40607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:18.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d9958700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2d4140140 0x7fb2d4140590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:18.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d9958700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d4066ea0 con 0x7fb2d40b3040 2022-01-10T01:32:18.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d9958700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d40648e0 con 0x7fb2d40a9c10 2022-01-10T01:32:18.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d9958700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d4061dd0 con 0x7fb2d4140140 2022-01-10T01:32:18.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb2d40a9c10 0x7fb2d40607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:18.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb2d40a9c10 0x7fb2d40607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40440/0 (socket says 172.21.15.36:40440) 2022-01-10T01:32:18.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d3fff700 1 -- 172.21.15.36:0/3553552936 learned_addr learned my addr 172.21.15.36:0/3553552936 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:18.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d9157700 1 --2- 172.21.15.36:0/3553552936 >> v2:172.21.15.59:3300/0 conn(0x7fb2d4140140 0x7fb2d4140590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:18.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d3fff700 1 -- 172.21.15.36:0/3553552936 >> v2:172.21.15.59:3300/0 conn(0x7fb2d4140140 msgr2=0x7fb2d4140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:18.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d3fff700 1 --2- 172.21.15.36:0/3553552936 >> v2:172.21.15.59:3300/0 conn(0x7fb2d4140140 0x7fb2d4140590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:18.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d3fff700 1 -- 172.21.15.36:0/3553552936 >> v1:172.21.15.59:6789/0 conn(0x7fb2d40b3040 legacy=0x7fb2d4065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:18.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d3fff700 1 -- 172.21.15.36:0/3553552936 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d40b3420 con 0x7fb2d40a9c10 2022-01-10T01:32:18.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d3fff700 1 --2- 172.21.15.36:0/3553552936 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40a9c10 0x7fb2d40607c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7fb2c0002f70 tx=0x7fb2c0006eb0).ready entity=mon.0 client_cookie=3862ef0e6cee42d4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:18.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d37fe700 1 -- 172.21.15.36:0/3553552936 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c000f9c0 con 0x7fb2d40a9c10 2022-01-10T01:32:18.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d37fe700 1 -- 172.21.15.36:0/3553552936 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c0000e90 con 0x7fb2d40a9c10 2022-01-10T01:32:18.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d37fe700 1 -- 172.21.15.36:0/3553552936 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c000fd50 con 0x7fb2d40a9c10 2022-01-10T01:32:18.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d9958700 1 -- 172.21.15.36:0/3553552936 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40a9c10 msgr2=0x7fb2d40607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:18.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d9958700 1 --2- 172.21.15.36:0/3553552936 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40a9c10 0x7fb2d40607c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7fb2c0002f70 tx=0x7fb2c0006eb0).stop 2022-01-10T01:32:18.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d9958700 1 -- 172.21.15.36:0/3553552936 shutdown_connections 2022-01-10T01:32:18.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d9958700 1 --2- 172.21.15.36:0/3553552936 >> v2:172.21.15.59:3300/0 conn(0x7fb2d4140140 0x7fb2d4140590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:18.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d9958700 1 --2- 172.21.15.36:0/3553552936 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40a9c10 0x7fb2d40607c0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:18.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.103+0000 7fb2d9958700 1 -- 172.21.15.36:0/3553552936 >> 172.21.15.36:0/3553552936 conn(0x7fb2d40636e0 msgr2=0x7fb2d4063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:18.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.107+0000 7fb2d9958700 1 -- 172.21.15.36:0/3553552936 shutdown_connections 2022-01-10T01:32:18.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.107+0000 7fb2d9958700 1 -- 172.21.15.36:0/3553552936 wait complete. 2022-01-10T01:32:18.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.107+0000 7fb2d9958700 1 Processor -- start 2022-01-10T01:32:18.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.107+0000 7fb2d9958700 1 -- start start 2022-01-10T01:32:18.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d9958700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40a9c10 0x7fb2d40ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:18.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d9958700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d40b3040 0x7fb2d4152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:18.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d9958700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d4140140 0x7fb2d4152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:18.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d9958700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d4153160 con 0x7fb2d40a9c10 2022-01-10T01:32:18.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d9958700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40a0090 con 0x7fb2d4140140 2022-01-10T01:32:18.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d9958700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d40a0330 con 0x7fb2d40b3040 2022-01-10T01:32:18.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d8956700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40a9c10 0x7fb2d40ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:18.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d8956700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40a9c10 0x7fb2d40ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40444/0 (socket says 172.21.15.36:40444) 2022-01-10T01:32:18.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d8956700 1 -- 172.21.15.36:0/2407254018 learned_addr learned my addr 172.21.15.36:0/2407254018 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:18.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d3fff700 1 --2- 172.21.15.36:0/2407254018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d40b3040 0x7fb2d4152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:18.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d9157700 1 --2- 172.21.15.36:0/2407254018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d4140140 0x7fb2d4152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:18.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d8956700 1 -- 172.21.15.36:0/2407254018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d40b3040 msgr2=0x7fb2d4152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:18.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d8956700 1 --2- 172.21.15.36:0/2407254018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d40b3040 0x7fb2d4152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:18.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d8956700 1 -- 172.21.15.36:0/2407254018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d4140140 msgr2=0x7fb2d4152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:18.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d8956700 1 --2- 172.21.15.36:0/2407254018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d4140140 0x7fb2d4152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:18.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d8956700 1 -- 172.21.15.36:0/2407254018 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c000b1e0 con 0x7fb2d40a9c10 2022-01-10T01:32:18.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d8956700 1 --2- 172.21.15.36:0/2407254018 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40a9c10 0x7fb2d40ae5d0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fb2d4063350 tx=0x7fb2c8007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:18.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d1ffb700 1 -- 172.21.15.36:0/2407254018 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c8012400 con 0x7fb2d40a9c10 2022-01-10T01:32:18.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d1ffb700 1 -- 172.21.15.36:0/2407254018 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c8012560 con 0x7fb2d40a9c10 2022-01-10T01:32:18.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d1ffb700 1 -- 172.21.15.36:0/2407254018 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2c80128c0 con 0x7fb2d40a9c10 2022-01-10T01:32:18.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d9958700 1 -- 172.21.15.36:0/2407254018 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d40a05d0 con 0x7fb2d40a9c10 2022-01-10T01:32:18.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d9958700 1 -- 172.21.15.36:0/2407254018 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d40aec60 con 0x7fb2d40a9c10 2022-01-10T01:32:18.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d9958700 1 -- 172.21.15.36:0/2407254018 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d409fec0 con 0x7fb2d40a9c10 2022-01-10T01:32:18.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.111+0000 7fb2d1ffb700 1 -- 172.21.15.36:0/2407254018 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb2c8019030 con 0x7fb2d40a9c10 2022-01-10T01:32:18.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.115+0000 7fb2d1ffb700 1 --2- 172.21.15.36:0/2407254018 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2b4053560 0x7fb2b4055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:18.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.115+0000 7fb2d1ffb700 1 -- 172.21.15.36:0/2407254018 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fb2c806adc0 con 0x7fb2d40a9c10 2022-01-10T01:32:18.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.115+0000 7fb2d3fff700 1 --2- 172.21.15.36:0/2407254018 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2b4053560 0x7fb2b4055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:18.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.115+0000 7fb2d3fff700 1 --2- 172.21.15.36:0/2407254018 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2b4053560 0x7fb2b4055a20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7fb2c001c000 tx=0x7fb2c0017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:18.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.119+0000 7fb2d1ffb700 1 -- 172.21.15.36:0/2407254018 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2c8041d80 con 0x7fb2d40a9c10 2022-01-10T01:32:18.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.283+0000 7fb2d9958700 1 -- 172.21.15.36:0/2407254018 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb2d40a0760 con 0x7fb2d40a9c10 2022-01-10T01:32:18.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.671+0000 7fb2d1ffb700 1 -- 172.21.15.36:0/2407254018 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb2c80453a0 con 0x7fb2d40a9c10 2022-01-10T01:32:18.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.671+0000 7fb2d9958700 1 -- 172.21.15.36:0/2407254018 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2b4053560 msgr2=0x7fb2b4055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:18.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.671+0000 7fb2d9958700 1 --2- 172.21.15.36:0/2407254018 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2b4053560 0x7fb2b4055a20 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7fb2c001c000 tx=0x7fb2c0017000).stop 2022-01-10T01:32:18.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.671+0000 7fb2d9958700 1 -- 172.21.15.36:0/2407254018 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40a9c10 msgr2=0x7fb2d40ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:18.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.671+0000 7fb2d9958700 1 --2- 172.21.15.36:0/2407254018 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40a9c10 0x7fb2d40ae5d0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fb2d4063350 tx=0x7fb2c8007c50).stop 2022-01-10T01:32:18.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.671+0000 7fb2d9958700 1 -- 172.21.15.36:0/2407254018 shutdown_connections 2022-01-10T01:32:18.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.671+0000 7fb2d9958700 1 --2- 172.21.15.36:0/2407254018 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2b4053560 0x7fb2b4055a20 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:18.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.671+0000 7fb2d9958700 1 --2- 172.21.15.36:0/2407254018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d4140140 0x7fb2d4152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:18.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.671+0000 7fb2d9958700 1 --2- 172.21.15.36:0/2407254018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2d40b3040 0x7fb2d4152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:18.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.671+0000 7fb2d9958700 1 --2- 172.21.15.36:0/2407254018 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2d40a9c10 0x7fb2d40ae5d0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:18.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.671+0000 7fb2d9958700 1 -- 172.21.15.36:0/2407254018 >> 172.21.15.36:0/2407254018 conn(0x7fb2d40636e0 msgr2=0x7fb2d4063ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:18.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.671+0000 7fb2d9958700 1 -- 172.21.15.36:0/2407254018 shutdown_connections 2022-01-10T01:32:18.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.671+0000 7fb2d9958700 1 -- 172.21.15.36:0/2407254018 wait complete. 2022-01-10T01:32:18.691 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:32:18.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.799+0000 7f433a2f4700 1 Processor -- start 2022-01-10T01:32:18.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.799+0000 7f433a2f4700 1 -- start start 2022-01-10T01:32:18.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.803+0000 7f433a2f4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4334139cc0 0x7f43340acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:18.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.803+0000 7f433a2f4700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43340ad070 con 0x7f433413a0a0 2022-01-10T01:32:18.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.803+0000 7f433a2f4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4334060d40 con 0x7f43340b21c0 2022-01-10T01:32:18.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.803+0000 7f433a2f4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43340b2730 con 0x7f4334139cc0 2022-01-10T01:32:18.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.803+0000 7f4333fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4334139cc0 0x7f43340acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:18.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.803+0000 7f4333fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4334139cc0 0x7f43340acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40452/0 (socket says 172.21.15.36:40452) 2022-01-10T01:32:18.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.803+0000 7f4333fff700 1 -- 172.21.15.36:0/3985005424 learned_addr learned my addr 172.21.15.36:0/3985005424 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:18.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.803+0000 7f4333fff700 1 -- 172.21.15.36:0/3985005424 >> v1:172.21.15.59:6789/0 conn(0x7f43340b21c0 legacy=0x7f43341434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:18.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.803+0000 7f4333fff700 1 -- 172.21.15.36:0/3985005424 >> v1:172.21.15.36:6789/0 conn(0x7f433413a0a0 legacy=0x7f43340b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:18.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.803+0000 7f4333fff700 1 -- 172.21.15.36:0/3985005424 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43340b6cd0 con 0x7f4334139cc0 2022-01-10T01:32:18.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.803+0000 7f4333fff700 1 --2- 172.21.15.36:0/3985005424 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4334139cc0 0x7f43340acb80 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f432c001620 tx=0x7f4324006eb0).ready entity=mon.0 client_cookie=70c4b48b41414ebe server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:18.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.803+0000 7f43337fe700 1 -- 172.21.15.36:0/3985005424 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f432400d610 con 0x7f4334139cc0 2022-01-10T01:32:18.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.803+0000 7f43337fe700 1 -- 172.21.15.36:0/3985005424 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4324000e90 con 0x7f4334139cc0 2022-01-10T01:32:18.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.803+0000 7f43337fe700 1 -- 172.21.15.36:0/3985005424 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f432400d9a0 con 0x7f4334139cc0 2022-01-10T01:32:18.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 -- 172.21.15.36:0/3985005424 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4334139cc0 msgr2=0x7f43340acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:18.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 --2- 172.21.15.36:0/3985005424 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4334139cc0 0x7f43340acb80 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f432c001620 tx=0x7f4324006eb0).stop 2022-01-10T01:32:18.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 -- 172.21.15.36:0/3985005424 shutdown_connections 2022-01-10T01:32:18.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 --2- 172.21.15.36:0/3985005424 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4334139cc0 0x7f43340acb80 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:18.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 -- 172.21.15.36:0/3985005424 >> 172.21.15.36:0/3985005424 conn(0x7f43340b3480 msgr2=0x7f43340b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:18.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 -- 172.21.15.36:0/3985005424 shutdown_connections 2022-01-10T01:32:18.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 -- 172.21.15.36:0/3985005424 wait complete. 2022-01-10T01:32:18.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 Processor -- start 2022-01-10T01:32:18.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 -- start start 2022-01-10T01:32:18.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43340b21c0 0x7f4334142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:18.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4334139cc0 0x7f4334154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:18.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f433413a0a0 0x7f4334154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:18.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43340af690 con 0x7f43340b21c0 2022-01-10T01:32:18.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4334153c20 con 0x7f433413a0a0 2022-01-10T01:32:18.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.807+0000 7f433a2f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433413e3f0 con 0x7f4334139cc0 2022-01-10T01:32:18.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4333fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43340b21c0 0x7f4334142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:18.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4333fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43340b21c0 0x7f4334142e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40458/0 (socket says 172.21.15.36:40458) 2022-01-10T01:32:18.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4333fff700 1 -- 172.21.15.36:0/3920191687 learned_addr learned my addr 172.21.15.36:0/3920191687 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:18.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f432bfff700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4334139cc0 0x7f4334154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:18.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4338891700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f433413a0a0 0x7f4334154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:18.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4333fff700 1 -- 172.21.15.36:0/3920191687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4334139cc0 msgr2=0x7f4334154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:18.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4333fff700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4334139cc0 0x7f4334154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:18.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4333fff700 1 -- 172.21.15.36:0/3920191687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f433413a0a0 msgr2=0x7f4334154500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:18.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4333fff700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f433413a0a0 0x7f4334154500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:18.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4333fff700 1 -- 172.21.15.36:0/3920191687 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432400b1e0 con 0x7f43340b21c0 2022-01-10T01:32:18.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f432bfff700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4334139cc0 0x7f4334154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:18.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4333fff700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43340b21c0 0x7f4334142e90 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f432c001620 tx=0x7f4324015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:18.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4331ffb700 1 -- 172.21.15.36:0/3920191687 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4324002f70 con 0x7f43340b21c0 2022-01-10T01:32:18.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4331ffb700 1 -- 172.21.15.36:0/3920191687 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432400d9b0 con 0x7f43340b21c0 2022-01-10T01:32:18.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f433a2f4700 1 -- 172.21.15.36:0/3920191687 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433413e620 con 0x7f43340b21c0 2022-01-10T01:32:18.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4331ffb700 1 -- 172.21.15.36:0/3920191687 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f432401e460 con 0x7f43340b21c0 2022-01-10T01:32:18.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f433a2f4700 1 -- 172.21.15.36:0/3920191687 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4334063ff0 con 0x7f43340b21c0 2022-01-10T01:32:18.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4331ffb700 1 -- 172.21.15.36:0/3920191687 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4324025030 con 0x7f43340b21c0 2022-01-10T01:32:18.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f433a2f4700 1 -- 172.21.15.36:0/3920191687 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4334060fa0 con 0x7f43340b21c0 2022-01-10T01:32:18.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.811+0000 7f4331ffb700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43180534d0 0x7f4318055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:18.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.815+0000 7f432bfff700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43180534d0 0x7f4318055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:18.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.815+0000 7f4331ffb700 1 -- 172.21.15.36:0/3920191687 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f432406cd10 con 0x7f43340b21c0 2022-01-10T01:32:18.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.815+0000 7f432bfff700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43180534d0 0x7f4318055990 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f431c00b000 tx=0x7f431c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:18.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.819+0000 7f4331ffb700 1 -- 172.21.15.36:0/3920191687 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4324043cd0 con 0x7f43340b21c0 2022-01-10T01:32:18.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:18.947+0000 7f433a2f4700 1 -- 172.21.15.36:0/3920191687 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4334057350 con 0x7f43340b21c0 2022-01-10T01:32:19.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.715+0000 7f4331ffb700 1 -- 172.21.15.36:0/3920191687 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v112) v1 ==== 185+0+0 (secure 0 0 0) 0x7f4324023070 con 0x7f43340b21c0 2022-01-10T01:32:19.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.719+0000 7f433a2f4700 1 -- 172.21.15.36:0/3920191687 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43180534d0 msgr2=0x7f4318055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:19.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.719+0000 7f433a2f4700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43180534d0 0x7f4318055990 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f431c00b000 tx=0x7f431c009040).stop 2022-01-10T01:32:19.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.719+0000 7f433a2f4700 1 -- 172.21.15.36:0/3920191687 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43340b21c0 msgr2=0x7f4334142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:19.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.719+0000 7f433a2f4700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43340b21c0 0x7f4334142e90 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f432c001620 tx=0x7f4324015000).stop 2022-01-10T01:32:19.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.719+0000 7f433a2f4700 1 -- 172.21.15.36:0/3920191687 shutdown_connections 2022-01-10T01:32:19.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.719+0000 7f433a2f4700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43180534d0 0x7f4318055990 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:19.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.719+0000 7f433a2f4700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f433413a0a0 0x7f4334154500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:19.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.719+0000 7f433a2f4700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4334139cc0 0x7f4334154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:19.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.719+0000 7f433a2f4700 1 --2- 172.21.15.36:0/3920191687 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43340b21c0 0x7f4334142e90 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:19.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.719+0000 7f433a2f4700 1 -- 172.21.15.36:0/3920191687 >> 172.21.15.36:0/3920191687 conn(0x7f43340b3480 msgr2=0x7f43340b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:19.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.719+0000 7f433a2f4700 1 -- 172.21.15.36:0/3920191687 shutdown_connections 2022-01-10T01:32:19.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.719+0000 7f433a2f4700 1 -- 172.21.15.36:0/3920191687 wait complete. 2022-01-10T01:32:19.727 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:32:19.738 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2022-01-10T01:32:19.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.847+0000 7fad44f1a700 1 Processor -- start 2022-01-10T01:32:19.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.847+0000 7fad44f1a700 1 -- start start 2022-01-10T01:32:19.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad44f1a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad400b34a0 0x7fad40143d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:19.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad44f1a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad400af780 0x7fad40140110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:19.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad44f1a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad400b3880 con 0x7fad400a9f40 2022-01-10T01:32:19.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad44f1a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad40144260 con 0x7fad400af780 2022-01-10T01:32:19.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad44f1a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad401469b0 con 0x7fad400b34a0 2022-01-10T01:32:19.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad35d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fad400a9f40 0x7fad400af070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38260/0 (socket says 172.21.15.36:38260) 2022-01-10T01:32:19.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad35d9b700 1 -- 172.21.15.36:0/1091627019 learned_addr learned my addr 172.21.15.36:0/1091627019 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:19.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3ed9d700 1 --2- 172.21.15.36:0/1091627019 >> v2:172.21.15.59:3300/0 conn(0x7fad400af780 0x7fad40140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:19.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3e59c700 1 --2- 172.21.15.36:0/1091627019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad400b34a0 0x7fad40143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:19.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 -- 172.21.15.36:0/1091627019 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966948229 0 0) 0x7fad400b3880 con 0x7fad400a9f40 2022-01-10T01:32:19.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 -- 172.21.15.36:0/1091627019 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad20003260 con 0x7fad400a9f40 2022-01-10T01:32:19.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 -- 172.21.15.36:0/1091627019 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3667182694 0 0) 0x7fad20003260 con 0x7fad400a9f40 2022-01-10T01:32:19.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 -- 172.21.15.36:0/1091627019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad400b34a0 msgr2=0x7fad40143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:19.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 --2- 172.21.15.36:0/1091627019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad400b34a0 0x7fad40143d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:19.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 -- 172.21.15.36:0/1091627019 >> v2:172.21.15.59:3300/0 conn(0x7fad400af780 msgr2=0x7fad40140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:19.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 --2- 172.21.15.36:0/1091627019 >> v2:172.21.15.59:3300/0 conn(0x7fad400af780 0x7fad40140110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:19.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 -- 172.21.15.36:0/1091627019 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad40146c50 con 0x7fad400a9f40 2022-01-10T01:32:19.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 -- 172.21.15.36:0/1091627019 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fad28001680 con 0x7fad400a9f40 2022-01-10T01:32:19.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3ed9d700 1 --2- 172.21.15.36:0/1091627019 >> v2:172.21.15.59:3300/0 conn(0x7fad400af780 0x7fad40140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:19.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 -- 172.21.15.36:0/1091627019 >> v1:172.21.15.36:6789/0 conn(0x7fad400a9f40 legacy=0x7fad400af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:19.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 --2- 172.21.15.36:0/1091627019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad400b34a0 0x7fad20003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:19.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 --2- 172.21.15.36:0/1091627019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad20003c80 0x7fad20004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:19.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 --2- 172.21.15.36:0/1091627019 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad200049f0 0x7fad20004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:19.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 -- 172.21.15.36:0/1091627019 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad40144260 con 0x7fad200049f0 2022-01-10T01:32:19.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 -- 172.21.15.36:0/1091627019 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad401469b0 con 0x7fad20003c80 2022-01-10T01:32:19.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 -- 172.21.15.36:0/1091627019 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2000b750 con 0x7fad400b34a0 2022-01-10T01:32:19.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3ed9d700 1 --2- 172.21.15.36:0/1091627019 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad200049f0 0x7fad20004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:19.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad35d9b700 1 --2- 172.21.15.36:0/1091627019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad20003c80 0x7fad20004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:19.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3e59c700 1 --2- 172.21.15.36:0/1091627019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad400b34a0 0x7fad20003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:19.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3ed9d700 1 -- 172.21.15.36:0/1091627019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad400b34a0 msgr2=0x7fad20003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:19.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3ed9d700 1 --2- 172.21.15.36:0/1091627019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad400b34a0 0x7fad20003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:19.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3ed9d700 1 -- 172.21.15.36:0/1091627019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad20003c80 msgr2=0x7fad20004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:19.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3ed9d700 1 --2- 172.21.15.36:0/1091627019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad20003c80 0x7fad20004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:19.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3ed9d700 1 -- 172.21.15.36:0/1091627019 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad20003260 con 0x7fad200049f0 2022-01-10T01:32:19.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3ed9d700 1 --2- 172.21.15.36:0/1091627019 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad200049f0 0x7fad20004e70 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7fad200054d0 tx=0x7fad380091d0).ready entity=mon.0 client_cookie=b190f7b882adc829 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:19.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 -- 172.21.15.36:0/1091627019 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3800e920 con 0x7fad200049f0 2022-01-10T01:32:19.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 -- 172.21.15.36:0/1091627019 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3800ea80 con 0x7fad200049f0 2022-01-10T01:32:19.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.851+0000 7fad3dd9b700 1 -- 172.21.15.36:0/1091627019 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad3800ede0 con 0x7fad200049f0 2022-01-10T01:32:19.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad44f1a700 1 -- 172.21.15.36:0/1091627019 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad200049f0 msgr2=0x7fad20004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:19.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad44f1a700 1 --2- 172.21.15.36:0/1091627019 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad200049f0 0x7fad20004e70 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7fad200054d0 tx=0x7fad380091d0).stop 2022-01-10T01:32:19.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad3ed9d700 1 -- 172.21.15.36:0/1091627019 reap_dead start 2022-01-10T01:32:19.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad44f1a700 1 -- 172.21.15.36:0/1091627019 shutdown_connections 2022-01-10T01:32:19.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad44f1a700 1 -- 172.21.15.36:0/1091627019 >> 172.21.15.36:0/1091627019 conn(0x7fad400607c0 msgr2=0x7fad40060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:19.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad44f1a700 1 -- 172.21.15.36:0/1091627019 shutdown_connections 2022-01-10T01:32:19.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad44f1a700 1 -- 172.21.15.36:0/1091627019 wait complete. 2022-01-10T01:32:19.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad44f1a700 1 Processor -- start 2022-01-10T01:32:19.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad44f1a700 1 -- start start 2022-01-10T01:32:19.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad44f1a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad401490c0 0x7fad40146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:19.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad44f1a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad4013e830 0x7fad40155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:19.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad44f1a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4013de90 0x7fad401560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:19.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad44f1a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad40145f60 con 0x7fad4013e830 2022-01-10T01:32:19.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad44f1a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad4013e400 con 0x7fad4013de90 2022-01-10T01:32:19.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad44f1a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad401494a0 con 0x7fad401490c0 2022-01-10T01:32:19.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad35d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad4013e830 0x7fad40155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:19.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad3ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4013de90 0x7fad401560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:19.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad3e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad401490c0 0x7fad40146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:19.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad35d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad4013e830 0x7fad40155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40482/0 (socket says 172.21.15.36:40482) 2022-01-10T01:32:19.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad3ed9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4013de90 0x7fad401560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:37114/0 (socket says 172.21.15.36:37114) 2022-01-10T01:32:19.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad35d9b700 1 -- 172.21.15.36:0/1878332491 learned_addr learned my addr 172.21.15.36:0/1878332491 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:19.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad3e59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad401490c0 0x7fad40146100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:46760/0 (socket says 172.21.15.36:46760) 2022-01-10T01:32:19.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad35d9b700 1 -- 172.21.15.36:0/1878332491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad401490c0 msgr2=0x7fad40146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:19.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad35d9b700 1 --2- 172.21.15.36:0/1878332491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad401490c0 0x7fad40146100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:19.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad35d9b700 1 -- 172.21.15.36:0/1878332491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4013de90 msgr2=0x7fad401560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:19.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad35d9b700 1 --2- 172.21.15.36:0/1878332491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4013de90 0x7fad401560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:19.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad35d9b700 1 -- 172.21.15.36:0/1878332491 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad400b5fc0 con 0x7fad4013e830 2022-01-10T01:32:19.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.855+0000 7fad35d9b700 1 --2- 172.21.15.36:0/1878332491 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad4013e830 0x7fad40155be0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fad2800d000 tx=0x7fad400aef90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:19.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.859+0000 7fad37fff700 1 -- 172.21.15.36:0/1878332491 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad280116b0 con 0x7fad4013e830 2022-01-10T01:32:19.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.859+0000 7fad37fff700 1 -- 172.21.15.36:0/1878332491 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad28011810 con 0x7fad4013e830 2022-01-10T01:32:19.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.859+0000 7fad44f1a700 1 -- 172.21.15.36:0/1878332491 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad400b6260 con 0x7fad4013e830 2022-01-10T01:32:19.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.859+0000 7fad37fff700 1 -- 172.21.15.36:0/1878332491 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad28011b70 con 0x7fad4013e830 2022-01-10T01:32:19.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.859+0000 7fad44f1a700 1 -- 172.21.15.36:0/1878332491 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad40138740 con 0x7fad4013e830 2022-01-10T01:32:19.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.859+0000 7fad44f1a700 1 -- 172.21.15.36:0/1878332491 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad400b63f0 con 0x7fad4013e830 2022-01-10T01:32:19.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.859+0000 7fad37fff700 1 -- 172.21.15.36:0/1878332491 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fad28011cd0 con 0x7fad4013e830 2022-01-10T01:32:19.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.859+0000 7fad37fff700 1 --2- 172.21.15.36:0/1878332491 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad24053680 0x7fad24055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:19.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.859+0000 7fad37fff700 1 -- 172.21.15.36:0/1878332491 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6068+0+0 (secure 0 0 0) 0x7fad2806b2f0 con 0x7fad4013e830 2022-01-10T01:32:19.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.859+0000 7fad3e59c700 1 --2- 172.21.15.36:0/1878332491 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad24053680 0x7fad24055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:19.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.863+0000 7fad3e59c700 1 --2- 172.21.15.36:0/1878332491 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad24053680 0x7fad24055b40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fad3000b000 tx=0x7fad30006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:19.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.867+0000 7fad37fff700 1 -- 172.21.15.36:0/1878332491 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fad28068e90 con 0x7fad4013e830 2022-01-10T01:32:20.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:19.999+0000 7fad44f1a700 1 -- 172.21.15.36:0/1878332491 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad40146ef0 con 0x7fad4013e830 2022-01-10T01:32:20.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.731+0000 7fad37fff700 1 -- 172.21.15.36:0/1878332491 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v113) v1 ==== 173+0+0 (secure 0 0 0) 0x7fad28019020 con 0x7fad4013e830 2022-01-10T01:32:20.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.735+0000 7fad44f1a700 1 -- 172.21.15.36:0/1878332491 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad24053680 msgr2=0x7fad24055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:20.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.735+0000 7fad44f1a700 1 --2- 172.21.15.36:0/1878332491 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad24053680 0x7fad24055b40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fad3000b000 tx=0x7fad30006df0).stop 2022-01-10T01:32:20.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.735+0000 7fad44f1a700 1 -- 172.21.15.36:0/1878332491 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad4013e830 msgr2=0x7fad40155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:20.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.735+0000 7fad44f1a700 1 --2- 172.21.15.36:0/1878332491 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad4013e830 0x7fad40155be0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fad2800d000 tx=0x7fad400aef90).stop 2022-01-10T01:32:20.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.735+0000 7fad44f1a700 1 -- 172.21.15.36:0/1878332491 shutdown_connections 2022-01-10T01:32:20.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.735+0000 7fad44f1a700 1 --2- 172.21.15.36:0/1878332491 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad24053680 0x7fad24055b40 secure :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0x7fad3000b000 tx=0x7fad30006df0).stop 2022-01-10T01:32:20.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.735+0000 7fad44f1a700 1 --2- 172.21.15.36:0/1878332491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad4013de90 0x7fad401560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:20.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.735+0000 7fad44f1a700 1 --2- 172.21.15.36:0/1878332491 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad4013e830 0x7fad40155be0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:20.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.735+0000 7fad44f1a700 1 --2- 172.21.15.36:0/1878332491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad401490c0 0x7fad40146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:20.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.735+0000 7fad44f1a700 1 -- 172.21.15.36:0/1878332491 >> 172.21.15.36:0/1878332491 conn(0x7fad400607c0 msgr2=0x7fad401401b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:20.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.735+0000 7fad44f1a700 1 -- 172.21.15.36:0/1878332491 shutdown_connections 2022-01-10T01:32:20.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.735+0000 7fad44f1a700 1 -- 172.21.15.36:0/1878332491 wait complete. 2022-01-10T01:32:20.740 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' removed 2022-01-10T01:32:20.751 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2022-01-10T01:32:20.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8332c64700 1 Processor -- start 2022-01-10T01:32:20.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8332c64700 1 -- start start 2022-01-10T01:32:20.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8332c64700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f832c0638d0 0x7f832c143d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:20.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8332c64700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c063cb0 con 0x7f832c140980 2022-01-10T01:32:20.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8332c64700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c061ff0 con 0x7f832c061920 2022-01-10T01:32:20.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8332c64700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c13fdb0 con 0x7f832c0638d0 2022-01-10T01:32:20.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8332463700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f832c140980 0x7f832c128c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38284/0 (socket says 172.21.15.36:38284) 2022-01-10T01:32:20.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8332463700 1 -- 172.21.15.36:0/655199954 learned_addr learned my addr 172.21.15.36:0/655199954 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:20.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8331c62700 1 --2- 172.21.15.36:0/655199954 >> v2:172.21.15.36:3300/0 conn(0x7f832c0638d0 0x7f832c143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:20.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8330c60700 1 -- 172.21.15.36:0/655199954 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014688082 0 0) 0x7f832c063cb0 con 0x7f832c140980 2022-01-10T01:32:20.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8330c60700 1 -- 172.21.15.36:0/655199954 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8310003260 con 0x7f832c140980 2022-01-10T01:32:20.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8330c60700 1 -- 172.21.15.36:0/655199954 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496686641 0 0) 0x7f832c061ff0 con 0x7f832c061920 2022-01-10T01:32:20.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8330c60700 1 -- 172.21.15.36:0/655199954 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f832c063cb0 con 0x7f832c061920 2022-01-10T01:32:20.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8330c60700 1 -- 172.21.15.36:0/655199954 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 549806842 0 0) 0x7f8310003260 con 0x7f832c140980 2022-01-10T01:32:20.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8331c62700 1 -- 172.21.15.36:0/655199954 >> v1:172.21.15.59:6789/0 conn(0x7f832c061920 legacy=0x7f832c0b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:20.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8331c62700 1 -- 172.21.15.36:0/655199954 >> v1:172.21.15.36:6789/0 conn(0x7f832c140980 legacy=0x7f832c128c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:20.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8331c62700 1 -- 172.21.15.36:0/655199954 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c13ffa0 con 0x7f832c0638d0 2022-01-10T01:32:20.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8331c62700 1 --2- 172.21.15.36:0/655199954 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f832c0638d0 0x7f832c143d50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f8324001110 tx=0x7f8328006df0).ready entity=mon.0 client_cookie=b87c0c5a4e30ac16 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:20.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8330c60700 1 -- 172.21.15.36:0/655199954 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8328014070 con 0x7f832c0638d0 2022-01-10T01:32:20.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8330c60700 1 -- 172.21.15.36:0/655199954 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8328000e90 con 0x7f832c0638d0 2022-01-10T01:32:20.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.859+0000 7f8330c60700 1 -- 172.21.15.36:0/655199954 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8324001680 con 0x7f832c0638d0 2022-01-10T01:32:20.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 -- 172.21.15.36:0/655199954 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f832c0638d0 msgr2=0x7f832c143d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:20.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 --2- 172.21.15.36:0/655199954 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f832c0638d0 0x7f832c143d50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f8324001110 tx=0x7f8328006df0).stop 2022-01-10T01:32:20.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 -- 172.21.15.36:0/655199954 shutdown_connections 2022-01-10T01:32:20.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 --2- 172.21.15.36:0/655199954 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f832c0638d0 0x7f832c143d50 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:20.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 -- 172.21.15.36:0/655199954 >> 172.21.15.36:0/655199954 conn(0x7f832c05c490 msgr2=0x7f832c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:20.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 -- 172.21.15.36:0/655199954 shutdown_connections 2022-01-10T01:32:20.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 -- 172.21.15.36:0/655199954 wait complete. 2022-01-10T01:32:20.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 Processor -- start 2022-01-10T01:32:20.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 -- start start 2022-01-10T01:32:20.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f832c061920 0x7f832c0afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:20.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f832c0638d0 0x7f832c0b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:20.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f832c140980 0x7f832c125ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:20.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0b0400 con 0x7f832c140980 2022-01-10T01:32:20.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c14ef40 con 0x7f832c061920 2022-01-10T01:32:20.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332c64700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c14ea30 con 0x7f832c0638d0 2022-01-10T01:32:20.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332463700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f832c140980 0x7f832c125ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:20.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332463700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f832c140980 0x7f832c125ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40496/0 (socket says 172.21.15.36:40496) 2022-01-10T01:32:20.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8332463700 1 -- 172.21.15.36:0/3315485081 learned_addr learned my addr 172.21.15.36:0/3315485081 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:20.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8331c62700 1 --2- 172.21.15.36:0/3315485081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f832c061920 0x7f832c0afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:20.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.863+0000 7f8331461700 1 --2- 172.21.15.36:0/3315485081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f832c0638d0 0x7f832c0b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:20.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f8332463700 1 -- 172.21.15.36:0/3315485081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f832c0638d0 msgr2=0x7f832c0b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:20.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f8332463700 1 --2- 172.21.15.36:0/3315485081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f832c0638d0 0x7f832c0b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:20.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f8332463700 1 -- 172.21.15.36:0/3315485081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f832c061920 msgr2=0x7f832c0afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:20.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f8332463700 1 --2- 172.21.15.36:0/3315485081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f832c061920 0x7f832c0afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:20.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f8332463700 1 -- 172.21.15.36:0/3315485081 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832800b180 con 0x7f832c140980 2022-01-10T01:32:20.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f8332463700 1 --2- 172.21.15.36:0/3315485081 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f832c140980 0x7f832c125ab0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f832c14ebc0 tx=0x7f8324001680).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:20.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f831effd700 1 -- 172.21.15.36:0/3315485081 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8324007170 con 0x7f832c140980 2022-01-10T01:32:20.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f831effd700 1 -- 172.21.15.36:0/3315485081 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83240072d0 con 0x7f832c140980 2022-01-10T01:32:20.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f8332c64700 1 -- 172.21.15.36:0/3315485081 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832c0b0630 con 0x7f832c140980 2022-01-10T01:32:20.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f831effd700 1 -- 172.21.15.36:0/3315485081 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8324004710 con 0x7f832c140980 2022-01-10T01:32:20.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f8332c64700 1 -- 172.21.15.36:0/3315485081 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c13f030 con 0x7f832c140980 2022-01-10T01:32:20.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f831effd700 1 -- 172.21.15.36:0/3315485081 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f832401b070 con 0x7f832c140980 2022-01-10T01:32:20.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f8332c64700 1 -- 172.21.15.36:0/3315485081 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c057350 con 0x7f832c140980 2022-01-10T01:32:20.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f831effd700 1 --2- 172.21.15.36:0/3315485081 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f83140534d0 0x7f8314055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:20.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f831effd700 1 -- 172.21.15.36:0/3315485081 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f832406ad40 con 0x7f832c140980 2022-01-10T01:32:20.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.867+0000 7f8331c62700 1 --2- 172.21.15.36:0/3315485081 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f83140534d0 0x7f8314055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:20.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.871+0000 7f8331c62700 1 --2- 172.21.15.36:0/3315485081 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f83140534d0 0x7f8314055990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f832801d000 tx=0x7f8328016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:20.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:20.875+0000 7f831effd700 1 -- 172.21.15.36:0/3315485081 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8324041f20 con 0x7f832c140980 2022-01-10T01:32:21.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.003+0000 7f8332c64700 1 -- 172.21.15.36:0/3315485081 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f832c0673a0 con 0x7f832c140980 2022-01-10T01:32:21.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.011+0000 7f831effd700 1 -- 172.21.15.36:0/3315485081 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8324045540 con 0x7f832c140980 2022-01-10T01:32:21.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.015+0000 7f8332c64700 1 -- 172.21.15.36:0/3315485081 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f83140534d0 msgr2=0x7f8314055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:21.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.015+0000 7f8332c64700 1 --2- 172.21.15.36:0/3315485081 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f83140534d0 0x7f8314055990 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f832801d000 tx=0x7f8328016000).stop 2022-01-10T01:32:21.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.015+0000 7f8332c64700 1 -- 172.21.15.36:0/3315485081 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f832c140980 msgr2=0x7f832c125ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:21.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.015+0000 7f8332c64700 1 --2- 172.21.15.36:0/3315485081 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f832c140980 0x7f832c125ab0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f832c14ebc0 tx=0x7f8324001680).stop 2022-01-10T01:32:21.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.015+0000 7f8332c64700 1 -- 172.21.15.36:0/3315485081 shutdown_connections 2022-01-10T01:32:21.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.015+0000 7f8332c64700 1 --2- 172.21.15.36:0/3315485081 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f83140534d0 0x7f8314055990 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.015+0000 7f8332c64700 1 --2- 172.21.15.36:0/3315485081 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f832c140980 0x7f832c125ab0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.015+0000 7f8332c64700 1 --2- 172.21.15.36:0/3315485081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f832c0638d0 0x7f832c0b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.015+0000 7f8332c64700 1 --2- 172.21.15.36:0/3315485081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f832c061920 0x7f832c0afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.015+0000 7f8332c64700 1 -- 172.21.15.36:0/3315485081 >> 172.21.15.36:0/3315485081 conn(0x7f832c05c490 msgr2=0x7f832c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:21.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.015+0000 7f8332c64700 1 -- 172.21.15.36:0/3315485081 shutdown_connections 2022-01-10T01:32:21.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.015+0000 7f8332c64700 1 -- 172.21.15.36:0/3315485081 wait complete. 2022-01-10T01:32:21.035 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2022-01-10T01:32:21.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f9521c48700 1 Processor -- start 2022-01-10T01:32:21.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f9521c48700 1 -- start start 2022-01-10T01:32:21.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f9521c48700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f951c0a9eb0 0x7f951c0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:21.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f9521c48700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f951c0af070 0x7f951c144480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:21.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f9521c48700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f951c0aa290 con 0x7f951c0b3130 2022-01-10T01:32:21.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f9521c48700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c0ae300 con 0x7f951c0af070 2022-01-10T01:32:21.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f9521c48700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c148170 con 0x7f951c0a9eb0 2022-01-10T01:32:21.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f951bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f951c0af070 0x7f951c144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:21.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f951bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f951c0af070 0x7f951c144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40504/0 (socket says 172.21.15.36:40504) 2022-01-10T01:32:21.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f951b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f951c0a9eb0 0x7f951c0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:21.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f951bfff700 1 -- 172.21.15.36:0/3185245355 learned_addr learned my addr 172.21.15.36:0/3185245355 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:21.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f951affd700 1 --1- 172.21.15.36:0/3185245355 >> v1:172.21.15.59:6789/0 conn(0x7f951c0b3130 0x7f951c14b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:55970/0 (socket says 172.21.15.36:55970) 2022-01-10T01:32:21.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f951bfff700 1 -- 172.21.15.36:0/3185245355 >> v2:172.21.15.59:3300/0 conn(0x7f951c0a9eb0 msgr2=0x7f951c0b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:21.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f951bfff700 1 --2- 172.21.15.36:0/3185245355 >> v2:172.21.15.59:3300/0 conn(0x7f951c0a9eb0 0x7f951c0b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f951bfff700 1 -- 172.21.15.36:0/3185245355 >> v1:172.21.15.59:6789/0 conn(0x7f951c0b3130 legacy=0x7f951c14b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:21.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f951bfff700 1 -- 172.21.15.36:0/3185245355 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c148410 con 0x7f951c0af070 2022-01-10T01:32:21.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f951bfff700 1 --2- 172.21.15.36:0/3185245355 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f951c0af070 0x7f951c144480 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f950c002f70 tx=0x7f950c006eb0).ready entity=mon.0 client_cookie=4f4a929a14948672 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:21.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f951a7fc700 1 -- 172.21.15.36:0/3185245355 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f950c00d5c0 con 0x7f951c0af070 2022-01-10T01:32:21.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f951a7fc700 1 -- 172.21.15.36:0/3185245355 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c000e90 con 0x7f951c0af070 2022-01-10T01:32:21.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.139+0000 7f951a7fc700 1 -- 172.21.15.36:0/3185245355 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f950c00d950 con 0x7f951c0af070 2022-01-10T01:32:21.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.143+0000 7f9521c48700 1 -- 172.21.15.36:0/3185245355 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f951c0af070 msgr2=0x7f951c144480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:21.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.143+0000 7f9521c48700 1 --2- 172.21.15.36:0/3185245355 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f951c0af070 0x7f951c144480 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f950c002f70 tx=0x7f950c006eb0).stop 2022-01-10T01:32:21.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.143+0000 7f9521c48700 1 -- 172.21.15.36:0/3185245355 shutdown_connections 2022-01-10T01:32:21.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.143+0000 7f9521c48700 1 --2- 172.21.15.36:0/3185245355 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f951c0af070 0x7f951c144480 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.143+0000 7f9521c48700 1 --2- 172.21.15.36:0/3185245355 >> v2:172.21.15.59:3300/0 conn(0x7f951c0a9eb0 0x7f951c0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.143+0000 7f9521c48700 1 -- 172.21.15.36:0/3185245355 >> 172.21.15.36:0/3185245355 conn(0x7f951c0607c0 msgr2=0x7f951c060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:21.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.143+0000 7f9521c48700 1 -- 172.21.15.36:0/3185245355 shutdown_connections 2022-01-10T01:32:21.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.143+0000 7f9521c48700 1 -- 172.21.15.36:0/3185245355 wait complete. 2022-01-10T01:32:21.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.143+0000 7f9521c48700 1 Processor -- start 2022-01-10T01:32:21.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.143+0000 7f9521c48700 1 -- start start 2022-01-10T01:32:21.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f9521c48700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c0a9eb0 0x7f951c0b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:21.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f9521c48700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c0af070 0x7f951c156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:21.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f9521c48700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f951c0b3130 0x7f951c156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:21.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f9521c48700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0b22b0 con 0x7f951c0b3130 2022-01-10T01:32:21.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f9521c48700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c149d50 con 0x7f951c0af070 2022-01-10T01:32:21.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f9521c48700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0b24e0 con 0x7f951c0a9eb0 2022-01-10T01:32:21.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f951bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f951c0b3130 0x7f951c156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:21.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f951bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f951c0b3130 0x7f951c156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40510/0 (socket says 172.21.15.36:40510) 2022-01-10T01:32:21.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f951bfff700 1 -- 172.21.15.36:0/909136021 learned_addr learned my addr 172.21.15.36:0/909136021 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:21.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f951affd700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c0af070 0x7f951c156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:21.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f951b7fe700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c0a9eb0 0x7f951c0b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:21.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f951bfff700 1 -- 172.21.15.36:0/909136021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c0a9eb0 msgr2=0x7f951c0b6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:21.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f951bfff700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c0a9eb0 0x7f951c0b6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f951bfff700 1 -- 172.21.15.36:0/909136021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c0af070 msgr2=0x7f951c156980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:21.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f951bfff700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c0af070 0x7f951c156980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f951bfff700 1 -- 172.21.15.36:0/909136021 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950c00b1e0 con 0x7f951c0b3130 2022-01-10T01:32:21.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f951affd700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c0af070 0x7f951c156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:21.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f951bfff700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f951c0b3130 0x7f951c156e70 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f950c002f70 tx=0x7f950c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:21.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f9518ff9700 1 -- 172.21.15.36:0/909136021 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f950c011790 con 0x7f951c0b3130 2022-01-10T01:32:21.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f9518ff9700 1 -- 172.21.15.36:0/909136021 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c0118f0 con 0x7f951c0b3130 2022-01-10T01:32:21.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f9518ff9700 1 -- 172.21.15.36:0/909136021 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f950c011c50 con 0x7f951c0b3130 2022-01-10T01:32:21.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f9521c48700 1 -- 172.21.15.36:0/909136021 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951c14a1e0 con 0x7f951c0b3130 2022-01-10T01:32:21.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f9521c48700 1 -- 172.21.15.36:0/909136021 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c149f20 con 0x7f951c0b3130 2022-01-10T01:32:21.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f9518ff9700 1 -- 172.21.15.36:0/909136021 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f950c025030 con 0x7f951c0b3130 2022-01-10T01:32:21.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.147+0000 7f9521c48700 1 -- 172.21.15.36:0/909136021 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951c14ae20 con 0x7f951c0b3130 2022-01-10T01:32:21.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.151+0000 7f9518ff9700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94fc0534d0 0x7f94fc055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:21.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.151+0000 7f9518ff9700 1 -- 172.21.15.36:0/909136021 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f950c06c960 con 0x7f951c0b3130 2022-01-10T01:32:21.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.151+0000 7f951b7fe700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94fc0534d0 0x7f94fc055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:21.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.151+0000 7f951b7fe700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94fc0534d0 0x7f94fc055990 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f951000b000 tx=0x7f9510008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:21.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.155+0000 7f9518ff9700 1 -- 172.21.15.36:0/909136021 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f950c043c50 con 0x7f951c0b3130 2022-01-10T01:32:21.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.327+0000 7f9521c48700 1 -- 172.21.15.36:0/909136021 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7f951c057350 con 0x7f951c0b3130 2022-01-10T01:32:21.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.731+0000 7f9518ff9700 1 -- 172.21.15.36:0/909136021 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v360) v1 ==== 127+0+0 (secure 0 0 0) 0x7f950c023020 con 0x7f951c0b3130 2022-01-10T01:32:21.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.735+0000 7f9521c48700 1 -- 172.21.15.36:0/909136021 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94fc0534d0 msgr2=0x7f94fc055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:21.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.735+0000 7f9521c48700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94fc0534d0 0x7f94fc055990 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f951000b000 tx=0x7f9510008040).stop 2022-01-10T01:32:21.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.735+0000 7f9521c48700 1 -- 172.21.15.36:0/909136021 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f951c0b3130 msgr2=0x7f951c156e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:21.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.735+0000 7f9521c48700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f951c0b3130 0x7f951c156e70 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f950c002f70 tx=0x7f950c015000).stop 2022-01-10T01:32:21.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.735+0000 7f9521c48700 1 -- 172.21.15.36:0/909136021 shutdown_connections 2022-01-10T01:32:21.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.735+0000 7f9521c48700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94fc0534d0 0x7f94fc055990 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.735+0000 7f9521c48700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f951c0b3130 0x7f951c156e70 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.735+0000 7f9521c48700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f951c0af070 0x7f951c156980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.735+0000 7f9521c48700 1 --2- 172.21.15.36:0/909136021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f951c0a9eb0 0x7f951c0b6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.735+0000 7f9521c48700 1 -- 172.21.15.36:0/909136021 >> 172.21.15.36:0/909136021 conn(0x7f951c0607c0 msgr2=0x7f951c0af9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:21.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.735+0000 7f9521c48700 1 -- 172.21.15.36:0/909136021 shutdown_connections 2022-01-10T01:32:21.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.735+0000 7f9521c48700 1 -- 172.21.15.36:0/909136021 wait complete. 2022-01-10T01:32:21.754 INFO:tasks.cephfs_test_runner:test_filtered_df (tasks.cephfs.test_misc.TestMisc) ... ok 2022-01-10T01:32:21.755 INFO:tasks.cephfs_test_runner:Starting test: test_fs_new (tasks.cephfs.test_misc.TestMisc) 2022-01-10T01:32:21.756 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2022-01-10T01:32:21.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.863+0000 7f5223f41700 1 Processor -- start 2022-01-10T01:32:21.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.863+0000 7f5223f41700 1 -- start start 2022-01-10T01:32:21.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5223f41700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f521c0b6760 0x7f521c13ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:21.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5223f41700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521c0ac550 con 0x7f521c05fdb0 2022-01-10T01:32:21.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5223f41700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521c0ac7f0 con 0x7f521c0aa080 2022-01-10T01:32:21.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5223f41700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521c0aca90 con 0x7f521c0b6760 2022-01-10T01:32:21.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f52224de700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f521c05fdb0 0x7f521c14db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38312/0 (socket says 172.21.15.36:38312) 2022-01-10T01:32:21.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f52224de700 1 -- 172.21.15.36:0/3105101377 learned_addr learned my addr 172.21.15.36:0/3105101377 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:21.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5221cdd700 1 --2- 172.21.15.36:0/3105101377 >> v2:172.21.15.59:3300/0 conn(0x7f521c0b6760 0x7f521c13ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:21.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5220cdb700 1 -- 172.21.15.36:0/3105101377 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154570011 0 0) 0x7f521c0ac550 con 0x7f521c05fdb0 2022-01-10T01:32:21.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5220cdb700 1 -- 172.21.15.36:0/3105101377 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5204003260 con 0x7f521c05fdb0 2022-01-10T01:32:21.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5221cdd700 1 -- 172.21.15.36:0/3105101377 >> v1:172.21.15.59:6789/0 conn(0x7f521c0aa080 legacy=0x7f521c1467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:21.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5221cdd700 1 -- 172.21.15.36:0/3105101377 >> v1:172.21.15.36:6789/0 conn(0x7f521c05fdb0 legacy=0x7f521c14db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:21.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5221cdd700 1 -- 172.21.15.36:0/3105101377 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c0acd30 con 0x7f521c0b6760 2022-01-10T01:32:21.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5221cdd700 1 --2- 172.21.15.36:0/3105101377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c0b6760 0x7f521c13ccf0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f5218002f70 tx=0x7f5218006df0).ready entity=mon.1 client_cookie=ca420088bd5d60e9 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:21.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5220cdb700 1 -- 172.21.15.36:0/3105101377 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f521800d610 con 0x7f521c0b6760 2022-01-10T01:32:21.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5220cdb700 1 -- 172.21.15.36:0/3105101377 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5218000e90 con 0x7f521c0b6760 2022-01-10T01:32:21.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5220cdb700 1 -- 172.21.15.36:0/3105101377 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f521800d960 con 0x7f521c0b6760 2022-01-10T01:32:21.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5223f41700 1 -- 172.21.15.36:0/3105101377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c0b6760 msgr2=0x7f521c13ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:21.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5223f41700 1 --2- 172.21.15.36:0/3105101377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c0b6760 0x7f521c13ccf0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f5218002f70 tx=0x7f5218006df0).stop 2022-01-10T01:32:21.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5223f41700 1 -- 172.21.15.36:0/3105101377 shutdown_connections 2022-01-10T01:32:21.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5223f41700 1 --2- 172.21.15.36:0/3105101377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c0b6760 0x7f521c13ccf0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5223f41700 1 -- 172.21.15.36:0/3105101377 >> 172.21.15.36:0/3105101377 conn(0x7f521c0b3480 msgr2=0x7f521c0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:21.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.867+0000 7f5223f41700 1 -- 172.21.15.36:0/3105101377 shutdown_connections 2022-01-10T01:32:21.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f5223f41700 1 -- 172.21.15.36:0/3105101377 wait complete. 2022-01-10T01:32:21.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f5223f41700 1 Processor -- start 2022-01-10T01:32:21.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f5223f41700 1 -- start start 2022-01-10T01:32:21.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f5223f41700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c05fdb0 0x7f521c0af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:21.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f5223f41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521c0aa080 0x7f521c1566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:21.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f5223f41700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f521c0b6760 0x7f521c152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:21.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f5223f41700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c145fb0 con 0x7f521c0b6760 2022-01-10T01:32:21.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f5223f41700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c152720 con 0x7f521c05fdb0 2022-01-10T01:32:21.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f5223f41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c156bb0 con 0x7f521c0aa080 2022-01-10T01:32:21.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f52224de700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f521c0b6760 0x7f521c152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:21.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f52224de700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f521c0b6760 0x7f521c152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40524/0 (socket says 172.21.15.36:40524) 2022-01-10T01:32:21.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f52224de700 1 -- 172.21.15.36:0/4091204809 learned_addr learned my addr 172.21.15.36:0/4091204809 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:21.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f5221cdd700 1 --2- 172.21.15.36:0/4091204809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c05fdb0 0x7f521c0af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:21.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f52214dc700 1 --2- 172.21.15.36:0/4091204809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521c0aa080 0x7f521c1566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:21.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f52224de700 1 -- 172.21.15.36:0/4091204809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521c0aa080 msgr2=0x7f521c1566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:21.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f52224de700 1 --2- 172.21.15.36:0/4091204809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521c0aa080 0x7f521c1566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f52224de700 1 -- 172.21.15.36:0/4091204809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c05fdb0 msgr2=0x7f521c0af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:21.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f52224de700 1 --2- 172.21.15.36:0/4091204809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c05fdb0 0x7f521c0af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:21.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f52224de700 1 -- 172.21.15.36:0/4091204809 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521800b180 con 0x7f521c0b6760 2022-01-10T01:32:21.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.871+0000 7f52224de700 1 --2- 172.21.15.36:0/4091204809 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f521c0b6760 0x7f521c152b10 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f5214001490 tx=0x7f5214007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:21.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.875+0000 7f520affd700 1 -- 172.21.15.36:0/4091204809 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5214005ba0 con 0x7f521c0b6760 2022-01-10T01:32:21.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.875+0000 7f520affd700 1 -- 172.21.15.36:0/4091204809 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5214005d00 con 0x7f521c0b6760 2022-01-10T01:32:21.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.875+0000 7f5223f41700 1 -- 172.21.15.36:0/4091204809 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521c065840 con 0x7f521c0b6760 2022-01-10T01:32:21.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.875+0000 7f520affd700 1 -- 172.21.15.36:0/4091204809 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52140072c0 con 0x7f521c0b6760 2022-01-10T01:32:21.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.875+0000 7f5223f41700 1 -- 172.21.15.36:0/4091204809 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521c150360 con 0x7f521c0b6760 2022-01-10T01:32:21.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.875+0000 7f520affd700 1 -- 172.21.15.36:0/4091204809 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5214010070 con 0x7f521c0b6760 2022-01-10T01:32:21.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.875+0000 7f5223f41700 1 -- 172.21.15.36:0/4091204809 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521c057350 con 0x7f521c0b6760 2022-01-10T01:32:21.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.875+0000 7f520affd700 1 --2- 172.21.15.36:0/4091204809 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51fc0536b0 0x7f51fc055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:21.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.875+0000 7f520affd700 1 -- 172.21.15.36:0/4091204809 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f521406b030 con 0x7f521c0b6760 2022-01-10T01:32:21.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.875+0000 7f5221cdd700 1 --2- 172.21.15.36:0/4091204809 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51fc0536b0 0x7f51fc055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:21.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.875+0000 7f5221cdd700 1 --2- 172.21.15.36:0/4091204809 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51fc0536b0 0x7f51fc055b70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f521801a000 tx=0x7f5218014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:21.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:21.883+0000 7f520affd700 1 -- 172.21.15.36:0/4091204809 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5214068e90 con 0x7f521c0b6760 2022-01-10T01:32:22.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.055+0000 7f5223f41700 1 -- 172.21.15.36:0/4091204809 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f521c140b10 con 0x7f521c0b6760 2022-01-10T01:32:22.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.739+0000 7f520affd700 1 -- 172.21.15.36:0/4091204809 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v361) v1 ==== 125+0+0 (secure 0 0 0) 0x7f5214018030 con 0x7f521c0b6760 2022-01-10T01:32:22.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.743+0000 7f5223f41700 1 -- 172.21.15.36:0/4091204809 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51fc0536b0 msgr2=0x7f51fc055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:22.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.743+0000 7f5223f41700 1 --2- 172.21.15.36:0/4091204809 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51fc0536b0 0x7f51fc055b70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f521801a000 tx=0x7f5218014000).stop 2022-01-10T01:32:22.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.743+0000 7f5223f41700 1 -- 172.21.15.36:0/4091204809 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f521c0b6760 msgr2=0x7f521c152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:22.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.743+0000 7f5223f41700 1 --2- 172.21.15.36:0/4091204809 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f521c0b6760 0x7f521c152b10 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f5214001490 tx=0x7f5214007e00).stop 2022-01-10T01:32:22.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.743+0000 7f5223f41700 1 -- 172.21.15.36:0/4091204809 shutdown_connections 2022-01-10T01:32:22.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.743+0000 7f5223f41700 1 --2- 172.21.15.36:0/4091204809 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51fc0536b0 0x7f51fc055b70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:22.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.743+0000 7f5223f41700 1 --2- 172.21.15.36:0/4091204809 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f521c0b6760 0x7f521c152b10 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:22.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.743+0000 7f5223f41700 1 --2- 172.21.15.36:0/4091204809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f521c0aa080 0x7f521c1566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:22.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.743+0000 7f5223f41700 1 --2- 172.21.15.36:0/4091204809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f521c05fdb0 0x7f521c0af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:22.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.743+0000 7f5223f41700 1 -- 172.21.15.36:0/4091204809 >> 172.21.15.36:0/4091204809 conn(0x7f521c0b3480 msgr2=0x7f521c0b4670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:22.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.743+0000 7f5223f41700 1 -- 172.21.15.36:0/4091204809 shutdown_connections 2022-01-10T01:32:22.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.743+0000 7f5223f41700 1 -- 172.21.15.36:0/4091204809 wait complete. 2022-01-10T01:32:22.760 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2022-01-10T01:32:22.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.875+0000 7fd8ef7b0700 1 Processor -- start 2022-01-10T01:32:22.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.875+0000 7fd8ef7b0700 1 -- start start 2022-01-10T01:32:22.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd8e80af780 0x7fd8e80b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:22.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e80b0790 0x7fd8e813dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:22.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8e80b43c0 0x7fd8e813e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:22.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e813ed20 con 0x7fd8e80af780 2022-01-10T01:32:22.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e805ca50 con 0x7fd8e80b43c0 2022-01-10T01:32:22.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80b3ff0 con 0x7fd8e80b0790 2022-01-10T01:32:22.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ed54c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd8e80af780 0x7fd8e80b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:22.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ed54c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd8e80af780 0x7fd8e80b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40528/0 (socket says 172.21.15.36:40528) 2022-01-10T01:32:22.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ed54c700 1 -- 172.21.15.36:0/1813389957 learned_addr learned my addr 172.21.15.36:0/1813389957 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:22.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8edd4d700 1 --2- 172.21.15.36:0/1813389957 >> v2:172.21.15.59:3300/0 conn(0x7fd8e80b43c0 0x7fd8e813e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:22.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ecd4b700 1 --2- 172.21.15.36:0/1813389957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e80b0790 0x7fd8e813dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:22.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ed54c700 1 -- 172.21.15.36:0/1813389957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e80b0790 msgr2=0x7fd8e813dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:22.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ed54c700 1 --2- 172.21.15.36:0/1813389957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e80b0790 0x7fd8e813dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:22.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ed54c700 1 -- 172.21.15.36:0/1813389957 >> v2:172.21.15.59:3300/0 conn(0x7fd8e80b43c0 msgr2=0x7fd8e813e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:22.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ed54c700 1 --2- 172.21.15.36:0/1813389957 >> v2:172.21.15.59:3300/0 conn(0x7fd8e80b43c0 0x7fd8e813e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:22.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ed54c700 1 -- 172.21.15.36:0/1813389957 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e80afb60 con 0x7fd8e80af780 2022-01-10T01:32:22.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ecd4b700 1 --2- 172.21.15.36:0/1813389957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e80b0790 0x7fd8e813dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:22.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ed54c700 1 --2- 172.21.15.36:0/1813389957 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8e80af780 0x7fd8e80b1e20 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fd8e4002f70 tx=0x7fd8e4006eb0).ready entity=mon.0 client_cookie=ebf69df16820007c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:22.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8d7fff700 1 -- 172.21.15.36:0/1813389957 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e400d570 con 0x7fd8e80af780 2022-01-10T01:32:22.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8d7fff700 1 -- 172.21.15.36:0/1813389957 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e4000e90 con 0x7fd8e80af780 2022-01-10T01:32:22.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8d7fff700 1 -- 172.21.15.36:0/1813389957 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e400d900 con 0x7fd8e80af780 2022-01-10T01:32:22.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/1813389957 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8e80af780 msgr2=0x7fd8e80b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:22.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 --2- 172.21.15.36:0/1813389957 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8e80af780 0x7fd8e80b1e20 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fd8e4002f70 tx=0x7fd8e4006eb0).stop 2022-01-10T01:32:22.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/1813389957 shutdown_connections 2022-01-10T01:32:22.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 --2- 172.21.15.36:0/1813389957 >> v2:172.21.15.59:3300/0 conn(0x7fd8e80b43c0 0x7fd8e813e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:22.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 --2- 172.21.15.36:0/1813389957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e80b0790 0x7fd8e813dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:22.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 --2- 172.21.15.36:0/1813389957 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8e80af780 0x7fd8e80b1e20 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:22.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/1813389957 >> 172.21.15.36:0/1813389957 conn(0x7fd8e806a110 msgr2=0x7fd8e805cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:22.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/1813389957 shutdown_connections 2022-01-10T01:32:22.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.879+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/1813389957 wait complete. 2022-01-10T01:32:22.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ef7b0700 1 Processor -- start 2022-01-10T01:32:22.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ef7b0700 1 -- start start 2022-01-10T01:32:22.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ef7b0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8e80af780 0x7fd8e80ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:22.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ef7b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e80b0790 0x7fd8e8152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:22.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ef7b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e80b43c0 0x7fd8e81415b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:22.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ef7b0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80af2b0 con 0x7fd8e80af780 2022-01-10T01:32:22.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ef7b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e81401b0 con 0x7fd8e80b43c0 2022-01-10T01:32:22.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ef7b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80ad720 con 0x7fd8e80b0790 2022-01-10T01:32:22.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ed54c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8e80af780 0x7fd8e80ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:22.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ed54c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8e80af780 0x7fd8e80ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40534/0 (socket says 172.21.15.36:40534) 2022-01-10T01:32:22.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ed54c700 1 -- 172.21.15.36:0/457439369 learned_addr learned my addr 172.21.15.36:0/457439369 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:22.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ecd4b700 1 --2- 172.21.15.36:0/457439369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e80b0790 0x7fd8e8152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:22.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8edd4d700 1 --2- 172.21.15.36:0/457439369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e80b43c0 0x7fd8e81415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:22.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ed54c700 1 -- 172.21.15.36:0/457439369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e80b0790 msgr2=0x7fd8e8152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:22.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ed54c700 1 --2- 172.21.15.36:0/457439369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e80b0790 0x7fd8e8152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:22.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ed54c700 1 -- 172.21.15.36:0/457439369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e80b43c0 msgr2=0x7fd8e81415b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:22.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ed54c700 1 --2- 172.21.15.36:0/457439369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e80b43c0 0x7fd8e81415b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:22.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ed54c700 1 -- 172.21.15.36:0/457439369 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e400b1e0 con 0x7fd8e80af780 2022-01-10T01:32:22.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.883+0000 7fd8ed54c700 1 --2- 172.21.15.36:0/457439369 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8e80af780 0x7fd8e80ad230 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7fd8e8065530 tx=0x7fd8e4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:22.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.887+0000 7fd8d67fc700 1 -- 172.21.15.36:0/457439369 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e40068b0 con 0x7fd8e80af780 2022-01-10T01:32:22.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.887+0000 7fd8d67fc700 1 -- 172.21.15.36:0/457439369 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e4011b40 con 0x7fd8e80af780 2022-01-10T01:32:22.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.887+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/457439369 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e8153200 con 0x7fd8e80af780 2022-01-10T01:32:22.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.887+0000 7fd8d67fc700 1 -- 172.21.15.36:0/457439369 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e4011ea0 con 0x7fd8e80af780 2022-01-10T01:32:22.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.887+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/457439369 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e8140610 con 0x7fd8e80af780 2022-01-10T01:32:22.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.887+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/457439369 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e81407d0 con 0x7fd8e80af780 2022-01-10T01:32:22.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.887+0000 7fd8d67fc700 1 -- 172.21.15.36:0/457439369 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd8e4025030 con 0x7fd8e80af780 2022-01-10T01:32:22.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.887+0000 7fd8d67fc700 1 --2- 172.21.15.36:0/457439369 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8c80534d0 0x7fd8c8055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:22.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.887+0000 7fd8d67fc700 1 -- 172.21.15.36:0/457439369 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fd8e406c820 con 0x7fd8e80af780 2022-01-10T01:32:22.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.887+0000 7fd8ecd4b700 1 --2- 172.21.15.36:0/457439369 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8c80534d0 0x7fd8c8055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:22.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.887+0000 7fd8ecd4b700 1 --2- 172.21.15.36:0/457439369 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8c80534d0 0x7fd8c8055990 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fd8d800c000 tx=0x7fd8d8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:22.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:22.895+0000 7fd8d67fc700 1 -- 172.21.15.36:0/457439369 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd8e4043b10 con 0x7fd8e80af780 2022-01-10T01:32:23.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.027+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/457439369 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd8e8057350 con 0x7fd8e80af780 2022-01-10T01:32:23.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.035+0000 7fd8d67fc700 1 -- 172.21.15.36:0/457439369 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd8e4023070 con 0x7fd8e80af780 2022-01-10T01:32:23.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.039+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/457439369 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8c80534d0 msgr2=0x7fd8c8055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:23.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.039+0000 7fd8ef7b0700 1 --2- 172.21.15.36:0/457439369 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8c80534d0 0x7fd8c8055990 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7fd8d800c000 tx=0x7fd8d8008040).stop 2022-01-10T01:32:23.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.039+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/457439369 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8e80af780 msgr2=0x7fd8e80ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:23.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.039+0000 7fd8ef7b0700 1 --2- 172.21.15.36:0/457439369 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8e80af780 0x7fd8e80ad230 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7fd8e8065530 tx=0x7fd8e4015000).stop 2022-01-10T01:32:23.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.039+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/457439369 shutdown_connections 2022-01-10T01:32:23.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.039+0000 7fd8ef7b0700 1 --2- 172.21.15.36:0/457439369 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd8c80534d0 0x7fd8c8055990 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.039+0000 7fd8ef7b0700 1 --2- 172.21.15.36:0/457439369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8e80b43c0 0x7fd8e81415b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.039+0000 7fd8ef7b0700 1 --2- 172.21.15.36:0/457439369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8e80b0790 0x7fd8e8152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.039+0000 7fd8ef7b0700 1 --2- 172.21.15.36:0/457439369 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd8e80af780 0x7fd8e80ad230 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.039+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/457439369 >> 172.21.15.36:0/457439369 conn(0x7fd8e806a110 msgr2=0x7fd8e8060300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:23.049 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.039+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/457439369 shutdown_connections 2022-01-10T01:32:23.050 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.039+0000 7fd8ef7b0700 1 -- 172.21.15.36:0/457439369 wait complete. 2022-01-10T01:32:23.058 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:32:23.059 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:32:23.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:32:23.098 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:32:23.120 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:32:23.143 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:32:23.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:23.144 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:23.144 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:23.175 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2022-01-10T01:32:23.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:32:23.178 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2022-01-10T01:32:23.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:23.179 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:23.180 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:23.198 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:32:23.200 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:32:23.200 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:32:23.200 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:32:23.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1dacca3700 1 Processor -- start 2022-01-10T01:32:23.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1dacca3700 1 -- start start 2022-01-10T01:32:23.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1dacca3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1da80b04a0 0x7f1da80add30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1dacca3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da80aa120 0x7f1da80ae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1dacca3700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da80b2af0 con 0x7f1da80b0880 2022-01-10T01:32:23.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1dacca3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da80b2770 con 0x7f1da80b04a0 2022-01-10T01:32:23.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1dacca3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80b2d20 con 0x7f1da80aa120 2022-01-10T01:32:23.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da6d9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f1da80b0880 0x7f1da8143710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38340/0 (socket says 172.21.15.36:38340) 2022-01-10T01:32:23.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da6d9d700 1 -- 172.21.15.36:0/4037026329 learned_addr learned my addr 172.21.15.36:0/4037026329 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:23.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da659c700 1 --2- 172.21.15.36:0/4037026329 >> v2:172.21.15.59:3300/0 conn(0x7f1da80b04a0 0x7f1da80add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da5d9b700 1 --2- 172.21.15.36:0/4037026329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da80aa120 0x7f1da80ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 -- 172.21.15.36:0/4037026329 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568596606 0 0) 0x7f1da80b2af0 con 0x7f1da80b0880 2022-01-10T01:32:23.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 -- 172.21.15.36:0/4037026329 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d8c003260 con 0x7f1da80b0880 2022-01-10T01:32:23.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 -- 172.21.15.36:0/4037026329 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1045156389 0 0) 0x7f1d8c003260 con 0x7f1da80b0880 2022-01-10T01:32:23.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 -- 172.21.15.36:0/4037026329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da80aa120 msgr2=0x7f1da80ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:23.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 --2- 172.21.15.36:0/4037026329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da80aa120 0x7f1da80ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 -- 172.21.15.36:0/4037026329 >> v2:172.21.15.59:3300/0 conn(0x7f1da80b04a0 msgr2=0x7f1da80add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:23.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 --2- 172.21.15.36:0/4037026329 >> v2:172.21.15.59:3300/0 conn(0x7f1da80b04a0 0x7f1da80add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 -- 172.21.15.36:0/4037026329 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da80a9b70 con 0x7f1da80b0880 2022-01-10T01:32:23.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 -- 172.21.15.36:0/4037026329 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f1da00019e0 con 0x7f1da80b0880 2022-01-10T01:32:23.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 -- 172.21.15.36:0/4037026329 >> v1:172.21.15.36:6789/0 conn(0x7f1da80b0880 legacy=0x7f1da8143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:23.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 --2- 172.21.15.36:0/4037026329 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d8c003750 0x7f1d8c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 --2- 172.21.15.36:0/4037026329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da80aa120 0x7f1d8c004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 --2- 172.21.15.36:0/4037026329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d8c0049f0 0x7f1d8c004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 -- 172.21.15.36:0/4037026329 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80b2770 con 0x7f1d8c003750 2022-01-10T01:32:23.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 -- 172.21.15.36:0/4037026329 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80b2d20 con 0x7f1d8c0049f0 2022-01-10T01:32:23.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 -- 172.21.15.36:0/4037026329 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c00b750 con 0x7f1da80aa120 2022-01-10T01:32:23.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da659c700 1 --2- 172.21.15.36:0/4037026329 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d8c003750 0x7f1d8c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da6d9d700 1 --2- 172.21.15.36:0/4037026329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d8c0049f0 0x7f1d8c004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da5d9b700 1 --2- 172.21.15.36:0/4037026329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da80aa120 0x7f1d8c004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da659c700 1 -- 172.21.15.36:0/4037026329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da80aa120 msgr2=0x7f1d8c004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:23.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da659c700 1 --2- 172.21.15.36:0/4037026329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da80aa120 0x7f1d8c004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da659c700 1 -- 172.21.15.36:0/4037026329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d8c0049f0 msgr2=0x7f1d8c004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:23.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da659c700 1 --2- 172.21.15.36:0/4037026329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d8c0049f0 0x7f1d8c004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da659c700 1 -- 172.21.15.36:0/4037026329 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c003260 con 0x7f1d8c003750 2022-01-10T01:32:23.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da6d9d700 1 --2- 172.21.15.36:0/4037026329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d8c0049f0 0x7f1d8c004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:23.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da659c700 1 --2- 172.21.15.36:0/4037026329 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d8c003750 0x7f1d8c003b70 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f1d9c00c000 tx=0x7f1d9c006df0).ready entity=mon.0 client_cookie=b07224b2e9c8f6ec server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:23.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 -- 172.21.15.36:0/4037026329 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9c00e830 con 0x7f1d8c003750 2022-01-10T01:32:23.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 -- 172.21.15.36:0/4037026329 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c00e990 con 0x7f1d8c003750 2022-01-10T01:32:23.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.315+0000 7f1da559a700 1 -- 172.21.15.36:0/4037026329 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9c00ecf0 con 0x7f1d8c003750 2022-01-10T01:32:23.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.319+0000 7f1dacca3700 1 -- 172.21.15.36:0/4037026329 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d8c003750 msgr2=0x7f1d8c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:23.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.319+0000 7f1dacca3700 1 --2- 172.21.15.36:0/4037026329 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d8c003750 0x7f1d8c003b70 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f1d9c00c000 tx=0x7f1d9c006df0).stop 2022-01-10T01:32:23.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.319+0000 7f1da6d9d700 1 -- 172.21.15.36:0/4037026329 reap_dead start 2022-01-10T01:32:23.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.319+0000 7f1dacca3700 1 -- 172.21.15.36:0/4037026329 shutdown_connections 2022-01-10T01:32:23.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.319+0000 7f1dacca3700 1 -- 172.21.15.36:0/4037026329 >> 172.21.15.36:0/4037026329 conn(0x7f1da80607c0 msgr2=0x7f1da8060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:23.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.319+0000 7f1dacca3700 1 -- 172.21.15.36:0/4037026329 shutdown_connections 2022-01-10T01:32:23.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.319+0000 7f1dacca3700 1 -- 172.21.15.36:0/4037026329 wait complete. 2022-01-10T01:32:23.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.319+0000 7f1dacca3700 1 Processor -- start 2022-01-10T01:32:23.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.319+0000 7f1dacca3700 1 -- start start 2022-01-10T01:32:23.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1dacca3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d8c003750 0x7f1da8063fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1dacca3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da8064580 0x7f1da8064a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1dacca3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da8064ef0 0x7f1da8135d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1dacca3700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da8137580 con 0x7f1d8c003750 2022-01-10T01:32:23.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1dacca3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80aa920 con 0x7f1da8064ef0 2022-01-10T01:32:23.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1dacca3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80aabc0 con 0x7f1da8064580 2022-01-10T01:32:23.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1da659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d8c003750 0x7f1da8063fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1da659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d8c003750 0x7f1da8063fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40554/0 (socket says 172.21.15.36:40554) 2022-01-10T01:32:23.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1da659c700 1 -- 172.21.15.36:0/3794735138 learned_addr learned my addr 172.21.15.36:0/3794735138 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:23.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1da5d9b700 1 --2- 172.21.15.36:0/3794735138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da8064580 0x7f1da8064a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1da6d9d700 1 --2- 172.21.15.36:0/3794735138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da8064ef0 0x7f1da8135d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1da659c700 1 -- 172.21.15.36:0/3794735138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da8064580 msgr2=0x7f1da8064a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:23.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1da659c700 1 --2- 172.21.15.36:0/3794735138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da8064580 0x7f1da8064a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1da659c700 1 -- 172.21.15.36:0/3794735138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da8064ef0 msgr2=0x7f1da8135d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:23.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1da659c700 1 --2- 172.21.15.36:0/3794735138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da8064ef0 0x7f1da8135d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1da659c700 1 -- 172.21.15.36:0/3794735138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da80673f0 con 0x7f1d8c003750 2022-01-10T01:32:23.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1da659c700 1 --2- 172.21.15.36:0/3794735138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d8c003750 0x7f1da8063fc0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f1d9c00c000 tx=0x7f1d9c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:23.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1d977fe700 1 -- 172.21.15.36:0/3794735138 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9c01b820 con 0x7f1d8c003750 2022-01-10T01:32:23.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1d977fe700 1 -- 172.21.15.36:0/3794735138 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9c000e90 con 0x7f1d8c003750 2022-01-10T01:32:23.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1dacca3700 1 -- 172.21.15.36:0/3794735138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da80ab660 con 0x7f1d8c003750 2022-01-10T01:32:23.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1d977fe700 1 -- 172.21.15.36:0/3794735138 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d9c01bb70 con 0x7f1d8c003750 2022-01-10T01:32:23.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1dacca3700 1 -- 172.21.15.36:0/3794735138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da8067670 con 0x7f1d8c003750 2022-01-10T01:32:23.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.323+0000 7f1dacca3700 1 -- 172.21.15.36:0/3794735138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da8057350 con 0x7f1d8c003750 2022-01-10T01:32:23.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.327+0000 7f1d977fe700 1 -- 172.21.15.36:0/3794735138 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1d9c01bcd0 con 0x7f1d8c003750 2022-01-10T01:32:23.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.327+0000 7f1d977fe700 1 --2- 172.21.15.36:0/3794735138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1d84053680 0x7f1d84055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.327+0000 7f1d977fe700 1 -- 172.21.15.36:0/3794735138 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f1d9c06c9e0 con 0x7f1d8c003750 2022-01-10T01:32:23.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.327+0000 7f1da5d9b700 1 --2- 172.21.15.36:0/3794735138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1d84053680 0x7f1d84055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.327+0000 7f1da5d9b700 1 --2- 172.21.15.36:0/3794735138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1d84053680 0x7f1d84055b40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f1d9800b000 tx=0x7f1d98006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:23.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.331+0000 7f1d977fe700 1 -- 172.21.15.36:0/3794735138 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1d9c043cd0 con 0x7f1d8c003750 2022-01-10T01:32:23.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.459+0000 7f1dacca3700 1 -- 172.21.15.36:0/3794735138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1da8044650 con 0x7f1d8c003750 2022-01-10T01:32:23.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.459+0000 7f1d977fe700 1 -- 172.21.15.36:0/3794735138 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v113) v1 ==== 81+0+29227 (secure 0 0 0) 0x7f1d9c0472f0 con 0x7f1d8c003750 2022-01-10T01:32:23.465 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:23.465 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:32:23.466 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 113, 2022-01-10T01:32:23.466 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:32:23.467 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:32:23.467 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:32:20.713759+0000", 2022-01-10T01:32:23.467 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:32:23.467 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:32:23.468 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:32:23.468 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:32:23.468 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:32:23.468 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:32:23.469 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:32:23.469 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:32:23.469 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:32:23.469 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:32:23.469 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:32:23.470 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:32:23.470 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:32:23.470 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:32:23.470 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:32:23.471 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 20, 2022-01-10T01:32:23.471 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:32:23.471 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:32:23.471 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:32:23.472 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:32:23.472 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:32:23.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.472 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:32:23.472 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:32:23.473 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:32:23.473 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:32:23.473 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:32:23.473 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:32:23.474 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:32:23.474 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:32:23.474 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:32:23.474 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:32:23.474 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:32:23.475 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:32:23.475 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:32:23.475 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:32:23.475 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:32:23.476 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:32:23.476 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:32:23.476 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:32:23.476 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:32:23.477 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:32:23.477 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:32:23.477 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:32:23.477 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:32:23.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.478 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:32:23.478 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:32:23.478 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:32:23.478 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:32:23.479 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:32:23.479 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:32:23.479 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:32:23.479 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:32:23.479 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:32:23.480 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:32:23.480 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:32:23.480 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:32:23.480 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:32:23.481 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:32:23.481 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:32:23.481 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:32:23.481 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:32:23.482 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:32:23.482 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:32:23.482 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:32:23.482 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:32:23.482 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:32:23.483 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:32:23.483 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:32:23.483 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:32:23.483 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:32:23.484 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:32:23.484 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.484 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:32:23.485 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:32:23.485 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:32:23.485 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:32:23.486 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:32:23.487 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:32:23.487 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:32:23.487 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:32:23.487 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:32:23.488 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:32:23.488 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:32:23.488 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:32:23.488 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:32:23.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.489 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:32:23.490 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:32:23.490 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.491 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.491 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:32:23.491 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:32:23.492 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:32:23.492 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:32:23.492 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:32:23.493 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:32:23.493 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:32:23.493 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:32:23.493 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:32:23.494 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:32:23.494 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:32:23.494 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:32:23.494 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:32:23.495 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:32:23.495 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:32:23.495 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:32:23.495 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:32:23.496 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:32:23.496 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:32:23.496 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:32:23.496 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:32:23.497 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:32:23.497 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:32:23.498 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.498 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:32:23.499 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:32:23.499 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:32:23.500 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:32:23.500 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:32:23.501 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:32:23.501 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:32:23.502 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:32:23.502 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:32:23.503 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:32:23.503 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:32:23.503 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:32:23.504 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:32:23.504 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:32:23.505 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:32:23.505 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:32:23.506 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:32:23.506 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:32:23.507 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:32:23.507 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:32:23.507 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:32:23.507 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:32:23.508 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:32:23.508 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:32:23.509 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:32:23.509 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:32:23.510 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:32:23.510 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.511 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:32:23.511 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:32:23.511 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:32:23.512 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:32:23.512 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:32:23.513 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:32:23.513 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:32:23.514 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:32:23.514 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:32:23.514 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:32:23.515 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:32:23.515 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:32:23.516 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:32:23.516 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:32:23.517 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.517 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.517 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:32:23.518 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:32:23.518 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.519 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:32:23.519 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:32:23.520 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:23.520 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:23.521 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:23.521 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:23.521 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:23.522 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:23.522 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:23.523 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 107, 2022-01-10T01:32:23.523 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:23.524 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:23.524 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:23.525 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.525 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.526 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:32:23.526 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:23.527 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.528 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.528 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:32:23.529 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:23.529 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.530 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.530 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:23.531 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.531 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.532 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:32:23.532 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:23.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.533 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.533 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:32:23.534 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:23.534 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.534 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.535 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:23.535 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.535 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.536 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:32:23.536 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:23.536 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.536 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.536 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.537 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:32:23.537 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:23.537 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.537 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.538 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.538 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:23.538 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.538 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.539 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.539 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:32:23.539 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:23.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.540 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.540 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:32:23.540 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:32:23.540 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.541 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.541 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:32:23.542 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:32:23.542 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:32:23.542 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:32:23.542 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:23.542 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:23.543 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:23.543 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.544 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:32:23.544 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:32:23.544 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:23.544 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:23.544 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:23.545 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:23.545 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:23.545 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:23.545 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:23.546 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 106, 2022-01-10T01:32:23.546 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:23.546 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:23.546 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:23.547 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.547 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.547 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:32:23.548 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:23.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.548 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.548 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.549 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:32:23.549 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:23.549 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.549 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.550 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.550 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:23.550 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.551 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.551 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:32:23.551 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:23.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.551 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.552 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.552 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:32:23.552 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:23.552 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.553 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.553 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:23.553 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.554 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.554 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:32:23.554 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:23.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.555 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.555 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.555 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:32:23.555 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:23.556 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.556 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.556 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.557 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:23.557 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.558 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.559 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:32:23.559 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:23.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.560 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.561 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:32:23.561 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:32:23.562 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.562 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.562 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.563 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:32:23.563 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:32:23.564 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:32:23.564 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:32:23.565 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:23.565 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:23.566 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:23.566 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.566 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.567 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:32:23.568 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:32:23.568 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:23.569 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:23.569 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:23.569 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:23.570 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:23.570 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:23.570 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:23.571 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 107, 2022-01-10T01:32:23.571 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:23.571 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:23.571 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:23.572 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.572 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.572 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:32:23.572 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:23.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.573 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.573 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.573 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:32:23.574 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:23.574 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.574 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.574 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.574 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:23.575 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.575 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.575 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:32:23.576 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:23.576 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.576 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.576 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.576 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:32:23.577 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:23.577 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.577 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.578 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:23.578 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.578 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.578 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:32:23.579 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:23.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.579 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.580 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:32:23.580 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:23.580 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.580 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.581 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:23.581 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.581 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.582 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:32:23.582 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:23.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.582 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.583 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:32:23.583 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:32:23.583 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.583 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.584 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.584 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:32:23.584 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:32:23.584 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:32:23.584 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:32:23.585 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:23.585 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:23.585 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:23.585 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.586 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.586 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:32:23.586 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:32:23.586 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:23.587 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:23.587 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:23.587 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:23.587 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:23.588 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:23.588 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:23.588 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 107, 2022-01-10T01:32:23.588 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:23.588 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:23.589 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:23.589 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.589 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.590 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:32:23.590 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:23.590 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.590 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.591 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:32:23.591 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:23.591 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.591 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.592 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:23.592 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.592 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.593 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:32:23.593 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:23.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.593 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.594 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:32:23.594 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:23.594 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.594 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.595 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:23.595 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.595 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.596 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:32:23.596 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:23.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.597 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.597 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:32:23.597 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:23.597 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.597 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.598 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:23.598 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.599 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.599 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:32:23.599 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:23.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.600 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.600 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:32:23.600 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:32:23.600 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.601 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.601 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:32:23.601 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:32:23.601 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:32:23.602 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:32:23.602 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:23.602 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:23.602 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:23.603 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.603 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:32:23.603 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:32:23.604 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:23.604 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:23.604 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:23.604 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:23.604 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:23.605 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:23.605 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:23.605 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 106, 2022-01-10T01:32:23.605 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:23.606 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:23.606 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:23.606 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.606 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.606 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.607 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:32:23.607 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:23.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.608 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.608 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:32:23.608 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:23.608 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.608 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.609 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.609 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:23.609 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.610 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.610 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:32:23.610 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:23.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.611 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.611 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:32:23.611 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:23.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.612 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.612 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.612 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:23.612 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.613 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.613 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:32:23.613 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:23.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.614 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.614 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:32:23.614 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:23.614 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.615 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.615 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:23.615 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.616 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.616 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:32:23.616 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:23.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.617 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.617 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:32:23.617 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:32:23.618 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.618 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.618 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:32:23.618 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:32:23.619 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:32:23.619 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:32:23.619 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:23.619 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:23.620 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:23.620 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.620 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:32:23.621 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:32:23.621 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:23.621 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:23.621 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:23.621 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:23.622 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:23.622 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:23.622 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:23.622 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 107, 2022-01-10T01:32:23.623 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:23.623 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:23.623 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:23.623 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.624 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.624 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:32:23.624 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:23.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.625 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.625 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:32:23.625 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:23.625 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.626 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.626 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:23.626 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.627 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.627 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:32:23.627 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:23.627 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.628 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.628 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:32:23.628 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:23.629 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.629 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.629 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:23.629 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.630 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.630 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.630 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:32:23.630 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:23.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.631 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.631 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:32:23.631 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:23.632 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.632 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.632 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:23.632 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.633 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.633 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:32:23.633 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:23.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.634 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.634 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:32:23.634 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:32:23.635 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.635 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.635 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.635 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:32:23.636 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:32:23.636 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:32:23.636 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:32:23.636 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:23.636 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:23.637 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:23.637 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.638 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:32:23.638 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:32:23.638 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:23.638 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:23.638 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:23.639 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:23.639 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:23.639 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:23.639 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:23.639 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 107, 2022-01-10T01:32:23.640 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:23.640 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:23.640 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:23.640 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.641 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.641 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:32:23.641 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:23.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.642 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.642 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:32:23.642 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:23.643 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.643 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.643 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:23.643 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.644 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.644 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.644 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:32:23.644 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:23.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.645 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.645 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:32:23.645 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:23.646 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.646 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.646 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:23.647 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.647 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.647 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.647 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:32:23.647 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:23.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.648 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.648 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:32:23.649 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:23.649 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.649 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.649 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:23.650 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.650 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.650 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:32:23.651 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:23.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.651 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.651 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.651 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:32:23.652 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:32:23.652 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.652 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.652 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.652 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:32:23.653 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:32:23.653 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:32:23.653 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:32:23.653 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:23.654 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:23.654 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:23.654 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.655 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:32:23.655 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:32:23.655 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:32:23.655 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:32:23.656 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:32:23.656 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:32:23.656 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:32:23.656 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:32:23.656 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:32:23.657 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 107, 2022-01-10T01:32:23.657 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:32:23.657 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:32:23.657 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:32:23.658 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.658 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.658 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.658 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:32:23.658 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:23.659 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.659 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.659 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:32:23.660 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:23.660 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.660 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.660 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:32:23.661 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.661 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.661 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.661 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:32:23.661 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:23.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.662 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.662 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:32:23.663 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:23.663 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.663 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.663 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:32:23.664 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.664 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.664 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.664 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:32:23.665 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:23.665 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.665 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.665 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:32:23.666 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:23.666 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.666 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.667 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:32:23.667 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:32:23.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.667 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:32:23.667 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:32:23.668 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:23.668 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.668 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.668 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:32:23.669 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:32:23.669 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:32:23.669 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.669 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.669 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.670 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:32:23.670 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:32:23.670 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:32:23.670 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:32:23.671 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:32:23.671 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:32:23.671 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:32:23.671 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:23.671 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.672 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:32:23.672 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:32:23.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.672 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:32:23.673 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:23.673 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:23.673 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:23.673 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:23.673 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:23.674 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:32:23.674 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:23.674 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.674 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.675 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:32:23.675 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:23.675 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:23.675 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:23.675 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:23.676 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:23.676 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:32:23.676 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:23.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.677 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:32:23.677 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:23.677 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:23.677 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:23.678 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:23.678 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:23.678 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:32:23.678 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:23.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.679 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:32:23.679 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:23.679 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:23.680 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:23.680 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:23.680 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:23.680 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:32:23.680 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:23.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.681 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.681 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:32:23.681 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:23.682 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:23.682 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:23.682 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:23.682 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:23.682 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:32:23.683 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:23.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.683 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:32:23.684 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:23.684 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:23.684 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:23.684 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:23.684 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:23.685 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:32:23.685 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:23.685 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.685 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.686 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:32:23.686 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:23.686 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:23.686 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:23.686 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:23.687 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:23.687 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:32:23.687 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:23.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.688 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:23.688 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:32:23.688 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:32:23.688 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:32:23.688 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:32:23.689 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:32:23.689 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:32:23.689 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:32:23.689 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:32:23.690 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.690 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:32:23.690 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:32:23.690 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:32:23.690 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:32:23.691 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:32:23.691 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": { 2022-01-10T01:32:23.691 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.59:6833/696360653": "2022-01-11T01:32:16.969567+0000", 2022-01-10T01:32:23.691 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.59:6832/696360653": "2022-01-11T01:32:16.969567+0000" 2022-01-10T01:32:23.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.692 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:32:23.692 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:32:23.692 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:32:23.692 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:32:23.693 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:32:23.693 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:32:23.693 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:32:23.693 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:32:23.694 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:32:23.694 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:32:23.694 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:32:23.694 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:32:23.694 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.695 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:32:23.695 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:32:23.695 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:32:23.695 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:32:23.695 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:32:23.696 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:32:23.696 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:32:23.696 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:23.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:23.697 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:32:23.697 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:32:23.697 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:32:23.697 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:32:23.697 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:32:23.698 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:32:23.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.463+0000 7f1dacca3700 1 -- 172.21.15.36:0/3794735138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1d84053680 msgr2=0x7f1d84055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:23.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.463+0000 7f1dacca3700 1 --2- 172.21.15.36:0/3794735138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1d84053680 0x7f1d84055b40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f1d9800b000 tx=0x7f1d98006df0).stop 2022-01-10T01:32:23.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.463+0000 7f1dacca3700 1 -- 172.21.15.36:0/3794735138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d8c003750 msgr2=0x7f1da8063fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:23.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.463+0000 7f1dacca3700 1 --2- 172.21.15.36:0/3794735138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d8c003750 0x7f1da8063fc0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f1d9c00c000 tx=0x7f1d9c019000).stop 2022-01-10T01:32:23.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.463+0000 7f1dacca3700 1 -- 172.21.15.36:0/3794735138 shutdown_connections 2022-01-10T01:32:23.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.463+0000 7f1dacca3700 1 --2- 172.21.15.36:0/3794735138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1d84053680 0x7f1d84055b40 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.463+0000 7f1dacca3700 1 --2- 172.21.15.36:0/3794735138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1da8064ef0 0x7f1da8135d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.463+0000 7f1dacca3700 1 --2- 172.21.15.36:0/3794735138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1da8064580 0x7f1da8064a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.463+0000 7f1dacca3700 1 --2- 172.21.15.36:0/3794735138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1d8c003750 0x7f1da8063fc0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.463+0000 7f1dacca3700 1 -- 172.21.15.36:0/3794735138 >> 172.21.15.36:0/3794735138 conn(0x7f1da80607c0 msgr2=0x7f1da80b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:23.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.463+0000 7f1dacca3700 1 -- 172.21.15.36:0/3794735138 shutdown_connections 2022-01-10T01:32:23.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.463+0000 7f1dacca3700 1 -- 172.21.15.36:0/3794735138 wait complete. 2022-01-10T01:32:23.704 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:32:23.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.811+0000 7fa32c988700 1 Processor -- start 2022-01-10T01:32:23.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32c988700 1 -- start start 2022-01-10T01:32:23.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32c988700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa328061320 0x7fa328061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32c988700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3280ad5c0 0x7fa3280b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32c988700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3280aecf0 con 0x7fa328140440 2022-01-10T01:32:23.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32c988700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3280b6f20 con 0x7fa328061320 2022-01-10T01:32:23.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32c988700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3280aef20 con 0x7fa3280ad5c0 2022-01-10T01:32:23.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32759e700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa328140440 0x7fa328146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38358/0 (socket says 172.21.15.36:38358) 2022-01-10T01:32:23.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32759e700 1 -- 172.21.15.36:0/1885502239 learned_addr learned my addr 172.21.15.36:0/1885502239 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:23.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa326d9d700 1 --2- 172.21.15.36:0/1885502239 >> v2:172.21.15.36:3300/0 conn(0x7fa328061320 0x7fa328061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32659c700 1 --2- 172.21.15.36:0/1885502239 >> v2:172.21.15.59:3300/0 conn(0x7fa3280ad5c0 0x7fa3280b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa325d9b700 1 -- 172.21.15.36:0/1885502239 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266870620 0 0) 0x7fa3280aecf0 con 0x7fa328140440 2022-01-10T01:32:23.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa325d9b700 1 -- 172.21.15.36:0/1885502239 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa308003260 con 0x7fa328140440 2022-01-10T01:32:23.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa326d9d700 1 -- 172.21.15.36:0/1885502239 >> v2:172.21.15.59:3300/0 conn(0x7fa3280ad5c0 msgr2=0x7fa3280b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:23.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa326d9d700 1 --2- 172.21.15.36:0/1885502239 >> v2:172.21.15.59:3300/0 conn(0x7fa3280ad5c0 0x7fa3280b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa326d9d700 1 -- 172.21.15.36:0/1885502239 >> v1:172.21.15.36:6789/0 conn(0x7fa328140440 legacy=0x7fa328146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:23.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa326d9d700 1 -- 172.21.15.36:0/1885502239 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3280af1c0 con 0x7fa328061320 2022-01-10T01:32:23.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32659c700 1 --2- 172.21.15.36:0/1885502239 >> v2:172.21.15.59:3300/0 conn(0x7fa3280ad5c0 0x7fa3280b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:23.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa326d9d700 1 --2- 172.21.15.36:0/1885502239 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa328061320 0x7fa328061700 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7fa3280aeba0 tx=0x7fa318006df0).ready entity=mon.0 client_cookie=5c99a255627c12cc server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:23.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa325d9b700 1 -- 172.21.15.36:0/1885502239 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa31800d4f0 con 0x7fa328061320 2022-01-10T01:32:23.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa325d9b700 1 -- 172.21.15.36:0/1885502239 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa318000e90 con 0x7fa328061320 2022-01-10T01:32:23.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa325d9b700 1 -- 172.21.15.36:0/1885502239 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa31800d840 con 0x7fa328061320 2022-01-10T01:32:23.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32c988700 1 -- 172.21.15.36:0/1885502239 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa328061320 msgr2=0x7fa328061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:23.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32c988700 1 --2- 172.21.15.36:0/1885502239 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa328061320 0x7fa328061700 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7fa3280aeba0 tx=0x7fa318006df0).stop 2022-01-10T01:32:23.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32c988700 1 -- 172.21.15.36:0/1885502239 shutdown_connections 2022-01-10T01:32:23.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32c988700 1 --2- 172.21.15.36:0/1885502239 >> v2:172.21.15.59:3300/0 conn(0x7fa3280ad5c0 0x7fa3280b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32c988700 1 --2- 172.21.15.36:0/1885502239 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa328061320 0x7fa328061700 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32c988700 1 -- 172.21.15.36:0/1885502239 >> 172.21.15.36:0/1885502239 conn(0x7fa328066de0 msgr2=0x7fa3280671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:23.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32c988700 1 -- 172.21.15.36:0/1885502239 shutdown_connections 2022-01-10T01:32:23.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.815+0000 7fa32c988700 1 -- 172.21.15.36:0/1885502239 wait complete. 2022-01-10T01:32:23.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32c988700 1 Processor -- start 2022-01-10T01:32:23.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32c988700 1 -- start start 2022-01-10T01:32:23.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32c988700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa328061320 0x7fa3281449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32c988700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3280ad5c0 0x7fa3280b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32c988700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa328140440 0x7fa3280ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32c988700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280b1f10 con 0x7fa3280ad5c0 2022-01-10T01:32:23.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32c988700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3280b0170 con 0x7fa328061320 2022-01-10T01:32:23.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32c988700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32809e9c0 con 0x7fa328140440 2022-01-10T01:32:23.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3280ad5c0 0x7fa3280b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3280ad5c0 0x7fa3280b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40568/0 (socket says 172.21.15.36:40568) 2022-01-10T01:32:23.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32659c700 1 -- 172.21.15.36:0/3194152159 learned_addr learned my addr 172.21.15.36:0/3194152159 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:23.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32759e700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa328140440 0x7fa3280ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa326d9d700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa328061320 0x7fa3281449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32659c700 1 -- 172.21.15.36:0/3194152159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa328140440 msgr2=0x7fa3280ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:23.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32659c700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa328140440 0x7fa3280ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32659c700 1 -- 172.21.15.36:0/3194152159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa328061320 msgr2=0x7fa3281449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:23.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32659c700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa328061320 0x7fa3281449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:23.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32659c700 1 -- 172.21.15.36:0/3194152159 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31000b180 con 0x7fa3280ad5c0 2022-01-10T01:32:23.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa326d9d700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa328061320 0x7fa3281449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:32:23.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32659c700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3280ad5c0 0x7fa3280b3350 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7fa31000c000 tx=0x7fa310006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:23.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa31ffff700 1 -- 172.21.15.36:0/3194152159 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa31000ca40 con 0x7fa3280ad5c0 2022-01-10T01:32:23.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa31ffff700 1 -- 172.21.15.36:0/3194152159 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31000cba0 con 0x7fa3280ad5c0 2022-01-10T01:32:23.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32c988700 1 -- 172.21.15.36:0/3194152159 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31800b180 con 0x7fa3280ad5c0 2022-01-10T01:32:23.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa31ffff700 1 -- 172.21.15.36:0/3194152159 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa31000ee70 con 0x7fa3280ad5c0 2022-01-10T01:32:23.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.819+0000 7fa32c988700 1 -- 172.21.15.36:0/3194152159 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3281557e0 con 0x7fa3280ad5c0 2022-01-10T01:32:23.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.823+0000 7fa32c988700 1 -- 172.21.15.36:0/3194152159 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3280b02e0 con 0x7fa3280ad5c0 2022-01-10T01:32:23.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.823+0000 7fa31ffff700 1 -- 172.21.15.36:0/3194152159 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa31001c460 con 0x7fa3280ad5c0 2022-01-10T01:32:23.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.823+0000 7fa31ffff700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa30c0534d0 0x7fa30c055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:23.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.823+0000 7fa31ffff700 1 -- 172.21.15.36:0/3194152159 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fa31006bdf0 con 0x7fa3280ad5c0 2022-01-10T01:32:23.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.823+0000 7fa326d9d700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa30c0534d0 0x7fa30c055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:23.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.823+0000 7fa326d9d700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa30c0534d0 0x7fa30c055990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fa318015000 tx=0x7fa318014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:23.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.831+0000 7fa31ffff700 1 -- 172.21.15.36:0/3194152159 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa3280b02e0 con 0x7fa3280ad5c0 2022-01-10T01:32:23.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.991+0000 7fa32c988700 1 -- 172.21.15.36:0/3194152159 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3280b02e0 con 0x7fa3280ad5c0 2022-01-10T01:32:23.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.991+0000 7fa31ffff700 1 -- 172.21.15.36:0/3194152159 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+1553 (secure 0 0 0) 0x7fa3280b02e0 con 0x7fa3280ad5c0 2022-01-10T01:32:23.996 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:23.997 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6836/13281616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":13281616},{"type":"v1","addr":"172.21.15.36:6836","nonce":13281616}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/2168511464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":2168511464},{"type":"v1","addr":"172.21.15.36:6837","nonce":2168511464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49},{"gid":7500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/785142778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":785142778},{"type":"v1","addr":"172.21.15.59:6833","nonce":785142778}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":53}],"filesystems":[]} 2022-01-10T01:32:23.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.995+0000 7fa32c988700 1 -- 172.21.15.36:0/3194152159 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa30c0534d0 msgr2=0x7fa30c055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:23.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.995+0000 7fa32c988700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa30c0534d0 0x7fa30c055990 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7fa318015000 tx=0x7fa318014000).stop 2022-01-10T01:32:23.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.995+0000 7fa32c988700 1 -- 172.21.15.36:0/3194152159 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3280ad5c0 msgr2=0x7fa3280b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:24.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.995+0000 7fa32c988700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3280ad5c0 0x7fa3280b3350 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7fa31000c000 tx=0x7fa310006df0).stop 2022-01-10T01:32:24.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.995+0000 7fa32c988700 1 -- 172.21.15.36:0/3194152159 shutdown_connections 2022-01-10T01:32:24.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.995+0000 7fa32c988700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa30c0534d0 0x7fa30c055990 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.995+0000 7fa32c988700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa328140440 0x7fa3280ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.995+0000 7fa32c988700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa3280ad5c0 0x7fa3280b3350 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.995+0000 7fa32c988700 1 --2- 172.21.15.36:0/3194152159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa328061320 0x7fa3281449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.995+0000 7fa32c988700 1 -- 172.21.15.36:0/3194152159 >> 172.21.15.36:0/3194152159 conn(0x7fa328066de0 msgr2=0x7fa328145810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:24.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.995+0000 7fa32c988700 1 -- 172.21.15.36:0/3194152159 shutdown_connections 2022-01-10T01:32:24.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:23.995+0000 7fa32c988700 1 -- 172.21.15.36:0/3194152159 wait complete. 2022-01-10T01:32:24.003 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 53 2022-01-10T01:32:24.009 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:32:24.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.107+0000 7faf38e1f700 1 Processor -- start 2022-01-10T01:32:24.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.107+0000 7faf38e1f700 1 -- start start 2022-01-10T01:32:24.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.107+0000 7faf38e1f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf340b1db0 0x7faf340b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.107+0000 7faf38e1f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faf340a70c0 0x7faf34144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.107+0000 7faf38e1f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf340b0350 con 0x7faf341483a0 2022-01-10T01:32:24.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.107+0000 7faf38e1f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf340a90c0 con 0x7faf340a70c0 2022-01-10T01:32:24.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.107+0000 7faf38e1f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf340b05f0 con 0x7faf340b1db0 2022-01-10T01:32:24.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf32d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faf340a70c0 0x7faf34144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf32d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faf340a70c0 0x7faf34144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40580/0 (socket says 172.21.15.36:40580) 2022-01-10T01:32:24.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf32d9d700 1 -- 172.21.15.36:0/89086220 learned_addr learned my addr 172.21.15.36:0/89086220 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:24.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf3259c700 1 --2- 172.21.15.36:0/89086220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf340b1db0 0x7faf340b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf32d9d700 1 -- 172.21.15.36:0/89086220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf340b1db0 msgr2=0x7faf340b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:24.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf32d9d700 1 --2- 172.21.15.36:0/89086220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf340b1db0 0x7faf340b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf3159a700 1 -- 172.21.15.36:0/89086220 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630602416 0 0) 0x7faf340b0350 con 0x7faf341483a0 2022-01-10T01:32:24.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf32d9d700 1 -- 172.21.15.36:0/89086220 >> v1:172.21.15.59:6789/0 conn(0x7faf341483a0 legacy=0x7faf340b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:24.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf32d9d700 1 -- 172.21.15.36:0/89086220 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf340b0890 con 0x7faf340a70c0 2022-01-10T01:32:24.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf32d9d700 1 --2- 172.21.15.36:0/89086220 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf340a70c0 0x7faf34144720 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7faf2c002f70 tx=0x7faf2c006eb0).ready entity=mon.0 client_cookie=ecc02858c434b810 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:24.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf3159a700 1 -- 172.21.15.36:0/89086220 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf2c00d570 con 0x7faf340a70c0 2022-01-10T01:32:24.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf3159a700 1 -- 172.21.15.36:0/89086220 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c000e90 con 0x7faf340a70c0 2022-01-10T01:32:24.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf3159a700 1 -- 172.21.15.36:0/89086220 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf2c00d8c0 con 0x7faf340a70c0 2022-01-10T01:32:24.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf38e1f700 1 -- 172.21.15.36:0/89086220 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf340a70c0 msgr2=0x7faf34144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:24.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf38e1f700 1 --2- 172.21.15.36:0/89086220 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf340a70c0 0x7faf34144720 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7faf2c002f70 tx=0x7faf2c006eb0).stop 2022-01-10T01:32:24.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf38e1f700 1 -- 172.21.15.36:0/89086220 shutdown_connections 2022-01-10T01:32:24.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf38e1f700 1 --2- 172.21.15.36:0/89086220 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf340a70c0 0x7faf34144720 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf38e1f700 1 --2- 172.21.15.36:0/89086220 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf340b1db0 0x7faf340b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf38e1f700 1 -- 172.21.15.36:0/89086220 >> 172.21.15.36:0/89086220 conn(0x7faf3405f6b0 msgr2=0x7faf3405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:24.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf38e1f700 1 -- 172.21.15.36:0/89086220 shutdown_connections 2022-01-10T01:32:24.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.111+0000 7faf38e1f700 1 -- 172.21.15.36:0/89086220 wait complete. 2022-01-10T01:32:24.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf38e1f700 1 Processor -- start 2022-01-10T01:32:24.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf38e1f700 1 -- start start 2022-01-10T01:32:24.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf38e1f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf340a70c0 0x7faf34142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf38e1f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf340b1db0 0x7faf34156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf38e1f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf341483a0 0x7faf34157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf38e1f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3413e260 con 0x7faf340b1db0 2022-01-10T01:32:24.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf38e1f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3415ab20 con 0x7faf340a70c0 2022-01-10T01:32:24.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf38e1f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3413dd20 con 0x7faf341483a0 2022-01-10T01:32:24.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf31d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf340b1db0 0x7faf34156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf3259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf340a70c0 0x7faf34142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf31d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf340b1db0 0x7faf34156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40584/0 (socket says 172.21.15.36:40584) 2022-01-10T01:32:24.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf31d9b700 1 -- 172.21.15.36:0/3277033427 learned_addr learned my addr 172.21.15.36:0/3277033427 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:24.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf32d9d700 1 --2- 172.21.15.36:0/3277033427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf341483a0 0x7faf34157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf31d9b700 1 -- 172.21.15.36:0/3277033427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf341483a0 msgr2=0x7faf34157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:24.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf31d9b700 1 --2- 172.21.15.36:0/3277033427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf341483a0 0x7faf34157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf31d9b700 1 -- 172.21.15.36:0/3277033427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf340a70c0 msgr2=0x7faf34142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:24.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf31d9b700 1 --2- 172.21.15.36:0/3277033427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf340a70c0 0x7faf34142360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf31d9b700 1 -- 172.21.15.36:0/3277033427 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c00b1e0 con 0x7faf340b1db0 2022-01-10T01:32:24.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.115+0000 7faf3259c700 1 --2- 172.21.15.36:0/3277033427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf340a70c0 0x7faf34142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:24.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.119+0000 7faf31d9b700 1 --2- 172.21.15.36:0/3277033427 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf340b1db0 0x7faf34156b10 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7faf24001250 tx=0x7faf240013f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:24.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.119+0000 7faf237fe700 1 -- 172.21.15.36:0/3277033427 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf2400e4a0 con 0x7faf340b1db0 2022-01-10T01:32:24.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.119+0000 7faf237fe700 1 -- 172.21.15.36:0/3277033427 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2400e600 con 0x7faf340b1db0 2022-01-10T01:32:24.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.119+0000 7faf38e1f700 1 -- 172.21.15.36:0/3277033427 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3413dfc0 con 0x7faf340b1db0 2022-01-10T01:32:24.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.119+0000 7faf237fe700 1 -- 172.21.15.36:0/3277033427 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf2400e960 con 0x7faf340b1db0 2022-01-10T01:32:24.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.119+0000 7faf38e1f700 1 -- 172.21.15.36:0/3277033427 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf34157690 con 0x7faf340b1db0 2022-01-10T01:32:24.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.119+0000 7faf38e1f700 1 -- 172.21.15.36:0/3277033427 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf34057350 con 0x7faf340b1db0 2022-01-10T01:32:24.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.119+0000 7faf237fe700 1 -- 172.21.15.36:0/3277033427 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7faf24019030 con 0x7faf340b1db0 2022-01-10T01:32:24.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.119+0000 7faf237fe700 1 --2- 172.21.15.36:0/3277033427 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faf100535f0 0x7faf10055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.119+0000 7faf237fe700 1 -- 172.21.15.36:0/3277033427 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5686+0+0 (secure 0 0 0) 0x7faf2406b1c0 con 0x7faf340b1db0 2022-01-10T01:32:24.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.119+0000 7faf3259c700 1 --2- 172.21.15.36:0/3277033427 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faf100535f0 0x7faf10055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.119+0000 7faf3259c700 1 --2- 172.21.15.36:0/3277033427 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faf100535f0 0x7faf10055ab0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7faf2800b000 tx=0x7faf28006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:24.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.127+0000 7faf237fe700 1 -- 172.21.15.36:0/3277033427 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faf24042410 con 0x7faf340b1db0 2022-01-10T01:32:24.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.287+0000 7faf38e1f700 1 -- 172.21.15.36:0/3277033427 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf34044650 con 0x7faf340b1db0 2022-01-10T01:32:24.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.287+0000 7faf237fe700 1 -- 172.21.15.36:0/3277033427 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+1553 (secure 0 0 0) 0x7faf24045a30 con 0x7faf340b1db0 2022-01-10T01:32:24.292 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:24.292 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6836/13281616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":13281616},{"type":"v1","addr":"172.21.15.36:6836","nonce":13281616}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/2168511464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6835","nonce":2168511464},{"type":"v1","addr":"172.21.15.36:6837","nonce":2168511464}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":49},{"gid":7500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/785142778","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":785142778},{"type":"v1","addr":"172.21.15.59:6833","nonce":785142778}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":53}],"filesystems":[]} 2022-01-10T01:32:24.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.291+0000 7faf38e1f700 1 -- 172.21.15.36:0/3277033427 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faf100535f0 msgr2=0x7faf10055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:24.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.291+0000 7faf38e1f700 1 --2- 172.21.15.36:0/3277033427 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faf100535f0 0x7faf10055ab0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7faf2800b000 tx=0x7faf28006df0).stop 2022-01-10T01:32:24.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.291+0000 7faf38e1f700 1 -- 172.21.15.36:0/3277033427 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf340b1db0 msgr2=0x7faf34156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:24.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.291+0000 7faf38e1f700 1 --2- 172.21.15.36:0/3277033427 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf340b1db0 0x7faf34156b10 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7faf24001250 tx=0x7faf240013f0).stop 2022-01-10T01:32:24.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.291+0000 7faf38e1f700 1 -- 172.21.15.36:0/3277033427 shutdown_connections 2022-01-10T01:32:24.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.291+0000 7faf38e1f700 1 --2- 172.21.15.36:0/3277033427 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faf100535f0 0x7faf10055ab0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.291+0000 7faf38e1f700 1 --2- 172.21.15.36:0/3277033427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf341483a0 0x7faf34157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.291+0000 7faf38e1f700 1 --2- 172.21.15.36:0/3277033427 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faf340b1db0 0x7faf34156b10 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.291+0000 7faf38e1f700 1 --2- 172.21.15.36:0/3277033427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf340a70c0 0x7faf34142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.291+0000 7faf38e1f700 1 -- 172.21.15.36:0/3277033427 >> 172.21.15.36:0/3277033427 conn(0x7faf3405f6b0 msgr2=0x7faf340af770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:24.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.291+0000 7faf38e1f700 1 -- 172.21.15.36:0/3277033427 shutdown_connections 2022-01-10T01:32:24.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.291+0000 7faf38e1f700 1 -- 172.21.15.36:0/3277033427 wait complete. 2022-01-10T01:32:24.297 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 53 2022-01-10T01:32:24.306 INFO:tasks.ceph.mds.a:Restarting daemon 2022-01-10T01:32:24.306 INFO:tasks.ceph.mds.a:Stopping old one... 2022-01-10T01:32:24.306 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-01-10T01:32:24.307 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:32:24.307 INFO:tasks.ceph.mds.c:Restarting daemon 2022-01-10T01:32:24.307 INFO:tasks.ceph.mds.c:Stopping old one... 2022-01-10T01:32:24.308 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-01-10T01:32:24.308 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:32:24.308 INFO:tasks.ceph.mds.b:Restarting daemon 2022-01-10T01:32:24.309 INFO:tasks.ceph.mds.b:Stopping old one... 2022-01-10T01:32:24.309 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-01-10T01:32:24.309 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:32:24.316 INFO:tasks.ceph.mds.a:Stopped 2022-01-10T01:32:24.317 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-01-10T01:32:24.319 INFO:tasks.ceph.mds.a:Started 2022-01-10T01:32:24.320 DEBUG:teuthology.parallel:result is None 2022-01-10T01:32:24.322 INFO:tasks.ceph.mds.c:Stopped 2022-01-10T01:32:24.322 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-01-10T01:32:24.324 INFO:tasks.ceph.mds.c:Started 2022-01-10T01:32:24.325 DEBUG:teuthology.parallel:result is None 2022-01-10T01:32:24.326 INFO:tasks.ceph.mds.b:Stopped 2022-01-10T01:32:24.326 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-01-10T01:32:24.329 INFO:tasks.ceph.mds.b:Started 2022-01-10T01:32:24.329 DEBUG:teuthology.parallel:result is None 2022-01-10T01:32:24.330 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2022-01-10T01:32:24.383 INFO:tasks.ceph.mds.c.smithi036.stdout:starting mds.c at 2022-01-10T01:32:24.391 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:32:24.407 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:32:24.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.423+0000 7f41f80f7700 1 Processor -- start 2022-01-10T01:32:24.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.423+0000 7f41f80f7700 1 -- start start 2022-01-10T01:32:24.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f80f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41f00a8bf0 0x7f41f0143620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f80f7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41f00aca70 0x7f41f00ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f80f7700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f00ae000 con 0x7f41f00b10e0 2022-01-10T01:32:24.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f80f7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f00b1820 con 0x7f41f00aca70 2022-01-10T01:32:24.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f80f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00b1580 con 0x7f41f00a8bf0 2022-01-10T01:32:24.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f5692700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f41f00b10e0 0x7f41f00ae700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38408/0 (socket says 172.21.15.36:38408) 2022-01-10T01:32:24.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f5692700 1 -- 172.21.15.36:0/2005599996 learned_addr learned my addr 172.21.15.36:0/2005599996 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:24.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f6694700 1 --2- 172.21.15.36:0/2005599996 >> v2:172.21.15.59:3300/0 conn(0x7f41f00aca70 0x7f41f00ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 -- 172.21.15.36:0/2005599996 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660992223 0 0) 0x7f41f00ae000 con 0x7f41f00b10e0 2022-01-10T01:32:24.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f5e93700 1 --2- 172.21.15.36:0/2005599996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41f00a8bf0 0x7f41f0143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 -- 172.21.15.36:0/2005599996 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41d8003260 con 0x7f41f00b10e0 2022-01-10T01:32:24.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 -- 172.21.15.36:0/2005599996 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1916926387 0 0) 0x7f41d8003260 con 0x7f41f00b10e0 2022-01-10T01:32:24.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 -- 172.21.15.36:0/2005599996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41f00a8bf0 msgr2=0x7f41f0143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:24.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 --2- 172.21.15.36:0/2005599996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41f00a8bf0 0x7f41f0143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 -- 172.21.15.36:0/2005599996 >> v2:172.21.15.59:3300/0 conn(0x7f41f00aca70 msgr2=0x7f41f00ad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:24.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 --2- 172.21.15.36:0/2005599996 >> v2:172.21.15.59:3300/0 conn(0x7f41f00aca70 0x7f41f00ad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 -- 172.21.15.36:0/2005599996 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f00ae260 con 0x7f41f00b10e0 2022-01-10T01:32:24.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 -- 172.21.15.36:0/2005599996 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f41ec001680 con 0x7f41f00b10e0 2022-01-10T01:32:24.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 -- 172.21.15.36:0/2005599996 >> v1:172.21.15.36:6789/0 conn(0x7f41f00b10e0 legacy=0x7f41f00ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:24.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 --2- 172.21.15.36:0/2005599996 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41d8003750 0x7f41d8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 --2- 172.21.15.36:0/2005599996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41f00a8bf0 0x7f41d8004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 --2- 172.21.15.36:0/2005599996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41d80049f0 0x7f41d8004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 -- 172.21.15.36:0/2005599996 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00b1820 con 0x7f41d8003750 2022-01-10T01:32:24.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 -- 172.21.15.36:0/2005599996 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00b1580 con 0x7f41d80049f0 2022-01-10T01:32:24.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 -- 172.21.15.36:0/2005599996 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d800b750 con 0x7f41f00a8bf0 2022-01-10T01:32:24.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f5e93700 1 --2- 172.21.15.36:0/2005599996 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41d8003750 0x7f41d8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f5692700 1 --2- 172.21.15.36:0/2005599996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41f00a8bf0 0x7f41d8004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f6694700 1 --2- 172.21.15.36:0/2005599996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41d80049f0 0x7f41d8004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f5e93700 1 -- 172.21.15.36:0/2005599996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41f00a8bf0 msgr2=0x7f41d8004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:24.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f5e93700 1 --2- 172.21.15.36:0/2005599996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41f00a8bf0 0x7f41d8004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f5e93700 1 -- 172.21.15.36:0/2005599996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41d80049f0 msgr2=0x7f41d8004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:24.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f5e93700 1 --2- 172.21.15.36:0/2005599996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41d80049f0 0x7f41d8004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f5e93700 1 -- 172.21.15.36:0/2005599996 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8003260 con 0x7f41d8003750 2022-01-10T01:32:24.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f5e93700 1 --2- 172.21.15.36:0/2005599996 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41d8003750 0x7f41d8003b70 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f41e000e000 tx=0x7f41e000a040).ready entity=mon.0 client_cookie=f46381b9902938f0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:24.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 -- 172.21.15.36:0/2005599996 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41e00072c0 con 0x7f41d8003750 2022-01-10T01:32:24.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 -- 172.21.15.36:0/2005599996 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e0007420 con 0x7f41d8003750 2022-01-10T01:32:24.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f4e91700 1 -- 172.21.15.36:0/2005599996 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41e00058e0 con 0x7f41d8003750 2022-01-10T01:32:24.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f80f7700 1 -- 172.21.15.36:0/2005599996 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41d8003750 msgr2=0x7f41d8003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:24.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f80f7700 1 --2- 172.21.15.36:0/2005599996 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41d8003750 0x7f41d8003b70 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f41e000e000 tx=0x7f41e000a040).stop 2022-01-10T01:32:24.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f6694700 1 -- 172.21.15.36:0/2005599996 reap_dead start 2022-01-10T01:32:24.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f80f7700 1 -- 172.21.15.36:0/2005599996 shutdown_connections 2022-01-10T01:32:24.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f80f7700 1 -- 172.21.15.36:0/2005599996 >> 172.21.15.36:0/2005599996 conn(0x7f41f00608d0 msgr2=0x7f41f0060ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:24.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f80f7700 1 -- 172.21.15.36:0/2005599996 shutdown_connections 2022-01-10T01:32:24.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.427+0000 7f41f80f7700 1 -- 172.21.15.36:0/2005599996 wait complete. 2022-01-10T01:32:24.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f80f7700 1 Processor -- start 2022-01-10T01:32:24.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f80f7700 1 -- start start 2022-01-10T01:32:24.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f80f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41d8003750 0x7f41f013fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f80f7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41f013ef80 0x7f41f01405c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f80f7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41f0140ab0 0x7f41f0066ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f80f7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00ab9b0 con 0x7f41f013ef80 2022-01-10T01:32:24.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f80f7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00b3cc0 con 0x7f41f0140ab0 2022-01-10T01:32:24.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f80f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f00b4430 con 0x7f41d8003750 2022-01-10T01:32:24.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f5692700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41f013ef80 0x7f41f01405c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f5692700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41f013ef80 0x7f41f01405c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40628/0 (socket says 172.21.15.36:40628) 2022-01-10T01:32:24.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f5692700 1 -- 172.21.15.36:0/1370750450 learned_addr learned my addr 172.21.15.36:0/1370750450 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:24.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f5e93700 1 --2- 172.21.15.36:0/1370750450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41d8003750 0x7f41f013fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f6694700 1 --2- 172.21.15.36:0/1370750450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41f0140ab0 0x7f41f0066ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f5692700 1 -- 172.21.15.36:0/1370750450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41d8003750 msgr2=0x7f41f013fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:24.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f5692700 1 --2- 172.21.15.36:0/1370750450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41d8003750 0x7f41f013fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f5692700 1 -- 172.21.15.36:0/1370750450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41f0140ab0 msgr2=0x7f41f0066ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:24.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f5692700 1 --2- 172.21.15.36:0/1370750450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41f0140ab0 0x7f41f0066ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:24.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f5692700 1 -- 172.21.15.36:0/1370750450 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f0140f30 con 0x7f41f013ef80 2022-01-10T01:32:24.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.431+0000 7f41f5692700 1 --2- 172.21.15.36:0/1370750450 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41f013ef80 0x7f41f01405c0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f41f014e2b0 tx=0x7f41f00b27d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:24.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.435+0000 7f41deffd700 1 -- 172.21.15.36:0/1370750450 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41ec0116b0 con 0x7f41f013ef80 2022-01-10T01:32:24.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.435+0000 7f41deffd700 1 -- 172.21.15.36:0/1370750450 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec011810 con 0x7f41f013ef80 2022-01-10T01:32:24.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.435+0000 7f41f80f7700 1 -- 172.21.15.36:0/1370750450 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f00b3ef0 con 0x7f41f013ef80 2022-01-10T01:32:24.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.435+0000 7f41deffd700 1 -- 172.21.15.36:0/1370750450 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41ec011b70 con 0x7f41f013ef80 2022-01-10T01:32:24.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.435+0000 7f41f80f7700 1 -- 172.21.15.36:0/1370750450 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f0064660 con 0x7f41f013ef80 2022-01-10T01:32:24.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.435+0000 7f41f80f7700 1 -- 172.21.15.36:0/1370750450 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f0140300 con 0x7f41f013ef80 2022-01-10T01:32:24.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.435+0000 7f41deffd700 1 -- 172.21.15.36:0/1370750450 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f41ec01b030 con 0x7f41f013ef80 2022-01-10T01:32:24.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.435+0000 7f41deffd700 1 --2- 172.21.15.36:0/1370750450 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41d0053680 0x7f41d0055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:24.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.435+0000 7f41deffd700 1 -- 172.21.15.36:0/1370750450 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f41ec06b0f0 con 0x7f41f013ef80 2022-01-10T01:32:24.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.435+0000 7f41f5e93700 1 --2- 172.21.15.36:0/1370750450 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41d0053680 0x7f41d0055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:24.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.435+0000 7f41f5e93700 1 --2- 172.21.15.36:0/1370750450 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41d0053680 0x7f41d0055b40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f41e001b000 tx=0x7f41e0018000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:24.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.439+0000 7f41deffd700 1 -- 172.21.15.36:0/1370750450 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f41f0140300 con 0x7f41f013ef80 2022-01-10T01:32:24.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:24.579+0000 7f41f80f7700 1 -- 172.21.15.36:0/1370750450 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f41f0140300 con 0x7f41f013ef80 2022-01-10T01:32:25.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.431+0000 7f41deffd700 1 -- 172.21.15.36:0/1370750450 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v116) v1 ==== 97+0+0 (secure 0 0 0) 0x7f41f0140300 con 0x7f41f013ef80 2022-01-10T01:32:25.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.431+0000 7f41f80f7700 1 -- 172.21.15.36:0/1370750450 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41d0053680 msgr2=0x7f41d0055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:25.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.431+0000 7f41f80f7700 1 --2- 172.21.15.36:0/1370750450 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41d0053680 0x7f41d0055b40 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f41e001b000 tx=0x7f41e0018000).stop 2022-01-10T01:32:25.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.431+0000 7f41f80f7700 1 -- 172.21.15.36:0/1370750450 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41f013ef80 msgr2=0x7f41f01405c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:25.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.431+0000 7f41f80f7700 1 --2- 172.21.15.36:0/1370750450 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41f013ef80 0x7f41f01405c0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f41f014e2b0 tx=0x7f41f00b27d0).stop 2022-01-10T01:32:25.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.435+0000 7f41f80f7700 1 -- 172.21.15.36:0/1370750450 shutdown_connections 2022-01-10T01:32:25.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.435+0000 7f41f80f7700 1 --2- 172.21.15.36:0/1370750450 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f41d0053680 0x7f41d0055b40 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:25.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.435+0000 7f41f80f7700 1 --2- 172.21.15.36:0/1370750450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41f0140ab0 0x7f41f0066ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:25.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.435+0000 7f41f80f7700 1 --2- 172.21.15.36:0/1370750450 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f41f013ef80 0x7f41f01405c0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:25.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.435+0000 7f41f80f7700 1 --2- 172.21.15.36:0/1370750450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41d8003750 0x7f41f013fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:25.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.435+0000 7f41f80f7700 1 -- 172.21.15.36:0/1370750450 >> 172.21.15.36:0/1370750450 conn(0x7f41f00608d0 msgr2=0x7f41f005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:25.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.435+0000 7f41f80f7700 1 -- 172.21.15.36:0/1370750450 shutdown_connections 2022-01-10T01:32:25.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.435+0000 7f41f80f7700 1 -- 172.21.15.36:0/1370750450 wait complete. 2022-01-10T01:32:25.440 INFO:teuthology.orchestra.run.smithi036.stderr: removed all blacklist entries 2022-01-10T01:32:25.452 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2022-01-10T01:32:25.452 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2022-01-10T01:32:25.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548a231700 1 Processor -- start 2022-01-10T01:32:25.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548a231700 1 -- start start 2022-01-10T01:32:25.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548a231700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54840b10b0 0x7f54840b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:25.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548a231700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54840b1de0 con 0x7f54840aeec0 2022-01-10T01:32:25.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548a231700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54840af630 con 0x7f548405d760 2022-01-10T01:32:25.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548a231700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54841434a0 con 0x7f54840b10b0 2022-01-10T01:32:25.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f5489a30700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f54840aeec0 0x7f5484149860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38436/0 (socket says 172.21.15.36:38436) 2022-01-10T01:32:25.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f5489a30700 1 -- 172.21.15.36:0/436477265 learned_addr learned my addr 172.21.15.36:0/436477265 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:25.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548922f700 1 --2- 172.21.15.36:0/436477265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54840b10b0 0x7f54840b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:25.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f547bfff700 1 -- 172.21.15.36:0/436477265 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443563905 0 0) 0x7f54840b1de0 con 0x7f54840aeec0 2022-01-10T01:32:25.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f547bfff700 1 -- 172.21.15.36:0/436477265 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5468003260 con 0x7f54840aeec0 2022-01-10T01:32:25.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f547bfff700 1 -- 172.21.15.36:0/436477265 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683709795 0 0) 0x7f54840af630 con 0x7f548405d760 2022-01-10T01:32:25.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f547bfff700 1 -- 172.21.15.36:0/436477265 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54840b1de0 con 0x7f548405d760 2022-01-10T01:32:25.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548922f700 1 -- 172.21.15.36:0/436477265 >> v1:172.21.15.59:6789/0 conn(0x7f548405d760 legacy=0x7f54840ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:25.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548922f700 1 -- 172.21.15.36:0/436477265 >> v1:172.21.15.36:6789/0 conn(0x7f54840aeec0 legacy=0x7f5484149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:25.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548922f700 1 -- 172.21.15.36:0/436477265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54840af8d0 con 0x7f54840b10b0 2022-01-10T01:32:25.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548922f700 1 --2- 172.21.15.36:0/436477265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54840b10b0 0x7f54840b14d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f5474002f70 tx=0x7f5474006e80).ready entity=mon.2 client_cookie=32d7f294338e923b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:25.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f547bfff700 1 -- 172.21.15.36:0/436477265 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5474010400 con 0x7f54840b10b0 2022-01-10T01:32:25.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f547bfff700 1 -- 172.21.15.36:0/436477265 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5474000e90 con 0x7f54840b10b0 2022-01-10T01:32:25.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f547bfff700 1 -- 172.21.15.36:0/436477265 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5474010750 con 0x7f54840b10b0 2022-01-10T01:32:25.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548a231700 1 -- 172.21.15.36:0/436477265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54840b10b0 msgr2=0x7f54840b14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:25.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548a231700 1 --2- 172.21.15.36:0/436477265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54840b10b0 0x7f54840b14d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f5474002f70 tx=0x7f5474006e80).stop 2022-01-10T01:32:25.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548a231700 1 -- 172.21.15.36:0/436477265 shutdown_connections 2022-01-10T01:32:25.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548a231700 1 --2- 172.21.15.36:0/436477265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54840b10b0 0x7f54840b14d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:25.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.555+0000 7f548a231700 1 -- 172.21.15.36:0/436477265 >> 172.21.15.36:0/436477265 conn(0x7f548405c490 msgr2=0x7f548405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:25.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548a231700 1 -- 172.21.15.36:0/436477265 shutdown_connections 2022-01-10T01:32:25.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548a231700 1 -- 172.21.15.36:0/436477265 wait complete. 2022-01-10T01:32:25.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548a231700 1 Processor -- start 2022-01-10T01:32:25.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548a231700 1 -- start start 2022-01-10T01:32:25.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548a231700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f548405d760 0x7f54840b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:25.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548a231700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54840aeec0 0x7f5484151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:25.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548a231700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54840b10b0 0x7f5484066dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:25.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548a231700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5484067730 con 0x7f548405d760 2022-01-10T01:32:25.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548a231700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54840abdf0 con 0x7f54840b10b0 2022-01-10T01:32:25.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548a231700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54840ab5a0 con 0x7f54840aeec0 2022-01-10T01:32:25.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548922f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f548405d760 0x7f54840b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:25.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548922f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f548405d760 0x7f54840b4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40646/0 (socket says 172.21.15.36:40646) 2022-01-10T01:32:25.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548922f700 1 -- 172.21.15.36:0/3439699357 learned_addr learned my addr 172.21.15.36:0/3439699357 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:25.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f5489a30700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54840b10b0 0x7f5484066dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:25.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f5488a2e700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54840aeec0 0x7f5484151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:25.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f5488a2e700 1 -- 172.21.15.36:0/3439699357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54840b10b0 msgr2=0x7f5484066dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:25.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f5488a2e700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54840b10b0 0x7f5484066dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:25.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f5488a2e700 1 -- 172.21.15.36:0/3439699357 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f548405d760 msgr2=0x7f54840b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:25.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f5488a2e700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f548405d760 0x7f54840b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:25.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f5488a2e700 1 -- 172.21.15.36:0/3439699357 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547400c310 con 0x7f54840aeec0 2022-01-10T01:32:25.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548922f700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f548405d760 0x7f54840b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:25.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f5488a2e700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54840aeec0 0x7f5484151810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f5480001110 tx=0x7f5480007a00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:25.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f547a7fc700 1 -- 172.21.15.36:0/3439699357 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f548000ce80 con 0x7f54840aeec0 2022-01-10T01:32:25.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f547a7fc700 1 -- 172.21.15.36:0/3439699357 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5480012400 con 0x7f54840aeec0 2022-01-10T01:32:25.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548a231700 1 -- 172.21.15.36:0/3439699357 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54840ab7d0 con 0x7f54840aeec0 2022-01-10T01:32:25.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f547a7fc700 1 -- 172.21.15.36:0/3439699357 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5480012760 con 0x7f54840aeec0 2022-01-10T01:32:25.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.559+0000 7f548a231700 1 -- 172.21.15.36:0/3439699357 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5484145390 con 0x7f54840aeec0 2022-01-10T01:32:25.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.563+0000 7f547a7fc700 1 -- 172.21.15.36:0/3439699357 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5480019030 con 0x7f54840aeec0 2022-01-10T01:32:25.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.563+0000 7f548a231700 1 -- 172.21.15.36:0/3439699357 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54840b2000 con 0x7f54840aeec0 2022-01-10T01:32:25.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.563+0000 7f547a7fc700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f546c053680 0x7f546c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:25.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.563+0000 7f547a7fc700 1 -- 172.21.15.36:0/3439699357 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f548006aa70 con 0x7f54840aeec0 2022-01-10T01:32:25.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.563+0000 7f548922f700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f546c053680 0x7f546c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:25.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.563+0000 7f548922f700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f546c053680 0x7f546c055b40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f5474019000 tx=0x7f5474015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:25.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.571+0000 7f547a7fc700 1 -- 172.21.15.36:0/3439699357 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5480041d20 con 0x7f54840aeec0 2022-01-10T01:32:25.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.739+0000 7f548a231700 1 -- 172.21.15.36:0/3439699357 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5484065810 con 0x7f54840aeec0 2022-01-10T01:32:25.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.743+0000 7f547a7fc700 1 -- 172.21.15.36:0/3439699357 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f548006ae60 con 0x7f54840aeec0 2022-01-10T01:32:25.746 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:25.746 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:32:25.747 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_dump": [ 2022-01-10T01:32:25.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.747 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.a", 2022-01-10T01:32:25.747 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthuGT4IxAA5DyijS4tPjdOLn5uiLXEPg==", 2022-01-10T01:32:25.748 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.748 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:32:25.748 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:25.748 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:25.749 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:25.749 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.750 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.b", 2022-01-10T01:32:25.750 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthkvX0LRAAtz19usFvoObvouQeLFwicg==", 2022-01-10T01:32:25.750 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.750 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:32:25.750 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:25.751 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:25.751 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:25.751 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.751 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.752 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.752 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.c", 2022-01-10T01:32:25.752 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthbvUmKhAA0pVpDJO1AfsAzIHU1cAHiw==", 2022-01-10T01:32:25.752 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.753 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:32:25.753 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:25.753 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:25.753 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:25.754 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.754 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.0", 2022-01-10T01:32:25.754 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCWitthk4iKHRAAF7aFP+i24xFvXXm8j5GzVg==", 2022-01-10T01:32:25.755 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.755 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:25.755 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:25.755 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:25.756 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.756 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.756 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.756 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.1", 2022-01-10T01:32:25.756 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCZitthsKSXABAAb3IkNvlyLub89HwaPWZ1Bg==", 2022-01-10T01:32:25.757 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.757 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:25.757 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:25.757 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:25.758 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.758 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.2", 2022-01-10T01:32:25.758 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCbitthvNzhIBAAXkZ6FslnMl1gS/rOa7G+Vg==", 2022-01-10T01:32:25.759 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.759 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:25.759 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:25.759 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:25.760 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.760 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.760 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.760 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.3", 2022-01-10T01:32:25.760 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCeitth9P7EAxAA7KOCP7Rh5oN1yqCz9I6v3A==", 2022-01-10T01:32:25.761 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.761 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:25.761 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:25.761 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:25.762 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.762 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.762 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.762 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.4", 2022-01-10T01:32:25.762 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCjitth/L1UBxAAskxmSV0aE6CSvDFR8O/+SQ==", 2022-01-10T01:32:25.763 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.763 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:25.763 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:25.763 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:25.764 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.764 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.764 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.5", 2022-01-10T01:32:25.764 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQClitthMoY6JhAAeeIrCmMcm3MpDPtdLUf+2g==", 2022-01-10T01:32:25.765 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.765 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:25.765 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:25.765 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:25.766 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.766 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.766 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.6", 2022-01-10T01:32:25.766 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCoitthrUhlCxAAsYhU7Kj6HMo/kD0DezvITg==", 2022-01-10T01:32:25.767 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.767 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:25.767 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:25.767 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:25.768 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.768 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.768 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.7", 2022-01-10T01:32:25.768 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCqitthFaLrKRAAC2g1OlcV2KTtaOXsyCrIrQ==", 2022-01-10T01:32:25.769 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.769 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:25.769 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:25.769 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:25.770 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.770 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.770 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.0", 2022-01-10T01:32:25.770 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthKoa/NBAADjvHh99F8YOktGID9uyttg==", 2022-01-10T01:32:25.771 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.771 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:32:25.771 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:32:25.771 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:32:25.772 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.772 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.1", 2022-01-10T01:32:25.772 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth3x76OBAAPTrw8OUmnpEflWuB7zzaHg==", 2022-01-10T01:32:25.773 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.773 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:32:25.773 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:32:25.773 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:32:25.774 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.774 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.774 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.admin", 2022-01-10T01:32:25.774 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthf9dqChAADHRsoZKuozdsqb41ztuR7w==", 2022-01-10T01:32:25.775 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.775 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:32:25.775 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:32:25.775 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:32:25.776 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:25.776 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.776 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.776 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.776 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.x", 2022-01-10T01:32:25.777 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth39syIRAA6pOvLWw2ADy72TWZ65MIkA==", 2022-01-10T01:32:25.777 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.777 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:32:25.777 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:32:25.778 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:25.778 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.778 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:25.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:25.779 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.y", 2022-01-10T01:32:25.779 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth4novHRAACVMjo72kOB/T7Ti/CiN27w==", 2022-01-10T01:32:25.779 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:32:25.779 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:32:25.779 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:32:25.780 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:32:25.780 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.780 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:25.781 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:25.781 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:32:25.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.743+0000 7f548a231700 1 -- 172.21.15.36:0/3439699357 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f546c053680 msgr2=0x7f546c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:25.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.743+0000 7f548a231700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f546c053680 0x7f546c055b40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f5474019000 tx=0x7f5474015000).stop 2022-01-10T01:32:25.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.743+0000 7f548a231700 1 -- 172.21.15.36:0/3439699357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54840aeec0 msgr2=0x7f5484151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:25.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.743+0000 7f548a231700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54840aeec0 0x7f5484151810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f5480001110 tx=0x7f5480007a00).stop 2022-01-10T01:32:25.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.743+0000 7f548a231700 1 -- 172.21.15.36:0/3439699357 shutdown_connections 2022-01-10T01:32:25.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.743+0000 7f548a231700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f546c053680 0x7f546c055b40 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:25.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.743+0000 7f548a231700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54840b10b0 0x7f5484066dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:25.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.743+0000 7f548a231700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54840aeec0 0x7f5484151810 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:25.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.743+0000 7f548a231700 1 --2- 172.21.15.36:0/3439699357 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f548405d760 0x7f54840b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:25.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.743+0000 7f548a231700 1 -- 172.21.15.36:0/3439699357 >> 172.21.15.36:0/3439699357 conn(0x7f548405c490 msgr2=0x7f5484143830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:25.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.747+0000 7f548a231700 1 -- 172.21.15.36:0/3439699357 shutdown_connections 2022-01-10T01:32:25.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.747+0000 7f548a231700 1 -- 172.21.15.36:0/3439699357 wait complete. 2022-01-10T01:32:25.787 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:32:25.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.891+0000 7fcfb6976700 1 Processor -- start 2022-01-10T01:32:25.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.891+0000 7fcfb6976700 1 -- start start 2022-01-10T01:32:25.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.891+0000 7fcfb6976700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fcfb00ace70 0x7fcfb0143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:25.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.891+0000 7fcfb6976700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb0143920 con 0x7fcfb00b30d0 2022-01-10T01:32:25.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.891+0000 7fcfb6976700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb00b0af0 con 0x7fcfb00b0710 2022-01-10T01:32:25.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.891+0000 7fcfb6976700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb00ae680 con 0x7fcfb00ace70 2022-01-10T01:32:25.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.891+0000 7fcfb5173700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fcfb00b30d0 0x7fcfb013f8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38446/0 (socket says 172.21.15.36:38446) 2022-01-10T01:32:25.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.891+0000 7fcfb5173700 1 -- 172.21.15.36:0/3233530250 learned_addr learned my addr 172.21.15.36:0/3233530250 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:25.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.891+0000 7fcfb6175700 1 --2- 172.21.15.36:0/3233530250 >> v2:172.21.15.36:3300/0 conn(0x7fcfb00ace70 0x7fcfb0143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:25.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb4972700 1 -- 172.21.15.36:0/3233530250 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157982679 0 0) 0x7fcfb0143920 con 0x7fcfb00b30d0 2022-01-10T01:32:25.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb4972700 1 -- 172.21.15.36:0/3233530250 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf98003260 con 0x7fcfb00b30d0 2022-01-10T01:32:25.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb6175700 1 -- 172.21.15.36:0/3233530250 >> v1:172.21.15.59:6789/0 conn(0x7fcfb00b0710 legacy=0x7fcfb0142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:25.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb6175700 1 -- 172.21.15.36:0/3233530250 >> v1:172.21.15.36:6789/0 conn(0x7fcfb00b30d0 legacy=0x7fcfb013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:25.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb4972700 1 -- 172.21.15.36:0/3233530250 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160872922 0 0) 0x7fcfb00b0af0 con 0x7fcfb00b0710 2022-01-10T01:32:25.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb6175700 1 -- 172.21.15.36:0/3233530250 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb00ae920 con 0x7fcfb00ace70 2022-01-10T01:32:25.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb6175700 1 --2- 172.21.15.36:0/3233530250 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcfb00ace70 0x7fcfb0143430 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fcfa8002f70 tx=0x7fcfa8006df0).ready entity=mon.0 client_cookie=aa6b053a069eecc3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:25.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb4972700 1 -- 172.21.15.36:0/3233530250 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfa800fab0 con 0x7fcfb00ace70 2022-01-10T01:32:25.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb4972700 1 -- 172.21.15.36:0/3233530250 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa8000e90 con 0x7fcfb00ace70 2022-01-10T01:32:25.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb4972700 1 -- 172.21.15.36:0/3233530250 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfa800fe00 con 0x7fcfb00ace70 2022-01-10T01:32:25.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb6976700 1 -- 172.21.15.36:0/3233530250 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcfb00ace70 msgr2=0x7fcfb0143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:25.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb6976700 1 --2- 172.21.15.36:0/3233530250 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcfb00ace70 0x7fcfb0143430 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7fcfa8002f70 tx=0x7fcfa8006df0).stop 2022-01-10T01:32:25.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb6976700 1 -- 172.21.15.36:0/3233530250 shutdown_connections 2022-01-10T01:32:25.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb6976700 1 --2- 172.21.15.36:0/3233530250 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcfb00ace70 0x7fcfb0143430 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:25.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb6976700 1 -- 172.21.15.36:0/3233530250 >> 172.21.15.36:0/3233530250 conn(0x7fcfb0061140 msgr2=0x7fcfb0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:25.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb6976700 1 -- 172.21.15.36:0/3233530250 shutdown_connections 2022-01-10T01:32:25.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb6976700 1 -- 172.21.15.36:0/3233530250 wait complete. 2022-01-10T01:32:25.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb6976700 1 Processor -- start 2022-01-10T01:32:25.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.895+0000 7fcfb6976700 1 -- start start 2022-01-10T01:32:25.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb6976700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb00ace70 0x7fcfb0064b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:25.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb6976700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcfb00b0710 0x7fcfb00abb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:25.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb6976700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb00b30d0 0x7fcfb0151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:25.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb6976700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb014ef20 con 0x7fcfb00b0710 2022-01-10T01:32:25.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb6976700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0065160 con 0x7fcfb00ace70 2022-01-10T01:32:25.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb6976700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0151510 con 0x7fcfb00b30d0 2022-01-10T01:32:25.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb5173700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcfb00b0710 0x7fcfb00abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:25.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb5173700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcfb00b0710 0x7fcfb00abb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40660/0 (socket says 172.21.15.36:40660) 2022-01-10T01:32:25.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb5173700 1 -- 172.21.15.36:0/1862782507 learned_addr learned my addr 172.21.15.36:0/1862782507 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:25.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb5974700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb00ace70 0x7fcfb0064b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:25.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb6175700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb00b30d0 0x7fcfb0151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:25.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb5173700 1 -- 172.21.15.36:0/1862782507 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb00b30d0 msgr2=0x7fcfb0151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:25.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb5173700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb00b30d0 0x7fcfb0151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:25.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb5173700 1 -- 172.21.15.36:0/1862782507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb00ace70 msgr2=0x7fcfb0064b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:25.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb5173700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb00ace70 0x7fcfb0064b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:25.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb5173700 1 -- 172.21.15.36:0/1862782507 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa800b180 con 0x7fcfb00b0710 2022-01-10T01:32:25.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb5974700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb00ace70 0x7fcfb0064b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:25.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb5173700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcfb00b0710 0x7fcfb00abb90 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fcfac001490 tx=0x7fcfac007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:25.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfa2ffd700 1 -- 172.21.15.36:0/1862782507 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfac005ba0 con 0x7fcfb00b0710 2022-01-10T01:32:25.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfa2ffd700 1 -- 172.21.15.36:0/1862782507 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac005d00 con 0x7fcfb00b0710 2022-01-10T01:32:25.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb6976700 1 -- 172.21.15.36:0/1862782507 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb01517b0 con 0x7fcfb00b0710 2022-01-10T01:32:25.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfa2ffd700 1 -- 172.21.15.36:0/1862782507 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfac0072c0 con 0x7fcfb00b0710 2022-01-10T01:32:25.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb6976700 1 -- 172.21.15.36:0/1862782507 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb0066fe0 con 0x7fcfb00b0710 2022-01-10T01:32:25.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.899+0000 7fcfb6976700 1 -- 172.21.15.36:0/1862782507 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb0057350 con 0x7fcfb00b0710 2022-01-10T01:32:25.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.903+0000 7fcfa2ffd700 1 -- 172.21.15.36:0/1862782507 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fcfac01a070 con 0x7fcfb00b0710 2022-01-10T01:32:25.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.903+0000 7fcfa2ffd700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf900535f0 0x7fcf90055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:25.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.903+0000 7fcfa2ffd700 1 -- 172.21.15.36:0/1862782507 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fcfac06ab60 con 0x7fcfb00b0710 2022-01-10T01:32:25.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.903+0000 7fcfb5974700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf900535f0 0x7fcf90055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:25.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.903+0000 7fcfb5974700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf900535f0 0x7fcf90055ab0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fcfa400b000 tx=0x7fcfa4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:25.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:25.907+0000 7fcfa2ffd700 1 -- 172.21.15.36:0/1862782507 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fcfac041da0 con 0x7fcfb00b0710 2022-01-10T01:32:26.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.035+0000 7fcfb6976700 1 -- 172.21.15.36:0/1862782507 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfb00b2c70 con 0x7fcfb00b0710 2022-01-10T01:32:26.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.039+0000 7fcfa2ffd700 1 -- 172.21.15.36:0/1862782507 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+13424 (secure 0 0 0) 0x7fcfac0453c0 con 0x7fcfb00b0710 2022-01-10T01:32:26.041 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:26.042 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":116,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:32:25.416304+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:32:26.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.039+0000 7fcfb6976700 1 -- 172.21.15.36:0/1862782507 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf900535f0 msgr2=0x7fcf90055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.039+0000 7fcfb6976700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf900535f0 0x7fcf90055ab0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fcfa400b000 tx=0x7fcfa4009040).stop 2022-01-10T01:32:26.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.039+0000 7fcfb6976700 1 -- 172.21.15.36:0/1862782507 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcfb00b0710 msgr2=0x7fcfb00abb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.039+0000 7fcfb6976700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcfb00b0710 0x7fcfb00abb90 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7fcfac001490 tx=0x7fcfac007e20).stop 2022-01-10T01:32:26.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.039+0000 7fcfb6976700 1 -- 172.21.15.36:0/1862782507 shutdown_connections 2022-01-10T01:32:26.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.039+0000 7fcfb6976700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fcf900535f0 0x7fcf90055ab0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.039+0000 7fcfb6976700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcfb00b30d0 0x7fcfb0151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.039+0000 7fcfb6976700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fcfb00b0710 0x7fcfb00abb90 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.039+0000 7fcfb6976700 1 --2- 172.21.15.36:0/1862782507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfb00ace70 0x7fcfb0064b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.039+0000 7fcfb6976700 1 -- 172.21.15.36:0/1862782507 >> 172.21.15.36:0/1862782507 conn(0x7fcfb0061140 msgr2=0x7fcfb0140f70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:26.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.039+0000 7fcfb6976700 1 -- 172.21.15.36:0/1862782507 shutdown_connections 2022-01-10T01:32:26.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.039+0000 7fcfb6976700 1 -- 172.21.15.36:0/1862782507 wait complete. 2022-01-10T01:32:26.062 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-01-10T01:32:26.063 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:32:26.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.167+0000 7f3f95ff0700 1 Processor -- start 2022-01-10T01:32:26.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.167+0000 7f3f95ff0700 1 -- start start 2022-01-10T01:32:26.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.167+0000 7f3f95ff0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3f900b76b0 0x7f3f90060a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.167+0000 7f3f95ff0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f900b27a0 0x7f3f90060f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.167+0000 7f3f95ff0700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f90067050 con 0x7f3f90146590 2022-01-10T01:32:26.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.167+0000 7f3f95ff0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f900653b0 con 0x7f3f900b76b0 2022-01-10T01:32:26.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.167+0000 7f3f95ff0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f900b7a90 con 0x7f3f900b27a0 2022-01-10T01:32:26.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.167+0000 7f3f94fee700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3f900b76b0 0x7f3f90060a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.167+0000 7f3f957ef700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f3f90146590 0x7f3f901469e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38464/0 (socket says 172.21.15.36:38464) 2022-01-10T01:32:26.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f957ef700 1 -- 172.21.15.36:0/1806990580 learned_addr learned my addr 172.21.15.36:0/1806990580 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:26.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f8ffff700 1 --2- 172.21.15.36:0/1806990580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f900b27a0 0x7f3f90060f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f8f7fe700 1 -- 172.21.15.36:0/1806990580 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962779984 0 0) 0x7f3f90067050 con 0x7f3f90146590 2022-01-10T01:32:26.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f8f7fe700 1 -- 172.21.15.36:0/1806990580 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f70003260 con 0x7f3f90146590 2022-01-10T01:32:26.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f94fee700 1 -- 172.21.15.36:0/1806990580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f900b27a0 msgr2=0x7f3f90060f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:26.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f94fee700 1 --2- 172.21.15.36:0/1806990580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f900b27a0 0x7f3f90060f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f94fee700 1 -- 172.21.15.36:0/1806990580 >> v1:172.21.15.36:6789/0 conn(0x7f3f90146590 legacy=0x7f3f901469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f94fee700 1 -- 172.21.15.36:0/1806990580 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f90066b50 con 0x7f3f900b76b0 2022-01-10T01:32:26.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f94fee700 1 --2- 172.21.15.36:0/1806990580 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f900b76b0 0x7f3f90060a50 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f3f78002f70 tx=0x7f3f78006d90).ready entity=mon.0 client_cookie=d7010ee430f0a895 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:26.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f8f7fe700 1 -- 172.21.15.36:0/1806990580 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f7800e590 con 0x7f3f900b76b0 2022-01-10T01:32:26.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f8f7fe700 1 -- 172.21.15.36:0/1806990580 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f78000e90 con 0x7f3f900b76b0 2022-01-10T01:32:26.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f8f7fe700 1 -- 172.21.15.36:0/1806990580 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f7800e8e0 con 0x7f3f900b76b0 2022-01-10T01:32:26.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 -- 172.21.15.36:0/1806990580 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f900b76b0 msgr2=0x7f3f90060a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 --2- 172.21.15.36:0/1806990580 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f900b76b0 0x7f3f90060a50 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f3f78002f70 tx=0x7f3f78006d90).stop 2022-01-10T01:32:26.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 -- 172.21.15.36:0/1806990580 shutdown_connections 2022-01-10T01:32:26.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 --2- 172.21.15.36:0/1806990580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f900b27a0 0x7f3f90060f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 --2- 172.21.15.36:0/1806990580 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f900b76b0 0x7f3f90060a50 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 -- 172.21.15.36:0/1806990580 >> 172.21.15.36:0/1806990580 conn(0x7f3f9005f6b0 msgr2=0x7f3f9005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:26.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 -- 172.21.15.36:0/1806990580 shutdown_connections 2022-01-10T01:32:26.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 -- 172.21.15.36:0/1806990580 wait complete. 2022-01-10T01:32:26.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 Processor -- start 2022-01-10T01:32:26.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 -- start start 2022-01-10T01:32:26.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f900b27a0 0x7f3f90141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f900b76b0 0x7f3f901405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f90146590 0x7f3f90140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f901471a0 con 0x7f3f90146590 2022-01-10T01:32:26.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f900b3a60 con 0x7f3f900b76b0 2022-01-10T01:32:26.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.171+0000 7f3f95ff0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f900b3d00 con 0x7f3f900b27a0 2022-01-10T01:32:26.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f957ef700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f90146590 0x7f3f90140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f957ef700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f90146590 0x7f3f90140ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40676/0 (socket says 172.21.15.36:40676) 2022-01-10T01:32:26.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f957ef700 1 -- 172.21.15.36:0/2442706820 learned_addr learned my addr 172.21.15.36:0/2442706820 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:26.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f94fee700 1 --2- 172.21.15.36:0/2442706820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f900b27a0 0x7f3f90141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f8ffff700 1 --2- 172.21.15.36:0/2442706820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f900b76b0 0x7f3f901405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f957ef700 1 -- 172.21.15.36:0/2442706820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f900b27a0 msgr2=0x7f3f90141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f957ef700 1 --2- 172.21.15.36:0/2442706820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f900b27a0 0x7f3f90141a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f957ef700 1 -- 172.21.15.36:0/2442706820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f900b76b0 msgr2=0x7f3f901405e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f957ef700 1 --2- 172.21.15.36:0/2442706820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f900b76b0 0x7f3f901405e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f957ef700 1 -- 172.21.15.36:0/2442706820 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7800b120 con 0x7f3f90146590 2022-01-10T01:32:26.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f957ef700 1 --2- 172.21.15.36:0/2442706820 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f90146590 0x7f3f90140ad0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f3f88001490 tx=0x7f3f88007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:26.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f8dffb700 1 -- 172.21.15.36:0/2442706820 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f88005ba0 con 0x7f3f90146590 2022-01-10T01:32:26.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f8dffb700 1 -- 172.21.15.36:0/2442706820 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f88005d00 con 0x7f3f90146590 2022-01-10T01:32:26.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f95ff0700 1 -- 172.21.15.36:0/2442706820 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f90140140 con 0x7f3f90146590 2022-01-10T01:32:26.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f8dffb700 1 -- 172.21.15.36:0/2442706820 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f880072c0 con 0x7f3f90146590 2022-01-10T01:32:26.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f95ff0700 1 -- 172.21.15.36:0/2442706820 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f900ab330 con 0x7f3f90146590 2022-01-10T01:32:26.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f95ff0700 1 -- 172.21.15.36:0/2442706820 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f900b3f00 con 0x7f3f90146590 2022-01-10T01:32:26.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.175+0000 7f3f8dffb700 1 -- 172.21.15.36:0/2442706820 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3f88010070 con 0x7f3f90146590 2022-01-10T01:32:26.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.179+0000 7f3f8dffb700 1 --2- 172.21.15.36:0/2442706820 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f74053500 0x7f3f740559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.179+0000 7f3f8dffb700 1 -- 172.21.15.36:0/2442706820 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f3f8806b0f0 con 0x7f3f90146590 2022-01-10T01:32:26.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.179+0000 7f3f94fee700 1 --2- 172.21.15.36:0/2442706820 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f74053500 0x7f3f740559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.179+0000 7f3f94fee700 1 --2- 172.21.15.36:0/2442706820 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f74053500 0x7f3f740559c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f3f78018000 tx=0x7f3f78014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:26.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.183+0000 7f3f8dffb700 1 -- 172.21.15.36:0/2442706820 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3f88042440 con 0x7f3f90146590 2022-01-10T01:32:26.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.311+0000 7f3f95ff0700 1 -- 172.21.15.36:0/2442706820 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3f901402d0 con 0x7f3f90146590 2022-01-10T01:32:26.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.311+0000 7f3f8dffb700 1 -- 172.21.15.36:0/2442706820 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v116) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3f88045a60 con 0x7f3f90146590 2022-01-10T01:32:26.316 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:32:26.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.315+0000 7f3f95ff0700 1 -- 172.21.15.36:0/2442706820 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f74053500 msgr2=0x7f3f740559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.318 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.315+0000 7f3f95ff0700 1 --2- 172.21.15.36:0/2442706820 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f74053500 0x7f3f740559c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f3f78018000 tx=0x7f3f78014000).stop 2022-01-10T01:32:26.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.315+0000 7f3f95ff0700 1 -- 172.21.15.36:0/2442706820 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f90146590 msgr2=0x7f3f90140ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.315+0000 7f3f95ff0700 1 --2- 172.21.15.36:0/2442706820 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f90146590 0x7f3f90140ad0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f3f88001490 tx=0x7f3f88007e00).stop 2022-01-10T01:32:26.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.315+0000 7f3f95ff0700 1 -- 172.21.15.36:0/2442706820 shutdown_connections 2022-01-10T01:32:26.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.315+0000 7f3f95ff0700 1 --2- 172.21.15.36:0/2442706820 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3f74053500 0x7f3f740559c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.319 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.315+0000 7f3f95ff0700 1 --2- 172.21.15.36:0/2442706820 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f90146590 0x7f3f90140ad0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.315+0000 7f3f95ff0700 1 --2- 172.21.15.36:0/2442706820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f900b76b0 0x7f3f901405e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.315+0000 7f3f95ff0700 1 --2- 172.21.15.36:0/2442706820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f900b27a0 0x7f3f90141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.315+0000 7f3f95ff0700 1 -- 172.21.15.36:0/2442706820 >> 172.21.15.36:0/2442706820 conn(0x7f3f9005f6b0 msgr2=0x7f3f90144970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:26.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.315+0000 7f3f95ff0700 1 -- 172.21.15.36:0/2442706820 shutdown_connections 2022-01-10T01:32:26.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.315+0000 7f3f95ff0700 1 -- 172.21.15.36:0/2442706820 wait complete. 2022-01-10T01:32:26.329 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:32:26.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.435+0000 7f0e20887700 1 Processor -- start 2022-01-10T01:32:26.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.435+0000 7f0e20887700 1 -- start start 2022-01-10T01:32:26.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1c0b21b0 0x7f0e1c05f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0e1c060d20 0x7f0e1c0b3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e1c143c90 0x7f0e1c12c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1c063df0 con 0x7f0e1c060d20 2022-01-10T01:32:26.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1c0b2590 con 0x7f0e1c143c90 2022-01-10T01:32:26.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c0b2e30 con 0x7f0e1c0b21b0 2022-01-10T01:32:26.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e12ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0e1c060d20 0x7f0e1c0b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e12ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0e1c060d20 0x7f0e1c0b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40682/0 (socket says 172.21.15.36:40682) 2022-01-10T01:32:26.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e12ffd700 1 -- 172.21.15.36:0/473564897 learned_addr learned my addr 172.21.15.36:0/473564897 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:26.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e1bfff700 1 --2- 172.21.15.36:0/473564897 >> v2:172.21.15.59:3300/0 conn(0x7f0e1c143c90 0x7f0e1c12c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e1b7fe700 1 --2- 172.21.15.36:0/473564897 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1c0b21b0 0x7f0e1c05f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e12ffd700 1 -- 172.21.15.36:0/473564897 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1c0b21b0 msgr2=0x7f0e1c05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:26.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e12ffd700 1 --2- 172.21.15.36:0/473564897 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1c0b21b0 0x7f0e1c05f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e12ffd700 1 -- 172.21.15.36:0/473564897 >> v2:172.21.15.59:3300/0 conn(0x7f0e1c143c90 msgr2=0x7f0e1c12c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:26.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e12ffd700 1 --2- 172.21.15.36:0/473564897 >> v2:172.21.15.59:3300/0 conn(0x7f0e1c143c90 0x7f0e1c12c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e12ffd700 1 -- 172.21.15.36:0/473564897 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c0638b0 con 0x7f0e1c060d20 2022-01-10T01:32:26.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e12ffd700 1 --2- 172.21.15.36:0/473564897 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e1c060d20 0x7f0e1c0b3530 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f0e04002f70 tx=0x7f0e04006eb0).ready entity=mon.0 client_cookie=9bd088bfc04432df server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:26.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e1affd700 1 -- 172.21.15.36:0/473564897 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e0400d570 con 0x7f0e1c060d20 2022-01-10T01:32:26.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e1affd700 1 -- 172.21.15.36:0/473564897 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e04000e90 con 0x7f0e1c060d20 2022-01-10T01:32:26.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e1affd700 1 -- 172.21.15.36:0/473564897 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e0400d900 con 0x7f0e1c060d20 2022-01-10T01:32:26.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 -- 172.21.15.36:0/473564897 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e1c060d20 msgr2=0x7f0e1c0b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 --2- 172.21.15.36:0/473564897 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e1c060d20 0x7f0e1c0b3530 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f0e04002f70 tx=0x7f0e04006eb0).stop 2022-01-10T01:32:26.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 -- 172.21.15.36:0/473564897 shutdown_connections 2022-01-10T01:32:26.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 --2- 172.21.15.36:0/473564897 >> v2:172.21.15.59:3300/0 conn(0x7f0e1c143c90 0x7f0e1c12c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 --2- 172.21.15.36:0/473564897 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e1c060d20 0x7f0e1c0b3530 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 --2- 172.21.15.36:0/473564897 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1c0b21b0 0x7f0e1c05f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 -- 172.21.15.36:0/473564897 >> 172.21.15.36:0/473564897 conn(0x7f0e1c05c490 msgr2=0x7f0e1c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:26.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 -- 172.21.15.36:0/473564897 shutdown_connections 2022-01-10T01:32:26.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.439+0000 7f0e20887700 1 -- 172.21.15.36:0/473564897 wait complete. 2022-01-10T01:32:26.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e20887700 1 Processor -- start 2022-01-10T01:32:26.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e20887700 1 -- start start 2022-01-10T01:32:26.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e20887700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1c060d20 0x7f0e1c0ae9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e20887700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1c0b21b0 0x7f0e1c145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e20887700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e1c143c90 0x7f0e1c1464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e20887700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c1535c0 con 0x7f0e1c143c90 2022-01-10T01:32:26.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e20887700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c153080 con 0x7f0e1c0b21b0 2022-01-10T01:32:26.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e20887700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c153320 con 0x7f0e1c060d20 2022-01-10T01:32:26.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e1bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e1c143c90 0x7f0e1c1464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e1bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e1c143c90 0x7f0e1c1464d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40690/0 (socket says 172.21.15.36:40690) 2022-01-10T01:32:26.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e1bfff700 1 -- 172.21.15.36:0/473386240 learned_addr learned my addr 172.21.15.36:0/473386240 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:26.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e1b7fe700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1c060d20 0x7f0e1c0ae9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e12ffd700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1c0b21b0 0x7f0e1c145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e1bfff700 1 -- 172.21.15.36:0/473386240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1c060d20 msgr2=0x7f0e1c0ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e1bfff700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1c060d20 0x7f0e1c0ae9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e1bfff700 1 -- 172.21.15.36:0/473386240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1c0b21b0 msgr2=0x7f0e1c145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e1bfff700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1c0b21b0 0x7f0e1c145fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e1bfff700 1 -- 172.21.15.36:0/473386240 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0400b1e0 con 0x7f0e1c143c90 2022-01-10T01:32:26.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e12ffd700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1c0b21b0 0x7f0e1c145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:26.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.443+0000 7f0e1bfff700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e1c143c90 0x7f0e1c1464d0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f0e14006e00 tx=0x7f0e140091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:26.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.447+0000 7f0e197fa700 1 -- 172.21.15.36:0/473386240 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e1400c7f0 con 0x7f0e1c143c90 2022-01-10T01:32:26.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.447+0000 7f0e197fa700 1 -- 172.21.15.36:0/473386240 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1400c950 con 0x7f0e1c143c90 2022-01-10T01:32:26.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.447+0000 7f0e20887700 1 -- 172.21.15.36:0/473386240 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1c144cc0 con 0x7f0e1c143c90 2022-01-10T01:32:26.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.447+0000 7f0e197fa700 1 -- 172.21.15.36:0/473386240 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e1400ccb0 con 0x7f0e1c143c90 2022-01-10T01:32:26.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.447+0000 7f0e20887700 1 -- 172.21.15.36:0/473386240 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1c144940 con 0x7f0e1c143c90 2022-01-10T01:32:26.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.447+0000 7f0e20887700 1 -- 172.21.15.36:0/473386240 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1c061bd0 con 0x7f0e1c143c90 2022-01-10T01:32:26.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.447+0000 7f0e197fa700 1 -- 172.21.15.36:0/473386240 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0e14022070 con 0x7f0e1c143c90 2022-01-10T01:32:26.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.447+0000 7f0e197fa700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0df4053560 0x7f0df4055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.447+0000 7f0e1b7fe700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0df4053560 0x7f0df4055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.447+0000 7f0e197fa700 1 -- 172.21.15.36:0/473386240 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f0e1406be60 con 0x7f0e1c143c90 2022-01-10T01:32:26.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.451+0000 7f0e1b7fe700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0df4053560 0x7f0df4055a20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f0e0c00b000 tx=0x7f0e0c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:26.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.455+0000 7f0e197fa700 1 -- 172.21.15.36:0/473386240 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0e140431b0 con 0x7f0e1c143c90 2022-01-10T01:32:26.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.575+0000 7f0e20887700 1 -- 172.21.15.36:0/473386240 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0e1c063b50 con 0x7f0e1c143c90 2022-01-10T01:32:26.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.579+0000 7f0e197fa700 1 -- 172.21.15.36:0/473386240 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v116) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0e14016070 con 0x7f0e1c143c90 2022-01-10T01:32:26.581 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:32:26.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.579+0000 7f0e20887700 1 -- 172.21.15.36:0/473386240 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0df4053560 msgr2=0x7f0df4055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.579+0000 7f0e20887700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0df4053560 0x7f0df4055a20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f0e0c00b000 tx=0x7f0e0c006df0).stop 2022-01-10T01:32:26.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.579+0000 7f0e20887700 1 -- 172.21.15.36:0/473386240 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e1c143c90 msgr2=0x7f0e1c1464d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.579+0000 7f0e20887700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e1c143c90 0x7f0e1c1464d0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f0e14006e00 tx=0x7f0e140091d0).stop 2022-01-10T01:32:26.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.579+0000 7f0e20887700 1 -- 172.21.15.36:0/473386240 shutdown_connections 2022-01-10T01:32:26.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.579+0000 7f0e20887700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0df4053560 0x7f0df4055a20 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.579+0000 7f0e20887700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e1c143c90 0x7f0e1c1464d0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.579+0000 7f0e20887700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1c0b21b0 0x7f0e1c145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.579+0000 7f0e20887700 1 --2- 172.21.15.36:0/473386240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e1c060d20 0x7f0e1c0ae9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.579+0000 7f0e20887700 1 -- 172.21.15.36:0/473386240 >> 172.21.15.36:0/473386240 conn(0x7f0e1c05c490 msgr2=0x7f0e1c0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:26.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.579+0000 7f0e20887700 1 -- 172.21.15.36:0/473386240 shutdown_connections 2022-01-10T01:32:26.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.579+0000 7f0e20887700 1 -- 172.21.15.36:0/473386240 wait complete. 2022-01-10T01:32:26.602 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-01-10T01:32:26.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.699+0000 7f177df17700 1 Processor -- start 2022-01-10T01:32:26.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.699+0000 7f177df17700 1 -- start start 2022-01-10T01:32:26.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.699+0000 7f177df17700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f17780b2580 0x7f1778140050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.699+0000 7f177df17700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17780ac6f0 0x7f1778140540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.699+0000 7f177df17700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1778067880 con 0x7f17780b00e0 2022-01-10T01:32:26.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.699+0000 7f177df17700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17780ad5b0 con 0x7f17780b2580 2022-01-10T01:32:26.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.699+0000 7f177df17700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1778067b20 con 0x7f17780ac6f0 2022-01-10T01:32:26.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.699+0000 7f1777fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f17780b00e0 0x7f1778142e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38488/0 (socket says 172.21.15.36:38488) 2022-01-10T01:32:26.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.699+0000 7f1777fff700 1 -- 172.21.15.36:0/3849055789 learned_addr learned my addr 172.21.15.36:0/3849055789 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:26.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.699+0000 7f177cf15700 1 --2- 172.21.15.36:0/3849055789 >> v2:172.21.15.36:3300/0 conn(0x7f17780b2580 0x7f1778140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.699+0000 7f177d716700 1 --2- 172.21.15.36:0/3849055789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17780ac6f0 0x7f1778140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.699+0000 7f17777fe700 1 -- 172.21.15.36:0/3849055789 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456548918 0 0) 0x7f1778067880 con 0x7f17780b00e0 2022-01-10T01:32:26.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.699+0000 7f17777fe700 1 -- 172.21.15.36:0/3849055789 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1764003260 con 0x7f17780b00e0 2022-01-10T01:32:26.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177d716700 1 -- 172.21.15.36:0/3849055789 >> v2:172.21.15.36:3300/0 conn(0x7f17780b2580 msgr2=0x7f1778140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:26.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177d716700 1 --2- 172.21.15.36:0/3849055789 >> v2:172.21.15.36:3300/0 conn(0x7f17780b2580 0x7f1778140050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177d716700 1 -- 172.21.15.36:0/3849055789 >> v1:172.21.15.36:6789/0 conn(0x7f17780b00e0 legacy=0x7f1778142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177d716700 1 -- 172.21.15.36:0/3849055789 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1778146fd0 con 0x7f17780ac6f0 2022-01-10T01:32:26.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177cf15700 1 --2- 172.21.15.36:0/3849055789 >> v2:172.21.15.36:3300/0 conn(0x7f17780b2580 0x7f1778140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:26.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177d716700 1 --2- 172.21.15.36:0/3849055789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17780ac6f0 0x7f1778140540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f17700032f0 tx=0x7f17700091d0).ready entity=mon.2 client_cookie=72d6e083a701ee8d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:26.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f17777fe700 1 -- 172.21.15.36:0/3849055789 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f177000b600 con 0x7f17780ac6f0 2022-01-10T01:32:26.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f17777fe700 1 -- 172.21.15.36:0/3849055789 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177000b760 con 0x7f17780ac6f0 2022-01-10T01:32:26.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f17777fe700 1 -- 172.21.15.36:0/3849055789 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f177000b8d0 con 0x7f17780ac6f0 2022-01-10T01:32:26.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177df17700 1 -- 172.21.15.36:0/3849055789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17780ac6f0 msgr2=0x7f1778140540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177df17700 1 --2- 172.21.15.36:0/3849055789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17780ac6f0 0x7f1778140540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f17700032f0 tx=0x7f17700091d0).stop 2022-01-10T01:32:26.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177df17700 1 -- 172.21.15.36:0/3849055789 shutdown_connections 2022-01-10T01:32:26.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177df17700 1 --2- 172.21.15.36:0/3849055789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17780ac6f0 0x7f1778140540 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177df17700 1 --2- 172.21.15.36:0/3849055789 >> v2:172.21.15.36:3300/0 conn(0x7f17780b2580 0x7f1778140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177df17700 1 -- 172.21.15.36:0/3849055789 >> 172.21.15.36:0/3849055789 conn(0x7f1778060180 msgr2=0x7f17780b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:26.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177df17700 1 -- 172.21.15.36:0/3849055789 shutdown_connections 2022-01-10T01:32:26.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177df17700 1 -- 172.21.15.36:0/3849055789 wait complete. 2022-01-10T01:32:26.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177df17700 1 Processor -- start 2022-01-10T01:32:26.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.703+0000 7f177df17700 1 -- start start 2022-01-10T01:32:26.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177df17700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17780ac6f0 0x7f17780b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177df17700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17780b00e0 0x7f177814f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177df17700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17780b2580 0x7f177814fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177df17700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1778155770 con 0x7f17780ac6f0 2022-01-10T01:32:26.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177df17700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177809eff0 con 0x7f17780b2580 2022-01-10T01:32:26.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177df17700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177809f290 con 0x7f17780b00e0 2022-01-10T01:32:26.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177cf15700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17780ac6f0 0x7f17780b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177cf15700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17780ac6f0 0x7f17780b3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40700/0 (socket says 172.21.15.36:40700) 2022-01-10T01:32:26.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177cf15700 1 -- 172.21.15.36:0/415479301 learned_addr learned my addr 172.21.15.36:0/415479301 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:26.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177d716700 1 --2- 172.21.15.36:0/415479301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17780b2580 0x7f177814fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f1777fff700 1 --2- 172.21.15.36:0/415479301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17780b00e0 0x7f177814f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177cf15700 1 -- 172.21.15.36:0/415479301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17780b00e0 msgr2=0x7f177814f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177cf15700 1 --2- 172.21.15.36:0/415479301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17780b00e0 0x7f177814f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177cf15700 1 -- 172.21.15.36:0/415479301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17780b2580 msgr2=0x7f177814fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177cf15700 1 --2- 172.21.15.36:0/415479301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17780b2580 0x7f177814fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177cf15700 1 -- 172.21.15.36:0/415479301 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c00b180 con 0x7f17780ac6f0 2022-01-10T01:32:26.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177cf15700 1 --2- 172.21.15.36:0/415479301 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17780ac6f0 0x7f17780b3e70 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7f176c00c000 tx=0x7f176c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:26.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f1775ffb700 1 -- 172.21.15.36:0/415479301 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f176c010780 con 0x7f17780ac6f0 2022-01-10T01:32:26.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f1775ffb700 1 -- 172.21.15.36:0/415479301 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176c0108e0 con 0x7f17780ac6f0 2022-01-10T01:32:26.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177df17700 1 -- 172.21.15.36:0/415479301 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1770009470 con 0x7f17780ac6f0 2022-01-10T01:32:26.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f1775ffb700 1 -- 172.21.15.36:0/415479301 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f176c010c40 con 0x7f17780ac6f0 2022-01-10T01:32:26.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.707+0000 7f177df17700 1 -- 172.21.15.36:0/415479301 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17780abd70 con 0x7f17780ac6f0 2022-01-10T01:32:26.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.711+0000 7f177df17700 1 -- 172.21.15.36:0/415479301 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1778057350 con 0x7f17780ac6f0 2022-01-10T01:32:26.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.711+0000 7f1775ffb700 1 -- 172.21.15.36:0/415479301 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f176c01c460 con 0x7f17780ac6f0 2022-01-10T01:32:26.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.711+0000 7f1775ffb700 1 --2- 172.21.15.36:0/415479301 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1758053560 0x7f1758055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.711+0000 7f1775ffb700 1 -- 172.21.15.36:0/415479301 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f176c06bcb0 con 0x7f17780ac6f0 2022-01-10T01:32:26.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.711+0000 7f1777fff700 1 --2- 172.21.15.36:0/415479301 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1758053560 0x7f1758055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.711+0000 7f1777fff700 1 --2- 172.21.15.36:0/415479301 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1758053560 0x7f1758055a20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f176800d000 tx=0x7f1768009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:26.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.715+0000 7f1775ffb700 1 -- 172.21.15.36:0/415479301 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f176c042f00 con 0x7f17780ac6f0 2022-01-10T01:32:26.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.847+0000 7f177df17700 1 -- 172.21.15.36:0/415479301 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f17780b1a20 con 0x7f17780ac6f0 2022-01-10T01:32:26.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.847+0000 7f1775ffb700 1 -- 172.21.15.36:0/415479301 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v116) v1 ==== 84+0+143 (secure 0 0 0) 0x7f176c046520 con 0x7f17780ac6f0 2022-01-10T01:32:26.852 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:26.852 INFO:teuthology.orchestra.run.smithi036.stdout:[ 2022-01-10T01:32:26.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:26.853 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 1, 2022-01-10T01:32:26.853 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "device_health_metrics" 2022-01-10T01:32:26.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:26.854 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:26.854 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 2, 2022-01-10T01:32:26.854 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "rbd" 2022-01-10T01:32:26.855 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:26.855 INFO:teuthology.orchestra.run.smithi036.stdout:] 2022-01-10T01:32:26.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.851+0000 7f177df17700 1 -- 172.21.15.36:0/415479301 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1758053560 msgr2=0x7f1758055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.851+0000 7f177df17700 1 --2- 172.21.15.36:0/415479301 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1758053560 0x7f1758055a20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f176800d000 tx=0x7f1768009040).stop 2022-01-10T01:32:26.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.851+0000 7f177df17700 1 -- 172.21.15.36:0/415479301 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17780ac6f0 msgr2=0x7f17780b3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.851+0000 7f177df17700 1 --2- 172.21.15.36:0/415479301 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17780ac6f0 0x7f17780b3e70 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7f176c00c000 tx=0x7f176c006df0).stop 2022-01-10T01:32:26.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.851+0000 7f177df17700 1 -- 172.21.15.36:0/415479301 shutdown_connections 2022-01-10T01:32:26.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.851+0000 7f177df17700 1 --2- 172.21.15.36:0/415479301 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1758053560 0x7f1758055a20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.851+0000 7f177df17700 1 --2- 172.21.15.36:0/415479301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17780b2580 0x7f177814fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.851+0000 7f177df17700 1 --2- 172.21.15.36:0/415479301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17780b00e0 0x7f177814f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.851+0000 7f177df17700 1 --2- 172.21.15.36:0/415479301 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f17780ac6f0 0x7f17780b3e70 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.851+0000 7f177df17700 1 -- 172.21.15.36:0/415479301 >> 172.21.15.36:0/415479301 conn(0x7f1778060180 msgr2=0x7f1778140280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:26.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.851+0000 7f177df17700 1 -- 172.21.15.36:0/415479301 shutdown_connections 2022-01-10T01:32:26.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.851+0000 7f177df17700 1 -- 172.21.15.36:0/415479301 wait complete. 2022-01-10T01:32:26.865 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-01-10T01:32:26.865 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:32:26.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.971+0000 7fee31c7e700 1 Processor -- start 2022-01-10T01:32:26.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.971+0000 7fee31c7e700 1 -- start start 2022-01-10T01:32:26.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.971+0000 7fee31c7e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fee2c05fdc0 0x7fee2c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.971+0000 7fee31c7e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2c140090 con 0x7fee2c0616d0 2022-01-10T01:32:26.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.971+0000 7fee31c7e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2c140330 con 0x7fee2c0b1980 2022-01-10T01:32:26.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.971+0000 7fee31c7e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2c0ad0b0 con 0x7fee2c05fdc0 2022-01-10T01:32:26.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.971+0000 7fee2affd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fee2c0616d0 0x7fee2c05f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38506/0 (socket says 172.21.15.36:38506) 2022-01-10T01:32:26.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.971+0000 7fee2affd700 1 -- 172.21.15.36:0/3526453361 learned_addr learned my addr 172.21.15.36:0/3526453361 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:26.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.971+0000 7fee2bfff700 1 --2- 172.21.15.36:0/3526453361 >> v2:172.21.15.59:3300/0 conn(0x7fee2c05fdc0 0x7fee2c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.971+0000 7fee2a7fc700 1 -- 172.21.15.36:0/3526453361 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1536926661 0 0) 0x7fee2c140090 con 0x7fee2c0616d0 2022-01-10T01:32:26.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.971+0000 7fee2a7fc700 1 -- 172.21.15.36:0/3526453361 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee18003260 con 0x7fee2c0616d0 2022-01-10T01:32:26.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.971+0000 7fee2a7fc700 1 -- 172.21.15.36:0/3526453361 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698763357 0 0) 0x7fee2c140330 con 0x7fee2c0b1980 2022-01-10T01:32:26.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.971+0000 7fee2a7fc700 1 -- 172.21.15.36:0/3526453361 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee2c140090 con 0x7fee2c0b1980 2022-01-10T01:32:26.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee2bfff700 1 -- 172.21.15.36:0/3526453361 >> v1:172.21.15.59:6789/0 conn(0x7fee2c0b1980 legacy=0x7fee2c139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee2bfff700 1 -- 172.21.15.36:0/3526453361 >> v1:172.21.15.36:6789/0 conn(0x7fee2c0616d0 legacy=0x7fee2c05f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee2bfff700 1 -- 172.21.15.36:0/3526453361 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c1405d0 con 0x7fee2c05fdc0 2022-01-10T01:32:26.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee2bfff700 1 --2- 172.21.15.36:0/3526453361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2c05fdc0 0x7fee2c0b1d60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fee24002f70 tx=0x7fee24006df0).ready entity=mon.1 client_cookie=a17f22a4bd7ce3e5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:26.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee2a7fc700 1 -- 172.21.15.36:0/3526453361 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee2400d540 con 0x7fee2c05fdc0 2022-01-10T01:32:26.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee2a7fc700 1 -- 172.21.15.36:0/3526453361 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee24000e90 con 0x7fee2c05fdc0 2022-01-10T01:32:26.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee2a7fc700 1 -- 172.21.15.36:0/3526453361 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee2400d890 con 0x7fee2c05fdc0 2022-01-10T01:32:26.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee31c7e700 1 -- 172.21.15.36:0/3526453361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2c05fdc0 msgr2=0x7fee2c0b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee31c7e700 1 --2- 172.21.15.36:0/3526453361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2c05fdc0 0x7fee2c0b1d60 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fee24002f70 tx=0x7fee24006df0).stop 2022-01-10T01:32:26.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee31c7e700 1 -- 172.21.15.36:0/3526453361 shutdown_connections 2022-01-10T01:32:26.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee31c7e700 1 --2- 172.21.15.36:0/3526453361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2c05fdc0 0x7fee2c0b1d60 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee31c7e700 1 -- 172.21.15.36:0/3526453361 >> 172.21.15.36:0/3526453361 conn(0x7fee2c0b2970 msgr2=0x7fee2c0b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:26.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee31c7e700 1 -- 172.21.15.36:0/3526453361 shutdown_connections 2022-01-10T01:32:26.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee31c7e700 1 -- 172.21.15.36:0/3526453361 wait complete. 2022-01-10T01:32:26.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee31c7e700 1 Processor -- start 2022-01-10T01:32:26.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.975+0000 7fee31c7e700 1 -- start start 2022-01-10T01:32:26.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee31c7e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee2c05fdc0 0x7fee2c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee31c7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee2c0616d0 0x7fee2c0af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee31c7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2c0b1980 0x7fee2c065950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee31c7e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c0a8e50 con 0x7fee2c05fdc0 2022-01-10T01:32:26.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee31c7e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c0afa00 con 0x7fee2c0b1980 2022-01-10T01:32:26.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee31c7e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c0a9080 con 0x7fee2c0616d0 2022-01-10T01:32:26.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee2b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee2c05fdc0 0x7fee2c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee2b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee2c05fdc0 0x7fee2c0b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40714/0 (socket says 172.21.15.36:40714) 2022-01-10T01:32:26.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee2b7fe700 1 -- 172.21.15.36:0/46689600 learned_addr learned my addr 172.21.15.36:0/46689600 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:26.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee2bfff700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2c0b1980 0x7fee2c065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee2affd700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee2c0616d0 0x7fee2c0af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee2b7fe700 1 -- 172.21.15.36:0/46689600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee2c0616d0 msgr2=0x7fee2c0af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee2b7fe700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee2c0616d0 0x7fee2c0af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee2b7fe700 1 -- 172.21.15.36:0/46689600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2c0b1980 msgr2=0x7fee2c065950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:26.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee2b7fe700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2c0b1980 0x7fee2c065950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:26.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee2b7fe700 1 -- 172.21.15.36:0/46689600 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2400b180 con 0x7fee2c05fdc0 2022-01-10T01:32:26.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee2bfff700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2c0b1980 0x7fee2c065950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:26.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee2b7fe700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee2c05fdc0 0x7fee2c0b5220 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7fee1c001490 tx=0x7fee1c007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:26.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee28ff9700 1 -- 172.21.15.36:0/46689600 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee1c002310 con 0x7fee2c05fdc0 2022-01-10T01:32:26.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee28ff9700 1 -- 172.21.15.36:0/46689600 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c002470 con 0x7fee2c05fdc0 2022-01-10T01:32:26.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee31c7e700 1 -- 172.21.15.36:0/46689600 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c0a9320 con 0x7fee2c05fdc0 2022-01-10T01:32:26.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee28ff9700 1 -- 172.21.15.36:0/46689600 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee1c0017a0 con 0x7fee2c05fdc0 2022-01-10T01:32:26.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee31c7e700 1 -- 172.21.15.36:0/46689600 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c0b0140 con 0x7fee2c05fdc0 2022-01-10T01:32:26.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.979+0000 7fee31c7e700 1 -- 172.21.15.36:0/46689600 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2c140870 con 0x7fee2c05fdc0 2022-01-10T01:32:26.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.983+0000 7fee28ff9700 1 -- 172.21.15.36:0/46689600 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fee1c010030 con 0x7fee2c05fdc0 2022-01-10T01:32:26.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.983+0000 7fee28ff9700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fee0c053680 0x7fee0c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:26.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.983+0000 7fee28ff9700 1 -- 172.21.15.36:0/46689600 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fee1c06b860 con 0x7fee2c05fdc0 2022-01-10T01:32:26.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.983+0000 7fee2affd700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fee0c053680 0x7fee0c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:26.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.983+0000 7fee2affd700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fee0c053680 0x7fee0c055b40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fee2000b000 tx=0x7fee20009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:26.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:26.987+0000 7fee28ff9700 1 -- 172.21.15.36:0/46689600 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fee1c042aa0 con 0x7fee2c05fdc0 2022-01-10T01:32:27.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.111+0000 7fee31c7e700 1 -- 172.21.15.36:0/46689600 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fee2c057350 con 0x7fee2c05fdc0 2022-01-10T01:32:27.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.771+0000 7fee28ff9700 1 -- 172.21.15.36:0/46689600 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v117) v1 ==== 133+0+0 (secure 0 0 0) 0x7fee1c06b020 con 0x7fee2c05fdc0 2022-01-10T01:32:27.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.779+0000 7fee31c7e700 1 -- 172.21.15.36:0/46689600 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fee0c053680 msgr2=0x7fee0c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:27.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.779+0000 7fee31c7e700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fee0c053680 0x7fee0c055b40 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fee2000b000 tx=0x7fee20009040).stop 2022-01-10T01:32:27.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.779+0000 7fee31c7e700 1 -- 172.21.15.36:0/46689600 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee2c05fdc0 msgr2=0x7fee2c0b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:27.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.779+0000 7fee31c7e700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee2c05fdc0 0x7fee2c0b5220 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7fee1c001490 tx=0x7fee1c007e60).stop 2022-01-10T01:32:27.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.779+0000 7fee31c7e700 1 -- 172.21.15.36:0/46689600 shutdown_connections 2022-01-10T01:32:27.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.779+0000 7fee31c7e700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fee0c053680 0x7fee0c055b40 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:27.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.779+0000 7fee31c7e700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee2c0b1980 0x7fee2c065950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:27.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.779+0000 7fee31c7e700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee2c0616d0 0x7fee2c0af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:27.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.779+0000 7fee31c7e700 1 --2- 172.21.15.36:0/46689600 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fee2c05fdc0 0x7fee2c0b5220 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:27.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.779+0000 7fee31c7e700 1 -- 172.21.15.36:0/46689600 >> 172.21.15.36:0/46689600 conn(0x7fee2c0b2970 msgr2=0x7fee2c13d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:27.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.779+0000 7fee31c7e700 1 -- 172.21.15.36:0/46689600 shutdown_connections 2022-01-10T01:32:27.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.779+0000 7fee31c7e700 1 -- 172.21.15.36:0/46689600 wait complete. 2022-01-10T01:32:27.786 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:32:27.795 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2022-01-10T01:32:27.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.895+0000 7f475a189700 1 Processor -- start 2022-01-10T01:32:27.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.895+0000 7f475a189700 1 -- start start 2022-01-10T01:32:27.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f475a189700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f47540b3040 0x7f4754065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:27.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f475a189700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4754066ea0 con 0x7f47540a9c10 2022-01-10T01:32:27.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f475a189700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47540b3420 con 0x7f4754140140 2022-01-10T01:32:27.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f475a189700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47540648e0 con 0x7f47540b3040 2022-01-10T01:32:27.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f4759187700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f47540b3040 0x7f4754065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:27.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f4758986700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f47540a9c10 0x7f47540607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38516/0 (socket says 172.21.15.36:38516) 2022-01-10T01:32:27.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f4758986700 1 -- 172.21.15.36:0/3303343572 learned_addr learned my addr 172.21.15.36:0/3303343572 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:27.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f4743fff700 1 -- 172.21.15.36:0/3303343572 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567904575 0 0) 0x7f4754066ea0 con 0x7f47540a9c10 2022-01-10T01:32:27.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f4743fff700 1 -- 172.21.15.36:0/3303343572 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f473c003260 con 0x7f47540a9c10 2022-01-10T01:32:27.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f4743fff700 1 -- 172.21.15.36:0/3303343572 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655447757 0 0) 0x7f47540b3420 con 0x7f4754140140 2022-01-10T01:32:27.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f4759187700 1 -- 172.21.15.36:0/3303343572 >> v1:172.21.15.59:6789/0 conn(0x7f4754140140 legacy=0x7f47541405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:27.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f4759187700 1 -- 172.21.15.36:0/3303343572 >> v1:172.21.15.36:6789/0 conn(0x7f47540a9c10 legacy=0x7f47540607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:27.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f4759187700 1 -- 172.21.15.36:0/3303343572 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4754066960 con 0x7f47540b3040 2022-01-10T01:32:27.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f4759187700 1 --2- 172.21.15.36:0/3303343572 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47540b3040 0x7f4754065e90 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f4750002f70 tx=0x7f4750006df0).ready entity=mon.0 client_cookie=8188912453c1b0d1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:27.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f4743fff700 1 -- 172.21.15.36:0/3303343572 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f475000d610 con 0x7f47540b3040 2022-01-10T01:32:27.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f4743fff700 1 -- 172.21.15.36:0/3303343572 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4750000e90 con 0x7f47540b3040 2022-01-10T01:32:27.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f4743fff700 1 -- 172.21.15.36:0/3303343572 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f475000d960 con 0x7f47540b3040 2022-01-10T01:32:27.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f475a189700 1 -- 172.21.15.36:0/3303343572 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47540b3040 msgr2=0x7f4754065e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:27.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.899+0000 7f475a189700 1 --2- 172.21.15.36:0/3303343572 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47540b3040 0x7f4754065e90 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7f4750002f70 tx=0x7f4750006df0).stop 2022-01-10T01:32:27.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.903+0000 7f475a189700 1 -- 172.21.15.36:0/3303343572 shutdown_connections 2022-01-10T01:32:27.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.903+0000 7f475a189700 1 --2- 172.21.15.36:0/3303343572 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f47540b3040 0x7f4754065e90 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:27.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.903+0000 7f475a189700 1 -- 172.21.15.36:0/3303343572 >> 172.21.15.36:0/3303343572 conn(0x7f47540636e0 msgr2=0x7f4754063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:27.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.903+0000 7f475a189700 1 -- 172.21.15.36:0/3303343572 shutdown_connections 2022-01-10T01:32:27.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.903+0000 7f475a189700 1 -- 172.21.15.36:0/3303343572 wait complete. 2022-01-10T01:32:27.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.903+0000 7f475a189700 1 Processor -- start 2022-01-10T01:32:27.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.903+0000 7f475a189700 1 -- start start 2022-01-10T01:32:27.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f475a189700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47540a9c10 0x7f47540b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:27.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f475a189700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47540b3040 0x7f4754155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:27.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f475a189700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4754140140 0x7f4754155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:27.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f475a189700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47540ad240 con 0x7f4754140140 2022-01-10T01:32:27.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f475a189700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4754145de0 con 0x7f47540a9c10 2022-01-10T01:32:27.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f475a189700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47540ac590 con 0x7f47540b3040 2022-01-10T01:32:27.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f4759988700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4754140140 0x7f4754155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:27.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f4759988700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4754140140 0x7f4754155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40732/0 (socket says 172.21.15.36:40732) 2022-01-10T01:32:27.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f4759988700 1 -- 172.21.15.36:0/2895487534 learned_addr learned my addr 172.21.15.36:0/2895487534 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:27.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f4758986700 1 --2- 172.21.15.36:0/2895487534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47540b3040 0x7f4754155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:27.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f4759187700 1 --2- 172.21.15.36:0/2895487534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47540a9c10 0x7f47540b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:27.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f4759988700 1 -- 172.21.15.36:0/2895487534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47540b3040 msgr2=0x7f4754155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:27.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f4759988700 1 --2- 172.21.15.36:0/2895487534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47540b3040 0x7f4754155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:27.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f4759988700 1 -- 172.21.15.36:0/2895487534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47540a9c10 msgr2=0x7f47540b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:27.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f4759988700 1 --2- 172.21.15.36:0/2895487534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47540a9c10 0x7f47540b42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:27.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f4759988700 1 -- 172.21.15.36:0/2895487534 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475000b180 con 0x7f4754140140 2022-01-10T01:32:27.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f4759988700 1 --2- 172.21.15.36:0/2895487534 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4754140140 0x7f4754155e60 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f474c001250 tx=0x7f474c00c7d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:27.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f47427fc700 1 -- 172.21.15.36:0/2895487534 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f474c006aa0 con 0x7f4754140140 2022-01-10T01:32:27.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f47427fc700 1 -- 172.21.15.36:0/2895487534 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c006c00 con 0x7f4754140140 2022-01-10T01:32:27.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f475a189700 1 -- 172.21.15.36:0/2895487534 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47540ac830 con 0x7f4754140140 2022-01-10T01:32:27.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f47427fc700 1 -- 172.21.15.36:0/2895487534 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f474c007030 con 0x7f4754140140 2022-01-10T01:32:27.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.907+0000 7f475a189700 1 -- 172.21.15.36:0/2895487534 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47540b47c0 con 0x7f4754140140 2022-01-10T01:32:27.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.911+0000 7f475a189700 1 -- 172.21.15.36:0/2895487534 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4754066c00 con 0x7f4754140140 2022-01-10T01:32:27.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.911+0000 7f47427fc700 1 -- 172.21.15.36:0/2895487534 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f474c010030 con 0x7f4754140140 2022-01-10T01:32:27.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.911+0000 7f47427fc700 1 --2- 172.21.15.36:0/2895487534 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4734053560 0x7f4734055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:27.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.911+0000 7f47427fc700 1 -- 172.21.15.36:0/2895487534 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f474c06b6e0 con 0x7f4754140140 2022-01-10T01:32:27.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.911+0000 7f4759187700 1 --2- 172.21.15.36:0/2895487534 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4734053560 0x7f4734055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:27.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.911+0000 7f4759187700 1 --2- 172.21.15.36:0/2895487534 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4734053560 0x7f4734055a20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f475001a000 tx=0x7f4750014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:27.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:27.915+0000 7f47427fc700 1 -- 172.21.15.36:0/2895487534 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f474c0428c0 con 0x7f4754140140 2022-01-10T01:32:28.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.043+0000 7f475a189700 1 -- 172.21.15.36:0/2895487534 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f4754057350 con 0x7f4754140140 2022-01-10T01:32:28.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.463+0000 7f47427fc700 1 -- 172.21.15.36:0/2895487534 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v118) v1 ==== 125+0+0 (secure 0 0 0) 0x7f474c045ee0 con 0x7f4754140140 2022-01-10T01:32:28.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.467+0000 7f475a189700 1 -- 172.21.15.36:0/2895487534 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4734053560 msgr2=0x7f4734055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:28.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.467+0000 7f475a189700 1 --2- 172.21.15.36:0/2895487534 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4734053560 0x7f4734055a20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f475001a000 tx=0x7f4750014000).stop 2022-01-10T01:32:28.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.467+0000 7f475a189700 1 -- 172.21.15.36:0/2895487534 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4754140140 msgr2=0x7f4754155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:28.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.467+0000 7f475a189700 1 --2- 172.21.15.36:0/2895487534 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4754140140 0x7f4754155e60 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7f474c001250 tx=0x7f474c00c7d0).stop 2022-01-10T01:32:28.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.467+0000 7f475a189700 1 -- 172.21.15.36:0/2895487534 shutdown_connections 2022-01-10T01:32:28.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.467+0000 7f475a189700 1 --2- 172.21.15.36:0/2895487534 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4734053560 0x7f4734055a20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.467+0000 7f475a189700 1 --2- 172.21.15.36:0/2895487534 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4754140140 0x7f4754155e60 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.467+0000 7f475a189700 1 --2- 172.21.15.36:0/2895487534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47540b3040 0x7f4754155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.467+0000 7f475a189700 1 --2- 172.21.15.36:0/2895487534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47540a9c10 0x7f47540b42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.467+0000 7f475a189700 1 -- 172.21.15.36:0/2895487534 >> 172.21.15.36:0/2895487534 conn(0x7f47540636e0 msgr2=0x7f4754063ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:28.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.467+0000 7f475a189700 1 -- 172.21.15.36:0/2895487534 shutdown_connections 2022-01-10T01:32:28.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.467+0000 7f475a189700 1 -- 172.21.15.36:0/2895487534 wait complete. 2022-01-10T01:32:28.476 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' created 2022-01-10T01:32:28.485 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-10T01:32:28.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff85d2bd700 1 Processor -- start 2022-01-10T01:32:28.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff85d2bd700 1 -- start start 2022-01-10T01:32:28.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff85d2bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff858060100 0x7ff8580b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:28.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff85d2bd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8580b4c40 0x7ff85814b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:28.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff85d2bd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8580aabb0 con 0x7ff858067300 2022-01-10T01:32:28.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff85d2bd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8580604e0 con 0x7ff8580b4c40 2022-01-10T01:32:28.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff85d2bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff858066ea0 con 0x7ff858060100 2022-01-10T01:32:28.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff856ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff858060100 0x7ff8580b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:28.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff8577fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff8580b4c40 0x7ff85814b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:28.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff856ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff858060100 0x7ff8580b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:47018/0 (socket says 172.21.15.36:47018) 2022-01-10T01:32:28.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff856ffd700 1 -- 172.21.15.36:0/2078676603 learned_addr learned my addr 172.21.15.36:0/2078676603 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:28.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff856ffd700 1 -- 172.21.15.36:0/2078676603 >> v2:172.21.15.59:3300/0 conn(0x7ff8580b4c40 msgr2=0x7ff85814b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:28.596 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff856ffd700 1 --2- 172.21.15.36:0/2078676603 >> v2:172.21.15.59:3300/0 conn(0x7ff8580b4c40 0x7ff85814b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff856ffd700 1 -- 172.21.15.36:0/2078676603 >> v1:172.21.15.59:6789/0 conn(0x7ff858067300 legacy=0x7ff8581438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:28.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff856ffd700 1 -- 172.21.15.36:0/2078676603 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8580b33b0 con 0x7ff858060100 2022-01-10T01:32:28.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff8577fe700 1 --2- 172.21.15.36:0/2078676603 >> v2:172.21.15.59:3300/0 conn(0x7ff8580b4c40 0x7ff85814b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:28.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.587+0000 7ff856ffd700 1 --2- 172.21.15.36:0/2078676603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff858060100 0x7ff8580b4750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7ff848002f70 tx=0x7ff848006eb0).ready entity=mon.2 client_cookie=863295b4ad3cf8df server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:28.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.591+0000 7ff855ffb700 1 -- 172.21.15.36:0/2078676603 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff84800d570 con 0x7ff858060100 2022-01-10T01:32:28.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.591+0000 7ff855ffb700 1 -- 172.21.15.36:0/2078676603 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff848000e90 con 0x7ff858060100 2022-01-10T01:32:28.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.591+0000 7ff855ffb700 1 -- 172.21.15.36:0/2078676603 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff84800d900 con 0x7ff858060100 2022-01-10T01:32:28.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.591+0000 7ff85d2bd700 1 -- 172.21.15.36:0/2078676603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff858060100 msgr2=0x7ff8580b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:28.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.591+0000 7ff85d2bd700 1 --2- 172.21.15.36:0/2078676603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff858060100 0x7ff8580b4750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7ff848002f70 tx=0x7ff848006eb0).stop 2022-01-10T01:32:28.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.591+0000 7ff85d2bd700 1 -- 172.21.15.36:0/2078676603 shutdown_connections 2022-01-10T01:32:28.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.591+0000 7ff85d2bd700 1 --2- 172.21.15.36:0/2078676603 >> v2:172.21.15.59:3300/0 conn(0x7ff8580b4c40 0x7ff85814b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.591+0000 7ff85d2bd700 1 --2- 172.21.15.36:0/2078676603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff858060100 0x7ff8580b4750 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.591+0000 7ff85d2bd700 1 -- 172.21.15.36:0/2078676603 >> 172.21.15.36:0/2078676603 conn(0x7ff85805cf30 msgr2=0x7ff85805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:28.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.591+0000 7ff85d2bd700 1 -- 172.21.15.36:0/2078676603 shutdown_connections 2022-01-10T01:32:28.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.591+0000 7ff85d2bd700 1 -- 172.21.15.36:0/2078676603 wait complete. 2022-01-10T01:32:28.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.591+0000 7ff85d2bd700 1 Processor -- start 2022-01-10T01:32:28.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.591+0000 7ff85d2bd700 1 -- start start 2022-01-10T01:32:28.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff85d2bd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff858060100 0x7ff8580b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:28.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff85d2bd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff858067300 0x7ff85809ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:28.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff85d2bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8580b4c40 0x7ff858142480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:28.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff85d2bd700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580a16f0 con 0x7ff858067300 2022-01-10T01:32:28.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff85d2bd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85809e8b0 con 0x7ff858060100 2022-01-10T01:32:28.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff85d2bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8580ad080 con 0x7ff8580b4c40 2022-01-10T01:32:28.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff8567fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff858067300 0x7ff85809ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:28.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff8567fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff858067300 0x7ff85809ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40744/0 (socket says 172.21.15.36:40744) 2022-01-10T01:32:28.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff8567fc700 1 -- 172.21.15.36:0/3946820542 learned_addr learned my addr 172.21.15.36:0/3946820542 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:28.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff8577fe700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8580b4c40 0x7ff858142480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:28.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff856ffd700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff858060100 0x7ff8580b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:28.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff8567fc700 1 -- 172.21.15.36:0/3946820542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8580b4c40 msgr2=0x7ff858142480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:28.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff8567fc700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8580b4c40 0x7ff858142480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff8567fc700 1 -- 172.21.15.36:0/3946820542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff858060100 msgr2=0x7ff8580b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:28.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff8567fc700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff858060100 0x7ff8580b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff8567fc700 1 -- 172.21.15.36:0/3946820542 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff850009470 con 0x7ff858067300 2022-01-10T01:32:28.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff856ffd700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff858060100 0x7ff8580b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:28.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff8567fc700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff858067300 0x7ff85809ef80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7ff8580671e0 tx=0x7ff84c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:28.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff847fff700 1 -- 172.21.15.36:0/3946820542 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff84c012400 con 0x7ff858067300 2022-01-10T01:32:28.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff847fff700 1 -- 172.21.15.36:0/3946820542 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c012560 con 0x7ff858067300 2022-01-10T01:32:28.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff85d2bd700 1 -- 172.21.15.36:0/3946820542 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84800b1e0 con 0x7ff858067300 2022-01-10T01:32:28.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff847fff700 1 -- 172.21.15.36:0/3946820542 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff84c0128c0 con 0x7ff858067300 2022-01-10T01:32:28.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff85d2bd700 1 -- 172.21.15.36:0/3946820542 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8580acd70 con 0x7ff858067300 2022-01-10T01:32:28.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.595+0000 7ff85d2bd700 1 -- 172.21.15.36:0/3946820542 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff858057350 con 0x7ff858067300 2022-01-10T01:32:28.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.599+0000 7ff847fff700 1 -- 172.21.15.36:0/3946820542 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff84c019030 con 0x7ff858067300 2022-01-10T01:32:28.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.599+0000 7ff847fff700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff8340535f0 0x7ff834055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:28.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.599+0000 7ff847fff700 1 -- 172.21.15.36:0/3946820542 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6304+0+0 (secure 0 0 0) 0x7ff84c06ada0 con 0x7ff858067300 2022-01-10T01:32:28.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.599+0000 7ff856ffd700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff8340535f0 0x7ff834055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:28.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.599+0000 7ff856ffd700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff8340535f0 0x7ff834055ab0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7ff84801c000 tx=0x7ff848015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:28.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.603+0000 7ff847fff700 1 -- 172.21.15.36:0/3946820542 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff84c041d30 con 0x7ff858067300 2022-01-10T01:32:28.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.771+0000 7ff85d2bd700 1 -- 172.21.15.36:0/3946820542 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7ff8580698e0 con 0x7ff858067300 2022-01-10T01:32:28.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.783+0000 7ff847fff700 1 -- 172.21.15.36:0/3946820542 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 21 and data pool 22 v55) v1 ==== 189+0+0 (secure 0 0 0) 0x7ff84c045350 con 0x7ff858067300 2022-01-10T01:32:28.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.787+0000 7ff85d2bd700 1 -- 172.21.15.36:0/3946820542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff8340535f0 msgr2=0x7ff834055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:28.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.787+0000 7ff85d2bd700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff8340535f0 0x7ff834055ab0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7ff84801c000 tx=0x7ff848015000).stop 2022-01-10T01:32:28.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.787+0000 7ff85d2bd700 1 -- 172.21.15.36:0/3946820542 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff858067300 msgr2=0x7ff85809ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:28.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.787+0000 7ff85d2bd700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff858067300 0x7ff85809ef80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7ff8580671e0 tx=0x7ff84c007c50).stop 2022-01-10T01:32:28.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.787+0000 7ff85d2bd700 1 -- 172.21.15.36:0/3946820542 shutdown_connections 2022-01-10T01:32:28.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.787+0000 7ff85d2bd700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff8340535f0 0x7ff834055ab0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.787+0000 7ff85d2bd700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8580b4c40 0x7ff858142480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.787+0000 7ff85d2bd700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff858067300 0x7ff85809ef80 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.787+0000 7ff85d2bd700 1 --2- 172.21.15.36:0/3946820542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff858060100 0x7ff8580b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.787+0000 7ff85d2bd700 1 -- 172.21.15.36:0/3946820542 >> 172.21.15.36:0/3946820542 conn(0x7ff85805cf30 msgr2=0x7ff858143f20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:28.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.787+0000 7ff85d2bd700 1 -- 172.21.15.36:0/3946820542 shutdown_connections 2022-01-10T01:32:28.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.787+0000 7ff85d2bd700 1 -- 172.21.15.36:0/3946820542 wait complete. 2022-01-10T01:32:28.794 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 21 and data pool 22 2022-01-10T01:32:28.806 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:32:28.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f907ab83700 1 Processor -- start 2022-01-10T01:32:28.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f907ab83700 1 -- start start 2022-01-10T01:32:28.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f907ab83700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90740b3550 0x7f9074067110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:28.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f907ab83700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9074066500 con 0x7f9074064980 2022-01-10T01:32:28.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f907ab83700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90740b46c0 con 0x7f9074144ce0 2022-01-10T01:32:28.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f907ab83700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90740b3ea0 con 0x7f90740b3550 2022-01-10T01:32:28.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f9079b81700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9074064980 0x7f9074066a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38552/0 (socket says 172.21.15.36:38552) 2022-01-10T01:32:28.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f9079b81700 1 -- 172.21.15.36:0/3171990605 learned_addr learned my addr 172.21.15.36:0/3171990605 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:28.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f9079380700 1 --2- 172.21.15.36:0/3171990605 >> v2:172.21.15.59:3300/0 conn(0x7f90740b3550 0x7f9074067110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:28.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f9078b7f700 1 -- 172.21.15.36:0/3171990605 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982090212 0 0) 0x7f9074066500 con 0x7f9074064980 2022-01-10T01:32:28.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f9078b7f700 1 -- 172.21.15.36:0/3171990605 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9060003260 con 0x7f9074064980 2022-01-10T01:32:28.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f9079380700 1 -- 172.21.15.36:0/3171990605 >> v1:172.21.15.59:6789/0 conn(0x7f9074144ce0 legacy=0x7f9074141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:28.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f9079380700 1 -- 172.21.15.36:0/3171990605 >> v1:172.21.15.36:6789/0 conn(0x7f9074064980 legacy=0x7f9074066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:28.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f9079380700 1 -- 172.21.15.36:0/3171990605 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9074064d60 con 0x7f90740b3550 2022-01-10T01:32:28.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f9079380700 1 --2- 172.21.15.36:0/3171990605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90740b3550 0x7f9074067110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f9064002f70 tx=0x7f9064006df0).ready entity=mon.1 client_cookie=1f3e7a5980ab8c12 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:28.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f9078b7f700 1 -- 172.21.15.36:0/3171990605 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f906400d5c0 con 0x7f90740b3550 2022-01-10T01:32:28.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f9078b7f700 1 -- 172.21.15.36:0/3171990605 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9064000e90 con 0x7f90740b3550 2022-01-10T01:32:28.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.895+0000 7f9078b7f700 1 -- 172.21.15.36:0/3171990605 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f906400d910 con 0x7f90740b3550 2022-01-10T01:32:28.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 -- 172.21.15.36:0/3171990605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90740b3550 msgr2=0x7f9074067110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:28.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 --2- 172.21.15.36:0/3171990605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90740b3550 0x7f9074067110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f9064002f70 tx=0x7f9064006df0).stop 2022-01-10T01:32:28.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 -- 172.21.15.36:0/3171990605 shutdown_connections 2022-01-10T01:32:28.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 --2- 172.21.15.36:0/3171990605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90740b3550 0x7f9074067110 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 -- 172.21.15.36:0/3171990605 >> 172.21.15.36:0/3171990605 conn(0x7f907405f6b0 msgr2=0x7f907405fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:28.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 -- 172.21.15.36:0/3171990605 shutdown_connections 2022-01-10T01:32:28.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 -- 172.21.15.36:0/3171990605 wait complete. 2022-01-10T01:32:28.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 Processor -- start 2022-01-10T01:32:28.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 -- start start 2022-01-10T01:32:28.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9074064980 0x7f90740b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:28.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90740b3550 0x7f907413c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:28.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9074144ce0 0x7f907413c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:28.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740b5810 con 0x7f90740b3550 2022-01-10T01:32:28.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907413bfb0 con 0x7f9074144ce0 2022-01-10T01:32:28.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907ab83700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90740b52d0 con 0x7f9074064980 2022-01-10T01:32:28.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f9079380700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90740b3550 0x7f907413c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:28.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f9079380700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90740b3550 0x7f907413c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40764/0 (socket says 172.21.15.36:40764) 2022-01-10T01:32:28.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f9079380700 1 -- 172.21.15.36:0/3772191488 learned_addr learned my addr 172.21.15.36:0/3772191488 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:28.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f9079b81700 1 --2- 172.21.15.36:0/3772191488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9074064980 0x7f90740b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:28.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f907a382700 1 --2- 172.21.15.36:0/3772191488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9074144ce0 0x7f907413c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:28.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f9079380700 1 -- 172.21.15.36:0/3772191488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9074064980 msgr2=0x7f90740b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:28.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f9079380700 1 --2- 172.21.15.36:0/3772191488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9074064980 0x7f90740b65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f9079380700 1 -- 172.21.15.36:0/3772191488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9074144ce0 msgr2=0x7f907413c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:28.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f9079380700 1 --2- 172.21.15.36:0/3772191488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9074144ce0 0x7f907413c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:28.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.899+0000 7f9079380700 1 -- 172.21.15.36:0/3772191488 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906400b180 con 0x7f90740b3550 2022-01-10T01:32:28.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.903+0000 7f9079380700 1 --2- 172.21.15.36:0/3772191488 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90740b3550 0x7f907413c410 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f9064002f70 tx=0x7f9064014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:28.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.903+0000 7f9072ffd700 1 -- 172.21.15.36:0/3772191488 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9064016070 con 0x7f90740b3550 2022-01-10T01:32:28.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.903+0000 7f9072ffd700 1 -- 172.21.15.36:0/3772191488 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906400de40 con 0x7f90740b3550 2022-01-10T01:32:28.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.903+0000 7f907ab83700 1 -- 172.21.15.36:0/3772191488 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90740b5570 con 0x7f90740b3550 2022-01-10T01:32:28.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.903+0000 7f9072ffd700 1 -- 172.21.15.36:0/3772191488 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9064013da0 con 0x7f90740b3550 2022-01-10T01:32:28.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.903+0000 7f907ab83700 1 -- 172.21.15.36:0/3772191488 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90741401f0 con 0x7f90740b3550 2022-01-10T01:32:28.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.903+0000 7f907ab83700 1 -- 172.21.15.36:0/3772191488 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9074057350 con 0x7f90740b3550 2022-01-10T01:32:28.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.903+0000 7f9072ffd700 1 -- 172.21.15.36:0/3772191488 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9064025030 con 0x7f90740b3550 2022-01-10T01:32:28.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.903+0000 7f9072ffd700 1 --2- 172.21.15.36:0/3772191488 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9054053590 0x7f9054055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:28.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.903+0000 7f9079b81700 1 --2- 172.21.15.36:0/3772191488 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9054053590 0x7f9054055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:28.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.903+0000 7f9072ffd700 1 -- 172.21.15.36:0/3772191488 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f906406c970 con 0x7f90740b3550 2022-01-10T01:32:28.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.903+0000 7f9079b81700 1 --2- 172.21.15.36:0/3772191488 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9054053590 0x7f9054055a50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f906800d000 tx=0x7f9068009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:28.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:28.911+0000 7f9072ffd700 1 -- 172.21.15.36:0/3772191488 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9064043870 con 0x7f90740b3550 2022-01-10T01:32:29.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.035+0000 7f907ab83700 1 -- 172.21.15.36:0/3772191488 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9074069c00 con 0x7f90740b3550 2022-01-10T01:32:29.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.035+0000 7f9072ffd700 1 -- 172.21.15.36:0/3772191488 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f9064023020 con 0x7f90740b3550 2022-01-10T01:32:29.040 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:29.040 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":119,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:32:28.773775+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:32:27.171024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2022-01-10T01:32:28.099192+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:32:29.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.039+0000 7f907ab83700 1 -- 172.21.15.36:0/3772191488 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9054053590 msgr2=0x7f9054055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.039+0000 7f907ab83700 1 --2- 172.21.15.36:0/3772191488 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9054053590 0x7f9054055a50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f906800d000 tx=0x7f9068009040).stop 2022-01-10T01:32:29.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.039+0000 7f907ab83700 1 -- 172.21.15.36:0/3772191488 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90740b3550 msgr2=0x7f907413c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.039+0000 7f907ab83700 1 --2- 172.21.15.36:0/3772191488 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90740b3550 0x7f907413c410 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f9064002f70 tx=0x7f9064014000).stop 2022-01-10T01:32:29.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.039+0000 7f907ab83700 1 -- 172.21.15.36:0/3772191488 shutdown_connections 2022-01-10T01:32:29.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.039+0000 7f907ab83700 1 --2- 172.21.15.36:0/3772191488 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9054053590 0x7f9054055a50 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.039+0000 7f907ab83700 1 --2- 172.21.15.36:0/3772191488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9074144ce0 0x7f907413c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.039+0000 7f907ab83700 1 --2- 172.21.15.36:0/3772191488 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90740b3550 0x7f907413c410 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.039+0000 7f907ab83700 1 --2- 172.21.15.36:0/3772191488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9074064980 0x7f90740b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.039+0000 7f907ab83700 1 -- 172.21.15.36:0/3772191488 >> 172.21.15.36:0/3772191488 conn(0x7f907405f6b0 msgr2=0x7f9074141050 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:29.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.039+0000 7f907ab83700 1 -- 172.21.15.36:0/3772191488 shutdown_connections 2022-01-10T01:32:29.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.039+0000 7f907ab83700 1 -- 172.21.15.36:0/3772191488 wait complete. 2022-01-10T01:32:29.054 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:32:29.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f1a2b5700 1 Processor -- start 2022-01-10T01:32:29.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f1a2b5700 1 -- start start 2022-01-10T01:32:29.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f1a2b5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3f141483a0 0x7f3f140b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f1a2b5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f140a70c0 0x7f3f14144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f1a2b5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f140b0350 con 0x7f3f140b1db0 2022-01-10T01:32:29.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f1a2b5700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f140a90c0 con 0x7f3f141483a0 2022-01-10T01:32:29.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f1a2b5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f140b05f0 con 0x7f3f140a70c0 2022-01-10T01:32:29.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f137fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3f141483a0 0x7f3f140b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f137fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3f141483a0 0x7f3f140b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40772/0 (socket says 172.21.15.36:40772) 2022-01-10T01:32:29.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f137fe700 1 -- 172.21.15.36:0/1670742985 learned_addr learned my addr 172.21.15.36:0/1670742985 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:29.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f18852700 1 --2- 172.21.15.36:0/1670742985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f140a70c0 0x7f3f14144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f137fe700 1 -- 172.21.15.36:0/1670742985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f140a70c0 msgr2=0x7f3f14144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:29.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f137fe700 1 --2- 172.21.15.36:0/1670742985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f140a70c0 0x7f3f14144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f12ffd700 1 -- 172.21.15.36:0/1670742985 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334463088 0 0) 0x7f3f140b0350 con 0x7f3f140b1db0 2022-01-10T01:32:29.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f137fe700 1 -- 172.21.15.36:0/1670742985 >> v1:172.21.15.59:6789/0 conn(0x7f3f140b1db0 legacy=0x7f3f140b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f137fe700 1 -- 172.21.15.36:0/1670742985 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f140b0890 con 0x7f3f141483a0 2022-01-10T01:32:29.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f18852700 1 --2- 172.21.15.36:0/1670742985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f140a70c0 0x7f3f14144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:29.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.151+0000 7f3f137fe700 1 --2- 172.21.15.36:0/1670742985 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f141483a0 0x7f3f140b0fd0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f3f14147730 tx=0x7f3efc006eb0).ready entity=mon.0 client_cookie=614af93f7d3936e6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:29.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.155+0000 7f3f12ffd700 1 -- 172.21.15.36:0/1670742985 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3efc00d5c0 con 0x7f3f141483a0 2022-01-10T01:32:29.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.155+0000 7f3f12ffd700 1 -- 172.21.15.36:0/1670742985 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc000e90 con 0x7f3f141483a0 2022-01-10T01:32:29.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.155+0000 7f3f12ffd700 1 -- 172.21.15.36:0/1670742985 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3efc00d910 con 0x7f3f141483a0 2022-01-10T01:32:29.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.155+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/1670742985 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f141483a0 msgr2=0x7f3f140b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.155+0000 7f3f1a2b5700 1 --2- 172.21.15.36:0/1670742985 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f141483a0 0x7f3f140b0fd0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f3f14147730 tx=0x7f3efc006eb0).stop 2022-01-10T01:32:29.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.155+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/1670742985 shutdown_connections 2022-01-10T01:32:29.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.155+0000 7f3f1a2b5700 1 --2- 172.21.15.36:0/1670742985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f140a70c0 0x7f3f14144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.155+0000 7f3f1a2b5700 1 --2- 172.21.15.36:0/1670742985 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f141483a0 0x7f3f140b0fd0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.155+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/1670742985 >> 172.21.15.36:0/1670742985 conn(0x7f3f1405f6b0 msgr2=0x7f3f1405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:29.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.155+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/1670742985 shutdown_connections 2022-01-10T01:32:29.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.155+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/1670742985 wait complete. 2022-01-10T01:32:29.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f1a2b5700 1 Processor -- start 2022-01-10T01:32:29.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f1a2b5700 1 -- start start 2022-01-10T01:32:29.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f1a2b5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f140a70c0 0x7f3f140ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f1a2b5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f140b1db0 0x7f3f1414b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f1a2b5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f141483a0 0x7f3f14143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f1a2b5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1414a840 con 0x7f3f140a70c0 2022-01-10T01:32:29.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f1a2b5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1414a140 con 0x7f3f140b1db0 2022-01-10T01:32:29.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f1a2b5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f140a9ae0 con 0x7f3f141483a0 2022-01-10T01:32:29.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f13fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f140a70c0 0x7f3f140ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f13fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f140a70c0 0x7f3f140ae170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40776/0 (socket says 172.21.15.36:40776) 2022-01-10T01:32:29.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f13fff700 1 -- 172.21.15.36:0/3667880509 learned_addr learned my addr 172.21.15.36:0/3667880509 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:29.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f18852700 1 --2- 172.21.15.36:0/3667880509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f141483a0 0x7f3f14143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f137fe700 1 --2- 172.21.15.36:0/3667880509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f140b1db0 0x7f3f1414b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f13fff700 1 -- 172.21.15.36:0/3667880509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f141483a0 msgr2=0x7f3f14143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f13fff700 1 --2- 172.21.15.36:0/3667880509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f141483a0 0x7f3f14143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f13fff700 1 -- 172.21.15.36:0/3667880509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f140b1db0 msgr2=0x7f3f1414b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f13fff700 1 --2- 172.21.15.36:0/3667880509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f140b1db0 0x7f3f1414b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f13fff700 1 -- 172.21.15.36:0/3667880509 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0400b180 con 0x7f3f140a70c0 2022-01-10T01:32:29.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f13fff700 1 --2- 172.21.15.36:0/3667880509 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f140a70c0 0x7f3f140ae170 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f3f140a9c70 tx=0x7f3f0c007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:29.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f117fa700 1 -- 172.21.15.36:0/3667880509 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f0c00e4a0 con 0x7f3f140a70c0 2022-01-10T01:32:29.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f117fa700 1 -- 172.21.15.36:0/3667880509 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c00e600 con 0x7f3f140a70c0 2022-01-10T01:32:29.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f117fa700 1 -- 172.21.15.36:0/3667880509 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f0c00e960 con 0x7f3f140a70c0 2022-01-10T01:32:29.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/3667880509 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc00b1e0 con 0x7f3f140a70c0 2022-01-10T01:32:29.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.159+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/3667880509 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1414a3a0 con 0x7f3f140a70c0 2022-01-10T01:32:29.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.163+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/3667880509 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f14057350 con 0x7f3f140a70c0 2022-01-10T01:32:29.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.163+0000 7f3f117fa700 1 -- 172.21.15.36:0/3667880509 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3f0c019030 con 0x7f3f140a70c0 2022-01-10T01:32:29.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.163+0000 7f3f117fa700 1 --2- 172.21.15.36:0/3667880509 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ef80535f0 0x7f3ef8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.163+0000 7f3f117fa700 1 -- 172.21.15.36:0/3667880509 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3f0c06b550 con 0x7f3f140a70c0 2022-01-10T01:32:29.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.163+0000 7f3f137fe700 1 --2- 172.21.15.36:0/3667880509 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ef80535f0 0x7f3ef8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.163+0000 7f3f137fe700 1 --2- 172.21.15.36:0/3667880509 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ef80535f0 0x7f3ef8055ab0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f3efc01b000 tx=0x7f3efc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:29.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.167+0000 7f3f117fa700 1 -- 172.21.15.36:0/3667880509 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3f0c042450 con 0x7f3f140a70c0 2022-01-10T01:32:29.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.291+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/3667880509 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f14044650 con 0x7f3f140a70c0 2022-01-10T01:32:29.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.295+0000 7f3f117fa700 1 -- 172.21.15.36:0/3667880509 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f3f0c045a70 con 0x7f3f140a70c0 2022-01-10T01:32:29.298 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:29.298 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":119,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:32:28.773775+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:32:27.171024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2022-01-10T01:32:28.099192+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:32:29.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.295+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/3667880509 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ef80535f0 msgr2=0x7f3ef8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.295+0000 7f3f1a2b5700 1 --2- 172.21.15.36:0/3667880509 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ef80535f0 0x7f3ef8055ab0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f3efc01b000 tx=0x7f3efc015000).stop 2022-01-10T01:32:29.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.295+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/3667880509 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f140a70c0 msgr2=0x7f3f140ae170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.295+0000 7f3f1a2b5700 1 --2- 172.21.15.36:0/3667880509 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f140a70c0 0x7f3f140ae170 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f3f140a9c70 tx=0x7f3f0c007e40).stop 2022-01-10T01:32:29.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.295+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/3667880509 shutdown_connections 2022-01-10T01:32:29.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.295+0000 7f3f1a2b5700 1 --2- 172.21.15.36:0/3667880509 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3ef80535f0 0x7f3ef8055ab0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.295+0000 7f3f1a2b5700 1 --2- 172.21.15.36:0/3667880509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f141483a0 0x7f3f14143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.295+0000 7f3f1a2b5700 1 --2- 172.21.15.36:0/3667880509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f140b1db0 0x7f3f1414b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.295+0000 7f3f1a2b5700 1 --2- 172.21.15.36:0/3667880509 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3f140a70c0 0x7f3f140ae170 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.295+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/3667880509 >> 172.21.15.36:0/3667880509 conn(0x7f3f1405f6b0 msgr2=0x7f3f140b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:29.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.295+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/3667880509 shutdown_connections 2022-01-10T01:32:29.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.295+0000 7f3f1a2b5700 1 -- 172.21.15.36:0/3667880509 wait complete. 2022-01-10T01:32:29.312 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-01-10T01:32:29.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f0037fff700 1 Processor -- start 2022-01-10T01:32:29.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f0037fff700 1 -- start start 2022-01-10T01:32:29.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f0037fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b0010 0x7f00380a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f0037fff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00380a70c0 con 0x7f00380b2580 2022-01-10T01:32:29.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f0037fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00380a72f0 con 0x7f00380afbd0 2022-01-10T01:32:29.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f0037fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00380a7590 con 0x7f00380b0010 2022-01-10T01:32:29.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f0036ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f00380b2580 0x7f003814ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38578/0 (socket says 172.21.15.36:38578) 2022-01-10T01:32:29.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f0036ffd700 1 -- 172.21.15.36:0/1221942819 learned_addr learned my addr 172.21.15.36:0/1221942819 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:29.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f002e7fc700 1 --2- 172.21.15.36:0/1221942819 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b0010 0x7f00380a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f00367fc700 1 -- 172.21.15.36:0/1221942819 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312624969 0 0) 0x7f00380a70c0 con 0x7f00380b2580 2022-01-10T01:32:29.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f00367fc700 1 -- 172.21.15.36:0/1221942819 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0018003260 con 0x7f00380b2580 2022-01-10T01:32:29.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f00367fc700 1 -- 172.21.15.36:0/1221942819 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069849855 0 0) 0x7f00380a72f0 con 0x7f00380afbd0 2022-01-10T01:32:29.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f00367fc700 1 -- 172.21.15.36:0/1221942819 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00380a70c0 con 0x7f00380afbd0 2022-01-10T01:32:29.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f002e7fc700 1 -- 172.21.15.36:0/1221942819 >> v1:172.21.15.59:6789/0 conn(0x7f00380afbd0 legacy=0x7f0038151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f002e7fc700 1 -- 172.21.15.36:0/1221942819 >> v1:172.21.15.36:6789/0 conn(0x7f00380b2580 legacy=0x7f003814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f002e7fc700 1 -- 172.21.15.36:0/1221942819 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00380a7830 con 0x7f00380b0010 2022-01-10T01:32:29.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.423+0000 7f002e7fc700 1 --2- 172.21.15.36:0/1221942819 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b0010 0x7f00380a83b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f0020002f70 tx=0x7f0020006df0).ready entity=mon.2 client_cookie=79c17dfab567a0b1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:29.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.427+0000 7f00367fc700 1 -- 172.21.15.36:0/1221942819 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f002000d5c0 con 0x7f00380b0010 2022-01-10T01:32:29.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.427+0000 7f00367fc700 1 -- 172.21.15.36:0/1221942819 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0020000e90 con 0x7f00380b0010 2022-01-10T01:32:29.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.427+0000 7f00367fc700 1 -- 172.21.15.36:0/1221942819 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f002000d910 con 0x7f00380b0010 2022-01-10T01:32:29.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.427+0000 7f0037fff700 1 -- 172.21.15.36:0/1221942819 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b0010 msgr2=0x7f00380a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.427+0000 7f0037fff700 1 --2- 172.21.15.36:0/1221942819 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b0010 0x7f00380a83b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f0020002f70 tx=0x7f0020006df0).stop 2022-01-10T01:32:29.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.427+0000 7f0037fff700 1 -- 172.21.15.36:0/1221942819 shutdown_connections 2022-01-10T01:32:29.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.427+0000 7f0037fff700 1 --2- 172.21.15.36:0/1221942819 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b0010 0x7f00380a83b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.427+0000 7f0037fff700 1 -- 172.21.15.36:0/1221942819 >> 172.21.15.36:0/1221942819 conn(0x7f0038060180 msgr2=0x7f00380b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:29.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.427+0000 7f0037fff700 1 -- 172.21.15.36:0/1221942819 shutdown_connections 2022-01-10T01:32:29.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.427+0000 7f0037fff700 1 -- 172.21.15.36:0/1221942819 wait complete. 2022-01-10T01:32:29.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f0037fff700 1 Processor -- start 2022-01-10T01:32:29.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f0037fff700 1 -- start start 2022-01-10T01:32:29.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f0037fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380afbd0 0x7f00380ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f0037fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00380b0010 0x7f00380abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f0037fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00380b2580 0x7f00380abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f0037fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00380a92c0 con 0x7f00380b2580 2022-01-10T01:32:29.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f0037fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00380a9560 con 0x7f00380b0010 2022-01-10T01:32:29.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f0037fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003815a830 con 0x7f00380afbd0 2022-01-10T01:32:29.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f00377fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00380b2580 0x7f00380abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f00377fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00380b2580 0x7f00380abff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40794/0 (socket says 172.21.15.36:40794) 2022-01-10T01:32:29.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f00377fe700 1 -- 172.21.15.36:0/2454023250 learned_addr learned my addr 172.21.15.36:0/2454023250 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:29.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f002e7fc700 1 --2- 172.21.15.36:0/2454023250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00380b0010 0x7f00380abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f0036ffd700 1 --2- 172.21.15.36:0/2454023250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380afbd0 0x7f00380ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f00377fe700 1 -- 172.21.15.36:0/2454023250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380afbd0 msgr2=0x7f00380ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f00377fe700 1 --2- 172.21.15.36:0/2454023250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380afbd0 0x7f00380ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f00377fe700 1 -- 172.21.15.36:0/2454023250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00380b0010 msgr2=0x7f00380abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f00377fe700 1 --2- 172.21.15.36:0/2454023250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00380b0010 0x7f00380abb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f00377fe700 1 -- 172.21.15.36:0/2454023250 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002000b180 con 0x7f00380b2580 2022-01-10T01:32:29.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f00377fe700 1 --2- 172.21.15.36:0/2454023250 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00380b2580 0x7f00380abff0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f0030001490 tx=0x7f0030007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:29.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f0034ff9700 1 -- 172.21.15.36:0/2454023250 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0030002310 con 0x7f00380b2580 2022-01-10T01:32:29.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f0034ff9700 1 -- 172.21.15.36:0/2454023250 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0030002470 con 0x7f00380b2580 2022-01-10T01:32:29.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f0037fff700 1 -- 172.21.15.36:0/2454023250 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00380b3420 con 0x7f00380b2580 2022-01-10T01:32:29.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f0034ff9700 1 -- 172.21.15.36:0/2454023250 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0030001840 con 0x7f00380b2580 2022-01-10T01:32:29.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.431+0000 7f0037fff700 1 -- 172.21.15.36:0/2454023250 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003815a290 con 0x7f00380b2580 2022-01-10T01:32:29.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.435+0000 7f0037fff700 1 -- 172.21.15.36:0/2454023250 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0038057350 con 0x7f00380b2580 2022-01-10T01:32:29.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.435+0000 7f0034ff9700 1 -- 172.21.15.36:0/2454023250 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0030010030 con 0x7f00380b2580 2022-01-10T01:32:29.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.435+0000 7f0034ff9700 1 --2- 172.21.15.36:0/2454023250 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f001c053560 0x7f001c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.435+0000 7f0034ff9700 1 -- 172.21.15.36:0/2454023250 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f003006b970 con 0x7f00380b2580 2022-01-10T01:32:29.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.435+0000 7f0036ffd700 1 --2- 172.21.15.36:0/2454023250 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f001c053560 0x7f001c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.435+0000 7f0036ffd700 1 --2- 172.21.15.36:0/2454023250 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f001c053560 0x7f001c055a20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f002800d000 tx=0x7f0028009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:29.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.439+0000 7f0034ff9700 1 -- 172.21.15.36:0/2454023250 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0030042920 con 0x7f00380b2580 2022-01-10T01:32:29.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.607+0000 7f0037fff700 1 -- 172.21.15.36:0/2454023250 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f003815a4e0 con 0x7f00380b2580 2022-01-10T01:32:29.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.803+0000 7f0034ff9700 1 -- 172.21.15.36:0/2454023250 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v56) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0030045f40 con 0x7f00380b2580 2022-01-10T01:32:29.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.803+0000 7f0037fff700 1 -- 172.21.15.36:0/2454023250 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f001c053560 msgr2=0x7f001c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.803+0000 7f0037fff700 1 --2- 172.21.15.36:0/2454023250 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f001c053560 0x7f001c055a20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f002800d000 tx=0x7f0028009040).stop 2022-01-10T01:32:29.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.803+0000 7f0037fff700 1 -- 172.21.15.36:0/2454023250 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00380b2580 msgr2=0x7f00380abff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.803+0000 7f0037fff700 1 --2- 172.21.15.36:0/2454023250 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00380b2580 0x7f00380abff0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f0030001490 tx=0x7f0030007d90).stop 2022-01-10T01:32:29.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.803+0000 7f0037fff700 1 -- 172.21.15.36:0/2454023250 shutdown_connections 2022-01-10T01:32:29.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.803+0000 7f0037fff700 1 --2- 172.21.15.36:0/2454023250 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f001c053560 0x7f001c055a20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.803+0000 7f0037fff700 1 --2- 172.21.15.36:0/2454023250 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00380b2580 0x7f00380abff0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.803+0000 7f0037fff700 1 --2- 172.21.15.36:0/2454023250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00380b0010 0x7f00380abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.803+0000 7f0037fff700 1 --2- 172.21.15.36:0/2454023250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380afbd0 0x7f00380ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.803+0000 7f0037fff700 1 -- 172.21.15.36:0/2454023250 >> 172.21.15.36:0/2454023250 conn(0x7f0038060180 msgr2=0x7f00381486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:29.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.803+0000 7f0037fff700 1 -- 172.21.15.36:0/2454023250 shutdown_connections 2022-01-10T01:32:29.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.803+0000 7f0037fff700 1 -- 172.21.15.36:0/2454023250 wait complete. 2022-01-10T01:32:29.827 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:32:29.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48c1c58700 1 Processor -- start 2022-01-10T01:32:29.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48c1c58700 1 -- start start 2022-01-10T01:32:29.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48c1c58700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f48bc0b65c0 0x7f48bc0b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48c1c58700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48bc060d70 0x7f48bc1450c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48c1c58700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48bc0ac5f0 0x7f48bc141000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48c1c58700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48bc0aca80 con 0x7f48bc0b65c0 2022-01-10T01:32:29.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48c1c58700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48bc0acc90 con 0x7f48bc0ac5f0 2022-01-10T01:32:29.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48c1c58700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc0ae560 con 0x7f48bc060d70 2022-01-10T01:32:29.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48bb7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f48bc0b65c0 0x7f48bc0b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48bb7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f48bc0b65c0 0x7f48bc0b69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40798/0 (socket says 172.21.15.36:40798) 2022-01-10T01:32:29.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48bb7fe700 1 -- 172.21.15.36:0/2693035629 learned_addr learned my addr 172.21.15.36:0/2693035629 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:29.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48bbfff700 1 --2- 172.21.15.36:0/2693035629 >> v2:172.21.15.59:3300/0 conn(0x7f48bc0ac5f0 0x7f48bc141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48baffd700 1 --2- 172.21.15.36:0/2693035629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48bc060d70 0x7f48bc1450c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48bb7fe700 1 -- 172.21.15.36:0/2693035629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48bc060d70 msgr2=0x7f48bc1450c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:29.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48bb7fe700 1 --2- 172.21.15.36:0/2693035629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48bc060d70 0x7f48bc1450c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48bb7fe700 1 -- 172.21.15.36:0/2693035629 >> v2:172.21.15.59:3300/0 conn(0x7f48bc0ac5f0 msgr2=0x7f48bc141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:29.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48bb7fe700 1 --2- 172.21.15.36:0/2693035629 >> v2:172.21.15.59:3300/0 conn(0x7f48bc0ac5f0 0x7f48bc141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48bb7fe700 1 -- 172.21.15.36:0/2693035629 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc1446e0 con 0x7f48bc0b65c0 2022-01-10T01:32:29.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.931+0000 7f48bb7fe700 1 --2- 172.21.15.36:0/2693035629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48bc0b65c0 0x7f48bc0b69a0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f48bc0ad9e0 tx=0x7f48ac006eb0).ready entity=mon.0 client_cookie=39dbfa32ca9f2a64 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:29.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48ba7fc700 1 -- 172.21.15.36:0/2693035629 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48ac00e610 con 0x7f48bc0b65c0 2022-01-10T01:32:29.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48ba7fc700 1 -- 172.21.15.36:0/2693035629 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac000e90 con 0x7f48bc0b65c0 2022-01-10T01:32:29.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48ba7fc700 1 -- 172.21.15.36:0/2693035629 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48ac00e9a0 con 0x7f48bc0b65c0 2022-01-10T01:32:29.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 -- 172.21.15.36:0/2693035629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48bc0b65c0 msgr2=0x7f48bc0b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 --2- 172.21.15.36:0/2693035629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48bc0b65c0 0x7f48bc0b69a0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f48bc0ad9e0 tx=0x7f48ac006eb0).stop 2022-01-10T01:32:29.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 -- 172.21.15.36:0/2693035629 shutdown_connections 2022-01-10T01:32:29.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 --2- 172.21.15.36:0/2693035629 >> v2:172.21.15.59:3300/0 conn(0x7f48bc0ac5f0 0x7f48bc141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 --2- 172.21.15.36:0/2693035629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48bc060d70 0x7f48bc1450c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 --2- 172.21.15.36:0/2693035629 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48bc0b65c0 0x7f48bc0b69a0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 -- 172.21.15.36:0/2693035629 >> 172.21.15.36:0/2693035629 conn(0x7f48bc0b3480 msgr2=0x7f48bc0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:29.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 -- 172.21.15.36:0/2693035629 shutdown_connections 2022-01-10T01:32:29.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 -- 172.21.15.36:0/2693035629 wait complete. 2022-01-10T01:32:29.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 Processor -- start 2022-01-10T01:32:29.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 -- start start 2022-01-10T01:32:29.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48bc060d70 0x7f48bc0b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48bc0ac5f0 0x7f48bc14f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48bc0b65c0 0x7f48bc14fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc13bc90 con 0x7f48bc060d70 2022-01-10T01:32:29.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc156ab0 con 0x7f48bc0b65c0 2022-01-10T01:32:29.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48c1c58700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc155b90 con 0x7f48bc0ac5f0 2022-01-10T01:32:29.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48bb7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48bc060d70 0x7f48bc0b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48bb7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48bc060d70 0x7f48bc0b5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40804/0 (socket says 172.21.15.36:40804) 2022-01-10T01:32:29.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48bb7fe700 1 -- 172.21.15.36:0/3483300781 learned_addr learned my addr 172.21.15.36:0/3483300781 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:29.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48baffd700 1 --2- 172.21.15.36:0/3483300781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48bc0ac5f0 0x7f48bc14f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48bbfff700 1 --2- 172.21.15.36:0/3483300781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48bc0b65c0 0x7f48bc14fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48bb7fe700 1 -- 172.21.15.36:0/3483300781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48bc0ac5f0 msgr2=0x7f48bc14f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48bb7fe700 1 --2- 172.21.15.36:0/3483300781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48bc0ac5f0 0x7f48bc14f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48bb7fe700 1 -- 172.21.15.36:0/3483300781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48bc0b65c0 msgr2=0x7f48bc14fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:29.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48bb7fe700 1 --2- 172.21.15.36:0/3483300781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48bc0b65c0 0x7f48bc14fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:29.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.935+0000 7f48bb7fe700 1 -- 172.21.15.36:0/3483300781 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac00b1e0 con 0x7f48bc060d70 2022-01-10T01:32:29.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.939+0000 7f48bb7fe700 1 --2- 172.21.15.36:0/3483300781 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48bc060d70 0x7f48bc0b5820 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f48bc0ad9e0 tx=0x7f48ac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:29.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.939+0000 7f48b8ff9700 1 -- 172.21.15.36:0/3483300781 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48ac011860 con 0x7f48bc060d70 2022-01-10T01:32:29.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.939+0000 7f48b8ff9700 1 -- 172.21.15.36:0/3483300781 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ac0119c0 con 0x7f48bc060d70 2022-01-10T01:32:29.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.939+0000 7f48c1c58700 1 -- 172.21.15.36:0/3483300781 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48bc155e30 con 0x7f48bc060d70 2022-01-10T01:32:29.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.939+0000 7f48b8ff9700 1 -- 172.21.15.36:0/3483300781 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f48ac011d20 con 0x7f48bc060d70 2022-01-10T01:32:29.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.939+0000 7f48c1c58700 1 -- 172.21.15.36:0/3483300781 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48bc156370 con 0x7f48bc060d70 2022-01-10T01:32:29.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.939+0000 7f48c1c58700 1 -- 172.21.15.36:0/3483300781 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48bc1567b0 con 0x7f48bc060d70 2022-01-10T01:32:29.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.939+0000 7f48b8ff9700 1 -- 172.21.15.36:0/3483300781 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f48ac025030 con 0x7f48bc060d70 2022-01-10T01:32:29.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.939+0000 7f48b8ff9700 1 --2- 172.21.15.36:0/3483300781 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f489c0534d0 0x7f489c055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:29.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.939+0000 7f48b8ff9700 1 -- 172.21.15.36:0/3483300781 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f48ac06cdd0 con 0x7f48bc060d70 2022-01-10T01:32:29.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.939+0000 7f48baffd700 1 --2- 172.21.15.36:0/3483300781 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f489c0534d0 0x7f489c055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:29.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.943+0000 7f48baffd700 1 --2- 172.21.15.36:0/3483300781 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f489c0534d0 0x7f489c055990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f48b000b000 tx=0x7f48b0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:29.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:29.947+0000 7f48b8ff9700 1 -- 172.21.15.36:0/3483300781 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f48ac043de0 con 0x7f48bc060d70 2022-01-10T01:32:30.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.111+0000 7f48c1c58700 1 -- 172.21.15.36:0/3483300781 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48bc144980 con 0x7f48bc060d70 2022-01-10T01:32:30.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.111+0000 7f48b8ff9700 1 -- 172.21.15.36:0/3483300781 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f48ac023020 con 0x7f48bc060d70 2022-01-10T01:32:30.115 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:30.115 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":56,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7590,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/2655140224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":2655140224},{"type":"v1","addr":"172.21.15.36:6837","nonce":2655140224}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":54},{"gid":7597,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/772662757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":772662757},{"type":"v1","addr":"172.21.15.59:6833","nonce":772662757}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:32:28.774139+0000","modified":"2022-01-10T01:32:29.795777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":36638},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36638":{"gid":36638,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/1669955501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":1669955501},{"type":"v1","addr":"172.21.15.36:6835","nonce":1669955501}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2022-01-10T01:32:30.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.111+0000 7f48c1c58700 1 -- 172.21.15.36:0/3483300781 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f489c0534d0 msgr2=0x7f489c055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.111+0000 7f48c1c58700 1 --2- 172.21.15.36:0/3483300781 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f489c0534d0 0x7f489c055990 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f48b000b000 tx=0x7f48b0008040).stop 2022-01-10T01:32:30.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.111+0000 7f48c1c58700 1 -- 172.21.15.36:0/3483300781 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48bc060d70 msgr2=0x7f48bc0b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.111+0000 7f48c1c58700 1 --2- 172.21.15.36:0/3483300781 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48bc060d70 0x7f48bc0b5820 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f48bc0ad9e0 tx=0x7f48ac015000).stop 2022-01-10T01:32:30.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.111+0000 7f48c1c58700 1 -- 172.21.15.36:0/3483300781 shutdown_connections 2022-01-10T01:32:30.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.111+0000 7f48c1c58700 1 --2- 172.21.15.36:0/3483300781 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f489c0534d0 0x7f489c055990 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.111+0000 7f48c1c58700 1 --2- 172.21.15.36:0/3483300781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48bc0b65c0 0x7f48bc14fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.111+0000 7f48c1c58700 1 --2- 172.21.15.36:0/3483300781 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48bc0ac5f0 0x7f48bc14f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.111+0000 7f48c1c58700 1 --2- 172.21.15.36:0/3483300781 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48bc060d70 0x7f48bc0b5820 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.111+0000 7f48c1c58700 1 -- 172.21.15.36:0/3483300781 >> 172.21.15.36:0/3483300781 conn(0x7f48bc0b3480 msgr2=0x7f48bc139480 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:30.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.111+0000 7f48c1c58700 1 -- 172.21.15.36:0/3483300781 shutdown_connections 2022-01-10T01:32:30.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.111+0000 7f48c1c58700 1 -- 172.21.15.36:0/3483300781 wait complete. 2022-01-10T01:32:30.120 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 56 2022-01-10T01:32:30.127 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:32:30.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60efa9b700 1 Processor -- start 2022-01-10T01:32:30.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60efa9b700 1 -- start start 2022-01-10T01:32:30.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60efa9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60e80b1db0 0x7f60e80b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60efa9b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e80b0350 con 0x7f60e80a70c0 2022-01-10T01:32:30.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60efa9b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e80b05f0 con 0x7f60e81483a0 2022-01-10T01:32:30.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60efa9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80a90c0 con 0x7f60e80b1db0 2022-01-10T01:32:30.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ee038700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f60e80a70c0 0x7f60e8144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38610/0 (socket says 172.21.15.36:38610) 2022-01-10T01:32:30.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ee038700 1 -- 172.21.15.36:0/609489869 learned_addr learned my addr 172.21.15.36:0/609489869 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:30.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ed837700 1 --2- 172.21.15.36:0/609489869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60e80b1db0 0x7f60e80b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ec835700 1 -- 172.21.15.36:0/609489869 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109046198 0 0) 0x7f60e80b0350 con 0x7f60e80a70c0 2022-01-10T01:32:30.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ec835700 1 -- 172.21.15.36:0/609489869 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60cc003260 con 0x7f60e80a70c0 2022-01-10T01:32:30.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ec835700 1 -- 172.21.15.36:0/609489869 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486005113 0 0) 0x7f60e80b05f0 con 0x7f60e81483a0 2022-01-10T01:32:30.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ec835700 1 -- 172.21.15.36:0/609489869 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60e80b0350 con 0x7f60e81483a0 2022-01-10T01:32:30.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ed837700 1 -- 172.21.15.36:0/609489869 >> v1:172.21.15.59:6789/0 conn(0x7f60e81483a0 legacy=0x7f60e80b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ed837700 1 -- 172.21.15.36:0/609489869 >> v1:172.21.15.36:6789/0 conn(0x7f60e80a70c0 legacy=0x7f60e8144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ec835700 1 -- 172.21.15.36:0/609489869 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1299199627 0 0) 0x7f60cc003260 con 0x7f60e80a70c0 2022-01-10T01:32:30.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ed837700 1 -- 172.21.15.36:0/609489869 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80b0890 con 0x7f60e80b1db0 2022-01-10T01:32:30.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ed837700 1 --2- 172.21.15.36:0/609489869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60e80b1db0 0x7f60e80b0fd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f60e4001110 tx=0x7f60dc006df0).ready entity=mon.2 client_cookie=f20ebd510326f6d7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:30.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ec835700 1 -- 172.21.15.36:0/609489869 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60e4001660 con 0x7f60e80b1db0 2022-01-10T01:32:30.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ec835700 1 -- 172.21.15.36:0/609489869 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc000e90 con 0x7f60e80b1db0 2022-01-10T01:32:30.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60ec835700 1 -- 172.21.15.36:0/609489869 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60dc012460 con 0x7f60e80b1db0 2022-01-10T01:32:30.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60efa9b700 1 -- 172.21.15.36:0/609489869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60e80b1db0 msgr2=0x7f60e80b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60efa9b700 1 --2- 172.21.15.36:0/609489869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60e80b1db0 0x7f60e80b0fd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f60e4001110 tx=0x7f60dc006df0).stop 2022-01-10T01:32:30.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60efa9b700 1 -- 172.21.15.36:0/609489869 shutdown_connections 2022-01-10T01:32:30.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60efa9b700 1 --2- 172.21.15.36:0/609489869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60e80b1db0 0x7f60e80b0fd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.223+0000 7f60efa9b700 1 -- 172.21.15.36:0/609489869 >> 172.21.15.36:0/609489869 conn(0x7f60e805f6b0 msgr2=0x7f60e805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:30.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60efa9b700 1 -- 172.21.15.36:0/609489869 shutdown_connections 2022-01-10T01:32:30.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60efa9b700 1 -- 172.21.15.36:0/609489869 wait complete. 2022-01-10T01:32:30.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60efa9b700 1 Processor -- start 2022-01-10T01:32:30.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60efa9b700 1 -- start start 2022-01-10T01:32:30.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60efa9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60e80a70c0 0x7f60e814d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60efa9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60e80b1db0 0x7f60e80ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60efa9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60e81483a0 0x7f60e80abee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60efa9b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80aad30 con 0x7f60e80a70c0 2022-01-10T01:32:30.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60efa9b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80aa7f0 con 0x7f60e81483a0 2022-01-10T01:32:30.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60efa9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80aaa90 con 0x7f60e80b1db0 2022-01-10T01:32:30.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60ed837700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60e80a70c0 0x7f60e814d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60ed837700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60e80a70c0 0x7f60e814d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40818/0 (socket says 172.21.15.36:40818) 2022-01-10T01:32:30.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60ed837700 1 -- 172.21.15.36:0/880817363 learned_addr learned my addr 172.21.15.36:0/880817363 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:30.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60ee038700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60e81483a0 0x7f60e80abee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60ed036700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60e80b1db0 0x7f60e80ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60ed837700 1 -- 172.21.15.36:0/880817363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60e80b1db0 msgr2=0x7f60e80ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60ed837700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60e80b1db0 0x7f60e80ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60ed837700 1 -- 172.21.15.36:0/880817363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60e81483a0 msgr2=0x7f60e80abee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60ed837700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60e81483a0 0x7f60e80abee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60ed837700 1 -- 172.21.15.36:0/880817363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc00b180 con 0x7f60e80a70c0 2022-01-10T01:32:30.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60ed036700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60e80b1db0 0x7f60e80ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:32:30.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60ed837700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60e80a70c0 0x7f60e814d5b0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f60e4001110 tx=0x7f60dc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:30.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60daffd700 1 -- 172.21.15.36:0/880817363 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60dc00d7d0 con 0x7f60e80a70c0 2022-01-10T01:32:30.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60daffd700 1 -- 172.21.15.36:0/880817363 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc017070 con 0x7f60e80a70c0 2022-01-10T01:32:30.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60efa9b700 1 -- 172.21.15.36:0/880817363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e814aac0 con 0x7f60e80a70c0 2022-01-10T01:32:30.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60daffd700 1 -- 172.21.15.36:0/880817363 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60dc00db20 con 0x7f60e80a70c0 2022-01-10T01:32:30.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.227+0000 7f60efa9b700 1 -- 172.21.15.36:0/880817363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e8148ad0 con 0x7f60e80a70c0 2022-01-10T01:32:30.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.231+0000 7f60efa9b700 1 -- 172.21.15.36:0/880817363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e8057350 con 0x7f60e80a70c0 2022-01-10T01:32:30.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.231+0000 7f60daffd700 1 -- 172.21.15.36:0/880817363 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f60dc025030 con 0x7f60e80a70c0 2022-01-10T01:32:30.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.231+0000 7f60daffd700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60d0053500 0x7f60d00559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.231+0000 7f60daffd700 1 -- 172.21.15.36:0/880817363 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f60dc06c520 con 0x7f60e80a70c0 2022-01-10T01:32:30.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.231+0000 7f60ed036700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60d0053500 0x7f60d00559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.231+0000 7f60ed036700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60d0053500 0x7f60d00559c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f60e0008000 tx=0x7f60e0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:30.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.239+0000 7f60daffd700 1 -- 172.21.15.36:0/880817363 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f60dc043530 con 0x7f60e80a70c0 2022-01-10T01:32:30.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.363+0000 7f60efa9b700 1 -- 172.21.15.36:0/880817363 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60e8044650 con 0x7f60e80a70c0 2022-01-10T01:32:30.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.367+0000 7f60daffd700 1 -- 172.21.15.36:0/880817363 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f60dc023020 con 0x7f60e80a70c0 2022-01-10T01:32:30.371 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:30.371 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":120,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:32:29.777012+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:32:27.171024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2022-01-10T01:32:28.099192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:32:30.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.367+0000 7f60efa9b700 1 -- 172.21.15.36:0/880817363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60d0053500 msgr2=0x7f60d00559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.367+0000 7f60efa9b700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60d0053500 0x7f60d00559c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f60e0008000 tx=0x7f60e0009040).stop 2022-01-10T01:32:30.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.367+0000 7f60efa9b700 1 -- 172.21.15.36:0/880817363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60e80a70c0 msgr2=0x7f60e814d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.367+0000 7f60efa9b700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60e80a70c0 0x7f60e814d5b0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f60e4001110 tx=0x7f60dc014000).stop 2022-01-10T01:32:30.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.367+0000 7f60efa9b700 1 -- 172.21.15.36:0/880817363 shutdown_connections 2022-01-10T01:32:30.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.367+0000 7f60efa9b700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60d0053500 0x7f60d00559c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.367+0000 7f60efa9b700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60e81483a0 0x7f60e80abee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.367+0000 7f60efa9b700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60e80b1db0 0x7f60e80ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.367+0000 7f60efa9b700 1 --2- 172.21.15.36:0/880817363 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60e80a70c0 0x7f60e814d5b0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.367+0000 7f60efa9b700 1 -- 172.21.15.36:0/880817363 >> 172.21.15.36:0/880817363 conn(0x7f60e805f6b0 msgr2=0x7f60e80b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:30.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.367+0000 7f60efa9b700 1 -- 172.21.15.36:0/880817363 shutdown_connections 2022-01-10T01:32:30.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.367+0000 7f60efa9b700 1 -- 172.21.15.36:0/880817363 wait complete. 2022-01-10T01:32:30.385 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:32:30.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.491+0000 7efdb005e700 1 Processor -- start 2022-01-10T01:32:30.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.491+0000 7efdb005e700 1 -- start start 2022-01-10T01:32:30.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdb005e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efda80af780 0x7efda8143d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdb005e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7efda80a9f40 0x7efda8140110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdb005e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda80b3880 con 0x7efda80b34a0 2022-01-10T01:32:30.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdb005e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda8144260 con 0x7efda80a9f40 2022-01-10T01:32:30.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdb005e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda81469b0 con 0x7efda80af780 2022-01-10T01:32:30.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdae5fb700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7efda80a9f40 0x7efda8140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdae5fb700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7efda80a9f40 0x7efda8140110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40830/0 (socket says 172.21.15.36:40830) 2022-01-10T01:32:30.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdae5fb700 1 -- 172.21.15.36:0/1476253067 learned_addr learned my addr 172.21.15.36:0/1476253067 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:30.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdad5f9700 1 --2- 172.21.15.36:0/1476253067 >> v2:172.21.15.59:3300/0 conn(0x7efda80af780 0x7efda8143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdae5fb700 1 -- 172.21.15.36:0/1476253067 >> v2:172.21.15.59:3300/0 conn(0x7efda80af780 msgr2=0x7efda8143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:30.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdae5fb700 1 --2- 172.21.15.36:0/1476253067 >> v2:172.21.15.59:3300/0 conn(0x7efda80af780 0x7efda8143d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdae5fb700 1 -- 172.21.15.36:0/1476253067 >> v1:172.21.15.59:6789/0 conn(0x7efda80b34a0 legacy=0x7efda80af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdae5fb700 1 -- 172.21.15.36:0/1476253067 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda8146c50 con 0x7efda80a9f40 2022-01-10T01:32:30.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdae5fb700 1 --2- 172.21.15.36:0/1476253067 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efda80a9f40 0x7efda8140110 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7efda00032f0 tx=0x7efda0009290).ready entity=mon.0 client_cookie=d7867b6d1e0be212 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:30.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdacdf8700 1 -- 172.21.15.36:0/1476253067 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efda000b870 con 0x7efda80a9f40 2022-01-10T01:32:30.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdacdf8700 1 -- 172.21.15.36:0/1476253067 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda000b9d0 con 0x7efda80a9f40 2022-01-10T01:32:30.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdacdf8700 1 -- 172.21.15.36:0/1476253067 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efda000bb40 con 0x7efda80a9f40 2022-01-10T01:32:30.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdb005e700 1 -- 172.21.15.36:0/1476253067 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efda80a9f40 msgr2=0x7efda8140110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdb005e700 1 --2- 172.21.15.36:0/1476253067 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efda80a9f40 0x7efda8140110 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7efda00032f0 tx=0x7efda0009290).stop 2022-01-10T01:32:30.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdb005e700 1 -- 172.21.15.36:0/1476253067 shutdown_connections 2022-01-10T01:32:30.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdb005e700 1 --2- 172.21.15.36:0/1476253067 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efda80a9f40 0x7efda8140110 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdb005e700 1 --2- 172.21.15.36:0/1476253067 >> v2:172.21.15.59:3300/0 conn(0x7efda80af780 0x7efda8143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdb005e700 1 -- 172.21.15.36:0/1476253067 >> 172.21.15.36:0/1476253067 conn(0x7efda80607c0 msgr2=0x7efda8060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:30.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdb005e700 1 -- 172.21.15.36:0/1476253067 shutdown_connections 2022-01-10T01:32:30.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.495+0000 7efdb005e700 1 -- 172.21.15.36:0/1476253067 wait complete. 2022-01-10T01:32:30.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.499+0000 7efdb005e700 1 Processor -- start 2022-01-10T01:32:30.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.499+0000 7efdb005e700 1 -- start start 2022-01-10T01:32:30.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.499+0000 7efdb005e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efda80a9f40 0x7efda813f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.499+0000 7efdb005e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efda80af780 0x7efda8141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.499+0000 7efdb005e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efda80b34a0 0x7efda8141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.499+0000 7efdb005e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda8145390 con 0x7efda80a9f40 2022-01-10T01:32:30.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.499+0000 7efdb005e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda8145630 con 0x7efda80af780 2022-01-10T01:32:30.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.499+0000 7efdb005e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda81458d0 con 0x7efda80b34a0 2022-01-10T01:32:30.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.499+0000 7efdaddfa700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efda80a9f40 0x7efda813f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.499+0000 7efdaddfa700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efda80a9f40 0x7efda813f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40832/0 (socket says 172.21.15.36:40832) 2022-01-10T01:32:30.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.499+0000 7efdaddfa700 1 -- 172.21.15.36:0/1714355620 learned_addr learned my addr 172.21.15.36:0/1714355620 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:30.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.499+0000 7efdad5f9700 1 --2- 172.21.15.36:0/1714355620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efda80af780 0x7efda8141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.499+0000 7efdae5fb700 1 --2- 172.21.15.36:0/1714355620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efda80b34a0 0x7efda8141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.499+0000 7efdaddfa700 1 -- 172.21.15.36:0/1714355620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efda80b34a0 msgr2=0x7efda8141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efdaddfa700 1 --2- 172.21.15.36:0/1714355620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efda80b34a0 0x7efda8141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efdaddfa700 1 -- 172.21.15.36:0/1714355620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efda80af780 msgr2=0x7efda8141a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efdaddfa700 1 --2- 172.21.15.36:0/1714355620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efda80af780 0x7efda8141a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efdaddfa700 1 -- 172.21.15.36:0/1714355620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda0009530 con 0x7efda80a9f40 2022-01-10T01:32:30.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efdaddfa700 1 --2- 172.21.15.36:0/1714355620 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efda80a9f40 0x7efda813f500 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7efda80ad990 tx=0x7efda4007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:30.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efd96ffd700 1 -- 172.21.15.36:0/1714355620 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efda4007030 con 0x7efda80a9f40 2022-01-10T01:32:30.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efd96ffd700 1 -- 172.21.15.36:0/1714355620 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda4007190 con 0x7efda80a9f40 2022-01-10T01:32:30.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efdb005e700 1 -- 172.21.15.36:0/1714355620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda8141580 con 0x7efda80a9f40 2022-01-10T01:32:30.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efd96ffd700 1 -- 172.21.15.36:0/1714355620 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efda4006510 con 0x7efda80a9f40 2022-01-10T01:32:30.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efdb005e700 1 -- 172.21.15.36:0/1714355620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda8146520 con 0x7efda80a9f40 2022-01-10T01:32:30.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efdb005e700 1 -- 172.21.15.36:0/1714355620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda8146ef0 con 0x7efda80a9f40 2022-01-10T01:32:30.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efd96ffd700 1 -- 172.21.15.36:0/1714355620 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7efda4006670 con 0x7efda80a9f40 2022-01-10T01:32:30.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efd96ffd700 1 --2- 172.21.15.36:0/1714355620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efd88053560 0x7efd88055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efd96ffd700 1 -- 172.21.15.36:0/1714355620 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7efda406b480 con 0x7efda80a9f40 2022-01-10T01:32:30.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.503+0000 7efdad5f9700 1 --2- 172.21.15.36:0/1714355620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efd88053560 0x7efd88055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.507+0000 7efdad5f9700 1 --2- 172.21.15.36:0/1714355620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efd88053560 0x7efd88055a20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7efd9800b000 tx=0x7efd98006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:30.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.507+0000 7efd96ffd700 1 -- 172.21.15.36:0/1714355620 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efda4042320 con 0x7efda80a9f40 2022-01-10T01:32:30.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.671+0000 7efdb005e700 1 -- 172.21.15.36:0/1714355620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7efda8057350 con 0x7efda80a9f40 2022-01-10T01:32:30.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.679+0000 7efd96ffd700 1 -- 172.21.15.36:0/1714355620 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7efda4045940 con 0x7efda80a9f40 2022-01-10T01:32:30.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.679+0000 7efdb005e700 1 -- 172.21.15.36:0/1714355620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efd88053560 msgr2=0x7efd88055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.679+0000 7efdb005e700 1 --2- 172.21.15.36:0/1714355620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efd88053560 0x7efd88055a20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7efd9800b000 tx=0x7efd98006df0).stop 2022-01-10T01:32:30.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.679+0000 7efdb005e700 1 -- 172.21.15.36:0/1714355620 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efda80a9f40 msgr2=0x7efda813f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.679+0000 7efdb005e700 1 --2- 172.21.15.36:0/1714355620 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efda80a9f40 0x7efda813f500 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7efda80ad990 tx=0x7efda4007be0).stop 2022-01-10T01:32:30.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.679+0000 7efdb005e700 1 -- 172.21.15.36:0/1714355620 shutdown_connections 2022-01-10T01:32:30.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.679+0000 7efdb005e700 1 --2- 172.21.15.36:0/1714355620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efd88053560 0x7efd88055a20 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.679+0000 7efdb005e700 1 --2- 172.21.15.36:0/1714355620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efda80b34a0 0x7efda8141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.689 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.679+0000 7efdb005e700 1 --2- 172.21.15.36:0/1714355620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efda80af780 0x7efda8141a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.679+0000 7efdb005e700 1 --2- 172.21.15.36:0/1714355620 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efda80a9f40 0x7efda813f500 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.679+0000 7efdb005e700 1 -- 172.21.15.36:0/1714355620 >> 172.21.15.36:0/1714355620 conn(0x7efda80607c0 msgr2=0x7efda80afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:30.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.679+0000 7efdb005e700 1 -- 172.21.15.36:0/1714355620 shutdown_connections 2022-01-10T01:32:30.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.679+0000 7efdb005e700 1 -- 172.21.15.36:0/1714355620 wait complete. 2022-01-10T01:32:30.692 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.0 2022-01-10T01:32:30.697 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:32:30.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.807+0000 7f9cd9501700 1 Processor -- start 2022-01-10T01:32:30.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.807+0000 7f9cd9501700 1 -- start start 2022-01-10T01:32:30.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.807+0000 7f9cd9501700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9cd40b6580 0x7f9cd40b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.807+0000 7f9cd9501700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9cd40b6960 0x7f9cd412ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.807+0000 7f9cd9501700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd41440b0 con 0x7f9cd40b43c0 2022-01-10T01:32:30.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.807+0000 7f9cd9501700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd4143b70 con 0x7f9cd40b6580 2022-01-10T01:32:30.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.807+0000 7f9cd9501700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd4143e10 con 0x7f9cd40b6960 2022-01-10T01:32:30.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.807+0000 7f9cd2ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9cd40b6580 0x7f9cd40b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.807+0000 7f9cd27fc700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9cd40b43c0 0x7f9cd4061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38634/0 (socket says 172.21.15.36:38634) 2022-01-10T01:32:30.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.807+0000 7f9cd27fc700 1 -- 172.21.15.36:0/1469543293 learned_addr learned my addr 172.21.15.36:0/1469543293 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:30.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.807+0000 7f9cd37fe700 1 --2- 172.21.15.36:0/1469543293 >> v2:172.21.15.59:3300/0 conn(0x7f9cd40b6960 0x7f9cd412ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd2ffd700 1 -- 172.21.15.36:0/1469543293 >> v2:172.21.15.59:3300/0 conn(0x7f9cd40b6960 msgr2=0x7f9cd412ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:30.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd2ffd700 1 --2- 172.21.15.36:0/1469543293 >> v2:172.21.15.59:3300/0 conn(0x7f9cd40b6960 0x7f9cd412ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd2ffd700 1 -- 172.21.15.36:0/1469543293 >> v1:172.21.15.36:6789/0 conn(0x7f9cd40b43c0 legacy=0x7f9cd4061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd2ffd700 1 -- 172.21.15.36:0/1469543293 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd40615f0 con 0x7f9cd40b6580 2022-01-10T01:32:30.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd37fe700 1 --2- 172.21.15.36:0/1469543293 >> v2:172.21.15.59:3300/0 conn(0x7f9cd40b6960 0x7f9cd412ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:30.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd2ffd700 1 --2- 172.21.15.36:0/1469543293 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cd40b6580 0x7f9cd40b5bf0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f9cd4143120 tx=0x7f9cc4006df0).ready entity=mon.0 client_cookie=1212dc2c601ebe8e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:30.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd1ffb700 1 -- 172.21.15.36:0/1469543293 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cc400d5c0 con 0x7f9cd40b6580 2022-01-10T01:32:30.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd1ffb700 1 -- 172.21.15.36:0/1469543293 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc4000e90 con 0x7f9cd40b6580 2022-01-10T01:32:30.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd1ffb700 1 -- 172.21.15.36:0/1469543293 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cc400d910 con 0x7f9cd40b6580 2022-01-10T01:32:30.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd9501700 1 -- 172.21.15.36:0/1469543293 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cd40b6580 msgr2=0x7f9cd40b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd9501700 1 --2- 172.21.15.36:0/1469543293 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cd40b6580 0x7f9cd40b5bf0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f9cd4143120 tx=0x7f9cc4006df0).stop 2022-01-10T01:32:30.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd9501700 1 -- 172.21.15.36:0/1469543293 shutdown_connections 2022-01-10T01:32:30.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd9501700 1 --2- 172.21.15.36:0/1469543293 >> v2:172.21.15.59:3300/0 conn(0x7f9cd40b6960 0x7f9cd412ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd9501700 1 --2- 172.21.15.36:0/1469543293 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cd40b6580 0x7f9cd40b5bf0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd9501700 1 -- 172.21.15.36:0/1469543293 >> 172.21.15.36:0/1469543293 conn(0x7f9cd405c490 msgr2=0x7f9cd405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:30.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd9501700 1 -- 172.21.15.36:0/1469543293 shutdown_connections 2022-01-10T01:32:30.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.811+0000 7f9cd9501700 1 -- 172.21.15.36:0/1469543293 wait complete. 2022-01-10T01:32:30.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd9501700 1 Processor -- start 2022-01-10T01:32:30.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd9501700 1 -- start start 2022-01-10T01:32:30.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd9501700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cd40b43c0 0x7f9cd41266b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd9501700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd40b6580 0x7f9cd4141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd9501700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cd40b6960 0x7f9cd4125120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd9501700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd40adcb0 con 0x7f9cd40b6960 2022-01-10T01:32:30.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd9501700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd4124ce0 con 0x7f9cd40b6580 2022-01-10T01:32:30.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd9501700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd4152640 con 0x7f9cd40b43c0 2022-01-10T01:32:30.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cd40b43c0 0x7f9cd41266b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd27fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd40b6580 0x7f9cd4141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd2ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cd40b43c0 0x7f9cd41266b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:47126/0 (socket says 172.21.15.36:47126) 2022-01-10T01:32:30.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd2ffd700 1 -- 172.21.15.36:0/1259214024 learned_addr learned my addr 172.21.15.36:0/1259214024 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:30.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd37fe700 1 --2- 172.21.15.36:0/1259214024 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cd40b6960 0x7f9cd4125120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd37fe700 1 -- 172.21.15.36:0/1259214024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cd40b43c0 msgr2=0x7f9cd41266b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd37fe700 1 --2- 172.21.15.36:0/1259214024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cd40b43c0 0x7f9cd41266b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd37fe700 1 -- 172.21.15.36:0/1259214024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd40b6580 msgr2=0x7f9cd4141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:30.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd37fe700 1 --2- 172.21.15.36:0/1259214024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd40b6580 0x7f9cd4141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:30.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd37fe700 1 -- 172.21.15.36:0/1259214024 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ccc009470 con 0x7f9cd40b6960 2022-01-10T01:32:30.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd27fc700 1 --2- 172.21.15.36:0/1259214024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd40b6580 0x7f9cd4141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:30.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.815+0000 7f9cd37fe700 1 --2- 172.21.15.36:0/1259214024 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cd40b6960 0x7f9cd4125120 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7f9ccc00c000 tx=0x7f9ccc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:30.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.819+0000 7f9cc3fff700 1 -- 172.21.15.36:0/1259214024 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ccc012600 con 0x7f9cd40b6960 2022-01-10T01:32:30.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.819+0000 7f9cd9501700 1 -- 172.21.15.36:0/1259214024 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc400b180 con 0x7f9cd40b6960 2022-01-10T01:32:30.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.819+0000 7f9cc3fff700 1 -- 172.21.15.36:0/1259214024 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ccc012760 con 0x7f9cd40b6960 2022-01-10T01:32:30.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.819+0000 7f9cd9501700 1 -- 172.21.15.36:0/1259214024 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd4152e20 con 0x7f9cd40b6960 2022-01-10T01:32:30.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.819+0000 7f9cc3fff700 1 -- 172.21.15.36:0/1259214024 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ccc012ac0 con 0x7f9cd40b6960 2022-01-10T01:32:30.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.819+0000 7f9cc3fff700 1 -- 172.21.15.36:0/1259214024 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9ccc022070 con 0x7f9cd40b6960 2022-01-10T01:32:30.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.819+0000 7f9cd9501700 1 -- 172.21.15.36:0/1259214024 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd4152fe0 con 0x7f9cd40b6960 2022-01-10T01:32:30.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.819+0000 7f9cc3fff700 1 --2- 172.21.15.36:0/1259214024 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cb8053800 0x7f9cb8055cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:30.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.819+0000 7f9cc3fff700 1 -- 172.21.15.36:0/1259214024 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9ccc06c0f0 con 0x7f9cd40b6960 2022-01-10T01:32:30.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.819+0000 7f9cd2ffd700 1 --2- 172.21.15.36:0/1259214024 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cb8053800 0x7f9cb8055cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:30.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.823+0000 7f9cd2ffd700 1 --2- 172.21.15.36:0/1259214024 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cb8053800 0x7f9cb8055cc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f9cc401a000 tx=0x7f9cc4014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:30.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.827+0000 7f9cc3fff700 1 -- 172.21.15.36:0/1259214024 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ccc043060 con 0x7f9cd40b6960 2022-01-10T01:32:30.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:30.995+0000 7f9cd9501700 1 -- 172.21.15.36:0/1259214024 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9cd4061890 con 0x7f9cd40b6960 2022-01-10T01:32:31.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.003+0000 7f9cc3fff700 1 -- 172.21.15.36:0/1259214024 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9ccc046680 con 0x7f9cd40b6960 2022-01-10T01:32:31.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.007+0000 7f9cd9501700 1 -- 172.21.15.36:0/1259214024 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cb8053800 msgr2=0x7f9cb8055cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:31.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.007+0000 7f9cd9501700 1 --2- 172.21.15.36:0/1259214024 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cb8053800 0x7f9cb8055cc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f9cc401a000 tx=0x7f9cc4014000).stop 2022-01-10T01:32:31.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.007+0000 7f9cd9501700 1 -- 172.21.15.36:0/1259214024 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cd40b6960 msgr2=0x7f9cd4125120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:31.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.007+0000 7f9cd9501700 1 --2- 172.21.15.36:0/1259214024 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cd40b6960 0x7f9cd4125120 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7f9ccc00c000 tx=0x7f9ccc0091d0).stop 2022-01-10T01:32:31.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.007+0000 7f9cd9501700 1 -- 172.21.15.36:0/1259214024 shutdown_connections 2022-01-10T01:32:31.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.007+0000 7f9cd9501700 1 --2- 172.21.15.36:0/1259214024 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cb8053800 0x7f9cb8055cc0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.007+0000 7f9cd9501700 1 --2- 172.21.15.36:0/1259214024 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cd40b6960 0x7f9cd4125120 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.007+0000 7f9cd9501700 1 --2- 172.21.15.36:0/1259214024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cd40b6580 0x7f9cd4141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.007+0000 7f9cd9501700 1 --2- 172.21.15.36:0/1259214024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cd40b43c0 0x7f9cd41266b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.007+0000 7f9cd9501700 1 -- 172.21.15.36:0/1259214024 >> 172.21.15.36:0/1259214024 conn(0x7f9cd405c490 msgr2=0x7f9cd4141df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:31.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.007+0000 7f9cd9501700 1 -- 172.21.15.36:0/1259214024 shutdown_connections 2022-01-10T01:32:31.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.007+0000 7f9cd9501700 1 -- 172.21.15.36:0/1259214024 wait complete. 2022-01-10T01:32:31.013 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.1 2022-01-10T01:32:31.022 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:32:31.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59fd741700 1 Processor -- start 2022-01-10T01:32:31.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59fd741700 1 -- start start 2022-01-10T01:32:31.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59fd741700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f59f80b6430 0x7f59f8061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:31.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59fd741700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f80b4060 0x7f59f8061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:31.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59fd741700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f80b1f70 con 0x7f59f8147bf0 2022-01-10T01:32:31.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59fd741700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f80b14a0 con 0x7f59f80b6430 2022-01-10T01:32:31.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59fd741700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f8061e50 con 0x7f59f80b4060 2022-01-10T01:32:31.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59fcf40700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f59f8147bf0 0x7f59f81444a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38650/0 (socket says 172.21.15.36:38650) 2022-01-10T01:32:31.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59f7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f59f80b6430 0x7f59f8061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:31.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59fcf40700 1 -- 172.21.15.36:0/2070281341 learned_addr learned my addr 172.21.15.36:0/2070281341 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:31.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59f77fe700 1 --2- 172.21.15.36:0/2070281341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f80b4060 0x7f59f8061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:31.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59f6ffd700 1 -- 172.21.15.36:0/2070281341 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973691675 0 0) 0x7f59f80b1f70 con 0x7f59f8147bf0 2022-01-10T01:32:31.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59f6ffd700 1 -- 172.21.15.36:0/2070281341 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d8003260 con 0x7f59f8147bf0 2022-01-10T01:32:31.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59f7fff700 1 -- 172.21.15.36:0/2070281341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f80b4060 msgr2=0x7f59f8061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:31.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59f7fff700 1 --2- 172.21.15.36:0/2070281341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f80b4060 0x7f59f8061960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59f7fff700 1 -- 172.21.15.36:0/2070281341 >> v1:172.21.15.36:6789/0 conn(0x7f59f8147bf0 legacy=0x7f59f81444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:31.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59f7fff700 1 -- 172.21.15.36:0/2070281341 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f80b6810 con 0x7f59f80b6430 2022-01-10T01:32:31.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59f7fff700 1 --2- 172.21.15.36:0/2070281341 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59f80b6430 0x7f59f8061470 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f59e0002f70 tx=0x7f59e0006df0).ready entity=mon.0 client_cookie=bd886925173f64f2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:31.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59f6ffd700 1 -- 172.21.15.36:0/2070281341 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59e000d4a0 con 0x7f59f80b6430 2022-01-10T01:32:31.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59f6ffd700 1 -- 172.21.15.36:0/2070281341 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e0000e90 con 0x7f59f80b6430 2022-01-10T01:32:31.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.119+0000 7f59f6ffd700 1 -- 172.21.15.36:0/2070281341 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59e000d7f0 con 0x7f59f80b6430 2022-01-10T01:32:31.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 -- 172.21.15.36:0/2070281341 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59f80b6430 msgr2=0x7f59f8061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:31.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 --2- 172.21.15.36:0/2070281341 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59f80b6430 0x7f59f8061470 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f59e0002f70 tx=0x7f59e0006df0).stop 2022-01-10T01:32:31.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 -- 172.21.15.36:0/2070281341 shutdown_connections 2022-01-10T01:32:31.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 --2- 172.21.15.36:0/2070281341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f80b4060 0x7f59f8061960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 --2- 172.21.15.36:0/2070281341 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59f80b6430 0x7f59f8061470 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 -- 172.21.15.36:0/2070281341 >> 172.21.15.36:0/2070281341 conn(0x7f59f805c490 msgr2=0x7f59f805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:31.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 -- 172.21.15.36:0/2070281341 shutdown_connections 2022-01-10T01:32:31.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 -- 172.21.15.36:0/2070281341 wait complete. 2022-01-10T01:32:31.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 Processor -- start 2022-01-10T01:32:31.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 -- start start 2022-01-10T01:32:31.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f80b4060 0x7f59f80afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:31.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59f8147bf0 0x7f59f8156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:31.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59f814b3c0 0x7f59f8157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:31.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f8063f90 con 0x7f59f814b3c0 2022-01-10T01:32:31.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f814a090 con 0x7f59f8147bf0 2022-01-10T01:32:31.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fd741700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f814aa10 con 0x7f59f80b4060 2022-01-10T01:32:31.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fcf40700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59f814b3c0 0x7f59f8157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:31.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fcf40700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59f814b3c0 0x7f59f8157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40862/0 (socket says 172.21.15.36:40862) 2022-01-10T01:32:31.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fcf40700 1 -- 172.21.15.36:0/358712492 learned_addr learned my addr 172.21.15.36:0/358712492 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:31.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59f77fe700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59f8147bf0 0x7f59f8156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:31.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59f7fff700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f80b4060 0x7f59f80afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:31.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fcf40700 1 -- 172.21.15.36:0/358712492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f80b4060 msgr2=0x7f59f80afa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:31.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fcf40700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f80b4060 0x7f59f80afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fcf40700 1 -- 172.21.15.36:0/358712492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59f8147bf0 msgr2=0x7f59f8156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:31.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fcf40700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59f8147bf0 0x7f59f8156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fcf40700 1 -- 172.21.15.36:0/358712492 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e000b180 con 0x7f59f814b3c0 2022-01-10T01:32:31.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59f77fe700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59f8147bf0 0x7f59f8156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:32:31.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59fcf40700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59f814b3c0 0x7f59f8157080 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f59f0001490 tx=0x7f59f0007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:31.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.123+0000 7f59f57fa700 1 -- 172.21.15.36:0/358712492 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59f0005c70 con 0x7f59f814b3c0 2022-01-10T01:32:31.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.127+0000 7f59f57fa700 1 -- 172.21.15.36:0/358712492 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f0005dd0 con 0x7f59f814b3c0 2022-01-10T01:32:31.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.127+0000 7f59fd741700 1 -- 172.21.15.36:0/358712492 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f814acb0 con 0x7f59f814b3c0 2022-01-10T01:32:31.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.127+0000 7f59f57fa700 1 -- 172.21.15.36:0/358712492 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59f00072c0 con 0x7f59f814b3c0 2022-01-10T01:32:31.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.127+0000 7f59fd741700 1 -- 172.21.15.36:0/358712492 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f81499f0 con 0x7f59f814b3c0 2022-01-10T01:32:31.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.127+0000 7f59fd741700 1 -- 172.21.15.36:0/358712492 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f8148110 con 0x7f59f814b3c0 2022-01-10T01:32:31.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.127+0000 7f59f57fa700 1 -- 172.21.15.36:0/358712492 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f59f001a060 con 0x7f59f814b3c0 2022-01-10T01:32:31.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.127+0000 7f59f57fa700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59dc053680 0x7f59dc055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:31.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.127+0000 7f59f57fa700 1 -- 172.21.15.36:0/358712492 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f59f006b4c0 con 0x7f59f814b3c0 2022-01-10T01:32:31.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.127+0000 7f59f7fff700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59dc053680 0x7f59dc055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:31.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.127+0000 7f59f7fff700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59dc053680 0x7f59dc055b40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f59e0015000 tx=0x7f59e0014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:31.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.131+0000 7f59f57fa700 1 -- 172.21.15.36:0/358712492 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f59f00424d0 con 0x7f59f814b3c0 2022-01-10T01:32:31.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.295+0000 7f59fd741700 1 -- 172.21.15.36:0/358712492 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59f8057350 con 0x7f59f814b3c0 2022-01-10T01:32:31.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.295+0000 7f59f57fa700 1 -- 172.21.15.36:0/358712492 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f59f0018070 con 0x7f59f814b3c0 2022-01-10T01:32:31.300 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:31.301 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":56,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7590,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/2655140224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":2655140224},{"type":"v1","addr":"172.21.15.36:6837","nonce":2655140224}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":54},{"gid":7597,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/772662757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":772662757},{"type":"v1","addr":"172.21.15.59:6833","nonce":772662757}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:32:28.774139+0000","modified":"2022-01-10T01:32:29.795777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":36638},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36638":{"gid":36638,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/1669955501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":1669955501},{"type":"v1","addr":"172.21.15.36:6835","nonce":1669955501}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2022-01-10T01:32:31.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.299+0000 7f59fd741700 1 -- 172.21.15.36:0/358712492 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59dc053680 msgr2=0x7f59dc055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:31.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.299+0000 7f59fd741700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59dc053680 0x7f59dc055b40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f59e0015000 tx=0x7f59e0014000).stop 2022-01-10T01:32:31.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.299+0000 7f59fd741700 1 -- 172.21.15.36:0/358712492 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59f814b3c0 msgr2=0x7f59f8157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:31.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.299+0000 7f59fd741700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59f814b3c0 0x7f59f8157080 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f59f0001490 tx=0x7f59f0007da0).stop 2022-01-10T01:32:31.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.299+0000 7f59fd741700 1 -- 172.21.15.36:0/358712492 shutdown_connections 2022-01-10T01:32:31.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.299+0000 7f59fd741700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59dc053680 0x7f59dc055b40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.299+0000 7f59fd741700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59f814b3c0 0x7f59f8157080 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.299+0000 7f59fd741700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59f8147bf0 0x7f59f8156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.299+0000 7f59fd741700 1 --2- 172.21.15.36:0/358712492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59f80b4060 0x7f59f80afa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.299+0000 7f59fd741700 1 -- 172.21.15.36:0/358712492 >> 172.21.15.36:0/358712492 conn(0x7f59f805c490 msgr2=0x7f59f80b5710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:31.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.299+0000 7f59fd741700 1 -- 172.21.15.36:0/358712492 shutdown_connections 2022-01-10T01:32:31.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.299+0000 7f59fd741700 1 -- 172.21.15.36:0/358712492 wait complete. 2022-01-10T01:32:31.306 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 56 2022-01-10T01:32:31.617 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:32:28.774139+0000', 'modified': '2022-01-10T01:32:29.795777+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 36638}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_36638': {'gid': 36638, 'name': 'c', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6835/1669955501', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6834', 'nonce': 1669955501}, {'type': 'v1', 'addr': '172.21.15.36:6835', 'nonce': 1669955501}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:32:31.618 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:32:31.618 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2022-01-10T01:32:31.736 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":36638,"want_state":"up:active","state":"up:active","rank_uptime":2.9465655110000002,"mdsmap_epoch":56,"osdmap_epoch":120,"osdmap_epoch_barrier":120,"uptime":7.3416779410000004} 2022-01-10T01:32:31.737 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 36638, "mdsmap_epoch": 56, "osdmap_epoch": 120, "osdmap_epoch_barrier": 120, "rank_uptime": 2.946565511, "state": "up:active", "uptime": 7.341677941, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:32:31.738 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:32:31.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.839+0000 7f6f8090f700 1 Processor -- start 2022-01-10T01:32:31.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.839+0000 7f6f8090f700 1 -- start start 2022-01-10T01:32:31.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.839+0000 7f6f8090f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f6f7c080c40 0x7f6f7c0b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:31.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.839+0000 7f6f8090f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f7c0af5d0 0x7f6f7c0afd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:31.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.839+0000 7f6f8090f700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7c081020 con 0x7f6f7c0b0250 2022-01-10T01:32:31.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.839+0000 7f6f8090f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7c0ae950 con 0x7f6f7c080c40 2022-01-10T01:32:31.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.839+0000 7f6f8090f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7c0aebf0 con 0x7f6f7c0af5d0 2022-01-10T01:32:31.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.839+0000 7f6f7ad9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f6f7c080c40 0x7f6f7c0b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:31.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.839+0000 7f6f7b59e700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f6f7c0b0250 0x7f6f7c05c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38664/0 (socket says 172.21.15.36:38664) 2022-01-10T01:32:31.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.839+0000 7f6f7b59e700 1 -- 172.21.15.36:0/1167090950 learned_addr learned my addr 172.21.15.36:0/1167090950 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:31.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.839+0000 7f6f7a59c700 1 --2- 172.21.15.36:0/1167090950 >> v2:172.21.15.59:3300/0 conn(0x7f6f7c0af5d0 0x7f6f7c0afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:31.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.839+0000 7f6f79d9b700 1 -- 172.21.15.36:0/1167090950 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714732786 0 0) 0x7f6f7c081020 con 0x7f6f7c0b0250 2022-01-10T01:32:31.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.907+0000 7f6f79d9b700 1 -- 172.21.15.36:0/1167090950 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f68003240 con 0x7f6f7c0b0250 2022-01-10T01:32:31.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.907+0000 7f6f7ad9d700 1 -- 172.21.15.36:0/1167090950 >> v2:172.21.15.59:3300/0 conn(0x7f6f7c0af5d0 msgr2=0x7f6f7c0afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:31.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.907+0000 7f6f7ad9d700 1 --2- 172.21.15.36:0/1167090950 >> v2:172.21.15.59:3300/0 conn(0x7f6f7c0af5d0 0x7f6f7c0afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.907+0000 7f6f7ad9d700 1 -- 172.21.15.36:0/1167090950 >> v1:172.21.15.36:6789/0 conn(0x7f6f7c0b0250 legacy=0x7f6f7c05c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:31.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.907+0000 7f6f7ad9d700 1 -- 172.21.15.36:0/1167090950 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c0aee90 con 0x7f6f7c080c40 2022-01-10T01:32:31.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.907+0000 7f6f7ad9d700 1 --2- 172.21.15.36:0/1167090950 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f7c080c40 0x7f6f7c0b5130 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f6f6c002f70 tx=0x7f6f6c006df0).ready entity=mon.0 client_cookie=d511f6dd48881f93 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:31.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.907+0000 7f6f79d9b700 1 -- 172.21.15.36:0/1167090950 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6c00d850 con 0x7f6f7c080c40 2022-01-10T01:32:31.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.907+0000 7f6f79d9b700 1 -- 172.21.15.36:0/1167090950 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c000e90 con 0x7f6f7c080c40 2022-01-10T01:32:31.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.907+0000 7f6f79d9b700 1 -- 172.21.15.36:0/1167090950 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6c00dba0 con 0x7f6f7c080c40 2022-01-10T01:32:31.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.911+0000 7f6f8090f700 1 -- 172.21.15.36:0/1167090950 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f7c080c40 msgr2=0x7f6f7c0b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:31.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.911+0000 7f6f8090f700 1 --2- 172.21.15.36:0/1167090950 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f7c080c40 0x7f6f7c0b5130 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f6f6c002f70 tx=0x7f6f6c006df0).stop 2022-01-10T01:32:31.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.911+0000 7f6f8090f700 1 -- 172.21.15.36:0/1167090950 shutdown_connections 2022-01-10T01:32:31.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.911+0000 7f6f8090f700 1 --2- 172.21.15.36:0/1167090950 >> v2:172.21.15.59:3300/0 conn(0x7f6f7c0af5d0 0x7f6f7c0afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.911+0000 7f6f8090f700 1 --2- 172.21.15.36:0/1167090950 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f7c080c40 0x7f6f7c0b5130 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.911+0000 7f6f8090f700 1 -- 172.21.15.36:0/1167090950 >> 172.21.15.36:0/1167090950 conn(0x7f6f7c05f6b0 msgr2=0x7f6f7c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:31.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.911+0000 7f6f8090f700 1 -- 172.21.15.36:0/1167090950 shutdown_connections 2022-01-10T01:32:31.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.911+0000 7f6f8090f700 1 -- 172.21.15.36:0/1167090950 wait complete. 2022-01-10T01:32:31.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.911+0000 7f6f8090f700 1 Processor -- start 2022-01-10T01:32:31.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.911+0000 7f6f8090f700 1 -- start start 2022-01-10T01:32:31.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f8090f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7c080c40 0x7f6f7c162e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:31.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f8090f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f7c0af5d0 0x7f6f7c0ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:31.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f8090f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f7c0b0250 0x7f6f7c0645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:31.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f8090f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c0ac250 con 0x7f6f7c0af5d0 2022-01-10T01:32:31.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f8090f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c067170 con 0x7f6f7c080c40 2022-01-10T01:32:31.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f8090f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c067410 con 0x7f6f7c0b0250 2022-01-10T01:32:31.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f7a59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f7c0af5d0 0x7f6f7c0ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:31.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f7a59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f7c0af5d0 0x7f6f7c0ab700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40872/0 (socket says 172.21.15.36:40872) 2022-01-10T01:32:31.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f7a59c700 1 -- 172.21.15.36:0/772458160 learned_addr learned my addr 172.21.15.36:0/772458160 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:31.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f7ad9d700 1 --2- 172.21.15.36:0/772458160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7c080c40 0x7f6f7c162e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:31.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f7b59e700 1 --2- 172.21.15.36:0/772458160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f7c0b0250 0x7f6f7c0645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:31.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f7a59c700 1 -- 172.21.15.36:0/772458160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f7c0b0250 msgr2=0x7f6f7c0645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:31.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f7a59c700 1 --2- 172.21.15.36:0/772458160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f7c0b0250 0x7f6f7c0645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f7a59c700 1 -- 172.21.15.36:0/772458160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7c080c40 msgr2=0x7f6f7c162e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:31.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f7a59c700 1 --2- 172.21.15.36:0/772458160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7c080c40 0x7f6f7c162e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:31.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f7a59c700 1 -- 172.21.15.36:0/772458160 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c00c290 con 0x7f6f7c0af5d0 2022-01-10T01:32:31.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f7a59c700 1 --2- 172.21.15.36:0/772458160 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f7c0af5d0 0x7f6f7c0ab700 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f6f6400d000 tx=0x7f6f64008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:31.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f73fff700 1 -- 172.21.15.36:0/772458160 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f6400dd10 con 0x7f6f7c0af5d0 2022-01-10T01:32:31.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f73fff700 1 -- 172.21.15.36:0/772458160 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6400de70 con 0x7f6f7c0af5d0 2022-01-10T01:32:31.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f8090f700 1 -- 172.21.15.36:0/772458160 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7c1502a0 con 0x7f6f7c0af5d0 2022-01-10T01:32:31.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f73fff700 1 -- 172.21.15.36:0/772458160 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f64019660 con 0x7f6f7c0af5d0 2022-01-10T01:32:31.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.915+0000 7f6f8090f700 1 -- 172.21.15.36:0/772458160 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7c1507c0 con 0x7f6f7c0af5d0 2022-01-10T01:32:31.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.919+0000 7f6f8090f700 1 -- 172.21.15.36:0/772458160 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7c0675d0 con 0x7f6f7c0af5d0 2022-01-10T01:32:31.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.919+0000 7f6f73fff700 1 -- 172.21.15.36:0/772458160 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6f640197c0 con 0x7f6f7c0af5d0 2022-01-10T01:32:31.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.919+0000 7f6f73fff700 1 --2- 172.21.15.36:0/772458160 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f600535f0 0x7f6f60055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:31.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.919+0000 7f6f7ad9d700 1 --2- 172.21.15.36:0/772458160 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f600535f0 0x7f6f60055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:31.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.919+0000 7f6f73fff700 1 -- 172.21.15.36:0/772458160 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6f6406cce0 con 0x7f6f7c0af5d0 2022-01-10T01:32:31.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.923+0000 7f6f7ad9d700 1 --2- 172.21.15.36:0/772458160 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f600535f0 0x7f6f60055ab0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f6f6c01b000 tx=0x7f6f6c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:31.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:31.931+0000 7f6f73fff700 1 -- 172.21.15.36:0/772458160 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6f64043be0 con 0x7f6f7c0af5d0 2022-01-10T01:32:31.953 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:32:31.956 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:32:31.959 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:32:31.961 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:32:32.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.063+0000 7f6f8090f700 1 -- 172.21.15.36:0/772458160 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f7c0af130 con 0x7f6f7c0af5d0 2022-01-10T01:32:32.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.063+0000 7f6f73fff700 1 -- 172.21.15.36:0/772458160 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f6f64047200 con 0x7f6f7c0af5d0 2022-01-10T01:32:32.067 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:32.068 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":120,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:32:29.777012+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:32:27.171024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2022-01-10T01:32:28.099192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:32:32.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.063+0000 7f6f8090f700 1 -- 172.21.15.36:0/772458160 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f600535f0 msgr2=0x7f6f60055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.067+0000 7f6f8090f700 1 --2- 172.21.15.36:0/772458160 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f600535f0 0x7f6f60055ab0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f6f6c01b000 tx=0x7f6f6c014000).stop 2022-01-10T01:32:32.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.067+0000 7f6f8090f700 1 -- 172.21.15.36:0/772458160 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f7c0af5d0 msgr2=0x7f6f7c0ab700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.067+0000 7f6f8090f700 1 --2- 172.21.15.36:0/772458160 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f7c0af5d0 0x7f6f7c0ab700 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f6f6400d000 tx=0x7f6f64008040).stop 2022-01-10T01:32:32.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.067+0000 7f6f8090f700 1 -- 172.21.15.36:0/772458160 shutdown_connections 2022-01-10T01:32:32.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.067+0000 7f6f8090f700 1 --2- 172.21.15.36:0/772458160 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6f600535f0 0x7f6f60055ab0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.067+0000 7f6f8090f700 1 --2- 172.21.15.36:0/772458160 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f7c0b0250 0x7f6f7c0645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.067+0000 7f6f8090f700 1 --2- 172.21.15.36:0/772458160 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6f7c0af5d0 0x7f6f7c0ab700 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.067+0000 7f6f8090f700 1 --2- 172.21.15.36:0/772458160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f7c080c40 0x7f6f7c162e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.067+0000 7f6f8090f700 1 -- 172.21.15.36:0/772458160 >> 172.21.15.36:0/772458160 conn(0x7f6f7c05f6b0 msgr2=0x7f6f7c151320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:32.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.067+0000 7f6f8090f700 1 -- 172.21.15.36:0/772458160 shutdown_connections 2022-01-10T01:32:32.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.067+0000 7f6f8090f700 1 -- 172.21.15.36:0/772458160 wait complete. 2022-01-10T01:32:32.081 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:32:27.171024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:32:28.099192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:32:32.082 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:32:32.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.183+0000 7f91a5f16700 1 Processor -- start 2022-01-10T01:32:32.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.183+0000 7f91a5f16700 1 -- start start 2022-01-10T01:32:32.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.183+0000 7f91a5f16700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91a00b0010 0x7f91a00a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.183+0000 7f91a5f16700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a00a70c0 con 0x7f91a00afbd0 2022-01-10T01:32:32.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.183+0000 7f91a5f16700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a00a72f0 con 0x7f91a00b2580 2022-01-10T01:32:32.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.183+0000 7f91a5f16700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a00a7590 con 0x7f91a00b0010 2022-01-10T01:32:32.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.183+0000 7f91a5715700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f91a00afbd0 0x7f91a0151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38676/0 (socket says 172.21.15.36:38676) 2022-01-10T01:32:32.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.183+0000 7f91a5715700 1 -- 172.21.15.36:0/1928969510 learned_addr learned my addr 172.21.15.36:0/1928969510 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:32.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.183+0000 7f919ffff700 1 --2- 172.21.15.36:0/1928969510 >> v2:172.21.15.59:3300/0 conn(0x7f91a00b0010 0x7f91a00a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.183+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612581716 0 0) 0x7f91a00a70c0 con 0x7f91a00afbd0 2022-01-10T01:32:32.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f918c003260 con 0x7f91a00afbd0 2022-01-10T01:32:32.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813987043 0 0) 0x7f91a00a72f0 con 0x7f91a00b2580 2022-01-10T01:32:32.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91a00a70c0 con 0x7f91a00b2580 2022-01-10T01:32:32.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 683164287 0 0) 0x7f918c003260 con 0x7f91a00afbd0 2022-01-10T01:32:32.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 >> v2:172.21.15.59:3300/0 conn(0x7f91a00b0010 msgr2=0x7f91a00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:32.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 --2- 172.21.15.36:0/1928969510 >> v2:172.21.15.59:3300/0 conn(0x7f91a00b0010 0x7f91a00a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 >> v1:172.21.15.59:6789/0 conn(0x7f91a00b2580 legacy=0x7f91a014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a00a7830 con 0x7f91a00afbd0 2022-01-10T01:32:32.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f91980019e0 con 0x7f91a00afbd0 2022-01-10T01:32:32.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 >> v1:172.21.15.36:6789/0 conn(0x7f91a00afbd0 legacy=0x7f91a0151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 --2- 172.21.15.36:0/1928969510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f918c0038e0 0x7f918c003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 --2- 172.21.15.36:0/1928969510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918c004500 0x7f918c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 --2- 172.21.15.36:0/1928969510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f918c004e70 0x7f918c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a00a7590 con 0x7f918c004e70 2022-01-10T01:32:32.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918c00bcf0 con 0x7f918c004500 2022-01-10T01:32:32.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918c00beb0 con 0x7f918c0038e0 2022-01-10T01:32:32.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5715700 1 --2- 172.21.15.36:0/1928969510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f918c004e70 0x7f918c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a4f14700 1 --2- 172.21.15.36:0/1928969510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f918c0038e0 0x7f918c003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919ffff700 1 --2- 172.21.15.36:0/1928969510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918c004500 0x7f918c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5715700 1 -- 172.21.15.36:0/1928969510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f918c0038e0 msgr2=0x7f918c003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:32.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5715700 1 --2- 172.21.15.36:0/1928969510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f918c0038e0 0x7f918c003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5715700 1 -- 172.21.15.36:0/1928969510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918c004500 msgr2=0x7f918c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:32.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5715700 1 --2- 172.21.15.36:0/1928969510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918c004500 0x7f918c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5715700 1 -- 172.21.15.36:0/1928969510 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918c003260 con 0x7f918c004e70 2022-01-10T01:32:32.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5715700 1 -- 172.21.15.36:0/1928969510 reap_dead start 2022-01-10T01:32:32.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5715700 1 --2- 172.21.15.36:0/1928969510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f918c004e70 0x7f918c00b750 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f91980017b0 tx=0x7f91a00a7480).ready entity=mon.0 client_cookie=19da1277907cd936 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:32.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f919800cc40 con 0x7f918c004e70 2022-01-10T01:32:32.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919800cda0 con 0x7f918c004e70 2022-01-10T01:32:32.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f919f7fe700 1 -- 172.21.15.36:0/1928969510 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9198005b80 con 0x7f918c004e70 2022-01-10T01:32:32.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5f16700 1 -- 172.21.15.36:0/1928969510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f918c004e70 msgr2=0x7f918c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5f16700 1 --2- 172.21.15.36:0/1928969510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f918c004e70 0x7f918c00b750 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f91980017b0 tx=0x7f91a00a7480).stop 2022-01-10T01:32:32.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5f16700 1 -- 172.21.15.36:0/1928969510 shutdown_connections 2022-01-10T01:32:32.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5f16700 1 --2- 172.21.15.36:0/1928969510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f918c004e70 0x7f918c00b750 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5f16700 1 -- 172.21.15.36:0/1928969510 >> 172.21.15.36:0/1928969510 conn(0x7f91a0060180 msgr2=0x7f91a00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:32.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5f16700 1 -- 172.21.15.36:0/1928969510 shutdown_connections 2022-01-10T01:32:32.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.187+0000 7f91a5f16700 1 -- 172.21.15.36:0/1928969510 wait complete. 2022-01-10T01:32:32.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5f16700 1 Processor -- start 2022-01-10T01:32:32.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5f16700 1 -- start start 2022-01-10T01:32:32.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5f16700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918c004e70 0x7f91a00ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5f16700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91a00ac000 0x7f91a00b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5f16700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91a00a9fe0 0x7f91a00aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5f16700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a00b3010 con 0x7f91a00a9fe0 2022-01-10T01:32:32.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5f16700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a00ac4a0 con 0x7f918c004e70 2022-01-10T01:32:32.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5f16700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a00b3240 con 0x7f91a00ac000 2022-01-10T01:32:32.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5715700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91a00a9fe0 0x7f91a00aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5715700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91a00a9fe0 0x7f91a00aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40894/0 (socket says 172.21.15.36:40894) 2022-01-10T01:32:32.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5715700 1 -- 172.21.15.36:0/1218339116 learned_addr learned my addr 172.21.15.36:0/1218339116 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:32.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a4f14700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918c004e70 0x7f91a00ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f919ffff700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91a00ac000 0x7f91a00b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5715700 1 -- 172.21.15.36:0/1218339116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91a00ac000 msgr2=0x7f91a00b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5715700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91a00ac000 0x7f91a00b3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5715700 1 -- 172.21.15.36:0/1218339116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918c004e70 msgr2=0x7f91a00ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5715700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918c004e70 0x7f91a00ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5715700 1 -- 172.21.15.36:0/1218339116 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a00b34e0 con 0x7f91a00a9fe0 2022-01-10T01:32:32.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a4f14700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918c004e70 0x7f91a00ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:32.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5715700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91a00a9fe0 0x7f91a00aa470 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f91980017b0 tx=0x7f9198013000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:32.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f919dffb700 1 -- 172.21.15.36:0/1218339116 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9198017070 con 0x7f91a00a9fe0 2022-01-10T01:32:32.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f919dffb700 1 -- 172.21.15.36:0/1218339116 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91980072e0 con 0x7f91a00a9fe0 2022-01-10T01:32:32.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5f16700 1 -- 172.21.15.36:0/1218339116 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a00ab870 con 0x7f91a00a9fe0 2022-01-10T01:32:32.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f919dffb700 1 -- 172.21.15.36:0/1218339116 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f919801a040 con 0x7f91a00a9fe0 2022-01-10T01:32:32.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5f16700 1 -- 172.21.15.36:0/1218339116 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a0141060 con 0x7f91a00a9fe0 2022-01-10T01:32:32.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.191+0000 7f91a5f16700 1 -- 172.21.15.36:0/1218339116 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a00b3670 con 0x7f91a00a9fe0 2022-01-10T01:32:32.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.195+0000 7f919dffb700 1 -- 172.21.15.36:0/1218339116 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9198010070 con 0x7f91a00a9fe0 2022-01-10T01:32:32.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.195+0000 7f919dffb700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9180053680 0x7f9180055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.195+0000 7f919dffb700 1 -- 172.21.15.36:0/1218339116 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f919806c440 con 0x7f91a00a9fe0 2022-01-10T01:32:32.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.195+0000 7f91a4f14700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9180053680 0x7f9180055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.195+0000 7f91a4f14700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9180053680 0x7f9180055b40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f919000d000 tx=0x7f9190009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:32.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.199+0000 7f919dffb700 1 -- 172.21.15.36:0/1218339116 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9198043300 con 0x7f91a00a9fe0 2022-01-10T01:32:32.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.331+0000 7f91a5f16700 1 -- 172.21.15.36:0/1218339116 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f91a0057350 con 0x7f91a00a9fe0 2022-01-10T01:32:32.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.331+0000 7f919dffb700 1 -- 172.21.15.36:0/1218339116 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v120) v1 ==== 110+0+10 (secure 0 0 0) 0x7f91980468e0 con 0x7f91a00a9fe0 2022-01-10T01:32:32.335 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:32:32.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.331+0000 7f91a5f16700 1 -- 172.21.15.36:0/1218339116 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9180053680 msgr2=0x7f9180055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.331+0000 7f91a5f16700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9180053680 0x7f9180055b40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f919000d000 tx=0x7f9190009040).stop 2022-01-10T01:32:32.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.331+0000 7f91a5f16700 1 -- 172.21.15.36:0/1218339116 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91a00a9fe0 msgr2=0x7f91a00aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.331+0000 7f91a5f16700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91a00a9fe0 0x7f91a00aa470 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f91980017b0 tx=0x7f9198013000).stop 2022-01-10T01:32:32.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.331+0000 7f91a5f16700 1 -- 172.21.15.36:0/1218339116 shutdown_connections 2022-01-10T01:32:32.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.331+0000 7f91a5f16700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9180053680 0x7f9180055b40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.331+0000 7f91a5f16700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91a00a9fe0 0x7f91a00aa470 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.331+0000 7f91a5f16700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91a00ac000 0x7f91a00b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.331+0000 7f91a5f16700 1 --2- 172.21.15.36:0/1218339116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f918c004e70 0x7f91a00ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.331+0000 7f91a5f16700 1 -- 172.21.15.36:0/1218339116 >> 172.21.15.36:0/1218339116 conn(0x7f91a0060180 msgr2=0x7f91a0144b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:32.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.335+0000 7f91a5f16700 1 -- 172.21.15.36:0/1218339116 shutdown_connections 2022-01-10T01:32:32.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.335+0000 7f91a5f16700 1 -- 172.21.15.36:0/1218339116 wait complete. 2022-01-10T01:32:32.354 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:32:32.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.455+0000 7f242bfff700 1 Processor -- start 2022-01-10T01:32:32.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.455+0000 7f242bfff700 1 -- start start 2022-01-10T01:32:32.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f242c0638d0 0x7f242c061ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f242c13e640 0x7f242c141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242bfff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242c0b0f40 con 0x7f242c0b17b0 2022-01-10T01:32:32.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242bfff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242c063cb0 con 0x7f242c13e640 2022-01-10T01:32:32.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242bfff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242c060070 con 0x7f242c0638d0 2022-01-10T01:32:32.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242b7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f242c13e640 0x7f242c141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f2423fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f242c0b17b0 0x7f242c13df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38694/0 (socket says 172.21.15.36:38694) 2022-01-10T01:32:32.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f2423fff700 1 -- 172.21.15.36:0/2375599241 learned_addr learned my addr 172.21.15.36:0/2375599241 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:32.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242affd700 1 --2- 172.21.15.36:0/2375599241 >> v2:172.21.15.59:3300/0 conn(0x7f242c0638d0 0x7f242c061ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242b7fe700 1 -- 172.21.15.36:0/2375599241 >> v2:172.21.15.59:3300/0 conn(0x7f242c0638d0 msgr2=0x7f242c061ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:32.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242b7fe700 1 --2- 172.21.15.36:0/2375599241 >> v2:172.21.15.59:3300/0 conn(0x7f242c0638d0 0x7f242c061ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242b7fe700 1 -- 172.21.15.36:0/2375599241 >> v1:172.21.15.36:6789/0 conn(0x7f242c0b17b0 legacy=0x7f242c13df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242b7fe700 1 -- 172.21.15.36:0/2375599241 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c0b1170 con 0x7f242c13e640 2022-01-10T01:32:32.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242a7fc700 1 -- 172.21.15.36:0/2375599241 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240773974 0 0) 0x7f242c0b0f40 con 0x7f242c0b17b0 2022-01-10T01:32:32.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242affd700 1 --2- 172.21.15.36:0/2375599241 >> v2:172.21.15.59:3300/0 conn(0x7f242c0638d0 0x7f242c061ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:32:32.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242b7fe700 1 --2- 172.21.15.36:0/2375599241 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f242c13e640 0x7f242c141330 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f24240032f0 tx=0x7f24240091d0).ready entity=mon.0 client_cookie=7f77d98a2cf88c88 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:32.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242a7fc700 1 -- 172.21.15.36:0/2375599241 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2424009ea0 con 0x7f242c13e640 2022-01-10T01:32:32.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242a7fc700 1 -- 172.21.15.36:0/2375599241 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242400b870 con 0x7f242c13e640 2022-01-10T01:32:32.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242a7fc700 1 -- 172.21.15.36:0/2375599241 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f242400b9e0 con 0x7f242c13e640 2022-01-10T01:32:32.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242bfff700 1 -- 172.21.15.36:0/2375599241 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f242c13e640 msgr2=0x7f242c141330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242bfff700 1 --2- 172.21.15.36:0/2375599241 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f242c13e640 0x7f242c141330 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f24240032f0 tx=0x7f24240091d0).stop 2022-01-10T01:32:32.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242bfff700 1 -- 172.21.15.36:0/2375599241 shutdown_connections 2022-01-10T01:32:32.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242bfff700 1 --2- 172.21.15.36:0/2375599241 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f242c13e640 0x7f242c141330 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242bfff700 1 --2- 172.21.15.36:0/2375599241 >> v2:172.21.15.59:3300/0 conn(0x7f242c0638d0 0x7f242c061ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242bfff700 1 -- 172.21.15.36:0/2375599241 >> 172.21.15.36:0/2375599241 conn(0x7f242c05c490 msgr2=0x7f242c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:32.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242bfff700 1 -- 172.21.15.36:0/2375599241 shutdown_connections 2022-01-10T01:32:32.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.459+0000 7f242bfff700 1 -- 172.21.15.36:0/2375599241 wait complete. 2022-01-10T01:32:32.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f242bfff700 1 Processor -- start 2022-01-10T01:32:32.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f242bfff700 1 -- start start 2022-01-10T01:32:32.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f242bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242c0638d0 0x7f242c153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f242bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f242c0b17b0 0x7f242c1345a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f242bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242c13e640 0x7f242c135ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f242bfff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c133d30 con 0x7f242c0b17b0 2022-01-10T01:32:32.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f242bfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c134fd0 con 0x7f242c13e640 2022-01-10T01:32:32.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f242bfff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c1359e0 con 0x7f242c0638d0 2022-01-10T01:32:32.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f2423fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f242c0b17b0 0x7f242c1345a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f2423fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f242c0b17b0 0x7f242c1345a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40908/0 (socket says 172.21.15.36:40908) 2022-01-10T01:32:32.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f2423fff700 1 -- 172.21.15.36:0/791239186 learned_addr learned my addr 172.21.15.36:0/791239186 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:32.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f242b7fe700 1 --2- 172.21.15.36:0/791239186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242c13e640 0x7f242c135ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f242affd700 1 --2- 172.21.15.36:0/791239186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242c0638d0 0x7f242c153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f2423fff700 1 -- 172.21.15.36:0/791239186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242c0638d0 msgr2=0x7f242c153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f2423fff700 1 --2- 172.21.15.36:0/791239186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242c0638d0 0x7f242c153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f2423fff700 1 -- 172.21.15.36:0/791239186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242c13e640 msgr2=0x7f242c135ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f2423fff700 1 --2- 172.21.15.36:0/791239186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242c13e640 0x7f242c135ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f2423fff700 1 -- 172.21.15.36:0/791239186 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2424009470 con 0x7f242c0b17b0 2022-01-10T01:32:32.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f2423fff700 1 --2- 172.21.15.36:0/791239186 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f242c0b17b0 0x7f242c1345a0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f2414000ed0 tx=0x7f2414007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:32.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.463+0000 7f2428ff9700 1 -- 172.21.15.36:0/791239186 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f24140070d0 con 0x7f242c0b17b0 2022-01-10T01:32:32.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.467+0000 7f2428ff9700 1 -- 172.21.15.36:0/791239186 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2414007230 con 0x7f242c0b17b0 2022-01-10T01:32:32.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.467+0000 7f242bfff700 1 -- 172.21.15.36:0/791239186 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242c135200 con 0x7f242c0b17b0 2022-01-10T01:32:32.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.467+0000 7f2428ff9700 1 -- 172.21.15.36:0/791239186 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2414005610 con 0x7f242c0b17b0 2022-01-10T01:32:32.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.467+0000 7f242bfff700 1 -- 172.21.15.36:0/791239186 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242c135740 con 0x7f242c0b17b0 2022-01-10T01:32:32.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.467+0000 7f242bfff700 1 -- 172.21.15.36:0/791239186 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242c1539e0 con 0x7f242c0b17b0 2022-01-10T01:32:32.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.467+0000 7f2428ff9700 1 -- 172.21.15.36:0/791239186 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f241401a060 con 0x7f242c0b17b0 2022-01-10T01:32:32.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.467+0000 7f2428ff9700 1 --2- 172.21.15.36:0/791239186 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24100535f0 0x7f2410055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.467+0000 7f242affd700 1 --2- 172.21.15.36:0/791239186 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24100535f0 0x7f2410055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.467+0000 7f2428ff9700 1 -- 172.21.15.36:0/791239186 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f241406b790 con 0x7f242c0b17b0 2022-01-10T01:32:32.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.471+0000 7f242affd700 1 --2- 172.21.15.36:0/791239186 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24100535f0 0x7f2410055ab0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f241c00d000 tx=0x7f241c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:32.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.475+0000 7f2428ff9700 1 -- 172.21.15.36:0/791239186 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2414042690 con 0x7f242c0b17b0 2022-01-10T01:32:32.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.603+0000 7f242bfff700 1 -- 172.21.15.36:0/791239186 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f242c0b1410 con 0x7f242c0b17b0 2022-01-10T01:32:32.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.603+0000 7f2428ff9700 1 -- 172.21.15.36:0/791239186 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v120) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2414018020 con 0x7f242c0b17b0 2022-01-10T01:32:32.609 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:32:32.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.607+0000 7f242bfff700 1 -- 172.21.15.36:0/791239186 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24100535f0 msgr2=0x7f2410055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.607+0000 7f242bfff700 1 --2- 172.21.15.36:0/791239186 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24100535f0 0x7f2410055ab0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f241c00d000 tx=0x7f241c008040).stop 2022-01-10T01:32:32.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.607+0000 7f242bfff700 1 -- 172.21.15.36:0/791239186 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f242c0b17b0 msgr2=0x7f242c1345a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.607+0000 7f242bfff700 1 --2- 172.21.15.36:0/791239186 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f242c0b17b0 0x7f242c1345a0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f2414000ed0 tx=0x7f2414007ac0).stop 2022-01-10T01:32:32.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.607+0000 7f242bfff700 1 -- 172.21.15.36:0/791239186 shutdown_connections 2022-01-10T01:32:32.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.607+0000 7f242bfff700 1 --2- 172.21.15.36:0/791239186 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f24100535f0 0x7f2410055ab0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.607+0000 7f242bfff700 1 --2- 172.21.15.36:0/791239186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f242c13e640 0x7f242c135ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.607+0000 7f242bfff700 1 --2- 172.21.15.36:0/791239186 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f242c0b17b0 0x7f242c1345a0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.607+0000 7f242bfff700 1 --2- 172.21.15.36:0/791239186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f242c0638d0 0x7f242c153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.607+0000 7f242bfff700 1 -- 172.21.15.36:0/791239186 >> 172.21.15.36:0/791239186 conn(0x7f242c05c490 msgr2=0x7f242c13aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:32.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.607+0000 7f242bfff700 1 -- 172.21.15.36:0/791239186 shutdown_connections 2022-01-10T01:32:32.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.607+0000 7f242bfff700 1 -- 172.21.15.36:0/791239186 wait complete. 2022-01-10T01:32:32.623 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:32:32.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.727+0000 7f599fd23700 1 Processor -- start 2022-01-10T01:32:32.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.727+0000 7f599fd23700 1 -- start start 2022-01-10T01:32:32.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.727+0000 7f599fd23700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5998146950 0x7f5998140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.727+0000 7f599fd23700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59980b4180 0x7f5998140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.727+0000 7f599fd23700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59980b4690 0x7f59980b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.727+0000 7f599fd23700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5998147510 con 0x7f5998146950 2022-01-10T01:32:32.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.727+0000 7f599fd23700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5998143b60 con 0x7f59980b4690 2022-01-10T01:32:32.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.727+0000 7f599fd23700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5998143e00 con 0x7f59980b4180 2022-01-10T01:32:32.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.727+0000 7f599dabf700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5998146950 0x7f5998140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.727+0000 7f599dabf700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5998146950 0x7f5998140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40914/0 (socket says 172.21.15.36:40914) 2022-01-10T01:32:32.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.727+0000 7f599dabf700 1 -- 172.21.15.36:0/3850336602 learned_addr learned my addr 172.21.15.36:0/3850336602 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:32.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599d2be700 1 --2- 172.21.15.36:0/3850336602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59980b4180 0x7f5998140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599e2c0700 1 --2- 172.21.15.36:0/3850336602 >> v2:172.21.15.59:3300/0 conn(0x7f59980b4690 0x7f59980b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599dabf700 1 -- 172.21.15.36:0/3850336602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59980b4180 msgr2=0x7f5998140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:32.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599dabf700 1 --2- 172.21.15.36:0/3850336602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59980b4180 0x7f5998140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599dabf700 1 -- 172.21.15.36:0/3850336602 >> v2:172.21.15.59:3300/0 conn(0x7f59980b4690 msgr2=0x7f59980b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:32.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599dabf700 1 --2- 172.21.15.36:0/3850336602 >> v2:172.21.15.59:3300/0 conn(0x7f59980b4690 0x7f59980b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599dabf700 1 -- 172.21.15.36:0/3850336602 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59980b0c90 con 0x7f5998146950 2022-01-10T01:32:32.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599dabf700 1 --2- 172.21.15.36:0/3850336602 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5998146950 0x7f5998140230 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f5988002f70 tx=0x7f5988006eb0).ready entity=mon.0 client_cookie=8c74c459da3d2ba2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:32.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599cabd700 1 -- 172.21.15.36:0/3850336602 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f598800d570 con 0x7f5998146950 2022-01-10T01:32:32.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599cabd700 1 -- 172.21.15.36:0/3850336602 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5988000e90 con 0x7f5998146950 2022-01-10T01:32:32.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599cabd700 1 -- 172.21.15.36:0/3850336602 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f598800d900 con 0x7f5998146950 2022-01-10T01:32:32.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 -- 172.21.15.36:0/3850336602 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5998146950 msgr2=0x7f5998140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 --2- 172.21.15.36:0/3850336602 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5998146950 0x7f5998140230 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f5988002f70 tx=0x7f5988006eb0).stop 2022-01-10T01:32:32.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 -- 172.21.15.36:0/3850336602 shutdown_connections 2022-01-10T01:32:32.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 --2- 172.21.15.36:0/3850336602 >> v2:172.21.15.59:3300/0 conn(0x7f59980b4690 0x7f59980b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 --2- 172.21.15.36:0/3850336602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59980b4180 0x7f5998140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 --2- 172.21.15.36:0/3850336602 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5998146950 0x7f5998140230 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 -- 172.21.15.36:0/3850336602 >> 172.21.15.36:0/3850336602 conn(0x7f599805c490 msgr2=0x7f599805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:32.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 -- 172.21.15.36:0/3850336602 shutdown_connections 2022-01-10T01:32:32.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 -- 172.21.15.36:0/3850336602 wait complete. 2022-01-10T01:32:32.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 Processor -- start 2022-01-10T01:32:32.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 -- start start 2022-01-10T01:32:32.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59980b4180 0x7f59980b88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59980b4690 0x7f5998152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5998146950 0x7f5998152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5998153470 con 0x7f59980b4180 2022-01-10T01:32:32.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5998152630 con 0x7f59980b4690 2022-01-10T01:32:32.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599fd23700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59981427b0 con 0x7f5998146950 2022-01-10T01:32:32.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599dabf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59980b4180 0x7f59980b88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599dabf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59980b4180 0x7f59980b88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40922/0 (socket says 172.21.15.36:40922) 2022-01-10T01:32:32.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599dabf700 1 -- 172.21.15.36:0/3056792574 learned_addr learned my addr 172.21.15.36:0/3056792574 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:32.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599e2c0700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5998146950 0x7f5998152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599d2be700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59980b4690 0x7f5998152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599dabf700 1 -- 172.21.15.36:0/3056792574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5998146950 msgr2=0x7f5998152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599dabf700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5998146950 0x7f5998152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599dabf700 1 -- 172.21.15.36:0/3056792574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59980b4690 msgr2=0x7f5998152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599dabf700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59980b4690 0x7f5998152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599dabf700 1 -- 172.21.15.36:0/3056792574 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598800b1e0 con 0x7f59980b4180 2022-01-10T01:32:32.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.731+0000 7f599d2be700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59980b4690 0x7f5998152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:32.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.735+0000 7f599dabf700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59980b4180 0x7f59980b88a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f5998142940 tx=0x7f5988015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:32.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.735+0000 7f5996ffd700 1 -- 172.21.15.36:0/3056792574 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5988006b40 con 0x7f59980b4180 2022-01-10T01:32:32.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.735+0000 7f5996ffd700 1 -- 172.21.15.36:0/3056792574 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598800d8f0 con 0x7f59980b4180 2022-01-10T01:32:32.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.735+0000 7f599fd23700 1 -- 172.21.15.36:0/3056792574 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5998142270 con 0x7f59980b4180 2022-01-10T01:32:32.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.735+0000 7f5996ffd700 1 -- 172.21.15.36:0/3056792574 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5988011de0 con 0x7f59980b4180 2022-01-10T01:32:32.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.735+0000 7f599fd23700 1 -- 172.21.15.36:0/3056792574 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5998144df0 con 0x7f59980b4180 2022-01-10T01:32:32.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.735+0000 7f599fd23700 1 -- 172.21.15.36:0/3056792574 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5998141080 con 0x7f59980b4180 2022-01-10T01:32:32.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.735+0000 7f5996ffd700 1 -- 172.21.15.36:0/3056792574 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5988025030 con 0x7f59980b4180 2022-01-10T01:32:32.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.735+0000 7f5996ffd700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59780534d0 0x7f5978055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:32.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.735+0000 7f5996ffd700 1 -- 172.21.15.36:0/3056792574 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f598806ccb0 con 0x7f59980b4180 2022-01-10T01:32:32.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.735+0000 7f599d2be700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59780534d0 0x7f5978055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:32.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.739+0000 7f599d2be700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59780534d0 0x7f5978055990 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f598c00c000 tx=0x7f598c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:32.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.743+0000 7f5996ffd700 1 -- 172.21.15.36:0/3056792574 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5998141080 con 0x7f59980b4180 2022-01-10T01:32:32.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.871+0000 7f599fd23700 1 -- 172.21.15.36:0/3056792574 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5998141080 con 0x7f59980b4180 2022-01-10T01:32:32.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.871+0000 7f5996ffd700 1 -- 172.21.15.36:0/3056792574 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v120) v1 ==== 104+0+10 (secure 0 0 0) 0x7f5998141080 con 0x7f59980b4180 2022-01-10T01:32:32.877 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:32:32.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.875+0000 7f599fd23700 1 -- 172.21.15.36:0/3056792574 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59780534d0 msgr2=0x7f5978055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.875+0000 7f599fd23700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59780534d0 0x7f5978055990 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f598c00c000 tx=0x7f598c008040).stop 2022-01-10T01:32:32.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.875+0000 7f599fd23700 1 -- 172.21.15.36:0/3056792574 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59980b4180 msgr2=0x7f59980b88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:32.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.875+0000 7f599fd23700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59980b4180 0x7f59980b88a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f5998142940 tx=0x7f5988015000).stop 2022-01-10T01:32:32.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.875+0000 7f599fd23700 1 -- 172.21.15.36:0/3056792574 shutdown_connections 2022-01-10T01:32:32.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.875+0000 7f599fd23700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f59780534d0 0x7f5978055990 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.875+0000 7f599fd23700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5998146950 0x7f5998152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.875+0000 7f599fd23700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59980b4690 0x7f5998152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.875+0000 7f599fd23700 1 --2- 172.21.15.36:0/3056792574 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f59980b4180 0x7f59980b88a0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:32.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.875+0000 7f599fd23700 1 -- 172.21.15.36:0/3056792574 >> 172.21.15.36:0/3056792574 conn(0x7f599805c490 msgr2=0x7f5998145bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:32.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.875+0000 7f599fd23700 1 -- 172.21.15.36:0/3056792574 shutdown_connections 2022-01-10T01:32:32.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:32.875+0000 7f599fd23700 1 -- 172.21.15.36:0/3056792574 wait complete. 2022-01-10T01:32:32.895 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:32:33.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f92631700 1 Processor -- start 2022-01-10T01:32:33.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f92631700 1 -- start start 2022-01-10T01:32:33.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f92631700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f8c061320 0x7f9f8c061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f92631700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8c0ad5c0 0x7f9f8c0b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f92631700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8c0aecf0 con 0x7f9f8c140440 2022-01-10T01:32:33.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f92631700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8c0b6f20 con 0x7f9f8c061320 2022-01-10T01:32:33.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f92631700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0aef20 con 0x7f9f8c0ad5c0 2022-01-10T01:32:33.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f9162f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f8c061320 0x7f9f8c061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f90e2e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8c0ad5c0 0x7f9f8c0b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f9162f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f8c061320 0x7f9f8c061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:37562/0 (socket says 172.21.15.36:37562) 2022-01-10T01:32:33.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f9162f700 1 -- 172.21.15.36:0/321052254 learned_addr learned my addr 172.21.15.36:0/321052254 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:33.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f9162f700 1 -- 172.21.15.36:0/321052254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8c0ad5c0 msgr2=0x7f9f8c0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:33.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f9162f700 1 --2- 172.21.15.36:0/321052254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8c0ad5c0 0x7f9f8c0b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f9162f700 1 -- 172.21.15.36:0/321052254 >> v1:172.21.15.59:6789/0 conn(0x7f9f8c140440 legacy=0x7f9f8c146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:33.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f9162f700 1 -- 172.21.15.36:0/321052254 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c0af1c0 con 0x7f9f8c061320 2022-01-10T01:32:33.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.003+0000 7f9f90e2e700 1 --2- 172.21.15.36:0/321052254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8c0ad5c0 0x7f9f8c0b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:33.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f9162f700 1 --2- 172.21.15.36:0/321052254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f8c061320 0x7f9f8c061700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f9f7c002f70 tx=0x7f9f7c006eb0).ready entity=mon.1 client_cookie=c7349916ff8e6279 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:33.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f8bfff700 1 -- 172.21.15.36:0/321052254 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f7c00d570 con 0x7f9f8c061320 2022-01-10T01:32:33.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f8bfff700 1 -- 172.21.15.36:0/321052254 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c000e90 con 0x7f9f8c061320 2022-01-10T01:32:33.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f8bfff700 1 -- 172.21.15.36:0/321052254 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f7c00d900 con 0x7f9f8c061320 2022-01-10T01:32:33.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 -- 172.21.15.36:0/321052254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f8c061320 msgr2=0x7f9f8c061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:33.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 --2- 172.21.15.36:0/321052254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f8c061320 0x7f9f8c061700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f9f7c002f70 tx=0x7f9f7c006eb0).stop 2022-01-10T01:32:33.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 -- 172.21.15.36:0/321052254 shutdown_connections 2022-01-10T01:32:33.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 --2- 172.21.15.36:0/321052254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8c0ad5c0 0x7f9f8c0b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 --2- 172.21.15.36:0/321052254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f8c061320 0x7f9f8c061700 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 -- 172.21.15.36:0/321052254 >> 172.21.15.36:0/321052254 conn(0x7f9f8c066de0 msgr2=0x7f9f8c0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:33.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 -- 172.21.15.36:0/321052254 shutdown_connections 2022-01-10T01:32:33.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 -- 172.21.15.36:0/321052254 wait complete. 2022-01-10T01:32:33.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 Processor -- start 2022-01-10T01:32:33.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 -- start start 2022-01-10T01:32:33.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8c061320 0x7f9f8c0b8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f8c0ad5c0 0x7f9f8c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f8c140440 0x7f9f8c155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c09f4b0 con 0x7f9f8c140440 2022-01-10T01:32:33.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0b3660 con 0x7f9f8c0ad5c0 2022-01-10T01:32:33.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.007+0000 7f9f92631700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c09f200 con 0x7f9f8c061320 2022-01-10T01:32:33.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f91e30700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f8c140440 0x7f9f8c155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f9162f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8c061320 0x7f9f8c0b8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f90e2e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f8c0ad5c0 0x7f9f8c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f91e30700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f8c140440 0x7f9f8c155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40938/0 (socket says 172.21.15.36:40938) 2022-01-10T01:32:33.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f91e30700 1 -- 172.21.15.36:0/2773431573 learned_addr learned my addr 172.21.15.36:0/2773431573 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:33.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f91e30700 1 -- 172.21.15.36:0/2773431573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8c061320 msgr2=0x7f9f8c0b8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:33.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f91e30700 1 --2- 172.21.15.36:0/2773431573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8c061320 0x7f9f8c0b8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f91e30700 1 -- 172.21.15.36:0/2773431573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f8c0ad5c0 msgr2=0x7f9f8c155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:33.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f91e30700 1 --2- 172.21.15.36:0/2773431573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f8c0ad5c0 0x7f9f8c155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f91e30700 1 -- 172.21.15.36:0/2773431573 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8000b180 con 0x7f9f8c140440 2022-01-10T01:32:33.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f90e2e700 1 --2- 172.21.15.36:0/2773431573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f8c0ad5c0 0x7f9f8c155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:33.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f9162f700 1 --2- 172.21.15.36:0/2773431573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8c061320 0x7f9f8c0b8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:33.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f91e30700 1 --2- 172.21.15.36:0/2773431573 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f8c140440 0x7f9f8c155f80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f9f8c143000 tx=0x7f9f840013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:33.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f8a7fc700 1 -- 172.21.15.36:0/2773431573 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f84006aa0 con 0x7f9f8c140440 2022-01-10T01:32:33.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f8a7fc700 1 -- 172.21.15.36:0/2773431573 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84006c00 con 0x7f9f8c140440 2022-01-10T01:32:33.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f92631700 1 -- 172.21.15.36:0/2773431573 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7c00b1e0 con 0x7f9f8c140440 2022-01-10T01:32:33.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f8a7fc700 1 -- 172.21.15.36:0/2773431573 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f84007030 con 0x7f9f8c140440 2022-01-10T01:32:33.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f92631700 1 -- 172.21.15.36:0/2773431573 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c0b38c0 con 0x7f9f8c140440 2022-01-10T01:32:33.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f8a7fc700 1 -- 172.21.15.36:0/2773431573 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9f84010030 con 0x7f9f8c140440 2022-01-10T01:32:33.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.011+0000 7f9f92631700 1 -- 172.21.15.36:0/2773431573 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8c0b3a80 con 0x7f9f8c140440 2022-01-10T01:32:33.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.015+0000 7f9f8a7fc700 1 --2- 172.21.15.36:0/2773431573 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9f6c0534d0 0x7f9f6c055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.015+0000 7f9f8a7fc700 1 -- 172.21.15.36:0/2773431573 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9f8406b840 con 0x7f9f8c140440 2022-01-10T01:32:33.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.015+0000 7f9f9162f700 1 --2- 172.21.15.36:0/2773431573 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9f6c0534d0 0x7f9f6c055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.015+0000 7f9f9162f700 1 --2- 172.21.15.36:0/2773431573 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9f6c0534d0 0x7f9f6c055990 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f9f7c01c000 tx=0x7f9f7c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:33.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.019+0000 7f9f8a7fc700 1 -- 172.21.15.36:0/2773431573 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9f84042850 con 0x7f9f8c140440 2022-01-10T01:32:33.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.151+0000 7f9f92631700 1 -- 172.21.15.36:0/2773431573 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f8c0af460 con 0x7f9f8c140440 2022-01-10T01:32:33.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.151+0000 7f9f8a7fc700 1 -- 172.21.15.36:0/2773431573 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v120) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9f84045e70 con 0x7f9f8c140440 2022-01-10T01:32:33.156 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:32:33.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.155+0000 7f9f92631700 1 -- 172.21.15.36:0/2773431573 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9f6c0534d0 msgr2=0x7f9f6c055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:33.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.155+0000 7f9f92631700 1 --2- 172.21.15.36:0/2773431573 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9f6c0534d0 0x7f9f6c055990 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f9f7c01c000 tx=0x7f9f7c015000).stop 2022-01-10T01:32:33.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.155+0000 7f9f92631700 1 -- 172.21.15.36:0/2773431573 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f8c140440 msgr2=0x7f9f8c155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:33.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.155+0000 7f9f92631700 1 --2- 172.21.15.36:0/2773431573 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f8c140440 0x7f9f8c155f80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f9f8c143000 tx=0x7f9f840013a0).stop 2022-01-10T01:32:33.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.155+0000 7f9f92631700 1 -- 172.21.15.36:0/2773431573 shutdown_connections 2022-01-10T01:32:33.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.155+0000 7f9f92631700 1 --2- 172.21.15.36:0/2773431573 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9f6c0534d0 0x7f9f6c055990 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.155+0000 7f9f92631700 1 --2- 172.21.15.36:0/2773431573 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9f8c140440 0x7f9f8c155f80 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.155+0000 7f9f92631700 1 --2- 172.21.15.36:0/2773431573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f8c0ad5c0 0x7f9f8c155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.155+0000 7f9f92631700 1 --2- 172.21.15.36:0/2773431573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f8c061320 0x7f9f8c0b8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.155+0000 7f9f92631700 1 -- 172.21.15.36:0/2773431573 >> 172.21.15.36:0/2773431573 conn(0x7f9f8c066de0 msgr2=0x7f9f8c140940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:33.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.155+0000 7f9f92631700 1 -- 172.21.15.36:0/2773431573 shutdown_connections 2022-01-10T01:32:33.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.155+0000 7f9f92631700 1 -- 172.21.15.36:0/2773431573 wait complete. 2022-01-10T01:32:33.175 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:32:33.175 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:32:33.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2f59e700 1 Processor -- start 2022-01-10T01:32:33.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2f59e700 1 -- start start 2022-01-10T01:32:33.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2f59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b300b3040 0x7f1b30065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b30140140 0x7f1b301405f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2f59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b30066ea0 con 0x7f1b300a9c10 2022-01-10T01:32:33.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2f59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b300648e0 con 0x7f1b300b3040 2022-01-10T01:32:33.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30061dd0 con 0x7f1b30140140 2022-01-10T01:32:33.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2dd9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f1b300a9c10 0x7f1b300607c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38738/0 (socket says 172.21.15.36:38738) 2022-01-10T01:32:33.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2dd9b700 1 -- 172.21.15.36:0/2885263206 learned_addr learned my addr 172.21.15.36:0/2885263206 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:33.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2ed9d700 1 --2- 172.21.15.36:0/2885263206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b30140140 0x7f1b301405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2e59c700 1 --2- 172.21.15.36:0/2885263206 >> v2:172.21.15.59:3300/0 conn(0x7f1b300b3040 0x7f1b30065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 -- 172.21.15.36:0/2885263206 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621502245 0 0) 0x7f1b30066ea0 con 0x7f1b300a9c10 2022-01-10T01:32:33.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 -- 172.21.15.36:0/2885263206 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b10005470 con 0x7f1b300a9c10 2022-01-10T01:32:33.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 -- 172.21.15.36:0/2885263206 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4067510124 0 0) 0x7f1b10005470 con 0x7f1b300a9c10 2022-01-10T01:32:33.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 -- 172.21.15.36:0/2885263206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b30140140 msgr2=0x7f1b301405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:33.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 --2- 172.21.15.36:0/2885263206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b30140140 0x7f1b301405f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 -- 172.21.15.36:0/2885263206 >> v2:172.21.15.59:3300/0 conn(0x7f1b300b3040 msgr2=0x7f1b30065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:33.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 --2- 172.21.15.36:0/2885263206 >> v2:172.21.15.59:3300/0 conn(0x7f1b300b3040 0x7f1b30065e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 -- 172.21.15.36:0/2885263206 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b300b3420 con 0x7f1b300a9c10 2022-01-10T01:32:33.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 -- 172.21.15.36:0/2885263206 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f1b18001660 con 0x7f1b300a9c10 2022-01-10T01:32:33.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2ed9d700 1 --2- 172.21.15.36:0/2885263206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b30140140 0x7f1b301405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:33.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 -- 172.21.15.36:0/2885263206 >> v1:172.21.15.36:6789/0 conn(0x7f1b300a9c10 legacy=0x7f1b300607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:33.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 --2- 172.21.15.36:0/2885263206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b10005960 0x7f1b10005d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 --2- 172.21.15.36:0/2885263206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b10006710 0x7f1b10006b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 --2- 172.21.15.36:0/2885263206 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1b10007080 0x7f1b1000d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 -- 172.21.15.36:0/2885263206 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b10006530 con 0x7f1b10007080 2022-01-10T01:32:33.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 -- 172.21.15.36:0/2885263206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1000de50 con 0x7f1b10006710 2022-01-10T01:32:33.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.271+0000 7f1b2d59a700 1 -- 172.21.15.36:0/2885263206 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1000dfc0 con 0x7f1b10005960 2022-01-10T01:32:33.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2ed9d700 1 --2- 172.21.15.36:0/2885263206 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1b10007080 0x7f1b1000d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2dd9b700 1 --2- 172.21.15.36:0/2885263206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b10006710 0x7f1b10006b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2e59c700 1 --2- 172.21.15.36:0/2885263206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b10005960 0x7f1b10005d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2ed9d700 1 -- 172.21.15.36:0/2885263206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b10005960 msgr2=0x7f1b10005d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:33.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2ed9d700 1 --2- 172.21.15.36:0/2885263206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b10005960 0x7f1b10005d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2ed9d700 1 -- 172.21.15.36:0/2885263206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b10006710 msgr2=0x7f1b10006b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:33.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2ed9d700 1 --2- 172.21.15.36:0/2885263206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b10006710 0x7f1b10006b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2ed9d700 1 -- 172.21.15.36:0/2885263206 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b10005470 con 0x7f1b10007080 2022-01-10T01:32:33.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2dd9b700 1 --2- 172.21.15.36:0/2885263206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b10006710 0x7f1b10006b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:33.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2ed9d700 1 --2- 172.21.15.36:0/2885263206 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1b10007080 0x7f1b1000d960 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f1b2000c000 tx=0x7f1b200091d0).ready entity=mon.0 client_cookie=4f57c827dacdab8c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:33.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2d59a700 1 -- 172.21.15.36:0/2885263206 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b200096e0 con 0x7f1b10007080 2022-01-10T01:32:33.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2d59a700 1 -- 172.21.15.36:0/2885263206 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2000e6c0 con 0x7f1b10007080 2022-01-10T01:32:33.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2d59a700 1 -- 172.21.15.36:0/2885263206 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b2000ea20 con 0x7f1b10007080 2022-01-10T01:32:33.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2f59e700 1 -- 172.21.15.36:0/2885263206 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1b10007080 msgr2=0x7f1b1000d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:33.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2f59e700 1 --2- 172.21.15.36:0/2885263206 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1b10007080 0x7f1b1000d960 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f1b2000c000 tx=0x7f1b200091d0).stop 2022-01-10T01:32:33.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2ed9d700 1 -- 172.21.15.36:0/2885263206 reap_dead start 2022-01-10T01:32:33.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2f59e700 1 -- 172.21.15.36:0/2885263206 shutdown_connections 2022-01-10T01:32:33.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2f59e700 1 -- 172.21.15.36:0/2885263206 >> 172.21.15.36:0/2885263206 conn(0x7f1b300636e0 msgr2=0x7f1b30063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:33.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2f59e700 1 -- 172.21.15.36:0/2885263206 shutdown_connections 2022-01-10T01:32:33.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2f59e700 1 -- 172.21.15.36:0/2885263206 wait complete. 2022-01-10T01:32:33.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2f59e700 1 Processor -- start 2022-01-10T01:32:33.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.275+0000 7f1b2f59e700 1 -- start start 2022-01-10T01:32:33.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2f59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1b300aaee0 0x7f1b300ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b30142030 0x7f1b301429f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b300ab7b0 0x7f1b30142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2f59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30141870 con 0x7f1b300aaee0 2022-01-10T01:32:33.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2f59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30152d70 con 0x7f1b30142030 2022-01-10T01:32:33.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30153010 con 0x7f1b300ab7b0 2022-01-10T01:32:33.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1b300aaee0 0x7f1b300ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1b300aaee0 0x7f1b300ab2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40952/0 (socket says 172.21.15.36:40952) 2022-01-10T01:32:33.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2e59c700 1 -- 172.21.15.36:0/162019026 learned_addr learned my addr 172.21.15.36:0/162019026 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:33.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2ed9d700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b300ab7b0 0x7f1b30142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2dd9b700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b30142030 0x7f1b301429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2e59c700 1 -- 172.21.15.36:0/162019026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b300ab7b0 msgr2=0x7f1b30142ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:33.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2e59c700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b300ab7b0 0x7f1b30142ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2e59c700 1 -- 172.21.15.36:0/162019026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b30142030 msgr2=0x7f1b301429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:33.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2e59c700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b30142030 0x7f1b301429f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2e59c700 1 -- 172.21.15.36:0/162019026 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b301412e0 con 0x7f1b300aaee0 2022-01-10T01:32:33.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2dd9b700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b30142030 0x7f1b301429f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:33.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2e59c700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1b300aaee0 0x7f1b300ab2c0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f1b2800b000 tx=0x7f1b28008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:33.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b277fe700 1 -- 172.21.15.36:0/162019026 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b28012610 con 0x7f1b300aaee0 2022-01-10T01:32:33.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b277fe700 1 -- 172.21.15.36:0/162019026 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28012770 con 0x7f1b300aaee0 2022-01-10T01:32:33.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2f59e700 1 -- 172.21.15.36:0/162019026 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b30141560 con 0x7f1b300aaee0 2022-01-10T01:32:33.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b277fe700 1 -- 172.21.15.36:0/162019026 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b28012ad0 con 0x7f1b300aaee0 2022-01-10T01:32:33.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.279+0000 7f1b2f59e700 1 -- 172.21.15.36:0/162019026 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b301521e0 con 0x7f1b300aaee0 2022-01-10T01:32:33.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.283+0000 7f1b2f59e700 1 -- 172.21.15.36:0/162019026 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b301531d0 con 0x7f1b300aaee0 2022-01-10T01:32:33.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.283+0000 7f1b277fe700 1 -- 172.21.15.36:0/162019026 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1b28012c30 con 0x7f1b300aaee0 2022-01-10T01:32:33.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.283+0000 7f1b277fe700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1b14053680 0x7f1b14055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:33.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.283+0000 7f1b277fe700 1 -- 172.21.15.36:0/162019026 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1b2806c3f0 con 0x7f1b300aaee0 2022-01-10T01:32:33.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.283+0000 7f1b2dd9b700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1b14053680 0x7f1b14055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:33.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.283+0000 7f1b2dd9b700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1b14053680 0x7f1b14055b40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f1b1800d000 tx=0x7f1b18009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:33.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.291+0000 7f1b277fe700 1 -- 172.21.15.36:0/162019026 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1b280432f0 con 0x7f1b300aaee0 2022-01-10T01:32:33.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.451+0000 7f1b2f59e700 1 -- 172.21.15.36:0/162019026 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b30066960 con 0x7f1b300aaee0 2022-01-10T01:32:33.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.451+0000 7f1b277fe700 1 -- 172.21.15.36:0/162019026 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f1b28046910 con 0x7f1b300aaee0 2022-01-10T01:32:33.457 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:33.458 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":56,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7590,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/2655140224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":2655140224},{"type":"v1","addr":"172.21.15.36:6837","nonce":2655140224}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":54},{"gid":7597,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/772662757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":772662757},{"type":"v1","addr":"172.21.15.59:6833","nonce":772662757}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:32:28.774139+0000","modified":"2022-01-10T01:32:29.795777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":36638},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36638":{"gid":36638,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/1669955501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":1669955501},{"type":"v1","addr":"172.21.15.36:6835","nonce":1669955501}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2022-01-10T01:32:33.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.455+0000 7f1b2f59e700 1 -- 172.21.15.36:0/162019026 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1b14053680 msgr2=0x7f1b14055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:33.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.455+0000 7f1b2f59e700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1b14053680 0x7f1b14055b40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f1b1800d000 tx=0x7f1b18009040).stop 2022-01-10T01:32:33.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.455+0000 7f1b2f59e700 1 -- 172.21.15.36:0/162019026 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1b300aaee0 msgr2=0x7f1b300ab2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:33.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.455+0000 7f1b2f59e700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1b300aaee0 0x7f1b300ab2c0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f1b2800b000 tx=0x7f1b28008040).stop 2022-01-10T01:32:33.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.455+0000 7f1b2f59e700 1 -- 172.21.15.36:0/162019026 shutdown_connections 2022-01-10T01:32:33.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.455+0000 7f1b2f59e700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1b14053680 0x7f1b14055b40 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.455+0000 7f1b2f59e700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b300ab7b0 0x7f1b30142ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.455+0000 7f1b2f59e700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b30142030 0x7f1b301429f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.455+0000 7f1b2f59e700 1 --2- 172.21.15.36:0/162019026 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1b300aaee0 0x7f1b300ab2c0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:33.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.455+0000 7f1b2f59e700 1 -- 172.21.15.36:0/162019026 >> 172.21.15.36:0/162019026 conn(0x7f1b300636e0 msgr2=0x7f1b3013c990 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:33.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.455+0000 7f1b2f59e700 1 -- 172.21.15.36:0/162019026 shutdown_connections 2022-01-10T01:32:33.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:33.455+0000 7f1b2f59e700 1 -- 172.21.15.36:0/162019026 wait complete. 2022-01-10T01:32:33.464 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 56 2022-01-10T01:32:33.780 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:32:28.774139+0000', 'modified': '2022-01-10T01:32:29.795777+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 36638}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_36638': {'gid': 36638, 'name': 'c', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6835/1669955501', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6834', 'nonce': 1669955501}, {'type': 'v1', 'addr': '172.21.15.36:6835', 'nonce': 1669955501}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:32:33.781 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:32:33.782 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2022-01-10T01:32:33.903 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":36638,"want_state":"up:active","state":"up:active","rank_uptime":5.1136318640000002,"mdsmap_epoch":56,"osdmap_epoch":120,"osdmap_epoch_barrier":120,"uptime":9.5087527600000001} 2022-01-10T01:32:33.903 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 36638, "mdsmap_epoch": 56, "osdmap_epoch": 120, "osdmap_epoch_barrier": 120, "rank_uptime": 5.113631864, "state": "up:active", "uptime": 9.50875276, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:32:33.904 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:32:33.904 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:32:33.905 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:32:33.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:33.906 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:33.914 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:32:33.929 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:32:33.930 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:32:33.986 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:32:33.987 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:32:33.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:33.988 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:32:33.994 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:32:33.995 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:33.998 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:32:34.014 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:32:34.014 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:32:34.071 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:32:34.072 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:32:34.068+0000 7fb655c0b080 -1 init, newargv = 0x55efe1a52be0 newargc=9 2022-01-10T01:32:34.072 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[15054]: starting ceph client 2022-01-10T01:32:34.073 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:32:34.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:34.074 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:32:34.082 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[15054]: starting fuse 2022-01-10T01:32:35.181 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:32:35.199 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:32:35.200 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:32:35.254 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:32:35.256 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:32:35.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:35.258 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:32:35.264 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:32:35.264 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:32:35.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:35.265 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:32:35.265 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:32:35.266 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:32:35.266 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:32:35.267 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:32:35.267 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:32:35.267 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:32:35.268 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:32:35.268 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:32:35.269 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:32:35.269 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:32:35.270 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:32:35.270 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:32:35.270 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:32:35.271 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:32:35.271 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:32:35.272 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:32:35.272 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:32:35.273 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:32:35.273 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:32:35.273 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:32:35.274 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:32:35.274 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:32:35.351 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.15054.asok 2022-01-10T01:32:35.355 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15054.asok 2022-01-10T01:32:35.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:35.357 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15054.asok status 2022-01-10T01:32:35.444 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:32:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:32:35.444 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:32:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:32:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:32:35.445 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:32:35.446 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:32:35.446 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "15054", 2022-01-10T01:32:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:32:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:32:35.447 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:32:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:32:35.448 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 7752, 2022-01-10T01:32:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:32:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:32:35.449 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:32:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 7752 2022-01-10T01:32:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:32:35.450 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:32:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:32:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:32:35.451 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 3497618015 2022-01-10T01:32:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:32:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:32:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:32:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:32:35.452 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:32:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 3497618015 2022-01-10T01:32:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:32:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.7752 172.21.15.139:0/3497618015", 2022-01-10T01:32:35.453 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/3497618015", 2022-01-10T01:32:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:32:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 56, 2022-01-10T01:32:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 120, 2022-01-10T01:32:35.454 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:32:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:32:35.455 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:32:35.455 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:32:35.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:35.458 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:35.459 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:35.467 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:32:35.468 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:32:35.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:35.469 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:35.530 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:32:35.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff146837700 1 Processor -- start 2022-01-10T01:32:35.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff146837700 1 -- start start 2022-01-10T01:32:35.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff146837700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1400b2580 0x7ff14014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:35.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff146837700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff1400b0010 0x7ff14014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:35.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff146837700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1400a70c0 con 0x7ff1400afbd0 2022-01-10T01:32:35.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff146837700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1400a72f0 con 0x7ff1400b0010 2022-01-10T01:32:35.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff146837700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1400a7590 con 0x7ff1400b2580 2022-01-10T01:32:35.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff145034700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff1400b0010 0x7ff14014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:35.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff145034700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff1400b0010 0x7ff14014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40960/0 (socket says 172.21.15.36:40960) 2022-01-10T01:32:35.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff145034700 1 -- 172.21.15.36:0/1415123316 learned_addr learned my addr 172.21.15.36:0/1415123316 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:35.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff146036700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff1400afbd0 0x7ff1400a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38758/0 (socket says 172.21.15.36:38758) 2022-01-10T01:32:35.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff145835700 1 --2- 172.21.15.36:0/1415123316 >> v2:172.21.15.59:3300/0 conn(0x7ff1400b2580 0x7ff14014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:35.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff145034700 1 -- 172.21.15.36:0/1415123316 >> v2:172.21.15.59:3300/0 conn(0x7ff1400b2580 msgr2=0x7ff14014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:35.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff145034700 1 --2- 172.21.15.36:0/1415123316 >> v2:172.21.15.59:3300/0 conn(0x7ff1400b2580 0x7ff14014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:35.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff145034700 1 -- 172.21.15.36:0/1415123316 >> v1:172.21.15.36:6789/0 conn(0x7ff1400afbd0 legacy=0x7ff1400a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:35.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff144833700 1 -- 172.21.15.36:0/1415123316 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158677652 0 0) 0x7ff1400a70c0 con 0x7ff1400afbd0 2022-01-10T01:32:35.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.639+0000 7ff145034700 1 -- 172.21.15.36:0/1415123316 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1400a7830 con 0x7ff1400b0010 2022-01-10T01:32:35.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.643+0000 7ff145034700 1 --2- 172.21.15.36:0/1415123316 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1400b0010 0x7ff14014b330 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7ff13c002f70 tx=0x7ff13c006eb0).ready entity=mon.0 client_cookie=dd7aceca5d54d9b5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:35.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.643+0000 7ff144833700 1 -- 172.21.15.36:0/1415123316 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff13c00d610 con 0x7ff1400b0010 2022-01-10T01:32:35.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.643+0000 7ff144833700 1 -- 172.21.15.36:0/1415123316 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c000e90 con 0x7ff1400b0010 2022-01-10T01:32:35.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.643+0000 7ff144833700 1 -- 172.21.15.36:0/1415123316 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff13c00d960 con 0x7ff1400b0010 2022-01-10T01:32:35.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.643+0000 7ff146837700 1 -- 172.21.15.36:0/1415123316 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1400b0010 msgr2=0x7ff14014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:35.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.643+0000 7ff146837700 1 --2- 172.21.15.36:0/1415123316 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1400b0010 0x7ff14014b330 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7ff13c002f70 tx=0x7ff13c006eb0).stop 2022-01-10T01:32:35.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.643+0000 7ff146837700 1 -- 172.21.15.36:0/1415123316 shutdown_connections 2022-01-10T01:32:35.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.643+0000 7ff146837700 1 --2- 172.21.15.36:0/1415123316 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1400b0010 0x7ff14014b330 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:35.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.643+0000 7ff146837700 1 --2- 172.21.15.36:0/1415123316 >> v2:172.21.15.59:3300/0 conn(0x7ff1400b2580 0x7ff14014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:35.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.643+0000 7ff146837700 1 -- 172.21.15.36:0/1415123316 >> 172.21.15.36:0/1415123316 conn(0x7ff140060180 msgr2=0x7ff1400b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:35.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.643+0000 7ff146837700 1 -- 172.21.15.36:0/1415123316 shutdown_connections 2022-01-10T01:32:35.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.643+0000 7ff146837700 1 -- 172.21.15.36:0/1415123316 wait complete. 2022-01-10T01:32:35.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.643+0000 7ff146837700 1 Processor -- start 2022-01-10T01:32:35.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.643+0000 7ff146837700 1 -- start start 2022-01-10T01:32:35.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff146837700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1400afbd0 0x7ff14005bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:35.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff146837700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1400b0010 0x7ff140156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:35.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff146837700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1400b2580 0x7ff140156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:35.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff146837700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400aada0 con 0x7ff1400b0010 2022-01-10T01:32:35.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff146837700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400aa860 con 0x7ff1400b2580 2022-01-10T01:32:35.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff146837700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400aab00 con 0x7ff1400afbd0 2022-01-10T01:32:35.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff145034700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1400b0010 0x7ff140156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:35.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff145034700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1400b0010 0x7ff140156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40968/0 (socket says 172.21.15.36:40968) 2022-01-10T01:32:35.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff145034700 1 -- 172.21.15.36:0/1236586804 learned_addr learned my addr 172.21.15.36:0/1236586804 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:35.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff145835700 1 --2- 172.21.15.36:0/1236586804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1400afbd0 0x7ff14005bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:35.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff146036700 1 --2- 172.21.15.36:0/1236586804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1400b2580 0x7ff140156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:35.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff145034700 1 -- 172.21.15.36:0/1236586804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1400afbd0 msgr2=0x7ff14005bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:35.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff145034700 1 --2- 172.21.15.36:0/1236586804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1400afbd0 0x7ff14005bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:35.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff145034700 1 -- 172.21.15.36:0/1236586804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1400b2580 msgr2=0x7ff140156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:35.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff145034700 1 --2- 172.21.15.36:0/1236586804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1400b2580 0x7ff140156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:35.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff145034700 1 -- 172.21.15.36:0/1236586804 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c00b1e0 con 0x7ff1400b0010 2022-01-10T01:32:35.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff145034700 1 --2- 172.21.15.36:0/1236586804 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1400b0010 0x7ff140156900 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7ff13c002f70 tx=0x7ff13c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:35.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff12effd700 1 -- 172.21.15.36:0/1236586804 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff13c00d290 con 0x7ff1400b0010 2022-01-10T01:32:35.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff12effd700 1 -- 172.21.15.36:0/1236586804 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c00de90 con 0x7ff1400b0010 2022-01-10T01:32:35.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff12effd700 1 -- 172.21.15.36:0/1236586804 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff13c011d70 con 0x7ff1400b0010 2022-01-10T01:32:35.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff146837700 1 -- 172.21.15.36:0/1236586804 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1400639e0 con 0x7ff1400b0010 2022-01-10T01:32:35.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.647+0000 7ff146837700 1 -- 172.21.15.36:0/1236586804 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff140157500 con 0x7ff1400b0010 2022-01-10T01:32:35.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.651+0000 7ff146837700 1 -- 172.21.15.36:0/1236586804 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1400ab540 con 0x7ff1400b0010 2022-01-10T01:32:35.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.651+0000 7ff12effd700 1 -- 172.21.15.36:0/1236586804 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff13c01a040 con 0x7ff1400b0010 2022-01-10T01:32:35.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.651+0000 7ff12effd700 1 --2- 172.21.15.36:0/1236586804 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff120053560 0x7ff120055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:35.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.651+0000 7ff12effd700 1 -- 172.21.15.36:0/1236586804 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff13c06cc00 con 0x7ff1400b0010 2022-01-10T01:32:35.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.651+0000 7ff145835700 1 --2- 172.21.15.36:0/1236586804 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff120053560 0x7ff120055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:35.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.655+0000 7ff145835700 1 --2- 172.21.15.36:0/1236586804 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff120053560 0x7ff120055a20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7ff13000c000 tx=0x7ff130008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:35.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.659+0000 7ff12effd700 1 -- 172.21.15.36:0/1236586804 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff13c043b00 con 0x7ff1400b0010 2022-01-10T01:32:35.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.783+0000 7ff146837700 1 -- 172.21.15.36:0/1236586804 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1400ab540 con 0x7ff1400b0010 2022-01-10T01:32:35.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.787+0000 7ff12effd700 1 -- 172.21.15.36:0/1236586804 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16285 (secure 0 0 0) 0x7ff1400ab540 con 0x7ff1400b0010 2022-01-10T01:32:35.791 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:35.792 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":120,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:32:29.777012+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:32:27.171024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2022-01-10T01:32:28.099192+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:32:35.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.791+0000 7ff146837700 1 -- 172.21.15.36:0/1236586804 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff120053560 msgr2=0x7ff120055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:35.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.791+0000 7ff146837700 1 --2- 172.21.15.36:0/1236586804 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff120053560 0x7ff120055a20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7ff13000c000 tx=0x7ff130008040).stop 2022-01-10T01:32:35.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.791+0000 7ff146837700 1 -- 172.21.15.36:0/1236586804 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1400b0010 msgr2=0x7ff140156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:35.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.791+0000 7ff146837700 1 --2- 172.21.15.36:0/1236586804 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1400b0010 0x7ff140156900 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7ff13c002f70 tx=0x7ff13c015000).stop 2022-01-10T01:32:35.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.791+0000 7ff146837700 1 -- 172.21.15.36:0/1236586804 shutdown_connections 2022-01-10T01:32:35.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.791+0000 7ff146837700 1 --2- 172.21.15.36:0/1236586804 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff120053560 0x7ff120055a20 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:35.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.791+0000 7ff146837700 1 --2- 172.21.15.36:0/1236586804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1400b2580 0x7ff140156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:35.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.791+0000 7ff146837700 1 --2- 172.21.15.36:0/1236586804 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1400b0010 0x7ff140156900 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:35.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.791+0000 7ff146837700 1 --2- 172.21.15.36:0/1236586804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1400afbd0 0x7ff14005bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:35.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.791+0000 7ff146837700 1 -- 172.21.15.36:0/1236586804 >> 172.21.15.36:0/1236586804 conn(0x7ff140060180 msgr2=0x7ff14014ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:35.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.791+0000 7ff146837700 1 -- 172.21.15.36:0/1236586804 shutdown_connections 2022-01-10T01:32:35.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.791+0000 7ff146837700 1 -- 172.21.15.36:0/1236586804 wait complete. 2022-01-10T01:32:35.810 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:32:27.171024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:32:28.099192+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:32:35.811 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:32:35.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16e063700 1 Processor -- start 2022-01-10T01:32:35.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16e063700 1 -- start start 2022-01-10T01:32:35.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16e063700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1680b2580 0x7fc16814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:35.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16e063700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc1680a8ac0 0x7fc16814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:35.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16e063700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1680a70c0 con 0x7fc1680b0010 2022-01-10T01:32:35.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16e063700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1680a72f0 con 0x7fc1680a8ac0 2022-01-10T01:32:35.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16e063700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1680a7590 con 0x7fc1680b2580 2022-01-10T01:32:35.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16d862700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc1680a8ac0 0x7fc16814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:35.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16c860700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fc1680b0010 0x7fc1680a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38768/0 (socket says 172.21.15.36:38768) 2022-01-10T01:32:35.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16c860700 1 -- 172.21.15.36:0/3292925413 learned_addr learned my addr 172.21.15.36:0/3292925413 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:35.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16d061700 1 --2- 172.21.15.36:0/3292925413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1680b2580 0x7fc16814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:35.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16d862700 1 -- 172.21.15.36:0/3292925413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1680b2580 msgr2=0x7fc16814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:35.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16d862700 1 --2- 172.21.15.36:0/3292925413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1680b2580 0x7fc16814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:35.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16d862700 1 -- 172.21.15.36:0/3292925413 >> v1:172.21.15.36:6789/0 conn(0x7fc1680b0010 legacy=0x7fc1680a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:35.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc167fff700 1 -- 172.21.15.36:0/3292925413 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 29799463 0 0) 0x7fc1680a70c0 con 0x7fc1680b0010 2022-01-10T01:32:35.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16d862700 1 -- 172.21.15.36:0/3292925413 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1680a7830 con 0x7fc1680a8ac0 2022-01-10T01:32:35.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16d061700 1 --2- 172.21.15.36:0/3292925413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1680b2580 0x7fc16814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:35.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc16d862700 1 --2- 172.21.15.36:0/3292925413 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1680a8ac0 0x7fc16814b330 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fc160002f70 tx=0x7fc160006df0).ready entity=mon.0 client_cookie=6559731811c23d24 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:35.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc167fff700 1 -- 172.21.15.36:0/3292925413 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16000d570 con 0x7fc1680a8ac0 2022-01-10T01:32:35.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc167fff700 1 -- 172.21.15.36:0/3292925413 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc160000e90 con 0x7fc1680a8ac0 2022-01-10T01:32:35.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.915+0000 7fc167fff700 1 -- 172.21.15.36:0/3292925413 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc16000d8c0 con 0x7fc1680a8ac0 2022-01-10T01:32:35.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.919+0000 7fc16e063700 1 -- 172.21.15.36:0/3292925413 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1680a8ac0 msgr2=0x7fc16814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:35.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.919+0000 7fc16e063700 1 --2- 172.21.15.36:0/3292925413 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1680a8ac0 0x7fc16814b330 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7fc160002f70 tx=0x7fc160006df0).stop 2022-01-10T01:32:35.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.919+0000 7fc16e063700 1 -- 172.21.15.36:0/3292925413 shutdown_connections 2022-01-10T01:32:35.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.919+0000 7fc16e063700 1 --2- 172.21.15.36:0/3292925413 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1680a8ac0 0x7fc16814b330 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:35.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.919+0000 7fc16e063700 1 --2- 172.21.15.36:0/3292925413 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1680b2580 0x7fc16814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:35.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.919+0000 7fc16e063700 1 -- 172.21.15.36:0/3292925413 >> 172.21.15.36:0/3292925413 conn(0x7fc168060180 msgr2=0x7fc1680b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:35.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.919+0000 7fc16e063700 1 -- 172.21.15.36:0/3292925413 shutdown_connections 2022-01-10T01:32:35.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.919+0000 7fc16e063700 1 -- 172.21.15.36:0/3292925413 wait complete. 2022-01-10T01:32:35.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.919+0000 7fc16e063700 1 Processor -- start 2022-01-10T01:32:35.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.919+0000 7fc16e063700 1 -- start start 2022-01-10T01:32:35.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16e063700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1680a8ac0 0x7fc168143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:35.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16e063700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1680b0010 0x7fc1680a9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:35.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16e063700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1680b2580 0x7fc1681569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:35.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16e063700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16815a2a0 con 0x7fc1680b2580 2022-01-10T01:32:35.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16e063700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16815a4c0 con 0x7fc1680a8ac0 2022-01-10T01:32:35.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16e063700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16815a760 con 0x7fc1680b0010 2022-01-10T01:32:35.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16d862700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1680b2580 0x7fc1681569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:35.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16d862700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1680b2580 0x7fc1681569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40982/0 (socket says 172.21.15.36:40982) 2022-01-10T01:32:35.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16d862700 1 -- 172.21.15.36:0/2406139300 learned_addr learned my addr 172.21.15.36:0/2406139300 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:35.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16d061700 1 --2- 172.21.15.36:0/2406139300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1680a8ac0 0x7fc168143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:35.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16c860700 1 --2- 172.21.15.36:0/2406139300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1680b0010 0x7fc1680a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:35.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16d862700 1 -- 172.21.15.36:0/2406139300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1680b0010 msgr2=0x7fc1680a9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:35.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16d862700 1 --2- 172.21.15.36:0/2406139300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1680b0010 0x7fc1680a9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:35.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16d862700 1 -- 172.21.15.36:0/2406139300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1680a8ac0 msgr2=0x7fc168143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:35.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16d862700 1 --2- 172.21.15.36:0/2406139300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1680a8ac0 0x7fc168143ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:35.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16d862700 1 -- 172.21.15.36:0/2406139300 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16000b180 con 0x7fc1680b2580 2022-01-10T01:32:35.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16d862700 1 --2- 172.21.15.36:0/2406139300 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1680b2580 0x7fc1681569c0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7fc160002f70 tx=0x7fc160015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:35.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc1667fc700 1 -- 172.21.15.36:0/2406139300 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc160011760 con 0x7fc1680b2580 2022-01-10T01:32:35.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc1667fc700 1 -- 172.21.15.36:0/2406139300 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1600118c0 con 0x7fc1680b2580 2022-01-10T01:32:35.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16e063700 1 -- 172.21.15.36:0/2406139300 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1680abf80 con 0x7fc1680b2580 2022-01-10T01:32:35.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc1667fc700 1 -- 172.21.15.36:0/2406139300 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc160011c20 con 0x7fc1680b2580 2022-01-10T01:32:35.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.923+0000 7fc16e063700 1 -- 172.21.15.36:0/2406139300 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1680ac420 con 0x7fc1680b2580 2022-01-10T01:32:35.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.927+0000 7fc1667fc700 1 -- 172.21.15.36:0/2406139300 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc160025030 con 0x7fc1680b2580 2022-01-10T01:32:35.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.927+0000 7fc16e063700 1 -- 172.21.15.36:0/2406139300 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1680ac110 con 0x7fc1680b2580 2022-01-10T01:32:35.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.927+0000 7fc1667fc700 1 --2- 172.21.15.36:0/2406139300 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc14c053560 0x7fc14c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:35.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.927+0000 7fc1667fc700 1 -- 172.21.15.36:0/2406139300 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc16006cd40 con 0x7fc1680b2580 2022-01-10T01:32:35.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.927+0000 7fc16d061700 1 --2- 172.21.15.36:0/2406139300 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc14c053560 0x7fc14c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:35.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.927+0000 7fc16d061700 1 --2- 172.21.15.36:0/2406139300 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc14c053560 0x7fc14c055a20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fc15800c000 tx=0x7fc158008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:35.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:35.935+0000 7fc1667fc700 1 -- 172.21.15.36:0/2406139300 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc160043bc0 con 0x7fc1680b2580 2022-01-10T01:32:36.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.063+0000 7fc16e063700 1 -- 172.21.15.36:0/2406139300 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc168057350 con 0x7fc1680b2580 2022-01-10T01:32:36.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.063+0000 7fc1667fc700 1 -- 172.21.15.36:0/2406139300 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v120) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc160023070 con 0x7fc1680b2580 2022-01-10T01:32:36.068 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:32:36.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.067+0000 7fc16e063700 1 -- 172.21.15.36:0/2406139300 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc14c053560 msgr2=0x7fc14c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.067+0000 7fc16e063700 1 --2- 172.21.15.36:0/2406139300 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc14c053560 0x7fc14c055a20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fc15800c000 tx=0x7fc158008040).stop 2022-01-10T01:32:36.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.067+0000 7fc16e063700 1 -- 172.21.15.36:0/2406139300 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1680b2580 msgr2=0x7fc1681569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.067+0000 7fc16e063700 1 --2- 172.21.15.36:0/2406139300 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1680b2580 0x7fc1681569c0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7fc160002f70 tx=0x7fc160015000).stop 2022-01-10T01:32:36.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.067+0000 7fc16e063700 1 -- 172.21.15.36:0/2406139300 shutdown_connections 2022-01-10T01:32:36.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.067+0000 7fc16e063700 1 --2- 172.21.15.36:0/2406139300 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc14c053560 0x7fc14c055a20 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.067+0000 7fc16e063700 1 --2- 172.21.15.36:0/2406139300 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1680b2580 0x7fc1681569c0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.067+0000 7fc16e063700 1 --2- 172.21.15.36:0/2406139300 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1680b0010 0x7fc1680a9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.067+0000 7fc16e063700 1 --2- 172.21.15.36:0/2406139300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1680a8ac0 0x7fc168143ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.067+0000 7fc16e063700 1 -- 172.21.15.36:0/2406139300 >> 172.21.15.36:0/2406139300 conn(0x7fc168060180 msgr2=0x7fc1681486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:36.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.067+0000 7fc16e063700 1 -- 172.21.15.36:0/2406139300 shutdown_connections 2022-01-10T01:32:36.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.067+0000 7fc16e063700 1 -- 172.21.15.36:0/2406139300 wait complete. 2022-01-10T01:32:36.081 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:32:36.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e6759e700 1 Processor -- start 2022-01-10T01:32:36.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e6759e700 1 -- start start 2022-01-10T01:32:36.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e6759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e680b4710 0x7f8e6813fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e6759e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8e681439a0 0x7f8e68140290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e6759e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e680b6910 con 0x7f8e68061680 2022-01-10T01:32:36.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e6759e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e680b9680 con 0x7f8e681439a0 2022-01-10T01:32:36.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e6759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e680b6bb0 con 0x7f8e680b4710 2022-01-10T01:32:36.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e66d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8e681439a0 0x7f8e68140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e66d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8e681439a0 0x7f8e68140290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40988/0 (socket says 172.21.15.36:40988) 2022-01-10T01:32:36.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e66d9d700 1 -- 172.21.15.36:0/837693851 learned_addr learned my addr 172.21.15.36:0/837693851 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:36.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e65d9b700 1 --2- 172.21.15.36:0/837693851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e680b4710 0x7f8e6813fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e66d9d700 1 -- 172.21.15.36:0/837693851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e680b4710 msgr2=0x7f8e6813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:36.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e66d9d700 1 --2- 172.21.15.36:0/837693851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e680b4710 0x7f8e6813fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e66d9d700 1 -- 172.21.15.36:0/837693851 >> v1:172.21.15.59:6789/0 conn(0x7f8e68061680 legacy=0x7f8e680b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.191+0000 7f8e66d9d700 1 -- 172.21.15.36:0/837693851 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e680b6e50 con 0x7f8e681439a0 2022-01-10T01:32:36.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e66d9d700 1 --2- 172.21.15.36:0/837693851 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e681439a0 0x7f8e68140290 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f8e600032f0 tx=0x7f8e60009290).ready entity=mon.0 client_cookie=d3b402c3cf76824d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:36.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6559a700 1 -- 172.21.15.36:0/837693851 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e6000b8a0 con 0x7f8e681439a0 2022-01-10T01:32:36.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6559a700 1 -- 172.21.15.36:0/837693851 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6000ba00 con 0x7f8e681439a0 2022-01-10T01:32:36.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6559a700 1 -- 172.21.15.36:0/837693851 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e6000bb70 con 0x7f8e681439a0 2022-01-10T01:32:36.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 -- 172.21.15.36:0/837693851 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e681439a0 msgr2=0x7f8e68140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 --2- 172.21.15.36:0/837693851 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e681439a0 0x7f8e68140290 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f8e600032f0 tx=0x7f8e60009290).stop 2022-01-10T01:32:36.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 -- 172.21.15.36:0/837693851 shutdown_connections 2022-01-10T01:32:36.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 --2- 172.21.15.36:0/837693851 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e681439a0 0x7f8e68140290 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 --2- 172.21.15.36:0/837693851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e680b4710 0x7f8e6813fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 -- 172.21.15.36:0/837693851 >> 172.21.15.36:0/837693851 conn(0x7f8e6806adf0 msgr2=0x7f8e6805f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:36.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 -- 172.21.15.36:0/837693851 shutdown_connections 2022-01-10T01:32:36.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 -- 172.21.15.36:0/837693851 wait complete. 2022-01-10T01:32:36.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 Processor -- start 2022-01-10T01:32:36.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 -- start start 2022-01-10T01:32:36.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e68061680 0x7f8e680ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e681439a0 0x7f8e681128a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e681446c0 0x7f8e680ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e680b9010 con 0x7f8e68061680 2022-01-10T01:32:36.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e680b0560 con 0x7f8e681446c0 2022-01-10T01:32:36.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.195+0000 7f8e6759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e68145ab0 con 0x7f8e681439a0 2022-01-10T01:32:36.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e6659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e68061680 0x7f8e680ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e6659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e68061680 0x7f8e680ad9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:40992/0 (socket says 172.21.15.36:40992) 2022-01-10T01:32:36.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e6659c700 1 -- 172.21.15.36:0/1303906221 learned_addr learned my addr 172.21.15.36:0/1303906221 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:36.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e65d9b700 1 --2- 172.21.15.36:0/1303906221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e681439a0 0x7f8e681128a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e66d9d700 1 --2- 172.21.15.36:0/1303906221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e681446c0 0x7f8e680ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e6659c700 1 -- 172.21.15.36:0/1303906221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e681439a0 msgr2=0x7f8e681128a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e6659c700 1 --2- 172.21.15.36:0/1303906221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e681439a0 0x7f8e681128a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e6659c700 1 -- 172.21.15.36:0/1303906221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e681446c0 msgr2=0x7f8e680ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e6659c700 1 --2- 172.21.15.36:0/1303906221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e681446c0 0x7f8e680ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e6659c700 1 -- 172.21.15.36:0/1303906221 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e60009530 con 0x7f8e68061680 2022-01-10T01:32:36.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e6659c700 1 --2- 172.21.15.36:0/1303906221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e68061680 0x7f8e680ad9e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f8e68062100 tx=0x7f8e58007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:36.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e5f7fe700 1 -- 172.21.15.36:0/1303906221 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e5800ce30 con 0x7f8e68061680 2022-01-10T01:32:36.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e5f7fe700 1 -- 172.21.15.36:0/1303906221 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5800f470 con 0x7f8e68061680 2022-01-10T01:32:36.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e5f7fe700 1 -- 172.21.15.36:0/1303906221 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e5800f7d0 con 0x7f8e68061680 2022-01-10T01:32:36.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e6759e700 1 -- 172.21.15.36:0/1303906221 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e68144ae0 con 0x7f8e68061680 2022-01-10T01:32:36.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e6759e700 1 -- 172.21.15.36:0/1303906221 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e68147240 con 0x7f8e68061680 2022-01-10T01:32:36.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e6759e700 1 -- 172.21.15.36:0/1303906221 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e68057350 con 0x7f8e68061680 2022-01-10T01:32:36.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.199+0000 7f8e5f7fe700 1 -- 172.21.15.36:0/1303906221 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8e58019030 con 0x7f8e68061680 2022-01-10T01:32:36.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.203+0000 7f8e5f7fe700 1 --2- 172.21.15.36:0/1303906221 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8e4c053680 0x7f8e4c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.203+0000 7f8e5f7fe700 1 -- 172.21.15.36:0/1303906221 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8e5806aec0 con 0x7f8e68061680 2022-01-10T01:32:36.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.203+0000 7f8e65d9b700 1 --2- 172.21.15.36:0/1303906221 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8e4c053680 0x7f8e4c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.203+0000 7f8e65d9b700 1 --2- 172.21.15.36:0/1303906221 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8e4c053680 0x7f8e4c055b40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f8e5000c000 tx=0x7f8e50008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:36.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.207+0000 7f8e5f7fe700 1 -- 172.21.15.36:0/1303906221 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8e58041ed0 con 0x7f8e68061680 2022-01-10T01:32:36.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.331+0000 7f8e6759e700 1 -- 172.21.15.36:0/1303906221 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8e680b0b10 con 0x7f8e68061680 2022-01-10T01:32:36.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.331+0000 7f8e5f7fe700 1 -- 172.21.15.36:0/1303906221 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v120) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8e580454f0 con 0x7f8e68061680 2022-01-10T01:32:36.337 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:32:36.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.335+0000 7f8e6759e700 1 -- 172.21.15.36:0/1303906221 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8e4c053680 msgr2=0x7f8e4c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.335+0000 7f8e6759e700 1 --2- 172.21.15.36:0/1303906221 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8e4c053680 0x7f8e4c055b40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f8e5000c000 tx=0x7f8e50008040).stop 2022-01-10T01:32:36.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.335+0000 7f8e6759e700 1 -- 172.21.15.36:0/1303906221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e68061680 msgr2=0x7f8e680ad9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.335+0000 7f8e6759e700 1 --2- 172.21.15.36:0/1303906221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e68061680 0x7f8e680ad9e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f8e68062100 tx=0x7f8e58007c50).stop 2022-01-10T01:32:36.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.335+0000 7f8e6759e700 1 -- 172.21.15.36:0/1303906221 shutdown_connections 2022-01-10T01:32:36.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.335+0000 7f8e6759e700 1 --2- 172.21.15.36:0/1303906221 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8e4c053680 0x7f8e4c055b40 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.335+0000 7f8e6759e700 1 --2- 172.21.15.36:0/1303906221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e681446c0 0x7f8e680ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.335+0000 7f8e6759e700 1 --2- 172.21.15.36:0/1303906221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e681439a0 0x7f8e681128a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.335+0000 7f8e6759e700 1 --2- 172.21.15.36:0/1303906221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8e68061680 0x7f8e680ad9e0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.335+0000 7f8e6759e700 1 -- 172.21.15.36:0/1303906221 >> 172.21.15.36:0/1303906221 conn(0x7f8e6806adf0 msgr2=0x7f8e6813ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:36.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.335+0000 7f8e6759e700 1 -- 172.21.15.36:0/1303906221 shutdown_connections 2022-01-10T01:32:36.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.335+0000 7f8e6759e700 1 -- 172.21.15.36:0/1303906221 wait complete. 2022-01-10T01:32:36.350 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:32:36.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.455+0000 7f8d0de57700 1 Processor -- start 2022-01-10T01:32:36.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0de57700 1 -- start start 2022-01-10T01:32:36.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0de57700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8d080b3000 0x7f8d08060b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0de57700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d08061000 0x7f8d08066c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0de57700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d08065330 con 0x7f8d080b25a0 2022-01-10T01:32:36.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0de57700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d08062000 con 0x7f8d080b3000 2022-01-10T01:32:36.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0de57700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d08061470 con 0x7f8d08061000 2022-01-10T01:32:36.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0ce55700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8d080b3000 0x7f8d08060b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0ce55700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8d080b3000 0x7f8d08060b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41000/0 (socket says 172.21.15.36:41000) 2022-01-10T01:32:36.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0ce55700 1 -- 172.21.15.36:0/2334632541 learned_addr learned my addr 172.21.15.36:0/2334632541 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:36.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0d656700 1 --2- 172.21.15.36:0/2334632541 >> v2:172.21.15.59:3300/0 conn(0x7f8d08061000 0x7f8d08066c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0ce55700 1 -- 172.21.15.36:0/2334632541 >> v2:172.21.15.59:3300/0 conn(0x7f8d08061000 msgr2=0x7f8d08066c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:36.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0ce55700 1 --2- 172.21.15.36:0/2334632541 >> v2:172.21.15.59:3300/0 conn(0x7f8d08061000 0x7f8d08066c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0ce55700 1 -- 172.21.15.36:0/2334632541 >> v1:172.21.15.36:6789/0 conn(0x7f8d080b25a0 legacy=0x7f8d08066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0ce55700 1 -- 172.21.15.36:0/2334632541 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d080b33e0 con 0x7f8d080b3000 2022-01-10T01:32:36.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0ce55700 1 --2- 172.21.15.36:0/2334632541 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d080b3000 0x7f8d08060b10 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f8cfc002f70 tx=0x7f8cfc006eb0).ready entity=mon.0 client_cookie=19b0a799d2d49c85 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:36.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d077fe700 1 -- 172.21.15.36:0/2334632541 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cfc00d610 con 0x7f8d080b3000 2022-01-10T01:32:36.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d077fe700 1 -- 172.21.15.36:0/2334632541 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc000e90 con 0x7f8d080b3000 2022-01-10T01:32:36.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d077fe700 1 -- 172.21.15.36:0/2334632541 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cfc00d9a0 con 0x7f8d080b3000 2022-01-10T01:32:36.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0de57700 1 -- 172.21.15.36:0/2334632541 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d080b3000 msgr2=0x7f8d08060b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0de57700 1 --2- 172.21.15.36:0/2334632541 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d080b3000 0x7f8d08060b10 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7f8cfc002f70 tx=0x7f8cfc006eb0).stop 2022-01-10T01:32:36.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0de57700 1 -- 172.21.15.36:0/2334632541 shutdown_connections 2022-01-10T01:32:36.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0de57700 1 --2- 172.21.15.36:0/2334632541 >> v2:172.21.15.59:3300/0 conn(0x7f8d08061000 0x7f8d08066c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0de57700 1 --2- 172.21.15.36:0/2334632541 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d080b3000 0x7f8d08060b10 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0de57700 1 -- 172.21.15.36:0/2334632541 >> 172.21.15.36:0/2334632541 conn(0x7f8d080636e0 msgr2=0x7f8d08063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:36.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0de57700 1 -- 172.21.15.36:0/2334632541 shutdown_connections 2022-01-10T01:32:36.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.459+0000 7f8d0de57700 1 -- 172.21.15.36:0/2334632541 wait complete. 2022-01-10T01:32:36.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0de57700 1 Processor -- start 2022-01-10T01:32:36.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0de57700 1 -- start start 2022-01-10T01:32:36.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0de57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d08061000 0x7f8d080ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0de57700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d080b25a0 0x7f8d08152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0de57700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d080b3000 0x7f8d080a3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0de57700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d080b0870 con 0x7f8d080b3000 2022-01-10T01:32:36.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0de57700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d080ae230 con 0x7f8d080b25a0 2022-01-10T01:32:36.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0de57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d08142320 con 0x7f8d08061000 2022-01-10T01:32:36.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0d656700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d080b3000 0x7f8d080a3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0d656700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d080b3000 0x7f8d080a3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41010/0 (socket says 172.21.15.36:41010) 2022-01-10T01:32:36.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0d656700 1 -- 172.21.15.36:0/3850998463 learned_addr learned my addr 172.21.15.36:0/3850998463 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:36.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0ce55700 1 --2- 172.21.15.36:0/3850998463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d08061000 0x7f8d080ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d07fff700 1 --2- 172.21.15.36:0/3850998463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d080b25a0 0x7f8d08152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0d656700 1 -- 172.21.15.36:0/3850998463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d08061000 msgr2=0x7f8d080ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0d656700 1 --2- 172.21.15.36:0/3850998463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d08061000 0x7f8d080ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0d656700 1 -- 172.21.15.36:0/3850998463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d080b25a0 msgr2=0x7f8d08152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0d656700 1 --2- 172.21.15.36:0/3850998463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d080b25a0 0x7f8d08152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0d656700 1 -- 172.21.15.36:0/3850998463 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc00b1e0 con 0x7f8d080b3000 2022-01-10T01:32:36.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0d656700 1 --2- 172.21.15.36:0/3850998463 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d080b3000 0x7f8d080a3e90 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f8d08142460 tx=0x7f8d00008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:36.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d05ffb700 1 -- 172.21.15.36:0/3850998463 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d00013620 con 0x7f8d080b3000 2022-01-10T01:32:36.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d05ffb700 1 -- 172.21.15.36:0/3850998463 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d00013780 con 0x7f8d080b3000 2022-01-10T01:32:36.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d05ffb700 1 -- 172.21.15.36:0/3850998463 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d00013ae0 con 0x7f8d080b3000 2022-01-10T01:32:36.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0de57700 1 -- 172.21.15.36:0/3850998463 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d080b05d0 con 0x7f8d080b3000 2022-01-10T01:32:36.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.463+0000 7f8d0de57700 1 -- 172.21.15.36:0/3850998463 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d080ad370 con 0x7f8d080b3000 2022-01-10T01:32:36.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.467+0000 7f8d0de57700 1 -- 172.21.15.36:0/3850998463 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0805fa60 con 0x7f8d080b3000 2022-01-10T01:32:36.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.467+0000 7f8d05ffb700 1 -- 172.21.15.36:0/3850998463 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8d00013c40 con 0x7f8d080b3000 2022-01-10T01:32:36.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.467+0000 7f8d05ffb700 1 --2- 172.21.15.36:0/3850998463 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8ce8053620 0x7f8ce8055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.467+0000 7f8d05ffb700 1 -- 172.21.15.36:0/3850998463 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8d0006bbe0 con 0x7f8d080b3000 2022-01-10T01:32:36.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.467+0000 7f8d0ce55700 1 --2- 172.21.15.36:0/3850998463 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8ce8053620 0x7f8ce8055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.467+0000 7f8d0ce55700 1 --2- 172.21.15.36:0/3850998463 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8ce8053620 0x7f8ce8055ae0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f8cfc01c000 tx=0x7f8cfc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:36.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.475+0000 7f8d05ffb700 1 -- 172.21.15.36:0/3850998463 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8d00042b50 con 0x7f8d080b3000 2022-01-10T01:32:36.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.603+0000 7f8d0de57700 1 -- 172.21.15.36:0/3850998463 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d08057350 con 0x7f8d080b3000 2022-01-10T01:32:36.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.603+0000 7f8d05ffb700 1 -- 172.21.15.36:0/3850998463 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v120) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8d0000f040 con 0x7f8d080b3000 2022-01-10T01:32:36.607 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:32:36.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.603+0000 7f8d0de57700 1 -- 172.21.15.36:0/3850998463 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8ce8053620 msgr2=0x7f8ce8055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.603+0000 7f8d0de57700 1 --2- 172.21.15.36:0/3850998463 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8ce8053620 0x7f8ce8055ae0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f8cfc01c000 tx=0x7f8cfc015000).stop 2022-01-10T01:32:36.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.603+0000 7f8d0de57700 1 -- 172.21.15.36:0/3850998463 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d080b3000 msgr2=0x7f8d080a3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.603+0000 7f8d0de57700 1 --2- 172.21.15.36:0/3850998463 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d080b3000 0x7f8d080a3e90 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f8d08142460 tx=0x7f8d00008040).stop 2022-01-10T01:32:36.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.603+0000 7f8d0de57700 1 -- 172.21.15.36:0/3850998463 shutdown_connections 2022-01-10T01:32:36.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.603+0000 7f8d0de57700 1 --2- 172.21.15.36:0/3850998463 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8ce8053620 0x7f8ce8055ae0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.603+0000 7f8d0de57700 1 --2- 172.21.15.36:0/3850998463 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d080b3000 0x7f8d080a3e90 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.603+0000 7f8d0de57700 1 --2- 172.21.15.36:0/3850998463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d080b25a0 0x7f8d08152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.603+0000 7f8d0de57700 1 --2- 172.21.15.36:0/3850998463 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d08061000 0x7f8d080ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.603+0000 7f8d0de57700 1 -- 172.21.15.36:0/3850998463 >> 172.21.15.36:0/3850998463 conn(0x7f8d080636e0 msgr2=0x7f8d080b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:36.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.603+0000 7f8d0de57700 1 -- 172.21.15.36:0/3850998463 shutdown_connections 2022-01-10T01:32:36.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.603+0000 7f8d0de57700 1 -- 172.21.15.36:0/3850998463 wait complete. 2022-01-10T01:32:36.620 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:32:36.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.727+0000 7f04e7541700 1 Processor -- start 2022-01-10T01:32:36.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.727+0000 7f04e7541700 1 -- start start 2022-01-10T01:32:36.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e7541700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f04e005ff60 0x7f04e0140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e7541700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e00b2710 0x7f04e0140930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e7541700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e0140e20 con 0x7f04e00611d0 2022-01-10T01:32:36.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e7541700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e0064910 con 0x7f04e005ff60 2022-01-10T01:32:36.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e7541700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e0064bb0 con 0x7f04e00b2710 2022-01-10T01:32:36.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e52dd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f04e005ff60 0x7f04e0140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e5ade700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f04e00611d0 0x7f04e0143110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38808/0 (socket says 172.21.15.36:38808) 2022-01-10T01:32:36.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e5ade700 1 -- 172.21.15.36:0/1775744316 learned_addr learned my addr 172.21.15.36:0/1775744316 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:36.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e4adc700 1 --2- 172.21.15.36:0/1775744316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e00b2710 0x7f04e0140930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04d3fff700 1 -- 172.21.15.36:0/1775744316 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 737114637 0 0) 0x7f04e0140e20 con 0x7f04e00611d0 2022-01-10T01:32:36.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04d3fff700 1 -- 172.21.15.36:0/1775744316 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04c4003260 con 0x7f04e00611d0 2022-01-10T01:32:36.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e52dd700 1 -- 172.21.15.36:0/1775744316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e00b2710 msgr2=0x7f04e0140930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:36.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e52dd700 1 --2- 172.21.15.36:0/1775744316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e00b2710 0x7f04e0140930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e52dd700 1 -- 172.21.15.36:0/1775744316 >> v1:172.21.15.36:6789/0 conn(0x7f04e00611d0 legacy=0x7f04e0143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e52dd700 1 -- 172.21.15.36:0/1775744316 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0064e50 con 0x7f04e005ff60 2022-01-10T01:32:36.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e52dd700 1 --2- 172.21.15.36:0/1775744316 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04e005ff60 0x7f04e0140440 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f04d4002f70 tx=0x7f04d4006df0).ready entity=mon.0 client_cookie=68e0ef476b7874fe server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:36.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04d3fff700 1 -- 172.21.15.36:0/1775744316 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d400d4a0 con 0x7f04e005ff60 2022-01-10T01:32:36.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04d3fff700 1 -- 172.21.15.36:0/1775744316 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d4000e90 con 0x7f04e005ff60 2022-01-10T01:32:36.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04d3fff700 1 -- 172.21.15.36:0/1775744316 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04d400d7f0 con 0x7f04e005ff60 2022-01-10T01:32:36.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e7541700 1 -- 172.21.15.36:0/1775744316 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04e005ff60 msgr2=0x7f04e0140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e7541700 1 --2- 172.21.15.36:0/1775744316 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04e005ff60 0x7f04e0140440 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f04d4002f70 tx=0x7f04d4006df0).stop 2022-01-10T01:32:36.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e7541700 1 -- 172.21.15.36:0/1775744316 shutdown_connections 2022-01-10T01:32:36.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e7541700 1 --2- 172.21.15.36:0/1775744316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e00b2710 0x7f04e0140930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e7541700 1 --2- 172.21.15.36:0/1775744316 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04e005ff60 0x7f04e0140440 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e7541700 1 -- 172.21.15.36:0/1775744316 >> 172.21.15.36:0/1775744316 conn(0x7f04e005cf60 msgr2=0x7f04e005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:36.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e7541700 1 -- 172.21.15.36:0/1775744316 shutdown_connections 2022-01-10T01:32:36.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.731+0000 7f04e7541700 1 -- 172.21.15.36:0/1775744316 wait complete. 2022-01-10T01:32:36.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e7541700 1 Processor -- start 2022-01-10T01:32:36.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e7541700 1 -- start start 2022-01-10T01:32:36.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e7541700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e005ff60 0x7f04e0145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e7541700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04e00611d0 0x7f04e01521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e7541700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04e00b2710 0x7f04e00b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e7541700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e0146100 con 0x7f04e00611d0 2022-01-10T01:32:36.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e7541700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e0152690 con 0x7f04e00b2710 2022-01-10T01:32:36.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e7541700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e01528b0 con 0x7f04e005ff60 2022-01-10T01:32:36.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e4adc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04e00611d0 0x7f04e01521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e4adc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04e00611d0 0x7f04e01521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41022/0 (socket says 172.21.15.36:41022) 2022-01-10T01:32:36.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e4adc700 1 -- 172.21.15.36:0/963585337 learned_addr learned my addr 172.21.15.36:0/963585337 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:36.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e5ade700 1 --2- 172.21.15.36:0/963585337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04e00b2710 0x7f04e00b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e52dd700 1 --2- 172.21.15.36:0/963585337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e005ff60 0x7f04e0145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e4adc700 1 -- 172.21.15.36:0/963585337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e005ff60 msgr2=0x7f04e0145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e4adc700 1 --2- 172.21.15.36:0/963585337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e005ff60 0x7f04e0145760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e4adc700 1 -- 172.21.15.36:0/963585337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04e00b2710 msgr2=0x7f04e00b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e4adc700 1 --2- 172.21.15.36:0/963585337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04e00b2710 0x7f04e00b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e4adc700 1 -- 172.21.15.36:0/963585337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d400b180 con 0x7f04e00611d0 2022-01-10T01:32:36.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.735+0000 7f04e4adc700 1 --2- 172.21.15.36:0/963585337 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04e00611d0 0x7f04e01521a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f04dc00c000 tx=0x7f04dc006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:36.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.739+0000 7f04d27fc700 1 -- 172.21.15.36:0/963585337 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04dc011750 con 0x7f04e00611d0 2022-01-10T01:32:36.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.739+0000 7f04d27fc700 1 -- 172.21.15.36:0/963585337 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04dc0118b0 con 0x7f04e00611d0 2022-01-10T01:32:36.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.739+0000 7f04e7541700 1 -- 172.21.15.36:0/963585337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e0152b50 con 0x7f04e00611d0 2022-01-10T01:32:36.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.739+0000 7f04d27fc700 1 -- 172.21.15.36:0/963585337 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f04dc011c10 con 0x7f04e00611d0 2022-01-10T01:32:36.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.739+0000 7f04e7541700 1 -- 172.21.15.36:0/963585337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e00b6af0 con 0x7f04e00611d0 2022-01-10T01:32:36.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.739+0000 7f04e7541700 1 -- 172.21.15.36:0/963585337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e00650f0 con 0x7f04e00611d0 2022-01-10T01:32:36.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.739+0000 7f04d27fc700 1 -- 172.21.15.36:0/963585337 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f04dc011d70 con 0x7f04e00611d0 2022-01-10T01:32:36.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.739+0000 7f04d27fc700 1 --2- 172.21.15.36:0/963585337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04c8053620 0x7f04c8055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:36.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.739+0000 7f04e52dd700 1 --2- 172.21.15.36:0/963585337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04c8053620 0x7f04c8055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:36.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.739+0000 7f04d27fc700 1 -- 172.21.15.36:0/963585337 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f04dc06be60 con 0x7f04e00611d0 2022-01-10T01:32:36.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.743+0000 7f04e52dd700 1 --2- 172.21.15.36:0/963585337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04c8053620 0x7f04c8055ae0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f04d401a000 tx=0x7f04d4014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:36.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.747+0000 7f04d27fc700 1 -- 172.21.15.36:0/963585337 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f04dc042e70 con 0x7f04e00611d0 2022-01-10T01:32:36.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.879+0000 7f04e7541700 1 -- 172.21.15.36:0/963585337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f04e0057350 con 0x7f04e00611d0 2022-01-10T01:32:36.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.879+0000 7f04d27fc700 1 -- 172.21.15.36:0/963585337 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v120) v1 ==== 100+0+10 (secure 0 0 0) 0x7f04dc046490 con 0x7f04e00611d0 2022-01-10T01:32:36.883 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:32:36.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.879+0000 7f04e7541700 1 -- 172.21.15.36:0/963585337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04c8053620 msgr2=0x7f04c8055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.879+0000 7f04e7541700 1 --2- 172.21.15.36:0/963585337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04c8053620 0x7f04c8055ae0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f04d401a000 tx=0x7f04d4014000).stop 2022-01-10T01:32:36.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.879+0000 7f04e7541700 1 -- 172.21.15.36:0/963585337 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04e00611d0 msgr2=0x7f04e01521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:36.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.879+0000 7f04e7541700 1 --2- 172.21.15.36:0/963585337 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04e00611d0 0x7f04e01521a0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f04dc00c000 tx=0x7f04dc006df0).stop 2022-01-10T01:32:36.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.879+0000 7f04e7541700 1 -- 172.21.15.36:0/963585337 shutdown_connections 2022-01-10T01:32:36.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.879+0000 7f04e7541700 1 --2- 172.21.15.36:0/963585337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f04c8053620 0x7f04c8055ae0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.879+0000 7f04e7541700 1 --2- 172.21.15.36:0/963585337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04e00b2710 0x7f04e00b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.879+0000 7f04e7541700 1 --2- 172.21.15.36:0/963585337 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f04e00611d0 0x7f04e01521a0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.879+0000 7f04e7541700 1 --2- 172.21.15.36:0/963585337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04e005ff60 0x7f04e0145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:36.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.879+0000 7f04e7541700 1 -- 172.21.15.36:0/963585337 >> 172.21.15.36:0/963585337 conn(0x7f04e005cf60 msgr2=0x7f04e0140540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:36.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.879+0000 7f04e7541700 1 -- 172.21.15.36:0/963585337 shutdown_connections 2022-01-10T01:32:36.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.879+0000 7f04e7541700 1 -- 172.21.15.36:0/963585337 wait complete. 2022-01-10T01:32:36.896 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:32:36.897 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:32:37.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.995+0000 7f00552ac700 1 Processor -- start 2022-01-10T01:32:37.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.995+0000 7f00552ac700 1 -- start start 2022-01-10T01:32:37.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f00500b03e0 0x7f00500aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:37.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f005013f8b0 0x7f005013fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:37.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00500af480 con 0x7f00500ad4e0 2022-01-10T01:32:37.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00500b0ab0 con 0x7f00500b03e0 2022-01-10T01:32:37.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00500b0d50 con 0x7f005013f8b0 2022-01-10T01:32:37.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f004ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f00500ad4e0 0x7f00500b1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38824/0 (socket says 172.21.15.36:38824) 2022-01-10T01:32:37.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f004ffff700 1 -- 172.21.15.36:0/2342414812 learned_addr learned my addr 172.21.15.36:0/2342414812 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:37.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f004f7fe700 1 --2- 172.21.15.36:0/2342414812 >> v2:172.21.15.59:3300/0 conn(0x7f00500b03e0 0x7f00500aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:37.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f0054aab700 1 --2- 172.21.15.36:0/2342414812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f005013f8b0 0x7f005013fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:37.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f004effd700 1 -- 172.21.15.36:0/2342414812 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96171756 0 0) 0x7f0044001110 con 0x7f00500ad4e0 2022-01-10T01:32:37.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f004effd700 1 -- 172.21.15.36:0/2342414812 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f003c003260 con 0x7f00500ad4e0 2022-01-10T01:32:37.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f004f7fe700 1 -- 172.21.15.36:0/2342414812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f005013f8b0 msgr2=0x7f005013fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:37.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f004f7fe700 1 --2- 172.21.15.36:0/2342414812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f005013f8b0 0x7f005013fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:37.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f004f7fe700 1 -- 172.21.15.36:0/2342414812 >> v1:172.21.15.36:6789/0 conn(0x7f00500ad4e0 legacy=0x7f00500b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:37.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f004f7fe700 1 -- 172.21.15.36:0/2342414812 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00500ae850 con 0x7f00500b03e0 2022-01-10T01:32:37.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f0054aab700 1 --2- 172.21.15.36:0/2342414812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f005013f8b0 0x7f005013fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:37.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f004f7fe700 1 --2- 172.21.15.36:0/2342414812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00500b03e0 0x7f00500aef90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f0040002f70 tx=0x7f0040006df0).ready entity=mon.1 client_cookie=8a2eae6354bd6ae6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:37.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f004effd700 1 -- 172.21.15.36:0/2342414812 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f004000d4a0 con 0x7f00500b03e0 2022-01-10T01:32:37.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f004effd700 1 -- 172.21.15.36:0/2342414812 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0040000e90 con 0x7f00500b03e0 2022-01-10T01:32:37.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f004effd700 1 -- 172.21.15.36:0/2342414812 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f004000d7f0 con 0x7f00500b03e0 2022-01-10T01:32:37.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 -- 172.21.15.36:0/2342414812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00500b03e0 msgr2=0x7f00500aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:37.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 --2- 172.21.15.36:0/2342414812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00500b03e0 0x7f00500aef90 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f0040002f70 tx=0x7f0040006df0).stop 2022-01-10T01:32:37.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 -- 172.21.15.36:0/2342414812 shutdown_connections 2022-01-10T01:32:37.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 --2- 172.21.15.36:0/2342414812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f005013f8b0 0x7f005013fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:37.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 --2- 172.21.15.36:0/2342414812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00500b03e0 0x7f00500aef90 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:37.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 -- 172.21.15.36:0/2342414812 >> 172.21.15.36:0/2342414812 conn(0x7f00500611d0 msgr2=0x7f0050062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:37.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 -- 172.21.15.36:0/2342414812 shutdown_connections 2022-01-10T01:32:37.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 -- 172.21.15.36:0/2342414812 wait complete. 2022-01-10T01:32:37.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 Processor -- start 2022-01-10T01:32:37.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:36.999+0000 7f00552ac700 1 -- start start 2022-01-10T01:32:37.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f00552ac700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00500ad4e0 0x7f0050141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:37.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f00552ac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00500b03e0 0x7f0050153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:37.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f00552ac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005013f8b0 0x7f00500ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:37.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f00552ac700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00500ac840 con 0x7f00500ad4e0 2022-01-10T01:32:37.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f00552ac700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0050153810 con 0x7f005013f8b0 2022-01-10T01:32:37.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f00552ac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0050063d60 con 0x7f00500b03e0 2022-01-10T01:32:37.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f004ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00500ad4e0 0x7f0050141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:37.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f004ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00500ad4e0 0x7f0050141a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41034/0 (socket says 172.21.15.36:41034) 2022-01-10T01:32:37.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f004ffff700 1 -- 172.21.15.36:0/3106208247 learned_addr learned my addr 172.21.15.36:0/3106208247 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:37.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f004f7fe700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00500b03e0 0x7f0050153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:37.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f0054aab700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005013f8b0 0x7f00500ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:37.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f004ffff700 1 -- 172.21.15.36:0/3106208247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00500b03e0 msgr2=0x7f0050153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:37.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f004ffff700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00500b03e0 0x7f0050153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:37.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f004ffff700 1 -- 172.21.15.36:0/3106208247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005013f8b0 msgr2=0x7f00500ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:37.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f004ffff700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005013f8b0 0x7f00500ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:37.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f004ffff700 1 -- 172.21.15.36:0/3106208247 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0048009470 con 0x7f00500ad4e0 2022-01-10T01:32:37.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f0054aab700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005013f8b0 0x7f00500ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:37.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f004ffff700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00500ad4e0 0x7f0050141a10 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f00440012a0 tx=0x7f0044007940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:37.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f004d7fa700 1 -- 172.21.15.36:0/3106208247 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f004400ce10 con 0x7f00500ad4e0 2022-01-10T01:32:37.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f004d7fa700 1 -- 172.21.15.36:0/3106208247 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00440072e0 con 0x7f00500ad4e0 2022-01-10T01:32:37.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f00552ac700 1 -- 172.21.15.36:0/3106208247 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004000b180 con 0x7f00500ad4e0 2022-01-10T01:32:37.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f004d7fa700 1 -- 172.21.15.36:0/3106208247 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0044005800 con 0x7f00500ad4e0 2022-01-10T01:32:37.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f00552ac700 1 -- 172.21.15.36:0/3106208247 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0050153a40 con 0x7f00500ad4e0 2022-01-10T01:32:37.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f00552ac700 1 -- 172.21.15.36:0/3106208247 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0050153bd0 con 0x7f00500ad4e0 2022-01-10T01:32:37.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.003+0000 7f004d7fa700 1 -- 172.21.15.36:0/3106208247 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f004401a060 con 0x7f00500ad4e0 2022-01-10T01:32:37.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.007+0000 7f004d7fa700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0030053590 0x7f0030055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:37.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.007+0000 7f004d7fa700 1 -- 172.21.15.36:0/3106208247 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f004406b140 con 0x7f00500ad4e0 2022-01-10T01:32:37.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.007+0000 7f004f7fe700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0030053590 0x7f0030055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:37.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.007+0000 7f004f7fe700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0030053590 0x7f0030055a50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f004001a000 tx=0x7f0040014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:37.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.011+0000 7f004d7fa700 1 -- 172.21.15.36:0/3106208247 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0044042040 con 0x7f00500ad4e0 2022-01-10T01:32:37.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.171+0000 7f00552ac700 1 -- 172.21.15.36:0/3106208247 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00500af480 con 0x7f00500ad4e0 2022-01-10T01:32:37.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.171+0000 7f004d7fa700 1 -- 172.21.15.36:0/3106208247 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f00500af480 con 0x7f00500ad4e0 2022-01-10T01:32:37.176 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:37.177 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":56,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7590,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/2655140224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":2655140224},{"type":"v1","addr":"172.21.15.36:6837","nonce":2655140224}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":54},{"gid":7597,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/772662757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":772662757},{"type":"v1","addr":"172.21.15.59:6833","nonce":772662757}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":55}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:32:28.774139+0000","modified":"2022-01-10T01:32:29.795777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":36638},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36638":{"gid":36638,"name":"c","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6835/1669955501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":1669955501},{"type":"v1","addr":"172.21.15.36:6835","nonce":1669955501}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2022-01-10T01:32:37.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.175+0000 7f00552ac700 1 -- 172.21.15.36:0/3106208247 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0030053590 msgr2=0x7f0030055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:37.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.175+0000 7f00552ac700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0030053590 0x7f0030055a50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f004001a000 tx=0x7f0040014000).stop 2022-01-10T01:32:37.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.175+0000 7f00552ac700 1 -- 172.21.15.36:0/3106208247 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00500ad4e0 msgr2=0x7f0050141a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:37.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.175+0000 7f00552ac700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00500ad4e0 0x7f0050141a10 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f00440012a0 tx=0x7f0044007940).stop 2022-01-10T01:32:37.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.175+0000 7f00552ac700 1 -- 172.21.15.36:0/3106208247 shutdown_connections 2022-01-10T01:32:37.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.175+0000 7f00552ac700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0030053590 0x7f0030055a50 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:37.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.175+0000 7f00552ac700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f005013f8b0 0x7f00500ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:37.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.175+0000 7f00552ac700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00500b03e0 0x7f0050153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:37.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.175+0000 7f00552ac700 1 --2- 172.21.15.36:0/3106208247 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f00500ad4e0 0x7f0050141a10 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:37.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.175+0000 7f00552ac700 1 -- 172.21.15.36:0/3106208247 >> 172.21.15.36:0/3106208247 conn(0x7f00500611d0 msgr2=0x7f00500b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:37.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.175+0000 7f00552ac700 1 -- 172.21.15.36:0/3106208247 shutdown_connections 2022-01-10T01:32:37.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:37.175+0000 7f00552ac700 1 -- 172.21.15.36:0/3106208247 wait complete. 2022-01-10T01:32:37.182 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 56 2022-01-10T01:32:37.496 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:32:28.774139+0000', 'modified': '2022-01-10T01:32:29.795777+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 36638}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_36638': {'gid': 36638, 'name': 'c', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6835/1669955501', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6834', 'nonce': 1669955501}, {'type': 'v1', 'addr': '172.21.15.36:6835', 'nonce': 1669955501}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:32:37.497 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:32:37.498 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2022-01-10T01:32:37.615 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":36638,"want_state":"up:active","state":"up:active","rank_uptime":8.8256608710000002,"mdsmap_epoch":56,"osdmap_epoch":120,"osdmap_epoch_barrier":120,"uptime":13.220778277999999} 2022-01-10T01:32:37.615 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 36638, "mdsmap_epoch": 56, "osdmap_epoch": 120, "osdmap_epoch_barrier": 120, "rank_uptime": 8.825660871, "state": "up:active", "uptime": 13.220778278, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:32:37.616 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:32:37.616 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2022-01-10T01:32:37.617 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi166.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2022-01-10T01:32:37.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:37.618 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:37.626 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:32:37.687 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:32:37.688 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:32:37.700 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:32:37.701 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:32:37.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:37.703 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:32:37.708 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:32:37.709 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:37.712 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:32:37.726 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:32:37.727 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:32:37.787 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:2022-01-10T01:32:37.787+0000 7fbe1eea7080 -1 init, newargv = 0x5560f2348c50 newargc=9 2022-01-10T01:32:37.787 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14527]: starting ceph client 2022-01-10T01:32:37.788 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:32:37.789 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:32:37.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:37.790 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:32:37.797 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14527]: starting fuse 2022-01-10T01:32:38.898 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:32:38.917 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:32:38.918 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:32:38.974 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:32:38.975 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:32:38.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:38.978 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:32:38.984 INFO:teuthology.orchestra.run.smithi166.stdout:52 2022-01-10T01:32:38.984 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:32:38.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:38.986 DEBUG:teuthology.orchestra.run.smithi166:> sudo python3 -c ' 2022-01-10T01:32:38.986 DEBUG:teuthology.orchestra.run.smithi166:> import glob 2022-01-10T01:32:38.987 DEBUG:teuthology.orchestra.run.smithi166:> import re 2022-01-10T01:32:38.988 DEBUG:teuthology.orchestra.run.smithi166:> import os 2022-01-10T01:32:38.989 DEBUG:teuthology.orchestra.run.smithi166:> import subprocess 2022-01-10T01:32:38.990 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:32:38.991 DEBUG:teuthology.orchestra.run.smithi166:> def find_socket(client_name): 2022-01-10T01:32:38.992 DEBUG:teuthology.orchestra.run.smithi166:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2022-01-10T01:32:38.992 DEBUG:teuthology.orchestra.run.smithi166:> files = glob.glob(asok_path) 2022-01-10T01:32:38.993 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:32:38.994 DEBUG:teuthology.orchestra.run.smithi166:> # Given a non-glob path, it better be there 2022-01-10T01:32:38.995 DEBUG:teuthology.orchestra.run.smithi166:> if "*" not in asok_path: 2022-01-10T01:32:38.995 DEBUG:teuthology.orchestra.run.smithi166:> assert(len(files) == 1) 2022-01-10T01:32:38.996 DEBUG:teuthology.orchestra.run.smithi166:> return files[0] 2022-01-10T01:32:38.997 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:32:38.998 DEBUG:teuthology.orchestra.run.smithi166:> for f in files: 2022-01-10T01:32:38.998 DEBUG:teuthology.orchestra.run.smithi166:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:32:38.999 DEBUG:teuthology.orchestra.run.smithi166:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:32:39.000 DEBUG:teuthology.orchestra.run.smithi166:> return f 2022-01-10T01:32:39.000 DEBUG:teuthology.orchestra.run.smithi166:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:32:39.001 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:32:39.001 DEBUG:teuthology.orchestra.run.smithi166:> print(find_socket("client.1")) 2022-01-10T01:32:39.002 DEBUG:teuthology.orchestra.run.smithi166:> ' 2022-01-10T01:32:39.046 INFO:teuthology.orchestra.run.smithi166.stdout:/var/run/ceph/ceph-client.1.14527.asok 2022-01-10T01:32:39.051 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14527.asok 2022-01-10T01:32:39.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:39.052 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14527.asok status 2022-01-10T01:32:39.184 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2022-01-10T01:32:39.184 INFO:teuthology.orchestra.run.smithi166.stdout: "metadata": { 2022-01-10T01:32:39.184 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:32:39.185 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:32:39.185 INFO:teuthology.orchestra.run.smithi166.stdout: "entity_id": "1", 2022-01-10T01:32:39.185 INFO:teuthology.orchestra.run.smithi166.stdout: "hostname": "smithi166", 2022-01-10T01:32:39.185 INFO:teuthology.orchestra.run.smithi166.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2022-01-10T01:32:39.185 INFO:teuthology.orchestra.run.smithi166.stdout: "pid": "14527", 2022-01-10T01:32:39.186 INFO:teuthology.orchestra.run.smithi166.stdout: "root": "/" 2022-01-10T01:32:39.186 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:32:39.186 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_count": 0, 2022-01-10T01:32:39.186 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_pinned_count": 0, 2022-01-10T01:32:39.187 INFO:teuthology.orchestra.run.smithi166.stdout: "id": 7806, 2022-01-10T01:32:39.187 INFO:teuthology.orchestra.run.smithi166.stdout: "inst": { 2022-01-10T01:32:39.187 INFO:teuthology.orchestra.run.smithi166.stdout: "name": { 2022-01-10T01:32:39.187 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "client", 2022-01-10T01:32:39.188 INFO:teuthology.orchestra.run.smithi166.stdout: "num": 7806 2022-01-10T01:32:39.188 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:32:39.188 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:32:39.188 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:32:39.188 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:32:39.189 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 1545386887 2022-01-10T01:32:39.189 INFO:teuthology.orchestra.run.smithi166.stdout: } 2022-01-10T01:32:39.189 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:32:39.189 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:32:39.189 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:32:39.190 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:32:39.190 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 1545386887 2022-01-10T01:32:39.190 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:32:39.190 INFO:teuthology.orchestra.run.smithi166.stdout: "inst_str": "client.7806 172.21.15.166:0/1545386887", 2022-01-10T01:32:39.191 INFO:teuthology.orchestra.run.smithi166.stdout: "addr_str": "172.21.15.166:0/1545386887", 2022-01-10T01:32:39.191 INFO:teuthology.orchestra.run.smithi166.stdout: "inode_count": 1, 2022-01-10T01:32:39.191 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_epoch": 56, 2022-01-10T01:32:39.191 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch": 120, 2022-01-10T01:32:39.191 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:32:39.192 INFO:teuthology.orchestra.run.smithi166.stdout: "blacklisted": false, 2022-01-10T01:32:39.192 INFO:teuthology.orchestra.run.smithi166.stdout: "fs_name": "cephfs" 2022-01-10T01:32:39.192 INFO:teuthology.orchestra.run.smithi166.stdout:} 2022-01-10T01:32:39.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:39.194 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:39.194 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:39.204 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:32:39.204 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:32:39.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:39.206 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:39.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:39.227 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:39.228 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:39.236 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:32:39.238 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:32:39.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:39.239 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:39.239 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:39.249 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:32:39.251 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:32:39.251 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:32:39.252 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:32:39.252 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:39.307 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[15054]: fuse finished with error 0 and tester_r 0 2022-01-10T01:32:39.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:39.309 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:39.310 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:39.316 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:32:39.317 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:32:39.318 INFO:teuthology.orchestra.run:waiting for 900 2022-01-10T01:32:45.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:32:45.420 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:32:45.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:45.429 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:45.430 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:45.439 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:32:45.440 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:32:45.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:45.441 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:45.441 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:45.449 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:32:45.450 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:32:45.451 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi166.front.sepia.ceph.com... 2022-01-10T01:32:45.451 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:32:45.452 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:45.509 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14527]: fuse finished with error 0 and tester_r 0 2022-01-10T01:32:45.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:32:45.512 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:32:45.512 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:45.519 INFO:teuthology.orchestra.run.smithi166.stdout:ext2/ext3 2022-01-10T01:32:45.520 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:32:45.521 INFO:teuthology.orchestra.run:waiting for 900 2022-01-10T01:32:45.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:32:45.589 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:32:45.597 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-01-10T01:32:45.598 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:32:45.598 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-01-10T01:32:45.599 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:32:45.599 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-01-10T01:32:45.599 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:32:45.613 INFO:tasks.ceph.mds.a:Stopped 2022-01-10T01:32:45.614 DEBUG:teuthology.parallel:result is None 2022-01-10T01:32:45.615 INFO:tasks.ceph.mds.c:Stopped 2022-01-10T01:32:45.616 DEBUG:teuthology.parallel:result is None 2022-01-10T01:32:45.618 INFO:tasks.ceph.mds.b:Stopped 2022-01-10T01:32:45.618 DEBUG:teuthology.parallel:result is None 2022-01-10T01:32:45.619 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2022-01-10T01:32:45.620 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2022-01-10T01:32:45.620 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2022-01-10T01:32:45.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d759e700 1 Processor -- start 2022-01-10T01:32:45.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d759e700 1 -- start start 2022-01-10T01:32:45.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d759e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f96d8061320 0x7f96d8061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96d8140440 0x7f96d81408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d759e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d80aecf0 con 0x7f96d80ad5c0 2022-01-10T01:32:45.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d759e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d80b6f20 con 0x7f96d8061320 2022-01-10T01:32:45.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d80aef20 con 0x7f96d8140440 2022-01-10T01:32:45.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d659c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f96d8061320 0x7f96d8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d5d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f96d80ad5c0 0x7f96d80b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38838/0 (socket says 172.21.15.36:38838) 2022-01-10T01:32:45.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d5d9b700 1 -- 172.21.15.36:0/1822352173 learned_addr learned my addr 172.21.15.36:0/1822352173 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:45.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d6d9d700 1 --2- 172.21.15.36:0/1822352173 >> v2:172.21.15.59:3300/0 conn(0x7f96d8140440 0x7f96d81408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d659c700 1 -- 172.21.15.36:0/1822352173 >> v2:172.21.15.59:3300/0 conn(0x7f96d8140440 msgr2=0x7f96d81408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:45.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d659c700 1 --2- 172.21.15.36:0/1822352173 >> v2:172.21.15.59:3300/0 conn(0x7f96d8140440 0x7f96d81408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:45.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d559a700 1 -- 172.21.15.36:0/1822352173 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738188985 0 0) 0x7f96d80aecf0 con 0x7f96d80ad5c0 2022-01-10T01:32:45.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d659c700 1 -- 172.21.15.36:0/1822352173 >> v1:172.21.15.36:6789/0 conn(0x7f96d80ad5c0 legacy=0x7f96d80b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:45.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d659c700 1 -- 172.21.15.36:0/1822352173 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d80af1c0 con 0x7f96d8061320 2022-01-10T01:32:45.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d659c700 1 --2- 172.21.15.36:0/1822352173 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d8061320 0x7f96d8061700 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7f96d80aeba0 tx=0x7f96d00091d0).ready entity=mon.0 client_cookie=5268fa748a835e4e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:45.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d559a700 1 -- 172.21.15.36:0/1822352173 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d0009ea0 con 0x7f96d8061320 2022-01-10T01:32:45.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d559a700 1 -- 172.21.15.36:0/1822352173 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d000b860 con 0x7f96d8061320 2022-01-10T01:32:45.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.758+0000 7f96d559a700 1 -- 172.21.15.36:0/1822352173 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d000b9d0 con 0x7f96d8061320 2022-01-10T01:32:45.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 -- 172.21.15.36:0/1822352173 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d8061320 msgr2=0x7f96d8061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:45.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 --2- 172.21.15.36:0/1822352173 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d8061320 0x7f96d8061700 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7f96d80aeba0 tx=0x7f96d00091d0).stop 2022-01-10T01:32:45.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 -- 172.21.15.36:0/1822352173 shutdown_connections 2022-01-10T01:32:45.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 --2- 172.21.15.36:0/1822352173 >> v2:172.21.15.59:3300/0 conn(0x7f96d8140440 0x7f96d81408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:45.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 --2- 172.21.15.36:0/1822352173 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d8061320 0x7f96d8061700 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:45.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 -- 172.21.15.36:0/1822352173 >> 172.21.15.36:0/1822352173 conn(0x7f96d8066de0 msgr2=0x7f96d80671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:45.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 -- 172.21.15.36:0/1822352173 shutdown_connections 2022-01-10T01:32:45.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 -- 172.21.15.36:0/1822352173 wait complete. 2022-01-10T01:32:45.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 Processor -- start 2022-01-10T01:32:45.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 -- start start 2022-01-10T01:32:45.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d8061320 0x7f96d80b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96d80ad5c0 0x7f96d80b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d8140440 0x7f96d8144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d80b0c10 con 0x7f96d8140440 2022-01-10T01:32:45.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d80b2690 con 0x7f96d80ad5c0 2022-01-10T01:32:45.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d81530f0 con 0x7f96d8061320 2022-01-10T01:32:45.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d6d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d8140440 0x7f96d8144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d6d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d8140440 0x7f96d8144990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41052/0 (socket says 172.21.15.36:41052) 2022-01-10T01:32:45.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d6d9d700 1 -- 172.21.15.36:0/1070314657 learned_addr learned my addr 172.21.15.36:0/1070314657 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:45.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d5d9b700 1 --2- 172.21.15.36:0/1070314657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96d80ad5c0 0x7f96d80b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.762+0000 7f96d659c700 1 --2- 172.21.15.36:0/1070314657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d8061320 0x7f96d80b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96d659c700 1 -- 172.21.15.36:0/1070314657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96d80ad5c0 msgr2=0x7f96d80b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:45.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96d659c700 1 --2- 172.21.15.36:0/1070314657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96d80ad5c0 0x7f96d80b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:45.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96d659c700 1 -- 172.21.15.36:0/1070314657 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d8140440 msgr2=0x7f96d8144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:45.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96d659c700 1 --2- 172.21.15.36:0/1070314657 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d8140440 0x7f96d8144990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:45.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96d659c700 1 -- 172.21.15.36:0/1070314657 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d0009470 con 0x7f96d8061320 2022-01-10T01:32:45.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96d659c700 1 --2- 172.21.15.36:0/1070314657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d8061320 0x7f96d80b1a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f96d80aeba0 tx=0x7f96d0016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:45.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96c77fe700 1 -- 172.21.15.36:0/1070314657 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d00032f0 con 0x7f96d8061320 2022-01-10T01:32:45.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96d759e700 1 -- 172.21.15.36:0/1070314657 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d80b0e40 con 0x7f96d8061320 2022-01-10T01:32:45.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96c77fe700 1 -- 172.21.15.36:0/1070314657 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d000b9d0 con 0x7f96d8061320 2022-01-10T01:32:45.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96c77fe700 1 -- 172.21.15.36:0/1070314657 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96d001f5e0 con 0x7f96d8061320 2022-01-10T01:32:45.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96d759e700 1 -- 172.21.15.36:0/1070314657 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d8144e80 con 0x7f96d8061320 2022-01-10T01:32:45.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96c77fe700 1 -- 172.21.15.36:0/1070314657 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f96d000f070 con 0x7f96d8061320 2022-01-10T01:32:45.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96c77fe700 1 --2- 172.21.15.36:0/1070314657 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96b4053500 0x7f96b40559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96c77fe700 1 -- 172.21.15.36:0/1070314657 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f96d006c440 con 0x7f96d8061320 2022-01-10T01:32:45.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96d5d9b700 1 --2- 172.21.15.36:0/1070314657 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96b4053500 0x7f96b40559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.766+0000 7f96d5d9b700 1 --2- 172.21.15.36:0/1070314657 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96b4053500 0x7f96b40559c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f96cc00d000 tx=0x7f96cc007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:45.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.770+0000 7f96d759e700 1 -- 172.21.15.36:0/1070314657 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d80af460 con 0x7f96d8061320 2022-01-10T01:32:45.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.778+0000 7f96c77fe700 1 -- 172.21.15.36:0/1070314657 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f96d0043380 con 0x7f96d8061320 2022-01-10T01:32:45.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.782+0000 7f89c1b7b700 1 Processor -- start 2022-01-10T01:32:45.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.782+0000 7f89c1b7b700 1 -- start start 2022-01-10T01:32:45.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.782+0000 7f89c1b7b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f89bc139ae0 0x7f89bc142db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.782+0000 7f89c1b7b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89bc0ac470 con 0x7f89bc0b1c50 2022-01-10T01:32:45.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.782+0000 7f89c1b7b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89bc143730 con 0x7f89bc1432a0 2022-01-10T01:32:45.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.782+0000 7f89c1b7b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89bc0b3010 con 0x7f89bc139ae0 2022-01-10T01:32:45.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.782+0000 7f89bb7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f89bc139ae0 0x7f89bc142db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.782+0000 7f89bbfff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f89bc0b1c50 0x7f89bc0a8950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38854/0 (socket says 172.21.15.36:38854) 2022-01-10T01:32:45.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.782+0000 7f89bb7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f89bc139ae0 0x7f89bc142db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41056/0 (socket says 172.21.15.36:41056) 2022-01-10T01:32:45.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.782+0000 7f89bbfff700 1 -- 172.21.15.36:0/3861670846 learned_addr learned my addr 172.21.15.36:0/3861670846 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:45.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.782+0000 7f89b2ffd700 1 --1- 172.21.15.36:0/3861670846 >> v1:172.21.15.59:6789/0 conn(0x7f89bc1432a0 0x7f89bc0ab530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:56528/0 (socket says 172.21.15.36:56528) 2022-01-10T01:32:45.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89bb7fe700 1 -- 172.21.15.36:0/3861670846 >> v1:172.21.15.59:6789/0 conn(0x7f89bc1432a0 legacy=0x7f89bc0ab530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:45.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89baffd700 1 -- 172.21.15.36:0/3861670846 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699731672 0 0) 0x7f89bc143730 con 0x7f89bc1432a0 2022-01-10T01:32:45.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89bb7fe700 1 -- 172.21.15.36:0/3861670846 >> v1:172.21.15.36:6789/0 conn(0x7f89bc0b1c50 legacy=0x7f89bc0a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:45.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89bb7fe700 1 -- 172.21.15.36:0/3861670846 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc1439d0 con 0x7f89bc139ae0 2022-01-10T01:32:45.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89bb7fe700 1 --2- 172.21.15.36:0/3861670846 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89bc139ae0 0x7f89bc142db0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f89a4002f70 tx=0x7f89a4006df0).ready entity=mon.0 client_cookie=3c1f75257a0ace4f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:45.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89baffd700 1 -- 172.21.15.36:0/3861670846 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89a4014070 con 0x7f89bc139ae0 2022-01-10T01:32:45.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89baffd700 1 -- 172.21.15.36:0/3861670846 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a4000e90 con 0x7f89bc139ae0 2022-01-10T01:32:45.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89baffd700 1 -- 172.21.15.36:0/3861670846 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89a400eb00 con 0x7f89bc139ae0 2022-01-10T01:32:45.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89c1b7b700 1 -- 172.21.15.36:0/3861670846 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89bc139ae0 msgr2=0x7f89bc142db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:45.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89c1b7b700 1 --2- 172.21.15.36:0/3861670846 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89bc139ae0 0x7f89bc142db0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f89a4002f70 tx=0x7f89a4006df0).stop 2022-01-10T01:32:45.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89c1b7b700 1 -- 172.21.15.36:0/3861670846 shutdown_connections 2022-01-10T01:32:45.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89c1b7b700 1 --2- 172.21.15.36:0/3861670846 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89bc139ae0 0x7f89bc142db0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:45.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89c1b7b700 1 -- 172.21.15.36:0/3861670846 >> 172.21.15.36:0/3861670846 conn(0x7f89bc05f6b0 msgr2=0x7f89bc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:45.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89c1b7b700 1 -- 172.21.15.36:0/3861670846 shutdown_connections 2022-01-10T01:32:45.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.786+0000 7f89c1b7b700 1 -- 172.21.15.36:0/3861670846 wait complete. 2022-01-10T01:32:45.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f56233b4700 1 Processor -- start 2022-01-10T01:32:45.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f56233b4700 1 -- start start 2022-01-10T01:32:45.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89c1b7b700 1 Processor -- start 2022-01-10T01:32:45.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89c1b7b700 1 -- start start 2022-01-10T01:32:45.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89c1b7b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89bc0b1c50 0x7f89bc062f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89c1b7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89bc063420 0x7f89bc1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f56233b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f561c0af2c0 0x7f561c0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89c1b7b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89bc151de0 0x7f89bc138820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89c1b7b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc139f90 con 0x7f89bc151de0 2022-01-10T01:32:45.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89c1b7b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc13a1c0 con 0x7f89bc0b1c50 2022-01-10T01:32:45.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89c1b7b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc13acd0 con 0x7f89bc063420 2022-01-10T01:32:45.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f56233b4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f561c0ad320 0x7f561c143150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f56233b4700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561c0afda0 con 0x7f561c143640 2022-01-10T01:32:45.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f56233b4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561c05c610 con 0x7f561c0ad320 2022-01-10T01:32:45.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f56233b4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561c140800 con 0x7f561c0af2c0 2022-01-10T01:32:45.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89bbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89bc151de0 0x7f89bc138820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89bbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89bc151de0 0x7f89bc138820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41068/0 (socket says 172.21.15.36:41068) 2022-01-10T01:32:45.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f5621bb1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f561c0ad320 0x7f561c143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89bbfff700 1 -- 172.21.15.36:0/1006990964 learned_addr learned my addr 172.21.15.36:0/1006990964 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:45.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89b2ffd700 1 --2- 172.21.15.36:0/1006990964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89bc063420 0x7f89bc1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f5621bb1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f561c0ad320 0x7f561c143150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41070/0 (socket says 172.21.15.36:41070) 2022-01-10T01:32:45.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f5621bb1700 1 -- 172.21.15.36:0/2549067114 learned_addr learned my addr 172.21.15.36:0/2549067114 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:45.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89bb7fe700 1 --2- 172.21.15.36:0/1006990964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89bc0b1c50 0x7f89bc062f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f56223b2700 1 --2- 172.21.15.36:0/2549067114 >> v2:172.21.15.59:3300/0 conn(0x7f561c0af2c0 0x7f561c0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f5621bb1700 1 -- 172.21.15.36:0/2549067114 >> v2:172.21.15.59:3300/0 conn(0x7f561c0af2c0 msgr2=0x7f561c0af6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:45.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f5621bb1700 1 --2- 172.21.15.36:0/2549067114 >> v2:172.21.15.59:3300/0 conn(0x7f561c0af2c0 0x7f561c0af6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:45.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f5621bb1700 1 -- 172.21.15.36:0/2549067114 >> v1:172.21.15.36:6789/0 conn(0x7f561c143640 legacy=0x7f561c0a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:45.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89bbfff700 1 -- 172.21.15.36:0/1006990964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89bc063420 msgr2=0x7f89bc1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:45.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89bbfff700 1 --2- 172.21.15.36:0/1006990964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89bc063420 0x7f89bc1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:45.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89bbfff700 1 -- 172.21.15.36:0/1006990964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89bc0b1c50 msgr2=0x7f89bc062f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:45.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89bbfff700 1 --2- 172.21.15.36:0/1006990964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89bc0b1c50 0x7f89bc062f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:45.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89bbfff700 1 -- 172.21.15.36:0/1006990964 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a400b180 con 0x7f89bc151de0 2022-01-10T01:32:45.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f5621bb1700 1 -- 172.21.15.36:0/2549067114 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561c0a93c0 con 0x7f561c0ad320 2022-01-10T01:32:45.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89bbfff700 1 --2- 172.21.15.36:0/1006990964 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89bc151de0 0x7f89bc138820 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f89bc13a870 tx=0x7f89b400c270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:45.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f5621bb1700 1 --2- 172.21.15.36:0/2549067114 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f561c0ad320 0x7f561c143150 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f561c0ad770 tx=0x7f560c006eb0).ready entity=mon.0 client_cookie=6a258bdf656f823b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:45.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89b97fa700 1 -- 172.21.15.36:0/1006990964 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89b4005d90 con 0x7f89bc151de0 2022-01-10T01:32:45.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89c1b7b700 1 -- 172.21.15.36:0/1006990964 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89bc13c220 con 0x7f89bc151de0 2022-01-10T01:32:45.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89b97fa700 1 -- 172.21.15.36:0/1006990964 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b4007110 con 0x7f89bc151de0 2022-01-10T01:32:45.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89c1b7b700 1 -- 172.21.15.36:0/1006990964 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89bc1405d0 con 0x7f89bc151de0 2022-01-10T01:32:45.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f89b97fa700 1 -- 172.21.15.36:0/1006990964 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89b4007470 con 0x7f89bc151de0 2022-01-10T01:32:45.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f56213b0700 1 -- 172.21.15.36:0/2549067114 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f560c00d610 con 0x7f561c0ad320 2022-01-10T01:32:45.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f56213b0700 1 -- 172.21.15.36:0/2549067114 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c000e90 con 0x7f561c0ad320 2022-01-10T01:32:45.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.790+0000 7f56213b0700 1 -- 172.21.15.36:0/2549067114 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f560c00d960 con 0x7f561c0ad320 2022-01-10T01:32:45.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f56233b4700 1 -- 172.21.15.36:0/2549067114 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f561c0ad320 msgr2=0x7f561c143150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:45.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f56233b4700 1 --2- 172.21.15.36:0/2549067114 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f561c0ad320 0x7f561c143150 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f561c0ad770 tx=0x7f560c006eb0).stop 2022-01-10T01:32:45.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f56233b4700 1 -- 172.21.15.36:0/2549067114 shutdown_connections 2022-01-10T01:32:45.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f56233b4700 1 --2- 172.21.15.36:0/2549067114 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f561c0ad320 0x7f561c143150 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:45.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f56233b4700 1 --2- 172.21.15.36:0/2549067114 >> v2:172.21.15.59:3300/0 conn(0x7f561c0af2c0 0x7f561c0af6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:45.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f56233b4700 1 -- 172.21.15.36:0/2549067114 >> 172.21.15.36:0/2549067114 conn(0x7f561c061140 msgr2=0x7f561c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:45.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f56233b4700 1 -- 172.21.15.36:0/2549067114 shutdown_connections 2022-01-10T01:32:45.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f56233b4700 1 -- 172.21.15.36:0/2549067114 wait complete. 2022-01-10T01:32:45.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f89b97fa700 1 -- 172.21.15.36:0/1006990964 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f89b40075d0 con 0x7f89bc151de0 2022-01-10T01:32:45.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f89b97fa700 1 --2- 172.21.15.36:0/1006990964 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f89a0053620 0x7f89a0055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f89b97fa700 1 -- 172.21.15.36:0/1006990964 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f89b406e300 con 0x7f89bc151de0 2022-01-10T01:32:45.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f89bb7fe700 1 --2- 172.21.15.36:0/1006990964 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f89a0053620 0x7f89a0055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f89bb7fe700 1 --2- 172.21.15.36:0/1006990964 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f89a0053620 0x7f89a0055ae0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f89a401c000 tx=0x7f89a4016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:45.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f56233b4700 1 Processor -- start 2022-01-10T01:32:45.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f56233b4700 1 -- start start 2022-01-10T01:32:45.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.794+0000 7f89c1b7b700 1 -- 172.21.15.36:0/1006990964 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8994003410 con 0x7f89bc151de0 2022-01-10T01:32:45.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f56233b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561c0ad320 0x7f561c0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f56233b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f561c0af2c0 0x7f561c1501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f56233b4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f561c143640 0x7f561c153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f56233b4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c1537e0 con 0x7f561c143640 2022-01-10T01:32:45.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f56233b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c0a9f90 con 0x7f561c0ad320 2022-01-10T01:32:45.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f56233b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561c153a10 con 0x7f561c0af2c0 2022-01-10T01:32:45.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f5622bb3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f561c143640 0x7f561c153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f56223b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561c0ad320 0x7f561c0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f5622bb3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f561c143640 0x7f561c153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41080/0 (socket says 172.21.15.36:41080) 2022-01-10T01:32:45.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f56223b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561c0ad320 0x7f561c0b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:37710/0 (socket says 172.21.15.36:37710) 2022-01-10T01:32:45.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f5622bb3700 1 -- 172.21.15.36:0/2659565193 learned_addr learned my addr 172.21.15.36:0/2659565193 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:45.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f5621bb1700 1 --2- 172.21.15.36:0/2659565193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f561c0af2c0 0x7f561c1501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f5622bb3700 1 -- 172.21.15.36:0/2659565193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f561c0af2c0 msgr2=0x7f561c1501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:45.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f5622bb3700 1 --2- 172.21.15.36:0/2659565193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f561c0af2c0 0x7f561c1501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:45.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f5622bb3700 1 -- 172.21.15.36:0/2659565193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561c0ad320 msgr2=0x7f561c0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:45.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f5622bb3700 1 --2- 172.21.15.36:0/2659565193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561c0ad320 0x7f561c0b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:45.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f5622bb3700 1 -- 172.21.15.36:0/2659565193 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c00b1e0 con 0x7f561c143640 2022-01-10T01:32:45.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.798+0000 7f5622bb3700 1 --2- 172.21.15.36:0/2659565193 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f561c143640 0x7f561c153eb0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f561c062870 tx=0x7f5614007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:45.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.802+0000 7f560b7fe700 1 -- 172.21.15.36:0/2659565193 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f561400ce50 con 0x7f561c143640 2022-01-10T01:32:45.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.802+0000 7f560b7fe700 1 -- 172.21.15.36:0/2659565193 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f561400f470 con 0x7f561c143640 2022-01-10T01:32:45.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.802+0000 7f560b7fe700 1 -- 172.21.15.36:0/2659565193 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f561400f7d0 con 0x7f561c143640 2022-01-10T01:32:45.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.802+0000 7f56233b4700 1 -- 172.21.15.36:0/2659565193 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561c0aa230 con 0x7f561c143640 2022-01-10T01:32:45.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.802+0000 7f56233b4700 1 -- 172.21.15.36:0/2659565193 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561c0a9840 con 0x7f561c143640 2022-01-10T01:32:45.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.802+0000 7f89b97fa700 1 -- 172.21.15.36:0/1006990964 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f89b4045270 con 0x7f89bc151de0 2022-01-10T01:32:45.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.802+0000 7f56233b4700 1 -- 172.21.15.36:0/2659565193 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561c153bd0 con 0x7f561c143640 2022-01-10T01:32:45.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.802+0000 7f560b7fe700 1 -- 172.21.15.36:0/2659565193 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5614019030 con 0x7f561c143640 2022-01-10T01:32:45.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.806+0000 7f560b7fe700 1 --2- 172.21.15.36:0/2659565193 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55fc0535f0 0x7f55fc055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:45.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.806+0000 7f560b7fe700 1 -- 172.21.15.36:0/2659565193 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f561406af00 con 0x7f561c143640 2022-01-10T01:32:45.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.806+0000 7f56223b2700 1 --2- 172.21.15.36:0/2659565193 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55fc0535f0 0x7f55fc055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:45.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.806+0000 7f56223b2700 1 --2- 172.21.15.36:0/2659565193 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55fc0535f0 0x7f55fc055ab0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f561800c000 tx=0x7f5618008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:45.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.814+0000 7f560b7fe700 1 -- 172.21.15.36:0/2659565193 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5614041f10 con 0x7f561c143640 2022-01-10T01:32:45.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.950+0000 7f96d759e700 1 -- 172.21.15.36:0/1070314657 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f96d8057350 con 0x7f96d8061320 2022-01-10T01:32:45.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.974+0000 7f89c1b7b700 1 -- 172.21.15.36:0/1006990964 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f89940036c0 con 0x7f89bc151de0 2022-01-10T01:32:45.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:45.986+0000 7f56233b4700 1 -- 172.21.15.36:0/2659565193 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f561c057350 con 0x7f561c143640 2022-01-10T01:32:46.689 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:32:46.686+0000 7f0b5376f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:32:46.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.698+0000 7f89b97fa700 1 -- 172.21.15.36:0/1006990964 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 36638 v57) v1 ==== 96+0+0 (secure 0 0 0) 0x7f89b4048890 con 0x7f89bc151de0 2022-01-10T01:32:46.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.698+0000 7f560b7fe700 1 -- 172.21.15.36:0/2659565193 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7597 v57) v1 ==== 95+0+0 (secure 0 0 0) 0x7f5614045530 con 0x7f561c143640 2022-01-10T01:32:46.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.698+0000 7f96c77fe700 1 -- 172.21.15.36:0/1070314657 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 7590 v57) v1 ==== 95+0+0 (secure 0 0 0) 0x7f96d0024070 con 0x7f96d8061320 2022-01-10T01:32:46.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f56233b4700 1 -- 172.21.15.36:0/2659565193 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55fc0535f0 msgr2=0x7f55fc055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:46.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f89c1b7b700 1 -- 172.21.15.36:0/1006990964 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f89a0053620 msgr2=0x7f89a0055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:46.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f89c1b7b700 1 --2- 172.21.15.36:0/1006990964 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f89a0053620 0x7f89a0055ae0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f89a401c000 tx=0x7f89a4016000).stop 2022-01-10T01:32:46.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f56233b4700 1 --2- 172.21.15.36:0/2659565193 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55fc0535f0 0x7f55fc055ab0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f561800c000 tx=0x7f5618008040).stop 2022-01-10T01:32:46.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f56233b4700 1 -- 172.21.15.36:0/2659565193 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f561c143640 msgr2=0x7f561c153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:46.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f89c1b7b700 1 -- 172.21.15.36:0/1006990964 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89bc151de0 msgr2=0x7f89bc138820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:46.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f89c1b7b700 1 --2- 172.21.15.36:0/1006990964 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89bc151de0 0x7f89bc138820 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f89bc13a870 tx=0x7f89b400c270).stop 2022-01-10T01:32:46.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f56233b4700 1 --2- 172.21.15.36:0/2659565193 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f561c143640 0x7f561c153eb0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7f561c062870 tx=0x7f5614007f20).stop 2022-01-10T01:32:46.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f56233b4700 1 -- 172.21.15.36:0/2659565193 shutdown_connections 2022-01-10T01:32:46.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f56233b4700 1 --2- 172.21.15.36:0/2659565193 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f55fc0535f0 0x7f55fc055ab0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f56233b4700 1 --2- 172.21.15.36:0/2659565193 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f561c143640 0x7f561c153eb0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f56233b4700 1 --2- 172.21.15.36:0/2659565193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f561c0af2c0 0x7f561c1501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f56233b4700 1 --2- 172.21.15.36:0/2659565193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561c0ad320 0x7f561c0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f56233b4700 1 -- 172.21.15.36:0/2659565193 >> 172.21.15.36:0/2659565193 conn(0x7f561c061140 msgr2=0x7f561c13db10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:46.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f89c1b7b700 1 -- 172.21.15.36:0/1006990964 shutdown_connections 2022-01-10T01:32:46.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f89c1b7b700 1 --2- 172.21.15.36:0/1006990964 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f89a0053620 0x7f89a0055ae0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f56233b4700 1 -- 172.21.15.36:0/2659565193 shutdown_connections 2022-01-10T01:32:46.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f89c1b7b700 1 --2- 172.21.15.36:0/1006990964 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89bc151de0 0x7f89bc138820 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f89c1b7b700 1 --2- 172.21.15.36:0/1006990964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89bc063420 0x7f89bc1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f89c1b7b700 1 --2- 172.21.15.36:0/1006990964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89bc0b1c50 0x7f89bc062f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f89c1b7b700 1 -- 172.21.15.36:0/1006990964 >> 172.21.15.36:0/1006990964 conn(0x7f89bc05f6b0 msgr2=0x7f89bc0b4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:46.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f56233b4700 1 -- 172.21.15.36:0/2659565193 wait complete. 2022-01-10T01:32:46.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f89c1b7b700 1 -- 172.21.15.36:0/1006990964 shutdown_connections 2022-01-10T01:32:46.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f89c1b7b700 1 -- 172.21.15.36:0/1006990964 wait complete. 2022-01-10T01:32:46.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f96d759e700 1 -- 172.21.15.36:0/1070314657 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96b4053500 msgr2=0x7f96b40559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:46.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f96d759e700 1 --2- 172.21.15.36:0/1070314657 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96b4053500 0x7f96b40559c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f96cc00d000 tx=0x7f96cc007a00).stop 2022-01-10T01:32:46.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f96d759e700 1 -- 172.21.15.36:0/1070314657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d8061320 msgr2=0x7f96d80b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:46.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f96d759e700 1 --2- 172.21.15.36:0/1070314657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d8061320 0x7f96d80b1a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f96d80aeba0 tx=0x7f96d0016000).stop 2022-01-10T01:32:46.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f96d759e700 1 -- 172.21.15.36:0/1070314657 shutdown_connections 2022-01-10T01:32:46.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f96d759e700 1 --2- 172.21.15.36:0/1070314657 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96b4053500 0x7f96b40559c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f96d759e700 1 --2- 172.21.15.36:0/1070314657 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d8140440 0x7f96d8144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f96d759e700 1 --2- 172.21.15.36:0/1070314657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96d80ad5c0 0x7f96d80b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f96d759e700 1 --2- 172.21.15.36:0/1070314657 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d8061320 0x7f96d80b1a00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f96d759e700 1 -- 172.21.15.36:0/1070314657 >> 172.21.15.36:0/1070314657 conn(0x7f96d8066de0 msgr2=0x7f96d805ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:46.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f96d759e700 1 -- 172.21.15.36:0/1070314657 shutdown_connections 2022-01-10T01:32:46.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.702+0000 7f96d759e700 1 -- 172.21.15.36:0/1070314657 wait complete. 2022-01-10T01:32:46.719 INFO:teuthology.orchestra.run.smithi036.stderr:failed mds gid 7597 2022-01-10T01:32:46.720 INFO:teuthology.orchestra.run.smithi036.stderr:failed mds gid 36638 2022-01-10T01:32:46.720 INFO:teuthology.orchestra.run.smithi036.stderr:failed mds gid 7590 2022-01-10T01:32:46.722 DEBUG:teuthology.parallel:result is '' 2022-01-10T01:32:46.723 DEBUG:teuthology.parallel:result is '' 2022-01-10T01:32:46.724 DEBUG:teuthology.parallel:result is '' 2022-01-10T01:32:46.725 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:32:46.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.822+0000 7fe28bfff700 1 Processor -- start 2022-01-10T01:32:46.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.822+0000 7fe28bfff700 1 -- start start 2022-01-10T01:32:46.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.822+0000 7fe28bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe28c0b0010 0x7fe28c0a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:46.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.822+0000 7fe28bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe28c0afbd0 0x7fe28c0a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:46.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.822+0000 7fe28bfff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28c0a70c0 con 0x7fe28c0b2580 2022-01-10T01:32:46.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.822+0000 7fe28bfff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28c0a72f0 con 0x7fe28c0b0010 2022-01-10T01:32:46.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.822+0000 7fe28bfff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c0a7590 con 0x7fe28c0afbd0 2022-01-10T01:32:46.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.822+0000 7fe28a7fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe28c0b0010 0x7fe28c0a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:46.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.822+0000 7fe28affd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe28c0b2580 0x7fe28c14ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38878/0 (socket says 172.21.15.36:38878) 2022-01-10T01:32:46.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.822+0000 7fe28affd700 1 -- 172.21.15.36:0/284382595 learned_addr learned my addr 172.21.15.36:0/284382595 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:46.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28b7fe700 1 --2- 172.21.15.36:0/284382595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe28c0afbd0 0x7fe28c0a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:46.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28a7fc700 1 -- 172.21.15.36:0/284382595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe28c0afbd0 msgr2=0x7fe28c0a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:46.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28a7fc700 1 --2- 172.21.15.36:0/284382595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe28c0afbd0 0x7fe28c0a88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28a7fc700 1 -- 172.21.15.36:0/284382595 >> v1:172.21.15.36:6789/0 conn(0x7fe28c0b2580 legacy=0x7fe28c14ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:46.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe289ffb700 1 -- 172.21.15.36:0/284382595 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488045662 0 0) 0x7fe28c0a70c0 con 0x7fe28c0b2580 2022-01-10T01:32:46.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28a7fc700 1 -- 172.21.15.36:0/284382595 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c0a7830 con 0x7fe28c0b0010 2022-01-10T01:32:46.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28a7fc700 1 --2- 172.21.15.36:0/284382595 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe28c0b0010 0x7fe28c0a83b0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7fe27c0032f0 tx=0x7fe27c0091d0).ready entity=mon.0 client_cookie=31822324e79acdc7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:46.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe289ffb700 1 -- 172.21.15.36:0/284382595 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe27c00b6c0 con 0x7fe28c0b0010 2022-01-10T01:32:46.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe289ffb700 1 -- 172.21.15.36:0/284382595 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c00b820 con 0x7fe28c0b0010 2022-01-10T01:32:46.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe289ffb700 1 -- 172.21.15.36:0/284382595 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe27c00b990 con 0x7fe28c0b0010 2022-01-10T01:32:46.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28bfff700 1 -- 172.21.15.36:0/284382595 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe28c0b0010 msgr2=0x7fe28c0a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:46.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28bfff700 1 --2- 172.21.15.36:0/284382595 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe28c0b0010 0x7fe28c0a83b0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7fe27c0032f0 tx=0x7fe27c0091d0).stop 2022-01-10T01:32:46.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28bfff700 1 -- 172.21.15.36:0/284382595 shutdown_connections 2022-01-10T01:32:46.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28bfff700 1 --2- 172.21.15.36:0/284382595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe28c0afbd0 0x7fe28c0a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28bfff700 1 --2- 172.21.15.36:0/284382595 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe28c0b0010 0x7fe28c0a83b0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28bfff700 1 -- 172.21.15.36:0/284382595 >> 172.21.15.36:0/284382595 conn(0x7fe28c060180 msgr2=0x7fe28c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:46.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28bfff700 1 -- 172.21.15.36:0/284382595 shutdown_connections 2022-01-10T01:32:46.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28bfff700 1 -- 172.21.15.36:0/284382595 wait complete. 2022-01-10T01:32:46.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28bfff700 1 Processor -- start 2022-01-10T01:32:46.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.826+0000 7fe28bfff700 1 -- start start 2022-01-10T01:32:46.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe28c0afbd0 0x7fe28c14d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:46.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe28c0b0010 0x7fe28c0aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:46.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe28c0b2580 0x7fe28c159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:46.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28bfff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c14ce00 con 0x7fe28c0b2580 2022-01-10T01:32:46.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28bfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c0abfe0 con 0x7fe28c0afbd0 2022-01-10T01:32:46.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28bfff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c0a9ec0 con 0x7fe28c0b0010 2022-01-10T01:32:46.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe28c0b2580 0x7fe28c159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:46.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe28c0b2580 0x7fe28c159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41094/0 (socket says 172.21.15.36:41094) 2022-01-10T01:32:46.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28b7fe700 1 -- 172.21.15.36:0/3887855940 learned_addr learned my addr 172.21.15.36:0/3887855940 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:46.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28a7fc700 1 --2- 172.21.15.36:0/3887855940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe28c0b0010 0x7fe28c0aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:46.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28affd700 1 --2- 172.21.15.36:0/3887855940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe28c0afbd0 0x7fe28c14d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:46.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28b7fe700 1 -- 172.21.15.36:0/3887855940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe28c0b0010 msgr2=0x7fe28c0aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:46.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28b7fe700 1 --2- 172.21.15.36:0/3887855940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe28c0b0010 0x7fe28c0aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28b7fe700 1 -- 172.21.15.36:0/3887855940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe28c0afbd0 msgr2=0x7fe28c14d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:46.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28b7fe700 1 --2- 172.21.15.36:0/3887855940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe28c0afbd0 0x7fe28c14d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:46.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28b7fe700 1 -- 172.21.15.36:0/3887855940 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c009470 con 0x7fe28c0b2580 2022-01-10T01:32:46.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28b7fe700 1 --2- 172.21.15.36:0/3887855940 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe28c0b2580 0x7fe28c159d00 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7fe28400c000 tx=0x7fe284006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:46.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe27bfff700 1 -- 172.21.15.36:0/3887855940 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe284011750 con 0x7fe28c0b2580 2022-01-10T01:32:46.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe27bfff700 1 -- 172.21.15.36:0/3887855940 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2840118b0 con 0x7fe28c0b2580 2022-01-10T01:32:46.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28bfff700 1 -- 172.21.15.36:0/3887855940 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c0ab9e0 con 0x7fe28c0b2580 2022-01-10T01:32:46.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe27bfff700 1 -- 172.21.15.36:0/3887855940 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe284011c10 con 0x7fe28c0b2580 2022-01-10T01:32:46.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28bfff700 1 -- 172.21.15.36:0/3887855940 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c0a9300 con 0x7fe28c0b2580 2022-01-10T01:32:46.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.830+0000 7fe28bfff700 1 -- 172.21.15.36:0/3887855940 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28c14b890 con 0x7fe28c0b2580 2022-01-10T01:32:46.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.834+0000 7fe27bfff700 1 -- 172.21.15.36:0/3887855940 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe284011d70 con 0x7fe28c0b2580 2022-01-10T01:32:46.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.834+0000 7fe27bfff700 1 --2- 172.21.15.36:0/3887855940 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe268053680 0x7fe268055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:46.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.834+0000 7fe27bfff700 1 -- 172.21.15.36:0/3887855940 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fe28406be20 con 0x7fe28c0b2580 2022-01-10T01:32:46.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.834+0000 7fe28affd700 1 --2- 172.21.15.36:0/3887855940 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe268053680 0x7fe268055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:46.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.834+0000 7fe28affd700 1 --2- 172.21.15.36:0/3887855940 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe268053680 0x7fe268055b40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fe28000d000 tx=0x7fe280007c20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:46.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:46.842+0000 7fe27bfff700 1 -- 172.21.15.36:0/3887855940 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe284042de0 con 0x7fe28c0b2580 2022-01-10T01:32:47.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:47.002+0000 7fe28bfff700 1 -- 172.21.15.36:0/3887855940 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe28c057350 con 0x7fe28c0b2580 2022-01-10T01:32:48.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:47.998+0000 7fe27bfff700 1 -- 172.21.15.36:0/3887855940 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe284046400 con 0x7fe28c0b2580 2022-01-10T01:32:48.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.002+0000 7fe28bfff700 1 -- 172.21.15.36:0/3887855940 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe268053680 msgr2=0x7fe268055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:48.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.002+0000 7fe28bfff700 1 --2- 172.21.15.36:0/3887855940 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe268053680 0x7fe268055b40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fe28000d000 tx=0x7fe280007c20).stop 2022-01-10T01:32:48.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.002+0000 7fe28bfff700 1 -- 172.21.15.36:0/3887855940 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe28c0b2580 msgr2=0x7fe28c159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:48.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.002+0000 7fe28bfff700 1 --2- 172.21.15.36:0/3887855940 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe28c0b2580 0x7fe28c159d00 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7fe28400c000 tx=0x7fe284006df0).stop 2022-01-10T01:32:48.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.002+0000 7fe28bfff700 1 -- 172.21.15.36:0/3887855940 shutdown_connections 2022-01-10T01:32:48.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.002+0000 7fe28bfff700 1 --2- 172.21.15.36:0/3887855940 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe268053680 0x7fe268055b40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:48.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.002+0000 7fe28bfff700 1 --2- 172.21.15.36:0/3887855940 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe28c0b2580 0x7fe28c159d00 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:48.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.002+0000 7fe28bfff700 1 --2- 172.21.15.36:0/3887855940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe28c0b0010 0x7fe28c0aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:48.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.002+0000 7fe28bfff700 1 --2- 172.21.15.36:0/3887855940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe28c0afbd0 0x7fe28c14d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:48.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.002+0000 7fe28bfff700 1 -- 172.21.15.36:0/3887855940 >> 172.21.15.36:0/3887855940 conn(0x7fe28c060180 msgr2=0x7fe28c0ad3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:48.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.002+0000 7fe28bfff700 1 -- 172.21.15.36:0/3887855940 shutdown_connections 2022-01-10T01:32:48.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.002+0000 7fe28bfff700 1 -- 172.21.15.36:0/3887855940 wait complete. 2022-01-10T01:32:48.024 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:32:48.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.134+0000 7f962f46a700 1 Processor -- start 2022-01-10T01:32:48.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.134+0000 7f962f46a700 1 -- start start 2022-01-10T01:32:48.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.134+0000 7f962f46a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9628060100 0x7f9628061650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:48.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.134+0000 7f962f46a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9628065970 0x7f9628065df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:48.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.134+0000 7f962f46a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96280604e0 con 0x7f96280665d0 2022-01-10T01:32:48.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.134+0000 7f962f46a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9628067120 con 0x7f9628065970 2022-01-10T01:32:48.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.134+0000 7f962f46a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9628060c70 con 0x7f9628060100 2022-01-10T01:32:48.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.134+0000 7f962da07700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f96280665d0 0x7f9628066a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38896/0 (socket says 172.21.15.36:38896) 2022-01-10T01:32:48.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.134+0000 7f962da07700 1 -- 172.21.15.36:0/2476752477 learned_addr learned my addr 172.21.15.36:0/2476752477 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:48.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.134+0000 7f962ca05700 1 --2- 172.21.15.36:0/2476752477 >> v2:172.21.15.59:3300/0 conn(0x7f9628065970 0x7f9628065df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:48.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.134+0000 7f962d206700 1 --2- 172.21.15.36:0/2476752477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9628060100 0x7f9628061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:48.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.134+0000 7f9617fff700 1 -- 172.21.15.36:0/2476752477 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142306460 0 0) 0x7f96280604e0 con 0x7f96280665d0 2022-01-10T01:32:48.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f9617fff700 1 -- 172.21.15.36:0/2476752477 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9610003260 con 0x7f96280665d0 2022-01-10T01:32:48.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f9617fff700 1 -- 172.21.15.36:0/2476752477 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1213466593 0 0) 0x7f9610003260 con 0x7f96280665d0 2022-01-10T01:32:48.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f962d206700 1 -- 172.21.15.36:0/2476752477 >> v2:172.21.15.59:3300/0 conn(0x7f9628065970 msgr2=0x7f9628065df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:48.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f962d206700 1 --2- 172.21.15.36:0/2476752477 >> v2:172.21.15.59:3300/0 conn(0x7f9628065970 0x7f9628065df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:48.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f962d206700 1 -- 172.21.15.36:0/2476752477 >> v1:172.21.15.36:6789/0 conn(0x7f96280665d0 legacy=0x7f9628066a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:48.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f962d206700 1 -- 172.21.15.36:0/2476752477 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9628060f10 con 0x7f9628060100 2022-01-10T01:32:48.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f962d206700 1 --2- 172.21.15.36:0/2476752477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9628060100 0x7f9628061650 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f9620001ba0 tx=0x7f9618006df0).ready entity=mon.2 client_cookie=7abb7409e6926f07 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:48.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f9617fff700 1 -- 172.21.15.36:0/2476752477 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9620001a00 con 0x7f9628060100 2022-01-10T01:32:48.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f9617fff700 1 -- 172.21.15.36:0/2476752477 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9618000e90 con 0x7f9628060100 2022-01-10T01:32:48.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f9617fff700 1 -- 172.21.15.36:0/2476752477 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9618012460 con 0x7f9628060100 2022-01-10T01:32:48.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f962f46a700 1 -- 172.21.15.36:0/2476752477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9628060100 msgr2=0x7f9628061650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:48.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f962f46a700 1 --2- 172.21.15.36:0/2476752477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9628060100 0x7f9628061650 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f9620001ba0 tx=0x7f9618006df0).stop 2022-01-10T01:32:48.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f962f46a700 1 -- 172.21.15.36:0/2476752477 shutdown_connections 2022-01-10T01:32:48.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f962f46a700 1 --2- 172.21.15.36:0/2476752477 >> v2:172.21.15.59:3300/0 conn(0x7f9628065970 0x7f9628065df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:48.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f962f46a700 1 --2- 172.21.15.36:0/2476752477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9628060100 0x7f9628061650 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:48.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f962f46a700 1 -- 172.21.15.36:0/2476752477 >> 172.21.15.36:0/2476752477 conn(0x7f962805cf30 msgr2=0x7f962805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:48.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f962f46a700 1 -- 172.21.15.36:0/2476752477 shutdown_connections 2022-01-10T01:32:48.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f962f46a700 1 -- 172.21.15.36:0/2476752477 wait complete. 2022-01-10T01:32:48.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.138+0000 7f962f46a700 1 Processor -- start 2022-01-10T01:32:48.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962f46a700 1 -- start start 2022-01-10T01:32:48.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962f46a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9628060100 0x7f9628144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:48.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962f46a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9628065970 0x7f9628155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:48.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962f46a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96280665d0 0x7f9628146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:48.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962f46a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96281418c0 con 0x7f96280665d0 2022-01-10T01:32:48.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962f46a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9628144e40 con 0x7f9628060100 2022-01-10T01:32:48.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962f46a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9628146ef0 con 0x7f9628065970 2022-01-10T01:32:48.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962da07700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96280665d0 0x7f9628146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:48.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962d206700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9628060100 0x7f9628144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:48.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962da07700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96280665d0 0x7f9628146320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41108/0 (socket says 172.21.15.36:41108) 2022-01-10T01:32:48.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962da07700 1 -- 172.21.15.36:0/3967045878 learned_addr learned my addr 172.21.15.36:0/3967045878 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:48.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962ca05700 1 --2- 172.21.15.36:0/3967045878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9628065970 0x7f9628155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:48.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962da07700 1 -- 172.21.15.36:0/3967045878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9628065970 msgr2=0x7f9628155b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:48.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962da07700 1 --2- 172.21.15.36:0/3967045878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9628065970 0x7f9628155b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:48.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962da07700 1 -- 172.21.15.36:0/3967045878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9628060100 msgr2=0x7f9628144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:48.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962da07700 1 --2- 172.21.15.36:0/3967045878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9628060100 0x7f9628144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:48.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962da07700 1 -- 172.21.15.36:0/3967045878 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961800b180 con 0x7f96280665d0 2022-01-10T01:32:48.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962da07700 1 --2- 172.21.15.36:0/3967045878 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96280665d0 0x7f9628146320 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f96280a3030 tx=0x7f96200020e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:48.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f96167fc700 1 -- 172.21.15.36:0/3967045878 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9620004ab0 con 0x7f96280665d0 2022-01-10T01:32:48.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f96167fc700 1 -- 172.21.15.36:0/3967045878 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9620004c10 con 0x7f96280665d0 2022-01-10T01:32:48.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962f46a700 1 -- 172.21.15.36:0/3967045878 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96281450c0 con 0x7f96280665d0 2022-01-10T01:32:48.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f96167fc700 1 -- 172.21.15.36:0/3967045878 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9620007170 con 0x7f96280665d0 2022-01-10T01:32:48.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.142+0000 7f962f46a700 1 -- 172.21.15.36:0/3967045878 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962813eb30 con 0x7f96280665d0 2022-01-10T01:32:48.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.146+0000 7f962f46a700 1 -- 172.21.15.36:0/3967045878 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96280611b0 con 0x7f96280665d0 2022-01-10T01:32:48.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.146+0000 7f96167fc700 1 -- 172.21.15.36:0/3967045878 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f962001b070 con 0x7f96280665d0 2022-01-10T01:32:48.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.146+0000 7f96167fc700 1 --2- 172.21.15.36:0/3967045878 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9608053560 0x7f9608055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:48.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.146+0000 7f962d206700 1 --2- 172.21.15.36:0/3967045878 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9608053560 0x7f9608055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:48.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.146+0000 7f96167fc700 1 -- 172.21.15.36:0/3967045878 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f962006b290 con 0x7f96280665d0 2022-01-10T01:32:48.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.146+0000 7f962d206700 1 --2- 172.21.15.36:0/3967045878 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9608053560 0x7f9608055a20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f961801a000 tx=0x7f9618014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:48.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.154+0000 7f96167fc700 1 -- 172.21.15.36:0/3967045878 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f96200421b0 con 0x7f96280665d0 2022-01-10T01:32:48.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:48.278+0000 7f962f46a700 1 -- 172.21.15.36:0/3967045878 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9628057350 con 0x7f96280665d0 2022-01-10T01:32:49.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.010+0000 7f96167fc700 1 -- 172.21.15.36:0/3967045878 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v124) v1 ==== 185+0+0 (secure 0 0 0) 0x7f96200457d0 con 0x7f96280665d0 2022-01-10T01:32:49.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.014+0000 7f962f46a700 1 -- 172.21.15.36:0/3967045878 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9608053560 msgr2=0x7f9608055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:49.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.014+0000 7f962f46a700 1 --2- 172.21.15.36:0/3967045878 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9608053560 0x7f9608055a20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f961801a000 tx=0x7f9618014000).stop 2022-01-10T01:32:49.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.014+0000 7f962f46a700 1 -- 172.21.15.36:0/3967045878 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96280665d0 msgr2=0x7f9628146320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:49.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.014+0000 7f962f46a700 1 --2- 172.21.15.36:0/3967045878 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96280665d0 0x7f9628146320 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f96280a3030 tx=0x7f96200020e0).stop 2022-01-10T01:32:49.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.018+0000 7f962f46a700 1 -- 172.21.15.36:0/3967045878 shutdown_connections 2022-01-10T01:32:49.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.018+0000 7f962f46a700 1 --2- 172.21.15.36:0/3967045878 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9608053560 0x7f9608055a20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:49.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.018+0000 7f962f46a700 1 --2- 172.21.15.36:0/3967045878 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96280665d0 0x7f9628146320 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:49.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.018+0000 7f962f46a700 1 --2- 172.21.15.36:0/3967045878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9628065970 0x7f9628155b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:49.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.018+0000 7f962f46a700 1 --2- 172.21.15.36:0/3967045878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9628060100 0x7f9628144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:49.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.018+0000 7f962f46a700 1 -- 172.21.15.36:0/3967045878 >> 172.21.15.36:0/3967045878 conn(0x7f962805cf30 msgr2=0x7f96280b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:49.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.018+0000 7f962f46a700 1 -- 172.21.15.36:0/3967045878 shutdown_connections 2022-01-10T01:32:49.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.018+0000 7f962f46a700 1 -- 172.21.15.36:0/3967045878 wait complete. 2022-01-10T01:32:49.024 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:32:49.038 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:32:49.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.146+0000 7f970b634700 1 Processor -- start 2022-01-10T01:32:49.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.146+0000 7f970b634700 1 -- start start 2022-01-10T01:32:49.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f970b634700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97040616d0 0x7f97040b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:49.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f970b634700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9704060b30 0x7f970405f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:49.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f970b634700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9704140090 con 0x7f97040b1980 2022-01-10T01:32:49.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f970b634700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97040ad0b0 con 0x7f97040616d0 2022-01-10T01:32:49.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f970b634700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97040abd30 con 0x7f9704060b30 2022-01-10T01:32:49.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f9709bd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9704060b30 0x7f970405f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:49.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f9708bcf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97040616d0 0x7f97040b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:49.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f9709bd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9704060b30 0x7f970405f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:47398/0 (socket says 172.21.15.36:47398) 2022-01-10T01:32:49.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f9708bcf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97040616d0 0x7f97040b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:37748/0 (socket says 172.21.15.36:37748) 2022-01-10T01:32:49.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f9709bd1700 1 -- 172.21.15.36:0/3445317577 learned_addr learned my addr 172.21.15.36:0/3445317577 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:49.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f97093d0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f97040b1980 0x7f9704139ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:56582/0 (socket says 172.21.15.36:56582) 2022-01-10T01:32:49.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f9709bd1700 1 -- 172.21.15.36:0/3445317577 >> v2:172.21.15.59:3300/0 conn(0x7f97040616d0 msgr2=0x7f97040b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:49.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f9709bd1700 1 --2- 172.21.15.36:0/3445317577 >> v2:172.21.15.59:3300/0 conn(0x7f97040616d0 0x7f97040b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:49.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f9709bd1700 1 -- 172.21.15.36:0/3445317577 >> v1:172.21.15.59:6789/0 conn(0x7f97040b1980 legacy=0x7f9704139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:49.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f9709bd1700 1 -- 172.21.15.36:0/3445317577 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9704140330 con 0x7f9704060b30 2022-01-10T01:32:49.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f9709bd1700 1 --2- 172.21.15.36:0/3445317577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9704060b30 0x7f970405f6b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f96fc0032f0 tx=0x7f96fc009290).ready entity=mon.2 client_cookie=be76c7e7d6a4519f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:49.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f96f3fff700 1 -- 172.21.15.36:0/3445317577 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96fc00b8a0 con 0x7f9704060b30 2022-01-10T01:32:49.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f96f3fff700 1 -- 172.21.15.36:0/3445317577 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96fc00ba00 con 0x7f9704060b30 2022-01-10T01:32:49.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f96f3fff700 1 -- 172.21.15.36:0/3445317577 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96fc00bb70 con 0x7f9704060b30 2022-01-10T01:32:49.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f970b634700 1 -- 172.21.15.36:0/3445317577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9704060b30 msgr2=0x7f970405f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:49.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f970b634700 1 --2- 172.21.15.36:0/3445317577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9704060b30 0x7f970405f6b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f96fc0032f0 tx=0x7f96fc009290).stop 2022-01-10T01:32:49.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f970b634700 1 -- 172.21.15.36:0/3445317577 shutdown_connections 2022-01-10T01:32:49.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f970b634700 1 --2- 172.21.15.36:0/3445317577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9704060b30 0x7f970405f6b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:49.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f970b634700 1 --2- 172.21.15.36:0/3445317577 >> v2:172.21.15.59:3300/0 conn(0x7f97040616d0 0x7f97040b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:49.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f970b634700 1 -- 172.21.15.36:0/3445317577 >> 172.21.15.36:0/3445317577 conn(0x7f97040b2970 msgr2=0x7f97040b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:49.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f970b634700 1 -- 172.21.15.36:0/3445317577 shutdown_connections 2022-01-10T01:32:49.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.150+0000 7f970b634700 1 -- 172.21.15.36:0/3445317577 wait complete. 2022-01-10T01:32:49.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f970b634700 1 Processor -- start 2022-01-10T01:32:49.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f970b634700 1 -- start start 2022-01-10T01:32:49.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f970b634700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9704060b30 0x7f97040b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:49.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f970b634700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f97040616d0 0x7f9704152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:49.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f970b634700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97040b1980 0x7f9704152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:49.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f970b634700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97040b03f0 con 0x7f97040616d0 2022-01-10T01:32:49.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f970b634700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97040ad2c0 con 0x7f9704060b30 2022-01-10T01:32:49.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f970b634700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97041566d0 con 0x7f97040b1980 2022-01-10T01:32:49.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f9708bcf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f97040616d0 0x7f9704152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:49.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f97093d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9704060b30 0x7f97040b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:49.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f9709bd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97040b1980 0x7f9704152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:49.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f97093d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9704060b30 0x7f97040b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:37752/0 (socket says 172.21.15.36:37752) 2022-01-10T01:32:49.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f97093d0700 1 -- 172.21.15.36:0/3363990694 learned_addr learned my addr 172.21.15.36:0/3363990694 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:49.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f9708bcf700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f97040616d0 0x7f9704152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41120/0 (socket says 172.21.15.36:41120) 2022-01-10T01:32:49.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f97093d0700 1 -- 172.21.15.36:0/3363990694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97040b1980 msgr2=0x7f9704152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:49.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f97093d0700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97040b1980 0x7f9704152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:49.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f97093d0700 1 -- 172.21.15.36:0/3363990694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f97040616d0 msgr2=0x7f9704152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:49.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f97093d0700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f97040616d0 0x7f9704152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:49.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f97093d0700 1 -- 172.21.15.36:0/3363990694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc009530 con 0x7f9704060b30 2022-01-10T01:32:49.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f9709bd1700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97040b1980 0x7f9704152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:49.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f9708bcf700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f97040616d0 0x7f9704152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:49.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f97093d0700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9704060b30 0x7f97040b0bb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f97040b2380 tx=0x7f9700007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:49.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f96f27fc700 1 -- 172.21.15.36:0/3363990694 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97000070d0 con 0x7f9704060b30 2022-01-10T01:32:49.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f96f27fc700 1 -- 172.21.15.36:0/3363990694 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9700007230 con 0x7f9704060b30 2022-01-10T01:32:49.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f970b634700 1 -- 172.21.15.36:0/3363990694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9704156970 con 0x7f9704060b30 2022-01-10T01:32:49.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f96f27fc700 1 -- 172.21.15.36:0/3363990694 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9700005550 con 0x7f9704060b30 2022-01-10T01:32:49.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.154+0000 7f970b634700 1 -- 172.21.15.36:0/3363990694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97040b10a0 con 0x7f9704060b30 2022-01-10T01:32:49.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.158+0000 7f970b634700 1 -- 172.21.15.36:0/3363990694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97041405d0 con 0x7f9704060b30 2022-01-10T01:32:49.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.158+0000 7f96f27fc700 1 -- 172.21.15.36:0/3363990694 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9700010070 con 0x7f9704060b30 2022-01-10T01:32:49.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.158+0000 7f96f27fc700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96e4053680 0x7f96e4055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:49.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.158+0000 7f96f27fc700 1 -- 172.21.15.36:0/3363990694 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f970006aec0 con 0x7f9704060b30 2022-01-10T01:32:49.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.158+0000 7f9708bcf700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96e4053680 0x7f96e4055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:49.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.158+0000 7f9708bcf700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96e4053680 0x7f96e4055b40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f96f400b000 tx=0x7f96f4006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:49.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.166+0000 7f96f27fc700 1 -- 172.21.15.36:0/3363990694 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9700042030 con 0x7f9704060b30 2022-01-10T01:32:49.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:49.298+0000 7f970b634700 1 -- 172.21.15.36:0/3363990694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f9704057350 con 0x7f9704060b30 2022-01-10T01:32:50.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:50.018+0000 7f96f27fc700 1 -- 172.21.15.36:0/3363990694 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v125) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9700045650 con 0x7f9704060b30 2022-01-10T01:32:50.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:50.026+0000 7f970b634700 1 -- 172.21.15.36:0/3363990694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96e4053680 msgr2=0x7f96e4055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:50.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:50.026+0000 7f970b634700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96e4053680 0x7f96e4055b40 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f96f400b000 tx=0x7f96f4006df0).stop 2022-01-10T01:32:50.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:50.026+0000 7f970b634700 1 -- 172.21.15.36:0/3363990694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9704060b30 msgr2=0x7f97040b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:50.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:50.026+0000 7f970b634700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9704060b30 0x7f97040b0bb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f97040b2380 tx=0x7f9700007c40).stop 2022-01-10T01:32:50.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:50.026+0000 7f970b634700 1 -- 172.21.15.36:0/3363990694 shutdown_connections 2022-01-10T01:32:50.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:50.026+0000 7f970b634700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96e4053680 0x7f96e4055b40 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:50.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:50.026+0000 7f970b634700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97040b1980 0x7f9704152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:50.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:50.026+0000 7f970b634700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f97040616d0 0x7f9704152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:50.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:50.026+0000 7f970b634700 1 --2- 172.21.15.36:0/3363990694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9704060b30 0x7f97040b0bb0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:50.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:50.026+0000 7f970b634700 1 -- 172.21.15.36:0/3363990694 >> 172.21.15.36:0/3363990694 conn(0x7f97040b2970 msgr2=0x7f970413ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:50.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:50.026+0000 7f970b634700 1 -- 172.21.15.36:0/3363990694 shutdown_connections 2022-01-10T01:32:50.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:50.026+0000 7f970b634700 1 -- 172.21.15.36:0/3363990694 wait complete. 2022-01-10T01:32:50.033 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:32:50.043 DEBUG:teuthology.orchestra.run.smithi139:> sudo rados -p cephfs_metadata put key /etc/fstab 2022-01-10T01:32:50.094 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.080+0000 7f6e47881b80 1 Processor -- start 2022-01-10T01:32:50.095 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.080+0000 7f6e47881b80 1 -- start start 2022-01-10T01:32:50.095 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.080+0000 7f6e47881b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6be3b0a0 0x55da6be4c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:50.095 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.080+0000 7f6e47881b80 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x55da6be47560 0x55da6be4c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:50.096 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.080+0000 7f6e47881b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55da6be49e40 0x55da6be4cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:50.096 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.080+0000 7f6e47881b80 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6bd5d1b0 con 0x55da6be47560 2022-01-10T01:32:50.096 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.080+0000 7f6e47881b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6bd5e900 con 0x55da6be3b0a0 2022-01-10T01:32:50.096 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.080+0000 7f6e47881b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da6bd2e380 con 0x55da6be49e40 2022-01-10T01:32:50.097 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e464c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55da6be49e40 0x55da6be4cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:50.097 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e45cbf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6be3b0a0 0x55da6be4c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:50.097 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e454be700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x55da6be47560 0x55da6be4c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:50.097 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e464c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55da6be49e40 0x55da6be4cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.139:37102/0 (socket says 172.21.15.139:37102) 2022-01-10T01:32:50.099 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e464c0700 1 -- 172.21.15.139:0/4050268364 learned_addr learned my addr 172.21.15.139:0/4050268364 (peer_addr_for_me v2:172.21.15.139:0/0) 2022-01-10T01:32:50.099 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e45cbf700 1 -- 172.21.15.139:0/4050268364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55da6be49e40 msgr2=0x55da6be4cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:50.099 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e45cbf700 1 --2- 172.21.15.139:0/4050268364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55da6be49e40 0x55da6be4cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:50.100 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e45cbf700 1 -- 172.21.15.139:0/4050268364 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x55da6be47560 msgr2=0x55da6be4c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:50.100 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e45cbf700 1 --2- 172.21.15.139:0/4050268364 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x55da6be47560 0x55da6be4c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:50.100 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e45cbf700 1 -- 172.21.15.139:0/4050268364 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e30005cd0 con 0x55da6be3b0a0 2022-01-10T01:32:50.101 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e45cbf700 1 --2- 172.21.15.139:0/4050268364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6be3b0a0 0x55da6be4c230 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f6e38001490 tx=0x7f6e38006940).ready entity=mon.1 client_cookie=e209ca2fd94e7a39 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:50.101 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e3f7fe700 1 -- 172.21.15.139:0/4050268364 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e38006320 con 0x55da6be3b0a0 2022-01-10T01:32:50.101 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e3f7fe700 1 -- 172.21.15.139:0/4050268364 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e38001ee0 con 0x55da6be3b0a0 2022-01-10T01:32:50.102 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e3f7fe700 1 -- 172.21.15.139:0/4050268364 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e38004480 con 0x55da6be3b0a0 2022-01-10T01:32:50.102 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e47881b80 1 -- 172.21.15.139:0/4050268364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6be3b0a0 msgr2=0x55da6be4c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:50.102 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e47881b80 1 --2- 172.21.15.139:0/4050268364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6be3b0a0 0x55da6be4c230 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f6e38001490 tx=0x7f6e38006940).stop 2022-01-10T01:32:50.103 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e47881b80 1 -- 172.21.15.139:0/4050268364 shutdown_connections 2022-01-10T01:32:50.103 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e47881b80 1 --2- 172.21.15.139:0/4050268364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55da6be49e40 0x55da6be4cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:50.103 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e47881b80 1 --2- 172.21.15.139:0/4050268364 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x55da6be47560 0x55da6be4c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:50.104 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e47881b80 1 --2- 172.21.15.139:0/4050268364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6be3b0a0 0x55da6be4c230 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:50.104 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e47881b80 1 -- 172.21.15.139:0/4050268364 >> 172.21.15.139:0/4050268364 conn(0x55da6be36bd0 msgr2=0x55da6be38eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:50.104 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e47881b80 1 -- 172.21.15.139:0/4050268364 shutdown_connections 2022-01-10T01:32:50.104 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e47881b80 1 -- 172.21.15.139:0/4050268364 wait complete. 2022-01-10T01:32:50.105 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e47881b80 1 Processor -- start 2022-01-10T01:32:50.105 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e47881b80 1 -- start start 2022-01-10T01:32:50.105 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.084+0000 7f6e47881b80 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x55da6be3b0a0 0x55da6be46cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:50.105 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e47881b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55da6be47560 0x55da6be41e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:50.106 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e47881b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6be49e40 0x55da6be42350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:50.106 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e47881b80 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6be41d20 con 0x55da6be3b0a0 2022-01-10T01:32:50.106 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e47881b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da6be42840 con 0x55da6be49e40 2022-01-10T01:32:50.107 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e47881b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da6be42a00 con 0x55da6be47560 2022-01-10T01:32:50.107 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e454be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55da6be47560 0x55da6be41e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:50.107 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e45cbf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x55da6be3b0a0 0x55da6be46cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:50.108 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e464c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6be49e40 0x55da6be42350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:50.108 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e454be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55da6be47560 0x55da6be41e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.139:37106/0 (socket says 172.21.15.139:37106) 2022-01-10T01:32:50.109 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e454be700 1 -- 172.21.15.139:0/143634377 learned_addr learned my addr 172.21.15.139:0/143634377 (peer_addr_for_me v2:172.21.15.139:0/0) 2022-01-10T01:32:50.109 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e45cbf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x55da6be3b0a0 0x55da6be46cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.139:54470/0 (socket says 172.21.15.139:54470) 2022-01-10T01:32:50.109 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e454be700 1 -- 172.21.15.139:0/143634377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6be49e40 msgr2=0x55da6be42350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:50.110 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e454be700 1 --2- 172.21.15.139:0/143634377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55da6be49e40 0x55da6be42350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:50.110 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e454be700 1 -- 172.21.15.139:0/143634377 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x55da6be3b0a0 msgr2=0x55da6be46cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:50.110 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e454be700 1 --2- 172.21.15.139:0/143634377 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x55da6be3b0a0 0x55da6be46cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:50.111 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e454be700 1 -- 172.21.15.139:0/143634377 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e28001e10 con 0x55da6be47560 2022-01-10T01:32:50.111 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e454be700 1 --2- 172.21.15.139:0/143634377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55da6be47560 0x55da6be41e60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x55da6be43410 tx=0x7f6e30015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:50.111 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e3effd700 1 -- 172.21.15.139:0/143634377 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e3001e830 con 0x55da6be47560 2022-01-10T01:32:50.111 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e3effd700 1 -- 172.21.15.139:0/143634377 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3001e990 con 0x55da6be47560 2022-01-10T01:32:50.112 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e47881b80 1 -- 172.21.15.139:0/143634377 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55da6bd26f00 con 0x55da6be47560 2022-01-10T01:32:50.112 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e3effd700 1 -- 172.21.15.139:0/143634377 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e3001ecf0 con 0x55da6be47560 2022-01-10T01:32:50.112 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e47881b80 1 -- 172.21.15.139:0/143634377 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da6be5b010 con 0x55da6be47560 2022-01-10T01:32:50.113 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.088+0000 7f6e3effd700 1 -- 172.21.15.139:0/143634377 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6e30024030 con 0x55da6be47560 2022-01-10T01:32:50.113 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.092+0000 7f6e3effd700 1 --2- 172.21.15.139:0/143634377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e2c052170 0x7f6e2c054630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:50.113 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.092+0000 7f6e3effd700 1 -- 172.21.15.139:0/143634377 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6422+0+0 (secure 0 0 0) 0x7f6e3006c820 con 0x55da6be47560 2022-01-10T01:32:50.114 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.092+0000 7f6e45cbf700 1 --2- 172.21.15.139:0/143634377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e2c052170 0x7f6e2c054630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:50.114 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.092+0000 7f6e47881b80 1 --2- 172.21.15.139:0/143634377 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x55da6be5bcf0 0x55da6be5e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:50.114 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.092+0000 7f6e47881b80 1 -- 172.21.15.139:0/143634377 --> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] -- osd_op(unknown.0.0:1 23.0 23:0620e6f9:::key:head [writefull 0~617 in=617b] snapc 0=[] ondisk+write+known_if_redirected e125) v8 -- 0x55da6be5e5d0 con 0x55da6be5bcf0 2022-01-10T01:32:50.115 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.092+0000 7f6e464c0700 1 --2- 172.21.15.139:0/143634377 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x55da6be5bcf0 0x55da6be5e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:50.115 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.092+0000 7f6e45cbf700 1 --2- 172.21.15.139:0/143634377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e2c052170 0x7f6e2c054630 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f6e3801a000 tx=0x7f6e38014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:50.116 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:50.092+0000 7f6e464c0700 1 --2- 172.21.15.139:0/143634377 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x55da6be5bcf0 0x55da6be5e0e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:51.084 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:51.084+0000 7f6e3effd700 1 -- 172.21.15.139:0/143634377 <== osd.6 v2:172.21.15.59:6808/15005 1 ==== osd_map(126..126 src has 1..126) v4 ==== 320+0+0 (crc 0 0 0) 0x7f6e4000fa40 con 0x55da6be5bcf0 2022-01-10T01:32:51.091 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:51.092+0000 7f6e464c0700 1 -- 172.21.15.139:0/143634377 <== osd.6 v2:172.21.15.59:6808/15005 2 ==== osd_op_reply(1 key [writefull 0~617] v126'1 uv1 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7f6e4000fd00 con 0x55da6be5bcf0 2022-01-10T01:32:51.093 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:51.092+0000 7f6e47881b80 1 -- 172.21.15.139:0/143634377 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x55da6be5bcf0 msgr2=0x55da6be5e0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:51.093 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:51.092+0000 7f6e47881b80 1 --2- 172.21.15.139:0/143634377 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x55da6be5bcf0 0x55da6be5e0e0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:51.093 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:51.092+0000 7f6e47881b80 1 -- 172.21.15.139:0/143634377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e2c052170 msgr2=0x7f6e2c054630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:51.093 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:51.092+0000 7f6e47881b80 1 --2- 172.21.15.139:0/143634377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6e2c052170 0x7f6e2c054630 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f6e3801a000 tx=0x7f6e38014000).stop 2022-01-10T01:32:51.094 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:51.092+0000 7f6e47881b80 1 -- 172.21.15.139:0/143634377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55da6be47560 msgr2=0x55da6be41e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:51.094 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:51.092+0000 7f6e47881b80 1 --2- 172.21.15.139:0/143634377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55da6be47560 0x55da6be41e60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x55da6be43410 tx=0x7f6e30015000).stop 2022-01-10T01:32:51.094 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:51.092+0000 7f6e464c0700 1 -- 172.21.15.139:0/143634377 reap_dead start 2022-01-10T01:32:51.094 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:51.092+0000 7f6e47881b80 1 -- 172.21.15.139:0/143634377 shutdown_connections 2022-01-10T01:32:51.095 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:51.092+0000 7f6e47881b80 1 -- 172.21.15.139:0/143634377 >> 172.21.15.139:0/143634377 conn(0x55da6be36bd0 msgr2=0x55da6be38e00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:51.095 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:51.092+0000 7f6e47881b80 1 -- 172.21.15.139:0/143634377 shutdown_connections 2022-01-10T01:32:51.095 INFO:teuthology.orchestra.run.smithi139.stderr:2022-01-10T01:32:51.092+0000 7f6e47881b80 1 -- 172.21.15.139:0/143634377 wait complete. 2022-01-10T01:32:51.097 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2022-01-10T01:32:51.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.198+0000 7fc931c5c700 1 Processor -- start 2022-01-10T01:32:51.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.198+0000 7fc931c5c700 1 -- start start 2022-01-10T01:32:51.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.198+0000 7fc931c5c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc92c0a9c10 0x7fc92c0607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:51.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.198+0000 7fc931c5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c140140 0x7fc92c1405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:51.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.198+0000 7fc931c5c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c066ea0 con 0x7fc92c0b3040 2022-01-10T01:32:51.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.198+0000 7fc931c5c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c0648e0 con 0x7fc92c0a9c10 2022-01-10T01:32:51.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.198+0000 7fc931c5c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c061dd0 con 0x7fc92c140140 2022-01-10T01:32:51.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.198+0000 7fc92bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc92c0a9c10 0x7fc92c0607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:51.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.198+0000 7fc92bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc92c0a9c10 0x7fc92c0607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41126/0 (socket says 172.21.15.36:41126) 2022-01-10T01:32:51.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.198+0000 7fc92bfff700 1 -- 172.21.15.36:0/3751867503 learned_addr learned my addr 172.21.15.36:0/3751867503 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:51.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.198+0000 7fc930c5a700 1 --1- 172.21.15.36:0/3751867503 >> v1:172.21.15.59:6789/0 conn(0x7fc92c0b3040 0x7fc92c065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:56596/0 (socket says 172.21.15.36:56596) 2022-01-10T01:32:51.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.198+0000 7fc93145b700 1 --2- 172.21.15.36:0/3751867503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c140140 0x7fc92c1405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:51.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc92bfff700 1 -- 172.21.15.36:0/3751867503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c140140 msgr2=0x7fc92c1405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:51.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc92bfff700 1 --2- 172.21.15.36:0/3751867503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c140140 0x7fc92c1405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:51.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc92bfff700 1 -- 172.21.15.36:0/3751867503 >> v1:172.21.15.59:6789/0 conn(0x7fc92c0b3040 legacy=0x7fc92c065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:51.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc92bfff700 1 -- 172.21.15.36:0/3751867503 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c0b3420 con 0x7fc92c0a9c10 2022-01-10T01:32:51.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc92bfff700 1 --2- 172.21.15.36:0/3751867503 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc92c0a9c10 0x7fc92c0607c0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7fc92c0630a0 tx=0x7fc918006eb0).ready entity=mon.0 client_cookie=65f0fddbc99264c2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:51.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc92b7fe700 1 -- 172.21.15.36:0/3751867503 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc91800d5c0 con 0x7fc92c0a9c10 2022-01-10T01:32:51.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc92b7fe700 1 -- 172.21.15.36:0/3751867503 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc918000e90 con 0x7fc92c0a9c10 2022-01-10T01:32:51.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc92b7fe700 1 -- 172.21.15.36:0/3751867503 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc91800d950 con 0x7fc92c0a9c10 2022-01-10T01:32:51.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc931c5c700 1 -- 172.21.15.36:0/3751867503 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc92c0a9c10 msgr2=0x7fc92c0607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:51.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc931c5c700 1 --2- 172.21.15.36:0/3751867503 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc92c0a9c10 0x7fc92c0607c0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7fc92c0630a0 tx=0x7fc918006eb0).stop 2022-01-10T01:32:51.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc931c5c700 1 -- 172.21.15.36:0/3751867503 shutdown_connections 2022-01-10T01:32:51.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc931c5c700 1 --2- 172.21.15.36:0/3751867503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c140140 0x7fc92c1405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:51.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc931c5c700 1 --2- 172.21.15.36:0/3751867503 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc92c0a9c10 0x7fc92c0607c0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:51.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc931c5c700 1 -- 172.21.15.36:0/3751867503 >> 172.21.15.36:0/3751867503 conn(0x7fc92c0636e0 msgr2=0x7fc92c063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:51.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc931c5c700 1 -- 172.21.15.36:0/3751867503 shutdown_connections 2022-01-10T01:32:51.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.202+0000 7fc931c5c700 1 -- 172.21.15.36:0/3751867503 wait complete. 2022-01-10T01:32:51.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc931c5c700 1 Processor -- start 2022-01-10T01:32:51.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc931c5c700 1 -- start start 2022-01-10T01:32:51.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc931c5c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc92c0a9c10 0x7fc92c0aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:51.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc931c5c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92c0b3040 0x7fc92c0aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:51.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc931c5c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c140140 0x7fc92c141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:51.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc931c5c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c0af410 con 0x7fc92c0a9c10 2022-01-10T01:32:51.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc931c5c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c142c30 con 0x7fc92c0b3040 2022-01-10T01:32:51.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc931c5c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c142e60 con 0x7fc92c140140 2022-01-10T01:32:51.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc930c5a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc92c0a9c10 0x7fc92c0aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:51.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc92bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92c0b3040 0x7fc92c0aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:51.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc93145b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c140140 0x7fc92c141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:51.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc930c5a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc92c0a9c10 0x7fc92c0aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41134/0 (socket says 172.21.15.36:41134) 2022-01-10T01:32:51.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc930c5a700 1 -- 172.21.15.36:0/1940805236 learned_addr learned my addr 172.21.15.36:0/1940805236 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:51.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc92bfff700 1 -- 172.21.15.36:0/1940805236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c140140 msgr2=0x7fc92c141c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:51.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc92bfff700 1 --2- 172.21.15.36:0/1940805236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c140140 0x7fc92c141c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:51.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc92bfff700 1 -- 172.21.15.36:0/1940805236 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc92c0a9c10 msgr2=0x7fc92c0aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:51.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc92bfff700 1 --2- 172.21.15.36:0/1940805236 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc92c0a9c10 0x7fc92c0aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:51.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc92bfff700 1 -- 172.21.15.36:0/1940805236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91800b1e0 con 0x7fc92c0b3040 2022-01-10T01:32:51.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc930c5a700 1 --2- 172.21.15.36:0/1940805236 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc92c0a9c10 0x7fc92c0aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:51.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc93145b700 1 --2- 172.21.15.36:0/1940805236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c140140 0x7fc92c141c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:51.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc92bfff700 1 --2- 172.21.15.36:0/1940805236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92c0b3040 0x7fc92c0aef20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fc92c0af550 tx=0x7fc918015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:51.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc929ffb700 1 -- 172.21.15.36:0/1940805236 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9180116e0 con 0x7fc92c0b3040 2022-01-10T01:32:51.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc929ffb700 1 -- 172.21.15.36:0/1940805236 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc918011840 con 0x7fc92c0b3040 2022-01-10T01:32:51.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc931c5c700 1 -- 172.21.15.36:0/1940805236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92c13fec0 con 0x7fc92c0b3040 2022-01-10T01:32:51.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.206+0000 7fc929ffb700 1 -- 172.21.15.36:0/1940805236 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc918011ba0 con 0x7fc92c0b3040 2022-01-10T01:32:51.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.210+0000 7fc931c5c700 1 -- 172.21.15.36:0/1940805236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92c0b0350 con 0x7fc92c0b3040 2022-01-10T01:32:51.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.210+0000 7fc931c5c700 1 -- 172.21.15.36:0/1940805236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92c0b0510 con 0x7fc92c0b3040 2022-01-10T01:32:51.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.210+0000 7fc929ffb700 1 -- 172.21.15.36:0/1940805236 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc91801a040 con 0x7fc92c0b3040 2022-01-10T01:32:51.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.210+0000 7fc929ffb700 1 --2- 172.21.15.36:0/1940805236 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc90c053500 0x7fc90c0559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:51.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.210+0000 7fc929ffb700 1 -- 172.21.15.36:0/1940805236 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6422+0+0 (secure 0 0 0) 0x7fc91806c7a0 con 0x7fc92c0b3040 2022-01-10T01:32:51.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.210+0000 7fc930c5a700 1 --2- 172.21.15.36:0/1940805236 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc90c053500 0x7fc90c0559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:51.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.214+0000 7fc930c5a700 1 --2- 172.21.15.36:0/1940805236 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc90c053500 0x7fc90c0559c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fc92000d000 tx=0x7fc920007c40).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:51.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.222+0000 7fc929ffb700 1 -- 172.21.15.36:0/1940805236 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc918043750 con 0x7fc92c0b3040 2022-01-10T01:32:51.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.394+0000 7fc931c5c700 1 -- 172.21.15.36:0/1940805236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fc92c066960 con 0x7fc92c0b3040 2022-01-10T01:32:51.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.394+0000 7fc929ffb700 1 -- 172.21.15.36:0/1940805236 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1906 (secure 0 0 0) 0x7fc918023090 con 0x7fc92c0b3040 2022-01-10T01:32:51.399 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:51.399 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:32:51.400 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:51.400 INFO:teuthology.orchestra.run.smithi036.stdout: "total_bytes": 773094113280, 2022-01-10T01:32:51.400 INFO:teuthology.orchestra.run.smithi036.stdout: "total_avail_bytes": 764491681792, 2022-01-10T01:32:51.400 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_bytes": 12496896, 2022-01-10T01:32:51.401 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_raw_bytes": 8602431488, 2022-01-10T01:32:51.401 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_raw_ratio": 0.011127276346087456, 2022-01-10T01:32:51.401 INFO:teuthology.orchestra.run.smithi036.stdout: "num_osds": 8, 2022-01-10T01:32:51.401 INFO:teuthology.orchestra.run.smithi036.stdout: "num_per_pool_osds": 8, 2022-01-10T01:32:51.401 INFO:teuthology.orchestra.run.smithi036.stdout: "num_per_pool_omap_osds": 8 2022-01-10T01:32:51.402 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:51.402 INFO:teuthology.orchestra.run.smithi036.stdout: "stats_by_class": { 2022-01-10T01:32:51.402 INFO:teuthology.orchestra.run.smithi036.stdout: "ssd": { 2022-01-10T01:32:51.402 INFO:teuthology.orchestra.run.smithi036.stdout: "total_bytes": 773094113280, 2022-01-10T01:32:51.403 INFO:teuthology.orchestra.run.smithi036.stdout: "total_avail_bytes": 764491681792, 2022-01-10T01:32:51.403 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_bytes": 12496896, 2022-01-10T01:32:51.403 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_raw_bytes": 8602431488, 2022-01-10T01:32:51.403 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_raw_ratio": 0.011127276346087456 2022-01-10T01:32:51.404 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:51.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:51.404 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:32:51.404 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:51.405 INFO:teuthology.orchestra.run.smithi036.stdout: "name": "device_health_metrics", 2022-01-10T01:32:51.405 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 1, 2022-01-10T01:32:51.405 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:51.406 INFO:teuthology.orchestra.run.smithi036.stdout: "stored": 0, 2022-01-10T01:32:51.406 INFO:teuthology.orchestra.run.smithi036.stdout: "objects": 2, 2022-01-10T01:32:51.406 INFO:teuthology.orchestra.run.smithi036.stdout: "kb_used": 0, 2022-01-10T01:32:51.407 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes_used": 0, 2022-01-10T01:32:51.407 INFO:teuthology.orchestra.run.smithi036.stdout: "percent_used": 0, 2022-01-10T01:32:51.408 INFO:teuthology.orchestra.run.smithi036.stdout: "max_avail": 362918445056 2022-01-10T01:32:51.408 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:51.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:51.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:51.409 INFO:teuthology.orchestra.run.smithi036.stdout: "name": "rbd", 2022-01-10T01:32:51.410 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 2, 2022-01-10T01:32:51.410 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:51.411 INFO:teuthology.orchestra.run.smithi036.stdout: "stored": 0, 2022-01-10T01:32:51.411 INFO:teuthology.orchestra.run.smithi036.stdout: "objects": 0, 2022-01-10T01:32:51.411 INFO:teuthology.orchestra.run.smithi036.stdout: "kb_used": 0, 2022-01-10T01:32:51.412 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes_used": 0, 2022-01-10T01:32:51.412 INFO:teuthology.orchestra.run.smithi036.stdout: "percent_used": 0, 2022-01-10T01:32:51.412 INFO:teuthology.orchestra.run.smithi036.stdout: "max_avail": 362918445056 2022-01-10T01:32:51.413 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:51.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:51.414 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:51.414 INFO:teuthology.orchestra.run.smithi036.stdout: "name": "cephfs_data", 2022-01-10T01:32:51.414 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 22, 2022-01-10T01:32:51.415 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:51.415 INFO:teuthology.orchestra.run.smithi036.stdout: "stored": 0, 2022-01-10T01:32:51.415 INFO:teuthology.orchestra.run.smithi036.stdout: "objects": 0, 2022-01-10T01:32:51.415 INFO:teuthology.orchestra.run.smithi036.stdout: "kb_used": 0, 2022-01-10T01:32:51.416 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes_used": 0, 2022-01-10T01:32:51.416 INFO:teuthology.orchestra.run.smithi036.stdout: "percent_used": 0, 2022-01-10T01:32:51.416 INFO:teuthology.orchestra.run.smithi036.stdout: "max_avail": 362918445056 2022-01-10T01:32:51.416 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:51.417 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:51.417 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:51.417 INFO:teuthology.orchestra.run.smithi036.stdout: "name": "cephfs_metadata", 2022-01-10T01:32:51.417 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 23, 2022-01-10T01:32:51.417 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:51.418 INFO:teuthology.orchestra.run.smithi036.stdout: "stored": 0, 2022-01-10T01:32:51.418 INFO:teuthology.orchestra.run.smithi036.stdout: "objects": 0, 2022-01-10T01:32:51.418 INFO:teuthology.orchestra.run.smithi036.stdout: "kb_used": 0, 2022-01-10T01:32:51.418 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes_used": 0, 2022-01-10T01:32:51.419 INFO:teuthology.orchestra.run.smithi036.stdout: "percent_used": 0, 2022-01-10T01:32:51.419 INFO:teuthology.orchestra.run.smithi036.stdout: "max_avail": 362918445056 2022-01-10T01:32:51.419 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:51.419 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:51.419 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:51.420 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:32:51.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.398+0000 7fc931c5c700 1 -- 172.21.15.36:0/1940805236 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc90c053500 msgr2=0x7fc90c0559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:51.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.398+0000 7fc931c5c700 1 --2- 172.21.15.36:0/1940805236 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc90c053500 0x7fc90c0559c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7fc92000d000 tx=0x7fc920007c40).stop 2022-01-10T01:32:51.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.398+0000 7fc931c5c700 1 -- 172.21.15.36:0/1940805236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92c0b3040 msgr2=0x7fc92c0aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:51.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.398+0000 7fc931c5c700 1 --2- 172.21.15.36:0/1940805236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92c0b3040 0x7fc92c0aef20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fc92c0af550 tx=0x7fc918015000).stop 2022-01-10T01:32:51.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.398+0000 7fc931c5c700 1 -- 172.21.15.36:0/1940805236 shutdown_connections 2022-01-10T01:32:51.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.398+0000 7fc931c5c700 1 --2- 172.21.15.36:0/1940805236 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc90c053500 0x7fc90c0559c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:51.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.398+0000 7fc931c5c700 1 --2- 172.21.15.36:0/1940805236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc92c140140 0x7fc92c141c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:51.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.398+0000 7fc931c5c700 1 --2- 172.21.15.36:0/1940805236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc92c0b3040 0x7fc92c0aef20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:51.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.398+0000 7fc931c5c700 1 --2- 172.21.15.36:0/1940805236 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc92c0a9c10 0x7fc92c0aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:51.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.398+0000 7fc931c5c700 1 -- 172.21.15.36:0/1940805236 >> 172.21.15.36:0/1940805236 conn(0x7fc92c0636e0 msgr2=0x7fc92c0b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:51.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.398+0000 7fc931c5c700 1 -- 172.21.15.36:0/1940805236 shutdown_connections 2022-01-10T01:32:51.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:51.398+0000 7fc931c5c700 1 -- 172.21.15.36:0/1940805236 wait complete. 2022-01-10T01:32:51.425 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30)... 2022-01-10T01:32:56.426 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2022-01-10T01:32:56.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed515c6700 1 Processor -- start 2022-01-10T01:32:56.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed515c6700 1 -- start start 2022-01-10T01:32:56.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed515c6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed4c0b1db0 0x7fed4c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:56.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed515c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c1483a0 0x7fed4c0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:56.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed515c6700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fed4c0a70c0 0x7fed4c144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:56.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed515c6700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c0a90c0 con 0x7fed4c0a70c0 2022-01-10T01:32:56.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed515c6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c0b0350 con 0x7fed4c0b1db0 2022-01-10T01:32:56.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed515c6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0b05f0 con 0x7fed4c1483a0 2022-01-10T01:32:56.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed4b7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fed4c0a70c0 0x7fed4c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:56.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed4b7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fed4c0a70c0 0x7fed4c144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41144/0 (socket says 172.21.15.36:41144) 2022-01-10T01:32:56.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed4b7fe700 1 -- 172.21.15.36:0/3609166164 learned_addr learned my addr 172.21.15.36:0/3609166164 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:56.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed4a7fc700 1 --2- 172.21.15.36:0/3609166164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c1483a0 0x7fed4c0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:56.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed4affd700 1 --2- 172.21.15.36:0/3609166164 >> v2:172.21.15.59:3300/0 conn(0x7fed4c0b1db0 0x7fed4c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:56.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed4b7fe700 1 -- 172.21.15.36:0/3609166164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c1483a0 msgr2=0x7fed4c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:56.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed4b7fe700 1 --2- 172.21.15.36:0/3609166164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c1483a0 0x7fed4c0b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed4b7fe700 1 -- 172.21.15.36:0/3609166164 >> v2:172.21.15.59:3300/0 conn(0x7fed4c0b1db0 msgr2=0x7fed4c0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:56.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed4b7fe700 1 --2- 172.21.15.36:0/3609166164 >> v2:172.21.15.59:3300/0 conn(0x7fed4c0b1db0 0x7fed4c0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed4b7fe700 1 -- 172.21.15.36:0/3609166164 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0b0890 con 0x7fed4c0a70c0 2022-01-10T01:32:56.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed4b7fe700 1 --2- 172.21.15.36:0/3609166164 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed4c0a70c0 0x7fed4c144720 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7fed440032f0 tx=0x7fed44009290).ready entity=mon.0 client_cookie=f26186b3f822d6ca server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:56.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed49ffb700 1 -- 172.21.15.36:0/3609166164 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed4400b870 con 0x7fed4c0a70c0 2022-01-10T01:32:56.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed49ffb700 1 -- 172.21.15.36:0/3609166164 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4400b9d0 con 0x7fed4c0a70c0 2022-01-10T01:32:56.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.534+0000 7fed49ffb700 1 -- 172.21.15.36:0/3609166164 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed4400bb40 con 0x7fed4c0a70c0 2022-01-10T01:32:56.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.538+0000 7fed515c6700 1 -- 172.21.15.36:0/3609166164 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed4c0a70c0 msgr2=0x7fed4c144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:56.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.538+0000 7fed515c6700 1 --2- 172.21.15.36:0/3609166164 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed4c0a70c0 0x7fed4c144720 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7fed440032f0 tx=0x7fed44009290).stop 2022-01-10T01:32:56.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.538+0000 7fed515c6700 1 -- 172.21.15.36:0/3609166164 shutdown_connections 2022-01-10T01:32:56.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.538+0000 7fed515c6700 1 --2- 172.21.15.36:0/3609166164 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed4c0a70c0 0x7fed4c144720 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.538+0000 7fed515c6700 1 --2- 172.21.15.36:0/3609166164 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c1483a0 0x7fed4c0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.538+0000 7fed515c6700 1 --2- 172.21.15.36:0/3609166164 >> v2:172.21.15.59:3300/0 conn(0x7fed4c0b1db0 0x7fed4c0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.538+0000 7fed515c6700 1 -- 172.21.15.36:0/3609166164 >> 172.21.15.36:0/3609166164 conn(0x7fed4c05f6b0 msgr2=0x7fed4c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:56.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.538+0000 7fed515c6700 1 -- 172.21.15.36:0/3609166164 shutdown_connections 2022-01-10T01:32:56.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.538+0000 7fed515c6700 1 -- 172.21.15.36:0/3609166164 wait complete. 2022-01-10T01:32:56.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.538+0000 7fed515c6700 1 Processor -- start 2022-01-10T01:32:56.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.538+0000 7fed515c6700 1 -- start start 2022-01-10T01:32:56.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed515c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c0a70c0 0x7fed4c0abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:56.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed515c6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed4c0b1db0 0x7fed4c0ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:56.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed515c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c1483a0 0x7fed4c0a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:56.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed515c6700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c149e20 con 0x7fed4c0b1db0 2022-01-10T01:32:56.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed515c6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c14b300 con 0x7fed4c0a70c0 2022-01-10T01:32:56.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed515c6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c14b5a0 con 0x7fed4c1483a0 2022-01-10T01:32:56.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed4a7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed4c0b1db0 0x7fed4c0ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:56.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed4affd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c0a70c0 0x7fed4c0abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:56.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed4a7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed4c0b1db0 0x7fed4c0ae170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41148/0 (socket says 172.21.15.36:41148) 2022-01-10T01:32:56.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed4a7fc700 1 -- 172.21.15.36:0/294996107 learned_addr learned my addr 172.21.15.36:0/294996107 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:56.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed4b7fe700 1 --2- 172.21.15.36:0/294996107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c1483a0 0x7fed4c0a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:56.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed4a7fc700 1 -- 172.21.15.36:0/294996107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c1483a0 msgr2=0x7fed4c0a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:56.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed4a7fc700 1 --2- 172.21.15.36:0/294996107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c1483a0 0x7fed4c0a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed4a7fc700 1 -- 172.21.15.36:0/294996107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c0a70c0 msgr2=0x7fed4c0abbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:56.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed4a7fc700 1 --2- 172.21.15.36:0/294996107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c0a70c0 0x7fed4c0abbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed4a7fc700 1 -- 172.21.15.36:0/294996107 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed44009530 con 0x7fed4c0b1db0 2022-01-10T01:32:56.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed4a7fc700 1 --2- 172.21.15.36:0/294996107 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed4c0b1db0 0x7fed4c0ae170 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fed3c00a000 tx=0x7fed3c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:56.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed3bfff700 1 -- 172.21.15.36:0/294996107 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed3c011780 con 0x7fed4c0b1db0 2022-01-10T01:32:56.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed3bfff700 1 -- 172.21.15.36:0/294996107 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c0118e0 con 0x7fed4c0b1db0 2022-01-10T01:32:56.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed3bfff700 1 -- 172.21.15.36:0/294996107 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed3c011c40 con 0x7fed4c0b1db0 2022-01-10T01:32:56.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed515c6700 1 -- 172.21.15.36:0/294996107 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c14b840 con 0x7fed4c0b1db0 2022-01-10T01:32:56.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.542+0000 7fed515c6700 1 -- 172.21.15.36:0/294996107 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c0aec00 con 0x7fed4c0b1db0 2022-01-10T01:32:56.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.546+0000 7fed515c6700 1 -- 172.21.15.36:0/294996107 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c0b0b30 con 0x7fed4c0b1db0 2022-01-10T01:32:56.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.546+0000 7fed3bfff700 1 -- 172.21.15.36:0/294996107 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fed3c01c460 con 0x7fed4c0b1db0 2022-01-10T01:32:56.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.546+0000 7fed3bfff700 1 --2- 172.21.15.36:0/294996107 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed280535f0 0x7fed28055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:56.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.546+0000 7fed3bfff700 1 -- 172.21.15.36:0/294996107 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6422+0+0 (secure 0 0 0) 0x7fed3c06bc20 con 0x7fed4c0b1db0 2022-01-10T01:32:56.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.546+0000 7fed4affd700 1 --2- 172.21.15.36:0/294996107 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed280535f0 0x7fed28055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:56.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.546+0000 7fed4affd700 1 --2- 172.21.15.36:0/294996107 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed280535f0 0x7fed28055ab0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fed4000c000 tx=0x7fed40008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:56.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.550+0000 7fed3bfff700 1 -- 172.21.15.36:0/294996107 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fed3c042ac0 con 0x7fed4c0b1db0 2022-01-10T01:32:56.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.726+0000 7fed515c6700 1 -- 172.21.15.36:0/294996107 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fed4c057350 con 0x7fed4c0b1db0 2022-01-10T01:32:56.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.726+0000 7fed3bfff700 1 -- 172.21.15.36:0/294996107 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1932 (secure 0 0 0) 0x7fed3c0460e0 con 0x7fed4c0b1db0 2022-01-10T01:32:56.731 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:32:56.731 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:32:56.731 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:56.732 INFO:teuthology.orchestra.run.smithi036.stdout: "total_bytes": 773094113280, 2022-01-10T01:32:56.732 INFO:teuthology.orchestra.run.smithi036.stdout: "total_avail_bytes": 764491333632, 2022-01-10T01:32:56.732 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_bytes": 12845056, 2022-01-10T01:32:56.733 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_raw_bytes": 8602779648, 2022-01-10T01:32:56.733 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_raw_ratio": 0.011127726174890995, 2022-01-10T01:32:56.734 INFO:teuthology.orchestra.run.smithi036.stdout: "num_osds": 8, 2022-01-10T01:32:56.734 INFO:teuthology.orchestra.run.smithi036.stdout: "num_per_pool_osds": 8, 2022-01-10T01:32:56.734 INFO:teuthology.orchestra.run.smithi036.stdout: "num_per_pool_omap_osds": 8 2022-01-10T01:32:56.735 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:56.735 INFO:teuthology.orchestra.run.smithi036.stdout: "stats_by_class": { 2022-01-10T01:32:56.735 INFO:teuthology.orchestra.run.smithi036.stdout: "ssd": { 2022-01-10T01:32:56.735 INFO:teuthology.orchestra.run.smithi036.stdout: "total_bytes": 773094113280, 2022-01-10T01:32:56.736 INFO:teuthology.orchestra.run.smithi036.stdout: "total_avail_bytes": 764491333632, 2022-01-10T01:32:56.736 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_bytes": 12845056, 2022-01-10T01:32:56.736 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_raw_bytes": 8602779648, 2022-01-10T01:32:56.736 INFO:teuthology.orchestra.run.smithi036.stdout: "total_used_raw_ratio": 0.011127726174890995 2022-01-10T01:32:56.737 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:56.737 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:56.737 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:32:56.737 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:56.737 INFO:teuthology.orchestra.run.smithi036.stdout: "name": "device_health_metrics", 2022-01-10T01:32:56.738 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 1, 2022-01-10T01:32:56.738 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:56.738 INFO:teuthology.orchestra.run.smithi036.stdout: "stored": 0, 2022-01-10T01:32:56.738 INFO:teuthology.orchestra.run.smithi036.stdout: "objects": 2, 2022-01-10T01:32:56.739 INFO:teuthology.orchestra.run.smithi036.stdout: "kb_used": 0, 2022-01-10T01:32:56.739 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes_used": 0, 2022-01-10T01:32:56.739 INFO:teuthology.orchestra.run.smithi036.stdout: "percent_used": 0, 2022-01-10T01:32:56.739 INFO:teuthology.orchestra.run.smithi036.stdout: "max_avail": 362918281216 2022-01-10T01:32:56.739 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:56.740 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:56.740 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:56.740 INFO:teuthology.orchestra.run.smithi036.stdout: "name": "rbd", 2022-01-10T01:32:56.740 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 2, 2022-01-10T01:32:56.740 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:56.741 INFO:teuthology.orchestra.run.smithi036.stdout: "stored": 0, 2022-01-10T01:32:56.741 INFO:teuthology.orchestra.run.smithi036.stdout: "objects": 0, 2022-01-10T01:32:56.741 INFO:teuthology.orchestra.run.smithi036.stdout: "kb_used": 0, 2022-01-10T01:32:56.741 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes_used": 0, 2022-01-10T01:32:56.742 INFO:teuthology.orchestra.run.smithi036.stdout: "percent_used": 0, 2022-01-10T01:32:56.742 INFO:teuthology.orchestra.run.smithi036.stdout: "max_avail": 362918281216 2022-01-10T01:32:56.742 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:56.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:56.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:56.743 INFO:teuthology.orchestra.run.smithi036.stdout: "name": "cephfs_data", 2022-01-10T01:32:56.743 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 22, 2022-01-10T01:32:56.744 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:56.744 INFO:teuthology.orchestra.run.smithi036.stdout: "stored": 0, 2022-01-10T01:32:56.745 INFO:teuthology.orchestra.run.smithi036.stdout: "objects": 0, 2022-01-10T01:32:56.745 INFO:teuthology.orchestra.run.smithi036.stdout: "kb_used": 0, 2022-01-10T01:32:56.745 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes_used": 0, 2022-01-10T01:32:56.745 INFO:teuthology.orchestra.run.smithi036.stdout: "percent_used": 0, 2022-01-10T01:32:56.746 INFO:teuthology.orchestra.run.smithi036.stdout: "max_avail": 362918281216 2022-01-10T01:32:56.746 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:56.746 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:32:56.746 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:32:56.747 INFO:teuthology.orchestra.run.smithi036.stdout: "name": "cephfs_metadata", 2022-01-10T01:32:56.747 INFO:teuthology.orchestra.run.smithi036.stdout: "id": 23, 2022-01-10T01:32:56.747 INFO:teuthology.orchestra.run.smithi036.stdout: "stats": { 2022-01-10T01:32:56.747 INFO:teuthology.orchestra.run.smithi036.stdout: "stored": 617, 2022-01-10T01:32:56.748 INFO:teuthology.orchestra.run.smithi036.stdout: "objects": 1, 2022-01-10T01:32:56.748 INFO:teuthology.orchestra.run.smithi036.stdout: "kb_used": 8, 2022-01-10T01:32:56.748 INFO:teuthology.orchestra.run.smithi036.stdout: "bytes_used": 8192, 2022-01-10T01:32:56.748 INFO:teuthology.orchestra.run.smithi036.stdout: "percent_used": 1.1286287460166022e-08, 2022-01-10T01:32:56.748 INFO:teuthology.orchestra.run.smithi036.stdout: "max_avail": 362918281216 2022-01-10T01:32:56.749 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:56.749 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:32:56.749 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:32:56.749 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:32:56.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.726+0000 7fed515c6700 1 -- 172.21.15.36:0/294996107 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed280535f0 msgr2=0x7fed28055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:56.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.726+0000 7fed515c6700 1 --2- 172.21.15.36:0/294996107 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed280535f0 0x7fed28055ab0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fed4000c000 tx=0x7fed40008040).stop 2022-01-10T01:32:56.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.726+0000 7fed515c6700 1 -- 172.21.15.36:0/294996107 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed4c0b1db0 msgr2=0x7fed4c0ae170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:56.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.726+0000 7fed515c6700 1 --2- 172.21.15.36:0/294996107 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed4c0b1db0 0x7fed4c0ae170 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fed3c00a000 tx=0x7fed3c008040).stop 2022-01-10T01:32:56.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.726+0000 7fed515c6700 1 -- 172.21.15.36:0/294996107 shutdown_connections 2022-01-10T01:32:56.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.726+0000 7fed515c6700 1 --2- 172.21.15.36:0/294996107 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed280535f0 0x7fed28055ab0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.726+0000 7fed515c6700 1 --2- 172.21.15.36:0/294996107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed4c1483a0 0x7fed4c0a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.726+0000 7fed515c6700 1 --2- 172.21.15.36:0/294996107 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed4c0b1db0 0x7fed4c0ae170 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.726+0000 7fed515c6700 1 --2- 172.21.15.36:0/294996107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c0a70c0 0x7fed4c0abbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.726+0000 7fed515c6700 1 -- 172.21.15.36:0/294996107 >> 172.21.15.36:0/294996107 conn(0x7fed4c05f6b0 msgr2=0x7fed4c0b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:56.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.726+0000 7fed515c6700 1 -- 172.21.15.36:0/294996107 shutdown_connections 2022-01-10T01:32:56.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.726+0000 7fed515c6700 1 -- 172.21.15.36:0/294996107 wait complete. 2022-01-10T01:32:56.755 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2022-01-10T01:32:56.756 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-01-10T01:32:56.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.862+0000 7f4c0e9be700 1 Processor -- start 2022-01-10T01:32:56.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.862+0000 7f4c0e9be700 1 -- start start 2022-01-10T01:32:56.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0e9be700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4c080b3060 0x7f4c080b7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:56.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0e9be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c080aac20 0x7f4c08064ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:56.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0e9be700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c080b2380 con 0x7f4c080b7370 2022-01-10T01:32:56.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0e9be700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c08144250 con 0x7f4c080b3060 2022-01-10T01:32:56.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0e9be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080b3570 con 0x7f4c080aac20 2022-01-10T01:32:56.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0d1bb700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4c080b3060 0x7f4c080b7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:56.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0d9bc700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f4c080b7370 0x7f4c0813e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38948/0 (socket says 172.21.15.36:38948) 2022-01-10T01:32:56.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0d9bc700 1 -- 172.21.15.36:0/3997170457 learned_addr learned my addr 172.21.15.36:0/3997170457 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:56.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0e1bd700 1 --2- 172.21.15.36:0/3997170457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c080aac20 0x7f4c08064ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:56.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0d1bb700 1 -- 172.21.15.36:0/3997170457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c080aac20 msgr2=0x7f4c08064ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:56.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0d1bb700 1 --2- 172.21.15.36:0/3997170457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c080aac20 0x7f4c08064ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0d1bb700 1 -- 172.21.15.36:0/3997170457 >> v1:172.21.15.36:6789/0 conn(0x7f4c080b7370 legacy=0x7f4c0813e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:56.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0c9ba700 1 -- 172.21.15.36:0/3997170457 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4067724483 0 0) 0x7f4c080b2380 con 0x7f4c080b7370 2022-01-10T01:32:56.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0d1bb700 1 -- 172.21.15.36:0/3997170457 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c080b25b0 con 0x7f4c080b3060 2022-01-10T01:32:56.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0d1bb700 1 --2- 172.21.15.36:0/3997170457 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c080b3060 0x7f4c080b7750 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f4bf8002f70 tx=0x7f4bf8006df0).ready entity=mon.0 client_cookie=291912b7b5d3fcff server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:56.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0c9ba700 1 -- 172.21.15.36:0/3997170457 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bf800d570 con 0x7f4c080b3060 2022-01-10T01:32:56.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0c9ba700 1 -- 172.21.15.36:0/3997170457 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf8000e90 con 0x7f4c080b3060 2022-01-10T01:32:56.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0c9ba700 1 -- 172.21.15.36:0/3997170457 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bf800d8c0 con 0x7f4c080b3060 2022-01-10T01:32:56.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0e9be700 1 -- 172.21.15.36:0/3997170457 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c080b3060 msgr2=0x7f4c080b7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:56.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0e9be700 1 --2- 172.21.15.36:0/3997170457 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c080b3060 0x7f4c080b7750 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f4bf8002f70 tx=0x7f4bf8006df0).stop 2022-01-10T01:32:56.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0e9be700 1 -- 172.21.15.36:0/3997170457 shutdown_connections 2022-01-10T01:32:56.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0e9be700 1 --2- 172.21.15.36:0/3997170457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c080aac20 0x7f4c08064ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0e9be700 1 --2- 172.21.15.36:0/3997170457 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c080b3060 0x7f4c080b7750 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0e9be700 1 -- 172.21.15.36:0/3997170457 >> 172.21.15.36:0/3997170457 conn(0x7f4c0805f6b0 msgr2=0x7f4c0805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:56.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0e9be700 1 -- 172.21.15.36:0/3997170457 shutdown_connections 2022-01-10T01:32:56.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.866+0000 7f4c0e9be700 1 -- 172.21.15.36:0/3997170457 wait complete. 2022-01-10T01:32:56.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0e9be700 1 Processor -- start 2022-01-10T01:32:56.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0e9be700 1 -- start start 2022-01-10T01:32:56.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0e9be700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c080aac20 0x7f4c08142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:56.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0e9be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c080b3060 0x7f4c08153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:56.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0e9be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c080b7370 0x7f4c080ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:56.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0e9be700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0805cea0 con 0x7f4c080aac20 2022-01-10T01:32:56.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0e9be700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080ac120 con 0x7f4c080b7370 2022-01-10T01:32:56.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0e9be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c08154020 con 0x7f4c080b3060 2022-01-10T01:32:56.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0d9bc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c080aac20 0x7f4c08142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:56.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0d9bc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c080aac20 0x7f4c08142080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41160/0 (socket says 172.21.15.36:41160) 2022-01-10T01:32:56.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0d9bc700 1 -- 172.21.15.36:0/4262992620 learned_addr learned my addr 172.21.15.36:0/4262992620 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:56.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0d1bb700 1 --2- 172.21.15.36:0/4262992620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c080b3060 0x7f4c08153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:56.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0e1bd700 1 --2- 172.21.15.36:0/4262992620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c080b7370 0x7f4c080ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:56.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0d9bc700 1 -- 172.21.15.36:0/4262992620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c080b3060 msgr2=0x7f4c08153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:56.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0d9bc700 1 --2- 172.21.15.36:0/4262992620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c080b3060 0x7f4c08153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0d9bc700 1 -- 172.21.15.36:0/4262992620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c080b7370 msgr2=0x7f4c080ad4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:56.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0d9bc700 1 --2- 172.21.15.36:0/4262992620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c080b7370 0x7f4c080ad4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:56.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0d9bc700 1 -- 172.21.15.36:0/4262992620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf800b180 con 0x7f4c080aac20 2022-01-10T01:32:56.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0d1bb700 1 --2- 172.21.15.36:0/4262992620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c080b3060 0x7f4c08153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:32:56.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0e1bd700 1 --2- 172.21.15.36:0/4262992620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c080b7370 0x7f4c080ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:32:56.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0d9bc700 1 --2- 172.21.15.36:0/4262992620 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4c080aac20 0x7f4c08142080 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f4c0805cc60 tx=0x7f4c04007b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:56.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4bf6ffd700 1 -- 172.21.15.36:0/4262992620 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c040070d0 con 0x7f4c080aac20 2022-01-10T01:32:56.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4bf6ffd700 1 -- 172.21.15.36:0/4262992620 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c04007230 con 0x7f4c080aac20 2022-01-10T01:32:56.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4c0e9be700 1 -- 172.21.15.36:0/4262992620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c08154250 con 0x7f4c080aac20 2022-01-10T01:32:56.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.870+0000 7f4bf6ffd700 1 -- 172.21.15.36:0/4262992620 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c040073a0 con 0x7f4c080aac20 2022-01-10T01:32:56.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.874+0000 7f4c0e9be700 1 -- 172.21.15.36:0/4262992620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c081544b0 con 0x7f4c080aac20 2022-01-10T01:32:56.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.874+0000 7f4c0e9be700 1 -- 172.21.15.36:0/4262992620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c081546b0 con 0x7f4c080aac20 2022-01-10T01:32:56.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.874+0000 7f4bf6ffd700 1 -- 172.21.15.36:0/4262992620 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4c0401a060 con 0x7f4c080aac20 2022-01-10T01:32:56.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.874+0000 7f4bf6ffd700 1 --2- 172.21.15.36:0/4262992620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4be80536b0 0x7f4be8055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:56.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.874+0000 7f4bf6ffd700 1 -- 172.21.15.36:0/4262992620 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6422+0+0 (secure 0 0 0) 0x7f4c0406b6c0 con 0x7f4c080aac20 2022-01-10T01:32:56.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.874+0000 7f4c0d1bb700 1 --2- 172.21.15.36:0/4262992620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4be80536b0 0x7f4be8055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:56.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.878+0000 7f4c0d1bb700 1 --2- 172.21.15.36:0/4262992620 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4be80536b0 0x7f4be8055b70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f4bf8015000 tx=0x7f4bf8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:56.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:56.882+0000 7f4bf6ffd700 1 -- 172.21.15.36:0/4262992620 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4c040426d0 con 0x7f4c080aac20 2022-01-10T01:32:57.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.050+0000 7f4c0e9be700 1 -- 172.21.15.36:0/4262992620 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4c08057350 con 0x7f4c080aac20 2022-01-10T01:32:57.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.050+0000 7f4bf6ffd700 1 -- 172.21.15.36:0/4262992620 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=-22 pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. v58) v1 ==== 209+0+0 (secure 0 0 0) 0x7f4c04045cf0 con 0x7f4c080aac20 2022-01-10T01:32:57.056 INFO:teuthology.orchestra.run.smithi036.stderr:Error EINVAL: pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. 2022-01-10T01:32:57.061 DEBUG:teuthology.orchestra.run:got remote process result: 22 2022-01-10T01:32:57.062 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-10T01:32:57.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.166+0000 7fc9e29a7700 1 Processor -- start 2022-01-10T01:32:57.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.166+0000 7fc9e29a7700 1 -- start start 2022-01-10T01:32:57.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9e29a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9dc0b6580 0x7fc9dc0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:57.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9e29a7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9dc0b6960 0x7fc9dc12ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:57.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9e29a7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9dc1440b0 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9e29a7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9dc143b70 con 0x7fc9dc0b6960 2022-01-10T01:32:57.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9e29a7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc143e10 con 0x7fc9dc0b6580 2022-01-10T01:32:57.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9dbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9dc0b6580 0x7fc9dc0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:57.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9e0f44700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9dc0b6960 0x7fc9dc12ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:57.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9db7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc9dc0b43c0 0x7fc9dc061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:56640/0 (socket says 172.21.15.36:56640) 2022-01-10T01:32:57.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9db7fe700 1 -- 172.21.15.36:0/1130842267 learned_addr learned my addr 172.21.15.36:0/1130842267 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:57.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9daffd700 1 -- 172.21.15.36:0/1130842267 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273528489 0 0) 0x7fc9dc1440b0 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9daffd700 1 -- 172.21.15.36:0/1130842267 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9c8003260 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9e0f44700 1 -- 172.21.15.36:0/1130842267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9dc0b6580 msgr2=0x7fc9dc0b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:57.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9e0f44700 1 --2- 172.21.15.36:0/1130842267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9dc0b6580 0x7fc9dc0b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:57.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9e0f44700 1 -- 172.21.15.36:0/1130842267 >> v1:172.21.15.59:6789/0 conn(0x7fc9dc0b43c0 legacy=0x7fc9dc061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:57.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9e0f44700 1 -- 172.21.15.36:0/1130842267 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc0615f0 con 0x7fc9dc0b6960 2022-01-10T01:32:57.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9dbfff700 1 --2- 172.21.15.36:0/1130842267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9dc0b6580 0x7fc9dc0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:57.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9e0f44700 1 --2- 172.21.15.36:0/1130842267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9dc0b6960 0x7fc9dc12ba00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fc9d40032f0 tx=0x7fc9d40091d0).ready entity=mon.1 client_cookie=44da2724091809a1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:57.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9daffd700 1 -- 172.21.15.36:0/1130842267 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d400b600 con 0x7fc9dc0b6960 2022-01-10T01:32:57.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9daffd700 1 -- 172.21.15.36:0/1130842267 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d400b760 con 0x7fc9dc0b6960 2022-01-10T01:32:57.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9daffd700 1 -- 172.21.15.36:0/1130842267 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d400b8d0 con 0x7fc9dc0b6960 2022-01-10T01:32:57.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9e29a7700 1 -- 172.21.15.36:0/1130842267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9dc0b6960 msgr2=0x7fc9dc12ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:57.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.170+0000 7fc9e29a7700 1 --2- 172.21.15.36:0/1130842267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9dc0b6960 0x7fc9dc12ba00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7fc9d40032f0 tx=0x7fc9d40091d0).stop 2022-01-10T01:32:57.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e29a7700 1 -- 172.21.15.36:0/1130842267 shutdown_connections 2022-01-10T01:32:57.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e29a7700 1 --2- 172.21.15.36:0/1130842267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9dc0b6960 0x7fc9dc12ba00 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:57.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e29a7700 1 --2- 172.21.15.36:0/1130842267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9dc0b6580 0x7fc9dc0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:57.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e29a7700 1 -- 172.21.15.36:0/1130842267 >> 172.21.15.36:0/1130842267 conn(0x7fc9dc05c490 msgr2=0x7fc9dc05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:57.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e29a7700 1 -- 172.21.15.36:0/1130842267 shutdown_connections 2022-01-10T01:32:57.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e29a7700 1 -- 172.21.15.36:0/1130842267 wait complete. 2022-01-10T01:32:57.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e29a7700 1 Processor -- start 2022-01-10T01:32:57.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e29a7700 1 -- start start 2022-01-10T01:32:57.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e29a7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9dc0b43c0 0x7fc9dc0b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:57.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e29a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9dc0b6580 0x7fc9dc122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:57.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e29a7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9dc0b6960 0x7fc9dc0aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:57.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e29a7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc0ad620 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e29a7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc122b00 con 0x7fc9dc0b6960 2022-01-10T01:32:57.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e29a7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc1226d0 con 0x7fc9dc0b6580 2022-01-10T01:32:57.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9dbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9dc0b43c0 0x7fc9dc0b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:57.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9dbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9dc0b43c0 0x7fc9dc0b2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41174/0 (socket says 172.21.15.36:41174) 2022-01-10T01:32:57.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9dbfff700 1 -- 172.21.15.36:0/3667577581 learned_addr learned my addr 172.21.15.36:0/3667577581 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:57.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9e0f44700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9dc0b6960 0x7fc9dc0aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:57.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9db7fe700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9dc0b6580 0x7fc9dc122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:57.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9dbfff700 1 -- 172.21.15.36:0/3667577581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9dc0b6580 msgr2=0x7fc9dc122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:57.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.174+0000 7fc9dbfff700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9dc0b6580 0x7fc9dc122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:57.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9dbfff700 1 -- 172.21.15.36:0/3667577581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9dc0b6960 msgr2=0x7fc9dc0aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:57.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9dbfff700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9dc0b6960 0x7fc9dc0aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:57.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9dbfff700 1 -- 172.21.15.36:0/3667577581 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d000b180 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9e0f44700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9dc0b6960 0x7fc9dc0aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:32:57.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9dbfff700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9dc0b43c0 0x7fc9dc0b2f90 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fc9d000c000 tx=0x7fc9d0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:57.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9d97fa700 1 -- 172.21.15.36:0/3667577581 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d000c7e0 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9d97fa700 1 -- 172.21.15.36:0/3667577581 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d000c940 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9e29a7700 1 -- 172.21.15.36:0/3667577581 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d4009470 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9d97fa700 1 -- 172.21.15.36:0/3667577581 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9d000cca0 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9e29a7700 1 -- 172.21.15.36:0/3667577581 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9dc0ad850 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9d97fa700 1 -- 172.21.15.36:0/3667577581 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc9d001c460 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9e29a7700 1 -- 172.21.15.36:0/3667577581 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9dc061890 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9d97fa700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9bc053590 0x7fc9bc055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:57.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9d97fa700 1 -- 172.21.15.36:0/3667577581 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6422+0+0 (secure 0 0 0) 0x7fc9d006bf70 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.178+0000 7fc9db7fe700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9bc053590 0x7fc9bc055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:57.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.182+0000 7fc9db7fe700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9bc053590 0x7fc9bc055a50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fc9cc00d000 tx=0x7fc9cc009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:57.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.186+0000 7fc9d97fa700 1 -- 172.21.15.36:0/3667577581 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc9d0042f20 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.350+0000 7fc9e29a7700 1 -- 172.21.15.36:0/3667577581 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fc9dc057350 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.355 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:32:57.350+0000 7f0b50f6a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:32:57.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.358+0000 7fc9d97fa700 1 -- 172.21.15.36:0/3667577581 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 23 and data pool 22 v59) v1 ==== 189+0+0 (secure 0 0 0) 0x7fc9d000ce00 con 0x7fc9dc0b43c0 2022-01-10T01:32:57.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.362+0000 7fc9e29a7700 1 -- 172.21.15.36:0/3667577581 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9bc053590 msgr2=0x7fc9bc055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:57.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.362+0000 7fc9e29a7700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9bc053590 0x7fc9bc055a50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fc9cc00d000 tx=0x7fc9cc009040).stop 2022-01-10T01:32:57.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.362+0000 7fc9e29a7700 1 -- 172.21.15.36:0/3667577581 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9dc0b43c0 msgr2=0x7fc9dc0b2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:57.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.362+0000 7fc9e29a7700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9dc0b43c0 0x7fc9dc0b2f90 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7fc9d000c000 tx=0x7fc9d0006df0).stop 2022-01-10T01:32:57.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.362+0000 7fc9e29a7700 1 -- 172.21.15.36:0/3667577581 shutdown_connections 2022-01-10T01:32:57.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.362+0000 7fc9e29a7700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc9bc053590 0x7fc9bc055a50 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:57.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.362+0000 7fc9e29a7700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9dc0b6960 0x7fc9dc0aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:57.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.362+0000 7fc9e29a7700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc9dc0b6580 0x7fc9dc122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:57.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.362+0000 7fc9e29a7700 1 --2- 172.21.15.36:0/3667577581 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc9dc0b43c0 0x7fc9dc0b2f90 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:57.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.362+0000 7fc9e29a7700 1 -- 172.21.15.36:0/3667577581 >> 172.21.15.36:0/3667577581 conn(0x7fc9dc05c490 msgr2=0x7fc9dc143160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:57.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.362+0000 7fc9e29a7700 1 -- 172.21.15.36:0/3667577581 shutdown_connections 2022-01-10T01:32:57.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.362+0000 7fc9e29a7700 1 -- 172.21.15.36:0/3667577581 wait complete. 2022-01-10T01:32:57.372 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 23 and data pool 22 2022-01-10T01:32:57.380 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:32:57.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.486+0000 7f4cd5b0f700 1 Processor -- start 2022-01-10T01:32:57.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.486+0000 7f4cd5b0f700 1 -- start start 2022-01-10T01:32:57.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cd5b0f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4cd00603d0 0x7f4cd00aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:57.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cd5b0f700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd0061990 con 0x7f4cd013f790 2022-01-10T01:32:57.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cd5b0f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd0061c30 con 0x7f4cd00a9ec0 2022-01-10T01:32:57.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cd5b0f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd0060b90 con 0x7f4cd00603d0 2022-01-10T01:32:57.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cc7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4cd00603d0 0x7f4cd00aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:57.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4ccffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f4cd013f790 0x7f4cd014a020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:38980/0 (socket says 172.21.15.36:38980) 2022-01-10T01:32:57.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4ccffff700 1 -- 172.21.15.36:0/2091561631 learned_addr learned my addr 172.21.15.36:0/2091561631 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:57.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cc7fff700 1 -- 172.21.15.36:0/2091561631 >> v1:172.21.15.59:6789/0 conn(0x7f4cd00a9ec0 legacy=0x7f4cd013ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:57.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cc7fff700 1 -- 172.21.15.36:0/2091561631 >> v1:172.21.15.36:6789/0 conn(0x7f4cd013f790 legacy=0x7f4cd014a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:57.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cc7fff700 1 -- 172.21.15.36:0/2091561631 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd0060e30 con 0x7f4cd00603d0 2022-01-10T01:32:57.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cc7fff700 1 --2- 172.21.15.36:0/2091561631 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cd00603d0 0x7f4cd00aa2a0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f4cd00aaaf0 tx=0x7f4cb8006df0).ready entity=mon.0 client_cookie=ef757f2cd80e91c5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:57.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cceffd700 1 -- 172.21.15.36:0/2091561631 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cb8014070 con 0x7f4cd00603d0 2022-01-10T01:32:57.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cceffd700 1 -- 172.21.15.36:0/2091561631 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb8000e90 con 0x7f4cd00603d0 2022-01-10T01:32:57.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cceffd700 1 -- 172.21.15.36:0/2091561631 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cb800eb00 con 0x7f4cd00603d0 2022-01-10T01:32:57.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/2091561631 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cd00603d0 msgr2=0x7f4cd00aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:57.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cd5b0f700 1 --2- 172.21.15.36:0/2091561631 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cd00603d0 0x7f4cd00aa2a0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7f4cd00aaaf0 tx=0x7f4cb8006df0).stop 2022-01-10T01:32:57.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/2091561631 shutdown_connections 2022-01-10T01:32:57.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cd5b0f700 1 --2- 172.21.15.36:0/2091561631 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cd00603d0 0x7f4cd00aa2a0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:57.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/2091561631 >> 172.21.15.36:0/2091561631 conn(0x7f4cd00b2970 msgr2=0x7f4cd00b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:57.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/2091561631 shutdown_connections 2022-01-10T01:32:57.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.490+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/2091561631 wait complete. 2022-01-10T01:32:57.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4cd5b0f700 1 Processor -- start 2022-01-10T01:32:57.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4cd5b0f700 1 -- start start 2022-01-10T01:32:57.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4cd5b0f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cd00603d0 0x7f4cd01468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:57.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4cd5b0f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cd00a9ec0 0x7f4cd00af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:57.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4cd5b0f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cd013f790 0x7f4cd0150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:57.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4cd5b0f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd0150930 con 0x7f4cd013f790 2022-01-10T01:32:57.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4cd5b0f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd013c610 con 0x7f4cd00603d0 2022-01-10T01:32:57.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4cd5b0f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd0144670 con 0x7f4cd00a9ec0 2022-01-10T01:32:57.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4ccffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cd013f790 0x7f4cd0150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:57.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4ccffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cd013f790 0x7f4cd0150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41192/0 (socket says 172.21.15.36:41192) 2022-01-10T01:32:57.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4ccffff700 1 -- 172.21.15.36:0/3363860375 learned_addr learned my addr 172.21.15.36:0/3363860375 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:57.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4ccf7fe700 1 --2- 172.21.15.36:0/3363860375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cd00603d0 0x7f4cd01468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:57.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4cc7fff700 1 --2- 172.21.15.36:0/3363860375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cd00a9ec0 0x7f4cd00af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:57.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4ccffff700 1 -- 172.21.15.36:0/3363860375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cd00a9ec0 msgr2=0x7f4cd00af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:57.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4ccffff700 1 --2- 172.21.15.36:0/3363860375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cd00a9ec0 0x7f4cd00af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:57.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4ccffff700 1 -- 172.21.15.36:0/3363860375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cd00603d0 msgr2=0x7f4cd01468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:57.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4ccffff700 1 --2- 172.21.15.36:0/3363860375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cd00603d0 0x7f4cd01468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:57.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4ccffff700 1 -- 172.21.15.36:0/3363860375 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb800b180 con 0x7f4cd013f790 2022-01-10T01:32:57.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4ccffff700 1 --2- 172.21.15.36:0/3363860375 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cd013f790 0x7f4cd0150d20 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f4cd00abc40 tx=0x7f4cc80013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:57.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4ccd7fa700 1 -- 172.21.15.36:0/3363860375 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cc8005ba0 con 0x7f4cd013f790 2022-01-10T01:32:57.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4ccd7fa700 1 -- 172.21.15.36:0/3363860375 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc8005d00 con 0x7f4cd013f790 2022-01-10T01:32:57.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/3363860375 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd0154930 con 0x7f4cd013f790 2022-01-10T01:32:57.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4ccd7fa700 1 -- 172.21.15.36:0/3363860375 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4cc80072c0 con 0x7f4cd013f790 2022-01-10T01:32:57.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.494+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/3363860375 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd0144910 con 0x7f4cd013f790 2022-01-10T01:32:57.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.498+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/3363860375 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd0057350 con 0x7f4cd013f790 2022-01-10T01:32:57.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.498+0000 7f4ccd7fa700 1 -- 172.21.15.36:0/3363860375 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4cc8010070 con 0x7f4cd013f790 2022-01-10T01:32:57.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.498+0000 7f4ccd7fa700 1 --2- 172.21.15.36:0/3363860375 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4cb4053500 0x7f4cb40559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:57.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.498+0000 7f4ccd7fa700 1 -- 172.21.15.36:0/3363860375 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f4cc806b350 con 0x7f4cd013f790 2022-01-10T01:32:57.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.498+0000 7f4ccf7fe700 1 --2- 172.21.15.36:0/3363860375 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4cb4053500 0x7f4cb40559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:57.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.498+0000 7f4ccf7fe700 1 --2- 172.21.15.36:0/3363860375 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4cb4053500 0x7f4cb40559c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f4cc000d000 tx=0x7f4cc0007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:57.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.502+0000 7f4ccd7fa700 1 -- 172.21.15.36:0/3363860375 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4cc8042310 con 0x7f4cd013f790 2022-01-10T01:32:57.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:57.670+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/3363860375 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4cd00ac9f0 con 0x7f4cd013f790 2022-01-10T01:32:58.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.362+0000 7f4ccd7fa700 1 -- 172.21.15.36:0/3363860375 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4cc8045930 con 0x7f4cd013f790 2022-01-10T01:32:58.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.366+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/3363860375 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4cb4053500 msgr2=0x7f4cb40559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:58.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.366+0000 7f4cd5b0f700 1 --2- 172.21.15.36:0/3363860375 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4cb4053500 0x7f4cb40559c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f4cc000d000 tx=0x7f4cc0007b90).stop 2022-01-10T01:32:58.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.366+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/3363860375 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cd013f790 msgr2=0x7f4cd0150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:58.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.366+0000 7f4cd5b0f700 1 --2- 172.21.15.36:0/3363860375 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cd013f790 0x7f4cd0150d20 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f4cd00abc40 tx=0x7f4cc80013a0).stop 2022-01-10T01:32:58.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.366+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/3363860375 shutdown_connections 2022-01-10T01:32:58.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.366+0000 7f4cd5b0f700 1 --2- 172.21.15.36:0/3363860375 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4cb4053500 0x7f4cb40559c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:58.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.366+0000 7f4cd5b0f700 1 --2- 172.21.15.36:0/3363860375 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4cd013f790 0x7f4cd0150d20 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:58.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.366+0000 7f4cd5b0f700 1 --2- 172.21.15.36:0/3363860375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cd00a9ec0 0x7f4cd00af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:58.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.366+0000 7f4cd5b0f700 1 --2- 172.21.15.36:0/3363860375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cd00603d0 0x7f4cd01468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:58.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.366+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/3363860375 >> 172.21.15.36:0/3363860375 conn(0x7f4cd00b2970 msgr2=0x7f4cd00b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:58.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.366+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/3363860375 shutdown_connections 2022-01-10T01:32:58.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.366+0000 7f4cd5b0f700 1 -- 172.21.15.36:0/3363860375 wait complete. 2022-01-10T01:32:58.388 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:32:58.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.502+0000 7f61b735c700 1 Processor -- start 2022-01-10T01:32:58.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.502+0000 7f61b735c700 1 -- start start 2022-01-10T01:32:58.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.502+0000 7f61b735c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f61b00b6580 0x7f61b00b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:58.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.502+0000 7f61b735c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61b00b43c0 0x7f61b00b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:58.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b735c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b0061d30 0x7f61b00621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:58.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b735c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b01440b0 con 0x7f61b00b6580 2022-01-10T01:32:58.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b735c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b00b6e50 con 0x7f61b00b43c0 2022-01-10T01:32:58.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b735c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0143b70 con 0x7f61b0061d30 2022-01-10T01:32:58.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b50f8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f61b00b6580 0x7f61b00b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:58.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b50f8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f61b00b6580 0x7f61b00b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41196/0 (socket says 172.21.15.36:41196) 2022-01-10T01:32:58.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b50f8700 1 -- 172.21.15.36:0/3809795071 learned_addr learned my addr 172.21.15.36:0/3809795071 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:58.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b48f7700 1 --2- 172.21.15.36:0/3809795071 >> v2:172.21.15.59:3300/0 conn(0x7f61b00b43c0 0x7f61b00b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:58.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b58f9700 1 --2- 172.21.15.36:0/3809795071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b0061d30 0x7f61b00621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:58.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b50f8700 1 -- 172.21.15.36:0/3809795071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b0061d30 msgr2=0x7f61b00621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:58.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b50f8700 1 --2- 172.21.15.36:0/3809795071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b0061d30 0x7f61b00621a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:58.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b50f8700 1 -- 172.21.15.36:0/3809795071 >> v2:172.21.15.59:3300/0 conn(0x7f61b00b43c0 msgr2=0x7f61b00b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:32:58.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b50f8700 1 --2- 172.21.15.36:0/3809795071 >> v2:172.21.15.59:3300/0 conn(0x7f61b00b43c0 0x7f61b00b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:58.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b50f8700 1 -- 172.21.15.36:0/3809795071 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b0143e10 con 0x7f61b00b6580 2022-01-10T01:32:58.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b58f9700 1 --2- 172.21.15.36:0/3809795071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b0061d30 0x7f61b00621a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:58.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b50f8700 1 --2- 172.21.15.36:0/3809795071 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61b00b6580 0x7f61b00b5bf0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f61b0143120 tx=0x7f61ac006eb0).ready entity=mon.0 client_cookie=f1e217f69da1db00 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:58.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f619bfff700 1 -- 172.21.15.36:0/3809795071 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61ac00d570 con 0x7f61b00b6580 2022-01-10T01:32:58.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f619bfff700 1 -- 172.21.15.36:0/3809795071 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac000e90 con 0x7f61b00b6580 2022-01-10T01:32:58.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f619bfff700 1 -- 172.21.15.36:0/3809795071 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61ac00d900 con 0x7f61b00b6580 2022-01-10T01:32:58.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b735c700 1 -- 172.21.15.36:0/3809795071 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61b00b6580 msgr2=0x7f61b00b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:58.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b735c700 1 --2- 172.21.15.36:0/3809795071 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61b00b6580 0x7f61b00b5bf0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7f61b0143120 tx=0x7f61ac006eb0).stop 2022-01-10T01:32:58.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b735c700 1 -- 172.21.15.36:0/3809795071 shutdown_connections 2022-01-10T01:32:58.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b735c700 1 --2- 172.21.15.36:0/3809795071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b0061d30 0x7f61b00621a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:58.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b735c700 1 --2- 172.21.15.36:0/3809795071 >> v2:172.21.15.59:3300/0 conn(0x7f61b00b43c0 0x7f61b00b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:58.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b735c700 1 --2- 172.21.15.36:0/3809795071 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61b00b6580 0x7f61b00b5bf0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:58.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b735c700 1 -- 172.21.15.36:0/3809795071 >> 172.21.15.36:0/3809795071 conn(0x7f61b005c490 msgr2=0x7f61b005c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:58.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b735c700 1 -- 172.21.15.36:0/3809795071 shutdown_connections 2022-01-10T01:32:58.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.506+0000 7f61b735c700 1 -- 172.21.15.36:0/3809795071 wait complete. 2022-01-10T01:32:58.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b735c700 1 Processor -- start 2022-01-10T01:32:58.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b735c700 1 -- start start 2022-01-10T01:32:58.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b735c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b0061d30 0x7f61b0147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:58.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b735c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61b00b43c0 0x7f61b012be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:58.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b735c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b00b6580 0x7f61b0140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:58.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b735c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b01466d0 con 0x7f61b00b43c0 2022-01-10T01:32:58.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b735c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0126c10 con 0x7f61b0061d30 2022-01-10T01:32:58.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b735c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b01481a0 con 0x7f61b00b6580 2022-01-10T01:32:58.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b48f7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61b00b43c0 0x7f61b012be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:58.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b48f7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61b00b43c0 0x7f61b012be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41204/0 (socket says 172.21.15.36:41204) 2022-01-10T01:32:58.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b48f7700 1 -- 172.21.15.36:0/1735909709 learned_addr learned my addr 172.21.15.36:0/1735909709 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:58.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b50f8700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b0061d30 0x7f61b0147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:58.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b58f9700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b00b6580 0x7f61b0140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:58.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b48f7700 1 -- 172.21.15.36:0/1735909709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b00b6580 msgr2=0x7f61b0140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:58.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b48f7700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b00b6580 0x7f61b0140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:58.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b48f7700 1 -- 172.21.15.36:0/1735909709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b0061d30 msgr2=0x7f61b0147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:58.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b48f7700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b0061d30 0x7f61b0147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:58.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b48f7700 1 -- 172.21.15.36:0/1735909709 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac00b1e0 con 0x7f61b00b43c0 2022-01-10T01:32:58.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b50f8700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b0061d30 0x7f61b0147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:58.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b48f7700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61b00b43c0 0x7f61b012be60 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f61a400c000 tx=0x7f61a4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:58.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61a2ffd700 1 -- 172.21.15.36:0/1735909709 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61a4010780 con 0x7f61b00b43c0 2022-01-10T01:32:58.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61a2ffd700 1 -- 172.21.15.36:0/1735909709 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a40108e0 con 0x7f61b00b43c0 2022-01-10T01:32:58.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b735c700 1 -- 172.21.15.36:0/1735909709 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b012a510 con 0x7f61b00b43c0 2022-01-10T01:32:58.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61a2ffd700 1 -- 172.21.15.36:0/1735909709 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61a4010c40 con 0x7f61b00b43c0 2022-01-10T01:32:58.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.510+0000 7f61b735c700 1 -- 172.21.15.36:0/1735909709 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b0129780 con 0x7f61b00b43c0 2022-01-10T01:32:58.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.514+0000 7f61b735c700 1 -- 172.21.15.36:0/1735909709 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b012a370 con 0x7f61b00b43c0 2022-01-10T01:32:58.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.514+0000 7f61a2ffd700 1 -- 172.21.15.36:0/1735909709 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f61a401c460 con 0x7f61b00b43c0 2022-01-10T01:32:58.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.514+0000 7f61a2ffd700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f618c0536b0 0x7f618c055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:58.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.514+0000 7f61a2ffd700 1 -- 172.21.15.36:0/1735909709 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f61a406bea0 con 0x7f61b00b43c0 2022-01-10T01:32:58.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.514+0000 7f61b50f8700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f618c0536b0 0x7f618c055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:58.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.514+0000 7f61b50f8700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f618c0536b0 0x7f618c055b70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f61ac01a000 tx=0x7f61ac015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:58.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.522+0000 7f61a2ffd700 1 -- 172.21.15.36:0/1735909709 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f61b012a370 con 0x7f61b00b43c0 2022-01-10T01:32:58.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:58.650+0000 7f61b735c700 1 -- 172.21.15.36:0/1735909709 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f61b012a370 con 0x7f61b00b43c0 2022-01-10T01:32:59.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.374+0000 7f61a2ffd700 1 -- 172.21.15.36:0/1735909709 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v129) v1 ==== 185+0+0 (secure 0 0 0) 0x7f61b012a370 con 0x7f61b00b43c0 2022-01-10T01:32:59.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.378+0000 7f61b735c700 1 -- 172.21.15.36:0/1735909709 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f618c0536b0 msgr2=0x7f618c055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:59.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.378+0000 7f61b735c700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f618c0536b0 0x7f618c055b70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f61ac01a000 tx=0x7f61ac015000).stop 2022-01-10T01:32:59.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.378+0000 7f61b735c700 1 -- 172.21.15.36:0/1735909709 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61b00b43c0 msgr2=0x7f61b012be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:59.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.378+0000 7f61b735c700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61b00b43c0 0x7f61b012be60 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f61a400c000 tx=0x7f61a4006df0).stop 2022-01-10T01:32:59.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.378+0000 7f61b735c700 1 -- 172.21.15.36:0/1735909709 shutdown_connections 2022-01-10T01:32:59.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.378+0000 7f61b735c700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f618c0536b0 0x7f618c055b70 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:59.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.378+0000 7f61b735c700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61b00b6580 0x7f61b0140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:59.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.378+0000 7f61b735c700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61b00b43c0 0x7f61b012be60 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:59.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.378+0000 7f61b735c700 1 --2- 172.21.15.36:0/1735909709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61b0061d30 0x7f61b0147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:59.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.378+0000 7f61b735c700 1 -- 172.21.15.36:0/1735909709 >> 172.21.15.36:0/1735909709 conn(0x7f61b005c490 msgr2=0x7f61b0143160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:59.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.378+0000 7f61b735c700 1 -- 172.21.15.36:0/1735909709 shutdown_connections 2022-01-10T01:32:59.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.378+0000 7f61b735c700 1 -- 172.21.15.36:0/1735909709 wait complete. 2022-01-10T01:32:59.387 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:32:59.399 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:32:59.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.514+0000 7f648d40f700 1 Processor -- start 2022-01-10T01:32:59.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.514+0000 7f648d40f700 1 -- start start 2022-01-10T01:32:59.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.514+0000 7f648d40f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f64880601a0 0x7f64880b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:59.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.514+0000 7f648d40f700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64880aa4a0 con 0x7f648805c560 2022-01-10T01:32:59.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.514+0000 7f648d40f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648805fb80 con 0x7f64880af3c0 2022-01-10T01:32:59.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.514+0000 7f648d40f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64880b1450 con 0x7f64880601a0 2022-01-10T01:32:59.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.514+0000 7f648cc0e700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f648805c560 0x7f64880a8bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39006/0 (socket says 172.21.15.36:39006) 2022-01-10T01:32:59.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.514+0000 7f647ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f64880601a0 0x7f64880b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:59.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.514+0000 7f648cc0e700 1 -- 172.21.15.36:0/2238866670 learned_addr learned my addr 172.21.15.36:0/2238866670 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:32:59.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.518+0000 7f647ffff700 1 -- 172.21.15.36:0/2238866670 >> v1:172.21.15.59:6789/0 conn(0x7f64880af3c0 legacy=0x7f6488144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:59.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.518+0000 7f647ffff700 1 -- 172.21.15.36:0/2238866670 >> v1:172.21.15.36:6789/0 conn(0x7f648805c560 legacy=0x7f64880a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:59.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.518+0000 7f647ffff700 1 -- 172.21.15.36:0/2238866670 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648805f6b0 con 0x7f64880601a0 2022-01-10T01:32:59.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.518+0000 7f647ffff700 1 --2- 172.21.15.36:0/2238866670 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64880601a0 0x7f64880b0cb0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f6470002f70 tx=0x7f6470006df0).ready entity=mon.0 client_cookie=813fdc1f8a1c0fba server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:59.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.518+0000 7f64877fe700 1 -- 172.21.15.36:0/2238866670 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f647000d610 con 0x7f64880601a0 2022-01-10T01:32:59.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.518+0000 7f64877fe700 1 -- 172.21.15.36:0/2238866670 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6470000e90 con 0x7f64880601a0 2022-01-10T01:32:59.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.518+0000 7f64877fe700 1 -- 172.21.15.36:0/2238866670 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f647000d9a0 con 0x7f64880601a0 2022-01-10T01:32:59.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.518+0000 7f648d40f700 1 -- 172.21.15.36:0/2238866670 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64880601a0 msgr2=0x7f64880b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:59.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.518+0000 7f648d40f700 1 --2- 172.21.15.36:0/2238866670 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64880601a0 0x7f64880b0cb0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f6470002f70 tx=0x7f6470006df0).stop 2022-01-10T01:32:59.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.518+0000 7f648d40f700 1 -- 172.21.15.36:0/2238866670 shutdown_connections 2022-01-10T01:32:59.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.518+0000 7f648d40f700 1 --2- 172.21.15.36:0/2238866670 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64880601a0 0x7f64880b0cb0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:59.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.518+0000 7f648d40f700 1 -- 172.21.15.36:0/2238866670 >> 172.21.15.36:0/2238866670 conn(0x7f6488061140 msgr2=0x7f6488062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:32:59.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.518+0000 7f648d40f700 1 -- 172.21.15.36:0/2238866670 shutdown_connections 2022-01-10T01:32:59.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.518+0000 7f648d40f700 1 -- 172.21.15.36:0/2238866670 wait complete. 2022-01-10T01:32:59.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648d40f700 1 Processor -- start 2022-01-10T01:32:59.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648d40f700 1 -- start start 2022-01-10T01:32:59.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648d40f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f648805c560 0x7f6488143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:59.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648d40f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64880601a0 0x7f6488150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:59.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648d40f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64880af3c0 0x7f64880aa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:59.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648d40f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6488144190 con 0x7f64880af3c0 2022-01-10T01:32:59.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648d40f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6488143d60 con 0x7f64880601a0 2022-01-10T01:32:59.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648d40f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64881502d0 con 0x7f648805c560 2022-01-10T01:32:59.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648cc0e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64880af3c0 0x7f64880aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:59.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648cc0e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64880af3c0 0x7f64880aa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41218/0 (socket says 172.21.15.36:41218) 2022-01-10T01:32:59.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648cc0e700 1 -- 172.21.15.36:0/2687235193 learned_addr learned my addr 172.21.15.36:0/2687235193 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:32:59.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f6487fff700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f648805c560 0x7f6488143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:59.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f647ffff700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64880601a0 0x7f6488150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:59.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648cc0e700 1 -- 172.21.15.36:0/2687235193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f648805c560 msgr2=0x7f6488143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:59.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648cc0e700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f648805c560 0x7f6488143330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:59.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648cc0e700 1 -- 172.21.15.36:0/2687235193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64880601a0 msgr2=0x7f6488150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:32:59.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648cc0e700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64880601a0 0x7f6488150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:32:59.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648cc0e700 1 -- 172.21.15.36:0/2687235193 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647000b180 con 0x7f64880af3c0 2022-01-10T01:32:59.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f6487fff700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f648805c560 0x7f6488143330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:59.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f647ffff700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64880601a0 0x7f6488150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:32:59.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648cc0e700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64880af3c0 0x7f64880aa680 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f64880b02c0 tx=0x7f6480007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:59.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f6485ffb700 1 -- 172.21.15.36:0/2687235193 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6480005ba0 con 0x7f64880af3c0 2022-01-10T01:32:59.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f6485ffb700 1 -- 172.21.15.36:0/2687235193 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6480005d00 con 0x7f64880af3c0 2022-01-10T01:32:59.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f6485ffb700 1 -- 172.21.15.36:0/2687235193 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64800072c0 con 0x7f64880af3c0 2022-01-10T01:32:59.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648d40f700 1 -- 172.21.15.36:0/2687235193 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6488150570 con 0x7f64880af3c0 2022-01-10T01:32:59.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.522+0000 7f648d40f700 1 -- 172.21.15.36:0/2687235193 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64880ac490 con 0x7f64880af3c0 2022-01-10T01:32:59.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.526+0000 7f648d40f700 1 -- 172.21.15.36:0/2687235193 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64881509b0 con 0x7f64880af3c0 2022-01-10T01:32:59.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.526+0000 7f6485ffb700 1 -- 172.21.15.36:0/2687235193 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6480010070 con 0x7f64880af3c0 2022-01-10T01:32:59.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.526+0000 7f6485ffb700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f646c0535f0 0x7f646c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:32:59.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.526+0000 7f6485ffb700 1 -- 172.21.15.36:0/2687235193 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f648006b320 con 0x7f64880af3c0 2022-01-10T01:32:59.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.526+0000 7f6487fff700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f646c0535f0 0x7f646c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:32:59.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.526+0000 7f6487fff700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f646c0535f0 0x7f646c055ab0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f647800b000 tx=0x7f6478009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:32:59.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.534+0000 7f6485ffb700 1 -- 172.21.15.36:0/2687235193 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6480042490 con 0x7f64880af3c0 2022-01-10T01:32:59.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:32:59.662+0000 7f648d40f700 1 -- 172.21.15.36:0/2687235193 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f6488057350 con 0x7f64880af3c0 2022-01-10T01:33:00.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.374+0000 7f6485ffb700 1 -- 172.21.15.36:0/2687235193 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v130) v1 ==== 133+0+0 (secure 0 0 0) 0x7f6480045ab0 con 0x7f64880af3c0 2022-01-10T01:33:00.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.378+0000 7f648d40f700 1 -- 172.21.15.36:0/2687235193 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f646c0535f0 msgr2=0x7f646c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:00.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.378+0000 7f648d40f700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f646c0535f0 0x7f646c055ab0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f647800b000 tx=0x7f6478009040).stop 2022-01-10T01:33:00.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.378+0000 7f648d40f700 1 -- 172.21.15.36:0/2687235193 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64880af3c0 msgr2=0x7f64880aa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:00.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.378+0000 7f648d40f700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64880af3c0 0x7f64880aa680 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f64880b02c0 tx=0x7f6480007f40).stop 2022-01-10T01:33:00.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.378+0000 7f648d40f700 1 -- 172.21.15.36:0/2687235193 shutdown_connections 2022-01-10T01:33:00.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.378+0000 7f648d40f700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f646c0535f0 0x7f646c055ab0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:00.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.378+0000 7f648d40f700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f64880af3c0 0x7f64880aa680 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:00.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.378+0000 7f648d40f700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64880601a0 0x7f6488150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:00.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.378+0000 7f648d40f700 1 --2- 172.21.15.36:0/2687235193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f648805c560 0x7f6488143330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:00.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.382+0000 7f648d40f700 1 -- 172.21.15.36:0/2687235193 >> 172.21.15.36:0/2687235193 conn(0x7f6488061140 msgr2=0x7f6488141760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:00.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.382+0000 7f648d40f700 1 -- 172.21.15.36:0/2687235193 shutdown_connections 2022-01-10T01:33:00.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.382+0000 7f648d40f700 1 -- 172.21.15.36:0/2687235193 wait complete. 2022-01-10T01:33:00.389 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:33:00.400 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-01-10T01:33:00.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe195b4700 1 Processor -- start 2022-01-10T01:33:00.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe195b4700 1 -- start start 2022-01-10T01:33:00.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe195b4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbe14146950 0x7fbe14140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:00.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe195b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe140b4180 0x7fbe14140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:00.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe195b4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe14143b60 con 0x7fbe140b4690 2022-01-10T01:33:00.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe195b4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe14147510 con 0x7fbe14146950 2022-01-10T01:33:00.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe195b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14143e00 con 0x7fbe140b4180 2022-01-10T01:33:00.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe12ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbe14146950 0x7fbe14140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:00.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe12ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbe14146950 0x7fbe14140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41222/0 (socket says 172.21.15.36:41222) 2022-01-10T01:33:00.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe12ffd700 1 -- 172.21.15.36:0/1253228620 learned_addr learned my addr 172.21.15.36:0/1253228620 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:00.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe127fc700 1 --2- 172.21.15.36:0/1253228620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe140b4180 0x7fbe14140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:00.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe12ffd700 1 -- 172.21.15.36:0/1253228620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe140b4180 msgr2=0x7fbe14140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:00.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe12ffd700 1 --2- 172.21.15.36:0/1253228620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe140b4180 0x7fbe14140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:00.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe12ffd700 1 -- 172.21.15.36:0/1253228620 >> v1:172.21.15.59:6789/0 conn(0x7fbe140b4690 legacy=0x7fbe140b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:00.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe12ffd700 1 -- 172.21.15.36:0/1253228620 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe140b0c90 con 0x7fbe14146950 2022-01-10T01:33:00.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe12ffd700 1 --2- 172.21.15.36:0/1253228620 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe14146950 0x7fbe14140230 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7fbe04002f70 tx=0x7fbe04006eb0).ready entity=mon.0 client_cookie=19b0ad3f55b9eedc server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:00.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe11ffb700 1 -- 172.21.15.36:0/1253228620 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe0400d5c0 con 0x7fbe14146950 2022-01-10T01:33:00.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe11ffb700 1 -- 172.21.15.36:0/1253228620 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe04000e90 con 0x7fbe14146950 2022-01-10T01:33:00.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe11ffb700 1 -- 172.21.15.36:0/1253228620 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe0400d950 con 0x7fbe14146950 2022-01-10T01:33:00.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe195b4700 1 -- 172.21.15.36:0/1253228620 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe14146950 msgr2=0x7fbe14140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:00.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.510+0000 7fbe195b4700 1 --2- 172.21.15.36:0/1253228620 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe14146950 0x7fbe14140230 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7fbe04002f70 tx=0x7fbe04006eb0).stop 2022-01-10T01:33:00.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.514+0000 7fbe195b4700 1 -- 172.21.15.36:0/1253228620 shutdown_connections 2022-01-10T01:33:00.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.514+0000 7fbe195b4700 1 --2- 172.21.15.36:0/1253228620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe140b4180 0x7fbe14140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:00.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.514+0000 7fbe195b4700 1 --2- 172.21.15.36:0/1253228620 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe14146950 0x7fbe14140230 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:00.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.514+0000 7fbe195b4700 1 -- 172.21.15.36:0/1253228620 >> 172.21.15.36:0/1253228620 conn(0x7fbe1405c490 msgr2=0x7fbe1405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:00.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.514+0000 7fbe195b4700 1 -- 172.21.15.36:0/1253228620 shutdown_connections 2022-01-10T01:33:00.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.514+0000 7fbe195b4700 1 -- 172.21.15.36:0/1253228620 wait complete. 2022-01-10T01:33:00.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.514+0000 7fbe195b4700 1 Processor -- start 2022-01-10T01:33:00.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.514+0000 7fbe195b4700 1 -- start start 2022-01-10T01:33:00.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe195b4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe140b4180 0x7fbe141522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:00.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe195b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe140b4690 0x7fbe140b84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:00.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe195b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe14146950 0x7fbe140ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:00.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe195b4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140ad700 con 0x7fbe140b4180 2022-01-10T01:33:00.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe195b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14142ce0 con 0x7fbe14146950 2022-01-10T01:33:00.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe195b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14142a40 con 0x7fbe140b4690 2022-01-10T01:33:00.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe12ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe140b4180 0x7fbe141522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:00.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe12ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe140b4180 0x7fbe141522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41228/0 (socket says 172.21.15.36:41228) 2022-01-10T01:33:00.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe12ffd700 1 -- 172.21.15.36:0/3480345904 learned_addr learned my addr 172.21.15.36:0/3480345904 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:00.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe127fc700 1 --2- 172.21.15.36:0/3480345904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe140b4690 0x7fbe140b84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:00.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe137fe700 1 --2- 172.21.15.36:0/3480345904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe14146950 0x7fbe140ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:00.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe12ffd700 1 -- 172.21.15.36:0/3480345904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe140b4690 msgr2=0x7fbe140b84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:00.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe12ffd700 1 --2- 172.21.15.36:0/3480345904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe140b4690 0x7fbe140b84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:00.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe12ffd700 1 -- 172.21.15.36:0/3480345904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe14146950 msgr2=0x7fbe140ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:00.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe12ffd700 1 --2- 172.21.15.36:0/3480345904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe14146950 0x7fbe140ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:00.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe12ffd700 1 -- 172.21.15.36:0/3480345904 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0400b1e0 con 0x7fbe140b4180 2022-01-10T01:33:00.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe12ffd700 1 --2- 172.21.15.36:0/3480345904 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe140b4180 0x7fbe141522f0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7fbe04002f70 tx=0x7fbe04015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:00.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe03fff700 1 -- 172.21.15.36:0/3480345904 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe0400d940 con 0x7fbe140b4180 2022-01-10T01:33:00.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe03fff700 1 -- 172.21.15.36:0/3480345904 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe04011ce0 con 0x7fbe140b4180 2022-01-10T01:33:00.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe03fff700 1 -- 172.21.15.36:0/3480345904 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe0401e650 con 0x7fbe140b4180 2022-01-10T01:33:00.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe195b4700 1 -- 172.21.15.36:0/3480345904 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe140ad960 con 0x7fbe140b4180 2022-01-10T01:33:00.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe195b4700 1 -- 172.21.15.36:0/3480345904 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe14142f20 con 0x7fbe140b4180 2022-01-10T01:33:00.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.518+0000 7fbe195b4700 1 -- 172.21.15.36:0/3480345904 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe140adb20 con 0x7fbe140b4180 2022-01-10T01:33:00.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.522+0000 7fbe03fff700 1 -- 172.21.15.36:0/3480345904 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbe04025030 con 0x7fbe140b4180 2022-01-10T01:33:00.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.522+0000 7fbe03fff700 1 --2- 172.21.15.36:0/3480345904 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbdf00534d0 0x7fbdf0055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:00.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.522+0000 7fbe03fff700 1 -- 172.21.15.36:0/3480345904 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6422+0+0 (secure 0 0 0) 0x7fbe0406cde0 con 0x7fbe140b4180 2022-01-10T01:33:00.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.522+0000 7fbe127fc700 1 --2- 172.21.15.36:0/3480345904 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbdf00534d0 0x7fbdf0055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:00.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.522+0000 7fbe127fc700 1 --2- 172.21.15.36:0/3480345904 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbdf00534d0 0x7fbdf0055990 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fbe0800c000 tx=0x7fbe08008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:00.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.530+0000 7fbe03fff700 1 -- 172.21.15.36:0/3480345904 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbe04043df0 con 0x7fbe140b4180 2022-01-10T01:33:00.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.698+0000 7fbe195b4700 1 -- 172.21.15.36:0/3480345904 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbe14057350 con 0x7fbe140b4180 2022-01-10T01:33:00.705 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:33:00.698+0000 7f0b50f6a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:33:00.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.710+0000 7fbe03fff700 1 -- 172.21.15.36:0/3480345904 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 22 v61) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbe04023070 con 0x7fbe140b4180 2022-01-10T01:33:00.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.710+0000 7fbe195b4700 1 -- 172.21.15.36:0/3480345904 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbdf00534d0 msgr2=0x7fbdf0055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:00.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.710+0000 7fbe195b4700 1 --2- 172.21.15.36:0/3480345904 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbdf00534d0 0x7fbdf0055990 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fbe0800c000 tx=0x7fbe08008040).stop 2022-01-10T01:33:00.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.710+0000 7fbe195b4700 1 -- 172.21.15.36:0/3480345904 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe140b4180 msgr2=0x7fbe141522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:00.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.710+0000 7fbe195b4700 1 --2- 172.21.15.36:0/3480345904 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe140b4180 0x7fbe141522f0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7fbe04002f70 tx=0x7fbe04015000).stop 2022-01-10T01:33:00.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.714+0000 7fbe195b4700 1 -- 172.21.15.36:0/3480345904 shutdown_connections 2022-01-10T01:33:00.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.714+0000 7fbe195b4700 1 --2- 172.21.15.36:0/3480345904 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbdf00534d0 0x7fbdf0055990 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:00.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.714+0000 7fbe195b4700 1 --2- 172.21.15.36:0/3480345904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe14146950 0x7fbe140ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:00.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.714+0000 7fbe195b4700 1 --2- 172.21.15.36:0/3480345904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe140b4690 0x7fbe140b84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:00.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.714+0000 7fbe195b4700 1 --2- 172.21.15.36:0/3480345904 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe140b4180 0x7fbe141522f0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:00.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.714+0000 7fbe195b4700 1 -- 172.21.15.36:0/3480345904 >> 172.21.15.36:0/3480345904 conn(0x7fbe1405c490 msgr2=0x7fbe140b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:00.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.714+0000 7fbe195b4700 1 -- 172.21.15.36:0/3480345904 shutdown_connections 2022-01-10T01:33:00.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.714+0000 7fbe195b4700 1 -- 172.21.15.36:0/3480345904 wait complete. 2022-01-10T01:33:00.724 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 24 and data pool 22 2022-01-10T01:33:00.730 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:33:00.731 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:00.743 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:00.763 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:00.784 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:00.807 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:33:00.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:00.808 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:00.809 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:00.816 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2022-01-10T01:33:00.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:33:00.818 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2022-01-10T01:33:00.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:33:00.819 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:00.866 INFO:teuthology.orchestra.run.smithi139.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2022-01-10T01:33:00.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:33:00.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:00.868 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:00.868 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:00.876 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:33:00.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:33:00.877 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:33:00.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:33:00.879 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:00.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:33:00.888 INFO:teuthology.orchestra.run.smithi166.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:33:00.888 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:33:01.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a9c9c700 1 Processor -- start 2022-01-10T01:33:01.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a9c9c700 1 -- start start 2022-01-10T01:33:01.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a9c9c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb2a4060100 0x7fb2a40b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a9c9c700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a40aabb0 con 0x7fb2a40b4c40 2022-01-10T01:33:01.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a9c9c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a40604e0 con 0x7fb2a4067300 2022-01-10T01:33:01.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a9c9c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a4066ea0 con 0x7fb2a4060100 2022-01-10T01:33:01.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a37fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb2a4060100 0x7fb2a40b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a3fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fb2a40b4c40 0x7fb2a414b850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39034/0 (socket says 172.21.15.36:39034) 2022-01-10T01:33:01.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a3fff700 1 -- 172.21.15.36:0/2518895948 learned_addr learned my addr 172.21.15.36:0/2518895948 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:01.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a37fe700 1 -- 172.21.15.36:0/2518895948 >> v1:172.21.15.59:6789/0 conn(0x7fb2a4067300 legacy=0x7fb2a41438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a37fe700 1 -- 172.21.15.36:0/2518895948 >> v1:172.21.15.36:6789/0 conn(0x7fb2a40b4c40 legacy=0x7fb2a414b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a27fc700 1 -- 172.21.15.36:0/2518895948 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849975736 0 0) 0x7fb2a40aabb0 con 0x7fb2a40b4c40 2022-01-10T01:33:01.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a37fe700 1 -- 172.21.15.36:0/2518895948 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a40b33b0 con 0x7fb2a4060100 2022-01-10T01:33:01.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a37fe700 1 --2- 172.21.15.36:0/2518895948 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2a4060100 0x7fb2a40b4750 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fb298002f70 tx=0x7fb298006df0).ready entity=mon.0 client_cookie=ea26c9a40868f7b9 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:01.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a27fc700 1 -- 172.21.15.36:0/2518895948 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb29800d610 con 0x7fb2a4060100 2022-01-10T01:33:01.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a27fc700 1 -- 172.21.15.36:0/2518895948 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb298000e90 con 0x7fb2a4060100 2022-01-10T01:33:01.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a27fc700 1 -- 172.21.15.36:0/2518895948 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb29800d960 con 0x7fb2a4060100 2022-01-10T01:33:01.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/2518895948 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2a4060100 msgr2=0x7fb2a40b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a9c9c700 1 --2- 172.21.15.36:0/2518895948 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2a4060100 0x7fb2a40b4750 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7fb298002f70 tx=0x7fb298006df0).stop 2022-01-10T01:33:01.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/2518895948 shutdown_connections 2022-01-10T01:33:01.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a9c9c700 1 --2- 172.21.15.36:0/2518895948 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2a4060100 0x7fb2a40b4750 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/2518895948 >> 172.21.15.36:0/2518895948 conn(0x7fb2a405cf30 msgr2=0x7fb2a405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:01.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/2518895948 shutdown_connections 2022-01-10T01:33:01.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:00.998+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/2518895948 wait complete. 2022-01-10T01:33:01.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a9c9c700 1 Processor -- start 2022-01-10T01:33:01.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a9c9c700 1 -- start start 2022-01-10T01:33:01.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a9c9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a4060100 0x7fb2a40b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a9c9c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2a4067300 0x7fb2a40619d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a9c9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a40b4c40 0x7fb2a4156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a9c9c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4062070 con 0x7fb2a4067300 2022-01-10T01:33:01.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a9c9c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4155c30 con 0x7fb2a4060100 2022-01-10T01:33:01.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a9c9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4155ed0 con 0x7fb2a40b4c40 2022-01-10T01:33:01.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a2ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2a4067300 0x7fb2a40619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a37fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a4060100 0x7fb2a40b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a2ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2a4067300 0x7fb2a40619d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41244/0 (socket says 172.21.15.36:41244) 2022-01-10T01:33:01.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a2ffd700 1 -- 172.21.15.36:0/161203893 learned_addr learned my addr 172.21.15.36:0/161203893 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:01.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a3fff700 1 --2- 172.21.15.36:0/161203893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a40b4c40 0x7fb2a4156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a2ffd700 1 -- 172.21.15.36:0/161203893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a40b4c40 msgr2=0x7fb2a4156610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a2ffd700 1 --2- 172.21.15.36:0/161203893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a40b4c40 0x7fb2a4156610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a2ffd700 1 -- 172.21.15.36:0/161203893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a4060100 msgr2=0x7fb2a40b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a2ffd700 1 --2- 172.21.15.36:0/161203893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a4060100 0x7fb2a40b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a2ffd700 1 -- 172.21.15.36:0/161203893 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29800b180 con 0x7fb2a4067300 2022-01-10T01:33:01.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a37fe700 1 --2- 172.21.15.36:0/161203893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a4060100 0x7fb2a40b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:01.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a2ffd700 1 --2- 172.21.15.36:0/161203893 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2a4067300 0x7fb2a40619d0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7fb2a405f220 tx=0x7fb294001400).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:01.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a0ff9700 1 -- 172.21.15.36:0/161203893 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb29400f470 con 0x7fb2a4067300 2022-01-10T01:33:01.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.002+0000 7fb2a0ff9700 1 -- 172.21.15.36:0/161203893 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29400f5d0 con 0x7fb2a4067300 2022-01-10T01:33:01.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.006+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/161203893 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a4156170 con 0x7fb2a4067300 2022-01-10T01:33:01.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.006+0000 7fb2a0ff9700 1 -- 172.21.15.36:0/161203893 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb29400f930 con 0x7fb2a4067300 2022-01-10T01:33:01.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.006+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/161203893 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a40622e0 con 0x7fb2a4067300 2022-01-10T01:33:01.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.006+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/161203893 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a4156300 con 0x7fb2a4067300 2022-01-10T01:33:01.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.006+0000 7fb2a0ff9700 1 -- 172.21.15.36:0/161203893 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb294019030 con 0x7fb2a4067300 2022-01-10T01:33:01.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.006+0000 7fb2a0ff9700 1 --2- 172.21.15.36:0/161203893 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2840535f0 0x7fb284055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.006+0000 7fb2a0ff9700 1 -- 172.21.15.36:0/161203893 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fb29406b230 con 0x7fb2a4067300 2022-01-10T01:33:01.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.006+0000 7fb2a37fe700 1 --2- 172.21.15.36:0/161203893 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2840535f0 0x7fb284055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.010+0000 7fb2a37fe700 1 --2- 172.21.15.36:0/161203893 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2840535f0 0x7fb284055ab0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fb29801c000 tx=0x7fb298015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:01.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.014+0000 7fb2a0ff9700 1 -- 172.21.15.36:0/161203893 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb2940421f0 con 0x7fb2a4067300 2022-01-10T01:33:01.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.142+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/161203893 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb2a4057350 con 0x7fb2a4067300 2022-01-10T01:33:01.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.142+0000 7fb2a0ff9700 1 -- 172.21.15.36:0/161203893 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v131) v1 ==== 81+0+34218 (secure 0 0 0) 0x7fb294045810 con 0x7fb2a4067300 2022-01-10T01:33:01.150 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:01.152 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:33:01.152 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 131, 2022-01-10T01:33:01.152 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:33:01.153 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:33:01.153 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:33:00.703500+0000", 2022-01-10T01:33:01.154 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:33:01.154 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:33:01.155 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:33:01.155 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:33:01.156 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:33:01.156 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:33:01.157 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:33:01.157 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:33:01.157 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:33:01.158 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:01.158 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:33:01.159 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:33:01.159 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:33:01.160 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:33:01.160 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:33:01.160 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 24, 2022-01-10T01:33:01.161 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:33:01.161 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:33:01.162 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:33:01.162 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:33:01.163 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:33:01.163 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.164 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:33:01.164 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:33:01.165 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:33:01.165 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:01.165 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:01.166 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:01.166 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:01.167 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:01.167 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:01.168 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:01.168 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:01.169 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:33:01.169 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:33:01.170 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:33:01.170 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:33:01.170 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:33:01.171 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:01.171 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:01.171 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:01.172 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:01.172 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:01.172 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:01.172 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:01.173 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.173 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:33:01.173 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:01.173 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:01.174 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:01.174 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:01.174 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:01.174 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:01.174 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:01.175 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:01.175 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:01.175 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:01.175 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:01.176 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:01.176 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:01.176 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:01.176 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:01.176 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:01.177 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:01.177 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:01.177 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:01.177 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:01.177 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:01.178 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:01.178 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:01.178 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:01.178 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:01.179 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:01.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.179 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:01.179 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:01.179 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:01.180 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:01.180 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:01.180 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:01.180 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:01.181 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:01.181 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:01.181 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:01.181 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:01.181 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:33:01.182 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:33:01.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.182 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:01.182 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:33:01.182 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.183 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.183 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:33:01.183 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:33:01.184 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:33:01.184 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:01.184 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:01.184 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:01.184 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:01.185 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:01.185 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:01.185 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:01.185 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:01.185 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:33:01.186 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:33:01.186 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:33:01.186 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:33:01.186 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:33:01.187 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:01.187 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:01.187 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:01.187 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:01.187 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:01.188 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:01.188 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:01.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.188 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:33:01.189 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:01.189 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:01.189 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:01.189 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:01.189 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:01.190 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:01.190 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:01.190 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:01.190 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:01.191 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:01.191 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:01.191 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:01.191 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:01.192 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:01.192 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:01.192 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:01.192 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:01.192 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:01.193 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:01.193 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:01.193 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:01.193 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:01.194 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:01.194 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:01.194 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:01.194 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:01.194 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.195 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:01.195 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:01.195 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:01.195 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:01.196 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:01.196 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:01.196 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:01.196 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:01.196 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:01.197 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:01.197 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:01.197 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:33:01.197 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:01.197 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:33:01.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.198 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.198 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 22, 2022-01-10T01:33:01.199 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_data", 2022-01-10T01:33:01.199 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:32:28.099192+0000", 2022-01-10T01:33:01.199 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:01.199 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:01.199 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:01.200 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:01.200 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:01.200 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:01.200 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:01.200 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:01.201 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:33:01.201 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:33:01.201 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:33:01.201 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:33:01.202 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:33:01.202 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:01.202 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:01.202 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:01.202 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:01.203 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:01.203 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:01.203 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:01.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.204 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "131", 2022-01-10T01:33:01.204 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:01.204 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:01.204 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:01.204 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:01.205 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:01.205 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:01.205 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:01.205 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:01.205 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:01.206 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:01.206 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:01.206 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:01.206 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:01.207 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:01.207 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:01.207 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:01.207 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:01.207 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:01.208 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:01.208 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:01.208 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:01.208 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:01.208 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:01.209 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:01.209 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:01.209 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:01.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.209 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:01.210 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:01.210 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:01.210 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:01.210 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:01.211 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:01.211 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:01.211 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:01.211 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:01.211 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:01.212 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:01.212 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:33:01.212 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:01.212 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:33:01.213 INFO:teuthology.orchestra.run.smithi036.stdout: "data": "cephfs" 2022-01-10T01:33:01.213 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.213 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.213 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.214 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 24, 2022-01-10T01:33:01.214 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_metadata", 2022-01-10T01:33:01.214 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:32:59.723220+0000", 2022-01-10T01:33:01.214 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 32769, 2022-01-10T01:33:01.215 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool,creating", 2022-01-10T01:33:01.215 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:01.215 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:01.215 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:01.215 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:01.216 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:01.216 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:01.216 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:33:01.216 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:33:01.216 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:33:01.217 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:33:01.217 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:33:01.217 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:01.217 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:01.217 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:01.218 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:01.218 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:01.218 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:01.218 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:01.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.219 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "131", 2022-01-10T01:33:01.219 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:01.219 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:01.219 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:01.220 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:01.220 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:01.220 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:01.220 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:01.221 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:01.221 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:01.221 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:01.221 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:01.222 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:01.222 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:01.222 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:01.223 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:01.223 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:01.223 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:01.223 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:01.223 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:01.224 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:01.224 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:01.224 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:01.224 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:01.225 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:01.225 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:01.225 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:01.225 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.226 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:01.226 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:01.226 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:01.226 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:01.227 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:01.227 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:01.227 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:01.227 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:01.227 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:01.228 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:01.228 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:01.228 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:33:01.228 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_bias": 4, 2022-01-10T01:33:01.229 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 16, 2022-01-10T01:33:01.229 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_priority": 5 2022-01-10T01:33:01.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.229 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:01.229 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:33:01.230 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": "cephfs" 2022-01-10T01:33:01.230 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.230 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.230 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.231 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:01.231 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:33:01.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.231 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:33:01.231 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:33:01.232 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:01.232 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:01.232 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:01.232 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:01.233 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:01.233 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:01.233 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:01.233 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 107, 2022-01-10T01:33:01.233 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:01.234 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:01.234 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:01.234 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.234 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.235 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:33:01.235 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:01.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.235 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.236 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.236 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:33:01.236 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:01.236 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.236 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.237 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:01.237 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.237 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.237 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.238 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:33:01.238 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:01.238 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.239 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.239 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:33:01.239 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:01.239 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.239 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.240 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:01.240 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.240 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.240 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.241 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:33:01.241 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:01.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.241 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.242 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:33:01.242 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:01.242 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.242 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.243 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.243 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:01.243 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.243 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.243 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.244 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:33:01.244 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:01.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.244 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.244 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.245 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:33:01.245 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:01.246 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.246 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.247 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:33:01.247 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:33:01.248 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:33:01.248 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:33:01.248 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:01.248 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:01.249 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:01.249 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.250 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:33:01.250 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:33:01.250 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:01.250 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:01.251 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:01.251 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:01.251 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:01.252 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:01.252 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:01.252 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 130, 2022-01-10T01:33:01.253 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:01.253 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:01.254 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:01.254 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.255 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.255 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:33:01.256 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:01.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.257 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.258 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:33:01.258 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:01.259 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.259 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.260 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:01.260 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.261 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.262 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:33:01.262 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:01.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.263 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.264 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:33:01.264 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:01.265 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.265 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.266 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:01.266 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.267 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.267 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:33:01.268 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:01.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.269 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.269 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:33:01.269 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:01.269 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.270 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.270 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:01.270 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.271 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.271 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:33:01.271 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:01.271 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.272 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.272 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:33:01.272 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:01.272 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.273 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.273 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:33:01.273 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:33:01.274 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:33:01.274 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:33:01.274 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:01.274 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:01.274 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:01.275 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.275 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:33:01.275 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:33:01.276 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:01.276 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:01.276 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:01.276 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:01.277 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:01.277 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:01.277 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:01.277 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 125, 2022-01-10T01:33:01.277 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:01.278 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:01.278 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:01.278 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.279 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.279 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:33:01.279 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:01.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.280 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.280 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:33:01.280 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:01.280 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.280 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.281 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:01.281 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.281 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.282 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.282 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:33:01.282 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:01.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.283 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.283 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:33:01.283 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:01.283 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.283 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.284 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:01.284 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.285 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.285 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:33:01.285 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:01.285 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.285 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.286 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.286 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:33:01.286 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:01.286 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.287 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.287 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.287 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:01.287 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.288 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.288 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:33:01.288 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:01.288 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.288 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.289 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.289 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:33:01.289 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:01.289 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.290 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.290 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.290 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:33:01.290 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:33:01.290 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:33:01.291 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:33:01.291 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:01.291 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:01.291 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:01.292 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.292 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.292 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.292 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:33:01.292 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:33:01.293 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:01.293 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:01.293 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:01.293 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:01.293 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:01.294 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:01.294 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:01.294 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 130, 2022-01-10T01:33:01.294 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:01.295 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:01.295 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:01.295 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.295 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.296 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:33:01.296 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:01.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.296 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.296 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.297 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:33:01.297 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:01.297 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.297 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.297 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.298 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:01.298 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.298 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.299 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:33:01.299 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:01.299 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.299 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.299 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.300 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:33:01.300 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:01.300 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.300 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.301 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.301 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:01.301 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.301 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.302 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:33:01.302 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:01.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.303 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.303 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:33:01.303 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:01.303 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.303 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.304 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:01.304 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.304 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.305 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.305 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:33:01.305 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:01.305 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.305 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.306 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.306 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:33:01.306 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:01.306 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.306 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.307 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.307 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:33:01.307 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:33:01.307 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:33:01.308 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:33:01.308 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:01.308 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:01.308 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:01.308 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.309 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.309 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.309 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:33:01.309 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:33:01.309 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:01.310 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:01.310 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:01.310 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:01.310 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:01.311 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:01.311 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:01.311 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 130, 2022-01-10T01:33:01.311 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:01.311 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:01.312 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:01.312 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.312 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.312 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.312 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:33:01.313 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:01.313 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.313 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.314 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:33:01.314 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:01.314 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.314 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.315 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:01.315 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.315 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.315 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.316 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:33:01.316 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:01.316 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.316 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.317 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:33:01.317 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:01.317 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.317 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.318 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:01.318 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.318 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.319 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:33:01.319 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:01.319 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.319 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.320 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:33:01.320 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:01.320 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.320 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.321 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:01.321 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.321 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.322 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:33:01.322 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:01.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.322 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.322 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.323 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:33:01.323 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:01.323 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.323 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.324 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:33:01.324 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:33:01.324 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:33:01.324 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:33:01.325 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:01.325 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:01.325 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:01.325 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.325 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.326 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.326 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:33:01.326 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:33:01.326 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:01.327 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:01.327 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:01.327 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:01.327 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:01.327 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:01.328 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:01.328 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 130, 2022-01-10T01:33:01.328 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:01.328 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:01.328 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:01.329 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.329 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.329 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.329 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:33:01.329 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:01.330 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.330 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.330 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:33:01.331 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:01.331 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.331 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.331 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.332 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:01.332 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.332 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.332 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:33:01.333 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:01.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.333 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.334 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:33:01.334 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:01.334 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.334 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.335 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:01.335 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.335 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.335 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:33:01.336 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:01.336 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.336 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.337 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.337 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:33:01.337 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:01.337 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.337 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.338 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.338 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:01.338 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.338 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.339 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.339 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:33:01.339 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:01.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.340 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.340 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:33:01.340 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:01.340 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.341 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.341 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:33:01.341 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:33:01.341 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:33:01.342 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:33:01.342 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:01.342 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:01.342 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:01.342 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.343 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.343 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.343 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:33:01.343 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:33:01.344 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:01.344 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:01.344 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:01.344 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:01.344 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:01.345 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:01.345 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:01.345 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 125, 2022-01-10T01:33:01.345 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:01.345 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:01.346 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:01.346 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.346 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.346 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.347 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:33:01.347 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:01.347 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.347 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.347 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.348 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:33:01.348 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:01.348 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.348 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.349 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:01.349 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.349 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.349 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.350 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:33:01.350 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:01.350 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.350 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.350 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.351 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:33:01.351 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:01.351 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.351 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.352 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.352 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:01.352 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.352 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.352 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.353 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:33:01.353 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:01.353 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.353 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.353 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.354 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:33:01.354 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:01.354 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.354 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.355 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.355 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:01.355 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.355 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.355 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.356 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:33:01.356 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:01.356 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.356 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.357 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.357 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:33:01.357 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:01.357 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.357 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.358 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.358 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:33:01.358 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:33:01.358 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:33:01.358 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:33:01.359 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:01.359 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:01.366 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:01.366 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.366 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.366 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.366 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:33:01.367 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:33:01.367 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:01.367 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:01.367 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:01.368 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:01.368 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:01.368 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:01.368 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:01.368 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 130, 2022-01-10T01:33:01.369 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:01.369 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:01.369 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:01.369 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.370 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.370 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.370 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:33:01.370 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:01.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.371 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.371 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.371 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:33:01.371 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:01.371 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.372 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.372 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.372 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:01.372 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.373 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.373 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.373 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:33:01.373 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:01.373 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.374 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.374 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.374 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:33:01.374 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:01.375 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.375 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.375 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.375 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:01.375 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.376 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.376 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.376 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:33:01.376 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:01.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.377 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.377 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.377 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:33:01.377 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:01.378 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.378 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.378 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.378 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:01.378 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:01.379 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.379 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:01.379 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:33:01.379 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:01.380 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.380 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.380 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:01.380 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:33:01.380 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:01.381 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.381 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.381 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.381 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:33:01.382 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:33:01.382 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:33:01.382 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:33:01.382 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:01.382 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:01.383 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:01.383 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:01.383 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.383 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:01.383 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:33:01.384 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.384 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:33:01.384 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:01.384 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:01.385 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:01.385 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:01.385 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:01.385 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:33:01.385 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:01.386 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.386 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:33:01.386 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:01.387 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:01.387 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:01.387 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:01.387 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:01.387 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:33:01.388 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:01.388 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.388 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:33:01.389 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:01.389 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:01.389 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:01.389 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:01.389 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:01.390 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:33:01.390 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:01.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.390 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.390 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:33:01.391 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:01.391 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:01.391 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:01.391 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:01.392 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:01.392 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:33:01.392 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:01.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.393 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:33:01.393 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:01.393 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:01.393 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:01.393 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:01.394 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:01.394 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:33:01.394 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:01.394 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.395 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:33:01.395 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:01.395 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:01.395 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:01.396 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:01.396 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:01.396 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:33:01.396 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:01.397 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.397 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.397 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:33:01.397 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:01.397 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:01.398 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:01.398 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:01.398 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:01.398 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:33:01.399 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:01.399 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:01.399 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:33:01.399 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:01.400 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:01.400 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:01.400 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:01.400 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:01.400 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:33:01.401 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:01.401 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.401 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:01.401 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:33:01.402 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:33:01.402 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:33:01.402 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:33:01.402 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": { 2022-01-10T01:33:01.402 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.36:6835/1669955501": "2022-01-11T01:32:45.980043+0000", 2022-01-10T01:33:01.403 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.36:6834/1669955501": "2022-01-11T01:32:45.980043+0000" 2022-01-10T01:33:01.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.403 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:33:01.403 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:33:01.404 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:33:01.404 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:33:01.404 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:33:01.404 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:33:01.404 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:33:01.405 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:33:01.405 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:33:01.405 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:33:01.405 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:33:01.405 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:33:01.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.406 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:33:01.406 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:33:01.406 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:33:01.407 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:33:01.407 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:33:01.407 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:33:01.407 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:33:01.407 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:01.408 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:01.408 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:33:01.408 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:33:01.408 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:33:01.408 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:33:01.409 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:33:01.409 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:33:01.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.146+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/161203893 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2840535f0 msgr2=0x7fb284055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.146+0000 7fb2a9c9c700 1 --2- 172.21.15.36:0/161203893 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2840535f0 0x7fb284055ab0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fb29801c000 tx=0x7fb298015000).stop 2022-01-10T01:33:01.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.146+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/161203893 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2a4067300 msgr2=0x7fb2a40619d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.146+0000 7fb2a9c9c700 1 --2- 172.21.15.36:0/161203893 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2a4067300 0x7fb2a40619d0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7fb2a405f220 tx=0x7fb294001400).stop 2022-01-10T01:33:01.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.146+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/161203893 shutdown_connections 2022-01-10T01:33:01.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.146+0000 7fb2a9c9c700 1 --2- 172.21.15.36:0/161203893 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb2840535f0 0x7fb284055ab0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.146+0000 7fb2a9c9c700 1 --2- 172.21.15.36:0/161203893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a40b4c40 0x7fb2a4156610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.146+0000 7fb2a9c9c700 1 --2- 172.21.15.36:0/161203893 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb2a4067300 0x7fb2a40619d0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.146+0000 7fb2a9c9c700 1 --2- 172.21.15.36:0/161203893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a4060100 0x7fb2a40b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.146+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/161203893 >> 172.21.15.36:0/161203893 conn(0x7fb2a405cf30 msgr2=0x7fb2a41436c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:01.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.146+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/161203893 shutdown_connections 2022-01-10T01:33:01.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.146+0000 7fb2a9c9c700 1 -- 172.21.15.36:0/161203893 wait complete. 2022-01-10T01:33:01.415 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:01.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.522+0000 7f1ad9a6d700 1 Processor -- start 2022-01-10T01:33:01.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.522+0000 7f1ad9a6d700 1 -- start start 2022-01-10T01:33:01.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad9a6d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ad40b43c0 0x7f1ad40b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad9a6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad40b6960 0x7f1ad412ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad9a6d700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad41440b0 con 0x7f1ad40b6580 2022-01-10T01:33:01.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad9a6d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad4143b70 con 0x7f1ad40b43c0 2022-01-10T01:33:01.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad9a6d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad4143e10 con 0x7f1ad40b6960 2022-01-10T01:33:01.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad37fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f1ad40b6580 0x7f1ad4061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39044/0 (socket says 172.21.15.36:39044) 2022-01-10T01:33:01.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad37fe700 1 -- 172.21.15.36:0/911731857 learned_addr learned my addr 172.21.15.36:0/911731857 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:01.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad2ffd700 1 --2- 172.21.15.36:0/911731857 >> v2:172.21.15.59:3300/0 conn(0x7f1ad40b43c0 0x7f1ad40b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad3fff700 1 --2- 172.21.15.36:0/911731857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad40b6960 0x7f1ad412ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad27fc700 1 -- 172.21.15.36:0/911731857 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684634320 0 0) 0x7f1ad41440b0 con 0x7f1ad40b6580 2022-01-10T01:33:01.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad27fc700 1 -- 172.21.15.36:0/911731857 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab4003260 con 0x7f1ad40b6580 2022-01-10T01:33:01.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad2ffd700 1 -- 172.21.15.36:0/911731857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad40b6960 msgr2=0x7f1ad412ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:01.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad2ffd700 1 --2- 172.21.15.36:0/911731857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad40b6960 0x7f1ad412ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad2ffd700 1 -- 172.21.15.36:0/911731857 >> v1:172.21.15.36:6789/0 conn(0x7f1ad40b6580 legacy=0x7f1ad4061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad27fc700 1 -- 172.21.15.36:0/911731857 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2550509690 0 0) 0x7f1ab4003260 con 0x7f1ad40b6580 2022-01-10T01:33:01.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad2ffd700 1 -- 172.21.15.36:0/911731857 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad40615f0 con 0x7f1ad40b43c0 2022-01-10T01:33:01.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad3fff700 1 --2- 172.21.15.36:0/911731857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad40b6960 0x7f1ad412ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:01.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad2ffd700 1 --2- 172.21.15.36:0/911731857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad40b43c0 0x7f1ad40b5bf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f1ac4001800 tx=0x7f1abc006df0).ready entity=mon.1 client_cookie=24fce8c89c3a8cb2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:01.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad27fc700 1 -- 172.21.15.36:0/911731857 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac4001660 con 0x7f1ad40b43c0 2022-01-10T01:33:01.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad27fc700 1 -- 172.21.15.36:0/911731857 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc000e90 con 0x7f1ad40b43c0 2022-01-10T01:33:01.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad27fc700 1 -- 172.21.15.36:0/911731857 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1abc012460 con 0x7f1ad40b43c0 2022-01-10T01:33:01.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/911731857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad40b43c0 msgr2=0x7f1ad40b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad9a6d700 1 --2- 172.21.15.36:0/911731857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad40b43c0 0x7f1ad40b5bf0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f1ac4001800 tx=0x7f1abc006df0).stop 2022-01-10T01:33:01.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/911731857 shutdown_connections 2022-01-10T01:33:01.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad9a6d700 1 --2- 172.21.15.36:0/911731857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad40b6960 0x7f1ad412ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad9a6d700 1 --2- 172.21.15.36:0/911731857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad40b43c0 0x7f1ad40b5bf0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/911731857 >> 172.21.15.36:0/911731857 conn(0x7f1ad405c490 msgr2=0x7f1ad405c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:01.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/911731857 shutdown_connections 2022-01-10T01:33:01.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.526+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/911731857 wait complete. 2022-01-10T01:33:01.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad9a6d700 1 Processor -- start 2022-01-10T01:33:01.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad9a6d700 1 -- start start 2022-01-10T01:33:01.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad9a6d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ad40b43c0 0x7f1ad40af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad9a6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad40b6580 0x7f1ad41273c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad9a6d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad40b6960 0x7f1ad4152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad9a6d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40af500 con 0x7f1ad40b43c0 2022-01-10T01:33:01.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad9a6d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40b9d80 con 0x7f1ad40b6960 2022-01-10T01:33:01.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad9a6d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad40b9fb0 con 0x7f1ad40b6580 2022-01-10T01:33:01.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad37fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ad40b43c0 0x7f1ad40af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad37fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ad40b43c0 0x7f1ad40af670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41256/0 (socket says 172.21.15.36:41256) 2022-01-10T01:33:01.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad37fe700 1 -- 172.21.15.36:0/2116316042 learned_addr learned my addr 172.21.15.36:0/2116316042 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:01.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad2ffd700 1 --2- 172.21.15.36:0/2116316042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad40b6580 0x7f1ad41273c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad3fff700 1 --2- 172.21.15.36:0/2116316042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad40b6960 0x7f1ad4152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad37fe700 1 -- 172.21.15.36:0/2116316042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad40b6580 msgr2=0x7f1ad41273c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad37fe700 1 --2- 172.21.15.36:0/2116316042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad40b6580 0x7f1ad41273c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad37fe700 1 -- 172.21.15.36:0/2116316042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad40b6960 msgr2=0x7f1ad4152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad37fe700 1 --2- 172.21.15.36:0/2116316042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad40b6960 0x7f1ad4152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad37fe700 1 -- 172.21.15.36:0/2116316042 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc009470 con 0x7f1ad40b43c0 2022-01-10T01:33:01.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad37fe700 1 --2- 172.21.15.36:0/2116316042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ad40b43c0 0x7f1ad40af670 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f1ad4149350 tx=0x7f1ac4001230).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:01.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad0ff9700 1 -- 172.21.15.36:0/2116316042 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac400ce30 con 0x7f1ad40b43c0 2022-01-10T01:33:01.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad0ff9700 1 -- 172.21.15.36:0/2116316042 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac4007170 con 0x7f1ad40b43c0 2022-01-10T01:33:01.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/2116316042 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1abc00b180 con 0x7f1ad40b43c0 2022-01-10T01:33:01.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad0ff9700 1 -- 172.21.15.36:0/2116316042 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ac4004730 con 0x7f1ad40b43c0 2022-01-10T01:33:01.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.530+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/2116316042 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad40ba4f0 con 0x7f1ad40b43c0 2022-01-10T01:33:01.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.534+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/2116316042 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad4061890 con 0x7f1ad40b43c0 2022-01-10T01:33:01.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.534+0000 7f1ad0ff9700 1 -- 172.21.15.36:0/2116316042 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1ac4004890 con 0x7f1ad40b43c0 2022-01-10T01:33:01.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.534+0000 7f1ad0ff9700 1 --2- 172.21.15.36:0/2116316042 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ab8053680 0x7f1ab8055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.534+0000 7f1ad0ff9700 1 -- 172.21.15.36:0/2116316042 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f1ac406b580 con 0x7f1ad40b43c0 2022-01-10T01:33:01.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.534+0000 7f1ad2ffd700 1 --2- 172.21.15.36:0/2116316042 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ab8053680 0x7f1ab8055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.534+0000 7f1ad2ffd700 1 --2- 172.21.15.36:0/2116316042 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ab8053680 0x7f1ab8055b40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f1abc01a000 tx=0x7f1abc014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:01.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.542+0000 7f1ad0ff9700 1 -- 172.21.15.36:0/2116316042 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1ac40424e0 con 0x7f1ad40b43c0 2022-01-10T01:33:01.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.706+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/2116316042 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ad4057350 con 0x7f1ad40b43c0 2022-01-10T01:33:01.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.706+0000 7f1ad0ff9700 1 -- 172.21.15.36:0/2116316042 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f1ac4045b00 con 0x7f1ad40b43c0 2022-01-10T01:33:01.711 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:01.711 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":61,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:00.703847+0000","modified":"2022-01-10T01:33:00.703941+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2022-01-10T01:33:01.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.706+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/2116316042 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ab8053680 msgr2=0x7f1ab8055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.706+0000 7f1ad9a6d700 1 --2- 172.21.15.36:0/2116316042 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ab8053680 0x7f1ab8055b40 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f1abc01a000 tx=0x7f1abc014000).stop 2022-01-10T01:33:01.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.706+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/2116316042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ad40b43c0 msgr2=0x7f1ad40af670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.706+0000 7f1ad9a6d700 1 --2- 172.21.15.36:0/2116316042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ad40b43c0 0x7f1ad40af670 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7f1ad4149350 tx=0x7f1ac4001230).stop 2022-01-10T01:33:01.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.706+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/2116316042 shutdown_connections 2022-01-10T01:33:01.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.706+0000 7f1ad9a6d700 1 --2- 172.21.15.36:0/2116316042 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1ab8053680 0x7f1ab8055b40 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.706+0000 7f1ad9a6d700 1 --2- 172.21.15.36:0/2116316042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad40b6960 0x7f1ad4152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.706+0000 7f1ad9a6d700 1 --2- 172.21.15.36:0/2116316042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ad40b6580 0x7f1ad41273c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.706+0000 7f1ad9a6d700 1 --2- 172.21.15.36:0/2116316042 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ad40b43c0 0x7f1ad40af670 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.706+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/2116316042 >> 172.21.15.36:0/2116316042 conn(0x7f1ad405c490 msgr2=0x7f1ad4061f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:01.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.706+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/2116316042 shutdown_connections 2022-01-10T01:33:01.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.706+0000 7f1ad9a6d700 1 -- 172.21.15.36:0/2116316042 wait complete. 2022-01-10T01:33:01.716 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 61 2022-01-10T01:33:01.725 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2022-01-10T01:33:01.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2e53a0700 1 Processor -- start 2022-01-10T01:33:01.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2e53a0700 1 -- start start 2022-01-10T01:33:01.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2e53a0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff2e00b2580 0x7ff2e014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2e53a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e00b0010 0x7ff2e014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2e53a0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e00a70c0 con 0x7ff2e00afbd0 2022-01-10T01:33:01.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2e53a0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e00a72f0 con 0x7ff2e00b2580 2022-01-10T01:33:01.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2e53a0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00a7590 con 0x7ff2e00b0010 2022-01-10T01:33:01.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2dffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff2e00b2580 0x7ff2e014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2dffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff2e00b2580 0x7ff2e014ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41266/0 (socket says 172.21.15.36:41266) 2022-01-10T01:33:01.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2dffff700 1 -- 172.21.15.36:0/146967093 learned_addr learned my addr 172.21.15.36:0/146967093 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:01.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2df7fe700 1 --2- 172.21.15.36:0/146967093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e00b0010 0x7ff2e014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2dffff700 1 -- 172.21.15.36:0/146967093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e00b0010 msgr2=0x7ff2e014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:01.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2dffff700 1 --2- 172.21.15.36:0/146967093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e00b0010 0x7ff2e014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2dffff700 1 -- 172.21.15.36:0/146967093 >> v1:172.21.15.59:6789/0 conn(0x7ff2e00afbd0 legacy=0x7ff2e00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.818+0000 7ff2dffff700 1 -- 172.21.15.36:0/146967093 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e00a7830 con 0x7ff2e00b2580 2022-01-10T01:33:01.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.822+0000 7ff2dffff700 1 --2- 172.21.15.36:0/146967093 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e00b2580 0x7ff2e014ae40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7ff2d4002f70 tx=0x7ff2d4006eb0).ready entity=mon.0 client_cookie=fd2508139fda6795 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:01.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.822+0000 7ff2deffd700 1 -- 172.21.15.36:0/146967093 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2d400d5c0 con 0x7ff2e00b2580 2022-01-10T01:33:01.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.822+0000 7ff2deffd700 1 -- 172.21.15.36:0/146967093 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d4000e90 con 0x7ff2e00b2580 2022-01-10T01:33:01.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.822+0000 7ff2deffd700 1 -- 172.21.15.36:0/146967093 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2d400d950 con 0x7ff2e00b2580 2022-01-10T01:33:01.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.822+0000 7ff2e53a0700 1 -- 172.21.15.36:0/146967093 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e00b2580 msgr2=0x7ff2e014ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.822+0000 7ff2e53a0700 1 --2- 172.21.15.36:0/146967093 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e00b2580 0x7ff2e014ae40 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7ff2d4002f70 tx=0x7ff2d4006eb0).stop 2022-01-10T01:33:01.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.822+0000 7ff2e53a0700 1 -- 172.21.15.36:0/146967093 shutdown_connections 2022-01-10T01:33:01.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.822+0000 7ff2e53a0700 1 --2- 172.21.15.36:0/146967093 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e00b0010 0x7ff2e014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.822+0000 7ff2e53a0700 1 --2- 172.21.15.36:0/146967093 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e00b2580 0x7ff2e014ae40 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.822+0000 7ff2e53a0700 1 -- 172.21.15.36:0/146967093 >> 172.21.15.36:0/146967093 conn(0x7ff2e0060180 msgr2=0x7ff2e00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:01.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.822+0000 7ff2e53a0700 1 -- 172.21.15.36:0/146967093 shutdown_connections 2022-01-10T01:33:01.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.822+0000 7ff2e53a0700 1 -- 172.21.15.36:0/146967093 wait complete. 2022-01-10T01:33:01.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.822+0000 7ff2e53a0700 1 Processor -- start 2022-01-10T01:33:01.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.822+0000 7ff2e53a0700 1 -- start start 2022-01-10T01:33:01.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2e53a0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e00afbd0 0x7ff2e00b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2e53a0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e00b0010 0x7ff2e00aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2e53a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e00b2580 0x7ff2e00aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2e53a0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00a95a0 con 0x7ff2e00afbd0 2022-01-10T01:33:01.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2e53a0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00b3790 con 0x7ff2e00b0010 2022-01-10T01:33:01.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2e53a0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00b3f90 con 0x7ff2e00b2580 2022-01-10T01:33:01.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2dffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e00afbd0 0x7ff2e00b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2dffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e00afbd0 0x7ff2e00b55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41270/0 (socket says 172.21.15.36:41270) 2022-01-10T01:33:01.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2dffff700 1 -- 172.21.15.36:0/715546326 learned_addr learned my addr 172.21.15.36:0/715546326 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:01.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2df7fe700 1 --2- 172.21.15.36:0/715546326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e00b0010 0x7ff2e00aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2e4b9f700 1 --2- 172.21.15.36:0/715546326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e00b2580 0x7ff2e00aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2dffff700 1 -- 172.21.15.36:0/715546326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e00b2580 msgr2=0x7ff2e00aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2dffff700 1 --2- 172.21.15.36:0/715546326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e00b2580 0x7ff2e00aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2dffff700 1 -- 172.21.15.36:0/715546326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e00b0010 msgr2=0x7ff2e00aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:01.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2dffff700 1 --2- 172.21.15.36:0/715546326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e00b0010 0x7ff2e00aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:01.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2dffff700 1 -- 172.21.15.36:0/715546326 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d400b1e0 con 0x7ff2e00afbd0 2022-01-10T01:33:01.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2dffff700 1 --2- 172.21.15.36:0/715546326 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e00afbd0 0x7ff2e00b55c0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7ff2d4002f70 tx=0x7ff2d4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:01.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2dd7fa700 1 -- 172.21.15.36:0/715546326 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2d40117e0 con 0x7ff2e00afbd0 2022-01-10T01:33:01.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2dd7fa700 1 -- 172.21.15.36:0/715546326 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d4011940 con 0x7ff2e00afbd0 2022-01-10T01:33:01.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2e53a0700 1 -- 172.21.15.36:0/715546326 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e00b4230 con 0x7ff2e00afbd0 2022-01-10T01:33:01.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2dd7fa700 1 -- 172.21.15.36:0/715546326 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2d4011ca0 con 0x7ff2e00afbd0 2022-01-10T01:33:01.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2e53a0700 1 -- 172.21.15.36:0/715546326 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e00b32f0 con 0x7ff2e00afbd0 2022-01-10T01:33:01.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.826+0000 7ff2e53a0700 1 -- 172.21.15.36:0/715546326 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e00b3990 con 0x7ff2e00afbd0 2022-01-10T01:33:01.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.830+0000 7ff2dd7fa700 1 -- 172.21.15.36:0/715546326 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff2d4025030 con 0x7ff2e00afbd0 2022-01-10T01:33:01.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.830+0000 7ff2dd7fa700 1 --2- 172.21.15.36:0/715546326 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2c00535f0 0x7ff2c0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:01.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.830+0000 7ff2dd7fa700 1 -- 172.21.15.36:0/715546326 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6506+0+0 (secure 0 0 0) 0x7ff2d406cc70 con 0x7ff2e00afbd0 2022-01-10T01:33:01.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.830+0000 7ff2df7fe700 1 --2- 172.21.15.36:0/715546326 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2c00535f0 0x7ff2c0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:01.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.830+0000 7ff2df7fe700 1 --2- 172.21.15.36:0/715546326 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2c00535f0 0x7ff2c0055ab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7ff2d000d000 tx=0x7ff2d0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:01.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:01.834+0000 7ff2dd7fa700 1 -- 172.21.15.36:0/715546326 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff2d4043c30 con 0x7ff2e00afbd0 2022-01-10T01:33:02.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.002+0000 7ff2e53a0700 1 -- 172.21.15.36:0/715546326 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff2e00b43c0 con 0x7ff2e00afbd0 2022-01-10T01:33:02.058 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:33:02.061 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:33:02.064 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:33:02.066 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:33:02.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.722+0000 7ff2dd7fa700 1 -- 172.21.15.36:0/715546326 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff2d4023020 con 0x7ff2e00afbd0 2022-01-10T01:33:02.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.722+0000 7ff2e53a0700 1 -- 172.21.15.36:0/715546326 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2c00535f0 msgr2=0x7ff2c0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:02.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.722+0000 7ff2e53a0700 1 --2- 172.21.15.36:0/715546326 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2c00535f0 0x7ff2c0055ab0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7ff2d000d000 tx=0x7ff2d0008040).stop 2022-01-10T01:33:02.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.722+0000 7ff2e53a0700 1 -- 172.21.15.36:0/715546326 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e00afbd0 msgr2=0x7ff2e00b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:02.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.722+0000 7ff2e53a0700 1 --2- 172.21.15.36:0/715546326 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e00afbd0 0x7ff2e00b55c0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7ff2d4002f70 tx=0x7ff2d4015000).stop 2022-01-10T01:33:02.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.722+0000 7ff2e53a0700 1 -- 172.21.15.36:0/715546326 shutdown_connections 2022-01-10T01:33:02.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.722+0000 7ff2e53a0700 1 --2- 172.21.15.36:0/715546326 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff2c00535f0 0x7ff2c0055ab0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:02.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.722+0000 7ff2e53a0700 1 --2- 172.21.15.36:0/715546326 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2e00b2580 0x7ff2e00aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:02.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.722+0000 7ff2e53a0700 1 --2- 172.21.15.36:0/715546326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e00b0010 0x7ff2e00aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:02.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.722+0000 7ff2e53a0700 1 --2- 172.21.15.36:0/715546326 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff2e00afbd0 0x7ff2e00b55c0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:02.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.722+0000 7ff2e53a0700 1 -- 172.21.15.36:0/715546326 >> 172.21.15.36:0/715546326 conn(0x7ff2e0060180 msgr2=0x7ff2e0149c20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:02.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.722+0000 7ff2e53a0700 1 -- 172.21.15.36:0/715546326 shutdown_connections 2022-01-10T01:33:02.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.722+0000 7ff2e53a0700 1 -- 172.21.15.36:0/715546326 wait complete. 2022-01-10T01:33:02.733 INFO:teuthology.orchestra.run.smithi036.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2022-01-10T01:33:02.747 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:02.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.850+0000 7fd673fff700 1 Processor -- start 2022-01-10T01:33:02.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.850+0000 7fd673fff700 1 -- start start 2022-01-10T01:33:02.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd673fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd6740b27a0 0x7fd674147470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:02.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd673fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6740b1d10 0x7fd67414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:02.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd673fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6740b2b80 con 0x7fd67405c490 2022-01-10T01:33:02.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd673fff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6741451b0 con 0x7fd6740b27a0 2022-01-10T01:33:02.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd673fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67414aad0 con 0x7fd6740b1d10 2022-01-10T01:33:02.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd672ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd6740b27a0 0x7fd674147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:02.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd6727fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6740b1d10 0x7fd67414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:02.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd6737fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd67405c490 0x7fd6740a8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:56752/0 (socket says 172.21.15.36:56752) 2022-01-10T01:33:02.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd672ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd6740b27a0 0x7fd674147470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41280/0 (socket says 172.21.15.36:41280) 2022-01-10T01:33:02.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd6727fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6740b1d10 0x7fd67414b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:47560/0 (socket says 172.21.15.36:47560) 2022-01-10T01:33:02.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd6737fe700 1 -- 172.21.15.36:0/962310022 learned_addr learned my addr 172.21.15.36:0/962310022 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:02.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd671ffb700 1 -- 172.21.15.36:0/962310022 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665975191 0 0) 0x7fd6740b2b80 con 0x7fd67405c490 2022-01-10T01:33:02.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd6727fc700 1 -- 172.21.15.36:0/962310022 >> v2:172.21.15.36:3300/0 conn(0x7fd6740b27a0 msgr2=0x7fd674147470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:02.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd6727fc700 1 --2- 172.21.15.36:0/962310022 >> v2:172.21.15.36:3300/0 conn(0x7fd6740b27a0 0x7fd674147470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:02.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd6727fc700 1 -- 172.21.15.36:0/962310022 >> v1:172.21.15.59:6789/0 conn(0x7fd67405c490 legacy=0x7fd6740a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:02.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd6727fc700 1 -- 172.21.15.36:0/962310022 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6740b0ec0 con 0x7fd6740b1d10 2022-01-10T01:33:02.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd672ffd700 1 --2- 172.21.15.36:0/962310022 >> v2:172.21.15.36:3300/0 conn(0x7fd6740b27a0 0x7fd674147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:02.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd6727fc700 1 --2- 172.21.15.36:0/962310022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6740b1d10 0x7fd67414b1d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fd664002f70 tx=0x7fd664006df0).ready entity=mon.2 client_cookie=328952e8611fa7d8 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:02.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd671ffb700 1 -- 172.21.15.36:0/962310022 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd66400d570 con 0x7fd6740b1d10 2022-01-10T01:33:02.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd671ffb700 1 -- 172.21.15.36:0/962310022 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd664000e90 con 0x7fd6740b1d10 2022-01-10T01:33:02.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd671ffb700 1 -- 172.21.15.36:0/962310022 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd66400d8c0 con 0x7fd6740b1d10 2022-01-10T01:33:02.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd673fff700 1 -- 172.21.15.36:0/962310022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6740b1d10 msgr2=0x7fd67414b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:02.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd673fff700 1 --2- 172.21.15.36:0/962310022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6740b1d10 0x7fd67414b1d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fd664002f70 tx=0x7fd664006df0).stop 2022-01-10T01:33:02.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd673fff700 1 -- 172.21.15.36:0/962310022 shutdown_connections 2022-01-10T01:33:02.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd673fff700 1 --2- 172.21.15.36:0/962310022 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6740b1d10 0x7fd67414b1d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:02.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd673fff700 1 --2- 172.21.15.36:0/962310022 >> v2:172.21.15.36:3300/0 conn(0x7fd6740b27a0 0x7fd674147470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:02.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd673fff700 1 -- 172.21.15.36:0/962310022 >> 172.21.15.36:0/962310022 conn(0x7fd674061140 msgr2=0x7fd674062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:02.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd673fff700 1 -- 172.21.15.36:0/962310022 shutdown_connections 2022-01-10T01:33:02.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.854+0000 7fd673fff700 1 -- 172.21.15.36:0/962310022 wait complete. 2022-01-10T01:33:02.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd673fff700 1 Processor -- start 2022-01-10T01:33:02.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd673fff700 1 -- start start 2022-01-10T01:33:02.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd673fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd67405c490 0x7fd6740aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:02.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd673fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6740b1d10 0x7fd6740ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:02.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd673fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6740b27a0 0x7fd6741569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:02.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd673fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd674146fc0 con 0x7fd67405c490 2022-01-10T01:33:02.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd673fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67415a540 con 0x7fd6740b27a0 2022-01-10T01:33:02.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd673fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd674147220 con 0x7fd6740b1d10 2022-01-10T01:33:02.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd672ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd67405c490 0x7fd6740aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:02.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd672ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd67405c490 0x7fd6740aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41284/0 (socket says 172.21.15.36:41284) 2022-01-10T01:33:02.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd672ffd700 1 -- 172.21.15.36:0/3494624660 learned_addr learned my addr 172.21.15.36:0/3494624660 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:02.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd6727fc700 1 --2- 172.21.15.36:0/3494624660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6740b1d10 0x7fd6740ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:02.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd6737fe700 1 --2- 172.21.15.36:0/3494624660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6740b27a0 0x7fd6741569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:02.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd672ffd700 1 -- 172.21.15.36:0/3494624660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6740b1d10 msgr2=0x7fd6740ac220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:02.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd672ffd700 1 --2- 172.21.15.36:0/3494624660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6740b1d10 0x7fd6740ac220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:02.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd672ffd700 1 -- 172.21.15.36:0/3494624660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6740b27a0 msgr2=0x7fd6741569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:02.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd672ffd700 1 --2- 172.21.15.36:0/3494624660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6740b27a0 0x7fd6741569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:02.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd672ffd700 1 -- 172.21.15.36:0/3494624660 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c00b180 con 0x7fd67405c490 2022-01-10T01:33:02.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd672ffd700 1 --2- 172.21.15.36:0/3494624660 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd67405c490 0x7fd6740aed60 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7fd65c00c000 tx=0x7fd65c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:02.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd66bfff700 1 -- 172.21.15.36:0/3494624660 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd65c00c7e0 con 0x7fd67405c490 2022-01-10T01:33:02.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd66bfff700 1 -- 172.21.15.36:0/3494624660 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65c00c940 con 0x7fd67405c490 2022-01-10T01:33:02.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.858+0000 7fd673fff700 1 -- 172.21.15.36:0/3494624660 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66400b180 con 0x7fd67405c490 2022-01-10T01:33:02.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.862+0000 7fd66bfff700 1 -- 172.21.15.36:0/3494624660 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd65c00cca0 con 0x7fd67405c490 2022-01-10T01:33:02.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.862+0000 7fd673fff700 1 -- 172.21.15.36:0/3494624660 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6741469d0 con 0x7fd67405c490 2022-01-10T01:33:02.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.862+0000 7fd673fff700 1 -- 172.21.15.36:0/3494624660 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67415a380 con 0x7fd67405c490 2022-01-10T01:33:02.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.862+0000 7fd66bfff700 1 -- 172.21.15.36:0/3494624660 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd65c01c460 con 0x7fd67405c490 2022-01-10T01:33:02.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.862+0000 7fd66bfff700 1 --2- 172.21.15.36:0/3494624660 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd658053560 0x7fd658055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:02.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.862+0000 7fd66bfff700 1 -- 172.21.15.36:0/3494624660 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6506+0+0 (secure 0 0 0) 0x7fd65c06c040 con 0x7fd67405c490 2022-01-10T01:33:02.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.862+0000 7fd6727fc700 1 --2- 172.21.15.36:0/3494624660 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd658053560 0x7fd658055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:02.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.862+0000 7fd6727fc700 1 --2- 172.21.15.36:0/3494624660 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd658053560 0x7fd658055a20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fd66401a000 tx=0x7fd664014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:02.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:02.870+0000 7fd66bfff700 1 -- 172.21.15.36:0/3494624660 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd65c042fa0 con 0x7fd67405c490 2022-01-10T01:33:03.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.034+0000 7fd673fff700 1 -- 172.21.15.36:0/3494624660 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6741473e0 con 0x7fd67405c490 2022-01-10T01:33:03.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.034+0000 7fd66bfff700 1 -- 172.21.15.36:0/3494624660 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+1426 (secure 0 0 0) 0x7fd65c00ce00 con 0x7fd67405c490 2022-01-10T01:33:03.039 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:03.039 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":62,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":62,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:00.703847+0000","modified":"2022-01-10T01:33:02.710532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2022-01-10T01:33:03.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.034+0000 7fd673fff700 1 -- 172.21.15.36:0/3494624660 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd658053560 msgr2=0x7fd658055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:03.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.034+0000 7fd673fff700 1 --2- 172.21.15.36:0/3494624660 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd658053560 0x7fd658055a20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fd66401a000 tx=0x7fd664014000).stop 2022-01-10T01:33:03.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.034+0000 7fd673fff700 1 -- 172.21.15.36:0/3494624660 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd67405c490 msgr2=0x7fd6740aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:03.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.034+0000 7fd673fff700 1 --2- 172.21.15.36:0/3494624660 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd67405c490 0x7fd6740aed60 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7fd65c00c000 tx=0x7fd65c006df0).stop 2022-01-10T01:33:03.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.034+0000 7fd673fff700 1 -- 172.21.15.36:0/3494624660 shutdown_connections 2022-01-10T01:33:03.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.034+0000 7fd673fff700 1 --2- 172.21.15.36:0/3494624660 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd658053560 0x7fd658055a20 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.034+0000 7fd673fff700 1 --2- 172.21.15.36:0/3494624660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6740b27a0 0x7fd6741569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.034+0000 7fd673fff700 1 --2- 172.21.15.36:0/3494624660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6740b1d10 0x7fd6740ac220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.034+0000 7fd673fff700 1 --2- 172.21.15.36:0/3494624660 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd67405c490 0x7fd6740aed60 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.034+0000 7fd673fff700 1 -- 172.21.15.36:0/3494624660 >> 172.21.15.36:0/3494624660 conn(0x7fd674061140 msgr2=0x7fd6741485e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:03.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.034+0000 7fd673fff700 1 -- 172.21.15.36:0/3494624660 shutdown_connections 2022-01-10T01:33:03.044 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.034+0000 7fd673fff700 1 -- 172.21.15.36:0/3494624660 wait complete. 2022-01-10T01:33:03.045 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 62 2022-01-10T01:33:03.053 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:33:03.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.150+0000 7f84e759e700 1 Processor -- start 2022-01-10T01:33:03.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.150+0000 7f84e759e700 1 -- start start 2022-01-10T01:33:03.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.150+0000 7f84e759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8064980 0x7f84e8144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:03.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.150+0000 7f84e759e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f84e8067110 0x7f84e8141130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:03.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.150+0000 7f84e759e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e8066500 con 0x7f84e80b3550 2022-01-10T01:33:03.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.150+0000 7f84e759e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e80b3ea0 con 0x7f84e8067110 2022-01-10T01:33:03.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.150+0000 7f84e759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8140d40 con 0x7f84e8064980 2022-01-10T01:33:03.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e6d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f84e8067110 0x7f84e8141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:03.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e6d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f84e8067110 0x7f84e8141130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41296/0 (socket says 172.21.15.36:41296) 2022-01-10T01:33:03.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e6d9d700 1 -- 172.21.15.36:0/941645684 learned_addr learned my addr 172.21.15.36:0/941645684 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:03.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e659c700 1 --2- 172.21.15.36:0/941645684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8064980 0x7f84e8144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:03.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e6d9d700 1 -- 172.21.15.36:0/941645684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8064980 msgr2=0x7f84e8144ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:03.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e6d9d700 1 --2- 172.21.15.36:0/941645684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8064980 0x7f84e8144ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e6d9d700 1 -- 172.21.15.36:0/941645684 >> v1:172.21.15.59:6789/0 conn(0x7f84e80b3550 legacy=0x7f84e8066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:03.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e6d9d700 1 -- 172.21.15.36:0/941645684 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e80b46c0 con 0x7f84e8067110 2022-01-10T01:33:03.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e6d9d700 1 --2- 172.21.15.36:0/941645684 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84e8067110 0x7f84e8141130 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f84e0002f70 tx=0x7f84e0006eb0).ready entity=mon.0 client_cookie=701d57436c247f42 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:03.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e559a700 1 -- 172.21.15.36:0/941645684 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84e000d570 con 0x7f84e8067110 2022-01-10T01:33:03.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e559a700 1 -- 172.21.15.36:0/941645684 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e0000e90 con 0x7f84e8067110 2022-01-10T01:33:03.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e559a700 1 -- 172.21.15.36:0/941645684 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84e000d900 con 0x7f84e8067110 2022-01-10T01:33:03.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e759e700 1 -- 172.21.15.36:0/941645684 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84e8067110 msgr2=0x7f84e8141130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:03.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e759e700 1 --2- 172.21.15.36:0/941645684 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84e8067110 0x7f84e8141130 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f84e0002f70 tx=0x7f84e0006eb0).stop 2022-01-10T01:33:03.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e759e700 1 -- 172.21.15.36:0/941645684 shutdown_connections 2022-01-10T01:33:03.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e759e700 1 --2- 172.21.15.36:0/941645684 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84e8067110 0x7f84e8141130 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e759e700 1 --2- 172.21.15.36:0/941645684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8064980 0x7f84e8144ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e759e700 1 -- 172.21.15.36:0/941645684 >> 172.21.15.36:0/941645684 conn(0x7f84e805f6b0 msgr2=0x7f84e805fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:03.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e759e700 1 -- 172.21.15.36:0/941645684 shutdown_connections 2022-01-10T01:33:03.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e759e700 1 -- 172.21.15.36:0/941645684 wait complete. 2022-01-10T01:33:03.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e759e700 1 Processor -- start 2022-01-10T01:33:03.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.154+0000 7f84e759e700 1 -- start start 2022-01-10T01:33:03.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8064980 0x7f84e80b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:03.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84e8067110 0x7f84e8153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:03.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84e80b3550 0x7f84e8150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:03.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8153d00 con 0x7f84e80b3550 2022-01-10T01:33:03.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8153fa0 con 0x7f84e8067110 2022-01-10T01:33:03.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e8154240 con 0x7f84e8064980 2022-01-10T01:33:03.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e6d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84e80b3550 0x7f84e8150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:03.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e6d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84e80b3550 0x7f84e8150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41300/0 (socket says 172.21.15.36:41300) 2022-01-10T01:33:03.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e6d9d700 1 -- 172.21.15.36:0/3779138273 learned_addr learned my addr 172.21.15.36:0/3779138273 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:03.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e659c700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8064980 0x7f84e80b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:03.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e6d9d700 1 -- 172.21.15.36:0/3779138273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8064980 msgr2=0x7f84e80b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:03.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e6d9d700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8064980 0x7f84e80b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e6d9d700 1 -- 172.21.15.36:0/3779138273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84e8067110 msgr2=0x7f84e8153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:03.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e5d9b700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84e8067110 0x7f84e8153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:03.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e6d9d700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84e8067110 0x7f84e8153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e6d9d700 1 -- 172.21.15.36:0/3779138273 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e000b1e0 con 0x7f84e80b3550 2022-01-10T01:33:03.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e659c700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8064980 0x7f84e80b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:33:03.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e5d9b700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84e8067110 0x7f84e8153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:33:03.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e6d9d700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84e80b3550 0x7f84e8150360 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f84e0002f70 tx=0x7f84e0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:03.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84d77fe700 1 -- 172.21.15.36:0/3779138273 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84e000d8f0 con 0x7f84e80b3550 2022-01-10T01:33:03.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84d77fe700 1 -- 172.21.15.36:0/3779138273 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e0011ce0 con 0x7f84e80b3550 2022-01-10T01:33:03.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e759e700 1 -- 172.21.15.36:0/3779138273 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e81544e0 con 0x7f84e80b3550 2022-01-10T01:33:03.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84d77fe700 1 -- 172.21.15.36:0/3779138273 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84e001e650 con 0x7f84e80b3550 2022-01-10T01:33:03.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e759e700 1 -- 172.21.15.36:0/3779138273 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e80ae1c0 con 0x7f84e80b3550 2022-01-10T01:33:03.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.158+0000 7f84e759e700 1 -- 172.21.15.36:0/3779138273 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e8150100 con 0x7f84e80b3550 2022-01-10T01:33:03.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.162+0000 7f84d77fe700 1 -- 172.21.15.36:0/3779138273 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f84e0025030 con 0x7f84e80b3550 2022-01-10T01:33:03.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.162+0000 7f84d77fe700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f84c4053560 0x7f84c4055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:03.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.162+0000 7f84d77fe700 1 -- 172.21.15.36:0/3779138273 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f84e006d0d0 con 0x7f84e80b3550 2022-01-10T01:33:03.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.162+0000 7f84e659c700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f84c4053560 0x7f84c4055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:03.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.162+0000 7f84e659c700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f84c4053560 0x7f84c4055a20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f84dc00b000 tx=0x7f84dc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:03.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.162+0000 7f84d77fe700 1 -- 172.21.15.36:0/3779138273 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f84e0044090 con 0x7f84e80b3550 2022-01-10T01:33:03.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.326+0000 7f84e759e700 1 -- 172.21.15.36:0/3779138273 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f84e8057350 con 0x7f84e80b3550 2022-01-10T01:33:03.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.730+0000 7f84d77fe700 1 -- 172.21.15.36:0/3779138273 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7f84e0023020 con 0x7f84e80b3550 2022-01-10T01:33:03.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.734+0000 7f84e759e700 1 -- 172.21.15.36:0/3779138273 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f84c4053560 msgr2=0x7f84c4055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:03.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.734+0000 7f84e759e700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f84c4053560 0x7f84c4055a20 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f84dc00b000 tx=0x7f84dc008040).stop 2022-01-10T01:33:03.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.734+0000 7f84e759e700 1 -- 172.21.15.36:0/3779138273 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84e80b3550 msgr2=0x7f84e8150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:03.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.734+0000 7f84e759e700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84e80b3550 0x7f84e8150360 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f84e0002f70 tx=0x7f84e0015000).stop 2022-01-10T01:33:03.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.734+0000 7f84e759e700 1 -- 172.21.15.36:0/3779138273 shutdown_connections 2022-01-10T01:33:03.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.734+0000 7f84e759e700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f84c4053560 0x7f84c4055a20 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.734+0000 7f84e759e700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f84e80b3550 0x7f84e8150360 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.734+0000 7f84e759e700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84e8067110 0x7f84e8153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.734+0000 7f84e759e700 1 --2- 172.21.15.36:0/3779138273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8064980 0x7f84e80b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.734+0000 7f84e759e700 1 -- 172.21.15.36:0/3779138273 >> 172.21.15.36:0/3779138273 conn(0x7f84e805f6b0 msgr2=0x7f84e8144040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:03.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.734+0000 7f84e759e700 1 -- 172.21.15.36:0/3779138273 shutdown_connections 2022-01-10T01:33:03.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.734+0000 7f84e759e700 1 -- 172.21.15.36:0/3779138273 wait complete. 2022-01-10T01:33:03.755 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:33:03.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.866+0000 7faa264e0700 1 Processor -- start 2022-01-10T01:33:03.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.866+0000 7faa264e0700 1 -- start start 2022-01-10T01:33:03.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.866+0000 7faa264e0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faa200aa120 0x7faa200ae440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:03.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.866+0000 7faa264e0700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa200b2af0 con 0x7faa200b04a0 2022-01-10T01:33:03.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.866+0000 7faa264e0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa200b2770 con 0x7faa200b0880 2022-01-10T01:33:03.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.866+0000 7faa264e0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa200b2d20 con 0x7faa200aa120 2022-01-10T01:33:03.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa1f7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faa200aa120 0x7faa200ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:03.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa1ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7faa200b04a0 0x7faa200add30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39102/0 (socket says 172.21.15.36:39102) 2022-01-10T01:33:03.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa1ffff700 1 -- 172.21.15.36:0/4035545971 learned_addr learned my addr 172.21.15.36:0/4035545971 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:03.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa1f7fe700 1 -- 172.21.15.36:0/4035545971 >> v1:172.21.15.59:6789/0 conn(0x7faa200b0880 legacy=0x7faa201405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:03.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa1f7fe700 1 -- 172.21.15.36:0/4035545971 >> v1:172.21.15.36:6789/0 conn(0x7faa200b04a0 legacy=0x7faa200add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:03.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa1effd700 1 -- 172.21.15.36:0/4035545971 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556308425 0 0) 0x7faa200b2770 con 0x7faa200b0880 2022-01-10T01:33:03.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa1f7fe700 1 -- 172.21.15.36:0/4035545971 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa200a9b70 con 0x7faa200aa120 2022-01-10T01:33:03.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa1f7fe700 1 --2- 172.21.15.36:0/4035545971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa200aa120 0x7faa200ae440 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7faa14001110 tx=0x7faa10006df0).ready entity=mon.0 client_cookie=aa73eb2d16dcbe0a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:03.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa1effd700 1 -- 172.21.15.36:0/4035545971 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa1000d5c0 con 0x7faa200aa120 2022-01-10T01:33:03.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa1effd700 1 -- 172.21.15.36:0/4035545971 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa10000e90 con 0x7faa200aa120 2022-01-10T01:33:03.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa1effd700 1 -- 172.21.15.36:0/4035545971 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa1000d910 con 0x7faa200aa120 2022-01-10T01:33:03.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa264e0700 1 -- 172.21.15.36:0/4035545971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa200aa120 msgr2=0x7faa200ae440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:03.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa264e0700 1 --2- 172.21.15.36:0/4035545971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa200aa120 0x7faa200ae440 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7faa14001110 tx=0x7faa10006df0).stop 2022-01-10T01:33:03.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa264e0700 1 -- 172.21.15.36:0/4035545971 shutdown_connections 2022-01-10T01:33:03.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa264e0700 1 --2- 172.21.15.36:0/4035545971 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa200aa120 0x7faa200ae440 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa264e0700 1 -- 172.21.15.36:0/4035545971 >> 172.21.15.36:0/4035545971 conn(0x7faa200607c0 msgr2=0x7faa20060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:03.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa264e0700 1 -- 172.21.15.36:0/4035545971 shutdown_connections 2022-01-10T01:33:03.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa264e0700 1 -- 172.21.15.36:0/4035545971 wait complete. 2022-01-10T01:33:03.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa264e0700 1 Processor -- start 2022-01-10T01:33:03.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.870+0000 7faa264e0700 1 -- start start 2022-01-10T01:33:03.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa264e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa200aa120 0x7faa20141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:03.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa264e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa200b04a0 0x7faa20063c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:03.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa264e0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa200b0880 0x7faa201444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:03.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa264e0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa201536d0 con 0x7faa200b0880 2022-01-10T01:33:03.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa264e0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa20064680 con 0x7faa200b04a0 2022-01-10T01:33:03.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa264e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa200643e0 con 0x7faa200aa120 2022-01-10T01:33:03.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa24a7d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa200b0880 0x7faa201444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:03.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa1f7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa200b04a0 0x7faa20063c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:03.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa24a7d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa200b0880 0x7faa201444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41316/0 (socket says 172.21.15.36:41316) 2022-01-10T01:33:03.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa1ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa200aa120 0x7faa20141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:03.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa24a7d700 1 -- 172.21.15.36:0/1200530030 learned_addr learned my addr 172.21.15.36:0/1200530030 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:03.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa24a7d700 1 -- 172.21.15.36:0/1200530030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa200aa120 msgr2=0x7faa20141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:03.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa24a7d700 1 --2- 172.21.15.36:0/1200530030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa200aa120 0x7faa20141530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa24a7d700 1 -- 172.21.15.36:0/1200530030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa200b04a0 msgr2=0x7faa20063c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:03.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa24a7d700 1 --2- 172.21.15.36:0/1200530030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa200b04a0 0x7faa20063c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:03.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa24a7d700 1 -- 172.21.15.36:0/1200530030 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1000b180 con 0x7faa200b0880 2022-01-10T01:33:03.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa1ffff700 1 --2- 172.21.15.36:0/1200530030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa200aa120 0x7faa20141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:03.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa24a7d700 1 --2- 172.21.15.36:0/1200530030 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa200b0880 0x7faa201444a0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7faa20153810 tx=0x7faa18007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:03.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa1d7fa700 1 -- 172.21.15.36:0/1200530030 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa1800ce80 con 0x7faa200b0880 2022-01-10T01:33:03.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa264e0700 1 -- 172.21.15.36:0/1200530030 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa20153230 con 0x7faa200b0880 2022-01-10T01:33:03.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa1d7fa700 1 -- 172.21.15.36:0/1200530030 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa18006aa0 con 0x7faa200b0880 2022-01-10T01:33:03.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa1d7fa700 1 -- 172.21.15.36:0/1200530030 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa18006e00 con 0x7faa200b0880 2022-01-10T01:33:03.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa264e0700 1 -- 172.21.15.36:0/1200530030 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa20144990 con 0x7faa200b0880 2022-01-10T01:33:03.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.874+0000 7faa264e0700 1 -- 172.21.15.36:0/1200530030 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa20153410 con 0x7faa200b0880 2022-01-10T01:33:03.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.878+0000 7faa1d7fa700 1 -- 172.21.15.36:0/1200530030 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7faa18010030 con 0x7faa200b0880 2022-01-10T01:33:03.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.878+0000 7faa1d7fa700 1 --2- 172.21.15.36:0/1200530030 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faa00053680 0x7faa00055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:03.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.878+0000 7faa1d7fa700 1 -- 172.21.15.36:0/1200530030 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6506+0+0 (secure 0 0 0) 0x7faa1806ba40 con 0x7faa200b0880 2022-01-10T01:33:03.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.878+0000 7faa1ffff700 1 --2- 172.21.15.36:0/1200530030 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faa00053680 0x7faa00055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:03.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.878+0000 7faa1ffff700 1 --2- 172.21.15.36:0/1200530030 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faa00053680 0x7faa00055b40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7faa1400d000 tx=0x7faa14009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:03.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:03.882+0000 7faa1d7fa700 1 -- 172.21.15.36:0/1200530030 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faa20153410 con 0x7faa200b0880 2022-01-10T01:33:04.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.010+0000 7faa264e0700 1 -- 172.21.15.36:0/1200530030 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faa201533c0 con 0x7faa200b0880 2022-01-10T01:33:04.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.742+0000 7faa1d7fa700 1 -- 172.21.15.36:0/1200530030 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v133) v1 ==== 185+0+0 (secure 0 0 0) 0x7faa18042870 con 0x7faa200b0880 2022-01-10T01:33:04.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.746+0000 7faa264e0700 1 -- 172.21.15.36:0/1200530030 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faa00053680 msgr2=0x7faa00055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:04.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.746+0000 7faa264e0700 1 --2- 172.21.15.36:0/1200530030 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faa00053680 0x7faa00055b40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7faa1400d000 tx=0x7faa14009040).stop 2022-01-10T01:33:04.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.746+0000 7faa264e0700 1 -- 172.21.15.36:0/1200530030 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa200b0880 msgr2=0x7faa201444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:04.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.746+0000 7faa264e0700 1 --2- 172.21.15.36:0/1200530030 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa200b0880 0x7faa201444a0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7faa20153810 tx=0x7faa18007f30).stop 2022-01-10T01:33:04.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.746+0000 7faa264e0700 1 -- 172.21.15.36:0/1200530030 shutdown_connections 2022-01-10T01:33:04.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.746+0000 7faa264e0700 1 --2- 172.21.15.36:0/1200530030 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faa00053680 0x7faa00055b40 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:04.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.746+0000 7faa264e0700 1 --2- 172.21.15.36:0/1200530030 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa200b0880 0x7faa201444a0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:04.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.746+0000 7faa264e0700 1 --2- 172.21.15.36:0/1200530030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa200b04a0 0x7faa20063c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:04.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.746+0000 7faa264e0700 1 --2- 172.21.15.36:0/1200530030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa200aa120 0x7faa20141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:04.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.746+0000 7faa264e0700 1 -- 172.21.15.36:0/1200530030 >> 172.21.15.36:0/1200530030 conn(0x7faa200607c0 msgr2=0x7faa200b4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:04.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.746+0000 7faa264e0700 1 -- 172.21.15.36:0/1200530030 shutdown_connections 2022-01-10T01:33:04.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.746+0000 7faa264e0700 1 -- 172.21.15.36:0/1200530030 wait complete. 2022-01-10T01:33:04.755 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:33:04.768 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2022-01-10T01:33:04.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.874+0000 7fb805ae0700 1 Processor -- start 2022-01-10T01:33:04.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.874+0000 7fb805ae0700 1 -- start start 2022-01-10T01:33:04.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb805ae0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb8000ad5c0 0x7fb800061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:04.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb805ae0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb800140440 0x7fb8001408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:04.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb805ae0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8000aecf0 con 0x7fb800061320 2022-01-10T01:33:04.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb805ae0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8000b6f20 con 0x7fb8000ad5c0 2022-01-10T01:33:04.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb805ae0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8000aef20 con 0x7fb800140440 2022-01-10T01:33:04.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb7fffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb8000ad5c0 0x7fb800061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:04.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb7fffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb8000ad5c0 0x7fb800061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41322/0 (socket says 172.21.15.36:41322) 2022-01-10T01:33:04.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb7fffff700 1 -- 172.21.15.36:0/3479796172 learned_addr learned my addr 172.21.15.36:0/3479796172 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:04.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb8052df700 1 --2- 172.21.15.36:0/3479796172 >> v2:172.21.15.59:3300/0 conn(0x7fb800140440 0x7fb8001408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:04.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb7fffff700 1 -- 172.21.15.36:0/3479796172 >> v2:172.21.15.59:3300/0 conn(0x7fb800140440 msgr2=0x7fb8001408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:04.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb7fffff700 1 --2- 172.21.15.36:0/3479796172 >> v2:172.21.15.59:3300/0 conn(0x7fb800140440 0x7fb8001408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:04.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb7fffff700 1 -- 172.21.15.36:0/3479796172 >> v1:172.21.15.59:6789/0 conn(0x7fb800061320 legacy=0x7fb8000b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:04.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb7fffff700 1 -- 172.21.15.36:0/3479796172 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8000af1c0 con 0x7fb8000ad5c0 2022-01-10T01:33:04.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb7fffff700 1 --2- 172.21.15.36:0/3479796172 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb8000ad5c0 0x7fb800061700 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fb7f4002f70 tx=0x7fb7f4006eb0).ready entity=mon.0 client_cookie=4066083d53b6e149 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:04.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb7ff7fe700 1 -- 172.21.15.36:0/3479796172 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7f400d5c0 con 0x7fb8000ad5c0 2022-01-10T01:33:04.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb7ff7fe700 1 -- 172.21.15.36:0/3479796172 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f4000e90 con 0x7fb8000ad5c0 2022-01-10T01:33:04.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb7ff7fe700 1 -- 172.21.15.36:0/3479796172 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7f400d950 con 0x7fb8000ad5c0 2022-01-10T01:33:04.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb805ae0700 1 -- 172.21.15.36:0/3479796172 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb8000ad5c0 msgr2=0x7fb800061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:04.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb805ae0700 1 --2- 172.21.15.36:0/3479796172 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb8000ad5c0 0x7fb800061700 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7fb7f4002f70 tx=0x7fb7f4006eb0).stop 2022-01-10T01:33:04.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb805ae0700 1 -- 172.21.15.36:0/3479796172 shutdown_connections 2022-01-10T01:33:04.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb805ae0700 1 --2- 172.21.15.36:0/3479796172 >> v2:172.21.15.59:3300/0 conn(0x7fb800140440 0x7fb8001408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:04.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb805ae0700 1 --2- 172.21.15.36:0/3479796172 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb8000ad5c0 0x7fb800061700 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:04.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb805ae0700 1 -- 172.21.15.36:0/3479796172 >> 172.21.15.36:0/3479796172 conn(0x7fb800066de0 msgr2=0x7fb8000671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:04.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb805ae0700 1 -- 172.21.15.36:0/3479796172 shutdown_connections 2022-01-10T01:33:04.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.878+0000 7fb805ae0700 1 -- 172.21.15.36:0/3479796172 wait complete. 2022-01-10T01:33:04.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb805ae0700 1 Processor -- start 2022-01-10T01:33:04.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb805ae0700 1 -- start start 2022-01-10T01:33:04.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb805ae0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb800061320 0x7fb8001432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:04.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb805ae0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb8000ad5c0 0x7fb8000ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:04.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb805ae0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb800140440 0x7fb8000ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:04.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb805ae0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000ac770 con 0x7fb8000ad5c0 2022-01-10T01:33:04.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb805ae0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000acc60 con 0x7fb800061320 2022-01-10T01:33:04.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb805ae0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000afab0 con 0x7fb800140440 2022-01-10T01:33:04.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb804ade700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb800061320 0x7fb8001432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:04.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb7fffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb8000ad5c0 0x7fb8000ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:04.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb804ade700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb800061320 0x7fb8001432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:37960/0 (socket says 172.21.15.36:37960) 2022-01-10T01:33:04.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb804ade700 1 -- 172.21.15.36:0/2970020207 learned_addr learned my addr 172.21.15.36:0/2970020207 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:04.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb8052df700 1 --2- 172.21.15.36:0/2970020207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb800140440 0x7fb8000ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:04.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb7fffff700 1 -- 172.21.15.36:0/2970020207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb800140440 msgr2=0x7fb8000ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:04.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb7fffff700 1 --2- 172.21.15.36:0/2970020207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb800140440 0x7fb8000ab9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:04.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb7fffff700 1 -- 172.21.15.36:0/2970020207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb800061320 msgr2=0x7fb8001432c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:04.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb7fffff700 1 --2- 172.21.15.36:0/2970020207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb800061320 0x7fb8001432c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:04.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb7fffff700 1 -- 172.21.15.36:0/2970020207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f400b1e0 con 0x7fb8000ad5c0 2022-01-10T01:33:04.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb7fffff700 1 --2- 172.21.15.36:0/2970020207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb8000ad5c0 0x7fb8000ab4b0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fb7f4002f70 tx=0x7fb7f4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:04.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb7fdffb700 1 -- 172.21.15.36:0/2970020207 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7f4011760 con 0x7fb8000ad5c0 2022-01-10T01:33:04.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb7fdffb700 1 -- 172.21.15.36:0/2970020207 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f40118c0 con 0x7fb8000ad5c0 2022-01-10T01:33:04.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb805ae0700 1 -- 172.21.15.36:0/2970020207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8000b1d10 con 0x7fb8000ad5c0 2022-01-10T01:33:04.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb7fdffb700 1 -- 172.21.15.36:0/2970020207 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7f4011c20 con 0x7fb8000ad5c0 2022-01-10T01:33:04.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.882+0000 7fb805ae0700 1 -- 172.21.15.36:0/2970020207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8000ac3f0 con 0x7fb8000ad5c0 2022-01-10T01:33:04.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.886+0000 7fb805ae0700 1 -- 172.21.15.36:0/2970020207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8000af460 con 0x7fb8000ad5c0 2022-01-10T01:33:04.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.886+0000 7fb7fdffb700 1 -- 172.21.15.36:0/2970020207 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb7f401a040 con 0x7fb8000ad5c0 2022-01-10T01:33:04.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.886+0000 7fb7fdffb700 1 --2- 172.21.15.36:0/2970020207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7e00535f0 0x7fb7e0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:04.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.886+0000 7fb7fdffb700 1 -- 172.21.15.36:0/2970020207 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6068+0+0 (secure 0 0 0) 0x7fb7f406c790 con 0x7fb8000ad5c0 2022-01-10T01:33:04.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.886+0000 7fb804ade700 1 --2- 172.21.15.36:0/2970020207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7e00535f0 0x7fb7e0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:04.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.886+0000 7fb804ade700 1 --2- 172.21.15.36:0/2970020207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7e00535f0 0x7fb7e0055ab0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fb7f000d000 tx=0x7fb7f0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:04.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:04.890+0000 7fb7fdffb700 1 -- 172.21.15.36:0/2970020207 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb7f40438a0 con 0x7fb8000ad5c0 2022-01-10T01:33:05.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.018+0000 7fb805ae0700 1 -- 172.21.15.36:0/2970020207 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb800057350 con 0x7fb8000ad5c0 2022-01-10T01:33:05.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.750+0000 7fb7fdffb700 1 -- 172.21.15.36:0/2970020207 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v134) v1 ==== 173+0+0 (secure 0 0 0) 0x7fb7f4046ec0 con 0x7fb8000ad5c0 2022-01-10T01:33:05.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.754+0000 7fb805ae0700 1 -- 172.21.15.36:0/2970020207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7e00535f0 msgr2=0x7fb7e0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:05.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.754+0000 7fb805ae0700 1 --2- 172.21.15.36:0/2970020207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7e00535f0 0x7fb7e0055ab0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fb7f000d000 tx=0x7fb7f0009040).stop 2022-01-10T01:33:05.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.754+0000 7fb805ae0700 1 -- 172.21.15.36:0/2970020207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb8000ad5c0 msgr2=0x7fb8000ab4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:05.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.754+0000 7fb805ae0700 1 --2- 172.21.15.36:0/2970020207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb8000ad5c0 0x7fb8000ab4b0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7fb7f4002f70 tx=0x7fb7f4015000).stop 2022-01-10T01:33:05.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.754+0000 7fb805ae0700 1 -- 172.21.15.36:0/2970020207 shutdown_connections 2022-01-10T01:33:05.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.754+0000 7fb805ae0700 1 --2- 172.21.15.36:0/2970020207 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb7e00535f0 0x7fb7e0055ab0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:05.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.754+0000 7fb805ae0700 1 --2- 172.21.15.36:0/2970020207 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb800140440 0x7fb8000ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:05.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.754+0000 7fb805ae0700 1 --2- 172.21.15.36:0/2970020207 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb8000ad5c0 0x7fb8000ab4b0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:05.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.754+0000 7fb805ae0700 1 --2- 172.21.15.36:0/2970020207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb800061320 0x7fb8001432c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:05.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.754+0000 7fb805ae0700 1 -- 172.21.15.36:0/2970020207 >> 172.21.15.36:0/2970020207 conn(0x7fb800066de0 msgr2=0x7fb800144b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:05.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.754+0000 7fb805ae0700 1 -- 172.21.15.36:0/2970020207 shutdown_connections 2022-01-10T01:33:05.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.754+0000 7fb805ae0700 1 -- 172.21.15.36:0/2970020207 wait complete. 2022-01-10T01:33:05.763 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' removed 2022-01-10T01:33:05.776 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2022-01-10T01:33:05.887 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.882+0000 7f5d3b374700 1 Processor -- start 2022-01-10T01:33:05.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.882+0000 7f5d3b374700 1 -- start start 2022-01-10T01:33:05.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.882+0000 7f5d3b374700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d3405fc00 0x7f5d340b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:05.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.882+0000 7f5d3b374700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5d340b6560 0x7f5d340b9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:05.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.882+0000 7f5d3b374700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d34143f60 con 0x7f5d340b5990 2022-01-10T01:33:05.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.882+0000 7f5d3b374700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3405ffe0 con 0x7f5d340b6560 2022-01-10T01:33:05.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.882+0000 7f5d3b374700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d34143a50 con 0x7f5d3405fc00 2022-01-10T01:33:05.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.882+0000 7f5d39911700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f5d340b5990 0x7f5d340b4a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39132/0 (socket says 172.21.15.36:39132) 2022-01-10T01:33:05.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.882+0000 7f5d3890f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5d340b6560 0x7f5d340b9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:05.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.882+0000 7f5d39911700 1 -- 172.21.15.36:0/2496800823 learned_addr learned my addr 172.21.15.36:0/2496800823 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:05.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.882+0000 7f5d39110700 1 --2- 172.21.15.36:0/2496800823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d3405fc00 0x7f5d340b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:05.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.882+0000 7f5d27fff700 1 -- 172.21.15.36:0/2496800823 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930940225 0 0) 0x7f5d34143f60 con 0x7f5d340b5990 2022-01-10T01:33:05.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d27fff700 1 -- 172.21.15.36:0/2496800823 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d18003260 con 0x7f5d340b5990 2022-01-10T01:33:05.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3890f700 1 -- 172.21.15.36:0/2496800823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d3405fc00 msgr2=0x7f5d340b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:05.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3890f700 1 --2- 172.21.15.36:0/2496800823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d3405fc00 0x7f5d340b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:05.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3890f700 1 -- 172.21.15.36:0/2496800823 >> v1:172.21.15.36:6789/0 conn(0x7f5d340b5990 legacy=0x7f5d340b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:05.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3890f700 1 -- 172.21.15.36:0/2496800823 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d34143cc0 con 0x7f5d340b6560 2022-01-10T01:33:05.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3890f700 1 --2- 172.21.15.36:0/2496800823 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5d340b6560 0x7f5d340b9fa0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f5d28002f70 tx=0x7f5d28006df0).ready entity=mon.0 client_cookie=b6cd17a04a62be98 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:05.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d27fff700 1 -- 172.21.15.36:0/2496800823 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d2800d4a0 con 0x7f5d340b6560 2022-01-10T01:33:05.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d27fff700 1 -- 172.21.15.36:0/2496800823 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d28000e90 con 0x7f5d340b6560 2022-01-10T01:33:05.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d27fff700 1 -- 172.21.15.36:0/2496800823 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d2800d7f0 con 0x7f5d340b6560 2022-01-10T01:33:05.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3b374700 1 -- 172.21.15.36:0/2496800823 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5d340b6560 msgr2=0x7f5d340b9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:05.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3b374700 1 --2- 172.21.15.36:0/2496800823 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5d340b6560 0x7f5d340b9fa0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7f5d28002f70 tx=0x7f5d28006df0).stop 2022-01-10T01:33:05.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3b374700 1 -- 172.21.15.36:0/2496800823 shutdown_connections 2022-01-10T01:33:05.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3b374700 1 --2- 172.21.15.36:0/2496800823 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5d340b6560 0x7f5d340b9fa0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:05.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3b374700 1 --2- 172.21.15.36:0/2496800823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d3405fc00 0x7f5d340b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:05.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3b374700 1 -- 172.21.15.36:0/2496800823 >> 172.21.15.36:0/2496800823 conn(0x7f5d340623a0 msgr2=0x7f5d34066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:05.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3b374700 1 -- 172.21.15.36:0/2496800823 shutdown_connections 2022-01-10T01:33:05.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3b374700 1 -- 172.21.15.36:0/2496800823 wait complete. 2022-01-10T01:33:05.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3b374700 1 Processor -- start 2022-01-10T01:33:05.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.886+0000 7f5d3b374700 1 -- start start 2022-01-10T01:33:05.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d3b374700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d3405fc00 0x7f5d340b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:05.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d3b374700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d340b5990 0x7f5d34156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:05.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d3b374700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5d340b6560 0x7f5d34156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:05.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d3b374700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d34156a70 con 0x7f5d340b6560 2022-01-10T01:33:05.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d3b374700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d340b35b0 con 0x7f5d3405fc00 2022-01-10T01:33:05.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d3b374700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d340ae560 con 0x7f5d340b5990 2022-01-10T01:33:05.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d39911700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5d340b6560 0x7f5d34156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:05.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d39911700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5d340b6560 0x7f5d34156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41344/0 (socket says 172.21.15.36:41344) 2022-01-10T01:33:05.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d39911700 1 -- 172.21.15.36:0/1640003001 learned_addr learned my addr 172.21.15.36:0/1640003001 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:05.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d39110700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d3405fc00 0x7f5d340b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:05.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d3890f700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d340b5990 0x7f5d34156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:05.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d39110700 1 -- 172.21.15.36:0/1640003001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d340b5990 msgr2=0x7f5d34156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:05.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d39110700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d340b5990 0x7f5d34156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:05.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d39110700 1 -- 172.21.15.36:0/1640003001 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5d340b6560 msgr2=0x7f5d34156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:05.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d39110700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5d340b6560 0x7f5d34156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:05.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d39110700 1 -- 172.21.15.36:0/1640003001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2800b180 con 0x7f5d3405fc00 2022-01-10T01:33:05.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d39911700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5d340b6560 0x7f5d34156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:05.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d39110700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d3405fc00 0x7f5d340b2f30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f5d34156bb0 tx=0x7f5d30006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:05.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d267fc700 1 -- 172.21.15.36:0/1640003001 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d30011750 con 0x7f5d3405fc00 2022-01-10T01:33:05.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d267fc700 1 -- 172.21.15.36:0/1640003001 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d300118b0 con 0x7f5d3405fc00 2022-01-10T01:33:05.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d3b374700 1 -- 172.21.15.36:0/1640003001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d340ae800 con 0x7f5d3405fc00 2022-01-10T01:33:05.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d267fc700 1 -- 172.21.15.36:0/1640003001 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d30011c10 con 0x7f5d3405fc00 2022-01-10T01:33:05.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.890+0000 7f5d3b374700 1 -- 172.21.15.36:0/1640003001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d340adbb0 con 0x7f5d3405fc00 2022-01-10T01:33:05.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.894+0000 7f5d3b374700 1 -- 172.21.15.36:0/1640003001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d340b9860 con 0x7f5d3405fc00 2022-01-10T01:33:05.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.894+0000 7f5d267fc700 1 -- 172.21.15.36:0/1640003001 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5d30011d70 con 0x7f5d3405fc00 2022-01-10T01:33:05.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.894+0000 7f5d267fc700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5d1c053560 0x7f5d1c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:05.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.894+0000 7f5d267fc700 1 -- 172.21.15.36:0/1640003001 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f5d3006bc20 con 0x7f5d3405fc00 2022-01-10T01:33:05.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.894+0000 7f5d3890f700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5d1c053560 0x7f5d1c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:05.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.894+0000 7f5d3890f700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5d1c053560 0x7f5d1c055a20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f5d2801a000 tx=0x7f5d28014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:05.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:05.906+0000 7f5d267fc700 1 -- 172.21.15.36:0/1640003001 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5d30042e10 con 0x7f5d3405fc00 2022-01-10T01:33:06.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.038+0000 7f5d3b374700 1 -- 172.21.15.36:0/1640003001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5d34057350 con 0x7f5d3405fc00 2022-01-10T01:33:06.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.046+0000 7f5d267fc700 1 -- 172.21.15.36:0/1640003001 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5d30046430 con 0x7f5d3405fc00 2022-01-10T01:33:06.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.050+0000 7f5d3b374700 1 -- 172.21.15.36:0/1640003001 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5d1c053560 msgr2=0x7f5d1c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:06.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.050+0000 7f5d3b374700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5d1c053560 0x7f5d1c055a20 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f5d2801a000 tx=0x7f5d28014000).stop 2022-01-10T01:33:06.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.050+0000 7f5d3b374700 1 -- 172.21.15.36:0/1640003001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d3405fc00 msgr2=0x7f5d340b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:06.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.050+0000 7f5d3b374700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d3405fc00 0x7f5d340b2f30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f5d34156bb0 tx=0x7f5d30006df0).stop 2022-01-10T01:33:06.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.050+0000 7f5d3b374700 1 -- 172.21.15.36:0/1640003001 shutdown_connections 2022-01-10T01:33:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.050+0000 7f5d3b374700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5d1c053560 0x7f5d1c055a20 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.050+0000 7f5d3b374700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5d340b6560 0x7f5d34156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.050+0000 7f5d3b374700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d340b5990 0x7f5d34156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.050+0000 7f5d3b374700 1 --2- 172.21.15.36:0/1640003001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d3405fc00 0x7f5d340b2f30 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.050+0000 7f5d3b374700 1 -- 172.21.15.36:0/1640003001 >> 172.21.15.36:0/1640003001 conn(0x7f5d340623a0 msgr2=0x7f5d34127e00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:06.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.050+0000 7f5d3b374700 1 -- 172.21.15.36:0/1640003001 shutdown_connections 2022-01-10T01:33:06.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.050+0000 7f5d3b374700 1 -- 172.21.15.36:0/1640003001 wait complete. 2022-01-10T01:33:06.068 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2022-01-10T01:33:06.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43d0859700 1 Processor -- start 2022-01-10T01:33:06.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43d0859700 1 -- start start 2022-01-10T01:33:06.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43d0859700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc0b0fd0 0x7f43cc144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:06.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43d0859700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43cc0b0350 con 0x7f43cc1483a0 2022-01-10T01:33:06.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43d0859700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43cc0b05f0 con 0x7f43cc0b1db0 2022-01-10T01:33:06.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43d0859700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc0a90c0 con 0x7f43cc0b0fd0 2022-01-10T01:33:06.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43c9d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f43cc1483a0 0x7f43cc0a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39142/0 (socket says 172.21.15.36:39142) 2022-01-10T01:33:06.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43c9d9b700 1 -- 172.21.15.36:0/3679454600 learned_addr learned my addr 172.21.15.36:0/3679454600 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:06.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43cad9d700 1 --2- 172.21.15.36:0/3679454600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc0b0fd0 0x7f43cc144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:06.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43c959a700 1 -- 172.21.15.36:0/3679454600 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303847094 0 0) 0x7f43cc0b0350 con 0x7f43cc1483a0 2022-01-10T01:33:06.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43c959a700 1 -- 172.21.15.36:0/3679454600 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b0003260 con 0x7f43cc1483a0 2022-01-10T01:33:06.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43c959a700 1 -- 172.21.15.36:0/3679454600 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128759955 0 0) 0x7f43cc0b05f0 con 0x7f43cc0b1db0 2022-01-10T01:33:06.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43c959a700 1 -- 172.21.15.36:0/3679454600 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43cc0b0350 con 0x7f43cc0b1db0 2022-01-10T01:33:06.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43cad9d700 1 -- 172.21.15.36:0/3679454600 >> v1:172.21.15.59:6789/0 conn(0x7f43cc0b1db0 legacy=0x7f43cc0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:06.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43c959a700 1 -- 172.21.15.36:0/3679454600 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1599006496 0 0) 0x7f43b0003260 con 0x7f43cc1483a0 2022-01-10T01:33:06.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43cad9d700 1 -- 172.21.15.36:0/3679454600 >> v1:172.21.15.36:6789/0 conn(0x7f43cc1483a0 legacy=0x7f43cc0a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:06.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43cad9d700 1 -- 172.21.15.36:0/3679454600 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc0b0890 con 0x7f43cc0b0fd0 2022-01-10T01:33:06.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43cad9d700 1 --2- 172.21.15.36:0/3679454600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc0b0fd0 0x7f43cc144720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f43cc147730 tx=0x7f43c40091d0).ready entity=mon.2 client_cookie=caf49fac586ece09 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:06.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43c959a700 1 -- 172.21.15.36:0/3679454600 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43bc001660 con 0x7f43cc0b0fd0 2022-01-10T01:33:06.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43c959a700 1 -- 172.21.15.36:0/3679454600 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c400f510 con 0x7f43cc0b0fd0 2022-01-10T01:33:06.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.166+0000 7f43c959a700 1 -- 172.21.15.36:0/3679454600 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43c400f680 con 0x7f43cc0b0fd0 2022-01-10T01:33:06.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 -- 172.21.15.36:0/3679454600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc0b0fd0 msgr2=0x7f43cc144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:06.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 --2- 172.21.15.36:0/3679454600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc0b0fd0 0x7f43cc144720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f43cc147730 tx=0x7f43c40091d0).stop 2022-01-10T01:33:06.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 -- 172.21.15.36:0/3679454600 shutdown_connections 2022-01-10T01:33:06.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 --2- 172.21.15.36:0/3679454600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc0b0fd0 0x7f43cc144720 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 -- 172.21.15.36:0/3679454600 >> 172.21.15.36:0/3679454600 conn(0x7f43cc05f6b0 msgr2=0x7f43cc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:06.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 -- 172.21.15.36:0/3679454600 shutdown_connections 2022-01-10T01:33:06.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 -- 172.21.15.36:0/3679454600 wait complete. 2022-01-10T01:33:06.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 Processor -- start 2022-01-10T01:33:06.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 -- start start 2022-01-10T01:33:06.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc0b0fd0 0x7f43cc0aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:06.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc0b1db0 0x7f43cc0a9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:06.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43cc1483a0 0x7f43cc0ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:06.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc14b810 con 0x7f43cc1483a0 2022-01-10T01:33:06.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc0a9c40 con 0x7f43cc0b1db0 2022-01-10T01:33:06.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43d0859700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc14a090 con 0x7f43cc0b0fd0 2022-01-10T01:33:06.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43cad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43cc1483a0 0x7f43cc0ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:06.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43c9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc0b1db0 0x7f43cc0a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:06.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43c9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc0b1db0 0x7f43cc0a9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:37988/0 (socket says 172.21.15.36:37988) 2022-01-10T01:33:06.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43c9d9b700 1 -- 172.21.15.36:0/2054116635 learned_addr learned my addr 172.21.15.36:0/2054116635 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:06.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.170+0000 7f43ca59c700 1 --2- 172.21.15.36:0/2054116635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc0b0fd0 0x7f43cc0aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:06.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43c9d9b700 1 -- 172.21.15.36:0/2054116635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc0b0fd0 msgr2=0x7f43cc0aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:06.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43c9d9b700 1 --2- 172.21.15.36:0/2054116635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc0b0fd0 0x7f43cc0aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43c9d9b700 1 -- 172.21.15.36:0/2054116635 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43cc1483a0 msgr2=0x7f43cc0ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:06.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43c9d9b700 1 --2- 172.21.15.36:0/2054116635 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43cc1483a0 0x7f43cc0ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43c9d9b700 1 -- 172.21.15.36:0/2054116635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4009470 con 0x7f43cc0b1db0 2022-01-10T01:33:06.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43cad9d700 1 --2- 172.21.15.36:0/2054116635 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43cc1483a0 0x7f43cc0ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:06.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43c9d9b700 1 --2- 172.21.15.36:0/2054116635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc0b1db0 0x7f43cc0a9750 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f43cc0a9470 tx=0x7f43bc001960).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:06.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43bb7fe700 1 -- 172.21.15.36:0/2054116635 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43bc00ce40 con 0x7f43cc0b1db0 2022-01-10T01:33:06.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43d0859700 1 -- 172.21.15.36:0/2054116635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc14b2d0 con 0x7f43cc0b1db0 2022-01-10T01:33:06.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43bb7fe700 1 -- 172.21.15.36:0/2054116635 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc0072e0 con 0x7f43cc0b1db0 2022-01-10T01:33:06.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43bb7fe700 1 -- 172.21.15.36:0/2054116635 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43bc005800 con 0x7f43cc0b1db0 2022-01-10T01:33:06.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43d0859700 1 -- 172.21.15.36:0/2054116635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc14afc0 con 0x7f43cc0b1db0 2022-01-10T01:33:06.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43d0859700 1 -- 172.21.15.36:0/2054116635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43cc057350 con 0x7f43cc0b1db0 2022-01-10T01:33:06.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43bb7fe700 1 -- 172.21.15.36:0/2054116635 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f43bc010070 con 0x7f43cc0b1db0 2022-01-10T01:33:06.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43bb7fe700 1 --2- 172.21.15.36:0/2054116635 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43a80535f0 0x7f43a8055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:06.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43bb7fe700 1 -- 172.21.15.36:0/2054116635 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f43bc06aff0 con 0x7f43cc0b1db0 2022-01-10T01:33:06.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.174+0000 7f43ca59c700 1 --2- 172.21.15.36:0/2054116635 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43a80535f0 0x7f43a8055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:06.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.178+0000 7f43ca59c700 1 --2- 172.21.15.36:0/2054116635 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43a80535f0 0x7f43a8055ab0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f43c000d000 tx=0x7f43c0007a20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:06.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.186+0000 7f43bb7fe700 1 -- 172.21.15.36:0/2054116635 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f43bc042190 con 0x7f43cc0b1db0 2022-01-10T01:33:06.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.354+0000 7f43d0859700 1 -- 172.21.15.36:0/2054116635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f43cc0b5320 con 0x7f43cc0b1db0 2022-01-10T01:33:06.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.766+0000 7f43bb7fe700 1 -- 172.21.15.36:0/2054116635 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v398) v1 ==== 122+0+0 (secure 0 0 0) 0x7f43bc018030 con 0x7f43cc0b1db0 2022-01-10T01:33:06.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.770+0000 7f43d0859700 1 -- 172.21.15.36:0/2054116635 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43a80535f0 msgr2=0x7f43a8055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:06.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.770+0000 7f43d0859700 1 --2- 172.21.15.36:0/2054116635 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43a80535f0 0x7f43a8055ab0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f43c000d000 tx=0x7f43c0007a20).stop 2022-01-10T01:33:06.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.770+0000 7f43d0859700 1 -- 172.21.15.36:0/2054116635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc0b1db0 msgr2=0x7f43cc0a9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:06.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.770+0000 7f43d0859700 1 --2- 172.21.15.36:0/2054116635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc0b1db0 0x7f43cc0a9750 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f43cc0a9470 tx=0x7f43bc001960).stop 2022-01-10T01:33:06.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.770+0000 7f43d0859700 1 -- 172.21.15.36:0/2054116635 shutdown_connections 2022-01-10T01:33:06.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.770+0000 7f43d0859700 1 --2- 172.21.15.36:0/2054116635 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43a80535f0 0x7f43a8055ab0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.770+0000 7f43d0859700 1 --2- 172.21.15.36:0/2054116635 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43cc1483a0 0x7f43cc0ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.770+0000 7f43d0859700 1 --2- 172.21.15.36:0/2054116635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43cc0b1db0 0x7f43cc0a9750 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.770+0000 7f43d0859700 1 --2- 172.21.15.36:0/2054116635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43cc0b0fd0 0x7f43cc0aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.770+0000 7f43d0859700 1 -- 172.21.15.36:0/2054116635 >> 172.21.15.36:0/2054116635 conn(0x7f43cc05f6b0 msgr2=0x7f43cc147770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:06.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.770+0000 7f43d0859700 1 -- 172.21.15.36:0/2054116635 shutdown_connections 2022-01-10T01:33:06.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.770+0000 7f43d0859700 1 -- 172.21.15.36:0/2054116635 wait complete. 2022-01-10T01:33:06.791 INFO:tasks.cephfs_test_runner:test_fs_new (tasks.cephfs.test_misc.TestMisc) ... ok 2022-01-10T01:33:06.792 INFO:tasks.cephfs_test_runner:Starting test: test_getattr_caps (tasks.cephfs.test_misc.TestMisc) 2022-01-10T01:33:06.792 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2022-01-10T01:33:06.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.898+0000 7f588f585700 1 Processor -- start 2022-01-10T01:33:06.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.898+0000 7f588f585700 1 -- start start 2022-01-10T01:33:06.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58880b0710 0x7f5888142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:06.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58880b30d0 0x7f5888143210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:06.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f58880ace70 0x7f588805f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:06.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58880b0af0 con 0x7f58880ace70 2022-01-10T01:33:06.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58880ae680 con 0x7f58880b30d0 2022-01-10T01:33:06.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58880ae920 con 0x7f58880b0710 2022-01-10T01:33:06.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588ed84700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f58880ace70 0x7f588805f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:06.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588ed84700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f58880ace70 0x7f588805f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41366/0 (socket says 172.21.15.36:41366) 2022-01-10T01:33:06.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588ed84700 1 -- 172.21.15.36:0/1959890018 learned_addr learned my addr 172.21.15.36:0/1959890018 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:06.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588e583700 1 --2- 172.21.15.36:0/1959890018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58880b0710 0x7f5888142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:06.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588dd82700 1 --2- 172.21.15.36:0/1959890018 >> v2:172.21.15.59:3300/0 conn(0x7f58880b30d0 0x7f5888143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:06.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588ed84700 1 -- 172.21.15.36:0/1959890018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58880b0710 msgr2=0x7f5888142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:06.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588ed84700 1 --2- 172.21.15.36:0/1959890018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58880b0710 0x7f5888142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588ed84700 1 -- 172.21.15.36:0/1959890018 >> v2:172.21.15.59:3300/0 conn(0x7f58880b30d0 msgr2=0x7f5888143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:06.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588ed84700 1 --2- 172.21.15.36:0/1959890018 >> v2:172.21.15.59:3300/0 conn(0x7f58880b30d0 0x7f5888143210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588ed84700 1 -- 172.21.15.36:0/1959890018 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58880aebc0 con 0x7f58880ace70 2022-01-10T01:33:06.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588e583700 1 --2- 172.21.15.36:0/1959890018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58880b0710 0x7f5888142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:06.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588ed84700 1 --2- 172.21.15.36:0/1959890018 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58880ace70 0x7f588805f6b0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f58800032f0 tx=0x7f5880009290).ready entity=mon.0 client_cookie=8b0a37aeeb74ffc0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:06.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588d581700 1 -- 172.21.15.36:0/1959890018 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f588000cb70 con 0x7f58880ace70 2022-01-10T01:33:06.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588d581700 1 -- 172.21.15.36:0/1959890018 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588000ccd0 con 0x7f58880ace70 2022-01-10T01:33:06.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588d581700 1 -- 172.21.15.36:0/1959890018 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5880010600 con 0x7f58880ace70 2022-01-10T01:33:06.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 -- 172.21.15.36:0/1959890018 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58880ace70 msgr2=0x7f588805f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:06.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 --2- 172.21.15.36:0/1959890018 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58880ace70 0x7f588805f6b0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f58800032f0 tx=0x7f5880009290).stop 2022-01-10T01:33:06.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 -- 172.21.15.36:0/1959890018 shutdown_connections 2022-01-10T01:33:06.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 --2- 172.21.15.36:0/1959890018 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58880ace70 0x7f588805f6b0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 --2- 172.21.15.36:0/1959890018 >> v2:172.21.15.59:3300/0 conn(0x7f58880b30d0 0x7f5888143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 --2- 172.21.15.36:0/1959890018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58880b0710 0x7f5888142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 -- 172.21.15.36:0/1959890018 >> 172.21.15.36:0/1959890018 conn(0x7f5888061140 msgr2=0x7f5888062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:06.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 -- 172.21.15.36:0/1959890018 shutdown_connections 2022-01-10T01:33:06.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.902+0000 7f588f585700 1 -- 172.21.15.36:0/1959890018 wait complete. 2022-01-10T01:33:06.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588f585700 1 Processor -- start 2022-01-10T01:33:06.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588f585700 1 -- start start 2022-01-10T01:33:06.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588f585700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58880ace70 0x7f5888066e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:06.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588f585700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58880b0710 0x7f5888064a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:06.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588f585700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58880b30d0 0x7f5888064f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:06.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588f585700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58880677f0 con 0x7f58880b30d0 2022-01-10T01:33:06.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588f585700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58881411f0 con 0x7f58880ace70 2022-01-10T01:33:06.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588f585700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5888141490 con 0x7f58880b0710 2022-01-10T01:33:06.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588ed84700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58880b30d0 0x7f5888064f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:06.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588ed84700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58880b30d0 0x7f5888064f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41372/0 (socket says 172.21.15.36:41372) 2022-01-10T01:33:06.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588ed84700 1 -- 172.21.15.36:0/1419716477 learned_addr learned my addr 172.21.15.36:0/1419716477 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:06.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588e583700 1 --2- 172.21.15.36:0/1419716477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58880ace70 0x7f5888066e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:06.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588dd82700 1 --2- 172.21.15.36:0/1419716477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58880b0710 0x7f5888064a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:06.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588ed84700 1 -- 172.21.15.36:0/1419716477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58880b0710 msgr2=0x7f5888064a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:06.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588ed84700 1 --2- 172.21.15.36:0/1419716477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58880b0710 0x7f5888064a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588ed84700 1 -- 172.21.15.36:0/1419716477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58880ace70 msgr2=0x7f5888066e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:06.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588ed84700 1 --2- 172.21.15.36:0/1419716477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58880ace70 0x7f5888066e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:06.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588ed84700 1 -- 172.21.15.36:0/1419716477 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5880009530 con 0x7f58880b30d0 2022-01-10T01:33:06.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588ed84700 1 --2- 172.21.15.36:0/1419716477 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58880b30d0 0x7f5888064f80 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f58800032f0 tx=0x7f5880017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:06.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f58777fe700 1 -- 172.21.15.36:0/1419716477 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f588001a450 con 0x7f58880b30d0 2022-01-10T01:33:06.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f58777fe700 1 -- 172.21.15.36:0/1419716477 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588001a5b0 con 0x7f58880b30d0 2022-01-10T01:33:06.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588f585700 1 -- 172.21.15.36:0/1419716477 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58880a6130 con 0x7f58880b30d0 2022-01-10T01:33:06.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f58777fe700 1 -- 172.21.15.36:0/1419716477 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f588001a910 con 0x7f58880b30d0 2022-01-10T01:33:06.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.906+0000 7f588f585700 1 -- 172.21.15.36:0/1419716477 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5888065470 con 0x7f58880b30d0 2022-01-10T01:33:06.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.910+0000 7f588f585700 1 -- 172.21.15.36:0/1419716477 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5888141650 con 0x7f58880b30d0 2022-01-10T01:33:06.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.910+0000 7f58777fe700 1 -- 172.21.15.36:0/1419716477 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f588002a070 con 0x7f58880b30d0 2022-01-10T01:33:06.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.910+0000 7f58777fe700 1 --2- 172.21.15.36:0/1419716477 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5868053560 0x7f5868055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:06.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.910+0000 7f58777fe700 1 -- 172.21.15.36:0/1419716477 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f588006d3d0 con 0x7f58880b30d0 2022-01-10T01:33:06.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.910+0000 7f588e583700 1 --2- 172.21.15.36:0/1419716477 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5868053560 0x7f5868055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:06.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.910+0000 7f588e583700 1 --2- 172.21.15.36:0/1419716477 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5868053560 0x7f5868055a20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f588400c000 tx=0x7f5884008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:06.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:06.918+0000 7f58777fe700 1 -- 172.21.15.36:0/1419716477 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5880044700 con 0x7f58880b30d0 2022-01-10T01:33:07.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.086+0000 7f588f585700 1 -- 172.21.15.36:0/1419716477 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f58880679b0 con 0x7f58880b30d0 2022-01-10T01:33:07.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.766+0000 7f58777fe700 1 -- 172.21.15.36:0/1419716477 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v399) v1 ==== 131+0+0 (secure 0 0 0) 0x7f5880047ce0 con 0x7f58880b30d0 2022-01-10T01:33:07.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.770+0000 7f588f585700 1 -- 172.21.15.36:0/1419716477 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5868053560 msgr2=0x7f5868055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:07.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.770+0000 7f588f585700 1 --2- 172.21.15.36:0/1419716477 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5868053560 0x7f5868055a20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f588400c000 tx=0x7f5884008040).stop 2022-01-10T01:33:07.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.770+0000 7f588f585700 1 -- 172.21.15.36:0/1419716477 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58880b30d0 msgr2=0x7f5888064f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:07.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.770+0000 7f588f585700 1 --2- 172.21.15.36:0/1419716477 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58880b30d0 0x7f5888064f80 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7f58800032f0 tx=0x7f5880017000).stop 2022-01-10T01:33:07.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.770+0000 7f588f585700 1 -- 172.21.15.36:0/1419716477 shutdown_connections 2022-01-10T01:33:07.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.770+0000 7f588f585700 1 --2- 172.21.15.36:0/1419716477 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5868053560 0x7f5868055a20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:07.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.770+0000 7f588f585700 1 --2- 172.21.15.36:0/1419716477 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f58880b30d0 0x7f5888064f80 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:07.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.770+0000 7f588f585700 1 --2- 172.21.15.36:0/1419716477 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58880b0710 0x7f5888064a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:07.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.770+0000 7f588f585700 1 --2- 172.21.15.36:0/1419716477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58880ace70 0x7f5888066e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:07.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.770+0000 7f588f585700 1 -- 172.21.15.36:0/1419716477 >> 172.21.15.36:0/1419716477 conn(0x7f5888061140 msgr2=0x7f58880b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:07.778 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.770+0000 7f588f585700 1 -- 172.21.15.36:0/1419716477 shutdown_connections 2022-01-10T01:33:07.779 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.770+0000 7f588f585700 1 -- 172.21.15.36:0/1419716477 wait complete. 2022-01-10T01:33:07.793 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2022-01-10T01:33:07.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.902+0000 7f90c6d26700 1 Processor -- start 2022-01-10T01:33:07.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.902+0000 7f90c6d26700 1 -- start start 2022-01-10T01:33:07.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.902+0000 7f90c6d26700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90c00b21b0 0x7f90c005f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:07.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.902+0000 7f90c6d26700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f90c0143c90 0x7f90c012c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:07.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.902+0000 7f90c6d26700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c00b3c40 con 0x7f90c0060d20 2022-01-10T01:33:07.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.902+0000 7f90c6d26700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c0063df0 con 0x7f90c0143c90 2022-01-10T01:33:07.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.902+0000 7f90c6d26700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c00b2590 con 0x7f90c00b21b0 2022-01-10T01:33:07.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.902+0000 7f90c6525700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f90c0143c90 0x7f90c012c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:07.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.902+0000 7f90c6525700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f90c0143c90 0x7f90c012c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41380/0 (socket says 172.21.15.36:41380) 2022-01-10T01:33:07.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.902+0000 7f90c5523700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f90c0060d20 0x7f90c00b3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39170/0 (socket says 172.21.15.36:39170) 2022-01-10T01:33:07.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.902+0000 7f90c6525700 1 -- 172.21.15.36:0/4154567598 learned_addr learned my addr 172.21.15.36:0/4154567598 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:07.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.902+0000 7f90c5d24700 1 --2- 172.21.15.36:0/4154567598 >> v2:172.21.15.59:3300/0 conn(0x7f90c00b21b0 0x7f90c005f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:07.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6525700 1 -- 172.21.15.36:0/4154567598 >> v2:172.21.15.59:3300/0 conn(0x7f90c00b21b0 msgr2=0x7f90c005f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:07.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6525700 1 --2- 172.21.15.36:0/4154567598 >> v2:172.21.15.59:3300/0 conn(0x7f90c00b21b0 0x7f90c005f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:07.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6525700 1 -- 172.21.15.36:0/4154567598 >> v1:172.21.15.36:6789/0 conn(0x7f90c0060d20 legacy=0x7f90c00b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:07.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6525700 1 -- 172.21.15.36:0/4154567598 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c00b2e30 con 0x7f90c0143c90 2022-01-10T01:33:07.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6525700 1 --2- 172.21.15.36:0/4154567598 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c0143c90 0x7f90c012c020 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f90b8002f70 tx=0x7f90b8006eb0).ready entity=mon.0 client_cookie=f572cf58b34f0da server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:07.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c4d22700 1 -- 172.21.15.36:0/4154567598 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90b800d5c0 con 0x7f90c0143c90 2022-01-10T01:33:07.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c4d22700 1 -- 172.21.15.36:0/4154567598 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b8000e90 con 0x7f90c0143c90 2022-01-10T01:33:07.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c4d22700 1 -- 172.21.15.36:0/4154567598 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90b800d950 con 0x7f90c0143c90 2022-01-10T01:33:07.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6d26700 1 -- 172.21.15.36:0/4154567598 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c0143c90 msgr2=0x7f90c012c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:07.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6d26700 1 --2- 172.21.15.36:0/4154567598 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c0143c90 0x7f90c012c020 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f90b8002f70 tx=0x7f90b8006eb0).stop 2022-01-10T01:33:07.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6d26700 1 -- 172.21.15.36:0/4154567598 shutdown_connections 2022-01-10T01:33:07.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6d26700 1 --2- 172.21.15.36:0/4154567598 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c0143c90 0x7f90c012c020 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:07.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6d26700 1 --2- 172.21.15.36:0/4154567598 >> v2:172.21.15.59:3300/0 conn(0x7f90c00b21b0 0x7f90c005f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:07.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6d26700 1 -- 172.21.15.36:0/4154567598 >> 172.21.15.36:0/4154567598 conn(0x7f90c005c490 msgr2=0x7f90c005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:07.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6d26700 1 -- 172.21.15.36:0/4154567598 shutdown_connections 2022-01-10T01:33:07.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6d26700 1 -- 172.21.15.36:0/4154567598 wait complete. 2022-01-10T01:33:07.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6d26700 1 Processor -- start 2022-01-10T01:33:07.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.906+0000 7f90c6d26700 1 -- start start 2022-01-10T01:33:07.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c6d26700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90c0060d20 0x7f90c00ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:07.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c6d26700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c00b21b0 0x7f90c0145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:07.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c6d26700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90c0143c90 0x7f90c0156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:07.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c6d26700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c0145af0 con 0x7f90c00b21b0 2022-01-10T01:33:07.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c6d26700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c0145d90 con 0x7f90c0143c90 2022-01-10T01:33:07.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c6d26700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c0155c10 con 0x7f90c0060d20 2022-01-10T01:33:07.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c5523700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c00b21b0 0x7f90c0145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:07.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c5523700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c00b21b0 0x7f90c0145300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41382/0 (socket says 172.21.15.36:41382) 2022-01-10T01:33:07.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c5523700 1 -- 172.21.15.36:0/3104002926 learned_addr learned my addr 172.21.15.36:0/3104002926 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:07.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c6525700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90c0143c90 0x7f90c0156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:07.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c5d24700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90c0060d20 0x7f90c00ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:07.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c5523700 1 -- 172.21.15.36:0/3104002926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90c0060d20 msgr2=0x7f90c00ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:07.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c5523700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90c0060d20 0x7f90c00ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:07.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c5523700 1 -- 172.21.15.36:0/3104002926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90c0143c90 msgr2=0x7f90c0156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:07.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c5523700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90c0143c90 0x7f90c0156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:07.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c5523700 1 -- 172.21.15.36:0/3104002926 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b800b1e0 con 0x7f90c00b21b0 2022-01-10T01:33:07.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c6525700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90c0143c90 0x7f90c0156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:07.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c5523700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c00b21b0 0x7f90c0145300 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f90c00b62c0 tx=0x7f90bc00c890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:07.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90b6ffd700 1 -- 172.21.15.36:0/3104002926 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90bc005ae0 con 0x7f90c00b21b0 2022-01-10T01:33:07.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90b6ffd700 1 -- 172.21.15.36:0/3104002926 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc005c40 con 0x7f90c00b21b0 2022-01-10T01:33:07.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c6d26700 1 -- 172.21.15.36:0/3104002926 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c0155eb0 con 0x7f90c00b21b0 2022-01-10T01:33:07.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90b6ffd700 1 -- 172.21.15.36:0/3104002926 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90bc0070d0 con 0x7f90c00b21b0 2022-01-10T01:33:07.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.910+0000 7f90c6d26700 1 -- 172.21.15.36:0/3104002926 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c0156840 con 0x7f90c00b21b0 2022-01-10T01:33:07.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.914+0000 7f90c6d26700 1 -- 172.21.15.36:0/3104002926 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c0061bd0 con 0x7f90c00b21b0 2022-01-10T01:33:07.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.914+0000 7f90b6ffd700 1 -- 172.21.15.36:0/3104002926 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f90bc01a060 con 0x7f90c00b21b0 2022-01-10T01:33:07.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.914+0000 7f90b6ffd700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90a0053590 0x7f90a0055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:07.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.914+0000 7f90b6ffd700 1 -- 172.21.15.36:0/3104002926 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f90bc06ae50 con 0x7f90c00b21b0 2022-01-10T01:33:07.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.914+0000 7f90c5d24700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90a0053590 0x7f90a0055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:07.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.914+0000 7f90c5d24700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90a0053590 0x7f90a0055a50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f90b000b000 tx=0x7f90b0006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:07.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:07.918+0000 7f90b6ffd700 1 -- 172.21.15.36:0/3104002926 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f90bc042140 con 0x7f90c00b21b0 2022-01-10T01:33:08.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.046+0000 7f90c6d26700 1 -- 172.21.15.36:0/3104002926 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f90c0156040 con 0x7f90c00b21b0 2022-01-10T01:33:08.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.058+0000 7f90b6ffd700 1 -- 172.21.15.36:0/3104002926 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f90bc018070 con 0x7f90c00b21b0 2022-01-10T01:33:08.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.058+0000 7f90c6d26700 1 -- 172.21.15.36:0/3104002926 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90a0053590 msgr2=0x7f90a0055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:08.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.058+0000 7f90c6d26700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90a0053590 0x7f90a0055a50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f90b000b000 tx=0x7f90b0006df0).stop 2022-01-10T01:33:08.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.058+0000 7f90c6d26700 1 -- 172.21.15.36:0/3104002926 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c00b21b0 msgr2=0x7f90c0145300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:08.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.058+0000 7f90c6d26700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c00b21b0 0x7f90c0145300 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f90c00b62c0 tx=0x7f90bc00c890).stop 2022-01-10T01:33:08.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.058+0000 7f90c6d26700 1 -- 172.21.15.36:0/3104002926 shutdown_connections 2022-01-10T01:33:08.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.058+0000 7f90c6d26700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90a0053590 0x7f90a0055a50 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.058+0000 7f90c6d26700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90c0143c90 0x7f90c0156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.058+0000 7f90c6d26700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f90c00b21b0 0x7f90c0145300 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.058+0000 7f90c6d26700 1 --2- 172.21.15.36:0/3104002926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90c0060d20 0x7f90c00ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.058+0000 7f90c6d26700 1 -- 172.21.15.36:0/3104002926 >> 172.21.15.36:0/3104002926 conn(0x7f90c005c490 msgr2=0x7f90c0140180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:08.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.058+0000 7f90c6d26700 1 -- 172.21.15.36:0/3104002926 shutdown_connections 2022-01-10T01:33:08.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.058+0000 7f90c6d26700 1 -- 172.21.15.36:0/3104002926 wait complete. 2022-01-10T01:33:08.076 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:33:08.077 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:08.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:08.118 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:08.140 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:08.162 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:33:08.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:08.163 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:08.164 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:08.186 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2022-01-10T01:33:08.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:33:08.188 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2022-01-10T01:33:08.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:08.189 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:08.189 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:08.213 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:33:08.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:33:08.215 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:33:08.215 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:33:08.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f9d347700 1 Processor -- start 2022-01-10T01:33:08.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f9d347700 1 -- start start 2022-01-10T01:33:08.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f9d347700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f980b6580 0x7f7f980b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:08.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f9d347700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7f980b43c0 0x7f7f980b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:08.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f9d347700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f981440b0 con 0x7f7f98061d30 2022-01-10T01:33:08.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f9d347700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f980b6e50 con 0x7f7f980b43c0 2022-01-10T01:33:08.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f9d347700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f98143b70 con 0x7f7f980b6580 2022-01-10T01:33:08.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f967fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7f980b43c0 0x7f7f980b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:08.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f967fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7f980b43c0 0x7f7f980b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41394/0 (socket says 172.21.15.36:41394) 2022-01-10T01:33:08.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f967fc700 1 -- 172.21.15.36:0/1854972907 learned_addr learned my addr 172.21.15.36:0/1854972907 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:08.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f96ffd700 1 --2- 172.21.15.36:0/1854972907 >> v2:172.21.15.59:3300/0 conn(0x7f7f980b6580 0x7f7f980b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:08.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f967fc700 1 -- 172.21.15.36:0/1854972907 >> v2:172.21.15.59:3300/0 conn(0x7f7f980b6580 msgr2=0x7f7f980b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:08.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f967fc700 1 --2- 172.21.15.36:0/1854972907 >> v2:172.21.15.59:3300/0 conn(0x7f7f980b6580 0x7f7f980b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f967fc700 1 -- 172.21.15.36:0/1854972907 >> v1:172.21.15.59:6789/0 conn(0x7f7f98061d30 legacy=0x7f7f981466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:08.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f967fc700 1 -- 172.21.15.36:0/1854972907 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f98143e10 con 0x7f7f980b43c0 2022-01-10T01:33:08.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f967fc700 1 --2- 172.21.15.36:0/1854972907 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7f980b43c0 0x7f7f980b6960 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f7f98143120 tx=0x7f7f80006eb0).ready entity=mon.0 client_cookie=be60b7ef0617488e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:08.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f95ffb700 1 -- 172.21.15.36:0/1854972907 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f8000d610 con 0x7f7f980b43c0 2022-01-10T01:33:08.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f95ffb700 1 -- 172.21.15.36:0/1854972907 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f80000e90 con 0x7f7f980b43c0 2022-01-10T01:33:08.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.322+0000 7f7f95ffb700 1 -- 172.21.15.36:0/1854972907 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f8000d9a0 con 0x7f7f980b43c0 2022-01-10T01:33:08.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 -- 172.21.15.36:0/1854972907 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7f980b43c0 msgr2=0x7f7f980b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:08.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 --2- 172.21.15.36:0/1854972907 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7f980b43c0 0x7f7f980b6960 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f7f98143120 tx=0x7f7f80006eb0).stop 2022-01-10T01:33:08.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 -- 172.21.15.36:0/1854972907 shutdown_connections 2022-01-10T01:33:08.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 --2- 172.21.15.36:0/1854972907 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7f980b43c0 0x7f7f980b6960 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 --2- 172.21.15.36:0/1854972907 >> v2:172.21.15.59:3300/0 conn(0x7f7f980b6580 0x7f7f980b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 -- 172.21.15.36:0/1854972907 >> 172.21.15.36:0/1854972907 conn(0x7f7f9805c490 msgr2=0x7f7f9805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:08.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 -- 172.21.15.36:0/1854972907 shutdown_connections 2022-01-10T01:33:08.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 -- 172.21.15.36:0/1854972907 wait complete. 2022-01-10T01:33:08.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 Processor -- start 2022-01-10T01:33:08.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 -- start start 2022-01-10T01:33:08.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7f98061d30 0x7f7f980b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:08.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f980b43c0 0x7f7f980b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:08.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f980b6580 0x7f7f980b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:08.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9812b670 con 0x7f7f98061d30 2022-01-10T01:33:08.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980ae2a0 con 0x7f7f980b6580 2022-01-10T01:33:08.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f9d347700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f980ae540 con 0x7f7f980b43c0 2022-01-10T01:33:08.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f96ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7f98061d30 0x7f7f980b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:08.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f96ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7f98061d30 0x7f7f980b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41396/0 (socket says 172.21.15.36:41396) 2022-01-10T01:33:08.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f96ffd700 1 -- 172.21.15.36:0/1696461487 learned_addr learned my addr 172.21.15.36:0/1696461487 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:08.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f967fc700 1 --2- 172.21.15.36:0/1696461487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f980b43c0 0x7f7f980b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:08.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f977fe700 1 --2- 172.21.15.36:0/1696461487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f980b6580 0x7f7f980b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:08.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f96ffd700 1 -- 172.21.15.36:0/1696461487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f980b43c0 msgr2=0x7f7f980b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:08.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f96ffd700 1 --2- 172.21.15.36:0/1696461487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f980b43c0 0x7f7f980b2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f96ffd700 1 -- 172.21.15.36:0/1696461487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f980b6580 msgr2=0x7f7f980b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:08.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f96ffd700 1 --2- 172.21.15.36:0/1696461487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f980b6580 0x7f7f980b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.326+0000 7f7f96ffd700 1 -- 172.21.15.36:0/1696461487 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8000b1e0 con 0x7f7f98061d30 2022-01-10T01:33:08.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.330+0000 7f7f96ffd700 1 --2- 172.21.15.36:0/1696461487 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7f98061d30 0x7f7f980b2000 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f7f8800c000 tx=0x7f7f880091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:08.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.330+0000 7f7f8ffff700 1 -- 172.21.15.36:0/1696461487 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f8800c6a0 con 0x7f7f98061d30 2022-01-10T01:33:08.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.330+0000 7f7f8ffff700 1 -- 172.21.15.36:0/1696461487 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8800c800 con 0x7f7f98061d30 2022-01-10T01:33:08.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.330+0000 7f7f9d347700 1 -- 172.21.15.36:0/1696461487 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f980ae7e0 con 0x7f7f98061d30 2022-01-10T01:33:08.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.330+0000 7f7f8ffff700 1 -- 172.21.15.36:0/1696461487 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f8800cb60 con 0x7f7f98061d30 2022-01-10T01:33:08.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.330+0000 7f7f9d347700 1 -- 172.21.15.36:0/1696461487 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f98148420 con 0x7f7f98061d30 2022-01-10T01:33:08.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.330+0000 7f7f9d347700 1 -- 172.21.15.36:0/1696461487 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f980615f0 con 0x7f7f98061d30 2022-01-10T01:33:08.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.330+0000 7f7f8ffff700 1 -- 172.21.15.36:0/1696461487 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7f8800ccc0 con 0x7f7f98061d30 2022-01-10T01:33:08.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.330+0000 7f7f8ffff700 1 --2- 172.21.15.36:0/1696461487 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7f700535f0 0x7f7f70055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:08.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.330+0000 7f7f8ffff700 1 -- 172.21.15.36:0/1696461487 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f7f8806ba90 con 0x7f7f98061d30 2022-01-10T01:33:08.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.330+0000 7f7f967fc700 1 --2- 172.21.15.36:0/1696461487 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7f700535f0 0x7f7f70055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:08.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.334+0000 7f7f967fc700 1 --2- 172.21.15.36:0/1696461487 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7f700535f0 0x7f7f70055ab0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f7f8001c000 tx=0x7f7f80015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:08.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.338+0000 7f7f8ffff700 1 -- 172.21.15.36:0/1696461487 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7f88042ce0 con 0x7f7f98061d30 2022-01-10T01:33:08.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.470+0000 7f7f9d347700 1 -- 172.21.15.36:0/1696461487 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7f98057350 con 0x7f7f98061d30 2022-01-10T01:33:08.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.470+0000 7f7f8ffff700 1 -- 172.21.15.36:0/1696461487 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v134) v1 ==== 81+0+29229 (secure 0 0 0) 0x7f7f880102b0 con 0x7f7f98061d30 2022-01-10T01:33:08.478 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:08.478 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:33:08.478 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 134, 2022-01-10T01:33:08.478 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:33:08.479 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:33:08.479 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:33:05.742854+0000", 2022-01-10T01:33:08.479 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:33:08.479 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:33:08.480 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:33:08.480 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:33:08.480 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:33:08.481 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:33:08.481 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:33:08.481 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:33:08.481 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:33:08.482 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:08.482 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:33:08.482 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:33:08.482 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:33:08.483 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:33:08.483 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:33:08.483 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 24, 2022-01-10T01:33:08.483 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:33:08.484 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:33:08.484 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:33:08.484 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:33:08.484 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:33:08.484 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.485 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:33:08.485 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:33:08.485 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:33:08.485 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:08.486 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:08.486 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:08.486 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:08.486 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:08.487 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:08.487 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:08.487 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:08.487 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:33:08.487 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:33:08.488 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:33:08.488 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:33:08.488 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:33:08.488 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:08.489 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:08.489 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:08.489 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:08.489 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:08.489 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:08.490 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:08.490 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.490 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:33:08.490 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:08.491 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:08.491 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:08.491 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:08.491 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:08.492 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:08.492 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:08.492 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:08.492 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:08.492 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:08.493 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:08.493 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:08.493 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:08.493 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:08.493 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:08.494 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:08.494 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:08.494 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:08.494 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:08.495 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:08.495 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:08.495 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:08.495 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:08.496 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:08.496 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:08.496 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:08.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.497 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:08.497 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:08.497 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:08.497 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:08.498 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:08.498 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:08.498 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:08.498 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:08.498 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:08.499 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:08.499 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:08.499 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:33:08.499 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:33:08.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.500 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:08.500 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:33:08.500 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.501 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.501 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.501 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:33:08.501 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:33:08.501 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:33:08.502 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:08.502 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:08.502 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:08.502 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:08.503 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:08.503 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:08.503 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:08.503 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:08.504 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:33:08.504 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:33:08.504 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:33:08.504 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:33:08.504 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:33:08.505 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:08.505 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:08.505 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:08.505 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:08.506 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:08.506 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:08.506 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:08.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.506 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:33:08.507 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:08.507 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:08.507 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:08.507 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:08.508 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:08.508 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:08.508 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:08.508 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:08.508 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:08.509 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:08.509 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:08.509 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:08.509 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:08.510 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:08.510 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:08.510 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:08.510 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:08.511 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:08.511 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:08.511 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:08.511 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:08.512 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:08.512 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:08.512 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:08.512 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:08.512 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:08.513 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.513 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:08.513 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:08.513 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:08.514 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:08.514 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:08.514 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:08.514 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:08.514 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:08.515 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:08.515 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:08.515 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:08.515 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:33:08.516 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:08.516 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:33:08.516 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.516 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.516 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:08.517 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:33:08.517 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.517 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:33:08.517 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:33:08.518 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:08.518 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:08.518 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:08.518 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:08.519 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:08.519 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:08.519 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:08.519 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 107, 2022-01-10T01:33:08.519 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:08.520 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:08.520 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:08.520 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.520 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.520 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.521 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:33:08.521 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:08.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.522 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.522 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:33:08.522 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:08.522 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.523 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.523 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:08.523 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.523 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.524 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.524 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:33:08.524 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:08.524 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.525 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.525 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.525 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:33:08.525 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:08.526 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.526 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.526 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.526 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:08.527 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.527 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.527 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.527 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:33:08.528 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:08.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.528 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.529 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:33:08.529 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:08.529 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.529 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.529 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.530 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:08.530 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.530 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.531 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:33:08.531 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:08.531 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.531 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.532 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.532 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:33:08.532 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:08.532 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.533 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.533 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.533 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:33:08.533 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:33:08.533 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:33:08.534 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:33:08.534 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:08.534 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:08.535 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:08.535 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.535 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.535 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.536 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:33:08.536 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:33:08.536 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:08.536 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:08.536 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:08.537 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:08.537 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:08.537 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:08.537 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:08.538 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 130, 2022-01-10T01:33:08.538 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:08.538 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:08.538 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:08.539 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.539 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.539 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.539 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:33:08.539 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:08.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.540 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.540 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.540 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:33:08.541 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:08.541 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.541 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.541 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.541 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:08.542 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.542 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.542 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.542 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:33:08.543 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:08.543 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.543 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.543 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.544 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:33:08.544 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:08.544 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.544 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.544 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.545 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:08.545 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.545 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.546 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.546 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:33:08.546 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:08.546 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.547 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.547 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.547 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:33:08.547 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:08.547 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.548 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.548 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:08.548 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.549 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.549 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:33:08.549 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:08.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.550 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.550 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.550 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:33:08.550 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:08.551 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.551 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.551 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.551 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:33:08.552 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:33:08.552 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:33:08.552 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:33:08.552 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:08.552 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:08.553 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:08.553 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.553 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.553 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.554 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:33:08.554 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:33:08.554 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:08.554 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:08.555 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:08.555 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:08.555 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:08.555 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:08.555 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:08.556 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 125, 2022-01-10T01:33:08.556 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:08.556 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:08.556 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:08.557 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.557 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.557 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.557 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:33:08.557 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:08.558 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.558 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.558 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.558 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:33:08.559 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:08.559 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.559 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.559 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.560 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:08.560 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.560 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.560 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.561 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:33:08.561 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:08.561 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.561 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.561 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.562 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:33:08.562 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:08.562 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.562 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.563 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.563 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:08.563 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.563 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.563 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.564 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:33:08.564 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:08.564 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.564 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.564 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.565 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:33:08.565 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:08.565 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.565 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.565 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.566 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:08.566 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.566 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.566 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.567 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:33:08.567 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:08.567 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.567 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.567 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.568 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:33:08.568 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:08.568 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.568 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.568 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.569 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:33:08.569 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:33:08.569 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:33:08.569 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:33:08.570 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:08.570 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:08.570 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:08.570 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.571 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.571 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:33:08.571 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:33:08.572 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:08.572 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:08.572 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:08.572 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:08.572 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:08.573 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:08.573 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:08.573 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 130, 2022-01-10T01:33:08.573 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:08.574 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:08.574 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:08.574 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.575 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.575 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:33:08.575 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:08.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.576 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.576 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:33:08.576 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:08.576 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.576 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.577 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:08.577 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.577 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.578 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.578 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:33:08.578 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:08.578 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.579 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.579 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:33:08.579 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:08.580 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.580 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.580 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:08.581 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.581 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.581 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.581 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:33:08.581 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:08.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.582 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.582 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:33:08.583 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:08.583 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.583 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.583 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.583 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:08.584 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.584 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.584 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.584 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:33:08.585 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:08.585 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.585 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.586 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:33:08.586 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:08.586 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.586 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.587 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:33:08.587 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:33:08.587 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:33:08.587 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:33:08.588 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:08.588 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:08.588 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:08.588 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.589 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.589 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:33:08.589 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:33:08.589 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:08.590 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:08.590 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:08.590 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:08.590 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:08.591 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:08.591 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:08.591 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 130, 2022-01-10T01:33:08.591 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:08.591 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:08.592 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:08.592 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.592 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.593 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:33:08.593 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:08.593 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.593 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.594 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:33:08.594 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:08.594 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.594 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.595 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:08.595 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.595 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.596 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:33:08.596 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:08.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.597 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.597 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:33:08.597 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:08.597 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.597 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.598 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.598 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:08.598 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.598 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.599 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.599 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:33:08.599 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:08.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.600 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.600 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.600 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:33:08.600 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:08.600 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.601 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.601 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:08.601 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.602 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.602 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:33:08.602 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:08.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.603 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.603 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:33:08.603 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:08.604 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.604 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.604 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.604 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:33:08.605 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:33:08.605 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:33:08.605 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:33:08.605 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:08.606 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:08.606 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:08.606 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.607 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:33:08.607 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:33:08.607 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:08.607 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:08.608 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:08.608 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:08.608 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:08.609 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:08.609 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:08.609 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 130, 2022-01-10T01:33:08.609 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:08.610 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:08.610 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:08.610 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.611 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.611 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:33:08.611 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:08.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.612 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.612 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:33:08.612 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:08.612 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.613 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.613 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:08.613 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.614 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.614 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:33:08.614 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:08.615 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.615 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.615 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.615 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:33:08.616 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:08.616 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.616 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.617 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:08.617 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.617 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.617 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.618 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:33:08.618 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:08.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.619 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.619 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:33:08.619 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:08.620 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.620 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.620 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:08.620 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.621 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.621 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.621 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:33:08.621 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:08.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.622 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.622 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:33:08.623 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:08.623 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.623 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.623 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:33:08.624 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:33:08.624 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:33:08.624 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:33:08.624 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:08.625 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:08.625 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:08.625 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.626 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:33:08.626 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:33:08.626 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:08.627 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:08.627 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:08.627 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:08.627 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:08.628 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:08.628 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:08.628 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 125, 2022-01-10T01:33:08.628 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:08.628 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:08.629 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:08.629 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.630 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.630 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:33:08.630 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:08.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.631 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.631 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.631 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:33:08.632 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:08.632 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.632 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.632 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.632 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:08.633 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.633 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.633 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:33:08.634 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:08.634 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.634 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.634 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.634 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:33:08.635 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:08.635 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.635 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.636 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.636 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:08.636 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.636 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.637 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:33:08.637 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:08.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.637 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.638 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:33:08.638 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:08.638 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.638 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.639 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.639 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:08.639 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.640 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.640 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:33:08.640 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:08.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.641 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.641 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.641 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:33:08.642 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:08.642 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.642 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.642 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.643 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:33:08.643 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:33:08.643 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:33:08.643 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:33:08.644 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:08.644 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:08.644 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:08.644 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.645 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.645 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:33:08.645 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:33:08.645 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:08.646 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:08.646 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:08.646 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:08.647 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:08.647 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:08.647 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:08.647 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 130, 2022-01-10T01:33:08.648 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:08.648 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:08.648 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:08.648 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.648 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.649 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.649 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:33:08.649 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:08.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.650 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.650 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:33:08.650 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:08.651 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.651 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.651 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.652 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:08.652 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.652 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.652 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.653 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:33:08.653 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:08.653 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.654 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.654 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:33:08.654 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:08.654 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.654 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.655 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:08.655 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.655 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.656 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.656 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:33:08.656 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:08.656 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.657 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.657 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:33:08.657 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:08.658 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.658 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.658 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:08.659 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:08.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.659 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:08.659 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:33:08.660 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:08.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.660 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:08.660 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:33:08.661 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:08.661 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.661 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.662 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.662 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:33:08.662 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:33:08.663 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:33:08.663 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:33:08.663 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:08.663 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:08.664 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:08.664 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:08.664 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.664 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:08.664 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:33:08.665 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.665 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:33:08.665 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:08.665 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:08.666 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:08.666 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:08.666 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:08.666 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:33:08.667 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:08.667 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.667 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.668 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:33:08.668 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:08.668 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:08.668 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:08.669 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:08.669 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:08.669 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:33:08.669 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:08.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.670 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:33:08.670 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:08.671 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:08.671 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:08.671 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:08.671 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:08.671 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:33:08.672 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:08.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.673 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:33:08.673 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:08.673 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:08.673 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:08.674 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:08.674 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:08.674 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:33:08.674 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:08.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.675 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:33:08.676 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:08.676 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:08.676 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:08.676 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:08.676 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:08.677 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:33:08.677 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:08.677 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.677 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.678 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:33:08.678 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:08.678 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:08.678 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:08.679 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:08.679 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:08.679 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:33:08.679 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:08.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.680 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:33:08.680 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:08.680 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:08.681 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:08.681 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:08.681 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:08.681 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:33:08.681 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:08.682 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.682 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:08.682 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:33:08.682 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:08.683 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:08.683 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:08.683 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:08.684 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:08.684 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:33:08.684 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:08.684 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.685 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:08.685 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:33:08.685 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:33:08.685 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:33:08.685 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:33:08.686 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": { 2022-01-10T01:33:08.686 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.36:6835/1669955501": "2022-01-11T01:32:45.980043+0000", 2022-01-10T01:33:08.686 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.36:6834/1669955501": "2022-01-11T01:32:45.980043+0000" 2022-01-10T01:33:08.686 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.687 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:33:08.687 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:33:08.687 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:33:08.687 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:33:08.688 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:33:08.688 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:33:08.688 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:33:08.688 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:33:08.688 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:33:08.689 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:33:08.689 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:33:08.689 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:33:08.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.690 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:33:08.691 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:33:08.691 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:33:08.691 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:33:08.691 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:33:08.692 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:33:08.692 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:33:08.692 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:08.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:08.693 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:33:08.693 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:33:08.693 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:33:08.693 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:33:08.693 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:33:08.694 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:33:08.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.474+0000 7f7f9d347700 1 -- 172.21.15.36:0/1696461487 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7f700535f0 msgr2=0x7f7f70055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:08.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.474+0000 7f7f9d347700 1 --2- 172.21.15.36:0/1696461487 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7f700535f0 0x7f7f70055ab0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f7f8001c000 tx=0x7f7f80015000).stop 2022-01-10T01:33:08.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.474+0000 7f7f9d347700 1 -- 172.21.15.36:0/1696461487 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7f98061d30 msgr2=0x7f7f980b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:08.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.474+0000 7f7f9d347700 1 --2- 172.21.15.36:0/1696461487 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7f98061d30 0x7f7f980b2000 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7f7f8800c000 tx=0x7f7f880091d0).stop 2022-01-10T01:33:08.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.474+0000 7f7f9d347700 1 -- 172.21.15.36:0/1696461487 shutdown_connections 2022-01-10T01:33:08.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.474+0000 7f7f9d347700 1 --2- 172.21.15.36:0/1696461487 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7f700535f0 0x7f7f70055ab0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.474+0000 7f7f9d347700 1 --2- 172.21.15.36:0/1696461487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f980b6580 0x7f7f980b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.474+0000 7f7f9d347700 1 --2- 172.21.15.36:0/1696461487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f980b43c0 0x7f7f980b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.474+0000 7f7f9d347700 1 --2- 172.21.15.36:0/1696461487 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7f98061d30 0x7f7f980b2000 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.698 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.474+0000 7f7f9d347700 1 -- 172.21.15.36:0/1696461487 >> 172.21.15.36:0/1696461487 conn(0x7f7f9805c490 msgr2=0x7f7f980b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:08.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.474+0000 7f7f9d347700 1 -- 172.21.15.36:0/1696461487 shutdown_connections 2022-01-10T01:33:08.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.474+0000 7f7f9d347700 1 -- 172.21.15.36:0/1696461487 wait complete. 2022-01-10T01:33:08.700 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:08.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25ee346700 1 Processor -- start 2022-01-10T01:33:08.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25ee346700 1 -- start start 2022-01-10T01:33:08.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25ee346700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25e80ad5c0 0x7f25e8061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:08.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25ee346700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f25e8140440 0x7f25e81408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:08.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25ee346700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e80aecf0 con 0x7f25e8061320 2022-01-10T01:33:08.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25ee346700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e80b6f20 con 0x7f25e8140440 2022-01-10T01:33:08.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25ee346700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e80aef20 con 0x7f25e80ad5c0 2022-01-10T01:33:08.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25edb45700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f25e8140440 0x7f25e81408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:08.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25edb45700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f25e8140440 0x7f25e81408f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41408/0 (socket says 172.21.15.36:41408) 2022-01-10T01:33:08.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25edb45700 1 -- 172.21.15.36:0/1546300668 learned_addr learned my addr 172.21.15.36:0/1546300668 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:08.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25ecb43700 1 --2- 172.21.15.36:0/1546300668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25e80ad5c0 0x7f25e8061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:08.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25edb45700 1 -- 172.21.15.36:0/1546300668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25e80ad5c0 msgr2=0x7f25e8061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:08.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25edb45700 1 --2- 172.21.15.36:0/1546300668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25e80ad5c0 0x7f25e8061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25edb45700 1 -- 172.21.15.36:0/1546300668 >> v1:172.21.15.59:6789/0 conn(0x7f25e8061320 legacy=0x7f25e80b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:08.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25edb45700 1 -- 172.21.15.36:0/1546300668 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e80af1c0 con 0x7f25e8140440 2022-01-10T01:33:08.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25edb45700 1 --2- 172.21.15.36:0/1546300668 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25e8140440 0x7f25e81408f0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f25e00032f0 tx=0x7f25e0009290).ready entity=mon.0 client_cookie=4ba09a618b6dd8db server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:08.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25dffff700 1 -- 172.21.15.36:0/1546300668 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e000b8a0 con 0x7f25e8140440 2022-01-10T01:33:08.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25dffff700 1 -- 172.21.15.36:0/1546300668 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e000ba00 con 0x7f25e8140440 2022-01-10T01:33:08.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.806+0000 7f25dffff700 1 -- 172.21.15.36:0/1546300668 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25e000bb70 con 0x7f25e8140440 2022-01-10T01:33:08.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 -- 172.21.15.36:0/1546300668 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25e8140440 msgr2=0x7f25e81408f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:08.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 --2- 172.21.15.36:0/1546300668 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25e8140440 0x7f25e81408f0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7f25e00032f0 tx=0x7f25e0009290).stop 2022-01-10T01:33:08.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 -- 172.21.15.36:0/1546300668 shutdown_connections 2022-01-10T01:33:08.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 --2- 172.21.15.36:0/1546300668 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25e8140440 0x7f25e81408f0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 --2- 172.21.15.36:0/1546300668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25e80ad5c0 0x7f25e8061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 -- 172.21.15.36:0/1546300668 >> 172.21.15.36:0/1546300668 conn(0x7f25e8066de0 msgr2=0x7f25e80671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:08.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 -- 172.21.15.36:0/1546300668 shutdown_connections 2022-01-10T01:33:08.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 -- 172.21.15.36:0/1546300668 wait complete. 2022-01-10T01:33:08.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 Processor -- start 2022-01-10T01:33:08.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 -- start start 2022-01-10T01:33:08.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25e8061320 0x7f25e8141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:08.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25e80ad5c0 0x7f25e8145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:08.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25e8140440 0x7f25e81458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:08.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e80b0160 con 0x7f25e8061320 2022-01-10T01:33:08.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e81563c0 con 0x7f25e80ad5c0 2022-01-10T01:33:08.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ee346700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e8156660 con 0x7f25e8140440 2022-01-10T01:33:08.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.810+0000 7f25ed344700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25e8061320 0x7f25e8141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:08.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25ed344700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25e8061320 0x7f25e8141980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41410/0 (socket says 172.21.15.36:41410) 2022-01-10T01:33:08.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25ed344700 1 -- 172.21.15.36:0/4076958807 learned_addr learned my addr 172.21.15.36:0/4076958807 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:08.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25ecb43700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25e80ad5c0 0x7f25e8145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:08.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25edb45700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25e8140440 0x7f25e81458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:08.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25ed344700 1 -- 172.21.15.36:0/4076958807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25e8140440 msgr2=0x7f25e81458f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:08.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25ed344700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25e8140440 0x7f25e81458f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25ed344700 1 -- 172.21.15.36:0/4076958807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25e80ad5c0 msgr2=0x7f25e8145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:08.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25ed344700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25e80ad5c0 0x7f25e8145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:08.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25ed344700 1 -- 172.21.15.36:0/4076958807 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e0009530 con 0x7f25e8061320 2022-01-10T01:33:08.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25ecb43700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25e80ad5c0 0x7f25e8145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:08.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25ed344700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25e8061320 0x7f25e8141980 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f25e80b6ae0 tx=0x7f25d8007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:08.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25de7fc700 1 -- 172.21.15.36:0/4076958807 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25d8012400 con 0x7f25e8061320 2022-01-10T01:33:08.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25de7fc700 1 -- 172.21.15.36:0/4076958807 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d8012560 con 0x7f25e8061320 2022-01-10T01:33:08.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25ee346700 1 -- 172.21.15.36:0/4076958807 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e80b0560 con 0x7f25e8061320 2022-01-10T01:33:08.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25de7fc700 1 -- 172.21.15.36:0/4076958807 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f25d80128c0 con 0x7f25e8061320 2022-01-10T01:33:08.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25ee346700 1 -- 172.21.15.36:0/4076958807 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e80b0a90 con 0x7f25e8061320 2022-01-10T01:33:08.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.814+0000 7f25ee346700 1 -- 172.21.15.36:0/4076958807 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e8156200 con 0x7f25e8061320 2022-01-10T01:33:08.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.818+0000 7f25de7fc700 1 -- 172.21.15.36:0/4076958807 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f25d8019030 con 0x7f25e8061320 2022-01-10T01:33:08.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.818+0000 7f25de7fc700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f25d00535f0 0x7f25d0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:08.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.818+0000 7f25de7fc700 1 -- 172.21.15.36:0/4076958807 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f25d806ac00 con 0x7f25e8061320 2022-01-10T01:33:08.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.818+0000 7f25ecb43700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f25d00535f0 0x7f25d0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:08.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.818+0000 7f25ecb43700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f25d00535f0 0x7f25d0055ab0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f25e400b000 tx=0x7f25e4006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:08.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.826+0000 7f25de7fc700 1 -- 172.21.15.36:0/4076958807 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f25d8070020 con 0x7f25e8061320 2022-01-10T01:33:08.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.990+0000 7f25ee346700 1 -- 172.21.15.36:0/4076958807 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25e80af460 con 0x7f25e8061320 2022-01-10T01:33:08.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.990+0000 7f25de7fc700 1 -- 172.21.15.36:0/4076958807 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+504 (secure 0 0 0) 0x7f25d8041e50 con 0x7f25e8061320 2022-01-10T01:33:08.997 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:08.998 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":63,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2022-01-10T01:33:08.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.994+0000 7f25ee346700 1 -- 172.21.15.36:0/4076958807 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f25d00535f0 msgr2=0x7f25d0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:08.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.994+0000 7f25ee346700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f25d00535f0 0x7f25d0055ab0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f25e400b000 tx=0x7f25e4006df0).stop 2022-01-10T01:33:09.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.994+0000 7f25ee346700 1 -- 172.21.15.36:0/4076958807 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25e8061320 msgr2=0x7f25e8141980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:09.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.994+0000 7f25ee346700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25e8061320 0x7f25e8141980 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f25e80b6ae0 tx=0x7f25d8007c50).stop 2022-01-10T01:33:09.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.994+0000 7f25ee346700 1 -- 172.21.15.36:0/4076958807 shutdown_connections 2022-01-10T01:33:09.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.994+0000 7f25ee346700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f25d00535f0 0x7f25d0055ab0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.994+0000 7f25ee346700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25e8140440 0x7f25e81458f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.994+0000 7f25ee346700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25e80ad5c0 0x7f25e8145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.994+0000 7f25ee346700 1 --2- 172.21.15.36:0/4076958807 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f25e8061320 0x7f25e8141980 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.994+0000 7f25ee346700 1 -- 172.21.15.36:0/4076958807 >> 172.21.15.36:0/4076958807 conn(0x7f25e8066de0 msgr2=0x7f25e80b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:09.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.994+0000 7f25ee346700 1 -- 172.21.15.36:0/4076958807 shutdown_connections 2022-01-10T01:33:09.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:08.994+0000 7f25ee346700 1 -- 172.21.15.36:0/4076958807 wait complete. 2022-01-10T01:33:09.002 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 63 2022-01-10T01:33:09.014 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:09.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.110+0000 7ff9bf0a2700 1 Processor -- start 2022-01-10T01:33:09.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.110+0000 7ff9bf0a2700 1 -- start start 2022-01-10T01:33:09.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.110+0000 7ff9bf0a2700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff9b80b2580 0x7ff9b814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.110+0000 7ff9bf0a2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff9b80b0010 0x7ff9b814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.110+0000 7ff9bf0a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b80afbd0 0x7ff9b80a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.110+0000 7ff9bf0a2700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b80a70c0 con 0x7ff9b80b2580 2022-01-10T01:33:09.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.110+0000 7ff9bf0a2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b80a72f0 con 0x7ff9b80b0010 2022-01-10T01:33:09.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.110+0000 7ff9bf0a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80a7590 con 0x7ff9b80afbd0 2022-01-10T01:33:09.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9be0a0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff9b80b2580 0x7ff9b814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bd89f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff9b80b0010 0x7ff9b814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9be8a1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b80afbd0 0x7ff9b80a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9be0a0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff9b80b2580 0x7ff9b814ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41418/0 (socket says 172.21.15.36:41418) 2022-01-10T01:33:09.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9be0a0700 1 -- 172.21.15.36:0/1148532675 learned_addr learned my addr 172.21.15.36:0/1148532675 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:09.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9be0a0700 1 -- 172.21.15.36:0/1148532675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b80afbd0 msgr2=0x7ff9b80a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:09.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9be0a0700 1 --2- 172.21.15.36:0/1148532675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b80afbd0 0x7ff9b80a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9be0a0700 1 -- 172.21.15.36:0/1148532675 >> v2:172.21.15.59:3300/0 conn(0x7ff9b80b0010 msgr2=0x7ff9b814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:09.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9be0a0700 1 --2- 172.21.15.36:0/1148532675 >> v2:172.21.15.59:3300/0 conn(0x7ff9b80b0010 0x7ff9b814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9be0a0700 1 -- 172.21.15.36:0/1148532675 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b80a7830 con 0x7ff9b80b2580 2022-01-10T01:33:09.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9be0a0700 1 --2- 172.21.15.36:0/1148532675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9b80b2580 0x7ff9b814ae40 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7ff9a8002f70 tx=0x7ff9a8006eb0).ready entity=mon.0 client_cookie=f4a04769bae3afb4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:09.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bd09e700 1 -- 172.21.15.36:0/1148532675 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9a800d570 con 0x7ff9b80b2580 2022-01-10T01:33:09.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bd09e700 1 -- 172.21.15.36:0/1148532675 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a8000e90 con 0x7ff9b80b2580 2022-01-10T01:33:09.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bd09e700 1 -- 172.21.15.36:0/1148532675 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9a800d900 con 0x7ff9b80b2580 2022-01-10T01:33:09.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1148532675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9b80b2580 msgr2=0x7ff9b814ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:09.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bf0a2700 1 --2- 172.21.15.36:0/1148532675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9b80b2580 0x7ff9b814ae40 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7ff9a8002f70 tx=0x7ff9a8006eb0).stop 2022-01-10T01:33:09.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1148532675 shutdown_connections 2022-01-10T01:33:09.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bf0a2700 1 --2- 172.21.15.36:0/1148532675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b80afbd0 0x7ff9b80a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bf0a2700 1 --2- 172.21.15.36:0/1148532675 >> v2:172.21.15.59:3300/0 conn(0x7ff9b80b0010 0x7ff9b814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bf0a2700 1 --2- 172.21.15.36:0/1148532675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9b80b2580 0x7ff9b814ae40 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1148532675 >> 172.21.15.36:0/1148532675 conn(0x7ff9b8060180 msgr2=0x7ff9b80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:09.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1148532675 shutdown_connections 2022-01-10T01:33:09.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1148532675 wait complete. 2022-01-10T01:33:09.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bf0a2700 1 Processor -- start 2022-01-10T01:33:09.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.114+0000 7ff9bf0a2700 1 -- start start 2022-01-10T01:33:09.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bf0a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b80afbd0 0x7ff9b8149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bf0a2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9b80b0010 0x7ff9b80a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bf0a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b80b2580 0x7ff9b80a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bf0a2700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80b5420 con 0x7ff9b80b0010 2022-01-10T01:33:09.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bf0a2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80b4d60 con 0x7ff9b80b2580 2022-01-10T01:33:09.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bf0a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b80b3640 con 0x7ff9b80afbd0 2022-01-10T01:33:09.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bd89f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9b80b0010 0x7ff9b80a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bd89f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9b80b0010 0x7ff9b80a97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41426/0 (socket says 172.21.15.36:41426) 2022-01-10T01:33:09.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9be8a1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b80b2580 0x7ff9b80a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bd89f700 1 -- 172.21.15.36:0/1359872216 learned_addr learned my addr 172.21.15.36:0/1359872216 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:09.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9be0a0700 1 --2- 172.21.15.36:0/1359872216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b80afbd0 0x7ff9b8149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bd89f700 1 -- 172.21.15.36:0/1359872216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b80afbd0 msgr2=0x7ff9b8149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:09.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bd89f700 1 --2- 172.21.15.36:0/1359872216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b80afbd0 0x7ff9b8149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bd89f700 1 -- 172.21.15.36:0/1359872216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b80b2580 msgr2=0x7ff9b80a9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:09.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bd89f700 1 --2- 172.21.15.36:0/1359872216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b80b2580 0x7ff9b80a9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bd89f700 1 -- 172.21.15.36:0/1359872216 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a800b1e0 con 0x7ff9b80b0010 2022-01-10T01:33:09.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9be0a0700 1 --2- 172.21.15.36:0/1359872216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b80afbd0 0x7ff9b8149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:09.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bd89f700 1 --2- 172.21.15.36:0/1359872216 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9b80b0010 0x7ff9b80a97a0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7ff9b80b4ea0 tx=0x7ff9b4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:09.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9a77fe700 1 -- 172.21.15.36:0/1359872216 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9b4010780 con 0x7ff9b80b0010 2022-01-10T01:33:09.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9a77fe700 1 -- 172.21.15.36:0/1359872216 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b40108e0 con 0x7ff9b80b0010 2022-01-10T01:33:09.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1359872216 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b80af750 con 0x7ff9b80b0010 2022-01-10T01:33:09.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9a77fe700 1 -- 172.21.15.36:0/1359872216 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9b4010c40 con 0x7ff9b80b0010 2022-01-10T01:33:09.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.118+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1359872216 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b80b3b10 con 0x7ff9b80b0010 2022-01-10T01:33:09.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.122+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1359872216 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b80b3cd0 con 0x7ff9b80b0010 2022-01-10T01:33:09.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.122+0000 7ff9a77fe700 1 -- 172.21.15.36:0/1359872216 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff9b401c460 con 0x7ff9b80b0010 2022-01-10T01:33:09.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.122+0000 7ff9a77fe700 1 --2- 172.21.15.36:0/1359872216 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff998053680 0x7ff998055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.122+0000 7ff9be0a0700 1 --2- 172.21.15.36:0/1359872216 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff998053680 0x7ff998055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.122+0000 7ff9a77fe700 1 -- 172.21.15.36:0/1359872216 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ff9b406bd00 con 0x7ff9b80b0010 2022-01-10T01:33:09.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.122+0000 7ff9be0a0700 1 --2- 172.21.15.36:0/1359872216 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff998053680 0x7ff998055b40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7ff9a801a000 tx=0x7ff9a8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:09.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.126+0000 7ff9a77fe700 1 -- 172.21.15.36:0/1359872216 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff9b4042e80 con 0x7ff9b80b0010 2022-01-10T01:33:09.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.290+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1359872216 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9b8057350 con 0x7ff9b80b0010 2022-01-10T01:33:09.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.290+0000 7ff9a77fe700 1 -- 172.21.15.36:0/1359872216 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+504 (secure 0 0 0) 0x7ff9b40464a0 con 0x7ff9b80b0010 2022-01-10T01:33:09.296 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:09.296 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":63,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[]} 2022-01-10T01:33:09.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.290+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1359872216 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff998053680 msgr2=0x7ff998055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:09.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.290+0000 7ff9bf0a2700 1 --2- 172.21.15.36:0/1359872216 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff998053680 0x7ff998055b40 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7ff9a801a000 tx=0x7ff9a8015000).stop 2022-01-10T01:33:09.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.290+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1359872216 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9b80b0010 msgr2=0x7ff9b80a97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:09.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.290+0000 7ff9bf0a2700 1 --2- 172.21.15.36:0/1359872216 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9b80b0010 0x7ff9b80a97a0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7ff9b80b4ea0 tx=0x7ff9b4006df0).stop 2022-01-10T01:33:09.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.290+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1359872216 shutdown_connections 2022-01-10T01:33:09.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.290+0000 7ff9bf0a2700 1 --2- 172.21.15.36:0/1359872216 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff998053680 0x7ff998055b40 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.290+0000 7ff9bf0a2700 1 --2- 172.21.15.36:0/1359872216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b80b2580 0x7ff9b80a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.290+0000 7ff9bf0a2700 1 --2- 172.21.15.36:0/1359872216 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff9b80b0010 0x7ff9b80a97a0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.290+0000 7ff9bf0a2700 1 --2- 172.21.15.36:0/1359872216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b80afbd0 0x7ff9b8149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.290+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1359872216 >> 172.21.15.36:0/1359872216 conn(0x7ff9b8060180 msgr2=0x7ff9b814b990 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:09.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.290+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1359872216 shutdown_connections 2022-01-10T01:33:09.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.290+0000 7ff9bf0a2700 1 -- 172.21.15.36:0/1359872216 wait complete. 2022-01-10T01:33:09.301 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 63 2022-01-10T01:33:09.309 INFO:tasks.ceph.mds.a:Restarting daemon 2022-01-10T01:33:09.310 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-01-10T01:33:09.310 INFO:tasks.ceph.mds.c:Restarting daemon 2022-01-10T01:33:09.311 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-01-10T01:33:09.311 INFO:tasks.ceph.mds.b:Restarting daemon 2022-01-10T01:33:09.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-01-10T01:33:09.314 INFO:tasks.ceph.mds.a:Started 2022-01-10T01:33:09.314 DEBUG:teuthology.parallel:result is None 2022-01-10T01:33:09.315 INFO:tasks.ceph.mds.b:Started 2022-01-10T01:33:09.316 INFO:tasks.ceph.mds.c:Started 2022-01-10T01:33:09.316 DEBUG:teuthology.parallel:result is None 2022-01-10T01:33:09.316 DEBUG:teuthology.parallel:result is None 2022-01-10T01:33:09.317 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2022-01-10T01:33:09.378 INFO:tasks.ceph.mds.c.smithi036.stdout:starting mds.c at 2022-01-10T01:33:09.385 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:33:09.389 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:33:09.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.406+0000 7fe7140c0700 1 Processor -- start 2022-01-10T01:33:09.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.406+0000 7fe7140c0700 1 -- start start 2022-01-10T01:33:09.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.406+0000 7fe7140c0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe70c0b21c0 0x7fe70c0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.406+0000 7fe7140c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe70c13a0a0 0x7fe70c0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.406+0000 7fe7140c0700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c0ad070 con 0x7fe70c139cc0 2022-01-10T01:33:09.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.406+0000 7fe7140c0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c0b2730 con 0x7fe70c0b21c0 2022-01-10T01:33:09.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.406+0000 7fe7140c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c060d40 con 0x7fe70c13a0a0 2022-01-10T01:33:09.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.406+0000 7fe711e5c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe70c139cc0 0x7fe70c1434f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39250/0 (socket says 172.21.15.36:39250) 2022-01-10T01:33:09.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.406+0000 7fe711e5c700 1 -- 172.21.15.36:0/981587344 learned_addr learned my addr 172.21.15.36:0/981587344 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:09.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe71265d700 1 --2- 172.21.15.36:0/981587344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe70c13a0a0 0x7fe70c0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe71165b700 1 --2- 172.21.15.36:0/981587344 >> v2:172.21.15.59:3300/0 conn(0x7fe70c0b21c0 0x7fe70c0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 -- 172.21.15.36:0/981587344 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736435664 0 0) 0x7fe704001490 con 0x7fe70c139cc0 2022-01-10T01:33:09.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 -- 172.21.15.36:0/981587344 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f8003260 con 0x7fe70c139cc0 2022-01-10T01:33:09.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 -- 172.21.15.36:0/981587344 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 357419638 0 0) 0x7fe6f8003260 con 0x7fe70c139cc0 2022-01-10T01:33:09.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 -- 172.21.15.36:0/981587344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe70c13a0a0 msgr2=0x7fe70c0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:09.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 --2- 172.21.15.36:0/981587344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe70c13a0a0 0x7fe70c0b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 -- 172.21.15.36:0/981587344 >> v2:172.21.15.59:3300/0 conn(0x7fe70c0b21c0 msgr2=0x7fe70c0acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:09.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 --2- 172.21.15.36:0/981587344 >> v2:172.21.15.59:3300/0 conn(0x7fe70c0b21c0 0x7fe70c0acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 -- 172.21.15.36:0/981587344 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c060fa0 con 0x7fe70c139cc0 2022-01-10T01:33:09.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 -- 172.21.15.36:0/981587344 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fe704001b70 con 0x7fe70c139cc0 2022-01-10T01:33:09.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 -- 172.21.15.36:0/981587344 >> v1:172.21.15.36:6789/0 conn(0x7fe70c139cc0 legacy=0x7fe70c1434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:09.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 --2- 172.21.15.36:0/981587344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6f8003750 0x7fe6f8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 --2- 172.21.15.36:0/981587344 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f8004500 0x7fe6f8004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 --2- 172.21.15.36:0/981587344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6f8004e70 0x7fe6f800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 -- 172.21.15.36:0/981587344 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b2730 con 0x7fe6f8004500 2022-01-10T01:33:09.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 -- 172.21.15.36:0/981587344 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c060d40 con 0x7fe6f8004e70 2022-01-10T01:33:09.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe710e5a700 1 -- 172.21.15.36:0/981587344 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f800bc40 con 0x7fe6f8003750 2022-01-10T01:33:09.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe71165b700 1 --2- 172.21.15.36:0/981587344 >> v2:172.21.15.59:3300/0 conn(0x7fe70c0b21c0 0x7fe70c0acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:09.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe71265d700 1 --2- 172.21.15.36:0/981587344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe70c13a0a0 0x7fe70c0b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:09.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe711e5c700 1 --2- 172.21.15.36:0/981587344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6f8003750 0x7fe6f8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe71165b700 1 --2- 172.21.15.36:0/981587344 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f8004500 0x7fe6f8004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe71265d700 1 --2- 172.21.15.36:0/981587344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6f8004e70 0x7fe6f800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe71165b700 1 -- 172.21.15.36:0/981587344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6f8003750 msgr2=0x7fe6f8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:09.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe71165b700 1 --2- 172.21.15.36:0/981587344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6f8003750 0x7fe6f8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe71165b700 1 -- 172.21.15.36:0/981587344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6f8004e70 msgr2=0x7fe6f800b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:09.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe71165b700 1 --2- 172.21.15.36:0/981587344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6f8004e70 0x7fe6f800b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe71165b700 1 -- 172.21.15.36:0/981587344 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f8003260 con 0x7fe6f8004500 2022-01-10T01:33:09.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.410+0000 7fe71165b700 1 --2- 172.21.15.36:0/981587344 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f8004500 0x7fe6f8004980 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fe70000c000 tx=0x7fe700006df0).ready entity=mon.0 client_cookie=758c4a0ec474d628 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:09.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.414+0000 7fe710e5a700 1 -- 172.21.15.36:0/981587344 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe70000e830 con 0x7fe6f8004500 2022-01-10T01:33:09.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.414+0000 7fe710e5a700 1 -- 172.21.15.36:0/981587344 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70000e990 con 0x7fe6f8004500 2022-01-10T01:33:09.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.414+0000 7fe710e5a700 1 -- 172.21.15.36:0/981587344 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe70000ecf0 con 0x7fe6f8004500 2022-01-10T01:33:09.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.414+0000 7fe7140c0700 1 -- 172.21.15.36:0/981587344 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f8004500 msgr2=0x7fe6f8004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:09.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.414+0000 7fe7140c0700 1 --2- 172.21.15.36:0/981587344 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe6f8004500 0x7fe6f8004980 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7fe70000c000 tx=0x7fe700006df0).stop 2022-01-10T01:33:09.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.414+0000 7fe71265d700 1 -- 172.21.15.36:0/981587344 reap_dead start 2022-01-10T01:33:09.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.414+0000 7fe7140c0700 1 -- 172.21.15.36:0/981587344 shutdown_connections 2022-01-10T01:33:09.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.414+0000 7fe7140c0700 1 -- 172.21.15.36:0/981587344 >> 172.21.15.36:0/981587344 conn(0x7fe70c0b3480 msgr2=0x7fe70c0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:09.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.414+0000 7fe7140c0700 1 -- 172.21.15.36:0/981587344 shutdown_connections 2022-01-10T01:33:09.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.414+0000 7fe7140c0700 1 -- 172.21.15.36:0/981587344 wait complete. 2022-01-10T01:33:09.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.414+0000 7fe7140c0700 1 Processor -- start 2022-01-10T01:33:09.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe7140c0700 1 -- start start 2022-01-10T01:33:09.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe7140c0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe70c0ad460 0x7fe70c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe7140c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe70c066e60 0x7fe70c0ae040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe7140c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe70c0aeb60 0x7fe70c151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe7140c0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c131150 con 0x7fe70c0ad460 2022-01-10T01:33:09.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe7140c0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c1313f0 con 0x7fe70c0aeb60 2022-01-10T01:33:09.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe7140c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c131690 con 0x7fe70c066e60 2022-01-10T01:33:09.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe711e5c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe70c0ad460 0x7fe70c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe711e5c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe70c0ad460 0x7fe70c0ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41468/0 (socket says 172.21.15.36:41468) 2022-01-10T01:33:09.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe711e5c700 1 -- 172.21.15.36:0/3371724560 learned_addr learned my addr 172.21.15.36:0/3371724560 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:09.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe71165b700 1 --2- 172.21.15.36:0/3371724560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe70c066e60 0x7fe70c0ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe71265d700 1 --2- 172.21.15.36:0/3371724560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe70c0aeb60 0x7fe70c151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe711e5c700 1 -- 172.21.15.36:0/3371724560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe70c066e60 msgr2=0x7fe70c0ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:09.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe711e5c700 1 --2- 172.21.15.36:0/3371724560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe70c066e60 0x7fe70c0ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe711e5c700 1 -- 172.21.15.36:0/3371724560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe70c0aeb60 msgr2=0x7fe70c151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:09.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe711e5c700 1 --2- 172.21.15.36:0/3371724560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe70c0aeb60 0x7fe70c151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:09.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe711e5c700 1 -- 172.21.15.36:0/3371724560 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c0b0290 con 0x7fe70c0ad460 2022-01-10T01:33:09.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe711e5c700 1 --2- 172.21.15.36:0/3371724560 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe70c0ad460 0x7fe70c0ad840 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7fe70400d000 tx=0x7fe704007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:09.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe70affd700 1 -- 172.21.15.36:0/3371724560 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe70400f9e0 con 0x7fe70c0ad460 2022-01-10T01:33:09.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe70affd700 1 -- 172.21.15.36:0/3371724560 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70400fb40 con 0x7fe70c0ad460 2022-01-10T01:33:09.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe70affd700 1 -- 172.21.15.36:0/3371724560 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe70400fea0 con 0x7fe70c0ad460 2022-01-10T01:33:09.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe7140c0700 1 -- 172.21.15.36:0/3371724560 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70c1521f0 con 0x7fe70c0ad460 2022-01-10T01:33:09.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe7140c0700 1 -- 172.21.15.36:0/3371724560 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c12ef00 con 0x7fe70c0ad460 2022-01-10T01:33:09.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.418+0000 7fe7140c0700 1 -- 172.21.15.36:0/3371724560 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70c0b0420 con 0x7fe70c0ad460 2022-01-10T01:33:09.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.422+0000 7fe70affd700 1 -- 172.21.15.36:0/3371724560 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe70401b030 con 0x7fe70c0ad460 2022-01-10T01:33:09.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.422+0000 7fe70affd700 1 --2- 172.21.15.36:0/3371724560 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe6ec053590 0x7fe6ec055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:09.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.422+0000 7fe70affd700 1 -- 172.21.15.36:0/3371724560 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fe70406b440 con 0x7fe70c0ad460 2022-01-10T01:33:09.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.422+0000 7fe71165b700 1 --2- 172.21.15.36:0/3371724560 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe6ec053590 0x7fe6ec055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:09.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.422+0000 7fe71165b700 1 --2- 172.21.15.36:0/3371724560 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe6ec053590 0x7fe6ec055a50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fe70001d000 tx=0x7fe700019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:09.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.426+0000 7fe70affd700 1 -- 172.21.15.36:0/3371724560 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe7040426d0 con 0x7fe70c0ad460 2022-01-10T01:33:09.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:09.566+0000 7fe7140c0700 1 -- 172.21.15.36:0/3371724560 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fe70c0add30 con 0x7fe70c0ad460 2022-01-10T01:33:10.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.418+0000 7fe70affd700 1 -- 172.21.15.36:0/3371724560 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v135) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe704019030 con 0x7fe70c0ad460 2022-01-10T01:33:10.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.422+0000 7fe7140c0700 1 -- 172.21.15.36:0/3371724560 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe6ec053590 msgr2=0x7fe6ec055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:10.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.422+0000 7fe7140c0700 1 --2- 172.21.15.36:0/3371724560 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe6ec053590 0x7fe6ec055a50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fe70001d000 tx=0x7fe700019000).stop 2022-01-10T01:33:10.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.422+0000 7fe7140c0700 1 -- 172.21.15.36:0/3371724560 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe70c0ad460 msgr2=0x7fe70c0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:10.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.422+0000 7fe7140c0700 1 --2- 172.21.15.36:0/3371724560 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe70c0ad460 0x7fe70c0ad840 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7fe70400d000 tx=0x7fe704007ac0).stop 2022-01-10T01:33:10.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.422+0000 7fe7140c0700 1 -- 172.21.15.36:0/3371724560 shutdown_connections 2022-01-10T01:33:10.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.422+0000 7fe7140c0700 1 --2- 172.21.15.36:0/3371724560 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe6ec053590 0x7fe6ec055a50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.422+0000 7fe7140c0700 1 --2- 172.21.15.36:0/3371724560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe70c0aeb60 0x7fe70c151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.422+0000 7fe7140c0700 1 --2- 172.21.15.36:0/3371724560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe70c066e60 0x7fe70c0ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.422+0000 7fe7140c0700 1 --2- 172.21.15.36:0/3371724560 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe70c0ad460 0x7fe70c0ad840 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.422+0000 7fe7140c0700 1 -- 172.21.15.36:0/3371724560 >> 172.21.15.36:0/3371724560 conn(0x7fe70c0b3480 msgr2=0x7fe70c05f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:10.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.422+0000 7fe7140c0700 1 -- 172.21.15.36:0/3371724560 shutdown_connections 2022-01-10T01:33:10.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.422+0000 7fe7140c0700 1 -- 172.21.15.36:0/3371724560 wait complete. 2022-01-10T01:33:10.432 INFO:teuthology.orchestra.run.smithi036.stderr: removed all blacklist entries 2022-01-10T01:33:10.442 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2022-01-10T01:33:10.442 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2022-01-10T01:33:10.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 Processor -- start 2022-01-10T01:33:10.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 -- start start 2022-01-10T01:33:10.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6040b1db0 0x7fd6040b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:10.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd6040a70c0 0x7fd604144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:10.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6040b0350 con 0x7fd6041483a0 2022-01-10T01:33:10.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6040a90c0 con 0x7fd6040a70c0 2022-01-10T01:33:10.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6040b05f0 con 0x7fd6040b1db0 2022-01-10T01:33:10.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd6094df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6040b1db0 0x7fd6040b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:10.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd609ce0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd6040a70c0 0x7fd604144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:10.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd6094df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6040b1db0 0x7fd6040b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:47762/0 (socket says 172.21.15.36:47762) 2022-01-10T01:33:10.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd6094df700 1 -- 172.21.15.36:0/4044297327 learned_addr learned my addr 172.21.15.36:0/4044297327 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:10.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd6094df700 1 -- 172.21.15.36:0/4044297327 >> v2:172.21.15.59:3300/0 conn(0x7fd6040a70c0 msgr2=0x7fd604144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:10.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd6094df700 1 --2- 172.21.15.36:0/4044297327 >> v2:172.21.15.59:3300/0 conn(0x7fd6040a70c0 0x7fd604144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd6094df700 1 -- 172.21.15.36:0/4044297327 >> v1:172.21.15.59:6789/0 conn(0x7fd6041483a0 legacy=0x7fd6040b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:10.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd6094df700 1 -- 172.21.15.36:0/4044297327 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6040b0890 con 0x7fd6040b1db0 2022-01-10T01:33:10.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd609ce0700 1 --2- 172.21.15.36:0/4044297327 >> v2:172.21.15.59:3300/0 conn(0x7fd6040a70c0 0x7fd604144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:10.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd6094df700 1 --2- 172.21.15.36:0/4044297327 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6040b1db0 0x7fd6040b0fd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fd600002f70 tx=0x7fd600006eb0).ready entity=mon.2 client_cookie=cb23c4a085f858c1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:10.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd5effff700 1 -- 172.21.15.36:0/4044297327 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd60000d570 con 0x7fd6040b1db0 2022-01-10T01:33:10.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd5effff700 1 -- 172.21.15.36:0/4044297327 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd600000e90 con 0x7fd6040b1db0 2022-01-10T01:33:10.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd5effff700 1 -- 172.21.15.36:0/4044297327 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd60000d900 con 0x7fd6040b1db0 2022-01-10T01:33:10.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 -- 172.21.15.36:0/4044297327 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6040b1db0 msgr2=0x7fd6040b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:10.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 --2- 172.21.15.36:0/4044297327 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6040b1db0 0x7fd6040b0fd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fd600002f70 tx=0x7fd600006eb0).stop 2022-01-10T01:33:10.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 -- 172.21.15.36:0/4044297327 shutdown_connections 2022-01-10T01:33:10.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 --2- 172.21.15.36:0/4044297327 >> v2:172.21.15.59:3300/0 conn(0x7fd6040a70c0 0x7fd604144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 --2- 172.21.15.36:0/4044297327 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6040b1db0 0x7fd6040b0fd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 -- 172.21.15.36:0/4044297327 >> 172.21.15.36:0/4044297327 conn(0x7fd60405f6b0 msgr2=0x7fd60405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:10.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 -- 172.21.15.36:0/4044297327 shutdown_connections 2022-01-10T01:33:10.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.546+0000 7fd60b743700 1 -- 172.21.15.36:0/4044297327 wait complete. 2022-01-10T01:33:10.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd60b743700 1 Processor -- start 2022-01-10T01:33:10.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd60b743700 1 -- start start 2022-01-10T01:33:10.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd60b743700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6040a70c0 0x7fd60414b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:10.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd60b743700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6040b1db0 0x7fd604143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:10.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd60b743700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6041483a0 0x7fd604143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:10.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd60b743700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd604149bf0 con 0x7fd6040b1db0 2022-01-10T01:33:10.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd60b743700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60414b990 con 0x7fd6041483a0 2022-01-10T01:33:10.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd60b743700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd604149e20 con 0x7fd6040a70c0 2022-01-10T01:33:10.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd608cde700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6040b1db0 0x7fd604143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:10.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd608cde700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6040b1db0 0x7fd604143840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41488/0 (socket says 172.21.15.36:41488) 2022-01-10T01:33:10.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd608cde700 1 -- 172.21.15.36:0/3394975513 learned_addr learned my addr 172.21.15.36:0/3394975513 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:10.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd609ce0700 1 --2- 172.21.15.36:0/3394975513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6041483a0 0x7fd604143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:10.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd6094df700 1 --2- 172.21.15.36:0/3394975513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6040a70c0 0x7fd60414b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:10.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd608cde700 1 -- 172.21.15.36:0/3394975513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6040a70c0 msgr2=0x7fd60414b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:10.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd608cde700 1 --2- 172.21.15.36:0/3394975513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6040a70c0 0x7fd60414b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd608cde700 1 -- 172.21.15.36:0/3394975513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6041483a0 msgr2=0x7fd604143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:10.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd608cde700 1 --2- 172.21.15.36:0/3394975513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6041483a0 0x7fd604143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd608cde700 1 -- 172.21.15.36:0/3394975513 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc009470 con 0x7fd6040b1db0 2022-01-10T01:33:10.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd608cde700 1 --2- 172.21.15.36:0/3394975513 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6040b1db0 0x7fd604143840 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7fd6040613a0 tx=0x7fd5f8007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:10.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.550+0000 7fd5f6ffd700 1 -- 172.21.15.36:0/3394975513 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f800ce50 con 0x7fd6040b1db0 2022-01-10T01:33:10.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.554+0000 7fd5f6ffd700 1 -- 172.21.15.36:0/3394975513 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8007030 con 0x7fd6040b1db0 2022-01-10T01:33:10.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.554+0000 7fd60b743700 1 -- 172.21.15.36:0/3394975513 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60000b1e0 con 0x7fd6040b1db0 2022-01-10T01:33:10.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.554+0000 7fd5f6ffd700 1 -- 172.21.15.36:0/3394975513 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f8007390 con 0x7fd6040b1db0 2022-01-10T01:33:10.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.554+0000 7fd60b743700 1 -- 172.21.15.36:0/3394975513 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6040ab5c0 con 0x7fd6040b1db0 2022-01-10T01:33:10.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.554+0000 7fd60b743700 1 -- 172.21.15.36:0/3394975513 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd604057350 con 0x7fd6040b1db0 2022-01-10T01:33:10.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.554+0000 7fd5f6ffd700 1 -- 172.21.15.36:0/3394975513 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd5f8010030 con 0x7fd6040b1db0 2022-01-10T01:33:10.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.554+0000 7fd5f6ffd700 1 --2- 172.21.15.36:0/3394975513 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd5e0053560 0x7fd5e0055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:10.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.554+0000 7fd5f6ffd700 1 -- 172.21.15.36:0/3394975513 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fd5f806b290 con 0x7fd6040b1db0 2022-01-10T01:33:10.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.554+0000 7fd6094df700 1 --2- 172.21.15.36:0/3394975513 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd5e0053560 0x7fd5e0055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:10.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.554+0000 7fd6094df700 1 --2- 172.21.15.36:0/3394975513 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd5e0053560 0x7fd5e0055a20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fd60001c000 tx=0x7fd600015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:10.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.562+0000 7fd5f6ffd700 1 -- 172.21.15.36:0/3394975513 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd5f8042540 con 0x7fd6040b1db0 2022-01-10T01:33:10.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.730+0000 7fd60b743700 1 -- 172.21.15.36:0/3394975513 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd604044650 con 0x7fd6040b1db0 2022-01-10T01:33:10.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.730+0000 7fd5f6ffd700 1 -- 172.21.15.36:0/3394975513 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v30) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fd5f8045b60 con 0x7fd6040b1db0 2022-01-10T01:33:10.737 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:10.737 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:33:10.738 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_dump": [ 2022-01-10T01:33:10.738 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.739 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.a", 2022-01-10T01:33:10.739 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthuGT4IxAA5DyijS4tPjdOLn5uiLXEPg==", 2022-01-10T01:33:10.740 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.740 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:33:10.741 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:10.741 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:10.742 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:10.742 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.743 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.743 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.743 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.b", 2022-01-10T01:33:10.744 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthkvX0LRAAtz19usFvoObvouQeLFwicg==", 2022-01-10T01:33:10.744 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.745 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:33:10.745 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:10.745 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:10.746 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:10.746 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.747 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.747 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.c", 2022-01-10T01:33:10.748 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthbvUmKhAA0pVpDJO1AfsAzIHU1cAHiw==", 2022-01-10T01:33:10.748 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.748 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:33:10.749 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:10.749 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:10.750 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:10.750 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.750 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.751 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.751 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.0", 2022-01-10T01:33:10.752 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCWitthk4iKHRAAF7aFP+i24xFvXXm8j5GzVg==", 2022-01-10T01:33:10.752 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.752 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:10.753 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:10.753 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:10.754 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.754 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.754 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.755 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.1", 2022-01-10T01:33:10.755 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCZitthsKSXABAAb3IkNvlyLub89HwaPWZ1Bg==", 2022-01-10T01:33:10.756 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.756 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:10.757 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:10.757 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:10.757 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.758 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.758 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.758 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.2", 2022-01-10T01:33:10.759 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCbitthvNzhIBAAXkZ6FslnMl1gS/rOa7G+Vg==", 2022-01-10T01:33:10.759 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.759 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:10.760 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:10.760 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:10.760 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.761 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.762 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.3", 2022-01-10T01:33:10.762 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCeitth9P7EAxAA7KOCP7Rh5oN1yqCz9I6v3A==", 2022-01-10T01:33:10.763 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.763 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:10.764 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:10.764 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:10.764 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.764 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.765 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.765 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.4", 2022-01-10T01:33:10.765 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCjitth/L1UBxAAskxmSV0aE6CSvDFR8O/+SQ==", 2022-01-10T01:33:10.765 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.766 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:10.766 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:10.766 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:10.766 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.766 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.767 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.5", 2022-01-10T01:33:10.767 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQClitthMoY6JhAAeeIrCmMcm3MpDPtdLUf+2g==", 2022-01-10T01:33:10.767 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.768 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:10.768 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:10.768 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:10.768 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.768 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.769 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.769 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.6", 2022-01-10T01:33:10.769 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCoitthrUhlCxAAsYhU7Kj6HMo/kD0DezvITg==", 2022-01-10T01:33:10.769 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.770 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:10.770 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:10.770 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:10.770 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.771 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.771 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.771 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.7", 2022-01-10T01:33:10.771 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCqitthFaLrKRAAC2g1OlcV2KTtaOXsyCrIrQ==", 2022-01-10T01:33:10.771 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.772 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:10.772 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:10.772 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:10.772 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.773 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.773 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.0", 2022-01-10T01:33:10.773 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthKoa/NBAADjvHh99F8YOktGID9uyttg==", 2022-01-10T01:33:10.773 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.774 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:33:10.774 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:33:10.775 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:33:10.775 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.776 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.1", 2022-01-10T01:33:10.776 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth3x76OBAAPTrw8OUmnpEflWuB7zzaHg==", 2022-01-10T01:33:10.777 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.777 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:33:10.778 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:33:10.778 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:33:10.779 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.780 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.admin", 2022-01-10T01:33:10.780 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthf9dqChAADHRsoZKuozdsqb41ztuR7w==", 2022-01-10T01:33:10.781 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.781 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:33:10.782 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:10.782 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:10.782 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:10.782 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.783 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.783 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.783 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.x", 2022-01-10T01:33:10.783 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth39syIRAA6pOvLWw2ADy72TWZ65MIkA==", 2022-01-10T01:33:10.784 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.784 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:33:10.784 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:33:10.784 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:10.784 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.785 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:10.785 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:10.785 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.y", 2022-01-10T01:33:10.785 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth4novHRAACVMjo72kOB/T7Ti/CiN27w==", 2022-01-10T01:33:10.786 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:10.786 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:33:10.786 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:33:10.786 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:10.786 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.787 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:10.787 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:10.787 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:33:10.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.734+0000 7fd60b743700 1 -- 172.21.15.36:0/3394975513 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd5e0053560 msgr2=0x7fd5e0055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:10.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.734+0000 7fd60b743700 1 --2- 172.21.15.36:0/3394975513 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd5e0053560 0x7fd5e0055a20 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fd60001c000 tx=0x7fd600015000).stop 2022-01-10T01:33:10.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.734+0000 7fd60b743700 1 -- 172.21.15.36:0/3394975513 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6040b1db0 msgr2=0x7fd604143840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:10.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.734+0000 7fd60b743700 1 --2- 172.21.15.36:0/3394975513 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6040b1db0 0x7fd604143840 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7fd6040613a0 tx=0x7fd5f8007bd0).stop 2022-01-10T01:33:10.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.734+0000 7fd60b743700 1 -- 172.21.15.36:0/3394975513 shutdown_connections 2022-01-10T01:33:10.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.734+0000 7fd60b743700 1 --2- 172.21.15.36:0/3394975513 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd5e0053560 0x7fd5e0055a20 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.734+0000 7fd60b743700 1 --2- 172.21.15.36:0/3394975513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6041483a0 0x7fd604143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.734+0000 7fd60b743700 1 --2- 172.21.15.36:0/3394975513 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd6040b1db0 0x7fd604143840 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.734+0000 7fd60b743700 1 --2- 172.21.15.36:0/3394975513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6040a70c0 0x7fd60414b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.734+0000 7fd60b743700 1 -- 172.21.15.36:0/3394975513 >> 172.21.15.36:0/3394975513 conn(0x7fd60405f6b0 msgr2=0x7fd604147770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:10.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.734+0000 7fd60b743700 1 -- 172.21.15.36:0/3394975513 shutdown_connections 2022-01-10T01:33:10.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.734+0000 7fd60b743700 1 -- 172.21.15.36:0/3394975513 wait complete. 2022-01-10T01:33:10.792 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:33:10.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.894+0000 7faa7d8a2700 1 Processor -- start 2022-01-10T01:33:10.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.894+0000 7faa7d8a2700 1 -- start start 2022-01-10T01:33:10.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.894+0000 7faa7d8a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa780b2580 0x7faa7814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:10.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.894+0000 7faa7d8a2700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faa780b0010 0x7faa7814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:10.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.894+0000 7faa7d8a2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa780a70c0 con 0x7faa780afbd0 2022-01-10T01:33:10.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.894+0000 7faa7d8a2700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa780a72f0 con 0x7faa780b0010 2022-01-10T01:33:10.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.894+0000 7faa7d8a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa780a7590 con 0x7faa780b2580 2022-01-10T01:33:10.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.894+0000 7faa77fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faa780b0010 0x7faa7814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:10.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.894+0000 7faa77fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7faa780b0010 0x7faa7814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41494/0 (socket says 172.21.15.36:41494) 2022-01-10T01:33:10.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.894+0000 7faa77fff700 1 -- 172.21.15.36:0/4155033044 learned_addr learned my addr 172.21.15.36:0/4155033044 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:10.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa7c8a0700 1 --2- 172.21.15.36:0/4155033044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa780b2580 0x7faa7814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:10.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa777fe700 1 -- 172.21.15.36:0/4155033044 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616640757 0 0) 0x7faa780a70c0 con 0x7faa780afbd0 2022-01-10T01:33:10.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa77fff700 1 -- 172.21.15.36:0/4155033044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa780b2580 msgr2=0x7faa7814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:10.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa77fff700 1 --2- 172.21.15.36:0/4155033044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa780b2580 0x7faa7814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa77fff700 1 -- 172.21.15.36:0/4155033044 >> v1:172.21.15.59:6789/0 conn(0x7faa780afbd0 legacy=0x7faa780a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:10.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa77fff700 1 -- 172.21.15.36:0/4155033044 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780a7830 con 0x7faa780b0010 2022-01-10T01:33:10.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa77fff700 1 --2- 172.21.15.36:0/4155033044 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa780b0010 0x7faa7814b330 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7faa64002f70 tx=0x7faa64006eb0).ready entity=mon.0 client_cookie=6f6e22d611ab4e67 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:10.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa777fe700 1 -- 172.21.15.36:0/4155033044 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6400d570 con 0x7faa780b0010 2022-01-10T01:33:10.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa777fe700 1 -- 172.21.15.36:0/4155033044 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa64000e90 con 0x7faa780b0010 2022-01-10T01:33:10.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa777fe700 1 -- 172.21.15.36:0/4155033044 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa6400d8c0 con 0x7faa780b0010 2022-01-10T01:33:10.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa7d8a2700 1 -- 172.21.15.36:0/4155033044 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa780b0010 msgr2=0x7faa7814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:10.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa7d8a2700 1 --2- 172.21.15.36:0/4155033044 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa780b0010 0x7faa7814b330 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7faa64002f70 tx=0x7faa64006eb0).stop 2022-01-10T01:33:10.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa7d8a2700 1 -- 172.21.15.36:0/4155033044 shutdown_connections 2022-01-10T01:33:10.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa7d8a2700 1 --2- 172.21.15.36:0/4155033044 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa780b0010 0x7faa7814b330 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa7d8a2700 1 --2- 172.21.15.36:0/4155033044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa780b2580 0x7faa7814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa7d8a2700 1 -- 172.21.15.36:0/4155033044 >> 172.21.15.36:0/4155033044 conn(0x7faa78060180 msgr2=0x7faa780b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:10.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa7d8a2700 1 -- 172.21.15.36:0/4155033044 shutdown_connections 2022-01-10T01:33:10.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa7d8a2700 1 -- 172.21.15.36:0/4155033044 wait complete. 2022-01-10T01:33:10.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa7d8a2700 1 Processor -- start 2022-01-10T01:33:10.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.898+0000 7faa7d8a2700 1 -- start start 2022-01-10T01:33:10.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa7d8a2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa780afbd0 0x7faa7814cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:10.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa7d8a2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa780b0010 0x7faa7813e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:10.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa7d8a2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa780b2580 0x7faa7813e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:10.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa7d8a2700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa780b3790 con 0x7faa780b0010 2022-01-10T01:33:10.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa7d8a2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa780b4e50 con 0x7faa780b2580 2022-01-10T01:33:10.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa7d8a2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa780b39c0 con 0x7faa780afbd0 2022-01-10T01:33:10.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa77fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa780b0010 0x7faa7813e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:10.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa77fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa780b0010 0x7faa7813e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41502/0 (socket says 172.21.15.36:41502) 2022-01-10T01:33:10.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa77fff700 1 -- 172.21.15.36:0/1306850834 learned_addr learned my addr 172.21.15.36:0/1306850834 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:10.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa7d0a1700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa780b2580 0x7faa7813e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:10.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa7c8a0700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa780afbd0 0x7faa7814cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:10.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa77fff700 1 -- 172.21.15.36:0/1306850834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa780afbd0 msgr2=0x7faa7814cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:10.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa77fff700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa780afbd0 0x7faa7814cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa77fff700 1 -- 172.21.15.36:0/1306850834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa780b2580 msgr2=0x7faa7813e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:10.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa77fff700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa780b2580 0x7faa7813e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:10.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa77fff700 1 -- 172.21.15.36:0/1306850834 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6400b1e0 con 0x7faa780b0010 2022-01-10T01:33:10.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa7d0a1700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa780b2580 0x7faa7813e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:10.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa77fff700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa780b0010 0x7faa7813e420 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7faa64002f70 tx=0x7faa64015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:10.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa75ffb700 1 -- 172.21.15.36:0/1306850834 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa64011990 con 0x7faa780b0010 2022-01-10T01:33:10.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa75ffb700 1 -- 172.21.15.36:0/1306850834 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa64011af0 con 0x7faa780b0010 2022-01-10T01:33:10.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa7d8a2700 1 -- 172.21.15.36:0/1306850834 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa780b4ad0 con 0x7faa780b0010 2022-01-10T01:33:10.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa75ffb700 1 -- 172.21.15.36:0/1306850834 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa64011e50 con 0x7faa780b0010 2022-01-10T01:33:10.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa7d8a2700 1 -- 172.21.15.36:0/1306850834 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa780b32e0 con 0x7faa780b0010 2022-01-10T01:33:10.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa7d8a2700 1 -- 172.21.15.36:0/1306850834 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa78057350 con 0x7faa780b0010 2022-01-10T01:33:10.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.902+0000 7faa75ffb700 1 -- 172.21.15.36:0/1306850834 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7faa64025030 con 0x7faa780b0010 2022-01-10T01:33:10.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.906+0000 7faa75ffb700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faa580536b0 0x7faa58055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:10.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.906+0000 7faa75ffb700 1 -- 172.21.15.36:0/1306850834 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5600+0+0 (secure 0 0 0) 0x7faa6406c9c0 con 0x7faa780b0010 2022-01-10T01:33:10.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.906+0000 7faa7c8a0700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faa580536b0 0x7faa58055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:10.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.906+0000 7faa7c8a0700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faa580536b0 0x7faa58055b70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7faa6c00b000 tx=0x7faa6c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:10.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:10.910+0000 7faa75ffb700 1 -- 172.21.15.36:0/1306850834 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7faa64043c90 con 0x7faa780b0010 2022-01-10T01:33:11.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.034+0000 7faa7d8a2700 1 -- 172.21.15.36:0/1306850834 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa7813efa0 con 0x7faa780b0010 2022-01-10T01:33:11.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.038+0000 7faa75ffb700 1 -- 172.21.15.36:0/1306850834 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+13424 (secure 0 0 0) 0x7faa64023020 con 0x7faa780b0010 2022-01-10T01:33:11.043 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:11.043 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":135,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:33:10.414080+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":107,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:33:11.045 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.038+0000 7faa7d8a2700 1 -- 172.21.15.36:0/1306850834 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faa580536b0 msgr2=0x7faa58055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.038+0000 7faa7d8a2700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faa580536b0 0x7faa58055b70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7faa6c00b000 tx=0x7faa6c008040).stop 2022-01-10T01:33:11.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.038+0000 7faa7d8a2700 1 -- 172.21.15.36:0/1306850834 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa780b0010 msgr2=0x7faa7813e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.046 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.038+0000 7faa7d8a2700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa780b0010 0x7faa7813e420 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7faa64002f70 tx=0x7faa64015000).stop 2022-01-10T01:33:11.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.038+0000 7faa7d8a2700 1 -- 172.21.15.36:0/1306850834 shutdown_connections 2022-01-10T01:33:11.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.038+0000 7faa7d8a2700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faa580536b0 0x7faa58055b70 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.038+0000 7faa7d8a2700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa780b2580 0x7faa7813e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.038+0000 7faa7d8a2700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7faa780b0010 0x7faa7813e420 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.038+0000 7faa7d8a2700 1 --2- 172.21.15.36:0/1306850834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa780afbd0 0x7faa7814cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.038+0000 7faa7d8a2700 1 -- 172.21.15.36:0/1306850834 >> 172.21.15.36:0/1306850834 conn(0x7faa78060180 msgr2=0x7faa78149730 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:11.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.038+0000 7faa7d8a2700 1 -- 172.21.15.36:0/1306850834 shutdown_connections 2022-01-10T01:33:11.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.038+0000 7faa7d8a2700 1 -- 172.21.15.36:0/1306850834 wait complete. 2022-01-10T01:33:11.057 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-01-10T01:33:11.057 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:33:11.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe938b32700 1 Processor -- start 2022-01-10T01:33:11.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe938b32700 1 -- start start 2022-01-10T01:33:11.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe938b32700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe9340b2580 0x7fe93414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe938b32700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9340a70c0 con 0x7fe9340b0010 2022-01-10T01:33:11.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe938b32700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9340a72f0 con 0x7fe9340a8ac0 2022-01-10T01:33:11.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe938b32700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9340a7590 con 0x7fe9340b2580 2022-01-10T01:33:11.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe92bfff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe9340b0010 0x7fe9340a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39304/0 (socket says 172.21.15.36:39304) 2022-01-10T01:33:11.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe92bfff700 1 -- 172.21.15.36:0/1390726609 learned_addr learned my addr 172.21.15.36:0/1390726609 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:11.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe9337fe700 1 --2- 172.21.15.36:0/1390726609 >> v2:172.21.15.36:3300/0 conn(0x7fe9340b2580 0x7fe93414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe932ffd700 1 -- 172.21.15.36:0/1390726609 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254944189 0 0) 0x7fe9340a70c0 con 0x7fe9340b0010 2022-01-10T01:33:11.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe932ffd700 1 -- 172.21.15.36:0/1390726609 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe914003260 con 0x7fe9340b0010 2022-01-10T01:33:11.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe9337fe700 1 -- 172.21.15.36:0/1390726609 >> v1:172.21.15.59:6789/0 conn(0x7fe9340a8ac0 legacy=0x7fe934151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe9337fe700 1 -- 172.21.15.36:0/1390726609 >> v1:172.21.15.36:6789/0 conn(0x7fe9340b0010 legacy=0x7fe9340a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe932ffd700 1 -- 172.21.15.36:0/1390726609 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3675219540 0 0) 0x7fe914003260 con 0x7fe9340b0010 2022-01-10T01:33:11.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe9337fe700 1 -- 172.21.15.36:0/1390726609 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9340a7830 con 0x7fe9340b2580 2022-01-10T01:33:11.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe9337fe700 1 --2- 172.21.15.36:0/1390726609 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9340b2580 0x7fe93414ae40 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7fe91c001800 tx=0x7fe924006df0).ready entity=mon.0 client_cookie=1f51a1765338b188 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:11.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe932ffd700 1 -- 172.21.15.36:0/1390726609 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c001660 con 0x7fe9340b2580 2022-01-10T01:33:11.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe932ffd700 1 -- 172.21.15.36:0/1390726609 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe924000e90 con 0x7fe9340b2580 2022-01-10T01:33:11.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe932ffd700 1 -- 172.21.15.36:0/1390726609 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe92400d4f0 con 0x7fe9340b2580 2022-01-10T01:33:11.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe938b32700 1 -- 172.21.15.36:0/1390726609 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9340b2580 msgr2=0x7fe93414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe938b32700 1 --2- 172.21.15.36:0/1390726609 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9340b2580 0x7fe93414ae40 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7fe91c001800 tx=0x7fe924006df0).stop 2022-01-10T01:33:11.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe938b32700 1 -- 172.21.15.36:0/1390726609 shutdown_connections 2022-01-10T01:33:11.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe938b32700 1 --2- 172.21.15.36:0/1390726609 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9340b2580 0x7fe93414ae40 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.166+0000 7fe938b32700 1 -- 172.21.15.36:0/1390726609 >> 172.21.15.36:0/1390726609 conn(0x7fe934060180 msgr2=0x7fe9340b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:11.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe938b32700 1 -- 172.21.15.36:0/1390726609 shutdown_connections 2022-01-10T01:33:11.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe938b32700 1 -- 172.21.15.36:0/1390726609 wait complete. 2022-01-10T01:33:11.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe938b32700 1 Processor -- start 2022-01-10T01:33:11.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe938b32700 1 -- start start 2022-01-10T01:33:11.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe938b32700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9340a8ac0 0x7fe934063c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe938b32700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9340b0010 0x7fe934066810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe938b32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9340b2580 0x7fe934066d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe938b32700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe934157550 con 0x7fe9340b0010 2022-01-10T01:33:11.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe938b32700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9341572b0 con 0x7fe9340a8ac0 2022-01-10T01:33:11.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe938b32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9341490e0 con 0x7fe9340b2580 2022-01-10T01:33:11.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe92bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9340b0010 0x7fe934066810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe92bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9340b0010 0x7fe934066810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41518/0 (socket says 172.21.15.36:41518) 2022-01-10T01:33:11.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe92bfff700 1 -- 172.21.15.36:0/2554246566 learned_addr learned my addr 172.21.15.36:0/2554246566 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:11.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe9337fe700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9340a8ac0 0x7fe934063c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe933fff700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9340b2580 0x7fe934066d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe92bfff700 1 -- 172.21.15.36:0/2554246566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9340b2580 msgr2=0x7fe934066d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe92bfff700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9340b2580 0x7fe934066d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe92bfff700 1 -- 172.21.15.36:0/2554246566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9340a8ac0 msgr2=0x7fe934063c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe92bfff700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9340a8ac0 0x7fe934063c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe92bfff700 1 -- 172.21.15.36:0/2554246566 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92400b180 con 0x7fe9340b0010 2022-01-10T01:33:11.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe9337fe700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9340a8ac0 0x7fe934063c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:11.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe933fff700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9340b2580 0x7fe934066d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:11.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe92bfff700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9340b0010 0x7fe934066810 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fe91c0018c0 tx=0x7fe91c001dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:11.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe9317fa700 1 -- 172.21.15.36:0/2554246566 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c0070d0 con 0x7fe9340b0010 2022-01-10T01:33:11.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe9317fa700 1 -- 172.21.15.36:0/2554246566 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c007230 con 0x7fe9340b0010 2022-01-10T01:33:11.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe938b32700 1 -- 172.21.15.36:0/2554246566 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe934157000 con 0x7fe9340b0010 2022-01-10T01:33:11.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe9317fa700 1 -- 172.21.15.36:0/2554246566 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c0055f0 con 0x7fe9340b0010 2022-01-10T01:33:11.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.170+0000 7fe938b32700 1 -- 172.21.15.36:0/2554246566 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe934154180 con 0x7fe9340b0010 2022-01-10T01:33:11.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.174+0000 7fe938b32700 1 -- 172.21.15.36:0/2554246566 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9341492a0 con 0x7fe9340b0010 2022-01-10T01:33:11.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.174+0000 7fe9317fa700 1 -- 172.21.15.36:0/2554246566 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe91c01a060 con 0x7fe9340b0010 2022-01-10T01:33:11.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.174+0000 7fe9317fa700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe918053680 0x7fe918055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.174+0000 7fe9317fa700 1 -- 172.21.15.36:0/2554246566 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fe91c06afb0 con 0x7fe9340b0010 2022-01-10T01:33:11.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.174+0000 7fe9337fe700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe918053680 0x7fe918055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.174+0000 7fe9337fe700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe918053680 0x7fe918055b40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fe92401a000 tx=0x7fe924014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:11.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.182+0000 7fe9317fa700 1 -- 172.21.15.36:0/2554246566 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe91c042300 con 0x7fe9340b0010 2022-01-10T01:33:11.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.310+0000 7fe938b32700 1 -- 172.21.15.36:0/2554246566 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe934057350 con 0x7fe9340b0010 2022-01-10T01:33:11.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.310+0000 7fe9317fa700 1 -- 172.21.15.36:0/2554246566 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v135) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe91c018070 con 0x7fe9340b0010 2022-01-10T01:33:11.318 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:33:11.320 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.314+0000 7fe938b32700 1 -- 172.21.15.36:0/2554246566 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe918053680 msgr2=0x7fe918055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.321 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.314+0000 7fe938b32700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe918053680 0x7fe918055b40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fe92401a000 tx=0x7fe924014000).stop 2022-01-10T01:33:11.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.314+0000 7fe938b32700 1 -- 172.21.15.36:0/2554246566 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9340b0010 msgr2=0x7fe934066810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.314+0000 7fe938b32700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9340b0010 0x7fe934066810 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fe91c0018c0 tx=0x7fe91c001dc0).stop 2022-01-10T01:33:11.322 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.314+0000 7fe938b32700 1 -- 172.21.15.36:0/2554246566 shutdown_connections 2022-01-10T01:33:11.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.314+0000 7fe938b32700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe918053680 0x7fe918055b40 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.314+0000 7fe938b32700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9340b2580 0x7fe934066d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.314+0000 7fe938b32700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe9340b0010 0x7fe934066810 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.314+0000 7fe938b32700 1 --2- 172.21.15.36:0/2554246566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9340a8ac0 0x7fe934063c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.314+0000 7fe938b32700 1 -- 172.21.15.36:0/2554246566 >> 172.21.15.36:0/2554246566 conn(0x7fe934060180 msgr2=0x7fe9340b5100 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:11.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.314+0000 7fe938b32700 1 -- 172.21.15.36:0/2554246566 shutdown_connections 2022-01-10T01:33:11.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.314+0000 7fe938b32700 1 -- 172.21.15.36:0/2554246566 wait complete. 2022-01-10T01:33:11.331 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:33:11.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.438+0000 7f465d65c700 1 Processor -- start 2022-01-10T01:33:11.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.438+0000 7f465d65c700 1 -- start start 2022-01-10T01:33:11.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f465d65c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46580b6560 0x7f46580b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f465d65c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f46580b5990 0x7f46580b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f465d65c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4658143f60 con 0x7f465805fc00 2022-01-10T01:33:11.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f465d65c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46580ba6b0 con 0x7f46580b5990 2022-01-10T01:33:11.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f465d65c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465805ffe0 con 0x7f46580b6560 2022-01-10T01:33:11.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f46577fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f46580b5990 0x7f46580b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f46577fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f46580b5990 0x7f46580b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41526/0 (socket says 172.21.15.36:41526) 2022-01-10T01:33:11.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f46577fe700 1 -- 172.21.15.36:0/1126787126 learned_addr learned my addr 172.21.15.36:0/1126787126 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:11.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f46567fc700 1 --2- 172.21.15.36:0/1126787126 >> v2:172.21.15.59:3300/0 conn(0x7f46580b6560 0x7f46580b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f46577fe700 1 -- 172.21.15.36:0/1126787126 >> v2:172.21.15.59:3300/0 conn(0x7f46580b6560 msgr2=0x7f46580b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:11.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f46577fe700 1 --2- 172.21.15.36:0/1126787126 >> v2:172.21.15.59:3300/0 conn(0x7f46580b6560 0x7f46580b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f46577fe700 1 -- 172.21.15.36:0/1126787126 >> v1:172.21.15.59:6789/0 conn(0x7f465805fc00 legacy=0x7f46580b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:11.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f46577fe700 1 -- 172.21.15.36:0/1126787126 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4658143a50 con 0x7f46580b5990 2022-01-10T01:33:11.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f46577fe700 1 --2- 172.21.15.36:0/1126787126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f46580b5990 0x7f46580b4a00 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f4658143040 tx=0x7f4650009290).ready entity=mon.0 client_cookie=f5a3e3bbdeecd672 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:11.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f4655ffb700 1 -- 172.21.15.36:0/1126787126 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465000b830 con 0x7f46580b5990 2022-01-10T01:33:11.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f4655ffb700 1 -- 172.21.15.36:0/1126787126 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465000b990 con 0x7f46580b5990 2022-01-10T01:33:11.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f4655ffb700 1 -- 172.21.15.36:0/1126787126 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f465000bb40 con 0x7f46580b5990 2022-01-10T01:33:11.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f465d65c700 1 -- 172.21.15.36:0/1126787126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f46580b5990 msgr2=0x7f46580b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f465d65c700 1 --2- 172.21.15.36:0/1126787126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f46580b5990 0x7f46580b4a00 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7f4658143040 tx=0x7f4650009290).stop 2022-01-10T01:33:11.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f465d65c700 1 -- 172.21.15.36:0/1126787126 shutdown_connections 2022-01-10T01:33:11.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f465d65c700 1 --2- 172.21.15.36:0/1126787126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f46580b5990 0x7f46580b4a00 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f465d65c700 1 --2- 172.21.15.36:0/1126787126 >> v2:172.21.15.59:3300/0 conn(0x7f46580b6560 0x7f46580b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f465d65c700 1 -- 172.21.15.36:0/1126787126 >> 172.21.15.36:0/1126787126 conn(0x7f46580623a0 msgr2=0x7f4658066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:11.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f465d65c700 1 -- 172.21.15.36:0/1126787126 shutdown_connections 2022-01-10T01:33:11.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.442+0000 7f465d65c700 1 -- 172.21.15.36:0/1126787126 wait complete. 2022-01-10T01:33:11.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f465d65c700 1 Processor -- start 2022-01-10T01:33:11.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f465d65c700 1 -- start start 2022-01-10T01:33:11.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f465d65c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f465805fc00 0x7f4658149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f465d65c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46580b5990 0x7f4658152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f465d65c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46580b6560 0x7f4658152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f465d65c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46580af4f0 con 0x7f465805fc00 2022-01-10T01:33:11.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f465d65c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46580af790 con 0x7f46580b6560 2022-01-10T01:33:11.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f465d65c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46580afa30 con 0x7f46580b5990 2022-01-10T01:33:11.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f4656ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f465805fc00 0x7f4658149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f4656ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f465805fc00 0x7f4658149e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41528/0 (socket says 172.21.15.36:41528) 2022-01-10T01:33:11.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f4656ffd700 1 -- 172.21.15.36:0/2308087418 learned_addr learned my addr 172.21.15.36:0/2308087418 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:11.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f46577fe700 1 --2- 172.21.15.36:0/2308087418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46580b6560 0x7f4658152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f46567fc700 1 --2- 172.21.15.36:0/2308087418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46580b5990 0x7f4658152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f4656ffd700 1 -- 172.21.15.36:0/2308087418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46580b5990 msgr2=0x7f4658152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f4656ffd700 1 --2- 172.21.15.36:0/2308087418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46580b5990 0x7f4658152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f4656ffd700 1 -- 172.21.15.36:0/2308087418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46580b6560 msgr2=0x7f4658152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f4656ffd700 1 --2- 172.21.15.36:0/2308087418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46580b6560 0x7f4658152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f4656ffd700 1 -- 172.21.15.36:0/2308087418 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4650009530 con 0x7f465805fc00 2022-01-10T01:33:11.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f4656ffd700 1 --2- 172.21.15.36:0/2308087418 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f465805fc00 0x7f4658149e50 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f4640001fa0 tx=0x7f4640007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:11.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f464ffff700 1 -- 172.21.15.36:0/2308087418 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f464000ce80 con 0x7f465805fc00 2022-01-10T01:33:11.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f464ffff700 1 -- 172.21.15.36:0/2308087418 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4640007240 con 0x7f465805fc00 2022-01-10T01:33:11.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f465d65c700 1 -- 172.21.15.36:0/2308087418 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46580afcd0 con 0x7f465805fc00 2022-01-10T01:33:11.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f464ffff700 1 -- 172.21.15.36:0/2308087418 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4640006510 con 0x7f465805fc00 2022-01-10T01:33:11.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.446+0000 7f465d65c700 1 -- 172.21.15.36:0/2308087418 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46580aee30 con 0x7f465805fc00 2022-01-10T01:33:11.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.450+0000 7f464ffff700 1 -- 172.21.15.36:0/2308087418 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4640010030 con 0x7f465805fc00 2022-01-10T01:33:11.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.450+0000 7f465d65c700 1 -- 172.21.15.36:0/2308087418 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46580b4600 con 0x7f465805fc00 2022-01-10T01:33:11.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.450+0000 7f464ffff700 1 --2- 172.21.15.36:0/2308087418 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f463c053590 0x7f463c055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.450+0000 7f464ffff700 1 -- 172.21.15.36:0/2308087418 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f464006b490 con 0x7f465805fc00 2022-01-10T01:33:11.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.450+0000 7f46567fc700 1 --2- 172.21.15.36:0/2308087418 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f463c053590 0x7f463c055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.450+0000 7f46567fc700 1 --2- 172.21.15.36:0/2308087418 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f463c053590 0x7f463c055a50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f464800c000 tx=0x7f4648008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:11.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.454+0000 7f464ffff700 1 -- 172.21.15.36:0/2308087418 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f46580b4600 con 0x7f465805fc00 2022-01-10T01:33:11.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.578+0000 7f465d65c700 1 -- 172.21.15.36:0/2308087418 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f46580b4600 con 0x7f465805fc00 2022-01-10T01:33:11.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.582+0000 7f464ffff700 1 -- 172.21.15.36:0/2308087418 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v135) v1 ==== 92+0+10 (secure 0 0 0) 0x7f46580b4600 con 0x7f465805fc00 2022-01-10T01:33:11.586 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:11.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.582+0000 7f465d65c700 1 -- 172.21.15.36:0/2308087418 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f463c053590 msgr2=0x7f463c055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.582+0000 7f465d65c700 1 --2- 172.21.15.36:0/2308087418 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f463c053590 0x7f463c055a50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f464800c000 tx=0x7f4648008040).stop 2022-01-10T01:33:11.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.582+0000 7f465d65c700 1 -- 172.21.15.36:0/2308087418 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f465805fc00 msgr2=0x7f4658149e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.582+0000 7f465d65c700 1 --2- 172.21.15.36:0/2308087418 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f465805fc00 0x7f4658149e50 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7f4640001fa0 tx=0x7f4640007c30).stop 2022-01-10T01:33:11.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.582+0000 7f465d65c700 1 -- 172.21.15.36:0/2308087418 shutdown_connections 2022-01-10T01:33:11.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.582+0000 7f465d65c700 1 --2- 172.21.15.36:0/2308087418 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f463c053590 0x7f463c055a50 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.582+0000 7f465d65c700 1 --2- 172.21.15.36:0/2308087418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46580b6560 0x7f4658152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.582+0000 7f465d65c700 1 --2- 172.21.15.36:0/2308087418 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46580b5990 0x7f4658152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.582+0000 7f465d65c700 1 --2- 172.21.15.36:0/2308087418 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f465805fc00 0x7f4658149e50 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.582+0000 7f465d65c700 1 -- 172.21.15.36:0/2308087418 >> 172.21.15.36:0/2308087418 conn(0x7f46580623a0 msgr2=0x7f46580b8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:11.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.582+0000 7f465d65c700 1 -- 172.21.15.36:0/2308087418 shutdown_connections 2022-01-10T01:33:11.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.582+0000 7f465d65c700 1 -- 172.21.15.36:0/2308087418 wait complete. 2022-01-10T01:33:11.599 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-01-10T01:33:11.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.698+0000 7fbea51c1700 1 Processor -- start 2022-01-10T01:33:11.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.698+0000 7fbea51c1700 1 -- start start 2022-01-10T01:33:11.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea51c1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbea0061320 0x7fbea0061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea51c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea0140440 0x7fbea01408d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea51c1700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea00aecf0 con 0x7fbea00ad5c0 2022-01-10T01:33:11.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea51c1700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea00b6f20 con 0x7fbea0061320 2022-01-10T01:33:11.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea51c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00aef20 con 0x7fbea0140440 2022-01-10T01:33:11.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbe9ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbea0061320 0x7fbea0061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbe977fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fbea00ad5c0 0x7fbea00b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39330/0 (socket says 172.21.15.36:39330) 2022-01-10T01:33:11.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbe977fe700 1 -- 172.21.15.36:0/2175471895 learned_addr learned my addr 172.21.15.36:0/2175471895 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:11.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea49c0700 1 --2- 172.21.15.36:0/2175471895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea0140440 0x7fbea01408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbe9f7fe700 1 -- 172.21.15.36:0/2175471895 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889826674 0 0) 0x7fbea00aecf0 con 0x7fbea00ad5c0 2022-01-10T01:33:11.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbe9f7fe700 1 -- 172.21.15.36:0/2175471895 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe84003260 con 0x7fbea00ad5c0 2022-01-10T01:33:11.715 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbe9ffff700 1 -- 172.21.15.36:0/2175471895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea0140440 msgr2=0x7fbea01408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:11.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbe9ffff700 1 --2- 172.21.15.36:0/2175471895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea0140440 0x7fbea01408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbe9ffff700 1 -- 172.21.15.36:0/2175471895 >> v1:172.21.15.36:6789/0 conn(0x7fbea00ad5c0 legacy=0x7fbea00b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbe9ffff700 1 -- 172.21.15.36:0/2175471895 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea00af1c0 con 0x7fbea0061320 2022-01-10T01:33:11.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea49c0700 1 --2- 172.21.15.36:0/2175471895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea0140440 0x7fbea01408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:11.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbe9ffff700 1 --2- 172.21.15.36:0/2175471895 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbea0061320 0x7fbea0061700 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7fbea00aeba0 tx=0x7fbe88006df0).ready entity=mon.0 client_cookie=d87be82f7ba4dac7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:11.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbe9f7fe700 1 -- 172.21.15.36:0/2175471895 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe8800d570 con 0x7fbea0061320 2022-01-10T01:33:11.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbe9f7fe700 1 -- 172.21.15.36:0/2175471895 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe88000e90 con 0x7fbea0061320 2022-01-10T01:33:11.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbe9f7fe700 1 -- 172.21.15.36:0/2175471895 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe8800d8c0 con 0x7fbea0061320 2022-01-10T01:33:11.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea51c1700 1 -- 172.21.15.36:0/2175471895 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbea0061320 msgr2=0x7fbea0061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea51c1700 1 --2- 172.21.15.36:0/2175471895 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbea0061320 0x7fbea0061700 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7fbea00aeba0 tx=0x7fbe88006df0).stop 2022-01-10T01:33:11.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea51c1700 1 -- 172.21.15.36:0/2175471895 shutdown_connections 2022-01-10T01:33:11.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea51c1700 1 --2- 172.21.15.36:0/2175471895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea0140440 0x7fbea01408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea51c1700 1 --2- 172.21.15.36:0/2175471895 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbea0061320 0x7fbea0061700 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea51c1700 1 -- 172.21.15.36:0/2175471895 >> 172.21.15.36:0/2175471895 conn(0x7fbea0066de0 msgr2=0x7fbea00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:11.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea51c1700 1 -- 172.21.15.36:0/2175471895 shutdown_connections 2022-01-10T01:33:11.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.702+0000 7fbea51c1700 1 -- 172.21.15.36:0/2175471895 wait complete. 2022-01-10T01:33:11.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.706+0000 7fbea51c1700 1 Processor -- start 2022-01-10T01:33:11.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.706+0000 7fbea51c1700 1 -- start start 2022-01-10T01:33:11.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.706+0000 7fbea51c1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbea0061320 0x7fbea005c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.706+0000 7fbea51c1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbea00ad5c0 0x7fbea00aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.706+0000 7fbea51c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea0140440 0x7fbea0152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.706+0000 7fbea51c1700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea0152300 con 0x7fbea0061320 2022-01-10T01:33:11.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.706+0000 7fbea51c1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00acf20 con 0x7fbea00ad5c0 2022-01-10T01:33:11.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.706+0000 7fbea51c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea0142a10 con 0x7fbea0140440 2022-01-10T01:33:11.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.706+0000 7fbe9ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbea0061320 0x7fbea005c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.706+0000 7fbe9ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbea0061320 0x7fbea005c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41542/0 (socket says 172.21.15.36:41542) 2022-01-10T01:33:11.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.706+0000 7fbe9ffff700 1 -- 172.21.15.36:0/3991049490 learned_addr learned my addr 172.21.15.36:0/3991049490 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:11.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.706+0000 7fbe977fe700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbea00ad5c0 0x7fbea00aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.706+0000 7fbea49c0700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea0140440 0x7fbea0152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.706+0000 7fbe9ffff700 1 -- 172.21.15.36:0/3991049490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea0140440 msgr2=0x7fbea0152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbe9ffff700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea0140440 0x7fbea0152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbe9ffff700 1 -- 172.21.15.36:0/3991049490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbea00ad5c0 msgr2=0x7fbea00aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbe9ffff700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbea00ad5c0 0x7fbea00aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbe9ffff700 1 -- 172.21.15.36:0/3991049490 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009470 con 0x7fbea0061320 2022-01-10T01:33:11.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbea49c0700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea0140440 0x7fbea0152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:11.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbe9ffff700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbea0061320 0x7fbea005c9f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7fbea00aeba0 tx=0x7fbe88014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:11.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbe9dffb700 1 -- 172.21.15.36:0/3991049490 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe88013e90 con 0x7fbea0061320 2022-01-10T01:33:11.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbe9dffb700 1 -- 172.21.15.36:0/3991049490 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe88002f70 con 0x7fbea0061320 2022-01-10T01:33:11.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbe9dffb700 1 -- 172.21.15.36:0/3991049490 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe8801e5f0 con 0x7fbea0061320 2022-01-10T01:33:11.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbea51c1700 1 -- 172.21.15.36:0/3991049490 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8800b180 con 0x7fbea0061320 2022-01-10T01:33:11.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbea51c1700 1 -- 172.21.15.36:0/3991049490 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea0152750 con 0x7fbea0061320 2022-01-10T01:33:11.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbea51c1700 1 -- 172.21.15.36:0/3991049490 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea00af460 con 0x7fbea0061320 2022-01-10T01:33:11.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbe9dffb700 1 -- 172.21.15.36:0/3991049490 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbe8801c070 con 0x7fbea0061320 2022-01-10T01:33:11.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbe9dffb700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe780534d0 0x7fbe78055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.710+0000 7fbe9dffb700 1 -- 172.21.15.36:0/3991049490 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fbe8806c280 con 0x7fbea0061320 2022-01-10T01:33:11.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.714+0000 7fbe977fe700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe780534d0 0x7fbe78055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.714+0000 7fbe977fe700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe780534d0 0x7fbe78055990 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fbe9000d000 tx=0x7fbe90009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:11.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.722+0000 7fbe9dffb700 1 -- 172.21.15.36:0/3991049490 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbe880435d0 con 0x7fbea0061320 2022-01-10T01:33:11.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.850+0000 7fbea51c1700 1 -- 172.21.15.36:0/3991049490 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbea0057350 con 0x7fbea0061320 2022-01-10T01:33:11.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.850+0000 7fbe9dffb700 1 -- 172.21.15.36:0/3991049490 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v135) v1 ==== 84+0+143 (secure 0 0 0) 0x7fbe88023020 con 0x7fbea0061320 2022-01-10T01:33:11.855 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:11.856 INFO:teuthology.orchestra.run.smithi036.stdout:[ 2022-01-10T01:33:11.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:11.856 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 1, 2022-01-10T01:33:11.856 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "device_health_metrics" 2022-01-10T01:33:11.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:11.857 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:11.857 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 2, 2022-01-10T01:33:11.857 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "rbd" 2022-01-10T01:33:11.857 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:11.858 INFO:teuthology.orchestra.run.smithi036.stdout:] 2022-01-10T01:33:11.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.850+0000 7fbea51c1700 1 -- 172.21.15.36:0/3991049490 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe780534d0 msgr2=0x7fbe78055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.850+0000 7fbea51c1700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe780534d0 0x7fbe78055990 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fbe9000d000 tx=0x7fbe90009040).stop 2022-01-10T01:33:11.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.850+0000 7fbea51c1700 1 -- 172.21.15.36:0/3991049490 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbea0061320 msgr2=0x7fbea005c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.850+0000 7fbea51c1700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbea0061320 0x7fbea005c9f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7fbea00aeba0 tx=0x7fbe88014000).stop 2022-01-10T01:33:11.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.850+0000 7fbea51c1700 1 -- 172.21.15.36:0/3991049490 shutdown_connections 2022-01-10T01:33:11.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.850+0000 7fbea51c1700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe780534d0 0x7fbe78055990 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.850+0000 7fbea51c1700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbea0140440 0x7fbea0152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.850+0000 7fbea51c1700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbea00ad5c0 0x7fbea00aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.850+0000 7fbea51c1700 1 --2- 172.21.15.36:0/3991049490 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbea0061320 0x7fbea005c9f0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.850+0000 7fbea51c1700 1 -- 172.21.15.36:0/3991049490 >> 172.21.15.36:0/3991049490 conn(0x7fbea0066de0 msgr2=0x7fbea00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:11.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.850+0000 7fbea51c1700 1 -- 172.21.15.36:0/3991049490 shutdown_connections 2022-01-10T01:33:11.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.850+0000 7fbea51c1700 1 -- 172.21.15.36:0/3991049490 wait complete. 2022-01-10T01:33:11.868 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-01-10T01:33:11.869 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:33:11.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.974+0000 7f1acbcfc700 1 Processor -- start 2022-01-10T01:33:11.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.974+0000 7f1acbcfc700 1 -- start start 2022-01-10T01:33:11.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.974+0000 7f1acbcfc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1ac4060100 0x7f1ac4064d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.974+0000 7f1acbcfc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ac4144440 0x7f1ac4065200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.974+0000 7f1acbcfc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ac40b38d0 0x7f1ac4144970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.974+0000 7f1acbcfc700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac40656f0 con 0x7f1ac4060100 2022-01-10T01:33:11.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.974+0000 7f1acbcfc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac4065c80 con 0x7f1ac40b38d0 2022-01-10T01:33:11.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.974+0000 7f1acbcfc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac40604e0 con 0x7f1ac4144440 2022-01-10T01:33:11.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.974+0000 7f1ac9a98700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1ac4060100 0x7f1ac4064d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.974+0000 7f1ac9a98700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1ac4060100 0x7f1ac4064d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41550/0 (socket says 172.21.15.36:41550) 2022-01-10T01:33:11.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.974+0000 7f1ac9a98700 1 -- 172.21.15.36:0/1144981416 learned_addr learned my addr 172.21.15.36:0/1144981416 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:11.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.974+0000 7f1ac9297700 1 --2- 172.21.15.36:0/1144981416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ac4144440 0x7f1ac4065200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.974+0000 7f1aca299700 1 --2- 172.21.15.36:0/1144981416 >> v2:172.21.15.59:3300/0 conn(0x7f1ac40b38d0 0x7f1ac4144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1ac9a98700 1 -- 172.21.15.36:0/1144981416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ac4144440 msgr2=0x7f1ac4065200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:11.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1ac9a98700 1 --2- 172.21.15.36:0/1144981416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ac4144440 0x7f1ac4065200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1ac9a98700 1 -- 172.21.15.36:0/1144981416 >> v2:172.21.15.59:3300/0 conn(0x7f1ac40b38d0 msgr2=0x7f1ac4144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:11.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1ac9a98700 1 --2- 172.21.15.36:0/1144981416 >> v2:172.21.15.59:3300/0 conn(0x7f1ac40b38d0 0x7f1ac4144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1ac9a98700 1 -- 172.21.15.36:0/1144981416 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac40b23b0 con 0x7f1ac4060100 2022-01-10T01:33:11.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1ac9a98700 1 --2- 172.21.15.36:0/1144981416 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ac4060100 0x7f1ac4064d10 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f1ab4002f70 tx=0x7f1ab4006eb0).ready entity=mon.0 client_cookie=e185ab47174c90fd server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:11.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1ac8a96700 1 -- 172.21.15.36:0/1144981416 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab400d570 con 0x7f1ac4060100 2022-01-10T01:33:11.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1ac8a96700 1 -- 172.21.15.36:0/1144981416 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab4000e90 con 0x7f1ac4060100 2022-01-10T01:33:11.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1ac8a96700 1 -- 172.21.15.36:0/1144981416 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab400d900 con 0x7f1ac4060100 2022-01-10T01:33:11.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1acbcfc700 1 -- 172.21.15.36:0/1144981416 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ac4060100 msgr2=0x7f1ac4064d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:11.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1acbcfc700 1 --2- 172.21.15.36:0/1144981416 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ac4060100 0x7f1ac4064d10 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f1ab4002f70 tx=0x7f1ab4006eb0).stop 2022-01-10T01:33:11.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1acbcfc700 1 -- 172.21.15.36:0/1144981416 shutdown_connections 2022-01-10T01:33:11.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1acbcfc700 1 --2- 172.21.15.36:0/1144981416 >> v2:172.21.15.59:3300/0 conn(0x7f1ac40b38d0 0x7f1ac4144970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1acbcfc700 1 --2- 172.21.15.36:0/1144981416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ac4144440 0x7f1ac4065200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1acbcfc700 1 --2- 172.21.15.36:0/1144981416 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ac4060100 0x7f1ac4064d10 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:11.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1acbcfc700 1 -- 172.21.15.36:0/1144981416 >> 172.21.15.36:0/1144981416 conn(0x7f1ac405cf60 msgr2=0x7f1ac405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:11.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1acbcfc700 1 -- 172.21.15.36:0/1144981416 shutdown_connections 2022-01-10T01:33:11.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.978+0000 7f1acbcfc700 1 -- 172.21.15.36:0/1144981416 wait complete. 2022-01-10T01:33:11.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1acbcfc700 1 Processor -- start 2022-01-10T01:33:11.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1acbcfc700 1 -- start start 2022-01-10T01:33:11.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1acbcfc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac4060100 0x7f1ac413c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1acbcfc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ac40b38d0 0x7f1ac413c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1acbcfc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ac4133a90 0x7f1ac4133f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:11.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1acbcfc700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac40b04d0 con 0x7f1ac4133a90 2022-01-10T01:33:11.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1acbcfc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac40b1110 con 0x7f1ac4060100 2022-01-10T01:33:11.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1acbcfc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac413bbc0 con 0x7f1ac40b38d0 2022-01-10T01:33:11.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1aca299700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ac4133a90 0x7f1ac4133f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1aca299700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ac4133a90 0x7f1ac4133f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41560/0 (socket says 172.21.15.36:41560) 2022-01-10T01:33:11.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1aca299700 1 -- 172.21.15.36:0/499922877 learned_addr learned my addr 172.21.15.36:0/499922877 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:11.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1ac9a98700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac4060100 0x7f1ac413c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:11.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1ac9297700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ac40b38d0 0x7f1ac413c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:12.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1aca299700 1 -- 172.21.15.36:0/499922877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ac40b38d0 msgr2=0x7f1ac413c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:12.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1aca299700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ac40b38d0 0x7f1ac413c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:12.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1aca299700 1 -- 172.21.15.36:0/499922877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac4060100 msgr2=0x7f1ac413c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:12.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1aca299700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac4060100 0x7f1ac413c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:12.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1aca299700 1 -- 172.21.15.36:0/499922877 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab400b1e0 con 0x7f1ac4133a90 2022-01-10T01:33:12.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1ac9297700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ac40b38d0 0x7f1ac413c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:12.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.982+0000 7f1aca299700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ac4133a90 0x7f1ac4133f40 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f1abc00c000 tx=0x7f1abc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:12.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.986+0000 7f1ab2ffd700 1 -- 172.21.15.36:0/499922877 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1abc00c610 con 0x7f1ac4133a90 2022-01-10T01:33:12.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.986+0000 7f1ab2ffd700 1 -- 172.21.15.36:0/499922877 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc00c770 con 0x7f1ac4133a90 2022-01-10T01:33:12.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.986+0000 7f1acbcfc700 1 -- 172.21.15.36:0/499922877 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac40b0730 con 0x7f1ac4133a90 2022-01-10T01:33:12.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.986+0000 7f1ab2ffd700 1 -- 172.21.15.36:0/499922877 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1abc00cad0 con 0x7f1ac4133a90 2022-01-10T01:33:12.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.986+0000 7f1acbcfc700 1 -- 172.21.15.36:0/499922877 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac40b0c70 con 0x7f1ac4133a90 2022-01-10T01:33:12.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.986+0000 7f1acbcfc700 1 -- 172.21.15.36:0/499922877 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac40b0e30 con 0x7f1ac4133a90 2022-01-10T01:33:12.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.986+0000 7f1ab2ffd700 1 -- 172.21.15.36:0/499922877 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1abc00cc30 con 0x7f1ac4133a90 2022-01-10T01:33:12.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.986+0000 7f1ab2ffd700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1aa4053500 0x7f1aa40559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:12.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.986+0000 7f1ab2ffd700 1 -- 172.21.15.36:0/499922877 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f1abc06bf00 con 0x7f1ac4133a90 2022-01-10T01:33:12.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.986+0000 7f1ac9a98700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1aa4053500 0x7f1aa40559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:12.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.986+0000 7f1ac9a98700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1aa4053500 0x7f1aa40559c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f1ab401c000 tx=0x7f1ab4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:12.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:11.994+0000 7f1ab2ffd700 1 -- 172.21.15.36:0/499922877 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1abc043250 con 0x7f1ac4133a90 2022-01-10T01:33:12.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:12.122+0000 7f1acbcfc700 1 -- 172.21.15.36:0/499922877 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f1ac4057350 con 0x7f1ac4133a90 2022-01-10T01:33:13.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.078+0000 7f1ab2ffd700 1 -- 172.21.15.36:0/499922877 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v136) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1abc0160a0 con 0x7f1ac4133a90 2022-01-10T01:33:13.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.082+0000 7f1acbcfc700 1 -- 172.21.15.36:0/499922877 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1aa4053500 msgr2=0x7f1aa40559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:13.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.082+0000 7f1acbcfc700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1aa4053500 0x7f1aa40559c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f1ab401c000 tx=0x7f1ab4015000).stop 2022-01-10T01:33:13.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.082+0000 7f1acbcfc700 1 -- 172.21.15.36:0/499922877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ac4133a90 msgr2=0x7f1ac4133f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:13.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.082+0000 7f1acbcfc700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ac4133a90 0x7f1ac4133f40 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f1abc00c000 tx=0x7f1abc0091d0).stop 2022-01-10T01:33:13.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.082+0000 7f1acbcfc700 1 -- 172.21.15.36:0/499922877 shutdown_connections 2022-01-10T01:33:13.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.082+0000 7f1acbcfc700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1aa4053500 0x7f1aa40559c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:13.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.082+0000 7f1acbcfc700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1ac4133a90 0x7f1ac4133f40 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:13.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.082+0000 7f1acbcfc700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ac40b38d0 0x7f1ac413c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:13.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.082+0000 7f1acbcfc700 1 --2- 172.21.15.36:0/499922877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ac4060100 0x7f1ac413c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:13.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.082+0000 7f1acbcfc700 1 -- 172.21.15.36:0/499922877 >> 172.21.15.36:0/499922877 conn(0x7f1ac405cf60 msgr2=0x7f1ac4144900 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:13.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.082+0000 7f1acbcfc700 1 -- 172.21.15.36:0/499922877 shutdown_connections 2022-01-10T01:33:13.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.086+0000 7f1acbcfc700 1 -- 172.21.15.36:0/499922877 wait complete. 2022-01-10T01:33:13.092 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:33:13.104 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2022-01-10T01:33:13.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe46cbc6700 1 Processor -- start 2022-01-10T01:33:13.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe46cbc6700 1 -- start start 2022-01-10T01:33:13.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe46cbc6700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe4680a8ac0 0x7fe468152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:13.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe46cbc6700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4680a70c0 con 0x7fe4680b0010 2022-01-10T01:33:13.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe46cbc6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4680a72f0 con 0x7fe4680b2580 2022-01-10T01:33:13.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe46cbc6700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4680a7590 con 0x7fe4680a8ac0 2022-01-10T01:33:13.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe467fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe4680a8ac0 0x7fe468152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:13.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe466ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe4680b0010 0x7fe4680a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39360/0 (socket says 172.21.15.36:39360) 2022-01-10T01:33:13.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe466ffd700 1 -- 172.21.15.36:0/2907885577 learned_addr learned my addr 172.21.15.36:0/2907885577 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:13.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe4667fc700 1 -- 172.21.15.36:0/2907885577 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 407426950 0 0) 0x7fe4680a70c0 con 0x7fe4680b0010 2022-01-10T01:33:13.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe4667fc700 1 -- 172.21.15.36:0/2907885577 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe454003260 con 0x7fe4680b0010 2022-01-10T01:33:13.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe4667fc700 1 -- 172.21.15.36:0/2907885577 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704117443 0 0) 0x7fe4680a72f0 con 0x7fe4680b2580 2022-01-10T01:33:13.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe4667fc700 1 -- 172.21.15.36:0/2907885577 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4680a70c0 con 0x7fe4680b2580 2022-01-10T01:33:13.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe467fff700 1 -- 172.21.15.36:0/2907885577 >> v1:172.21.15.59:6789/0 conn(0x7fe4680b2580 legacy=0x7fe46814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:13.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe467fff700 1 -- 172.21.15.36:0/2907885577 >> v1:172.21.15.36:6789/0 conn(0x7fe4680b0010 legacy=0x7fe4680a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:13.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe467fff700 1 -- 172.21.15.36:0/2907885577 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4680a7830 con 0x7fe4680a8ac0 2022-01-10T01:33:13.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe467fff700 1 --2- 172.21.15.36:0/2907885577 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4680a8ac0 0x7fe468152be0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7fe4600032f0 tx=0x7fe4600091d0).ready entity=mon.0 client_cookie=d81bddaeba820fc0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:13.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe4667fc700 1 -- 172.21.15.36:0/2907885577 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe46000b600 con 0x7fe4680a8ac0 2022-01-10T01:33:13.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe4667fc700 1 -- 172.21.15.36:0/2907885577 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46000b760 con 0x7fe4680a8ac0 2022-01-10T01:33:13.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.210+0000 7fe4667fc700 1 -- 172.21.15.36:0/2907885577 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe46000b8d0 con 0x7fe4680a8ac0 2022-01-10T01:33:13.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.214+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2907885577 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4680a8ac0 msgr2=0x7fe468152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:13.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.214+0000 7fe46cbc6700 1 --2- 172.21.15.36:0/2907885577 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4680a8ac0 0x7fe468152be0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7fe4600032f0 tx=0x7fe4600091d0).stop 2022-01-10T01:33:13.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.214+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2907885577 shutdown_connections 2022-01-10T01:33:13.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.214+0000 7fe46cbc6700 1 --2- 172.21.15.36:0/2907885577 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4680a8ac0 0x7fe468152be0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:13.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.214+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2907885577 >> 172.21.15.36:0/2907885577 conn(0x7fe468060180 msgr2=0x7fe4680b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:13.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.214+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2907885577 shutdown_connections 2022-01-10T01:33:13.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.214+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2907885577 wait complete. 2022-01-10T01:33:13.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.214+0000 7fe46cbc6700 1 Processor -- start 2022-01-10T01:33:13.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.214+0000 7fe46cbc6700 1 -- start start 2022-01-10T01:33:13.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe46cbc6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4680a8ac0 0x7fe4680a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:13.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe46cbc6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4680b0010 0x7fe468142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:13.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe46cbc6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4680b2580 0x7fe4681434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:13.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe46cbc6700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680af4d0 con 0x7fe4680b0010 2022-01-10T01:33:13.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe46cbc6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680b4b60 con 0x7fe4680b2580 2022-01-10T01:33:13.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe46cbc6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe468144350 con 0x7fe4680a8ac0 2022-01-10T01:33:13.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe466ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4680b0010 0x7fe468142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:13.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe466ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4680b0010 0x7fe468142fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41572/0 (socket says 172.21.15.36:41572) 2022-01-10T01:33:13.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe466ffd700 1 -- 172.21.15.36:0/2251763608 learned_addr learned my addr 172.21.15.36:0/2251763608 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:13.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe467fff700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4680b2580 0x7fe4681434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:13.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe4677fe700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4680a8ac0 0x7fe4680a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:13.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe466ffd700 1 -- 172.21.15.36:0/2251763608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4680a8ac0 msgr2=0x7fe4680a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:13.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe466ffd700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4680a8ac0 0x7fe4680a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:13.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe466ffd700 1 -- 172.21.15.36:0/2251763608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4680b2580 msgr2=0x7fe4681434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:13.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe466ffd700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4680b2580 0x7fe4681434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:13.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe466ffd700 1 -- 172.21.15.36:0/2251763608 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe460009470 con 0x7fe4680b0010 2022-01-10T01:33:13.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe467fff700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4680b2580 0x7fe4681434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:13.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe466ffd700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4680b0010 0x7fe468142fc0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fe458001110 tx=0x7fe458007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:13.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe464ff9700 1 -- 172.21.15.36:0/2251763608 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe4580070d0 con 0x7fe4680b0010 2022-01-10T01:33:13.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe464ff9700 1 -- 172.21.15.36:0/2251763608 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe458007230 con 0x7fe4680b0010 2022-01-10T01:33:13.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2251763608 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe468142b20 con 0x7fe4680b0010 2022-01-10T01:33:13.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe464ff9700 1 -- 172.21.15.36:0/2251763608 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe458005610 con 0x7fe4680b0010 2022-01-10T01:33:13.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.218+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2251763608 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe468143e60 con 0x7fe4680b0010 2022-01-10T01:33:13.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.222+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2251763608 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe468057350 con 0x7fe4680b0010 2022-01-10T01:33:13.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.222+0000 7fe464ff9700 1 -- 172.21.15.36:0/2251763608 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe45801a060 con 0x7fe4680b0010 2022-01-10T01:33:13.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.222+0000 7fe464ff9700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe448053680 0x7fe448055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:13.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.222+0000 7fe4677fe700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe448053680 0x7fe448055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:13.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.222+0000 7fe464ff9700 1 -- 172.21.15.36:0/2251763608 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5954+0+0 (secure 0 0 0) 0x7fe45806ace0 con 0x7fe4680b0010 2022-01-10T01:33:13.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.222+0000 7fe4677fe700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe448053680 0x7fe448055b40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fe45c00d000 tx=0x7fe45c007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:13.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.226+0000 7fe464ff9700 1 -- 172.21.15.36:0/2251763608 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe458041db0 con 0x7fe4680b0010 2022-01-10T01:33:13.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:13.358+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2251763608 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fe4680698e0 con 0x7fe4680b0010 2022-01-10T01:33:14.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.082+0000 7fe464ff9700 1 -- 172.21.15.36:0/2251763608 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v137) v1 ==== 125+0+0 (secure 0 0 0) 0x7fe458018070 con 0x7fe4680b0010 2022-01-10T01:33:14.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.094+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2251763608 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe448053680 msgr2=0x7fe448055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.094+0000 7fe46cbc6700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe448053680 0x7fe448055b40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fe45c00d000 tx=0x7fe45c007a00).stop 2022-01-10T01:33:14.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.094+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2251763608 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4680b0010 msgr2=0x7fe468142fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.094+0000 7fe46cbc6700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4680b0010 0x7fe468142fc0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7fe458001110 tx=0x7fe458007ac0).stop 2022-01-10T01:33:14.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.094+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2251763608 shutdown_connections 2022-01-10T01:33:14.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.094+0000 7fe46cbc6700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe448053680 0x7fe448055b40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.094+0000 7fe46cbc6700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4680b2580 0x7fe4681434b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.094+0000 7fe46cbc6700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe4680b0010 0x7fe468142fc0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.094+0000 7fe46cbc6700 1 --2- 172.21.15.36:0/2251763608 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4680a8ac0 0x7fe4680a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.094+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2251763608 >> 172.21.15.36:0/2251763608 conn(0x7fe468060180 msgr2=0x7fe468144ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:14.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.094+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2251763608 shutdown_connections 2022-01-10T01:33:14.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.094+0000 7fe46cbc6700 1 -- 172.21.15.36:0/2251763608 wait complete. 2022-01-10T01:33:14.102 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' created 2022-01-10T01:33:14.111 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-10T01:33:14.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.210+0000 7f948f4f4700 1 Processor -- start 2022-01-10T01:33:14.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.210+0000 7f948f4f4700 1 -- start start 2022-01-10T01:33:14.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.210+0000 7f948f4f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9488064640 0x7f94880b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.210+0000 7f948f4f4700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94880b8090 con 0x7f9488064a20 2022-01-10T01:33:14.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.210+0000 7f948f4f4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9488143130 con 0x7f94880b4aa0 2022-01-10T01:33:14.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.210+0000 7f948f4f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9488142f40 con 0x7f9488064640 2022-01-10T01:33:14.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.210+0000 7f948ecf3700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9488064a20 0x7f9488066500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39376/0 (socket says 172.21.15.36:39376) 2022-01-10T01:33:14.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.210+0000 7f948ecf3700 1 -- 172.21.15.36:0/1428909438 learned_addr learned my addr 172.21.15.36:0/1428909438 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:14.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.210+0000 7f948e4f2700 1 --2- 172.21.15.36:0/1428909438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9488064640 0x7f94880b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.210+0000 7f948d4f0700 1 -- 172.21.15.36:0/1428909438 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092951155 0 0) 0x7f94880b8090 con 0x7f9488064a20 2022-01-10T01:33:14.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.210+0000 7f948d4f0700 1 -- 172.21.15.36:0/1428909438 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9470003260 con 0x7f9488064a20 2022-01-10T01:33:14.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.210+0000 7f948d4f0700 1 -- 172.21.15.36:0/1428909438 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841988027 0 0) 0x7f9488143130 con 0x7f94880b4aa0 2022-01-10T01:33:14.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948d4f0700 1 -- 172.21.15.36:0/1428909438 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94880b8090 con 0x7f94880b4aa0 2022-01-10T01:33:14.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948d4f0700 1 -- 172.21.15.36:0/1428909438 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 165458249 0 0) 0x7f9470003260 con 0x7f9488064a20 2022-01-10T01:33:14.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948e4f2700 1 -- 172.21.15.36:0/1428909438 >> v1:172.21.15.59:6789/0 conn(0x7f94880b4aa0 legacy=0x7f9488143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948e4f2700 1 -- 172.21.15.36:0/1428909438 >> v1:172.21.15.36:6789/0 conn(0x7f9488064a20 legacy=0x7f9488066500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948e4f2700 1 -- 172.21.15.36:0/1428909438 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94881433d0 con 0x7f9488064640 2022-01-10T01:33:14.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948e4f2700 1 --2- 172.21.15.36:0/1428909438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9488064640 0x7f94880b3710 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f9480001b80 tx=0x7f9478006df0).ready entity=mon.2 client_cookie=963f9c29fb4f07cd server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:14.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948d4f0700 1 -- 172.21.15.36:0/1428909438 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94800019e0 con 0x7f9488064640 2022-01-10T01:33:14.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948d4f0700 1 -- 172.21.15.36:0/1428909438 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9478000e90 con 0x7f9488064640 2022-01-10T01:33:14.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948d4f0700 1 -- 172.21.15.36:0/1428909438 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9478012460 con 0x7f9488064640 2022-01-10T01:33:14.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 -- 172.21.15.36:0/1428909438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9488064640 msgr2=0x7f94880b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 --2- 172.21.15.36:0/1428909438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9488064640 0x7f94880b3710 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f9480001b80 tx=0x7f9478006df0).stop 2022-01-10T01:33:14.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 -- 172.21.15.36:0/1428909438 shutdown_connections 2022-01-10T01:33:14.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 --2- 172.21.15.36:0/1428909438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9488064640 0x7f94880b3710 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 -- 172.21.15.36:0/1428909438 >> 172.21.15.36:0/1428909438 conn(0x7f948805f6b0 msgr2=0x7f948805fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:14.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 -- 172.21.15.36:0/1428909438 shutdown_connections 2022-01-10T01:33:14.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 -- 172.21.15.36:0/1428909438 wait complete. 2022-01-10T01:33:14.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 Processor -- start 2022-01-10T01:33:14.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 -- start start 2022-01-10T01:33:14.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9488064640 0x7f94880b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9488064a20 0x7f94881421e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94880b4aa0 0x7f948813c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94880b1560 con 0x7f9488064a20 2022-01-10T01:33:14.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94880b12c0 con 0x7f94880b4aa0 2022-01-10T01:33:14.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948f4f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9488146cc0 con 0x7f9488064640 2022-01-10T01:33:14.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948dcf1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9488064a20 0x7f94881421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948e4f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9488064640 0x7f94880b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948dcf1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9488064a20 0x7f94881421e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41586/0 (socket says 172.21.15.36:41586) 2022-01-10T01:33:14.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948e4f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9488064640 0x7f94880b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:47866/0 (socket says 172.21.15.36:47866) 2022-01-10T01:33:14.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948dcf1700 1 -- 172.21.15.36:0/3873903178 learned_addr learned my addr 172.21.15.36:0/3873903178 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:14.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.214+0000 7f948ecf3700 1 --2- 172.21.15.36:0/3873903178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94880b4aa0 0x7f948813c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.218+0000 7f948dcf1700 1 -- 172.21.15.36:0/3873903178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9488064640 msgr2=0x7f94880b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.218+0000 7f948dcf1700 1 --2- 172.21.15.36:0/3873903178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9488064640 0x7f94880b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.218+0000 7f948dcf1700 1 -- 172.21.15.36:0/3873903178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94880b4aa0 msgr2=0x7f948813c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.218+0000 7f948dcf1700 1 --2- 172.21.15.36:0/3873903178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94880b4aa0 0x7f948813c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.218+0000 7f948dcf1700 1 -- 172.21.15.36:0/3873903178 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947800b180 con 0x7f9488064a20 2022-01-10T01:33:14.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.218+0000 7f948dcf1700 1 --2- 172.21.15.36:0/3873903178 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9488064a20 0x7f94881421e0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f9484001110 tx=0x7f9484007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:14.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.218+0000 7f94777fe700 1 -- 172.21.15.36:0/3873903178 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f948400cde0 con 0x7f9488064a20 2022-01-10T01:33:14.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.218+0000 7f94777fe700 1 -- 172.21.15.36:0/3873903178 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9484012400 con 0x7f9488064a20 2022-01-10T01:33:14.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.218+0000 7f948f4f4700 1 -- 172.21.15.36:0/3873903178 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9488146f60 con 0x7f9488064a20 2022-01-10T01:33:14.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.218+0000 7f94777fe700 1 -- 172.21.15.36:0/3873903178 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9484012760 con 0x7f9488064a20 2022-01-10T01:33:14.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.218+0000 7f948f4f4700 1 -- 172.21.15.36:0/3873903178 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9488145e40 con 0x7f9488064a20 2022-01-10T01:33:14.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.218+0000 7f948f4f4700 1 -- 172.21.15.36:0/3873903178 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94881470f0 con 0x7f9488064a20 2022-01-10T01:33:14.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.218+0000 7f94777fe700 1 -- 172.21.15.36:0/3873903178 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9484019030 con 0x7f9488064a20 2022-01-10T01:33:14.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.222+0000 7f94777fe700 1 --2- 172.21.15.36:0/3873903178 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94680535b0 0x7f9468055a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.222+0000 7f948e4f2700 1 --2- 172.21.15.36:0/3873903178 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94680535b0 0x7f9468055a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.222+0000 7f94777fe700 1 -- 172.21.15.36:0/3873903178 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f948406ae20 con 0x7f9488064a20 2022-01-10T01:33:14.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.222+0000 7f948e4f2700 1 --2- 172.21.15.36:0/3873903178 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94680535b0 0x7f9468055a70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f947801a000 tx=0x7f9478014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:14.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.222+0000 7f94777fe700 1 -- 172.21.15.36:0/3873903178 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9484041da0 con 0x7f9488064a20 2022-01-10T01:33:14.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.386+0000 7f948f4f4700 1 -- 172.21.15.36:0/3873903178 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f94880b7d40 con 0x7f9488064a20 2022-01-10T01:33:14.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.398+0000 7f94777fe700 1 -- 172.21.15.36:0/3873903178 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 25 and data pool 26 v65) v1 ==== 189+0+0 (secure 0 0 0) 0x7f94840453c0 con 0x7f9488064a20 2022-01-10T01:33:14.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.402+0000 7f948f4f4700 1 -- 172.21.15.36:0/3873903178 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94680535b0 msgr2=0x7f9468055a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.402+0000 7f948f4f4700 1 --2- 172.21.15.36:0/3873903178 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94680535b0 0x7f9468055a70 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f947801a000 tx=0x7f9478014000).stop 2022-01-10T01:33:14.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.402+0000 7f948f4f4700 1 -- 172.21.15.36:0/3873903178 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9488064a20 msgr2=0x7f94881421e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.402+0000 7f948f4f4700 1 --2- 172.21.15.36:0/3873903178 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9488064a20 0x7f94881421e0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f9484001110 tx=0x7f9484007a90).stop 2022-01-10T01:33:14.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.406+0000 7f948f4f4700 1 -- 172.21.15.36:0/3873903178 shutdown_connections 2022-01-10T01:33:14.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.406+0000 7f948f4f4700 1 --2- 172.21.15.36:0/3873903178 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94680535b0 0x7f9468055a70 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.406+0000 7f948f4f4700 1 --2- 172.21.15.36:0/3873903178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94880b4aa0 0x7f948813c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.406+0000 7f948f4f4700 1 --2- 172.21.15.36:0/3873903178 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9488064a20 0x7f94881421e0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.406+0000 7f948f4f4700 1 --2- 172.21.15.36:0/3873903178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9488064640 0x7f94880b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.406+0000 7f948f4f4700 1 -- 172.21.15.36:0/3873903178 >> 172.21.15.36:0/3873903178 conn(0x7f948805f6b0 msgr2=0x7f948805cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:14.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.406+0000 7f948f4f4700 1 -- 172.21.15.36:0/3873903178 shutdown_connections 2022-01-10T01:33:14.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.410+0000 7f948f4f4700 1 -- 172.21.15.36:0/3873903178 wait complete. 2022-01-10T01:33:14.417 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 25 and data pool 26 2022-01-10T01:33:14.428 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:33:14.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f70f5700 1 Processor -- start 2022-01-10T01:33:14.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f70f5700 1 -- start start 2022-01-10T01:33:14.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f70f5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f71f00b2580 0x7f71f014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f70f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71f00a8ac0 0x7f71f014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f70f5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f00a70c0 con 0x7f71f00b0010 2022-01-10T01:33:14.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f70f5700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f00a72f0 con 0x7f71f00b2580 2022-01-10T01:33:14.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f70f5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00a7590 con 0x7f71f00a8ac0 2022-01-10T01:33:14.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f60f3700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f71f00b2580 0x7f71f014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f60f3700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f71f00b2580 0x7f71f014ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41592/0 (socket says 172.21.15.36:41592) 2022-01-10T01:33:14.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f60f3700 1 -- 172.21.15.36:0/3773098544 learned_addr learned my addr 172.21.15.36:0/3773098544 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:14.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f68f4700 1 --2- 172.21.15.36:0/3773098544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71f00a8ac0 0x7f71f014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f60f3700 1 -- 172.21.15.36:0/3773098544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71f00a8ac0 msgr2=0x7f71f014b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:14.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f60f3700 1 --2- 172.21.15.36:0/3773098544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71f00a8ac0 0x7f71f014b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f60f3700 1 -- 172.21.15.36:0/3773098544 >> v1:172.21.15.59:6789/0 conn(0x7f71f00b0010 legacy=0x7f71f00a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:14.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f60f3700 1 -- 172.21.15.36:0/3773098544 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f00a7830 con 0x7f71f00b2580 2022-01-10T01:33:14.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f68f4700 1 --2- 172.21.15.36:0/3773098544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71f00a8ac0 0x7f71f014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:33:14.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f60f3700 1 --2- 172.21.15.36:0/3773098544 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71f00b2580 0x7f71f014ae40 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f71f006b7c0 tx=0x7f71e8009290).ready entity=mon.0 client_cookie=f6a578a47894dc2f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:14.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f50f1700 1 -- 172.21.15.36:0/3773098544 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71e800b860 con 0x7f71f00b2580 2022-01-10T01:33:14.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f50f1700 1 -- 172.21.15.36:0/3773098544 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e800b9c0 con 0x7f71f00b2580 2022-01-10T01:33:14.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f50f1700 1 -- 172.21.15.36:0/3773098544 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71e800bb70 con 0x7f71f00b2580 2022-01-10T01:33:14.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f70f5700 1 -- 172.21.15.36:0/3773098544 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71f00b2580 msgr2=0x7f71f014ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f70f5700 1 --2- 172.21.15.36:0/3773098544 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71f00b2580 0x7f71f014ae40 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f71f006b7c0 tx=0x7f71e8009290).stop 2022-01-10T01:33:14.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f70f5700 1 -- 172.21.15.36:0/3773098544 shutdown_connections 2022-01-10T01:33:14.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f70f5700 1 --2- 172.21.15.36:0/3773098544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71f00a8ac0 0x7f71f014b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f70f5700 1 --2- 172.21.15.36:0/3773098544 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71f00b2580 0x7f71f014ae40 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f70f5700 1 -- 172.21.15.36:0/3773098544 >> 172.21.15.36:0/3773098544 conn(0x7f71f0060180 msgr2=0x7f71f00b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:14.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.518+0000 7f71f70f5700 1 -- 172.21.15.36:0/3773098544 shutdown_connections 2022-01-10T01:33:14.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.522+0000 7f71f70f5700 1 -- 172.21.15.36:0/3773098544 wait complete. 2022-01-10T01:33:14.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.522+0000 7f71f70f5700 1 Processor -- start 2022-01-10T01:33:14.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.522+0000 7f71f70f5700 1 -- start start 2022-01-10T01:33:14.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.522+0000 7f71f70f5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71f00a8ac0 0x7f71f00abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.522+0000 7f71f70f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f00b0010 0x7f71f0063890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.522+0000 7f71f70f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71f00b2580 0x7f71f00ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.522+0000 7f71f70f5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f011cec0 con 0x7f71f00a8ac0 2022-01-10T01:33:14.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.522+0000 7f71f70f5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f0157190 con 0x7f71f00b0010 2022-01-10T01:33:14.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.522+0000 7f71f70f5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00af080 con 0x7f71f00b2580 2022-01-10T01:33:14.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71f60f3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71f00a8ac0 0x7f71f00abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71f60f3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71f00a8ac0 0x7f71f00abb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41598/0 (socket says 172.21.15.36:41598) 2022-01-10T01:33:14.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71f60f3700 1 -- 172.21.15.36:0/1077006238 learned_addr learned my addr 172.21.15.36:0/1077006238 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:14.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71f68f4700 1 --2- 172.21.15.36:0/1077006238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71f00b2580 0x7f71f00ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71f58f2700 1 --2- 172.21.15.36:0/1077006238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f00b0010 0x7f71f0063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71f60f3700 1 -- 172.21.15.36:0/1077006238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71f00b2580 msgr2=0x7f71f00ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71f60f3700 1 --2- 172.21.15.36:0/1077006238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71f00b2580 0x7f71f00ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71f60f3700 1 -- 172.21.15.36:0/1077006238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f00b0010 msgr2=0x7f71f0063890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71f60f3700 1 --2- 172.21.15.36:0/1077006238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f00b0010 0x7f71f0063890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71f60f3700 1 -- 172.21.15.36:0/1077006238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8009530 con 0x7f71f00a8ac0 2022-01-10T01:33:14.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71f60f3700 1 --2- 172.21.15.36:0/1077006238 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71f00a8ac0 0x7f71f00abb30 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f71f006b7c0 tx=0x7f71e8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:14.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71df7fe700 1 -- 172.21.15.36:0/1077006238 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71e8021440 con 0x7f71f00a8ac0 2022-01-10T01:33:14.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71df7fe700 1 -- 172.21.15.36:0/1077006238 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e80215a0 con 0x7f71f00a8ac0 2022-01-10T01:33:14.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71f70f5700 1 -- 172.21.15.36:0/1077006238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f0157430 con 0x7f71f00a8ac0 2022-01-10T01:33:14.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71df7fe700 1 -- 172.21.15.36:0/1077006238 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71e8021900 con 0x7f71f00a8ac0 2022-01-10T01:33:14.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71f70f5700 1 -- 172.21.15.36:0/1077006238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f00ac020 con 0x7f71f00a8ac0 2022-01-10T01:33:14.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71f70f5700 1 -- 172.21.15.36:0/1077006238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f0156fd0 con 0x7f71f00a8ac0 2022-01-10T01:33:14.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.526+0000 7f71df7fe700 1 -- 172.21.15.36:0/1077006238 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f71e800f070 con 0x7f71f00a8ac0 2022-01-10T01:33:14.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.530+0000 7f71df7fe700 1 --2- 172.21.15.36:0/1077006238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71d0053560 0x7f71d0055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.530+0000 7f71f58f2700 1 --2- 172.21.15.36:0/1077006238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71d0053560 0x7f71d0055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.530+0000 7f71df7fe700 1 -- 172.21.15.36:0/1077006238 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f71e806caf0 con 0x7f71f00a8ac0 2022-01-10T01:33:14.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.530+0000 7f71f58f2700 1 --2- 172.21.15.36:0/1077006238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71d0053560 0x7f71d0055a20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f71e000d000 tx=0x7f71e0007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:14.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.534+0000 7f71df7fe700 1 -- 172.21.15.36:0/1077006238 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f71e8043b00 con 0x7f71f00a8ac0 2022-01-10T01:33:14.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.658+0000 7f71f70f5700 1 -- 172.21.15.36:0/1077006238 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71f0057350 con 0x7f71f00a8ac0 2022-01-10T01:33:14.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.662+0000 7f71df7fe700 1 -- 172.21.15.36:0/1077006238 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f71e8015030 con 0x7f71f00a8ac0 2022-01-10T01:33:14.668 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:14.668 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":138,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:33:14.392468+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:33:12.182921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2022-01-10T01:33:13.414645+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:33:14.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.662+0000 7f71f70f5700 1 -- 172.21.15.36:0/1077006238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71d0053560 msgr2=0x7f71d0055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.662+0000 7f71f70f5700 1 --2- 172.21.15.36:0/1077006238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71d0053560 0x7f71d0055a20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f71e000d000 tx=0x7f71e0007b90).stop 2022-01-10T01:33:14.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.662+0000 7f71f70f5700 1 -- 172.21.15.36:0/1077006238 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71f00a8ac0 msgr2=0x7f71f00abb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.662+0000 7f71f70f5700 1 --2- 172.21.15.36:0/1077006238 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71f00a8ac0 0x7f71f00abb30 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f71f006b7c0 tx=0x7f71e8016000).stop 2022-01-10T01:33:14.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.662+0000 7f71f70f5700 1 -- 172.21.15.36:0/1077006238 shutdown_connections 2022-01-10T01:33:14.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.662+0000 7f71f70f5700 1 --2- 172.21.15.36:0/1077006238 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71d0053560 0x7f71d0055a20 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.662+0000 7f71f70f5700 1 --2- 172.21.15.36:0/1077006238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71f00b2580 0x7f71f00ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.662+0000 7f71f70f5700 1 --2- 172.21.15.36:0/1077006238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f00b0010 0x7f71f0063890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.662+0000 7f71f70f5700 1 --2- 172.21.15.36:0/1077006238 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71f00a8ac0 0x7f71f00abb30 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.662+0000 7f71f70f5700 1 -- 172.21.15.36:0/1077006238 >> 172.21.15.36:0/1077006238 conn(0x7f71f0060180 msgr2=0x7f71f00b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:14.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.666+0000 7f71f70f5700 1 -- 172.21.15.36:0/1077006238 shutdown_connections 2022-01-10T01:33:14.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.666+0000 7f71f70f5700 1 -- 172.21.15.36:0/1077006238 wait complete. 2022-01-10T01:33:14.681 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:33:14.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.778+0000 7fc4d2df2700 1 Processor -- start 2022-01-10T01:33:14.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.778+0000 7fc4d2df2700 1 -- start start 2022-01-10T01:33:14.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.778+0000 7fc4d2df2700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc4cc064640 0x7fc4cc0b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.778+0000 7fc4d2df2700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4cc0b8090 con 0x7fc4cc0b4aa0 2022-01-10T01:33:14.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.778+0000 7fc4d2df2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4cc143130 con 0x7fc4cc064a20 2022-01-10T01:33:14.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.778+0000 7fc4d2df2700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4cc142f40 con 0x7fc4cc064640 2022-01-10T01:33:14.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.778+0000 7fc4d15ef700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fc4cc0b4aa0 0x7fc4cc143870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39400/0 (socket says 172.21.15.36:39400) 2022-01-10T01:33:14.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.778+0000 7fc4d15ef700 1 -- 172.21.15.36:0/3731388916 learned_addr learned my addr 172.21.15.36:0/3731388916 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:14.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.778+0000 7fc4d1df0700 1 --2- 172.21.15.36:0/3731388916 >> v2:172.21.15.36:3300/0 conn(0x7fc4cc064640 0x7fc4cc0b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.778+0000 7fc4d0dee700 1 -- 172.21.15.36:0/3731388916 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087884128 0 0) 0x7fc4cc0b8090 con 0x7fc4cc0b4aa0 2022-01-10T01:33:14.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.778+0000 7fc4d0dee700 1 -- 172.21.15.36:0/3731388916 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4b4003260 con 0x7fc4cc0b4aa0 2022-01-10T01:33:14.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.778+0000 7fc4d1df0700 1 -- 172.21.15.36:0/3731388916 >> v1:172.21.15.59:6789/0 conn(0x7fc4cc064a20 legacy=0x7fc4cc066500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.778+0000 7fc4d1df0700 1 -- 172.21.15.36:0/3731388916 >> v1:172.21.15.36:6789/0 conn(0x7fc4cc0b4aa0 legacy=0x7fc4cc143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.778+0000 7fc4d1df0700 1 -- 172.21.15.36:0/3731388916 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc1433d0 con 0x7fc4cc064640 2022-01-10T01:33:14.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.782+0000 7fc4d1df0700 1 --2- 172.21.15.36:0/3731388916 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4cc064640 0x7fc4cc0b3710 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fc4c4001490 tx=0x7fc4bc006df0).ready entity=mon.0 client_cookie=eff7fc2443b95856 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:14.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.782+0000 7fc4d0dee700 1 -- 172.21.15.36:0/3731388916 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4bc00d4f0 con 0x7fc4cc064640 2022-01-10T01:33:14.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.782+0000 7fc4d0dee700 1 -- 172.21.15.36:0/3731388916 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc000e90 con 0x7fc4cc064640 2022-01-10T01:33:14.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.782+0000 7fc4d0dee700 1 -- 172.21.15.36:0/3731388916 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4bc00d840 con 0x7fc4cc064640 2022-01-10T01:33:14.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.782+0000 7fc4d2df2700 1 -- 172.21.15.36:0/3731388916 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4cc064640 msgr2=0x7fc4cc0b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.782+0000 7fc4d2df2700 1 --2- 172.21.15.36:0/3731388916 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4cc064640 0x7fc4cc0b3710 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fc4c4001490 tx=0x7fc4bc006df0).stop 2022-01-10T01:33:14.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.782+0000 7fc4d2df2700 1 -- 172.21.15.36:0/3731388916 shutdown_connections 2022-01-10T01:33:14.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.782+0000 7fc4d2df2700 1 --2- 172.21.15.36:0/3731388916 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4cc064640 0x7fc4cc0b3710 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.782+0000 7fc4d2df2700 1 -- 172.21.15.36:0/3731388916 >> 172.21.15.36:0/3731388916 conn(0x7fc4cc05f6b0 msgr2=0x7fc4cc05fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:14.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.782+0000 7fc4d2df2700 1 -- 172.21.15.36:0/3731388916 shutdown_connections 2022-01-10T01:33:14.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.782+0000 7fc4d2df2700 1 -- 172.21.15.36:0/3731388916 wait complete. 2022-01-10T01:33:14.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.782+0000 7fc4d2df2700 1 Processor -- start 2022-01-10T01:33:14.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.782+0000 7fc4d2df2700 1 -- start start 2022-01-10T01:33:14.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d2df2700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4cc064a20 0x7fc4cc0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d2df2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4cc0b4aa0 0x7fc4cc14f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d2df2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4cc13d630 0x7fc4cc14fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d2df2700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc13f890 con 0x7fc4cc064a20 2022-01-10T01:33:14.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d2df2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc152ab0 con 0x7fc4cc13d630 2022-01-10T01:33:14.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d2df2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc152d50 con 0x7fc4cc0b4aa0 2022-01-10T01:33:14.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d1df0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4cc064a20 0x7fc4cc0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d1df0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4cc064a20 0x7fc4cc0b0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41614/0 (socket says 172.21.15.36:41614) 2022-01-10T01:33:14.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d1df0700 1 -- 172.21.15.36:0/2237445844 learned_addr learned my addr 172.21.15.36:0/2237445844 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:14.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d15ef700 1 --2- 172.21.15.36:0/2237445844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4cc0b4aa0 0x7fc4cc14f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d25f1700 1 --2- 172.21.15.36:0/2237445844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4cc13d630 0x7fc4cc14fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d1df0700 1 -- 172.21.15.36:0/2237445844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4cc0b4aa0 msgr2=0x7fc4cc14f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d1df0700 1 --2- 172.21.15.36:0/2237445844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4cc0b4aa0 0x7fc4cc14f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d1df0700 1 -- 172.21.15.36:0/2237445844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4cc13d630 msgr2=0x7fc4cc14fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d1df0700 1 --2- 172.21.15.36:0/2237445844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4cc13d630 0x7fc4cc14fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d1df0700 1 -- 172.21.15.36:0/2237445844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc00b180 con 0x7fc4cc064a20 2022-01-10T01:33:14.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d1df0700 1 --2- 172.21.15.36:0/2237445844 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4cc064a20 0x7fc4cc0b0b40 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fc4c4001490 tx=0x7fc4bc014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:14.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4baffd700 1 -- 172.21.15.36:0/2237445844 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4bc013de0 con 0x7fc4cc064a20 2022-01-10T01:33:14.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4baffd700 1 -- 172.21.15.36:0/2237445844 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc0067c0 con 0x7fc4cc064a20 2022-01-10T01:33:14.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d2df2700 1 -- 172.21.15.36:0/2237445844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4cc152ff0 con 0x7fc4cc064a20 2022-01-10T01:33:14.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4baffd700 1 -- 172.21.15.36:0/2237445844 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4bc01e5f0 con 0x7fc4cc064a20 2022-01-10T01:33:14.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d2df2700 1 -- 172.21.15.36:0/2237445844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4cc1527a0 con 0x7fc4cc064a20 2022-01-10T01:33:14.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.786+0000 7fc4d2df2700 1 -- 172.21.15.36:0/2237445844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4cc150480 con 0x7fc4cc064a20 2022-01-10T01:33:14.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.790+0000 7fc4baffd700 1 -- 172.21.15.36:0/2237445844 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc4bc01c070 con 0x7fc4cc064a20 2022-01-10T01:33:14.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.790+0000 7fc4baffd700 1 --2- 172.21.15.36:0/2237445844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc4ac0535f0 0x7fc4ac055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:14.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.790+0000 7fc4baffd700 1 -- 172.21.15.36:0/2237445844 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc4bc06c2f0 con 0x7fc4cc064a20 2022-01-10T01:33:14.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.790+0000 7fc4d15ef700 1 --2- 172.21.15.36:0/2237445844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc4ac0535f0 0x7fc4ac055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:14.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.790+0000 7fc4d15ef700 1 --2- 172.21.15.36:0/2237445844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc4ac0535f0 0x7fc4ac055ab0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fc4c800d000 tx=0x7fc4c8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:14.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.794+0000 7fc4baffd700 1 -- 172.21.15.36:0/2237445844 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc4bc043260 con 0x7fc4cc064a20 2022-01-10T01:33:14.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.922+0000 7fc4d2df2700 1 -- 172.21.15.36:0/2237445844 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4cc0b7d40 con 0x7fc4cc064a20 2022-01-10T01:33:14.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.922+0000 7fc4baffd700 1 -- 172.21.15.36:0/2237445844 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+16298 (secure 0 0 0) 0x7fc4bc023020 con 0x7fc4cc064a20 2022-01-10T01:33:14.930 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:14.930 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":138,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:33:14.392468+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:33:12.182921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2022-01-10T01:33:13.414645+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:33:14.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.926+0000 7fc4d2df2700 1 -- 172.21.15.36:0/2237445844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc4ac0535f0 msgr2=0x7fc4ac055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.926+0000 7fc4d2df2700 1 --2- 172.21.15.36:0/2237445844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc4ac0535f0 0x7fc4ac055ab0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fc4c800d000 tx=0x7fc4c8009040).stop 2022-01-10T01:33:14.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.926+0000 7fc4d2df2700 1 -- 172.21.15.36:0/2237445844 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4cc064a20 msgr2=0x7fc4cc0b0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:14.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.926+0000 7fc4d2df2700 1 --2- 172.21.15.36:0/2237445844 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4cc064a20 0x7fc4cc0b0b40 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fc4c4001490 tx=0x7fc4bc014000).stop 2022-01-10T01:33:14.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.926+0000 7fc4d2df2700 1 -- 172.21.15.36:0/2237445844 shutdown_connections 2022-01-10T01:33:14.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.926+0000 7fc4d2df2700 1 --2- 172.21.15.36:0/2237445844 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc4ac0535f0 0x7fc4ac055ab0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.926+0000 7fc4d2df2700 1 --2- 172.21.15.36:0/2237445844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4cc13d630 0x7fc4cc14fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.926+0000 7fc4d2df2700 1 --2- 172.21.15.36:0/2237445844 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4cc0b4aa0 0x7fc4cc14f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.926+0000 7fc4d2df2700 1 --2- 172.21.15.36:0/2237445844 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc4cc064a20 0x7fc4cc0b0b40 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:14.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.926+0000 7fc4d2df2700 1 -- 172.21.15.36:0/2237445844 >> 172.21.15.36:0/2237445844 conn(0x7fc4cc05f6b0 msgr2=0x7fc4cc05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:14.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.926+0000 7fc4d2df2700 1 -- 172.21.15.36:0/2237445844 shutdown_connections 2022-01-10T01:33:14.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:14.926+0000 7fc4d2df2700 1 -- 172.21.15.36:0/2237445844 wait complete. 2022-01-10T01:33:14.943 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-01-10T01:33:15.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e12978700 1 Processor -- start 2022-01-10T01:33:15.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e12978700 1 -- start start 2022-01-10T01:33:15.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e12978700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9e0c0b2580 0x7f9e0c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e12978700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e0c0a8ac0 0x7f9e0c14b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e12978700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0c0a70c0 con 0x7f9e0c0b0010 2022-01-10T01:33:15.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e12978700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c0a72f0 con 0x7f9e0c0b2580 2022-01-10T01:33:15.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e12978700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0c0a7590 con 0x7f9e0c0a8ac0 2022-01-10T01:33:15.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e11976700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9e0c0b2580 0x7f9e0c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e11976700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9e0c0b2580 0x7f9e0c14ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41620/0 (socket says 172.21.15.36:41620) 2022-01-10T01:33:15.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e11976700 1 -- 172.21.15.36:0/1338648750 learned_addr learned my addr 172.21.15.36:0/1338648750 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:15.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e12177700 1 --2- 172.21.15.36:0/1338648750 >> v2:172.21.15.59:3300/0 conn(0x7f9e0c0a8ac0 0x7f9e0c14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e11976700 1 -- 172.21.15.36:0/1338648750 >> v2:172.21.15.59:3300/0 conn(0x7f9e0c0a8ac0 msgr2=0x7f9e0c14b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:15.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e11976700 1 --2- 172.21.15.36:0/1338648750 >> v2:172.21.15.59:3300/0 conn(0x7f9e0c0a8ac0 0x7f9e0c14b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e11976700 1 -- 172.21.15.36:0/1338648750 >> v1:172.21.15.59:6789/0 conn(0x7f9e0c0b0010 legacy=0x7f9e0c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e11976700 1 -- 172.21.15.36:0/1338648750 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c0a7830 con 0x7f9e0c0b2580 2022-01-10T01:33:15.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e11976700 1 --2- 172.21.15.36:0/1338648750 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e0c0b2580 0x7f9e0c14ae40 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f9e08002f70 tx=0x7f9e08006eb0).ready entity=mon.0 client_cookie=d9d1b5adc699fe37 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:15.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e10974700 1 -- 172.21.15.36:0/1338648750 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0800d5c0 con 0x7f9e0c0b2580 2022-01-10T01:33:15.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e10974700 1 -- 172.21.15.36:0/1338648750 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e08000e90 con 0x7f9e0c0b2580 2022-01-10T01:33:15.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e10974700 1 -- 172.21.15.36:0/1338648750 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0800d950 con 0x7f9e0c0b2580 2022-01-10T01:33:15.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e12978700 1 -- 172.21.15.36:0/1338648750 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e0c0b2580 msgr2=0x7f9e0c14ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.054+0000 7f9e12978700 1 --2- 172.21.15.36:0/1338648750 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e0c0b2580 0x7f9e0c14ae40 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f9e08002f70 tx=0x7f9e08006eb0).stop 2022-01-10T01:33:15.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.058+0000 7f9e12978700 1 -- 172.21.15.36:0/1338648750 shutdown_connections 2022-01-10T01:33:15.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.058+0000 7f9e12978700 1 --2- 172.21.15.36:0/1338648750 >> v2:172.21.15.59:3300/0 conn(0x7f9e0c0a8ac0 0x7f9e0c14b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.058+0000 7f9e12978700 1 --2- 172.21.15.36:0/1338648750 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e0c0b2580 0x7f9e0c14ae40 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.058+0000 7f9e12978700 1 -- 172.21.15.36:0/1338648750 >> 172.21.15.36:0/1338648750 conn(0x7f9e0c060180 msgr2=0x7f9e0c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:15.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.058+0000 7f9e12978700 1 -- 172.21.15.36:0/1338648750 shutdown_connections 2022-01-10T01:33:15.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.058+0000 7f9e12978700 1 -- 172.21.15.36:0/1338648750 wait complete. 2022-01-10T01:33:15.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.058+0000 7f9e12978700 1 Processor -- start 2022-01-10T01:33:15.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.058+0000 7f9e12978700 1 -- start start 2022-01-10T01:33:15.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e12978700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e0c0a8ac0 0x7f9e0c148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e12978700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0c0b0010 0x7f9e0c0ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e12978700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e0c0b2580 0x7f9e0c156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e12978700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0669e0 con 0x7f9e0c0a8ac0 2022-01-10T01:33:15.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e12978700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0aa0d0 con 0x7f9e0c0b0010 2022-01-10T01:33:15.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e12978700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0c0aa370 con 0x7f9e0c0b2580 2022-01-10T01:33:15.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e11976700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e0c0a8ac0 0x7f9e0c148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e11976700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e0c0a8ac0 0x7f9e0c148860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41626/0 (socket says 172.21.15.36:41626) 2022-01-10T01:33:15.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e11976700 1 -- 172.21.15.36:0/1108308921 learned_addr learned my addr 172.21.15.36:0/1108308921 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:15.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e11175700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0c0b0010 0x7f9e0c0ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e12177700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e0c0b2580 0x7f9e0c156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e11976700 1 -- 172.21.15.36:0/1108308921 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e0c0b2580 msgr2=0x7f9e0c156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e11976700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e0c0b2580 0x7f9e0c156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e11976700 1 -- 172.21.15.36:0/1108308921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0c0b0010 msgr2=0x7f9e0c0ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e11976700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0c0b0010 0x7f9e0c0ab950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e11976700 1 -- 172.21.15.36:0/1108308921 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0800b1e0 con 0x7f9e0c0a8ac0 2022-01-10T01:33:15.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e11175700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0c0b0010 0x7f9e0c0ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:15.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e11976700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e0c0a8ac0 0x7f9e0c148860 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f9e08002f70 tx=0x7f9e08015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:15.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e02ffd700 1 -- 172.21.15.36:0/1108308921 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0800d940 con 0x7f9e0c0a8ac0 2022-01-10T01:33:15.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e02ffd700 1 -- 172.21.15.36:0/1108308921 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e08011ce0 con 0x7f9e0c0a8ac0 2022-01-10T01:33:15.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e12978700 1 -- 172.21.15.36:0/1108308921 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0c0aa610 con 0x7f9e0c0a8ac0 2022-01-10T01:33:15.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e02ffd700 1 -- 172.21.15.36:0/1108308921 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e0801e650 con 0x7f9e0c0a8ac0 2022-01-10T01:33:15.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e12978700 1 -- 172.21.15.36:0/1108308921 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0c148dd0 con 0x7f9e0c0a8ac0 2022-01-10T01:33:15.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.062+0000 7f9e12978700 1 -- 172.21.15.36:0/1108308921 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0c057350 con 0x7f9e0c0a8ac0 2022-01-10T01:33:15.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.066+0000 7f9e02ffd700 1 -- 172.21.15.36:0/1108308921 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9e08025030 con 0x7f9e0c0a8ac0 2022-01-10T01:33:15.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.066+0000 7f9e02ffd700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9df40534d0 0x7f9df4055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.066+0000 7f9e02ffd700 1 -- 172.21.15.36:0/1108308921 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9e0806cb60 con 0x7f9e0c0a8ac0 2022-01-10T01:33:15.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.066+0000 7f9e11175700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9df40534d0 0x7f9df4055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.066+0000 7f9e11175700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9df40534d0 0x7f9df4055990 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f9dfc00b000 tx=0x7f9dfc009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:15.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.070+0000 7f9e02ffd700 1 -- 172.21.15.36:0/1108308921 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9e08043b70 con 0x7f9e0c0a8ac0 2022-01-10T01:33:15.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.234+0000 7f9e12978700 1 -- 172.21.15.36:0/1108308921 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9e0c0698e0 con 0x7f9e0c0a8ac0 2022-01-10T01:33:15.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.406+0000 7f9e02ffd700 1 -- 172.21.15.36:0/1108308921 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9e08023020 con 0x7f9e0c0a8ac0 2022-01-10T01:33:15.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.410+0000 7f9e12978700 1 -- 172.21.15.36:0/1108308921 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9df40534d0 msgr2=0x7f9df4055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.410+0000 7f9e12978700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9df40534d0 0x7f9df4055990 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f9dfc00b000 tx=0x7f9dfc009040).stop 2022-01-10T01:33:15.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.410+0000 7f9e12978700 1 -- 172.21.15.36:0/1108308921 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e0c0a8ac0 msgr2=0x7f9e0c148860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.410+0000 7f9e12978700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e0c0a8ac0 0x7f9e0c148860 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f9e08002f70 tx=0x7f9e08015000).stop 2022-01-10T01:33:15.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.410+0000 7f9e12978700 1 -- 172.21.15.36:0/1108308921 shutdown_connections 2022-01-10T01:33:15.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.410+0000 7f9e12978700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9df40534d0 0x7f9df4055990 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.410+0000 7f9e12978700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e0c0b2580 0x7f9e0c156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.410+0000 7f9e12978700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e0c0b0010 0x7f9e0c0ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.410+0000 7f9e12978700 1 --2- 172.21.15.36:0/1108308921 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e0c0a8ac0 0x7f9e0c148860 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.410+0000 7f9e12978700 1 -- 172.21.15.36:0/1108308921 >> 172.21.15.36:0/1108308921 conn(0x7f9e0c060180 msgr2=0x7f9e0c0adc10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:15.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.410+0000 7f9e12978700 1 -- 172.21.15.36:0/1108308921 shutdown_connections 2022-01-10T01:33:15.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.410+0000 7f9e12978700 1 -- 172.21.15.36:0/1108308921 wait complete. 2022-01-10T01:33:15.430 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:15.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.530+0000 7f60affff700 1 Processor -- start 2022-01-10T01:33:15.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.530+0000 7f60affff700 1 -- start start 2022-01-10T01:33:15.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60affff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f60b00601a0 0x7f60b00b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60affff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60b005c560 0x7f60b00a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60affff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b00aa4a0 con 0x7f60b00af3c0 2022-01-10T01:33:15.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60affff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b00b1450 con 0x7f60b00601a0 2022-01-10T01:33:15.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60affff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00af7a0 con 0x7f60b005c560 2022-01-10T01:33:15.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60a7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f60b00601a0 0x7f60b00b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60b005c560 0x7f60b00a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60a7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f60b00601a0 0x7f60b00b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:38268/0 (socket says 172.21.15.36:38268) 2022-01-10T01:33:15.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60aeffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f60b00af3c0 0x7f60b0144450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:57104/0 (socket says 172.21.15.36:57104) 2022-01-10T01:33:15.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60a7fff700 1 -- 172.21.15.36:0/824086880 learned_addr learned my addr 172.21.15.36:0/824086880 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:15.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60a7fff700 1 -- 172.21.15.36:0/824086880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60b005c560 msgr2=0x7f60b00a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:15.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60a7fff700 1 --2- 172.21.15.36:0/824086880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60b005c560 0x7f60b00a8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60a7fff700 1 -- 172.21.15.36:0/824086880 >> v1:172.21.15.59:6789/0 conn(0x7f60b00af3c0 legacy=0x7f60b0144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60a7fff700 1 -- 172.21.15.36:0/824086880 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b005fb80 con 0x7f60b00601a0 2022-01-10T01:33:15.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60af7fe700 1 --2- 172.21.15.36:0/824086880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60b005c560 0x7f60b00a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:15.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60a7fff700 1 --2- 172.21.15.36:0/824086880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60b00601a0 0x7f60b00b0cb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f6098002f70 tx=0x7f6098006eb0).ready entity=mon.1 client_cookie=6cc8eaa5c2283c2b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:15.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60ae7fc700 1 -- 172.21.15.36:0/824086880 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609800d570 con 0x7f60b00601a0 2022-01-10T01:33:15.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60ae7fc700 1 -- 172.21.15.36:0/824086880 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6098000e90 con 0x7f60b00601a0 2022-01-10T01:33:15.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60ae7fc700 1 -- 172.21.15.36:0/824086880 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609800d900 con 0x7f60b00601a0 2022-01-10T01:33:15.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60affff700 1 -- 172.21.15.36:0/824086880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60b00601a0 msgr2=0x7f60b00b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60affff700 1 --2- 172.21.15.36:0/824086880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60b00601a0 0x7f60b00b0cb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f6098002f70 tx=0x7f6098006eb0).stop 2022-01-10T01:33:15.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60affff700 1 -- 172.21.15.36:0/824086880 shutdown_connections 2022-01-10T01:33:15.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60affff700 1 --2- 172.21.15.36:0/824086880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60b005c560 0x7f60b00a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60affff700 1 --2- 172.21.15.36:0/824086880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60b00601a0 0x7f60b00b0cb0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60affff700 1 -- 172.21.15.36:0/824086880 >> 172.21.15.36:0/824086880 conn(0x7f60b0061140 msgr2=0x7f60b0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:15.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60affff700 1 -- 172.21.15.36:0/824086880 shutdown_connections 2022-01-10T01:33:15.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.534+0000 7f60affff700 1 -- 172.21.15.36:0/824086880 wait complete. 2022-01-10T01:33:15.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60affff700 1 Processor -- start 2022-01-10T01:33:15.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60affff700 1 -- start start 2022-01-10T01:33:15.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60affff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60b005c560 0x7f60b00a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60affff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60b00601a0 0x7f60b0144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60affff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60b00af3c0 0x7f60b0144e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60affff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b01416a0 con 0x7f60b005c560 2022-01-10T01:33:15.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60affff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00ae390 con 0x7f60b00af3c0 2022-01-10T01:33:15.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60affff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00b5000 con 0x7f60b00601a0 2022-01-10T01:33:15.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60aeffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60b005c560 0x7f60b00a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60af7fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60b00af3c0 0x7f60b0144e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60aeffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60b005c560 0x7f60b00a8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41640/0 (socket says 172.21.15.36:41640) 2022-01-10T01:33:15.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60aeffd700 1 -- 172.21.15.36:0/2078525887 learned_addr learned my addr 172.21.15.36:0/2078525887 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:15.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60a7fff700 1 --2- 172.21.15.36:0/2078525887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60b00601a0 0x7f60b0144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60aeffd700 1 -- 172.21.15.36:0/2078525887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60b00601a0 msgr2=0x7f60b0144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60aeffd700 1 --2- 172.21.15.36:0/2078525887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60b00601a0 0x7f60b0144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60aeffd700 1 -- 172.21.15.36:0/2078525887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60b00af3c0 msgr2=0x7f60b0144e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60aeffd700 1 --2- 172.21.15.36:0/2078525887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60b00af3c0 0x7f60b0144e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60aeffd700 1 -- 172.21.15.36:0/2078525887 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a8009470 con 0x7f60b005c560 2022-01-10T01:33:15.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.538+0000 7f60aeffd700 1 --2- 172.21.15.36:0/2078525887 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60b005c560 0x7f60b00a8480 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f60b0144670 tx=0x7f60a0007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:15.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.542+0000 7f60acff9700 1 -- 172.21.15.36:0/2078525887 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a0007170 con 0x7f60b005c560 2022-01-10T01:33:15.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.542+0000 7f60acff9700 1 -- 172.21.15.36:0/2078525887 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a00072d0 con 0x7f60b005c560 2022-01-10T01:33:15.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.542+0000 7f60affff700 1 -- 172.21.15.36:0/2078525887 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609800b1e0 con 0x7f60b005c560 2022-01-10T01:33:15.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.542+0000 7f60acff9700 1 -- 172.21.15.36:0/2078525887 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a0004710 con 0x7f60b005c560 2022-01-10T01:33:15.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.542+0000 7f60affff700 1 -- 172.21.15.36:0/2078525887 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b005f6b0 con 0x7f60b005c560 2022-01-10T01:33:15.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.542+0000 7f60affff700 1 -- 172.21.15.36:0/2078525887 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b0144720 con 0x7f60b005c560 2022-01-10T01:33:15.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.542+0000 7f60acff9700 1 -- 172.21.15.36:0/2078525887 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f60a0004870 con 0x7f60b005c560 2022-01-10T01:33:15.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.546+0000 7f60acff9700 1 --2- 172.21.15.36:0/2078525887 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60940534d0 0x7f6094055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.546+0000 7f60acff9700 1 -- 172.21.15.36:0/2078525887 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f60a006b380 con 0x7f60b005c560 2022-01-10T01:33:15.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.546+0000 7f60a7fff700 1 --2- 172.21.15.36:0/2078525887 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60940534d0 0x7f6094055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.546+0000 7f60a7fff700 1 --2- 172.21.15.36:0/2078525887 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60940534d0 0x7f6094055990 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f609801c000 tx=0x7f6098015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:15.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.550+0000 7f60acff9700 1 -- 172.21.15.36:0/2078525887 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f60a0068e90 con 0x7f60b005c560 2022-01-10T01:33:15.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.718+0000 7f60affff700 1 -- 172.21.15.36:0/2078525887 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60b005f8e0 con 0x7f60b005c560 2022-01-10T01:33:15.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.722+0000 7f60acff9700 1 -- 172.21.15.36:0/2078525887 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f60a0047020 con 0x7f60b005c560 2022-01-10T01:33:15.726 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:15.726 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8016,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/2824324236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2824324236},{"type":"v1","addr":"172.21.15.36:6835","nonce":2824324236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1768428808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1768428808},{"type":"v1","addr":"172.21.15.36:6837","nonce":1768428808}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:14.392835+0000","modified":"2022-01-10T01:33:15.396812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8028":{"gid":8028,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3822558856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3822558856},{"type":"v1","addr":"172.21.15.59:6833","nonce":3822558856}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2022-01-10T01:33:15.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.722+0000 7f60affff700 1 -- 172.21.15.36:0/2078525887 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60940534d0 msgr2=0x7f6094055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.722+0000 7f60affff700 1 --2- 172.21.15.36:0/2078525887 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60940534d0 0x7f6094055990 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f609801c000 tx=0x7f6098015000).stop 2022-01-10T01:33:15.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.722+0000 7f60affff700 1 -- 172.21.15.36:0/2078525887 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60b005c560 msgr2=0x7f60b00a8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.722+0000 7f60affff700 1 --2- 172.21.15.36:0/2078525887 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60b005c560 0x7f60b00a8480 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f60b0144670 tx=0x7f60a0007c10).stop 2022-01-10T01:33:15.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.722+0000 7f60affff700 1 -- 172.21.15.36:0/2078525887 shutdown_connections 2022-01-10T01:33:15.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.722+0000 7f60affff700 1 --2- 172.21.15.36:0/2078525887 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60940534d0 0x7f6094055990 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.722+0000 7f60affff700 1 --2- 172.21.15.36:0/2078525887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60b00af3c0 0x7f60b0144e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.722+0000 7f60affff700 1 --2- 172.21.15.36:0/2078525887 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60b00601a0 0x7f60b0144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.722+0000 7f60affff700 1 --2- 172.21.15.36:0/2078525887 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60b005c560 0x7f60b00a8480 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.722+0000 7f60affff700 1 -- 172.21.15.36:0/2078525887 >> 172.21.15.36:0/2078525887 conn(0x7f60b0061140 msgr2=0x7f60b00a8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:15.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.722+0000 7f60affff700 1 -- 172.21.15.36:0/2078525887 shutdown_connections 2022-01-10T01:33:15.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.722+0000 7f60affff700 1 -- 172.21.15.36:0/2078525887 wait complete. 2022-01-10T01:33:15.731 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 66 2022-01-10T01:33:15.746 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:33:15.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f910a308700 1 Processor -- start 2022-01-10T01:33:15.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f910a308700 1 -- start start 2022-01-10T01:33:15.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f910a308700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91040b1db0 0x7f91040b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f910a308700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91041483a0 0x7f91040b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f910a308700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91040b0350 con 0x7f91040a70c0 2022-01-10T01:33:15.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f910a308700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91040a90c0 con 0x7f91040b1db0 2022-01-10T01:33:15.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f910a308700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91040b05f0 con 0x7f91041483a0 2022-01-10T01:33:15.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f91088a5700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f91040a70c0 0x7f9104144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39446/0 (socket says 172.21.15.36:39446) 2022-01-10T01:33:15.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f91088a5700 1 -- 172.21.15.36:0/1473194996 learned_addr learned my addr 172.21.15.36:0/1473194996 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:15.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f9103fff700 1 --2- 172.21.15.36:0/1473194996 >> v2:172.21.15.59:3300/0 conn(0x7f91040b1db0 0x7f91040b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f91037fe700 1 --2- 172.21.15.36:0/1473194996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91041483a0 0x7f91040b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f9102ffd700 1 -- 172.21.15.36:0/1473194996 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823677276 0 0) 0x7f91040b0350 con 0x7f91040a70c0 2022-01-10T01:33:15.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f9102ffd700 1 -- 172.21.15.36:0/1473194996 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f0003260 con 0x7f91040a70c0 2022-01-10T01:33:15.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f9103fff700 1 -- 172.21.15.36:0/1473194996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91041483a0 msgr2=0x7f91040b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:15.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f9103fff700 1 --2- 172.21.15.36:0/1473194996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91041483a0 0x7f91040b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f9103fff700 1 -- 172.21.15.36:0/1473194996 >> v1:172.21.15.36:6789/0 conn(0x7f91040a70c0 legacy=0x7f9104144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f9103fff700 1 -- 172.21.15.36:0/1473194996 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91040b0890 con 0x7f91040b1db0 2022-01-10T01:33:15.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.842+0000 7f91037fe700 1 --2- 172.21.15.36:0/1473194996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91041483a0 0x7f91040b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:15.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.846+0000 7f9103fff700 1 --2- 172.21.15.36:0/1473194996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91040b1db0 0x7f91040b0fd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f90f8002f70 tx=0x7f90f8006df0).ready entity=mon.1 client_cookie=ea88d478504a9565 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:15.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.846+0000 7f9102ffd700 1 -- 172.21.15.36:0/1473194996 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90f800d4a0 con 0x7f91040b1db0 2022-01-10T01:33:15.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.846+0000 7f9102ffd700 1 -- 172.21.15.36:0/1473194996 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f8000e90 con 0x7f91040b1db0 2022-01-10T01:33:15.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.846+0000 7f9102ffd700 1 -- 172.21.15.36:0/1473194996 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90f800d7f0 con 0x7f91040b1db0 2022-01-10T01:33:15.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.846+0000 7f910a308700 1 -- 172.21.15.36:0/1473194996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91040b1db0 msgr2=0x7f91040b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.846+0000 7f910a308700 1 --2- 172.21.15.36:0/1473194996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91040b1db0 0x7f91040b0fd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f90f8002f70 tx=0x7f90f8006df0).stop 2022-01-10T01:33:15.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.846+0000 7f910a308700 1 -- 172.21.15.36:0/1473194996 shutdown_connections 2022-01-10T01:33:15.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.846+0000 7f910a308700 1 --2- 172.21.15.36:0/1473194996 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91041483a0 0x7f91040b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.846+0000 7f910a308700 1 --2- 172.21.15.36:0/1473194996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91040b1db0 0x7f91040b0fd0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.846+0000 7f910a308700 1 -- 172.21.15.36:0/1473194996 >> 172.21.15.36:0/1473194996 conn(0x7f910405f6b0 msgr2=0x7f910405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:15.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.846+0000 7f910a308700 1 -- 172.21.15.36:0/1473194996 shutdown_connections 2022-01-10T01:33:15.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.846+0000 7f910a308700 1 -- 172.21.15.36:0/1473194996 wait complete. 2022-01-10T01:33:15.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f910a308700 1 Processor -- start 2022-01-10T01:33:15.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f910a308700 1 -- start start 2022-01-10T01:33:15.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f910a308700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91040a70c0 0x7f9104140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f910a308700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91040b1db0 0x7f91041418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f910a308700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91041483a0 0x7f9104141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f910a308700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9104142290 con 0x7f91040b1db0 2022-01-10T01:33:15.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f910a308700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910413e4f0 con 0x7f91041483a0 2022-01-10T01:33:15.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f910a308700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910413dfb0 con 0x7f91040a70c0 2022-01-10T01:33:15.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f91037fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91040b1db0 0x7f91041418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f91037fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91040b1db0 0x7f91041418b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41656/0 (socket says 172.21.15.36:41656) 2022-01-10T01:33:15.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f91037fe700 1 -- 172.21.15.36:0/2308671107 learned_addr learned my addr 172.21.15.36:0/2308671107 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:15.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f9103fff700 1 --2- 172.21.15.36:0/2308671107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91040a70c0 0x7f9104140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f91088a5700 1 --2- 172.21.15.36:0/2308671107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91041483a0 0x7f9104141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f91037fe700 1 -- 172.21.15.36:0/2308671107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91040a70c0 msgr2=0x7f9104140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f91037fe700 1 --2- 172.21.15.36:0/2308671107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91040a70c0 0x7f9104140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f91037fe700 1 -- 172.21.15.36:0/2308671107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91041483a0 msgr2=0x7f9104141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f91037fe700 1 --2- 172.21.15.36:0/2308671107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91041483a0 0x7f9104141da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f91037fe700 1 -- 172.21.15.36:0/2308671107 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f400b180 con 0x7f91040b1db0 2022-01-10T01:33:15.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f91037fe700 1 --2- 172.21.15.36:0/2308671107 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91040b1db0 0x7f91041418b0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f90f400c000 tx=0x7f90f4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:15.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f91017fa700 1 -- 172.21.15.36:0/2308671107 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90f4010780 con 0x7f91040b1db0 2022-01-10T01:33:15.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f91017fa700 1 -- 172.21.15.36:0/2308671107 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f40108e0 con 0x7f91040b1db0 2022-01-10T01:33:15.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f910a308700 1 -- 172.21.15.36:0/2308671107 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f800b180 con 0x7f91040b1db0 2022-01-10T01:33:15.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.850+0000 7f91017fa700 1 -- 172.21.15.36:0/2308671107 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90f4010c40 con 0x7f91040b1db0 2022-01-10T01:33:15.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.854+0000 7f910a308700 1 -- 172.21.15.36:0/2308671107 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9104140860 con 0x7f91040b1db0 2022-01-10T01:33:15.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.854+0000 7f910a308700 1 -- 172.21.15.36:0/2308671107 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91040b0b30 con 0x7f91040b1db0 2022-01-10T01:33:15.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.854+0000 7f91017fa700 1 -- 172.21.15.36:0/2308671107 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f90f401c460 con 0x7f91040b1db0 2022-01-10T01:33:15.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.854+0000 7f91017fa700 1 --2- 172.21.15.36:0/2308671107 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90e4053620 0x7f90e4055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:15.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.854+0000 7f91017fa700 1 -- 172.21.15.36:0/2308671107 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f90f406bf80 con 0x7f91040b1db0 2022-01-10T01:33:15.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.854+0000 7f9103fff700 1 --2- 172.21.15.36:0/2308671107 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90e4053620 0x7f90e4055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:15.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.854+0000 7f9103fff700 1 --2- 172.21.15.36:0/2308671107 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90e4053620 0x7f90e4055ae0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f90f801a000 tx=0x7f90f8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:15.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.862+0000 7f91017fa700 1 -- 172.21.15.36:0/2308671107 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f90f4042f30 con 0x7f91040b1db0 2022-01-10T01:33:15.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.986+0000 7f910a308700 1 -- 172.21.15.36:0/2308671107 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9104057350 con 0x7f91040b1db0 2022-01-10T01:33:15.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.990+0000 7f91017fa700 1 -- 172.21.15.36:0/2308671107 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f90f4046550 con 0x7f91040b1db0 2022-01-10T01:33:15.995 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:15.995 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":139,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:33:15.396927+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:33:12.182921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2022-01-10T01:33:13.414645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:33:15.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.990+0000 7f910a308700 1 -- 172.21.15.36:0/2308671107 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90e4053620 msgr2=0x7f90e4055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.990+0000 7f910a308700 1 --2- 172.21.15.36:0/2308671107 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90e4053620 0x7f90e4055ae0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f90f801a000 tx=0x7f90f8014000).stop 2022-01-10T01:33:15.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.990+0000 7f910a308700 1 -- 172.21.15.36:0/2308671107 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91040b1db0 msgr2=0x7f91041418b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:15.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.990+0000 7f910a308700 1 --2- 172.21.15.36:0/2308671107 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91040b1db0 0x7f91041418b0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f90f400c000 tx=0x7f90f4006df0).stop 2022-01-10T01:33:15.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.990+0000 7f910a308700 1 -- 172.21.15.36:0/2308671107 shutdown_connections 2022-01-10T01:33:15.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.990+0000 7f910a308700 1 --2- 172.21.15.36:0/2308671107 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90e4053620 0x7f90e4055ae0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.990+0000 7f910a308700 1 --2- 172.21.15.36:0/2308671107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91041483a0 0x7f9104141da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:15.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.990+0000 7f910a308700 1 --2- 172.21.15.36:0/2308671107 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f91040b1db0 0x7f91041418b0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.990+0000 7f910a308700 1 --2- 172.21.15.36:0/2308671107 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91040a70c0 0x7f9104140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.990+0000 7f910a308700 1 -- 172.21.15.36:0/2308671107 >> 172.21.15.36:0/2308671107 conn(0x7f910405f6b0 msgr2=0x7f9104147770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:16.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.990+0000 7f910a308700 1 -- 172.21.15.36:0/2308671107 shutdown_connections 2022-01-10T01:33:16.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:15.990+0000 7f910a308700 1 -- 172.21.15.36:0/2308671107 wait complete. 2022-01-10T01:33:16.008 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:33:16.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.114+0000 7f903e287700 1 Processor -- start 2022-01-10T01:33:16.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.114+0000 7f903e287700 1 -- start start 2022-01-10T01:33:16.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903e287700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f903805d0b0 0x7f90380b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903e287700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f903813f390 0x7f90380aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903e287700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903805cbb0 con 0x7f903805c7d0 2022-01-10T01:33:16.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903e287700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90380ad540 con 0x7f903813f390 2022-01-10T01:33:16.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903e287700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9038067d70 con 0x7f903805d0b0 2022-01-10T01:33:16.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903da86700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f903813f390 0x7f90380aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903d285700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f903805c7d0 0x7f90380ace30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39456/0 (socket says 172.21.15.36:39456) 2022-01-10T01:33:16.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903d285700 1 -- 172.21.15.36:0/3717341120 learned_addr learned my addr 172.21.15.36:0/3717341120 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:16.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903ca84700 1 --2- 172.21.15.36:0/3717341120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f903805d0b0 0x7f90380b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f9027fff700 1 -- 172.21.15.36:0/3717341120 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079187957 0 0) 0x7f903805cbb0 con 0x7f903805c7d0 2022-01-10T01:33:16.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f9027fff700 1 -- 172.21.15.36:0/3717341120 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9020003260 con 0x7f903805c7d0 2022-01-10T01:33:16.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903da86700 1 -- 172.21.15.36:0/3717341120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f903805d0b0 msgr2=0x7f90380b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:16.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903da86700 1 --2- 172.21.15.36:0/3717341120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f903805d0b0 0x7f90380b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903da86700 1 -- 172.21.15.36:0/3717341120 >> v1:172.21.15.36:6789/0 conn(0x7f903805c7d0 legacy=0x7f90380ace30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903da86700 1 -- 172.21.15.36:0/3717341120 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90380b1790 con 0x7f903813f390 2022-01-10T01:33:16.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903da86700 1 --2- 172.21.15.36:0/3717341120 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f903813f390 0x7f90380aece0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f90300032f0 tx=0x7f90300091d0).ready entity=mon.0 client_cookie=803fd4653c25634a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:16.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f9027fff700 1 -- 172.21.15.36:0/3717341120 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f903000b600 con 0x7f903813f390 2022-01-10T01:33:16.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f9027fff700 1 -- 172.21.15.36:0/3717341120 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903000b760 con 0x7f903813f390 2022-01-10T01:33:16.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f9027fff700 1 -- 172.21.15.36:0/3717341120 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f903000b8d0 con 0x7f903813f390 2022-01-10T01:33:16.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903e287700 1 -- 172.21.15.36:0/3717341120 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f903813f390 msgr2=0x7f90380aece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903e287700 1 --2- 172.21.15.36:0/3717341120 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f903813f390 0x7f90380aece0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f90300032f0 tx=0x7f90300091d0).stop 2022-01-10T01:33:16.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903e287700 1 -- 172.21.15.36:0/3717341120 shutdown_connections 2022-01-10T01:33:16.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903e287700 1 --2- 172.21.15.36:0/3717341120 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f903813f390 0x7f90380aece0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903e287700 1 --2- 172.21.15.36:0/3717341120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f903805d0b0 0x7f90380b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903e287700 1 -- 172.21.15.36:0/3717341120 >> 172.21.15.36:0/3717341120 conn(0x7f9038060180 msgr2=0x7f90380b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:16.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903e287700 1 -- 172.21.15.36:0/3717341120 shutdown_connections 2022-01-10T01:33:16.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.118+0000 7f903e287700 1 -- 172.21.15.36:0/3717341120 wait complete. 2022-01-10T01:33:16.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.122+0000 7f903e287700 1 Processor -- start 2022-01-10T01:33:16.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.122+0000 7f903e287700 1 -- start start 2022-01-10T01:33:16.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903e287700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f903805c7d0 0x7f90380636d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903e287700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f903805d0b0 0x7f9038142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903e287700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f903813f390 0x7f9038064e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903e287700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9038064350 con 0x7f903813f390 2022-01-10T01:33:16.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903e287700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9038063000 con 0x7f903805d0b0 2022-01-10T01:33:16.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903e287700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90380ab780 con 0x7f903805c7d0 2022-01-10T01:33:16.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903da86700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f903813f390 0x7f9038064e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903da86700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f903813f390 0x7f9038064e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41672/0 (socket says 172.21.15.36:41672) 2022-01-10T01:33:16.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903ca84700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f903805d0b0 0x7f9038142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903d285700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f903805c7d0 0x7f90380636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903da86700 1 -- 172.21.15.36:0/280015675 learned_addr learned my addr 172.21.15.36:0/280015675 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:16.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903d285700 1 -- 172.21.15.36:0/280015675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f903805d0b0 msgr2=0x7f9038142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903d285700 1 --2- 172.21.15.36:0/280015675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f903805d0b0 0x7f9038142750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903d285700 1 -- 172.21.15.36:0/280015675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f903813f390 msgr2=0x7f9038064e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903d285700 1 --2- 172.21.15.36:0/280015675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f903813f390 0x7f9038064e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903d285700 1 -- 172.21.15.36:0/280015675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9030009470 con 0x7f903805c7d0 2022-01-10T01:33:16.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903d285700 1 --2- 172.21.15.36:0/280015675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f903805c7d0 0x7f90380636d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f9038064d50 tx=0x7f9034007a20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:16.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f90267fc700 1 -- 172.21.15.36:0/280015675 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90340070d0 con 0x7f903805c7d0 2022-01-10T01:33:16.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f90267fc700 1 -- 172.21.15.36:0/280015675 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9034007230 con 0x7f903805c7d0 2022-01-10T01:33:16.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903e287700 1 -- 172.21.15.36:0/280015675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90380aba20 con 0x7f903805c7d0 2022-01-10T01:33:16.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f90267fc700 1 -- 172.21.15.36:0/280015675 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9034005610 con 0x7f903805c7d0 2022-01-10T01:33:16.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903e287700 1 -- 172.21.15.36:0/280015675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903813cce0 con 0x7f903805c7d0 2022-01-10T01:33:16.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f90267fc700 1 -- 172.21.15.36:0/280015675 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9034010070 con 0x7f903805c7d0 2022-01-10T01:33:16.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.126+0000 7f903e287700 1 -- 172.21.15.36:0/280015675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90380ab4f0 con 0x7f903805c7d0 2022-01-10T01:33:16.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.130+0000 7f90267fc700 1 --2- 172.21.15.36:0/280015675 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90180535f0 0x7f9018055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.130+0000 7f90267fc700 1 -- 172.21.15.36:0/280015675 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f903406b250 con 0x7f903805c7d0 2022-01-10T01:33:16.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.130+0000 7f903ca84700 1 --2- 172.21.15.36:0/280015675 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90180535f0 0x7f9018055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.130+0000 7f903ca84700 1 --2- 172.21.15.36:0/280015675 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90180535f0 0x7f9018055ab0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f902800b000 tx=0x7f9028006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:16.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.138+0000 7f90267fc700 1 -- 172.21.15.36:0/280015675 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f90340420d0 con 0x7f903805c7d0 2022-01-10T01:33:16.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.310+0000 7f903e287700 1 -- 172.21.15.36:0/280015675 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9038057350 con 0x7f903805c7d0 2022-01-10T01:33:16.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.322+0000 7f90267fc700 1 -- 172.21.15.36:0/280015675 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7f90340456f0 con 0x7f903805c7d0 2022-01-10T01:33:16.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.322+0000 7f903e287700 1 -- 172.21.15.36:0/280015675 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90180535f0 msgr2=0x7f9018055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.322+0000 7f903e287700 1 --2- 172.21.15.36:0/280015675 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90180535f0 0x7f9018055ab0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f902800b000 tx=0x7f9028006df0).stop 2022-01-10T01:33:16.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.322+0000 7f903e287700 1 -- 172.21.15.36:0/280015675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f903805c7d0 msgr2=0x7f90380636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.322+0000 7f903e287700 1 --2- 172.21.15.36:0/280015675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f903805c7d0 0x7f90380636d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f9038064d50 tx=0x7f9034007a20).stop 2022-01-10T01:33:16.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.322+0000 7f903e287700 1 -- 172.21.15.36:0/280015675 shutdown_connections 2022-01-10T01:33:16.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.322+0000 7f903e287700 1 --2- 172.21.15.36:0/280015675 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f90180535f0 0x7f9018055ab0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.322+0000 7f903e287700 1 --2- 172.21.15.36:0/280015675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f903813f390 0x7f9038064e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.322+0000 7f903e287700 1 --2- 172.21.15.36:0/280015675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f903805d0b0 0x7f9038142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.322+0000 7f903e287700 1 --2- 172.21.15.36:0/280015675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f903805c7d0 0x7f90380636d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.322+0000 7f903e287700 1 -- 172.21.15.36:0/280015675 >> 172.21.15.36:0/280015675 conn(0x7f9038060180 msgr2=0x7f903813f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:16.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.322+0000 7f903e287700 1 -- 172.21.15.36:0/280015675 shutdown_connections 2022-01-10T01:33:16.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.322+0000 7f903e287700 1 -- 172.21.15.36:0/280015675 wait complete. 2022-01-10T01:33:16.333 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.0 2022-01-10T01:33:16.343 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:33:16.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.450+0000 7f9d32a9c700 1 Processor -- start 2022-01-10T01:33:16.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.450+0000 7f9d32a9c700 1 -- start start 2022-01-10T01:33:16.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.450+0000 7f9d32a9c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9d2c0b5bf0 0x7f9d2c0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.450+0000 7f9d32a9c700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c1440b0 con 0x7f9d2c0b6580 2022-01-10T01:33:16.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.450+0000 7f9d32a9c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c0b6e50 con 0x7f9d2c0b43c0 2022-01-10T01:33:16.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.450+0000 7f9d32a9c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d2c143b70 con 0x7f9d2c0b5bf0 2022-01-10T01:33:16.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d30838700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9d2c0b6580 0x7f9d2c061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39470/0 (socket says 172.21.15.36:39470) 2022-01-10T01:33:16.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d30838700 1 -- 172.21.15.36:0/25953862 learned_addr learned my addr 172.21.15.36:0/25953862 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:16.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d31039700 1 --2- 172.21.15.36:0/25953862 >> v2:172.21.15.59:3300/0 conn(0x7f9d2c0b5bf0 0x7f9d2c0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207375330 0 0) 0x7f9d2c1440b0 con 0x7f9d2c0b6580 2022-01-10T01:33:16.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d18003260 con 0x7f9d2c0b6580 2022-01-10T01:33:16.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989218260 0 0) 0x7f9d2c0b6e50 con 0x7f9d2c0b43c0 2022-01-10T01:33:16.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d2c1440b0 con 0x7f9d2c0b43c0 2022-01-10T01:33:16.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4150924555 0 0) 0x7f9d18003260 con 0x7f9d2c0b6580 2022-01-10T01:33:16.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 >> v2:172.21.15.59:3300/0 conn(0x7f9d2c0b5bf0 msgr2=0x7f9d2c0b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:16.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 --2- 172.21.15.36:0/25953862 >> v2:172.21.15.59:3300/0 conn(0x7f9d2c0b5bf0 0x7f9d2c0b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 >> v1:172.21.15.59:6789/0 conn(0x7f9d2c0b43c0 legacy=0x7f9d2c12ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c143e10 con 0x7f9d2c0b6580 2022-01-10T01:33:16.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f9d20001660 con 0x7f9d2c0b6580 2022-01-10T01:33:16.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 >> v1:172.21.15.36:6789/0 conn(0x7f9d2c0b6580 legacy=0x7f9d2c061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 --2- 172.21.15.36:0/25953862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180038e0 0x7f9d18003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 --2- 172.21.15.36:0/25953862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d18004500 0x7f9d18004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 --2- 172.21.15.36:0/25953862 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d18004e70 0x7f9d1800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c143b70 con 0x7f9d18004e70 2022-01-10T01:33:16.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1800bcf0 con 0x7f9d18004500 2022-01-10T01:33:16.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1800beb0 con 0x7f9d180038e0 2022-01-10T01:33:16.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d31039700 1 --2- 172.21.15.36:0/25953862 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d18004e70 0x7f9d1800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2bfff700 1 --2- 172.21.15.36:0/25953862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d18004500 0x7f9d18004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d30838700 1 --2- 172.21.15.36:0/25953862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180038e0 0x7f9d18003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d31039700 1 -- 172.21.15.36:0/25953862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180038e0 msgr2=0x7f9d18003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:16.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d31039700 1 --2- 172.21.15.36:0/25953862 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180038e0 0x7f9d18003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d31039700 1 -- 172.21.15.36:0/25953862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d18004500 msgr2=0x7f9d18004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:16.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d31039700 1 --2- 172.21.15.36:0/25953862 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d18004500 0x7f9d18004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d31039700 1 -- 172.21.15.36:0/25953862 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d18003260 con 0x7f9d18004e70 2022-01-10T01:33:16.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d31039700 1 -- 172.21.15.36:0/25953862 reap_dead start 2022-01-10T01:33:16.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d31039700 1 --2- 172.21.15.36:0/25953862 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d18004e70 0x7f9d1800b750 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f9d2400c000 tx=0x7f9d240091d0).ready entity=mon.0 client_cookie=65ce6af50e67fa7e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:16.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d2400e6e0 con 0x7f9d18004e70 2022-01-10T01:33:16.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2400e840 con 0x7f9d18004e70 2022-01-10T01:33:16.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d2b7fe700 1 -- 172.21.15.36:0/25953862 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d2400eba0 con 0x7f9d18004e70 2022-01-10T01:33:16.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d32a9c700 1 -- 172.21.15.36:0/25953862 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d18004e70 msgr2=0x7f9d1800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d32a9c700 1 --2- 172.21.15.36:0/25953862 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d18004e70 0x7f9d1800b750 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f9d2400c000 tx=0x7f9d240091d0).stop 2022-01-10T01:33:16.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d32a9c700 1 -- 172.21.15.36:0/25953862 shutdown_connections 2022-01-10T01:33:16.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d32a9c700 1 --2- 172.21.15.36:0/25953862 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d18004e70 0x7f9d1800b750 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d32a9c700 1 -- 172.21.15.36:0/25953862 >> 172.21.15.36:0/25953862 conn(0x7f9d2c05c490 msgr2=0x7f9d2c05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:16.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d32a9c700 1 -- 172.21.15.36:0/25953862 shutdown_connections 2022-01-10T01:33:16.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.454+0000 7f9d32a9c700 1 -- 172.21.15.36:0/25953862 wait complete. 2022-01-10T01:33:16.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d32a9c700 1 Processor -- start 2022-01-10T01:33:16.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d32a9c700 1 -- start start 2022-01-10T01:33:16.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d32a9c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d18004e70 0x7f9d2c1423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d32a9c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d2c141a00 0x7f9d2c128720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d32a9c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d2c128c10 0x7f9d2c1402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d32a9c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c142cc0 con 0x7f9d2c128c10 2022-01-10T01:33:16.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d32a9c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c12c640 con 0x7f9d2c141a00 2022-01-10T01:33:16.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d32a9c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c142a20 con 0x7f9d18004e70 2022-01-10T01:33:16.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d31039700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d2c128c10 0x7f9d2c1402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d2bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d2c141a00 0x7f9d2c128720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d31039700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d2c128c10 0x7f9d2c1402d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41692/0 (socket says 172.21.15.36:41692) 2022-01-10T01:33:16.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d31039700 1 -- 172.21.15.36:0/3656439258 learned_addr learned my addr 172.21.15.36:0/3656439258 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:16.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d30838700 1 --2- 172.21.15.36:0/3656439258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d18004e70 0x7f9d2c1423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d31039700 1 -- 172.21.15.36:0/3656439258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d18004e70 msgr2=0x7f9d2c1423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d31039700 1 --2- 172.21.15.36:0/3656439258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d18004e70 0x7f9d2c1423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d31039700 1 -- 172.21.15.36:0/3656439258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d2c141a00 msgr2=0x7f9d2c128720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d31039700 1 --2- 172.21.15.36:0/3656439258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d2c141a00 0x7f9d2c128720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d31039700 1 -- 172.21.15.36:0/3656439258 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c1414c0 con 0x7f9d2c128c10 2022-01-10T01:33:16.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d31039700 1 --2- 172.21.15.36:0/3656439258 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d2c128c10 0x7f9d2c1402d0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f9d2400c000 tx=0x7f9d24019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:16.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d29ffb700 1 -- 172.21.15.36:0/3656439258 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d2400e6e0 con 0x7f9d2c128c10 2022-01-10T01:33:16.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d29ffb700 1 -- 172.21.15.36:0/3656439258 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2401b640 con 0x7f9d2c128c10 2022-01-10T01:33:16.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d29ffb700 1 -- 172.21.15.36:0/3656439258 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d24009600 con 0x7f9d2c128c10 2022-01-10T01:33:16.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d32a9c700 1 -- 172.21.15.36:0/3656439258 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c12a200 con 0x7f9d2c128c10 2022-01-10T01:33:16.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.458+0000 7f9d32a9c700 1 -- 172.21.15.36:0/3656439258 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c0ba4d0 con 0x7f9d2c128c10 2022-01-10T01:33:16.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.462+0000 7f9d32a9c700 1 -- 172.21.15.36:0/3656439258 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2c141650 con 0x7f9d2c128c10 2022-01-10T01:33:16.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.462+0000 7f9d29ffb700 1 -- 172.21.15.36:0/3656439258 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9d24018020 con 0x7f9d2c128c10 2022-01-10T01:33:16.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.462+0000 7f9d29ffb700 1 --2- 172.21.15.36:0/3656439258 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9d0c053560 0x7f9d0c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.462+0000 7f9d29ffb700 1 -- 172.21.15.36:0/3656439258 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9d2406d0e0 con 0x7f9d2c128c10 2022-01-10T01:33:16.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.462+0000 7f9d30838700 1 --2- 172.21.15.36:0/3656439258 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9d0c053560 0x7f9d0c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.462+0000 7f9d30838700 1 --2- 172.21.15.36:0/3656439258 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9d0c053560 0x7f9d0c055a20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f9d20005000 tx=0x7f9d2c143fa0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:16.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.466+0000 7f9d29ffb700 1 -- 172.21.15.36:0/3656439258 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9d240440f0 con 0x7f9d2c128c10 2022-01-10T01:33:16.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.637+0000 7f9d32a9c700 1 -- 172.21.15.36:0/3656439258 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9d2c0615f0 con 0x7f9d2c128c10 2022-01-10T01:33:16.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.645+0000 7f9d29ffb700 1 -- 172.21.15.36:0/3656439258 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v32) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9d24047710 con 0x7f9d2c128c10 2022-01-10T01:33:16.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.649+0000 7f9d32a9c700 1 -- 172.21.15.36:0/3656439258 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9d0c053560 msgr2=0x7f9d0c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.649+0000 7f9d32a9c700 1 --2- 172.21.15.36:0/3656439258 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9d0c053560 0x7f9d0c055a20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f9d20005000 tx=0x7f9d2c143fa0).stop 2022-01-10T01:33:16.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.649+0000 7f9d32a9c700 1 -- 172.21.15.36:0/3656439258 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d2c128c10 msgr2=0x7f9d2c1402d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.649+0000 7f9d32a9c700 1 --2- 172.21.15.36:0/3656439258 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d2c128c10 0x7f9d2c1402d0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f9d2400c000 tx=0x7f9d24019000).stop 2022-01-10T01:33:16.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.649+0000 7f9d32a9c700 1 -- 172.21.15.36:0/3656439258 shutdown_connections 2022-01-10T01:33:16.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.649+0000 7f9d32a9c700 1 --2- 172.21.15.36:0/3656439258 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9d0c053560 0x7f9d0c055a20 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.649+0000 7f9d32a9c700 1 --2- 172.21.15.36:0/3656439258 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d2c128c10 0x7f9d2c1402d0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.649+0000 7f9d32a9c700 1 --2- 172.21.15.36:0/3656439258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d2c141a00 0x7f9d2c128720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.649+0000 7f9d32a9c700 1 --2- 172.21.15.36:0/3656439258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d18004e70 0x7f9d2c1423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.649+0000 7f9d32a9c700 1 -- 172.21.15.36:0/3656439258 >> 172.21.15.36:0/3656439258 conn(0x7f9d2c05c490 msgr2=0x7f9d2c143160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:16.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.649+0000 7f9d32a9c700 1 -- 172.21.15.36:0/3656439258 shutdown_connections 2022-01-10T01:33:16.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.649+0000 7f9d32a9c700 1 -- 172.21.15.36:0/3656439258 wait complete. 2022-01-10T01:33:16.658 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.1 2022-01-10T01:33:16.671 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:16.776 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.769+0000 7f9a2dd72700 1 Processor -- start 2022-01-10T01:33:16.777 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.769+0000 7f9a2dd72700 1 -- start start 2022-01-10T01:33:16.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.769+0000 7f9a2dd72700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9a280b2580 0x7f9a2814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.769+0000 7f9a2dd72700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9a280b0010 0x7f9a2814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.769+0000 7f9a2dd72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a280afbd0 0x7f9a280a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.769+0000 7f9a2dd72700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a280a70c0 con 0x7f9a280b2580 2022-01-10T01:33:16.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.769+0000 7f9a2dd72700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a280a72f0 con 0x7f9a280b0010 2022-01-10T01:33:16.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.769+0000 7f9a2dd72700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280a7590 con 0x7f9a280afbd0 2022-01-10T01:33:16.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.769+0000 7f9a2cd70700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9a280b2580 0x7f9a2814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.769+0000 7f9a27fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9a280b0010 0x7f9a2814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.769+0000 7f9a2d571700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a280afbd0 0x7f9a280a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.769+0000 7f9a2cd70700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9a280b2580 0x7f9a2814ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41698/0 (socket says 172.21.15.36:41698) 2022-01-10T01:33:16.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.769+0000 7f9a27fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9a280b0010 0x7f9a2814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:38330/0 (socket says 172.21.15.36:38330) 2022-01-10T01:33:16.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.769+0000 7f9a2cd70700 1 -- 172.21.15.36:0/1072049328 learned_addr learned my addr 172.21.15.36:0/1072049328 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:16.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2cd70700 1 -- 172.21.15.36:0/1072049328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a280afbd0 msgr2=0x7f9a280a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:16.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2cd70700 1 --2- 172.21.15.36:0/1072049328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a280afbd0 0x7f9a280a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2cd70700 1 -- 172.21.15.36:0/1072049328 >> v2:172.21.15.59:3300/0 conn(0x7f9a280b0010 msgr2=0x7f9a2814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:16.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2cd70700 1 --2- 172.21.15.36:0/1072049328 >> v2:172.21.15.59:3300/0 conn(0x7f9a280b0010 0x7f9a2814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2cd70700 1 -- 172.21.15.36:0/1072049328 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a280a7830 con 0x7f9a280b2580 2022-01-10T01:33:16.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2cd70700 1 --2- 172.21.15.36:0/1072049328 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9a280b2580 0x7f9a2814ae40 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f9a1c002f70 tx=0x7f9a1c006eb0).ready entity=mon.0 client_cookie=74cffe26b32f2c57 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:16.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a277fe700 1 -- 172.21.15.36:0/1072049328 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a1c00d570 con 0x7f9a280b2580 2022-01-10T01:33:16.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a277fe700 1 -- 172.21.15.36:0/1072049328 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c000e90 con 0x7f9a280b2580 2022-01-10T01:33:16.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a277fe700 1 -- 172.21.15.36:0/1072049328 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a1c00d900 con 0x7f9a280b2580 2022-01-10T01:33:16.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1072049328 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9a280b2580 msgr2=0x7f9a2814ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2dd72700 1 --2- 172.21.15.36:0/1072049328 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9a280b2580 0x7f9a2814ae40 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f9a1c002f70 tx=0x7f9a1c006eb0).stop 2022-01-10T01:33:16.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1072049328 shutdown_connections 2022-01-10T01:33:16.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2dd72700 1 --2- 172.21.15.36:0/1072049328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a280afbd0 0x7f9a280a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2dd72700 1 --2- 172.21.15.36:0/1072049328 >> v2:172.21.15.59:3300/0 conn(0x7f9a280b0010 0x7f9a2814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2dd72700 1 --2- 172.21.15.36:0/1072049328 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9a280b2580 0x7f9a2814ae40 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1072049328 >> 172.21.15.36:0/1072049328 conn(0x7f9a28060180 msgr2=0x7f9a280b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:16.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1072049328 shutdown_connections 2022-01-10T01:33:16.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.773+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1072049328 wait complete. 2022-01-10T01:33:16.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a2dd72700 1 Processor -- start 2022-01-10T01:33:16.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a2dd72700 1 -- start start 2022-01-10T01:33:16.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a2dd72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a280afbd0 0x7f9a280af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a2dd72700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9a280b0010 0x7f9a280a9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a2dd72700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a280b2580 0x7f9a280aa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a2dd72700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2814d5a0 con 0x7f9a280b0010 2022-01-10T01:33:16.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a2dd72700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280b3fc0 con 0x7f9a280b2580 2022-01-10T01:33:16.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a2dd72700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280b2e80 con 0x7f9a280afbd0 2022-01-10T01:33:16.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a27fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9a280b0010 0x7f9a280a9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a27fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9a280b0010 0x7f9a280a9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41704/0 (socket says 172.21.15.36:41704) 2022-01-10T01:33:16.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a27fff700 1 -- 172.21.15.36:0/1247151805 learned_addr learned my addr 172.21.15.36:0/1247151805 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:16.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a2cd70700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a280afbd0 0x7f9a280af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a2d571700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a280b2580 0x7f9a280aa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a27fff700 1 -- 172.21.15.36:0/1247151805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a280afbd0 msgr2=0x7f9a280af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a27fff700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a280afbd0 0x7f9a280af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a27fff700 1 -- 172.21.15.36:0/1247151805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a280b2580 msgr2=0x7f9a280aa010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a27fff700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a280b2580 0x7f9a280aa010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a27fff700 1 -- 172.21.15.36:0/1247151805 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c00b1e0 con 0x7f9a280b0010 2022-01-10T01:33:16.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a2d571700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a280b2580 0x7f9a280aa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:33:16.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a27fff700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9a280b0010 0x7f9a280a9b20 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f9a280b4100 tx=0x7f9a18006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:16.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a25ffb700 1 -- 172.21.15.36:0/1247151805 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a18010780 con 0x7f9a280b0010 2022-01-10T01:33:16.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a25ffb700 1 -- 172.21.15.36:0/1247151805 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a180108e0 con 0x7f9a280b0010 2022-01-10T01:33:16.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1247151805 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a280b3400 con 0x7f9a280b0010 2022-01-10T01:33:16.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.777+0000 7f9a25ffb700 1 -- 172.21.15.36:0/1247151805 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a18010c40 con 0x7f9a280b0010 2022-01-10T01:33:16.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.781+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1247151805 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a280aa500 con 0x7f9a280b0010 2022-01-10T01:33:16.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.781+0000 7f9a25ffb700 1 -- 172.21.15.36:0/1247151805 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9a1801c460 con 0x7f9a280b0010 2022-01-10T01:33:16.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.781+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1247151805 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a280b4810 con 0x7f9a280b0010 2022-01-10T01:33:16.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.781+0000 7f9a25ffb700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9a08053560 0x7f9a08055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:16.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.781+0000 7f9a25ffb700 1 -- 172.21.15.36:0/1247151805 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9a1806bfe0 con 0x7f9a280b0010 2022-01-10T01:33:16.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.781+0000 7f9a2cd70700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9a08053560 0x7f9a08055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:16.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.781+0000 7f9a2cd70700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9a08053560 0x7f9a08055a20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f9a1c01c000 tx=0x7f9a1c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:16.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.785+0000 7f9a25ffb700 1 -- 172.21.15.36:0/1247151805 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9a18042e80 con 0x7f9a280b0010 2022-01-10T01:33:16.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.949+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1247151805 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a280b06f0 con 0x7f9a280b0010 2022-01-10T01:33:16.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.949+0000 7f9a25ffb700 1 -- 172.21.15.36:0/1247151805 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f9a180464a0 con 0x7f9a280b0010 2022-01-10T01:33:16.957 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:16.958 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8016,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/2824324236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2824324236},{"type":"v1","addr":"172.21.15.36:6835","nonce":2824324236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1768428808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1768428808},{"type":"v1","addr":"172.21.15.36:6837","nonce":1768428808}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:14.392835+0000","modified":"2022-01-10T01:33:15.396812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8028":{"gid":8028,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3822558856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3822558856},{"type":"v1","addr":"172.21.15.59:6833","nonce":3822558856}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2022-01-10T01:33:16.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.953+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1247151805 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9a08053560 msgr2=0x7f9a08055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.953+0000 7f9a2dd72700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9a08053560 0x7f9a08055a20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f9a1c01c000 tx=0x7f9a1c015000).stop 2022-01-10T01:33:16.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.953+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1247151805 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9a280b0010 msgr2=0x7f9a280a9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:16.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.953+0000 7f9a2dd72700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9a280b0010 0x7f9a280a9b20 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f9a280b4100 tx=0x7f9a18006df0).stop 2022-01-10T01:33:16.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.953+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1247151805 shutdown_connections 2022-01-10T01:33:16.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.953+0000 7f9a2dd72700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9a08053560 0x7f9a08055a20 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.953+0000 7f9a2dd72700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a280b2580 0x7f9a280aa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.953+0000 7f9a2dd72700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9a280b0010 0x7f9a280a9b20 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.953+0000 7f9a2dd72700 1 --2- 172.21.15.36:0/1247151805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a280afbd0 0x7f9a280af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:16.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.953+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1247151805 >> 172.21.15.36:0/1247151805 conn(0x7f9a28060180 msgr2=0x7f9a281486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:16.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.953+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1247151805 shutdown_connections 2022-01-10T01:33:16.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:16.953+0000 7f9a2dd72700 1 -- 172.21.15.36:0/1247151805 wait complete. 2022-01-10T01:33:16.962 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 66 2022-01-10T01:33:17.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:33:14.392835+0000', 'modified': '2022-01-10T01:33:15.396812+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8028}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8028': {'gid': 8028, 'name': 'b', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/3822558856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 3822558856}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 3822558856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:33:17.273 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:33:17.273 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:33:17.390 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":8028,"want_state":"up:active","state":"up:active","rank_uptime":2.9822090490000002,"mdsmap_epoch":66,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":7.9899055719999996} 2022-01-10T01:33:17.390 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 8028, "mdsmap_epoch": 66, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 2.982209049, "state": "up:active", "uptime": 7.989905572, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:33:17.391 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:33:17.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea3b55700 1 Processor -- start 2022-01-10T01:33:17.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea3b55700 1 -- start start 2022-01-10T01:33:17.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea3b55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9c0b1db0 0x7fae9c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea3b55700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae9c0a70c0 0x7fae9c144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea3b55700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9c0b0350 con 0x7fae9c1483a0 2022-01-10T01:33:17.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea3b55700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9c0a90c0 con 0x7fae9c0a70c0 2022-01-10T01:33:17.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea3b55700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c0b05f0 con 0x7fae9c0b1db0 2022-01-10T01:33:17.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea10f0700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fae9c1483a0 0x7fae9c0b2190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39506/0 (socket says 172.21.15.36:39506) 2022-01-10T01:33:17.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea10f0700 1 -- 172.21.15.36:0/1723011943 learned_addr learned my addr 172.21.15.36:0/1723011943 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:17.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea20f2700 1 --2- 172.21.15.36:0/1723011943 >> v2:172.21.15.59:3300/0 conn(0x7fae9c0a70c0 0x7fae9c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea18f1700 1 --2- 172.21.15.36:0/1723011943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9c0b1db0 0x7fae9c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 -- 172.21.15.36:0/1723011943 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117431996 0 0) 0x7fae9c0b0350 con 0x7fae9c1483a0 2022-01-10T01:33:17.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 -- 172.21.15.36:0/1723011943 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae80003260 con 0x7fae9c1483a0 2022-01-10T01:33:17.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 -- 172.21.15.36:0/1723011943 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1450458103 0 0) 0x7fae80003260 con 0x7fae9c1483a0 2022-01-10T01:33:17.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 -- 172.21.15.36:0/1723011943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9c0b1db0 msgr2=0x7fae9c0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:17.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 --2- 172.21.15.36:0/1723011943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9c0b1db0 0x7fae9c0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 -- 172.21.15.36:0/1723011943 >> v2:172.21.15.59:3300/0 conn(0x7fae9c0a70c0 msgr2=0x7fae9c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:17.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 --2- 172.21.15.36:0/1723011943 >> v2:172.21.15.59:3300/0 conn(0x7fae9c0a70c0 0x7fae9c144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 -- 172.21.15.36:0/1723011943 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c0b0890 con 0x7fae9c1483a0 2022-01-10T01:33:17.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 -- 172.21.15.36:0/1723011943 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fae8c001660 con 0x7fae9c1483a0 2022-01-10T01:33:17.510 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 -- 172.21.15.36:0/1723011943 >> v1:172.21.15.36:6789/0 conn(0x7fae9c1483a0 legacy=0x7fae9c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:17.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 --2- 172.21.15.36:0/1723011943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9c0b1db0 0x7fae800037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 --2- 172.21.15.36:0/1723011943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae80003cc0 0x7fae80004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 --2- 172.21.15.36:0/1723011943 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae800049f0 0x7fae80004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 -- 172.21.15.36:0/1723011943 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c0b05f0 con 0x7fae800049f0 2022-01-10T01:33:17.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 -- 172.21.15.36:0/1723011943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8000b750 con 0x7fae80003cc0 2022-01-10T01:33:17.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea08ef700 1 -- 172.21.15.36:0/1723011943 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8000b890 con 0x7fae9c0b1db0 2022-01-10T01:33:17.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea18f1700 1 --2- 172.21.15.36:0/1723011943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9c0b1db0 0x7fae800037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea20f2700 1 --2- 172.21.15.36:0/1723011943 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae800049f0 0x7fae80004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea10f0700 1 --2- 172.21.15.36:0/1723011943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae80003cc0 0x7fae80004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea20f2700 1 -- 172.21.15.36:0/1723011943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9c0b1db0 msgr2=0x7fae800037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:17.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea20f2700 1 --2- 172.21.15.36:0/1723011943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9c0b1db0 0x7fae800037d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea20f2700 1 -- 172.21.15.36:0/1723011943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae80003cc0 msgr2=0x7fae80004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:17.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.497+0000 7faea20f2700 1 --2- 172.21.15.36:0/1723011943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae80003cc0 0x7fae80004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.501+0000 7faea20f2700 1 -- 172.21.15.36:0/1723011943 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae80003260 con 0x7fae800049f0 2022-01-10T01:33:17.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.501+0000 7faea20f2700 1 --2- 172.21.15.36:0/1723011943 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae800049f0 0x7fae80004e70 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7fae9400c000 tx=0x7fae940091d0).ready entity=mon.0 client_cookie=36c9b9f31077d4bd server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:17.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.501+0000 7faea08ef700 1 -- 172.21.15.36:0/1723011943 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae9400e7e0 con 0x7fae800049f0 2022-01-10T01:33:17.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.501+0000 7faea08ef700 1 -- 172.21.15.36:0/1723011943 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9400e940 con 0x7fae800049f0 2022-01-10T01:33:17.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.501+0000 7faea08ef700 1 -- 172.21.15.36:0/1723011943 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae9400eca0 con 0x7fae800049f0 2022-01-10T01:33:17.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.501+0000 7faea3b55700 1 -- 172.21.15.36:0/1723011943 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae800049f0 msgr2=0x7fae80004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:17.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.501+0000 7faea3b55700 1 --2- 172.21.15.36:0/1723011943 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae800049f0 0x7fae80004e70 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7fae9400c000 tx=0x7fae940091d0).stop 2022-01-10T01:33:17.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.501+0000 7faea20f2700 1 -- 172.21.15.36:0/1723011943 reap_dead start 2022-01-10T01:33:17.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.501+0000 7faea3b55700 1 -- 172.21.15.36:0/1723011943 shutdown_connections 2022-01-10T01:33:17.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.501+0000 7faea3b55700 1 -- 172.21.15.36:0/1723011943 >> 172.21.15.36:0/1723011943 conn(0x7fae9c05f6b0 msgr2=0x7fae9c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:17.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.501+0000 7faea3b55700 1 -- 172.21.15.36:0/1723011943 shutdown_connections 2022-01-10T01:33:17.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.501+0000 7faea3b55700 1 -- 172.21.15.36:0/1723011943 wait complete. 2022-01-10T01:33:17.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.501+0000 7faea3b55700 1 Processor -- start 2022-01-10T01:33:17.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.501+0000 7faea3b55700 1 -- start start 2022-01-10T01:33:17.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea3b55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9c14b610 0x7fae9c14a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea3b55700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae9c14a8e0 0x7fae9c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea3b55700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae9c15a6d0 0x7fae9c156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea3b55700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c156900 con 0x7fae9c14a8e0 2022-01-10T01:33:17.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea3b55700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c0ae3f0 con 0x7fae9c15a6d0 2022-01-10T01:33:17.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea3b55700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae9c0aee00 con 0x7fae9c14b610 2022-01-10T01:33:17.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea10f0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae9c14a8e0 0x7fae9c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea10f0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae9c14a8e0 0x7fae9c15a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41724/0 (socket says 172.21.15.36:41724) 2022-01-10T01:33:17.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea10f0700 1 -- 172.21.15.36:0/2795985633 learned_addr learned my addr 172.21.15.36:0/2795985633 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:17.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea18f1700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9c14b610 0x7fae9c14a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea20f2700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae9c15a6d0 0x7fae9c156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea10f0700 1 -- 172.21.15.36:0/2795985633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9c14b610 msgr2=0x7fae9c14a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:17.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea10f0700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9c14b610 0x7fae9c14a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea10f0700 1 -- 172.21.15.36:0/2795985633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae9c15a6d0 msgr2=0x7fae9c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:17.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea10f0700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae9c15a6d0 0x7fae9c156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea10f0700 1 -- 172.21.15.36:0/2795985633 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c14b9f0 con 0x7fae9c14a8e0 2022-01-10T01:33:17.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea20f2700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae9c15a6d0 0x7fae9c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:17.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea10f0700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae9c14a8e0 0x7fae9c15a1e0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7fae9c15a0c0 tx=0x7fae9c0b04e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:17.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7fae92ffd700 1 -- 172.21.15.36:0/2795985633 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c00f840 con 0x7fae9c14a8e0 2022-01-10T01:33:17.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7fae92ffd700 1 -- 172.21.15.36:0/2795985633 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c00f9a0 con 0x7fae9c14a8e0 2022-01-10T01:33:17.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea3b55700 1 -- 172.21.15.36:0/2795985633 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9c0ae620 con 0x7fae9c14a8e0 2022-01-10T01:33:17.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7fae92ffd700 1 -- 172.21.15.36:0/2795985633 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae8c00fd00 con 0x7fae9c14a8e0 2022-01-10T01:33:17.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea3b55700 1 -- 172.21.15.36:0/2795985633 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae9c0aeb60 con 0x7fae9c14a8e0 2022-01-10T01:33:17.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7fae92ffd700 1 -- 172.21.15.36:0/2795985633 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fae8c016440 con 0x7fae9c14a8e0 2022-01-10T01:33:17.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.505+0000 7faea3b55700 1 -- 172.21.15.36:0/2795985633 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9c057350 con 0x7fae9c14a8e0 2022-01-10T01:33:17.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.509+0000 7fae92ffd700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae840535f0 0x7fae84055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.509+0000 7fae92ffd700 1 -- 172.21.15.36:0/2795985633 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fae8c06beb0 con 0x7fae9c14a8e0 2022-01-10T01:33:17.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.509+0000 7faea18f1700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae840535f0 0x7fae84055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.509+0000 7faea18f1700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae840535f0 0x7fae84055ab0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fae9800b000 tx=0x7fae98006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:17.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.513+0000 7fae92ffd700 1 -- 172.21.15.36:0/2795985633 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fae8c042d50 con 0x7fae9c14a8e0 2022-01-10T01:33:17.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.641+0000 7faea3b55700 1 -- 172.21.15.36:0/2795985633 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae9c044650 con 0x7fae9c14a8e0 2022-01-10T01:33:17.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.641+0000 7fae92ffd700 1 -- 172.21.15.36:0/2795985633 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fae8c027fb0 con 0x7fae9c14a8e0 2022-01-10T01:33:17.650 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:17.650 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":139,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:33:15.396927+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:33:12.182921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2022-01-10T01:33:13.414645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:33:17.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.645+0000 7faea3b55700 1 -- 172.21.15.36:0/2795985633 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae840535f0 msgr2=0x7fae84055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:17.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.645+0000 7faea3b55700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae840535f0 0x7fae84055ab0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fae9800b000 tx=0x7fae98006df0).stop 2022-01-10T01:33:17.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.645+0000 7faea3b55700 1 -- 172.21.15.36:0/2795985633 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae9c14a8e0 msgr2=0x7fae9c15a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:17.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.645+0000 7faea3b55700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae9c14a8e0 0x7fae9c15a1e0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7fae9c15a0c0 tx=0x7fae9c0b04e0).stop 2022-01-10T01:33:17.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.645+0000 7faea3b55700 1 -- 172.21.15.36:0/2795985633 shutdown_connections 2022-01-10T01:33:17.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.645+0000 7faea3b55700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fae840535f0 0x7fae84055ab0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.645+0000 7faea3b55700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae9c15a6d0 0x7fae9c156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.645+0000 7faea3b55700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fae9c14a8e0 0x7fae9c15a1e0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.645+0000 7faea3b55700 1 --2- 172.21.15.36:0/2795985633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae9c14b610 0x7fae9c14a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.645+0000 7faea3b55700 1 -- 172.21.15.36:0/2795985633 >> 172.21.15.36:0/2795985633 conn(0x7fae9c05f6b0 msgr2=0x7fae9c0a89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:17.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.645+0000 7faea3b55700 1 -- 172.21.15.36:0/2795985633 shutdown_connections 2022-01-10T01:33:17.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.645+0000 7faea3b55700 1 -- 172.21.15.36:0/2795985633 wait complete. 2022-01-10T01:33:17.668 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:33:12.182921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:33:13.414645+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:33:17.669 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:33:17.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.769+0000 7f7135af4700 1 Processor -- start 2022-01-10T01:33:17.780 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.769+0000 7f7135af4700 1 -- start start 2022-01-10T01:33:17.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.769+0000 7f7135af4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f71300b4060 0x7f7130061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.769+0000 7f7135af4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7130142e60 0x7f7130143310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.781 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.769+0000 7f7135af4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71300b5f50 con 0x7f71300b6290 2022-01-10T01:33:17.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.769+0000 7f7135af4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71300b1f70 con 0x7f71300b4060 2022-01-10T01:33:17.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.769+0000 7f7135af4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71300b2210 con 0x7f7130142e60 2022-01-10T01:33:17.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f712ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f71300b4060 0x7f7130061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f712ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f71300b4060 0x7f7130061b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41734/0 (socket says 172.21.15.36:41734) 2022-01-10T01:33:17.782 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f712ffff700 1 -- 172.21.15.36:0/3615162310 learned_addr learned my addr 172.21.15.36:0/3615162310 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:17.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f71352f3700 1 --2- 172.21.15.36:0/3615162310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7130142e60 0x7f7130143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f71352f3700 1 -- 172.21.15.36:0/3615162310 >> v2:172.21.15.36:3300/0 conn(0x7f71300b4060 msgr2=0x7f7130061b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:17.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f71352f3700 1 --2- 172.21.15.36:0/3615162310 >> v2:172.21.15.36:3300/0 conn(0x7f71300b4060 0x7f7130061b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f71352f3700 1 -- 172.21.15.36:0/3615162310 >> v1:172.21.15.59:6789/0 conn(0x7f71300b6290 legacy=0x7f7130061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:17.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f71352f3700 1 -- 172.21.15.36:0/3615162310 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71300b24b0 con 0x7f7130142e60 2022-01-10T01:33:17.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f712ffff700 1 --2- 172.21.15.36:0/3615162310 >> v2:172.21.15.36:3300/0 conn(0x7f71300b4060 0x7f7130061b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:17.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f71352f3700 1 --2- 172.21.15.36:0/3615162310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7130142e60 0x7f7130143310 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f71280032f0 tx=0x7f71280091d0).ready entity=mon.2 client_cookie=94185c2f463957af server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:17.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f712f7fe700 1 -- 172.21.15.36:0/3615162310 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f712800b6c0 con 0x7f7130142e60 2022-01-10T01:33:17.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f712f7fe700 1 -- 172.21.15.36:0/3615162310 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712800b820 con 0x7f7130142e60 2022-01-10T01:33:17.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f712f7fe700 1 -- 172.21.15.36:0/3615162310 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f712800b990 con 0x7f7130142e60 2022-01-10T01:33:17.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f7135af4700 1 -- 172.21.15.36:0/3615162310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7130142e60 msgr2=0x7f7130143310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:17.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f7135af4700 1 --2- 172.21.15.36:0/3615162310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7130142e60 0x7f7130143310 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f71280032f0 tx=0x7f71280091d0).stop 2022-01-10T01:33:17.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f7135af4700 1 -- 172.21.15.36:0/3615162310 shutdown_connections 2022-01-10T01:33:17.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f7135af4700 1 --2- 172.21.15.36:0/3615162310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7130142e60 0x7f7130143310 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f7135af4700 1 --2- 172.21.15.36:0/3615162310 >> v2:172.21.15.36:3300/0 conn(0x7f71300b4060 0x7f7130061b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f7135af4700 1 -- 172.21.15.36:0/3615162310 >> 172.21.15.36:0/3615162310 conn(0x7f713005c490 msgr2=0x7f713005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:17.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f7135af4700 1 -- 172.21.15.36:0/3615162310 shutdown_connections 2022-01-10T01:33:17.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.773+0000 7f7135af4700 1 -- 172.21.15.36:0/3615162310 wait complete. 2022-01-10T01:33:17.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f7135af4700 1 Processor -- start 2022-01-10T01:33:17.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f7135af4700 1 -- start start 2022-01-10T01:33:17.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f7135af4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71300b4060 0x7f71300b9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f7135af4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71300b6290 0x7f7130155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f7135af4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7130142e60 0x7f7130155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f7135af4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7130156450 con 0x7f71300b6290 2022-01-10T01:33:17.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f7135af4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71301463d0 con 0x7f7130142e60 2022-01-10T01:33:17.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f7135af4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7130146950 con 0x7f71300b4060 2022-01-10T01:33:17.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f712ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71300b6290 0x7f7130155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f712ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71300b6290 0x7f7130155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41738/0 (socket says 172.21.15.36:41738) 2022-01-10T01:33:17.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f712ffff700 1 -- 172.21.15.36:0/2029813221 learned_addr learned my addr 172.21.15.36:0/2029813221 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:17.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f7134af2700 1 --2- 172.21.15.36:0/2029813221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71300b4060 0x7f71300b9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f71352f3700 1 --2- 172.21.15.36:0/2029813221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7130142e60 0x7f7130155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f712ffff700 1 -- 172.21.15.36:0/2029813221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71300b4060 msgr2=0x7f71300b9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:17.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f712ffff700 1 --2- 172.21.15.36:0/2029813221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71300b4060 0x7f71300b9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f712ffff700 1 -- 172.21.15.36:0/2029813221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7130142e60 msgr2=0x7f7130155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:17.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f712ffff700 1 --2- 172.21.15.36:0/2029813221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7130142e60 0x7f7130155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f712ffff700 1 -- 172.21.15.36:0/2029813221 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712400b1e0 con 0x7f71300b6290 2022-01-10T01:33:17.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f712ffff700 1 --2- 172.21.15.36:0/2029813221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71300b6290 0x7f7130155a70 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f712400c000 tx=0x7f7124006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:17.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f712dffb700 1 -- 172.21.15.36:0/2029813221 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7124012600 con 0x7f71300b6290 2022-01-10T01:33:17.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f712dffb700 1 -- 172.21.15.36:0/2029813221 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7124012760 con 0x7f71300b6290 2022-01-10T01:33:17.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f712dffb700 1 -- 172.21.15.36:0/2029813221 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7124012ac0 con 0x7f71300b6290 2022-01-10T01:33:17.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f7135af4700 1 -- 172.21.15.36:0/2029813221 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7128009470 con 0x7f71300b6290 2022-01-10T01:33:17.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.777+0000 7f7135af4700 1 -- 172.21.15.36:0/2029813221 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7130150050 con 0x7f71300b6290 2022-01-10T01:33:17.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.781+0000 7f7135af4700 1 -- 172.21.15.36:0/2029813221 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71300b2750 con 0x7f71300b6290 2022-01-10T01:33:17.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.781+0000 7f712dffb700 1 -- 172.21.15.36:0/2029813221 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7124012c20 con 0x7f71300b6290 2022-01-10T01:33:17.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.781+0000 7f712dffb700 1 --2- 172.21.15.36:0/2029813221 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71100535f0 0x7f7110055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:17.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.781+0000 7f712dffb700 1 -- 172.21.15.36:0/2029813221 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f712406bd70 con 0x7f71300b6290 2022-01-10T01:33:17.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.781+0000 7f7134af2700 1 --2- 172.21.15.36:0/2029813221 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71100535f0 0x7f7110055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:17.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.781+0000 7f7134af2700 1 --2- 172.21.15.36:0/2029813221 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71100535f0 0x7f7110055ab0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f712000d000 tx=0x7f7120007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:17.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.789+0000 7f712dffb700 1 -- 172.21.15.36:0/2029813221 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7124042d80 con 0x7f71300b6290 2022-01-10T01:33:17.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.913+0000 7f7135af4700 1 -- 172.21.15.36:0/2029813221 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7130057350 con 0x7f71300b6290 2022-01-10T01:33:17.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.913+0000 7f712dffb700 1 -- 172.21.15.36:0/2029813221 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v139) v1 ==== 110+0+10 (secure 0 0 0) 0x7f71240463a0 con 0x7f71300b6290 2022-01-10T01:33:17.923 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:33:17.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.917+0000 7f7135af4700 1 -- 172.21.15.36:0/2029813221 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71100535f0 msgr2=0x7f7110055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:17.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.917+0000 7f7135af4700 1 --2- 172.21.15.36:0/2029813221 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71100535f0 0x7f7110055ab0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f712000d000 tx=0x7f7120007b90).stop 2022-01-10T01:33:17.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.917+0000 7f7135af4700 1 -- 172.21.15.36:0/2029813221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71300b6290 msgr2=0x7f7130155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:17.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.917+0000 7f7135af4700 1 --2- 172.21.15.36:0/2029813221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71300b6290 0x7f7130155a70 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f712400c000 tx=0x7f7124006eb0).stop 2022-01-10T01:33:17.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.917+0000 7f7135af4700 1 -- 172.21.15.36:0/2029813221 shutdown_connections 2022-01-10T01:33:17.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.917+0000 7f7135af4700 1 --2- 172.21.15.36:0/2029813221 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f71100535f0 0x7f7110055ab0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.917+0000 7f7135af4700 1 --2- 172.21.15.36:0/2029813221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7130142e60 0x7f7130155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.917+0000 7f7135af4700 1 --2- 172.21.15.36:0/2029813221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f71300b6290 0x7f7130155a70 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.917+0000 7f7135af4700 1 --2- 172.21.15.36:0/2029813221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71300b4060 0x7f71300b9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:17.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.917+0000 7f7135af4700 1 -- 172.21.15.36:0/2029813221 >> 172.21.15.36:0/2029813221 conn(0x7f713005c490 msgr2=0x7f71300b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:17.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.917+0000 7f7135af4700 1 -- 172.21.15.36:0/2029813221 shutdown_connections 2022-01-10T01:33:17.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:17.917+0000 7f7135af4700 1 -- 172.21.15.36:0/2029813221 wait complete. 2022-01-10T01:33:17.936 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:33:18.047 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff53dc62700 1 Processor -- start 2022-01-10T01:33:18.048 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff53dc62700 1 -- start start 2022-01-10T01:33:18.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff53dc62700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5380aad80 0x7ff538067300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff53dc62700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff538065960 con 0x7ff5380ab160 2022-01-10T01:33:18.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff53dc62700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff538064f10 con 0x7ff5380b4d50 2022-01-10T01:33:18.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff53dc62700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5380b3ce0 con 0x7ff5380aad80 2022-01-10T01:33:18.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff537fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff5380ab160 0x7ff538064800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39538/0 (socket says 172.21.15.36:39538) 2022-01-10T01:33:18.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff537fff700 1 -- 172.21.15.36:0/2067162129 learned_addr learned my addr 172.21.15.36:0/2067162129 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:18.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff53cc60700 1 --2- 172.21.15.36:0/2067162129 >> v2:172.21.15.59:3300/0 conn(0x7ff5380aad80 0x7ff538067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469080676 0 0) 0x7ff538065960 con 0x7ff5380ab160 2022-01-10T01:33:18.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff524003260 con 0x7ff5380ab160 2022-01-10T01:33:18.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559102297 0 0) 0x7ff538064f10 con 0x7ff5380b4d50 2022-01-10T01:33:18.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff538065960 con 0x7ff5380b4d50 2022-01-10T01:33:18.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3958790755 0 0) 0x7ff524003260 con 0x7ff5380ab160 2022-01-10T01:33:18.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 >> v2:172.21.15.59:3300/0 conn(0x7ff5380aad80 msgr2=0x7ff538067300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:18.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff5377fe700 1 --2- 172.21.15.36:0/2067162129 >> v2:172.21.15.59:3300/0 conn(0x7ff5380aad80 0x7ff538067300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 >> v1:172.21.15.59:6789/0 conn(0x7ff5380b4d50 legacy=0x7ff5380b7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff538066e60 con 0x7ff5380ab160 2022-01-10T01:33:18.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7ff528001780 con 0x7ff5380ab160 2022-01-10T01:33:18.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.041+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 >> v1:172.21.15.36:6789/0 conn(0x7ff5380ab160 legacy=0x7ff538064800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff5377fe700 1 --2- 172.21.15.36:0/2067162129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff524003930 0x7ff524003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff5377fe700 1 --2- 172.21.15.36:0/2067162129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff524004500 0x7ff524004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff5377fe700 1 --2- 172.21.15.36:0/2067162129 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff524004e70 0x7ff52400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5380b3ce0 con 0x7ff524004e70 2022-01-10T01:33:18.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52400bd20 con 0x7ff524003930 2022-01-10T01:33:18.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52400bee0 con 0x7ff524004500 2022-01-10T01:33:18.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53d461700 1 --2- 172.21.15.36:0/2067162129 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff524004e70 0x7ff52400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff537fff700 1 --2- 172.21.15.36:0/2067162129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff524004500 0x7ff524004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53cc60700 1 --2- 172.21.15.36:0/2067162129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff524003930 0x7ff524003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53d461700 1 -- 172.21.15.36:0/2067162129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff524004500 msgr2=0x7ff524004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:18.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53d461700 1 --2- 172.21.15.36:0/2067162129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff524004500 0x7ff524004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53d461700 1 -- 172.21.15.36:0/2067162129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff524003930 msgr2=0x7ff524003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:18.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53d461700 1 --2- 172.21.15.36:0/2067162129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff524003930 0x7ff524003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53d461700 1 -- 172.21.15.36:0/2067162129 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff524003260 con 0x7ff524004e70 2022-01-10T01:33:18.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff537fff700 1 --2- 172.21.15.36:0/2067162129 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff524004500 0x7ff524004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:18.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53d461700 1 -- 172.21.15.36:0/2067162129 reap_dead start 2022-01-10T01:33:18.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53d461700 1 --2- 172.21.15.36:0/2067162129 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff524004e70 0x7ff52400b750 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7ff530001490 tx=0x7ff530007d80).ready entity=mon.0 client_cookie=ea0bfa2bc87e5548 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:18.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff530001780 con 0x7ff524004e70 2022-01-10T01:33:18.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff530006890 con 0x7ff524004e70 2022-01-10T01:33:18.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff5377fe700 1 -- 172.21.15.36:0/2067162129 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff530006bf0 con 0x7ff524004e70 2022-01-10T01:33:18.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 -- 172.21.15.36:0/2067162129 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff524004e70 msgr2=0x7ff52400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 --2- 172.21.15.36:0/2067162129 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff524004e70 0x7ff52400b750 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7ff530001490 tx=0x7ff530007d80).stop 2022-01-10T01:33:18.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 -- 172.21.15.36:0/2067162129 shutdown_connections 2022-01-10T01:33:18.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 --2- 172.21.15.36:0/2067162129 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff524004e70 0x7ff52400b750 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 -- 172.21.15.36:0/2067162129 >> 172.21.15.36:0/2067162129 conn(0x7ff538062be0 msgr2=0x7ff53805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:18.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 -- 172.21.15.36:0/2067162129 shutdown_connections 2022-01-10T01:33:18.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 -- 172.21.15.36:0/2067162129 wait complete. 2022-01-10T01:33:18.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 Processor -- start 2022-01-10T01:33:18.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 -- start start 2022-01-10T01:33:18.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff524004e70 0x7ff538061190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5380affe0 0x7ff538155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5380af4c0 0x7ff5380ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff538156200 con 0x7ff5380affe0 2022-01-10T01:33:18.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5381564a0 con 0x7ff524004e70 2022-01-10T01:33:18.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff53dc62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5380ae410 con 0x7ff5380af4c0 2022-01-10T01:33:18.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff537fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5380affe0 0x7ff538155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.045+0000 7ff537fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5380affe0 0x7ff538155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41758/0 (socket says 172.21.15.36:41758) 2022-01-10T01:33:18.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff537fff700 1 -- 172.21.15.36:0/2053773083 learned_addr learned my addr 172.21.15.36:0/2053773083 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:18.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff53d461700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5380af4c0 0x7ff5380ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff53cc60700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff524004e70 0x7ff538061190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff537fff700 1 -- 172.21.15.36:0/2053773083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5380af4c0 msgr2=0x7ff5380ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff537fff700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5380af4c0 0x7ff5380ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff537fff700 1 -- 172.21.15.36:0/2053773083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff524004e70 msgr2=0x7ff538061190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff537fff700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff524004e70 0x7ff538061190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff537fff700 1 -- 172.21.15.36:0/2053773083 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5380ae6b0 con 0x7ff5380affe0 2022-01-10T01:33:18.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff53d461700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5380af4c0 0x7ff5380ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:18.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff537fff700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5380affe0 0x7ff538155a30 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7ff52800b000 tx=0x7ff528009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:18.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff535ffb700 1 -- 172.21.15.36:0/2053773083 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5280072c0 con 0x7ff5380affe0 2022-01-10T01:33:18.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff535ffb700 1 -- 172.21.15.36:0/2053773083 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff528010040 con 0x7ff5380affe0 2022-01-10T01:33:18.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff535ffb700 1 -- 172.21.15.36:0/2053773083 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5280058e0 con 0x7ff5380affe0 2022-01-10T01:33:18.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff53dc62700 1 -- 172.21.15.36:0/2053773083 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5380b05a0 con 0x7ff5380affe0 2022-01-10T01:33:18.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff53dc62700 1 -- 172.21.15.36:0/2053773083 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5380625c0 con 0x7ff5380affe0 2022-01-10T01:33:18.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff53dc62700 1 -- 172.21.15.36:0/2053773083 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5380ae840 con 0x7ff5380affe0 2022-01-10T01:33:18.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff535ffb700 1 -- 172.21.15.36:0/2053773083 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff528005a40 con 0x7ff5380affe0 2022-01-10T01:33:18.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff535ffb700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff518053620 0x7ff518055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.049+0000 7ff535ffb700 1 -- 172.21.15.36:0/2053773083 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff52806b3e0 con 0x7ff5380affe0 2022-01-10T01:33:18.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.053+0000 7ff53cc60700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff518053620 0x7ff518055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.053+0000 7ff53cc60700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff518053620 0x7ff518055ae0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7ff52c00b000 tx=0x7ff52c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:18.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.057+0000 7ff535ffb700 1 -- 172.21.15.36:0/2053773083 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff5280423f0 con 0x7ff5380affe0 2022-01-10T01:33:18.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.185+0000 7ff53dc62700 1 -- 172.21.15.36:0/2053773083 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff538057350 con 0x7ff5380affe0 2022-01-10T01:33:18.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.185+0000 7ff535ffb700 1 -- 172.21.15.36:0/2053773083 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff52801a070 con 0x7ff5380affe0 2022-01-10T01:33:18.194 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:18.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.189+0000 7ff53dc62700 1 -- 172.21.15.36:0/2053773083 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff518053620 msgr2=0x7ff518055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.189+0000 7ff53dc62700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff518053620 0x7ff518055ae0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7ff52c00b000 tx=0x7ff52c008040).stop 2022-01-10T01:33:18.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.189+0000 7ff53dc62700 1 -- 172.21.15.36:0/2053773083 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5380affe0 msgr2=0x7ff538155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.189+0000 7ff53dc62700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5380affe0 0x7ff538155a30 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7ff52800b000 tx=0x7ff528009040).stop 2022-01-10T01:33:18.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.189+0000 7ff53dc62700 1 -- 172.21.15.36:0/2053773083 shutdown_connections 2022-01-10T01:33:18.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.189+0000 7ff53dc62700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff518053620 0x7ff518055ae0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.189+0000 7ff53dc62700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5380af4c0 0x7ff5380ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.189+0000 7ff53dc62700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff5380affe0 0x7ff538155a30 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.189+0000 7ff53dc62700 1 --2- 172.21.15.36:0/2053773083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff524004e70 0x7ff538061190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.189+0000 7ff53dc62700 1 -- 172.21.15.36:0/2053773083 >> 172.21.15.36:0/2053773083 conn(0x7ff538062be0 msgr2=0x7ff5381403f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:18.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.189+0000 7ff53dc62700 1 -- 172.21.15.36:0/2053773083 shutdown_connections 2022-01-10T01:33:18.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.189+0000 7ff53dc62700 1 -- 172.21.15.36:0/2053773083 wait complete. 2022-01-10T01:33:18.213 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:33:18.325 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.317+0000 7fdfe1668700 1 Processor -- start 2022-01-10T01:33:18.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.317+0000 7fdfe1668700 1 -- start start 2022-01-10T01:33:18.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfe1668700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdfdc061320 0x7fdfdc061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfe1668700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc0ad5c0 0x7fdfdc0b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfe1668700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc0aecf0 con 0x7fdfdc140440 2022-01-10T01:33:18.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfe1668700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc0b6f20 con 0x7fdfdc061320 2022-01-10T01:33:18.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfe1668700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0aef20 con 0x7fdfdc0ad5c0 2022-01-10T01:33:18.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfd3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc0ad5c0 0x7fdfdc0b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfe0e67700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdfdc140440 0x7fdfdc146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:57238/0 (socket says 172.21.15.36:57238) 2022-01-10T01:33:18.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfe0e67700 1 -- 172.21.15.36:0/2050914725 learned_addr learned my addr 172.21.15.36:0/2050914725 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:18.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfd3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc0ad5c0 0x7fdfdc0b9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:48048/0 (socket says 172.21.15.36:48048) 2022-01-10T01:33:18.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfdbfff700 1 --2- 172.21.15.36:0/2050914725 >> v2:172.21.15.59:3300/0 conn(0x7fdfdc061320 0x7fdfdc061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfdbfff700 1 -- 172.21.15.36:0/2050914725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc0ad5c0 msgr2=0x7fdfdc0b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:18.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfdbfff700 1 --2- 172.21.15.36:0/2050914725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc0ad5c0 0x7fdfdc0b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfdbfff700 1 -- 172.21.15.36:0/2050914725 >> v1:172.21.15.59:6789/0 conn(0x7fdfdc140440 legacy=0x7fdfdc146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfdbfff700 1 -- 172.21.15.36:0/2050914725 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc0af1c0 con 0x7fdfdc061320 2022-01-10T01:33:18.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfd3fff700 1 --2- 172.21.15.36:0/2050914725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc0ad5c0 0x7fdfdc0b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:18.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.321+0000 7fdfdbfff700 1 --2- 172.21.15.36:0/2050914725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc061320 0x7fdfdc061700 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fdfc4002f70 tx=0x7fdfc4006df0).ready entity=mon.1 client_cookie=664027c5e2e740b7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:18.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.325+0000 7fdfdb7fe700 1 -- 172.21.15.36:0/2050914725 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc400d570 con 0x7fdfdc061320 2022-01-10T01:33:18.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.325+0000 7fdfdb7fe700 1 -- 172.21.15.36:0/2050914725 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc4000e90 con 0x7fdfdc061320 2022-01-10T01:33:18.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.325+0000 7fdfdb7fe700 1 -- 172.21.15.36:0/2050914725 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc400d8c0 con 0x7fdfdc061320 2022-01-10T01:33:18.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.325+0000 7fdfe1668700 1 -- 172.21.15.36:0/2050914725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc061320 msgr2=0x7fdfdc061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.325+0000 7fdfe1668700 1 --2- 172.21.15.36:0/2050914725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc061320 0x7fdfdc061700 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fdfc4002f70 tx=0x7fdfc4006df0).stop 2022-01-10T01:33:18.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.325+0000 7fdfe1668700 1 -- 172.21.15.36:0/2050914725 shutdown_connections 2022-01-10T01:33:18.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.325+0000 7fdfe1668700 1 --2- 172.21.15.36:0/2050914725 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc0ad5c0 0x7fdfdc0b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.325+0000 7fdfe1668700 1 --2- 172.21.15.36:0/2050914725 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc061320 0x7fdfdc061700 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.325+0000 7fdfe1668700 1 -- 172.21.15.36:0/2050914725 >> 172.21.15.36:0/2050914725 conn(0x7fdfdc066de0 msgr2=0x7fdfdc0671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:18.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.325+0000 7fdfe1668700 1 -- 172.21.15.36:0/2050914725 shutdown_connections 2022-01-10T01:33:18.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.325+0000 7fdfe1668700 1 -- 172.21.15.36:0/2050914725 wait complete. 2022-01-10T01:33:18.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe1668700 1 Processor -- start 2022-01-10T01:33:18.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe1668700 1 -- start start 2022-01-10T01:33:18.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe1668700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc061320 0x7fdfdc1427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe1668700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc0ad5c0 0x7fdfdc09e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe1668700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdfdc140440 0x7fdfdc09eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe1668700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0a1960 con 0x7fdfdc140440 2022-01-10T01:33:18.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe1668700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0b2530 con 0x7fdfdc0ad5c0 2022-01-10T01:33:18.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe1668700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0b3150 con 0x7fdfdc061320 2022-01-10T01:33:18.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe0e67700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdfdc140440 0x7fdfdc09eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe0e67700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdfdc140440 0x7fdfdc09eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41774/0 (socket says 172.21.15.36:41774) 2022-01-10T01:33:18.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe0e67700 1 -- 172.21.15.36:0/4263033154 learned_addr learned my addr 172.21.15.36:0/4263033154 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:18.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfdbfff700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc061320 0x7fdfdc1427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfd3fff700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc0ad5c0 0x7fdfdc09e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe0e67700 1 -- 172.21.15.36:0/4263033154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc061320 msgr2=0x7fdfdc1427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe0e67700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc061320 0x7fdfdc1427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe0e67700 1 -- 172.21.15.36:0/4263033154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc0ad5c0 msgr2=0x7fdfdc09e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe0e67700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc0ad5c0 0x7fdfdc09e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe0e67700 1 -- 172.21.15.36:0/4263033154 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc00b180 con 0x7fdfdc140440 2022-01-10T01:33:18.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfdbfff700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc061320 0x7fdfdc1427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:18.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfd3fff700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc0ad5c0 0x7fdfdc09e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:18.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe0e67700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdfdc140440 0x7fdfdc09eda0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fdfdc143000 tx=0x7fdfd40013a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:18.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfd9ffb700 1 -- 172.21.15.36:0/4263033154 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfd4005ba0 con 0x7fdfdc140440 2022-01-10T01:33:18.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfd9ffb700 1 -- 172.21.15.36:0/4263033154 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd4005d00 con 0x7fdfdc140440 2022-01-10T01:33:18.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe1668700 1 -- 172.21.15.36:0/4263033154 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc400b180 con 0x7fdfdc140440 2022-01-10T01:33:18.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfd9ffb700 1 -- 172.21.15.36:0/4263033154 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfd40072c0 con 0x7fdfdc140440 2022-01-10T01:33:18.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.329+0000 7fdfe1668700 1 -- 172.21.15.36:0/4263033154 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc0b2790 con 0x7fdfdc140440 2022-01-10T01:33:18.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.333+0000 7fdfe1668700 1 -- 172.21.15.36:0/4263033154 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc0b2950 con 0x7fdfdc140440 2022-01-10T01:33:18.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.333+0000 7fdfd9ffb700 1 -- 172.21.15.36:0/4263033154 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fdfd401a060 con 0x7fdfdc140440 2022-01-10T01:33:18.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.333+0000 7fdfd9ffb700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdfc00534d0 0x7fdfc0055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.333+0000 7fdfd9ffb700 1 -- 172.21.15.36:0/4263033154 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdfd406b600 con 0x7fdfdc140440 2022-01-10T01:33:18.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.333+0000 7fdfdbfff700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdfc00534d0 0x7fdfc0055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.333+0000 7fdfdbfff700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdfc00534d0 0x7fdfc0055990 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fdfc4018000 tx=0x7fdfc4014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:18.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.341+0000 7fdfd9ffb700 1 -- 172.21.15.36:0/4263033154 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdfd4042500 con 0x7fdfdc140440 2022-01-10T01:33:18.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.469+0000 7fdfe1668700 1 -- 172.21.15.36:0/4263033154 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdfdc0af460 con 0x7fdfdc140440 2022-01-10T01:33:18.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.469+0000 7fdfd9ffb700 1 -- 172.21.15.36:0/4263033154 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v139) v1 ==== 104+0+10 (secure 0 0 0) 0x7fdfd4018020 con 0x7fdfdc140440 2022-01-10T01:33:18.478 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:18.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.473+0000 7fdfe1668700 1 -- 172.21.15.36:0/4263033154 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdfc00534d0 msgr2=0x7fdfc0055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.473+0000 7fdfe1668700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdfc00534d0 0x7fdfc0055990 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7fdfc4018000 tx=0x7fdfc4014000).stop 2022-01-10T01:33:18.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.473+0000 7fdfe1668700 1 -- 172.21.15.36:0/4263033154 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdfdc140440 msgr2=0x7fdfdc09eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.473+0000 7fdfe1668700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdfdc140440 0x7fdfdc09eda0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fdfdc143000 tx=0x7fdfd40013a0).stop 2022-01-10T01:33:18.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.473+0000 7fdfe1668700 1 -- 172.21.15.36:0/4263033154 shutdown_connections 2022-01-10T01:33:18.480 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.473+0000 7fdfe1668700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdfc00534d0 0x7fdfc0055990 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.473+0000 7fdfe1668700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdfdc140440 0x7fdfdc09eda0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.473+0000 7fdfe1668700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc0ad5c0 0x7fdfdc09e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.473+0000 7fdfe1668700 1 --2- 172.21.15.36:0/4263033154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc061320 0x7fdfdc1427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.473+0000 7fdfe1668700 1 -- 172.21.15.36:0/4263033154 >> 172.21.15.36:0/4263033154 conn(0x7fdfdc066de0 msgr2=0x7fdfdc13fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:18.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.473+0000 7fdfe1668700 1 -- 172.21.15.36:0/4263033154 shutdown_connections 2022-01-10T01:33:18.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.473+0000 7fdfe1668700 1 -- 172.21.15.36:0/4263033154 wait complete. 2022-01-10T01:33:18.494 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:33:18.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd27e7d700 1 Processor -- start 2022-01-10T01:33:18.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd27e7d700 1 -- start start 2022-01-10T01:33:18.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd27e7d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbd20146950 0x7fbd20140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd27e7d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd200b4690 0x7fbd200b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd27e7d700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd20143b60 con 0x7fbd200b4180 2022-01-10T01:33:18.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd27e7d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd20147510 con 0x7fbd20146950 2022-01-10T01:33:18.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd27e7d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20143e00 con 0x7fbd200b4690 2022-01-10T01:33:18.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd25418700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fbd200b4180 0x7fbd20140720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39574/0 (socket says 172.21.15.36:39574) 2022-01-10T01:33:18.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd25418700 1 -- 172.21.15.36:0/2450766525 learned_addr learned my addr 172.21.15.36:0/2450766525 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:18.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd25c19700 1 --2- 172.21.15.36:0/2450766525 >> v2:172.21.15.59:3300/0 conn(0x7fbd20146950 0x7fbd20140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd2641a700 1 --2- 172.21.15.36:0/2450766525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd200b4690 0x7fbd200b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd24c17700 1 -- 172.21.15.36:0/2450766525 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790259079 0 0) 0x7fbd20143b60 con 0x7fbd200b4180 2022-01-10T01:33:18.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd24c17700 1 -- 172.21.15.36:0/2450766525 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd08003260 con 0x7fbd200b4180 2022-01-10T01:33:18.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd25c19700 1 -- 172.21.15.36:0/2450766525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd200b4690 msgr2=0x7fbd200b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:18.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd25c19700 1 --2- 172.21.15.36:0/2450766525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd200b4690 0x7fbd200b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd25c19700 1 -- 172.21.15.36:0/2450766525 >> v1:172.21.15.36:6789/0 conn(0x7fbd200b4180 legacy=0x7fbd20140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd25c19700 1 -- 172.21.15.36:0/2450766525 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd200b0c90 con 0x7fbd20146950 2022-01-10T01:33:18.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.597+0000 7fbd25c19700 1 --2- 172.21.15.36:0/2450766525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd20146950 0x7fbd20140230 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fbd1c002f70 tx=0x7fbd1c006df0).ready entity=mon.1 client_cookie=cec725742dbe941f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:18.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.601+0000 7fbd24c17700 1 -- 172.21.15.36:0/2450766525 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1c00d4a0 con 0x7fbd20146950 2022-01-10T01:33:18.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.601+0000 7fbd24c17700 1 -- 172.21.15.36:0/2450766525 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c000e90 con 0x7fbd20146950 2022-01-10T01:33:18.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.601+0000 7fbd24c17700 1 -- 172.21.15.36:0/2450766525 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1c00d7f0 con 0x7fbd20146950 2022-01-10T01:33:18.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.601+0000 7fbd27e7d700 1 -- 172.21.15.36:0/2450766525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd20146950 msgr2=0x7fbd20140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.601+0000 7fbd27e7d700 1 --2- 172.21.15.36:0/2450766525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd20146950 0x7fbd20140230 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fbd1c002f70 tx=0x7fbd1c006df0).stop 2022-01-10T01:33:18.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.601+0000 7fbd27e7d700 1 -- 172.21.15.36:0/2450766525 shutdown_connections 2022-01-10T01:33:18.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.601+0000 7fbd27e7d700 1 --2- 172.21.15.36:0/2450766525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd200b4690 0x7fbd200b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.601+0000 7fbd27e7d700 1 --2- 172.21.15.36:0/2450766525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd20146950 0x7fbd20140230 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.601+0000 7fbd27e7d700 1 -- 172.21.15.36:0/2450766525 >> 172.21.15.36:0/2450766525 conn(0x7fbd2005c490 msgr2=0x7fbd2005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:18.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.601+0000 7fbd27e7d700 1 -- 172.21.15.36:0/2450766525 shutdown_connections 2022-01-10T01:33:18.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.601+0000 7fbd27e7d700 1 -- 172.21.15.36:0/2450766525 wait complete. 2022-01-10T01:33:18.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd27e7d700 1 Processor -- start 2022-01-10T01:33:18.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd27e7d700 1 -- start start 2022-01-10T01:33:18.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd27e7d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd200b4180 0x7fbd200b9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd27e7d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbd200b4690 0x7fbd200b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd27e7d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd20146950 0x7fbd20145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd27e7d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200ad380 con 0x7fbd200b4690 2022-01-10T01:33:18.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd27e7d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20146d30 con 0x7fbd20146950 2022-01-10T01:33:18.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd27e7d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd201444d0 con 0x7fbd200b4180 2022-01-10T01:33:18.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd25418700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbd200b4690 0x7fbd200b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd25418700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbd200b4690 0x7fbd200b6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41786/0 (socket says 172.21.15.36:41786) 2022-01-10T01:33:18.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd25418700 1 -- 172.21.15.36:0/887656190 learned_addr learned my addr 172.21.15.36:0/887656190 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:18.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd2641a700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd20146950 0x7fbd20145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd25c19700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd200b4180 0x7fbd200b9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd25418700 1 -- 172.21.15.36:0/887656190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd200b4180 msgr2=0x7fbd200b9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd25418700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd200b4180 0x7fbd200b9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd25418700 1 -- 172.21.15.36:0/887656190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd20146950 msgr2=0x7fbd20145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd25418700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd20146950 0x7fbd20145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd25418700 1 -- 172.21.15.36:0/887656190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c00b180 con 0x7fbd200b4690 2022-01-10T01:33:18.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd25c19700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd200b4180 0x7fbd200b9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:18.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd25418700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbd200b4690 0x7fbd200b6070 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7fbd10001110 tx=0x7fbd10007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:18.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd0effd700 1 -- 172.21.15.36:0/887656190 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd1000ce60 con 0x7fbd200b4690 2022-01-10T01:33:18.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd0effd700 1 -- 172.21.15.36:0/887656190 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd100070d0 con 0x7fbd200b4690 2022-01-10T01:33:18.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd0effd700 1 -- 172.21.15.36:0/887656190 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbd10007430 con 0x7fbd200b4690 2022-01-10T01:33:18.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd27e7d700 1 -- 172.21.15.36:0/887656190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd200b8440 con 0x7fbd200b4690 2022-01-10T01:33:18.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.605+0000 7fbd27e7d700 1 -- 172.21.15.36:0/887656190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd20145170 con 0x7fbd200b4690 2022-01-10T01:33:18.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.609+0000 7fbd27e7d700 1 -- 172.21.15.36:0/887656190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd20057350 con 0x7fbd200b4690 2022-01-10T01:33:18.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.609+0000 7fbd0effd700 1 -- 172.21.15.36:0/887656190 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbd1001a070 con 0x7fbd200b4690 2022-01-10T01:33:18.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.609+0000 7fbd0effd700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbd00053560 0x7fbd00055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.609+0000 7fbd0effd700 1 -- 172.21.15.36:0/887656190 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbd1006abf0 con 0x7fbd200b4690 2022-01-10T01:33:18.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.609+0000 7fbd25c19700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbd00053560 0x7fbd00055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.609+0000 7fbd25c19700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbd00053560 0x7fbd00055a20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fbd1c018000 tx=0x7fbd1c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:18.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.613+0000 7fbd0effd700 1 -- 172.21.15.36:0/887656190 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbd10041c00 con 0x7fbd200b4690 2022-01-10T01:33:18.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.741+0000 7fbd27e7d700 1 -- 172.21.15.36:0/887656190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd2013ad60 con 0x7fbd200b4690 2022-01-10T01:33:18.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.741+0000 7fbd0effd700 1 -- 172.21.15.36:0/887656190 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v139) v1 ==== 100+0+10 (secure 0 0 0) 0x7fbd10045220 con 0x7fbd200b4690 2022-01-10T01:33:18.750 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:18.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.745+0000 7fbd27e7d700 1 -- 172.21.15.36:0/887656190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbd00053560 msgr2=0x7fbd00055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.745+0000 7fbd27e7d700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbd00053560 0x7fbd00055a20 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fbd1c018000 tx=0x7fbd1c014000).stop 2022-01-10T01:33:18.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.745+0000 7fbd27e7d700 1 -- 172.21.15.36:0/887656190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbd200b4690 msgr2=0x7fbd200b6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.745+0000 7fbd27e7d700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbd200b4690 0x7fbd200b6070 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7fbd10001110 tx=0x7fbd10007a60).stop 2022-01-10T01:33:18.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.745+0000 7fbd27e7d700 1 -- 172.21.15.36:0/887656190 shutdown_connections 2022-01-10T01:33:18.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.745+0000 7fbd27e7d700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbd00053560 0x7fbd00055a20 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.745+0000 7fbd27e7d700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbd20146950 0x7fbd20145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.745+0000 7fbd27e7d700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbd200b4690 0x7fbd200b6070 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.745+0000 7fbd27e7d700 1 --2- 172.21.15.36:0/887656190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbd200b4180 0x7fbd200b9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.745+0000 7fbd27e7d700 1 -- 172.21.15.36:0/887656190 >> 172.21.15.36:0/887656190 conn(0x7fbd2005c490 msgr2=0x7fbd20061d30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:18.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.745+0000 7fbd27e7d700 1 -- 172.21.15.36:0/887656190 shutdown_connections 2022-01-10T01:33:18.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.745+0000 7fbd27e7d700 1 -- 172.21.15.36:0/887656190 wait complete. 2022-01-10T01:33:18.767 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:33:18.768 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:18.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce49274700 1 Processor -- start 2022-01-10T01:33:18.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce49274700 1 -- start start 2022-01-10T01:33:18.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce49274700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fce44061320 0x7fce44061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce49274700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce440ad5c0 0x7fce440b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce49274700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce44140440 0x7fce441408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce49274700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce440aecf0 con 0x7fce44061320 2022-01-10T01:33:18.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce49274700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce440b6f20 con 0x7fce440ad5c0 2022-01-10T01:33:18.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce49274700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce440aef20 con 0x7fce44140440 2022-01-10T01:33:18.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce43fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fce44061320 0x7fce44061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce43fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fce44061320 0x7fce44061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41792/0 (socket says 172.21.15.36:41792) 2022-01-10T01:33:18.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce43fff700 1 -- 172.21.15.36:0/2665948216 learned_addr learned my addr 172.21.15.36:0/2665948216 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:18.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce437fe700 1 --2- 172.21.15.36:0/2665948216 >> v2:172.21.15.59:3300/0 conn(0x7fce440ad5c0 0x7fce440b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce48a73700 1 --2- 172.21.15.36:0/2665948216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce44140440 0x7fce441408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce43fff700 1 -- 172.21.15.36:0/2665948216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce44140440 msgr2=0x7fce441408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:18.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce43fff700 1 --2- 172.21.15.36:0/2665948216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce44140440 0x7fce441408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce43fff700 1 -- 172.21.15.36:0/2665948216 >> v2:172.21.15.59:3300/0 conn(0x7fce440ad5c0 msgr2=0x7fce440b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:18.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce43fff700 1 --2- 172.21.15.36:0/2665948216 >> v2:172.21.15.59:3300/0 conn(0x7fce440ad5c0 0x7fce440b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce43fff700 1 -- 172.21.15.36:0/2665948216 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce440af1c0 con 0x7fce44061320 2022-01-10T01:33:18.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce437fe700 1 --2- 172.21.15.36:0/2665948216 >> v2:172.21.15.59:3300/0 conn(0x7fce440ad5c0 0x7fce440b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:18.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce43fff700 1 --2- 172.21.15.36:0/2665948216 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fce44061320 0x7fce44061700 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fce440aeba0 tx=0x7fce34006eb0).ready entity=mon.0 client_cookie=73e812dc42be0860 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:18.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce42ffd700 1 -- 172.21.15.36:0/2665948216 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce3400d570 con 0x7fce44061320 2022-01-10T01:33:18.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce42ffd700 1 -- 172.21.15.36:0/2665948216 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce34000e90 con 0x7fce44061320 2022-01-10T01:33:18.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.869+0000 7fce42ffd700 1 -- 172.21.15.36:0/2665948216 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce3400d8c0 con 0x7fce44061320 2022-01-10T01:33:18.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 -- 172.21.15.36:0/2665948216 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fce44061320 msgr2=0x7fce44061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 --2- 172.21.15.36:0/2665948216 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fce44061320 0x7fce44061700 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fce440aeba0 tx=0x7fce34006eb0).stop 2022-01-10T01:33:18.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 -- 172.21.15.36:0/2665948216 shutdown_connections 2022-01-10T01:33:18.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 --2- 172.21.15.36:0/2665948216 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce44140440 0x7fce441408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 --2- 172.21.15.36:0/2665948216 >> v2:172.21.15.59:3300/0 conn(0x7fce440ad5c0 0x7fce440b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 --2- 172.21.15.36:0/2665948216 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fce44061320 0x7fce44061700 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 -- 172.21.15.36:0/2665948216 >> 172.21.15.36:0/2665948216 conn(0x7fce44066de0 msgr2=0x7fce440671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:18.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 -- 172.21.15.36:0/2665948216 shutdown_connections 2022-01-10T01:33:18.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 -- 172.21.15.36:0/2665948216 wait complete. 2022-01-10T01:33:18.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 Processor -- start 2022-01-10T01:33:18.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 -- start start 2022-01-10T01:33:18.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce44061320 0x7fce440b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce440ad5c0 0x7fce440afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fce44140440 0x7fce440ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4409e950 con 0x7fce44140440 2022-01-10T01:33:18.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4409ebf0 con 0x7fce44061320 2022-01-10T01:33:18.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce49274700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce440b1da0 con 0x7fce440ad5c0 2022-01-10T01:33:18.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce43fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce44061320 0x7fce440b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce48a73700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fce44140440 0x7fce440ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce43fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce44061320 0x7fce440b23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:38432/0 (socket says 172.21.15.36:38432) 2022-01-10T01:33:18.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce43fff700 1 -- 172.21.15.36:0/280702817 learned_addr learned my addr 172.21.15.36:0/280702817 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:18.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce437fe700 1 --2- 172.21.15.36:0/280702817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce440ad5c0 0x7fce440afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce48a73700 1 -- 172.21.15.36:0/280702817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce440ad5c0 msgr2=0x7fce440afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce48a73700 1 --2- 172.21.15.36:0/280702817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce440ad5c0 0x7fce440afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce48a73700 1 -- 172.21.15.36:0/280702817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce44061320 msgr2=0x7fce440b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:18.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.873+0000 7fce48a73700 1 --2- 172.21.15.36:0/280702817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce44061320 0x7fce440b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:18.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.877+0000 7fce48a73700 1 -- 172.21.15.36:0/280702817 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3400b1e0 con 0x7fce44140440 2022-01-10T01:33:18.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.877+0000 7fce48a73700 1 --2- 172.21.15.36:0/280702817 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fce44140440 0x7fce440ac330 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fce3c00a000 tx=0x7fce3c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:18.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.877+0000 7fce417fa700 1 -- 172.21.15.36:0/280702817 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce3c011780 con 0x7fce44140440 2022-01-10T01:33:18.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.877+0000 7fce417fa700 1 -- 172.21.15.36:0/280702817 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c0118e0 con 0x7fce44140440 2022-01-10T01:33:18.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.877+0000 7fce49274700 1 -- 172.21.15.36:0/280702817 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce440b07d0 con 0x7fce44140440 2022-01-10T01:33:18.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.877+0000 7fce417fa700 1 -- 172.21.15.36:0/280702817 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce3c011c40 con 0x7fce44140440 2022-01-10T01:33:18.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.877+0000 7fce49274700 1 -- 172.21.15.36:0/280702817 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce440b3ce0 con 0x7fce44140440 2022-01-10T01:33:18.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.877+0000 7fce49274700 1 -- 172.21.15.36:0/280702817 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4409edf0 con 0x7fce44140440 2022-01-10T01:33:18.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.877+0000 7fce417fa700 1 -- 172.21.15.36:0/280702817 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fce3c01c460 con 0x7fce44140440 2022-01-10T01:33:18.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.877+0000 7fce417fa700 1 --2- 172.21.15.36:0/280702817 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fce1c0535f0 0x7fce1c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:18.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.877+0000 7fce417fa700 1 -- 172.21.15.36:0/280702817 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fce3c06bec0 con 0x7fce44140440 2022-01-10T01:33:18.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.877+0000 7fce43fff700 1 --2- 172.21.15.36:0/280702817 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fce1c0535f0 0x7fce1c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:18.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.881+0000 7fce43fff700 1 --2- 172.21.15.36:0/280702817 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fce1c0535f0 0x7fce1c055ab0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fce3401c000 tx=0x7fce34015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:18.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:18.885+0000 7fce417fa700 1 -- 172.21.15.36:0/280702817 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fce4409edf0 con 0x7fce44140440 2022-01-10T01:33:19.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:19.049+0000 7fce49274700 1 -- 172.21.15.36:0/280702817 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce440b1be0 con 0x7fce44140440 2022-01-10T01:33:19.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:19.049+0000 7fce417fa700 1 -- 172.21.15.36:0/280702817 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fce3c042dd0 con 0x7fce44140440 2022-01-10T01:33:19.056 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:19.056 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8016,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/2824324236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2824324236},{"type":"v1","addr":"172.21.15.36:6835","nonce":2824324236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1768428808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1768428808},{"type":"v1","addr":"172.21.15.36:6837","nonce":1768428808}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:14.392835+0000","modified":"2022-01-10T01:33:15.396812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8028":{"gid":8028,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3822558856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3822558856},{"type":"v1","addr":"172.21.15.59:6833","nonce":3822558856}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2022-01-10T01:33:19.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:19.049+0000 7fce49274700 1 -- 172.21.15.36:0/280702817 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fce1c0535f0 msgr2=0x7fce1c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:19.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:19.049+0000 7fce49274700 1 --2- 172.21.15.36:0/280702817 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fce1c0535f0 0x7fce1c055ab0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fce3401c000 tx=0x7fce34015000).stop 2022-01-10T01:33:19.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:19.049+0000 7fce49274700 1 -- 172.21.15.36:0/280702817 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fce44140440 msgr2=0x7fce440ac330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:19.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:19.049+0000 7fce49274700 1 --2- 172.21.15.36:0/280702817 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fce44140440 0x7fce440ac330 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fce3c00a000 tx=0x7fce3c008040).stop 2022-01-10T01:33:19.058 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:19.049+0000 7fce49274700 1 -- 172.21.15.36:0/280702817 shutdown_connections 2022-01-10T01:33:19.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:19.049+0000 7fce49274700 1 --2- 172.21.15.36:0/280702817 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fce1c0535f0 0x7fce1c055ab0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:19.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:19.049+0000 7fce49274700 1 --2- 172.21.15.36:0/280702817 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fce44140440 0x7fce440ac330 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:19.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:19.049+0000 7fce49274700 1 --2- 172.21.15.36:0/280702817 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce440ad5c0 0x7fce440afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:19.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:19.049+0000 7fce49274700 1 --2- 172.21.15.36:0/280702817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce44061320 0x7fce440b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:19.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:19.049+0000 7fce49274700 1 -- 172.21.15.36:0/280702817 >> 172.21.15.36:0/280702817 conn(0x7fce44066de0 msgr2=0x7fce441447e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:19.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:19.049+0000 7fce49274700 1 -- 172.21.15.36:0/280702817 shutdown_connections 2022-01-10T01:33:19.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:19.049+0000 7fce49274700 1 -- 172.21.15.36:0/280702817 wait complete. 2022-01-10T01:33:19.060 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 66 2022-01-10T01:33:19.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:33:14.392835+0000', 'modified': '2022-01-10T01:33:15.396812+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8028}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8028': {'gid': 8028, 'name': 'b', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/3822558856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 3822558856}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 3822558856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:33:19.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:33:19.373 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:33:19.492 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":8028,"want_state":"up:active","state":"up:active","rank_uptime":5.0845259609999998,"mdsmap_epoch":66,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":10.092216648999999} 2022-01-10T01:33:19.493 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 8028, "mdsmap_epoch": 66, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 5.084525961, "state": "up:active", "uptime": 10.092216649, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:33:19.493 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:33:19.494 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:33:19.494 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:33:19.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:19.495 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:19.503 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:33:19.520 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:33:19.520 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:33:19.580 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:33:19.581 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:33:19.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:19.582 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:33:19.589 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:33:19.589 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:19.592 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:33:19.605 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:33:19.606 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:33:19.617 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:33:19.618 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:33:19.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:19.619 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:33:19.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:33:19.659+0000 7f8716d33080 -1 init, newargv = 0x55c5fa093360 newargc=9ceph-fuse[15173]: starting ceph client 2022-01-10T01:33:19.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr: 2022-01-10T01:33:19.672 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[15173]: starting fuse 2022-01-10T01:33:20.726 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:33:20.745 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:33:20.745 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:33:20.803 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:33:20.804 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:33:20.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:20.805 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:33:20.813 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:33:20.813 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:33:20.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:20.814 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:33:20.815 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:33:20.815 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:33:20.816 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:33:20.816 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:33:20.817 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:33:20.817 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:33:20.817 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:33:20.818 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:33:20.818 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:33:20.818 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:33:20.819 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:33:20.819 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:33:20.820 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:33:20.820 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:33:20.821 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:33:20.821 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:33:20.821 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:33:20.822 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:33:20.822 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:33:20.823 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:33:20.823 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:33:20.823 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:33:20.899 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.15173.asok 2022-01-10T01:33:20.903 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15173.asok 2022-01-10T01:33:20.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:20.904 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15173.asok status 2022-01-10T01:33:20.992 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:33:20.992 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:33:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:33:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:33:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:33:20.993 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:33:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:33:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "15173", 2022-01-10T01:33:20.994 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:33:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:33:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:33:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:33:20.995 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 8113, 2022-01-10T01:33:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:33:20.996 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:33:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:33:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 8113 2022-01-10T01:33:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:33:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:33:20.997 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:33:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:33:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 1113997125 2022-01-10T01:33:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:33:20.998 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:33:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:33:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:33:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:33:20.999 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 1113997125 2022-01-10T01:33:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:33:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.8113 172.21.15.139:0/1113997125", 2022-01-10T01:33:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/1113997125", 2022-01-10T01:33:21.000 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:33:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 66, 2022-01-10T01:33:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 139, 2022-01-10T01:33:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:33:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:33:21.001 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:33:21.002 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:33:21.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:21.004 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:21.004 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:21.011 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:33:21.012 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:33:21.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:21.013 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:21.075 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:33:21.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.181+0000 7f7ed247e700 1 Processor -- start 2022-01-10T01:33:21.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.181+0000 7f7ed247e700 1 -- start start 2022-01-10T01:33:21.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.181+0000 7f7ed247e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7ecc0b1db0 0x7f7ecc0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.181+0000 7f7ed247e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc0b0350 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.181+0000 7f7ed247e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc0b05f0 con 0x7f7ecc1483a0 2022-01-10T01:33:21.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.181+0000 7f7ed247e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ecc0a90c0 con 0x7f7ecc0b1db0 2022-01-10T01:33:21.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.181+0000 7f7ed0a1b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f7ecc0a70c0 0x7f7ecc144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39604/0 (socket says 172.21.15.36:39604) 2022-01-10T01:33:21.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.181+0000 7f7ed0a1b700 1 -- 172.21.15.36:0/123182404 learned_addr learned my addr 172.21.15.36:0/123182404 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:21.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.181+0000 7f7ecbfff700 1 --2- 172.21.15.36:0/123182404 >> v2:172.21.15.59:3300/0 conn(0x7f7ecc0b1db0 0x7f7ecc0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.181+0000 7f7ecaffd700 1 -- 172.21.15.36:0/123182404 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190079201 0 0) 0x7f7ecc0b0350 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.181+0000 7f7ecaffd700 1 -- 172.21.15.36:0/123182404 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb8003260 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.181+0000 7f7ecaffd700 1 -- 172.21.15.36:0/123182404 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476238678 0 0) 0x7f7ecc0b05f0 con 0x7f7ecc1483a0 2022-01-10T01:33:21.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.181+0000 7f7ecaffd700 1 -- 172.21.15.36:0/123182404 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ecc0b0350 con 0x7f7ecc1483a0 2022-01-10T01:33:21.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ecbfff700 1 -- 172.21.15.36:0/123182404 >> v1:172.21.15.59:6789/0 conn(0x7f7ecc1483a0 legacy=0x7f7ecc0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ecbfff700 1 -- 172.21.15.36:0/123182404 >> v1:172.21.15.36:6789/0 conn(0x7f7ecc0a70c0 legacy=0x7f7ecc144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ecbfff700 1 -- 172.21.15.36:0/123182404 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc0b0890 con 0x7f7ecc0b1db0 2022-01-10T01:33:21.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ecbfff700 1 --2- 172.21.15.36:0/123182404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc0b1db0 0x7f7ecc0b0fd0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f7ecc147730 tx=0x7f7ec0006df0).ready entity=mon.1 client_cookie=fe3d593ae268d2fa server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:21.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ecaffd700 1 -- 172.21.15.36:0/123182404 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ec000d610 con 0x7f7ecc0b1db0 2022-01-10T01:33:21.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ecaffd700 1 -- 172.21.15.36:0/123182404 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec0000e90 con 0x7f7ecc0b1db0 2022-01-10T01:33:21.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ecaffd700 1 -- 172.21.15.36:0/123182404 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ec000d960 con 0x7f7ecc0b1db0 2022-01-10T01:33:21.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ed247e700 1 -- 172.21.15.36:0/123182404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc0b1db0 msgr2=0x7f7ecc0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ed247e700 1 --2- 172.21.15.36:0/123182404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc0b1db0 0x7f7ecc0b0fd0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f7ecc147730 tx=0x7f7ec0006df0).stop 2022-01-10T01:33:21.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ed247e700 1 -- 172.21.15.36:0/123182404 shutdown_connections 2022-01-10T01:33:21.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ed247e700 1 --2- 172.21.15.36:0/123182404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc0b1db0 0x7f7ecc0b0fd0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ed247e700 1 -- 172.21.15.36:0/123182404 >> 172.21.15.36:0/123182404 conn(0x7f7ecc05f6b0 msgr2=0x7f7ecc05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:21.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ed247e700 1 -- 172.21.15.36:0/123182404 shutdown_connections 2022-01-10T01:33:21.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ed247e700 1 -- 172.21.15.36:0/123182404 wait complete. 2022-01-10T01:33:21.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ed247e700 1 Processor -- start 2022-01-10T01:33:21.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.185+0000 7f7ed247e700 1 -- start start 2022-01-10T01:33:21.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ed247e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7ecc0a70c0 0x7f7ecc0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ed247e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ecc0b1db0 0x7f7ecc0ab580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ed247e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc1483a0 0x7f7ecc0aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ed247e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0ac2f0 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ed247e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0a9f30 con 0x7f7ecc1483a0 2022-01-10T01:33:21.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ed247e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0ac7e0 con 0x7f7ecc0b1db0 2022-01-10T01:33:21.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ecbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7ecc0a70c0 0x7f7ecc0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ecbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7ecc0a70c0 0x7f7ecc0aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41814/0 (socket says 172.21.15.36:41814) 2022-01-10T01:33:21.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ecbfff700 1 -- 172.21.15.36:0/3332826138 learned_addr learned my addr 172.21.15.36:0/3332826138 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:21.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ecb7fe700 1 --2- 172.21.15.36:0/3332826138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ecc0b1db0 0x7f7ecc0ab580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ed0a1b700 1 --2- 172.21.15.36:0/3332826138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc1483a0 0x7f7ecc0aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ecbfff700 1 -- 172.21.15.36:0/3332826138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ecc0b1db0 msgr2=0x7f7ecc0ab580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ecbfff700 1 --2- 172.21.15.36:0/3332826138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ecc0b1db0 0x7f7ecc0ab580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ecbfff700 1 -- 172.21.15.36:0/3332826138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc1483a0 msgr2=0x7f7ecc0aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ecbfff700 1 --2- 172.21.15.36:0/3332826138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc1483a0 0x7f7ecc0aba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ecbfff700 1 -- 172.21.15.36:0/3332826138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec000b180 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ecbfff700 1 --2- 172.21.15.36:0/3332826138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7ecc0a70c0 0x7f7ecc0aeaf0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f7ecc0ac970 tx=0x7f7ec0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:21.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ec97fa700 1 -- 172.21.15.36:0/3332826138 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ec0013da0 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ed247e700 1 -- 172.21.15.36:0/3332826138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ecc0ac050 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ec97fa700 1 -- 172.21.15.36:0/3332826138 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec000d290 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ec97fa700 1 -- 172.21.15.36:0/3332826138 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ec001e5f0 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.189+0000 7f7ed247e700 1 -- 172.21.15.36:0/3332826138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ecc0af6c0 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.193+0000 7f7ed247e700 1 -- 172.21.15.36:0/3332826138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ecc057350 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.193+0000 7f7ec97fa700 1 -- 172.21.15.36:0/3332826138 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7ec0025030 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.193+0000 7f7ec97fa700 1 --2- 172.21.15.36:0/3332826138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7eac053620 0x7f7eac055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.193+0000 7f7ec97fa700 1 -- 172.21.15.36:0/3332826138 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7ec006c890 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.193+0000 7f7ecb7fe700 1 --2- 172.21.15.36:0/3332826138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7eac053620 0x7f7eac055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.193+0000 7f7ecb7fe700 1 --2- 172.21.15.36:0/3332826138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7eac053620 0x7f7eac055ae0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f7ebc00d000 tx=0x7f7ebc007a20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:21.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.197+0000 7f7ec97fa700 1 -- 172.21.15.36:0/3332826138 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7ec0043710 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.329+0000 7f7ed247e700 1 -- 172.21.15.36:0/3332826138 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ecc0ab300 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.329+0000 7f7ec97fa700 1 -- 172.21.15.36:0/3332826138 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f7ec0023020 con 0x7f7ecc0a70c0 2022-01-10T01:33:21.336 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:21.337 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":139,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:33:15.396927+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:33:12.182921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2022-01-10T01:33:13.414645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:33:21.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.329+0000 7f7ed247e700 1 -- 172.21.15.36:0/3332826138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7eac053620 msgr2=0x7f7eac055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.329+0000 7f7ed247e700 1 --2- 172.21.15.36:0/3332826138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7eac053620 0x7f7eac055ae0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f7ebc00d000 tx=0x7f7ebc007a20).stop 2022-01-10T01:33:21.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.329+0000 7f7ed247e700 1 -- 172.21.15.36:0/3332826138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7ecc0a70c0 msgr2=0x7f7ecc0aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.329+0000 7f7ed247e700 1 --2- 172.21.15.36:0/3332826138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7ecc0a70c0 0x7f7ecc0aeaf0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f7ecc0ac970 tx=0x7f7ec0014000).stop 2022-01-10T01:33:21.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.333+0000 7f7ed247e700 1 -- 172.21.15.36:0/3332826138 shutdown_connections 2022-01-10T01:33:21.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.333+0000 7f7ed247e700 1 --2- 172.21.15.36:0/3332826138 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7eac053620 0x7f7eac055ae0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.333+0000 7f7ed247e700 1 --2- 172.21.15.36:0/3332826138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ecc1483a0 0x7f7ecc0aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.333+0000 7f7ed247e700 1 --2- 172.21.15.36:0/3332826138 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ecc0b1db0 0x7f7ecc0ab580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.333+0000 7f7ed247e700 1 --2- 172.21.15.36:0/3332826138 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7ecc0a70c0 0x7f7ecc0aeaf0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.333+0000 7f7ed247e700 1 -- 172.21.15.36:0/3332826138 >> 172.21.15.36:0/3332826138 conn(0x7f7ecc05f6b0 msgr2=0x7f7ecc14e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:21.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.333+0000 7f7ed247e700 1 -- 172.21.15.36:0/3332826138 shutdown_connections 2022-01-10T01:33:21.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.333+0000 7f7ed247e700 1 -- 172.21.15.36:0/3332826138 wait complete. 2022-01-10T01:33:21.349 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:33:12.182921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:33:13.414645+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:33:21.350 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:33:21.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f733359e700 1 Processor -- start 2022-01-10T01:33:21.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f733359e700 1 -- start start 2022-01-10T01:33:21.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f733359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7334061b80 0x7f73341444a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f733359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f73340b4060 0x7f7334144990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f733359e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73340b1f70 con 0x7f73340b6430 2022-01-10T01:33:21.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f733359e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73340b14a0 con 0x7f73340b4060 2022-01-10T01:33:21.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f733359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73340b6810 con 0x7f7334061b80 2022-01-10T01:33:21.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f733259c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f73340b6430 0x7f7334061470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39614/0 (socket says 172.21.15.36:39614) 2022-01-10T01:33:21.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f733259c700 1 -- 172.21.15.36:0/3400262775 learned_addr learned my addr 172.21.15.36:0/3400262775 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:21.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f7332d9d700 1 --2- 172.21.15.36:0/3400262775 >> v2:172.21.15.59:3300/0 conn(0x7f73340b4060 0x7f7334144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f7331d9b700 1 --2- 172.21.15.36:0/3400262775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7334061b80 0x7f73341444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f733159a700 1 -- 172.21.15.36:0/3400262775 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321209235 0 0) 0x7f73340b1f70 con 0x7f73340b6430 2022-01-10T01:33:21.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f733159a700 1 -- 172.21.15.36:0/3400262775 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7318003260 con 0x7f73340b6430 2022-01-10T01:33:21.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f7332d9d700 1 -- 172.21.15.36:0/3400262775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7334061b80 msgr2=0x7f73341444a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:21.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f7332d9d700 1 --2- 172.21.15.36:0/3400262775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7334061b80 0x7f73341444a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f7332d9d700 1 -- 172.21.15.36:0/3400262775 >> v1:172.21.15.36:6789/0 conn(0x7f73340b6430 legacy=0x7f7334061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f7332d9d700 1 -- 172.21.15.36:0/3400262775 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7334148110 con 0x7f73340b4060 2022-01-10T01:33:21.464 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f7332d9d700 1 --2- 172.21.15.36:0/3400262775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73340b4060 0x7f7334144990 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f732c0032f0 tx=0x7f732c0091d0).ready entity=mon.1 client_cookie=608692e744145707 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:21.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f733159a700 1 -- 172.21.15.36:0/3400262775 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f732c00b600 con 0x7f73340b4060 2022-01-10T01:33:21.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f733159a700 1 -- 172.21.15.36:0/3400262775 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732c00b760 con 0x7f73340b4060 2022-01-10T01:33:21.465 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.453+0000 7f733159a700 1 -- 172.21.15.36:0/3400262775 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f732c00b8d0 con 0x7f73340b4060 2022-01-10T01:33:21.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 -- 172.21.15.36:0/3400262775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73340b4060 msgr2=0x7f7334144990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.468 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 --2- 172.21.15.36:0/3400262775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73340b4060 0x7f7334144990 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f732c0032f0 tx=0x7f732c0091d0).stop 2022-01-10T01:33:21.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 -- 172.21.15.36:0/3400262775 shutdown_connections 2022-01-10T01:33:21.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 --2- 172.21.15.36:0/3400262775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73340b4060 0x7f7334144990 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 --2- 172.21.15.36:0/3400262775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7334061b80 0x7f73341444a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 -- 172.21.15.36:0/3400262775 >> 172.21.15.36:0/3400262775 conn(0x7f733405c490 msgr2=0x7f733405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:21.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 -- 172.21.15.36:0/3400262775 shutdown_connections 2022-01-10T01:33:21.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 -- 172.21.15.36:0/3400262775 wait complete. 2022-01-10T01:33:21.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 Processor -- start 2022-01-10T01:33:21.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 -- start start 2022-01-10T01:33:21.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7334061b80 0x7f73340b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73340b4060 0x7f73340af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73340b6430 0x7f73340afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73340b8eb0 con 0x7f7334061b80 2022-01-10T01:33:21.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73340aea40 con 0x7f73340b6430 2022-01-10T01:33:21.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7334145b50 con 0x7f73340b4060 2022-01-10T01:33:21.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.457+0000 7f733259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7334061b80 0x7f73340b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f7331d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73340b4060 0x7f73340af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f733259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7334061b80 0x7f73340b7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41826/0 (socket says 172.21.15.36:41826) 2022-01-10T01:33:21.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f733259c700 1 -- 172.21.15.36:0/1303114972 learned_addr learned my addr 172.21.15.36:0/1303114972 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:21.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f7332d9d700 1 --2- 172.21.15.36:0/1303114972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73340b6430 0x7f73340afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f733259c700 1 -- 172.21.15.36:0/1303114972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73340b4060 msgr2=0x7f73340af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f733259c700 1 --2- 172.21.15.36:0/1303114972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73340b4060 0x7f73340af8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f733259c700 1 -- 172.21.15.36:0/1303114972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73340b6430 msgr2=0x7f73340afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f733259c700 1 --2- 172.21.15.36:0/1303114972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73340b6430 0x7f73340afd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f733259c700 1 -- 172.21.15.36:0/1303114972 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c009470 con 0x7f7334061b80 2022-01-10T01:33:21.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f733259c700 1 --2- 172.21.15.36:0/1303114972 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7334061b80 0x7f73340b7ae0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f7324001110 tx=0x7f7324007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:21.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f73237fe700 1 -- 172.21.15.36:0/1303114972 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f732400ce80 con 0x7f7334061b80 2022-01-10T01:33:21.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f73237fe700 1 -- 172.21.15.36:0/1303114972 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73240070d0 con 0x7f7334061b80 2022-01-10T01:33:21.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f733359e700 1 -- 172.21.15.36:0/1303114972 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7334146410 con 0x7f7334061b80 2022-01-10T01:33:21.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f73237fe700 1 -- 172.21.15.36:0/1303114972 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7324007430 con 0x7f7334061b80 2022-01-10T01:33:21.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f733359e700 1 -- 172.21.15.36:0/1303114972 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7334145da0 con 0x7f7334061b80 2022-01-10T01:33:21.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f733359e700 1 -- 172.21.15.36:0/1303114972 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73340b21a0 con 0x7f7334061b80 2022-01-10T01:33:21.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.461+0000 7f73237fe700 1 -- 172.21.15.36:0/1303114972 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f732401a070 con 0x7f7334061b80 2022-01-10T01:33:21.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.465+0000 7f73237fe700 1 --2- 172.21.15.36:0/1303114972 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73100535f0 0x7f7310055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.465+0000 7f7331d9b700 1 --2- 172.21.15.36:0/1303114972 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73100535f0 0x7f7310055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.465+0000 7f73237fe700 1 -- 172.21.15.36:0/1303114972 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f732406a9c0 con 0x7f7334061b80 2022-01-10T01:33:21.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.465+0000 7f7331d9b700 1 --2- 172.21.15.36:0/1303114972 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73100535f0 0x7f7310055ab0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f732800b000 tx=0x7f7328006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:21.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.469+0000 7f73237fe700 1 -- 172.21.15.36:0/1303114972 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f73240419d0 con 0x7f7334061b80 2022-01-10T01:33:21.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.601+0000 7f733359e700 1 -- 172.21.15.36:0/1303114972 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7334057350 con 0x7f7334061b80 2022-01-10T01:33:21.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.601+0000 7f73237fe700 1 -- 172.21.15.36:0/1303114972 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v139) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7324044ff0 con 0x7f7334061b80 2022-01-10T01:33:21.608 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:33:21.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.601+0000 7f733359e700 1 -- 172.21.15.36:0/1303114972 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73100535f0 msgr2=0x7f7310055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.601+0000 7f733359e700 1 --2- 172.21.15.36:0/1303114972 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73100535f0 0x7f7310055ab0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f732800b000 tx=0x7f7328006df0).stop 2022-01-10T01:33:21.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.601+0000 7f733359e700 1 -- 172.21.15.36:0/1303114972 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7334061b80 msgr2=0x7f73340b7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.601+0000 7f733359e700 1 --2- 172.21.15.36:0/1303114972 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7334061b80 0x7f73340b7ae0 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f7324001110 tx=0x7f7324007aa0).stop 2022-01-10T01:33:21.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.601+0000 7f733359e700 1 -- 172.21.15.36:0/1303114972 shutdown_connections 2022-01-10T01:33:21.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.601+0000 7f733359e700 1 --2- 172.21.15.36:0/1303114972 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73100535f0 0x7f7310055ab0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.601+0000 7f733359e700 1 --2- 172.21.15.36:0/1303114972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73340b6430 0x7f73340afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.601+0000 7f733359e700 1 --2- 172.21.15.36:0/1303114972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73340b4060 0x7f73340af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.601+0000 7f733359e700 1 --2- 172.21.15.36:0/1303114972 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7334061b80 0x7f73340b7ae0 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.601+0000 7f733359e700 1 -- 172.21.15.36:0/1303114972 >> 172.21.15.36:0/1303114972 conn(0x7f733405c490 msgr2=0x7f7334061470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:21.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.605+0000 7f733359e700 1 -- 172.21.15.36:0/1303114972 shutdown_connections 2022-01-10T01:33:21.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.605+0000 7f733359e700 1 -- 172.21.15.36:0/1303114972 wait complete. 2022-01-10T01:33:21.621 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:33:21.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.721+0000 7f9ce1bf7700 1 Processor -- start 2022-01-10T01:33:21.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.721+0000 7f9ce1bf7700 1 -- start start 2022-01-10T01:33:21.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9ce1bf7700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9cdc0af630 0x7f9cdc05f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9ce1bf7700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc141140 con 0x7f9cdc0aed60 2022-01-10T01:33:21.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9ce1bf7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cdc0ac2a0 con 0x7f9cdc060bd0 2022-01-10T01:33:21.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9ce1bf7700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cdc0ac000 con 0x7f9cdc0af630 2022-01-10T01:33:21.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9cdbfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9cdc0af630 0x7f9cdc05f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9cdb7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9cdc0aed60 0x7f9cdc141840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39628/0 (socket says 172.21.15.36:39628) 2022-01-10T01:33:21.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9cdbfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9cdc0af630 0x7f9cdc05f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41838/0 (socket says 172.21.15.36:41838) 2022-01-10T01:33:21.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9cdb7fe700 1 -- 172.21.15.36:0/1532792243 learned_addr learned my addr 172.21.15.36:0/1532792243 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:21.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9cdbfff700 1 -- 172.21.15.36:0/1532792243 >> v1:172.21.15.59:6789/0 conn(0x7f9cdc060bd0 legacy=0x7f9cdc13e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9cda7fc700 1 -- 172.21.15.36:0/1532792243 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520029837 0 0) 0x7f9cdc141140 con 0x7f9cdc0aed60 2022-01-10T01:33:21.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9cdbfff700 1 -- 172.21.15.36:0/1532792243 >> v1:172.21.15.36:6789/0 conn(0x7f9cdc0aed60 legacy=0x7f9cdc141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9cdbfff700 1 -- 172.21.15.36:0/1532792243 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc1413a0 con 0x7f9cdc0af630 2022-01-10T01:33:21.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9cdbfff700 1 --2- 172.21.15.36:0/1532792243 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cdc0af630 0x7f9cdc05f6b0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f9cdc0ac8a0 tx=0x7f9cd4006df0).ready entity=mon.0 client_cookie=8b93b60aeedc9ae5 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:21.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9cda7fc700 1 -- 172.21.15.36:0/1532792243 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cd400d610 con 0x7f9cdc0af630 2022-01-10T01:33:21.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9cda7fc700 1 -- 172.21.15.36:0/1532792243 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd4000e90 con 0x7f9cdc0af630 2022-01-10T01:33:21.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9cda7fc700 1 -- 172.21.15.36:0/1532792243 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cd400d960 con 0x7f9cdc0af630 2022-01-10T01:33:21.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/1532792243 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cdc0af630 msgr2=0x7f9cdc05f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9ce1bf7700 1 --2- 172.21.15.36:0/1532792243 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cdc0af630 0x7f9cdc05f6b0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f9cdc0ac8a0 tx=0x7f9cd4006df0).stop 2022-01-10T01:33:21.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/1532792243 shutdown_connections 2022-01-10T01:33:21.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9ce1bf7700 1 --2- 172.21.15.36:0/1532792243 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cdc0af630 0x7f9cdc05f6b0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/1532792243 >> 172.21.15.36:0/1532792243 conn(0x7f9cdc0b5570 msgr2=0x7f9cdc0b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:21.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/1532792243 shutdown_connections 2022-01-10T01:33:21.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.725+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/1532792243 wait complete. 2022-01-10T01:33:21.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9ce1bf7700 1 Processor -- start 2022-01-10T01:33:21.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9ce1bf7700 1 -- start start 2022-01-10T01:33:21.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9ce1bf7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cdc060bd0 0x7f9cdc13bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9ce1bf7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cdc0aed60 0x7f9cdc1502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9ce1bf7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cdc0af630 0x7f9cdc1507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9ce1bf7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc1397d0 con 0x7f9cdc0af630 2022-01-10T01:33:21.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9ce1bf7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc0653c0 con 0x7f9cdc060bd0 2022-01-10T01:33:21.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9ce1bf7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc065660 con 0x7f9cdc0aed60 2022-01-10T01:33:21.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9cdbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cdc0af630 0x7f9cdc1507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9cdbfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cdc0af630 0x7f9cdc1507e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41844/0 (socket says 172.21.15.36:41844) 2022-01-10T01:33:21.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9cdbfff700 1 -- 172.21.15.36:0/2081926916 learned_addr learned my addr 172.21.15.36:0/2081926916 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:21.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9cdb7fe700 1 --2- 172.21.15.36:0/2081926916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cdc060bd0 0x7f9cdc13bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9cdaffd700 1 --2- 172.21.15.36:0/2081926916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cdc0aed60 0x7f9cdc1502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9cdbfff700 1 -- 172.21.15.36:0/2081926916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cdc0aed60 msgr2=0x7f9cdc1502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9cdbfff700 1 --2- 172.21.15.36:0/2081926916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cdc0aed60 0x7f9cdc1502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9cdbfff700 1 -- 172.21.15.36:0/2081926916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cdc060bd0 msgr2=0x7f9cdc13bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9cdbfff700 1 --2- 172.21.15.36:0/2081926916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cdc060bd0 0x7f9cdc13bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.729+0000 7f9cdbfff700 1 -- 172.21.15.36:0/2081926916 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd400b180 con 0x7f9cdc0af630 2022-01-10T01:33:21.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.733+0000 7f9cdbfff700 1 --2- 172.21.15.36:0/2081926916 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cdc0af630 0x7f9cdc1507e0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f9cdc0ac8a0 tx=0x7f9cd4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:21.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.733+0000 7f9cd8ff9700 1 -- 172.21.15.36:0/2081926916 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cd400bec0 con 0x7f9cdc0af630 2022-01-10T01:33:21.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.733+0000 7f9cd8ff9700 1 -- 172.21.15.36:0/2081926916 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd4011b40 con 0x7f9cdc0af630 2022-01-10T01:33:21.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.733+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/2081926916 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cdc13c450 con 0x7f9cdc0af630 2022-01-10T01:33:21.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.733+0000 7f9cd8ff9700 1 -- 172.21.15.36:0/2081926916 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cd4011ea0 con 0x7f9cdc0af630 2022-01-10T01:33:21.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.733+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/2081926916 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cdc065ca0 con 0x7f9cdc0af630 2022-01-10T01:33:21.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.733+0000 7f9cd8ff9700 1 -- 172.21.15.36:0/2081926916 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9cd4025030 con 0x7f9cdc0af630 2022-01-10T01:33:21.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.733+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/2081926916 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cdc139990 con 0x7f9cdc0af630 2022-01-10T01:33:21.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.733+0000 7f9cd8ff9700 1 --2- 172.21.15.36:0/2081926916 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cc00536b0 0x7f9cc0055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.733+0000 7f9cd8ff9700 1 -- 172.21.15.36:0/2081926916 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9cd406cbb0 con 0x7f9cdc0af630 2022-01-10T01:33:21.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.733+0000 7f9cdb7fe700 1 --2- 172.21.15.36:0/2081926916 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cc00536b0 0x7f9cc0055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:21.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.733+0000 7f9cdb7fe700 1 --2- 172.21.15.36:0/2081926916 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cc00536b0 0x7f9cc0055b70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f9cc400d000 tx=0x7f9cc4007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:21.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.737+0000 7f9cd8ff9700 1 -- 172.21.15.36:0/2081926916 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9cd4073080 con 0x7f9cdc0af630 2022-01-10T01:33:21.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.861+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/2081926916 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9cdc065820 con 0x7f9cdc0af630 2022-01-10T01:33:21.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.865+0000 7f9cd8ff9700 1 -- 172.21.15.36:0/2081926916 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9cd4023070 con 0x7f9cdc0af630 2022-01-10T01:33:21.871 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:21.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.865+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/2081926916 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cc00536b0 msgr2=0x7f9cc0055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.865+0000 7f9ce1bf7700 1 --2- 172.21.15.36:0/2081926916 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cc00536b0 0x7f9cc0055b70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f9cc400d000 tx=0x7f9cc4007a00).stop 2022-01-10T01:33:21.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.865+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/2081926916 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cdc0af630 msgr2=0x7f9cdc1507e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:21.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.865+0000 7f9ce1bf7700 1 --2- 172.21.15.36:0/2081926916 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cdc0af630 0x7f9cdc1507e0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7f9cdc0ac8a0 tx=0x7f9cd4015000).stop 2022-01-10T01:33:21.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.865+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/2081926916 shutdown_connections 2022-01-10T01:33:21.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.865+0000 7f9ce1bf7700 1 --2- 172.21.15.36:0/2081926916 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cc00536b0 0x7f9cc0055b70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.865+0000 7f9ce1bf7700 1 --2- 172.21.15.36:0/2081926916 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9cdc0af630 0x7f9cdc1507e0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.865+0000 7f9ce1bf7700 1 --2- 172.21.15.36:0/2081926916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9cdc0aed60 0x7f9cdc1502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.865+0000 7f9ce1bf7700 1 --2- 172.21.15.36:0/2081926916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cdc060bd0 0x7f9cdc13bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:21.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.865+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/2081926916 >> 172.21.15.36:0/2081926916 conn(0x7f9cdc0b5570 msgr2=0x7f9cdc1403e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:21.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.865+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/2081926916 shutdown_connections 2022-01-10T01:33:21.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.865+0000 7f9ce1bf7700 1 -- 172.21.15.36:0/2081926916 wait complete. 2022-01-10T01:33:21.884 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:33:21.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.989+0000 7f55696aa700 1 Processor -- start 2022-01-10T01:33:21.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.989+0000 7f55696aa700 1 -- start start 2022-01-10T01:33:21.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.989+0000 7f55696aa700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f55640b2580 0x7f556414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f55696aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55640a8ac0 0x7f556414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:21.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f55696aa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55640a70c0 con 0x7f55640b0010 2022-01-10T01:33:21.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f55696aa700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55640a72f0 con 0x7f55640b2580 2022-01-10T01:33:22.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f55696aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55640a7590 con 0x7f55640a8ac0 2022-01-10T01:33:22.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f5563fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f55640b2580 0x7f556414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f5563fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f55640b2580 0x7f556414ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41848/0 (socket says 172.21.15.36:41848) 2022-01-10T01:33:22.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f5563fff700 1 -- 172.21.15.36:0/2364389941 learned_addr learned my addr 172.21.15.36:0/2364389941 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:22.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f5568ea9700 1 --2- 172.21.15.36:0/2364389941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55640a8ac0 0x7f556414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f5563fff700 1 -- 172.21.15.36:0/2364389941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55640a8ac0 msgr2=0x7f556414b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:22.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f5563fff700 1 --2- 172.21.15.36:0/2364389941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55640a8ac0 0x7f556414b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f5562ffd700 1 -- 172.21.15.36:0/2364389941 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302357426 0 0) 0x7f55640a70c0 con 0x7f55640b0010 2022-01-10T01:33:22.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f5563fff700 1 -- 172.21.15.36:0/2364389941 >> v1:172.21.15.59:6789/0 conn(0x7f55640b0010 legacy=0x7f55640a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f5563fff700 1 -- 172.21.15.36:0/2364389941 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55640a7830 con 0x7f55640b2580 2022-01-10T01:33:22.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f5563fff700 1 --2- 172.21.15.36:0/2364389941 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55640b2580 0x7f556414ae40 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f5558002f70 tx=0x7f5558006eb0).ready entity=mon.0 client_cookie=7f60f41ceef33249 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:22.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f5562ffd700 1 -- 172.21.15.36:0/2364389941 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f555800d570 con 0x7f55640b2580 2022-01-10T01:33:22.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f5562ffd700 1 -- 172.21.15.36:0/2364389941 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5558000e90 con 0x7f55640b2580 2022-01-10T01:33:22.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f5562ffd700 1 -- 172.21.15.36:0/2364389941 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f555800d8c0 con 0x7f55640b2580 2022-01-10T01:33:22.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f55696aa700 1 -- 172.21.15.36:0/2364389941 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55640b2580 msgr2=0x7f556414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f55696aa700 1 --2- 172.21.15.36:0/2364389941 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55640b2580 0x7f556414ae40 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f5558002f70 tx=0x7f5558006eb0).stop 2022-01-10T01:33:22.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f55696aa700 1 -- 172.21.15.36:0/2364389941 shutdown_connections 2022-01-10T01:33:22.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f55696aa700 1 --2- 172.21.15.36:0/2364389941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55640a8ac0 0x7f556414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f55696aa700 1 --2- 172.21.15.36:0/2364389941 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55640b2580 0x7f556414ae40 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f55696aa700 1 -- 172.21.15.36:0/2364389941 >> 172.21.15.36:0/2364389941 conn(0x7f5564060180 msgr2=0x7f55640b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:22.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f55696aa700 1 -- 172.21.15.36:0/2364389941 shutdown_connections 2022-01-10T01:33:22.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.993+0000 7f55696aa700 1 -- 172.21.15.36:0/2364389941 wait complete. 2022-01-10T01:33:22.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55696aa700 1 Processor -- start 2022-01-10T01:33:22.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55696aa700 1 -- start start 2022-01-10T01:33:22.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55696aa700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55640a8ac0 0x7f5564156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55696aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55640b0010 0x7f5564064f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55696aa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55640b2580 0x7f55640aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55696aa700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5564066ff0 con 0x7f55640a8ac0 2022-01-10T01:33:22.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55696aa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5564065f50 con 0x7f55640b2580 2022-01-10T01:33:22.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55696aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5564067810 con 0x7f55640b0010 2022-01-10T01:33:22.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f5563fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55640a8ac0 0x7f5564156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f5563fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55640a8ac0 0x7f5564156ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41852/0 (socket says 172.21.15.36:41852) 2022-01-10T01:33:22.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f5563fff700 1 -- 172.21.15.36:0/1305557069 learned_addr learned my addr 172.21.15.36:0/1305557069 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:22.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55637fe700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55640b0010 0x7f5564064f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f5568ea9700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55640b2580 0x7f55640aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f5563fff700 1 -- 172.21.15.36:0/1305557069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55640b0010 msgr2=0x7f5564064f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f5563fff700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55640b0010 0x7f5564064f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f5563fff700 1 -- 172.21.15.36:0/1305557069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55640b2580 msgr2=0x7f55640aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f5563fff700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55640b2580 0x7f55640aa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f5563fff700 1 -- 172.21.15.36:0/1305557069 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555800b1e0 con 0x7f55640a8ac0 2022-01-10T01:33:22.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55637fe700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55640b0010 0x7f5564064f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:22.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f5563fff700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55640a8ac0 0x7f5564156ea0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f5564066090 tx=0x7f5558015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:22.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55617fa700 1 -- 172.21.15.36:0/1305557069 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5558011950 con 0x7f55640a8ac0 2022-01-10T01:33:22.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55617fa700 1 -- 172.21.15.36:0/1305557069 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5558011ab0 con 0x7f55640a8ac0 2022-01-10T01:33:22.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55696aa700 1 -- 172.21.15.36:0/1305557069 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5564067ce0 con 0x7f55640a8ac0 2022-01-10T01:33:22.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55617fa700 1 -- 172.21.15.36:0/1305557069 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5558011e10 con 0x7f55640a8ac0 2022-01-10T01:33:22.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:21.997+0000 7f55696aa700 1 -- 172.21.15.36:0/1305557069 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556411cf30 con 0x7f55640a8ac0 2022-01-10T01:33:22.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.001+0000 7f55617fa700 1 -- 172.21.15.36:0/1305557069 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5558025030 con 0x7f55640a8ac0 2022-01-10T01:33:22.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.001+0000 7f55696aa700 1 -- 172.21.15.36:0/1305557069 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5564067b50 con 0x7f55640a8ac0 2022-01-10T01:33:22.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.001+0000 7f55617fa700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5544053500 0x7f55440559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.001+0000 7f55617fa700 1 -- 172.21.15.36:0/1305557069 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f555806cc50 con 0x7f55640a8ac0 2022-01-10T01:33:22.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.001+0000 7f55637fe700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5544053500 0x7f55440559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.001+0000 7f55637fe700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5544053500 0x7f55440559c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f555400b000 tx=0x7f5554009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:22.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.005+0000 7f55617fa700 1 -- 172.21.15.36:0/1305557069 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5558043c60 con 0x7f55640a8ac0 2022-01-10T01:33:22.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.133+0000 7f55696aa700 1 -- 172.21.15.36:0/1305557069 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5564057350 con 0x7f55640a8ac0 2022-01-10T01:33:22.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.133+0000 7f55617fa700 1 -- 172.21.15.36:0/1305557069 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v139) v1 ==== 104+0+10 (secure 0 0 0) 0x7f55580230a0 con 0x7f55640a8ac0 2022-01-10T01:33:22.141 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:22.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.137+0000 7f55696aa700 1 -- 172.21.15.36:0/1305557069 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5544053500 msgr2=0x7f55440559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.137+0000 7f55696aa700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5544053500 0x7f55440559c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f555400b000 tx=0x7f5554009040).stop 2022-01-10T01:33:22.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.137+0000 7f55696aa700 1 -- 172.21.15.36:0/1305557069 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55640a8ac0 msgr2=0x7f5564156ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.137+0000 7f55696aa700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55640a8ac0 0x7f5564156ea0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f5564066090 tx=0x7f5558015000).stop 2022-01-10T01:33:22.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.137+0000 7f55696aa700 1 -- 172.21.15.36:0/1305557069 shutdown_connections 2022-01-10T01:33:22.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.137+0000 7f55696aa700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5544053500 0x7f55440559c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.137+0000 7f55696aa700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55640b2580 0x7f55640aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.137+0000 7f55696aa700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55640b0010 0x7f5564064f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.137+0000 7f55696aa700 1 --2- 172.21.15.36:0/1305557069 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55640a8ac0 0x7f5564156ea0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.137+0000 7f55696aa700 1 -- 172.21.15.36:0/1305557069 >> 172.21.15.36:0/1305557069 conn(0x7f5564060180 msgr2=0x7f55640af210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:22.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.137+0000 7f55696aa700 1 -- 172.21.15.36:0/1305557069 shutdown_connections 2022-01-10T01:33:22.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.137+0000 7f55696aa700 1 -- 172.21.15.36:0/1305557069 wait complete. 2022-01-10T01:33:22.154 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:33:22.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 Processor -- start 2022-01-10T01:33:22.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 -- start start 2022-01-10T01:33:22.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f43d00b6290 0x7f43d0061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43d0142e60 0x7f43d01432f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d00b5f50 con 0x7f43d00b4060 2022-01-10T01:33:22.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d00b1f70 con 0x7f43d00b6290 2022-01-10T01:33:22.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d00b2210 con 0x7f43d0142e60 2022-01-10T01:33:22.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d5f88700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f43d00b6290 0x7f43d0061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d5787700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f43d00b4060 0x7f43d0061960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39654/0 (socket says 172.21.15.36:39654) 2022-01-10T01:33:22.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d5787700 1 -- 172.21.15.36:0/3995458675 learned_addr learned my addr 172.21.15.36:0/3995458675 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:22.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6789700 1 --2- 172.21.15.36:0/3995458675 >> v2:172.21.15.59:3300/0 conn(0x7f43d0142e60 0x7f43d01432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d4f86700 1 -- 172.21.15.36:0/3995458675 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824374933 0 0) 0x7f43cc001490 con 0x7f43d00b4060 2022-01-10T01:33:22.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d5f88700 1 -- 172.21.15.36:0/3995458675 >> v2:172.21.15.59:3300/0 conn(0x7f43d0142e60 msgr2=0x7f43d01432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:22.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d5f88700 1 --2- 172.21.15.36:0/3995458675 >> v2:172.21.15.59:3300/0 conn(0x7f43d0142e60 0x7f43d01432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d5f88700 1 -- 172.21.15.36:0/3995458675 >> v1:172.21.15.36:6789/0 conn(0x7f43d00b4060 legacy=0x7f43d0061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d5f88700 1 -- 172.21.15.36:0/3995458675 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d00b24b0 con 0x7f43d00b6290 2022-01-10T01:33:22.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6789700 1 --2- 172.21.15.36:0/3995458675 >> v2:172.21.15.59:3300/0 conn(0x7f43d0142e60 0x7f43d01432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:22.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d5f88700 1 --2- 172.21.15.36:0/3995458675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43d00b6290 0x7f43d0061470 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f43c0002f70 tx=0x7f43c0006df0).ready entity=mon.0 client_cookie=2f69ddcb6119f342 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:22.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d4f86700 1 -- 172.21.15.36:0/3995458675 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43c000d5c0 con 0x7f43d00b6290 2022-01-10T01:33:22.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d4f86700 1 -- 172.21.15.36:0/3995458675 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c0000e90 con 0x7f43d00b6290 2022-01-10T01:33:22.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d4f86700 1 -- 172.21.15.36:0/3995458675 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43c000d910 con 0x7f43d00b6290 2022-01-10T01:33:22.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 -- 172.21.15.36:0/3995458675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43d00b6290 msgr2=0x7f43d0061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 --2- 172.21.15.36:0/3995458675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43d00b6290 0x7f43d0061470 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f43c0002f70 tx=0x7f43c0006df0).stop 2022-01-10T01:33:22.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 -- 172.21.15.36:0/3995458675 shutdown_connections 2022-01-10T01:33:22.266 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 --2- 172.21.15.36:0/3995458675 >> v2:172.21.15.59:3300/0 conn(0x7f43d0142e60 0x7f43d01432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 --2- 172.21.15.36:0/3995458675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43d00b6290 0x7f43d0061470 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 -- 172.21.15.36:0/3995458675 >> 172.21.15.36:0/3995458675 conn(0x7f43d005c490 msgr2=0x7f43d005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:22.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 -- 172.21.15.36:0/3995458675 shutdown_connections 2022-01-10T01:33:22.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.253+0000 7f43d6f8a700 1 -- 172.21.15.36:0/3995458675 wait complete. 2022-01-10T01:33:22.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d6f8a700 1 Processor -- start 2022-01-10T01:33:22.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d6f8a700 1 -- start start 2022-01-10T01:33:22.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d6f8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d00b4060 0x7f43d0140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d6f8a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43d00b6290 0x7f43d00b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d6f8a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43d0142e60 0x7f43d00b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d6f8a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d013fec0 con 0x7f43d00b6290 2022-01-10T01:33:22.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d6f8a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d013fc20 con 0x7f43d00b4060 2022-01-10T01:33:22.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d6f8a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d0153070 con 0x7f43d0142e60 2022-01-10T01:33:22.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d5787700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43d00b6290 0x7f43d00b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d5787700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43d00b6290 0x7f43d00b0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41868/0 (socket says 172.21.15.36:41868) 2022-01-10T01:33:22.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d5787700 1 -- 172.21.15.36:0/276288829 learned_addr learned my addr 172.21.15.36:0/276288829 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:22.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d5f88700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d00b4060 0x7f43d0140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d6789700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43d0142e60 0x7f43d00b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d5787700 1 -- 172.21.15.36:0/276288829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43d0142e60 msgr2=0x7f43d00b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d5787700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43d0142e60 0x7f43d00b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d5787700 1 -- 172.21.15.36:0/276288829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d00b4060 msgr2=0x7f43d0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d5787700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d00b4060 0x7f43d0140440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d5787700 1 -- 172.21.15.36:0/276288829 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c000b180 con 0x7f43d00b6290 2022-01-10T01:33:22.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d6789700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43d0142e60 0x7f43d00b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:22.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d5787700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43d00b6290 0x7f43d00b0030 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f43cc001250 tx=0x7f43cc007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:22.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43c6ffd700 1 -- 172.21.15.36:0/276288829 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43cc005b20 con 0x7f43d00b6290 2022-01-10T01:33:22.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43c6ffd700 1 -- 172.21.15.36:0/276288829 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc005c80 con 0x7f43d00b6290 2022-01-10T01:33:22.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d6f8a700 1 -- 172.21.15.36:0/276288829 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d0153310 con 0x7f43d00b6290 2022-01-10T01:33:22.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43c6ffd700 1 -- 172.21.15.36:0/276288829 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43cc0070d0 con 0x7f43d00b6290 2022-01-10T01:33:22.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.257+0000 7f43d6f8a700 1 -- 172.21.15.36:0/276288829 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d0140930 con 0x7f43d00b6290 2022-01-10T01:33:22.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.261+0000 7f43d6f8a700 1 -- 172.21.15.36:0/276288829 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d00adb20 con 0x7f43d00b6290 2022-01-10T01:33:22.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.261+0000 7f43c6ffd700 1 -- 172.21.15.36:0/276288829 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f43cc010070 con 0x7f43d00b6290 2022-01-10T01:33:22.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.261+0000 7f43c6ffd700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43b80536b0 0x7f43b8055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.261+0000 7f43c6ffd700 1 -- 172.21.15.36:0/276288829 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f43cc06b450 con 0x7f43d00b6290 2022-01-10T01:33:22.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.261+0000 7f43d5f88700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43b80536b0 0x7f43b8055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.261+0000 7f43d5f88700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43b80536b0 0x7f43b8055b70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f43c001a000 tx=0x7f43c0014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:22.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.265+0000 7f43c6ffd700 1 -- 172.21.15.36:0/276288829 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f43cc0422d0 con 0x7f43d00b6290 2022-01-10T01:33:22.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.393+0000 7f43d6f8a700 1 -- 172.21.15.36:0/276288829 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f43d00b5f50 con 0x7f43d00b6290 2022-01-10T01:33:22.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.393+0000 7f43c6ffd700 1 -- 172.21.15.36:0/276288829 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v139) v1 ==== 100+0+10 (secure 0 0 0) 0x7f43d00b5f50 con 0x7f43d00b6290 2022-01-10T01:33:22.401 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:22.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.397+0000 7f43d6f8a700 1 -- 172.21.15.36:0/276288829 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43b80536b0 msgr2=0x7f43b8055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.397+0000 7f43d6f8a700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43b80536b0 0x7f43b8055b70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f43c001a000 tx=0x7f43c0014000).stop 2022-01-10T01:33:22.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.397+0000 7f43d6f8a700 1 -- 172.21.15.36:0/276288829 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43d00b6290 msgr2=0x7f43d00b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.397+0000 7f43d6f8a700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43d00b6290 0x7f43d00b0030 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f43cc001250 tx=0x7f43cc007c60).stop 2022-01-10T01:33:22.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.397+0000 7f43d6f8a700 1 -- 172.21.15.36:0/276288829 shutdown_connections 2022-01-10T01:33:22.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.397+0000 7f43d6f8a700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f43b80536b0 0x7f43b8055b70 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.397+0000 7f43d6f8a700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f43d0142e60 0x7f43d00b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.397+0000 7f43d6f8a700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f43d00b6290 0x7f43d00b0030 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.397+0000 7f43d6f8a700 1 --2- 172.21.15.36:0/276288829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d00b4060 0x7f43d0140440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.397+0000 7f43d6f8a700 1 -- 172.21.15.36:0/276288829 >> 172.21.15.36:0/276288829 conn(0x7f43d005c490 msgr2=0x7f43d01422a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:22.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.397+0000 7f43d6f8a700 1 -- 172.21.15.36:0/276288829 shutdown_connections 2022-01-10T01:33:22.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.397+0000 7f43d6f8a700 1 -- 172.21.15.36:0/276288829 wait complete. 2022-01-10T01:33:22.415 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:33:22.415 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:22.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec65833700 1 Processor -- start 2022-01-10T01:33:22.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec65833700 1 -- start start 2022-01-10T01:33:22.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec65833700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fec600b2580 0x7fec6014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec65833700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec600a70c0 con 0x7fec600a8ac0 2022-01-10T01:33:22.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec65833700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec600a72f0 con 0x7fec600b0010 2022-01-10T01:33:22.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec65833700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec600a7590 con 0x7fec600b2580 2022-01-10T01:33:22.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec65032700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fec600a8ac0 0x7fec60151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39672/0 (socket says 172.21.15.36:39672) 2022-01-10T01:33:22.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec65032700 1 -- 172.21.15.36:0/2872489962 learned_addr learned my addr 172.21.15.36:0/2872489962 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:22.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec64831700 1 --2- 172.21.15.36:0/2872489962 >> v2:172.21.15.59:3300/0 conn(0x7fec600b2580 0x7fec6014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec5f7fe700 1 -- 172.21.15.36:0/2872489962 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896630224 0 0) 0x7fec600a70c0 con 0x7fec600a8ac0 2022-01-10T01:33:22.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec5f7fe700 1 -- 172.21.15.36:0/2872489962 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec44003260 con 0x7fec600a8ac0 2022-01-10T01:33:22.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec5f7fe700 1 -- 172.21.15.36:0/2872489962 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768766872 0 0) 0x7fec600a72f0 con 0x7fec600b0010 2022-01-10T01:33:22.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec5f7fe700 1 -- 172.21.15.36:0/2872489962 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec600a70c0 con 0x7fec600b0010 2022-01-10T01:33:22.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec5f7fe700 1 -- 172.21.15.36:0/2872489962 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2484337888 0 0) 0x7fec44003260 con 0x7fec600a8ac0 2022-01-10T01:33:22.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec64831700 1 -- 172.21.15.36:0/2872489962 >> v1:172.21.15.59:6789/0 conn(0x7fec600b0010 legacy=0x7fec600a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec64831700 1 -- 172.21.15.36:0/2872489962 >> v1:172.21.15.36:6789/0 conn(0x7fec600a8ac0 legacy=0x7fec60151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec64831700 1 -- 172.21.15.36:0/2872489962 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec600a7830 con 0x7fec600b2580 2022-01-10T01:33:22.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec64831700 1 --2- 172.21.15.36:0/2872489962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec600b2580 0x7fec6014ae40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fec58001490 tx=0x7fec4c006df0).ready entity=mon.1 client_cookie=24b983230bbb7a16 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:22.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.509+0000 7fec5f7fe700 1 -- 172.21.15.36:0/2872489962 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec580019e0 con 0x7fec600b2580 2022-01-10T01:33:22.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec5f7fe700 1 -- 172.21.15.36:0/2872489962 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4c000e90 con 0x7fec600b2580 2022-01-10T01:33:22.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec5f7fe700 1 -- 172.21.15.36:0/2872489962 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec4c012460 con 0x7fec600b2580 2022-01-10T01:33:22.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 -- 172.21.15.36:0/2872489962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec600b2580 msgr2=0x7fec6014ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 --2- 172.21.15.36:0/2872489962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec600b2580 0x7fec6014ae40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7fec58001490 tx=0x7fec4c006df0).stop 2022-01-10T01:33:22.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 -- 172.21.15.36:0/2872489962 shutdown_connections 2022-01-10T01:33:22.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 --2- 172.21.15.36:0/2872489962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec600b2580 0x7fec6014ae40 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 -- 172.21.15.36:0/2872489962 >> 172.21.15.36:0/2872489962 conn(0x7fec60060180 msgr2=0x7fec600b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:22.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 -- 172.21.15.36:0/2872489962 shutdown_connections 2022-01-10T01:33:22.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 -- 172.21.15.36:0/2872489962 wait complete. 2022-01-10T01:33:22.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 Processor -- start 2022-01-10T01:33:22.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 -- start start 2022-01-10T01:33:22.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec600a8ac0 0x7fec6014aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec600b0010 0x7fec60159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fec600b2580 0x7fec60159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec60063350 con 0x7fec600b2580 2022-01-10T01:33:22.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec60064680 con 0x7fec600b0010 2022-01-10T01:33:22.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65833700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec60149300 con 0x7fec600a8ac0 2022-01-10T01:33:22.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65032700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fec600b2580 0x7fec60159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65032700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fec600b2580 0x7fec60159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41884/0 (socket says 172.21.15.36:41884) 2022-01-10T01:33:22.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec65032700 1 -- 172.21.15.36:0/4138953068 learned_addr learned my addr 172.21.15.36:0/4138953068 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:22.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec5ffff700 1 --2- 172.21.15.36:0/4138953068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec600b0010 0x7fec60159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.513+0000 7fec64831700 1 --2- 172.21.15.36:0/4138953068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec600a8ac0 0x7fec6014aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec65032700 1 -- 172.21.15.36:0/4138953068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec600a8ac0 msgr2=0x7fec6014aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec65032700 1 --2- 172.21.15.36:0/4138953068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec600a8ac0 0x7fec6014aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec65032700 1 -- 172.21.15.36:0/4138953068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec600b0010 msgr2=0x7fec60159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec65032700 1 --2- 172.21.15.36:0/4138953068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec600b0010 0x7fec60159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec65032700 1 -- 172.21.15.36:0/4138953068 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c00b180 con 0x7fec600b2580 2022-01-10T01:33:22.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec65032700 1 --2- 172.21.15.36:0/4138953068 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fec600b2580 0x7fec60159fd0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7fec6014b820 tx=0x7fec58001a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:22.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec5dffb700 1 -- 172.21.15.36:0/4138953068 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec58004ab0 con 0x7fec600b2580 2022-01-10T01:33:22.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec5dffb700 1 -- 172.21.15.36:0/4138953068 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec58004c10 con 0x7fec600b2580 2022-01-10T01:33:22.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec65833700 1 -- 172.21.15.36:0/4138953068 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec601495a0 con 0x7fec600b2580 2022-01-10T01:33:22.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec5dffb700 1 -- 172.21.15.36:0/4138953068 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec58007170 con 0x7fec600b2580 2022-01-10T01:33:22.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec65833700 1 -- 172.21.15.36:0/4138953068 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6014af20 con 0x7fec600b2580 2022-01-10T01:33:22.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec65833700 1 -- 172.21.15.36:0/4138953068 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec60057350 con 0x7fec600b2580 2022-01-10T01:33:22.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec5dffb700 1 -- 172.21.15.36:0/4138953068 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fec580072d0 con 0x7fec600b2580 2022-01-10T01:33:22.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec5dffb700 1 --2- 172.21.15.36:0/4138953068 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fec400535f0 0x7fec40055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:22.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec5dffb700 1 -- 172.21.15.36:0/4138953068 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fec5806b7b0 con 0x7fec600b2580 2022-01-10T01:33:22.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.517+0000 7fec64831700 1 --2- 172.21.15.36:0/4138953068 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fec400535f0 0x7fec40055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:22.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.521+0000 7fec64831700 1 --2- 172.21.15.36:0/4138953068 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fec400535f0 0x7fec40055ab0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fec4c01a000 tx=0x7fec4c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:22.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.525+0000 7fec5dffb700 1 -- 172.21.15.36:0/4138953068 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fec58042720 con 0x7fec600b2580 2022-01-10T01:33:22.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.689+0000 7fec65833700 1 -- 172.21.15.36:0/4138953068 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec600a7a30 con 0x7fec600b2580 2022-01-10T01:33:22.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.689+0000 7fec5dffb700 1 -- 172.21.15.36:0/4138953068 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fec58045d40 con 0x7fec600b2580 2022-01-10T01:33:22.697 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:22.697 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8016,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/2824324236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2824324236},{"type":"v1","addr":"172.21.15.36:6835","nonce":2824324236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1768428808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1768428808},{"type":"v1","addr":"172.21.15.36:6837","nonce":1768428808}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:14.392835+0000","modified":"2022-01-10T01:33:15.396812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8028":{"gid":8028,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3822558856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3822558856},{"type":"v1","addr":"172.21.15.59:6833","nonce":3822558856}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2022-01-10T01:33:22.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.693+0000 7fec65833700 1 -- 172.21.15.36:0/4138953068 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fec400535f0 msgr2=0x7fec40055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.693+0000 7fec65833700 1 --2- 172.21.15.36:0/4138953068 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fec400535f0 0x7fec40055ab0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7fec4c01a000 tx=0x7fec4c014000).stop 2022-01-10T01:33:22.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.693+0000 7fec65833700 1 -- 172.21.15.36:0/4138953068 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fec600b2580 msgr2=0x7fec60159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:22.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.693+0000 7fec65833700 1 --2- 172.21.15.36:0/4138953068 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fec600b2580 0x7fec60159fd0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7fec6014b820 tx=0x7fec58001a20).stop 2022-01-10T01:33:22.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.693+0000 7fec65833700 1 -- 172.21.15.36:0/4138953068 shutdown_connections 2022-01-10T01:33:22.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.693+0000 7fec65833700 1 --2- 172.21.15.36:0/4138953068 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fec400535f0 0x7fec40055ab0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.693+0000 7fec65833700 1 --2- 172.21.15.36:0/4138953068 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fec600b2580 0x7fec60159fd0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.693+0000 7fec65833700 1 --2- 172.21.15.36:0/4138953068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec600b0010 0x7fec60159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.693+0000 7fec65833700 1 --2- 172.21.15.36:0/4138953068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec600a8ac0 0x7fec6014aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:22.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.693+0000 7fec65833700 1 -- 172.21.15.36:0/4138953068 >> 172.21.15.36:0/4138953068 conn(0x7fec60060180 msgr2=0x7fec600ad200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:22.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.693+0000 7fec65833700 1 -- 172.21.15.36:0/4138953068 shutdown_connections 2022-01-10T01:33:22.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:22.693+0000 7fec65833700 1 -- 172.21.15.36:0/4138953068 wait complete. 2022-01-10T01:33:22.702 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 66 2022-01-10T01:33:23.013 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:33:14.392835+0000', 'modified': '2022-01-10T01:33:15.396812+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8028}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8028': {'gid': 8028, 'name': 'b', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/3822558856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 3822558856}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 3822558856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:33:23.013 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:33:23.014 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:33:23.137 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":8028,"want_state":"up:active","state":"up:active","rank_uptime":8.7298453669999994,"mdsmap_epoch":66,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":13.737542845} 2022-01-10T01:33:23.138 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 8028, "mdsmap_epoch": 66, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 8.729845367, "state": "up:active", "uptime": 13.737542845, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:33:23.138 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:33:23.139 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2022-01-10T01:33:23.139 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi166.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2022-01-10T01:33:23.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:23.140 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:23.149 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:33:23.163 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:33:23.163 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:33:23.219 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:33:23.220 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:33:23.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:23.222 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:33:23.227 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:33:23.228 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:23.231 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:33:23.248 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:33:23.249 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:33:23.304 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:2022-01-10T01:33:23.302+0000 7fb36595c080 -1 init, newargv = 0x5618d25dad00 newargc=9 2022-01-10T01:33:23.305 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14619]: starting ceph client 2022-01-10T01:33:23.310 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:33:23.311 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:33:23.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:23.313 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:33:23.316 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14619]: starting fuse 2022-01-10T01:33:23.317 INFO:teuthology.orchestra.run.smithi166.stdout:52 2022-01-10T01:33:23.318 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:33:23.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:23.319 DEBUG:teuthology.orchestra.run.smithi166:> sudo python3 -c ' 2022-01-10T01:33:23.320 DEBUG:teuthology.orchestra.run.smithi166:> import glob 2022-01-10T01:33:23.320 DEBUG:teuthology.orchestra.run.smithi166:> import re 2022-01-10T01:33:23.321 DEBUG:teuthology.orchestra.run.smithi166:> import os 2022-01-10T01:33:23.321 DEBUG:teuthology.orchestra.run.smithi166:> import subprocess 2022-01-10T01:33:23.322 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:33:23.322 DEBUG:teuthology.orchestra.run.smithi166:> def find_socket(client_name): 2022-01-10T01:33:23.323 DEBUG:teuthology.orchestra.run.smithi166:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2022-01-10T01:33:23.323 DEBUG:teuthology.orchestra.run.smithi166:> files = glob.glob(asok_path) 2022-01-10T01:33:23.324 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:33:23.324 DEBUG:teuthology.orchestra.run.smithi166:> # Given a non-glob path, it better be there 2022-01-10T01:33:23.325 DEBUG:teuthology.orchestra.run.smithi166:> if "*" not in asok_path: 2022-01-10T01:33:23.325 DEBUG:teuthology.orchestra.run.smithi166:> assert(len(files) == 1) 2022-01-10T01:33:23.326 DEBUG:teuthology.orchestra.run.smithi166:> return files[0] 2022-01-10T01:33:23.326 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:33:23.327 DEBUG:teuthology.orchestra.run.smithi166:> for f in files: 2022-01-10T01:33:23.327 DEBUG:teuthology.orchestra.run.smithi166:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:33:23.328 DEBUG:teuthology.orchestra.run.smithi166:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:33:23.328 DEBUG:teuthology.orchestra.run.smithi166:> return f 2022-01-10T01:33:23.329 DEBUG:teuthology.orchestra.run.smithi166:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:33:23.329 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:33:23.329 DEBUG:teuthology.orchestra.run.smithi166:> print(find_socket("client.1")) 2022-01-10T01:33:23.330 DEBUG:teuthology.orchestra.run.smithi166:> ' 2022-01-10T01:33:23.369 INFO:teuthology.orchestra.run.smithi166.stdout:/var/run/ceph/ceph-client.1.14619.asok 2022-01-10T01:33:23.373 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14619.asok 2022-01-10T01:33:23.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:23.374 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14619.asok status 2022-01-10T01:33:23.508 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2022-01-10T01:33:23.508 INFO:teuthology.orchestra.run.smithi166.stdout: "metadata": { 2022-01-10T01:33:23.508 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:33:23.508 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:33:23.509 INFO:teuthology.orchestra.run.smithi166.stdout: "entity_id": "1", 2022-01-10T01:33:23.509 INFO:teuthology.orchestra.run.smithi166.stdout: "hostname": "smithi166", 2022-01-10T01:33:23.509 INFO:teuthology.orchestra.run.smithi166.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2022-01-10T01:33:23.509 INFO:teuthology.orchestra.run.smithi166.stdout: "pid": "14619", 2022-01-10T01:33:23.510 INFO:teuthology.orchestra.run.smithi166.stdout: "root": "/" 2022-01-10T01:33:23.510 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:33:23.510 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_count": 0, 2022-01-10T01:33:23.510 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_pinned_count": 0, 2022-01-10T01:33:23.511 INFO:teuthology.orchestra.run.smithi166.stdout: "id": 8226, 2022-01-10T01:33:23.511 INFO:teuthology.orchestra.run.smithi166.stdout: "inst": { 2022-01-10T01:33:23.511 INFO:teuthology.orchestra.run.smithi166.stdout: "name": { 2022-01-10T01:33:23.511 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "client", 2022-01-10T01:33:23.511 INFO:teuthology.orchestra.run.smithi166.stdout: "num": 8226 2022-01-10T01:33:23.512 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:33:23.512 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:33:23.512 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:33:23.512 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:33:23.513 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 2149110254 2022-01-10T01:33:23.513 INFO:teuthology.orchestra.run.smithi166.stdout: } 2022-01-10T01:33:23.513 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:33:23.513 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:33:23.513 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:33:23.514 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:33:23.514 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 2149110254 2022-01-10T01:33:23.514 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:33:23.514 INFO:teuthology.orchestra.run.smithi166.stdout: "inst_str": "client.8226 172.21.15.166:0/2149110254", 2022-01-10T01:33:23.515 INFO:teuthology.orchestra.run.smithi166.stdout: "addr_str": "172.21.15.166:0/2149110254", 2022-01-10T01:33:23.515 INFO:teuthology.orchestra.run.smithi166.stdout: "inode_count": 1, 2022-01-10T01:33:23.515 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_epoch": 66, 2022-01-10T01:33:23.515 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch": 139, 2022-01-10T01:33:23.516 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:33:23.516 INFO:teuthology.orchestra.run.smithi166.stdout: "blacklisted": false, 2022-01-10T01:33:23.516 INFO:teuthology.orchestra.run.smithi166.stdout: "fs_name": "cephfs" 2022-01-10T01:33:23.516 INFO:teuthology.orchestra.run.smithi166.stdout:} 2022-01-10T01:33:23.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:23.518 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:23.519 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:23.526 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:33:23.527 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:33:23.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:23.528 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:23.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:23.544 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:23.544 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:23.593 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:33:23.595 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:33:23.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:23.596 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:23.596 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:23.605 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:33:23.607 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:33:23.607 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi166.front.sepia.ceph.com... 2022-01-10T01:33:23.607 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:33:23.608 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:23.623 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14619]: fuse finished with error 0 and tester_r 0 2022-01-10T01:33:23.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:23.625 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:23.626 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:23.672 INFO:teuthology.orchestra.run.smithi166.stdout:ext2/ext3 2022-01-10T01:33:23.674 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:33:23.674 INFO:teuthology.orchestra.run:waiting for 900 2022-01-10T01:33:23.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:33:23.695 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:23.704 DEBUG:teuthology.orchestra.run.smithi036:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-10T01:33:23.707 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-10T01:33:23.710 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-10T01:33:23.713 DEBUG:teuthology.orchestra.run.smithi166:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-10T01:33:23.750 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2022-01-10T01:33:23.750 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2022-01-10T01:33:23.751 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-10T01:33:23.751 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2022-01-10T01:33:23.751 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.751 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2022-01-10T01:33:23.752 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.752 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2022-01-10T01:33:23.752 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.752 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2022-01-10T01:33:23.752 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2022-01-10T01:33:23.753 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.753 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2022-01-10T01:33:23.753 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2022-01-10T01:33:23.753 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.754 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-10T01:33:23.754 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2022-01-10T01:33:23.754 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.754 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2022-01-10T01:33:23.755 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-10T01:33:23.755 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.755 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2022-01-10T01:33:23.755 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.756 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2022-01-10T01:33:23.756 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2022-01-10T01:33:23.756 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2022-01-10T01:33:23.756 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2022-01-10T01:33:23.756 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2022-01-10T01:33:23.757 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2022-01-10T01:33:23.757 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2022-01-10T01:33:23.757 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-10T01:33:23.757 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-10T01:33:23.758 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.758 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-10T01:33:23.758 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.758 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2022-01-10T01:33:23.758 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.759 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2022-01-10T01:33:23.759 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.759 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2022-01-10T01:33:23.759 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2022-01-10T01:33:23.760 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2022-01-10T01:33:23.761 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = "172.21.15.36,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2022-01-10T01:33:23.761 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762 2022-01-10T01:33:23.761 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.762 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2022-01-10T01:33:23.762 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2022-01-10T01:33:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2022-01-10T01:33:23.763 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2022-01-10T01:33:23.764 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.764 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2022-01-10T01:33:23.764 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2022-01-10T01:33:23.764 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.764 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2022-01-10T01:33:23.765 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2022-01-10T01:33:23.765 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2022-01-10T01:33:23.765 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.765 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2022-01-10T01:33:23.765 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2022-01-10T01:33:23.766 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.766 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2022-01-10T01:33:23.766 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.766 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2022-01-10T01:33:23.767 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.767 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2022-01-10T01:33:23.767 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.767 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2022-01-10T01:33:23.767 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2022-01-10T01:33:23.768 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.768 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2022-01-10T01:33:23.768 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2022-01-10T01:33:23.768 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore block size = 96636764160 2022-01-10T01:33:23.769 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore compression mode = aggressive 2022-01-10T01:33:23.769 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore fsck on mount = True 2022-01-10T01:33:23.769 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluefs = 20 2022-01-10T01:33:23.769 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluestore = 20 2022-01-10T01:33:23.769 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:33:23.770 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2022-01-10T01:33:23.770 INFO:teuthology.orchestra.run.smithi139.stdout: debug rocksdb = 10 2022-01-10T01:33:23.770 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd backfillfull_ratio = 0.85 2022-01-10T01:33:23.770 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd full ratio = 0.9 2022-01-10T01:33:23.770 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd nearfull ratio = 0.8 2022-01-10T01:33:23.771 INFO:teuthology.orchestra.run.smithi139.stdout: osd failsafe full ratio = 0.95 2022-01-10T01:33:23.771 INFO:teuthology.orchestra.run.smithi139.stdout: osd objectstore = bluestore 2022-01-10T01:33:23.771 INFO:teuthology.orchestra.run.smithi139.stdout: osd op complaint time = 180 2022-01-10T01:33:23.771 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.772 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2022-01-10T01:33:23.772 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:33:23.772 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2022-01-10T01:33:23.772 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2022-01-10T01:33:23.772 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2022-01-10T01:33:23.773 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:23.773 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:23.773 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2022-01-10T01:33:23.773 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.774 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2022-01-10T01:33:23.774 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:33:23.774 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2022-01-10T01:33:23.774 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2022-01-10T01:33:23.775 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2022-01-10T01:33:23.775 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2022-01-10T01:33:23.775 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2022-01-10T01:33:23.775 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:23.775 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2022-01-10T01:33:23.776 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2022-01-10T01:33:23.776 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:23.776 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.776 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-10T01:33:23.776 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2022-01-10T01:33:23.777 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2022-01-10T01:33:23.777 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.777 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2022-01-10T01:33:23.777 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-10T01:33:23.778 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-10T01:33:23.778 INFO:teuthology.orchestra.run.smithi139.stdout: mon op complaint time = 120 2022-01-10T01:33:23.778 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:23.778 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2022-01-10T01:33:23.778 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2022-01-10T01:33:23.779 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2022-01-10T01:33:23.779 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2022-01-10T01:33:23.779 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-10T01:33:23.779 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-10T01:33:23.779 INFO:teuthology.orchestra.run.smithi139.stdout: client mount timeout = 600 2022-01-10T01:33:23.780 INFO:teuthology.orchestra.run.smithi139.stdout: debug client = 20 2022-01-10T01:33:23.780 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:33:23.780 INFO:teuthology.orchestra.run.smithi139.stdout: rados mon op timeout = 15m 2022-01-10T01:33:23.780 INFO:teuthology.orchestra.run.smithi139.stdout: rados osd op timeout = 15m 2022-01-10T01:33:23.781 INFO:teuthology.orchestra.run.smithi139.stdout: client debug getattr caps = true 2022-01-10T01:33:23.781 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2022-01-10T01:33:23.781 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.b] 2022-01-10T01:33:23.781 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.c] 2022-01-10T01:33:23.781 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2022-01-10T01:33:23.782 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.c] 2022-01-10T01:33:23.782 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2022-01-10T01:33:23.782 INFO:teuthology.orchestra.run.smithi139.stdout:[mds] 2022-01-10T01:33:23.783 INFO:teuthology.orchestra.run.smithi139.stdout: debug mds = 20 2022-01-10T01:33:23.783 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:33:23.783 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal frag = True 2022-01-10T01:33:23.784 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal fragment size max = 10000 2022-01-10T01:33:23.784 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal merge size = 5 2022-01-10T01:33:23.784 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal split bits = 3 2022-01-10T01:33:23.784 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal split size = 100 2022-01-10T01:33:23.784 INFO:teuthology.orchestra.run.smithi139.stdout: mds debug frag = True 2022-01-10T01:33:23.785 INFO:teuthology.orchestra.run.smithi139.stdout: mds debug scatterstat = True 2022-01-10T01:33:23.785 INFO:teuthology.orchestra.run.smithi139.stdout: mds op complaint time = 180 2022-01-10T01:33:23.785 INFO:teuthology.orchestra.run.smithi139.stdout: mds verify scatter = True 2022-01-10T01:33:23.785 INFO:teuthology.orchestra.run.smithi139.stdout: osd op complaint time = 180 2022-01-10T01:33:23.786 INFO:teuthology.orchestra.run.smithi139.stdout: rados mon op timeout = 15m 2022-01-10T01:33:23.786 INFO:teuthology.orchestra.run.smithi139.stdout: rados osd op timeout = 15m 2022-01-10T01:33:23.786 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2022-01-10T01:33:23.787 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2022-01-10T01:33:23.787 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-10T01:33:23.787 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2022-01-10T01:33:23.787 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.787 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2022-01-10T01:33:23.788 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.788 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2022-01-10T01:33:23.788 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.788 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2022-01-10T01:33:23.789 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2022-01-10T01:33:23.789 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.789 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2022-01-10T01:33:23.789 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2022-01-10T01:33:23.789 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.790 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-10T01:33:23.790 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2022-01-10T01:33:23.790 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.790 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2022-01-10T01:33:23.791 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-10T01:33:23.791 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.791 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2022-01-10T01:33:23.791 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.792 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2022-01-10T01:33:23.792 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2022-01-10T01:33:23.792 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2022-01-10T01:33:23.792 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2022-01-10T01:33:23.792 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2022-01-10T01:33:23.793 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2022-01-10T01:33:23.793 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2022-01-10T01:33:23.793 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-10T01:33:23.793 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-10T01:33:23.793 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.794 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-10T01:33:23.794 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.794 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2022-01-10T01:33:23.794 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.795 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2022-01-10T01:33:23.795 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.795 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2022-01-10T01:33:23.795 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2022-01-10T01:33:23.795 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2022-01-10T01:33:23.796 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.36,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2022-01-10T01:33:23.796 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762 2022-01-10T01:33:23.796 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.796 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2022-01-10T01:33:23.797 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2022-01-10T01:33:23.797 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.797 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2022-01-10T01:33:23.797 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2022-01-10T01:33:23.797 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.798 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2022-01-10T01:33:23.798 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2022-01-10T01:33:23.798 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.798 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2022-01-10T01:33:23.799 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2022-01-10T01:33:23.799 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2022-01-10T01:33:23.799 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.799 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2022-01-10T01:33:23.800 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2022-01-10T01:33:23.800 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.800 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2022-01-10T01:33:23.800 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.800 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2022-01-10T01:33:23.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.801 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2022-01-10T01:33:23.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.801 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2022-01-10T01:33:23.802 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2022-01-10T01:33:23.802 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.802 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2022-01-10T01:33:23.802 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2022-01-10T01:33:23.802 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2022-01-10T01:33:23.803 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore compression mode = aggressive 2022-01-10T01:33:23.803 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2022-01-10T01:33:23.803 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 20 2022-01-10T01:33:23.803 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 20 2022-01-10T01:33:23.803 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:33:23.804 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2022-01-10T01:33:23.804 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 10 2022-01-10T01:33:23.804 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2022-01-10T01:33:23.804 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2022-01-10T01:33:23.805 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2022-01-10T01:33:23.805 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2022-01-10T01:33:23.805 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2022-01-10T01:33:23.805 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2022-01-10T01:33:23.805 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.806 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2022-01-10T01:33:23.806 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:33:23.806 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2022-01-10T01:33:23.806 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2022-01-10T01:33:23.807 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2022-01-10T01:33:23.807 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:23.807 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:23.807 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2022-01-10T01:33:23.807 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.808 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2022-01-10T01:33:23.808 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:33:23.808 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2022-01-10T01:33:23.808 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2022-01-10T01:33:23.808 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2022-01-10T01:33:23.809 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2022-01-10T01:33:23.809 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2022-01-10T01:33:23.809 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:23.809 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2022-01-10T01:33:23.809 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2022-01-10T01:33:23.810 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:23.810 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.810 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-10T01:33:23.810 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2022-01-10T01:33:23.811 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2022-01-10T01:33:23.811 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.811 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2022-01-10T01:33:23.811 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-10T01:33:23.811 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-10T01:33:23.812 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2022-01-10T01:33:23.812 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:23.812 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2022-01-10T01:33:23.812 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2022-01-10T01:33:23.812 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2022-01-10T01:33:23.813 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2022-01-10T01:33:23.813 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-10T01:33:23.813 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-10T01:33:23.813 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2022-01-10T01:33:23.814 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2022-01-10T01:33:23.814 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:33:23.814 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 15m 2022-01-10T01:33:23.814 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 15m 2022-01-10T01:33:23.815 INFO:teuthology.orchestra.run.smithi059.stdout: client debug getattr caps = true 2022-01-10T01:33:23.815 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2022-01-10T01:33:23.815 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2022-01-10T01:33:23.815 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2022-01-10T01:33:23.815 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2022-01-10T01:33:23.816 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2022-01-10T01:33:23.816 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2022-01-10T01:33:23.816 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2022-01-10T01:33:23.816 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2022-01-10T01:33:23.816 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:33:23.817 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal frag = True 2022-01-10T01:33:23.817 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal fragment size max = 10000 2022-01-10T01:33:23.817 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal merge size = 5 2022-01-10T01:33:23.817 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal split bits = 3 2022-01-10T01:33:23.818 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal split size = 100 2022-01-10T01:33:23.818 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2022-01-10T01:33:23.818 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = True 2022-01-10T01:33:23.818 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2022-01-10T01:33:23.819 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = True 2022-01-10T01:33:23.819 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2022-01-10T01:33:23.819 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 15m 2022-01-10T01:33:23.819 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 15m 2022-01-10T01:33:23.820 INFO:teuthology.orchestra.run.smithi036.stdout:[global] 2022-01-10T01:33:23.820 INFO:teuthology.orchestra.run.smithi036.stdout: chdir = "" 2022-01-10T01:33:23.820 INFO:teuthology.orchestra.run.smithi036.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-10T01:33:23.820 INFO:teuthology.orchestra.run.smithi036.stdout: auth supported = cephx 2022-01-10T01:33:23.821 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.821 INFO:teuthology.orchestra.run.smithi036.stdout: filestore xattr use omap = true 2022-01-10T01:33:23.821 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.821 INFO:teuthology.orchestra.run.smithi036.stdout: mon clock drift allowed = 1.000 2022-01-10T01:33:23.821 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.822 INFO:teuthology.orchestra.run.smithi036.stdout: osd crush chooseleaf type = 0 2022-01-10T01:33:23.822 INFO:teuthology.orchestra.run.smithi036.stdout: auth debug = true 2022-01-10T01:33:23.822 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.823 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on old message = true 2022-01-10T01:33:23.823 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on bug = true 2022-01-10T01:33:23.823 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.823 INFO:teuthology.orchestra.run.smithi036.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-10T01:33:23.823 INFO:teuthology.orchestra.run.smithi036.stdout: mon pg warn max object skew = 0 2022-01-10T01:33:23.824 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.824 INFO:teuthology.orchestra.run.smithi036.stdout: # disable pg_autoscaler by default for new pools 2022-01-10T01:33:23.824 INFO:teuthology.orchestra.run.smithi036.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-10T01:33:23.824 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.825 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default size = 2 2022-01-10T01:33:23.825 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.825 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow primary affinity = true 2022-01-10T01:33:23.825 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow pg remap = true 2022-01-10T01:33:23.826 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on legacy crush tunables = false 2022-01-10T01:33:23.826 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on crush straw calc version zero = false 2022-01-10T01:33:23.826 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on no sortbitwise = false 2022-01-10T01:33:23.826 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on osd down out interval zero = false 2022-01-10T01:33:23.827 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on too few osds = false 2022-01-10T01:33:23.827 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-10T01:33:23.827 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-10T01:33:23.827 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.827 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-10T01:33:23.828 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.828 INFO:teuthology.orchestra.run.smithi036.stdout: osd default data pool replay window = 5 2022-01-10T01:33:23.828 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.828 INFO:teuthology.orchestra.run.smithi036.stdout: mon allow pool delete = true 2022-01-10T01:33:23.829 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.829 INFO:teuthology.orchestra.run.smithi036.stdout: mon cluster log file level = debug 2022-01-10T01:33:23.829 INFO:teuthology.orchestra.run.smithi036.stdout: debug asserts on shutdown = true 2022-01-10T01:33:23.829 INFO:teuthology.orchestra.run.smithi036.stdout: mon health detail to clog = false 2022-01-10T01:33:23.829 INFO:teuthology.orchestra.run.smithi036.stdout: mon host = "172.21.15.36,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2022-01-10T01:33:23.830 INFO:teuthology.orchestra.run.smithi036.stdout: fsid = 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762 2022-01-10T01:33:23.830 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.830 INFO:teuthology.orchestra.run.smithi036.stdout:[osd] 2022-01-10T01:33:23.830 INFO:teuthology.orchestra.run.smithi036.stdout: osd journal size = 100 2022-01-10T01:33:23.830 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.831 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub load threshold = 5.0 2022-01-10T01:33:23.831 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub max interval = 600 2022-01-10T01:33:23.831 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.831 INFO:teuthology.orchestra.run.smithi036.stdout: osd recover clone overlap = true 2022-01-10T01:33:23.832 INFO:teuthology.orchestra.run.smithi036.stdout: osd recovery max chunk = 1048576 2022-01-10T01:33:23.832 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.832 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug shutdown = true 2022-01-10T01:33:23.832 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug op order = true 2022-01-10T01:33:23.833 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug verify stray on activate = true 2022-01-10T01:33:23.833 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.833 INFO:teuthology.orchestra.run.smithi036.stdout: osd open classes on start = true 2022-01-10T01:33:23.833 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug pg log writeout = true 2022-01-10T01:33:23.834 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.834 INFO:teuthology.orchestra.run.smithi036.stdout: osd deep scrub update digest min age = 30 2022-01-10T01:33:23.834 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.834 INFO:teuthology.orchestra.run.smithi036.stdout: osd map max advance = 10 2022-01-10T01:33:23.835 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.835 INFO:teuthology.orchestra.run.smithi036.stdout: journal zero on create = true 2022-01-10T01:33:23.835 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.835 INFO:teuthology.orchestra.run.smithi036.stdout: filestore ondisk finisher threads = 3 2022-01-10T01:33:23.835 INFO:teuthology.orchestra.run.smithi036.stdout: filestore apply finisher threads = 3 2022-01-10T01:33:23.836 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.836 INFO:teuthology.orchestra.run.smithi036.stdout: bdev debug aio = true 2022-01-10T01:33:23.836 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug misdirected ops = true 2022-01-10T01:33:23.836 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore block size = 96636764160 2022-01-10T01:33:23.837 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore compression mode = aggressive 2022-01-10T01:33:23.837 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore fsck on mount = True 2022-01-10T01:33:23.837 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluefs = 20 2022-01-10T01:33:23.837 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluestore = 20 2022-01-10T01:33:23.838 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:33:23.838 INFO:teuthology.orchestra.run.smithi036.stdout: debug osd = 20 2022-01-10T01:33:23.838 INFO:teuthology.orchestra.run.smithi036.stdout: debug rocksdb = 10 2022-01-10T01:33:23.838 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd backfillfull_ratio = 0.85 2022-01-10T01:33:23.839 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd full ratio = 0.9 2022-01-10T01:33:23.839 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd nearfull ratio = 0.8 2022-01-10T01:33:23.839 INFO:teuthology.orchestra.run.smithi036.stdout: osd failsafe full ratio = 0.95 2022-01-10T01:33:23.839 INFO:teuthology.orchestra.run.smithi036.stdout: osd objectstore = bluestore 2022-01-10T01:33:23.839 INFO:teuthology.orchestra.run.smithi036.stdout: osd op complaint time = 180 2022-01-10T01:33:23.840 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.840 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr] 2022-01-10T01:33:23.840 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:33:23.840 INFO:teuthology.orchestra.run.smithi036.stdout: debug mgr = 20 2022-01-10T01:33:23.841 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2022-01-10T01:33:23.841 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2022-01-10T01:33:23.841 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:23.841 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:23.841 INFO:teuthology.orchestra.run.smithi036.stdout: mgr/telemetry/nag = false 2022-01-10T01:33:23.842 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.842 INFO:teuthology.orchestra.run.smithi036.stdout:[mon] 2022-01-10T01:33:23.842 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:33:23.842 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2022-01-10T01:33:23.842 INFO:teuthology.orchestra.run.smithi036.stdout: debug paxos = 20 2022-01-10T01:33:23.843 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2022-01-10T01:33:23.843 INFO:teuthology.orchestra.run.smithi036.stdout: mon data avail warn = 5 2022-01-10T01:33:23.843 INFO:teuthology.orchestra.run.smithi036.stdout: mon mgr mkfs grace = 240 2022-01-10T01:33:23.843 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:23.843 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd reporter subtree level = osd 2022-01-10T01:33:23.844 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd prime pg temp = true 2022-01-10T01:33:23.844 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:23.844 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.844 INFO:teuthology.orchestra.run.smithi036.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-10T01:33:23.844 INFO:teuthology.orchestra.run.smithi036.stdout: auth mon ticket ttl = 660 # 11m 2022-01-10T01:33:23.845 INFO:teuthology.orchestra.run.smithi036.stdout: auth service ticket ttl = 240 # 4m 2022-01-10T01:33:23.845 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.845 INFO:teuthology.orchestra.run.smithi036.stdout: # don't complain about insecure global_id in the test suite 2022-01-10T01:33:23.845 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-10T01:33:23.846 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-10T01:33:23.846 INFO:teuthology.orchestra.run.smithi036.stdout: mon op complaint time = 120 2022-01-10T01:33:23.846 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:23.846 INFO:teuthology.orchestra.run.smithi036.stdout:[client] 2022-01-10T01:33:23.846 INFO:teuthology.orchestra.run.smithi036.stdout: rgw cache enabled = true 2022-01-10T01:33:23.847 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable ops log = true 2022-01-10T01:33:23.847 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable usage log = true 2022-01-10T01:33:23.847 INFO:teuthology.orchestra.run.smithi036.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-10T01:33:23.847 INFO:teuthology.orchestra.run.smithi036.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-10T01:33:23.847 INFO:teuthology.orchestra.run.smithi036.stdout: client mount timeout = 600 2022-01-10T01:33:23.848 INFO:teuthology.orchestra.run.smithi036.stdout: debug client = 20 2022-01-10T01:33:23.848 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:33:23.848 INFO:teuthology.orchestra.run.smithi036.stdout: rados mon op timeout = 15m 2022-01-10T01:33:23.848 INFO:teuthology.orchestra.run.smithi036.stdout: rados osd op timeout = 15m 2022-01-10T01:33:23.849 INFO:teuthology.orchestra.run.smithi036.stdout: client debug getattr caps = true 2022-01-10T01:33:23.849 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.a] 2022-01-10T01:33:23.849 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.b] 2022-01-10T01:33:23.849 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.c] 2022-01-10T01:33:23.849 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.a] 2022-01-10T01:33:23.850 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.c] 2022-01-10T01:33:23.850 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.b] 2022-01-10T01:33:23.850 INFO:teuthology.orchestra.run.smithi036.stdout:[mds] 2022-01-10T01:33:23.850 INFO:teuthology.orchestra.run.smithi036.stdout: debug mds = 20 2022-01-10T01:33:23.850 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:33:23.851 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal frag = True 2022-01-10T01:33:23.851 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal fragment size max = 10000 2022-01-10T01:33:23.851 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal merge size = 5 2022-01-10T01:33:23.851 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal split bits = 3 2022-01-10T01:33:23.852 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal split size = 100 2022-01-10T01:33:23.852 INFO:teuthology.orchestra.run.smithi036.stdout: mds debug frag = True 2022-01-10T01:33:23.852 INFO:teuthology.orchestra.run.smithi036.stdout: mds debug scatterstat = True 2022-01-10T01:33:23.852 INFO:teuthology.orchestra.run.smithi036.stdout: mds op complaint time = 180 2022-01-10T01:33:23.852 INFO:teuthology.orchestra.run.smithi036.stdout: mds verify scatter = True 2022-01-10T01:33:23.853 INFO:teuthology.orchestra.run.smithi036.stdout: osd op complaint time = 180 2022-01-10T01:33:23.853 INFO:teuthology.orchestra.run.smithi036.stdout: rados mon op timeout = 15m 2022-01-10T01:33:23.853 INFO:teuthology.orchestra.run.smithi036.stdout: rados osd op timeout = 15m 2022-01-10T01:33:23.856 INFO:teuthology.orchestra.run.smithi166.stdout:[global] 2022-01-10T01:33:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: chdir = "" 2022-01-10T01:33:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-10T01:33:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: auth supported = cephx 2022-01-10T01:33:23.857 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: filestore xattr use omap = true 2022-01-10T01:33:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: mon clock drift allowed = 1.000 2022-01-10T01:33:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.858 INFO:teuthology.orchestra.run.smithi166.stdout: osd crush chooseleaf type = 0 2022-01-10T01:33:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: auth debug = true 2022-01-10T01:33:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.859 INFO:teuthology.orchestra.run.smithi166.stdout: ms die on old message = true 2022-01-10T01:33:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: ms die on bug = true 2022-01-10T01:33:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-10T01:33:23.860 INFO:teuthology.orchestra.run.smithi166.stdout: mon pg warn max object skew = 0 2022-01-10T01:33:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: # disable pg_autoscaler by default for new pools 2022-01-10T01:33:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-10T01:33:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.861 INFO:teuthology.orchestra.run.smithi166.stdout: osd pool default size = 2 2022-01-10T01:33:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd allow primary affinity = true 2022-01-10T01:33:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd allow pg remap = true 2022-01-10T01:33:23.862 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on legacy crush tunables = false 2022-01-10T01:33:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on crush straw calc version zero = false 2022-01-10T01:33:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on no sortbitwise = false 2022-01-10T01:33:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on osd down out interval zero = false 2022-01-10T01:33:23.863 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on too few osds = false 2022-01-10T01:33:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-10T01:33:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-10T01:33:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.864 INFO:teuthology.orchestra.run.smithi166.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-10T01:33:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: osd default data pool replay window = 5 2022-01-10T01:33:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.865 INFO:teuthology.orchestra.run.smithi166.stdout: mon allow pool delete = true 2022-01-10T01:33:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: mon cluster log file level = debug 2022-01-10T01:33:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: debug asserts on shutdown = true 2022-01-10T01:33:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: mon health detail to clog = false 2022-01-10T01:33:23.866 INFO:teuthology.orchestra.run.smithi166.stdout: mon host = "172.21.15.36,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2022-01-10T01:33:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: fsid = 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762 2022-01-10T01:33:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.867 INFO:teuthology.orchestra.run.smithi166.stdout:[osd] 2022-01-10T01:33:23.867 INFO:teuthology.orchestra.run.smithi166.stdout: osd journal size = 100 2022-01-10T01:33:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: osd scrub load threshold = 5.0 2022-01-10T01:33:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: osd scrub max interval = 600 2022-01-10T01:33:23.868 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: osd recover clone overlap = true 2022-01-10T01:33:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: osd recovery max chunk = 1048576 2022-01-10T01:33:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.869 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug shutdown = true 2022-01-10T01:33:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug op order = true 2022-01-10T01:33:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug verify stray on activate = true 2022-01-10T01:33:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: osd open classes on start = true 2022-01-10T01:33:23.870 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug pg log writeout = true 2022-01-10T01:33:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: osd deep scrub update digest min age = 30 2022-01-10T01:33:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.871 INFO:teuthology.orchestra.run.smithi166.stdout: osd map max advance = 10 2022-01-10T01:33:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: journal zero on create = true 2022-01-10T01:33:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.872 INFO:teuthology.orchestra.run.smithi166.stdout: filestore ondisk finisher threads = 3 2022-01-10T01:33:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: filestore apply finisher threads = 3 2022-01-10T01:33:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: bdev debug aio = true 2022-01-10T01:33:23.873 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug misdirected ops = true 2022-01-10T01:33:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore block size = 96636764160 2022-01-10T01:33:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore compression mode = aggressive 2022-01-10T01:33:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore fsck on mount = True 2022-01-10T01:33:23.874 INFO:teuthology.orchestra.run.smithi166.stdout: debug bluefs = 20 2022-01-10T01:33:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: debug bluestore = 20 2022-01-10T01:33:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:33:23.875 INFO:teuthology.orchestra.run.smithi166.stdout: debug osd = 20 2022-01-10T01:33:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: debug rocksdb = 10 2022-01-10T01:33:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd backfillfull_ratio = 0.85 2022-01-10T01:33:23.876 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd full ratio = 0.9 2022-01-10T01:33:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd nearfull ratio = 0.8 2022-01-10T01:33:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: osd failsafe full ratio = 0.95 2022-01-10T01:33:23.877 INFO:teuthology.orchestra.run.smithi166.stdout: osd objectstore = bluestore 2022-01-10T01:33:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: osd op complaint time = 180 2022-01-10T01:33:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.878 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr] 2022-01-10T01:33:23.878 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:33:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: debug mgr = 20 2022-01-10T01:33:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: debug mon = 20 2022-01-10T01:33:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: debug auth = 20 2022-01-10T01:33:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:23.879 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: mgr/telemetry/nag = false 2022-01-10T01:33:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.880 INFO:teuthology.orchestra.run.smithi166.stdout:[mon] 2022-01-10T01:33:23.880 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:33:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: debug mon = 20 2022-01-10T01:33:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: debug paxos = 20 2022-01-10T01:33:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: debug auth = 20 2022-01-10T01:33:23.881 INFO:teuthology.orchestra.run.smithi166.stdout: mon data avail warn = 5 2022-01-10T01:33:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: mon mgr mkfs grace = 240 2022-01-10T01:33:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd reporter subtree level = osd 2022-01-10T01:33:23.882 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd prime pg temp = true 2022-01-10T01:33:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-10T01:33:23.883 INFO:teuthology.orchestra.run.smithi166.stdout: auth mon ticket ttl = 660 # 11m 2022-01-10T01:33:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: auth service ticket ttl = 240 # 4m 2022-01-10T01:33:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.884 INFO:teuthology.orchestra.run.smithi166.stdout: # don't complain about insecure global_id in the test suite 2022-01-10T01:33:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-10T01:33:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-10T01:33:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: mon op complaint time = 120 2022-01-10T01:33:23.885 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:23.886 INFO:teuthology.orchestra.run.smithi166.stdout:[client] 2022-01-10T01:33:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: rgw cache enabled = true 2022-01-10T01:33:23.886 INFO:teuthology.orchestra.run.smithi166.stdout: rgw enable ops log = true 2022-01-10T01:33:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: rgw enable usage log = true 2022-01-10T01:33:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-10T01:33:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-10T01:33:23.887 INFO:teuthology.orchestra.run.smithi166.stdout: client mount timeout = 600 2022-01-10T01:33:23.888 INFO:teuthology.orchestra.run.smithi166.stdout: debug client = 20 2022-01-10T01:33:23.888 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:33:23.888 INFO:teuthology.orchestra.run.smithi166.stdout: rados mon op timeout = 15m 2022-01-10T01:33:23.888 INFO:teuthology.orchestra.run.smithi166.stdout: rados osd op timeout = 15m 2022-01-10T01:33:23.888 INFO:teuthology.orchestra.run.smithi166.stdout: client debug getattr caps = true 2022-01-10T01:33:23.889 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.a] 2022-01-10T01:33:23.889 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.b] 2022-01-10T01:33:23.889 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.c] 2022-01-10T01:33:23.889 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.a] 2022-01-10T01:33:23.890 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.c] 2022-01-10T01:33:23.890 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.b] 2022-01-10T01:33:23.890 INFO:teuthology.orchestra.run.smithi166.stdout:[mds] 2022-01-10T01:33:23.890 INFO:teuthology.orchestra.run.smithi166.stdout: debug mds = 20 2022-01-10T01:33:23.890 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:33:23.891 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal frag = True 2022-01-10T01:33:23.891 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal fragment size max = 10000 2022-01-10T01:33:23.891 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal merge size = 5 2022-01-10T01:33:23.891 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal split bits = 3 2022-01-10T01:33:23.892 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal split size = 100 2022-01-10T01:33:23.892 INFO:teuthology.orchestra.run.smithi166.stdout: mds debug frag = True 2022-01-10T01:33:23.892 INFO:teuthology.orchestra.run.smithi166.stdout: mds debug scatterstat = True 2022-01-10T01:33:23.892 INFO:teuthology.orchestra.run.smithi166.stdout: mds op complaint time = 180 2022-01-10T01:33:23.893 INFO:teuthology.orchestra.run.smithi166.stdout: mds verify scatter = True 2022-01-10T01:33:23.893 INFO:teuthology.orchestra.run.smithi166.stdout: osd op complaint time = 180 2022-01-10T01:33:23.893 INFO:teuthology.orchestra.run.smithi166.stdout: rados mon op timeout = 15m 2022-01-10T01:33:23.893 INFO:teuthology.orchestra.run.smithi166.stdout: rados osd op timeout = 15m 2022-01-10T01:33:23.894 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:33:24.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:23.997+0000 7f535d7ff700 1 Processor -- start 2022-01-10T01:33:24.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:23.997+0000 7f535d7ff700 1 -- start start 2022-01-10T01:33:24.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:23.997+0000 7f535d7ff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f53580b6510 0x7f5358143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:23.997+0000 7f535d7ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53580b4b40 0x7f53580b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:23.997+0000 7f535d7ff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53580b68f0 con 0x7f53581402f0 2022-01-10T01:33:24.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:23.997+0000 7f535d7ff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5358143fb0 con 0x7f53580b6510 2022-01-10T01:33:24.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:23.997+0000 7f535d7ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53580ae660 con 0x7f53580b4b40 2022-01-10T01:33:24.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f53577fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f53581402f0 0x7f5358140760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39682/0 (socket says 172.21.15.36:39682) 2022-01-10T01:33:24.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f53577fe700 1 -- 172.21.15.36:0/3207703812 learned_addr learned my addr 172.21.15.36:0/3207703812 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:24.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f535cffe700 1 --2- 172.21.15.36:0/3207703812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53580b4b40 0x7f53580b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f5357fff700 1 --2- 172.21.15.36:0/3207703812 >> v2:172.21.15.59:3300/0 conn(0x7f53580b6510 0x7f5358143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f5356ffd700 1 -- 172.21.15.36:0/3207703812 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524338402 0 0) 0x7f53580b68f0 con 0x7f53581402f0 2022-01-10T01:33:24.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f5356ffd700 1 -- 172.21.15.36:0/3207703812 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5344003260 con 0x7f53581402f0 2022-01-10T01:33:24.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f535cffe700 1 -- 172.21.15.36:0/3207703812 >> v2:172.21.15.59:3300/0 conn(0x7f53580b6510 msgr2=0x7f5358143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:24.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f5356ffd700 1 -- 172.21.15.36:0/3207703812 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2082903619 0 0) 0x7f5344003260 con 0x7f53581402f0 2022-01-10T01:33:24.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f535cffe700 1 --2- 172.21.15.36:0/3207703812 >> v2:172.21.15.59:3300/0 conn(0x7f53580b6510 0x7f5358143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f535cffe700 1 -- 172.21.15.36:0/3207703812 >> v1:172.21.15.36:6789/0 conn(0x7f53581402f0 legacy=0x7f5358140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f535cffe700 1 -- 172.21.15.36:0/3207703812 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53580ae900 con 0x7f53580b4b40 2022-01-10T01:33:24.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f535cffe700 1 --2- 172.21.15.36:0/3207703812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53580b4b40 0x7f53580b4fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f5348001800 tx=0x7f53500091d0).ready entity=mon.2 client_cookie=968163e637883a0e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:24.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f5356ffd700 1 -- 172.21.15.36:0/3207703812 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5348001660 con 0x7f53580b4b40 2022-01-10T01:33:24.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f5356ffd700 1 -- 172.21.15.36:0/3207703812 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535000f510 con 0x7f53580b4b40 2022-01-10T01:33:24.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f5356ffd700 1 -- 172.21.15.36:0/3207703812 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f535000f680 con 0x7f53580b4b40 2022-01-10T01:33:24.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f535d7ff700 1 -- 172.21.15.36:0/3207703812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53580b4b40 msgr2=0x7f53580b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f535d7ff700 1 --2- 172.21.15.36:0/3207703812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53580b4b40 0x7f53580b4fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f5348001800 tx=0x7f53500091d0).stop 2022-01-10T01:33:24.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f535d7ff700 1 -- 172.21.15.36:0/3207703812 shutdown_connections 2022-01-10T01:33:24.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f535d7ff700 1 --2- 172.21.15.36:0/3207703812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53580b4b40 0x7f53580b4fb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f535d7ff700 1 --2- 172.21.15.36:0/3207703812 >> v2:172.21.15.59:3300/0 conn(0x7f53580b6510 0x7f5358143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f535d7ff700 1 -- 172.21.15.36:0/3207703812 >> 172.21.15.36:0/3207703812 conn(0x7f535805f8c0 msgr2=0x7f53580614b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:24.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f535d7ff700 1 -- 172.21.15.36:0/3207703812 shutdown_connections 2022-01-10T01:33:24.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.001+0000 7f535d7ff700 1 -- 172.21.15.36:0/3207703812 wait complete. 2022-01-10T01:33:24.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.005+0000 7f535d7ff700 1 Processor -- start 2022-01-10T01:33:24.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.005+0000 7f535d7ff700 1 -- start start 2022-01-10T01:33:24.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.005+0000 7f535d7ff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53580b4b40 0x7f5358149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.005+0000 7f535d7ff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f53580b6510 0x7f5358146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.005+0000 7f535d7ff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53581402f0 0x7f5358147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.005+0000 7f535d7ff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5358147f30 con 0x7f53580b6510 2022-01-10T01:33:24.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.005+0000 7f535d7ff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5358153220 con 0x7f53581402f0 2022-01-10T01:33:24.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.005+0000 7f535d7ff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5358152f80 con 0x7f53580b4b40 2022-01-10T01:33:24.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f53577fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f53580b6510 0x7f5358146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f53577fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f53580b6510 0x7f5358146f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41896/0 (socket says 172.21.15.36:41896) 2022-01-10T01:33:24.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f53577fe700 1 -- 172.21.15.36:0/178797425 learned_addr learned my addr 172.21.15.36:0/178797425 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:24.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f5357fff700 1 --2- 172.21.15.36:0/178797425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53580b4b40 0x7f5358149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f535cffe700 1 --2- 172.21.15.36:0/178797425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53581402f0 0x7f5358147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f53577fe700 1 -- 172.21.15.36:0/178797425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53580b4b40 msgr2=0x7f5358149020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f53577fe700 1 --2- 172.21.15.36:0/178797425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53580b4b40 0x7f5358149020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f53577fe700 1 -- 172.21.15.36:0/178797425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53581402f0 msgr2=0x7f5358147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f53577fe700 1 --2- 172.21.15.36:0/178797425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53581402f0 0x7f5358147440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f53577fe700 1 -- 172.21.15.36:0/178797425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5350009470 con 0x7f53580b6510 2022-01-10T01:33:24.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f53577fe700 1 --2- 172.21.15.36:0/178797425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f53580b6510 0x7f5358146f50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f53480018c0 tx=0x7f53480011a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:24.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f53557fa700 1 -- 172.21.15.36:0/178797425 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5348007170 con 0x7f53580b6510 2022-01-10T01:33:24.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f53557fa700 1 -- 172.21.15.36:0/178797425 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53480072d0 con 0x7f53580b6510 2022-01-10T01:33:24.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f535d7ff700 1 -- 172.21.15.36:0/178797425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5358146810 con 0x7f53580b6510 2022-01-10T01:33:24.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f53557fa700 1 -- 172.21.15.36:0/178797425 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5348004920 con 0x7f53580b6510 2022-01-10T01:33:24.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f535d7ff700 1 -- 172.21.15.36:0/178797425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53580b3b20 con 0x7f53580b6510 2022-01-10T01:33:24.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f535d7ff700 1 -- 172.21.15.36:0/178797425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5358153850 con 0x7f53580b6510 2022-01-10T01:33:24.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.009+0000 7f53557fa700 1 -- 172.21.15.36:0/178797425 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5348004a80 con 0x7f53580b6510 2022-01-10T01:33:24.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.013+0000 7f53557fa700 1 --2- 172.21.15.36:0/178797425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f53380536b0 0x7f5338055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.013+0000 7f5357fff700 1 --2- 172.21.15.36:0/178797425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f53380536b0 0x7f5338055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.013+0000 7f53557fa700 1 -- 172.21.15.36:0/178797425 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f534806b610 con 0x7f53580b6510 2022-01-10T01:33:24.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.013+0000 7f5357fff700 1 --2- 172.21.15.36:0/178797425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f53380536b0 0x7f5338055b70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f534c00b000 tx=0x7f534c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:24.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.017+0000 7f53557fa700 1 -- 172.21.15.36:0/178797425 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5348042620 con 0x7f53580b6510 2022-01-10T01:33:24.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.149+0000 7f535d7ff700 1 -- 172.21.15.36:0/178797425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53580aeba0 con 0x7f53580b6510 2022-01-10T01:33:24.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.149+0000 7f53557fa700 1 -- 172.21.15.36:0/178797425 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f5348001b40 con 0x7f53580b6510 2022-01-10T01:33:24.158 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:24.158 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":139,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:33:15.396927+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:33:12.182921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2022-01-10T01:33:13.414645+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:33:24.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.153+0000 7f535d7ff700 1 -- 172.21.15.36:0/178797425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f53380536b0 msgr2=0x7f5338055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.153+0000 7f535d7ff700 1 --2- 172.21.15.36:0/178797425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f53380536b0 0x7f5338055b70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f534c00b000 tx=0x7f534c006df0).stop 2022-01-10T01:33:24.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.153+0000 7f535d7ff700 1 -- 172.21.15.36:0/178797425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f53580b6510 msgr2=0x7f5358146f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.153+0000 7f535d7ff700 1 --2- 172.21.15.36:0/178797425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f53580b6510 0x7f5358146f50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f53480018c0 tx=0x7f53480011a0).stop 2022-01-10T01:33:24.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.153+0000 7f535d7ff700 1 -- 172.21.15.36:0/178797425 shutdown_connections 2022-01-10T01:33:24.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.153+0000 7f535d7ff700 1 --2- 172.21.15.36:0/178797425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f53380536b0 0x7f5338055b70 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.153+0000 7f535d7ff700 1 --2- 172.21.15.36:0/178797425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53581402f0 0x7f5358147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.153+0000 7f535d7ff700 1 --2- 172.21.15.36:0/178797425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f53580b6510 0x7f5358146f50 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.153+0000 7f535d7ff700 1 --2- 172.21.15.36:0/178797425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53580b4b40 0x7f5358149020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.153+0000 7f535d7ff700 1 -- 172.21.15.36:0/178797425 >> 172.21.15.36:0/178797425 conn(0x7f535805f8c0 msgr2=0x7f5358142f30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:24.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.153+0000 7f535d7ff700 1 -- 172.21.15.36:0/178797425 shutdown_connections 2022-01-10T01:33:24.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.153+0000 7f535d7ff700 1 -- 172.21.15.36:0/178797425 wait complete. 2022-01-10T01:33:24.170 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:33:12.182921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:33:13.414645+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:33:24.171 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:33:24.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc4594cf700 1 Processor -- start 2022-01-10T01:33:24.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc4594cf700 1 -- start start 2022-01-10T01:33:24.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc4594cf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc45414b4e0 0x7fc4540ade70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc4594cf700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45405fdd0 con 0x7fc4540b1530 2022-01-10T01:33:24.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc4594cf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45414ab00 con 0x7fc45405f9f0 2022-01-10T01:33:24.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc4594cf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4540ae360 con 0x7fc45414b4e0 2022-01-10T01:33:24.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc4537fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fc4540b1530 0x7fc4540ad760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39700/0 (socket says 172.21.15.36:39700) 2022-01-10T01:33:24.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc4537fe700 1 -- 172.21.15.36:0/3169840501 learned_addr learned my addr 172.21.15.36:0/3169840501 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:24.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc458cce700 1 --2- 172.21.15.36:0/3169840501 >> v2:172.21.15.59:3300/0 conn(0x7fc45414b4e0 0x7fc4540ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612843441 0 0) 0x7fc45405fdd0 con 0x7fc4540b1530 2022-01-10T01:33:24.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc434003260 con 0x7fc4540b1530 2022-01-10T01:33:24.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850436950 0 0) 0x7fc45414ab00 con 0x7fc45405f9f0 2022-01-10T01:33:24.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc45405fdd0 con 0x7fc45405f9f0 2022-01-10T01:33:24.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1782057216 0 0) 0x7fc434003260 con 0x7fc4540b1530 2022-01-10T01:33:24.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 >> v2:172.21.15.59:3300/0 conn(0x7fc45414b4e0 msgr2=0x7fc4540ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:24.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc452ffd700 1 --2- 172.21.15.36:0/3169840501 >> v2:172.21.15.59:3300/0 conn(0x7fc45414b4e0 0x7fc4540ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 >> v1:172.21.15.59:6789/0 conn(0x7fc45405f9f0 legacy=0x7fc4541473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45414ada0 con 0x7fc4540b1530 2022-01-10T01:33:24.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7fc444001960 con 0x7fc4540b1530 2022-01-10T01:33:24.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.277+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 >> v1:172.21.15.36:6789/0 conn(0x7fc4540b1530 legacy=0x7fc4540ad760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc452ffd700 1 --2- 172.21.15.36:0/3169840501 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc434003930 0x7fc434003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc452ffd700 1 --2- 172.21.15.36:0/3169840501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc434004500 0x7fc434004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc452ffd700 1 --2- 172.21.15.36:0/3169840501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434004e70 0x7fc43400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540ae360 con 0x7fc434003930 2022-01-10T01:33:24.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43400bd20 con 0x7fc434004500 2022-01-10T01:33:24.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43400bee0 con 0x7fc434004e70 2022-01-10T01:33:24.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc453fff700 1 --2- 172.21.15.36:0/3169840501 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc434003930 0x7fc434003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4537fe700 1 --2- 172.21.15.36:0/3169840501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc434004500 0x7fc434004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc453fff700 1 -- 172.21.15.36:0/3169840501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434004e70 msgr2=0x7fc43400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:24.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc458cce700 1 --2- 172.21.15.36:0/3169840501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434004e70 0x7fc43400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc453fff700 1 --2- 172.21.15.36:0/3169840501 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434004e70 0x7fc43400b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc453fff700 1 -- 172.21.15.36:0/3169840501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc434004500 msgr2=0x7fc434004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:24.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc453fff700 1 --2- 172.21.15.36:0/3169840501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc434004500 0x7fc434004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc453fff700 1 -- 172.21.15.36:0/3169840501 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc434003260 con 0x7fc434003930 2022-01-10T01:33:24.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc458cce700 1 -- 172.21.15.36:0/3169840501 reap_dead start 2022-01-10T01:33:24.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4537fe700 1 --2- 172.21.15.36:0/3169840501 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc434004500 0x7fc434004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:24.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc453fff700 1 --2- 172.21.15.36:0/3169840501 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc434003930 0x7fc434003d30 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7fc43c001110 tx=0x7fc43c007a00).ready entity=mon.0 client_cookie=5fc4f4b1f8273a49 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:24.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc43c007d10 con 0x7fc434003930 2022-01-10T01:33:24.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43c007030 con 0x7fc434003930 2022-01-10T01:33:24.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc452ffd700 1 -- 172.21.15.36:0/3169840501 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc43c007390 con 0x7fc434003930 2022-01-10T01:33:24.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 -- 172.21.15.36:0/3169840501 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc434003930 msgr2=0x7fc434003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 --2- 172.21.15.36:0/3169840501 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc434003930 0x7fc434003d30 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7fc43c001110 tx=0x7fc43c007a00).stop 2022-01-10T01:33:24.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 -- 172.21.15.36:0/3169840501 shutdown_connections 2022-01-10T01:33:24.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 --2- 172.21.15.36:0/3169840501 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc434003930 0x7fc434003d30 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 -- 172.21.15.36:0/3169840501 >> 172.21.15.36:0/3169840501 conn(0x7fc4540b5360 msgr2=0x7fc4540b5770 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:24.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 -- 172.21.15.36:0/3169840501 shutdown_connections 2022-01-10T01:33:24.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 -- 172.21.15.36:0/3169840501 wait complete. 2022-01-10T01:33:24.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 Processor -- start 2022-01-10T01:33:24.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 -- start start 2022-01-10T01:33:24.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434003930 0x7fc454063aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc454067070 0x7fc4540aad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4540ab200 0x7fc454146080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc454065a80 con 0x7fc454067070 2022-01-10T01:33:24.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540aa330 con 0x7fc4540ab200 2022-01-10T01:33:24.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.281+0000 7fc4594cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540aa5d0 con 0x7fc434003930 2022-01-10T01:33:24.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4537fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc454067070 0x7fc4540aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4537fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc454067070 0x7fc4540aad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41916/0 (socket says 172.21.15.36:41916) 2022-01-10T01:33:24.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4537fe700 1 -- 172.21.15.36:0/2238857489 learned_addr learned my addr 172.21.15.36:0/2238857489 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:24.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc458cce700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4540ab200 0x7fc454146080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc453fff700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434003930 0x7fc454063aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4537fe700 1 -- 172.21.15.36:0/2238857489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434003930 msgr2=0x7fc454063aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4537fe700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434003930 0x7fc454063aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4537fe700 1 -- 172.21.15.36:0/2238857489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4540ab200 msgr2=0x7fc454146080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4537fe700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4540ab200 0x7fc454146080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4537fe700 1 -- 172.21.15.36:0/2238857489 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4540aa870 con 0x7fc454067070 2022-01-10T01:33:24.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc453fff700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434003930 0x7fc454063aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:24.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4537fe700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc454067070 0x7fc4540aad10 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7fc44400b000 tx=0x7fc45414ac90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:24.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4517fa700 1 -- 172.21.15.36:0/2238857489 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4440107e0 con 0x7fc454067070 2022-01-10T01:33:24.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4517fa700 1 -- 172.21.15.36:0/2238857489 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc444010940 con 0x7fc454067070 2022-01-10T01:33:24.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4594cf700 1 -- 172.21.15.36:0/2238857489 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45405cd50 con 0x7fc454067070 2022-01-10T01:33:24.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4517fa700 1 -- 172.21.15.36:0/2238857489 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc444010ca0 con 0x7fc454067070 2022-01-10T01:33:24.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4594cf700 1 -- 172.21.15.36:0/2238857489 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc454063500 con 0x7fc454067070 2022-01-10T01:33:24.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4517fa700 1 -- 172.21.15.36:0/2238857489 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc444014430 con 0x7fc454067070 2022-01-10T01:33:24.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4594cf700 1 -- 172.21.15.36:0/2238857489 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4540ab9f0 con 0x7fc454067070 2022-01-10T01:33:24.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4517fa700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc438053680 0x7fc438055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc4517fa700 1 -- 172.21.15.36:0/2238857489 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc44406c290 con 0x7fc454067070 2022-01-10T01:33:24.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.285+0000 7fc453fff700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc438053680 0x7fc438055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.289+0000 7fc453fff700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc438053680 0x7fc438055b40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fc43c019000 tx=0x7fc43c016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:24.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.293+0000 7fc4517fa700 1 -- 172.21.15.36:0/2238857489 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc444043240 con 0x7fc454067070 2022-01-10T01:33:24.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.413+0000 7fc4594cf700 1 -- 172.21.15.36:0/2238857489 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc4540aaa00 con 0x7fc454067070 2022-01-10T01:33:24.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.413+0000 7fc4517fa700 1 -- 172.21.15.36:0/2238857489 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v139) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc444010e00 con 0x7fc454067070 2022-01-10T01:33:24.422 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:33:24.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.417+0000 7fc4594cf700 1 -- 172.21.15.36:0/2238857489 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc438053680 msgr2=0x7fc438055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.417+0000 7fc4594cf700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc438053680 0x7fc438055b40 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fc43c019000 tx=0x7fc43c016000).stop 2022-01-10T01:33:24.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.417+0000 7fc4594cf700 1 -- 172.21.15.36:0/2238857489 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc454067070 msgr2=0x7fc4540aad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.417+0000 7fc4594cf700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc454067070 0x7fc4540aad10 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7fc44400b000 tx=0x7fc45414ac90).stop 2022-01-10T01:33:24.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.417+0000 7fc4594cf700 1 -- 172.21.15.36:0/2238857489 shutdown_connections 2022-01-10T01:33:24.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.417+0000 7fc4594cf700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc438053680 0x7fc438055b40 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.417+0000 7fc4594cf700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4540ab200 0x7fc454146080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.417+0000 7fc4594cf700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc454067070 0x7fc4540aad10 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.417+0000 7fc4594cf700 1 --2- 172.21.15.36:0/2238857489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc434003930 0x7fc454063aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.417+0000 7fc4594cf700 1 -- 172.21.15.36:0/2238857489 >> 172.21.15.36:0/2238857489 conn(0x7fc4540b5360 msgr2=0x7fc4540b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:24.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.417+0000 7fc4594cf700 1 -- 172.21.15.36:0/2238857489 shutdown_connections 2022-01-10T01:33:24.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.417+0000 7fc4594cf700 1 -- 172.21.15.36:0/2238857489 wait complete. 2022-01-10T01:33:24.435 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:33:24.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.541+0000 7f0e4ee70700 1 Processor -- start 2022-01-10T01:33:24.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.541+0000 7f0e4ee70700 1 -- start start 2022-01-10T01:33:24.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4ee70700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0e480b9bd0 0x7f0e480b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4ee70700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e4813d2d0 0x7f0e481468a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4ee70700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4813d710 con 0x7f0e480b5130 2022-01-10T01:33:24.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4ee70700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e480b9fb0 con 0x7f0e480b9bd0 2022-01-10T01:33:24.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4ee70700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e480b69e0 con 0x7f0e4813d2d0 2022-01-10T01:33:24.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4cc0c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0e480b9bd0 0x7f0e480b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4cc0c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0e480b9bd0 0x7f0e480b5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41922/0 (socket says 172.21.15.36:41922) 2022-01-10T01:33:24.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4cc0c700 1 -- 172.21.15.36:0/28554314 learned_addr learned my addr 172.21.15.36:0/28554314 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:24.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4d40d700 1 --2- 172.21.15.36:0/28554314 >> v2:172.21.15.59:3300/0 conn(0x7f0e4813d2d0 0x7f0e481468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4cc0c700 1 -- 172.21.15.36:0/28554314 >> v2:172.21.15.59:3300/0 conn(0x7f0e4813d2d0 msgr2=0x7f0e481468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:24.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4cc0c700 1 --2- 172.21.15.36:0/28554314 >> v2:172.21.15.59:3300/0 conn(0x7f0e4813d2d0 0x7f0e481468a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4cc0c700 1 -- 172.21.15.36:0/28554314 >> v1:172.21.15.59:6789/0 conn(0x7f0e480b5130 legacy=0x7f0e4813cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e477fe700 1 -- 172.21.15.36:0/28554314 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662808244 0 0) 0x7f0e4813d710 con 0x7f0e480b5130 2022-01-10T01:33:24.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4cc0c700 1 -- 172.21.15.36:0/28554314 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e480b6c80 con 0x7f0e480b9bd0 2022-01-10T01:33:24.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4cc0c700 1 --2- 172.21.15.36:0/28554314 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e480b9bd0 0x7f0e480b5c60 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f0e30002f70 tx=0x7f0e30006eb0).ready entity=mon.0 client_cookie=9194dbe0c18e12ea server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:24.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e477fe700 1 -- 172.21.15.36:0/28554314 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e3000d5c0 con 0x7f0e480b9bd0 2022-01-10T01:33:24.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e477fe700 1 -- 172.21.15.36:0/28554314 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e30000e90 con 0x7f0e480b9bd0 2022-01-10T01:33:24.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e477fe700 1 -- 172.21.15.36:0/28554314 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e3000d910 con 0x7f0e480b9bd0 2022-01-10T01:33:24.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4ee70700 1 -- 172.21.15.36:0/28554314 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e480b9bd0 msgr2=0x7f0e480b5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4ee70700 1 --2- 172.21.15.36:0/28554314 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e480b9bd0 0x7f0e480b5c60 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f0e30002f70 tx=0x7f0e30006eb0).stop 2022-01-10T01:33:24.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4ee70700 1 -- 172.21.15.36:0/28554314 shutdown_connections 2022-01-10T01:33:24.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4ee70700 1 --2- 172.21.15.36:0/28554314 >> v2:172.21.15.59:3300/0 conn(0x7f0e4813d2d0 0x7f0e481468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4ee70700 1 --2- 172.21.15.36:0/28554314 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e480b9bd0 0x7f0e480b5c60 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4ee70700 1 -- 172.21.15.36:0/28554314 >> 172.21.15.36:0/28554314 conn(0x7f0e4805f960 msgr2=0x7f0e480616a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:24.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4ee70700 1 -- 172.21.15.36:0/28554314 shutdown_connections 2022-01-10T01:33:24.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.545+0000 7f0e4ee70700 1 -- 172.21.15.36:0/28554314 wait complete. 2022-01-10T01:33:24.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4ee70700 1 Processor -- start 2022-01-10T01:33:24.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4ee70700 1 -- start start 2022-01-10T01:33:24.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4ee70700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e480b5130 0x7f0e48142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4ee70700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e480b9bd0 0x7f0e481352c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4ee70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e4813d2d0 0x7f0e481357b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4ee70700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e480b5d30 con 0x7f0e480b5130 2022-01-10T01:33:24.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4ee70700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4805ad30 con 0x7f0e480b9bd0 2022-01-10T01:33:24.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4ee70700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4813a670 con 0x7f0e4813d2d0 2022-01-10T01:33:24.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4cc0c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e480b5130 0x7f0e48142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4cc0c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e480b5130 0x7f0e48142770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41928/0 (socket says 172.21.15.36:41928) 2022-01-10T01:33:24.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4cc0c700 1 -- 172.21.15.36:0/2831177176 learned_addr learned my addr 172.21.15.36:0/2831177176 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:24.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4d40d700 1 --2- 172.21.15.36:0/2831177176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e4813d2d0 0x7f0e481357b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e47fff700 1 --2- 172.21.15.36:0/2831177176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e480b9bd0 0x7f0e481352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4cc0c700 1 -- 172.21.15.36:0/2831177176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e4813d2d0 msgr2=0x7f0e481357b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4cc0c700 1 --2- 172.21.15.36:0/2831177176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e4813d2d0 0x7f0e481357b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4cc0c700 1 -- 172.21.15.36:0/2831177176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e480b9bd0 msgr2=0x7f0e481352c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4cc0c700 1 --2- 172.21.15.36:0/2831177176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e480b9bd0 0x7f0e481352c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.549+0000 7f0e4cc0c700 1 -- 172.21.15.36:0/2831177176 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3000b1e0 con 0x7f0e480b5130 2022-01-10T01:33:24.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.553+0000 7f0e4cc0c700 1 --2- 172.21.15.36:0/2831177176 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e480b5130 0x7f0e48142770 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f0e30002f70 tx=0x7f0e30015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:24.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.553+0000 7f0e45ffb700 1 -- 172.21.15.36:0/2831177176 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e300068b0 con 0x7f0e480b5130 2022-01-10T01:33:24.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.553+0000 7f0e45ffb700 1 -- 172.21.15.36:0/2831177176 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3000d960 con 0x7f0e480b5130 2022-01-10T01:33:24.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.553+0000 7f0e4ee70700 1 -- 172.21.15.36:0/2831177176 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4813b180 con 0x7f0e480b5130 2022-01-10T01:33:24.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.553+0000 7f0e45ffb700 1 -- 172.21.15.36:0/2831177176 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0e30011d70 con 0x7f0e480b5130 2022-01-10T01:33:24.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.553+0000 7f0e4ee70700 1 -- 172.21.15.36:0/2831177176 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4813a8a0 con 0x7f0e480b5130 2022-01-10T01:33:24.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.553+0000 7f0e4ee70700 1 -- 172.21.15.36:0/2831177176 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4813b550 con 0x7f0e480b5130 2022-01-10T01:33:24.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.553+0000 7f0e45ffb700 1 -- 172.21.15.36:0/2831177176 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0e30025030 con 0x7f0e480b5130 2022-01-10T01:33:24.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.553+0000 7f0e45ffb700 1 --2- 172.21.15.36:0/2831177176 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e2c0535f0 0x7f0e2c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.557+0000 7f0e45ffb700 1 -- 172.21.15.36:0/2831177176 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0e3006caa0 con 0x7f0e480b5130 2022-01-10T01:33:24.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.557+0000 7f0e47fff700 1 --2- 172.21.15.36:0/2831177176 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e2c0535f0 0x7f0e2c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.557+0000 7f0e47fff700 1 --2- 172.21.15.36:0/2831177176 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e2c0535f0 0x7f0e2c055ab0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f0e3800d000 tx=0x7f0e38007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:24.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.561+0000 7f0e45ffb700 1 -- 172.21.15.36:0/2831177176 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0e30043ab0 con 0x7f0e480b5130 2022-01-10T01:33:24.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.689+0000 7f0e4ee70700 1 -- 172.21.15.36:0/2831177176 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0e480b6f20 con 0x7f0e480b5130 2022-01-10T01:33:24.696 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.689+0000 7f0e45ffb700 1 -- 172.21.15.36:0/2831177176 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0e30023020 con 0x7f0e480b5130 2022-01-10T01:33:24.697 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:24.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.693+0000 7f0e4ee70700 1 -- 172.21.15.36:0/2831177176 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e2c0535f0 msgr2=0x7f0e2c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.693+0000 7f0e4ee70700 1 --2- 172.21.15.36:0/2831177176 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e2c0535f0 0x7f0e2c055ab0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f0e3800d000 tx=0x7f0e38007b90).stop 2022-01-10T01:33:24.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.693+0000 7f0e4ee70700 1 -- 172.21.15.36:0/2831177176 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e480b5130 msgr2=0x7f0e48142770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.699 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.693+0000 7f0e4ee70700 1 --2- 172.21.15.36:0/2831177176 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e480b5130 0x7f0e48142770 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f0e30002f70 tx=0x7f0e30015000).stop 2022-01-10T01:33:24.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.693+0000 7f0e4ee70700 1 -- 172.21.15.36:0/2831177176 shutdown_connections 2022-01-10T01:33:24.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.693+0000 7f0e4ee70700 1 --2- 172.21.15.36:0/2831177176 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0e2c0535f0 0x7f0e2c055ab0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.693+0000 7f0e4ee70700 1 --2- 172.21.15.36:0/2831177176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e4813d2d0 0x7f0e481357b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.693+0000 7f0e4ee70700 1 --2- 172.21.15.36:0/2831177176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e480b9bd0 0x7f0e481352c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.693+0000 7f0e4ee70700 1 --2- 172.21.15.36:0/2831177176 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0e480b5130 0x7f0e48142770 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.693+0000 7f0e4ee70700 1 -- 172.21.15.36:0/2831177176 >> 172.21.15.36:0/2831177176 conn(0x7f0e4805f960 msgr2=0x7f0e48143ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:24.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.693+0000 7f0e4ee70700 1 -- 172.21.15.36:0/2831177176 shutdown_connections 2022-01-10T01:33:24.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.693+0000 7f0e4ee70700 1 -- 172.21.15.36:0/2831177176 wait complete. 2022-01-10T01:33:24.710 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:33:24.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.817+0000 7fb16a690700 1 Processor -- start 2022-01-10T01:33:24.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.817+0000 7fb16a690700 1 -- start start 2022-01-10T01:33:24.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb16405cce0 0x7fb16405d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb1640b1ff0 0x7fb164147020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb164067240 0x7fb16413cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1640aebc0 con 0x7fb16405cce0 2022-01-10T01:33:24.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb164146640 con 0x7fb1640b1ff0 2022-01-10T01:33:24.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1641468e0 con 0x7fb164067240 2022-01-10T01:33:24.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16968e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb16405cce0 0x7fb16405d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16968e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb16405cce0 0x7fb16405d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41936/0 (socket says 172.21.15.36:41936) 2022-01-10T01:33:24.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16968e700 1 -- 172.21.15.36:0/4198019110 learned_addr learned my addr 172.21.15.36:0/4198019110 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:24.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb168e8d700 1 --2- 172.21.15.36:0/4198019110 >> v2:172.21.15.59:3300/0 conn(0x7fb1640b1ff0 0x7fb164147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb169e8f700 1 --2- 172.21.15.36:0/4198019110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb164067240 0x7fb16413cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb168e8d700 1 -- 172.21.15.36:0/4198019110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb164067240 msgr2=0x7fb16413cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:24.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb168e8d700 1 --2- 172.21.15.36:0/4198019110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb164067240 0x7fb16413cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb168e8d700 1 -- 172.21.15.36:0/4198019110 >> v2:172.21.15.36:3300/0 conn(0x7fb16405cce0 msgr2=0x7fb16405d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:24.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb168e8d700 1 --2- 172.21.15.36:0/4198019110 >> v2:172.21.15.36:3300/0 conn(0x7fb16405cce0 0x7fb16405d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb168e8d700 1 -- 172.21.15.36:0/4198019110 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb164146b80 con 0x7fb1640b1ff0 2022-01-10T01:33:24.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16968e700 1 --2- 172.21.15.36:0/4198019110 >> v2:172.21.15.36:3300/0 conn(0x7fb16405cce0 0x7fb16405d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:24.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb168e8d700 1 --2- 172.21.15.36:0/4198019110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1640b1ff0 0x7fb164147020 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fb154002f70 tx=0x7fb154006df0).ready entity=mon.1 client_cookie=6c025b8e6d8a19ba server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:24.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb153fff700 1 -- 172.21.15.36:0/4198019110 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb15400d4a0 con 0x7fb1640b1ff0 2022-01-10T01:33:24.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb153fff700 1 -- 172.21.15.36:0/4198019110 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb154000e90 con 0x7fb1640b1ff0 2022-01-10T01:33:24.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb153fff700 1 -- 172.21.15.36:0/4198019110 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb15400d7f0 con 0x7fb1640b1ff0 2022-01-10T01:33:24.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 -- 172.21.15.36:0/4198019110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1640b1ff0 msgr2=0x7fb164147020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 --2- 172.21.15.36:0/4198019110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1640b1ff0 0x7fb164147020 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fb154002f70 tx=0x7fb154006df0).stop 2022-01-10T01:33:24.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 -- 172.21.15.36:0/4198019110 shutdown_connections 2022-01-10T01:33:24.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 --2- 172.21.15.36:0/4198019110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb164067240 0x7fb16413cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 --2- 172.21.15.36:0/4198019110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1640b1ff0 0x7fb164147020 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 --2- 172.21.15.36:0/4198019110 >> v2:172.21.15.36:3300/0 conn(0x7fb16405cce0 0x7fb16405d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 -- 172.21.15.36:0/4198019110 >> 172.21.15.36:0/4198019110 conn(0x7fb164060180 msgr2=0x7fb16405c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:24.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 -- 172.21.15.36:0/4198019110 shutdown_connections 2022-01-10T01:33:24.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.821+0000 7fb16a690700 1 -- 172.21.15.36:0/4198019110 wait complete. 2022-01-10T01:33:24.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb16a690700 1 Processor -- start 2022-01-10T01:33:24.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb16a690700 1 -- start start 2022-01-10T01:33:24.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb16a690700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb16405cce0 0x7fb16414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb16a690700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb164067240 0x7fb1641433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb16a690700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1640b1ff0 0x7fb1641438b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb16a690700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb164143da0 con 0x7fb164067240 2022-01-10T01:33:24.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb16a690700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb164145e30 con 0x7fb1640b1ff0 2022-01-10T01:33:24.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb16a690700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb164152e60 con 0x7fb16405cce0 2022-01-10T01:33:24.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb168e8d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb164067240 0x7fb1641433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb168e8d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb164067240 0x7fb1641433c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41944/0 (socket says 172.21.15.36:41944) 2022-01-10T01:33:24.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb168e8d700 1 -- 172.21.15.36:0/1987798209 learned_addr learned my addr 172.21.15.36:0/1987798209 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:24.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb16968e700 1 --2- 172.21.15.36:0/1987798209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb16405cce0 0x7fb16414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb169e8f700 1 --2- 172.21.15.36:0/1987798209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1640b1ff0 0x7fb1641438b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb168e8d700 1 -- 172.21.15.36:0/1987798209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb16405cce0 msgr2=0x7fb16414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb168e8d700 1 --2- 172.21.15.36:0/1987798209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb16405cce0 0x7fb16414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb168e8d700 1 -- 172.21.15.36:0/1987798209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1640b1ff0 msgr2=0x7fb1641438b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb168e8d700 1 --2- 172.21.15.36:0/1987798209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1640b1ff0 0x7fb1641438b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.825+0000 7fb168e8d700 1 -- 172.21.15.36:0/1987798209 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16000b1e0 con 0x7fb164067240 2022-01-10T01:33:24.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.829+0000 7fb168e8d700 1 --2- 172.21.15.36:0/1987798209 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb164067240 0x7fb1641433c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7fb154002f70 tx=0x7fb154014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:24.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.829+0000 7fb1527fc700 1 -- 172.21.15.36:0/1987798209 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb154013ca0 con 0x7fb164067240 2022-01-10T01:33:24.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.829+0000 7fb1527fc700 1 -- 172.21.15.36:0/1987798209 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb154013e00 con 0x7fb164067240 2022-01-10T01:33:24.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.829+0000 7fb1527fc700 1 -- 172.21.15.36:0/1987798209 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb15401e5f0 con 0x7fb164067240 2022-01-10T01:33:24.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.829+0000 7fb16a690700 1 -- 172.21.15.36:0/1987798209 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15400b180 con 0x7fb164067240 2022-01-10T01:33:24.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.829+0000 7fb16a690700 1 -- 172.21.15.36:0/1987798209 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16412b320 con 0x7fb164067240 2022-01-10T01:33:24.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.829+0000 7fb16a690700 1 -- 172.21.15.36:0/1987798209 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb164146030 con 0x7fb164067240 2022-01-10T01:33:24.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.829+0000 7fb1527fc700 1 -- 172.21.15.36:0/1987798209 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb15401c070 con 0x7fb164067240 2022-01-10T01:33:24.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.829+0000 7fb1527fc700 1 --2- 172.21.15.36:0/1987798209 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb144053680 0x7fb144055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:24.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.829+0000 7fb1527fc700 1 -- 172.21.15.36:0/1987798209 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb15406c450 con 0x7fb164067240 2022-01-10T01:33:24.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.829+0000 7fb16968e700 1 --2- 172.21.15.36:0/1987798209 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb144053680 0x7fb144055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:24.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.833+0000 7fb16968e700 1 --2- 172.21.15.36:0/1987798209 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb144053680 0x7fb144055b40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fb16000b000 tx=0x7fb160006eb0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:24.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.837+0000 7fb1527fc700 1 -- 172.21.15.36:0/1987798209 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb154043460 con 0x7fb164067240 2022-01-10T01:33:24.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.961+0000 7fb16a690700 1 -- 172.21.15.36:0/1987798209 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1640676b0 con 0x7fb164067240 2022-01-10T01:33:24.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.961+0000 7fb1527fc700 1 -- 172.21.15.36:0/1987798209 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v139) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb1540230a0 con 0x7fb164067240 2022-01-10T01:33:24.968 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:24.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.961+0000 7fb16a690700 1 -- 172.21.15.36:0/1987798209 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb144053680 msgr2=0x7fb144055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.961+0000 7fb16a690700 1 --2- 172.21.15.36:0/1987798209 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb144053680 0x7fb144055b40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fb16000b000 tx=0x7fb160006eb0).stop 2022-01-10T01:33:24.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.961+0000 7fb16a690700 1 -- 172.21.15.36:0/1987798209 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb164067240 msgr2=0x7fb1641433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:24.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.961+0000 7fb16a690700 1 --2- 172.21.15.36:0/1987798209 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb164067240 0x7fb1641433c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7fb154002f70 tx=0x7fb154014000).stop 2022-01-10T01:33:24.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.961+0000 7fb16a690700 1 -- 172.21.15.36:0/1987798209 shutdown_connections 2022-01-10T01:33:24.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.961+0000 7fb16a690700 1 --2- 172.21.15.36:0/1987798209 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb144053680 0x7fb144055b40 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.961+0000 7fb16a690700 1 --2- 172.21.15.36:0/1987798209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1640b1ff0 0x7fb1641438b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.961+0000 7fb16a690700 1 --2- 172.21.15.36:0/1987798209 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb164067240 0x7fb1641433c0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.961+0000 7fb16a690700 1 --2- 172.21.15.36:0/1987798209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb16405cce0 0x7fb16414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:24.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.961+0000 7fb16a690700 1 -- 172.21.15.36:0/1987798209 >> 172.21.15.36:0/1987798209 conn(0x7fb164060180 msgr2=0x7fb1640b4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:24.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.961+0000 7fb16a690700 1 -- 172.21.15.36:0/1987798209 shutdown_connections 2022-01-10T01:33:24.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:24.961+0000 7fb16a690700 1 -- 172.21.15.36:0/1987798209 wait complete. 2022-01-10T01:33:24.981 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:33:25.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d99b5b700 1 Processor -- start 2022-01-10T01:33:25.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d99b5b700 1 -- start start 2022-01-10T01:33:25.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d99b5b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3d940b6510 0x7f3d94143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:25.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d99b5b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d941402f0 0x7f3d94140760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:25.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d99b5b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d940b68f0 con 0x7f3d940b4b40 2022-01-10T01:33:25.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d99b5b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d94143fb0 con 0x7f3d940b6510 2022-01-10T01:33:25.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d99b5b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d940ae660 con 0x7f3d941402f0 2022-01-10T01:33:25.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d98b59700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f3d940b6510 0x7f3d94143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:25.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d9935a700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f3d940b4b40 0x7f3d940b4f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39748/0 (socket says 172.21.15.36:39748) 2022-01-10T01:33:25.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d9935a700 1 -- 172.21.15.36:0/3994690740 learned_addr learned my addr 172.21.15.36:0/3994690740 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:25.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d93fff700 1 --2- 172.21.15.36:0/3994690740 >> v2:172.21.15.59:3300/0 conn(0x7f3d941402f0 0x7f3d94140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:25.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d98b59700 1 -- 172.21.15.36:0/3994690740 >> v2:172.21.15.59:3300/0 conn(0x7f3d941402f0 msgr2=0x7f3d94140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:25.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d98b59700 1 --2- 172.21.15.36:0/3994690740 >> v2:172.21.15.59:3300/0 conn(0x7f3d941402f0 0x7f3d94140760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d937fe700 1 -- 172.21.15.36:0/3994690740 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906406324 0 0) 0x7f3d940b68f0 con 0x7f3d940b4b40 2022-01-10T01:33:25.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d98b59700 1 -- 172.21.15.36:0/3994690740 >> v1:172.21.15.36:6789/0 conn(0x7f3d940b4b40 legacy=0x7f3d940b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:25.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d98b59700 1 -- 172.21.15.36:0/3994690740 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d940ae900 con 0x7f3d940b6510 2022-01-10T01:33:25.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d93fff700 1 --2- 172.21.15.36:0/3994690740 >> v2:172.21.15.59:3300/0 conn(0x7f3d941402f0 0x7f3d94140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:25.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d98b59700 1 --2- 172.21.15.36:0/3994690740 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d940b6510 0x7f3d94143ac0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f3d84002f70 tx=0x7f3d84006df0).ready entity=mon.0 client_cookie=5466d4f904b65826 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:25.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d937fe700 1 -- 172.21.15.36:0/3994690740 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d8400d5c0 con 0x7f3d940b6510 2022-01-10T01:33:25.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d937fe700 1 -- 172.21.15.36:0/3994690740 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d84000e90 con 0x7f3d940b6510 2022-01-10T01:33:25.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.081+0000 7f3d937fe700 1 -- 172.21.15.36:0/3994690740 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d8400d910 con 0x7f3d940b6510 2022-01-10T01:33:25.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 -- 172.21.15.36:0/3994690740 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d940b6510 msgr2=0x7f3d94143ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:25.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 --2- 172.21.15.36:0/3994690740 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d940b6510 0x7f3d94143ac0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f3d84002f70 tx=0x7f3d84006df0).stop 2022-01-10T01:33:25.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 -- 172.21.15.36:0/3994690740 shutdown_connections 2022-01-10T01:33:25.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 --2- 172.21.15.36:0/3994690740 >> v2:172.21.15.59:3300/0 conn(0x7f3d941402f0 0x7f3d94140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 --2- 172.21.15.36:0/3994690740 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d940b6510 0x7f3d94143ac0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 -- 172.21.15.36:0/3994690740 >> 172.21.15.36:0/3994690740 conn(0x7f3d9405f8c0 msgr2=0x7f3d940614b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:25.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 -- 172.21.15.36:0/3994690740 shutdown_connections 2022-01-10T01:33:25.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 -- 172.21.15.36:0/3994690740 wait complete. 2022-01-10T01:33:25.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 Processor -- start 2022-01-10T01:33:25.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 -- start start 2022-01-10T01:33:25.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d940b4b40 0x7f3d9413e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:25.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d940b6510 0x7f3d94156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:25.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d941402f0 0x7f3d94139c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:25.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94156580 con 0x7f3d940b6510 2022-01-10T01:33:25.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d941521f0 con 0x7f3d941402f0 2022-01-10T01:33:25.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94152490 con 0x7f3d940b4b40 2022-01-10T01:33:25.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d93fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d940b6510 0x7f3d94156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:25.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d93fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d940b6510 0x7f3d94156090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41958/0 (socket says 172.21.15.36:41958) 2022-01-10T01:33:25.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d93fff700 1 -- 172.21.15.36:0/763553195 learned_addr learned my addr 172.21.15.36:0/763553195 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:25.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d9935a700 1 --2- 172.21.15.36:0/763553195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d941402f0 0x7f3d94139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:25.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d98b59700 1 --2- 172.21.15.36:0/763553195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d940b4b40 0x7f3d9413e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:25.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d93fff700 1 -- 172.21.15.36:0/763553195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d940b4b40 msgr2=0x7f3d9413e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:25.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d93fff700 1 --2- 172.21.15.36:0/763553195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d940b4b40 0x7f3d9413e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d93fff700 1 -- 172.21.15.36:0/763553195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d941402f0 msgr2=0x7f3d94139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:25.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d93fff700 1 --2- 172.21.15.36:0/763553195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d941402f0 0x7f3d94139c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d93fff700 1 -- 172.21.15.36:0/763553195 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8400b180 con 0x7f3d940b6510 2022-01-10T01:33:25.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d93fff700 1 --2- 172.21.15.36:0/763553195 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d940b6510 0x7f3d94156090 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f3d88006940 tx=0x7f3d88008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:25.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d91ffb700 1 -- 172.21.15.36:0/763553195 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d88011780 con 0x7f3d940b6510 2022-01-10T01:33:25.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 -- 172.21.15.36:0/763553195 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d94152730 con 0x7f3d940b6510 2022-01-10T01:33:25.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d91ffb700 1 -- 172.21.15.36:0/763553195 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d880118e0 con 0x7f3d940b6510 2022-01-10T01:33:25.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d99b5b700 1 -- 172.21.15.36:0/763553195 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d94152e70 con 0x7f3d940b6510 2022-01-10T01:33:25.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.085+0000 7f3d91ffb700 1 -- 172.21.15.36:0/763553195 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d88011c40 con 0x7f3d940b6510 2022-01-10T01:33:25.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.089+0000 7f3d99b5b700 1 -- 172.21.15.36:0/763553195 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d9413d1e0 con 0x7f3d940b6510 2022-01-10T01:33:25.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.089+0000 7f3d91ffb700 1 -- 172.21.15.36:0/763553195 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3d88012420 con 0x7f3d940b6510 2022-01-10T01:33:25.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.089+0000 7f3d91ffb700 1 --2- 172.21.15.36:0/763553195 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d740535f0 0x7f3d74055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:25.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.089+0000 7f3d91ffb700 1 -- 172.21.15.36:0/763553195 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f3d8806bc50 con 0x7f3d940b6510 2022-01-10T01:33:25.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.089+0000 7f3d98b59700 1 --2- 172.21.15.36:0/763553195 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d740535f0 0x7f3d74055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:25.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.089+0000 7f3d98b59700 1 --2- 172.21.15.36:0/763553195 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d740535f0 0x7f3d74055ab0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f3d8401a000 tx=0x7f3d84014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:25.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.097+0000 7f3d91ffb700 1 -- 172.21.15.36:0/763553195 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3d9413d1e0 con 0x7f3d940b6510 2022-01-10T01:33:25.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.221+0000 7f3d99b5b700 1 -- 172.21.15.36:0/763553195 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d9413d1e0 con 0x7f3d940b6510 2022-01-10T01:33:25.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.221+0000 7f3d91ffb700 1 -- 172.21.15.36:0/763553195 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v139) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3d9413d1e0 con 0x7f3d940b6510 2022-01-10T01:33:25.230 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:25.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.225+0000 7f3d99b5b700 1 -- 172.21.15.36:0/763553195 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d740535f0 msgr2=0x7f3d74055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:25.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.225+0000 7f3d99b5b700 1 --2- 172.21.15.36:0/763553195 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d740535f0 0x7f3d74055ab0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f3d8401a000 tx=0x7f3d84014000).stop 2022-01-10T01:33:25.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.225+0000 7f3d99b5b700 1 -- 172.21.15.36:0/763553195 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d940b6510 msgr2=0x7f3d94156090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:25.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.225+0000 7f3d99b5b700 1 --2- 172.21.15.36:0/763553195 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d940b6510 0x7f3d94156090 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f3d88006940 tx=0x7f3d88008040).stop 2022-01-10T01:33:25.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.225+0000 7f3d99b5b700 1 -- 172.21.15.36:0/763553195 shutdown_connections 2022-01-10T01:33:25.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.225+0000 7f3d99b5b700 1 --2- 172.21.15.36:0/763553195 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3d740535f0 0x7f3d74055ab0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.225+0000 7f3d99b5b700 1 --2- 172.21.15.36:0/763553195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d941402f0 0x7f3d94139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.225+0000 7f3d99b5b700 1 --2- 172.21.15.36:0/763553195 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f3d940b6510 0x7f3d94156090 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.225+0000 7f3d99b5b700 1 --2- 172.21.15.36:0/763553195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d940b4b40 0x7f3d9413e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.225+0000 7f3d99b5b700 1 -- 172.21.15.36:0/763553195 >> 172.21.15.36:0/763553195 conn(0x7f3d9405f8c0 msgr2=0x7f3d940b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:25.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.225+0000 7f3d99b5b700 1 -- 172.21.15.36:0/763553195 shutdown_connections 2022-01-10T01:33:25.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.225+0000 7f3d99b5b700 1 -- 172.21.15.36:0/763553195 wait complete. 2022-01-10T01:33:25.243 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:33:25.244 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:25.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b359e700 1 Processor -- start 2022-01-10T01:33:25.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b359e700 1 -- start start 2022-01-10T01:33:25.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b359e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f50b40b1370 0x7f50b4144a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:25.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b359e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b40b17c0 con 0x7f50b40b0670 2022-01-10T01:33:25.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50b40aecd0 con 0x7f50b40ac7a0 2022-01-10T01:33:25.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b359e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50b40b0a50 con 0x7f50b40b1370 2022-01-10T01:33:25.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b2d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f50b40b1370 0x7f50b4144a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:25.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b259c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f50b40b0670 0x7f50b40b0c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39758/0 (socket says 172.21.15.36:39758) 2022-01-10T01:33:25.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b2d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f50b40b1370 0x7f50b4144a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41968/0 (socket says 172.21.15.36:41968) 2022-01-10T01:33:25.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b259c700 1 -- 172.21.15.36:0/3128088283 learned_addr learned my addr 172.21.15.36:0/3128088283 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:25.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b2d9d700 1 -- 172.21.15.36:0/3128088283 >> v1:172.21.15.59:6789/0 conn(0x7f50b40ac7a0 legacy=0x7f50b4144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:25.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b2d9d700 1 -- 172.21.15.36:0/3128088283 >> v1:172.21.15.36:6789/0 conn(0x7f50b40b0670 legacy=0x7f50b40b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:25.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b2d9d700 1 -- 172.21.15.36:0/3128088283 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b40ae2f0 con 0x7f50b40b1370 2022-01-10T01:33:25.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b2d9d700 1 --2- 172.21.15.36:0/3128088283 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40b1370 0x7f50b4144a50 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f50a4002f70 tx=0x7f50a4006df0).ready entity=mon.0 client_cookie=6e34340491b7937 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:25.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b159a700 1 -- 172.21.15.36:0/3128088283 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50a400d610 con 0x7f50b40b1370 2022-01-10T01:33:25.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b159a700 1 -- 172.21.15.36:0/3128088283 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a4000e90 con 0x7f50b40b1370 2022-01-10T01:33:25.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b159a700 1 -- 172.21.15.36:0/3128088283 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50a400d960 con 0x7f50b40b1370 2022-01-10T01:33:25.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b359e700 1 -- 172.21.15.36:0/3128088283 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40b1370 msgr2=0x7f50b4144a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:25.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b359e700 1 --2- 172.21.15.36:0/3128088283 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40b1370 0x7f50b4144a50 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f50a4002f70 tx=0x7f50a4006df0).stop 2022-01-10T01:33:25.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b359e700 1 -- 172.21.15.36:0/3128088283 shutdown_connections 2022-01-10T01:33:25.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b359e700 1 --2- 172.21.15.36:0/3128088283 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40b1370 0x7f50b4144a50 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b359e700 1 -- 172.21.15.36:0/3128088283 >> 172.21.15.36:0/3128088283 conn(0x7f50b405bd40 msgr2=0x7f50b4062560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:25.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.345+0000 7f50b359e700 1 -- 172.21.15.36:0/3128088283 shutdown_connections 2022-01-10T01:33:25.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.349+0000 7f50b359e700 1 -- 172.21.15.36:0/3128088283 wait complete. 2022-01-10T01:33:25.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.349+0000 7f50b359e700 1 Processor -- start 2022-01-10T01:33:25.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.349+0000 7f50b359e700 1 -- start start 2022-01-10T01:33:25.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40ac7a0 0x7f50b4064800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:25.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b40b0670 0x7f50b4157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:25.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50b40b1370 0x7f50b41467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:25.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b359e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4147d60 con 0x7f50b40ac7a0 2022-01-10T01:33:25.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4156bb0 con 0x7f50b40b0670 2022-01-10T01:33:25.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40ac7a0 0x7f50b4064800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:25.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b4064e30 con 0x7f50b40b1370 2022-01-10T01:33:25.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40ac7a0 0x7f50b4064800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41970/0 (socket says 172.21.15.36:41970) 2022-01-10T01:33:25.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b259c700 1 -- 172.21.15.36:0/3476915049 learned_addr learned my addr 172.21.15.36:0/3476915049 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:25.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b1d9b700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b40b0670 0x7f50b4157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:25.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b2d9d700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50b40b1370 0x7f50b41467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:25.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b259c700 1 -- 172.21.15.36:0/3476915049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50b40b1370 msgr2=0x7f50b41467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:25.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b259c700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50b40b1370 0x7f50b41467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b259c700 1 -- 172.21.15.36:0/3476915049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b40b0670 msgr2=0x7f50b4157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:25.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b259c700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b40b0670 0x7f50b4157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b259c700 1 -- 172.21.15.36:0/3476915049 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a400b180 con 0x7f50b40ac7a0 2022-01-10T01:33:25.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b1d9b700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b40b0670 0x7f50b4157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:25.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b259c700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40ac7a0 0x7f50b4064800 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f50b4064fc0 tx=0x7f509c007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:25.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50ab7fe700 1 -- 172.21.15.36:0/3476915049 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f509c00ce20 con 0x7f50b40ac7a0 2022-01-10T01:33:25.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50ab7fe700 1 -- 172.21.15.36:0/3476915049 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c0072e0 con 0x7f50b40ac7a0 2022-01-10T01:33:25.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b359e700 1 -- 172.21.15.36:0/3476915049 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b4147620 con 0x7f50b40ac7a0 2022-01-10T01:33:25.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50ab7fe700 1 -- 172.21.15.36:0/3476915049 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f509c005800 con 0x7f50b40ac7a0 2022-01-10T01:33:25.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.353+0000 7f50b359e700 1 -- 172.21.15.36:0/3476915049 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b41570b0 con 0x7f50b40ac7a0 2022-01-10T01:33:25.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.357+0000 7f50ab7fe700 1 -- 172.21.15.36:0/3476915049 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f509c010070 con 0x7f50b40ac7a0 2022-01-10T01:33:25.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.357+0000 7f50b359e700 1 -- 172.21.15.36:0/3476915049 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b40ae590 con 0x7f50b40ac7a0 2022-01-10T01:33:25.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.357+0000 7f50ab7fe700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f508c0535f0 0x7f508c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:25.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.357+0000 7f50ab7fe700 1 -- 172.21.15.36:0/3476915049 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f509c06b1b0 con 0x7f50b40ac7a0 2022-01-10T01:33:25.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.357+0000 7f50b1d9b700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f508c0535f0 0x7f508c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:25.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.357+0000 7f50b1d9b700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f508c0535f0 0x7f508c055ab0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f50ac00b000 tx=0x7f50ac009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:25.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.361+0000 7f50ab7fe700 1 -- 172.21.15.36:0/3476915049 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f509c0420b0 con 0x7f50b40ac7a0 2022-01-10T01:33:25.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.525+0000 7f50b359e700 1 -- 172.21.15.36:0/3476915049 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50b4057350 con 0x7f50b40ac7a0 2022-01-10T01:33:25.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.525+0000 7f50ab7fe700 1 -- 172.21.15.36:0/3476915049 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f509c0456d0 con 0x7f50b40ac7a0 2022-01-10T01:33:25.531 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:25.531 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8016,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/2824324236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2824324236},{"type":"v1","addr":"172.21.15.36:6835","nonce":2824324236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1768428808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1768428808},{"type":"v1","addr":"172.21.15.36:6837","nonce":1768428808}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:14.392835+0000","modified":"2022-01-10T01:33:15.396812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8028":{"gid":8028,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3822558856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3822558856},{"type":"v1","addr":"172.21.15.59:6833","nonce":3822558856}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2022-01-10T01:33:25.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.525+0000 7f50b359e700 1 -- 172.21.15.36:0/3476915049 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f508c0535f0 msgr2=0x7f508c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:25.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.525+0000 7f50b359e700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f508c0535f0 0x7f508c055ab0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f50ac00b000 tx=0x7f50ac009040).stop 2022-01-10T01:33:25.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.525+0000 7f50b359e700 1 -- 172.21.15.36:0/3476915049 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40ac7a0 msgr2=0x7f50b4064800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:25.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.525+0000 7f50b359e700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40ac7a0 0x7f50b4064800 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f50b4064fc0 tx=0x7f509c007c40).stop 2022-01-10T01:33:25.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.525+0000 7f50b359e700 1 -- 172.21.15.36:0/3476915049 shutdown_connections 2022-01-10T01:33:25.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.525+0000 7f50b359e700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f508c0535f0 0x7f508c055ab0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.525+0000 7f50b359e700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50b40b1370 0x7f50b41467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.525+0000 7f50b359e700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b40b0670 0x7f50b4157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.525+0000 7f50b359e700 1 --2- 172.21.15.36:0/3476915049 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f50b40ac7a0 0x7f50b4064800 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:25.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.525+0000 7f50b359e700 1 -- 172.21.15.36:0/3476915049 >> 172.21.15.36:0/3476915049 conn(0x7f50b405bd40 msgr2=0x7f50b40b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:25.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.525+0000 7f50b359e700 1 -- 172.21.15.36:0/3476915049 shutdown_connections 2022-01-10T01:33:25.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:25.525+0000 7f50b359e700 1 -- 172.21.15.36:0/3476915049 wait complete. 2022-01-10T01:33:25.537 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 66 2022-01-10T01:33:25.846 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:33:14.392835+0000', 'modified': '2022-01-10T01:33:15.396812+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8028}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8028': {'gid': 8028, 'name': 'b', 'rank': 0, 'incarnation': 65, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/3822558856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 3822558856}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 3822558856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:33:25.847 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:33:25.847 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:33:25.965 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":8028,"want_state":"up:active","state":"up:active","rank_uptime":11.557267937000001,"mdsmap_epoch":66,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":16.56496954} 2022-01-10T01:33:25.965 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 8028, "mdsmap_epoch": 66, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 11.557267937, "state": "up:active", "uptime": 16.56496954, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:33:25.966 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:33:25.966 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2022-01-10T01:33:25.967 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi166.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2022-01-10T01:33:25.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:25.967 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:25.976 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:33:26.035 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:33:26.036 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:33:26.046 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:33:26.047 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:33:26.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:26.048 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:33:26.054 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:33:26.055 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:26.057 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:33:26.077 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:33:26.077 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:33:26.133 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:2022-01-10T01:33:26.130+0000 7fa335c52080 -1 init, newargv = 0x5594834971c0 newargc=9 2022-01-10T01:33:26.133 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14696]: starting ceph client 2022-01-10T01:33:26.137 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:33:26.138 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:33:26.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:26.139 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:33:26.143 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14696]: starting fuse 2022-01-10T01:33:26.146 INFO:teuthology.orchestra.run.smithi166.stdout:52 2022-01-10T01:33:26.147 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:33:26.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:26.148 DEBUG:teuthology.orchestra.run.smithi166:> sudo python3 -c ' 2022-01-10T01:33:26.148 DEBUG:teuthology.orchestra.run.smithi166:> import glob 2022-01-10T01:33:26.148 DEBUG:teuthology.orchestra.run.smithi166:> import re 2022-01-10T01:33:26.149 DEBUG:teuthology.orchestra.run.smithi166:> import os 2022-01-10T01:33:26.149 DEBUG:teuthology.orchestra.run.smithi166:> import subprocess 2022-01-10T01:33:26.150 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:33:26.150 DEBUG:teuthology.orchestra.run.smithi166:> def find_socket(client_name): 2022-01-10T01:33:26.151 DEBUG:teuthology.orchestra.run.smithi166:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2022-01-10T01:33:26.151 DEBUG:teuthology.orchestra.run.smithi166:> files = glob.glob(asok_path) 2022-01-10T01:33:26.151 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:33:26.152 DEBUG:teuthology.orchestra.run.smithi166:> # Given a non-glob path, it better be there 2022-01-10T01:33:26.152 DEBUG:teuthology.orchestra.run.smithi166:> if "*" not in asok_path: 2022-01-10T01:33:26.153 DEBUG:teuthology.orchestra.run.smithi166:> assert(len(files) == 1) 2022-01-10T01:33:26.153 DEBUG:teuthology.orchestra.run.smithi166:> return files[0] 2022-01-10T01:33:26.153 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:33:26.154 DEBUG:teuthology.orchestra.run.smithi166:> for f in files: 2022-01-10T01:33:26.154 DEBUG:teuthology.orchestra.run.smithi166:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:33:26.155 DEBUG:teuthology.orchestra.run.smithi166:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:33:26.155 DEBUG:teuthology.orchestra.run.smithi166:> return f 2022-01-10T01:33:26.155 DEBUG:teuthology.orchestra.run.smithi166:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:33:26.156 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:33:26.156 DEBUG:teuthology.orchestra.run.smithi166:> print(find_socket("client.1")) 2022-01-10T01:33:26.157 DEBUG:teuthology.orchestra.run.smithi166:> ' 2022-01-10T01:33:26.199 INFO:teuthology.orchestra.run.smithi166.stdout:/var/run/ceph/ceph-client.1.14696.asok 2022-01-10T01:33:26.204 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14696.asok 2022-01-10T01:33:26.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:26.205 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14696.asok status 2022-01-10T01:33:26.342 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2022-01-10T01:33:26.343 INFO:teuthology.orchestra.run.smithi166.stdout: "metadata": { 2022-01-10T01:33:26.343 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:33:26.343 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:33:26.343 INFO:teuthology.orchestra.run.smithi166.stdout: "entity_id": "1", 2022-01-10T01:33:26.344 INFO:teuthology.orchestra.run.smithi166.stdout: "hostname": "smithi166", 2022-01-10T01:33:26.344 INFO:teuthology.orchestra.run.smithi166.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2022-01-10T01:33:26.344 INFO:teuthology.orchestra.run.smithi166.stdout: "pid": "14696", 2022-01-10T01:33:26.344 INFO:teuthology.orchestra.run.smithi166.stdout: "root": "/" 2022-01-10T01:33:26.345 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:33:26.345 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_count": 0, 2022-01-10T01:33:26.345 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_pinned_count": 0, 2022-01-10T01:33:26.345 INFO:teuthology.orchestra.run.smithi166.stdout: "id": 8212, 2022-01-10T01:33:26.346 INFO:teuthology.orchestra.run.smithi166.stdout: "inst": { 2022-01-10T01:33:26.346 INFO:teuthology.orchestra.run.smithi166.stdout: "name": { 2022-01-10T01:33:26.346 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "client", 2022-01-10T01:33:26.346 INFO:teuthology.orchestra.run.smithi166.stdout: "num": 8212 2022-01-10T01:33:26.347 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:33:26.347 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:33:26.347 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:33:26.347 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:33:26.347 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 2902020487 2022-01-10T01:33:26.348 INFO:teuthology.orchestra.run.smithi166.stdout: } 2022-01-10T01:33:26.348 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:33:26.348 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:33:26.348 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:33:26.349 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:33:26.349 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 2902020487 2022-01-10T01:33:26.349 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:33:26.349 INFO:teuthology.orchestra.run.smithi166.stdout: "inst_str": "client.8212 172.21.15.166:0/2902020487", 2022-01-10T01:33:26.350 INFO:teuthology.orchestra.run.smithi166.stdout: "addr_str": "172.21.15.166:0/2902020487", 2022-01-10T01:33:26.350 INFO:teuthology.orchestra.run.smithi166.stdout: "inode_count": 1, 2022-01-10T01:33:26.350 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_epoch": 66, 2022-01-10T01:33:26.350 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch": 139, 2022-01-10T01:33:26.351 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:33:26.351 INFO:teuthology.orchestra.run.smithi166.stdout: "blacklisted": false, 2022-01-10T01:33:26.351 INFO:teuthology.orchestra.run.smithi166.stdout: "fs_name": "cephfs" 2022-01-10T01:33:26.351 INFO:teuthology.orchestra.run.smithi166.stdout:} 2022-01-10T01:33:26.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:26.353 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:26.354 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:26.361 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:33:26.362 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:33:26.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:26.363 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:26.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:26.378 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:26.379 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:26.388 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:33:26.389 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:33:26.389 DEBUG:teuthology.orchestra.run.smithi139:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2022-01-10T01:33:26.390 DEBUG:teuthology.orchestra.run.smithi139:> import time 2022-01-10T01:33:26.390 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:33:26.391 DEBUG:teuthology.orchestra.run.smithi139:> with open("/home/ubuntu/cephtest/mnt.0/testfile", '"'"'w'"'"') as f: 2022-01-10T01:33:26.391 DEBUG:teuthology.orchestra.run.smithi139:> f.write('"'"'content'"'"') 2022-01-10T01:33:26.391 DEBUG:teuthology.orchestra.run.smithi139:> f.flush() 2022-01-10T01:33:26.392 DEBUG:teuthology.orchestra.run.smithi139:> f.write('"'"'content2'"'"') 2022-01-10T01:33:26.392 DEBUG:teuthology.orchestra.run.smithi139:> while True: 2022-01-10T01:33:26.393 DEBUG:teuthology.orchestra.run.smithi139:> time.sleep(1) 2022-01-10T01:33:26.393 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:33:26.396 DEBUG:teuthology.orchestra.run.smithi139:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2022-01-10T01:33:26.416 INFO:teuthology.orchestra.run.smithi139.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/testfile': No such file or directory 2022-01-10T01:33:26.417 DEBUG:teuthology.orchestra.run:got remote process result: 2 2022-01-10T01:33:27.419 DEBUG:teuthology.orchestra.run.smithi139:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2022-01-10T01:33:27.437 INFO:teuthology.orchestra.run.smithi139.stdout:/home/ubuntu/cephtest/mnt.0/testfile 2022-01-10T01:33:27.438 DEBUG:tasks.cephfs.mount:File testfile became visible from 0 after 1s 2022-01-10T01:33:27.439 DEBUG:teuthology.orchestra.run.smithi166:> sudo ls /home/ubuntu/cephtest/mnt.1/testfile 2022-01-10T01:33:27.475 INFO:teuthology.orchestra.run.smithi166.stdout:/home/ubuntu/cephtest/mnt.1/testfile 2022-01-10T01:33:27.477 DEBUG:tasks.cephfs.mount:File testfile became visible from 1 after 0s 2022-01-10T01:33:27.478 INFO:teuthology.orchestra.run:Running command with timeout 10800 2022-01-10T01:33:27.478 DEBUG:teuthology.orchestra.run.smithi166:> cd /home/ubuntu/cephtest/mnt.1 && sudo cat testfile 2022-01-10T01:33:27.522 INFO:teuthology.orchestra.run.smithi166.stdout:content 2022-01-10T01:33:27.539 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:33:27.539 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:27.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:27.584 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:27.603 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:27.624 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:33:27.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:27.625 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:27.626 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:27.651 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:33:27.652 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:33:27.653 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:33:27.653 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:33:27.654 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:27.668 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[15173]: fuse finished with error 0 and tester_r 0 2022-01-10T01:33:27.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:27.671 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:27.672 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:27.679 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:33:27.680 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:33:27.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:33:27.797 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:27.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:27.848 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:27.848 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:27.857 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:33:27.858 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:33:27.858 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi166.front.sepia.ceph.com... 2022-01-10T01:33:27.859 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:33:27.859 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:27.917 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14696]: fuse finished with error 0 and tester_r 0 2022-01-10T01:33:27.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:27.920 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:27.920 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:27.926 INFO:teuthology.orchestra.run.smithi166.stdout:ext2/ext3 2022-01-10T01:33:27.927 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:33:28.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:33:28.046 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:28.054 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:33:28.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cc09ea700 1 Processor -- start 2022-01-10T01:33:28.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cc09ea700 1 -- start start 2022-01-10T01:33:28.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cc09ea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cbc0b9910 0x7f1cbc0b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cc09ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0b7160 0x7f1cbc0b5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cc09ea700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc1468e0 con 0x7f1cbc0b4370 2022-01-10T01:33:28.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cc09ea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cbc0b4c30 con 0x7f1cbc0b9910 2022-01-10T01:33:28.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cc09ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0b4990 con 0x7f1cbc0b7160 2022-01-10T01:33:28.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cb9d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f1cbc0b4370 0x7f1cbc146fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39776/0 (socket says 172.21.15.36:39776) 2022-01-10T01:33:28.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cb9d9b700 1 -- 172.21.15.36:0/2341114193 learned_addr learned my addr 172.21.15.36:0/2341114193 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:28.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cba59c700 1 --2- 172.21.15.36:0/2341114193 >> v2:172.21.15.59:3300/0 conn(0x7f1cbc0b9910 0x7f1cbc0b9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cbad9d700 1 --2- 172.21.15.36:0/2341114193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0b7160 0x7f1cbc0b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cb959a700 1 -- 172.21.15.36:0/2341114193 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066829022 0 0) 0x7f1cbc1468e0 con 0x7f1cbc0b4370 2022-01-10T01:33:28.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cb959a700 1 -- 172.21.15.36:0/2341114193 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca0003260 con 0x7f1cbc0b4370 2022-01-10T01:33:28.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cba59c700 1 -- 172.21.15.36:0/2341114193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0b7160 msgr2=0x7f1cbc0b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:28.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cba59c700 1 --2- 172.21.15.36:0/2341114193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0b7160 0x7f1cbc0b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cba59c700 1 -- 172.21.15.36:0/2341114193 >> v1:172.21.15.36:6789/0 conn(0x7f1cbc0b4370 legacy=0x7f1cbc146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cba59c700 1 -- 172.21.15.36:0/2341114193 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc146b40 con 0x7f1cbc0b9910 2022-01-10T01:33:28.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cbad9d700 1 --2- 172.21.15.36:0/2341114193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0b7160 0x7f1cbc0b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:28.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cba59c700 1 --2- 172.21.15.36:0/2341114193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc0b9910 0x7f1cbc0b9cf0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f1ca4002f70 tx=0x7f1ca4006df0).ready entity=mon.1 client_cookie=fc09ac1acde16578 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:28.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cb959a700 1 -- 172.21.15.36:0/2341114193 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ca400d570 con 0x7f1cbc0b9910 2022-01-10T01:33:28.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cb959a700 1 -- 172.21.15.36:0/2341114193 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca4000e90 con 0x7f1cbc0b9910 2022-01-10T01:33:28.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.157+0000 7f1cb959a700 1 -- 172.21.15.36:0/2341114193 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ca400d8c0 con 0x7f1cbc0b9910 2022-01-10T01:33:28.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 -- 172.21.15.36:0/2341114193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc0b9910 msgr2=0x7f1cbc0b9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 --2- 172.21.15.36:0/2341114193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc0b9910 0x7f1cbc0b9cf0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f1ca4002f70 tx=0x7f1ca4006df0).stop 2022-01-10T01:33:28.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 -- 172.21.15.36:0/2341114193 shutdown_connections 2022-01-10T01:33:28.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 --2- 172.21.15.36:0/2341114193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0b7160 0x7f1cbc0b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 --2- 172.21.15.36:0/2341114193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc0b9910 0x7f1cbc0b9cf0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 -- 172.21.15.36:0/2341114193 >> 172.21.15.36:0/2341114193 conn(0x7f1cbc05ff60 msgr2=0x7f1cbc0616a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:28.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 -- 172.21.15.36:0/2341114193 shutdown_connections 2022-01-10T01:33:28.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 -- 172.21.15.36:0/2341114193 wait complete. 2022-01-10T01:33:28.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 Processor -- start 2022-01-10T01:33:28.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 -- start start 2022-01-10T01:33:28.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1cbc0b4370 0x7f1cbc13c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0b7160 0x7f1cbc141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc0b9910 0x7f1cbc141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc1430a0 con 0x7f1cbc0b4370 2022-01-10T01:33:28.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc14a120 con 0x7f1cbc0b9910 2022-01-10T01:33:28.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cc09ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0b0b70 con 0x7f1cbc0b7160 2022-01-10T01:33:28.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cba59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1cbc0b4370 0x7f1cbc13c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cba59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1cbc0b4370 0x7f1cbc13c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:41984/0 (socket says 172.21.15.36:41984) 2022-01-10T01:33:28.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cba59c700 1 -- 172.21.15.36:0/3405736332 learned_addr learned my addr 172.21.15.36:0/3405736332 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:28.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cbad9d700 1 --2- 172.21.15.36:0/3405736332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc0b9910 0x7f1cbc141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cb9d9b700 1 --2- 172.21.15.36:0/3405736332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0b7160 0x7f1cbc141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cba59c700 1 -- 172.21.15.36:0/3405736332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0b7160 msgr2=0x7f1cbc141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cba59c700 1 --2- 172.21.15.36:0/3405736332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0b7160 0x7f1cbc141450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cba59c700 1 -- 172.21.15.36:0/3405736332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc0b9910 msgr2=0x7f1cbc141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cba59c700 1 --2- 172.21.15.36:0/3405736332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc0b9910 0x7f1cbc141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.161+0000 7f1cba59c700 1 -- 172.21.15.36:0/3405736332 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca400b180 con 0x7f1cbc0b4370 2022-01-10T01:33:28.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.165+0000 7f1cba59c700 1 --2- 172.21.15.36:0/3405736332 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1cbc0b4370 0x7f1cbc13c060 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f1ca4002f70 tx=0x7f1ca4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:28.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.165+0000 7f1cb37fe700 1 -- 172.21.15.36:0/3405736332 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ca4016070 con 0x7f1cbc0b4370 2022-01-10T01:33:28.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.165+0000 7f1cb37fe700 1 -- 172.21.15.36:0/3405736332 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca4013910 con 0x7f1cbc0b4370 2022-01-10T01:33:28.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.165+0000 7f1cc09ea700 1 -- 172.21.15.36:0/3405736332 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cbc0b0e10 con 0x7f1cbc0b4370 2022-01-10T01:33:28.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.165+0000 7f1cb37fe700 1 -- 172.21.15.36:0/3405736332 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ca4013c70 con 0x7f1cbc0b4370 2022-01-10T01:33:28.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.165+0000 7f1cc09ea700 1 -- 172.21.15.36:0/3405736332 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cbc13dbe0 con 0x7f1cbc0b4370 2022-01-10T01:33:28.182 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.165+0000 7f1cc09ea700 1 -- 172.21.15.36:0/3405736332 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cbc13dda0 con 0x7f1cbc0b4370 2022-01-10T01:33:28.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.165+0000 7f1cb37fe700 1 -- 172.21.15.36:0/3405736332 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1ca4024030 con 0x7f1cbc0b4370 2022-01-10T01:33:28.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.165+0000 7f1cb37fe700 1 --2- 172.21.15.36:0/3405736332 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1c940535f0 0x7f1c94055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.165+0000 7f1cb37fe700 1 -- 172.21.15.36:0/3405736332 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1ca406c730 con 0x7f1cbc0b4370 2022-01-10T01:33:28.183 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.165+0000 7f1cb9d9b700 1 --2- 172.21.15.36:0/3405736332 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1c940535f0 0x7f1c94055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.169+0000 7f1cb9d9b700 1 --2- 172.21.15.36:0/3405736332 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1c940535f0 0x7f1c94055ab0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f1cac00b000 tx=0x7f1cac009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:28.184 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.173+0000 7f1cb37fe700 1 -- 172.21.15.36:0/3405736332 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1ca4043740 con 0x7f1cbc0b4370 2022-01-10T01:33:28.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.301+0000 7f1cc09ea700 1 -- 172.21.15.36:0/3405736332 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1cbc057350 con 0x7f1cbc0b4370 2022-01-10T01:33:28.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.305+0000 7f1cb37fe700 1 -- 172.21.15.36:0/3405736332 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+34051 (secure 0 0 0) 0x7f1ca4022090 con 0x7f1cbc0b4370 2022-01-10T01:33:28.312 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:28.312 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:33:28.312 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 139, 2022-01-10T01:33:28.312 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:33:28.313 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:33:28.313 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:33:15.396927+0000", 2022-01-10T01:33:28.313 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:33:28.313 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:33:28.313 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:33:28.314 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:33:28.314 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:33:28.314 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:33:28.314 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:33:28.315 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:33:28.315 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:33:28.315 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:28.315 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:33:28.315 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:33:28.316 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:33:28.316 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:33:28.316 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:33:28.316 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 26, 2022-01-10T01:33:28.316 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:33:28.317 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:33:28.317 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:33:28.317 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:33:28.317 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:33:28.318 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.318 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:33:28.318 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:33:28.318 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:33:28.318 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:28.319 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:28.319 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:28.319 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:28.319 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:28.320 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:28.320 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:28.320 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:28.320 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:33:28.320 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:33:28.321 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:33:28.321 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:33:28.321 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:33:28.321 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:28.321 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:28.322 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:28.322 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:28.322 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:28.322 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:28.323 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:28.323 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.323 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:33:28.323 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:28.323 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:28.324 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:28.324 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:28.324 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:28.324 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:28.325 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:28.325 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:28.325 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:28.325 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:28.325 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:28.326 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:28.326 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:28.326 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:28.326 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:28.327 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:28.327 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:28.327 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:28.327 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:28.327 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:28.328 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:28.328 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:28.328 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:28.328 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:28.329 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:28.329 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:28.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.329 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:28.329 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:28.330 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:28.330 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:28.330 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:28.330 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:28.331 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:28.331 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:28.331 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:28.331 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:28.331 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:28.332 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:33:28.332 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:33:28.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.332 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:28.332 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:33:28.333 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.333 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.333 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.333 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:33:28.334 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:33:28.334 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:33:28.334 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:28.334 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:28.335 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:28.335 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:28.335 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:28.335 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:28.335 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:28.336 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:28.336 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:33:28.336 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:33:28.336 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:33:28.337 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:33:28.337 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:33:28.337 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:28.337 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:28.337 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:28.338 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:28.338 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:28.338 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:28.338 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:28.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.339 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:33:28.339 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:28.339 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:28.339 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:28.340 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:28.340 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:28.340 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:28.340 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:28.341 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:28.341 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:28.341 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:28.341 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:28.341 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:28.342 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:28.342 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:28.342 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:28.342 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:28.342 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:28.343 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:28.343 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:28.343 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:28.343 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:28.344 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:28.344 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:28.344 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:28.344 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:28.344 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:28.345 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.345 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:28.345 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:28.345 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:28.345 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:28.346 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:28.346 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:28.346 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:28.346 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:28.347 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:28.347 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:28.347 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:28.347 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:33:28.347 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:28.348 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:33:28.348 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.348 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.348 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.348 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 25, 2022-01-10T01:33:28.349 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_metadata", 2022-01-10T01:33:28.349 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:33:12.182921+0000", 2022-01-10T01:33:28.349 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:28.349 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:28.350 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:28.350 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:28.350 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:28.350 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:28.351 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:28.351 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:28.351 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:33:28.351 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:33:28.352 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:33:28.352 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:33:28.352 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:33:28.352 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:28.352 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:28.353 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:28.353 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:28.353 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:28.353 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:28.354 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:28.354 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.354 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "138", 2022-01-10T01:33:28.354 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:28.355 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:28.355 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:28.355 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:28.355 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:28.356 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:28.356 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:28.356 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:28.356 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:28.356 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:28.357 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:28.357 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:28.357 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:28.357 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:28.357 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:28.358 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:28.358 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:28.358 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:28.358 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:28.359 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:28.359 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:28.359 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:28.359 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:28.359 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:28.360 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:28.360 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:28.360 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.360 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:28.360 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:28.361 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:28.361 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:28.361 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:28.361 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:28.361 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:28.362 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:28.362 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:28.362 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:28.362 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:28.363 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:33:28.363 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_bias": 4, 2022-01-10T01:33:28.363 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 16, 2022-01-10T01:33:28.363 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_priority": 5 2022-01-10T01:33:28.363 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.364 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:28.364 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:33:28.364 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": "cephfs" 2022-01-10T01:33:28.364 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.365 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.365 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.365 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.365 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 26, 2022-01-10T01:33:28.365 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_data", 2022-01-10T01:33:28.366 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:33:13.414645+0000", 2022-01-10T01:33:28.366 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:28.366 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:28.366 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:28.367 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:28.367 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:28.367 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:28.367 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:28.367 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:28.368 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:33:28.368 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:33:28.368 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:33:28.368 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:33:28.368 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:33:28.369 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:28.369 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:28.369 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:28.369 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:28.370 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:28.370 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:28.370 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:28.370 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.370 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "139", 2022-01-10T01:33:28.371 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:28.371 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:28.371 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:28.371 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:28.371 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:28.372 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:28.372 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:28.372 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:28.372 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:28.373 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:28.373 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:28.373 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:28.373 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:28.373 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:28.374 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:28.374 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:28.374 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:28.374 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:28.374 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:28.375 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:28.375 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:28.375 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:28.375 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:28.376 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:28.376 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:28.376 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:28.376 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.377 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:28.377 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:28.377 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:28.377 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:28.377 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:28.378 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:28.378 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:28.378 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:28.378 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:28.379 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:28.379 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:28.379 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:33:28.379 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:28.379 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:33:28.380 INFO:teuthology.orchestra.run.smithi036.stdout: "data": "cephfs" 2022-01-10T01:33:28.380 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.380 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.380 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.381 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:28.381 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:33:28.381 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.381 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:33:28.381 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:33:28.382 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:28.382 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:28.382 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:28.382 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:28.383 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:28.383 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:28.383 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:28.383 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 137, 2022-01-10T01:33:28.384 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:28.384 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:28.384 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:28.384 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.385 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.385 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.385 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:33:28.385 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:28.385 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.386 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.386 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.386 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:33:28.386 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:28.387 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.387 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.387 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.387 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:28.387 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.388 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.388 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.388 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:33:28.388 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:28.389 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.389 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.389 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.389 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:33:28.390 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:28.390 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.390 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.390 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.390 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:28.391 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.391 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.391 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.391 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:33:28.392 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:28.392 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.392 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.392 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.392 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:33:28.393 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:28.393 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.393 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.393 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.394 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:28.394 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.394 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.394 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.394 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:33:28.395 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:28.395 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.395 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.395 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.396 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:33:28.396 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:28.396 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.396 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.396 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.397 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:33:28.397 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:33:28.397 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:33:28.397 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:33:28.397 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:28.398 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:28.398 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:28.398 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.398 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.399 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.399 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:33:28.399 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:33:28.399 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:28.399 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:28.400 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:28.400 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:28.400 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:28.400 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:28.400 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:28.401 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 137, 2022-01-10T01:33:28.401 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:28.401 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:28.401 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:28.402 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.402 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.402 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.402 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:33:28.402 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:28.403 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.403 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.403 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.403 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:33:28.404 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:28.404 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.404 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.404 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.404 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:28.405 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.405 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.405 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.405 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:33:28.405 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:28.406 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.406 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.406 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.406 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:33:28.407 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:28.407 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.407 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.407 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.407 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:28.408 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.408 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.408 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.408 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:33:28.408 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:28.409 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.409 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.409 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.409 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:33:28.410 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:28.410 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.410 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.410 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.410 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:28.411 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.411 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.411 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.411 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:33:28.411 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:28.412 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.412 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.412 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.412 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:33:28.412 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:28.413 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.413 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.413 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.413 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:33:28.414 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:33:28.414 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:33:28.414 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:33:28.414 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:28.414 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:28.415 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:28.415 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.415 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.415 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.416 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:33:28.416 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:33:28.416 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:28.416 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:28.416 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:28.417 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:28.417 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:28.417 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:28.417 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:28.417 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 125, 2022-01-10T01:33:28.418 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:28.418 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:28.418 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:28.418 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.419 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.419 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.419 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:33:28.419 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:28.419 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.420 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.420 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.420 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:33:28.420 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:28.421 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.421 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.421 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.421 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:28.422 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.422 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.422 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.422 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:33:28.423 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:28.423 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.423 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.423 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.424 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:33:28.424 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:28.424 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.424 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.424 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.425 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:28.425 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.425 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.425 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.426 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:33:28.426 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:28.426 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.426 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.426 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.427 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:33:28.427 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:28.427 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.427 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.428 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.428 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:28.428 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.428 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.428 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.429 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:33:28.429 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:28.429 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.429 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.429 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.430 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:33:28.430 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:28.430 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.431 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.431 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.431 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:33:28.431 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:33:28.432 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:33:28.432 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:33:28.432 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:28.433 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:28.433 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:28.433 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.433 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.434 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.434 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:33:28.434 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:33:28.434 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:28.435 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:28.435 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:28.435 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:28.435 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:28.436 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:28.436 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:28.436 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 137, 2022-01-10T01:33:28.436 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:28.437 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:28.437 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:28.437 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.437 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.438 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.438 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:33:28.438 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:28.438 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.438 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.439 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.439 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:33:28.439 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:28.439 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.440 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.440 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.440 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:28.440 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.440 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.441 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.441 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:33:28.441 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:28.441 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.441 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.442 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.442 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:33:28.442 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:28.442 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.443 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.443 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.443 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:28.443 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.443 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.444 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.444 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:33:28.444 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:28.444 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.444 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.445 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.445 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:33:28.445 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:28.445 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.446 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.446 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.446 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:28.446 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.446 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.447 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.447 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:33:28.447 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:28.447 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.447 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.448 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.448 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:33:28.448 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:28.448 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.449 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.449 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.449 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:33:28.449 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:33:28.449 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:33:28.450 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:33:28.450 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:28.450 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:28.450 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:28.450 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.451 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.451 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.451 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:33:28.451 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:33:28.452 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:28.452 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:28.452 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:28.452 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:28.452 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:28.453 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:28.453 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:28.453 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 137, 2022-01-10T01:33:28.453 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:28.453 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:28.454 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:28.454 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.454 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.454 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.455 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:33:28.455 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:28.455 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.455 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.455 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.456 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:33:28.456 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:28.456 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.456 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.456 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.457 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:28.457 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.457 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.457 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.458 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:33:28.458 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:28.458 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.458 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.459 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.459 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:33:28.459 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:28.459 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.459 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.460 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.460 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:28.460 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.460 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.461 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.461 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:33:28.461 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:28.462 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.462 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.462 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.462 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:33:28.462 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:28.463 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.463 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.463 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.463 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:28.464 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.464 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.464 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.464 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:33:28.464 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:28.465 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.465 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.465 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.465 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:33:28.465 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:28.466 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.466 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.466 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.466 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:33:28.467 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:33:28.467 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:33:28.467 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:33:28.467 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:28.467 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:28.468 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:28.468 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.468 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.468 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.468 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:33:28.469 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:33:28.469 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:28.469 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:28.469 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:28.469 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:28.470 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:28.470 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:28.470 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:28.470 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 137, 2022-01-10T01:33:28.471 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:28.471 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:28.471 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:28.471 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.471 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.472 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.472 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:33:28.472 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:28.472 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.472 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.473 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.473 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:33:28.473 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:28.473 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.473 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.474 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.474 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:28.474 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.474 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.475 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.475 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:33:28.475 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:28.475 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.475 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.476 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.476 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:33:28.476 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:28.476 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.476 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.477 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.477 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:28.477 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.477 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.477 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.478 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:33:28.478 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:28.478 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.478 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.479 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.479 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:33:28.479 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:28.479 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.479 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.480 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.480 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:28.480 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.480 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.480 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.481 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:33:28.481 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:28.481 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.481 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.482 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.482 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:33:28.482 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:28.482 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.482 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.483 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.483 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:33:28.483 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:33:28.483 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:33:28.483 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:33:28.484 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:28.484 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:28.484 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:28.484 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.485 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.485 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.485 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:33:28.485 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:33:28.485 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:28.486 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:28.486 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:28.486 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:28.487 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:28.487 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:28.487 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:28.487 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 125, 2022-01-10T01:33:28.488 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:28.488 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:28.488 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:28.488 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.489 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.489 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.489 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:33:28.489 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:28.489 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.490 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.490 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.490 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:33:28.490 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:28.491 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.491 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.491 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.491 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:28.491 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.492 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.492 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.492 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:33:28.492 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:28.493 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.493 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.493 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.493 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:33:28.493 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:28.494 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.494 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.494 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.494 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:28.494 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.495 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.495 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.495 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:33:28.495 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:28.496 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.496 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.496 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.496 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:33:28.496 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:28.497 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.497 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.497 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.497 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:28.498 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.498 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.498 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.498 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:33:28.498 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:28.499 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.499 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.499 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.499 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:33:28.500 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:28.500 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.500 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.500 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.500 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:33:28.501 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:33:28.501 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:33:28.501 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:33:28.501 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:28.501 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:28.502 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:28.502 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.502 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.502 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.503 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:33:28.503 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:33:28.503 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:28.503 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:28.503 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:28.504 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:28.504 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:28.504 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:28.504 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:28.504 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 137, 2022-01-10T01:33:28.505 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:28.505 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:28.505 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:28.505 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.505 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.506 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.506 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:33:28.506 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:28.506 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.507 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.507 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.507 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:33:28.507 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:28.507 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.508 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.508 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.508 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:28.508 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.508 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.509 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.509 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:33:28.509 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:28.509 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.510 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.510 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.510 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:33:28.510 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:28.510 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.511 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.511 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.511 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:28.511 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.511 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.512 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.512 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:33:28.512 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:28.512 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.512 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.513 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.513 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:33:28.513 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:28.513 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.514 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.514 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.514 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:28.514 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:28.514 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.515 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:28.515 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:33:28.515 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:28.515 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.515 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.516 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:28.516 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:33:28.516 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:28.516 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.517 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.517 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.517 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:33:28.517 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:33:28.517 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:33:28.518 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:33:28.518 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:28.518 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:28.518 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:28.518 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:28.519 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.519 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:28.519 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:33:28.519 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.520 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:33:28.520 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:28.520 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:28.520 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:28.520 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:28.521 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:28.521 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:33:28.521 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:28.521 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.521 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.522 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:33:28.522 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:28.522 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:28.522 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:28.522 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:28.523 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:28.523 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:33:28.523 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:28.523 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.524 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.524 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:33:28.524 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:28.524 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:28.524 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:28.525 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:28.525 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:28.525 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:33:28.525 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:28.525 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.526 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.526 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:33:28.526 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:28.526 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:28.527 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:28.527 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:28.527 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:28.527 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:33:28.527 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:28.528 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.528 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.528 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:33:28.528 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:28.528 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:28.529 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:28.529 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:28.529 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:28.529 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:33:28.530 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:28.530 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.530 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.530 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:33:28.530 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:28.531 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:28.531 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:28.531 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:28.531 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:28.531 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:33:28.532 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:28.532 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.532 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.532 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:33:28.533 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:28.533 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:28.533 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:28.533 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:28.533 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:28.534 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:33:28.534 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:28.534 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.534 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:28.535 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:33:28.535 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:28.535 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:28.535 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:28.535 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:28.536 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:28.536 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:33:28.536 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:28.536 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.536 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:28.537 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:33:28.537 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:33:28.537 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:33:28.537 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:33:28.537 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2022-01-10T01:33:28.538 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:33:28.538 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:33:28.538 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:33:28.538 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:33:28.539 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:33:28.539 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:33:28.539 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:33:28.539 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:33:28.539 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:33:28.540 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:33:28.540 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:33:28.540 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:33:28.540 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.540 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:33:28.541 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:33:28.541 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:33:28.541 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:33:28.541 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:33:28.541 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:33:28.542 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:33:28.542 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:28.542 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:28.542 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:33:28.543 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:33:28.543 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:33:28.543 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:33:28.543 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:33:28.543 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:33:28.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.305+0000 7f1cc09ea700 1 -- 172.21.15.36:0/3405736332 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1c940535f0 msgr2=0x7f1c94055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.305+0000 7f1cc09ea700 1 --2- 172.21.15.36:0/3405736332 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1c940535f0 0x7f1c94055ab0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f1cac00b000 tx=0x7f1cac009040).stop 2022-01-10T01:33:28.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.305+0000 7f1cc09ea700 1 -- 172.21.15.36:0/3405736332 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1cbc0b4370 msgr2=0x7f1cbc13c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.305+0000 7f1cc09ea700 1 --2- 172.21.15.36:0/3405736332 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1cbc0b4370 0x7f1cbc13c060 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f1ca4002f70 tx=0x7f1ca4014000).stop 2022-01-10T01:33:28.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.305+0000 7f1cc09ea700 1 -- 172.21.15.36:0/3405736332 shutdown_connections 2022-01-10T01:33:28.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.305+0000 7f1cc09ea700 1 --2- 172.21.15.36:0/3405736332 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1c940535f0 0x7f1c94055ab0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.305+0000 7f1cc09ea700 1 --2- 172.21.15.36:0/3405736332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc0b9910 0x7f1cbc141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.305+0000 7f1cc09ea700 1 --2- 172.21.15.36:0/3405736332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0b7160 0x7f1cbc141450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.305+0000 7f1cc09ea700 1 --2- 172.21.15.36:0/3405736332 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1cbc0b4370 0x7f1cbc13c060 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.305+0000 7f1cc09ea700 1 -- 172.21.15.36:0/3405736332 >> 172.21.15.36:0/3405736332 conn(0x7f1cbc05ff60 msgr2=0x7f1cbc0b81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:28.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.305+0000 7f1cc09ea700 1 -- 172.21.15.36:0/3405736332 shutdown_connections 2022-01-10T01:33:28.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.305+0000 7f1cc09ea700 1 -- 172.21.15.36:0/3405736332 wait complete. 2022-01-10T01:33:28.549 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:28.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.653+0000 7f850af38700 1 Processor -- start 2022-01-10T01:33:28.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.653+0000 7f850af38700 1 -- start start 2022-01-10T01:33:28.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f850af38700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f85040b2560 0x7f85040a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f850af38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85040b1950 0x7f85041475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f850af38700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850414ac10 con 0x7f850414b2e0 2022-01-10T01:33:28.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f850af38700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85040a8cc0 con 0x7f85040b2560 2022-01-10T01:33:28.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f850af38700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85040b2940 con 0x7f85040b1950 2022-01-10T01:33:28.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f8508cd4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f85040b2560 0x7f85040a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f85094d5700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f850414b2e0 0x7f85040ab7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39790/0 (socket says 172.21.15.36:39790) 2022-01-10T01:33:28.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f85094d5700 1 -- 172.21.15.36:0/135678821 learned_addr learned my addr 172.21.15.36:0/135678821 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:28.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f8503fff700 1 --2- 172.21.15.36:0/135678821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85040b1950 0x7f85041475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f85037fe700 1 -- 172.21.15.36:0/135678821 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851074754 0 0) 0x7f850414ac10 con 0x7f850414b2e0 2022-01-10T01:33:28.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f85037fe700 1 -- 172.21.15.36:0/135678821 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f0003260 con 0x7f850414b2e0 2022-01-10T01:33:28.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f8508cd4700 1 -- 172.21.15.36:0/135678821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85040b1950 msgr2=0x7f85041475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:28.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f8508cd4700 1 --2- 172.21.15.36:0/135678821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85040b1950 0x7f85041475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f8508cd4700 1 -- 172.21.15.36:0/135678821 >> v1:172.21.15.36:6789/0 conn(0x7f850414b2e0 legacy=0x7f85040ab7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f8508cd4700 1 -- 172.21.15.36:0/135678821 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85040b0910 con 0x7f85040b2560 2022-01-10T01:33:28.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f8508cd4700 1 --2- 172.21.15.36:0/135678821 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85040b2560 0x7f85040a7d00 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f84f8002f70 tx=0x7f84f8006df0).ready entity=mon.0 client_cookie=7c63e14111256946 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:28.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f85037fe700 1 -- 172.21.15.36:0/135678821 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f800d4a0 con 0x7f85040b2560 2022-01-10T01:33:28.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f85037fe700 1 -- 172.21.15.36:0/135678821 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f8000e90 con 0x7f85040b2560 2022-01-10T01:33:28.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f85037fe700 1 -- 172.21.15.36:0/135678821 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f800d7f0 con 0x7f85040b2560 2022-01-10T01:33:28.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f850af38700 1 -- 172.21.15.36:0/135678821 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85040b2560 msgr2=0x7f85040a7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f850af38700 1 --2- 172.21.15.36:0/135678821 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85040b2560 0x7f85040a7d00 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f84f8002f70 tx=0x7f84f8006df0).stop 2022-01-10T01:33:28.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f850af38700 1 -- 172.21.15.36:0/135678821 shutdown_connections 2022-01-10T01:33:28.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f850af38700 1 --2- 172.21.15.36:0/135678821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85040b1950 0x7f85041475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f850af38700 1 --2- 172.21.15.36:0/135678821 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85040b2560 0x7f85040a7d00 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f850af38700 1 -- 172.21.15.36:0/135678821 >> 172.21.15.36:0/135678821 conn(0x7f850405ca20 msgr2=0x7f850405ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:28.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f850af38700 1 -- 172.21.15.36:0/135678821 shutdown_connections 2022-01-10T01:33:28.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.657+0000 7f850af38700 1 -- 172.21.15.36:0/135678821 wait complete. 2022-01-10T01:33:28.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f850af38700 1 Processor -- start 2022-01-10T01:33:28.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f850af38700 1 -- start start 2022-01-10T01:33:28.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f850af38700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85040b1950 0x7f85040ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f850af38700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85040b2560 0x7f8504159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f850af38700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f850414b2e0 0x7f850415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f850af38700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85040b4e20 con 0x7f85040b2560 2022-01-10T01:33:28.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f850af38700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85040b5050 con 0x7f85040b1950 2022-01-10T01:33:28.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f850af38700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85040b52f0 con 0x7f850414b2e0 2022-01-10T01:33:28.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f8503fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85040b2560 0x7f8504159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f8503fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85040b2560 0x7f8504159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42000/0 (socket says 172.21.15.36:42000) 2022-01-10T01:33:28.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f8508cd4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85040b1950 0x7f85040ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f8503fff700 1 -- 172.21.15.36:0/1076194087 learned_addr learned my addr 172.21.15.36:0/1076194087 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:28.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f85094d5700 1 --2- 172.21.15.36:0/1076194087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f850414b2e0 0x7f850415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f8503fff700 1 -- 172.21.15.36:0/1076194087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f850414b2e0 msgr2=0x7f850415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f8503fff700 1 --2- 172.21.15.36:0/1076194087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f850414b2e0 0x7f850415a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f8503fff700 1 -- 172.21.15.36:0/1076194087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85040b1950 msgr2=0x7f85040ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f8503fff700 1 --2- 172.21.15.36:0/1076194087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85040b1950 0x7f85040ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.661+0000 7f8503fff700 1 -- 172.21.15.36:0/1076194087 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f800b180 con 0x7f85040b2560 2022-01-10T01:33:28.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.665+0000 7f8503fff700 1 --2- 172.21.15.36:0/1076194087 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85040b2560 0x7f8504159cd0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f84f400c000 tx=0x7f84f4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:28.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.665+0000 7f8501ffb700 1 -- 172.21.15.36:0/1076194087 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f4010780 con 0x7f85040b2560 2022-01-10T01:33:28.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.665+0000 7f8501ffb700 1 -- 172.21.15.36:0/1076194087 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f40108e0 con 0x7f85040b2560 2022-01-10T01:33:28.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.665+0000 7f850af38700 1 -- 172.21.15.36:0/1076194087 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85040b5590 con 0x7f85040b2560 2022-01-10T01:33:28.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.665+0000 7f8501ffb700 1 -- 172.21.15.36:0/1076194087 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84f4010c40 con 0x7f85040b2560 2022-01-10T01:33:28.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.665+0000 7f850af38700 1 -- 172.21.15.36:0/1076194087 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f850415a6b0 con 0x7f85040b2560 2022-01-10T01:33:28.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.665+0000 7f850af38700 1 -- 172.21.15.36:0/1076194087 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f850414ae40 con 0x7f85040b2560 2022-01-10T01:33:28.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.665+0000 7f8501ffb700 1 -- 172.21.15.36:0/1076194087 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f84f401c460 con 0x7f85040b2560 2022-01-10T01:33:28.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.669+0000 7f8501ffb700 1 --2- 172.21.15.36:0/1076194087 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f84e4053560 0x7f84e4055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.669+0000 7f8501ffb700 1 -- 172.21.15.36:0/1076194087 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f84f406bdb0 con 0x7f85040b2560 2022-01-10T01:33:28.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.669+0000 7f8508cd4700 1 --2- 172.21.15.36:0/1076194087 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f84e4053560 0x7f84e4055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.669+0000 7f8508cd4700 1 --2- 172.21.15.36:0/1076194087 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f84e4053560 0x7f84e4055a20 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f84f801a000 tx=0x7f84f8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:28.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.673+0000 7f8501ffb700 1 -- 172.21.15.36:0/1076194087 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f84f4042d60 con 0x7f85040b2560 2022-01-10T01:33:28.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.841+0000 7f850af38700 1 -- 172.21.15.36:0/1076194087 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8504057350 con 0x7f85040b2560 2022-01-10T01:33:28.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.841+0000 7f8501ffb700 1 -- 172.21.15.36:0/1076194087 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f84f4046380 con 0x7f85040b2560 2022-01-10T01:33:28.847 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:28.848 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":66,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8016,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/2824324236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2824324236},{"type":"v1","addr":"172.21.15.36:6835","nonce":2824324236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1768428808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1768428808},{"type":"v1","addr":"172.21.15.36:6837","nonce":1768428808}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:14.392835+0000","modified":"2022-01-10T01:33:15.396812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8028},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8028":{"gid":8028,"name":"b","rank":0,"incarnation":65,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/3822558856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3822558856},{"type":"v1","addr":"172.21.15.59:6833","nonce":3822558856}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2022-01-10T01:33:28.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.841+0000 7f850af38700 1 -- 172.21.15.36:0/1076194087 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f84e4053560 msgr2=0x7f84e4055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.841+0000 7f850af38700 1 --2- 172.21.15.36:0/1076194087 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f84e4053560 0x7f84e4055a20 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f84f801a000 tx=0x7f84f8014000).stop 2022-01-10T01:33:28.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.841+0000 7f850af38700 1 -- 172.21.15.36:0/1076194087 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85040b2560 msgr2=0x7f8504159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.841+0000 7f850af38700 1 --2- 172.21.15.36:0/1076194087 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85040b2560 0x7f8504159cd0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f84f400c000 tx=0x7f84f4006df0).stop 2022-01-10T01:33:28.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.841+0000 7f850af38700 1 -- 172.21.15.36:0/1076194087 shutdown_connections 2022-01-10T01:33:28.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.841+0000 7f850af38700 1 --2- 172.21.15.36:0/1076194087 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f84e4053560 0x7f84e4055a20 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.841+0000 7f850af38700 1 --2- 172.21.15.36:0/1076194087 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f850414b2e0 0x7f850415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.841+0000 7f850af38700 1 --2- 172.21.15.36:0/1076194087 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f85040b2560 0x7f8504159cd0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.841+0000 7f850af38700 1 --2- 172.21.15.36:0/1076194087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85040b1950 0x7f85040ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.841+0000 7f850af38700 1 -- 172.21.15.36:0/1076194087 >> 172.21.15.36:0/1076194087 conn(0x7f850405ca20 msgr2=0x7f8504149b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:28.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.841+0000 7f850af38700 1 -- 172.21.15.36:0/1076194087 shutdown_connections 2022-01-10T01:33:28.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.841+0000 7f850af38700 1 -- 172.21.15.36:0/1076194087 wait complete. 2022-01-10T01:33:28.852 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 66 2022-01-10T01:33:28.860 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2022-01-10T01:33:28.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f4878910700 1 Processor -- start 2022-01-10T01:33:28.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f4878910700 1 -- start start 2022-01-10T01:33:28.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f4878910700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4874140a00 0x7f4874143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f4878910700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f48740b4b40 0x7f48740b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f4878910700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48740b68f0 con 0x7f48740b6510 2022-01-10T01:33:28.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f4878910700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4874143fb0 con 0x7f48740b4b40 2022-01-10T01:33:28.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f4878910700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48740ae660 con 0x7f4874140a00 2022-01-10T01:33:28.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f487359e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f48740b4b40 0x7f48740b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f4872d9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f48740b6510 0x7f48741402f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39800/0 (socket says 172.21.15.36:39800) 2022-01-10T01:33:28.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f4872d9d700 1 -- 172.21.15.36:0/2499567075 learned_addr learned my addr 172.21.15.36:0/2499567075 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:28.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f487259c700 1 --2- 172.21.15.36:0/2499567075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4874140a00 0x7f4874143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f4871d9b700 1 -- 172.21.15.36:0/2499567075 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288948916 0 0) 0x7f48740b68f0 con 0x7f48740b6510 2022-01-10T01:33:28.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f4871d9b700 1 -- 172.21.15.36:0/2499567075 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4854003260 con 0x7f48740b6510 2022-01-10T01:33:28.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f487359e700 1 -- 172.21.15.36:0/2499567075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4874140a00 msgr2=0x7f4874143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:28.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f487359e700 1 --2- 172.21.15.36:0/2499567075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4874140a00 0x7f4874143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f487359e700 1 -- 172.21.15.36:0/2499567075 >> v1:172.21.15.36:6789/0 conn(0x7f48740b6510 legacy=0x7f48741402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f487359e700 1 -- 172.21.15.36:0/2499567075 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48740ae900 con 0x7f48740b4b40 2022-01-10T01:33:28.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f487359e700 1 --2- 172.21.15.36:0/2499567075 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48740b4b40 0x7f48740b4fb0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f486c002f70 tx=0x7f486c006df0).ready entity=mon.0 client_cookie=eccbb99132dc9bf1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:28.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f4871d9b700 1 -- 172.21.15.36:0/2499567075 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f486c00d4a0 con 0x7f48740b4b40 2022-01-10T01:33:28.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f4871d9b700 1 -- 172.21.15.36:0/2499567075 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c000e90 con 0x7f48740b4b40 2022-01-10T01:33:28.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.961+0000 7f4871d9b700 1 -- 172.21.15.36:0/2499567075 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f486c00d7f0 con 0x7f48740b4b40 2022-01-10T01:33:28.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 -- 172.21.15.36:0/2499567075 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48740b4b40 msgr2=0x7f48740b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 --2- 172.21.15.36:0/2499567075 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48740b4b40 0x7f48740b4fb0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f486c002f70 tx=0x7f486c006df0).stop 2022-01-10T01:33:28.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 -- 172.21.15.36:0/2499567075 shutdown_connections 2022-01-10T01:33:28.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 --2- 172.21.15.36:0/2499567075 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f48740b4b40 0x7f48740b4fb0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 --2- 172.21.15.36:0/2499567075 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4874140a00 0x7f4874143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 -- 172.21.15.36:0/2499567075 >> 172.21.15.36:0/2499567075 conn(0x7f487405f8c0 msgr2=0x7f48740614b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:28.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 -- 172.21.15.36:0/2499567075 shutdown_connections 2022-01-10T01:33:28.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 -- 172.21.15.36:0/2499567075 wait complete. 2022-01-10T01:33:28.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 Processor -- start 2022-01-10T01:33:28.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 -- start start 2022-01-10T01:33:28.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48740b4b40 0x7f4874156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48740b6510 0x7f487413eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4874140a00 0x7f487413b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4874156580 con 0x7f4874140a00 2022-01-10T01:33:28.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4874152200 con 0x7f48740b6510 2022-01-10T01:33:28.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48741524a0 con 0x7f48740b4b40 2022-01-10T01:33:28.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f487359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4874140a00 0x7f487413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f487359e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4874140a00 0x7f487413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42016/0 (socket says 172.21.15.36:42016) 2022-01-10T01:33:28.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f487359e700 1 -- 172.21.15.36:0/4265349036 learned_addr learned my addr 172.21.15.36:0/4265349036 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:28.982 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f487259c700 1 --2- 172.21.15.36:0/4265349036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48740b6510 0x7f487413eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4872d9d700 1 --2- 172.21.15.36:0/4265349036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48740b4b40 0x7f4874156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f487359e700 1 -- 172.21.15.36:0/4265349036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48740b4b40 msgr2=0x7f4874156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f487359e700 1 --2- 172.21.15.36:0/4265349036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48740b4b40 0x7f4874156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.983 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f487359e700 1 -- 172.21.15.36:0/4265349036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48740b6510 msgr2=0x7f487413eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:28.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f487359e700 1 --2- 172.21.15.36:0/4265349036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48740b6510 0x7f487413eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:28.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f487359e700 1 -- 172.21.15.36:0/4265349036 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c00b180 con 0x7f4874140a00 2022-01-10T01:33:28.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f487359e700 1 --2- 172.21.15.36:0/4265349036 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4874140a00 0x7f487413b990 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f486c002f70 tx=0x7f486c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:28.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f486bfff700 1 -- 172.21.15.36:0/4265349036 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f486c012930 con 0x7f4874140a00 2022-01-10T01:33:28.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f486bfff700 1 -- 172.21.15.36:0/4265349036 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c012a90 con 0x7f4874140a00 2022-01-10T01:33:28.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f486bfff700 1 -- 172.21.15.36:0/4265349036 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f486c012df0 con 0x7f4874140a00 2022-01-10T01:33:28.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 -- 172.21.15.36:0/4265349036 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4874152740 con 0x7f4874140a00 2022-01-10T01:33:28.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.965+0000 7f4878910700 1 -- 172.21.15.36:0/4265349036 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4874152e80 con 0x7f4874140a00 2022-01-10T01:33:28.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.969+0000 7f4878910700 1 -- 172.21.15.36:0/4265349036 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48740aeba0 con 0x7f4874140a00 2022-01-10T01:33:28.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.969+0000 7f486bfff700 1 -- 172.21.15.36:0/4265349036 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f486c01c070 con 0x7f4874140a00 2022-01-10T01:33:28.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.969+0000 7f486bfff700 1 --2- 172.21.15.36:0/4265349036 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f48580536b0 0x7f4858055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:28.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.969+0000 7f486bfff700 1 -- 172.21.15.36:0/4265349036 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f486c06cf40 con 0x7f4874140a00 2022-01-10T01:33:28.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.969+0000 7f4872d9d700 1 --2- 172.21.15.36:0/4265349036 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f48580536b0 0x7f4858055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:28.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.969+0000 7f4872d9d700 1 --2- 172.21.15.36:0/4265349036 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f48580536b0 0x7f4858055b70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f486400d000 tx=0x7f4864009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:28.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:28.973+0000 7f486bfff700 1 -- 172.21.15.36:0/4265349036 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f486c047870 con 0x7f4874140a00 2022-01-10T01:33:29.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.137+0000 7f4878910700 1 -- 172.21.15.36:0/4265349036 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4874057350 con 0x7f4874140a00 2022-01-10T01:33:29.365 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:33:29.357+0000 7f0b5376f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:33:29.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.377+0000 7f486bfff700 1 -- 172.21.15.36:0/4265349036 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v67) v1 ==== 161+0+0 (secure 0 0 0) 0x7f486c02c020 con 0x7f4874140a00 2022-01-10T01:33:29.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.381+0000 7f4878910700 1 -- 172.21.15.36:0/4265349036 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f48580536b0 msgr2=0x7f4858055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:29.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.381+0000 7f4878910700 1 --2- 172.21.15.36:0/4265349036 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f48580536b0 0x7f4858055b70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f486400d000 tx=0x7f4864009040).stop 2022-01-10T01:33:29.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.381+0000 7f4878910700 1 -- 172.21.15.36:0/4265349036 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4874140a00 msgr2=0x7f487413b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:29.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.381+0000 7f4878910700 1 --2- 172.21.15.36:0/4265349036 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4874140a00 0x7f487413b990 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7f486c002f70 tx=0x7f486c014000).stop 2022-01-10T01:33:29.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.381+0000 7f4878910700 1 -- 172.21.15.36:0/4265349036 shutdown_connections 2022-01-10T01:33:29.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.381+0000 7f4878910700 1 --2- 172.21.15.36:0/4265349036 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f48580536b0 0x7f4858055b70 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.381+0000 7f4878910700 1 --2- 172.21.15.36:0/4265349036 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4874140a00 0x7f487413b990 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.381+0000 7f4878910700 1 --2- 172.21.15.36:0/4265349036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48740b6510 0x7f487413eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.381+0000 7f4878910700 1 --2- 172.21.15.36:0/4265349036 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48740b4b40 0x7f4874156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.381+0000 7f4878910700 1 -- 172.21.15.36:0/4265349036 >> 172.21.15.36:0/4265349036 conn(0x7f487405f8c0 msgr2=0x7f48740b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:29.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.381+0000 7f4878910700 1 -- 172.21.15.36:0/4265349036 shutdown_connections 2022-01-10T01:33:29.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.381+0000 7f4878910700 1 -- 172.21.15.36:0/4265349036 wait complete. 2022-01-10T01:33:29.391 INFO:teuthology.orchestra.run.smithi036.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2022-01-10T01:33:29.403 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:29.420 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:33:29.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.509+0000 7f18b487e700 1 Processor -- start 2022-01-10T01:33:29.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.509+0000 7f18b487e700 1 -- start start 2022-01-10T01:33:29.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18b487e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18b005cce0 0x7f18b005d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:29.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18b487e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f18b00b1610 0x7f18b013f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:29.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18b487e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b013d180 con 0x7f18b00b1b40 2022-01-10T01:33:29.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18b487e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b0067410 con 0x7f18b00b1610 2022-01-10T01:33:29.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18b487e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b0062a40 con 0x7f18b005cce0 2022-01-10T01:33:29.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18affff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f18b00b1610 0x7f18b013f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:29.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18a7fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f18b00b1b40 0x7f18b00b2cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39814/0 (socket says 172.21.15.36:39814) 2022-01-10T01:33:29.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18affff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f18b00b1610 0x7f18b013f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42024/0 (socket says 172.21.15.36:42024) 2022-01-10T01:33:29.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18a7fff700 1 -- 172.21.15.36:0/1149773335 learned_addr learned my addr 172.21.15.36:0/1149773335 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:29.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18af7fe700 1 --2- 172.21.15.36:0/1149773335 >> v2:172.21.15.59:3300/0 conn(0x7f18b005cce0 0x7f18b005d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:29.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18affff700 1 -- 172.21.15.36:0/1149773335 >> v2:172.21.15.59:3300/0 conn(0x7f18b005cce0 msgr2=0x7f18b005d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:29.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18affff700 1 --2- 172.21.15.36:0/1149773335 >> v2:172.21.15.59:3300/0 conn(0x7f18b005cce0 0x7f18b005d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18affff700 1 -- 172.21.15.36:0/1149773335 >> v1:172.21.15.36:6789/0 conn(0x7f18b00b1b40 legacy=0x7f18b00b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:29.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18affff700 1 -- 172.21.15.36:0/1149773335 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b00b2520 con 0x7f18b00b1610 2022-01-10T01:33:29.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18aeffd700 1 -- 172.21.15.36:0/1149773335 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34999731 0 0) 0x7f18b013d180 con 0x7f18b00b1b40 2022-01-10T01:33:29.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18affff700 1 --2- 172.21.15.36:0/1149773335 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18b00b1610 0x7f18b013f940 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f18a80032f0 tx=0x7f18a80091d0).ready entity=mon.0 client_cookie=9703212a40e2bc3b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:29.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18aeffd700 1 -- 172.21.15.36:0/1149773335 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18a800b680 con 0x7f18b00b1610 2022-01-10T01:33:29.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18aeffd700 1 -- 172.21.15.36:0/1149773335 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a800b7e0 con 0x7f18b00b1610 2022-01-10T01:33:29.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18aeffd700 1 -- 172.21.15.36:0/1149773335 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18a800b950 con 0x7f18b00b1610 2022-01-10T01:33:29.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18b487e700 1 -- 172.21.15.36:0/1149773335 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18b00b1610 msgr2=0x7f18b013f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:29.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18b487e700 1 --2- 172.21.15.36:0/1149773335 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18b00b1610 0x7f18b013f940 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f18a80032f0 tx=0x7f18a80091d0).stop 2022-01-10T01:33:29.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18b487e700 1 -- 172.21.15.36:0/1149773335 shutdown_connections 2022-01-10T01:33:29.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18b487e700 1 --2- 172.21.15.36:0/1149773335 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18b00b1610 0x7f18b013f940 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18b487e700 1 --2- 172.21.15.36:0/1149773335 >> v2:172.21.15.59:3300/0 conn(0x7f18b005cce0 0x7f18b005d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18b487e700 1 -- 172.21.15.36:0/1149773335 >> 172.21.15.36:0/1149773335 conn(0x7f18b0060180 msgr2=0x7f18b005c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:29.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18b487e700 1 -- 172.21.15.36:0/1149773335 shutdown_connections 2022-01-10T01:33:29.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.513+0000 7f18b487e700 1 -- 172.21.15.36:0/1149773335 wait complete. 2022-01-10T01:33:29.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.517+0000 7f18b487e700 1 Processor -- start 2022-01-10T01:33:29.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.517+0000 7f18b487e700 1 -- start start 2022-01-10T01:33:29.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.517+0000 7f18b487e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18b005cce0 0x7f18b012c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:29.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.517+0000 7f18b487e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b00b1610 0x7f18b00abf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:29.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.517+0000 7f18b487e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18b00b1b40 0x7f18b00ac450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:29.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.517+0000 7f18b487e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b012a550 con 0x7f18b00b1b40 2022-01-10T01:33:29.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.517+0000 7f18b487e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b0127b50 con 0x7f18b00b1610 2022-01-10T01:33:29.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.517+0000 7f18b487e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00ac940 con 0x7f18b005cce0 2022-01-10T01:33:29.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.517+0000 7f18affff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18b00b1b40 0x7f18b00ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:29.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.517+0000 7f18af7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18b005cce0 0x7f18b012c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:29.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.517+0000 7f18a7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b00b1610 0x7f18b00abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:29.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.517+0000 7f18affff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18b00b1b40 0x7f18b00ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42030/0 (socket says 172.21.15.36:42030) 2022-01-10T01:33:29.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.517+0000 7f18affff700 1 -- 172.21.15.36:0/1525359658 learned_addr learned my addr 172.21.15.36:0/1525359658 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:29.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18affff700 1 -- 172.21.15.36:0/1525359658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18b005cce0 msgr2=0x7f18b012c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:29.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18affff700 1 --2- 172.21.15.36:0/1525359658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18b005cce0 0x7f18b012c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18affff700 1 -- 172.21.15.36:0/1525359658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b00b1610 msgr2=0x7f18b00abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:29.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18affff700 1 --2- 172.21.15.36:0/1525359658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b00b1610 0x7f18b00abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18affff700 1 -- 172.21.15.36:0/1525359658 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a8009470 con 0x7f18b00b1b40 2022-01-10T01:33:29.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18affff700 1 --2- 172.21.15.36:0/1525359658 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18b00b1b40 0x7f18b00ac450 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f18a80032f0 tx=0x7f18a8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:29.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18ad7fa700 1 -- 172.21.15.36:0/1525359658 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18a8011cc0 con 0x7f18b00b1b40 2022-01-10T01:33:29.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18ad7fa700 1 -- 172.21.15.36:0/1525359658 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a8011e20 con 0x7f18b00b1b40 2022-01-10T01:33:29.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18b487e700 1 -- 172.21.15.36:0/1525359658 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b01299c0 con 0x7f18b00b1b40 2022-01-10T01:33:29.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18ad7fa700 1 -- 172.21.15.36:0/1525359658 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18a801e5f0 con 0x7f18b00b1b40 2022-01-10T01:33:29.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18b487e700 1 -- 172.21.15.36:0/1525359658 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b01283c0 con 0x7f18b00b1b40 2022-01-10T01:33:29.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18ad7fa700 1 -- 172.21.15.36:0/1525359658 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f18a800f070 con 0x7f18b00b1b40 2022-01-10T01:33:29.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18b487e700 1 -- 172.21.15.36:0/1525359658 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b012a6c0 con 0x7f18b00b1b40 2022-01-10T01:33:29.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18ad7fa700 1 --2- 172.21.15.36:0/1525359658 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f18940535f0 0x7f1894055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:29.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18ad7fa700 1 -- 172.21.15.36:0/1525359658 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f18a806e970 con 0x7f18b00b1b40 2022-01-10T01:33:29.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.521+0000 7f18af7fe700 1 --2- 172.21.15.36:0/1525359658 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f18940535f0 0x7f1894055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:29.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.525+0000 7f18af7fe700 1 --2- 172.21.15.36:0/1525359658 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f18940535f0 0x7f1894055ab0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f18a000b000 tx=0x7f18a0006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:29.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.529+0000 7f18ad7fa700 1 -- 172.21.15.36:0/1525359658 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f18b012a6c0 con 0x7f18b00b1b40 2022-01-10T01:33:29.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.693+0000 7f18b487e700 1 -- 172.21.15.36:0/1525359658 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18b012a690 con 0x7f18b00b1b40 2022-01-10T01:33:29.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.693+0000 7f18ad7fa700 1 -- 172.21.15.36:0/1525359658 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f18a8022090 con 0x7f18b00b1b40 2022-01-10T01:33:29.702 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:29.702 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":67,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8016,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/2824324236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2824324236},{"type":"v1","addr":"172.21.15.36:6835","nonce":2824324236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1768428808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1768428808},{"type":"v1","addr":"172.21.15.36:6837","nonce":1768428808}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64}],"filesystems":[{"mdsmap":{"epoch":67,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:14.392835+0000","modified":"2022-01-10T01:33:29.363375+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":140,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2022-01-10T01:33:29.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.697+0000 7f18b487e700 1 -- 172.21.15.36:0/1525359658 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f18940535f0 msgr2=0x7f1894055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:29.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.697+0000 7f18b487e700 1 --2- 172.21.15.36:0/1525359658 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f18940535f0 0x7f1894055ab0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f18a000b000 tx=0x7f18a0006df0).stop 2022-01-10T01:33:29.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.697+0000 7f18b487e700 1 -- 172.21.15.36:0/1525359658 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18b00b1b40 msgr2=0x7f18b00ac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:29.705 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.697+0000 7f18b487e700 1 --2- 172.21.15.36:0/1525359658 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18b00b1b40 0x7f18b00ac450 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f18a80032f0 tx=0x7f18a8016000).stop 2022-01-10T01:33:29.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.697+0000 7f18b487e700 1 -- 172.21.15.36:0/1525359658 shutdown_connections 2022-01-10T01:33:29.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.697+0000 7f18b487e700 1 --2- 172.21.15.36:0/1525359658 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f18940535f0 0x7f1894055ab0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.697+0000 7f18b487e700 1 --2- 172.21.15.36:0/1525359658 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f18b00b1b40 0x7f18b00ac450 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.697+0000 7f18b487e700 1 --2- 172.21.15.36:0/1525359658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b00b1610 0x7f18b00abf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.697+0000 7f18b487e700 1 --2- 172.21.15.36:0/1525359658 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18b005cce0 0x7f18b012c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.697+0000 7f18b487e700 1 -- 172.21.15.36:0/1525359658 >> 172.21.15.36:0/1525359658 conn(0x7f18b0060180 msgr2=0x7f18b00b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:29.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.697+0000 7f18b487e700 1 -- 172.21.15.36:0/1525359658 shutdown_connections 2022-01-10T01:33:29.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.697+0000 7f18b487e700 1 -- 172.21.15.36:0/1525359658 wait complete. 2022-01-10T01:33:29.708 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 67 2022-01-10T01:33:29.720 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:33:29.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.821+0000 7f16c6d1b700 1 Processor -- start 2022-01-10T01:33:29.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.821+0000 7f16c6d1b700 1 -- start start 2022-01-10T01:33:29.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.821+0000 7f16c6d1b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f16c00afac0 0x7f16c013dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:29.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.821+0000 7f16c6d1b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16c00640f0 0x7f16c013e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:29.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.821+0000 7f16c6d1b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c00b6aa0 con 0x7f16c00b66c0 2022-01-10T01:33:29.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.821+0000 7f16c6d1b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c00602d0 con 0x7f16c00afac0 2022-01-10T01:33:29.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.821+0000 7f16c6d1b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c00639f0 con 0x7f16c00640f0 2022-01-10T01:33:29.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.821+0000 7f16c5518700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f16c00afac0 0x7f16c013dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:29.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.821+0000 7f16c5518700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f16c00afac0 0x7f16c013dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42036/0 (socket says 172.21.15.36:42036) 2022-01-10T01:33:29.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.821+0000 7f16c5518700 1 -- 172.21.15.36:0/3138722187 learned_addr learned my addr 172.21.15.36:0/3138722187 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:29.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.821+0000 7f16c5d19700 1 --1- 172.21.15.36:0/3138722187 >> v1:172.21.15.36:6789/0 conn(0x7f16c00b66c0 0x7f16c0144320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39828/0 (socket says 172.21.15.36:39828) 2022-01-10T01:33:29.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c651a700 1 --2- 172.21.15.36:0/3138722187 >> v2:172.21.15.59:3300/0 conn(0x7f16c00640f0 0x7f16c013e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:29.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c5518700 1 -- 172.21.15.36:0/3138722187 >> v2:172.21.15.59:3300/0 conn(0x7f16c00640f0 msgr2=0x7f16c013e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:29.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c5518700 1 --2- 172.21.15.36:0/3138722187 >> v2:172.21.15.59:3300/0 conn(0x7f16c00640f0 0x7f16c013e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c5518700 1 -- 172.21.15.36:0/3138722187 >> v1:172.21.15.36:6789/0 conn(0x7f16c00b66c0 legacy=0x7f16c0144320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:29.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c5518700 1 -- 172.21.15.36:0/3138722187 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c0060030 con 0x7f16c00afac0 2022-01-10T01:33:29.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c5518700 1 --2- 172.21.15.36:0/3138722187 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16c00afac0 0x7f16c013dfb0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f16bc002f70 tx=0x7f16bc006eb0).ready entity=mon.0 client_cookie=3f87ad6d4af7ee9e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:29.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c4d17700 1 -- 172.21.15.36:0/3138722187 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16bc00d610 con 0x7f16c00afac0 2022-01-10T01:33:29.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c4d17700 1 -- 172.21.15.36:0/3138722187 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc000e90 con 0x7f16c00afac0 2022-01-10T01:33:29.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c4d17700 1 -- 172.21.15.36:0/3138722187 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16bc00d9a0 con 0x7f16c00afac0 2022-01-10T01:33:29.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 -- 172.21.15.36:0/3138722187 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16c00afac0 msgr2=0x7f16c013dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:29.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 --2- 172.21.15.36:0/3138722187 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16c00afac0 0x7f16c013dfb0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7f16bc002f70 tx=0x7f16bc006eb0).stop 2022-01-10T01:33:29.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 -- 172.21.15.36:0/3138722187 shutdown_connections 2022-01-10T01:33:29.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 --2- 172.21.15.36:0/3138722187 >> v2:172.21.15.59:3300/0 conn(0x7f16c00640f0 0x7f16c013e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 --2- 172.21.15.36:0/3138722187 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16c00afac0 0x7f16c013dfb0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 -- 172.21.15.36:0/3138722187 >> 172.21.15.36:0/3138722187 conn(0x7f16c005c720 msgr2=0x7f16c005cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:29.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 -- 172.21.15.36:0/3138722187 shutdown_connections 2022-01-10T01:33:29.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 -- 172.21.15.36:0/3138722187 wait complete. 2022-01-10T01:33:29.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 Processor -- start 2022-01-10T01:33:29.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 -- start start 2022-01-10T01:33:29.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c00640f0 0x7f16c013fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:29.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16c00afac0 0x7f16c00ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:29.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16c00b66c0 0x7f16c0152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:29.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01500d0 con 0x7f16c00afac0 2022-01-10T01:33:29.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0144f70 con 0x7f16c00640f0 2022-01-10T01:33:29.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c6d1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0156630 con 0x7f16c00b66c0 2022-01-10T01:33:29.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.825+0000 7f16c5518700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16c00afac0 0x7f16c00ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:29.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16c5518700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16c00afac0 0x7f16c00ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42040/0 (socket says 172.21.15.36:42040) 2022-01-10T01:33:29.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16c5518700 1 -- 172.21.15.36:0/2934349675 learned_addr learned my addr 172.21.15.36:0/2934349675 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:29.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16c651a700 1 --2- 172.21.15.36:0/2934349675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16c00b66c0 0x7f16c0152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:29.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16c5d19700 1 --2- 172.21.15.36:0/2934349675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c00640f0 0x7f16c013fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:29.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16c5518700 1 -- 172.21.15.36:0/2934349675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16c00b66c0 msgr2=0x7f16c0152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:29.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16c5518700 1 --2- 172.21.15.36:0/2934349675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16c00b66c0 0x7f16c0152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16c5518700 1 -- 172.21.15.36:0/2934349675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c00640f0 msgr2=0x7f16c013fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:29.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16c5518700 1 --2- 172.21.15.36:0/2934349675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c00640f0 0x7f16c013fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:29.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16c5518700 1 -- 172.21.15.36:0/2934349675 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc00b1e0 con 0x7f16c00afac0 2022-01-10T01:33:29.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16c5518700 1 --2- 172.21.15.36:0/2934349675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16c00afac0 0x7f16c00ae810 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f16bc002f70 tx=0x7f16bc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:29.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16aeffd700 1 -- 172.21.15.36:0/2934349675 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16bc011860 con 0x7f16c00afac0 2022-01-10T01:33:29.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16aeffd700 1 -- 172.21.15.36:0/2934349675 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc0119c0 con 0x7f16c00afac0 2022-01-10T01:33:29.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16aeffd700 1 -- 172.21.15.36:0/2934349675 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16bc011d20 con 0x7f16c00afac0 2022-01-10T01:33:29.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16c6d1b700 1 -- 172.21.15.36:0/2934349675 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c0156350 con 0x7f16c00afac0 2022-01-10T01:33:29.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16c6d1b700 1 -- 172.21.15.36:0/2934349675 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c01523b0 con 0x7f16c00afac0 2022-01-10T01:33:29.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16c6d1b700 1 -- 172.21.15.36:0/2934349675 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c0145130 con 0x7f16c00afac0 2022-01-10T01:33:29.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.829+0000 7f16aeffd700 1 -- 172.21.15.36:0/2934349675 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f16bc01a040 con 0x7f16c00afac0 2022-01-10T01:33:29.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.833+0000 7f16aeffd700 1 --2- 172.21.15.36:0/2934349675 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f16a0053680 0x7f16a0055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:29.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.833+0000 7f16aeffd700 1 -- 172.21.15.36:0/2934349675 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f16bc06c910 con 0x7f16c00afac0 2022-01-10T01:33:29.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.833+0000 7f16c5d19700 1 --2- 172.21.15.36:0/2934349675 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f16a0053680 0x7f16a0055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:29.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.833+0000 7f16c5d19700 1 --2- 172.21.15.36:0/2934349675 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f16a0053680 0x7f16a0055b40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f16b000d000 tx=0x7f16b0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:29.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:29.837+0000 7f16aeffd700 1 -- 172.21.15.36:0/2934349675 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f16bc0438d0 con 0x7f16c00afac0 2022-01-10T01:33:30.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.001+0000 7f16c6d1b700 1 -- 172.21.15.36:0/2934349675 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f16c00af450 con 0x7f16c00afac0 2022-01-10T01:33:30.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.385+0000 7f16aeffd700 1 -- 172.21.15.36:0/2934349675 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7f16bc0230a0 con 0x7f16c00afac0 2022-01-10T01:33:30.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.389+0000 7f16c6d1b700 1 -- 172.21.15.36:0/2934349675 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f16a0053680 msgr2=0x7f16a0055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:30.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.389+0000 7f16c6d1b700 1 --2- 172.21.15.36:0/2934349675 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f16a0053680 0x7f16a0055b40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f16b000d000 tx=0x7f16b0009040).stop 2022-01-10T01:33:30.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.389+0000 7f16c6d1b700 1 -- 172.21.15.36:0/2934349675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16c00afac0 msgr2=0x7f16c00ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:30.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.389+0000 7f16c6d1b700 1 --2- 172.21.15.36:0/2934349675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16c00afac0 0x7f16c00ae810 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f16bc002f70 tx=0x7f16bc015000).stop 2022-01-10T01:33:30.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.389+0000 7f16c6d1b700 1 -- 172.21.15.36:0/2934349675 shutdown_connections 2022-01-10T01:33:30.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.389+0000 7f16c6d1b700 1 --2- 172.21.15.36:0/2934349675 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f16a0053680 0x7f16a0055b40 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:30.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.389+0000 7f16c6d1b700 1 --2- 172.21.15.36:0/2934349675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16c00b66c0 0x7f16c0152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:30.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.389+0000 7f16c6d1b700 1 --2- 172.21.15.36:0/2934349675 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16c00afac0 0x7f16c00ae810 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:30.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.389+0000 7f16c6d1b700 1 --2- 172.21.15.36:0/2934349675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c00640f0 0x7f16c013fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:30.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.389+0000 7f16c6d1b700 1 -- 172.21.15.36:0/2934349675 >> 172.21.15.36:0/2934349675 conn(0x7f16c005c720 msgr2=0x7f16c0141620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:30.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.389+0000 7f16c6d1b700 1 -- 172.21.15.36:0/2934349675 shutdown_connections 2022-01-10T01:33:30.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.389+0000 7f16c6d1b700 1 -- 172.21.15.36:0/2934349675 wait complete. 2022-01-10T01:33:30.407 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:33:30.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.521+0000 7f2334e6b700 1 Processor -- start 2022-01-10T01:33:30.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.521+0000 7f2334e6b700 1 -- start start 2022-01-10T01:33:30.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f2334e6b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23300addc0 0x7f2330144180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:30.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f2334e6b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23300ae1a0 con 0x7f23300b2000 2022-01-10T01:33:30.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f2334e6b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23300b24a0 con 0x7f23300b1420 2022-01-10T01:33:30.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f2334e6b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23301437a0 con 0x7f23300addc0 2022-01-10T01:33:30.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f2327fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f23300b2000 0x7f23300af6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39844/0 (socket says 172.21.15.36:39844) 2022-01-10T01:33:30.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f2327fff700 1 -- 172.21.15.36:0/3577664506 learned_addr learned my addr 172.21.15.36:0/3577664506 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:30.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f232e59c700 1 --2- 172.21.15.36:0/3577664506 >> v2:172.21.15.59:3300/0 conn(0x7f23300addc0 0x7f2330144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:30.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f232dd9b700 1 -- 172.21.15.36:0/3577664506 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997531809 0 0) 0x7f23300ae1a0 con 0x7f23300b2000 2022-01-10T01:33:30.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f232dd9b700 1 -- 172.21.15.36:0/3577664506 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2310003260 con 0x7f23300b2000 2022-01-10T01:33:30.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f232e59c700 1 -- 172.21.15.36:0/3577664506 >> v1:172.21.15.59:6789/0 conn(0x7f23300b1420 legacy=0x7f23300b0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:30.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f232e59c700 1 -- 172.21.15.36:0/3577664506 >> v1:172.21.15.36:6789/0 conn(0x7f23300b2000 legacy=0x7f23300af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:30.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f232e59c700 1 -- 172.21.15.36:0/3577664506 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2330143a40 con 0x7f23300addc0 2022-01-10T01:33:30.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f232e59c700 1 --2- 172.21.15.36:0/3577664506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23300addc0 0x7f2330144180 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f2320002f70 tx=0x7f2320006df0).ready entity=mon.1 client_cookie=1e9c2f9fc585054d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:30.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f232dd9b700 1 -- 172.21.15.36:0/3577664506 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f232000d610 con 0x7f23300addc0 2022-01-10T01:33:30.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f232dd9b700 1 -- 172.21.15.36:0/3577664506 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2320000e90 con 0x7f23300addc0 2022-01-10T01:33:30.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f232dd9b700 1 -- 172.21.15.36:0/3577664506 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f232000d960 con 0x7f23300addc0 2022-01-10T01:33:30.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f2334e6b700 1 -- 172.21.15.36:0/3577664506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23300addc0 msgr2=0x7f2330144180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:30.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f2334e6b700 1 --2- 172.21.15.36:0/3577664506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23300addc0 0x7f2330144180 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f2320002f70 tx=0x7f2320006df0).stop 2022-01-10T01:33:30.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f2334e6b700 1 -- 172.21.15.36:0/3577664506 shutdown_connections 2022-01-10T01:33:30.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f2334e6b700 1 --2- 172.21.15.36:0/3577664506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23300addc0 0x7f2330144180 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:30.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f2334e6b700 1 -- 172.21.15.36:0/3577664506 >> 172.21.15.36:0/3577664506 conn(0x7f233005bd40 msgr2=0x7f233005c150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:30.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f2334e6b700 1 -- 172.21.15.36:0/3577664506 shutdown_connections 2022-01-10T01:33:30.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.525+0000 7f2334e6b700 1 -- 172.21.15.36:0/3577664506 wait complete. 2022-01-10T01:33:30.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f2334e6b700 1 Processor -- start 2022-01-10T01:33:30.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f2334e6b700 1 -- start start 2022-01-10T01:33:30.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f2334e6b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23300addc0 0x7f233005f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:30.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f2334e6b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23300b1420 0x7f233009e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:30.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f2334e6b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23300b2000 0x7f233009eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:30.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f2334e6b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23300a3d60 con 0x7f23300addc0 2022-01-10T01:33:30.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f2334e6b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23300a3380 con 0x7f23300b2000 2022-01-10T01:33:30.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f2334e6b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23300a3620 con 0x7f23300b1420 2022-01-10T01:33:30.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f232e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23300addc0 0x7f233005f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:30.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f232e59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23300addc0 0x7f233005f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42054/0 (socket says 172.21.15.36:42054) 2022-01-10T01:33:30.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f232e59c700 1 -- 172.21.15.36:0/1443493913 learned_addr learned my addr 172.21.15.36:0/1443493913 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:30.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f2327fff700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23300b1420 0x7f233009e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:30.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f232ed9d700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23300b2000 0x7f233009eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:30.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f232e59c700 1 -- 172.21.15.36:0/1443493913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23300b1420 msgr2=0x7f233009e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:30.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f232e59c700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23300b1420 0x7f233009e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:30.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f232e59c700 1 -- 172.21.15.36:0/1443493913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23300b2000 msgr2=0x7f233009eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:30.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f232e59c700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23300b2000 0x7f233009eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:30.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f232e59c700 1 -- 172.21.15.36:0/1443493913 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232000b180 con 0x7f23300addc0 2022-01-10T01:33:30.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f232ed9d700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23300b2000 0x7f233009eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:30.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f232e59c700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23300addc0 0x7f233005f6b0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f2320002f70 tx=0x7f2320014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:30.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f23277fe700 1 -- 172.21.15.36:0/1443493913 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f232000d290 con 0x7f23300addc0 2022-01-10T01:33:30.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f23277fe700 1 -- 172.21.15.36:0/1443493913 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232001e400 con 0x7f23300addc0 2022-01-10T01:33:30.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f2334e6b700 1 -- 172.21.15.36:0/1443493913 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23300a38c0 con 0x7f23300addc0 2022-01-10T01:33:30.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f23277fe700 1 -- 172.21.15.36:0/1443493913 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f232001e760 con 0x7f23300addc0 2022-01-10T01:33:30.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.529+0000 7f2334e6b700 1 -- 172.21.15.36:0/1443493913 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233009f3d0 con 0x7f23300addc0 2022-01-10T01:33:30.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.533+0000 7f2334e6b700 1 -- 172.21.15.36:0/1443493913 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23300a3a50 con 0x7f23300addc0 2022-01-10T01:33:30.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.533+0000 7f23277fe700 1 -- 172.21.15.36:0/1443493913 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2320025030 con 0x7f23300addc0 2022-01-10T01:33:30.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.533+0000 7f23277fe700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2314053560 0x7f2314055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:30.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.533+0000 7f23277fe700 1 -- 172.21.15.36:0/1443493913 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f232006c9f0 con 0x7f23300addc0 2022-01-10T01:33:30.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.533+0000 7f2327fff700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2314053560 0x7f2314055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:30.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.533+0000 7f2327fff700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2314053560 0x7f2314055a20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f231800b000 tx=0x7f2318009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:30.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.537+0000 7f23277fe700 1 -- 172.21.15.36:0/1443493913 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f232006ee60 con 0x7f23300addc0 2022-01-10T01:33:30.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:30.669+0000 7f2334e6b700 1 -- 172.21.15.36:0/1443493913 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2330143ce0 con 0x7f23300addc0 2022-01-10T01:33:31.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.401+0000 7f23277fe700 1 -- 172.21.15.36:0/1443493913 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v141) v1 ==== 185+0+0 (secure 0 0 0) 0x7f2320023020 con 0x7f23300addc0 2022-01-10T01:33:31.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.405+0000 7f2334e6b700 1 -- 172.21.15.36:0/1443493913 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2314053560 msgr2=0x7f2314055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:31.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.405+0000 7f2334e6b700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2314053560 0x7f2314055a20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f231800b000 tx=0x7f2318009040).stop 2022-01-10T01:33:31.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.405+0000 7f2334e6b700 1 -- 172.21.15.36:0/1443493913 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23300addc0 msgr2=0x7f233005f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:31.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.405+0000 7f2334e6b700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23300addc0 0x7f233005f6b0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f2320002f70 tx=0x7f2320014000).stop 2022-01-10T01:33:31.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.409+0000 7f2334e6b700 1 -- 172.21.15.36:0/1443493913 shutdown_connections 2022-01-10T01:33:31.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.409+0000 7f2334e6b700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2314053560 0x7f2314055a20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:31.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.409+0000 7f2334e6b700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23300b2000 0x7f233009eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:31.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.409+0000 7f2334e6b700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f23300b1420 0x7f233009e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:31.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.409+0000 7f2334e6b700 1 --2- 172.21.15.36:0/1443493913 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f23300addc0 0x7f233005f6b0 secure :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0x7f2320002f70 tx=0x7f2320014000).stop 2022-01-10T01:33:31.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.409+0000 7f2334e6b700 1 -- 172.21.15.36:0/1443493913 >> 172.21.15.36:0/1443493913 conn(0x7f233005bd40 msgr2=0x7f23300ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:31.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.409+0000 7f2334e6b700 1 -- 172.21.15.36:0/1443493913 shutdown_connections 2022-01-10T01:33:31.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.409+0000 7f2334e6b700 1 -- 172.21.15.36:0/1443493913 wait complete. 2022-01-10T01:33:31.418 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:33:31.429 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2022-01-10T01:33:31.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49ec9a0700 1 Processor -- start 2022-01-10T01:33:31.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49ec9a0700 1 -- start start 2022-01-10T01:33:31.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49ec9a0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f49e80ae0e0 0x7f49e80afef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:31.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49ec9a0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49e8067510 0x7f49e8143000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:31.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49ec9a0700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e80b3000 con 0x7f49e80afb10 2022-01-10T01:33:31.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49ec9a0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e80b32a0 con 0x7f49e80ae0e0 2022-01-10T01:33:31.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49ec9a0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e80b1540 con 0x7f49e8067510 2022-01-10T01:33:31.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e77fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f49e80afb10 0x7f49e805fdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39856/0 (socket says 172.21.15.36:39856) 2022-01-10T01:33:31.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e77fe700 1 -- 172.21.15.36:0/2160633884 learned_addr learned my addr 172.21.15.36:0/2160633884 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:31.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e6ffd700 1 --2- 172.21.15.36:0/2160633884 >> v2:172.21.15.36:3300/0 conn(0x7f49e80ae0e0 0x7f49e80afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:31.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e7fff700 1 --2- 172.21.15.36:0/2160633884 >> v2:172.21.15.59:3300/0 conn(0x7f49e8067510 0x7f49e8143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:31.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e67fc700 1 -- 172.21.15.36:0/2160633884 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579513367 0 0) 0x7f49e80b3000 con 0x7f49e80afb10 2022-01-10T01:33:31.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e67fc700 1 -- 172.21.15.36:0/2160633884 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d4004370 con 0x7f49e80afb10 2022-01-10T01:33:31.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e6ffd700 1 -- 172.21.15.36:0/2160633884 >> v2:172.21.15.59:3300/0 conn(0x7f49e8067510 msgr2=0x7f49e8143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:31.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e6ffd700 1 --2- 172.21.15.36:0/2160633884 >> v2:172.21.15.59:3300/0 conn(0x7f49e8067510 0x7f49e8143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:31.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e6ffd700 1 -- 172.21.15.36:0/2160633884 >> v1:172.21.15.36:6789/0 conn(0x7f49e80afb10 legacy=0x7f49e805fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:31.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e67fc700 1 -- 172.21.15.36:0/2160633884 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1300891701 0 0) 0x7f49d4004370 con 0x7f49e80afb10 2022-01-10T01:33:31.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e6ffd700 1 -- 172.21.15.36:0/2160633884 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8142930 con 0x7f49e80ae0e0 2022-01-10T01:33:31.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e7fff700 1 --2- 172.21.15.36:0/2160633884 >> v2:172.21.15.59:3300/0 conn(0x7f49e8067510 0x7f49e8143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:31.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e6ffd700 1 --2- 172.21.15.36:0/2160633884 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f49e80ae0e0 0x7f49e80afef0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f49d8001b80 tx=0x7f49dc006df0).ready entity=mon.0 client_cookie=279720db47803c36 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:31.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e67fc700 1 -- 172.21.15.36:0/2160633884 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49d80019e0 con 0x7f49e80ae0e0 2022-01-10T01:33:31.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e67fc700 1 -- 172.21.15.36:0/2160633884 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc000e90 con 0x7f49e80ae0e0 2022-01-10T01:33:31.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.525+0000 7f49e67fc700 1 -- 172.21.15.36:0/2160633884 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49dc00d4a0 con 0x7f49e80ae0e0 2022-01-10T01:33:31.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 -- 172.21.15.36:0/2160633884 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f49e80ae0e0 msgr2=0x7f49e80afef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:31.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 --2- 172.21.15.36:0/2160633884 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f49e80ae0e0 0x7f49e80afef0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f49d8001b80 tx=0x7f49dc006df0).stop 2022-01-10T01:33:31.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 -- 172.21.15.36:0/2160633884 shutdown_connections 2022-01-10T01:33:31.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 --2- 172.21.15.36:0/2160633884 >> v2:172.21.15.59:3300/0 conn(0x7f49e8067510 0x7f49e8143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:31.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 --2- 172.21.15.36:0/2160633884 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f49e80ae0e0 0x7f49e80afef0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:31.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 -- 172.21.15.36:0/2160633884 >> 172.21.15.36:0/2160633884 conn(0x7f49e805d010 msgr2=0x7f49e805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:31.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 -- 172.21.15.36:0/2160633884 shutdown_connections 2022-01-10T01:33:31.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 -- 172.21.15.36:0/2160633884 wait complete. 2022-01-10T01:33:31.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 Processor -- start 2022-01-10T01:33:31.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 -- start start 2022-01-10T01:33:31.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e8067510 0x7f49e8134460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:31.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e80ae0e0 0x7f49e8132220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:31.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f49e80afb10 0x7f49e8132710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:31.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8150f80 con 0x7f49e80afb10 2022-01-10T01:33:31.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8150300 con 0x7f49e80ae0e0 2022-01-10T01:33:31.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49ec9a0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e81505a0 con 0x7f49e8067510 2022-01-10T01:33:31.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.529+0000 7f49e7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f49e80afb10 0x7f49e8132710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:31.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49e7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f49e80afb10 0x7f49e8132710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42072/0 (socket says 172.21.15.36:42072) 2022-01-10T01:33:31.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49e77fe700 1 --2- 172.21.15.36:0/1141804425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e8067510 0x7f49e8134460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:31.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49e7fff700 1 -- 172.21.15.36:0/1141804425 learned_addr learned my addr 172.21.15.36:0/1141804425 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:31.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49e6ffd700 1 --2- 172.21.15.36:0/1141804425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e80ae0e0 0x7f49e8132220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:31.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49e7fff700 1 -- 172.21.15.36:0/1141804425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e8067510 msgr2=0x7f49e8134460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:31.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49e7fff700 1 --2- 172.21.15.36:0/1141804425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e8067510 0x7f49e8134460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:31.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49e7fff700 1 -- 172.21.15.36:0/1141804425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e80ae0e0 msgr2=0x7f49e8132220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:31.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49e7fff700 1 --2- 172.21.15.36:0/1141804425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e80ae0e0 0x7f49e8132220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:31.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49e7fff700 1 -- 172.21.15.36:0/1141804425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc00b180 con 0x7f49e80afb10 2022-01-10T01:33:31.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49e7fff700 1 --2- 172.21.15.36:0/1141804425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f49e80afb10 0x7f49e8132710 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f49e000a000 tx=0x7f49e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:31.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49e4ff9700 1 -- 172.21.15.36:0/1141804425 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e0011780 con 0x7f49e80afb10 2022-01-10T01:33:31.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49e4ff9700 1 -- 172.21.15.36:0/1141804425 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e00118e0 con 0x7f49e80afb10 2022-01-10T01:33:31.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49ec9a0700 1 -- 172.21.15.36:0/1141804425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e8150840 con 0x7f49e80afb10 2022-01-10T01:33:31.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49e4ff9700 1 -- 172.21.15.36:0/1141804425 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49e0011c40 con 0x7f49e80afb10 2022-01-10T01:33:31.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49ec9a0700 1 -- 172.21.15.36:0/1141804425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e814fff0 con 0x7f49e80afb10 2022-01-10T01:33:31.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.533+0000 7f49ec9a0700 1 -- 172.21.15.36:0/1141804425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e8057350 con 0x7f49e80afb10 2022-01-10T01:33:31.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.537+0000 7f49e4ff9700 1 -- 172.21.15.36:0/1141804425 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f49e0012420 con 0x7f49e80afb10 2022-01-10T01:33:31.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.537+0000 7f49e4ff9700 1 --2- 172.21.15.36:0/1141804425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f49c8053500 0x7f49c80559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:31.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.537+0000 7f49e4ff9700 1 -- 172.21.15.36:0/1141804425 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f49e006b690 con 0x7f49e80afb10 2022-01-10T01:33:31.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.537+0000 7f49e77fe700 1 --2- 172.21.15.36:0/1141804425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f49c8053500 0x7f49c80559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:31.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.537+0000 7f49e77fe700 1 --2- 172.21.15.36:0/1141804425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f49c8053500 0x7f49c80559c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f49d800d000 tx=0x7f49d8002120).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:31.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.541+0000 7f49e4ff9700 1 -- 172.21.15.36:0/1141804425 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f49e00427a0 con 0x7f49e80afb10 2022-01-10T01:33:31.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:31.665+0000 7f49ec9a0700 1 -- 172.21.15.36:0/1141804425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f49e8066d70 con 0x7f49e80afb10 2022-01-10T01:33:32.216 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:33:32.219 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:33:32.222 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:33:32.225 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:33:32.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.417+0000 7f49e4ff9700 1 -- 172.21.15.36:0/1141804425 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v142) v1 ==== 173+0+0 (secure 0 0 0) 0x7f49e0045dc0 con 0x7f49e80afb10 2022-01-10T01:33:32.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.421+0000 7f49ec9a0700 1 -- 172.21.15.36:0/1141804425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f49c8053500 msgr2=0x7f49c80559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:32.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.421+0000 7f49ec9a0700 1 --2- 172.21.15.36:0/1141804425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f49c8053500 0x7f49c80559c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f49d800d000 tx=0x7f49d8002120).stop 2022-01-10T01:33:32.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.421+0000 7f49ec9a0700 1 -- 172.21.15.36:0/1141804425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f49e80afb10 msgr2=0x7f49e8132710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:32.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.421+0000 7f49ec9a0700 1 --2- 172.21.15.36:0/1141804425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f49e80afb10 0x7f49e8132710 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f49e000a000 tx=0x7f49e0008040).stop 2022-01-10T01:33:32.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.421+0000 7f49ec9a0700 1 -- 172.21.15.36:0/1141804425 shutdown_connections 2022-01-10T01:33:32.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.421+0000 7f49ec9a0700 1 --2- 172.21.15.36:0/1141804425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f49c8053500 0x7f49c80559c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.421+0000 7f49ec9a0700 1 --2- 172.21.15.36:0/1141804425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f49e80afb10 0x7f49e8132710 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.421+0000 7f49ec9a0700 1 --2- 172.21.15.36:0/1141804425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e80ae0e0 0x7f49e8132220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.421+0000 7f49ec9a0700 1 --2- 172.21.15.36:0/1141804425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49e8067510 0x7f49e8134460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.421+0000 7f49ec9a0700 1 -- 172.21.15.36:0/1141804425 >> 172.21.15.36:0/1141804425 conn(0x7f49e805d010 msgr2=0x7f49e8149500 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:32.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.421+0000 7f49ec9a0700 1 -- 172.21.15.36:0/1141804425 shutdown_connections 2022-01-10T01:33:32.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.421+0000 7f49ec9a0700 1 -- 172.21.15.36:0/1141804425 wait complete. 2022-01-10T01:33:32.432 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' removed 2022-01-10T01:33:32.445 DEBUG:teuthology.orchestra.run.smithi036:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-10T01:33:32.448 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-10T01:33:32.450 DEBUG:teuthology.orchestra.run.smithi139:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-10T01:33:32.454 DEBUG:teuthology.orchestra.run.smithi166:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-01-10T01:33:32.478 INFO:teuthology.orchestra.run.smithi036.stdout:[global] 2022-01-10T01:33:32.478 INFO:teuthology.orchestra.run.smithi036.stdout: chdir = "" 2022-01-10T01:33:32.479 INFO:teuthology.orchestra.run.smithi036.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-10T01:33:32.479 INFO:teuthology.orchestra.run.smithi036.stdout: auth supported = cephx 2022-01-10T01:33:32.479 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.479 INFO:teuthology.orchestra.run.smithi036.stdout: filestore xattr use omap = true 2022-01-10T01:33:32.480 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.480 INFO:teuthology.orchestra.run.smithi036.stdout: mon clock drift allowed = 1.000 2022-01-10T01:33:32.480 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.480 INFO:teuthology.orchestra.run.smithi036.stdout: osd crush chooseleaf type = 0 2022-01-10T01:33:32.481 INFO:teuthology.orchestra.run.smithi036.stdout: auth debug = true 2022-01-10T01:33:32.481 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.481 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on old message = true 2022-01-10T01:33:32.482 INFO:teuthology.orchestra.run.smithi036.stdout: ms die on bug = true 2022-01-10T01:33:32.482 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.482 INFO:teuthology.orchestra.run.smithi036.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-10T01:33:32.482 INFO:teuthology.orchestra.run.smithi036.stdout: mon pg warn max object skew = 0 2022-01-10T01:33:32.483 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.483 INFO:teuthology.orchestra.run.smithi036.stdout: # disable pg_autoscaler by default for new pools 2022-01-10T01:33:32.483 INFO:teuthology.orchestra.run.smithi036.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-10T01:33:32.483 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.484 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default size = 2 2022-01-10T01:33:32.484 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.484 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow primary affinity = true 2022-01-10T01:33:32.484 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd allow pg remap = true 2022-01-10T01:33:32.484 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on legacy crush tunables = false 2022-01-10T01:33:32.485 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on crush straw calc version zero = false 2022-01-10T01:33:32.485 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on no sortbitwise = false 2022-01-10T01:33:32.485 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on osd down out interval zero = false 2022-01-10T01:33:32.485 INFO:teuthology.orchestra.run.smithi036.stdout: mon warn on too few osds = false 2022-01-10T01:33:32.485 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-10T01:33:32.486 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-10T01:33:32.486 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.486 INFO:teuthology.orchestra.run.smithi036.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-10T01:33:32.486 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.487 INFO:teuthology.orchestra.run.smithi036.stdout: osd default data pool replay window = 5 2022-01-10T01:33:32.487 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.487 INFO:teuthology.orchestra.run.smithi036.stdout: mon allow pool delete = true 2022-01-10T01:33:32.487 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.487 INFO:teuthology.orchestra.run.smithi036.stdout: mon cluster log file level = debug 2022-01-10T01:33:32.488 INFO:teuthology.orchestra.run.smithi036.stdout: debug asserts on shutdown = true 2022-01-10T01:33:32.488 INFO:teuthology.orchestra.run.smithi036.stdout: mon health detail to clog = false 2022-01-10T01:33:32.488 INFO:teuthology.orchestra.run.smithi036.stdout: mon host = "172.21.15.36,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2022-01-10T01:33:32.488 INFO:teuthology.orchestra.run.smithi036.stdout: fsid = 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762 2022-01-10T01:33:32.489 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.489 INFO:teuthology.orchestra.run.smithi036.stdout:[osd] 2022-01-10T01:33:32.489 INFO:teuthology.orchestra.run.smithi036.stdout: osd journal size = 100 2022-01-10T01:33:32.489 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.489 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub load threshold = 5.0 2022-01-10T01:33:32.490 INFO:teuthology.orchestra.run.smithi036.stdout: osd scrub max interval = 600 2022-01-10T01:33:32.490 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.490 INFO:teuthology.orchestra.run.smithi036.stdout: osd recover clone overlap = true 2022-01-10T01:33:32.490 INFO:teuthology.orchestra.run.smithi036.stdout: osd recovery max chunk = 1048576 2022-01-10T01:33:32.491 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.491 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug shutdown = true 2022-01-10T01:33:32.491 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug op order = true 2022-01-10T01:33:32.491 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug verify stray on activate = true 2022-01-10T01:33:32.491 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.492 INFO:teuthology.orchestra.run.smithi036.stdout: osd open classes on start = true 2022-01-10T01:33:32.492 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug pg log writeout = true 2022-01-10T01:33:32.492 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.492 INFO:teuthology.orchestra.run.smithi036.stdout: osd deep scrub update digest min age = 30 2022-01-10T01:33:32.493 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.493 INFO:teuthology.orchestra.run.smithi036.stdout: osd map max advance = 10 2022-01-10T01:33:32.493 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.493 INFO:teuthology.orchestra.run.smithi036.stdout: journal zero on create = true 2022-01-10T01:33:32.494 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.494 INFO:teuthology.orchestra.run.smithi036.stdout: filestore ondisk finisher threads = 3 2022-01-10T01:33:32.494 INFO:teuthology.orchestra.run.smithi036.stdout: filestore apply finisher threads = 3 2022-01-10T01:33:32.495 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.495 INFO:teuthology.orchestra.run.smithi036.stdout: bdev debug aio = true 2022-01-10T01:33:32.495 INFO:teuthology.orchestra.run.smithi036.stdout: osd debug misdirected ops = true 2022-01-10T01:33:32.495 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore block size = 96636764160 2022-01-10T01:33:32.496 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore compression mode = aggressive 2022-01-10T01:33:32.496 INFO:teuthology.orchestra.run.smithi036.stdout: bluestore fsck on mount = True 2022-01-10T01:33:32.496 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluefs = 20 2022-01-10T01:33:32.496 INFO:teuthology.orchestra.run.smithi036.stdout: debug bluestore = 20 2022-01-10T01:33:32.496 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:33:32.497 INFO:teuthology.orchestra.run.smithi036.stdout: debug osd = 20 2022-01-10T01:33:32.497 INFO:teuthology.orchestra.run.smithi036.stdout: debug rocksdb = 10 2022-01-10T01:33:32.497 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd backfillfull_ratio = 0.85 2022-01-10T01:33:32.497 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd full ratio = 0.9 2022-01-10T01:33:32.497 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd nearfull ratio = 0.8 2022-01-10T01:33:32.498 INFO:teuthology.orchestra.run.smithi036.stdout: osd failsafe full ratio = 0.95 2022-01-10T01:33:32.498 INFO:teuthology.orchestra.run.smithi036.stdout: osd objectstore = bluestore 2022-01-10T01:33:32.498 INFO:teuthology.orchestra.run.smithi036.stdout: osd op complaint time = 180 2022-01-10T01:33:32.498 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.499 INFO:teuthology.orchestra.run.smithi036.stdout:[mgr] 2022-01-10T01:33:32.499 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:33:32.499 INFO:teuthology.orchestra.run.smithi036.stdout: debug mgr = 20 2022-01-10T01:33:32.499 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2022-01-10T01:33:32.499 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2022-01-10T01:33:32.500 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:32.500 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:32.500 INFO:teuthology.orchestra.run.smithi036.stdout: mgr/telemetry/nag = false 2022-01-10T01:33:32.500 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.501 INFO:teuthology.orchestra.run.smithi036.stdout:[mon] 2022-01-10T01:33:32.501 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:33:32.501 INFO:teuthology.orchestra.run.smithi036.stdout: debug mon = 20 2022-01-10T01:33:32.501 INFO:teuthology.orchestra.run.smithi036.stdout: debug paxos = 20 2022-01-10T01:33:32.501 INFO:teuthology.orchestra.run.smithi036.stdout: debug auth = 20 2022-01-10T01:33:32.502 INFO:teuthology.orchestra.run.smithi036.stdout: mon data avail warn = 5 2022-01-10T01:33:32.502 INFO:teuthology.orchestra.run.smithi036.stdout: mon mgr mkfs grace = 240 2022-01-10T01:33:32.502 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:32.502 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd reporter subtree level = osd 2022-01-10T01:33:32.502 INFO:teuthology.orchestra.run.smithi036.stdout: mon osd prime pg temp = true 2022-01-10T01:33:32.503 INFO:teuthology.orchestra.run.smithi036.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:32.503 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.503 INFO:teuthology.orchestra.run.smithi036.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-10T01:33:32.503 INFO:teuthology.orchestra.run.smithi036.stdout: auth mon ticket ttl = 660 # 11m 2022-01-10T01:33:32.504 INFO:teuthology.orchestra.run.smithi036.stdout: auth service ticket ttl = 240 # 4m 2022-01-10T01:33:32.504 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.504 INFO:teuthology.orchestra.run.smithi036.stdout: # don't complain about insecure global_id in the test suite 2022-01-10T01:33:32.504 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-10T01:33:32.504 INFO:teuthology.orchestra.run.smithi036.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-10T01:33:32.505 INFO:teuthology.orchestra.run.smithi036.stdout: mon op complaint time = 120 2022-01-10T01:33:32.505 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:32.505 INFO:teuthology.orchestra.run.smithi036.stdout:[client] 2022-01-10T01:33:32.505 INFO:teuthology.orchestra.run.smithi036.stdout: rgw cache enabled = true 2022-01-10T01:33:32.506 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable ops log = true 2022-01-10T01:33:32.506 INFO:teuthology.orchestra.run.smithi036.stdout: rgw enable usage log = true 2022-01-10T01:33:32.506 INFO:teuthology.orchestra.run.smithi036.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-10T01:33:32.506 INFO:teuthology.orchestra.run.smithi036.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-10T01:33:32.506 INFO:teuthology.orchestra.run.smithi036.stdout: client mount timeout = 600 2022-01-10T01:33:32.507 INFO:teuthology.orchestra.run.smithi036.stdout: debug client = 20 2022-01-10T01:33:32.507 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:33:32.507 INFO:teuthology.orchestra.run.smithi036.stdout: rados mon op timeout = 15m 2022-01-10T01:33:32.507 INFO:teuthology.orchestra.run.smithi036.stdout: rados osd op timeout = 15m 2022-01-10T01:33:32.507 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.a] 2022-01-10T01:33:32.508 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.b] 2022-01-10T01:33:32.508 INFO:teuthology.orchestra.run.smithi036.stdout:[mon.c] 2022-01-10T01:33:32.508 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.a] 2022-01-10T01:33:32.508 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.c] 2022-01-10T01:33:32.508 INFO:teuthology.orchestra.run.smithi036.stdout:[mds.b] 2022-01-10T01:33:32.509 INFO:teuthology.orchestra.run.smithi036.stdout:[mds] 2022-01-10T01:33:32.509 INFO:teuthology.orchestra.run.smithi036.stdout: debug mds = 20 2022-01-10T01:33:32.509 INFO:teuthology.orchestra.run.smithi036.stdout: debug ms = 1 2022-01-10T01:33:32.509 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal frag = True 2022-01-10T01:33:32.510 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal fragment size max = 10000 2022-01-10T01:33:32.510 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal merge size = 5 2022-01-10T01:33:32.510 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal split bits = 3 2022-01-10T01:33:32.510 INFO:teuthology.orchestra.run.smithi036.stdout: mds bal split size = 100 2022-01-10T01:33:32.510 INFO:teuthology.orchestra.run.smithi036.stdout: mds debug frag = True 2022-01-10T01:33:32.511 INFO:teuthology.orchestra.run.smithi036.stdout: mds debug scatterstat = True 2022-01-10T01:33:32.511 INFO:teuthology.orchestra.run.smithi036.stdout: mds op complaint time = 180 2022-01-10T01:33:32.511 INFO:teuthology.orchestra.run.smithi036.stdout: mds verify scatter = True 2022-01-10T01:33:32.511 INFO:teuthology.orchestra.run.smithi036.stdout: osd op complaint time = 180 2022-01-10T01:33:32.511 INFO:teuthology.orchestra.run.smithi036.stdout: rados mon op timeout = 15m 2022-01-10T01:33:32.512 INFO:teuthology.orchestra.run.smithi036.stdout: rados osd op timeout = 15m 2022-01-10T01:33:32.515 INFO:teuthology.orchestra.run.smithi166.stdout:[global] 2022-01-10T01:33:32.515 INFO:teuthology.orchestra.run.smithi166.stdout: chdir = "" 2022-01-10T01:33:32.515 INFO:teuthology.orchestra.run.smithi166.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-10T01:33:32.516 INFO:teuthology.orchestra.run.smithi166.stdout: auth supported = cephx 2022-01-10T01:33:32.516 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.516 INFO:teuthology.orchestra.run.smithi166.stdout: filestore xattr use omap = true 2022-01-10T01:33:32.516 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.516 INFO:teuthology.orchestra.run.smithi166.stdout: mon clock drift allowed = 1.000 2022-01-10T01:33:32.517 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.517 INFO:teuthology.orchestra.run.smithi166.stdout: osd crush chooseleaf type = 0 2022-01-10T01:33:32.517 INFO:teuthology.orchestra.run.smithi166.stdout: auth debug = true 2022-01-10T01:33:32.517 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.517 INFO:teuthology.orchestra.run.smithi166.stdout: ms die on old message = true 2022-01-10T01:33:32.518 INFO:teuthology.orchestra.run.smithi166.stdout: ms die on bug = true 2022-01-10T01:33:32.518 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.518 INFO:teuthology.orchestra.run.smithi166.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-10T01:33:32.518 INFO:teuthology.orchestra.run.smithi166.stdout: mon pg warn max object skew = 0 2022-01-10T01:33:32.519 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.519 INFO:teuthology.orchestra.run.smithi166.stdout: # disable pg_autoscaler by default for new pools 2022-01-10T01:33:32.519 INFO:teuthology.orchestra.run.smithi166.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-10T01:33:32.519 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.519 INFO:teuthology.orchestra.run.smithi166.stdout: osd pool default size = 2 2022-01-10T01:33:32.520 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.520 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd allow primary affinity = true 2022-01-10T01:33:32.520 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd allow pg remap = true 2022-01-10T01:33:32.520 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on legacy crush tunables = false 2022-01-10T01:33:32.521 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on crush straw calc version zero = false 2022-01-10T01:33:32.521 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on no sortbitwise = false 2022-01-10T01:33:32.521 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on osd down out interval zero = false 2022-01-10T01:33:32.521 INFO:teuthology.orchestra.run.smithi166.stdout: mon warn on too few osds = false 2022-01-10T01:33:32.521 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-10T01:33:32.522 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-10T01:33:32.522 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.522 INFO:teuthology.orchestra.run.smithi166.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-10T01:33:32.522 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.523 INFO:teuthology.orchestra.run.smithi166.stdout: osd default data pool replay window = 5 2022-01-10T01:33:32.523 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.523 INFO:teuthology.orchestra.run.smithi166.stdout: mon allow pool delete = true 2022-01-10T01:33:32.523 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.523 INFO:teuthology.orchestra.run.smithi166.stdout: mon cluster log file level = debug 2022-01-10T01:33:32.524 INFO:teuthology.orchestra.run.smithi166.stdout: debug asserts on shutdown = true 2022-01-10T01:33:32.524 INFO:teuthology.orchestra.run.smithi166.stdout: mon health detail to clog = false 2022-01-10T01:33:32.524 INFO:teuthology.orchestra.run.smithi166.stdout: mon host = "172.21.15.36,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2022-01-10T01:33:32.524 INFO:teuthology.orchestra.run.smithi166.stdout: fsid = 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762 2022-01-10T01:33:32.525 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.525 INFO:teuthology.orchestra.run.smithi166.stdout:[osd] 2022-01-10T01:33:32.525 INFO:teuthology.orchestra.run.smithi166.stdout: osd journal size = 100 2022-01-10T01:33:32.525 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.525 INFO:teuthology.orchestra.run.smithi166.stdout: osd scrub load threshold = 5.0 2022-01-10T01:33:32.526 INFO:teuthology.orchestra.run.smithi166.stdout: osd scrub max interval = 600 2022-01-10T01:33:32.526 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.526 INFO:teuthology.orchestra.run.smithi166.stdout: osd recover clone overlap = true 2022-01-10T01:33:32.526 INFO:teuthology.orchestra.run.smithi166.stdout: osd recovery max chunk = 1048576 2022-01-10T01:33:32.526 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.527 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug shutdown = true 2022-01-10T01:33:32.527 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug op order = true 2022-01-10T01:33:32.527 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug verify stray on activate = true 2022-01-10T01:33:32.527 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.528 INFO:teuthology.orchestra.run.smithi166.stdout: osd open classes on start = true 2022-01-10T01:33:32.528 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug pg log writeout = true 2022-01-10T01:33:32.528 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.528 INFO:teuthology.orchestra.run.smithi166.stdout: osd deep scrub update digest min age = 30 2022-01-10T01:33:32.528 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.529 INFO:teuthology.orchestra.run.smithi166.stdout: osd map max advance = 10 2022-01-10T01:33:32.529 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.529 INFO:teuthology.orchestra.run.smithi166.stdout: journal zero on create = true 2022-01-10T01:33:32.530 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.530 INFO:teuthology.orchestra.run.smithi166.stdout: filestore ondisk finisher threads = 3 2022-01-10T01:33:32.530 INFO:teuthology.orchestra.run.smithi166.stdout: filestore apply finisher threads = 3 2022-01-10T01:33:32.530 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.531 INFO:teuthology.orchestra.run.smithi166.stdout: bdev debug aio = true 2022-01-10T01:33:32.531 INFO:teuthology.orchestra.run.smithi166.stdout: osd debug misdirected ops = true 2022-01-10T01:33:32.531 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore block size = 96636764160 2022-01-10T01:33:32.531 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore compression mode = aggressive 2022-01-10T01:33:32.532 INFO:teuthology.orchestra.run.smithi166.stdout: bluestore fsck on mount = True 2022-01-10T01:33:32.532 INFO:teuthology.orchestra.run.smithi166.stdout: debug bluefs = 20 2022-01-10T01:33:32.532 INFO:teuthology.orchestra.run.smithi166.stdout: debug bluestore = 20 2022-01-10T01:33:32.532 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:33:32.532 INFO:teuthology.orchestra.run.smithi166.stdout: debug osd = 20 2022-01-10T01:33:32.533 INFO:teuthology.orchestra.run.smithi166.stdout: debug rocksdb = 10 2022-01-10T01:33:32.533 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd backfillfull_ratio = 0.85 2022-01-10T01:33:32.533 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd full ratio = 0.9 2022-01-10T01:33:32.533 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd nearfull ratio = 0.8 2022-01-10T01:33:32.534 INFO:teuthology.orchestra.run.smithi166.stdout: osd failsafe full ratio = 0.95 2022-01-10T01:33:32.534 INFO:teuthology.orchestra.run.smithi166.stdout: osd objectstore = bluestore 2022-01-10T01:33:32.534 INFO:teuthology.orchestra.run.smithi166.stdout: osd op complaint time = 180 2022-01-10T01:33:32.534 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.534 INFO:teuthology.orchestra.run.smithi166.stdout:[mgr] 2022-01-10T01:33:32.535 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:33:32.535 INFO:teuthology.orchestra.run.smithi166.stdout: debug mgr = 20 2022-01-10T01:33:32.535 INFO:teuthology.orchestra.run.smithi166.stdout: debug mon = 20 2022-01-10T01:33:32.535 INFO:teuthology.orchestra.run.smithi166.stdout: debug auth = 20 2022-01-10T01:33:32.536 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:32.536 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:32.536 INFO:teuthology.orchestra.run.smithi166.stdout: mgr/telemetry/nag = false 2022-01-10T01:33:32.536 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.536 INFO:teuthology.orchestra.run.smithi166.stdout:[mon] 2022-01-10T01:33:32.537 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:33:32.537 INFO:teuthology.orchestra.run.smithi166.stdout: debug mon = 20 2022-01-10T01:33:32.537 INFO:teuthology.orchestra.run.smithi166.stdout: debug paxos = 20 2022-01-10T01:33:32.537 INFO:teuthology.orchestra.run.smithi166.stdout: debug auth = 20 2022-01-10T01:33:32.537 INFO:teuthology.orchestra.run.smithi166.stdout: mon data avail warn = 5 2022-01-10T01:33:32.538 INFO:teuthology.orchestra.run.smithi166.stdout: mon mgr mkfs grace = 240 2022-01-10T01:33:32.538 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:32.538 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd reporter subtree level = osd 2022-01-10T01:33:32.538 INFO:teuthology.orchestra.run.smithi166.stdout: mon osd prime pg temp = true 2022-01-10T01:33:32.539 INFO:teuthology.orchestra.run.smithi166.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:32.539 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.539 INFO:teuthology.orchestra.run.smithi166.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-10T01:33:32.539 INFO:teuthology.orchestra.run.smithi166.stdout: auth mon ticket ttl = 660 # 11m 2022-01-10T01:33:32.539 INFO:teuthology.orchestra.run.smithi166.stdout: auth service ticket ttl = 240 # 4m 2022-01-10T01:33:32.540 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.540 INFO:teuthology.orchestra.run.smithi166.stdout: # don't complain about insecure global_id in the test suite 2022-01-10T01:33:32.540 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-10T01:33:32.540 INFO:teuthology.orchestra.run.smithi166.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-10T01:33:32.541 INFO:teuthology.orchestra.run.smithi166.stdout: mon op complaint time = 120 2022-01-10T01:33:32.541 INFO:teuthology.orchestra.run.smithi166.stdout: 2022-01-10T01:33:32.541 INFO:teuthology.orchestra.run.smithi166.stdout:[client] 2022-01-10T01:33:32.541 INFO:teuthology.orchestra.run.smithi166.stdout: rgw cache enabled = true 2022-01-10T01:33:32.542 INFO:teuthology.orchestra.run.smithi166.stdout: rgw enable ops log = true 2022-01-10T01:33:32.542 INFO:teuthology.orchestra.run.smithi166.stdout: rgw enable usage log = true 2022-01-10T01:33:32.542 INFO:teuthology.orchestra.run.smithi166.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-10T01:33:32.543 INFO:teuthology.orchestra.run.smithi166.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-10T01:33:32.543 INFO:teuthology.orchestra.run.smithi166.stdout: client mount timeout = 600 2022-01-10T01:33:32.543 INFO:teuthology.orchestra.run.smithi166.stdout: debug client = 20 2022-01-10T01:33:32.543 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:33:32.543 INFO:teuthology.orchestra.run.smithi166.stdout: rados mon op timeout = 15m 2022-01-10T01:33:32.544 INFO:teuthology.orchestra.run.smithi166.stdout: rados osd op timeout = 15m 2022-01-10T01:33:32.544 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.a] 2022-01-10T01:33:32.544 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.b] 2022-01-10T01:33:32.544 INFO:teuthology.orchestra.run.smithi166.stdout:[mon.c] 2022-01-10T01:33:32.544 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.a] 2022-01-10T01:33:32.545 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.c] 2022-01-10T01:33:32.545 INFO:teuthology.orchestra.run.smithi166.stdout:[mds.b] 2022-01-10T01:33:32.545 INFO:teuthology.orchestra.run.smithi166.stdout:[mds] 2022-01-10T01:33:32.545 INFO:teuthology.orchestra.run.smithi166.stdout: debug mds = 20 2022-01-10T01:33:32.546 INFO:teuthology.orchestra.run.smithi166.stdout: debug ms = 1 2022-01-10T01:33:32.546 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal frag = True 2022-01-10T01:33:32.546 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal fragment size max = 10000 2022-01-10T01:33:32.546 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal merge size = 5 2022-01-10T01:33:32.546 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal split bits = 3 2022-01-10T01:33:32.547 INFO:teuthology.orchestra.run.smithi166.stdout: mds bal split size = 100 2022-01-10T01:33:32.547 INFO:teuthology.orchestra.run.smithi166.stdout: mds debug frag = True 2022-01-10T01:33:32.547 INFO:teuthology.orchestra.run.smithi166.stdout: mds debug scatterstat = True 2022-01-10T01:33:32.547 INFO:teuthology.orchestra.run.smithi166.stdout: mds op complaint time = 180 2022-01-10T01:33:32.547 INFO:teuthology.orchestra.run.smithi166.stdout: mds verify scatter = True 2022-01-10T01:33:32.548 INFO:teuthology.orchestra.run.smithi166.stdout: osd op complaint time = 180 2022-01-10T01:33:32.548 INFO:teuthology.orchestra.run.smithi166.stdout: rados mon op timeout = 15m 2022-01-10T01:33:32.548 INFO:teuthology.orchestra.run.smithi166.stdout: rados osd op timeout = 15m 2022-01-10T01:33:32.548 INFO:teuthology.orchestra.run.smithi139.stdout:[global] 2022-01-10T01:33:32.549 INFO:teuthology.orchestra.run.smithi139.stdout: chdir = "" 2022-01-10T01:33:32.549 INFO:teuthology.orchestra.run.smithi139.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-10T01:33:32.549 INFO:teuthology.orchestra.run.smithi139.stdout: auth supported = cephx 2022-01-10T01:33:32.549 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.549 INFO:teuthology.orchestra.run.smithi139.stdout: filestore xattr use omap = true 2022-01-10T01:33:32.550 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.550 INFO:teuthology.orchestra.run.smithi139.stdout: mon clock drift allowed = 1.000 2022-01-10T01:33:32.550 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.550 INFO:teuthology.orchestra.run.smithi139.stdout: osd crush chooseleaf type = 0 2022-01-10T01:33:32.551 INFO:teuthology.orchestra.run.smithi139.stdout: auth debug = true 2022-01-10T01:33:32.551 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.551 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on old message = true 2022-01-10T01:33:32.551 INFO:teuthology.orchestra.run.smithi139.stdout: ms die on bug = true 2022-01-10T01:33:32.551 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.552 INFO:teuthology.orchestra.run.smithi139.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-10T01:33:32.552 INFO:teuthology.orchestra.run.smithi139.stdout: mon pg warn max object skew = 0 2022-01-10T01:33:32.552 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.552 INFO:teuthology.orchestra.run.smithi139.stdout: # disable pg_autoscaler by default for new pools 2022-01-10T01:33:32.552 INFO:teuthology.orchestra.run.smithi139.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-10T01:33:32.553 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.553 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default size = 2 2022-01-10T01:33:32.553 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.553 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow primary affinity = true 2022-01-10T01:33:32.554 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd allow pg remap = true 2022-01-10T01:33:32.554 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on legacy crush tunables = false 2022-01-10T01:33:32.554 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on crush straw calc version zero = false 2022-01-10T01:33:32.554 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on no sortbitwise = false 2022-01-10T01:33:32.554 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on osd down out interval zero = false 2022-01-10T01:33:32.555 INFO:teuthology.orchestra.run.smithi139.stdout: mon warn on too few osds = false 2022-01-10T01:33:32.555 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-10T01:33:32.555 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-10T01:33:32.555 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.555 INFO:teuthology.orchestra.run.smithi139.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-10T01:33:32.556 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.556 INFO:teuthology.orchestra.run.smithi139.stdout: osd default data pool replay window = 5 2022-01-10T01:33:32.556 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.557 INFO:teuthology.orchestra.run.smithi139.stdout: mon allow pool delete = true 2022-01-10T01:33:32.557 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.557 INFO:teuthology.orchestra.run.smithi139.stdout: mon cluster log file level = debug 2022-01-10T01:33:32.557 INFO:teuthology.orchestra.run.smithi139.stdout: debug asserts on shutdown = true 2022-01-10T01:33:32.557 INFO:teuthology.orchestra.run.smithi139.stdout: mon health detail to clog = false 2022-01-10T01:33:32.558 INFO:teuthology.orchestra.run.smithi139.stdout: mon host = "172.21.15.36,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2022-01-10T01:33:32.558 INFO:teuthology.orchestra.run.smithi139.stdout: fsid = 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762 2022-01-10T01:33:32.558 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.558 INFO:teuthology.orchestra.run.smithi139.stdout:[osd] 2022-01-10T01:33:32.558 INFO:teuthology.orchestra.run.smithi139.stdout: osd journal size = 100 2022-01-10T01:33:32.559 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.559 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub load threshold = 5.0 2022-01-10T01:33:32.559 INFO:teuthology.orchestra.run.smithi139.stdout: osd scrub max interval = 600 2022-01-10T01:33:32.559 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.560 INFO:teuthology.orchestra.run.smithi139.stdout: osd recover clone overlap = true 2022-01-10T01:33:32.560 INFO:teuthology.orchestra.run.smithi139.stdout: osd recovery max chunk = 1048576 2022-01-10T01:33:32.560 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.560 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug shutdown = true 2022-01-10T01:33:32.560 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug op order = true 2022-01-10T01:33:32.561 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug verify stray on activate = true 2022-01-10T01:33:32.561 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.561 INFO:teuthology.orchestra.run.smithi139.stdout: osd open classes on start = true 2022-01-10T01:33:32.561 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug pg log writeout = true 2022-01-10T01:33:32.561 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.562 INFO:teuthology.orchestra.run.smithi139.stdout: osd deep scrub update digest min age = 30 2022-01-10T01:33:32.562 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.562 INFO:teuthology.orchestra.run.smithi139.stdout: osd map max advance = 10 2022-01-10T01:33:32.562 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.563 INFO:teuthology.orchestra.run.smithi139.stdout: journal zero on create = true 2022-01-10T01:33:32.563 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.563 INFO:teuthology.orchestra.run.smithi139.stdout: filestore ondisk finisher threads = 3 2022-01-10T01:33:32.563 INFO:teuthology.orchestra.run.smithi139.stdout: filestore apply finisher threads = 3 2022-01-10T01:33:32.563 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.564 INFO:teuthology.orchestra.run.smithi139.stdout: bdev debug aio = true 2022-01-10T01:33:32.564 INFO:teuthology.orchestra.run.smithi139.stdout: osd debug misdirected ops = true 2022-01-10T01:33:32.564 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore block size = 96636764160 2022-01-10T01:33:32.564 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore compression mode = aggressive 2022-01-10T01:33:32.565 INFO:teuthology.orchestra.run.smithi139.stdout: bluestore fsck on mount = True 2022-01-10T01:33:32.565 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluefs = 20 2022-01-10T01:33:32.565 INFO:teuthology.orchestra.run.smithi139.stdout: debug bluestore = 20 2022-01-10T01:33:32.565 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:33:32.565 INFO:teuthology.orchestra.run.smithi139.stdout: debug osd = 20 2022-01-10T01:33:32.566 INFO:teuthology.orchestra.run.smithi139.stdout: debug rocksdb = 10 2022-01-10T01:33:32.566 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd backfillfull_ratio = 0.85 2022-01-10T01:33:32.566 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd full ratio = 0.9 2022-01-10T01:33:32.566 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd nearfull ratio = 0.8 2022-01-10T01:33:32.567 INFO:teuthology.orchestra.run.smithi139.stdout: osd failsafe full ratio = 0.95 2022-01-10T01:33:32.567 INFO:teuthology.orchestra.run.smithi139.stdout: osd objectstore = bluestore 2022-01-10T01:33:32.567 INFO:teuthology.orchestra.run.smithi139.stdout: osd op complaint time = 180 2022-01-10T01:33:32.567 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.568 INFO:teuthology.orchestra.run.smithi139.stdout:[mgr] 2022-01-10T01:33:32.568 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:33:32.568 INFO:teuthology.orchestra.run.smithi139.stdout: debug mgr = 20 2022-01-10T01:33:32.569 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2022-01-10T01:33:32.569 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2022-01-10T01:33:32.569 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:32.569 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:32.569 INFO:teuthology.orchestra.run.smithi139.stdout: mgr/telemetry/nag = false 2022-01-10T01:33:32.570 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.570 INFO:teuthology.orchestra.run.smithi139.stdout:[mon] 2022-01-10T01:33:32.570 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:33:32.570 INFO:teuthology.orchestra.run.smithi139.stdout: debug mon = 20 2022-01-10T01:33:32.570 INFO:teuthology.orchestra.run.smithi139.stdout: debug paxos = 20 2022-01-10T01:33:32.571 INFO:teuthology.orchestra.run.smithi139.stdout: debug auth = 20 2022-01-10T01:33:32.571 INFO:teuthology.orchestra.run.smithi139.stdout: mon data avail warn = 5 2022-01-10T01:33:32.571 INFO:teuthology.orchestra.run.smithi139.stdout: mon mgr mkfs grace = 240 2022-01-10T01:33:32.571 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:32.571 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd reporter subtree level = osd 2022-01-10T01:33:32.572 INFO:teuthology.orchestra.run.smithi139.stdout: mon osd prime pg temp = true 2022-01-10T01:33:32.572 INFO:teuthology.orchestra.run.smithi139.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:32.572 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.572 INFO:teuthology.orchestra.run.smithi139.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-10T01:33:32.573 INFO:teuthology.orchestra.run.smithi139.stdout: auth mon ticket ttl = 660 # 11m 2022-01-10T01:33:32.573 INFO:teuthology.orchestra.run.smithi139.stdout: auth service ticket ttl = 240 # 4m 2022-01-10T01:33:32.573 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.573 INFO:teuthology.orchestra.run.smithi139.stdout: # don't complain about insecure global_id in the test suite 2022-01-10T01:33:32.573 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-10T01:33:32.574 INFO:teuthology.orchestra.run.smithi139.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-10T01:33:32.574 INFO:teuthology.orchestra.run.smithi139.stdout: mon op complaint time = 120 2022-01-10T01:33:32.574 INFO:teuthology.orchestra.run.smithi139.stdout: 2022-01-10T01:33:32.574 INFO:teuthology.orchestra.run.smithi139.stdout:[client] 2022-01-10T01:33:32.574 INFO:teuthology.orchestra.run.smithi139.stdout: rgw cache enabled = true 2022-01-10T01:33:32.575 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable ops log = true 2022-01-10T01:33:32.575 INFO:teuthology.orchestra.run.smithi139.stdout: rgw enable usage log = true 2022-01-10T01:33:32.575 INFO:teuthology.orchestra.run.smithi139.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-10T01:33:32.575 INFO:teuthology.orchestra.run.smithi139.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-10T01:33:32.576 INFO:teuthology.orchestra.run.smithi139.stdout: client mount timeout = 600 2022-01-10T01:33:32.576 INFO:teuthology.orchestra.run.smithi139.stdout: debug client = 20 2022-01-10T01:33:32.576 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:33:32.576 INFO:teuthology.orchestra.run.smithi139.stdout: rados mon op timeout = 15m 2022-01-10T01:33:32.576 INFO:teuthology.orchestra.run.smithi139.stdout: rados osd op timeout = 15m 2022-01-10T01:33:32.577 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.a] 2022-01-10T01:33:32.577 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.b] 2022-01-10T01:33:32.577 INFO:teuthology.orchestra.run.smithi139.stdout:[mon.c] 2022-01-10T01:33:32.577 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.a] 2022-01-10T01:33:32.577 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.c] 2022-01-10T01:33:32.578 INFO:teuthology.orchestra.run.smithi139.stdout:[mds.b] 2022-01-10T01:33:32.578 INFO:teuthology.orchestra.run.smithi139.stdout:[mds] 2022-01-10T01:33:32.578 INFO:teuthology.orchestra.run.smithi139.stdout: debug mds = 20 2022-01-10T01:33:32.578 INFO:teuthology.orchestra.run.smithi139.stdout: debug ms = 1 2022-01-10T01:33:32.578 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal frag = True 2022-01-10T01:33:32.579 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal fragment size max = 10000 2022-01-10T01:33:32.579 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal merge size = 5 2022-01-10T01:33:32.579 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal split bits = 3 2022-01-10T01:33:32.579 INFO:teuthology.orchestra.run.smithi139.stdout: mds bal split size = 100 2022-01-10T01:33:32.579 INFO:teuthology.orchestra.run.smithi139.stdout: mds debug frag = True 2022-01-10T01:33:32.580 INFO:teuthology.orchestra.run.smithi139.stdout: mds debug scatterstat = True 2022-01-10T01:33:32.580 INFO:teuthology.orchestra.run.smithi139.stdout: mds op complaint time = 180 2022-01-10T01:33:32.580 INFO:teuthology.orchestra.run.smithi139.stdout: mds verify scatter = True 2022-01-10T01:33:32.580 INFO:teuthology.orchestra.run.smithi139.stdout: osd op complaint time = 180 2022-01-10T01:33:32.581 INFO:teuthology.orchestra.run.smithi139.stdout: rados mon op timeout = 15m 2022-01-10T01:33:32.581 INFO:teuthology.orchestra.run.smithi139.stdout: rados osd op timeout = 15m 2022-01-10T01:33:32.581 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2022-01-10T01:33:32.581 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2022-01-10T01:33:32.581 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-01-10T01:33:32.582 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2022-01-10T01:33:32.582 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.582 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2022-01-10T01:33:32.582 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.583 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2022-01-10T01:33:32.583 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.583 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2022-01-10T01:33:32.583 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2022-01-10T01:33:32.583 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.584 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2022-01-10T01:33:32.584 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2022-01-10T01:33:32.584 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.584 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2022-01-10T01:33:32.585 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2022-01-10T01:33:32.585 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.585 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2022-01-10T01:33:32.585 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2022-01-10T01:33:32.585 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.586 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2022-01-10T01:33:32.586 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.586 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2022-01-10T01:33:32.586 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2022-01-10T01:33:32.586 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2022-01-10T01:33:32.587 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2022-01-10T01:33:32.587 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2022-01-10T01:33:32.587 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2022-01-10T01:33:32.587 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2022-01-10T01:33:32.588 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-01-10T01:33:32.588 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2022-01-10T01:33:32.588 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.588 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2022-01-10T01:33:32.588 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.589 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2022-01-10T01:33:32.589 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.589 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2022-01-10T01:33:32.589 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.590 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2022-01-10T01:33:32.590 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2022-01-10T01:33:32.590 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2022-01-10T01:33:32.590 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.36,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2022-01-10T01:33:32.590 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = 5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762 2022-01-10T01:33:32.591 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.591 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2022-01-10T01:33:32.591 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2022-01-10T01:33:32.591 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.592 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2022-01-10T01:33:32.592 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2022-01-10T01:33:32.592 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.592 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2022-01-10T01:33:32.592 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2022-01-10T01:33:32.593 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.593 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2022-01-10T01:33:32.593 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2022-01-10T01:33:32.593 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2022-01-10T01:33:32.594 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.594 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2022-01-10T01:33:32.594 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2022-01-10T01:33:32.594 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.594 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2022-01-10T01:33:32.595 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.595 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2022-01-10T01:33:32.595 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.595 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2022-01-10T01:33:32.596 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.596 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2022-01-10T01:33:32.596 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2022-01-10T01:33:32.596 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.596 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2022-01-10T01:33:32.597 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2022-01-10T01:33:32.597 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2022-01-10T01:33:32.597 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore compression mode = aggressive 2022-01-10T01:33:32.597 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2022-01-10T01:33:32.598 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 20 2022-01-10T01:33:32.598 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 20 2022-01-10T01:33:32.598 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:33:32.598 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2022-01-10T01:33:32.598 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 10 2022-01-10T01:33:32.599 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2022-01-10T01:33:32.599 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2022-01-10T01:33:32.599 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2022-01-10T01:33:32.599 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2022-01-10T01:33:32.600 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2022-01-10T01:33:32.600 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2022-01-10T01:33:32.600 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.600 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2022-01-10T01:33:32.600 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:33:32.601 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2022-01-10T01:33:32.601 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2022-01-10T01:33:32.601 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2022-01-10T01:33:32.601 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:32.601 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:32.602 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2022-01-10T01:33:32.602 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.602 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2022-01-10T01:33:32.602 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:33:32.603 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2022-01-10T01:33:32.603 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2022-01-10T01:33:32.603 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2022-01-10T01:33:32.603 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2022-01-10T01:33:32.604 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2022-01-10T01:33:32.604 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2022-01-10T01:33:32.604 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2022-01-10T01:33:32.604 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2022-01-10T01:33:32.605 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2022-01-10T01:33:32.605 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.605 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-01-10T01:33:32.605 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2022-01-10T01:33:32.606 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2022-01-10T01:33:32.606 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.606 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2022-01-10T01:33:32.606 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-01-10T01:33:32.606 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-01-10T01:33:32.607 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2022-01-10T01:33:32.607 INFO:teuthology.orchestra.run.smithi059.stdout: 2022-01-10T01:33:32.607 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2022-01-10T01:33:32.607 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2022-01-10T01:33:32.608 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2022-01-10T01:33:32.608 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2022-01-10T01:33:32.608 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-01-10T01:33:32.608 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-01-10T01:33:32.608 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2022-01-10T01:33:32.609 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2022-01-10T01:33:32.609 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:33:32.609 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 15m 2022-01-10T01:33:32.609 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 15m 2022-01-10T01:33:32.609 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2022-01-10T01:33:32.610 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2022-01-10T01:33:32.610 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2022-01-10T01:33:32.610 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2022-01-10T01:33:32.610 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2022-01-10T01:33:32.610 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2022-01-10T01:33:32.611 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2022-01-10T01:33:32.611 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2022-01-10T01:33:32.611 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2022-01-10T01:33:32.611 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal frag = True 2022-01-10T01:33:32.611 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal fragment size max = 10000 2022-01-10T01:33:32.612 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal merge size = 5 2022-01-10T01:33:32.612 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal split bits = 3 2022-01-10T01:33:32.612 INFO:teuthology.orchestra.run.smithi059.stdout: mds bal split size = 100 2022-01-10T01:33:32.612 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2022-01-10T01:33:32.613 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = True 2022-01-10T01:33:32.613 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2022-01-10T01:33:32.613 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = True 2022-01-10T01:33:32.613 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2022-01-10T01:33:32.613 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 15m 2022-01-10T01:33:32.614 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 15m 2022-01-10T01:33:32.614 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2022-01-10T01:33:32.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.721+0000 7fabc52b4700 1 Processor -- start 2022-01-10T01:33:32.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.721+0000 7fabc52b4700 1 -- start start 2022-01-10T01:33:32.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fabc00b54a0 0x7fabc00af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:32.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc00b0610 0x7fabc01475a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:32.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fabc00675a0 0x7fabc00acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:32.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc01452e0 con 0x7fabc00675a0 2022-01-10T01:33:32.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc00adff0 con 0x7fabc00b54a0 2022-01-10T01:33:32.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc00b5880 con 0x7fabc00b0610 2022-01-10T01:33:32.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc4ab3700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fabc00675a0 0x7fabc00acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:32.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc4ab3700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fabc00675a0 0x7fabc00acc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42080/0 (socket says 172.21.15.36:42080) 2022-01-10T01:33:32.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc4ab3700 1 -- 172.21.15.36:0/4238547483 learned_addr learned my addr 172.21.15.36:0/4238547483 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:32.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabbf7fe700 1 --2- 172.21.15.36:0/4238547483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc00b0610 0x7fabc01475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:32.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabbffff700 1 --2- 172.21.15.36:0/4238547483 >> v2:172.21.15.59:3300/0 conn(0x7fabc00b54a0 0x7fabc00af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:32.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc4ab3700 1 -- 172.21.15.36:0/4238547483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc00b0610 msgr2=0x7fabc01475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:32.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc4ab3700 1 --2- 172.21.15.36:0/4238547483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc00b0610 0x7fabc01475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc4ab3700 1 -- 172.21.15.36:0/4238547483 >> v2:172.21.15.59:3300/0 conn(0x7fabc00b54a0 msgr2=0x7fabc00af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:32.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc4ab3700 1 --2- 172.21.15.36:0/4238547483 >> v2:172.21.15.59:3300/0 conn(0x7fabc00b54a0 0x7fabc00af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc4ab3700 1 -- 172.21.15.36:0/4238547483 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc00ac800 con 0x7fabc00675a0 2022-01-10T01:33:32.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabbf7fe700 1 --2- 172.21.15.36:0/4238547483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc00b0610 0x7fabc01475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:32.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc4ab3700 1 --2- 172.21.15.36:0/4238547483 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabc00675a0 0x7fabc00acc60 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7fabb80032f0 tx=0x7fabb8009290).ready entity=mon.0 client_cookie=e9827ccdc598fd8f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:32.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabbeffd700 1 -- 172.21.15.36:0/4238547483 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabb800b870 con 0x7fabc00675a0 2022-01-10T01:33:32.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabbeffd700 1 -- 172.21.15.36:0/4238547483 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb800b9d0 con 0x7fabc00675a0 2022-01-10T01:33:32.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabbeffd700 1 -- 172.21.15.36:0/4238547483 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabb800bb40 con 0x7fabc00675a0 2022-01-10T01:33:32.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 -- 172.21.15.36:0/4238547483 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabc00675a0 msgr2=0x7fabc00acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:32.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 --2- 172.21.15.36:0/4238547483 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabc00675a0 0x7fabc00acc60 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7fabb80032f0 tx=0x7fabb8009290).stop 2022-01-10T01:33:32.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 -- 172.21.15.36:0/4238547483 shutdown_connections 2022-01-10T01:33:32.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 --2- 172.21.15.36:0/4238547483 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabc00675a0 0x7fabc00acc60 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 --2- 172.21.15.36:0/4238547483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc00b0610 0x7fabc01475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 --2- 172.21.15.36:0/4238547483 >> v2:172.21.15.59:3300/0 conn(0x7fabc00b54a0 0x7fabc00af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 -- 172.21.15.36:0/4238547483 >> 172.21.15.36:0/4238547483 conn(0x7fabc0062560 msgr2=0x7fabc0062940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:32.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 -- 172.21.15.36:0/4238547483 shutdown_connections 2022-01-10T01:33:32.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 -- 172.21.15.36:0/4238547483 wait complete. 2022-01-10T01:33:32.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 Processor -- start 2022-01-10T01:33:32.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.725+0000 7fabc52b4700 1 -- start start 2022-01-10T01:33:32.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc52b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabc00675a0 0x7fabc01466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:32.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc52b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc00b0610 0x7fabc0157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:32.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc52b4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabc00b54a0 0x7fabc0157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:32.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc52b4700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc0156fd0 con 0x7fabc00b54a0 2022-01-10T01:33:32.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc52b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc0138210 con 0x7fabc00675a0 2022-01-10T01:33:32.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc52b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc0066ce0 con 0x7fabc00b0610 2022-01-10T01:33:32.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc4ab3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabc00b54a0 0x7fabc0157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:32.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabbffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabc00675a0 0x7fabc01466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:32.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabbf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc00b0610 0x7fabc0157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:32.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc4ab3700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabc00b54a0 0x7fabc0157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42086/0 (socket says 172.21.15.36:42086) 2022-01-10T01:33:32.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabbf7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc00b0610 0x7fabc0157660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:48366/0 (socket says 172.21.15.36:48366) 2022-01-10T01:33:32.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabbffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabc00675a0 0x7fabc01466f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:38716/0 (socket says 172.21.15.36:38716) 2022-01-10T01:33:32.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabbf7fe700 1 -- 172.21.15.36:0/471380350 learned_addr learned my addr 172.21.15.36:0/471380350 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:32.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc4ab3700 1 -- 172.21.15.36:0/471380350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc00b0610 msgr2=0x7fabc0157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:32.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc4ab3700 1 --2- 172.21.15.36:0/471380350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc00b0610 0x7fabc0157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc4ab3700 1 -- 172.21.15.36:0/471380350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabc00675a0 msgr2=0x7fabc01466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:32.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc4ab3700 1 --2- 172.21.15.36:0/471380350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabc00675a0 0x7fabc01466f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc4ab3700 1 -- 172.21.15.36:0/471380350 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb8009530 con 0x7fabc00b54a0 2022-01-10T01:33:32.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc4ab3700 1 --2- 172.21.15.36:0/471380350 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabc00b54a0 0x7fabc0157b50 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7fabb80032f0 tx=0x7fabb8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:32.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabbd7fa700 1 -- 172.21.15.36:0/471380350 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabb800b870 con 0x7fabc00b54a0 2022-01-10T01:33:32.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabbd7fa700 1 -- 172.21.15.36:0/471380350 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb8011e60 con 0x7fabc00b54a0 2022-01-10T01:33:32.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc52b4700 1 -- 172.21.15.36:0/471380350 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc00649e0 con 0x7fabc00b54a0 2022-01-10T01:33:32.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabbd7fa700 1 -- 172.21.15.36:0/471380350 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabb8020660 con 0x7fabc00b54a0 2022-01-10T01:33:32.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.729+0000 7fabc52b4700 1 -- 172.21.15.36:0/471380350 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc00b4760 con 0x7fabc00b54a0 2022-01-10T01:33:32.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.733+0000 7fabc52b4700 1 -- 172.21.15.36:0/471380350 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc00b14f0 con 0x7fabc00b54a0 2022-01-10T01:33:32.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.733+0000 7fabbd7fa700 1 -- 172.21.15.36:0/471380350 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fabb800f070 con 0x7fabc00b54a0 2022-01-10T01:33:32.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.733+0000 7fabbd7fa700 1 --2- 172.21.15.36:0/471380350 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faba0053620 0x7faba0055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:32.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.733+0000 7fabbd7fa700 1 -- 172.21.15.36:0/471380350 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fabb806c390 con 0x7fabc00b54a0 2022-01-10T01:33:32.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.733+0000 7fabbffff700 1 --2- 172.21.15.36:0/471380350 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faba0053620 0x7faba0055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:32.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.733+0000 7fabbffff700 1 --2- 172.21.15.36:0/471380350 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faba0053620 0x7faba0055ae0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fabb400c000 tx=0x7fabb4006f90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:32.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.741+0000 7fabbd7fa700 1 -- 172.21.15.36:0/471380350 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fabb8043570 con 0x7fabc00b54a0 2022-01-10T01:33:32.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.873+0000 7fabc52b4700 1 -- 172.21.15.36:0/471380350 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fabc0057350 con 0x7fabc00b54a0 2022-01-10T01:33:32.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.881+0000 7fabbd7fa700 1 -- 172.21.15.36:0/471380350 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fabb80150a0 con 0x7fabc00b54a0 2022-01-10T01:33:32.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.885+0000 7fabc52b4700 1 -- 172.21.15.36:0/471380350 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faba0053620 msgr2=0x7faba0055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:32.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.885+0000 7fabc52b4700 1 --2- 172.21.15.36:0/471380350 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faba0053620 0x7faba0055ae0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fabb400c000 tx=0x7fabb4006f90).stop 2022-01-10T01:33:32.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.885+0000 7fabc52b4700 1 -- 172.21.15.36:0/471380350 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabc00b54a0 msgr2=0x7fabc0157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:32.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.885+0000 7fabc52b4700 1 --2- 172.21.15.36:0/471380350 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabc00b54a0 0x7fabc0157b50 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7fabb80032f0 tx=0x7fabb8016000).stop 2022-01-10T01:33:32.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.885+0000 7fabc52b4700 1 -- 172.21.15.36:0/471380350 shutdown_connections 2022-01-10T01:33:32.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.885+0000 7fabc52b4700 1 --2- 172.21.15.36:0/471380350 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7faba0053620 0x7faba0055ae0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.885+0000 7fabc52b4700 1 --2- 172.21.15.36:0/471380350 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fabc00b54a0 0x7fabc0157b50 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.885+0000 7fabc52b4700 1 --2- 172.21.15.36:0/471380350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fabc00b0610 0x7fabc0157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.885+0000 7fabc52b4700 1 --2- 172.21.15.36:0/471380350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabc00675a0 0x7fabc01466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:32.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.885+0000 7fabc52b4700 1 -- 172.21.15.36:0/471380350 >> 172.21.15.36:0/471380350 conn(0x7fabc0062560 msgr2=0x7fabc00ae670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:32.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.885+0000 7fabc52b4700 1 -- 172.21.15.36:0/471380350 shutdown_connections 2022-01-10T01:33:32.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:32.885+0000 7fabc52b4700 1 -- 172.21.15.36:0/471380350 wait complete. 2022-01-10T01:33:32.905 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2022-01-10T01:33:33.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16effff700 1 Processor -- start 2022-01-10T01:33:33.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16effff700 1 -- start start 2022-01-10T01:33:33.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16effff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f16f00b30d0 0x7f16f0143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:33.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16effff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00ace70 0x7f16f013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:33.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16effff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f0143920 con 0x7f16f00b0710 2022-01-10T01:33:33.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16effff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f00b0af0 con 0x7f16f00b30d0 2022-01-10T01:33:33.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16effff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f00ae680 con 0x7f16f00ace70 2022-01-10T01:33:33.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16eeffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f16f00b0710 0x7f16f0142d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39884/0 (socket says 172.21.15.36:39884) 2022-01-10T01:33:33.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16eeffd700 1 -- 172.21.15.36:0/3022470870 learned_addr learned my addr 172.21.15.36:0/3022470870 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:33.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16ee7fc700 1 --2- 172.21.15.36:0/3022470870 >> v2:172.21.15.36:3300/0 conn(0x7f16f00b30d0 0x7f16f0143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:33.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 -- 172.21.15.36:0/3022470870 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241536333 0 0) 0x7f16f0143920 con 0x7f16f00b0710 2022-01-10T01:33:33.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 -- 172.21.15.36:0/3022470870 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16d0003260 con 0x7f16f00b0710 2022-01-10T01:33:33.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16ef7fe700 1 --2- 172.21.15.36:0/3022470870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00ace70 0x7f16f013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:33.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 -- 172.21.15.36:0/3022470870 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1187874425 0 0) 0x7f16d0003260 con 0x7f16f00b0710 2022-01-10T01:33:33.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 -- 172.21.15.36:0/3022470870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00ace70 msgr2=0x7f16f013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:33.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 --2- 172.21.15.36:0/3022470870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00ace70 0x7f16f013f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:33.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 -- 172.21.15.36:0/3022470870 >> v2:172.21.15.36:3300/0 conn(0x7f16f00b30d0 msgr2=0x7f16f0143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:33.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 --2- 172.21.15.36:0/3022470870 >> v2:172.21.15.36:3300/0 conn(0x7f16f00b30d0 0x7f16f0143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:33.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 -- 172.21.15.36:0/3022470870 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f00ae920 con 0x7f16f00b0710 2022-01-10T01:33:33.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 -- 172.21.15.36:0/3022470870 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f16e00019e0 con 0x7f16f00b0710 2022-01-10T01:33:33.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16ee7fc700 1 --2- 172.21.15.36:0/3022470870 >> v2:172.21.15.36:3300/0 conn(0x7f16f00b30d0 0x7f16f0143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:33.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 -- 172.21.15.36:0/3022470870 >> v1:172.21.15.36:6789/0 conn(0x7f16f00b0710 legacy=0x7f16f0142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:33.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 --2- 172.21.15.36:0/3022470870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00ace70 0x7f16d0003750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:33.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 --2- 172.21.15.36:0/3022470870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16d0003c80 0x7f16d0004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:33.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 --2- 172.21.15.36:0/3022470870 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16d00049f0 0x7f16d0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:33.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 -- 172.21.15.36:0/3022470870 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f00b0af0 con 0x7f16d00049f0 2022-01-10T01:33:33.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 -- 172.21.15.36:0/3022470870 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f00ae680 con 0x7f16d0003c80 2022-01-10T01:33:33.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 -- 172.21.15.36:0/3022470870 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d000b750 con 0x7f16f00ace70 2022-01-10T01:33:33.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16ef7fe700 1 --2- 172.21.15.36:0/3022470870 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16d00049f0 0x7f16d0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:33.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16ee7fc700 1 --2- 172.21.15.36:0/3022470870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16d0003c80 0x7f16d0004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:33.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16eeffd700 1 --2- 172.21.15.36:0/3022470870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00ace70 0x7f16d0003750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:33.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16ef7fe700 1 -- 172.21.15.36:0/3022470870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00ace70 msgr2=0x7f16d0003750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:33.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16ef7fe700 1 --2- 172.21.15.36:0/3022470870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00ace70 0x7f16d0003750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:33.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16ef7fe700 1 -- 172.21.15.36:0/3022470870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16d0003c80 msgr2=0x7f16d0004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:33.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16ef7fe700 1 --2- 172.21.15.36:0/3022470870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16d0003c80 0x7f16d0004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:33.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16ef7fe700 1 -- 172.21.15.36:0/3022470870 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d0003260 con 0x7f16d00049f0 2022-01-10T01:33:33.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16eeffd700 1 --2- 172.21.15.36:0/3022470870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f00ace70 0x7f16d0003750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:33:33.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16ef7fe700 1 --2- 172.21.15.36:0/3022470870 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16d00049f0 0x7f16d0004e70 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f16d00054d0 tx=0x7f16e8006df0).ready entity=mon.0 client_cookie=cbe6932aedf8ed12 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:33.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 -- 172.21.15.36:0/3022470870 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16e800e830 con 0x7f16d00049f0 2022-01-10T01:33:33.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 -- 172.21.15.36:0/3022470870 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e800be90 con 0x7f16d00049f0 2022-01-10T01:33:33.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.005+0000 7f16edffb700 1 -- 172.21.15.36:0/3022470870 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16e800eb80 con 0x7f16d00049f0 2022-01-10T01:33:33.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16effff700 1 -- 172.21.15.36:0/3022470870 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16d00049f0 msgr2=0x7f16d0004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:33.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16effff700 1 --2- 172.21.15.36:0/3022470870 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16d00049f0 0x7f16d0004e70 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f16d00054d0 tx=0x7f16e8006df0).stop 2022-01-10T01:33:33.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16ef7fe700 1 -- 172.21.15.36:0/3022470870 reap_dead start 2022-01-10T01:33:33.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16effff700 1 -- 172.21.15.36:0/3022470870 shutdown_connections 2022-01-10T01:33:33.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16effff700 1 -- 172.21.15.36:0/3022470870 >> 172.21.15.36:0/3022470870 conn(0x7f16f0061140 msgr2=0x7f16f0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:33.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16effff700 1 -- 172.21.15.36:0/3022470870 shutdown_connections 2022-01-10T01:33:33.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16effff700 1 -- 172.21.15.36:0/3022470870 wait complete. 2022-01-10T01:33:33.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16effff700 1 Processor -- start 2022-01-10T01:33:33.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16effff700 1 -- start start 2022-01-10T01:33:33.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16effff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16d00049f0 0x7f16f013e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:33.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16effff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f013abc0 0x7f16f0156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:33.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16effff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f013c810 0x7f16f013cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:33.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16effff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f013b020 con 0x7f16d00049f0 2022-01-10T01:33:33.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16effff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f0156740 con 0x7f16f013c810 2022-01-10T01:33:33.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16effff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f013ebc0 con 0x7f16f013abc0 2022-01-10T01:33:33.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16eeffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16d00049f0 0x7f16f013e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:33.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16eeffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16d00049f0 0x7f16f013e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42102/0 (socket says 172.21.15.36:42102) 2022-01-10T01:33:33.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16eeffd700 1 -- 172.21.15.36:0/2662437009 learned_addr learned my addr 172.21.15.36:0/2662437009 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:33.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16ef7fe700 1 --2- 172.21.15.36:0/2662437009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f013c810 0x7f16f013cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:33.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16ee7fc700 1 --2- 172.21.15.36:0/2662437009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f013abc0 0x7f16f0156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:33.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16eeffd700 1 -- 172.21.15.36:0/2662437009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f013abc0 msgr2=0x7f16f0156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:33.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16eeffd700 1 --2- 172.21.15.36:0/2662437009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f013abc0 0x7f16f0156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:33.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16eeffd700 1 -- 172.21.15.36:0/2662437009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f013c810 msgr2=0x7f16f013cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:33.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16eeffd700 1 --2- 172.21.15.36:0/2662437009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f013c810 0x7f16f013cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:33.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.009+0000 7f16eeffd700 1 -- 172.21.15.36:0/2662437009 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f013ee60 con 0x7f16d00049f0 2022-01-10T01:33:33.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.013+0000 7f16eeffd700 1 --2- 172.21.15.36:0/2662437009 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16d00049f0 0x7f16f013e590 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f16e0008000 tx=0x7f16e0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:33.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.013+0000 7f16e7fff700 1 -- 172.21.15.36:0/2662437009 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16e0004ab0 con 0x7f16d00049f0 2022-01-10T01:33:33.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.013+0000 7f16e7fff700 1 -- 172.21.15.36:0/2662437009 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e0004c10 con 0x7f16d00049f0 2022-01-10T01:33:33.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.013+0000 7f16effff700 1 -- 172.21.15.36:0/2662437009 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f00aa950 con 0x7f16d00049f0 2022-01-10T01:33:33.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.013+0000 7f16e7fff700 1 -- 172.21.15.36:0/2662437009 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16e0007170 con 0x7f16d00049f0 2022-01-10T01:33:33.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.013+0000 7f16effff700 1 -- 172.21.15.36:0/2662437009 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f00aadf0 con 0x7f16d00049f0 2022-01-10T01:33:33.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.013+0000 7f16effff700 1 -- 172.21.15.36:0/2662437009 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f0057350 con 0x7f16d00049f0 2022-01-10T01:33:33.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.013+0000 7f16e7fff700 1 -- 172.21.15.36:0/2662437009 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f16e00072d0 con 0x7f16d00049f0 2022-01-10T01:33:33.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.013+0000 7f16e7fff700 1 --2- 172.21.15.36:0/2662437009 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f16d4053560 0x7f16d4055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:33.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.013+0000 7f16e7fff700 1 -- 172.21.15.36:0/2662437009 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f16e006bdf0 con 0x7f16d00049f0 2022-01-10T01:33:33.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.013+0000 7f16ee7fc700 1 --2- 172.21.15.36:0/2662437009 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f16d4053560 0x7f16d4055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:33.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.017+0000 7f16ee7fc700 1 --2- 172.21.15.36:0/2662437009 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f16d4053560 0x7f16d4055a20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f16d800b000 tx=0x7f16d8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:33.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.021+0000 7f16e7fff700 1 -- 172.21.15.36:0/2662437009 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f16e00430e0 con 0x7f16d00049f0 2022-01-10T01:33:33.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.193+0000 7f16effff700 1 -- 172.21.15.36:0/2662437009 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f16f00b2c70 con 0x7f16d00049f0 2022-01-10T01:33:33.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.417+0000 7f16e7fff700 1 -- 172.21.15.36:0/2662437009 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v422) v1 ==== 128+0+0 (secure 0 0 0) 0x7f16e0046700 con 0x7f16d00049f0 2022-01-10T01:33:33.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.421+0000 7f16effff700 1 -- 172.21.15.36:0/2662437009 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f16d4053560 msgr2=0x7f16d4055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:33.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.421+0000 7f16effff700 1 --2- 172.21.15.36:0/2662437009 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f16d4053560 0x7f16d4055a20 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f16d800b000 tx=0x7f16d8008040).stop 2022-01-10T01:33:33.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.421+0000 7f16effff700 1 -- 172.21.15.36:0/2662437009 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16d00049f0 msgr2=0x7f16f013e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:33.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.421+0000 7f16effff700 1 --2- 172.21.15.36:0/2662437009 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16d00049f0 0x7f16f013e590 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f16e0008000 tx=0x7f16e0009040).stop 2022-01-10T01:33:33.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.421+0000 7f16effff700 1 -- 172.21.15.36:0/2662437009 shutdown_connections 2022-01-10T01:33:33.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.421+0000 7f16effff700 1 --2- 172.21.15.36:0/2662437009 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f16d4053560 0x7f16d4055a20 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:33.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.421+0000 7f16effff700 1 --2- 172.21.15.36:0/2662437009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16f013c810 0x7f16f013cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:33.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.421+0000 7f16effff700 1 --2- 172.21.15.36:0/2662437009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16f013abc0 0x7f16f0156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:33.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.421+0000 7f16effff700 1 --2- 172.21.15.36:0/2662437009 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f16d00049f0 0x7f16f013e590 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:33.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.421+0000 7f16effff700 1 -- 172.21.15.36:0/2662437009 >> 172.21.15.36:0/2662437009 conn(0x7f16f0061140 msgr2=0x7f16f005fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:33.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.421+0000 7f16effff700 1 -- 172.21.15.36:0/2662437009 shutdown_connections 2022-01-10T01:33:33.431 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.421+0000 7f16effff700 1 -- 172.21.15.36:0/2662437009 wait complete. 2022-01-10T01:33:33.443 INFO:tasks.cephfs_test_runner:test_getattr_caps (tasks.cephfs.test_misc.TestMisc) ... ok 2022-01-10T01:33:33.443 INFO:tasks.cephfs_test_runner:Starting test: test_root_rctime (tasks.cephfs.test_misc.TestMisc) 2022-01-10T01:33:33.444 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2022-01-10T01:33:33.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe08c9a8700 1 Processor -- start 2022-01-10T01:33:33.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe08c9a8700 1 -- start start 2022-01-10T01:33:33.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe08c9a8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe0880b27a0 0x7fe088147470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:33.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe08c9a8700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08814b8e0 con 0x7fe08805c490 2022-01-10T01:33:33.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe08c9a8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0880b2b80 con 0x7fe0880b1d10 2022-01-10T01:33:33.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe08c9a8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0881451b0 con 0x7fe0880b27a0 2022-01-10T01:33:33.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe087fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe08805c490 0x7fe0880a8b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39908/0 (socket says 172.21.15.36:39908) 2022-01-10T01:33:33.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe087fff700 1 -- 172.21.15.36:0/3667121038 learned_addr learned my addr 172.21.15.36:0/3667121038 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:33.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe0877fe700 1 --2- 172.21.15.36:0/3667121038 >> v2:172.21.15.59:3300/0 conn(0x7fe0880b27a0 0x7fe088147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:33.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe0867fc700 1 -- 172.21.15.36:0/3667121038 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301243471 0 0) 0x7fe08814b8e0 con 0x7fe08805c490 2022-01-10T01:33:33.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe0867fc700 1 -- 172.21.15.36:0/3667121038 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe068003260 con 0x7fe08805c490 2022-01-10T01:33:33.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe0877fe700 1 -- 172.21.15.36:0/3667121038 >> v1:172.21.15.59:6789/0 conn(0x7fe0880b1d10 legacy=0x7fe08814b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:33.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe0867fc700 1 -- 172.21.15.36:0/3667121038 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1758955538 0 0) 0x7fe068003260 con 0x7fe08805c490 2022-01-10T01:33:33.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe0877fe700 1 -- 172.21.15.36:0/3667121038 >> v1:172.21.15.36:6789/0 conn(0x7fe08805c490 legacy=0x7fe0880a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:33.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe0877fe700 1 -- 172.21.15.36:0/3667121038 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08814aad0 con 0x7fe0880b27a0 2022-01-10T01:33:33.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe0877fe700 1 --2- 172.21.15.36:0/3667121038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0880b27a0 0x7fe088147470 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fe078001800 tx=0x7fe070006df0).ready entity=mon.1 client_cookie=9940470b30f1d491 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:33.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe0867fc700 1 -- 172.21.15.36:0/3667121038 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe078001660 con 0x7fe0880b27a0 2022-01-10T01:33:33.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe0867fc700 1 -- 172.21.15.36:0/3667121038 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe070000e90 con 0x7fe0880b27a0 2022-01-10T01:33:33.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe0867fc700 1 -- 172.21.15.36:0/3667121038 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe07000d4f0 con 0x7fe0880b27a0 2022-01-10T01:33:33.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe08c9a8700 1 -- 172.21.15.36:0/3667121038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0880b27a0 msgr2=0x7fe088147470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:33.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.553+0000 7fe08c9a8700 1 --2- 172.21.15.36:0/3667121038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0880b27a0 0x7fe088147470 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fe078001800 tx=0x7fe070006df0).stop 2022-01-10T01:33:33.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.557+0000 7fe08c9a8700 1 -- 172.21.15.36:0/3667121038 shutdown_connections 2022-01-10T01:33:33.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.557+0000 7fe08c9a8700 1 --2- 172.21.15.36:0/3667121038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0880b27a0 0x7fe088147470 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:33.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.557+0000 7fe08c9a8700 1 -- 172.21.15.36:0/3667121038 >> 172.21.15.36:0/3667121038 conn(0x7fe088061140 msgr2=0x7fe088062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:33.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.557+0000 7fe08c9a8700 1 -- 172.21.15.36:0/3667121038 shutdown_connections 2022-01-10T01:33:33.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.557+0000 7fe08c9a8700 1 -- 172.21.15.36:0/3667121038 wait complete. 2022-01-10T01:33:33.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.557+0000 7fe08c9a8700 1 Processor -- start 2022-01-10T01:33:33.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.557+0000 7fe08c9a8700 1 -- start start 2022-01-10T01:33:33.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe08c9a8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe08805c490 0x7fe0880afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:33.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe08c9a8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0880b1d10 0x7fe088146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:33.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe08c9a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0880b27a0 0x7fe0880aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:33.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe08c9a8700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0880a9840 con 0x7fe08805c490 2022-01-10T01:33:33.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe08c9a8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0880a9ae0 con 0x7fe0880b1d10 2022-01-10T01:33:33.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe08c9a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0880a9d80 con 0x7fe0880b27a0 2022-01-10T01:33:33.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe0877fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe08805c490 0x7fe0880afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:33.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe0877fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe08805c490 0x7fe0880afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42116/0 (socket says 172.21.15.36:42116) 2022-01-10T01:33:33.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe0877fe700 1 -- 172.21.15.36:0/288871222 learned_addr learned my addr 172.21.15.36:0/288871222 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:33.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe087fff700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0880b27a0 0x7fe0880aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:33.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe086ffd700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0880b1d10 0x7fe088146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:33.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe0877fe700 1 -- 172.21.15.36:0/288871222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0880b27a0 msgr2=0x7fe0880aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:33.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe0877fe700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0880b27a0 0x7fe0880aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:33.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe0877fe700 1 -- 172.21.15.36:0/288871222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0880b1d10 msgr2=0x7fe088146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:33.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe0877fe700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0880b1d10 0x7fe088146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:33.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe0877fe700 1 -- 172.21.15.36:0/288871222 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07000b180 con 0x7fe08805c490 2022-01-10T01:33:33.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe087fff700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0880b27a0 0x7fe0880aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:33.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe086ffd700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0880b1d10 0x7fe088146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:33.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe0877fe700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe08805c490 0x7fe0880afad0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7fe078001800 tx=0x7fe070014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:33.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe084ff9700 1 -- 172.21.15.36:0/288871222 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe070002f50 con 0x7fe08805c490 2022-01-10T01:33:33.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe084ff9700 1 -- 172.21.15.36:0/288871222 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07000de40 con 0x7fe08805c490 2022-01-10T01:33:33.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe08c9a8700 1 -- 172.21.15.36:0/288871222 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0880aa020 con 0x7fe08805c490 2022-01-10T01:33:33.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe084ff9700 1 -- 172.21.15.36:0/288871222 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe07001e5f0 con 0x7fe08805c490 2022-01-10T01:33:33.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe08c9a8700 1 -- 172.21.15.36:0/288871222 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0881443d0 con 0x7fe08805c490 2022-01-10T01:33:33.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.561+0000 7fe08c9a8700 1 -- 172.21.15.36:0/288871222 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe088057350 con 0x7fe08805c490 2022-01-10T01:33:33.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.565+0000 7fe084ff9700 1 -- 172.21.15.36:0/288871222 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe070025030 con 0x7fe08805c490 2022-01-10T01:33:33.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.565+0000 7fe084ff9700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe06c053680 0x7fe06c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:33.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.565+0000 7fe084ff9700 1 -- 172.21.15.36:0/288871222 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fe07006c5f0 con 0x7fe08805c490 2022-01-10T01:33:33.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.565+0000 7fe086ffd700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe06c053680 0x7fe06c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:33.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.565+0000 7fe086ffd700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe06c053680 0x7fe06c055b40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fe08000b000 tx=0x7fe080009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:33.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.569+0000 7fe084ff9700 1 -- 172.21.15.36:0/288871222 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe070043850 con 0x7fe08805c490 2022-01-10T01:33:33.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:33.737+0000 7fe08c9a8700 1 -- 172.21.15.36:0/288871222 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7fe0880b5790 con 0x7fe08805c490 2022-01-10T01:33:34.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.421+0000 7fe084ff9700 1 -- 172.21.15.36:0/288871222 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v423) v1 ==== 130+0+0 (secure 0 0 0) 0x7fe070046df0 con 0x7fe08805c490 2022-01-10T01:33:34.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.425+0000 7fe08c9a8700 1 -- 172.21.15.36:0/288871222 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe06c053680 msgr2=0x7fe06c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:34.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.425+0000 7fe08c9a8700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe06c053680 0x7fe06c055b40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fe08000b000 tx=0x7fe080009040).stop 2022-01-10T01:33:34.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.425+0000 7fe08c9a8700 1 -- 172.21.15.36:0/288871222 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe08805c490 msgr2=0x7fe0880afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:34.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.425+0000 7fe08c9a8700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe08805c490 0x7fe0880afad0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7fe078001800 tx=0x7fe070014000).stop 2022-01-10T01:33:34.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.425+0000 7fe08c9a8700 1 -- 172.21.15.36:0/288871222 shutdown_connections 2022-01-10T01:33:34.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.425+0000 7fe08c9a8700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe06c053680 0x7fe06c055b40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:34.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.425+0000 7fe08c9a8700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0880b27a0 0x7fe0880aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:34.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.425+0000 7fe08c9a8700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0880b1d10 0x7fe088146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:34.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.425+0000 7fe08c9a8700 1 --2- 172.21.15.36:0/288871222 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe08805c490 0x7fe0880afad0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:34.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.425+0000 7fe08c9a8700 1 -- 172.21.15.36:0/288871222 >> 172.21.15.36:0/288871222 conn(0x7fe088061140 msgr2=0x7fe08814b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:34.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.425+0000 7fe08c9a8700 1 -- 172.21.15.36:0/288871222 shutdown_connections 2022-01-10T01:33:34.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.425+0000 7fe08c9a8700 1 -- 172.21.15.36:0/288871222 wait complete. 2022-01-10T01:33:34.451 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2022-01-10T01:33:34.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.561+0000 7ff433434700 1 Processor -- start 2022-01-10T01:33:34.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.561+0000 7ff433434700 1 -- start start 2022-01-10T01:33:34.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff433434700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff42c1445a0 0x7ff42c0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:34.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff433434700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c062100 con 0x7ff42c061d20 2022-01-10T01:33:34.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff433434700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42c0b2a10 con 0x7ff42c0b3ac0 2022-01-10T01:33:34.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff433434700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42c0b11e0 con 0x7ff42c1445a0 2022-01-10T01:33:34.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff4319d1700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff42c1445a0 0x7ff42c0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:34.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff4311d0700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff42c061d20 0x7ff42c05ff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39918/0 (socket says 172.21.15.36:39918) 2022-01-10T01:33:34.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff4311d0700 1 -- 172.21.15.36:0/1914756302 learned_addr learned my addr 172.21.15.36:0/1914756302 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:34.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff4319d1700 1 -- 172.21.15.36:0/1914756302 >> v1:172.21.15.59:6789/0 conn(0x7ff42c0b3ac0 legacy=0x7ff42c13dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:34.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff4319d1700 1 -- 172.21.15.36:0/1914756302 >> v1:172.21.15.36:6789/0 conn(0x7ff42c061d20 legacy=0x7ff42c05ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:34.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff4319d1700 1 -- 172.21.15.36:0/1914756302 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c0b2ca0 con 0x7ff42c1445a0 2022-01-10T01:33:34.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff4319d1700 1 --2- 172.21.15.36:0/1914756302 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff42c1445a0 0x7ff42c0b2520 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7ff42c141000 tx=0x7ff4240091d0).ready entity=mon.0 client_cookie=80771d25965aeca8 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:34.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff423fff700 1 -- 172.21.15.36:0/1914756302 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff42400b860 con 0x7ff42c1445a0 2022-01-10T01:33:34.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff423fff700 1 -- 172.21.15.36:0/1914756302 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42400b9c0 con 0x7ff42c1445a0 2022-01-10T01:33:34.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff433434700 1 -- 172.21.15.36:0/1914756302 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff42c1445a0 msgr2=0x7ff42c0b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:34.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff433434700 1 --2- 172.21.15.36:0/1914756302 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff42c1445a0 0x7ff42c0b2520 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7ff42c141000 tx=0x7ff4240091d0).stop 2022-01-10T01:33:34.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff433434700 1 -- 172.21.15.36:0/1914756302 shutdown_connections 2022-01-10T01:33:34.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff433434700 1 --2- 172.21.15.36:0/1914756302 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff42c1445a0 0x7ff42c0b2520 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:34.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff433434700 1 -- 172.21.15.36:0/1914756302 >> 172.21.15.36:0/1914756302 conn(0x7ff42c0639b0 msgr2=0x7ff42c063d90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:34.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff433434700 1 -- 172.21.15.36:0/1914756302 shutdown_connections 2022-01-10T01:33:34.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.565+0000 7ff433434700 1 -- 172.21.15.36:0/1914756302 wait complete. 2022-01-10T01:33:34.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff433434700 1 Processor -- start 2022-01-10T01:33:34.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff433434700 1 -- start start 2022-01-10T01:33:34.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff433434700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff42c061d20 0x7ff42c143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:34.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff433434700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff42c0b3ac0 0x7ff42c0664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:34.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff433434700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff42c1445a0 0x7ff42c0669d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:34.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff433434700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c1475d0 con 0x7ff42c061d20 2022-01-10T01:33:34.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff433434700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c13a8c0 con 0x7ff42c0b3ac0 2022-01-10T01:33:34.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff433434700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42c13ad90 con 0x7ff42c1445a0 2022-01-10T01:33:34.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff4311d0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff42c061d20 0x7ff42c143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:34.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff4311d0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff42c061d20 0x7ff42c143890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42130/0 (socket says 172.21.15.36:42130) 2022-01-10T01:33:34.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff4311d0700 1 -- 172.21.15.36:0/399478780 learned_addr learned my addr 172.21.15.36:0/399478780 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:34.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff4309cf700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff42c0b3ac0 0x7ff42c0664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:34.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff4319d1700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff42c1445a0 0x7ff42c0669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:34.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff4311d0700 1 -- 172.21.15.36:0/399478780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff42c1445a0 msgr2=0x7ff42c0669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:34.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff4311d0700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff42c1445a0 0x7ff42c0669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:34.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff4311d0700 1 -- 172.21.15.36:0/399478780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff42c0b3ac0 msgr2=0x7ff42c0664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:34.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff4311d0700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff42c0b3ac0 0x7ff42c0664e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:34.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff4311d0700 1 -- 172.21.15.36:0/399478780 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff424009470 con 0x7ff42c061d20 2022-01-10T01:33:34.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.569+0000 7ff4309cf700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff42c0b3ac0 0x7ff42c0664e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:34.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.573+0000 7ff4311d0700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff42c061d20 0x7ff42c143890 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7ff42c13d850 tx=0x7ff428007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:34.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.573+0000 7ff4227fc700 1 -- 172.21.15.36:0/399478780 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff42800ce20 con 0x7ff42c061d20 2022-01-10T01:33:34.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.573+0000 7ff4227fc700 1 -- 172.21.15.36:0/399478780 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4280072e0 con 0x7ff42c061d20 2022-01-10T01:33:34.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.573+0000 7ff433434700 1 -- 172.21.15.36:0/399478780 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42c066ec0 con 0x7ff42c061d20 2022-01-10T01:33:34.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.573+0000 7ff4227fc700 1 -- 172.21.15.36:0/399478780 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff428005800 con 0x7ff42c061d20 2022-01-10T01:33:34.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.573+0000 7ff433434700 1 -- 172.21.15.36:0/399478780 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42c13aaf0 con 0x7ff42c061d20 2022-01-10T01:33:34.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.573+0000 7ff433434700 1 -- 172.21.15.36:0/399478780 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42c05f830 con 0x7ff42c061d20 2022-01-10T01:33:34.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.573+0000 7ff4227fc700 1 -- 172.21.15.36:0/399478780 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff428010070 con 0x7ff42c061d20 2022-01-10T01:33:34.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.573+0000 7ff4227fc700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff414053590 0x7ff414055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:34.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.573+0000 7ff4227fc700 1 -- 172.21.15.36:0/399478780 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ff42806ad60 con 0x7ff42c061d20 2022-01-10T01:33:34.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.573+0000 7ff4309cf700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff414053590 0x7ff414055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:34.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.577+0000 7ff4309cf700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff414053590 0x7ff414055a50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7ff41c00b000 tx=0x7ff41c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:34.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.581+0000 7ff4227fc700 1 -- 172.21.15.36:0/399478780 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff428041f40 con 0x7ff42c061d20 2022-01-10T01:33:34.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.709+0000 7ff433434700 1 -- 172.21.15.36:0/399478780 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff42c066ec0 con 0x7ff42c061d20 2022-01-10T01:33:34.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.721+0000 7ff4227fc700 1 -- 172.21.15.36:0/399478780 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff42c066ec0 con 0x7ff42c061d20 2022-01-10T01:33:34.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.721+0000 7ff433434700 1 -- 172.21.15.36:0/399478780 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff414053590 msgr2=0x7ff414055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:34.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.721+0000 7ff433434700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff414053590 0x7ff414055a50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7ff41c00b000 tx=0x7ff41c009040).stop 2022-01-10T01:33:34.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.721+0000 7ff433434700 1 -- 172.21.15.36:0/399478780 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff42c061d20 msgr2=0x7ff42c143890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:34.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.721+0000 7ff433434700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff42c061d20 0x7ff42c143890 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7ff42c13d850 tx=0x7ff428007c00).stop 2022-01-10T01:33:34.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.721+0000 7ff433434700 1 -- 172.21.15.36:0/399478780 shutdown_connections 2022-01-10T01:33:34.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.721+0000 7ff433434700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff414053590 0x7ff414055a50 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:34.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.721+0000 7ff433434700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff42c1445a0 0x7ff42c0669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:34.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.721+0000 7ff433434700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff42c0b3ac0 0x7ff42c0664e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:34.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.721+0000 7ff433434700 1 --2- 172.21.15.36:0/399478780 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff42c061d20 0x7ff42c143890 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:34.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.721+0000 7ff433434700 1 -- 172.21.15.36:0/399478780 >> 172.21.15.36:0/399478780 conn(0x7ff42c0639b0 msgr2=0x7ff42c145910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:34.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.721+0000 7ff433434700 1 -- 172.21.15.36:0/399478780 shutdown_connections 2022-01-10T01:33:34.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.721+0000 7ff433434700 1 -- 172.21.15.36:0/399478780 wait complete. 2022-01-10T01:33:34.741 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:33:34.742 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:34.759 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:34.780 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:34.801 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:34.822 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:33:34.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:34.823 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:34.823 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:34.850 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2022-01-10T01:33:34.850 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:33:34.851 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2022-01-10T01:33:34.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:34.852 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:34.852 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:34.872 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:33:34.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:33:34.874 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:33:34.874 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:33:34.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.977+0000 7f56bc993700 1 Processor -- start 2022-01-10T01:33:34.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.977+0000 7f56bc993700 1 -- start start 2022-01-10T01:33:34.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56bc993700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56b80b1c50 0x7f56b80ab530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:34.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56bc993700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f56b80b2960 0x7f56b80aba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:34.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56bc993700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b81434c0 con 0x7f56b8139ae0 2022-01-10T01:33:34.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56bc993700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b80b3010 con 0x7f56b80b2960 2022-01-10T01:33:34.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56bc993700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b80af320 con 0x7f56b80b1c50 2022-01-10T01:33:34.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56b6d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f56b80b2960 0x7f56b80aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:34.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56b659c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f56b8139ae0 0x7f56b8142db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39932/0 (socket says 172.21.15.36:39932) 2022-01-10T01:33:34.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56b6d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f56b80b2960 0x7f56b80aba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42140/0 (socket says 172.21.15.36:42140) 2022-01-10T01:33:34.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56b659c700 1 -- 172.21.15.36:0/1676109390 learned_addr learned my addr 172.21.15.36:0/1676109390 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:34.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56b5d9b700 1 --2- 172.21.15.36:0/1676109390 >> v2:172.21.15.59:3300/0 conn(0x7f56b80b1c50 0x7f56b80ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:34.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56b6d9d700 1 -- 172.21.15.36:0/1676109390 >> v2:172.21.15.59:3300/0 conn(0x7f56b80b1c50 msgr2=0x7f56b80ab530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:34.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56b6d9d700 1 --2- 172.21.15.36:0/1676109390 >> v2:172.21.15.59:3300/0 conn(0x7f56b80b1c50 0x7f56b80ab530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:34.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56b6d9d700 1 -- 172.21.15.36:0/1676109390 >> v1:172.21.15.36:6789/0 conn(0x7f56b8139ae0 legacy=0x7f56b8142db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:34.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56b559a700 1 -- 172.21.15.36:0/1676109390 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642976090 0 0) 0x7f56b81434c0 con 0x7f56b8139ae0 2022-01-10T01:33:34.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56b6d9d700 1 -- 172.21.15.36:0/1676109390 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b80ac470 con 0x7f56b80b2960 2022-01-10T01:33:34.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56b6d9d700 1 --2- 172.21.15.36:0/1676109390 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56b80b2960 0x7f56b80aba20 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f56b80af120 tx=0x7f56a8006df0).ready entity=mon.0 client_cookie=fe1cdf2bba8fdd83 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:34.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56b559a700 1 -- 172.21.15.36:0/1676109390 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56a800d5c0 con 0x7f56b80b2960 2022-01-10T01:33:34.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56b559a700 1 -- 172.21.15.36:0/1676109390 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a8000e90 con 0x7f56b80b2960 2022-01-10T01:33:34.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56b559a700 1 -- 172.21.15.36:0/1676109390 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56a800d910 con 0x7f56b80b2960 2022-01-10T01:33:34.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56bc993700 1 -- 172.21.15.36:0/1676109390 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56b80b2960 msgr2=0x7f56b80aba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:34.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56bc993700 1 --2- 172.21.15.36:0/1676109390 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56b80b2960 0x7f56b80aba20 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f56b80af120 tx=0x7f56a8006df0).stop 2022-01-10T01:33:34.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56bc993700 1 -- 172.21.15.36:0/1676109390 shutdown_connections 2022-01-10T01:33:34.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56bc993700 1 --2- 172.21.15.36:0/1676109390 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56b80b2960 0x7f56b80aba20 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:34.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56bc993700 1 --2- 172.21.15.36:0/1676109390 >> v2:172.21.15.59:3300/0 conn(0x7f56b80b1c50 0x7f56b80ab530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:34.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56bc993700 1 -- 172.21.15.36:0/1676109390 >> 172.21.15.36:0/1676109390 conn(0x7f56b805f6b0 msgr2=0x7f56b805fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:34.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56bc993700 1 -- 172.21.15.36:0/1676109390 shutdown_connections 2022-01-10T01:33:34.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.981+0000 7f56bc993700 1 -- 172.21.15.36:0/1676109390 wait complete. 2022-01-10T01:33:34.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56bc993700 1 Processor -- start 2022-01-10T01:33:34.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56bc993700 1 -- start start 2022-01-10T01:33:34.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56bc993700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56b80b1c50 0x7f56b8063720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:34.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56bc993700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b80b2960 0x7f56b813fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:34.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56bc993700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56b8062a90 0x7f56b8062f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:35.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56bc993700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b813cd70 con 0x7f56b8062a90 2022-01-10T01:33:35.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56bc993700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8153a50 con 0x7f56b80b1c50 2022-01-10T01:33:35.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56bc993700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b813c830 con 0x7f56b80b2960 2022-01-10T01:33:35.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56b6d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56b8062a90 0x7f56b8062f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56b659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56b80b1c50 0x7f56b8063720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56b5d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b80b2960 0x7f56b813fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56b659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56b80b1c50 0x7f56b8063720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:38778/0 (socket says 172.21.15.36:38778) 2022-01-10T01:33:35.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56b659c700 1 -- 172.21.15.36:0/2954579618 learned_addr learned my addr 172.21.15.36:0/2954579618 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:35.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56b6d9d700 1 -- 172.21.15.36:0/2954579618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b80b2960 msgr2=0x7f56b813fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56b6d9d700 1 --2- 172.21.15.36:0/2954579618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b80b2960 0x7f56b813fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56b6d9d700 1 -- 172.21.15.36:0/2954579618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56b80b1c50 msgr2=0x7f56b8063720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56b6d9d700 1 --2- 172.21.15.36:0/2954579618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56b80b1c50 0x7f56b8063720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56b6d9d700 1 -- 172.21.15.36:0/2954579618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a800b180 con 0x7f56b8062a90 2022-01-10T01:33:35.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56b6d9d700 1 --2- 172.21.15.36:0/2954579618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56b8062a90 0x7f56b8062f20 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f56b80af120 tx=0x7f56a8012000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:35.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56af7fe700 1 -- 172.21.15.36:0/2954579618 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56a8016070 con 0x7f56b8062a90 2022-01-10T01:33:35.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56af7fe700 1 -- 172.21.15.36:0/2954579618 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a800de40 con 0x7f56b8062a90 2022-01-10T01:33:35.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56bc993700 1 -- 172.21.15.36:0/2954579618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b813cad0 con 0x7f56b8062a90 2022-01-10T01:33:35.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56af7fe700 1 -- 172.21.15.36:0/2954579618 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56a8013de0 con 0x7f56b8062a90 2022-01-10T01:33:35.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.985+0000 7f56bc993700 1 -- 172.21.15.36:0/2954579618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b8063410 con 0x7f56b8062a90 2022-01-10T01:33:35.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.989+0000 7f56af7fe700 1 -- 172.21.15.36:0/2954579618 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f56a800f030 con 0x7f56b8062a90 2022-01-10T01:33:35.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.989+0000 7f56bc993700 1 -- 172.21.15.36:0/2954579618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b8143730 con 0x7f56b8062a90 2022-01-10T01:33:35.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.989+0000 7f56af7fe700 1 --2- 172.21.15.36:0/2954579618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f569c053590 0x7f569c055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:35.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.989+0000 7f56af7fe700 1 -- 172.21.15.36:0/2954579618 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f56a806c410 con 0x7f56b8062a90 2022-01-10T01:33:35.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.989+0000 7f56b659c700 1 --2- 172.21.15.36:0/2954579618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f569c053590 0x7f569c055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.989+0000 7f56b659c700 1 --2- 172.21.15.36:0/2954579618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f569c053590 0x7f569c055a50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f56b000d000 tx=0x7f56b00013f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:35.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:34.993+0000 7f56af7fe700 1 -- 172.21.15.36:0/2954579618 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f56a80435b0 con 0x7f56b8062a90 2022-01-10T01:33:35.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.121+0000 7f56bc993700 1 -- 172.21.15.36:0/2954579618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f56b8057350 con 0x7f56b8062a90 2022-01-10T01:33:35.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.125+0000 7f56af7fe700 1 -- 172.21.15.36:0/2954579618 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v142) v1 ==== 81+0+29229 (secure 0 0 0) 0x7f56a8023090 con 0x7f56b8062a90 2022-01-10T01:33:35.133 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:35.133 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:33:35.133 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 142, 2022-01-10T01:33:35.133 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:33:35.134 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:33:35.134 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:33:32.404871+0000", 2022-01-10T01:33:35.134 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:33:35.134 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:33:35.135 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:33:35.135 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:33:35.135 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:33:35.135 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:33:35.136 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:33:35.136 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:33:35.136 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:33:35.136 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:35.137 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:33:35.137 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:33:35.137 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:33:35.137 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:33:35.138 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:33:35.138 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 26, 2022-01-10T01:33:35.138 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:33:35.139 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:33:35.139 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:33:35.139 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:33:35.139 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:33:35.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.140 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:33:35.140 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:33:35.140 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:33:35.140 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:35.141 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:35.141 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:35.141 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:35.141 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:35.142 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:35.142 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:35.142 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:35.142 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:33:35.143 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:33:35.143 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:33:35.143 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:33:35.143 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:33:35.144 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:35.144 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:35.144 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:35.144 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:35.144 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:35.145 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:35.145 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:35.145 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.145 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:33:35.146 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:35.146 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:35.146 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:35.146 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:35.147 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:35.147 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:35.147 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:35.147 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:35.148 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:35.148 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:35.148 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:35.148 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:35.149 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:35.149 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:35.149 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:35.149 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:35.150 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:35.150 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:35.150 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:35.150 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:35.151 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:35.151 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:35.151 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:35.151 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:35.152 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:35.152 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:35.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.152 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:35.153 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:35.153 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:35.153 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:35.153 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:35.153 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:35.154 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:35.154 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:35.154 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:35.154 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:35.155 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:35.155 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:33:35.155 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:33:35.155 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.156 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:35.156 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:33:35.156 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.157 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:33:35.157 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:33:35.157 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:33:35.157 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:35.158 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:35.158 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:35.158 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:35.158 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:35.159 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:35.159 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:35.159 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:35.159 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:33:35.160 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:33:35.160 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:33:35.160 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:33:35.160 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:33:35.160 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:35.161 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:35.161 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:35.161 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:35.161 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:35.162 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:35.162 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:35.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.162 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:33:35.163 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:35.163 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:35.163 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:35.163 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:35.164 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:35.164 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:35.164 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:35.164 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:35.164 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:35.165 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:35.165 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:35.165 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:35.165 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:35.166 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:35.166 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:35.166 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:35.166 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:35.167 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:35.167 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:35.167 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:35.167 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:35.167 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:35.168 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:35.168 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:35.168 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:35.168 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:35.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.169 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:35.169 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:35.169 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:35.169 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:35.170 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:35.170 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:35.170 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:35.170 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:35.171 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:35.171 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:35.171 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:35.171 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:33:35.172 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:35.172 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:33:35.172 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.172 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.172 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:35.173 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:33:35.173 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.173 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:33:35.173 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:33:35.174 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:35.174 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:35.174 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:35.174 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:35.175 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:35.175 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:35.175 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:35.175 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 137, 2022-01-10T01:33:35.176 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:35.176 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:35.176 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:35.176 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.177 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.177 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.177 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:33:35.178 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:35.178 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.178 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.178 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:33:35.179 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:35.179 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.179 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.180 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:35.180 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.180 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.181 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.181 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:33:35.181 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:35.181 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.182 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.182 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:33:35.182 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:35.182 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.183 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.183 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.183 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:35.183 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.184 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.184 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.184 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:33:35.184 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:35.185 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.185 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.185 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.185 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:33:35.185 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:35.186 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.186 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.186 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.186 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:35.187 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.187 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.187 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:33:35.188 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:35.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.188 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.188 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.188 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:33:35.189 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:35.189 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.189 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.189 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.190 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:33:35.190 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:33:35.190 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:33:35.190 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:33:35.191 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:35.191 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:35.191 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:35.191 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.192 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:33:35.192 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:33:35.193 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:35.193 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:35.193 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:35.193 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:35.194 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:35.194 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:35.194 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:35.194 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 137, 2022-01-10T01:33:35.194 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:35.195 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:35.195 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:35.195 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.195 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.196 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.196 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:33:35.196 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:35.196 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.197 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.197 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:33:35.197 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:35.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.198 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.198 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:35.199 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.199 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.199 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.199 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:33:35.200 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:35.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.200 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.201 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:33:35.201 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:35.201 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.201 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.201 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.202 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:35.202 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.202 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.203 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.203 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:33:35.203 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:35.203 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.204 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.204 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:33:35.204 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:35.205 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.205 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.205 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:35.206 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.206 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.206 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.206 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:33:35.207 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:35.207 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.207 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.208 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:33:35.208 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:35.208 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.208 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.209 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.209 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:33:35.209 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:33:35.209 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:33:35.210 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:33:35.210 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:35.210 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:35.210 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:35.211 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.211 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.211 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:33:35.212 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:33:35.212 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:35.212 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:35.212 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:35.213 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:35.213 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:35.213 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:35.213 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:35.214 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 125, 2022-01-10T01:33:35.214 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:35.214 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:35.214 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:35.215 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.215 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.215 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:33:35.216 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:35.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.216 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.216 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.217 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:33:35.217 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:35.217 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.217 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.217 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.218 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:35.218 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.218 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.218 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.219 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:33:35.219 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:35.219 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.219 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.220 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:33:35.220 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:35.220 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.220 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.221 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.221 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:35.221 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.221 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.221 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.222 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:33:35.222 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:35.222 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.222 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.223 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.223 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:33:35.223 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:35.223 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.224 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.224 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.224 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:35.224 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.225 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.225 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.225 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:33:35.225 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:35.226 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.226 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.226 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.226 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:33:35.227 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:35.227 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.227 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.228 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:33:35.228 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:33:35.228 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:33:35.229 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:33:35.229 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:35.229 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:35.229 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:35.230 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.230 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.231 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:33:35.231 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:33:35.231 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:35.232 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:35.232 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:35.232 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:35.232 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:35.233 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:35.233 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:35.233 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 137, 2022-01-10T01:33:35.233 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:35.234 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:35.234 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:35.234 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.235 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.235 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:33:35.235 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:35.235 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.236 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.236 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:33:35.236 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:35.237 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.237 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.237 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:35.238 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.238 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.238 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:33:35.239 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:35.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.239 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.239 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.240 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:33:35.240 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:35.240 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.240 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.240 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.241 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:35.241 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.241 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.242 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:33:35.242 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:35.242 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.242 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.243 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.243 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:33:35.243 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:35.244 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.244 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.244 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.244 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:35.245 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.245 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.246 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:33:35.246 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:35.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.247 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.247 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:33:35.247 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:35.248 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.248 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.248 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.248 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:33:35.249 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:33:35.249 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:33:35.249 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:33:35.249 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:35.249 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:35.250 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:35.250 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.250 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.250 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.251 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:33:35.251 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:33:35.251 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:35.251 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:35.252 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:35.252 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:35.252 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:35.252 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:35.253 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:35.253 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 137, 2022-01-10T01:33:35.253 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:35.253 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:35.253 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:35.254 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.254 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.254 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.254 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:33:35.255 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:35.255 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.255 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.255 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:33:35.256 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:35.256 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.256 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.257 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:35.257 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.257 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.257 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.258 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:33:35.258 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:35.258 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.258 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.259 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.259 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:33:35.259 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:35.259 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.259 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.260 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.260 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:35.260 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.261 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.261 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:33:35.261 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:35.261 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.261 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.262 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.262 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:33:35.262 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:35.262 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.263 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.263 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.263 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:35.263 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.264 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.264 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:33:35.264 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:35.265 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.265 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.265 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.265 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:33:35.265 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:35.266 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.266 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.266 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:33:35.267 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:33:35.267 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:33:35.267 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:33:35.267 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:35.267 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:35.268 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:35.268 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.268 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.268 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.269 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:33:35.269 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:33:35.269 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:35.269 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:35.269 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:35.270 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:35.270 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:35.270 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:35.270 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:35.271 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 137, 2022-01-10T01:33:35.271 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:35.271 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:35.271 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:35.272 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.272 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.272 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.272 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:33:35.272 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:35.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.273 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.273 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:33:35.274 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:35.274 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.274 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.274 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.275 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:35.275 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.275 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.275 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.275 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:33:35.276 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:35.276 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.276 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.276 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.277 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:33:35.277 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:35.277 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.277 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.278 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.278 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:35.278 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.279 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.279 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:33:35.279 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:35.279 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.279 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.280 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.280 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:33:35.280 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:35.280 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.281 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.281 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.281 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:35.281 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.282 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.282 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:33:35.282 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:35.283 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.283 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.283 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.283 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:33:35.284 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:35.284 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.284 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.284 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:33:35.285 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:33:35.285 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:33:35.285 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:33:35.285 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:35.286 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:35.286 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:35.286 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.287 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:33:35.287 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:33:35.287 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:35.287 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:35.288 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:35.288 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:35.288 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:35.288 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:35.289 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:35.289 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 125, 2022-01-10T01:33:35.289 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:35.289 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:35.289 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:35.290 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.290 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.290 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.291 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:33:35.291 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:35.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.292 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.292 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:33:35.292 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:35.292 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.293 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.293 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.293 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:35.293 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.294 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.294 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:33:35.294 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:35.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.295 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.295 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.295 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:33:35.295 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:35.296 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.296 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.296 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.296 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:35.297 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.297 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.297 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.297 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:33:35.298 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:35.298 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.298 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.298 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.299 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:33:35.299 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:35.299 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.299 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.300 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:35.300 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.301 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.301 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.301 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:33:35.301 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:35.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.302 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.302 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.302 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:33:35.303 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:35.303 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.303 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.304 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.304 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:33:35.304 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:33:35.304 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:33:35.305 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:33:35.305 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:35.305 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:35.305 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:35.306 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.306 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.306 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.306 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:33:35.307 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:33:35.307 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:35.307 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:35.307 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:35.308 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:35.308 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:35.308 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:35.308 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:35.308 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 137, 2022-01-10T01:33:35.309 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:35.309 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:35.309 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:35.309 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.310 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.310 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.310 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:33:35.310 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:35.311 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.311 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.311 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.311 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:33:35.312 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:35.312 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.312 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.312 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.312 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:35.313 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.313 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.313 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.313 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:33:35.314 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:35.314 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.314 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.314 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.315 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:33:35.315 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:35.315 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.315 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.315 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.316 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:35.316 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.316 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.316 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.316 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:33:35.317 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:35.317 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.317 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.317 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.317 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:33:35.318 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:35.318 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.318 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.318 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.319 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:35.319 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:35.319 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.319 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:35.320 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:33:35.320 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:35.320 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.321 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.321 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:35.321 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:33:35.321 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:35.321 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.322 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.322 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.322 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:33:35.322 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:33:35.323 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:33:35.323 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:33:35.323 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:35.323 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:35.324 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:35.324 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:35.324 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.324 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:35.325 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:33:35.325 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.325 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:33:35.325 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:35.325 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:35.326 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:35.326 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:35.326 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:35.326 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:33:35.327 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:35.327 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.327 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.327 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:33:35.328 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:35.328 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:35.328 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:35.328 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:35.329 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:35.329 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:33:35.329 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:35.329 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.330 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.330 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:33:35.330 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:35.330 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:35.331 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:35.331 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:35.331 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:35.331 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:33:35.332 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:35.332 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.332 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.332 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:33:35.333 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:35.333 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:35.333 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:35.333 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:35.334 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:35.334 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:33:35.334 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:35.334 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.335 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.335 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:33:35.335 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:35.335 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:35.335 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:35.336 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:35.336 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:35.336 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:33:35.336 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:35.337 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.337 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.337 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:33:35.337 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:35.338 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:35.338 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:35.338 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:35.338 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:35.338 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:33:35.339 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:35.339 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.339 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.339 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:33:35.340 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:35.340 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:35.340 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:35.340 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:35.341 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:35.341 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:33:35.341 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:35.341 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.342 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:35.342 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:33:35.342 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:35.342 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:35.343 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:35.343 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:35.343 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:35.343 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:33:35.344 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:35.344 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.344 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:35.344 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:33:35.344 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:33:35.345 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:33:35.345 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:33:35.345 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": { 2022-01-10T01:33:35.345 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.59:6833/3822558856": "2022-01-11T01:33:29.142886+0000", 2022-01-10T01:33:35.346 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.59:6832/3822558856": "2022-01-11T01:33:29.142886+0000" 2022-01-10T01:33:35.346 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.346 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:33:35.346 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:33:35.347 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:33:35.347 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:33:35.347 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:33:35.347 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:33:35.348 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:33:35.348 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:33:35.348 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:33:35.348 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:33:35.348 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:33:35.349 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:33:35.349 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.349 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:33:35.349 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:33:35.350 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:33:35.350 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:33:35.350 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:33:35.350 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:33:35.351 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:33:35.351 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:35.351 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:35.351 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:33:35.352 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:33:35.352 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:33:35.352 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:33:35.352 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:33:35.352 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:33:35.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.125+0000 7f56bc993700 1 -- 172.21.15.36:0/2954579618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f569c053590 msgr2=0x7f569c055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.125+0000 7f56bc993700 1 --2- 172.21.15.36:0/2954579618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f569c053590 0x7f569c055a50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f56b000d000 tx=0x7f56b00013f0).stop 2022-01-10T01:33:35.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.125+0000 7f56bc993700 1 -- 172.21.15.36:0/2954579618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56b8062a90 msgr2=0x7f56b8062f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.125+0000 7f56bc993700 1 --2- 172.21.15.36:0/2954579618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56b8062a90 0x7f56b8062f20 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7f56b80af120 tx=0x7f56a8012000).stop 2022-01-10T01:33:35.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.125+0000 7f56bc993700 1 -- 172.21.15.36:0/2954579618 shutdown_connections 2022-01-10T01:33:35.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.125+0000 7f56bc993700 1 --2- 172.21.15.36:0/2954579618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f569c053590 0x7f569c055a50 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.125+0000 7f56bc993700 1 --2- 172.21.15.36:0/2954579618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f56b8062a90 0x7f56b8062f20 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.125+0000 7f56bc993700 1 --2- 172.21.15.36:0/2954579618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56b80b2960 0x7f56b813fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.125+0000 7f56bc993700 1 --2- 172.21.15.36:0/2954579618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56b80b1c50 0x7f56b8063720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.125+0000 7f56bc993700 1 -- 172.21.15.36:0/2954579618 >> 172.21.15.36:0/2954579618 conn(0x7f56b805f6b0 msgr2=0x7f56b80ad400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:35.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.129+0000 7f56bc993700 1 -- 172.21.15.36:0/2954579618 shutdown_connections 2022-01-10T01:33:35.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.129+0000 7f56bc993700 1 -- 172.21.15.36:0/2954579618 wait complete. 2022-01-10T01:33:35.358 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:35.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144f59e700 1 Processor -- start 2022-01-10T01:33:35.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144f59e700 1 -- start start 2022-01-10T01:33:35.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144f59e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f14500a9c10 0x7f14500607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:35.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144f59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1450066ea0 con 0x7f1450140140 2022-01-10T01:33:35.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144f59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14500b3420 con 0x7f14500b3040 2022-01-10T01:33:35.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144f59e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14500648e0 con 0x7f14500a9c10 2022-01-10T01:33:35.474 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144dd9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f14500a9c10 0x7f14500607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144ed9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f1450140140 0x7f1450140590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:39950/0 (socket says 172.21.15.36:39950) 2022-01-10T01:33:35.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144dd9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f14500a9c10 0x7f14500607c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42154/0 (socket says 172.21.15.36:42154) 2022-01-10T01:33:35.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144ed9d700 1 -- 172.21.15.36:0/1799500513 learned_addr learned my addr 172.21.15.36:0/1799500513 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:35.475 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144dd9b700 1 -- 172.21.15.36:0/1799500513 >> v1:172.21.15.59:6789/0 conn(0x7f14500b3040 legacy=0x7f1450065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144dd9b700 1 -- 172.21.15.36:0/1799500513 >> v1:172.21.15.36:6789/0 conn(0x7f1450140140 legacy=0x7f1450140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144dd9b700 1 -- 172.21.15.36:0/1799500513 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1450066960 con 0x7f14500a9c10 2022-01-10T01:33:35.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144dd9b700 1 --2- 172.21.15.36:0/1799500513 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f14500a9c10 0x7f14500607c0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f14480032f0 tx=0x7f14480091d0).ready entity=mon.0 client_cookie=ac851095f5f64b83 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:35.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144d59a700 1 -- 172.21.15.36:0/1799500513 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1448009ea0 con 0x7f14500a9c10 2022-01-10T01:33:35.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144d59a700 1 -- 172.21.15.36:0/1799500513 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144800ba90 con 0x7f14500a9c10 2022-01-10T01:33:35.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.465+0000 7f144d59a700 1 -- 172.21.15.36:0/1799500513 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f144800bdf0 con 0x7f14500a9c10 2022-01-10T01:33:35.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.469+0000 7f144f59e700 1 -- 172.21.15.36:0/1799500513 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f14500a9c10 msgr2=0x7f14500607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.469+0000 7f144f59e700 1 --2- 172.21.15.36:0/1799500513 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f14500a9c10 0x7f14500607c0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7f14480032f0 tx=0x7f14480091d0).stop 2022-01-10T01:33:35.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.469+0000 7f144f59e700 1 -- 172.21.15.36:0/1799500513 shutdown_connections 2022-01-10T01:33:35.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.469+0000 7f144f59e700 1 --2- 172.21.15.36:0/1799500513 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f14500a9c10 0x7f14500607c0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.469+0000 7f144f59e700 1 -- 172.21.15.36:0/1799500513 >> 172.21.15.36:0/1799500513 conn(0x7f14500636e0 msgr2=0x7f1450063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:35.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.469+0000 7f144f59e700 1 -- 172.21.15.36:0/1799500513 shutdown_connections 2022-01-10T01:33:35.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.469+0000 7f144f59e700 1 -- 172.21.15.36:0/1799500513 wait complete. 2022-01-10T01:33:35.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.469+0000 7f144f59e700 1 Processor -- start 2022-01-10T01:33:35.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.469+0000 7f144f59e700 1 -- start start 2022-01-10T01:33:35.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14500a9c10 0x7f145013faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:35.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144f59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f14500b3040 0x7f14500b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:35.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1450140140 0x7f145013def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:35.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144f59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145014e350 con 0x7f14500b3040 2022-01-10T01:33:35.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144f59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145014e5f0 con 0x7f1450140140 2022-01-10T01:33:35.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145014e890 con 0x7f14500a9c10 2022-01-10T01:33:35.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144dd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f14500b3040 0x7f14500b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144dd9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f14500b3040 0x7f14500b4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42160/0 (socket says 172.21.15.36:42160) 2022-01-10T01:33:35.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144dd9b700 1 -- 172.21.15.36:0/2490838925 learned_addr learned my addr 172.21.15.36:0/2490838925 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:35.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144ed9d700 1 --2- 172.21.15.36:0/2490838925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1450140140 0x7f145013def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144e59c700 1 --2- 172.21.15.36:0/2490838925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14500a9c10 0x7f145013faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144dd9b700 1 -- 172.21.15.36:0/2490838925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14500a9c10 msgr2=0x7f145013faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144dd9b700 1 --2- 172.21.15.36:0/2490838925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14500a9c10 0x7f145013faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144dd9b700 1 -- 172.21.15.36:0/2490838925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1450140140 msgr2=0x7f145013def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144dd9b700 1 --2- 172.21.15.36:0/2490838925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1450140140 0x7f145013def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144dd9b700 1 -- 172.21.15.36:0/2490838925 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1448009470 con 0x7f14500b3040 2022-01-10T01:33:35.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144dd9b700 1 --2- 172.21.15.36:0/2490838925 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f14500b3040 0x7f14500b4590 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f14480032f0 tx=0x7f1448018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:35.487 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f14477fe700 1 -- 172.21.15.36:0/2490838925 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1448023440 con 0x7f14500b3040 2022-01-10T01:33:35.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f14477fe700 1 -- 172.21.15.36:0/2490838925 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144801e040 con 0x7f14500b3040 2022-01-10T01:33:35.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144f59e700 1 -- 172.21.15.36:0/2490838925 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145014eb30 con 0x7f14500b3040 2022-01-10T01:33:35.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f14477fe700 1 -- 172.21.15.36:0/2490838925 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1448023790 con 0x7f14500b3040 2022-01-10T01:33:35.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.473+0000 7f144f59e700 1 -- 172.21.15.36:0/2490838925 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145014efd0 con 0x7f14500b3040 2022-01-10T01:33:35.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.477+0000 7f144f59e700 1 -- 172.21.15.36:0/2490838925 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145013a760 con 0x7f14500b3040 2022-01-10T01:33:35.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.477+0000 7f14477fe700 1 -- 172.21.15.36:0/2490838925 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1448029020 con 0x7f14500b3040 2022-01-10T01:33:35.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.477+0000 7f14477fe700 1 --2- 172.21.15.36:0/2490838925 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1434053620 0x7f1434055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:35.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.477+0000 7f14477fe700 1 -- 172.21.15.36:0/2490838925 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f144806f1b0 con 0x7f14500b3040 2022-01-10T01:33:35.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.477+0000 7f144e59c700 1 --2- 172.21.15.36:0/2490838925 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1434053620 0x7f1434055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.477+0000 7f144e59c700 1 --2- 172.21.15.36:0/2490838925 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1434053620 0x7f1434055ae0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f144000d000 tx=0x7f1440007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:35.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.481+0000 7f14477fe700 1 -- 172.21.15.36:0/2490838925 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f145013a760 con 0x7f14500b3040 2022-01-10T01:33:35.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.645+0000 7f144f59e700 1 -- 172.21.15.36:0/2490838925 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f145013a760 con 0x7f14500b3040 2022-01-10T01:33:35.784 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.645+0000 7f14477fe700 1 -- 172.21.15.36:0/2490838925 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+1562 (secure 0 0 0) 0x7f145013a760 con 0x7f14500b3040 2022-01-10T01:33:35.785 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:35.785 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":69,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8016,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/2824324236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2824324236},{"type":"v1","addr":"172.21.15.36:6835","nonce":2824324236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1768428808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1768428808},{"type":"v1","addr":"172.21.15.36:6837","nonce":1768428808}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8230,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/3297714708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3297714708},{"type":"v1","addr":"172.21.15.59:6833","nonce":3297714708}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[]} 2022-01-10T01:33:35.787 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.649+0000 7f144f59e700 1 -- 172.21.15.36:0/2490838925 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1434053620 msgr2=0x7f1434055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.649+0000 7f144f59e700 1 --2- 172.21.15.36:0/2490838925 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1434053620 0x7f1434055ae0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f144000d000 tx=0x7f1440007b90).stop 2022-01-10T01:33:35.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.649+0000 7f144f59e700 1 -- 172.21.15.36:0/2490838925 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f14500b3040 msgr2=0x7f14500b4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.649+0000 7f144f59e700 1 --2- 172.21.15.36:0/2490838925 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f14500b3040 0x7f14500b4590 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f14480032f0 tx=0x7f1448018000).stop 2022-01-10T01:33:35.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.649+0000 7f144f59e700 1 -- 172.21.15.36:0/2490838925 shutdown_connections 2022-01-10T01:33:35.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.649+0000 7f144f59e700 1 --2- 172.21.15.36:0/2490838925 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1434053620 0x7f1434055ae0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.649+0000 7f144f59e700 1 --2- 172.21.15.36:0/2490838925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1450140140 0x7f145013def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.649+0000 7f144f59e700 1 --2- 172.21.15.36:0/2490838925 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f14500b3040 0x7f14500b4590 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.649+0000 7f144f59e700 1 --2- 172.21.15.36:0/2490838925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14500a9c10 0x7f145013faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.649+0000 7f144f59e700 1 -- 172.21.15.36:0/2490838925 >> 172.21.15.36:0/2490838925 conn(0x7f14500636e0 msgr2=0x7f14500b5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:35.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.649+0000 7f144f59e700 1 -- 172.21.15.36:0/2490838925 shutdown_connections 2022-01-10T01:33:35.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.649+0000 7f144f59e700 1 -- 172.21.15.36:0/2490838925 wait complete. 2022-01-10T01:33:35.790 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 69 2022-01-10T01:33:35.791 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:35.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab96c34700 1 Processor -- start 2022-01-10T01:33:35.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab96c34700 1 -- start start 2022-01-10T01:33:35.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab96c34700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab90061320 0x7fab90061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:35.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab96c34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab900ad5c0 0x7fab900b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:35.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab96c34700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab900aecf0 con 0x7fab90140440 2022-01-10T01:33:35.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab96c34700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab900b6f20 con 0x7fab90061320 2022-01-10T01:33:35.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab96c34700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab900aef20 con 0x7fab900ad5c0 2022-01-10T01:33:35.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab95c32700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab90061320 0x7fab90061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab95431700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab900ad5c0 0x7fab900b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab95431700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab900ad5c0 0x7fab900b9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:48450/0 (socket says 172.21.15.36:48450) 2022-01-10T01:33:35.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab95431700 1 -- 172.21.15.36:0/4097967349 learned_addr learned my addr 172.21.15.36:0/4097967349 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:35.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab95c32700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab90061320 0x7fab90061700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:38800/0 (socket says 172.21.15.36:38800) 2022-01-10T01:33:35.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab96433700 1 --1- 172.21.15.36:0/4097967349 >> v1:172.21.15.59:6789/0 conn(0x7fab90140440 0x7fab90146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:57640/0 (socket says 172.21.15.36:57640) 2022-01-10T01:33:35.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab95431700 1 -- 172.21.15.36:0/4097967349 >> v2:172.21.15.59:3300/0 conn(0x7fab90061320 msgr2=0x7fab90061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:35.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab95431700 1 --2- 172.21.15.36:0/4097967349 >> v2:172.21.15.59:3300/0 conn(0x7fab90061320 0x7fab90061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab95431700 1 -- 172.21.15.36:0/4097967349 >> v1:172.21.15.59:6789/0 conn(0x7fab90140440 legacy=0x7fab90146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab95431700 1 -- 172.21.15.36:0/4097967349 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900af1c0 con 0x7fab900ad5c0 2022-01-10T01:33:35.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab95431700 1 --2- 172.21.15.36:0/4097967349 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab900ad5c0 0x7fab900b9e60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fab840032f0 tx=0x7fab84009290).ready entity=mon.2 client_cookie=3e8ec08021c62a1d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:35.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.893+0000 7fab94c30700 1 -- 172.21.15.36:0/4097967349 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab8400b8a0 con 0x7fab900ad5c0 2022-01-10T01:33:35.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab94c30700 1 -- 172.21.15.36:0/4097967349 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8400ba00 con 0x7fab900ad5c0 2022-01-10T01:33:35.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab94c30700 1 -- 172.21.15.36:0/4097967349 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab8400bb70 con 0x7fab900ad5c0 2022-01-10T01:33:35.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 -- 172.21.15.36:0/4097967349 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab900ad5c0 msgr2=0x7fab900b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 --2- 172.21.15.36:0/4097967349 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab900ad5c0 0x7fab900b9e60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fab840032f0 tx=0x7fab84009290).stop 2022-01-10T01:33:35.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 -- 172.21.15.36:0/4097967349 shutdown_connections 2022-01-10T01:33:35.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 --2- 172.21.15.36:0/4097967349 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab900ad5c0 0x7fab900b9e60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 --2- 172.21.15.36:0/4097967349 >> v2:172.21.15.59:3300/0 conn(0x7fab90061320 0x7fab90061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 -- 172.21.15.36:0/4097967349 >> 172.21.15.36:0/4097967349 conn(0x7fab90066de0 msgr2=0x7fab900671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:35.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 -- 172.21.15.36:0/4097967349 shutdown_connections 2022-01-10T01:33:35.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 -- 172.21.15.36:0/4097967349 wait complete. 2022-01-10T01:33:35.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 Processor -- start 2022-01-10T01:33:35.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 -- start start 2022-01-10T01:33:35.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab90061320 0x7fab9009ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:35.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fab900ad5c0 0x7fab90145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:35.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab90140440 0x7fab90152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:35.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9009e8b0 con 0x7fab900ad5c0 2022-01-10T01:33:35.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab90141b60 con 0x7fab90140440 2022-01-10T01:33:35.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab96c34700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab901532f0 con 0x7fab90061320 2022-01-10T01:33:35.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab95431700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fab900ad5c0 0x7fab90145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab95431700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fab900ad5c0 0x7fab90145ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42174/0 (socket says 172.21.15.36:42174) 2022-01-10T01:33:35.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.897+0000 7fab95431700 1 -- 172.21.15.36:0/3858241977 learned_addr learned my addr 172.21.15.36:0/3858241977 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:35.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab95c32700 1 --2- 172.21.15.36:0/3858241977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab90061320 0x7fab9009ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab96433700 1 --2- 172.21.15.36:0/3858241977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab90140440 0x7fab90152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab95431700 1 -- 172.21.15.36:0/3858241977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab90061320 msgr2=0x7fab9009ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab95431700 1 --2- 172.21.15.36:0/3858241977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab90061320 0x7fab9009ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab95431700 1 -- 172.21.15.36:0/3858241977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab90140440 msgr2=0x7fab90152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:35.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab95431700 1 --2- 172.21.15.36:0/3858241977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab90140440 0x7fab90152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:35.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab95431700 1 -- 172.21.15.36:0/3858241977 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab84009530 con 0x7fab900ad5c0 2022-01-10T01:33:35.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab95431700 1 --2- 172.21.15.36:0/3858241977 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fab900ad5c0 0x7fab90145ae0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7fab840032f0 tx=0x7fab84016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:35.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab82ffd700 1 -- 172.21.15.36:0/3858241977 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab8400b8a0 con 0x7fab900ad5c0 2022-01-10T01:33:35.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab82ffd700 1 -- 172.21.15.36:0/3858241977 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab84021480 con 0x7fab900ad5c0 2022-01-10T01:33:35.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab96c34700 1 -- 172.21.15.36:0/3858241977 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab901426e0 con 0x7fab900ad5c0 2022-01-10T01:33:35.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab82ffd700 1 -- 172.21.15.36:0/3858241977 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab840217e0 con 0x7fab900ad5c0 2022-01-10T01:33:35.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab96c34700 1 -- 172.21.15.36:0/3858241977 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab90142c20 con 0x7fab900ad5c0 2022-01-10T01:33:35.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab96c34700 1 -- 172.21.15.36:0/3858241977 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab900af460 con 0x7fab900ad5c0 2022-01-10T01:33:35.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.901+0000 7fab82ffd700 1 -- 172.21.15.36:0/3858241977 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fab8400f070 con 0x7fab900ad5c0 2022-01-10T01:33:35.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.905+0000 7fab82ffd700 1 --2- 172.21.15.36:0/3858241977 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fab70053560 0x7fab70055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:35.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.905+0000 7fab95c32700 1 --2- 172.21.15.36:0/3858241977 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fab70053560 0x7fab70055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:35.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.905+0000 7fab82ffd700 1 -- 172.21.15.36:0/3858241977 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fab8406cba0 con 0x7fab900ad5c0 2022-01-10T01:33:35.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.905+0000 7fab95c32700 1 --2- 172.21.15.36:0/3858241977 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fab70053560 0x7fab70055a20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7fab8c00b000 tx=0x7fab8c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:35.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:35.913+0000 7fab82ffd700 1 -- 172.21.15.36:0/3858241977 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fab84043e90 con 0x7fab900ad5c0 2022-01-10T01:33:36.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.081+0000 7fab96c34700 1 -- 172.21.15.36:0/3858241977 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab90057350 con 0x7fab900ad5c0 2022-01-10T01:33:36.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.081+0000 7fab82ffd700 1 -- 172.21.15.36:0/3858241977 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+1562 (secure 0 0 0) 0x7fab84015030 con 0x7fab900ad5c0 2022-01-10T01:33:36.088 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:36.089 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":69,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8016,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/2824324236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":2824324236},{"type":"v1","addr":"172.21.15.36:6835","nonce":2824324236}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8025,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/1768428808","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1768428808},{"type":"v1","addr":"172.21.15.36:6837","nonce":1768428808}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":64},{"gid":8230,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.59:6833/3297714708","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3297714708},{"type":"v1","addr":"172.21.15.59:6833","nonce":3297714708}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":69}],"filesystems":[]} 2022-01-10T01:33:36.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.081+0000 7fab96c34700 1 -- 172.21.15.36:0/3858241977 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fab70053560 msgr2=0x7fab70055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:36.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.081+0000 7fab96c34700 1 --2- 172.21.15.36:0/3858241977 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fab70053560 0x7fab70055a20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7fab8c00b000 tx=0x7fab8c006df0).stop 2022-01-10T01:33:36.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.081+0000 7fab96c34700 1 -- 172.21.15.36:0/3858241977 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fab900ad5c0 msgr2=0x7fab90145ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:36.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.081+0000 7fab96c34700 1 --2- 172.21.15.36:0/3858241977 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fab900ad5c0 0x7fab90145ae0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7fab840032f0 tx=0x7fab84016000).stop 2022-01-10T01:33:36.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.085+0000 7fab96c34700 1 -- 172.21.15.36:0/3858241977 shutdown_connections 2022-01-10T01:33:36.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.085+0000 7fab96c34700 1 --2- 172.21.15.36:0/3858241977 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fab70053560 0x7fab70055a20 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:36.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.085+0000 7fab96c34700 1 --2- 172.21.15.36:0/3858241977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab90140440 0x7fab90152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:36.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.085+0000 7fab96c34700 1 --2- 172.21.15.36:0/3858241977 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fab900ad5c0 0x7fab90145ae0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:36.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.085+0000 7fab96c34700 1 --2- 172.21.15.36:0/3858241977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fab90061320 0x7fab9009ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:36.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.085+0000 7fab96c34700 1 -- 172.21.15.36:0/3858241977 >> 172.21.15.36:0/3858241977 conn(0x7fab90066de0 msgr2=0x7fab900b8850 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:36.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.085+0000 7fab96c34700 1 -- 172.21.15.36:0/3858241977 shutdown_connections 2022-01-10T01:33:36.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.085+0000 7fab96c34700 1 -- 172.21.15.36:0/3858241977 wait complete. 2022-01-10T01:33:36.093 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 69 2022-01-10T01:33:36.102 INFO:tasks.ceph.mds.a:Restarting daemon 2022-01-10T01:33:36.102 INFO:tasks.ceph.mds.a:Stopping old one... 2022-01-10T01:33:36.102 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-01-10T01:33:36.103 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:33:36.103 INFO:tasks.ceph.mds.c:Restarting daemon 2022-01-10T01:33:36.103 INFO:tasks.ceph.mds.c:Stopping old one... 2022-01-10T01:33:36.104 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-01-10T01:33:36.104 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:33:36.104 INFO:tasks.ceph.mds.b:Restarting daemon 2022-01-10T01:33:36.104 INFO:tasks.ceph.mds.b:Stopping old one... 2022-01-10T01:33:36.105 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-01-10T01:33:36.105 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:33:36.115 INFO:tasks.ceph.mds.c:Stopped 2022-01-10T01:33:36.115 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-01-10T01:33:36.117 INFO:tasks.ceph.mds.a:Stopped 2022-01-10T01:33:36.117 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-01-10T01:33:36.118 INFO:tasks.ceph.mds.c:Started 2022-01-10T01:33:36.119 DEBUG:teuthology.parallel:result is None 2022-01-10T01:33:36.120 INFO:tasks.ceph.mds.a:Started 2022-01-10T01:33:36.121 DEBUG:teuthology.parallel:result is None 2022-01-10T01:33:36.121 INFO:tasks.ceph.mds.b:Stopped 2022-01-10T01:33:36.122 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-01-10T01:33:36.170 INFO:tasks.ceph.mds.b:Started 2022-01-10T01:33:36.171 DEBUG:teuthology.parallel:result is None 2022-01-10T01:33:36.172 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2022-01-10T01:33:36.197 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:33:36.206 INFO:tasks.ceph.mds.c.smithi036.stdout:starting mds.c at 2022-01-10T01:33:36.244 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:33:36.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.265+0000 7fd03ed2a700 1 Processor -- start 2022-01-10T01:33:36.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.265+0000 7fd03ed2a700 1 -- start start 2022-01-10T01:33:36.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03ed2a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd038060d70 0x7fd0380b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:36.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03ed2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0381450c0 0x7fd0380ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:36.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03ed2a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0380acc90 con 0x7fd0380b65c0 2022-01-10T01:33:36.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03ed2a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0380ae560 con 0x7fd038060d70 2022-01-10T01:33:36.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03cac6700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd0380b65c0 0x7fd038141000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40004/0 (socket says 172.21.15.36:40004) 2022-01-10T01:33:36.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03ed2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0381446e0 con 0x7fd0381450c0 2022-01-10T01:33:36.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03cac6700 1 -- 172.21.15.36:0/3396166266 learned_addr learned my addr 172.21.15.36:0/3396166266 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:36.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd037fff700 1 --2- 172.21.15.36:0/3396166266 >> v2:172.21.15.36:3300/0 conn(0x7fd038060d70 0x7fd0380b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:36.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03d2c7700 1 --2- 172.21.15.36:0/3396166266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0381450c0 0x7fd0380ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:36.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd0377fe700 1 -- 172.21.15.36:0/3396166266 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591825067 0 0) 0x7fd0380acc90 con 0x7fd0380b65c0 2022-01-10T01:33:36.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd0377fe700 1 -- 172.21.15.36:0/3396166266 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd024003260 con 0x7fd0380b65c0 2022-01-10T01:33:36.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd037fff700 1 -- 172.21.15.36:0/3396166266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0381450c0 msgr2=0x7fd0380ac5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:36.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd037fff700 1 --2- 172.21.15.36:0/3396166266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0381450c0 0x7fd0380ac5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:36.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd037fff700 1 -- 172.21.15.36:0/3396166266 >> v1:172.21.15.36:6789/0 conn(0x7fd0380b65c0 legacy=0x7fd038141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:36.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd037fff700 1 -- 172.21.15.36:0/3396166266 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd038144980 con 0x7fd038060d70 2022-01-10T01:33:36.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03d2c7700 1 --2- 172.21.15.36:0/3396166266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0381450c0 0x7fd0380ac5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:36.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd037fff700 1 --2- 172.21.15.36:0/3396166266 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd038060d70 0x7fd0380b69a0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7fd02c002f70 tx=0x7fd02c006df0).ready entity=mon.0 client_cookie=aa2d708cf1bd6b82 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:36.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd0377fe700 1 -- 172.21.15.36:0/3396166266 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd02c00d570 con 0x7fd038060d70 2022-01-10T01:33:36.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd0377fe700 1 -- 172.21.15.36:0/3396166266 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02c000e90 con 0x7fd038060d70 2022-01-10T01:33:36.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd0377fe700 1 -- 172.21.15.36:0/3396166266 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd02c00d8c0 con 0x7fd038060d70 2022-01-10T01:33:36.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3396166266 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd038060d70 msgr2=0x7fd0380b69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:36.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03ed2a700 1 --2- 172.21.15.36:0/3396166266 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd038060d70 0x7fd0380b69a0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7fd02c002f70 tx=0x7fd02c006df0).stop 2022-01-10T01:33:36.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3396166266 shutdown_connections 2022-01-10T01:33:36.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03ed2a700 1 --2- 172.21.15.36:0/3396166266 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0381450c0 0x7fd0380ac5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:36.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03ed2a700 1 --2- 172.21.15.36:0/3396166266 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd038060d70 0x7fd0380b69a0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:36.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3396166266 >> 172.21.15.36:0/3396166266 conn(0x7fd0380b3480 msgr2=0x7fd0380b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:36.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3396166266 shutdown_connections 2022-01-10T01:33:36.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.269+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3396166266 wait complete. 2022-01-10T01:33:36.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.273+0000 7fd03ed2a700 1 Processor -- start 2022-01-10T01:33:36.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.273+0000 7fd03ed2a700 1 -- start start 2022-01-10T01:33:36.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd03ed2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd038060d70 0x7fd038147210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:36.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd03ed2a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd0380b65c0 0x7fd03813fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:36.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd03ed2a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0381450c0 0x7fd0381400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:36.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd03ed2a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd038138a60 con 0x7fd0380b65c0 2022-01-10T01:33:36.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd03ed2a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0380ab420 con 0x7fd0381450c0 2022-01-10T01:33:36.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd03ed2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd038139920 con 0x7fd038060d70 2022-01-10T01:33:36.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd037fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd0380b65c0 0x7fd03813fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:36.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd037fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd0380b65c0 0x7fd03813fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42218/0 (socket says 172.21.15.36:42218) 2022-01-10T01:33:36.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd037fff700 1 -- 172.21.15.36:0/3435655126 learned_addr learned my addr 172.21.15.36:0/3435655126 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:36.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd03cac6700 1 --2- 172.21.15.36:0/3435655126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd038060d70 0x7fd038147210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:36.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd03d2c7700 1 --2- 172.21.15.36:0/3435655126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0381450c0 0x7fd0381400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:36.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd037fff700 1 -- 172.21.15.36:0/3435655126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd038060d70 msgr2=0x7fd038147210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:36.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd037fff700 1 --2- 172.21.15.36:0/3435655126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd038060d70 0x7fd038147210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:36.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd037fff700 1 -- 172.21.15.36:0/3435655126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0381450c0 msgr2=0x7fd0381400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:36.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd037fff700 1 --2- 172.21.15.36:0/3435655126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0381450c0 0x7fd0381400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:36.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd037fff700 1 -- 172.21.15.36:0/3435655126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02c00b180 con 0x7fd0380b65c0 2022-01-10T01:33:36.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd037fff700 1 --2- 172.21.15.36:0/3435655126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd0380b65c0 0x7fd03813fbb0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fd02c002f70 tx=0x7fd02c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:36.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd035ffb700 1 -- 172.21.15.36:0/3435655126 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd02c006b20 con 0x7fd0380b65c0 2022-01-10T01:33:36.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd035ffb700 1 -- 172.21.15.36:0/3435655126 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02c013e90 con 0x7fd0380b65c0 2022-01-10T01:33:36.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3435655126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd038138080 con 0x7fd0380b65c0 2022-01-10T01:33:36.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd035ffb700 1 -- 172.21.15.36:0/3435655126 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd02c00dea0 con 0x7fd0380b65c0 2022-01-10T01:33:36.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3435655126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0380ab180 con 0x7fd0380b65c0 2022-01-10T01:33:36.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3435655126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd038144c20 con 0x7fd0380b65c0 2022-01-10T01:33:36.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.277+0000 7fd035ffb700 1 -- 172.21.15.36:0/3435655126 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd02c025030 con 0x7fd0380b65c0 2022-01-10T01:33:36.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.281+0000 7fd035ffb700 1 --2- 172.21.15.36:0/3435655126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd018053560 0x7fd018055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:36.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.281+0000 7fd035ffb700 1 -- 172.21.15.36:0/3435655126 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fd02c06c4b0 con 0x7fd0380b65c0 2022-01-10T01:33:36.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.281+0000 7fd03cac6700 1 --2- 172.21.15.36:0/3435655126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd018053560 0x7fd018055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:36.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.281+0000 7fd03cac6700 1 --2- 172.21.15.36:0/3435655126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd018053560 0x7fd018055a20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fd02800d000 tx=0x7fd028009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:36.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.285+0000 7fd035ffb700 1 -- 172.21.15.36:0/3435655126 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd02c0437a0 con 0x7fd0380b65c0 2022-01-10T01:33:36.430 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:36.421+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3435655126 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fd038057350 con 0x7fd0380b65c0 2022-01-10T01:33:37.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.225+0000 7fd035ffb700 1 -- 172.21.15.36:0/3435655126 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v144) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd02c023020 con 0x7fd0380b65c0 2022-01-10T01:33:37.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.229+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3435655126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd018053560 msgr2=0x7fd018055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.229+0000 7fd03ed2a700 1 --2- 172.21.15.36:0/3435655126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd018053560 0x7fd018055a20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fd02800d000 tx=0x7fd028009040).stop 2022-01-10T01:33:37.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.229+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3435655126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd0380b65c0 msgr2=0x7fd03813fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.229+0000 7fd03ed2a700 1 --2- 172.21.15.36:0/3435655126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd0380b65c0 0x7fd03813fbb0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fd02c002f70 tx=0x7fd02c014000).stop 2022-01-10T01:33:37.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.229+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3435655126 shutdown_connections 2022-01-10T01:33:37.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.229+0000 7fd03ed2a700 1 --2- 172.21.15.36:0/3435655126 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd018053560 0x7fd018055a20 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.229+0000 7fd03ed2a700 1 --2- 172.21.15.36:0/3435655126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0381450c0 0x7fd0381400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.229+0000 7fd03ed2a700 1 --2- 172.21.15.36:0/3435655126 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd0380b65c0 0x7fd03813fbb0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.229+0000 7fd03ed2a700 1 --2- 172.21.15.36:0/3435655126 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd038060d70 0x7fd038147210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.229+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3435655126 >> 172.21.15.36:0/3435655126 conn(0x7fd0380b3480 msgr2=0x7fd038143ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:37.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.229+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3435655126 shutdown_connections 2022-01-10T01:33:37.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.229+0000 7fd03ed2a700 1 -- 172.21.15.36:0/3435655126 wait complete. 2022-01-10T01:33:37.240 INFO:teuthology.orchestra.run.smithi036.stderr: removed all blacklist entries 2022-01-10T01:33:37.253 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2022-01-10T01:33:37.254 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2022-01-10T01:33:37.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.401+0000 7fbe6616c700 1 Processor -- start 2022-01-10T01:33:37.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.401+0000 7fbe6616c700 1 -- start start 2022-01-10T01:33:37.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.401+0000 7fbe6616c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe600b00e0 0x7fbe60142e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:37.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.401+0000 7fbe6616c700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe60067880 con 0x7fbe600b2580 2022-01-10T01:33:37.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.401+0000 7fbe6616c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe60067b20 con 0x7fbe600ac6f0 2022-01-10T01:33:37.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.401+0000 7fbe6616c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600ad5b0 con 0x7fbe600b00e0 2022-01-10T01:33:37.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.401+0000 7fbe6516a700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fbe600b2580 0x7fbe60140050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40022/0 (socket says 172.21.15.36:40022) 2022-01-10T01:33:37.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.401+0000 7fbe6516a700 1 -- 172.21.15.36:0/3028440258 learned_addr learned my addr 172.21.15.36:0/3028440258 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:37.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.401+0000 7fbe64969700 1 --2- 172.21.15.36:0/3028440258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe600b00e0 0x7fbe60142e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:37.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe57fff700 1 -- 172.21.15.36:0/3028440258 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263278341 0 0) 0x7fbe60067880 con 0x7fbe600b2580 2022-01-10T01:33:37.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe57fff700 1 -- 172.21.15.36:0/3028440258 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe44003260 con 0x7fbe600b2580 2022-01-10T01:33:37.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe57fff700 1 -- 172.21.15.36:0/3028440258 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131729135 0 0) 0x7fbe60067b20 con 0x7fbe600ac6f0 2022-01-10T01:33:37.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe57fff700 1 -- 172.21.15.36:0/3028440258 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe60067880 con 0x7fbe600ac6f0 2022-01-10T01:33:37.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe64969700 1 -- 172.21.15.36:0/3028440258 >> v1:172.21.15.59:6789/0 conn(0x7fbe600ac6f0 legacy=0x7fbe60143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe64969700 1 -- 172.21.15.36:0/3028440258 >> v1:172.21.15.36:6789/0 conn(0x7fbe600b2580 legacy=0x7fbe60140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe64969700 1 -- 172.21.15.36:0/3028440258 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe60146fd0 con 0x7fbe600b00e0 2022-01-10T01:33:37.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe64969700 1 --2- 172.21.15.36:0/3028440258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe600b00e0 0x7fbe60142e70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fbe5c002f70 tx=0x7fbe5c006df0).ready entity=mon.2 client_cookie=12a6c02238858642 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:37.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe57fff700 1 -- 172.21.15.36:0/3028440258 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5c00d5c0 con 0x7fbe600b00e0 2022-01-10T01:33:37.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe57fff700 1 -- 172.21.15.36:0/3028440258 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c000e90 con 0x7fbe600b00e0 2022-01-10T01:33:37.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe57fff700 1 -- 172.21.15.36:0/3028440258 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5c00d910 con 0x7fbe600b00e0 2022-01-10T01:33:37.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe6616c700 1 -- 172.21.15.36:0/3028440258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe600b00e0 msgr2=0x7fbe60142e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe6616c700 1 --2- 172.21.15.36:0/3028440258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe600b00e0 0x7fbe60142e70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fbe5c002f70 tx=0x7fbe5c006df0).stop 2022-01-10T01:33:37.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe6616c700 1 -- 172.21.15.36:0/3028440258 shutdown_connections 2022-01-10T01:33:37.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe6616c700 1 --2- 172.21.15.36:0/3028440258 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe600b00e0 0x7fbe60142e70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe6616c700 1 -- 172.21.15.36:0/3028440258 >> 172.21.15.36:0/3028440258 conn(0x7fbe60060180 msgr2=0x7fbe600b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:37.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe6616c700 1 -- 172.21.15.36:0/3028440258 shutdown_connections 2022-01-10T01:33:37.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe6616c700 1 -- 172.21.15.36:0/3028440258 wait complete. 2022-01-10T01:33:37.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe6616c700 1 Processor -- start 2022-01-10T01:33:37.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.405+0000 7fbe6616c700 1 -- start start 2022-01-10T01:33:37.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe6616c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe600ac6f0 0x7fbe601465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:37.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe6616c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe600b00e0 0x7fbe6013f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:37.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe6616c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe600b2580 0x7fbe6013f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:37.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe6616c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6009fc60 con 0x7fbe600b00e0 2022-01-10T01:33:37.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe6616c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600abf10 con 0x7fbe600b2580 2022-01-10T01:33:37.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe6616c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6009fe90 con 0x7fbe600ac6f0 2022-01-10T01:33:37.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe64969700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe600b00e0 0x7fbe6013f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:37.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe64969700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe600b00e0 0x7fbe6013f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42234/0 (socket says 172.21.15.36:42234) 2022-01-10T01:33:37.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe64969700 1 -- 172.21.15.36:0/3972108122 learned_addr learned my addr 172.21.15.36:0/3972108122 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:37.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe6596b700 1 --2- 172.21.15.36:0/3972108122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe600b2580 0x7fbe6013f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:37.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe6516a700 1 --2- 172.21.15.36:0/3972108122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe600ac6f0 0x7fbe601465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:37.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe64969700 1 -- 172.21.15.36:0/3972108122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe600ac6f0 msgr2=0x7fbe601465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe64969700 1 --2- 172.21.15.36:0/3972108122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe600ac6f0 0x7fbe601465c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe64969700 1 -- 172.21.15.36:0/3972108122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe600b2580 msgr2=0x7fbe6013f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe64969700 1 --2- 172.21.15.36:0/3972108122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe600b2580 0x7fbe6013f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe64969700 1 -- 172.21.15.36:0/3972108122 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c00b180 con 0x7fbe600b00e0 2022-01-10T01:33:37.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe64969700 1 --2- 172.21.15.36:0/3972108122 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe600b00e0 0x7fbe6013f3a0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7fbe5c002f70 tx=0x7fbe5c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:37.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe567fc700 1 -- 172.21.15.36:0/3972108122 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5c013de0 con 0x7fbe600b00e0 2022-01-10T01:33:37.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe567fc700 1 -- 172.21.15.36:0/3972108122 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c01e400 con 0x7fbe600b00e0 2022-01-10T01:33:37.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe6616c700 1 -- 172.21.15.36:0/3972108122 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe600a2000 con 0x7fbe600b00e0 2022-01-10T01:33:37.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe567fc700 1 -- 172.21.15.36:0/3972108122 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe5c01e760 con 0x7fbe600b00e0 2022-01-10T01:33:37.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe6616c700 1 -- 172.21.15.36:0/3972108122 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe600b2f20 con 0x7fbe600b00e0 2022-01-10T01:33:37.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe6616c700 1 -- 172.21.15.36:0/3972108122 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe600ac080 con 0x7fbe600b00e0 2022-01-10T01:33:37.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.409+0000 7fbe567fc700 1 -- 172.21.15.36:0/3972108122 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbe5c01c070 con 0x7fbe600b00e0 2022-01-10T01:33:37.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.413+0000 7fbe567fc700 1 --2- 172.21.15.36:0/3972108122 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe48053620 0x7fbe48055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:37.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.413+0000 7fbe567fc700 1 -- 172.21.15.36:0/3972108122 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fbe5c06c070 con 0x7fbe600b00e0 2022-01-10T01:33:37.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.413+0000 7fbe6516a700 1 --2- 172.21.15.36:0/3972108122 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe48053620 0x7fbe48055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:37.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.413+0000 7fbe6516a700 1 --2- 172.21.15.36:0/3972108122 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe48053620 0x7fbe48055ae0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fbe5000d000 tx=0x7fbe50009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:37.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.417+0000 7fbe567fc700 1 -- 172.21.15.36:0/3972108122 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbe600ac080 con 0x7fbe600b00e0 2022-01-10T01:33:37.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.581+0000 7fbe6616c700 1 -- 172.21.15.36:0/3972108122 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbe600ac080 con 0x7fbe600b00e0 2022-01-10T01:33:37.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.585+0000 7fbe567fc700 1 -- 172.21.15.36:0/3972108122 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v32) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fbe600ac080 con 0x7fbe600b00e0 2022-01-10T01:33:37.592 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:37.592 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:33:37.593 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_dump": [ 2022-01-10T01:33:37.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.594 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.a", 2022-01-10T01:33:37.594 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthuGT4IxAA5DyijS4tPjdOLn5uiLXEPg==", 2022-01-10T01:33:37.595 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.595 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:33:37.595 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:37.596 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:37.596 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:37.596 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.596 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.597 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.597 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.b", 2022-01-10T01:33:37.597 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthkvX0LRAAtz19usFvoObvouQeLFwicg==", 2022-01-10T01:33:37.597 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.597 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:33:37.598 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:37.598 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:37.598 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:37.598 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.599 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.c", 2022-01-10T01:33:37.599 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthbvUmKhAA0pVpDJO1AfsAzIHU1cAHiw==", 2022-01-10T01:33:37.600 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.600 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:33:37.600 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:37.600 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:37.600 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:37.601 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.601 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.601 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.601 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.0", 2022-01-10T01:33:37.601 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCWitthk4iKHRAAF7aFP+i24xFvXXm8j5GzVg==", 2022-01-10T01:33:37.602 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.602 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:37.602 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:37.602 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:37.603 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.603 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.1", 2022-01-10T01:33:37.604 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCZitthsKSXABAAb3IkNvlyLub89HwaPWZ1Bg==", 2022-01-10T01:33:37.604 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.604 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:37.604 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:37.605 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:37.605 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.605 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.2", 2022-01-10T01:33:37.606 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCbitthvNzhIBAAXkZ6FslnMl1gS/rOa7G+Vg==", 2022-01-10T01:33:37.606 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.606 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:37.606 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:37.607 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:37.607 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.607 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.608 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.608 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.3", 2022-01-10T01:33:37.609 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCeitth9P7EAxAA7KOCP7Rh5oN1yqCz9I6v3A==", 2022-01-10T01:33:37.609 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.609 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:37.610 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:37.610 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:37.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.611 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.611 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.4", 2022-01-10T01:33:37.612 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCjitth/L1UBxAAskxmSV0aE6CSvDFR8O/+SQ==", 2022-01-10T01:33:37.612 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.612 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:37.612 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:37.613 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:37.613 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.614 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.614 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.5", 2022-01-10T01:33:37.615 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQClitthMoY6JhAAeeIrCmMcm3MpDPtdLUf+2g==", 2022-01-10T01:33:37.615 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.615 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:37.615 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:37.616 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:37.616 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.616 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.6", 2022-01-10T01:33:37.617 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCoitthrUhlCxAAsYhU7Kj6HMo/kD0DezvITg==", 2022-01-10T01:33:37.617 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.617 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:37.617 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:37.617 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:37.618 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.618 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.618 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.618 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.7", 2022-01-10T01:33:37.619 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCqitthFaLrKRAAC2g1OlcV2KTtaOXsyCrIrQ==", 2022-01-10T01:33:37.619 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.619 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:37.619 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:37.620 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:37.620 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.620 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.0", 2022-01-10T01:33:37.621 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthKoa/NBAADjvHh99F8YOktGID9uyttg==", 2022-01-10T01:33:37.621 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.621 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:33:37.621 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:33:37.622 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:33:37.622 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.623 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.1", 2022-01-10T01:33:37.623 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth3x76OBAAPTrw8OUmnpEflWuB7zzaHg==", 2022-01-10T01:33:37.623 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.623 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:33:37.624 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:33:37.624 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:33:37.624 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.624 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.624 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.625 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.admin", 2022-01-10T01:33:37.625 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthf9dqChAADHRsoZKuozdsqb41ztuR7w==", 2022-01-10T01:33:37.625 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.625 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:33:37.626 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:33:37.626 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:33:37.626 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:37.626 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.627 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.627 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.x", 2022-01-10T01:33:37.627 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth39syIRAA6pOvLWw2ADy72TWZ65MIkA==", 2022-01-10T01:33:37.627 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.628 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:33:37.628 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:33:37.628 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:37.628 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:37.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:37.629 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.y", 2022-01-10T01:33:37.629 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth4novHRAACVMjo72kOB/T7Ti/CiN27w==", 2022-01-10T01:33:37.629 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:33:37.630 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:33:37.630 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:33:37.630 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:33:37.630 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.631 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:37.631 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:37.631 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:33:37.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.585+0000 7fbe6616c700 1 -- 172.21.15.36:0/3972108122 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe48053620 msgr2=0x7fbe48055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.585+0000 7fbe6616c700 1 --2- 172.21.15.36:0/3972108122 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe48053620 0x7fbe48055ae0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fbe5000d000 tx=0x7fbe50009040).stop 2022-01-10T01:33:37.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.585+0000 7fbe6616c700 1 -- 172.21.15.36:0/3972108122 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe600b00e0 msgr2=0x7fbe6013f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.585+0000 7fbe6616c700 1 --2- 172.21.15.36:0/3972108122 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe600b00e0 0x7fbe6013f3a0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7fbe5c002f70 tx=0x7fbe5c014000).stop 2022-01-10T01:33:37.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.585+0000 7fbe6616c700 1 -- 172.21.15.36:0/3972108122 shutdown_connections 2022-01-10T01:33:37.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.585+0000 7fbe6616c700 1 --2- 172.21.15.36:0/3972108122 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbe48053620 0x7fbe48055ae0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.585+0000 7fbe6616c700 1 --2- 172.21.15.36:0/3972108122 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe600b2580 0x7fbe6013f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.585+0000 7fbe6616c700 1 --2- 172.21.15.36:0/3972108122 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbe600b00e0 0x7fbe6013f3a0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.585+0000 7fbe6616c700 1 --2- 172.21.15.36:0/3972108122 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe600ac6f0 0x7fbe601465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.585+0000 7fbe6616c700 1 -- 172.21.15.36:0/3972108122 >> 172.21.15.36:0/3972108122 conn(0x7fbe60060180 msgr2=0x7fbe6005cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:37.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.585+0000 7fbe6616c700 1 -- 172.21.15.36:0/3972108122 shutdown_connections 2022-01-10T01:33:37.637 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.585+0000 7fbe6616c700 1 -- 172.21.15.36:0/3972108122 wait complete. 2022-01-10T01:33:37.637 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:33:37.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.733+0000 7f5aed974700 1 Processor -- start 2022-01-10T01:33:37.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.733+0000 7f5aed974700 1 -- start start 2022-01-10T01:33:37.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aed974700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ae8064640 0x7f5ae80b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:37.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aed974700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae80b8090 con 0x7f5ae8064a20 2022-01-10T01:33:37.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aed974700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae8143130 con 0x7f5ae80b4aa0 2022-01-10T01:33:37.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aed974700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae8142f40 con 0x7f5ae8064640 2022-01-10T01:33:37.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aed173700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f5ae8064a20 0x7f5ae8066500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40038/0 (socket says 172.21.15.36:40038) 2022-01-10T01:33:37.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aed173700 1 -- 172.21.15.36:0/441638288 learned_addr learned my addr 172.21.15.36:0/441638288 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:37.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aec972700 1 --2- 172.21.15.36:0/441638288 >> v2:172.21.15.59:3300/0 conn(0x7f5ae8064640 0x7f5ae80b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:37.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5ae77fe700 1 -- 172.21.15.36:0/441638288 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136252073 0 0) 0x7f5ae80b8090 con 0x7f5ae8064a20 2022-01-10T01:33:37.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5ae77fe700 1 -- 172.21.15.36:0/441638288 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5acc003260 con 0x7f5ae8064a20 2022-01-10T01:33:37.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5ae77fe700 1 -- 172.21.15.36:0/441638288 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188590727 0 0) 0x7f5ae8143130 con 0x7f5ae80b4aa0 2022-01-10T01:33:37.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5ae77fe700 1 -- 172.21.15.36:0/441638288 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ae80b8090 con 0x7f5ae80b4aa0 2022-01-10T01:33:37.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5ae77fe700 1 -- 172.21.15.36:0/441638288 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3471318279 0 0) 0x7f5acc003260 con 0x7f5ae8064a20 2022-01-10T01:33:37.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aec972700 1 -- 172.21.15.36:0/441638288 >> v1:172.21.15.59:6789/0 conn(0x7f5ae80b4aa0 legacy=0x7f5ae8143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aec972700 1 -- 172.21.15.36:0/441638288 >> v1:172.21.15.36:6789/0 conn(0x7f5ae8064a20 legacy=0x7f5ae8066500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aec972700 1 -- 172.21.15.36:0/441638288 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae81433d0 con 0x7f5ae8064640 2022-01-10T01:33:37.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aec972700 1 --2- 172.21.15.36:0/441638288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae8064640 0x7f5ae80b3710 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f5ae0001490 tx=0x7f5adc006df0).ready entity=mon.1 client_cookie=e5bf649059cc7f6c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:37.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5ae77fe700 1 -- 172.21.15.36:0/441638288 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ae00019e0 con 0x7f5ae8064640 2022-01-10T01:33:37.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5ae77fe700 1 -- 172.21.15.36:0/441638288 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc000e90 con 0x7f5ae8064640 2022-01-10T01:33:37.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5ae77fe700 1 -- 172.21.15.36:0/441638288 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5adc012460 con 0x7f5ae8064640 2022-01-10T01:33:37.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aed974700 1 -- 172.21.15.36:0/441638288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae8064640 msgr2=0x7f5ae80b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aed974700 1 --2- 172.21.15.36:0/441638288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae8064640 0x7f5ae80b3710 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f5ae0001490 tx=0x7f5adc006df0).stop 2022-01-10T01:33:37.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aed974700 1 -- 172.21.15.36:0/441638288 shutdown_connections 2022-01-10T01:33:37.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aed974700 1 --2- 172.21.15.36:0/441638288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae8064640 0x7f5ae80b3710 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aed974700 1 -- 172.21.15.36:0/441638288 >> 172.21.15.36:0/441638288 conn(0x7f5ae805f6b0 msgr2=0x7f5ae805fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:37.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aed974700 1 -- 172.21.15.36:0/441638288 shutdown_connections 2022-01-10T01:33:37.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.737+0000 7f5aed974700 1 -- 172.21.15.36:0/441638288 wait complete. 2022-01-10T01:33:37.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5aed974700 1 Processor -- start 2022-01-10T01:33:37.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5aed974700 1 -- start start 2022-01-10T01:33:37.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5aed974700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae8064640 0x7f5ae8146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:37.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5aed974700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5ae8064a20 0x7f5ae8149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:37.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5aed974700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ae80b4aa0 0x7f5ae8144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:37.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5aed974700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80b1610 con 0x7f5ae8064a20 2022-01-10T01:33:37.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5aed974700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80b1010 con 0x7f5ae8064640 2022-01-10T01:33:37.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5aed974700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae80b1290 con 0x7f5ae80b4aa0 2022-01-10T01:33:37.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5ae7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5ae8064a20 0x7f5ae8149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:37.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5ae7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5ae8064a20 0x7f5ae8149ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42248/0 (socket says 172.21.15.36:42248) 2022-01-10T01:33:37.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5aec972700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae8064640 0x7f5ae8146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:37.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5ae7fff700 1 -- 172.21.15.36:0/2081692872 learned_addr learned my addr 172.21.15.36:0/2081692872 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:37.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5aed173700 1 --2- 172.21.15.36:0/2081692872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ae80b4aa0 0x7f5ae8144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:37.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5ae7fff700 1 -- 172.21.15.36:0/2081692872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ae80b4aa0 msgr2=0x7f5ae8144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5ae7fff700 1 --2- 172.21.15.36:0/2081692872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ae80b4aa0 0x7f5ae8144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5ae7fff700 1 -- 172.21.15.36:0/2081692872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae8064640 msgr2=0x7f5ae8146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5ae7fff700 1 --2- 172.21.15.36:0/2081692872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae8064640 0x7f5ae8146d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5ae7fff700 1 -- 172.21.15.36:0/2081692872 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc00b180 con 0x7f5ae8064a20 2022-01-10T01:33:37.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5ae7fff700 1 --2- 172.21.15.36:0/2081692872 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5ae8064a20 0x7f5ae8149ee0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f5ad4001110 tx=0x7f5ad4007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:37.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5ae5ffb700 1 -- 172.21.15.36:0/2081692872 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ad400cde0 con 0x7f5ae8064a20 2022-01-10T01:33:37.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5ae5ffb700 1 -- 172.21.15.36:0/2081692872 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad4012400 con 0x7f5ae8064a20 2022-01-10T01:33:37.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5aed974700 1 -- 172.21.15.36:0/2081692872 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae8146610 con 0x7f5ae8064a20 2022-01-10T01:33:37.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5ae5ffb700 1 -- 172.21.15.36:0/2081692872 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ad4012760 con 0x7f5ae8064a20 2022-01-10T01:33:37.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.741+0000 7f5aed974700 1 -- 172.21.15.36:0/2081692872 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae814a5a0 con 0x7f5ae8064a20 2022-01-10T01:33:37.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.745+0000 7f5aed974700 1 -- 172.21.15.36:0/2081692872 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae80b7d40 con 0x7f5ae8064a20 2022-01-10T01:33:37.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.745+0000 7f5ae5ffb700 1 -- 172.21.15.36:0/2081692872 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5ad4019030 con 0x7f5ae8064a20 2022-01-10T01:33:37.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.745+0000 7f5ae5ffb700 1 --2- 172.21.15.36:0/2081692872 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ac8053590 0x7f5ac8055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:37.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.745+0000 7f5ae5ffb700 1 -- 172.21.15.36:0/2081692872 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f5ad406aae0 con 0x7f5ae8064a20 2022-01-10T01:33:37.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.745+0000 7f5aec972700 1 --2- 172.21.15.36:0/2081692872 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ac8053590 0x7f5ac8055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:37.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.745+0000 7f5aec972700 1 --2- 172.21.15.36:0/2081692872 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ac8053590 0x7f5ac8055a50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f5adc01a000 tx=0x7f5adc014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:37.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.753+0000 7f5ae5ffb700 1 -- 172.21.15.36:0/2081692872 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ad4041d20 con 0x7f5ae8064a20 2022-01-10T01:33:37.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.881+0000 7f5aed974700 1 -- 172.21.15.36:0/2081692872 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ae8057350 con 0x7f5ae8064a20 2022-01-10T01:33:37.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.881+0000 7f5ae5ffb700 1 -- 172.21.15.36:0/2081692872 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+13424 (secure 0 0 0) 0x7f5ad4045340 con 0x7f5ae8064a20 2022-01-10T01:33:37.890 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:37.890 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":144,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:33:37.221306+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:33:37.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.885+0000 7f5aed974700 1 -- 172.21.15.36:0/2081692872 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ac8053590 msgr2=0x7f5ac8055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.885+0000 7f5aed974700 1 --2- 172.21.15.36:0/2081692872 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ac8053590 0x7f5ac8055a50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f5adc01a000 tx=0x7f5adc014000).stop 2022-01-10T01:33:37.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.885+0000 7f5aed974700 1 -- 172.21.15.36:0/2081692872 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5ae8064a20 msgr2=0x7f5ae8149ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:37.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.885+0000 7f5aed974700 1 --2- 172.21.15.36:0/2081692872 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5ae8064a20 0x7f5ae8149ee0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f5ad4001110 tx=0x7f5ad4007ab0).stop 2022-01-10T01:33:37.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.885+0000 7f5aed974700 1 -- 172.21.15.36:0/2081692872 shutdown_connections 2022-01-10T01:33:37.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.885+0000 7f5aed974700 1 --2- 172.21.15.36:0/2081692872 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5ac8053590 0x7f5ac8055a50 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.885+0000 7f5aed974700 1 --2- 172.21.15.36:0/2081692872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ae80b4aa0 0x7f5ae8144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.885+0000 7f5aed974700 1 --2- 172.21.15.36:0/2081692872 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5ae8064a20 0x7f5ae8149ee0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.885+0000 7f5aed974700 1 --2- 172.21.15.36:0/2081692872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae8064640 0x7f5ae8146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:37.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.885+0000 7f5aed974700 1 -- 172.21.15.36:0/2081692872 >> 172.21.15.36:0/2081692872 conn(0x7f5ae805f6b0 msgr2=0x7f5ae8141c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:37.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.885+0000 7f5aed974700 1 -- 172.21.15.36:0/2081692872 shutdown_connections 2022-01-10T01:33:37.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:37.885+0000 7f5aed974700 1 -- 172.21.15.36:0/2081692872 wait complete. 2022-01-10T01:33:37.903 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-01-10T01:33:37.904 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:33:38.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.009+0000 7f73eb59e700 1 Processor -- start 2022-01-10T01:33:38.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.009+0000 7f73eb59e700 1 -- start start 2022-01-10T01:33:38.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73eb59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f73ec0a9190 0x7f73ec146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73eb59e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ec0b1140 con 0x7f73ec0b03d0 2022-01-10T01:33:38.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73eb59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ec0a9570 con 0x7f73ec0b0b80 2022-01-10T01:33:38.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73eb59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ec0b1370 con 0x7f73ec0a9190 2022-01-10T01:33:38.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73ead9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f73ec0b03d0 0x7f73ec1401c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40050/0 (socket says 172.21.15.36:40050) 2022-01-10T01:33:38.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73ead9d700 1 -- 172.21.15.36:0/631293656 learned_addr learned my addr 172.21.15.36:0/631293656 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:38.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73ea59c700 1 --2- 172.21.15.36:0/631293656 >> v2:172.21.15.59:3300/0 conn(0x7f73ec0a9190 0x7f73ec146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 -- 172.21.15.36:0/631293656 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493956771 0 0) 0x7f73ec0b1140 con 0x7f73ec0b03d0 2022-01-10T01:33:38.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 -- 172.21.15.36:0/631293656 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73d0003260 con 0x7f73ec0b03d0 2022-01-10T01:33:38.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 -- 172.21.15.36:0/631293656 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2937559311 0 0) 0x7f73d0003260 con 0x7f73ec0b03d0 2022-01-10T01:33:38.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 -- 172.21.15.36:0/631293656 >> v2:172.21.15.59:3300/0 conn(0x7f73ec0a9190 msgr2=0x7f73ec146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:38.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 --2- 172.21.15.36:0/631293656 >> v2:172.21.15.59:3300/0 conn(0x7f73ec0a9190 0x7f73ec146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 -- 172.21.15.36:0/631293656 >> v1:172.21.15.59:6789/0 conn(0x7f73ec0b0b80 legacy=0x7f73ec146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 -- 172.21.15.36:0/631293656 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec0b1610 con 0x7f73ec0b03d0 2022-01-10T01:33:38.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 -- 172.21.15.36:0/631293656 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f73e40019e0 con 0x7f73ec0b03d0 2022-01-10T01:33:38.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 -- 172.21.15.36:0/631293656 >> v1:172.21.15.36:6789/0 conn(0x7f73ec0b03d0 legacy=0x7f73ec1401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 --2- 172.21.15.36:0/631293656 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73d0003750 0x7f73d0003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 --2- 172.21.15.36:0/631293656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73d0004500 0x7f73d0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 --2- 172.21.15.36:0/631293656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73d0004e70 0x7f73d000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 -- 172.21.15.36:0/631293656 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0b1370 con 0x7f73d0003750 2022-01-10T01:33:38.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 -- 172.21.15.36:0/631293656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d000bca0 con 0x7f73d0004500 2022-01-10T01:33:38.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 -- 172.21.15.36:0/631293656 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d000be60 con 0x7f73d0004e70 2022-01-10T01:33:38.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73ea59c700 1 --2- 172.21.15.36:0/631293656 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73d0003750 0x7f73d0003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e3fff700 1 --2- 172.21.15.36:0/631293656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73d0004500 0x7f73d0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73ead9d700 1 --2- 172.21.15.36:0/631293656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73d0004e70 0x7f73d000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73ea59c700 1 -- 172.21.15.36:0/631293656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73d0004e70 msgr2=0x7f73d000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:38.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73ea59c700 1 --2- 172.21.15.36:0/631293656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73d0004e70 0x7f73d000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73ea59c700 1 -- 172.21.15.36:0/631293656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73d0004500 msgr2=0x7f73d0004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:38.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73ea59c700 1 --2- 172.21.15.36:0/631293656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73d0004500 0x7f73d0004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73ea59c700 1 -- 172.21.15.36:0/631293656 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d0003260 con 0x7f73d0003750 2022-01-10T01:33:38.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73ead9d700 1 --2- 172.21.15.36:0/631293656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73d0004e70 0x7f73d000b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:38.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73ead9d700 1 -- 172.21.15.36:0/631293656 reap_dead start 2022-01-10T01:33:38.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73ea59c700 1 --2- 172.21.15.36:0/631293656 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73d0003750 0x7f73d0003b50 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f73dc00c000 tx=0x7f73dc006df0).ready entity=mon.0 client_cookie=3ce43623e1acd42a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:38.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 -- 172.21.15.36:0/631293656 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73dc00e800 con 0x7f73d0003750 2022-01-10T01:33:38.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 -- 172.21.15.36:0/631293656 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc00e960 con 0x7f73d0003750 2022-01-10T01:33:38.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.013+0000 7f73e9d9b700 1 -- 172.21.15.36:0/631293656 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73dc00ecc0 con 0x7f73d0003750 2022-01-10T01:33:38.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 -- 172.21.15.36:0/631293656 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73d0003750 msgr2=0x7f73d0003b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 --2- 172.21.15.36:0/631293656 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73d0003750 0x7f73d0003b50 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f73dc00c000 tx=0x7f73dc006df0).stop 2022-01-10T01:33:38.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 -- 172.21.15.36:0/631293656 shutdown_connections 2022-01-10T01:33:38.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 --2- 172.21.15.36:0/631293656 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73d0003750 0x7f73d0003b50 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 -- 172.21.15.36:0/631293656 >> 172.21.15.36:0/631293656 conn(0x7f73ec061140 msgr2=0x7f73ec062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:38.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 -- 172.21.15.36:0/631293656 shutdown_connections 2022-01-10T01:33:38.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 -- 172.21.15.36:0/631293656 wait complete. 2022-01-10T01:33:38.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 Processor -- start 2022-01-10T01:33:38.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 -- start start 2022-01-10T01:33:38.036 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73d0003750 0x7f73ec0a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73ec140fb0 0x7f73ec1527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73ec152cc0 0x7f73ec142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec141d50 con 0x7f73ec140fb0 2022-01-10T01:33:38.037 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0ab640 con 0x7f73ec152cc0 2022-01-10T01:33:38.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73eb59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ec0ab8e0 con 0x7f73d0003750 2022-01-10T01:33:38.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73e3fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73ec140fb0 0x7f73ec1527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73e3fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73ec140fb0 0x7f73ec1527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42268/0 (socket says 172.21.15.36:42268) 2022-01-10T01:33:38.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73e3fff700 1 -- 172.21.15.36:0/1224454480 learned_addr learned my addr 172.21.15.36:0/1224454480 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:38.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73ea59c700 1 --2- 172.21.15.36:0/1224454480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73d0003750 0x7f73ec0a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.017+0000 7f73ead9d700 1 --2- 172.21.15.36:0/1224454480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73ec152cc0 0x7f73ec142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73e3fff700 1 -- 172.21.15.36:0/1224454480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73d0003750 msgr2=0x7f73ec0a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73e3fff700 1 --2- 172.21.15.36:0/1224454480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73d0003750 0x7f73ec0a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73e3fff700 1 -- 172.21.15.36:0/1224454480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73ec152cc0 msgr2=0x7f73ec142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73e3fff700 1 --2- 172.21.15.36:0/1224454480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73ec152cc0 0x7f73ec142180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73e3fff700 1 -- 172.21.15.36:0/1224454480 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ec0abb80 con 0x7f73ec140fb0 2022-01-10T01:33:38.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73e3fff700 1 --2- 172.21.15.36:0/1224454480 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73ec140fb0 0x7f73ec1527d0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f73d400d000 tx=0x7f73d4007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:38.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73e37fe700 1 -- 172.21.15.36:0/1224454480 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d400fa90 con 0x7f73ec140fb0 2022-01-10T01:33:38.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73e37fe700 1 -- 172.21.15.36:0/1224454480 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d400fbf0 con 0x7f73ec140fb0 2022-01-10T01:33:38.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73eb59e700 1 -- 172.21.15.36:0/1224454480 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ec153150 con 0x7f73ec140fb0 2022-01-10T01:33:38.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73e37fe700 1 -- 172.21.15.36:0/1224454480 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d4003d60 con 0x7f73ec140fb0 2022-01-10T01:33:38.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73eb59e700 1 -- 172.21.15.36:0/1224454480 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec1521f0 con 0x7f73ec140fb0 2022-01-10T01:33:38.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73eb59e700 1 -- 172.21.15.36:0/1224454480 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ec057350 con 0x7f73ec140fb0 2022-01-10T01:33:38.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73e37fe700 1 -- 172.21.15.36:0/1224454480 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f73d401b030 con 0x7f73ec140fb0 2022-01-10T01:33:38.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73e37fe700 1 --2- 172.21.15.36:0/1224454480 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73c4053590 0x7f73c4055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73e37fe700 1 -- 172.21.15.36:0/1224454480 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f73d406b830 con 0x7f73ec140fb0 2022-01-10T01:33:38.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.021+0000 7f73ea59c700 1 --2- 172.21.15.36:0/1224454480 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73c4053590 0x7f73c4055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.025+0000 7f73ea59c700 1 --2- 172.21.15.36:0/1224454480 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73c4053590 0x7f73c4055a50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f73dc01a000 tx=0x7f73dc019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:38.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.029+0000 7f73e37fe700 1 -- 172.21.15.36:0/1224454480 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f73d4042b80 con 0x7f73ec140fb0 2022-01-10T01:33:38.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.157+0000 7f73eb59e700 1 -- 172.21.15.36:0/1224454480 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f73ec141b30 con 0x7f73ec140fb0 2022-01-10T01:33:38.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.157+0000 7f73e37fe700 1 -- 172.21.15.36:0/1224454480 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v144) v1 ==== 110+0+10 (secure 0 0 0) 0x7f73d40461a0 con 0x7f73ec140fb0 2022-01-10T01:33:38.164 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:33:38.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.157+0000 7f73eb59e700 1 -- 172.21.15.36:0/1224454480 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73c4053590 msgr2=0x7f73c4055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.157+0000 7f73eb59e700 1 --2- 172.21.15.36:0/1224454480 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73c4053590 0x7f73c4055a50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f73dc01a000 tx=0x7f73dc019000).stop 2022-01-10T01:33:38.166 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.157+0000 7f73eb59e700 1 -- 172.21.15.36:0/1224454480 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73ec140fb0 msgr2=0x7f73ec1527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.157+0000 7f73eb59e700 1 --2- 172.21.15.36:0/1224454480 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73ec140fb0 0x7f73ec1527d0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f73d400d000 tx=0x7f73d4007a00).stop 2022-01-10T01:33:38.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.157+0000 7f73eb59e700 1 -- 172.21.15.36:0/1224454480 shutdown_connections 2022-01-10T01:33:38.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.157+0000 7f73eb59e700 1 --2- 172.21.15.36:0/1224454480 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73c4053590 0x7f73c4055a50 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.157+0000 7f73eb59e700 1 --2- 172.21.15.36:0/1224454480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73ec152cc0 0x7f73ec142180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.157+0000 7f73eb59e700 1 --2- 172.21.15.36:0/1224454480 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73ec140fb0 0x7f73ec1527d0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.157+0000 7f73eb59e700 1 --2- 172.21.15.36:0/1224454480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73d0003750 0x7f73ec0a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.157+0000 7f73eb59e700 1 -- 172.21.15.36:0/1224454480 >> 172.21.15.36:0/1224454480 conn(0x7f73ec061140 msgr2=0x7f73ec0addc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:38.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.161+0000 7f73eb59e700 1 -- 172.21.15.36:0/1224454480 shutdown_connections 2022-01-10T01:33:38.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.161+0000 7f73eb59e700 1 -- 172.21.15.36:0/1224454480 wait complete. 2022-01-10T01:33:38.177 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:33:38.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.281+0000 7fc1a60a5700 1 Processor -- start 2022-01-10T01:33:38.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.281+0000 7fc1a60a5700 1 -- start start 2022-01-10T01:33:38.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.281+0000 7fc1a60a5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc1a00b6560 0x7fc1a00b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.281+0000 7fc1a60a5700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a0143f60 con 0x7fc1a005fc00 2022-01-10T01:33:38.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.281+0000 7fc1a60a5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a005ffe0 con 0x7fc1a00b5990 2022-01-10T01:33:38.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.281+0000 7fc1a60a5700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a00ba6b0 con 0x7fc1a00b6560 2022-01-10T01:33:38.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.281+0000 7fc19effd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc1a00b6560 0x7fc1a00b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.281+0000 7fc19f7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fc1a005fc00 0x7fc1a00b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40068/0 (socket says 172.21.15.36:40068) 2022-01-10T01:33:38.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.281+0000 7fc19f7fe700 1 -- 172.21.15.36:0/427806644 learned_addr learned my addr 172.21.15.36:0/427806644 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:38.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc19effd700 1 -- 172.21.15.36:0/427806644 >> v1:172.21.15.59:6789/0 conn(0x7fc1a00b5990 legacy=0x7fc1a00b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc19effd700 1 -- 172.21.15.36:0/427806644 >> v1:172.21.15.36:6789/0 conn(0x7fc1a005fc00 legacy=0x7fc1a00b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc19effd700 1 -- 172.21.15.36:0/427806644 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a0143a50 con 0x7fc1a00b6560 2022-01-10T01:33:38.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc19e7fc700 1 -- 172.21.15.36:0/427806644 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149335014 0 0) 0x7fc1a005ffe0 con 0x7fc1a00b5990 2022-01-10T01:33:38.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc19effd700 1 --2- 172.21.15.36:0/427806644 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1a00b6560 0x7fc1a00b41b0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7fc190002f70 tx=0x7fc190006df0).ready entity=mon.0 client_cookie=63a0296ac17f26b8 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:38.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc19e7fc700 1 -- 172.21.15.36:0/427806644 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc19000d610 con 0x7fc1a00b6560 2022-01-10T01:33:38.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc19e7fc700 1 -- 172.21.15.36:0/427806644 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc190000e90 con 0x7fc1a00b6560 2022-01-10T01:33:38.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc19e7fc700 1 -- 172.21.15.36:0/427806644 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc19000d960 con 0x7fc1a00b6560 2022-01-10T01:33:38.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 -- 172.21.15.36:0/427806644 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1a00b6560 msgr2=0x7fc1a00b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 --2- 172.21.15.36:0/427806644 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1a00b6560 0x7fc1a00b41b0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7fc190002f70 tx=0x7fc190006df0).stop 2022-01-10T01:33:38.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 -- 172.21.15.36:0/427806644 shutdown_connections 2022-01-10T01:33:38.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 --2- 172.21.15.36:0/427806644 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1a00b6560 0x7fc1a00b41b0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 -- 172.21.15.36:0/427806644 >> 172.21.15.36:0/427806644 conn(0x7fc1a00623a0 msgr2=0x7fc1a0066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:38.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 -- 172.21.15.36:0/427806644 shutdown_connections 2022-01-10T01:33:38.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 -- 172.21.15.36:0/427806644 wait complete. 2022-01-10T01:33:38.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 Processor -- start 2022-01-10T01:33:38.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 -- start start 2022-01-10T01:33:38.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1a005fc00 0x7fc1a01523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1a00b5990 0x7fc1a0144890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1a00b6560 0x7fc1a00ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a01450d0 con 0x7fc1a00b5990 2022-01-10T01:33:38.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a0145300 con 0x7fc1a005fc00 2022-01-10T01:33:38.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc1a60a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a0146020 con 0x7fc1a00b6560 2022-01-10T01:33:38.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc19effd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1a00b5990 0x7fc1a0144890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc19effd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1a00b5990 0x7fc1a0144890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42282/0 (socket says 172.21.15.36:42282) 2022-01-10T01:33:38.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc19effd700 1 -- 172.21.15.36:0/3362068691 learned_addr learned my addr 172.21.15.36:0/3362068691 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:38.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc19f7fe700 1 --2- 172.21.15.36:0/3362068691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1a005fc00 0x7fc1a01523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.285+0000 7fc19ffff700 1 --2- 172.21.15.36:0/3362068691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1a00b6560 0x7fc1a00ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc19effd700 1 -- 172.21.15.36:0/3362068691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1a00b6560 msgr2=0x7fc1a00ad620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc19effd700 1 --2- 172.21.15.36:0/3362068691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1a00b6560 0x7fc1a00ad620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc19effd700 1 -- 172.21.15.36:0/3362068691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1a005fc00 msgr2=0x7fc1a01523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc19effd700 1 --2- 172.21.15.36:0/3362068691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1a005fc00 0x7fc1a01523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc19effd700 1 -- 172.21.15.36:0/3362068691 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19000b180 con 0x7fc1a00b5990 2022-01-10T01:33:38.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc19effd700 1 --2- 172.21.15.36:0/3362068691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1a00b5990 0x7fc1a0144890 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7fc190002f70 tx=0x7fc190015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:38.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc19cff9700 1 -- 172.21.15.36:0/3362068691 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc19000d290 con 0x7fc1a00b5990 2022-01-10T01:33:38.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc19cff9700 1 -- 172.21.15.36:0/3362068691 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc190011c30 con 0x7fc1a00b5990 2022-01-10T01:33:38.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc19cff9700 1 -- 172.21.15.36:0/3362068691 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc19001e460 con 0x7fc1a00b5990 2022-01-10T01:33:38.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc1a60a5700 1 -- 172.21.15.36:0/3362068691 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a01462c0 con 0x7fc1a00b5990 2022-01-10T01:33:38.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc1a60a5700 1 -- 172.21.15.36:0/3362068691 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a0144d80 con 0x7fc1a00b5990 2022-01-10T01:33:38.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc1a60a5700 1 -- 172.21.15.36:0/3362068691 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a0143cc0 con 0x7fc1a00b5990 2022-01-10T01:33:38.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc19cff9700 1 -- 172.21.15.36:0/3362068691 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc19001a040 con 0x7fc1a00b5990 2022-01-10T01:33:38.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc19cff9700 1 --2- 172.21.15.36:0/3362068691 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc184053680 0x7fc184055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc19cff9700 1 -- 172.21.15.36:0/3362068691 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fc19006c6d0 con 0x7fc1a00b5990 2022-01-10T01:33:38.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.289+0000 7fc19f7fe700 1 --2- 172.21.15.36:0/3362068691 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc184053680 0x7fc184055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.293+0000 7fc19f7fe700 1 --2- 172.21.15.36:0/3362068691 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc184053680 0x7fc184055b40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fc18800d000 tx=0x7fc188009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:38.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.297+0000 7fc19cff9700 1 -- 172.21.15.36:0/3362068691 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc190043a20 con 0x7fc1a00b5990 2022-01-10T01:33:38.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.425+0000 7fc1a60a5700 1 -- 172.21.15.36:0/3362068691 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc1a0057350 con 0x7fc1a00b5990 2022-01-10T01:33:38.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.425+0000 7fc19cff9700 1 -- 172.21.15.36:0/3362068691 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v144) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc1900230a0 con 0x7fc1a00b5990 2022-01-10T01:33:38.433 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:38.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.429+0000 7fc1a60a5700 1 -- 172.21.15.36:0/3362068691 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc184053680 msgr2=0x7fc184055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.429+0000 7fc1a60a5700 1 --2- 172.21.15.36:0/3362068691 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc184053680 0x7fc184055b40 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fc18800d000 tx=0x7fc188009040).stop 2022-01-10T01:33:38.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.429+0000 7fc1a60a5700 1 -- 172.21.15.36:0/3362068691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1a00b5990 msgr2=0x7fc1a0144890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.429+0000 7fc1a60a5700 1 --2- 172.21.15.36:0/3362068691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1a00b5990 0x7fc1a0144890 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7fc190002f70 tx=0x7fc190015000).stop 2022-01-10T01:33:38.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.429+0000 7fc1a60a5700 1 -- 172.21.15.36:0/3362068691 shutdown_connections 2022-01-10T01:33:38.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.429+0000 7fc1a60a5700 1 --2- 172.21.15.36:0/3362068691 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc184053680 0x7fc184055b40 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.429+0000 7fc1a60a5700 1 --2- 172.21.15.36:0/3362068691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1a00b6560 0x7fc1a00ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.429+0000 7fc1a60a5700 1 --2- 172.21.15.36:0/3362068691 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc1a00b5990 0x7fc1a0144890 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.429+0000 7fc1a60a5700 1 --2- 172.21.15.36:0/3362068691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1a005fc00 0x7fc1a01523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.429+0000 7fc1a60a5700 1 -- 172.21.15.36:0/3362068691 >> 172.21.15.36:0/3362068691 conn(0x7fc1a00623a0 msgr2=0x7fc1a005cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:38.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.429+0000 7fc1a60a5700 1 -- 172.21.15.36:0/3362068691 shutdown_connections 2022-01-10T01:33:38.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.429+0000 7fc1a60a5700 1 -- 172.21.15.36:0/3362068691 wait complete. 2022-01-10T01:33:38.447 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-01-10T01:33:38.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc08abd700 1 Processor -- start 2022-01-10T01:33:38.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc08abd700 1 -- start start 2022-01-10T01:33:38.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc08abd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040b0710 0x7fbc04142d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc08abd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbc040b30d0 0x7fbc04143210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc08abd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbc040ace70 0x7fbc0405c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc08abd700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc040b0af0 con 0x7fbc040ace70 2022-01-10T01:33:38.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc08abd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc040ae680 con 0x7fbc040b30d0 2022-01-10T01:33:38.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc08abd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc040ae920 con 0x7fbc040b0710 2022-01-10T01:33:38.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc03fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbc040ace70 0x7fbc0405c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc03fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbc040ace70 0x7fbc0405c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42292/0 (socket says 172.21.15.36:42292) 2022-01-10T01:33:38.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc03fff700 1 -- 172.21.15.36:0/1084348278 learned_addr learned my addr 172.21.15.36:0/1084348278 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:38.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbbfbfff700 1 --2- 172.21.15.36:0/1084348278 >> v2:172.21.15.59:3300/0 conn(0x7fbc040b30d0 0x7fbc04143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc037fe700 1 --2- 172.21.15.36:0/1084348278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040b0710 0x7fbc04142d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc03fff700 1 -- 172.21.15.36:0/1084348278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040b0710 msgr2=0x7fbc04142d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:38.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc03fff700 1 --2- 172.21.15.36:0/1084348278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040b0710 0x7fbc04142d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc03fff700 1 -- 172.21.15.36:0/1084348278 >> v2:172.21.15.59:3300/0 conn(0x7fbc040b30d0 msgr2=0x7fbc04143210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:38.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc03fff700 1 --2- 172.21.15.36:0/1084348278 >> v2:172.21.15.59:3300/0 conn(0x7fbc040b30d0 0x7fbc04143210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc03fff700 1 -- 172.21.15.36:0/1084348278 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc040aebc0 con 0x7fbc040ace70 2022-01-10T01:33:38.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbbfbfff700 1 --2- 172.21.15.36:0/1084348278 >> v2:172.21.15.59:3300/0 conn(0x7fbc040b30d0 0x7fbc04143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:38.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc03fff700 1 --2- 172.21.15.36:0/1084348278 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc040ace70 0x7fbc0405c490 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7fbbfc0032f0 tx=0x7fbbfc009290).ready entity=mon.0 client_cookie=b8c65c16ea792e5f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:38.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc02ffd700 1 -- 172.21.15.36:0/1084348278 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbfc00b870 con 0x7fbc040ace70 2022-01-10T01:33:38.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc02ffd700 1 -- 172.21.15.36:0/1084348278 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc00b9d0 con 0x7fbc040ace70 2022-01-10T01:33:38.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.541+0000 7fbc02ffd700 1 -- 172.21.15.36:0/1084348278 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbfc00bb40 con 0x7fbc040ace70 2022-01-10T01:33:38.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.545+0000 7fbc08abd700 1 -- 172.21.15.36:0/1084348278 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc040ace70 msgr2=0x7fbc0405c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.545+0000 7fbc08abd700 1 --2- 172.21.15.36:0/1084348278 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc040ace70 0x7fbc0405c490 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7fbbfc0032f0 tx=0x7fbbfc009290).stop 2022-01-10T01:33:38.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.545+0000 7fbc08abd700 1 -- 172.21.15.36:0/1084348278 shutdown_connections 2022-01-10T01:33:38.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.545+0000 7fbc08abd700 1 --2- 172.21.15.36:0/1084348278 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc040ace70 0x7fbc0405c490 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.545+0000 7fbc08abd700 1 --2- 172.21.15.36:0/1084348278 >> v2:172.21.15.59:3300/0 conn(0x7fbc040b30d0 0x7fbc04143210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.545+0000 7fbc08abd700 1 --2- 172.21.15.36:0/1084348278 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040b0710 0x7fbc04142d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.545+0000 7fbc08abd700 1 -- 172.21.15.36:0/1084348278 >> 172.21.15.36:0/1084348278 conn(0x7fbc04061140 msgr2=0x7fbc04062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:38.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.545+0000 7fbc08abd700 1 -- 172.21.15.36:0/1084348278 shutdown_connections 2022-01-10T01:33:38.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.545+0000 7fbc08abd700 1 -- 172.21.15.36:0/1084348278 wait complete. 2022-01-10T01:33:38.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.545+0000 7fbc08abd700 1 Processor -- start 2022-01-10T01:33:38.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.545+0000 7fbc08abd700 1 -- start start 2022-01-10T01:33:38.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc08abd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc040ace70 0x7fbc04152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc08abd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc040b0710 0x7fbc040675c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc08abd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040b30d0 0x7fbc040b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc08abd700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc04155790 con 0x7fbc040ace70 2022-01-10T01:33:38.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc037fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc040ace70 0x7fbc04152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc08abd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0409e9c0 con 0x7fbc040b0710 2022-01-10T01:33:38.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc037fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc040ace70 0x7fbc04152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42294/0 (socket says 172.21.15.36:42294) 2022-01-10T01:33:38.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc08abd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0409ec60 con 0x7fbc040b30d0 2022-01-10T01:33:38.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc037fe700 1 -- 172.21.15.36:0/888556241 learned_addr learned my addr 172.21.15.36:0/888556241 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:38.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc03fff700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040b30d0 0x7fbc040b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbbfbfff700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc040b0710 0x7fbc040675c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc037fe700 1 -- 172.21.15.36:0/888556241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040b30d0 msgr2=0x7fbc040b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc037fe700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040b30d0 0x7fbc040b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc037fe700 1 -- 172.21.15.36:0/888556241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc040b0710 msgr2=0x7fbc040675c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc037fe700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc040b0710 0x7fbc040675c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc037fe700 1 -- 172.21.15.36:0/888556241 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc009530 con 0x7fbc040ace70 2022-01-10T01:33:38.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc03fff700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040b30d0 0x7fbc040b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:38.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc037fe700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc040ace70 0x7fbc04152240 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7fbbf40030b0 tx=0x7fbbf4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:38.565 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc017fa700 1 -- 172.21.15.36:0/888556241 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbf4011780 con 0x7fbc040ace70 2022-01-10T01:33:38.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc017fa700 1 -- 172.21.15.36:0/888556241 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf40118e0 con 0x7fbc040ace70 2022-01-10T01:33:38.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc08abd700 1 -- 172.21.15.36:0/888556241 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc041559c0 con 0x7fbc040ace70 2022-01-10T01:33:38.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc017fa700 1 -- 172.21.15.36:0/888556241 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbf4011c40 con 0x7fbc040ace70 2022-01-10T01:33:38.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.549+0000 7fbc08abd700 1 -- 172.21.15.36:0/888556241 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0414aab0 con 0x7fbc040ace70 2022-01-10T01:33:38.566 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.553+0000 7fbc017fa700 1 -- 172.21.15.36:0/888556241 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbbf4012420 con 0x7fbc040ace70 2022-01-10T01:33:38.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.553+0000 7fbc08abd700 1 -- 172.21.15.36:0/888556241 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc04155b50 con 0x7fbc040ace70 2022-01-10T01:33:38.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.553+0000 7fbc017fa700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbe8053560 0x7fbbe8055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.553+0000 7fbc017fa700 1 -- 172.21.15.36:0/888556241 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fbbf406b720 con 0x7fbc040ace70 2022-01-10T01:33:38.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.553+0000 7fbbfbfff700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbe8053560 0x7fbbe8055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.553+0000 7fbbfbfff700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbe8053560 0x7fbbe8055a20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fbbec00c000 tx=0x7fbbec008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:38.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.561+0000 7fbc017fa700 1 -- 172.21.15.36:0/888556241 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbbf4042900 con 0x7fbc040ace70 2022-01-10T01:33:38.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.685+0000 7fbc08abd700 1 -- 172.21.15.36:0/888556241 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbc04057350 con 0x7fbc040ace70 2022-01-10T01:33:38.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.685+0000 7fbc017fa700 1 -- 172.21.15.36:0/888556241 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v144) v1 ==== 84+0+143 (secure 0 0 0) 0x7fbbf4045f20 con 0x7fbc040ace70 2022-01-10T01:33:38.694 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:38.694 INFO:teuthology.orchestra.run.smithi036.stdout:[ 2022-01-10T01:33:38.695 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:38.695 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 1, 2022-01-10T01:33:38.696 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "device_health_metrics" 2022-01-10T01:33:38.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:38.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:38.697 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 2, 2022-01-10T01:33:38.697 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "rbd" 2022-01-10T01:33:38.698 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:38.698 INFO:teuthology.orchestra.run.smithi036.stdout:] 2022-01-10T01:33:38.700 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.689+0000 7fbc08abd700 1 -- 172.21.15.36:0/888556241 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbe8053560 msgr2=0x7fbbe8055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.689+0000 7fbc08abd700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbe8053560 0x7fbbe8055a20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fbbec00c000 tx=0x7fbbec008040).stop 2022-01-10T01:33:38.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.689+0000 7fbc08abd700 1 -- 172.21.15.36:0/888556241 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc040ace70 msgr2=0x7fbc04152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.689+0000 7fbc08abd700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc040ace70 0x7fbc04152240 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7fbbf40030b0 tx=0x7fbbf4008040).stop 2022-01-10T01:33:38.701 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.689+0000 7fbc08abd700 1 -- 172.21.15.36:0/888556241 shutdown_connections 2022-01-10T01:33:38.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.689+0000 7fbc08abd700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbe8053560 0x7fbbe8055a20 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.689+0000 7fbc08abd700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040b30d0 0x7fbc040b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.702 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.689+0000 7fbc08abd700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc040b0710 0x7fbc040675c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.689+0000 7fbc08abd700 1 --2- 172.21.15.36:0/888556241 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc040ace70 0x7fbc04152240 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.689+0000 7fbc08abd700 1 -- 172.21.15.36:0/888556241 >> 172.21.15.36:0/888556241 conn(0x7fbc04061140 msgr2=0x7fbc04142ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:38.703 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.689+0000 7fbc08abd700 1 -- 172.21.15.36:0/888556241 shutdown_connections 2022-01-10T01:33:38.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.689+0000 7fbc08abd700 1 -- 172.21.15.36:0/888556241 wait complete. 2022-01-10T01:33:38.707 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-01-10T01:33:38.707 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:33:38.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f138a633700 1 Processor -- start 2022-01-10T01:33:38.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f138a633700 1 -- start start 2022-01-10T01:33:38.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f138a633700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13840b0010 0x7f13840a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f138a633700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f13840afbd0 0x7f13840a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f138a633700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13840a70c0 con 0x7f13840b2580 2022-01-10T01:33:38.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f138a633700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13840a72f0 con 0x7f13840afbd0 2022-01-10T01:33:38.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f138a633700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13840a7590 con 0x7f13840b0010 2022-01-10T01:33:38.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f1389631700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f13840b2580 0x7f138414ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40096/0 (socket says 172.21.15.36:40096) 2022-01-10T01:33:38.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f1389631700 1 -- 172.21.15.36:0/2836591074 learned_addr learned my addr 172.21.15.36:0/2836591074 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:38.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f1388e30700 1 --2- 172.21.15.36:0/2836591074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13840b0010 0x7f13840a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f1389e32700 1 --2- 172.21.15.36:0/2836591074 >> v2:172.21.15.59:3300/0 conn(0x7f13840afbd0 0x7f13840a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f137bfff700 1 -- 172.21.15.36:0/2836591074 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288726896 0 0) 0x7f13840a70c0 con 0x7f13840b2580 2022-01-10T01:33:38.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f137bfff700 1 -- 172.21.15.36:0/2836591074 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1368003260 con 0x7f13840b2580 2022-01-10T01:33:38.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f1389e32700 1 -- 172.21.15.36:0/2836591074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13840b0010 msgr2=0x7f13840a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:38.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f137bfff700 1 -- 172.21.15.36:0/2836591074 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 64182547 0 0) 0x7f1368003260 con 0x7f13840b2580 2022-01-10T01:33:38.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f1389e32700 1 --2- 172.21.15.36:0/2836591074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13840b0010 0x7f13840a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f1389e32700 1 -- 172.21.15.36:0/2836591074 >> v1:172.21.15.36:6789/0 conn(0x7f13840b2580 legacy=0x7f138414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f1389e32700 1 -- 172.21.15.36:0/2836591074 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13840a7830 con 0x7f13840afbd0 2022-01-10T01:33:38.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f1389e32700 1 --2- 172.21.15.36:0/2836591074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13840afbd0 0x7f13840a88a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f1380001800 tx=0x7f137c0091d0).ready entity=mon.1 client_cookie=357f5741207635f6 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:38.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f137bfff700 1 -- 172.21.15.36:0/2836591074 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1380001660 con 0x7f13840afbd0 2022-01-10T01:33:38.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f137bfff700 1 -- 172.21.15.36:0/2836591074 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c00f510 con 0x7f13840afbd0 2022-01-10T01:33:38.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f137bfff700 1 -- 172.21.15.36:0/2836591074 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f137c00f680 con 0x7f13840afbd0 2022-01-10T01:33:38.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f138a633700 1 -- 172.21.15.36:0/2836591074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13840afbd0 msgr2=0x7f13840a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.809+0000 7f138a633700 1 --2- 172.21.15.36:0/2836591074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13840afbd0 0x7f13840a88a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f1380001800 tx=0x7f137c0091d0).stop 2022-01-10T01:33:38.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f138a633700 1 -- 172.21.15.36:0/2836591074 shutdown_connections 2022-01-10T01:33:38.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f138a633700 1 --2- 172.21.15.36:0/2836591074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13840afbd0 0x7f13840a88a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f138a633700 1 --2- 172.21.15.36:0/2836591074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13840b0010 0x7f13840a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f138a633700 1 -- 172.21.15.36:0/2836591074 >> 172.21.15.36:0/2836591074 conn(0x7f1384060180 msgr2=0x7f13840b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:38.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f138a633700 1 -- 172.21.15.36:0/2836591074 shutdown_connections 2022-01-10T01:33:38.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f138a633700 1 -- 172.21.15.36:0/2836591074 wait complete. 2022-01-10T01:33:38.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f138a633700 1 Processor -- start 2022-01-10T01:33:38.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f138a633700 1 -- start start 2022-01-10T01:33:38.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f138a633700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13840afbd0 0x7f138413f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f138a633700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13840b0010 0x7f13840aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f138a633700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13840b2580 0x7f13841599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f138a633700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13840ad4c0 con 0x7f13840b2580 2022-01-10T01:33:38.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f138a633700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1384157150 con 0x7f13840afbd0 2022-01-10T01:33:38.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f138a633700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13841573f0 con 0x7f13840b0010 2022-01-10T01:33:38.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f1389e32700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13840b2580 0x7f13841599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f1389e32700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13840b2580 0x7f13841599f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42312/0 (socket says 172.21.15.36:42312) 2022-01-10T01:33:38.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f1389e32700 1 -- 172.21.15.36:0/677832140 learned_addr learned my addr 172.21.15.36:0/677832140 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:38.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f1389631700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13840afbd0 0x7f138413f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f1388e30700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13840b0010 0x7f13840aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f1389e32700 1 -- 172.21.15.36:0/677832140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13840b0010 msgr2=0x7f13840aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f1389e32700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13840b0010 0x7f13840aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f1389e32700 1 -- 172.21.15.36:0/677832140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13840afbd0 msgr2=0x7f138413f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:38.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f1389e32700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13840afbd0 0x7f138413f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:38.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f1389e32700 1 -- 172.21.15.36:0/677832140 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c009470 con 0x7f13840b2580 2022-01-10T01:33:38.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f1388e30700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13840b0010 0x7f13840aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:38.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f1389e32700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13840b2580 0x7f13841599f0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f1380001800 tx=0x7f137c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:38.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.813+0000 7f137a7fc700 1 -- 172.21.15.36:0/677832140 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f137c0032f0 con 0x7f13840b2580 2022-01-10T01:33:38.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.817+0000 7f137a7fc700 1 -- 172.21.15.36:0/677832140 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c011c30 con 0x7f13840b2580 2022-01-10T01:33:38.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.817+0000 7f137a7fc700 1 -- 172.21.15.36:0/677832140 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f137c021480 con 0x7f13840b2580 2022-01-10T01:33:38.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.817+0000 7f138a633700 1 -- 172.21.15.36:0/677832140 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13840ae8a0 con 0x7f13840b2580 2022-01-10T01:33:38.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.817+0000 7f138a633700 1 -- 172.21.15.36:0/677832140 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138413f630 con 0x7f13840b2580 2022-01-10T01:33:38.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.817+0000 7f137a7fc700 1 -- 172.21.15.36:0/677832140 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f137c00f070 con 0x7f13840b2580 2022-01-10T01:33:38.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.817+0000 7f138a633700 1 -- 172.21.15.36:0/677832140 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13840a8cb0 con 0x7f13840b2580 2022-01-10T01:33:38.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.817+0000 7f137a7fc700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f136c053680 0x7f136c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:38.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.817+0000 7f137a7fc700 1 -- 172.21.15.36:0/677832140 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f137c06c730 con 0x7f13840b2580 2022-01-10T01:33:38.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.817+0000 7f1389631700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f136c053680 0x7f136c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:38.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.821+0000 7f1389631700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f136c053680 0x7f136c055b40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f138000d000 tx=0x7f13800019e0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:38.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.825+0000 7f137a7fc700 1 -- 172.21.15.36:0/677832140 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f137c043a80 con 0x7f13840b2580 2022-01-10T01:33:38.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:38.953+0000 7f138a633700 1 -- 172.21.15.36:0/677832140 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f1384057350 con 0x7f13840b2580 2022-01-10T01:33:39.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.465+0000 7f137a7fc700 1 -- 172.21.15.36:0/677832140 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v145) v1 ==== 133+0+0 (secure 0 0 0) 0x7f137c0150a0 con 0x7f13840b2580 2022-01-10T01:33:39.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.469+0000 7f138a633700 1 -- 172.21.15.36:0/677832140 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f136c053680 msgr2=0x7f136c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:39.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.469+0000 7f138a633700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f136c053680 0x7f136c055b40 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f138000d000 tx=0x7f13800019e0).stop 2022-01-10T01:33:39.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.469+0000 7f138a633700 1 -- 172.21.15.36:0/677832140 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13840b2580 msgr2=0x7f13841599f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:39.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.469+0000 7f138a633700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13840b2580 0x7f13841599f0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f1380001800 tx=0x7f137c016000).stop 2022-01-10T01:33:39.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.469+0000 7f138a633700 1 -- 172.21.15.36:0/677832140 shutdown_connections 2022-01-10T01:33:39.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.469+0000 7f138a633700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f136c053680 0x7f136c055b40 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:39.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.469+0000 7f138a633700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f13840b2580 0x7f13841599f0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:39.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.469+0000 7f138a633700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13840b0010 0x7f13840aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:39.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.469+0000 7f138a633700 1 --2- 172.21.15.36:0/677832140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13840afbd0 0x7f138413f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:39.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.469+0000 7f138a633700 1 -- 172.21.15.36:0/677832140 >> 172.21.15.36:0/677832140 conn(0x7f1384060180 msgr2=0x7f138405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:39.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.469+0000 7f138a633700 1 -- 172.21.15.36:0/677832140 shutdown_connections 2022-01-10T01:33:39.479 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.469+0000 7f138a633700 1 -- 172.21.15.36:0/677832140 wait complete. 2022-01-10T01:33:39.479 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:33:39.488 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2022-01-10T01:33:39.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.593+0000 7f73ee613700 1 Processor -- start 2022-01-10T01:33:39.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.593+0000 7f73ee613700 1 -- start start 2022-01-10T01:33:39.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.593+0000 7f73ee613700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73e80b2580 0x7f73e80abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:39.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ee613700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e80add80 con 0x7f73e80b1260 2022-01-10T01:33:39.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ee613700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e80ae020 con 0x7f73e80b02e0 2022-01-10T01:33:39.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ee613700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e80a9390 con 0x7f73e80b2580 2022-01-10T01:33:39.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ece10700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f73e80b1260 0x7f73e80afbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40110/0 (socket says 172.21.15.36:40110) 2022-01-10T01:33:39.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ece10700 1 -- 172.21.15.36:0/4000463421 learned_addr learned my addr 172.21.15.36:0/4000463421 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:39.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ed611700 1 --2- 172.21.15.36:0/4000463421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73e80b2580 0x7f73e80abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:39.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73d7fff700 1 -- 172.21.15.36:0/4000463421 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478657058 0 0) 0x7f73e80add80 con 0x7f73e80b1260 2022-01-10T01:33:39.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73d7fff700 1 -- 172.21.15.36:0/4000463421 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73d0003260 con 0x7f73e80b1260 2022-01-10T01:33:39.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73d7fff700 1 -- 172.21.15.36:0/4000463421 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000018361 0 0) 0x7f73e80ae020 con 0x7f73e80b02e0 2022-01-10T01:33:39.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73d7fff700 1 -- 172.21.15.36:0/4000463421 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73e80add80 con 0x7f73e80b02e0 2022-01-10T01:33:39.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ed611700 1 -- 172.21.15.36:0/4000463421 >> v1:172.21.15.59:6789/0 conn(0x7f73e80b02e0 legacy=0x7f73e814a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:39.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ed611700 1 -- 172.21.15.36:0/4000463421 >> v1:172.21.15.36:6789/0 conn(0x7f73e80b1260 legacy=0x7f73e80afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:39.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ed611700 1 -- 172.21.15.36:0/4000463421 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e80a9830 con 0x7f73e80b2580 2022-01-10T01:33:39.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ed611700 1 --2- 172.21.15.36:0/4000463421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73e80b2580 0x7f73e80abb10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f73d8002f70 tx=0x7f73d8006df0).ready entity=mon.2 client_cookie=c5d528bac37890d3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:39.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73d7fff700 1 -- 172.21.15.36:0/4000463421 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d800d5c0 con 0x7f73e80b2580 2022-01-10T01:33:39.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73d7fff700 1 -- 172.21.15.36:0/4000463421 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d8000e90 con 0x7f73e80b2580 2022-01-10T01:33:39.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73d7fff700 1 -- 172.21.15.36:0/4000463421 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73d800d910 con 0x7f73e80b2580 2022-01-10T01:33:39.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ee613700 1 -- 172.21.15.36:0/4000463421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73e80b2580 msgr2=0x7f73e80abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:39.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ee613700 1 --2- 172.21.15.36:0/4000463421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73e80b2580 0x7f73e80abb10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f73d8002f70 tx=0x7f73d8006df0).stop 2022-01-10T01:33:39.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ee613700 1 -- 172.21.15.36:0/4000463421 shutdown_connections 2022-01-10T01:33:39.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ee613700 1 --2- 172.21.15.36:0/4000463421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73e80b2580 0x7f73e80abb10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:39.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ee613700 1 -- 172.21.15.36:0/4000463421 >> 172.21.15.36:0/4000463421 conn(0x7f73e8060180 msgr2=0x7f73e80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:39.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ee613700 1 -- 172.21.15.36:0/4000463421 shutdown_connections 2022-01-10T01:33:39.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.597+0000 7f73ee613700 1 -- 172.21.15.36:0/4000463421 wait complete. 2022-01-10T01:33:39.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ee613700 1 Processor -- start 2022-01-10T01:33:39.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ee613700 1 -- start start 2022-01-10T01:33:39.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ee613700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e80b02e0 0x7f73e80648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:39.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ee613700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73e80b1260 0x7f73e8152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:39.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ee613700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73e80b2580 0x7f73e80a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:39.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ee613700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8152380 con 0x7f73e80b1260 2022-01-10T01:33:39.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ee613700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8152570 con 0x7f73e80b02e0 2022-01-10T01:33:39.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ee613700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8065cd0 con 0x7f73e80b2580 2022-01-10T01:33:39.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ece10700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73e80b1260 0x7f73e8152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:39.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ece10700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73e80b1260 0x7f73e8152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42324/0 (socket says 172.21.15.36:42324) 2022-01-10T01:33:39.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ece10700 1 -- 172.21.15.36:0/1761086960 learned_addr learned my addr 172.21.15.36:0/1761086960 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:39.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ede12700 1 --2- 172.21.15.36:0/1761086960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73e80b2580 0x7f73e80a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:39.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ed611700 1 --2- 172.21.15.36:0/1761086960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e80b02e0 0x7f73e80648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:39.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ece10700 1 -- 172.21.15.36:0/1761086960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73e80b2580 msgr2=0x7f73e80a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:39.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ece10700 1 --2- 172.21.15.36:0/1761086960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73e80b2580 0x7f73e80a3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:39.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ece10700 1 -- 172.21.15.36:0/1761086960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e80b02e0 msgr2=0x7f73e80648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:39.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ece10700 1 --2- 172.21.15.36:0/1761086960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e80b02e0 0x7f73e80648a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:39.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ece10700 1 -- 172.21.15.36:0/1761086960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d800b180 con 0x7f73e80b1260 2022-01-10T01:33:39.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ece10700 1 --2- 172.21.15.36:0/1761086960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73e80b1260 0x7f73e8152c70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f73e4001110 tx=0x7f73e4007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:39.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73d67fc700 1 -- 172.21.15.36:0/1761086960 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e40070d0 con 0x7f73e80b1260 2022-01-10T01:33:39.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73d67fc700 1 -- 172.21.15.36:0/1761086960 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e4007230 con 0x7f73e80b1260 2022-01-10T01:33:39.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ee613700 1 -- 172.21.15.36:0/1761086960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e81527d0 con 0x7f73e80b1260 2022-01-10T01:33:39.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73d67fc700 1 -- 172.21.15.36:0/1761086960 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f73e4005610 con 0x7f73e80b1260 2022-01-10T01:33:39.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.601+0000 7f73ee613700 1 -- 172.21.15.36:0/1761086960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e8153160 con 0x7f73e80b1260 2022-01-10T01:33:39.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.605+0000 7f73ee613700 1 -- 172.21.15.36:0/1761086960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e8152960 con 0x7f73e80b1260 2022-01-10T01:33:39.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.605+0000 7f73d67fc700 1 -- 172.21.15.36:0/1761086960 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f73e4010070 con 0x7f73e80b1260 2022-01-10T01:33:39.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.605+0000 7f73d67fc700 1 --2- 172.21.15.36:0/1761086960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73c8053680 0x7f73c8055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:39.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.605+0000 7f73d67fc700 1 -- 172.21.15.36:0/1761086960 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f73e406ae70 con 0x7f73e80b1260 2022-01-10T01:33:39.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.605+0000 7f73ed611700 1 --2- 172.21.15.36:0/1761086960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73c8053680 0x7f73c8055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:39.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.605+0000 7f73ed611700 1 --2- 172.21.15.36:0/1761086960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73c8053680 0x7f73c8055b40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f73d8018000 tx=0x7f73d8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:39.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.613+0000 7f73d67fc700 1 -- 172.21.15.36:0/1761086960 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f73e4041f40 con 0x7f73e80b1260 2022-01-10T01:33:39.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:39.737+0000 7f73ee613700 1 -- 172.21.15.36:0/1761086960 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f73e8057350 con 0x7f73e80b1260 2022-01-10T01:33:40.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.209+0000 7f73d67fc700 1 -- 172.21.15.36:0/1761086960 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v146) v1 ==== 125+0+0 (secure 0 0 0) 0x7f73e4018030 con 0x7f73e80b1260 2022-01-10T01:33:40.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.213+0000 7f73ee613700 1 -- 172.21.15.36:0/1761086960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73c8053680 msgr2=0x7f73c8055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.213+0000 7f73ee613700 1 --2- 172.21.15.36:0/1761086960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73c8053680 0x7f73c8055b40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f73d8018000 tx=0x7f73d8014000).stop 2022-01-10T01:33:40.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.213+0000 7f73ee613700 1 -- 172.21.15.36:0/1761086960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73e80b1260 msgr2=0x7f73e8152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.213+0000 7f73ee613700 1 --2- 172.21.15.36:0/1761086960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73e80b1260 0x7f73e8152c70 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f73e4001110 tx=0x7f73e4007af0).stop 2022-01-10T01:33:40.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.213+0000 7f73ee613700 1 -- 172.21.15.36:0/1761086960 shutdown_connections 2022-01-10T01:33:40.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.213+0000 7f73ee613700 1 --2- 172.21.15.36:0/1761086960 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f73c8053680 0x7f73c8055b40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.217+0000 7f73ee613700 1 --2- 172.21.15.36:0/1761086960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f73e80b2580 0x7f73e80a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.217+0000 7f73ee613700 1 --2- 172.21.15.36:0/1761086960 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f73e80b1260 0x7f73e8152c70 secure :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0x7f73e4001110 tx=0x7f73e4007af0).stop 2022-01-10T01:33:40.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.217+0000 7f73ee613700 1 --2- 172.21.15.36:0/1761086960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f73e80b02e0 0x7f73e80648a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.217+0000 7f73ee613700 1 -- 172.21.15.36:0/1761086960 >> 172.21.15.36:0/1761086960 conn(0x7f73e8060180 msgr2=0x7f73e80b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:40.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.217+0000 7f73ee613700 1 -- 172.21.15.36:0/1761086960 shutdown_connections 2022-01-10T01:33:40.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.217+0000 7f73ee613700 1 -- 172.21.15.36:0/1761086960 wait complete. 2022-01-10T01:33:40.226 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' created 2022-01-10T01:33:40.236 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-10T01:33:40.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.337+0000 7f5e911ce700 1 Processor -- start 2022-01-10T01:33:40.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.337+0000 7f5e911ce700 1 -- start start 2022-01-10T01:33:40.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.337+0000 7f5e911ce700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5e8c0b21c0 0x7f5e8c0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.337+0000 7f5e911ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e8c13a0a0 0x7f5e8c0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.337+0000 7f5e911ce700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8c0ad070 con 0x7f5e8c139cc0 2022-01-10T01:33:40.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.337+0000 7f5e911ce700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8c0b2730 con 0x7f5e8c0b21c0 2022-01-10T01:33:40.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.337+0000 7f5e911ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c060d40 con 0x7f5e8c13a0a0 2022-01-10T01:33:40.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.337+0000 7f5e8a59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5e8c0b21c0 0x7f5e8c0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e8a59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5e8c0b21c0 0x7f5e8c0acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42332/0 (socket says 172.21.15.36:42332) 2022-01-10T01:33:40.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e8a59c700 1 -- 172.21.15.36:0/3351920989 learned_addr learned my addr 172.21.15.36:0/3351920989 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:40.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e8b59e700 1 --2- 172.21.15.36:0/3351920989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e8c13a0a0 0x7f5e8c0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e8a59c700 1 -- 172.21.15.36:0/3351920989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e8c13a0a0 msgr2=0x7f5e8c0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:40.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e8a59c700 1 --2- 172.21.15.36:0/3351920989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e8c13a0a0 0x7f5e8c0b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e8a59c700 1 -- 172.21.15.36:0/3351920989 >> v1:172.21.15.59:6789/0 conn(0x7f5e8c139cc0 legacy=0x7f5e8c1434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e8a59c700 1 -- 172.21.15.36:0/3351920989 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c060fa0 con 0x7f5e8c0b21c0 2022-01-10T01:33:40.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e8b59e700 1 --2- 172.21.15.36:0/3351920989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e8c13a0a0 0x7f5e8c0b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:40.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e8a59c700 1 --2- 172.21.15.36:0/3351920989 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e8c0b21c0 0x7f5e8c0acb80 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f5e80002f70 tx=0x7f5e80006eb0).ready entity=mon.0 client_cookie=f294d6e44900d684 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:40.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e89d9b700 1 -- 172.21.15.36:0/3351920989 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e8000d5c0 con 0x7f5e8c0b21c0 2022-01-10T01:33:40.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e89d9b700 1 -- 172.21.15.36:0/3351920989 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e80000e90 con 0x7f5e8c0b21c0 2022-01-10T01:33:40.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e89d9b700 1 -- 172.21.15.36:0/3351920989 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e8000d950 con 0x7f5e8c0b21c0 2022-01-10T01:33:40.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e911ce700 1 -- 172.21.15.36:0/3351920989 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e8c0b21c0 msgr2=0x7f5e8c0acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e911ce700 1 --2- 172.21.15.36:0/3351920989 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e8c0b21c0 0x7f5e8c0acb80 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f5e80002f70 tx=0x7f5e80006eb0).stop 2022-01-10T01:33:40.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e911ce700 1 -- 172.21.15.36:0/3351920989 shutdown_connections 2022-01-10T01:33:40.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e911ce700 1 --2- 172.21.15.36:0/3351920989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e8c13a0a0 0x7f5e8c0b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e911ce700 1 --2- 172.21.15.36:0/3351920989 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e8c0b21c0 0x7f5e8c0acb80 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e911ce700 1 -- 172.21.15.36:0/3351920989 >> 172.21.15.36:0/3351920989 conn(0x7f5e8c0b3480 msgr2=0x7f5e8c0b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:40.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e911ce700 1 -- 172.21.15.36:0/3351920989 shutdown_connections 2022-01-10T01:33:40.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e911ce700 1 -- 172.21.15.36:0/3351920989 wait complete. 2022-01-10T01:33:40.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e911ce700 1 Processor -- start 2022-01-10T01:33:40.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.341+0000 7f5e911ce700 1 -- start start 2022-01-10T01:33:40.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e911ce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e8c0b21c0 0x7f5e8c05f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e911ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e8c139cc0 0x7f5e8c152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e911ce700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e8c13a0a0 0x7f5e8c0aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e911ce700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c153630 con 0x7f5e8c13a0a0 2022-01-10T01:33:40.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e911ce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c060670 con 0x7f5e8c0b21c0 2022-01-10T01:33:40.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e911ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0b0280 con 0x7f5e8c139cc0 2022-01-10T01:33:40.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e8b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e8c13a0a0 0x7f5e8c0aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e8b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e8c13a0a0 0x7f5e8c0aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42340/0 (socket says 172.21.15.36:42340) 2022-01-10T01:33:40.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e8b59e700 1 -- 172.21.15.36:0/3288999190 learned_addr learned my addr 172.21.15.36:0/3288999190 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:40.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e8ad9d700 1 --2- 172.21.15.36:0/3288999190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e8c0b21c0 0x7f5e8c05f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e8a59c700 1 --2- 172.21.15.36:0/3288999190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e8c139cc0 0x7f5e8c152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e8b59e700 1 -- 172.21.15.36:0/3288999190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e8c139cc0 msgr2=0x7f5e8c152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e8b59e700 1 --2- 172.21.15.36:0/3288999190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e8c139cc0 0x7f5e8c152690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e8b59e700 1 -- 172.21.15.36:0/3288999190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e8c0b21c0 msgr2=0x7f5e8c05f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e8b59e700 1 --2- 172.21.15.36:0/3288999190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e8c0b21c0 0x7f5e8c05f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e8b59e700 1 -- 172.21.15.36:0/3288999190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8000b1e0 con 0x7f5e8c13a0a0 2022-01-10T01:33:40.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e8b59e700 1 --2- 172.21.15.36:0/3288999190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e8c13a0a0 0x7f5e8c0aec60 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f5e84006cc0 tx=0x7f5e84008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:40.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e7bfff700 1 -- 172.21.15.36:0/3288999190 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e8400f710 con 0x7f5e8c13a0a0 2022-01-10T01:33:40.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e7bfff700 1 -- 172.21.15.36:0/3288999190 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8400f870 con 0x7f5e8c13a0a0 2022-01-10T01:33:40.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e911ce700 1 -- 172.21.15.36:0/3288999190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8c0af840 con 0x7f5e8c13a0a0 2022-01-10T01:33:40.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e7bfff700 1 -- 172.21.15.36:0/3288999190 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5e8400fbd0 con 0x7f5e8c13a0a0 2022-01-10T01:33:40.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e911ce700 1 -- 172.21.15.36:0/3288999190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8c0a9120 con 0x7f5e8c13a0a0 2022-01-10T01:33:40.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.345+0000 7f5e911ce700 1 -- 172.21.15.36:0/3288999190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8c061240 con 0x7f5e8c13a0a0 2022-01-10T01:33:40.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.349+0000 7f5e7bfff700 1 -- 172.21.15.36:0/3288999190 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5e8401a030 con 0x7f5e8c13a0a0 2022-01-10T01:33:40.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.349+0000 7f5e7bfff700 1 --2- 172.21.15.36:0/3288999190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5e680534d0 0x7f5e68055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.349+0000 7f5e7bfff700 1 -- 172.21.15.36:0/3288999190 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f5e8406b920 con 0x7f5e8c13a0a0 2022-01-10T01:33:40.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.349+0000 7f5e8ad9d700 1 --2- 172.21.15.36:0/3288999190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5e680534d0 0x7f5e68055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.349+0000 7f5e8ad9d700 1 --2- 172.21.15.36:0/3288999190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5e680534d0 0x7f5e68055990 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f5e7c00d000 tx=0x7f5e7c007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:40.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.353+0000 7f5e7bfff700 1 -- 172.21.15.36:0/3288999190 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5e840429b0 con 0x7f5e8c13a0a0 2022-01-10T01:33:40.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.525+0000 7f5e911ce700 1 -- 172.21.15.36:0/3288999190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f5e8c057350 con 0x7f5e8c13a0a0 2022-01-10T01:33:40.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.533+0000 7f5e7bfff700 1 -- 172.21.15.36:0/3288999190 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 27 and data pool 28 v72) v1 ==== 189+0+0 (secure 0 0 0) 0x7f5e84045fd0 con 0x7f5e8c13a0a0 2022-01-10T01:33:40.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.537+0000 7f5e911ce700 1 -- 172.21.15.36:0/3288999190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5e680534d0 msgr2=0x7f5e68055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.537+0000 7f5e911ce700 1 --2- 172.21.15.36:0/3288999190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5e680534d0 0x7f5e68055990 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f5e7c00d000 tx=0x7f5e7c007b90).stop 2022-01-10T01:33:40.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.537+0000 7f5e911ce700 1 -- 172.21.15.36:0/3288999190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e8c13a0a0 msgr2=0x7f5e8c0aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.537+0000 7f5e911ce700 1 --2- 172.21.15.36:0/3288999190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e8c13a0a0 0x7f5e8c0aec60 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f5e84006cc0 tx=0x7f5e84008040).stop 2022-01-10T01:33:40.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.537+0000 7f5e911ce700 1 -- 172.21.15.36:0/3288999190 shutdown_connections 2022-01-10T01:33:40.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.537+0000 7f5e911ce700 1 --2- 172.21.15.36:0/3288999190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5e680534d0 0x7f5e68055990 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.537+0000 7f5e911ce700 1 --2- 172.21.15.36:0/3288999190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5e8c13a0a0 0x7f5e8c0aec60 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.537+0000 7f5e911ce700 1 --2- 172.21.15.36:0/3288999190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e8c139cc0 0x7f5e8c152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.537+0000 7f5e911ce700 1 --2- 172.21.15.36:0/3288999190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e8c0b21c0 0x7f5e8c05f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.537+0000 7f5e911ce700 1 -- 172.21.15.36:0/3288999190 >> 172.21.15.36:0/3288999190 conn(0x7f5e8c0b3480 msgr2=0x7f5e8c1395b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:40.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.537+0000 7f5e911ce700 1 -- 172.21.15.36:0/3288999190 shutdown_connections 2022-01-10T01:33:40.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.537+0000 7f5e911ce700 1 -- 172.21.15.36:0/3288999190 wait complete. 2022-01-10T01:33:40.546 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 27 and data pool 28 2022-01-10T01:33:40.559 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:33:40.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.645+0000 7f7755ac7700 1 Processor -- start 2022-01-10T01:33:40.652 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.645+0000 7f7755ac7700 1 -- start start 2022-01-10T01:33:40.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.645+0000 7f7755ac7700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7750139cc0 0x7f77500acb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.645+0000 7f7755ac7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f77500b21c0 0x7f77501434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.645+0000 7f7755ac7700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77500ad070 con 0x7f775013a0a0 2022-01-10T01:33:40.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.645+0000 7f7755ac7700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77500b2730 con 0x7f7750139cc0 2022-01-10T01:33:40.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.645+0000 7f7755ac7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7750060d40 con 0x7f77500b21c0 2022-01-10T01:33:40.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.645+0000 7f774f7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7750139cc0 0x7f77500acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f774f7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7750139cc0 0x7f77500acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42346/0 (socket says 172.21.15.36:42346) 2022-01-10T01:33:40.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f774ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f775013a0a0 0x7f77500b65c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40144/0 (socket says 172.21.15.36:40144) 2022-01-10T01:33:40.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f774f7fe700 1 -- 172.21.15.36:0/3913438392 learned_addr learned my addr 172.21.15.36:0/3913438392 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:40.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f774effd700 1 --2- 172.21.15.36:0/3913438392 >> v2:172.21.15.59:3300/0 conn(0x7f77500b21c0 0x7f77501434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f774f7fe700 1 -- 172.21.15.36:0/3913438392 >> v2:172.21.15.59:3300/0 conn(0x7f77500b21c0 msgr2=0x7f77501434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:40.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f774f7fe700 1 --2- 172.21.15.36:0/3913438392 >> v2:172.21.15.59:3300/0 conn(0x7f77500b21c0 0x7f77501434f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f774f7fe700 1 -- 172.21.15.36:0/3913438392 >> v1:172.21.15.36:6789/0 conn(0x7f775013a0a0 legacy=0x7f77500b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f774f7fe700 1 -- 172.21.15.36:0/3913438392 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77500b6cd0 con 0x7f7750139cc0 2022-01-10T01:33:40.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f774e7fc700 1 -- 172.21.15.36:0/3913438392 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573279140 0 0) 0x7f7748001490 con 0x7f775013a0a0 2022-01-10T01:33:40.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f774f7fe700 1 --2- 172.21.15.36:0/3913438392 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7750139cc0 0x7f77500acb80 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f7740002f70 tx=0x7f7740006f40).ready entity=mon.0 client_cookie=3eaa85c3dfbeba3c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:40.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f774e7fc700 1 -- 172.21.15.36:0/3913438392 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f774000da80 con 0x7f7750139cc0 2022-01-10T01:33:40.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f774e7fc700 1 -- 172.21.15.36:0/3913438392 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7740000e90 con 0x7f7750139cc0 2022-01-10T01:33:40.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f774e7fc700 1 -- 172.21.15.36:0/3913438392 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f774000ddd0 con 0x7f7750139cc0 2022-01-10T01:33:40.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f7755ac7700 1 -- 172.21.15.36:0/3913438392 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7750139cc0 msgr2=0x7f77500acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f7755ac7700 1 --2- 172.21.15.36:0/3913438392 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7750139cc0 0x7f77500acb80 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f7740002f70 tx=0x7f7740006f40).stop 2022-01-10T01:33:40.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f7755ac7700 1 -- 172.21.15.36:0/3913438392 shutdown_connections 2022-01-10T01:33:40.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f7755ac7700 1 --2- 172.21.15.36:0/3913438392 >> v2:172.21.15.59:3300/0 conn(0x7f77500b21c0 0x7f77501434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f7755ac7700 1 --2- 172.21.15.36:0/3913438392 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7750139cc0 0x7f77500acb80 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f7755ac7700 1 -- 172.21.15.36:0/3913438392 >> 172.21.15.36:0/3913438392 conn(0x7f77500b3480 msgr2=0x7f77500b5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:40.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f7755ac7700 1 -- 172.21.15.36:0/3913438392 shutdown_connections 2022-01-10T01:33:40.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.649+0000 7f7755ac7700 1 -- 172.21.15.36:0/3913438392 wait complete. 2022-01-10T01:33:40.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.653+0000 7f7755ac7700 1 Processor -- start 2022-01-10T01:33:40.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.653+0000 7f7755ac7700 1 -- start start 2022-01-10T01:33:40.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.653+0000 7f7755ac7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77500b21c0 0x7f7750143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.653+0000 7f7755ac7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7750139cc0 0x7f77501415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.653+0000 7f7755ac7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f775013a0a0 0x7f7750152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.653+0000 7f7755ac7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7750141f30 con 0x7f7750139cc0 2022-01-10T01:33:40.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.653+0000 7f7755ac7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77500b4470 con 0x7f77500b21c0 2022-01-10T01:33:40.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.653+0000 7f7755ac7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77500ad2c0 con 0x7f775013a0a0 2022-01-10T01:33:40.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.653+0000 7f774effd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7750139cc0 0x7f77501415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.653+0000 7f774effd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7750139cc0 0x7f77501415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42354/0 (socket says 172.21.15.36:42354) 2022-01-10T01:33:40.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.653+0000 7f774effd700 1 -- 172.21.15.36:0/60391855 learned_addr learned my addr 172.21.15.36:0/60391855 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:40.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.653+0000 7f774f7fe700 1 --2- 172.21.15.36:0/60391855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77500b21c0 0x7f7750143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.653+0000 7f774ffff700 1 --2- 172.21.15.36:0/60391855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f775013a0a0 0x7f7750152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f774effd700 1 -- 172.21.15.36:0/60391855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f775013a0a0 msgr2=0x7f7750152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f774effd700 1 --2- 172.21.15.36:0/60391855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f775013a0a0 0x7f7750152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f774effd700 1 -- 172.21.15.36:0/60391855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77500b21c0 msgr2=0x7f7750143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f774effd700 1 --2- 172.21.15.36:0/60391855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77500b21c0 0x7f7750143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f774effd700 1 -- 172.21.15.36:0/60391855 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774000b460 con 0x7f7750139cc0 2022-01-10T01:33:40.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f774effd700 1 --2- 172.21.15.36:0/60391855 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7750139cc0 0x7f77501415f0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f774400c000 tx=0x7f7744006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:40.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f774cff9700 1 -- 172.21.15.36:0/60391855 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7744010780 con 0x7f7750139cc0 2022-01-10T01:33:40.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f774cff9700 1 -- 172.21.15.36:0/60391855 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77440108e0 con 0x7f7750139cc0 2022-01-10T01:33:40.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f7755ac7700 1 -- 172.21.15.36:0/60391855 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77500b46a0 con 0x7f7750139cc0 2022-01-10T01:33:40.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f774cff9700 1 -- 172.21.15.36:0/60391855 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7744010c40 con 0x7f7750139cc0 2022-01-10T01:33:40.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f7755ac7700 1 -- 172.21.15.36:0/60391855 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77500b5b00 con 0x7f7750139cc0 2022-01-10T01:33:40.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f774cff9700 1 -- 172.21.15.36:0/60391855 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f774401c460 con 0x7f7750139cc0 2022-01-10T01:33:40.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f7755ac7700 1 -- 172.21.15.36:0/60391855 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77500b4830 con 0x7f7750139cc0 2022-01-10T01:33:40.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f774cff9700 1 --2- 172.21.15.36:0/60391855 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f77300534d0 0x7f7730055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f774cff9700 1 -- 172.21.15.36:0/60391855 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f774406bdb0 con 0x7f7750139cc0 2022-01-10T01:33:40.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f774f7fe700 1 --2- 172.21.15.36:0/60391855 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f77300534d0 0x7f7730055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.657+0000 7f774f7fe700 1 --2- 172.21.15.36:0/60391855 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f77300534d0 0x7f7730055990 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f774001b000 tx=0x7f775013ff20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:40.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.665+0000 7f774cff9700 1 -- 172.21.15.36:0/60391855 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7744042d60 con 0x7f7750139cc0 2022-01-10T01:33:40.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.793+0000 7f7755ac7700 1 -- 172.21.15.36:0/60391855 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7750060fa0 con 0x7f7750139cc0 2022-01-10T01:33:40.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.793+0000 7f774cff9700 1 -- 172.21.15.36:0/60391855 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f7744046380 con 0x7f7750139cc0 2022-01-10T01:33:40.801 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:40.801 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":148,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:33:40.529449+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:33:39.011334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2022-01-10T01:33:39.792400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:33:40.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.797+0000 7f7755ac7700 1 -- 172.21.15.36:0/60391855 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f77300534d0 msgr2=0x7f7730055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.797+0000 7f7755ac7700 1 --2- 172.21.15.36:0/60391855 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f77300534d0 0x7f7730055990 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f774001b000 tx=0x7f775013ff20).stop 2022-01-10T01:33:40.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.797+0000 7f7755ac7700 1 -- 172.21.15.36:0/60391855 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7750139cc0 msgr2=0x7f77501415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.797+0000 7f7755ac7700 1 --2- 172.21.15.36:0/60391855 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7750139cc0 0x7f77501415f0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f774400c000 tx=0x7f7744006df0).stop 2022-01-10T01:33:40.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.797+0000 7f7755ac7700 1 -- 172.21.15.36:0/60391855 shutdown_connections 2022-01-10T01:33:40.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.797+0000 7f7755ac7700 1 --2- 172.21.15.36:0/60391855 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f77300534d0 0x7f7730055990 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.797+0000 7f7755ac7700 1 --2- 172.21.15.36:0/60391855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f775013a0a0 0x7f7750152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.797+0000 7f7755ac7700 1 --2- 172.21.15.36:0/60391855 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7750139cc0 0x7f77501415f0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.797+0000 7f7755ac7700 1 --2- 172.21.15.36:0/60391855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77500b21c0 0x7f7750143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.797+0000 7f7755ac7700 1 -- 172.21.15.36:0/60391855 >> 172.21.15.36:0/60391855 conn(0x7f77500b3480 msgr2=0x7f775013dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:40.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.797+0000 7f7755ac7700 1 -- 172.21.15.36:0/60391855 shutdown_connections 2022-01-10T01:33:40.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.797+0000 7f7755ac7700 1 -- 172.21.15.36:0/60391855 wait complete. 2022-01-10T01:33:40.814 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:33:40.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.909+0000 7f5008cae700 1 Processor -- start 2022-01-10T01:33:40.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 -- start start 2022-01-10T01:33:40.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f500405c7d0 0x7f50040b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f500405d0b0 0x7f500413f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50040ace30 0x7f50040b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5004067d70 con 0x7f500405d0b0 2022-01-10T01:33:40.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500413f880 con 0x7f500405c7d0 2022-01-10T01:33:40.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500405cbb0 con 0x7f50040ace30 2022-01-10T01:33:40.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f4ffbfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f500405d0b0 0x7f500413f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f4ffbfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f500405d0b0 0x7f500413f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42360/0 (socket says 172.21.15.36:42360) 2022-01-10T01:33:40.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f4ffbfff700 1 -- 172.21.15.36:0/3150544836 learned_addr learned my addr 172.21.15.36:0/3150544836 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:40.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5003fff700 1 --2- 172.21.15.36:0/3150544836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50040ace30 0x7f50040b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f50037fe700 1 --2- 172.21.15.36:0/3150544836 >> v2:172.21.15.59:3300/0 conn(0x7f500405c7d0 0x7f50040b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f4ffbfff700 1 -- 172.21.15.36:0/3150544836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50040ace30 msgr2=0x7f50040b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:40.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f4ffbfff700 1 --2- 172.21.15.36:0/3150544836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50040ace30 0x7f50040b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f4ffbfff700 1 -- 172.21.15.36:0/3150544836 >> v2:172.21.15.59:3300/0 conn(0x7f500405c7d0 msgr2=0x7f50040b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:40.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f4ffbfff700 1 --2- 172.21.15.36:0/3150544836 >> v2:172.21.15.59:3300/0 conn(0x7f500405c7d0 0x7f50040b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f4ffbfff700 1 -- 172.21.15.36:0/3150544836 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50040b1790 con 0x7f500405d0b0 2022-01-10T01:33:40.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f50037fe700 1 --2- 172.21.15.36:0/3150544836 >> v2:172.21.15.59:3300/0 conn(0x7f500405c7d0 0x7f50040b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:33:40.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f4ffbfff700 1 --2- 172.21.15.36:0/3150544836 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f500405d0b0 0x7f500413f390 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f4fec002f70 tx=0x7f4fec006eb0).ready entity=mon.0 client_cookie=9ecb6417fb05a55d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:40.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5002ffd700 1 -- 172.21.15.36:0/3150544836 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fec00d570 con 0x7f500405d0b0 2022-01-10T01:33:40.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5002ffd700 1 -- 172.21.15.36:0/3150544836 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fec000e90 con 0x7f500405d0b0 2022-01-10T01:33:40.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5002ffd700 1 -- 172.21.15.36:0/3150544836 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fec00d900 con 0x7f500405d0b0 2022-01-10T01:33:40.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 -- 172.21.15.36:0/3150544836 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f500405d0b0 msgr2=0x7f500413f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 --2- 172.21.15.36:0/3150544836 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f500405d0b0 0x7f500413f390 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f4fec002f70 tx=0x7f4fec006eb0).stop 2022-01-10T01:33:40.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 -- 172.21.15.36:0/3150544836 shutdown_connections 2022-01-10T01:33:40.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 --2- 172.21.15.36:0/3150544836 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50040ace30 0x7f50040b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 --2- 172.21.15.36:0/3150544836 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f500405d0b0 0x7f500413f390 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 --2- 172.21.15.36:0/3150544836 >> v2:172.21.15.59:3300/0 conn(0x7f500405c7d0 0x7f50040b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 -- 172.21.15.36:0/3150544836 >> 172.21.15.36:0/3150544836 conn(0x7f5004060180 msgr2=0x7f50040b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:40.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 -- 172.21.15.36:0/3150544836 shutdown_connections 2022-01-10T01:33:40.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.913+0000 7f5008cae700 1 -- 172.21.15.36:0/3150544836 wait complete. 2022-01-10T01:33:40.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f5008cae700 1 Processor -- start 2022-01-10T01:33:40.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f5008cae700 1 -- start start 2022-01-10T01:33:40.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f5008cae700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f500405c7d0 0x7f500414fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f5008cae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500405d0b0 0x7f500413ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f5008cae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50040ace30 0x7f5004140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f5008cae700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f500414eec0 con 0x7f500405c7d0 2022-01-10T01:33:40.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f5008cae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5004153330 con 0x7f500405d0b0 2022-01-10T01:33:40.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f5008cae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5004142d40 con 0x7f50040ace30 2022-01-10T01:33:40.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f50037fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f500405c7d0 0x7f500414fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f50037fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f500405c7d0 0x7f500414fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42366/0 (socket says 172.21.15.36:42366) 2022-01-10T01:33:40.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f50037fe700 1 -- 172.21.15.36:0/2632146863 learned_addr learned my addr 172.21.15.36:0/2632146863 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:40.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f4ffbfff700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500405d0b0 0x7f500413ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f5003fff700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50040ace30 0x7f5004140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f50037fe700 1 -- 172.21.15.36:0/2632146863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50040ace30 msgr2=0x7f5004140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f50037fe700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50040ace30 0x7f5004140710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f50037fe700 1 -- 172.21.15.36:0/2632146863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500405d0b0 msgr2=0x7f500413ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:40.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f50037fe700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500405d0b0 0x7f500413ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:40.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f50037fe700 1 -- 172.21.15.36:0/2632146863 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec00b1e0 con 0x7f500405c7d0 2022-01-10T01:33:40.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f5003fff700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50040ace30 0x7f5004140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:40.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.917+0000 7f50037fe700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f500405c7d0 0x7f500414fa50 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f4ff4007000 tx=0x7f4ff4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:40.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.921+0000 7f50017fa700 1 -- 172.21.15.36:0/2632146863 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ff4010580 con 0x7f500405c7d0 2022-01-10T01:33:40.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.921+0000 7f50017fa700 1 -- 172.21.15.36:0/2632146863 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff40106e0 con 0x7f500405c7d0 2022-01-10T01:33:40.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.921+0000 7f5008cae700 1 -- 172.21.15.36:0/2632146863 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500414f0b0 con 0x7f500405c7d0 2022-01-10T01:33:40.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.921+0000 7f50017fa700 1 -- 172.21.15.36:0/2632146863 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ff4010a40 con 0x7f500405c7d0 2022-01-10T01:33:40.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.921+0000 7f5008cae700 1 -- 172.21.15.36:0/2632146863 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5004152e20 con 0x7f500405c7d0 2022-01-10T01:33:40.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.921+0000 7f5008cae700 1 -- 172.21.15.36:0/2632146863 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50040b1a30 con 0x7f500405c7d0 2022-01-10T01:33:40.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.921+0000 7f50017fa700 1 -- 172.21.15.36:0/2632146863 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4ff4010ba0 con 0x7f500405c7d0 2022-01-10T01:33:40.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.921+0000 7f50017fa700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4fe8053500 0x7f4fe80559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:40.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.921+0000 7f50017fa700 1 -- 172.21.15.36:0/2632146863 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f4ff406bb90 con 0x7f500405c7d0 2022-01-10T01:33:40.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.921+0000 7f4ffbfff700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4fe8053500 0x7f4fe80559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:40.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.921+0000 7f4ffbfff700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4fe8053500 0x7f4fe80559c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f4fec01a000 tx=0x7f4fec015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:40.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:40.929+0000 7f50017fa700 1 -- 172.21.15.36:0/2632146863 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4ff4042b40 con 0x7f500405c7d0 2022-01-10T01:33:41.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.053+0000 7f5008cae700 1 -- 172.21.15.36:0/2632146863 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5004057350 con 0x7f500405c7d0 2022-01-10T01:33:41.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.057+0000 7f50017fa700 1 -- 172.21.15.36:0/2632146863 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f4ff4046160 con 0x7f500405c7d0 2022-01-10T01:33:41.064 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:41.064 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":148,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:33:40.529449+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:33:39.011334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2022-01-10T01:33:39.792400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:33:41.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.057+0000 7f5008cae700 1 -- 172.21.15.36:0/2632146863 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4fe8053500 msgr2=0x7f4fe80559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:41.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.057+0000 7f5008cae700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4fe8053500 0x7f4fe80559c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f4fec01a000 tx=0x7f4fec015000).stop 2022-01-10T01:33:41.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.057+0000 7f5008cae700 1 -- 172.21.15.36:0/2632146863 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f500405c7d0 msgr2=0x7f500414fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:41.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.057+0000 7f5008cae700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f500405c7d0 0x7f500414fa50 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f4ff4007000 tx=0x7f4ff4008040).stop 2022-01-10T01:33:41.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.057+0000 7f5008cae700 1 -- 172.21.15.36:0/2632146863 shutdown_connections 2022-01-10T01:33:41.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.057+0000 7f5008cae700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4fe8053500 0x7f4fe80559c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.057+0000 7f5008cae700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50040ace30 0x7f5004140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.057+0000 7f5008cae700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500405d0b0 0x7f500413ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.057+0000 7f5008cae700 1 --2- 172.21.15.36:0/2632146863 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f500405c7d0 0x7f500414fa50 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.057+0000 7f5008cae700 1 -- 172.21.15.36:0/2632146863 >> 172.21.15.36:0/2632146863 conn(0x7f5004060180 msgr2=0x7f500413e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:41.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.057+0000 7f5008cae700 1 -- 172.21.15.36:0/2632146863 shutdown_connections 2022-01-10T01:33:41.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.057+0000 7f5008cae700 1 -- 172.21.15.36:0/2632146863 wait complete. 2022-01-10T01:33:41.078 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-01-10T01:33:41.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd69358700 1 Processor -- start 2022-01-10T01:33:41.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd69358700 1 -- start start 2022-01-10T01:33:41.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd69358700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fdd640b2580 0x7fdd6414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:41.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd69358700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd640b0010 0x7fdd6414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:41.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd69358700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd640a70c0 con 0x7fdd640afbd0 2022-01-10T01:33:41.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd69358700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd640a72f0 con 0x7fdd640b2580 2022-01-10T01:33:41.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd69358700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640a7590 con 0x7fdd640b0010 2022-01-10T01:33:41.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd63fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fdd640b2580 0x7fdd6414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:41.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd68b57700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fdd640afbd0 0x7fdd640a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40172/0 (socket says 172.21.15.36:40172) 2022-01-10T01:33:41.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd68b57700 1 -- 172.21.15.36:0/649895136 learned_addr learned my addr 172.21.15.36:0/649895136 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:41.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd5bfff700 1 --2- 172.21.15.36:0/649895136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd640b0010 0x7fdd6414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:41.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd63fff700 1 -- 172.21.15.36:0/649895136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd640b0010 msgr2=0x7fdd6414b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:41.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd63fff700 1 --2- 172.21.15.36:0/649895136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd640b0010 0x7fdd6414b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd63fff700 1 -- 172.21.15.36:0/649895136 >> v1:172.21.15.36:6789/0 conn(0x7fdd640afbd0 legacy=0x7fdd640a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:41.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd63fff700 1 -- 172.21.15.36:0/649895136 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd640a7830 con 0x7fdd640b2580 2022-01-10T01:33:41.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd63fff700 1 --2- 172.21.15.36:0/649895136 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd640b2580 0x7fdd6414ae40 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7fdd5c001490 tx=0x7fdd54006df0).ready entity=mon.0 client_cookie=2ad1452c76e47395 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:41.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd637fe700 1 -- 172.21.15.36:0/649895136 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5400d570 con 0x7fdd640b2580 2022-01-10T01:33:41.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd637fe700 1 -- 172.21.15.36:0/649895136 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd54000e90 con 0x7fdd640b2580 2022-01-10T01:33:41.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.185+0000 7fdd637fe700 1 -- 172.21.15.36:0/649895136 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5400d8c0 con 0x7fdd640b2580 2022-01-10T01:33:41.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 -- 172.21.15.36:0/649895136 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd640b2580 msgr2=0x7fdd6414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:41.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 --2- 172.21.15.36:0/649895136 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd640b2580 0x7fdd6414ae40 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7fdd5c001490 tx=0x7fdd54006df0).stop 2022-01-10T01:33:41.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 -- 172.21.15.36:0/649895136 shutdown_connections 2022-01-10T01:33:41.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 --2- 172.21.15.36:0/649895136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd640b0010 0x7fdd6414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 --2- 172.21.15.36:0/649895136 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd640b2580 0x7fdd6414ae40 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 -- 172.21.15.36:0/649895136 >> 172.21.15.36:0/649895136 conn(0x7fdd64060180 msgr2=0x7fdd640b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:41.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 -- 172.21.15.36:0/649895136 shutdown_connections 2022-01-10T01:33:41.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 -- 172.21.15.36:0/649895136 wait complete. 2022-01-10T01:33:41.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 Processor -- start 2022-01-10T01:33:41.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 -- start start 2022-01-10T01:33:41.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd640afbd0 0x7fdd640b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:41.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd640b0010 0x7fdd640af020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:41.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd640b2580 0x7fdd640aa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:41.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640abe20 con 0x7fdd640afbd0 2022-01-10T01:33:41.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6414d830 con 0x7fdd640b0010 2022-01-10T01:33:41.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd69358700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd640a9440 con 0x7fdd640b2580 2022-01-10T01:33:41.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd63fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd640afbd0 0x7fdd640b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:41.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd63fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd640afbd0 0x7fdd640b5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42384/0 (socket says 172.21.15.36:42384) 2022-01-10T01:33:41.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd63fff700 1 -- 172.21.15.36:0/159368460 learned_addr learned my addr 172.21.15.36:0/159368460 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:41.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd68b57700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd640b2580 0x7fdd640aa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:41.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd5bfff700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd640b0010 0x7fdd640af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:41.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd63fff700 1 -- 172.21.15.36:0/159368460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd640b2580 msgr2=0x7fdd640aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:41.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd63fff700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd640b2580 0x7fdd640aa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd63fff700 1 -- 172.21.15.36:0/159368460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd640b0010 msgr2=0x7fdd640af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:41.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd63fff700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd640b0010 0x7fdd640af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd63fff700 1 -- 172.21.15.36:0/159368460 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5400b180 con 0x7fdd640afbd0 2022-01-10T01:33:41.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.189+0000 7fdd68b57700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd640b2580 0x7fdd640aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:41.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.193+0000 7fdd63fff700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd640afbd0 0x7fdd640b5c50 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7fdd6414cd20 tx=0x7fdd54014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:41.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.193+0000 7fdd61ffb700 1 -- 172.21.15.36:0/159368460 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5400dea0 con 0x7fdd640afbd0 2022-01-10T01:33:41.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.193+0000 7fdd61ffb700 1 -- 172.21.15.36:0/159368460 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd54002f50 con 0x7fdd640afbd0 2022-01-10T01:33:41.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.193+0000 7fdd69358700 1 -- 172.21.15.36:0/159368460 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd640a91e0 con 0x7fdd640afbd0 2022-01-10T01:33:41.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.193+0000 7fdd61ffb700 1 -- 172.21.15.36:0/159368460 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd5401e5f0 con 0x7fdd640afbd0 2022-01-10T01:33:41.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.193+0000 7fdd69358700 1 -- 172.21.15.36:0/159368460 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6414d590 con 0x7fdd640afbd0 2022-01-10T01:33:41.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.193+0000 7fdd69358700 1 -- 172.21.15.36:0/159368460 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd640b59f0 con 0x7fdd640afbd0 2022-01-10T01:33:41.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.193+0000 7fdd61ffb700 1 -- 172.21.15.36:0/159368460 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fdd54025030 con 0x7fdd640afbd0 2022-01-10T01:33:41.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.193+0000 7fdd61ffb700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd480536b0 0x7fdd48055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:41.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.193+0000 7fdd61ffb700 1 -- 172.21.15.36:0/159368460 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdd5406c920 con 0x7fdd640afbd0 2022-01-10T01:33:41.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.193+0000 7fdd5bfff700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd480536b0 0x7fdd48055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:41.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.193+0000 7fdd5bfff700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd480536b0 0x7fdd48055b70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fdd4c00c000 tx=0x7fdd4c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:41.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.205+0000 7fdd61ffb700 1 -- 172.21.15.36:0/159368460 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdd54043930 con 0x7fdd640afbd0 2022-01-10T01:33:41.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.369+0000 7fdd69358700 1 -- 172.21.15.36:0/159368460 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdd64057350 con 0x7fdd640afbd0 2022-01-10T01:33:41.706 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.701+0000 7fdd61ffb700 1 -- 172.21.15.36:0/159368460 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v74) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdd54046f50 con 0x7fdd640afbd0 2022-01-10T01:33:41.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.705+0000 7fdd69358700 1 -- 172.21.15.36:0/159368460 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd480536b0 msgr2=0x7fdd48055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:41.711 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.705+0000 7fdd69358700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd480536b0 0x7fdd48055b70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fdd4c00c000 tx=0x7fdd4c008040).stop 2022-01-10T01:33:41.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.705+0000 7fdd69358700 1 -- 172.21.15.36:0/159368460 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd640afbd0 msgr2=0x7fdd640b5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:41.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.705+0000 7fdd69358700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd640afbd0 0x7fdd640b5c50 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7fdd6414cd20 tx=0x7fdd54014000).stop 2022-01-10T01:33:41.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.705+0000 7fdd69358700 1 -- 172.21.15.36:0/159368460 shutdown_connections 2022-01-10T01:33:41.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.705+0000 7fdd69358700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdd480536b0 0x7fdd48055b70 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.705+0000 7fdd69358700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd640b2580 0x7fdd640aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.705+0000 7fdd69358700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd640b0010 0x7fdd640af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.705+0000 7fdd69358700 1 --2- 172.21.15.36:0/159368460 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdd640afbd0 0x7fdd640b5c50 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.705+0000 7fdd69358700 1 -- 172.21.15.36:0/159368460 >> 172.21.15.36:0/159368460 conn(0x7fdd64060180 msgr2=0x7fdd64144b40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:41.713 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.705+0000 7fdd69358700 1 -- 172.21.15.36:0/159368460 shutdown_connections 2022-01-10T01:33:41.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.705+0000 7fdd69358700 1 -- 172.21.15.36:0/159368460 wait complete. 2022-01-10T01:33:41.727 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:41.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4ed768700 1 Processor -- start 2022-01-10T01:33:41.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4ed768700 1 -- start start 2022-01-10T01:33:41.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4ed768700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa4e80b0010 0x7fa4e80a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:41.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4ed768700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4e80afbd0 0x7fa4e80a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:41.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4ed768700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e80a70c0 con 0x7fa4e80b2580 2022-01-10T01:33:41.839 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4ed768700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e80a72f0 con 0x7fa4e80b0010 2022-01-10T01:33:41.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4ed768700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e80a7590 con 0x7fa4e80afbd0 2022-01-10T01:33:41.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4e7fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa4e80b2580 0x7fa4e814ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40182/0 (socket says 172.21.15.36:40182) 2022-01-10T01:33:41.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4e7fff700 1 -- 172.21.15.36:0/387622158 learned_addr learned my addr 172.21.15.36:0/387622158 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:41.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4e77fe700 1 --2- 172.21.15.36:0/387622158 >> v2:172.21.15.36:3300/0 conn(0x7fa4e80b0010 0x7fa4e80a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:41.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4ecf67700 1 --2- 172.21.15.36:0/387622158 >> v2:172.21.15.59:3300/0 conn(0x7fa4e80afbd0 0x7fa4e80a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:41.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4e6ffd700 1 -- 172.21.15.36:0/387622158 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947033271 0 0) 0x7fa4e80a70c0 con 0x7fa4e80b2580 2022-01-10T01:33:41.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4e77fe700 1 -- 172.21.15.36:0/387622158 >> v2:172.21.15.59:3300/0 conn(0x7fa4e80afbd0 msgr2=0x7fa4e80a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:41.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4e77fe700 1 --2- 172.21.15.36:0/387622158 >> v2:172.21.15.59:3300/0 conn(0x7fa4e80afbd0 0x7fa4e80a88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.829+0000 7fa4e77fe700 1 -- 172.21.15.36:0/387622158 >> v1:172.21.15.36:6789/0 conn(0x7fa4e80b2580 legacy=0x7fa4e814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:41.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.833+0000 7fa4e77fe700 1 -- 172.21.15.36:0/387622158 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e80a7830 con 0x7fa4e80b0010 2022-01-10T01:33:41.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.833+0000 7fa4e77fe700 1 --2- 172.21.15.36:0/387622158 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4e80b0010 0x7fa4e80a83b0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7fa4d80032f0 tx=0x7fa4d80091d0).ready entity=mon.0 client_cookie=2f00de5088042848 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:41.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.833+0000 7fa4e6ffd700 1 -- 172.21.15.36:0/387622158 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d800b680 con 0x7fa4e80b0010 2022-01-10T01:33:41.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.833+0000 7fa4e6ffd700 1 -- 172.21.15.36:0/387622158 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d800b7e0 con 0x7fa4e80b0010 2022-01-10T01:33:41.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.833+0000 7fa4e6ffd700 1 -- 172.21.15.36:0/387622158 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d800b950 con 0x7fa4e80b0010 2022-01-10T01:33:41.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.833+0000 7fa4ed768700 1 -- 172.21.15.36:0/387622158 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4e80b0010 msgr2=0x7fa4e80a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:41.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.833+0000 7fa4ed768700 1 --2- 172.21.15.36:0/387622158 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4e80b0010 0x7fa4e80a83b0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7fa4d80032f0 tx=0x7fa4d80091d0).stop 2022-01-10T01:33:41.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.833+0000 7fa4ed768700 1 -- 172.21.15.36:0/387622158 shutdown_connections 2022-01-10T01:33:41.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.833+0000 7fa4ed768700 1 --2- 172.21.15.36:0/387622158 >> v2:172.21.15.59:3300/0 conn(0x7fa4e80afbd0 0x7fa4e80a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.833+0000 7fa4ed768700 1 --2- 172.21.15.36:0/387622158 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4e80b0010 0x7fa4e80a83b0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.833+0000 7fa4ed768700 1 -- 172.21.15.36:0/387622158 >> 172.21.15.36:0/387622158 conn(0x7fa4e8060180 msgr2=0x7fa4e80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:41.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.833+0000 7fa4ed768700 1 -- 172.21.15.36:0/387622158 shutdown_connections 2022-01-10T01:33:41.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.833+0000 7fa4ed768700 1 -- 172.21.15.36:0/387622158 wait complete. 2022-01-10T01:33:41.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4ed768700 1 Processor -- start 2022-01-10T01:33:41.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4ed768700 1 -- start start 2022-01-10T01:33:41.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4ed768700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e80afbd0 0x7fa4e80aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:41.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4ed768700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4e80b0010 0x7fa4e814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:41.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4ed768700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4e80b2580 0x7fa4e815a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:41.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4ed768700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80a9c50 con 0x7fa4e80b0010 2022-01-10T01:33:41.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4ed768700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e815a7a0 con 0x7fa4e80b2580 2022-01-10T01:33:41.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4ed768700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80a9eb0 con 0x7fa4e80afbd0 2022-01-10T01:33:41.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4e77fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4e80b0010 0x7fa4e814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:41.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4e77fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4e80b0010 0x7fa4e814e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42396/0 (socket says 172.21.15.36:42396) 2022-01-10T01:33:41.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4e77fe700 1 -- 172.21.15.36:0/2307070541 learned_addr learned my addr 172.21.15.36:0/2307070541 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:41.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4e7fff700 1 --2- 172.21.15.36:0/2307070541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e80afbd0 0x7fa4e80aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:41.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4ecf67700 1 --2- 172.21.15.36:0/2307070541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4e80b2580 0x7fa4e815a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:41.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4e77fe700 1 -- 172.21.15.36:0/2307070541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e80afbd0 msgr2=0x7fa4e80aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:41.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4e77fe700 1 --2- 172.21.15.36:0/2307070541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e80afbd0 0x7fa4e80aab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4e77fe700 1 -- 172.21.15.36:0/2307070541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4e80b2580 msgr2=0x7fa4e815a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:41.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4e77fe700 1 --2- 172.21.15.36:0/2307070541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4e80b2580 0x7fa4e815a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:41.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4e77fe700 1 -- 172.21.15.36:0/2307070541 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d8009470 con 0x7fa4e80b0010 2022-01-10T01:33:41.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4e77fe700 1 --2- 172.21.15.36:0/2307070541 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4e80b0010 0x7fa4e814e3b0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7fa4d80032f0 tx=0x7fa4d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:41.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4e57fa700 1 -- 172.21.15.36:0/2307070541 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d800b680 con 0x7fa4e80b0010 2022-01-10T01:33:41.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4e57fa700 1 -- 172.21.15.36:0/2307070541 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d8021630 con 0x7fa4e80b0010 2022-01-10T01:33:41.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4ed768700 1 -- 172.21.15.36:0/2307070541 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e80aa150 con 0x7fa4e80b0010 2022-01-10T01:33:41.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4e57fa700 1 -- 172.21.15.36:0/2307070541 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4d8021990 con 0x7fa4e80b0010 2022-01-10T01:33:41.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.837+0000 7fa4ed768700 1 -- 172.21.15.36:0/2307070541 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e80a9140 con 0x7fa4e80b0010 2022-01-10T01:33:41.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.841+0000 7fa4ed768700 1 -- 172.21.15.36:0/2307070541 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e8057350 con 0x7fa4e80b0010 2022-01-10T01:33:41.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.841+0000 7fa4e57fa700 1 -- 172.21.15.36:0/2307070541 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa4d8027020 con 0x7fa4e80b0010 2022-01-10T01:33:41.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.841+0000 7fa4e57fa700 1 --2- 172.21.15.36:0/2307070541 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4c8053680 0x7fa4c8055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:41.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.841+0000 7fa4e57fa700 1 -- 172.21.15.36:0/2307070541 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa4d806cf70 con 0x7fa4e80b0010 2022-01-10T01:33:41.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.841+0000 7fa4e7fff700 1 --2- 172.21.15.36:0/2307070541 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4c8053680 0x7fa4c8055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:41.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.841+0000 7fa4e7fff700 1 --2- 172.21.15.36:0/2307070541 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4c8053680 0x7fa4c8055b40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fa4dc00d000 tx=0x7fa4dc007c20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:41.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:41.845+0000 7fa4e57fa700 1 -- 172.21.15.36:0/2307070541 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa4d8043e70 con 0x7fa4e80b0010 2022-01-10T01:33:42.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.013+0000 7fa4ed768700 1 -- 172.21.15.36:0/2307070541 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4e80698e0 con 0x7fa4e80b0010 2022-01-10T01:33:42.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.013+0000 7fa4e57fa700 1 -- 172.21.15.36:0/2307070541 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2486 (secure 0 0 0) 0x7fa4d8015090 con 0x7fa4e80b0010 2022-01-10T01:33:42.020 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:42.020 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":74,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/967641645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":967641645},{"type":"v1","addr":"172.21.15.36:6835","nonce":967641645}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/109014568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":109014568},{"type":"v1","addr":"172.21.15.36:6837","nonce":109014568}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:40.529600+0000","modified":"2022-01-10T01:33:41.697488+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8409},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8409":{"gid":8409,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/138807571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":138807571},{"type":"v1","addr":"172.21.15.59:6833","nonce":138807571}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2022-01-10T01:33:42.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.013+0000 7fa4ed768700 1 -- 172.21.15.36:0/2307070541 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4c8053680 msgr2=0x7fa4c8055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.013+0000 7fa4ed768700 1 --2- 172.21.15.36:0/2307070541 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4c8053680 0x7fa4c8055b40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fa4dc00d000 tx=0x7fa4dc007c20).stop 2022-01-10T01:33:42.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.013+0000 7fa4ed768700 1 -- 172.21.15.36:0/2307070541 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4e80b0010 msgr2=0x7fa4e814e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.013+0000 7fa4ed768700 1 --2- 172.21.15.36:0/2307070541 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4e80b0010 0x7fa4e814e3b0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7fa4d80032f0 tx=0x7fa4d8016000).stop 2022-01-10T01:33:42.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.017+0000 7fa4ed768700 1 -- 172.21.15.36:0/2307070541 shutdown_connections 2022-01-10T01:33:42.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.017+0000 7fa4ed768700 1 --2- 172.21.15.36:0/2307070541 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa4c8053680 0x7fa4c8055b40 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.017+0000 7fa4ed768700 1 --2- 172.21.15.36:0/2307070541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4e80b2580 0x7fa4e815a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.017+0000 7fa4ed768700 1 --2- 172.21.15.36:0/2307070541 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa4e80b0010 0x7fa4e814e3b0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.017+0000 7fa4ed768700 1 --2- 172.21.15.36:0/2307070541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4e80afbd0 0x7fa4e80aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.017+0000 7fa4ed768700 1 -- 172.21.15.36:0/2307070541 >> 172.21.15.36:0/2307070541 conn(0x7fa4e8060180 msgr2=0x7fa4e8148aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:42.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.017+0000 7fa4ed768700 1 -- 172.21.15.36:0/2307070541 shutdown_connections 2022-01-10T01:33:42.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.017+0000 7fa4ed768700 1 -- 172.21.15.36:0/2307070541 wait complete. 2022-01-10T01:33:42.025 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 74 2022-01-10T01:33:42.033 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:33:42.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.129+0000 7f5a6e988700 1 Processor -- start 2022-01-10T01:33:42.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.129+0000 7f5a6e988700 1 -- start start 2022-01-10T01:33:42.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5a680b3040 0x7f5a68065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a680a9c10 0x7f5a680607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a68143320 0x7f5a681437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a680648e0 con 0x7f5a680b3040 2022-01-10T01:33:42.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a68061dd0 con 0x7f5a68143320 2022-01-10T01:33:42.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a68066ea0 con 0x7f5a680a9c10 2022-01-10T01:33:42.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6d986700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5a680b3040 0x7f5a68065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6d986700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f5a680b3040 0x7f5a68065e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42404/0 (socket says 172.21.15.36:42404) 2022-01-10T01:33:42.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e187700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a68143320 0x7f5a681437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6d986700 1 -- 172.21.15.36:0/2807493439 learned_addr learned my addr 172.21.15.36:0/2807493439 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:42.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6d185700 1 --2- 172.21.15.36:0/2807493439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a680a9c10 0x7f5a680607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6d986700 1 -- 172.21.15.36:0/2807493439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a680a9c10 msgr2=0x7f5a680607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:42.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6d986700 1 --2- 172.21.15.36:0/2807493439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a680a9c10 0x7f5a680607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6d986700 1 -- 172.21.15.36:0/2807493439 >> v2:172.21.15.59:3300/0 conn(0x7f5a68143320 msgr2=0x7f5a681437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:42.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6d986700 1 --2- 172.21.15.36:0/2807493439 >> v2:172.21.15.59:3300/0 conn(0x7f5a68143320 0x7f5a681437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6d986700 1 -- 172.21.15.36:0/2807493439 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680b3420 con 0x7f5a680b3040 2022-01-10T01:33:42.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6d185700 1 --2- 172.21.15.36:0/2807493439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a680a9c10 0x7f5a680607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:42.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6d986700 1 --2- 172.21.15.36:0/2807493439 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a680b3040 0x7f5a68065e90 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f5a64002f70 tx=0x7f5a64006eb0).ready entity=mon.0 client_cookie=e6a0ba53e9d296fc server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:42.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6c984700 1 -- 172.21.15.36:0/2807493439 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a6400d570 con 0x7f5a680b3040 2022-01-10T01:33:42.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6c984700 1 -- 172.21.15.36:0/2807493439 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a64000e90 con 0x7f5a680b3040 2022-01-10T01:33:42.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6c984700 1 -- 172.21.15.36:0/2807493439 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a6400d900 con 0x7f5a680b3040 2022-01-10T01:33:42.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 -- 172.21.15.36:0/2807493439 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a680b3040 msgr2=0x7f5a68065e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 --2- 172.21.15.36:0/2807493439 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a680b3040 0x7f5a68065e90 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f5a64002f70 tx=0x7f5a64006eb0).stop 2022-01-10T01:33:42.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 -- 172.21.15.36:0/2807493439 shutdown_connections 2022-01-10T01:33:42.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 --2- 172.21.15.36:0/2807493439 >> v2:172.21.15.59:3300/0 conn(0x7f5a68143320 0x7f5a681437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 --2- 172.21.15.36:0/2807493439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a680a9c10 0x7f5a680607c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 --2- 172.21.15.36:0/2807493439 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a680b3040 0x7f5a68065e90 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 -- 172.21.15.36:0/2807493439 >> 172.21.15.36:0/2807493439 conn(0x7f5a680636e0 msgr2=0x7f5a68063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:42.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 -- 172.21.15.36:0/2807493439 shutdown_connections 2022-01-10T01:33:42.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.133+0000 7f5a6e988700 1 -- 172.21.15.36:0/2807493439 wait complete. 2022-01-10T01:33:42.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6e988700 1 Processor -- start 2022-01-10T01:33:42.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6e988700 1 -- start start 2022-01-10T01:33:42.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6e988700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a680a9c10 0x7f5a6805f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6e988700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a680b3040 0x7f5a6814fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6e988700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a68143320 0x7f5a680b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6e988700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680af420 con 0x7f5a680b3040 2022-01-10T01:33:42.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6e988700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a681502c0 con 0x7f5a680a9c10 2022-01-10T01:33:42.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6e988700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a680aeee0 con 0x7f5a68143320 2022-01-10T01:33:42.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6d185700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a680b3040 0x7f5a6814fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6d185700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a680b3040 0x7f5a6814fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42410/0 (socket says 172.21.15.36:42410) 2022-01-10T01:33:42.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6d185700 1 -- 172.21.15.36:0/4203833148 learned_addr learned my addr 172.21.15.36:0/4203833148 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:42.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6d986700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a680a9c10 0x7f5a6805f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6e187700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a68143320 0x7f5a680b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6d185700 1 -- 172.21.15.36:0/4203833148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a68143320 msgr2=0x7f5a680b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6d185700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a68143320 0x7f5a680b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6d185700 1 -- 172.21.15.36:0/4203833148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a680a9c10 msgr2=0x7f5a6805f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6d185700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a680a9c10 0x7f5a6805f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6d185700 1 -- 172.21.15.36:0/4203833148 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6400b1e0 con 0x7f5a680b3040 2022-01-10T01:33:42.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6d986700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a680a9c10 0x7f5a6805f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:42.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6d185700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a680b3040 0x7f5a6814fdd0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f5a58006940 tx=0x7f5a58008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:42.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a56ffd700 1 -- 172.21.15.36:0/4203833148 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a58011780 con 0x7f5a680b3040 2022-01-10T01:33:42.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a56ffd700 1 -- 172.21.15.36:0/4203833148 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a580118e0 con 0x7f5a680b3040 2022-01-10T01:33:42.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a6e988700 1 -- 172.21.15.36:0/4203833148 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a680af180 con 0x7f5a680b3040 2022-01-10T01:33:42.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.137+0000 7f5a56ffd700 1 -- 172.21.15.36:0/4203833148 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a58011c40 con 0x7f5a680b3040 2022-01-10T01:33:42.159 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.141+0000 7f5a6e988700 1 -- 172.21.15.36:0/4203833148 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a680a08a0 con 0x7f5a680b3040 2022-01-10T01:33:42.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.141+0000 7f5a56ffd700 1 -- 172.21.15.36:0/4203833148 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5a58012420 con 0x7f5a680b3040 2022-01-10T01:33:42.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.141+0000 7f5a6e988700 1 -- 172.21.15.36:0/4203833148 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a680afe00 con 0x7f5a680b3040 2022-01-10T01:33:42.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.141+0000 7f5a56ffd700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5a480534d0 0x7f5a48055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.160 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.141+0000 7f5a56ffd700 1 -- 172.21.15.36:0/4203833148 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f5a5806b940 con 0x7f5a680b3040 2022-01-10T01:33:42.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.141+0000 7f5a6d986700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5a480534d0 0x7f5a48055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.141+0000 7f5a6d986700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5a480534d0 0x7f5a48055990 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f5a6401a000 tx=0x7f5a64015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:42.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.149+0000 7f5a56ffd700 1 -- 172.21.15.36:0/4203833148 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5a680afe00 con 0x7f5a680b3040 2022-01-10T01:33:42.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.269+0000 7f5a6e988700 1 -- 172.21.15.36:0/4203833148 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a680afe00 con 0x7f5a680b3040 2022-01-10T01:33:42.278 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.273+0000 7f5a56ffd700 1 -- 172.21.15.36:0/4203833148 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f5a680afe00 con 0x7f5a680b3040 2022-01-10T01:33:42.279 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:42.279 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":148,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:33:40.529449+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:33:39.011334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2022-01-10T01:33:39.792400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:33:42.280 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.273+0000 7f5a6e988700 1 -- 172.21.15.36:0/4203833148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5a480534d0 msgr2=0x7f5a48055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.273+0000 7f5a6e988700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5a480534d0 0x7f5a48055990 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f5a6401a000 tx=0x7f5a64015000).stop 2022-01-10T01:33:42.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.273+0000 7f5a6e988700 1 -- 172.21.15.36:0/4203833148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a680b3040 msgr2=0x7f5a6814fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.273+0000 7f5a6e988700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a680b3040 0x7f5a6814fdd0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f5a58006940 tx=0x7f5a58008040).stop 2022-01-10T01:33:42.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.273+0000 7f5a6e988700 1 -- 172.21.15.36:0/4203833148 shutdown_connections 2022-01-10T01:33:42.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.273+0000 7f5a6e988700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5a480534d0 0x7f5a48055990 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.273+0000 7f5a6e988700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a68143320 0x7f5a680b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.273+0000 7f5a6e988700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5a680b3040 0x7f5a6814fdd0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.273+0000 7f5a6e988700 1 --2- 172.21.15.36:0/4203833148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a680a9c10 0x7f5a6805f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.273+0000 7f5a6e988700 1 -- 172.21.15.36:0/4203833148 >> 172.21.15.36:0/4203833148 conn(0x7f5a680636e0 msgr2=0x7f5a68142920 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:42.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.273+0000 7f5a6e988700 1 -- 172.21.15.36:0/4203833148 shutdown_connections 2022-01-10T01:33:42.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.273+0000 7f5a6e988700 1 -- 172.21.15.36:0/4203833148 wait complete. 2022-01-10T01:33:42.292 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:33:42.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f7daa700 1 Processor -- start 2022-01-10T01:33:42.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f7daa700 1 -- start start 2022-01-10T01:33:42.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f7daa700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f51f00b6580 0x7f51f00b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f7daa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51f00b6960 0x7f51f012ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f7daa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f01440b0 con 0x7f51f00b43c0 2022-01-10T01:33:42.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f7daa700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f0143b70 con 0x7f51f00b6580 2022-01-10T01:33:42.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f7daa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f0143e10 con 0x7f51f00b6960 2022-01-10T01:33:42.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f5b46700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f51f00b6580 0x7f51f00b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f5b46700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f51f00b6580 0x7f51f00b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42416/0 (socket says 172.21.15.36:42416) 2022-01-10T01:33:42.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f5b46700 1 -- 172.21.15.36:0/4185025807 learned_addr learned my addr 172.21.15.36:0/4185025807 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:42.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f6347700 1 --2- 172.21.15.36:0/4185025807 >> v2:172.21.15.59:3300/0 conn(0x7f51f00b6960 0x7f51f012ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f5b46700 1 -- 172.21.15.36:0/4185025807 >> v2:172.21.15.59:3300/0 conn(0x7f51f00b6960 msgr2=0x7f51f012ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:42.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f5b46700 1 --2- 172.21.15.36:0/4185025807 >> v2:172.21.15.59:3300/0 conn(0x7f51f00b6960 0x7f51f012ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f5b46700 1 -- 172.21.15.36:0/4185025807 >> v1:172.21.15.59:6789/0 conn(0x7f51f00b43c0 legacy=0x7f51f0061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f5b46700 1 -- 172.21.15.36:0/4185025807 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f00615f0 con 0x7f51f00b6580 2022-01-10T01:33:42.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.401+0000 7f51f5b46700 1 --2- 172.21.15.36:0/4185025807 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51f00b6580 0x7f51f00b5bf0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f51f0143120 tx=0x7f51ec006eb0).ready entity=mon.0 client_cookie=b63af0ac56349f7a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:42.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.405+0000 7f51f4b44700 1 -- 172.21.15.36:0/4185025807 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ec00d610 con 0x7f51f00b6580 2022-01-10T01:33:42.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.405+0000 7f51f4b44700 1 -- 172.21.15.36:0/4185025807 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec000e90 con 0x7f51f00b6580 2022-01-10T01:33:42.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.405+0000 7f51f4b44700 1 -- 172.21.15.36:0/4185025807 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ec00d9a0 con 0x7f51f00b6580 2022-01-10T01:33:42.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.405+0000 7f51f7daa700 1 -- 172.21.15.36:0/4185025807 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51f00b6580 msgr2=0x7f51f00b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.405+0000 7f51f7daa700 1 --2- 172.21.15.36:0/4185025807 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51f00b6580 0x7f51f00b5bf0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f51f0143120 tx=0x7f51ec006eb0).stop 2022-01-10T01:33:42.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.405+0000 7f51f7daa700 1 -- 172.21.15.36:0/4185025807 shutdown_connections 2022-01-10T01:33:42.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.405+0000 7f51f7daa700 1 --2- 172.21.15.36:0/4185025807 >> v2:172.21.15.59:3300/0 conn(0x7f51f00b6960 0x7f51f012ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.405+0000 7f51f7daa700 1 --2- 172.21.15.36:0/4185025807 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51f00b6580 0x7f51f00b5bf0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.405+0000 7f51f7daa700 1 -- 172.21.15.36:0/4185025807 >> 172.21.15.36:0/4185025807 conn(0x7f51f005c490 msgr2=0x7f51f005c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:42.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.405+0000 7f51f7daa700 1 -- 172.21.15.36:0/4185025807 shutdown_connections 2022-01-10T01:33:42.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.405+0000 7f51f7daa700 1 -- 172.21.15.36:0/4185025807 wait complete. 2022-01-10T01:33:42.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.405+0000 7f51f7daa700 1 Processor -- start 2022-01-10T01:33:42.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.405+0000 7f51f7daa700 1 -- start start 2022-01-10T01:33:42.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f7daa700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51f00b43c0 0x7f51f0129ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f7daa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f00b6580 0x7f51f0129fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.421 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f7daa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f00b6960 0x7f51f012b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f7daa700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00b2fe0 con 0x7f51f00b43c0 2022-01-10T01:33:42.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f7daa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00b2230 con 0x7f51f00b6960 2022-01-10T01:33:42.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f7daa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00b3680 con 0x7f51f00b6580 2022-01-10T01:33:42.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f5b46700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51f00b43c0 0x7f51f0129ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f5b46700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51f00b43c0 0x7f51f0129ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42422/0 (socket says 172.21.15.36:42422) 2022-01-10T01:33:42.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f5b46700 1 -- 172.21.15.36:0/2512015321 learned_addr learned my addr 172.21.15.36:0/2512015321 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:42.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f5345700 1 --2- 172.21.15.36:0/2512015321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f00b6580 0x7f51f0129fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f6347700 1 --2- 172.21.15.36:0/2512015321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f00b6960 0x7f51f012b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f5b46700 1 -- 172.21.15.36:0/2512015321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f00b6580 msgr2=0x7f51f0129fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f5b46700 1 --2- 172.21.15.36:0/2512015321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f00b6580 0x7f51f0129fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f5b46700 1 -- 172.21.15.36:0/2512015321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f00b6960 msgr2=0x7f51f012b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f5b46700 1 --2- 172.21.15.36:0/2512015321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f00b6960 0x7f51f012b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f5b46700 1 -- 172.21.15.36:0/2512015321 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec00b1e0 con 0x7f51f00b43c0 2022-01-10T01:33:42.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f5b46700 1 --2- 172.21.15.36:0/2512015321 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51f00b43c0 0x7f51f0129ac0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f51f0143120 tx=0x7f51ec015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:42.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51deffd700 1 -- 172.21.15.36:0/2512015321 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ec0117e0 con 0x7f51f00b43c0 2022-01-10T01:33:42.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51deffd700 1 -- 172.21.15.36:0/2512015321 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec011940 con 0x7f51f00b43c0 2022-01-10T01:33:42.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f7daa700 1 -- 172.21.15.36:0/2512015321 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f00b3990 con 0x7f51f00b43c0 2022-01-10T01:33:42.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51deffd700 1 -- 172.21.15.36:0/2512015321 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51ec011ca0 con 0x7f51f00b43c0 2022-01-10T01:33:42.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.409+0000 7f51f7daa700 1 -- 172.21.15.36:0/2512015321 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f012c660 con 0x7f51f00b43c0 2022-01-10T01:33:42.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.413+0000 7f51f7daa700 1 -- 172.21.15.36:0/2512015321 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f00b23d0 con 0x7f51f00b43c0 2022-01-10T01:33:42.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.413+0000 7f51deffd700 1 -- 172.21.15.36:0/2512015321 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f51ec025030 con 0x7f51f00b43c0 2022-01-10T01:33:42.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.413+0000 7f51deffd700 1 --2- 172.21.15.36:0/2512015321 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51d0053560 0x7f51d0055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.413+0000 7f51deffd700 1 -- 172.21.15.36:0/2512015321 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f51ec06cbb0 con 0x7f51f00b43c0 2022-01-10T01:33:42.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.413+0000 7f51f5345700 1 --2- 172.21.15.36:0/2512015321 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51d0053560 0x7f51d0055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.413+0000 7f51f5345700 1 --2- 172.21.15.36:0/2512015321 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51d0053560 0x7f51d0055a20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f51e000d000 tx=0x7f51e0007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:42.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.421+0000 7f51deffd700 1 -- 172.21.15.36:0/2512015321 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f51ec043b30 con 0x7f51f00b43c0 2022-01-10T01:33:42.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.593+0000 7f51f7daa700 1 -- 172.21.15.36:0/2512015321 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f51f0061890 con 0x7f51f00b43c0 2022-01-10T01:33:42.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.597+0000 7f51deffd700 1 -- 172.21.15.36:0/2512015321 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7f51ec023020 con 0x7f51f00b43c0 2022-01-10T01:33:42.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.601+0000 7f51f7daa700 1 -- 172.21.15.36:0/2512015321 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51d0053560 msgr2=0x7f51d0055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.601+0000 7f51f7daa700 1 --2- 172.21.15.36:0/2512015321 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51d0053560 0x7f51d0055a20 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f51e000d000 tx=0x7f51e0007b90).stop 2022-01-10T01:33:42.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.601+0000 7f51f7daa700 1 -- 172.21.15.36:0/2512015321 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51f00b43c0 msgr2=0x7f51f0129ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.601+0000 7f51f7daa700 1 --2- 172.21.15.36:0/2512015321 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51f00b43c0 0x7f51f0129ac0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f51f0143120 tx=0x7f51ec015000).stop 2022-01-10T01:33:42.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.601+0000 7f51f7daa700 1 -- 172.21.15.36:0/2512015321 shutdown_connections 2022-01-10T01:33:42.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.601+0000 7f51f7daa700 1 --2- 172.21.15.36:0/2512015321 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51d0053560 0x7f51d0055a20 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.601+0000 7f51f7daa700 1 --2- 172.21.15.36:0/2512015321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51f00b6960 0x7f51f012b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.601+0000 7f51f7daa700 1 --2- 172.21.15.36:0/2512015321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51f00b6580 0x7f51f0129fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.601+0000 7f51f7daa700 1 --2- 172.21.15.36:0/2512015321 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f51f00b43c0 0x7f51f0129ac0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.601+0000 7f51f7daa700 1 -- 172.21.15.36:0/2512015321 >> 172.21.15.36:0/2512015321 conn(0x7f51f005c490 msgr2=0x7f51f0128380 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:42.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.601+0000 7f51f7daa700 1 -- 172.21.15.36:0/2512015321 shutdown_connections 2022-01-10T01:33:42.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.601+0000 7f51f7daa700 1 -- 172.21.15.36:0/2512015321 wait complete. 2022-01-10T01:33:42.613 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.0 2022-01-10T01:33:42.626 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:33:42.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.729+0000 7f8d75865700 1 Processor -- start 2022-01-10T01:33:42.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.729+0000 7f8d75865700 1 -- start start 2022-01-10T01:33:42.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8d70060100 0x7f8d70061650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d70065970 0x7f8d70065e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d700604e0 con 0x7f8d700665d0 2022-01-10T01:33:42.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d70067150 con 0x7f8d70060100 2022-01-10T01:33:42.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70060c70 con 0x7f8d70065970 2022-01-10T01:33:42.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d6effd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8d70060100 0x7f8d70061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d6effd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8d70060100 0x7f8d70061650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42430/0 (socket says 172.21.15.36:42430) 2022-01-10T01:33:42.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d6effd700 1 -- 172.21.15.36:0/3593963153 learned_addr learned my addr 172.21.15.36:0/3593963153 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:42.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d667fc700 1 --2- 172.21.15.36:0/3593963153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d70065970 0x7f8d70065e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d6effd700 1 -- 172.21.15.36:0/3593963153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d70065970 msgr2=0x7f8d70065e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:42.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d6effd700 1 --2- 172.21.15.36:0/3593963153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d70065970 0x7f8d70065e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d6effd700 1 -- 172.21.15.36:0/3593963153 >> v1:172.21.15.59:6789/0 conn(0x7f8d700665d0 legacy=0x7f8d70066a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d6effd700 1 -- 172.21.15.36:0/3593963153 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d70060f10 con 0x7f8d70060100 2022-01-10T01:33:42.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d667fc700 1 --2- 172.21.15.36:0/3593963153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d70065970 0x7f8d70065e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:33:42.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d6effd700 1 --2- 172.21.15.36:0/3593963153 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d70060100 0x7f8d70061650 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f8d60002f70 tx=0x7f8d60006eb0).ready entity=mon.0 client_cookie=b27325ae0193b288 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:42.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d6e7fc700 1 -- 172.21.15.36:0/3593963153 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d6000d5c0 con 0x7f8d70060100 2022-01-10T01:33:42.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d6e7fc700 1 -- 172.21.15.36:0/3593963153 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d60000e90 con 0x7f8d70060100 2022-01-10T01:33:42.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d6e7fc700 1 -- 172.21.15.36:0/3593963153 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d6000d950 con 0x7f8d70060100 2022-01-10T01:33:42.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 -- 172.21.15.36:0/3593963153 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d70060100 msgr2=0x7f8d70061650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 --2- 172.21.15.36:0/3593963153 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d70060100 0x7f8d70061650 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f8d60002f70 tx=0x7f8d60006eb0).stop 2022-01-10T01:33:42.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 -- 172.21.15.36:0/3593963153 shutdown_connections 2022-01-10T01:33:42.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 --2- 172.21.15.36:0/3593963153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d70065970 0x7f8d70065e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 --2- 172.21.15.36:0/3593963153 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d70060100 0x7f8d70061650 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 -- 172.21.15.36:0/3593963153 >> 172.21.15.36:0/3593963153 conn(0x7f8d7005cf30 msgr2=0x7f8d7005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:42.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 -- 172.21.15.36:0/3593963153 shutdown_connections 2022-01-10T01:33:42.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 -- 172.21.15.36:0/3593963153 wait complete. 2022-01-10T01:33:42.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 Processor -- start 2022-01-10T01:33:42.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.733+0000 7f8d75865700 1 -- start start 2022-01-10T01:33:42.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d75865700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d70060100 0x7f8d70153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d75865700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d70065970 0x7f8d70146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d75865700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d700665d0 0x7f8d7014fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d75865700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700b7ba0 con 0x7f8d700665d0 2022-01-10T01:33:42.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d75865700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700a7920 con 0x7f8d70065970 2022-01-10T01:33:42.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d75865700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d701535f0 con 0x7f8d70060100 2022-01-10T01:33:42.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d6f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d700665d0 0x7f8d7014fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d6f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d700665d0 0x7f8d7014fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42438/0 (socket says 172.21.15.36:42438) 2022-01-10T01:33:42.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d6f7fe700 1 -- 172.21.15.36:0/2992369626 learned_addr learned my addr 172.21.15.36:0/2992369626 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:42.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d6effd700 1 --2- 172.21.15.36:0/2992369626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d70060100 0x7f8d70153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d667fc700 1 --2- 172.21.15.36:0/2992369626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d70065970 0x7f8d70146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d6f7fe700 1 -- 172.21.15.36:0/2992369626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d70060100 msgr2=0x7f8d70153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.752 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d6f7fe700 1 --2- 172.21.15.36:0/2992369626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d70060100 0x7f8d70153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d6f7fe700 1 -- 172.21.15.36:0/2992369626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d70065970 msgr2=0x7f8d70146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d6f7fe700 1 --2- 172.21.15.36:0/2992369626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d70065970 0x7f8d70146b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d6f7fe700 1 -- 172.21.15.36:0/2992369626 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6000b1e0 con 0x7f8d700665d0 2022-01-10T01:33:42.753 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d6f7fe700 1 --2- 172.21.15.36:0/2992369626 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d700665d0 0x7f8d7014fa20 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f8d70061530 tx=0x7f8d68007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:42.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d6cff9700 1 -- 172.21.15.36:0/2992369626 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d6800cea0 con 0x7f8d700665d0 2022-01-10T01:33:42.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d6cff9700 1 -- 172.21.15.36:0/2992369626 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d68006aa0 con 0x7f8d700665d0 2022-01-10T01:33:42.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d75865700 1 -- 172.21.15.36:0/2992369626 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d700a7b80 con 0x7f8d700665d0 2022-01-10T01:33:42.754 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d6cff9700 1 -- 172.21.15.36:0/2992369626 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d68006e00 con 0x7f8d700665d0 2022-01-10T01:33:42.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d75865700 1 -- 172.21.15.36:0/2992369626 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d700a80c0 con 0x7f8d700665d0 2022-01-10T01:33:42.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d75865700 1 -- 172.21.15.36:0/2992369626 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d700a8280 con 0x7f8d700665d0 2022-01-10T01:33:42.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.737+0000 7f8d6cff9700 1 -- 172.21.15.36:0/2992369626 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8d68010070 con 0x7f8d700665d0 2022-01-10T01:33:42.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.741+0000 7f8d6cff9700 1 --2- 172.21.15.36:0/2992369626 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8d540534d0 0x7f8d54055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:42.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.741+0000 7f8d6cff9700 1 -- 172.21.15.36:0/2992369626 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8d6806b710 con 0x7f8d700665d0 2022-01-10T01:33:42.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.741+0000 7f8d6effd700 1 --2- 172.21.15.36:0/2992369626 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8d540534d0 0x7f8d54055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:42.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.741+0000 7f8d6effd700 1 --2- 172.21.15.36:0/2992369626 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8d540534d0 0x7f8d54055990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f8d6001c000 tx=0x7f8d60015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:42.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.749+0000 7f8d6cff9700 1 -- 172.21.15.36:0/2992369626 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8d68042720 con 0x7f8d700665d0 2022-01-10T01:33:42.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.913+0000 7f8d75865700 1 -- 172.21.15.36:0/2992369626 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f8d700611b0 con 0x7f8d700665d0 2022-01-10T01:33:42.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.921+0000 7f8d6cff9700 1 -- 172.21.15.36:0/2992369626 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8d68045d40 con 0x7f8d700665d0 2022-01-10T01:33:42.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.925+0000 7f8d75865700 1 -- 172.21.15.36:0/2992369626 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8d540534d0 msgr2=0x7f8d54055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.925+0000 7f8d75865700 1 --2- 172.21.15.36:0/2992369626 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8d540534d0 0x7f8d54055990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f8d6001c000 tx=0x7f8d60015000).stop 2022-01-10T01:33:42.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.925+0000 7f8d75865700 1 -- 172.21.15.36:0/2992369626 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d700665d0 msgr2=0x7f8d7014fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:42.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.925+0000 7f8d75865700 1 --2- 172.21.15.36:0/2992369626 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d700665d0 0x7f8d7014fa20 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f8d70061530 tx=0x7f8d68007f70).stop 2022-01-10T01:33:42.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.925+0000 7f8d75865700 1 -- 172.21.15.36:0/2992369626 shutdown_connections 2022-01-10T01:33:42.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.925+0000 7f8d75865700 1 --2- 172.21.15.36:0/2992369626 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8d540534d0 0x7f8d54055990 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.925+0000 7f8d75865700 1 --2- 172.21.15.36:0/2992369626 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8d700665d0 0x7f8d7014fa20 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.925+0000 7f8d75865700 1 --2- 172.21.15.36:0/2992369626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d70065970 0x7f8d70146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.925+0000 7f8d75865700 1 --2- 172.21.15.36:0/2992369626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d70060100 0x7f8d70153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:42.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.925+0000 7f8d75865700 1 -- 172.21.15.36:0/2992369626 >> 172.21.15.36:0/2992369626 conn(0x7f8d7005cf30 msgr2=0x7f8d701458e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:42.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.925+0000 7f8d75865700 1 -- 172.21.15.36:0/2992369626 shutdown_connections 2022-01-10T01:33:42.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:42.925+0000 7f8d75865700 1 -- 172.21.15.36:0/2992369626 wait complete. 2022-01-10T01:33:42.937 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.1 2022-01-10T01:33:42.948 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:43.053 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.045+0000 7f45bcd80700 1 Processor -- start 2022-01-10T01:33:43.054 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.045+0000 7f45bcd80700 1 -- start start 2022-01-10T01:33:43.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45bcd80700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45b80b2580 0x7f45b814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:43.059 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45bcd80700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b80a70c0 con 0x7f45b80a8ac0 2022-01-10T01:33:43.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45bcd80700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b80a72f0 con 0x7f45b80b0010 2022-01-10T01:33:43.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45bcd80700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b80a7590 con 0x7f45b80b2580 2022-01-10T01:33:43.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b7fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f45b80a8ac0 0x7f45b8151bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40242/0 (socket says 172.21.15.36:40242) 2022-01-10T01:33:43.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b7fff700 1 -- 172.21.15.36:0/117626063 learned_addr learned my addr 172.21.15.36:0/117626063 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:43.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b77fe700 1 --2- 172.21.15.36:0/117626063 >> v2:172.21.15.59:3300/0 conn(0x7f45b80b2580 0x7f45b814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:43.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637790722 0 0) 0x7f45b80a70c0 con 0x7f45b80a8ac0 2022-01-10T01:33:43.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a4003260 con 0x7f45b80a8ac0 2022-01-10T01:33:43.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194774615 0 0) 0x7f45b80a72f0 con 0x7f45b80b0010 2022-01-10T01:33:43.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45b80a70c0 con 0x7f45b80b0010 2022-01-10T01:33:43.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1490994635 0 0) 0x7f45a4003260 con 0x7f45b80a8ac0 2022-01-10T01:33:43.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 >> v2:172.21.15.59:3300/0 conn(0x7f45b80b2580 msgr2=0x7f45b814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:43.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 --2- 172.21.15.36:0/117626063 >> v2:172.21.15.59:3300/0 conn(0x7f45b80b2580 0x7f45b814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 >> v1:172.21.15.59:6789/0 conn(0x7f45b80b0010 legacy=0x7f45b80a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:43.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b80a7830 con 0x7f45b80a8ac0 2022-01-10T01:33:43.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f45b00019e0 con 0x7f45b80a8ac0 2022-01-10T01:33:43.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 >> v1:172.21.15.36:6789/0 conn(0x7f45b80a8ac0 legacy=0x7f45b8151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:43.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 --2- 172.21.15.36:0/117626063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45a40038e0 0x7f45a4003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:43.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 --2- 172.21.15.36:0/117626063 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45a4004500 0x7f45a4004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:43.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 --2- 172.21.15.36:0/117626063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45a4004e70 0x7f45a400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:43.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b80a7590 con 0x7f45a4004500 2022-01-10T01:33:43.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b6ffd700 1 --2- 172.21.15.36:0/117626063 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45a4004500 0x7f45a4004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:43.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a400bcf0 con 0x7f45a40038e0 2022-01-10T01:33:43.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a400beb0 con 0x7f45a4004e70 2022-01-10T01:33:43.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b77fe700 1 --2- 172.21.15.36:0/117626063 >> v2:172.21.15.59:3300/0 conn(0x7f45b80b2580 0x7f45b814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:43.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b7fff700 1 --2- 172.21.15.36:0/117626063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45a4004e70 0x7f45a400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:43.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b77fe700 1 --2- 172.21.15.36:0/117626063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45a40038e0 0x7f45a4003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:43.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b6ffd700 1 -- 172.21.15.36:0/117626063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45a4004e70 msgr2=0x7f45a400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:43.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b6ffd700 1 --2- 172.21.15.36:0/117626063 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45a4004e70 0x7f45a400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b6ffd700 1 -- 172.21.15.36:0/117626063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45a40038e0 msgr2=0x7f45a4003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:43.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b6ffd700 1 --2- 172.21.15.36:0/117626063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45a40038e0 0x7f45a4003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b6ffd700 1 -- 172.21.15.36:0/117626063 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a4003260 con 0x7f45a4004500 2022-01-10T01:33:43.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b77fe700 1 --2- 172.21.15.36:0/117626063 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45a40038e0 0x7f45a4003ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:33:43.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b7fff700 1 -- 172.21.15.36:0/117626063 reap_dead start 2022-01-10T01:33:43.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b6ffd700 1 --2- 172.21.15.36:0/117626063 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45a4004500 0x7f45a4004980 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f45a8001110 tx=0x7f45a80079c0).ready entity=mon.0 client_cookie=523efe6502649328 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:43.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45a8007cd0 con 0x7f45a4004500 2022-01-10T01:33:43.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a8007030 con 0x7f45a4004500 2022-01-10T01:33:43.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.049+0000 7f45b67fc700 1 -- 172.21.15.36:0/117626063 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45a8007390 con 0x7f45a4004500 2022-01-10T01:33:43.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 -- 172.21.15.36:0/117626063 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45a4004500 msgr2=0x7f45a4004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:43.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 --2- 172.21.15.36:0/117626063 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45a4004500 0x7f45a4004980 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f45a8001110 tx=0x7f45a80079c0).stop 2022-01-10T01:33:43.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 -- 172.21.15.36:0/117626063 shutdown_connections 2022-01-10T01:33:43.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 --2- 172.21.15.36:0/117626063 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45a4004500 0x7f45a4004980 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 -- 172.21.15.36:0/117626063 >> 172.21.15.36:0/117626063 conn(0x7f45b8060180 msgr2=0x7f45b80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:43.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 -- 172.21.15.36:0/117626063 shutdown_connections 2022-01-10T01:33:43.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 -- 172.21.15.36:0/117626063 wait complete. 2022-01-10T01:33:43.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 Processor -- start 2022-01-10T01:33:43.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 -- start start 2022-01-10T01:33:43.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45a4004500 0x7f45b8065c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:43.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45b80664b0 0x7f45b80ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:43.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45b8156a80 0x7f45b8156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:43.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b815a600 con 0x7f45b8156a80 2022-01-10T01:33:43.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b815a8a0 con 0x7f45b80664b0 2022-01-10T01:33:43.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45bcd80700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b8063000 con 0x7f45a4004500 2022-01-10T01:33:43.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45b7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45b8156a80 0x7f45b8156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:43.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45b7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45b8156a80 0x7f45b8156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42460/0 (socket says 172.21.15.36:42460) 2022-01-10T01:33:43.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45b7fff700 1 -- 172.21.15.36:0/2519939886 learned_addr learned my addr 172.21.15.36:0/2519939886 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:43.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45b77fe700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45a4004500 0x7f45b8065c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:43.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45b6ffd700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45b80664b0 0x7f45b80ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:43.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45b6ffd700 1 -- 172.21.15.36:0/2519939886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45a4004500 msgr2=0x7f45b8065c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:43.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45b6ffd700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45a4004500 0x7f45b8065c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45b6ffd700 1 -- 172.21.15.36:0/2519939886 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45b8156a80 msgr2=0x7f45b8156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:43.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45b6ffd700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45b8156a80 0x7f45b8156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45b6ffd700 1 -- 172.21.15.36:0/2519939886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b8066180 con 0x7f45b80664b0 2022-01-10T01:33:43.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.053+0000 7f45b7fff700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45b8156a80 0x7f45b8156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:43.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.057+0000 7f45b6ffd700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45b80664b0 0x7f45b80ab2e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f45a8001110 tx=0x7f45a8015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:43.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.057+0000 7f45b4ff9700 1 -- 172.21.15.36:0/2519939886 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45a8020670 con 0x7f45b80664b0 2022-01-10T01:33:43.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.057+0000 7f45b4ff9700 1 -- 172.21.15.36:0/2519939886 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a80207d0 con 0x7f45b80664b0 2022-01-10T01:33:43.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.057+0000 7f45bcd80700 1 -- 172.21.15.36:0/2519939886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b80634a0 con 0x7f45b80664b0 2022-01-10T01:33:43.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.057+0000 7f45b4ff9700 1 -- 172.21.15.36:0/2519939886 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45a8020b30 con 0x7f45b80664b0 2022-01-10T01:33:43.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.057+0000 7f45bcd80700 1 -- 172.21.15.36:0/2519939886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b8156510 con 0x7f45b80664b0 2022-01-10T01:33:43.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.057+0000 7f45bcd80700 1 -- 172.21.15.36:0/2519939886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b80ac3c0 con 0x7f45b80664b0 2022-01-10T01:33:43.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.057+0000 7f45b4ff9700 1 -- 172.21.15.36:0/2519939886 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f45a8010070 con 0x7f45b80664b0 2022-01-10T01:33:43.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.057+0000 7f45b4ff9700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f45980536b0 0x7f4598055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:43.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.057+0000 7f45b4ff9700 1 -- 172.21.15.36:0/2519939886 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f45a806c630 con 0x7f45b80664b0 2022-01-10T01:33:43.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.057+0000 7f45b77fe700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f45980536b0 0x7f4598055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:43.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.061+0000 7f45b77fe700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f45980536b0 0x7f4598055b70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f45ac00b000 tx=0x7f45ac008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:43.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.069+0000 7f45b4ff9700 1 -- 172.21.15.36:0/2519939886 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f45b80ac3c0 con 0x7f45b80664b0 2022-01-10T01:33:43.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.233+0000 7f45bcd80700 1 -- 172.21.15.36:0/2519939886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45b80ac3c0 con 0x7f45b80664b0 2022-01-10T01:33:43.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.233+0000 7f45b4ff9700 1 -- 172.21.15.36:0/2519939886 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f45b80ac3c0 con 0x7f45b80664b0 2022-01-10T01:33:43.241 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:43.241 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":74,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/967641645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":967641645},{"type":"v1","addr":"172.21.15.36:6835","nonce":967641645}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/109014568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":109014568},{"type":"v1","addr":"172.21.15.36:6837","nonce":109014568}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:40.529600+0000","modified":"2022-01-10T01:33:41.697488+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8409},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8409":{"gid":8409,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/138807571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":138807571},{"type":"v1","addr":"172.21.15.59:6833","nonce":138807571}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2022-01-10T01:33:43.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.237+0000 7f45bcd80700 1 -- 172.21.15.36:0/2519939886 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f45980536b0 msgr2=0x7f4598055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:43.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.237+0000 7f45bcd80700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f45980536b0 0x7f4598055b70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f45ac00b000 tx=0x7f45ac008040).stop 2022-01-10T01:33:43.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.237+0000 7f45bcd80700 1 -- 172.21.15.36:0/2519939886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45b80664b0 msgr2=0x7f45b80ab2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:43.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.237+0000 7f45bcd80700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45b80664b0 0x7f45b80ab2e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f45a8001110 tx=0x7f45a8015000).stop 2022-01-10T01:33:43.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.237+0000 7f45bcd80700 1 -- 172.21.15.36:0/2519939886 shutdown_connections 2022-01-10T01:33:43.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.237+0000 7f45bcd80700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f45980536b0 0x7f4598055b70 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.237+0000 7f45bcd80700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f45b8156a80 0x7f45b8156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.237+0000 7f45bcd80700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45b80664b0 0x7f45b80ab2e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.237+0000 7f45bcd80700 1 --2- 172.21.15.36:0/2519939886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45a4004500 0x7f45b8065c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.237+0000 7f45bcd80700 1 -- 172.21.15.36:0/2519939886 >> 172.21.15.36:0/2519939886 conn(0x7f45b8060180 msgr2=0x7f45b80ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:43.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.237+0000 7f45bcd80700 1 -- 172.21.15.36:0/2519939886 shutdown_connections 2022-01-10T01:33:43.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.237+0000 7f45bcd80700 1 -- 172.21.15.36:0/2519939886 wait complete. 2022-01-10T01:33:43.246 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 74 2022-01-10T01:33:43.556 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:33:40.529600+0000', 'modified': '2022-01-10T01:33:41.697488+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8409}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8409': {'gid': 8409, 'name': 'b', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/138807571', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 138807571}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 138807571}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:33:43.556 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:33:43.557 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:33:43.673 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":8409,"want_state":"up:active","state":"up:active","rank_uptime":3.1294489790000002,"mdsmap_epoch":74,"osdmap_epoch":148,"osdmap_epoch_barrier":148,"uptime":7.4178940799999999} 2022-01-10T01:33:43.673 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 8409, "mdsmap_epoch": 74, "osdmap_epoch": 148, "osdmap_epoch_barrier": 148, "rank_uptime": 3.129448979, "state": "up:active", "uptime": 7.41789408, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:33:43.674 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:33:43.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.781+0000 7fe787fff700 1 Processor -- start 2022-01-10T01:33:43.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.781+0000 7fe787fff700 1 -- start start 2022-01-10T01:33:43.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe787fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880b0010 0x7fe7880a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:43.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe787fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe7880afbd0 0x7fe7880a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:43.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe787fff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7880a70c0 con 0x7fe7880b2580 2022-01-10T01:33:43.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe787fff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7880a72f0 con 0x7fe7880afbd0 2022-01-10T01:33:43.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe787fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880a7590 con 0x7fe7880b0010 2022-01-10T01:33:43.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe7877fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe7880afbd0 0x7fe7880a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:43.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe786ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fe7880b2580 0x7fe78814ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40260/0 (socket says 172.21.15.36:40260) 2022-01-10T01:33:43.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe786ffd700 1 -- 172.21.15.36:0/2503149174 learned_addr learned my addr 172.21.15.36:0/2503149174 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:43.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe7867fc700 1 --2- 172.21.15.36:0/2503149174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880b0010 0x7fe7880a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:43.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe7877fe700 1 -- 172.21.15.36:0/2503149174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880b0010 msgr2=0x7fe7880a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:43.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe7877fe700 1 --2- 172.21.15.36:0/2503149174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880b0010 0x7fe7880a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe7877fe700 1 -- 172.21.15.36:0/2503149174 >> v1:172.21.15.36:6789/0 conn(0x7fe7880b2580 legacy=0x7fe78814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:43.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe785ffb700 1 -- 172.21.15.36:0/2503149174 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1081624302 0 0) 0x7fe7880a70c0 con 0x7fe7880b2580 2022-01-10T01:33:43.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe7877fe700 1 -- 172.21.15.36:0/2503149174 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7880a7830 con 0x7fe7880afbd0 2022-01-10T01:33:43.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe7877fe700 1 --2- 172.21.15.36:0/2503149174 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7880afbd0 0x7fe7880a88a0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fe780002f70 tx=0x7fe780006df0).ready entity=mon.0 client_cookie=6ba959abc7d864c0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:43.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe785ffb700 1 -- 172.21.15.36:0/2503149174 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe78000d570 con 0x7fe7880afbd0 2022-01-10T01:33:43.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe785ffb700 1 -- 172.21.15.36:0/2503149174 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe780000e90 con 0x7fe7880afbd0 2022-01-10T01:33:43.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe785ffb700 1 -- 172.21.15.36:0/2503149174 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe78000d8c0 con 0x7fe7880afbd0 2022-01-10T01:33:43.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe787fff700 1 -- 172.21.15.36:0/2503149174 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7880afbd0 msgr2=0x7fe7880a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:43.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe787fff700 1 --2- 172.21.15.36:0/2503149174 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7880afbd0 0x7fe7880a88a0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fe780002f70 tx=0x7fe780006df0).stop 2022-01-10T01:33:43.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe787fff700 1 -- 172.21.15.36:0/2503149174 shutdown_connections 2022-01-10T01:33:43.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe787fff700 1 --2- 172.21.15.36:0/2503149174 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7880afbd0 0x7fe7880a88a0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe787fff700 1 --2- 172.21.15.36:0/2503149174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880b0010 0x7fe7880a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe787fff700 1 -- 172.21.15.36:0/2503149174 >> 172.21.15.36:0/2503149174 conn(0x7fe788060180 msgr2=0x7fe7880b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:43.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe787fff700 1 -- 172.21.15.36:0/2503149174 shutdown_connections 2022-01-10T01:33:43.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.785+0000 7fe787fff700 1 -- 172.21.15.36:0/2503149174 wait complete. 2022-01-10T01:33:43.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.789+0000 7fe787fff700 1 Processor -- start 2022-01-10T01:33:43.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.789+0000 7fe787fff700 1 -- start start 2022-01-10T01:33:43.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.789+0000 7fe787fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7880afbd0 0x7fe78814cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:43.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.789+0000 7fe787fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7880b0010 0x7fe7880ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:43.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.789+0000 7fe787fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880b2580 0x7fe7880ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:43.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.789+0000 7fe787fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78805c730 con 0x7fe7880afbd0 2022-01-10T01:33:43.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.789+0000 7fe787fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880a9dd0 con 0x7fe7880b0010 2022-01-10T01:33:43.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.789+0000 7fe787fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880aa070 con 0x7fe7880b2580 2022-01-10T01:33:43.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.789+0000 7fe786ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7880afbd0 0x7fe78814cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:43.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.789+0000 7fe786ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7880afbd0 0x7fe78814cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42470/0 (socket says 172.21.15.36:42470) 2022-01-10T01:33:43.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.789+0000 7fe786ffd700 1 -- 172.21.15.36:0/3315772270 learned_addr learned my addr 172.21.15.36:0/3315772270 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:43.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.789+0000 7fe7867fc700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7880b0010 0x7fe7880ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:43.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe7877fe700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880b2580 0x7fe7880ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:43.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe786ffd700 1 -- 172.21.15.36:0/3315772270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880b2580 msgr2=0x7fe7880ab800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:43.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe786ffd700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880b2580 0x7fe7880ab800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe786ffd700 1 -- 172.21.15.36:0/3315772270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7880b0010 msgr2=0x7fe7880ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:43.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe786ffd700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7880b0010 0x7fe7880ab310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe786ffd700 1 -- 172.21.15.36:0/3315772270 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78000b180 con 0x7fe7880afbd0 2022-01-10T01:33:43.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe7877fe700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880b2580 0x7fe7880ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:33:43.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe7867fc700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7880b0010 0x7fe7880ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:43.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe786ffd700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7880afbd0 0x7fe78814cdd0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7fe77c000ed0 tx=0x7fe77c007ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:43.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe777fff700 1 -- 172.21.15.36:0/3315772270 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe77c00ce20 con 0x7fe7880afbd0 2022-01-10T01:33:43.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe777fff700 1 -- 172.21.15.36:0/3315772270 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c0072e0 con 0x7fe7880afbd0 2022-01-10T01:33:43.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe787fff700 1 -- 172.21.15.36:0/3315772270 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7880aa310 con 0x7fe7880afbd0 2022-01-10T01:33:43.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe777fff700 1 -- 172.21.15.36:0/3315772270 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe77c005610 con 0x7fe7880afbd0 2022-01-10T01:33:43.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe787fff700 1 -- 172.21.15.36:0/3315772270 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7880b5f10 con 0x7fe7880afbd0 2022-01-10T01:33:43.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe787fff700 1 -- 172.21.15.36:0/3315772270 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe788057350 con 0x7fe7880afbd0 2022-01-10T01:33:43.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe777fff700 1 -- 172.21.15.36:0/3315772270 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe77c01a060 con 0x7fe7880afbd0 2022-01-10T01:33:43.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe777fff700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe764053680 0x7fe764055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:43.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.793+0000 7fe777fff700 1 -- 172.21.15.36:0/3315772270 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe77c06b280 con 0x7fe7880afbd0 2022-01-10T01:33:43.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.797+0000 7fe7867fc700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe764053680 0x7fe764055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:43.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.797+0000 7fe7867fc700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe764053680 0x7fe764055b40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fe77800b000 tx=0x7fe778008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:43.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.801+0000 7fe777fff700 1 -- 172.21.15.36:0/3315772270 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe77c042290 con 0x7fe7880afbd0 2022-01-10T01:33:43.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.929+0000 7fe787fff700 1 -- 172.21.15.36:0/3315772270 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7880698e0 con 0x7fe7880afbd0 2022-01-10T01:33:43.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.929+0000 7fe777fff700 1 -- 172.21.15.36:0/3315772270 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fe77c018020 con 0x7fe7880afbd0 2022-01-10T01:33:43.937 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:43.937 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":148,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:33:40.529449+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:33:39.011334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2022-01-10T01:33:39.792400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:33:43.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.933+0000 7fe787fff700 1 -- 172.21.15.36:0/3315772270 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe764053680 msgr2=0x7fe764055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:43.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.933+0000 7fe787fff700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe764053680 0x7fe764055b40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fe77800b000 tx=0x7fe778008040).stop 2022-01-10T01:33:43.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.933+0000 7fe787fff700 1 -- 172.21.15.36:0/3315772270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7880afbd0 msgr2=0x7fe78814cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:43.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.933+0000 7fe787fff700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7880afbd0 0x7fe78814cdd0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7fe77c000ed0 tx=0x7fe77c007ce0).stop 2022-01-10T01:33:43.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.933+0000 7fe787fff700 1 -- 172.21.15.36:0/3315772270 shutdown_connections 2022-01-10T01:33:43.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.933+0000 7fe787fff700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe764053680 0x7fe764055b40 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.933+0000 7fe787fff700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880b2580 0x7fe7880ab800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.933+0000 7fe787fff700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7880b0010 0x7fe7880ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.933+0000 7fe787fff700 1 --2- 172.21.15.36:0/3315772270 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe7880afbd0 0x7fe78814cdd0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:43.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.933+0000 7fe787fff700 1 -- 172.21.15.36:0/3315772270 >> 172.21.15.36:0/3315772270 conn(0x7fe788060180 msgr2=0x7fe7881454c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:43.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.933+0000 7fe787fff700 1 -- 172.21.15.36:0/3315772270 shutdown_connections 2022-01-10T01:33:43.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:43.933+0000 7fe787fff700 1 -- 172.21.15.36:0/3315772270 wait complete. 2022-01-10T01:33:43.950 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:33:39.011334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:33:39.792400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:33:43.951 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:33:44.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.053+0000 7f2094fee700 1 Processor -- start 2022-01-10T01:33:44.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.053+0000 7f2094fee700 1 -- start start 2022-01-10T01:33:44.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f2094fee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20900b3000 0x7f2090060b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f2094fee700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f20900b25a0 0x7f2090061000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f2094fee700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2090065330 con 0x7f2090066520 2022-01-10T01:33:44.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f2094fee700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2090062000 con 0x7f20900b25a0 2022-01-10T01:33:44.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f2094fee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20900b33e0 con 0x7f20900b3000 2022-01-10T01:33:44.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f208effd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f20900b25a0 0x7f2090061000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f208ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f2090066520 0x7f2090066990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40276/0 (socket says 172.21.15.36:40276) 2022-01-10T01:33:44.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f208ffff700 1 -- 172.21.15.36:0/169847484 learned_addr learned my addr 172.21.15.36:0/169847484 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:44.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f208f7fe700 1 --2- 172.21.15.36:0/169847484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20900b3000 0x7f2090060b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f208e7fc700 1 -- 172.21.15.36:0/169847484 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218381968 0 0) 0x7f2090065330 con 0x7f2090066520 2022-01-10T01:33:44.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f208e7fc700 1 -- 172.21.15.36:0/169847484 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f207c003260 con 0x7f2090066520 2022-01-10T01:33:44.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f208effd700 1 -- 172.21.15.36:0/169847484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20900b3000 msgr2=0x7f2090060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:44.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f208effd700 1 --2- 172.21.15.36:0/169847484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20900b3000 0x7f2090060b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f208effd700 1 -- 172.21.15.36:0/169847484 >> v1:172.21.15.36:6789/0 conn(0x7f2090066520 legacy=0x7f2090066990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f208effd700 1 -- 172.21.15.36:0/169847484 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209005fa60 con 0x7f20900b25a0 2022-01-10T01:33:44.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f208effd700 1 --2- 172.21.15.36:0/169847484 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20900b25a0 0x7f2090061000 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f2084002f70 tx=0x7f2084006df0).ready entity=mon.0 client_cookie=87840fc0403e240c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:44.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f208e7fc700 1 -- 172.21.15.36:0/169847484 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f208400d4a0 con 0x7f20900b25a0 2022-01-10T01:33:44.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f208e7fc700 1 -- 172.21.15.36:0/169847484 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2084000e90 con 0x7f20900b25a0 2022-01-10T01:33:44.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f208e7fc700 1 -- 172.21.15.36:0/169847484 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f208400d7f0 con 0x7f20900b25a0 2022-01-10T01:33:44.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f2094fee700 1 -- 172.21.15.36:0/169847484 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20900b25a0 msgr2=0x7f2090061000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f2094fee700 1 --2- 172.21.15.36:0/169847484 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20900b25a0 0x7f2090061000 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f2084002f70 tx=0x7f2084006df0).stop 2022-01-10T01:33:44.070 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f2094fee700 1 -- 172.21.15.36:0/169847484 shutdown_connections 2022-01-10T01:33:44.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f2094fee700 1 --2- 172.21.15.36:0/169847484 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20900b25a0 0x7f2090061000 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f2094fee700 1 --2- 172.21.15.36:0/169847484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20900b3000 0x7f2090060b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f2094fee700 1 -- 172.21.15.36:0/169847484 >> 172.21.15.36:0/169847484 conn(0x7f20900636e0 msgr2=0x7f2090063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:44.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f2094fee700 1 -- 172.21.15.36:0/169847484 shutdown_connections 2022-01-10T01:33:44.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.057+0000 7f2094fee700 1 -- 172.21.15.36:0/169847484 wait complete. 2022-01-10T01:33:44.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.061+0000 7f2094fee700 1 Processor -- start 2022-01-10T01:33:44.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.061+0000 7f2094fee700 1 -- start start 2022-01-10T01:33:44.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.061+0000 7f2094fee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2090066520 0x7f20900ad570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.061+0000 7f2094fee700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20900b25a0 0x7f20900b0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.061+0000 7f2094fee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20900b3000 0x7f2090152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.061+0000 7f2094fee700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2090156090 con 0x7f20900b25a0 2022-01-10T01:33:44.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f2094fee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20901562c0 con 0x7f2090066520 2022-01-10T01:33:44.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f2094fee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20900ac230 con 0x7f20900b3000 2022-01-10T01:33:44.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f208effd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20900b25a0 0x7f20900b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f208effd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20900b25a0 0x7f20900b0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42486/0 (socket says 172.21.15.36:42486) 2022-01-10T01:33:44.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f208effd700 1 -- 172.21.15.36:0/774436525 learned_addr learned my addr 172.21.15.36:0/774436525 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:44.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f208f7fe700 1 --2- 172.21.15.36:0/774436525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2090066520 0x7f20900ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f208ffff700 1 --2- 172.21.15.36:0/774436525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20900b3000 0x7f2090152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f208effd700 1 -- 172.21.15.36:0/774436525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20900b3000 msgr2=0x7f2090152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f208effd700 1 --2- 172.21.15.36:0/774436525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20900b3000 0x7f2090152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f208effd700 1 -- 172.21.15.36:0/774436525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2090066520 msgr2=0x7f20900ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f208effd700 1 --2- 172.21.15.36:0/774436525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2090066520 0x7f20900ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f208effd700 1 -- 172.21.15.36:0/774436525 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208400b180 con 0x7f20900b25a0 2022-01-10T01:33:44.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f208effd700 1 --2- 172.21.15.36:0/774436525 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20900b25a0 0x7f20900b0140 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f2084002f70 tx=0x7f2084014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:44.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f208cff9700 1 -- 172.21.15.36:0/774436525 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2084016070 con 0x7f20900b25a0 2022-01-10T01:33:44.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f208cff9700 1 -- 172.21.15.36:0/774436525 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20840137d0 con 0x7f20900b25a0 2022-01-10T01:33:44.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f2094fee700 1 -- 172.21.15.36:0/774436525 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20900ac6d0 con 0x7f20900b25a0 2022-01-10T01:33:44.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f208cff9700 1 -- 172.21.15.36:0/774436525 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2084013b30 con 0x7f20900b25a0 2022-01-10T01:33:44.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.065+0000 7f2094fee700 1 -- 172.21.15.36:0/774436525 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20900ac9c0 con 0x7f20900b25a0 2022-01-10T01:33:44.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.069+0000 7f2094fee700 1 -- 172.21.15.36:0/774436525 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f209005fd00 con 0x7f20900b25a0 2022-01-10T01:33:44.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.069+0000 7f208cff9700 1 -- 172.21.15.36:0/774436525 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2084025030 con 0x7f20900b25a0 2022-01-10T01:33:44.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.069+0000 7f208cff9700 1 --2- 172.21.15.36:0/774436525 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f20700536b0 0x7f2070055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.069+0000 7f208cff9700 1 -- 172.21.15.36:0/774436525 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f208406c7a0 con 0x7f20900b25a0 2022-01-10T01:33:44.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.069+0000 7f208f7fe700 1 --2- 172.21.15.36:0/774436525 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f20700536b0 0x7f2070055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.069+0000 7f208f7fe700 1 --2- 172.21.15.36:0/774436525 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f20700536b0 0x7f2070055b70 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f208000b000 tx=0x7f2080006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:44.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.073+0000 7f208cff9700 1 -- 172.21.15.36:0/774436525 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f20840437b0 con 0x7f20900b25a0 2022-01-10T01:33:44.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.197+0000 7f2094fee700 1 -- 172.21.15.36:0/774436525 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2090057350 con 0x7f20900b25a0 2022-01-10T01:33:44.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.197+0000 7f208cff9700 1 -- 172.21.15.36:0/774436525 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v148) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2084046dd0 con 0x7f20900b25a0 2022-01-10T01:33:44.204 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:33:44.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.197+0000 7f2094fee700 1 -- 172.21.15.36:0/774436525 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f20700536b0 msgr2=0x7f2070055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.197+0000 7f2094fee700 1 --2- 172.21.15.36:0/774436525 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f20700536b0 0x7f2070055b70 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f208000b000 tx=0x7f2080006df0).stop 2022-01-10T01:33:44.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.197+0000 7f2094fee700 1 -- 172.21.15.36:0/774436525 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20900b25a0 msgr2=0x7f20900b0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.197+0000 7f2094fee700 1 --2- 172.21.15.36:0/774436525 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20900b25a0 0x7f20900b0140 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f2084002f70 tx=0x7f2084014000).stop 2022-01-10T01:33:44.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.201+0000 7f2094fee700 1 -- 172.21.15.36:0/774436525 shutdown_connections 2022-01-10T01:33:44.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.201+0000 7f2094fee700 1 --2- 172.21.15.36:0/774436525 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f20700536b0 0x7f2070055b70 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.201+0000 7f2094fee700 1 --2- 172.21.15.36:0/774436525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20900b3000 0x7f2090152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.201+0000 7f2094fee700 1 --2- 172.21.15.36:0/774436525 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f20900b25a0 0x7f20900b0140 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.201+0000 7f2094fee700 1 --2- 172.21.15.36:0/774436525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2090066520 0x7f20900ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.201+0000 7f2094fee700 1 -- 172.21.15.36:0/774436525 >> 172.21.15.36:0/774436525 conn(0x7f20900636e0 msgr2=0x7f2090146090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:44.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.201+0000 7f2094fee700 1 -- 172.21.15.36:0/774436525 shutdown_connections 2022-01-10T01:33:44.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.201+0000 7f2094fee700 1 -- 172.21.15.36:0/774436525 wait complete. 2022-01-10T01:33:44.218 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:33:44.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f530ce10700 1 Processor -- start 2022-01-10T01:33:44.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f530ce10700 1 -- start start 2022-01-10T01:33:44.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f530ce10700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f53080a8f60 0x7f53080b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.334 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f530ce10700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53080af120 0x7f53080af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f530ce10700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53080b61f0 con 0x7f53080b0300 2022-01-10T01:33:44.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f530ce10700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53080a8400 con 0x7f53080a8f60 2022-01-10T01:33:44.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f530ce10700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530814b190 con 0x7f53080af120 2022-01-10T01:33:44.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f5307fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53080af120 0x7f53080af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f53077fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f53080a8f60 0x7f53080b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f5307fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53080af120 0x7f53080af590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:48778/0 (socket says 172.21.15.36:48778) 2022-01-10T01:33:44.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f5306ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f53080b0300 0x7f530814aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:57964/0 (socket says 172.21.15.36:57964) 2022-01-10T01:33:44.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f5307fff700 1 -- 172.21.15.36:0/3260766301 learned_addr learned my addr 172.21.15.36:0/3260766301 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:44.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f53077fe700 1 -- 172.21.15.36:0/3260766301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53080af120 msgr2=0x7f53080af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:44.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f53077fe700 1 --2- 172.21.15.36:0/3260766301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53080af120 0x7f53080af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f53077fe700 1 -- 172.21.15.36:0/3260766301 >> v1:172.21.15.59:6789/0 conn(0x7f53080b0300 legacy=0x7f530814aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f53067fc700 1 -- 172.21.15.36:0/3260766301 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647212245 0 0) 0x7f53080b61f0 con 0x7f53080b0300 2022-01-10T01:33:44.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f53077fe700 1 -- 172.21.15.36:0/3260766301 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080a9340 con 0x7f53080a8f60 2022-01-10T01:33:44.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.325+0000 7f53077fe700 1 --2- 172.21.15.36:0/3260766301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53080a8f60 0x7f53080b1aa0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f52f8002f70 tx=0x7f52f8006df0).ready entity=mon.1 client_cookie=3c8f58b25bd3bc84 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:44.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.329+0000 7f53067fc700 1 -- 172.21.15.36:0/3260766301 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52f800d570 con 0x7f53080a8f60 2022-01-10T01:33:44.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.329+0000 7f53067fc700 1 -- 172.21.15.36:0/3260766301 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f8000e90 con 0x7f53080a8f60 2022-01-10T01:33:44.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.329+0000 7f53067fc700 1 -- 172.21.15.36:0/3260766301 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52f800d8c0 con 0x7f53080a8f60 2022-01-10T01:33:44.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.329+0000 7f530ce10700 1 -- 172.21.15.36:0/3260766301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53080a8f60 msgr2=0x7f53080b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.329+0000 7f530ce10700 1 --2- 172.21.15.36:0/3260766301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53080a8f60 0x7f53080b1aa0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f52f8002f70 tx=0x7f52f8006df0).stop 2022-01-10T01:33:44.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.329+0000 7f530ce10700 1 -- 172.21.15.36:0/3260766301 shutdown_connections 2022-01-10T01:33:44.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.329+0000 7f530ce10700 1 --2- 172.21.15.36:0/3260766301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53080af120 0x7f53080af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.329+0000 7f530ce10700 1 --2- 172.21.15.36:0/3260766301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53080a8f60 0x7f53080b1aa0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.329+0000 7f530ce10700 1 -- 172.21.15.36:0/3260766301 >> 172.21.15.36:0/3260766301 conn(0x7f530805c490 msgr2=0x7f530805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:44.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.329+0000 7f530ce10700 1 -- 172.21.15.36:0/3260766301 shutdown_connections 2022-01-10T01:33:44.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.329+0000 7f530ce10700 1 -- 172.21.15.36:0/3260766301 wait complete. 2022-01-10T01:33:44.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.329+0000 7f530ce10700 1 Processor -- start 2022-01-10T01:33:44.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.329+0000 7f530ce10700 1 -- start start 2022-01-10T01:33:44.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f530ce10700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53080a8f60 0x7f53080a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f530ce10700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53080af120 0x7f53080aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f530ce10700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f53080b0300 0x7f53080ab300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f530ce10700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5308156db0 con 0x7f53080b0300 2022-01-10T01:33:44.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f530ce10700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5308157050 con 0x7f53080a8f60 2022-01-10T01:33:44.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f530ce10700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53081572f0 con 0x7f53080af120 2022-01-10T01:33:44.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f5307fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f53080b0300 0x7f53080ab300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f5307fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f53080b0300 0x7f53080ab300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42502/0 (socket says 172.21.15.36:42502) 2022-01-10T01:33:44.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f5307fff700 1 -- 172.21.15.36:0/928069707 learned_addr learned my addr 172.21.15.36:0/928069707 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:44.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f53077fe700 1 --2- 172.21.15.36:0/928069707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53080a8f60 0x7f53080a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f5306ffd700 1 --2- 172.21.15.36:0/928069707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53080af120 0x7f53080aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f5307fff700 1 -- 172.21.15.36:0/928069707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53080af120 msgr2=0x7f53080aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f5307fff700 1 --2- 172.21.15.36:0/928069707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53080af120 0x7f53080aa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f5307fff700 1 -- 172.21.15.36:0/928069707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53080a8f60 msgr2=0x7f53080a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f5307fff700 1 --2- 172.21.15.36:0/928069707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53080a8f60 0x7f53080a9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f5307fff700 1 -- 172.21.15.36:0/928069707 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f800b180 con 0x7f53080b0300 2022-01-10T01:33:44.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f5307fff700 1 --2- 172.21.15.36:0/928069707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f53080b0300 0x7f53080ab300 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f530000c000 tx=0x7f5300009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:44.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f5304ff9700 1 -- 172.21.15.36:0/928069707 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f530000c6a0 con 0x7f53080b0300 2022-01-10T01:33:44.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f5304ff9700 1 -- 172.21.15.36:0/928069707 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530000c800 con 0x7f53080b0300 2022-01-10T01:33:44.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f5304ff9700 1 -- 172.21.15.36:0/928069707 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f530000cb60 con 0x7f53080b0300 2022-01-10T01:33:44.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f530ce10700 1 -- 172.21.15.36:0/928069707 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5308157590 con 0x7f53080b0300 2022-01-10T01:33:44.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.333+0000 7f530ce10700 1 -- 172.21.15.36:0/928069707 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5308157a30 con 0x7f53080b0300 2022-01-10T01:33:44.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.337+0000 7f530ce10700 1 -- 172.21.15.36:0/928069707 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5308157720 con 0x7f53080b0300 2022-01-10T01:33:44.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.337+0000 7f5304ff9700 1 -- 172.21.15.36:0/928069707 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5300022070 con 0x7f53080b0300 2022-01-10T01:33:44.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.337+0000 7f5304ff9700 1 --2- 172.21.15.36:0/928069707 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f52e80534d0 0x7f52e8055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.337+0000 7f53077fe700 1 --2- 172.21.15.36:0/928069707 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f52e80534d0 0x7f52e8055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.337+0000 7f5304ff9700 1 -- 172.21.15.36:0/928069707 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f530006c1e0 con 0x7f53080b0300 2022-01-10T01:33:44.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.337+0000 7f53077fe700 1 --2- 172.21.15.36:0/928069707 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f52e80534d0 0x7f52e8055990 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f52f801a000 tx=0x7f52f8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:44.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.345+0000 7f5304ff9700 1 -- 172.21.15.36:0/928069707 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f53000430e0 con 0x7f53080b0300 2022-01-10T01:33:44.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.465+0000 7f530ce10700 1 -- 172.21.15.36:0/928069707 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f53080a7830 con 0x7f53080b0300 2022-01-10T01:33:44.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.465+0000 7f5304ff9700 1 -- 172.21.15.36:0/928069707 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v148) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5300016020 con 0x7f53080b0300 2022-01-10T01:33:44.474 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:44.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.469+0000 7f530ce10700 1 -- 172.21.15.36:0/928069707 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f52e80534d0 msgr2=0x7f52e8055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.469+0000 7f530ce10700 1 --2- 172.21.15.36:0/928069707 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f52e80534d0 0x7f52e8055990 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f52f801a000 tx=0x7f52f8014000).stop 2022-01-10T01:33:44.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.469+0000 7f530ce10700 1 -- 172.21.15.36:0/928069707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f53080b0300 msgr2=0x7f53080ab300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.469+0000 7f530ce10700 1 --2- 172.21.15.36:0/928069707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f53080b0300 0x7f53080ab300 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f530000c000 tx=0x7f5300009290).stop 2022-01-10T01:33:44.476 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.469+0000 7f530ce10700 1 -- 172.21.15.36:0/928069707 shutdown_connections 2022-01-10T01:33:44.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.469+0000 7f530ce10700 1 --2- 172.21.15.36:0/928069707 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f52e80534d0 0x7f52e8055990 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.469+0000 7f530ce10700 1 --2- 172.21.15.36:0/928069707 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f53080b0300 0x7f53080ab300 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.469+0000 7f530ce10700 1 --2- 172.21.15.36:0/928069707 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53080af120 0x7f53080aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.469+0000 7f530ce10700 1 --2- 172.21.15.36:0/928069707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53080a8f60 0x7f53080a9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.477 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.469+0000 7f530ce10700 1 -- 172.21.15.36:0/928069707 >> 172.21.15.36:0/928069707 conn(0x7f530805c490 msgr2=0x7f530814b340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:44.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.469+0000 7f530ce10700 1 -- 172.21.15.36:0/928069707 shutdown_connections 2022-01-10T01:33:44.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.469+0000 7f530ce10700 1 -- 172.21.15.36:0/928069707 wait complete. 2022-01-10T01:33:44.487 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:33:44.594 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d8f8d700 1 Processor -- start 2022-01-10T01:33:44.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d8f8d700 1 -- start start 2022-01-10T01:33:44.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d8f8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d40b0010 0x7f57d40a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d8f8d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f57d40afbd0 0x7f57d40a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d8f8d700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d40a70c0 con 0x7f57d40b2580 2022-01-10T01:33:44.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d8f8d700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d40a72f0 con 0x7f57d40afbd0 2022-01-10T01:33:44.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d8f8d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d40a7590 con 0x7f57d40b0010 2022-01-10T01:33:44.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d37fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f57d40b2580 0x7f57d414ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40300/0 (socket says 172.21.15.36:40300) 2022-01-10T01:33:44.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d37fe700 1 -- 172.21.15.36:0/1617909084 learned_addr learned my addr 172.21.15.36:0/1617909084 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:44.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d3fff700 1 --2- 172.21.15.36:0/1617909084 >> v2:172.21.15.36:3300/0 conn(0x7f57d40afbd0 0x7f57d40a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d2ffd700 1 --2- 172.21.15.36:0/1617909084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d40b0010 0x7f57d40a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d27fc700 1 -- 172.21.15.36:0/1617909084 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2303807932 0 0) 0x7f57d40a70c0 con 0x7f57d40b2580 2022-01-10T01:33:44.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d27fc700 1 -- 172.21.15.36:0/1617909084 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57c0003260 con 0x7f57d40b2580 2022-01-10T01:33:44.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d3fff700 1 -- 172.21.15.36:0/1617909084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d40b0010 msgr2=0x7f57d40a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:44.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d3fff700 1 --2- 172.21.15.36:0/1617909084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d40b0010 0x7f57d40a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d3fff700 1 -- 172.21.15.36:0/1617909084 >> v1:172.21.15.36:6789/0 conn(0x7f57d40b2580 legacy=0x7f57d414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d3fff700 1 -- 172.21.15.36:0/1617909084 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d40a7830 con 0x7f57d40afbd0 2022-01-10T01:33:44.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d2ffd700 1 --2- 172.21.15.36:0/1617909084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d40b0010 0x7f57d40a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:44.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d3fff700 1 --2- 172.21.15.36:0/1617909084 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57d40afbd0 0x7f57d40a88a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f57cc0032f0 tx=0x7f57cc0091d0).ready entity=mon.0 client_cookie=c2e8678b442d6798 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:44.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d27fc700 1 -- 172.21.15.36:0/1617909084 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57cc00b6c0 con 0x7f57d40afbd0 2022-01-10T01:33:44.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d27fc700 1 -- 172.21.15.36:0/1617909084 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc00b820 con 0x7f57d40afbd0 2022-01-10T01:33:44.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d27fc700 1 -- 172.21.15.36:0/1617909084 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57cc00b990 con 0x7f57d40afbd0 2022-01-10T01:33:44.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d8f8d700 1 -- 172.21.15.36:0/1617909084 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57d40afbd0 msgr2=0x7f57d40a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d8f8d700 1 --2- 172.21.15.36:0/1617909084 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57d40afbd0 0x7f57d40a88a0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f57cc0032f0 tx=0x7f57cc0091d0).stop 2022-01-10T01:33:44.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d8f8d700 1 -- 172.21.15.36:0/1617909084 shutdown_connections 2022-01-10T01:33:44.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d8f8d700 1 --2- 172.21.15.36:0/1617909084 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57d40afbd0 0x7f57d40a88a0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d8f8d700 1 --2- 172.21.15.36:0/1617909084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d40b0010 0x7f57d40a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d8f8d700 1 -- 172.21.15.36:0/1617909084 >> 172.21.15.36:0/1617909084 conn(0x7f57d4060180 msgr2=0x7f57d40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:44.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.589+0000 7f57d8f8d700 1 -- 172.21.15.36:0/1617909084 shutdown_connections 2022-01-10T01:33:44.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d8f8d700 1 -- 172.21.15.36:0/1617909084 wait complete. 2022-01-10T01:33:44.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d8f8d700 1 Processor -- start 2022-01-10T01:33:44.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d8f8d700 1 -- start start 2022-01-10T01:33:44.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d8f8d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57d40afbd0 0x7f57d4143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d8f8d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d40b0010 0x7f57d415a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d8f8d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d40b2580 0x7f57d40aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d8f8d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d4159cc0 con 0x7f57d40afbd0 2022-01-10T01:33:44.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d8f8d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d40abe30 con 0x7f57d40b2580 2022-01-10T01:33:44.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d8f8d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d4159ef0 con 0x7f57d40b0010 2022-01-10T01:33:44.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d37fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57d40afbd0 0x7f57d4143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d37fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57d40afbd0 0x7f57d4143f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42512/0 (socket says 172.21.15.36:42512) 2022-01-10T01:33:44.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d37fe700 1 -- 172.21.15.36:0/3073639900 learned_addr learned my addr 172.21.15.36:0/3073639900 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:44.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d3fff700 1 --2- 172.21.15.36:0/3073639900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d40b2580 0x7f57d40aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d2ffd700 1 --2- 172.21.15.36:0/3073639900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d40b0010 0x7f57d415a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d37fe700 1 -- 172.21.15.36:0/3073639900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d40b0010 msgr2=0x7f57d415a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d37fe700 1 --2- 172.21.15.36:0/3073639900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d40b0010 0x7f57d415a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d37fe700 1 -- 172.21.15.36:0/3073639900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d40b2580 msgr2=0x7f57d40aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d37fe700 1 --2- 172.21.15.36:0/3073639900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d40b2580 0x7f57d40aa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d37fe700 1 -- 172.21.15.36:0/3073639900 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc009470 con 0x7f57d40afbd0 2022-01-10T01:33:44.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d37fe700 1 --2- 172.21.15.36:0/3073639900 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57d40afbd0 0x7f57d4143f20 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f57c4001110 tx=0x7f57c4007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:44.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d0ff9700 1 -- 172.21.15.36:0/3073639900 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57c40070d0 con 0x7f57d40afbd0 2022-01-10T01:33:44.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d0ff9700 1 -- 172.21.15.36:0/3073639900 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c4007230 con 0x7f57d40afbd0 2022-01-10T01:33:44.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d8f8d700 1 -- 172.21.15.36:0/3073639900 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d40ac0d0 con 0x7f57d40afbd0 2022-01-10T01:33:44.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d0ff9700 1 -- 172.21.15.36:0/3073639900 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57c4005610 con 0x7f57d40afbd0 2022-01-10T01:33:44.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.593+0000 7f57d8f8d700 1 -- 172.21.15.36:0/3073639900 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d414a550 con 0x7f57d40afbd0 2022-01-10T01:33:44.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.597+0000 7f57d8f8d700 1 -- 172.21.15.36:0/3073639900 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d4057350 con 0x7f57d40afbd0 2022-01-10T01:33:44.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.597+0000 7f57d0ff9700 1 -- 172.21.15.36:0/3073639900 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f57c401a070 con 0x7f57d40afbd0 2022-01-10T01:33:44.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.597+0000 7f57d0ff9700 1 --2- 172.21.15.36:0/3073639900 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f57b4053680 0x7f57b4055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.597+0000 7f57d0ff9700 1 -- 172.21.15.36:0/3073639900 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f57c406ab70 con 0x7f57d40afbd0 2022-01-10T01:33:44.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.597+0000 7f57d2ffd700 1 --2- 172.21.15.36:0/3073639900 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f57b4053680 0x7f57b4055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.597+0000 7f57d2ffd700 1 --2- 172.21.15.36:0/3073639900 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f57b4053680 0x7f57b4055b40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f57c800c000 tx=0x7f57c8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:44.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.601+0000 7f57d0ff9700 1 -- 172.21.15.36:0/3073639900 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f57c4041a70 con 0x7f57d40afbd0 2022-01-10T01:33:44.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.725+0000 7f57d8f8d700 1 -- 172.21.15.36:0/3073639900 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57d40af0e0 con 0x7f57d40afbd0 2022-01-10T01:33:44.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.725+0000 7f57d0ff9700 1 -- 172.21.15.36:0/3073639900 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v148) v1 ==== 104+0+10 (secure 0 0 0) 0x7f57c4045090 con 0x7f57d40afbd0 2022-01-10T01:33:44.732 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:44.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.725+0000 7f57d8f8d700 1 -- 172.21.15.36:0/3073639900 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f57b4053680 msgr2=0x7f57b4055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.725+0000 7f57d8f8d700 1 --2- 172.21.15.36:0/3073639900 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f57b4053680 0x7f57b4055b40 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f57c800c000 tx=0x7f57c8008040).stop 2022-01-10T01:33:44.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.725+0000 7f57d8f8d700 1 -- 172.21.15.36:0/3073639900 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57d40afbd0 msgr2=0x7f57d4143f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.725+0000 7f57d8f8d700 1 --2- 172.21.15.36:0/3073639900 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57d40afbd0 0x7f57d4143f20 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f57c4001110 tx=0x7f57c4007aa0).stop 2022-01-10T01:33:44.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.725+0000 7f57d8f8d700 1 -- 172.21.15.36:0/3073639900 shutdown_connections 2022-01-10T01:33:44.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.725+0000 7f57d8f8d700 1 --2- 172.21.15.36:0/3073639900 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f57b4053680 0x7f57b4055b40 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.725+0000 7f57d8f8d700 1 --2- 172.21.15.36:0/3073639900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57d40b2580 0x7f57d40aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.725+0000 7f57d8f8d700 1 --2- 172.21.15.36:0/3073639900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57d40b0010 0x7f57d415a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.725+0000 7f57d8f8d700 1 --2- 172.21.15.36:0/3073639900 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57d40afbd0 0x7f57d4143f20 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.725+0000 7f57d8f8d700 1 -- 172.21.15.36:0/3073639900 >> 172.21.15.36:0/3073639900 conn(0x7f57d4060180 msgr2=0x7f57d41486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:44.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.725+0000 7f57d8f8d700 1 -- 172.21.15.36:0/3073639900 shutdown_connections 2022-01-10T01:33:44.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.725+0000 7f57d8f8d700 1 -- 172.21.15.36:0/3073639900 wait complete. 2022-01-10T01:33:44.744 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:33:44.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.841+0000 7fb43dcab700 1 Processor -- start 2022-01-10T01:33:44.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.841+0000 7fb43dcab700 1 -- start start 2022-01-10T01:33:44.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.841+0000 7fb43dcab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4380b25a0 0x7fb438066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.841+0000 7fb43dcab700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb438066a10 0x7fb43814d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.841+0000 7fb43dcab700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb438065330 con 0x7fb4380b3000 2022-01-10T01:33:44.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.841+0000 7fb43dcab700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb438062000 con 0x7fb438066a10 2022-01-10T01:33:44.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.841+0000 7fb43dcab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380b33e0 con 0x7fb4380b25a0 2022-01-10T01:33:44.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.841+0000 7fb43d4aa700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb438066a10 0x7fb43814d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43d4aa700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb438066a10 0x7fb43814d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42524/0 (socket says 172.21.15.36:42524) 2022-01-10T01:33:44.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43d4aa700 1 -- 172.21.15.36:0/3861281028 learned_addr learned my addr 172.21.15.36:0/3861281028 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:44.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb437fff700 1 --2- 172.21.15.36:0/3861281028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4380b25a0 0x7fb438066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43d4aa700 1 -- 172.21.15.36:0/3861281028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4380b25a0 msgr2=0x7fb438066520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:44.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43d4aa700 1 --2- 172.21.15.36:0/3861281028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4380b25a0 0x7fb438066520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43d4aa700 1 -- 172.21.15.36:0/3861281028 >> v1:172.21.15.59:6789/0 conn(0x7fb4380b3000 legacy=0x7fb438060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43d4aa700 1 -- 172.21.15.36:0/3861281028 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43805fa60 con 0x7fb438066a10 2022-01-10T01:33:44.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43d4aa700 1 --2- 172.21.15.36:0/3861281028 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb438066a10 0x7fb43814d920 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7fb4300032f0 tx=0x7fb430009290).ready entity=mon.0 client_cookie=e80b0bc1ba392a96 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:44.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb4377fe700 1 -- 172.21.15.36:0/3861281028 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43000b8a0 con 0x7fb438066a10 2022-01-10T01:33:44.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb4377fe700 1 -- 172.21.15.36:0/3861281028 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43000ba00 con 0x7fb438066a10 2022-01-10T01:33:44.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb4377fe700 1 -- 172.21.15.36:0/3861281028 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43000bb70 con 0x7fb438066a10 2022-01-10T01:33:44.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43dcab700 1 -- 172.21.15.36:0/3861281028 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb438066a10 msgr2=0x7fb43814d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43dcab700 1 --2- 172.21.15.36:0/3861281028 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb438066a10 0x7fb43814d920 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7fb4300032f0 tx=0x7fb430009290).stop 2022-01-10T01:33:44.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43dcab700 1 -- 172.21.15.36:0/3861281028 shutdown_connections 2022-01-10T01:33:44.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43dcab700 1 --2- 172.21.15.36:0/3861281028 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb438066a10 0x7fb43814d920 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43dcab700 1 --2- 172.21.15.36:0/3861281028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4380b25a0 0x7fb438066520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43dcab700 1 -- 172.21.15.36:0/3861281028 >> 172.21.15.36:0/3861281028 conn(0x7fb4380636e0 msgr2=0x7fb438063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:44.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43dcab700 1 -- 172.21.15.36:0/3861281028 shutdown_connections 2022-01-10T01:33:44.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43dcab700 1 -- 172.21.15.36:0/3861281028 wait complete. 2022-01-10T01:33:44.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.845+0000 7fb43dcab700 1 Processor -- start 2022-01-10T01:33:44.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43dcab700 1 -- start start 2022-01-10T01:33:44.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43dcab700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb438066a10 0x7fb438152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43dcab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4380b25a0 0x7fb4380b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43dcab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4380b3000 0x7fb4380ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43dcab700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380ad310 con 0x7fb438066a10 2022-01-10T01:33:44.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43dcab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380a2cc0 con 0x7fb4380b25a0 2022-01-10T01:33:44.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43dcab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4380a2f60 con 0x7fb4380b3000 2022-01-10T01:33:44.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43cca9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb438066a10 0x7fb438152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43cca9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb438066a10 0x7fb438152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42526/0 (socket says 172.21.15.36:42526) 2022-01-10T01:33:44.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43cca9700 1 -- 172.21.15.36:0/1961574462 learned_addr learned my addr 172.21.15.36:0/1961574462 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:44.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb437fff700 1 --2- 172.21.15.36:0/1961574462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4380b25a0 0x7fb4380b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43d4aa700 1 --2- 172.21.15.36:0/1961574462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4380b3000 0x7fb4380ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43cca9700 1 -- 172.21.15.36:0/1961574462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4380b3000 msgr2=0x7fb4380ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43cca9700 1 --2- 172.21.15.36:0/1961574462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4380b3000 0x7fb4380ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43cca9700 1 -- 172.21.15.36:0/1961574462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4380b25a0 msgr2=0x7fb4380b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43cca9700 1 --2- 172.21.15.36:0/1961574462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4380b25a0 0x7fb4380b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43cca9700 1 -- 172.21.15.36:0/1961574462 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb430009530 con 0x7fb438066a10 2022-01-10T01:33:44.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43cca9700 1 --2- 172.21.15.36:0/1961574462 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb438066a10 0x7fb438152ff0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7fb438063350 tx=0x7fb428007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:44.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb435ffb700 1 -- 172.21.15.36:0/1961574462 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb428007030 con 0x7fb438066a10 2022-01-10T01:33:44.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb435ffb700 1 -- 172.21.15.36:0/1961574462 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb428007190 con 0x7fb438066a10 2022-01-10T01:33:44.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43dcab700 1 -- 172.21.15.36:0/1961574462 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4380aea20 con 0x7fb438066a10 2022-01-10T01:33:44.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb435ffb700 1 -- 172.21.15.36:0/1961574462 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb428006510 con 0x7fb438066a10 2022-01-10T01:33:44.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.849+0000 7fb43dcab700 1 -- 172.21.15.36:0/1961574462 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4380ae6d0 con 0x7fb438066a10 2022-01-10T01:33:44.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.853+0000 7fb435ffb700 1 -- 172.21.15.36:0/1961574462 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb428010030 con 0x7fb438066a10 2022-01-10T01:33:44.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.853+0000 7fb43dcab700 1 -- 172.21.15.36:0/1961574462 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43805fd00 con 0x7fb438066a10 2022-01-10T01:33:44.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.853+0000 7fb435ffb700 1 --2- 172.21.15.36:0/1961574462 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb41c0535f0 0x7fb41c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:44.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.853+0000 7fb435ffb700 1 -- 172.21.15.36:0/1961574462 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb42806b720 con 0x7fb438066a10 2022-01-10T01:33:44.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.853+0000 7fb437fff700 1 --2- 172.21.15.36:0/1961574462 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb41c0535f0 0x7fb41c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:44.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.853+0000 7fb437fff700 1 --2- 172.21.15.36:0/1961574462 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb41c0535f0 0x7fb41c055ab0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fb42000b000 tx=0x7fb420006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:44.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.857+0000 7fb435ffb700 1 -- 172.21.15.36:0/1961574462 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb4280460c0 con 0x7fb438066a10 2022-01-10T01:33:44.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.985+0000 7fb43dcab700 1 -- 172.21.15.36:0/1961574462 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb438057350 con 0x7fb438066a10 2022-01-10T01:33:44.994 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.985+0000 7fb435ffb700 1 -- 172.21.15.36:0/1961574462 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v148) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb428045cb0 con 0x7fb438066a10 2022-01-10T01:33:44.995 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:44.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.989+0000 7fb43dcab700 1 -- 172.21.15.36:0/1961574462 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb41c0535f0 msgr2=0x7fb41c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.989+0000 7fb43dcab700 1 --2- 172.21.15.36:0/1961574462 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb41c0535f0 0x7fb41c055ab0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7fb42000b000 tx=0x7fb420006df0).stop 2022-01-10T01:33:44.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.989+0000 7fb43dcab700 1 -- 172.21.15.36:0/1961574462 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb438066a10 msgr2=0x7fb438152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:44.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.989+0000 7fb43dcab700 1 --2- 172.21.15.36:0/1961574462 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb438066a10 0x7fb438152ff0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7fb438063350 tx=0x7fb428007c00).stop 2022-01-10T01:33:44.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.989+0000 7fb43dcab700 1 -- 172.21.15.36:0/1961574462 shutdown_connections 2022-01-10T01:33:44.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.989+0000 7fb43dcab700 1 --2- 172.21.15.36:0/1961574462 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb41c0535f0 0x7fb41c055ab0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.989+0000 7fb43dcab700 1 --2- 172.21.15.36:0/1961574462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4380b3000 0x7fb4380ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.989+0000 7fb43dcab700 1 --2- 172.21.15.36:0/1961574462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4380b25a0 0x7fb4380b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.989+0000 7fb43dcab700 1 --2- 172.21.15.36:0/1961574462 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb438066a10 0x7fb438152ff0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:44.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.989+0000 7fb43dcab700 1 -- 172.21.15.36:0/1961574462 >> 172.21.15.36:0/1961574462 conn(0x7fb4380636e0 msgr2=0x7fb438144ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:44.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.989+0000 7fb43dcab700 1 -- 172.21.15.36:0/1961574462 shutdown_connections 2022-01-10T01:33:44.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:44.989+0000 7fb43dcab700 1 -- 172.21.15.36:0/1961574462 wait complete. 2022-01-10T01:33:45.006 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:33:45.007 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:45.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.101+0000 7f1c45240700 1 Processor -- start 2022-01-10T01:33:45.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.101+0000 7f1c45240700 1 -- start start 2022-01-10T01:33:45.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.101+0000 7f1c45240700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1c400b0010 0x7f1c400a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:45.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.101+0000 7f1c45240700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c400a70c0 con 0x7f1c400afbd0 2022-01-10T01:33:45.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.101+0000 7f1c45240700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c400a72f0 con 0x7f1c400b2580 2022-01-10T01:33:45.113 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.101+0000 7f1c45240700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c400a7590 con 0x7f1c400b0010 2022-01-10T01:33:45.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.101+0000 7f1c3f7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1c400b0010 0x7f1c400a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:45.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.101+0000 7f1c3f7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f1c400b0010 0x7f1c400a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42534/0 (socket says 172.21.15.36:42534) 2022-01-10T01:33:45.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.101+0000 7f1c3f7fe700 1 -- 172.21.15.36:0/3997500044 learned_addr learned my addr 172.21.15.36:0/3997500044 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:45.114 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.105+0000 7f1c3f7fe700 1 -- 172.21.15.36:0/3997500044 >> v1:172.21.15.59:6789/0 conn(0x7f1c400b2580 legacy=0x7f1c4014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:45.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.105+0000 7f1c3f7fe700 1 -- 172.21.15.36:0/3997500044 >> v1:172.21.15.36:6789/0 conn(0x7f1c400afbd0 legacy=0x7f1c40151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:45.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.105+0000 7f1c3f7fe700 1 -- 172.21.15.36:0/3997500044 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c400a7830 con 0x7f1c400b0010 2022-01-10T01:33:45.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.105+0000 7f1c3f7fe700 1 --2- 172.21.15.36:0/3997500044 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1c400b0010 0x7f1c400a83b0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f1c300032f0 tx=0x7f1c30009290).ready entity=mon.0 client_cookie=57a2e7b7b1ab83ae server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:45.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.105+0000 7f1c3effd700 1 -- 172.21.15.36:0/3997500044 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c3000b8a0 con 0x7f1c400b0010 2022-01-10T01:33:45.115 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.105+0000 7f1c3effd700 1 -- 172.21.15.36:0/3997500044 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3000ba00 con 0x7f1c400b0010 2022-01-10T01:33:45.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.105+0000 7f1c3effd700 1 -- 172.21.15.36:0/3997500044 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c3000bb70 con 0x7f1c400b0010 2022-01-10T01:33:45.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.105+0000 7f1c45240700 1 -- 172.21.15.36:0/3997500044 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1c400b0010 msgr2=0x7f1c400a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:45.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.105+0000 7f1c45240700 1 --2- 172.21.15.36:0/3997500044 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1c400b0010 0x7f1c400a83b0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f1c300032f0 tx=0x7f1c30009290).stop 2022-01-10T01:33:45.116 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.105+0000 7f1c45240700 1 -- 172.21.15.36:0/3997500044 shutdown_connections 2022-01-10T01:33:45.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.105+0000 7f1c45240700 1 --2- 172.21.15.36:0/3997500044 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1c400b0010 0x7f1c400a83b0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:45.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.105+0000 7f1c45240700 1 -- 172.21.15.36:0/3997500044 >> 172.21.15.36:0/3997500044 conn(0x7f1c40060180 msgr2=0x7f1c400b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:45.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.105+0000 7f1c45240700 1 -- 172.21.15.36:0/3997500044 shutdown_connections 2022-01-10T01:33:45.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.105+0000 7f1c45240700 1 -- 172.21.15.36:0/3997500044 wait complete. 2022-01-10T01:33:45.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c45240700 1 Processor -- start 2022-01-10T01:33:45.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c45240700 1 -- start start 2022-01-10T01:33:45.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c45240700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c400afbd0 0x7f1c40064010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:45.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c45240700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c400b0010 0x7f1c40064500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:45.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c45240700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1c400b2580 0x7f1c400a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:45.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c45240700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400aa980 con 0x7f1c400b2580 2022-01-10T01:33:45.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c45240700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c40157110 con 0x7f1c400b0010 2022-01-10T01:33:45.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c45240700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400abce0 con 0x7f1c400afbd0 2022-01-10T01:33:45.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c44a3f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1c400b2580 0x7f1c400a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:45.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c44a3f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1c400b2580 0x7f1c400a91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42544/0 (socket says 172.21.15.36:42544) 2022-01-10T01:33:45.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c44a3f700 1 -- 172.21.15.36:0/1356338542 learned_addr learned my addr 172.21.15.36:0/1356338542 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:45.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c3f7fe700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c400b0010 0x7f1c40064500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:45.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c3ffff700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c400afbd0 0x7f1c40064010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:45.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c3f7fe700 1 -- 172.21.15.36:0/1356338542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c400afbd0 msgr2=0x7f1c40064010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:45.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c3f7fe700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c400afbd0 0x7f1c40064010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:45.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c3f7fe700 1 -- 172.21.15.36:0/1356338542 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1c400b2580 msgr2=0x7f1c400a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:45.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c3f7fe700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1c400b2580 0x7f1c400a91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:45.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c3f7fe700 1 -- 172.21.15.36:0/1356338542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c30009530 con 0x7f1c400b0010 2022-01-10T01:33:45.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c44a3f700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1c400b2580 0x7f1c400a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:45.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c3f7fe700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c400b0010 0x7f1c40064500 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f1c40065dc0 tx=0x7f1c30016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:45.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.109+0000 7f1c3d7fa700 1 -- 172.21.15.36:0/1356338542 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c3000bde0 con 0x7f1c400b0010 2022-01-10T01:33:45.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.113+0000 7f1c3d7fa700 1 -- 172.21.15.36:0/1356338542 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3001f3f0 con 0x7f1c400b0010 2022-01-10T01:33:45.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.113+0000 7f1c45240700 1 -- 172.21.15.36:0/1356338542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c400abf80 con 0x7f1c400b0010 2022-01-10T01:33:45.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.113+0000 7f1c3d7fa700 1 -- 172.21.15.36:0/1356338542 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c3001f750 con 0x7f1c400b0010 2022-01-10T01:33:45.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.113+0000 7f1c45240700 1 -- 172.21.15.36:0/1356338542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c400649f0 con 0x7f1c400b0010 2022-01-10T01:33:45.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.113+0000 7f1c45240700 1 -- 172.21.15.36:0/1356338542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c40057350 con 0x7f1c400b0010 2022-01-10T01:33:45.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.113+0000 7f1c3d7fa700 1 -- 172.21.15.36:0/1356338542 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f1c3000f070 con 0x7f1c400b0010 2022-01-10T01:33:45.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.113+0000 7f1c3d7fa700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1c200535f0 0x7f1c20055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:45.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.113+0000 7f1c3d7fa700 1 -- 172.21.15.36:0/1356338542 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f1c3006c480 con 0x7f1c400b0010 2022-01-10T01:33:45.128 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.113+0000 7f1c3ffff700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1c200535f0 0x7f1c20055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:45.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.113+0000 7f1c3ffff700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1c200535f0 0x7f1c20055ab0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f1c3400d000 tx=0x7f1c34007b70).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:45.129 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.121+0000 7f1c3d7fa700 1 -- 172.21.15.36:0/1356338542 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1c300433f0 con 0x7f1c400b0010 2022-01-10T01:33:45.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.285+0000 7f1c45240700 1 -- 172.21.15.36:0/1356338542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c400698e0 con 0x7f1c400b0010 2022-01-10T01:33:45.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.285+0000 7f1c3d7fa700 1 -- 172.21.15.36:0/1356338542 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f1c30024090 con 0x7f1c400b0010 2022-01-10T01:33:45.293 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:45.293 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":74,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/967641645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":967641645},{"type":"v1","addr":"172.21.15.36:6835","nonce":967641645}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/109014568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":109014568},{"type":"v1","addr":"172.21.15.36:6837","nonce":109014568}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:40.529600+0000","modified":"2022-01-10T01:33:41.697488+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8409},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8409":{"gid":8409,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/138807571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":138807571},{"type":"v1","addr":"172.21.15.59:6833","nonce":138807571}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2022-01-10T01:33:45.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.289+0000 7f1c45240700 1 -- 172.21.15.36:0/1356338542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1c200535f0 msgr2=0x7f1c20055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:45.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.289+0000 7f1c45240700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1c200535f0 0x7f1c20055ab0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f1c3400d000 tx=0x7f1c34007b70).stop 2022-01-10T01:33:45.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.289+0000 7f1c45240700 1 -- 172.21.15.36:0/1356338542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c400b0010 msgr2=0x7f1c40064500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:45.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.289+0000 7f1c45240700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c400b0010 0x7f1c40064500 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f1c40065dc0 tx=0x7f1c30016000).stop 2022-01-10T01:33:45.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.289+0000 7f1c45240700 1 -- 172.21.15.36:0/1356338542 shutdown_connections 2022-01-10T01:33:45.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.289+0000 7f1c45240700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f1c200535f0 0x7f1c20055ab0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:45.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.289+0000 7f1c45240700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f1c400b2580 0x7f1c400a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:45.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.289+0000 7f1c45240700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c400b0010 0x7f1c40064500 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:45.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.289+0000 7f1c45240700 1 --2- 172.21.15.36:0/1356338542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c400afbd0 0x7f1c40064010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:45.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.289+0000 7f1c45240700 1 -- 172.21.15.36:0/1356338542 >> 172.21.15.36:0/1356338542 conn(0x7f1c40060180 msgr2=0x7f1c401486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:45.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.289+0000 7f1c45240700 1 -- 172.21.15.36:0/1356338542 shutdown_connections 2022-01-10T01:33:45.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:45.289+0000 7f1c45240700 1 -- 172.21.15.36:0/1356338542 wait complete. 2022-01-10T01:33:45.298 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 74 2022-01-10T01:33:45.609 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:33:40.529600+0000', 'modified': '2022-01-10T01:33:41.697488+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8409}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8409': {'gid': 8409, 'name': 'b', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/138807571', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 138807571}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 138807571}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:33:45.610 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:33:45.610 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:33:45.729 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":8409,"want_state":"up:active","state":"up:active","rank_uptime":5.1848763719999997,"mdsmap_epoch":74,"osdmap_epoch":148,"osdmap_epoch_barrier":148,"uptime":9.4733200069999999} 2022-01-10T01:33:45.730 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 8409, "mdsmap_epoch": 74, "osdmap_epoch": 148, "osdmap_epoch_barrier": 148, "rank_uptime": 5.184876372, "state": "up:active", "uptime": 9.473320007, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:33:45.730 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:33:45.731 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:33:45.731 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:33:45.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:45.732 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:45.740 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:33:45.758 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:33:45.759 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:33:45.773 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:33:45.774 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:33:45.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:45.776 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:33:45.822 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:33:45.823 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:45.827 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:33:45.845 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:33:45.845 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:33:45.900 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:33:45.894+0000 7fb335f9d080 -1 init, newargv = 0x5586729e4c50 newargc=9 2022-01-10T01:33:45.900 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[15286]: starting ceph client 2022-01-10T01:33:45.902 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:33:45.903 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:33:45.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:45.904 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:33:45.911 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[15286]: starting fuse 2022-01-10T01:33:47.011 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:33:47.030 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:33:47.030 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:33:47.087 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:33:47.088 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:33:47.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:47.089 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:33:47.095 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:33:47.095 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:33:47.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:47.096 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:33:47.097 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:33:47.097 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:33:47.097 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:33:47.098 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:33:47.098 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:33:47.099 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:33:47.099 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:33:47.100 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:33:47.100 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:33:47.101 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:33:47.101 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:33:47.101 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:33:47.102 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:33:47.102 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:33:47.103 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:33:47.103 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:33:47.103 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:33:47.104 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:33:47.104 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:33:47.105 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:33:47.105 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:33:47.106 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:33:47.149 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.15286.asok 2022-01-10T01:33:47.153 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15286.asok 2022-01-10T01:33:47.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:47.154 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15286.asok status 2022-01-10T01:33:47.289 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:33:47.289 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:33:47.289 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:33:47.290 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:33:47.290 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:33:47.290 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:33:47.290 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:33:47.291 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "15286", 2022-01-10T01:33:47.291 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:33:47.291 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:33:47.291 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:33:47.292 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:33:47.292 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 8458, 2022-01-10T01:33:47.292 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:33:47.292 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:33:47.292 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:33:47.293 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 8458 2022-01-10T01:33:47.293 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:33:47.293 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:33:47.293 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:33:47.294 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:33:47.294 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 573906498 2022-01-10T01:33:47.294 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:33:47.294 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:33:47.295 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:33:47.295 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:33:47.295 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:33:47.295 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 573906498 2022-01-10T01:33:47.295 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:33:47.296 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.8458 172.21.15.139:0/573906498", 2022-01-10T01:33:47.296 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/573906498", 2022-01-10T01:33:47.296 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:33:47.296 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 74, 2022-01-10T01:33:47.297 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 148, 2022-01-10T01:33:47.297 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:33:47.297 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:33:47.297 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:33:47.297 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:33:47.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:47.306 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:47.306 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:47.313 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:33:47.314 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:33:47.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:47.315 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:47.332 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:33:47.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.437+0000 7fdce848c700 1 Processor -- start 2022-01-10T01:33:47.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.437+0000 7fdce848c700 1 -- start start 2022-01-10T01:33:47.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.437+0000 7fdce848c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdce00b1db0 0x7fdce00b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.437+0000 7fdce848c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fdce00a70c0 0x7fdce0144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.446 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.437+0000 7fdce848c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce00b0350 con 0x7fdce01483a0 2022-01-10T01:33:47.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.437+0000 7fdce848c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce00a90c0 con 0x7fdce00a70c0 2022-01-10T01:33:47.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.437+0000 7fdce848c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce00b05f0 con 0x7fdce00b1db0 2022-01-10T01:33:47.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.437+0000 7fdce6a29700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fdce00a70c0 0x7fdce0144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.437+0000 7fdce6a29700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fdce00a70c0 0x7fdce0144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42550/0 (socket says 172.21.15.36:42550) 2022-01-10T01:33:47.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce6a29700 1 -- 172.21.15.36:0/3696873321 learned_addr learned my addr 172.21.15.36:0/3696873321 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:47.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce6228700 1 --2- 172.21.15.36:0/3696873321 >> v2:172.21.15.59:3300/0 conn(0x7fdce00b1db0 0x7fdce00b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce5226700 1 -- 172.21.15.36:0/3696873321 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654904396 0 0) 0x7fdce00b0350 con 0x7fdce01483a0 2022-01-10T01:33:47.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce5226700 1 -- 172.21.15.36:0/3696873321 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc8003260 con 0x7fdce01483a0 2022-01-10T01:33:47.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce6a29700 1 -- 172.21.15.36:0/3696873321 >> v2:172.21.15.59:3300/0 conn(0x7fdce00b1db0 msgr2=0x7fdce00b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:47.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce6a29700 1 --2- 172.21.15.36:0/3696873321 >> v2:172.21.15.59:3300/0 conn(0x7fdce00b1db0 0x7fdce00b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce6a29700 1 -- 172.21.15.36:0/3696873321 >> v1:172.21.15.59:6789/0 conn(0x7fdce01483a0 legacy=0x7fdce00b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce6a29700 1 -- 172.21.15.36:0/3696873321 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce00b0890 con 0x7fdce00a70c0 2022-01-10T01:33:47.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce6a29700 1 --2- 172.21.15.36:0/3696873321 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdce00a70c0 0x7fdce0144720 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7fdce0147730 tx=0x7fdcd8009290).ready entity=mon.0 client_cookie=64892fffc3394db9 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:47.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce5226700 1 -- 172.21.15.36:0/3696873321 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd800b680 con 0x7fdce00a70c0 2022-01-10T01:33:47.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce5226700 1 -- 172.21.15.36:0/3696873321 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd800b7e0 con 0x7fdce00a70c0 2022-01-10T01:33:47.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce5226700 1 -- 172.21.15.36:0/3696873321 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd800b950 con 0x7fdce00a70c0 2022-01-10T01:33:47.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce848c700 1 -- 172.21.15.36:0/3696873321 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdce00a70c0 msgr2=0x7fdce0144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce848c700 1 --2- 172.21.15.36:0/3696873321 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdce00a70c0 0x7fdce0144720 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7fdce0147730 tx=0x7fdcd8009290).stop 2022-01-10T01:33:47.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce848c700 1 -- 172.21.15.36:0/3696873321 shutdown_connections 2022-01-10T01:33:47.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce848c700 1 --2- 172.21.15.36:0/3696873321 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdce00a70c0 0x7fdce0144720 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce848c700 1 --2- 172.21.15.36:0/3696873321 >> v2:172.21.15.59:3300/0 conn(0x7fdce00b1db0 0x7fdce00b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce848c700 1 -- 172.21.15.36:0/3696873321 >> 172.21.15.36:0/3696873321 conn(0x7fdce005f6b0 msgr2=0x7fdce005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:47.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce848c700 1 -- 172.21.15.36:0/3696873321 shutdown_connections 2022-01-10T01:33:47.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.441+0000 7fdce848c700 1 -- 172.21.15.36:0/3696873321 wait complete. 2022-01-10T01:33:47.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.445+0000 7fdce848c700 1 Processor -- start 2022-01-10T01:33:47.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.445+0000 7fdce848c700 1 -- start start 2022-01-10T01:33:47.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.445+0000 7fdce848c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdce00a70c0 0x7fdce00af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.456 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.445+0000 7fdce848c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdce00b1db0 0x7fdce0148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.445+0000 7fdce848c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce01483a0 0x7fdce00ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.445+0000 7fdce848c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce00a9e10 con 0x7fdce00a70c0 2022-01-10T01:33:47.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.445+0000 7fdce848c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce014a8a0 con 0x7fdce01483a0 2022-01-10T01:33:47.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.445+0000 7fdce848c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce0145190 con 0x7fdce00b1db0 2022-01-10T01:33:47.457 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.445+0000 7fdce6228700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdce00a70c0 0x7fdce00af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.445+0000 7fdce6228700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdce00a70c0 0x7fdce00af060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42552/0 (socket says 172.21.15.36:42552) 2022-01-10T01:33:47.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.445+0000 7fdce6228700 1 -- 172.21.15.36:0/1157902239 learned_addr learned my addr 172.21.15.36:0/1157902239 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:47.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdce6a29700 1 --2- 172.21.15.36:0/1157902239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce01483a0 0x7fdce00ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdce5a27700 1 --2- 172.21.15.36:0/1157902239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdce00b1db0 0x7fdce0148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.458 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdce6228700 1 -- 172.21.15.36:0/1157902239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdce00b1db0 msgr2=0x7fdce0148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdce6228700 1 --2- 172.21.15.36:0/1157902239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdce00b1db0 0x7fdce0148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdce6228700 1 -- 172.21.15.36:0/1157902239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce01483a0 msgr2=0x7fdce00ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdce6228700 1 --2- 172.21.15.36:0/1157902239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce01483a0 0x7fdce00ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.459 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdce6228700 1 -- 172.21.15.36:0/1157902239 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd8009530 con 0x7fdce00a70c0 2022-01-10T01:33:47.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdce6228700 1 --2- 172.21.15.36:0/1157902239 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdce00a70c0 0x7fdce00af060 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7fdce00ae900 tx=0x7fdcd0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:47.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdccf7fe700 1 -- 172.21.15.36:0/1157902239 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd0010780 con 0x7fdce00a70c0 2022-01-10T01:33:47.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdccf7fe700 1 -- 172.21.15.36:0/1157902239 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd00108e0 con 0x7fdce00a70c0 2022-01-10T01:33:47.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdce848c700 1 -- 172.21.15.36:0/1157902239 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce014aad0 con 0x7fdce00a70c0 2022-01-10T01:33:47.460 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdccf7fe700 1 -- 172.21.15.36:0/1157902239 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcd0010c40 con 0x7fdce00a70c0 2022-01-10T01:33:47.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdce848c700 1 -- 172.21.15.36:0/1157902239 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce01567f0 con 0x7fdce00a70c0 2022-01-10T01:33:47.461 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdce848c700 1 -- 172.21.15.36:0/1157902239 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce00b0b30 con 0x7fdce00a70c0 2022-01-10T01:33:47.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.449+0000 7fdccf7fe700 1 -- 172.21.15.36:0/1157902239 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fdcd001c460 con 0x7fdce00a70c0 2022-01-10T01:33:47.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.453+0000 7fdccf7fe700 1 --2- 172.21.15.36:0/1157902239 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdcc00534d0 0x7fdcc0055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.453+0000 7fdccf7fe700 1 -- 172.21.15.36:0/1157902239 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fdcd006bed0 con 0x7fdce00a70c0 2022-01-10T01:33:47.462 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.453+0000 7fdce5a27700 1 --2- 172.21.15.36:0/1157902239 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdcc00534d0 0x7fdcc0055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.453+0000 7fdce5a27700 1 --2- 172.21.15.36:0/1157902239 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdcc00534d0 0x7fdcc0055990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fdcdc00d000 tx=0x7fdcdc007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:47.463 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.457+0000 7fdccf7fe700 1 -- 172.21.15.36:0/1157902239 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fdcd0042de0 con 0x7fdce00a70c0 2022-01-10T01:33:47.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.585+0000 7fdce848c700 1 -- 172.21.15.36:0/1157902239 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdce0057350 con 0x7fdce00a70c0 2022-01-10T01:33:47.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.589+0000 7fdccf7fe700 1 -- 172.21.15.36:0/1157902239 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fdcd0046400 con 0x7fdce00a70c0 2022-01-10T01:33:47.595 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:47.596 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":148,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:33:40.529449+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:33:39.011334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2022-01-10T01:33:39.792400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:33:47.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.589+0000 7fdce848c700 1 -- 172.21.15.36:0/1157902239 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdcc00534d0 msgr2=0x7fdcc0055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.589+0000 7fdce848c700 1 --2- 172.21.15.36:0/1157902239 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdcc00534d0 0x7fdcc0055990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fdcdc00d000 tx=0x7fdcdc007a00).stop 2022-01-10T01:33:47.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.589+0000 7fdce848c700 1 -- 172.21.15.36:0/1157902239 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdce00a70c0 msgr2=0x7fdce00af060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.589+0000 7fdce848c700 1 --2- 172.21.15.36:0/1157902239 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdce00a70c0 0x7fdce00af060 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7fdce00ae900 tx=0x7fdcd0006df0).stop 2022-01-10T01:33:47.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.589+0000 7fdce848c700 1 -- 172.21.15.36:0/1157902239 shutdown_connections 2022-01-10T01:33:47.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.589+0000 7fdce848c700 1 --2- 172.21.15.36:0/1157902239 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fdcc00534d0 0x7fdcc0055990 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.589+0000 7fdce848c700 1 --2- 172.21.15.36:0/1157902239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce01483a0 0x7fdce00ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.589+0000 7fdce848c700 1 --2- 172.21.15.36:0/1157902239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdce00b1db0 0x7fdce0148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.589+0000 7fdce848c700 1 --2- 172.21.15.36:0/1157902239 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fdce00a70c0 0x7fdce00af060 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.589+0000 7fdce848c700 1 -- 172.21.15.36:0/1157902239 >> 172.21.15.36:0/1157902239 conn(0x7fdce005f6b0 msgr2=0x7fdce00b4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:47.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.589+0000 7fdce848c700 1 -- 172.21.15.36:0/1157902239 shutdown_connections 2022-01-10T01:33:47.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.589+0000 7fdce848c700 1 -- 172.21.15.36:0/1157902239 wait complete. 2022-01-10T01:33:47.608 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:33:39.011334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:33:39.792400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:33:47.609 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:33:47.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.709+0000 7fad9d0a5700 1 Processor -- start 2022-01-10T01:33:47.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad9d0a5700 1 -- start start 2022-01-10T01:33:47.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad9d0a5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fad980a9c10 0x7fad980607c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad9d0a5700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad98066ea0 con 0x7fad980b3040 2022-01-10T01:33:47.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad9d0a5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad980b3420 con 0x7fad98140140 2022-01-10T01:33:47.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad9d0a5700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad980648e0 con 0x7fad980a9c10 2022-01-10T01:33:47.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad8ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fad980a9c10 0x7fad980607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad97fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fad980b3040 0x7fad98065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40354/0 (socket says 172.21.15.36:40354) 2022-01-10T01:33:47.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad97fff700 1 -- 172.21.15.36:0/1879393733 learned_addr learned my addr 172.21.15.36:0/1879393733 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:47.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad8ffff700 1 -- 172.21.15.36:0/1879393733 >> v1:172.21.15.59:6789/0 conn(0x7fad98140140 legacy=0x7fad98140590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad8ffff700 1 -- 172.21.15.36:0/1879393733 >> v1:172.21.15.36:6789/0 conn(0x7fad980b3040 legacy=0x7fad98065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad8ffff700 1 -- 172.21.15.36:0/1879393733 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad98066960 con 0x7fad980a9c10 2022-01-10T01:33:47.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad8ffff700 1 --2- 172.21.15.36:0/1879393733 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad980a9c10 0x7fad980607c0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7fad80002f70 tx=0x7fad80006df0).ready entity=mon.0 client_cookie=dcac21fddf2a4044 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:47.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad977fe700 1 -- 172.21.15.36:0/1879393733 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad8000d610 con 0x7fad980a9c10 2022-01-10T01:33:47.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad977fe700 1 -- 172.21.15.36:0/1879393733 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad80000e90 con 0x7fad980a9c10 2022-01-10T01:33:47.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad977fe700 1 -- 172.21.15.36:0/1879393733 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad8000d960 con 0x7fad980a9c10 2022-01-10T01:33:47.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad9d0a5700 1 -- 172.21.15.36:0/1879393733 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad980a9c10 msgr2=0x7fad980607c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad9d0a5700 1 --2- 172.21.15.36:0/1879393733 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad980a9c10 0x7fad980607c0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7fad80002f70 tx=0x7fad80006df0).stop 2022-01-10T01:33:47.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad9d0a5700 1 -- 172.21.15.36:0/1879393733 shutdown_connections 2022-01-10T01:33:47.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad9d0a5700 1 --2- 172.21.15.36:0/1879393733 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad980a9c10 0x7fad980607c0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad9d0a5700 1 -- 172.21.15.36:0/1879393733 >> 172.21.15.36:0/1879393733 conn(0x7fad980636e0 msgr2=0x7fad98063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:47.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad9d0a5700 1 -- 172.21.15.36:0/1879393733 shutdown_connections 2022-01-10T01:33:47.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.713+0000 7fad9d0a5700 1 -- 172.21.15.36:0/1879393733 wait complete. 2022-01-10T01:33:47.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad9d0a5700 1 Processor -- start 2022-01-10T01:33:47.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad9d0a5700 1 -- start start 2022-01-10T01:33:47.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad9d0a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad980a9c10 0x7fad980af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad9d0a5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad980b3040 0x7fad980acc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad9d0a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad98140140 0x7fad9813d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad9d0a5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9813f0e0 con 0x7fad980b3040 2022-01-10T01:33:47.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad9d0a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980b48e0 con 0x7fad980a9c10 2022-01-10T01:33:47.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad9d0a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad98135990 con 0x7fad98140140 2022-01-10T01:33:47.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad8ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad980b3040 0x7fad980acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad8ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad980b3040 0x7fad980acc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42568/0 (socket says 172.21.15.36:42568) 2022-01-10T01:33:47.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad8ffff700 1 -- 172.21.15.36:0/3481413131 learned_addr learned my addr 172.21.15.36:0/3481413131 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:47.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad97fff700 1 --2- 172.21.15.36:0/3481413131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad980a9c10 0x7fad980af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad9c8a4700 1 --2- 172.21.15.36:0/3481413131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad98140140 0x7fad9813d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad8ffff700 1 -- 172.21.15.36:0/3481413131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad98140140 msgr2=0x7fad9813d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad8ffff700 1 --2- 172.21.15.36:0/3481413131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad98140140 0x7fad9813d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.732 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad8ffff700 1 -- 172.21.15.36:0/3481413131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad980a9c10 msgr2=0x7fad980af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad8ffff700 1 --2- 172.21.15.36:0/3481413131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad980a9c10 0x7fad980af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad8ffff700 1 -- 172.21.15.36:0/3481413131 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8000b180 con 0x7fad980b3040 2022-01-10T01:33:47.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad8ffff700 1 --2- 172.21.15.36:0/3481413131 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad980b3040 0x7fad980acc30 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7fad80002f70 tx=0x7fad80015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:47.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad95ffb700 1 -- 172.21.15.36:0/3481413131 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad8000de70 con 0x7fad980b3040 2022-01-10T01:33:47.733 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad95ffb700 1 -- 172.21.15.36:0/3481413131 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad80011bf0 con 0x7fad980b3040 2022-01-10T01:33:47.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.717+0000 7fad9d0a5700 1 -- 172.21.15.36:0/3481413131 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9813ee40 con 0x7fad980b3040 2022-01-10T01:33:47.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.721+0000 7fad95ffb700 1 -- 172.21.15.36:0/3481413131 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad8001e460 con 0x7fad980b3040 2022-01-10T01:33:47.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.721+0000 7fad9d0a5700 1 -- 172.21.15.36:0/3481413131 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad980afe20 con 0x7fad980b3040 2022-01-10T01:33:47.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.721+0000 7fad9d0a5700 1 -- 172.21.15.36:0/3481413131 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad98066c00 con 0x7fad980b3040 2022-01-10T01:33:47.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.721+0000 7fad95ffb700 1 -- 172.21.15.36:0/3481413131 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fad80025030 con 0x7fad980b3040 2022-01-10T01:33:47.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.721+0000 7fad95ffb700 1 --2- 172.21.15.36:0/3481413131 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad700534d0 0x7fad70055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.721+0000 7fad95ffb700 1 -- 172.21.15.36:0/3481413131 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fad8006ce60 con 0x7fad980b3040 2022-01-10T01:33:47.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.721+0000 7fad97fff700 1 --2- 172.21.15.36:0/3481413131 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad700534d0 0x7fad70055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.725+0000 7fad97fff700 1 --2- 172.21.15.36:0/3481413131 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad700534d0 0x7fad70055990 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fad8800d000 tx=0x7fad88009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:47.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.729+0000 7fad95ffb700 1 -- 172.21.15.36:0/3481413131 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fad80043e70 con 0x7fad980b3040 2022-01-10T01:33:47.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.853+0000 7fad9d0a5700 1 -- 172.21.15.36:0/3481413131 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fad98057350 con 0x7fad980b3040 2022-01-10T01:33:47.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.853+0000 7fad95ffb700 1 -- 172.21.15.36:0/3481413131 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v148) v1 ==== 110+0+10 (secure 0 0 0) 0x7fad80023020 con 0x7fad980b3040 2022-01-10T01:33:47.862 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:33:47.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.857+0000 7fad9d0a5700 1 -- 172.21.15.36:0/3481413131 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad700534d0 msgr2=0x7fad70055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.857+0000 7fad9d0a5700 1 --2- 172.21.15.36:0/3481413131 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad700534d0 0x7fad70055990 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fad8800d000 tx=0x7fad88009040).stop 2022-01-10T01:33:47.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.857+0000 7fad9d0a5700 1 -- 172.21.15.36:0/3481413131 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad980b3040 msgr2=0x7fad980acc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.857+0000 7fad9d0a5700 1 --2- 172.21.15.36:0/3481413131 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad980b3040 0x7fad980acc30 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7fad80002f70 tx=0x7fad80015000).stop 2022-01-10T01:33:47.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.857+0000 7fad9d0a5700 1 -- 172.21.15.36:0/3481413131 shutdown_connections 2022-01-10T01:33:47.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.857+0000 7fad9d0a5700 1 --2- 172.21.15.36:0/3481413131 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad700534d0 0x7fad70055990 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.857+0000 7fad9d0a5700 1 --2- 172.21.15.36:0/3481413131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad98140140 0x7fad9813d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.857+0000 7fad9d0a5700 1 --2- 172.21.15.36:0/3481413131 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad980b3040 0x7fad980acc30 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.857+0000 7fad9d0a5700 1 --2- 172.21.15.36:0/3481413131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad980a9c10 0x7fad980af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.857+0000 7fad9d0a5700 1 -- 172.21.15.36:0/3481413131 >> 172.21.15.36:0/3481413131 conn(0x7fad980636e0 msgr2=0x7fad980b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:47.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.857+0000 7fad9d0a5700 1 -- 172.21.15.36:0/3481413131 shutdown_connections 2022-01-10T01:33:47.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.857+0000 7fad9d0a5700 1 -- 172.21.15.36:0/3481413131 wait complete. 2022-01-10T01:33:47.874 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:33:47.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.973+0000 7fd244fcd700 1 Processor -- start 2022-01-10T01:33:47.981 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.973+0000 7fd244fcd700 1 -- start start 2022-01-10T01:33:47.984 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd240061680 0x7fd2400b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd2400b4710 0x7fd2400ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2400b6910 con 0x7fd2401439a0 2022-01-10T01:33:47.985 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2400b9680 con 0x7fd2400b4710 2022-01-10T01:33:47.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400b6bb0 con 0x7fd240061680 2022-01-10T01:33:47.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd23effd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd2400b4710 0x7fd2400ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.986 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd23ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd2401439a0 0x7fd24013fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40372/0 (socket says 172.21.15.36:40372) 2022-01-10T01:33:47.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd23ffff700 1 -- 172.21.15.36:0/1032153049 learned_addr learned my addr 172.21.15.36:0/1032153049 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:47.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd23f7fe700 1 --2- 172.21.15.36:0/1032153049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd240061680 0x7fd2400b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd23e7fc700 1 -- 172.21.15.36:0/1032153049 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2953787366 0 0) 0x7fd2400b6910 con 0x7fd2401439a0 2022-01-10T01:33:47.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd23e7fc700 1 -- 172.21.15.36:0/1032153049 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd22c003260 con 0x7fd2401439a0 2022-01-10T01:33:47.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd23effd700 1 -- 172.21.15.36:0/1032153049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd240061680 msgr2=0x7fd2400b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:47.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd23effd700 1 --2- 172.21.15.36:0/1032153049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd240061680 0x7fd2400b9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd23effd700 1 -- 172.21.15.36:0/1032153049 >> v1:172.21.15.36:6789/0 conn(0x7fd2401439a0 legacy=0x7fd24013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd23effd700 1 -- 172.21.15.36:0/1032153049 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2400b6e50 con 0x7fd2400b4710 2022-01-10T01:33:47.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd23effd700 1 --2- 172.21.15.36:0/1032153049 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2400b4710 0x7fd2400ba200 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7fd230002f70 tx=0x7fd230006df0).ready entity=mon.0 client_cookie=cf158487df0d4c38 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:47.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd23e7fc700 1 -- 172.21.15.36:0/1032153049 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23000d4a0 con 0x7fd2400b4710 2022-01-10T01:33:47.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd23e7fc700 1 -- 172.21.15.36:0/1032153049 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd230000e90 con 0x7fd2400b4710 2022-01-10T01:33:47.989 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd23e7fc700 1 -- 172.21.15.36:0/1032153049 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23000d7f0 con 0x7fd2400b4710 2022-01-10T01:33:47.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 -- 172.21.15.36:0/1032153049 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2400b4710 msgr2=0x7fd2400ba200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 --2- 172.21.15.36:0/1032153049 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2400b4710 0x7fd2400ba200 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7fd230002f70 tx=0x7fd230006df0).stop 2022-01-10T01:33:47.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 -- 172.21.15.36:0/1032153049 shutdown_connections 2022-01-10T01:33:47.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 --2- 172.21.15.36:0/1032153049 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd2400b4710 0x7fd2400ba200 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 --2- 172.21.15.36:0/1032153049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd240061680 0x7fd2400b9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 -- 172.21.15.36:0/1032153049 >> 172.21.15.36:0/1032153049 conn(0x7fd24006adf0 msgr2=0x7fd24005f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:47.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 -- 172.21.15.36:0/1032153049 shutdown_connections 2022-01-10T01:33:47.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 -- 172.21.15.36:0/1032153049 wait complete. 2022-01-10T01:33:47.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 Processor -- start 2022-01-10T01:33:47.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.977+0000 7fd244fcd700 1 -- start start 2022-01-10T01:33:47.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd244fcd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd240061680 0x7fd2401468a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.995 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd244fcd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2401439a0 0x7fd24013e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd244fcd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd240112bb0 0x7fd24013e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:47.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd244fcd700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400ae090 con 0x7fd240061680 2022-01-10T01:33:47.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd244fcd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd240153b80 con 0x7fd2401439a0 2022-01-10T01:33:47.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd244fcd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400b08f0 con 0x7fd240112bb0 2022-01-10T01:33:47.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd23f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd240061680 0x7fd2401468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd23f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd240061680 0x7fd2401468a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42580/0 (socket says 172.21.15.36:42580) 2022-01-10T01:33:47.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd23f7fe700 1 -- 172.21.15.36:0/3506884345 learned_addr learned my addr 172.21.15.36:0/3506884345 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:47.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd23effd700 1 --2- 172.21.15.36:0/3506884345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2401439a0 0x7fd24013e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd23ffff700 1 --2- 172.21.15.36:0/3506884345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd240112bb0 0x7fd24013e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:47.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd23f7fe700 1 -- 172.21.15.36:0/3506884345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd240112bb0 msgr2=0x7fd24013e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd23f7fe700 1 --2- 172.21.15.36:0/3506884345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd240112bb0 0x7fd24013e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd23f7fe700 1 -- 172.21.15.36:0/3506884345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2401439a0 msgr2=0x7fd24013e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:47.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd23f7fe700 1 --2- 172.21.15.36:0/3506884345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2401439a0 0x7fd24013e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:47.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd23f7fe700 1 -- 172.21.15.36:0/3506884345 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23000b180 con 0x7fd240061680 2022-01-10T01:33:47.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd23f7fe700 1 --2- 172.21.15.36:0/3506884345 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd240061680 0x7fd2401468a0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fd2401128d0 tx=0x7fd234006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:47.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd23cff9700 1 -- 172.21.15.36:0/3506884345 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23400c830 con 0x7fd240061680 2022-01-10T01:33:47.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd23cff9700 1 -- 172.21.15.36:0/3506884345 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23400c990 con 0x7fd240061680 2022-01-10T01:33:48.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd244fcd700 1 -- 172.21.15.36:0/3506884345 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2400b0690 con 0x7fd240061680 2022-01-10T01:33:48.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd23cff9700 1 -- 172.21.15.36:0/3506884345 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd23400ccf0 con 0x7fd240061680 2022-01-10T01:33:48.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.981+0000 7fd244fcd700 1 -- 172.21.15.36:0/3506884345 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2400ad7c0 con 0x7fd240061680 2022-01-10T01:33:48.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.985+0000 7fd244fcd700 1 -- 172.21.15.36:0/3506884345 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd240057350 con 0x7fd240061680 2022-01-10T01:33:48.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.985+0000 7fd23cff9700 1 -- 172.21.15.36:0/3506884345 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd23401c460 con 0x7fd240061680 2022-01-10T01:33:48.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.985+0000 7fd23cff9700 1 --2- 172.21.15.36:0/3506884345 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd220053620 0x7fd220055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.985+0000 7fd23cff9700 1 -- 172.21.15.36:0/3506884345 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd23406bf80 con 0x7fd240061680 2022-01-10T01:33:48.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.985+0000 7fd23effd700 1 --2- 172.21.15.36:0/3506884345 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd220053620 0x7fd220055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.985+0000 7fd23effd700 1 --2- 172.21.15.36:0/3506884345 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd220053620 0x7fd220055ae0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fd230018000 tx=0x7fd230014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:48.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:47.989+0000 7fd23cff9700 1 -- 172.21.15.36:0/3506884345 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd234042f30 con 0x7fd240061680 2022-01-10T01:33:48.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.109+0000 7fd244fcd700 1 -- 172.21.15.36:0/3506884345 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd2400b0b10 con 0x7fd240061680 2022-01-10T01:33:48.118 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.113+0000 7fd23cff9700 1 -- 172.21.15.36:0/3506884345 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v148) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd234046550 con 0x7fd240061680 2022-01-10T01:33:48.118 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:48.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.113+0000 7fd244fcd700 1 -- 172.21.15.36:0/3506884345 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd220053620 msgr2=0x7fd220055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.113+0000 7fd244fcd700 1 --2- 172.21.15.36:0/3506884345 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd220053620 0x7fd220055ae0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7fd230018000 tx=0x7fd230014000).stop 2022-01-10T01:33:48.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.113+0000 7fd244fcd700 1 -- 172.21.15.36:0/3506884345 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd240061680 msgr2=0x7fd2401468a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.113+0000 7fd244fcd700 1 --2- 172.21.15.36:0/3506884345 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd240061680 0x7fd2401468a0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fd2401128d0 tx=0x7fd234006df0).stop 2022-01-10T01:33:48.122 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.113+0000 7fd244fcd700 1 -- 172.21.15.36:0/3506884345 shutdown_connections 2022-01-10T01:33:48.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.113+0000 7fd244fcd700 1 --2- 172.21.15.36:0/3506884345 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd220053620 0x7fd220055ae0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.113+0000 7fd244fcd700 1 --2- 172.21.15.36:0/3506884345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd240112bb0 0x7fd24013e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.113+0000 7fd244fcd700 1 --2- 172.21.15.36:0/3506884345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2401439a0 0x7fd24013e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.113+0000 7fd244fcd700 1 --2- 172.21.15.36:0/3506884345 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd240061680 0x7fd2401468a0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.113+0000 7fd244fcd700 1 -- 172.21.15.36:0/3506884345 >> 172.21.15.36:0/3506884345 conn(0x7fd24006adf0 msgr2=0x7fd2400b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:48.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.113+0000 7fd244fcd700 1 -- 172.21.15.36:0/3506884345 shutdown_connections 2022-01-10T01:33:48.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.113+0000 7fd244fcd700 1 -- 172.21.15.36:0/3506884345 wait complete. 2022-01-10T01:33:48.133 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:33:48.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.241+0000 7f68be062700 1 Processor -- start 2022-01-10T01:33:48.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.241+0000 7f68be062700 1 -- start start 2022-01-10T01:33:48.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.241+0000 7f68be062700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f68b80b4060 0x7f68b8061b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.241+0000 7f68be062700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b80b5f50 con 0x7f68b80b6290 2022-01-10T01:33:48.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.241+0000 7f68be062700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b80b1f70 con 0x7f68b8142e60 2022-01-10T01:33:48.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.241+0000 7f68be062700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b80b2210 con 0x7f68b80b4060 2022-01-10T01:33:48.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.241+0000 7f68bc85f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f68b80b4060 0x7f68b8061b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.241+0000 7f68bc85f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f68b80b4060 0x7f68b8061b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42588/0 (socket says 172.21.15.36:42588) 2022-01-10T01:33:48.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.241+0000 7f68bc85f700 1 -- 172.21.15.36:0/1207847065 learned_addr learned my addr 172.21.15.36:0/1207847065 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:48.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.241+0000 7f68bd060700 1 --1- 172.21.15.36:0/1207847065 >> v1:172.21.15.36:6789/0 conn(0x7f68b80b6290 0x7f68b8061470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40384/0 (socket says 172.21.15.36:40384) 2022-01-10T01:33:48.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68bc85f700 1 -- 172.21.15.36:0/1207847065 >> v1:172.21.15.59:6789/0 conn(0x7f68b8142e60 legacy=0x7f68b81432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68bc85f700 1 -- 172.21.15.36:0/1207847065 >> v1:172.21.15.36:6789/0 conn(0x7f68b80b6290 legacy=0x7f68b8061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68bc85f700 1 -- 172.21.15.36:0/1207847065 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b80b24b0 con 0x7f68b80b4060 2022-01-10T01:33:48.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68bc85f700 1 --2- 172.21.15.36:0/1207847065 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f68b80b4060 0x7f68b8061b80 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f68b8060190 tx=0x7f68b4006eb0).ready entity=mon.0 client_cookie=306c379edfbf25ee server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:48.253 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68a3fff700 1 -- 172.21.15.36:0/1207847065 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b400d610 con 0x7f68b80b4060 2022-01-10T01:33:48.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68a3fff700 1 -- 172.21.15.36:0/1207847065 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b4000e90 con 0x7f68b80b4060 2022-01-10T01:33:48.254 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68a3fff700 1 -- 172.21.15.36:0/1207847065 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b400d960 con 0x7f68b80b4060 2022-01-10T01:33:48.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68be062700 1 -- 172.21.15.36:0/1207847065 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f68b80b4060 msgr2=0x7f68b8061b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68be062700 1 --2- 172.21.15.36:0/1207847065 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f68b80b4060 0x7f68b8061b80 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f68b8060190 tx=0x7f68b4006eb0).stop 2022-01-10T01:33:48.258 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68be062700 1 -- 172.21.15.36:0/1207847065 shutdown_connections 2022-01-10T01:33:48.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68be062700 1 --2- 172.21.15.36:0/1207847065 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f68b80b4060 0x7f68b8061b80 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68be062700 1 -- 172.21.15.36:0/1207847065 >> 172.21.15.36:0/1207847065 conn(0x7f68b805c490 msgr2=0x7f68b805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:48.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68be062700 1 -- 172.21.15.36:0/1207847065 shutdown_connections 2022-01-10T01:33:48.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68be062700 1 -- 172.21.15.36:0/1207847065 wait complete. 2022-01-10T01:33:48.259 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68be062700 1 Processor -- start 2022-01-10T01:33:48.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.245+0000 7f68be062700 1 -- start start 2022-01-10T01:33:48.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68be062700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b80b4060 0x7f68b813f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68be062700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f68b80b6290 0x7f68b8152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68be062700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b8142e60 0x7f68b8152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.260 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68be062700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b80ad670 con 0x7f68b80b6290 2022-01-10T01:33:48.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68be062700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b80ae480 con 0x7f68b8142e60 2022-01-10T01:33:48.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68be062700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b80ad8a0 con 0x7f68b80b4060 2022-01-10T01:33:48.261 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68bc85f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f68b80b6290 0x7f68b8152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68bc85f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f68b80b6290 0x7f68b8152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42596/0 (socket says 172.21.15.36:42596) 2022-01-10T01:33:48.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68bc85f700 1 -- 172.21.15.36:0/3102757987 learned_addr learned my addr 172.21.15.36:0/3102757987 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:48.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68bd060700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b80b4060 0x7f68b813f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68bd861700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b8142e60 0x7f68b8152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.262 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68bc85f700 1 -- 172.21.15.36:0/3102757987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b80b4060 msgr2=0x7f68b813f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68bc85f700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b80b4060 0x7f68b813f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68bc85f700 1 -- 172.21.15.36:0/3102757987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b8142e60 msgr2=0x7f68b8152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.263 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68bc85f700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b8142e60 0x7f68b8152e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68bc85f700 1 -- 172.21.15.36:0/3102757987 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b400b1e0 con 0x7f68b80b6290 2022-01-10T01:33:48.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68bd060700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b80b4060 0x7f68b813f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:48.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68bc85f700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f68b80b6290 0x7f68b8152920 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f68b8060190 tx=0x7f68b4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:48.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68aaffd700 1 -- 172.21.15.36:0/3102757987 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b4011880 con 0x7f68b80b6290 2022-01-10T01:33:48.264 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68aaffd700 1 -- 172.21.15.36:0/3102757987 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b40119e0 con 0x7f68b80b6290 2022-01-10T01:33:48.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68be062700 1 -- 172.21.15.36:0/3102757987 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b80adb40 con 0x7f68b80b6290 2022-01-10T01:33:48.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68aaffd700 1 -- 172.21.15.36:0/3102757987 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68b4011d40 con 0x7f68b80b6290 2022-01-10T01:33:48.265 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.249+0000 7f68be062700 1 -- 172.21.15.36:0/3102757987 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b8140110 con 0x7f68b80b6290 2022-01-10T01:33:48.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.253+0000 7f68be062700 1 -- 172.21.15.36:0/3102757987 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b80b2750 con 0x7f68b80b6290 2022-01-10T01:33:48.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.253+0000 7f68aaffd700 1 -- 172.21.15.36:0/3102757987 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f68b4025030 con 0x7f68b80b6290 2022-01-10T01:33:48.267 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.253+0000 7f68aaffd700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f68940536b0 0x7f6894055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.253+0000 7f68aaffd700 1 -- 172.21.15.36:0/3102757987 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f68b406cc00 con 0x7f68b80b6290 2022-01-10T01:33:48.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.253+0000 7f68bd060700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f68940536b0 0x7f6894055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.253+0000 7f68bd060700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f68940536b0 0x7f6894055b70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f68ac00b000 tx=0x7f68ac0070e0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:48.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.257+0000 7f68aaffd700 1 -- 172.21.15.36:0/3102757987 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f68b4072020 con 0x7f68b80b6290 2022-01-10T01:33:48.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.381+0000 7f68be062700 1 -- 172.21.15.36:0/3102757987 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68b8057350 con 0x7f68b80b6290 2022-01-10T01:33:48.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.385+0000 7f68aaffd700 1 -- 172.21.15.36:0/3102757987 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v148) v1 ==== 104+0+10 (secure 0 0 0) 0x7f68b4023020 con 0x7f68b80b6290 2022-01-10T01:33:48.391 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:48.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.385+0000 7f68be062700 1 -- 172.21.15.36:0/3102757987 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f68940536b0 msgr2=0x7f6894055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.385+0000 7f68be062700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f68940536b0 0x7f6894055b70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f68ac00b000 tx=0x7f68ac0070e0).stop 2022-01-10T01:33:48.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.385+0000 7f68be062700 1 -- 172.21.15.36:0/3102757987 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f68b80b6290 msgr2=0x7f68b8152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.385+0000 7f68be062700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f68b80b6290 0x7f68b8152920 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7f68b8060190 tx=0x7f68b4015000).stop 2022-01-10T01:33:48.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.385+0000 7f68be062700 1 -- 172.21.15.36:0/3102757987 shutdown_connections 2022-01-10T01:33:48.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.385+0000 7f68be062700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f68940536b0 0x7f6894055b70 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.385+0000 7f68be062700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b8142e60 0x7f68b8152e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.385+0000 7f68be062700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f68b80b6290 0x7f68b8152920 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.385+0000 7f68be062700 1 --2- 172.21.15.36:0/3102757987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b80b4060 0x7f68b813f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.385+0000 7f68be062700 1 -- 172.21.15.36:0/3102757987 >> 172.21.15.36:0/3102757987 conn(0x7f68b805c490 msgr2=0x7f68b80b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:48.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.385+0000 7f68be062700 1 -- 172.21.15.36:0/3102757987 shutdown_connections 2022-01-10T01:33:48.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.385+0000 7f68be062700 1 -- 172.21.15.36:0/3102757987 wait complete. 2022-01-10T01:33:48.403 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:33:48.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.509+0000 7f5548241700 1 Processor -- start 2022-01-10T01:33:48.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.509+0000 7f5548241700 1 -- start start 2022-01-10T01:33:48.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.509+0000 7f5548241700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55400611d0 0x7f5540143820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.509+0000 7f5548241700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5540064910 con 0x7f55400b2710 2022-01-10T01:33:48.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.509+0000 7f5548241700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5540064bb0 con 0x7f554005ff60 2022-01-10T01:33:48.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.509+0000 7f5548241700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5540064e50 con 0x7f55400611d0 2022-01-10T01:33:48.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.509+0000 7f55457dc700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f55400b2710 0x7f5540143110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40396/0 (socket says 172.21.15.36:40396) 2022-01-10T01:33:48.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.509+0000 7f55457dc700 1 -- 172.21.15.36:0/2039779957 learned_addr learned my addr 172.21.15.36:0/2039779957 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:48.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.509+0000 7f55467de700 1 --2- 172.21.15.36:0/2039779957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55400611d0 0x7f5540143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5544fdb700 1 -- 172.21.15.36:0/2039779957 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987207080 0 0) 0x7f5540064910 con 0x7f55400b2710 2022-01-10T01:33:48.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5544fdb700 1 -- 172.21.15.36:0/2039779957 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5528003260 con 0x7f55400b2710 2022-01-10T01:33:48.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5544fdb700 1 -- 172.21.15.36:0/2039779957 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912452121 0 0) 0x7f5540064bb0 con 0x7f554005ff60 2022-01-10T01:33:48.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5544fdb700 1 -- 172.21.15.36:0/2039779957 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5540064910 con 0x7f554005ff60 2022-01-10T01:33:48.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f55467de700 1 -- 172.21.15.36:0/2039779957 >> v1:172.21.15.59:6789/0 conn(0x7f554005ff60 legacy=0x7f5540140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f55467de700 1 -- 172.21.15.36:0/2039779957 >> v1:172.21.15.36:6789/0 conn(0x7f55400b2710 legacy=0x7f5540143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5544fdb700 1 -- 172.21.15.36:0/2039779957 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 322098602 0 0) 0x7f5528003260 con 0x7f55400b2710 2022-01-10T01:33:48.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f55467de700 1 -- 172.21.15.36:0/2039779957 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55400650f0 con 0x7f55400611d0 2022-01-10T01:33:48.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f55467de700 1 --2- 172.21.15.36:0/2039779957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55400611d0 0x7f5540143820 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f5534001800 tx=0x7f55380091d0).ready entity=mon.2 client_cookie=9757843a87f88f31 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:48.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5544fdb700 1 -- 172.21.15.36:0/2039779957 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5534001660 con 0x7f55400611d0 2022-01-10T01:33:48.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5544fdb700 1 -- 172.21.15.36:0/2039779957 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553800f510 con 0x7f55400611d0 2022-01-10T01:33:48.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5544fdb700 1 -- 172.21.15.36:0/2039779957 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f553800f680 con 0x7f55400611d0 2022-01-10T01:33:48.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5548241700 1 -- 172.21.15.36:0/2039779957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55400611d0 msgr2=0x7f5540143820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5548241700 1 --2- 172.21.15.36:0/2039779957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55400611d0 0x7f5540143820 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f5534001800 tx=0x7f55380091d0).stop 2022-01-10T01:33:48.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5548241700 1 -- 172.21.15.36:0/2039779957 shutdown_connections 2022-01-10T01:33:48.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5548241700 1 --2- 172.21.15.36:0/2039779957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55400611d0 0x7f5540143820 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5548241700 1 -- 172.21.15.36:0/2039779957 >> 172.21.15.36:0/2039779957 conn(0x7f554005cf60 msgr2=0x7f554005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:48.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5548241700 1 -- 172.21.15.36:0/2039779957 shutdown_connections 2022-01-10T01:33:48.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5548241700 1 -- 172.21.15.36:0/2039779957 wait complete. 2022-01-10T01:33:48.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5548241700 1 Processor -- start 2022-01-10T01:33:48.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.513+0000 7f5548241700 1 -- start start 2022-01-10T01:33:48.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f5548241700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f554005ff60 0x7f55401433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f5548241700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55400611d0 0x7f554013f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f5548241700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55400b2710 0x7f554013fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f5548241700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5540146e20 con 0x7f55400b2710 2022-01-10T01:33:48.530 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f5548241700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55401470c0 con 0x7f55400611d0 2022-01-10T01:33:48.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f5548241700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5540147360 con 0x7f554005ff60 2022-01-10T01:33:48.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f55467de700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55400b2710 0x7f554013fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f55457dc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55400611d0 0x7f554013f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f5545fdd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f554005ff60 0x7f55401433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f55467de700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55400b2710 0x7f554013fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42612/0 (socket says 172.21.15.36:42612) 2022-01-10T01:33:48.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f55467de700 1 -- 172.21.15.36:0/2897256222 learned_addr learned my addr 172.21.15.36:0/2897256222 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:48.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f55467de700 1 -- 172.21.15.36:0/2897256222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f554005ff60 msgr2=0x7f55401433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f55467de700 1 --2- 172.21.15.36:0/2897256222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f554005ff60 0x7f55401433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f55467de700 1 -- 172.21.15.36:0/2897256222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55400611d0 msgr2=0x7f554013f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f55467de700 1 --2- 172.21.15.36:0/2897256222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55400611d0 0x7f554013f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f55467de700 1 -- 172.21.15.36:0/2897256222 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5538009470 con 0x7f55400b2710 2022-01-10T01:33:48.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f55457dc700 1 --2- 172.21.15.36:0/2897256222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55400611d0 0x7f554013f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:48.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f5545fdd700 1 --2- 172.21.15.36:0/2897256222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f554005ff60 0x7f55401433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:48.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f55467de700 1 --2- 172.21.15.36:0/2897256222 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55400b2710 0x7f554013fd10 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f5534001800 tx=0x7f5538016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:48.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f5532ffd700 1 -- 172.21.15.36:0/2897256222 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55380032d0 con 0x7f55400b2710 2022-01-10T01:33:48.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f5532ffd700 1 -- 172.21.15.36:0/2897256222 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5538011b80 con 0x7f55400b2710 2022-01-10T01:33:48.535 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f5548241700 1 -- 172.21.15.36:0/2897256222 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5540146440 con 0x7f55400b2710 2022-01-10T01:33:48.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f5532ffd700 1 -- 172.21.15.36:0/2897256222 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5538021440 con 0x7f55400b2710 2022-01-10T01:33:48.536 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.517+0000 7f5548241700 1 -- 172.21.15.36:0/2897256222 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5540140200 con 0x7f55400b2710 2022-01-10T01:33:48.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.521+0000 7f5548241700 1 -- 172.21.15.36:0/2897256222 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5540143d10 con 0x7f55400b2710 2022-01-10T01:33:48.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.521+0000 7f5532ffd700 1 -- 172.21.15.36:0/2897256222 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5538027020 con 0x7f55400b2710 2022-01-10T01:33:48.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.521+0000 7f5532ffd700 1 --2- 172.21.15.36:0/2897256222 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5520053560 0x7f5520055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.521+0000 7f5532ffd700 1 -- 172.21.15.36:0/2897256222 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f553806cb90 con 0x7f55400b2710 2022-01-10T01:33:48.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.521+0000 7f5545fdd700 1 --2- 172.21.15.36:0/2897256222 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5520053560 0x7f5520055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.521+0000 7f5545fdd700 1 --2- 172.21.15.36:0/2897256222 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5520053560 0x7f5520055a20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f553c00d000 tx=0x7f553c007a20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:48.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.525+0000 7f5532ffd700 1 -- 172.21.15.36:0/2897256222 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5538043ba0 con 0x7f55400b2710 2022-01-10T01:33:48.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.653+0000 7f5548241700 1 -- 172.21.15.36:0/2897256222 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5540057350 con 0x7f55400b2710 2022-01-10T01:33:48.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.653+0000 7f5532ffd700 1 -- 172.21.15.36:0/2897256222 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v148) v1 ==== 100+0+10 (secure 0 0 0) 0x7f5538015070 con 0x7f55400b2710 2022-01-10T01:33:48.662 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:33:48.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.657+0000 7f5548241700 1 -- 172.21.15.36:0/2897256222 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5520053560 msgr2=0x7f5520055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.657+0000 7f5548241700 1 --2- 172.21.15.36:0/2897256222 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5520053560 0x7f5520055a20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f553c00d000 tx=0x7f553c007a20).stop 2022-01-10T01:33:48.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.657+0000 7f5548241700 1 -- 172.21.15.36:0/2897256222 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55400b2710 msgr2=0x7f554013fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.657+0000 7f5548241700 1 --2- 172.21.15.36:0/2897256222 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55400b2710 0x7f554013fd10 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f5534001800 tx=0x7f5538016000).stop 2022-01-10T01:33:48.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.657+0000 7f5548241700 1 -- 172.21.15.36:0/2897256222 shutdown_connections 2022-01-10T01:33:48.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.657+0000 7f5548241700 1 --2- 172.21.15.36:0/2897256222 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5520053560 0x7f5520055a20 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.657+0000 7f5548241700 1 --2- 172.21.15.36:0/2897256222 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f55400b2710 0x7f554013fd10 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.657+0000 7f5548241700 1 --2- 172.21.15.36:0/2897256222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55400611d0 0x7f554013f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.657+0000 7f5548241700 1 --2- 172.21.15.36:0/2897256222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f554005ff60 0x7f55401433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.657+0000 7f5548241700 1 -- 172.21.15.36:0/2897256222 >> 172.21.15.36:0/2897256222 conn(0x7f554005cf60 msgr2=0x7f554005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:48.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.657+0000 7f5548241700 1 -- 172.21.15.36:0/2897256222 shutdown_connections 2022-01-10T01:33:48.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.657+0000 7f5548241700 1 -- 172.21.15.36:0/2897256222 wait complete. 2022-01-10T01:33:48.675 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:33:48.675 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:48.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.777+0000 7f938229a700 1 Processor -- start 2022-01-10T01:33:48.785 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.777+0000 7f938229a700 1 -- start start 2022-01-10T01:33:48.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.777+0000 7f938229a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f937c0b1db0 0x7f937c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.777+0000 7f938229a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f937c1483a0 0x7f937c0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.777+0000 7f938229a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f937c0a70c0 0x7f937c144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.777+0000 7f938229a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937c0a90c0 con 0x7f937c0a70c0 2022-01-10T01:33:48.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.777+0000 7f938229a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937c0b0350 con 0x7f937c1483a0 2022-01-10T01:33:48.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.777+0000 7f938229a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0b05f0 con 0x7f937c0b1db0 2022-01-10T01:33:48.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f9380837700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f937c0a70c0 0x7f937c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f9380837700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f937c0a70c0 0x7f937c144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42620/0 (socket says 172.21.15.36:42620) 2022-01-10T01:33:48.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f9380837700 1 -- 172.21.15.36:0/30308234 learned_addr learned my addr 172.21.15.36:0/30308234 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:48.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f937b7fe700 1 --2- 172.21.15.36:0/30308234 >> v2:172.21.15.59:3300/0 conn(0x7f937c1483a0 0x7f937c0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f937bfff700 1 --2- 172.21.15.36:0/30308234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f937c0b1db0 0x7f937c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f9380837700 1 -- 172.21.15.36:0/30308234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f937c0b1db0 msgr2=0x7f937c0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:48.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f9380837700 1 --2- 172.21.15.36:0/30308234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f937c0b1db0 0x7f937c0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f9380837700 1 -- 172.21.15.36:0/30308234 >> v2:172.21.15.59:3300/0 conn(0x7f937c1483a0 msgr2=0x7f937c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:48.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f9380837700 1 --2- 172.21.15.36:0/30308234 >> v2:172.21.15.59:3300/0 conn(0x7f937c1483a0 0x7f937c0b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f9380837700 1 -- 172.21.15.36:0/30308234 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c0b0890 con 0x7f937c0a70c0 2022-01-10T01:33:48.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f937bfff700 1 --2- 172.21.15.36:0/30308234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f937c0b1db0 0x7f937c0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:33:48.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f937b7fe700 1 --2- 172.21.15.36:0/30308234 >> v2:172.21.15.59:3300/0 conn(0x7f937c1483a0 0x7f937c0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:33:48.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f9380837700 1 --2- 172.21.15.36:0/30308234 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f937c0a70c0 0x7f937c144720 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f936c002f70 tx=0x7f936c006eb0).ready entity=mon.0 client_cookie=37a488b447849e0d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:48.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f937affd700 1 -- 172.21.15.36:0/30308234 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f936c00d570 con 0x7f937c0a70c0 2022-01-10T01:33:48.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f937affd700 1 -- 172.21.15.36:0/30308234 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c000e90 con 0x7f937c0a70c0 2022-01-10T01:33:48.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f937affd700 1 -- 172.21.15.36:0/30308234 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f936c00d900 con 0x7f937c0a70c0 2022-01-10T01:33:48.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 -- 172.21.15.36:0/30308234 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f937c0a70c0 msgr2=0x7f937c144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 --2- 172.21.15.36:0/30308234 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f937c0a70c0 0x7f937c144720 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f936c002f70 tx=0x7f936c006eb0).stop 2022-01-10T01:33:48.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 -- 172.21.15.36:0/30308234 shutdown_connections 2022-01-10T01:33:48.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 --2- 172.21.15.36:0/30308234 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f937c0a70c0 0x7f937c144720 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 --2- 172.21.15.36:0/30308234 >> v2:172.21.15.59:3300/0 conn(0x7f937c1483a0 0x7f937c0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 --2- 172.21.15.36:0/30308234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f937c0b1db0 0x7f937c0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 -- 172.21.15.36:0/30308234 >> 172.21.15.36:0/30308234 conn(0x7f937c05f6b0 msgr2=0x7f937c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:48.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 -- 172.21.15.36:0/30308234 shutdown_connections 2022-01-10T01:33:48.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 -- 172.21.15.36:0/30308234 wait complete. 2022-01-10T01:33:48.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 Processor -- start 2022-01-10T01:33:48.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 -- start start 2022-01-10T01:33:48.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f937c0a70c0 0x7f937c1424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f937c0b1db0 0x7f937c157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f937c1483a0 0x7f937c143fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c148e80 con 0x7f937c0b1db0 2022-01-10T01:33:48.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c156820 con 0x7f937c0a70c0 2022-01-10T01:33:48.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f938229a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937c156ac0 con 0x7f937c1483a0 2022-01-10T01:33:48.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.781+0000 7f937b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f937c0b1db0 0x7f937c157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f937b7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f937c0b1db0 0x7f937c157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42624/0 (socket says 172.21.15.36:42624) 2022-01-10T01:33:48.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f937b7fe700 1 -- 172.21.15.36:0/249719206 learned_addr learned my addr 172.21.15.36:0/249719206 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:48.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f9380837700 1 --2- 172.21.15.36:0/249719206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f937c1483a0 0x7f937c143fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f937bfff700 1 --2- 172.21.15.36:0/249719206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f937c0a70c0 0x7f937c1424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f937b7fe700 1 -- 172.21.15.36:0/249719206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f937c1483a0 msgr2=0x7f937c143fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f937b7fe700 1 --2- 172.21.15.36:0/249719206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f937c1483a0 0x7f937c143fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f937b7fe700 1 -- 172.21.15.36:0/249719206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f937c0a70c0 msgr2=0x7f937c1424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f937b7fe700 1 --2- 172.21.15.36:0/249719206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f937c0a70c0 0x7f937c1424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f937b7fe700 1 -- 172.21.15.36:0/249719206 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c00b1e0 con 0x7f937c0b1db0 2022-01-10T01:33:48.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f937b7fe700 1 --2- 172.21.15.36:0/249719206 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f937c0b1db0 0x7f937c157200 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f9370007000 tx=0x7f9370008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:48.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f93797fa700 1 -- 172.21.15.36:0/249719206 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f937000ce50 con 0x7f937c0b1db0 2022-01-10T01:33:48.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f93797fa700 1 -- 172.21.15.36:0/249719206 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9370010580 con 0x7f937c0b1db0 2022-01-10T01:33:48.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f938229a700 1 -- 172.21.15.36:0/249719206 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f937c156d60 con 0x7f937c0b1db0 2022-01-10T01:33:48.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f93797fa700 1 -- 172.21.15.36:0/249719206 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93700108e0 con 0x7f937c0b1db0 2022-01-10T01:33:48.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f938229a700 1 -- 172.21.15.36:0/249719206 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f937c148b00 con 0x7f937c0b1db0 2022-01-10T01:33:48.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f938229a700 1 -- 172.21.15.36:0/249719206 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f937c156ef0 con 0x7f937c0b1db0 2022-01-10T01:33:48.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f93797fa700 1 -- 172.21.15.36:0/249719206 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9370010a40 con 0x7f937c0b1db0 2022-01-10T01:33:48.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f93797fa700 1 --2- 172.21.15.36:0/249719206 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f935c053620 0x7f935c055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:48.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f93797fa700 1 -- 172.21.15.36:0/249719206 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f937006b870 con 0x7f937c0b1db0 2022-01-10T01:33:48.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.785+0000 7f937bfff700 1 --2- 172.21.15.36:0/249719206 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f935c053620 0x7f935c055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:48.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.789+0000 7f937bfff700 1 --2- 172.21.15.36:0/249719206 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f935c053620 0x7f935c055ae0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f937400d000 tx=0x7f9374008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:48.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.789+0000 7f93797fa700 1 -- 172.21.15.36:0/249719206 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f93700427b0 con 0x7f937c0b1db0 2022-01-10T01:33:48.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.953+0000 7f938229a700 1 -- 172.21.15.36:0/249719206 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f937c0b0b30 con 0x7f937c0b1db0 2022-01-10T01:33:48.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.953+0000 7f93797fa700 1 -- 172.21.15.36:0/249719206 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f9370045dd0 con 0x7f937c0b1db0 2022-01-10T01:33:48.961 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:48.961 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":74,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/967641645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":967641645},{"type":"v1","addr":"172.21.15.36:6835","nonce":967641645}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/109014568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":109014568},{"type":"v1","addr":"172.21.15.36:6837","nonce":109014568}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:40.529600+0000","modified":"2022-01-10T01:33:41.697488+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8409},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8409":{"gid":8409,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/138807571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":138807571},{"type":"v1","addr":"172.21.15.59:6833","nonce":138807571}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2022-01-10T01:33:48.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.957+0000 7f938229a700 1 -- 172.21.15.36:0/249719206 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f935c053620 msgr2=0x7f935c055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.957+0000 7f938229a700 1 --2- 172.21.15.36:0/249719206 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f935c053620 0x7f935c055ae0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f937400d000 tx=0x7f9374008040).stop 2022-01-10T01:33:48.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.957+0000 7f938229a700 1 -- 172.21.15.36:0/249719206 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f937c0b1db0 msgr2=0x7f937c157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:48.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.957+0000 7f938229a700 1 --2- 172.21.15.36:0/249719206 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f937c0b1db0 0x7f937c157200 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f9370007000 tx=0x7f9370008040).stop 2022-01-10T01:33:48.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.957+0000 7f938229a700 1 -- 172.21.15.36:0/249719206 shutdown_connections 2022-01-10T01:33:48.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.957+0000 7f938229a700 1 --2- 172.21.15.36:0/249719206 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f935c053620 0x7f935c055ae0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.957+0000 7f938229a700 1 --2- 172.21.15.36:0/249719206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f937c1483a0 0x7f937c143fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.957+0000 7f938229a700 1 --2- 172.21.15.36:0/249719206 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f937c0b1db0 0x7f937c157200 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.957+0000 7f938229a700 1 --2- 172.21.15.36:0/249719206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f937c0a70c0 0x7f937c1424e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:48.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.957+0000 7f938229a700 1 -- 172.21.15.36:0/249719206 >> 172.21.15.36:0/249719206 conn(0x7f937c05f6b0 msgr2=0x7f937c0b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:48.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.957+0000 7f938229a700 1 -- 172.21.15.36:0/249719206 shutdown_connections 2022-01-10T01:33:48.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:48.957+0000 7f938229a700 1 -- 172.21.15.36:0/249719206 wait complete. 2022-01-10T01:33:48.967 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 74 2022-01-10T01:33:49.282 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:33:40.529600+0000', 'modified': '2022-01-10T01:33:41.697488+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8409}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8409': {'gid': 8409, 'name': 'b', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6833/138807571', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 138807571}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 138807571}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:33:49.283 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:33:49.283 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2022-01-10T01:33:49.401 INFO:teuthology.orchestra.run.smithi059.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":8409,"want_state":"up:active","state":"up:active","rank_uptime":8.8558714849999998,"mdsmap_epoch":74,"osdmap_epoch":148,"osdmap_epoch_barrier":148,"uptime":13.144316426} 2022-01-10T01:33:49.402 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 8409, "mdsmap_epoch": 74, "osdmap_epoch": 148, "osdmap_epoch_barrier": 148, "rank_uptime": 8.855871485, "state": "up:active", "uptime": 13.144316426, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:33:49.403 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:33:49.404 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2022-01-10T01:33:49.405 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi166.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2022-01-10T01:33:49.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:49.406 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:49.416 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:33:49.475 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:33:49.475 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:33:49.491 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:33:49.492 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:33:49.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:49.494 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:33:49.500 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:33:49.500 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:49.544 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:33:49.560 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:33:49.561 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:33:49.575 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:33:49.576 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:33:49.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:49.577 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:33:49.623 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:2022-01-10T01:33:49.621+0000 7f1a2ee1b080 -1 init, newargv = 0x556baf2a0d70 newargc=9 2022-01-10T01:33:49.623 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14792]: starting ceph client 2022-01-10T01:33:49.634 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14792]: starting fuse 2022-01-10T01:33:50.684 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:33:50.703 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:33:50.703 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:33:50.761 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:33:50.762 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:33:50.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:50.764 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:33:50.769 INFO:teuthology.orchestra.run.smithi166.stdout:52 2022-01-10T01:33:50.769 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:33:50.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:50.770 DEBUG:teuthology.orchestra.run.smithi166:> sudo python3 -c ' 2022-01-10T01:33:50.771 DEBUG:teuthology.orchestra.run.smithi166:> import glob 2022-01-10T01:33:50.771 DEBUG:teuthology.orchestra.run.smithi166:> import re 2022-01-10T01:33:50.772 DEBUG:teuthology.orchestra.run.smithi166:> import os 2022-01-10T01:33:50.772 DEBUG:teuthology.orchestra.run.smithi166:> import subprocess 2022-01-10T01:33:50.773 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:33:50.773 DEBUG:teuthology.orchestra.run.smithi166:> def find_socket(client_name): 2022-01-10T01:33:50.773 DEBUG:teuthology.orchestra.run.smithi166:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2022-01-10T01:33:50.774 DEBUG:teuthology.orchestra.run.smithi166:> files = glob.glob(asok_path) 2022-01-10T01:33:50.774 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:33:50.775 DEBUG:teuthology.orchestra.run.smithi166:> # Given a non-glob path, it better be there 2022-01-10T01:33:50.775 DEBUG:teuthology.orchestra.run.smithi166:> if "*" not in asok_path: 2022-01-10T01:33:50.776 DEBUG:teuthology.orchestra.run.smithi166:> assert(len(files) == 1) 2022-01-10T01:33:50.776 DEBUG:teuthology.orchestra.run.smithi166:> return files[0] 2022-01-10T01:33:50.776 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:33:50.777 DEBUG:teuthology.orchestra.run.smithi166:> for f in files: 2022-01-10T01:33:50.777 DEBUG:teuthology.orchestra.run.smithi166:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:33:50.778 DEBUG:teuthology.orchestra.run.smithi166:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:33:50.778 DEBUG:teuthology.orchestra.run.smithi166:> return f 2022-01-10T01:33:50.779 DEBUG:teuthology.orchestra.run.smithi166:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:33:50.779 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:33:50.779 DEBUG:teuthology.orchestra.run.smithi166:> print(find_socket("client.1")) 2022-01-10T01:33:50.780 DEBUG:teuthology.orchestra.run.smithi166:> ' 2022-01-10T01:33:50.819 INFO:teuthology.orchestra.run.smithi166.stdout:/var/run/ceph/ceph-client.1.14792.asok 2022-01-10T01:33:50.824 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14792.asok 2022-01-10T01:33:50.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:50.825 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14792.asok status 2022-01-10T01:33:50.910 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2022-01-10T01:33:50.911 INFO:teuthology.orchestra.run.smithi166.stdout: "metadata": { 2022-01-10T01:33:50.911 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:33:50.912 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:33:50.912 INFO:teuthology.orchestra.run.smithi166.stdout: "entity_id": "1", 2022-01-10T01:33:50.912 INFO:teuthology.orchestra.run.smithi166.stdout: "hostname": "smithi166", 2022-01-10T01:33:50.912 INFO:teuthology.orchestra.run.smithi166.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2022-01-10T01:33:50.912 INFO:teuthology.orchestra.run.smithi166.stdout: "pid": "14792", 2022-01-10T01:33:50.913 INFO:teuthology.orchestra.run.smithi166.stdout: "root": "/" 2022-01-10T01:33:50.913 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:33:50.913 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_count": 0, 2022-01-10T01:33:50.913 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_pinned_count": 0, 2022-01-10T01:33:50.914 INFO:teuthology.orchestra.run.smithi166.stdout: "id": 8634, 2022-01-10T01:33:50.914 INFO:teuthology.orchestra.run.smithi166.stdout: "inst": { 2022-01-10T01:33:50.914 INFO:teuthology.orchestra.run.smithi166.stdout: "name": { 2022-01-10T01:33:50.914 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "client", 2022-01-10T01:33:50.914 INFO:teuthology.orchestra.run.smithi166.stdout: "num": 8634 2022-01-10T01:33:50.915 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:33:50.915 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:33:50.915 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:33:50.915 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:33:50.916 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 1526013117 2022-01-10T01:33:50.916 INFO:teuthology.orchestra.run.smithi166.stdout: } 2022-01-10T01:33:50.916 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:33:50.916 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:33:50.916 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:33:50.917 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:33:50.917 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 1526013117 2022-01-10T01:33:50.917 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:33:50.917 INFO:teuthology.orchestra.run.smithi166.stdout: "inst_str": "client.8634 172.21.15.166:0/1526013117", 2022-01-10T01:33:50.918 INFO:teuthology.orchestra.run.smithi166.stdout: "addr_str": "172.21.15.166:0/1526013117", 2022-01-10T01:33:50.918 INFO:teuthology.orchestra.run.smithi166.stdout: "inode_count": 1, 2022-01-10T01:33:50.918 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_epoch": 74, 2022-01-10T01:33:50.918 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch": 148, 2022-01-10T01:33:50.918 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:33:50.919 INFO:teuthology.orchestra.run.smithi166.stdout: "blacklisted": false, 2022-01-10T01:33:50.919 INFO:teuthology.orchestra.run.smithi166.stdout: "fs_name": "cephfs" 2022-01-10T01:33:50.919 INFO:teuthology.orchestra.run.smithi166.stdout:} 2022-01-10T01:33:50.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:50.921 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:50.922 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:50.928 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:33:50.929 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:33:50.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:50.930 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:50.993 INFO:teuthology.orchestra.run:Running command with timeout 10800 2022-01-10T01:33:50.993 DEBUG:teuthology.orchestra.run.smithi139:> cd /home/ubuntu/cephtest/mnt.0 && sudo getfattr --only-values -n ceph.dir.rctime . 2022-01-10T01:33:51.035 INFO:teuthology.orchestra.run.smithi139.stdout:1641778430.990501121 2022-01-10T01:33:51.035 INFO:tasks.cephfs.test_misc:rctime = 1641778430.990501121 2022-01-10T01:33:51.036 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:33:51.036 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:51.058 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:51.081 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:51.102 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:51.123 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:33:51.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:51.124 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:51.125 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:51.155 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:33:51.156 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:33:51.157 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi139.front.sepia.ceph.com... 2022-01-10T01:33:51.157 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:33:51.158 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:51.172 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[15286]: fuse finished with error 0 and tester_r 0 2022-01-10T01:33:51.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:51.175 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:51.175 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:51.183 INFO:teuthology.orchestra.run.smithi139.stdout:ext2/ext3 2022-01-10T01:33:51.184 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:33:51.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:33:51.301 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:51.308 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:51.309 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:51.309 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:51.318 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:33:51.319 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:33:51.319 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi166.front.sepia.ceph.com... 2022-01-10T01:33:51.320 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:33:51.320 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:51.377 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14792]: fuse finished with error 0 and tester_r 0 2022-01-10T01:33:51.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:51.380 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:51.380 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:51.386 INFO:teuthology.orchestra.run.smithi166.stdout:ext2/ext3 2022-01-10T01:33:51.388 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:33:51.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:33:51.415 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:51.422 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:33:51.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.529+0000 7fa1d0b92700 1 Processor -- start 2022-01-10T01:33:51.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.529+0000 7fa1d0b92700 1 -- start start 2022-01-10T01:33:51.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa1cc0b6580 0x7fa1cc0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:51.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1cc0b43c0 0x7fa1cc0b6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:51.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc061d30 0x7fa1cc0621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:51.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1cc1440b0 con 0x7fa1cc0b6580 2022-01-10T01:33:51.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1cc0b6e50 con 0x7fa1cc0b43c0 2022-01-10T01:33:51.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc143b70 con 0x7fa1cc061d30 2022-01-10T01:33:51.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1ca59c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa1cc0b6580 0x7fa1cc0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:51.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1c9d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1cc0b43c0 0x7fa1cc0b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:51.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1c9d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1cc0b43c0 0x7fa1cc0b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:39264/0 (socket says 172.21.15.36:39264) 2022-01-10T01:33:51.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1c9d9b700 1 -- 172.21.15.36:0/3816862255 learned_addr learned my addr 172.21.15.36:0/3816862255 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:51.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1ca59c700 1 --2- 172.21.15.36:0/3816862255 >> v2:172.21.15.36:3300/0 conn(0x7fa1cc0b6580 0x7fa1cc0b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42632/0 (socket says 172.21.15.36:42632) 2022-01-10T01:33:51.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1cad9d700 1 --2- 172.21.15.36:0/3816862255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc061d30 0x7fa1cc0621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:51.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1c9d9b700 1 -- 172.21.15.36:0/3816862255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc061d30 msgr2=0x7fa1cc0621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:51.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1c9d9b700 1 --2- 172.21.15.36:0/3816862255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc061d30 0x7fa1cc0621a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:51.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1c9d9b700 1 -- 172.21.15.36:0/3816862255 >> v2:172.21.15.36:3300/0 conn(0x7fa1cc0b6580 msgr2=0x7fa1cc0b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:51.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1c9d9b700 1 --2- 172.21.15.36:0/3816862255 >> v2:172.21.15.36:3300/0 conn(0x7fa1cc0b6580 0x7fa1cc0b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:51.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1c9d9b700 1 -- 172.21.15.36:0/3816862255 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc143e10 con 0x7fa1cc0b43c0 2022-01-10T01:33:51.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1c9d9b700 1 --2- 172.21.15.36:0/3816862255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc0b43c0 0x7fa1cc0b6960 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fa1cc143120 tx=0x7fa1c0006eb0).ready entity=mon.1 client_cookie=9e25046aa7f93ab server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:51.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1c959a700 1 -- 172.21.15.36:0/3816862255 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1c000e610 con 0x7fa1cc0b43c0 2022-01-10T01:33:51.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1c959a700 1 -- 172.21.15.36:0/3816862255 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c0000e90 con 0x7fa1cc0b43c0 2022-01-10T01:33:51.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1c959a700 1 -- 172.21.15.36:0/3816862255 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1c000e9a0 con 0x7fa1cc0b43c0 2022-01-10T01:33:51.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 -- 172.21.15.36:0/3816862255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc0b43c0 msgr2=0x7fa1cc0b6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:51.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 --2- 172.21.15.36:0/3816862255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc0b43c0 0x7fa1cc0b6960 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fa1cc143120 tx=0x7fa1c0006eb0).stop 2022-01-10T01:33:51.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 -- 172.21.15.36:0/3816862255 shutdown_connections 2022-01-10T01:33:51.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 --2- 172.21.15.36:0/3816862255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc061d30 0x7fa1cc0621a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:51.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 --2- 172.21.15.36:0/3816862255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc0b43c0 0x7fa1cc0b6960 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:51.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 --2- 172.21.15.36:0/3816862255 >> v2:172.21.15.36:3300/0 conn(0x7fa1cc0b6580 0x7fa1cc0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:51.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 -- 172.21.15.36:0/3816862255 >> 172.21.15.36:0/3816862255 conn(0x7fa1cc05c490 msgr2=0x7fa1cc05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:51.550 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 -- 172.21.15.36:0/3816862255 shutdown_connections 2022-01-10T01:33:51.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.533+0000 7fa1d0b92700 1 -- 172.21.15.36:0/3816862255 wait complete. 2022-01-10T01:33:51.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.537+0000 7fa1d0b92700 1 Processor -- start 2022-01-10T01:33:51.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.537+0000 7fa1d0b92700 1 -- start start 2022-01-10T01:33:51.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.537+0000 7fa1d0b92700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc061d30 0x7fa1cc148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:51.551 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.537+0000 7fa1d0b92700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0b43c0 0x7fa1cc152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:51.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1d0b92700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1cc0b6580 0x7fa1cc1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:51.552 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1d0b92700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc148250 con 0x7fa1cc0b6580 2022-01-10T01:33:51.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1d0b92700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc129890 con 0x7fa1cc061d30 2022-01-10T01:33:51.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1d0b92700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc129b30 con 0x7fa1cc0b43c0 2022-01-10T01:33:51.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1cad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1cc0b6580 0x7fa1cc1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:51.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1ca59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc061d30 0x7fa1cc148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:51.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1cad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1cc0b6580 0x7fa1cc1529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42640/0 (socket says 172.21.15.36:42640) 2022-01-10T01:33:51.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1cad9d700 1 -- 172.21.15.36:0/4071784073 learned_addr learned my addr 172.21.15.36:0/4071784073 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:51.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1c9d9b700 1 --2- 172.21.15.36:0/4071784073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0b43c0 0x7fa1cc152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:51.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1cad9d700 1 -- 172.21.15.36:0/4071784073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0b43c0 msgr2=0x7fa1cc152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:51.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1cad9d700 1 --2- 172.21.15.36:0/4071784073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0b43c0 0x7fa1cc152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:51.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1cad9d700 1 -- 172.21.15.36:0/4071784073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc061d30 msgr2=0x7fa1cc148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:51.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1cad9d700 1 --2- 172.21.15.36:0/4071784073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc061d30 0x7fa1cc148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:51.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1cad9d700 1 -- 172.21.15.36:0/4071784073 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c000b1e0 con 0x7fa1cc0b6580 2022-01-10T01:33:51.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1cad9d700 1 --2- 172.21.15.36:0/4071784073 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1cc0b6580 0x7fa1cc1529f0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7fa1c4006e00 tx=0x7fa1c40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:51.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1bb7fe700 1 -- 172.21.15.36:0/4071784073 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1c400c670 con 0x7fa1cc0b6580 2022-01-10T01:33:51.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1bb7fe700 1 -- 172.21.15.36:0/4071784073 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c400c7d0 con 0x7fa1cc0b6580 2022-01-10T01:33:51.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1d0b92700 1 -- 172.21.15.36:0/4071784073 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1cc129dd0 con 0x7fa1cc0b6580 2022-01-10T01:33:51.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1bb7fe700 1 -- 172.21.15.36:0/4071784073 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1c400cb30 con 0x7fa1cc0b6580 2022-01-10T01:33:51.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1d0b92700 1 -- 172.21.15.36:0/4071784073 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1cc140800 con 0x7fa1cc0b6580 2022-01-10T01:33:51.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.541+0000 7fa1d0b92700 1 -- 172.21.15.36:0/4071784073 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1cc0b3cb0 con 0x7fa1cc0b6580 2022-01-10T01:33:51.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.545+0000 7fa1bb7fe700 1 -- 172.21.15.36:0/4071784073 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa1c400cc90 con 0x7fa1cc0b6580 2022-01-10T01:33:51.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.545+0000 7fa1bb7fe700 1 --2- 172.21.15.36:0/4071784073 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa1a8053590 0x7fa1a8055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:51.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.545+0000 7fa1bb7fe700 1 -- 172.21.15.36:0/4071784073 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa1c406bd20 con 0x7fa1cc0b6580 2022-01-10T01:33:51.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.545+0000 7fa1ca59c700 1 --2- 172.21.15.36:0/4071784073 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa1a8053590 0x7fa1a8055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:51.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.545+0000 7fa1ca59c700 1 --2- 172.21.15.36:0/4071784073 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa1a8053590 0x7fa1a8055a50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fa1bc00b000 tx=0x7fa1bc006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:51.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.553+0000 7fa1bb7fe700 1 -- 172.21.15.36:0/4071784073 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa1c4042d30 con 0x7fa1cc0b6580 2022-01-10T01:33:51.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.685+0000 7fa1d0b92700 1 -- 172.21.15.36:0/4071784073 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa1cc129f60 con 0x7fa1cc0b6580 2022-01-10T01:33:51.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.685+0000 7fa1bb7fe700 1 -- 172.21.15.36:0/4071784073 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v148) v1 ==== 81+0+34051 (secure 0 0 0) 0x7fa1c4046350 con 0x7fa1cc0b6580 2022-01-10T01:33:51.694 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:51.694 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:33:51.695 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 148, 2022-01-10T01:33:51.695 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:33:51.695 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:33:51.695 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:33:40.529449+0000", 2022-01-10T01:33:51.696 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:33:51.696 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:33:51.696 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:33:51.696 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:33:51.696 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:33:51.697 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:33:51.697 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:33:51.697 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:33:51.697 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:33:51.698 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:51.698 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:33:51.698 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:33:51.698 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:33:51.698 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:33:51.699 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:33:51.699 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 28, 2022-01-10T01:33:51.699 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:33:51.699 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:33:51.700 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:33:51.700 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:33:51.700 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:33:51.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.700 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:33:51.701 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:33:51.701 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:33:51.701 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:51.701 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:51.702 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:51.702 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:51.702 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:51.702 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:51.703 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:51.703 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:51.703 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:33:51.703 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:33:51.703 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:33:51.704 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:33:51.704 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:33:51.704 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:51.704 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:51.704 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:51.705 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:51.705 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:51.705 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:51.706 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:51.706 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.706 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:33:51.706 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:51.707 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:51.707 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:51.707 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:51.707 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:51.708 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:51.708 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:51.708 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:51.708 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:51.708 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:51.709 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:51.709 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:51.709 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:51.709 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:51.710 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:51.710 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:51.710 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:51.710 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:51.710 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:51.711 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:51.711 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:51.711 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:51.711 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:51.711 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:51.712 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:51.712 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:51.712 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.712 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:51.713 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:51.713 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:51.713 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:51.713 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:51.713 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:51.714 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:51.714 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:51.714 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:51.714 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:51.715 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:51.715 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:33:51.715 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:33:51.715 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:33:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:33:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:33:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:33:51.717 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:51.718 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:33:51.719 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:33:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:33:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:33:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:33:51.720 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:51.721 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.722 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:33:51.723 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:51.723 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:51.723 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:51.723 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:51.724 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:51.724 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:51.724 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:51.724 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:51.724 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:51.725 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:51.725 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:51.725 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:51.725 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:51.725 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:51.726 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:51.726 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:51.726 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:51.726 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:51.727 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:51.727 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:51.727 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:51.727 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:51.728 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:51.729 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:51.730 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:33:51.731 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:33:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.732 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 27, 2022-01-10T01:33:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_metadata", 2022-01-10T01:33:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:33:39.011334+0000", 2022-01-10T01:33:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:51.733 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:51.734 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:51.734 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:51.734 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:51.734 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:51.735 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:51.735 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:51.735 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:33:51.735 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:33:51.735 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:33:51.736 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:33:51.736 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:33:51.736 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:51.736 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:51.736 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:51.737 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:51.737 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:51.737 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:51.737 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "148", 2022-01-10T01:33:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:51.738 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:51.739 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:51.740 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:51.741 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:51.742 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:51.743 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:51.744 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.744 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:51.744 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:51.744 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:51.744 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:51.745 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:51.745 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:51.745 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:51.745 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:51.746 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:33:51.747 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_bias": 4, 2022-01-10T01:33:51.747 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 16, 2022-01-10T01:33:51.747 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_priority": 5 2022-01-10T01:33:51.747 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.747 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:51.748 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:33:51.748 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": "cephfs" 2022-01-10T01:33:51.748 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.748 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.749 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.749 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.749 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 28, 2022-01-10T01:33:51.749 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_data", 2022-01-10T01:33:51.749 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:33:39.792400+0000", 2022-01-10T01:33:51.750 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:51.750 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:51.750 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:51.750 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:51.751 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:51.751 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:51.751 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:51.752 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:51.752 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:33:51.752 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:33:51.753 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:33:51.753 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:33:51.753 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:33:51.753 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:51.754 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:51.754 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:51.754 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:51.754 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:51.755 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:51.755 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:51.755 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.755 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "148", 2022-01-10T01:33:51.755 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:51.756 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:51.756 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:51.756 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:51.756 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:51.757 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:51.757 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:51.757 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:51.757 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:51.757 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:51.758 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:51.758 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:51.758 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:51.758 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:51.758 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:51.759 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:51.759 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:51.759 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:51.759 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:51.760 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:51.760 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:51.760 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:51.760 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:51.760 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:51.761 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:51.761 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:51.761 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.761 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:51.761 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:51.762 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:51.762 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:51.762 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:51.762 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:51.763 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:51.763 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:51.763 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:51.763 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:51.764 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:51.764 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:33:51.764 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:51.765 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:33:51.765 INFO:teuthology.orchestra.run.smithi036.stdout: "data": "cephfs" 2022-01-10T01:33:51.765 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.765 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.766 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.766 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:51.766 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:33:51.767 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.767 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:33:51.767 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:33:51.767 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:51.768 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:51.768 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:51.768 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:51.768 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:51.769 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:51.769 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:51.769 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 146, 2022-01-10T01:33:51.769 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:51.770 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:51.770 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:51.770 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.770 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.771 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.771 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:33:51.771 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:51.772 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.772 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.772 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.772 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:33:51.773 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:51.773 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.773 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.773 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.774 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:51.774 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.774 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.774 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.775 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:33:51.775 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:51.775 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.775 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.776 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.776 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:33:51.776 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:51.776 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.777 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.777 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.777 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:51.777 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.778 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.778 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.778 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:33:51.778 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:51.779 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.779 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.779 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.779 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:33:51.780 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:51.780 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.780 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.780 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.781 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:51.781 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.781 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.781 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.782 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:33:51.782 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:51.782 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.782 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.783 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.783 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:33:51.783 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:51.783 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.784 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.784 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.784 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:33:51.784 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:33:51.785 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:33:51.785 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:33:51.785 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:51.785 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:51.786 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:51.786 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.786 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.787 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.787 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:33:51.787 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:33:51.787 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:51.788 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:51.788 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:51.788 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:51.788 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:51.788 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:51.789 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:51.789 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 146, 2022-01-10T01:33:51.789 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:51.789 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:51.790 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:51.790 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.790 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.790 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.791 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:33:51.791 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:51.791 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.791 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.792 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.792 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:33:51.792 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:51.792 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.792 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.793 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.793 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:51.793 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.793 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.794 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.794 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:33:51.794 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:51.794 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.795 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.795 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.795 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:33:51.795 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:51.795 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.796 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.796 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.796 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:51.796 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.797 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.797 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.797 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:33:51.797 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:51.797 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.798 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.798 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.798 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:33:51.798 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:51.799 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.799 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.799 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.799 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:51.800 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.800 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.800 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.800 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:33:51.801 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:51.801 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.801 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.801 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.802 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:33:51.802 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:51.802 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.802 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.802 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.803 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:33:51.803 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:33:51.803 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:33:51.804 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:33:51.804 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:51.804 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:51.804 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:51.804 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.805 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.805 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.805 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:33:51.805 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:33:51.806 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:51.806 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:51.806 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:51.806 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:51.807 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:51.807 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:51.807 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:51.807 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 146, 2022-01-10T01:33:51.807 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:51.808 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:51.808 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:51.808 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.808 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.809 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.809 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:33:51.809 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:51.809 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.809 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.810 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.810 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:33:51.810 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:51.810 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.811 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.811 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.811 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:51.811 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.812 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.812 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.812 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:33:51.812 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:51.812 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.813 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.813 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.813 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:33:51.813 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:51.813 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.814 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.814 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.814 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:51.814 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.815 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.815 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.815 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:33:51.815 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:51.815 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.816 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.816 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.816 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:33:51.816 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:51.817 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.817 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.817 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.817 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:51.817 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.818 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.818 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.818 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:33:51.818 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:51.819 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.819 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.819 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.819 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:33:51.820 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:51.820 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.820 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.820 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.820 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:33:51.821 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:33:51.821 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:33:51.821 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:33:51.821 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:51.822 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:51.822 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:51.822 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.822 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.823 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.823 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:33:51.823 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:33:51.823 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:51.824 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:51.824 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:51.824 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:51.824 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:51.825 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:51.825 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:51.825 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 145, 2022-01-10T01:33:51.825 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:51.826 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:51.826 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:51.826 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.826 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.826 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.827 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:33:51.827 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:51.827 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.827 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.828 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.828 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:33:51.828 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:51.828 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.829 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.829 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.829 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:51.829 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.830 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.830 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:33:51.830 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:51.831 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.831 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.831 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.831 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:33:51.831 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:51.832 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.832 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.832 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.832 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:51.833 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.833 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.833 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:33:51.834 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:51.834 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.834 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.834 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.835 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:33:51.835 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:51.835 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.835 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.836 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.836 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:51.836 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.836 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.837 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.837 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:33:51.837 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:51.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.838 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.838 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:33:51.838 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:51.838 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.839 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.839 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.839 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:33:51.839 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:33:51.840 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:33:51.840 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:33:51.840 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:51.840 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:51.841 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:51.841 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.841 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.841 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.841 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:33:51.842 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:33:51.842 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:51.842 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:51.843 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:51.843 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:51.843 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:51.843 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:51.844 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:51.844 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 145, 2022-01-10T01:33:51.844 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:51.844 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:51.845 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:51.845 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.845 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.845 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.845 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:33:51.846 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:51.846 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.846 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.847 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:33:51.847 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:51.847 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.847 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.847 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.848 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:51.848 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.848 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.848 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.849 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:33:51.849 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:51.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.850 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.850 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.850 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:33:51.850 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:51.850 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.851 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.851 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.851 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:51.851 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.852 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.852 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:33:51.852 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:51.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.853 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.853 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.853 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:33:51.853 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:51.854 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.854 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.854 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.854 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:51.855 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.855 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.855 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:33:51.855 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:51.856 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.856 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.856 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.856 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:33:51.857 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:51.857 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.857 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.857 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.858 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:33:51.858 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:33:51.858 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:33:51.858 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:33:51.859 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:51.859 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:51.859 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:51.859 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.860 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.860 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.860 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:33:51.860 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:33:51.860 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:51.861 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:51.861 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:51.861 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:51.861 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:51.862 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:51.862 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:51.862 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 146, 2022-01-10T01:33:51.862 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:51.862 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:51.863 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:51.863 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.863 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.863 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.864 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:33:51.864 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:51.864 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.864 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.864 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.865 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:33:51.865 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:51.865 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.865 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.866 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.866 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:51.866 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.866 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.867 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.867 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:33:51.867 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:51.867 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.868 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.868 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.868 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:33:51.868 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:51.868 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.869 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.869 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:51.869 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.870 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.870 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.870 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:33:51.870 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:51.871 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.871 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.871 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.871 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:33:51.872 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:51.872 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.872 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.873 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:51.873 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.873 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.873 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.873 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:33:51.874 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:51.874 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.874 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.874 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.875 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:33:51.875 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:51.875 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.875 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.876 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:33:51.876 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:33:51.876 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:33:51.877 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:33:51.877 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:51.877 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:51.877 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:51.878 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.878 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.878 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:33:51.879 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:33:51.879 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:51.879 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:51.879 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:51.880 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:51.880 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:51.880 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:51.880 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:51.881 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 146, 2022-01-10T01:33:51.881 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:51.881 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:51.881 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:51.881 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.882 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.882 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.882 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:33:51.882 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:51.883 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.883 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.883 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.883 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:33:51.884 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:51.884 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.884 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.884 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.884 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:51.885 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.885 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.885 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.885 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:33:51.885 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:51.886 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.886 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.886 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.886 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:33:51.887 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:51.887 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.887 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.887 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.888 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:51.888 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.888 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.888 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.889 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:33:51.889 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:51.889 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.889 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.890 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.890 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:33:51.890 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:51.890 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.891 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.891 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.891 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:51.891 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.892 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.892 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.892 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:33:51.892 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:51.893 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.893 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.893 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.893 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:33:51.894 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:51.894 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.894 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.894 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.894 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:33:51.895 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:33:51.895 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:33:51.895 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:33:51.895 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:51.896 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:51.896 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:51.896 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.896 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.897 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.897 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:33:51.897 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:33:51.897 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:51.898 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:51.898 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:51.898 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:51.898 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:51.898 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:51.899 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:51.899 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 146, 2022-01-10T01:33:51.899 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:51.899 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:51.899 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:51.900 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.900 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.900 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.900 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:33:51.901 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:51.901 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.901 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.901 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.901 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:33:51.902 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:51.902 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.902 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.902 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.903 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:51.903 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.903 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.903 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.904 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:33:51.904 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:51.904 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.904 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.904 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.905 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:33:51.905 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:51.905 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.905 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.906 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.906 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:51.906 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.907 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.907 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.907 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:33:51.907 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:51.908 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.908 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.908 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.908 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:33:51.909 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:51.909 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.909 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.909 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.910 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:51.910 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:51.910 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.910 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:51.911 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:33:51.911 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:51.911 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.911 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.912 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:51.912 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:33:51.912 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:51.913 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.913 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.913 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.913 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:33:51.913 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:33:51.914 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:33:51.914 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:33:51.914 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:51.914 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:51.915 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:51.915 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:51.915 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.916 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:51.916 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:33:51.916 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.916 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:33:51.917 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:51.917 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:51.917 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:51.917 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:51.917 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:51.918 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:33:51.918 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:51.918 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.918 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.919 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:33:51.919 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:51.919 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:51.919 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:51.920 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:51.920 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:51.920 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:33:51.920 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:51.921 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.921 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.921 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:33:51.921 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:51.921 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:51.922 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:51.922 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:51.922 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:51.922 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:33:51.923 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:51.923 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.923 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.923 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:33:51.924 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:51.924 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:51.924 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:51.924 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:51.925 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:51.925 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:33:51.925 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:51.925 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.925 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.926 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:33:51.926 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:51.926 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:51.926 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:51.927 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:51.927 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:51.927 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:33:51.927 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:51.928 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.928 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.928 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:33:51.928 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:51.929 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:51.929 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:51.929 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:51.929 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:51.929 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:33:51.930 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:51.930 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.930 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.930 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:33:51.931 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:51.931 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:51.931 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:51.931 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:51.932 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:51.932 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:33:51.932 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:51.932 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.933 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:51.933 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:33:51.933 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:51.933 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:51.934 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:51.934 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:51.934 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:51.934 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:33:51.935 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:51.935 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.935 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:51.935 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:33:51.935 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:33:51.936 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:33:51.936 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:33:51.936 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2022-01-10T01:33:51.936 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:33:51.937 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:33:51.937 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:33:51.937 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:33:51.937 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:33:51.938 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:33:51.938 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:33:51.938 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:33:51.938 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:33:51.938 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:33:51.939 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:33:51.939 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:33:51.939 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.939 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:33:51.940 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:33:51.940 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:33:51.940 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:33:51.940 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:33:51.941 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:33:51.941 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:33:51.941 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:51.941 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:51.942 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:33:51.942 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:33:51.942 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:33:51.942 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:33:51.943 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:33:51.943 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:33:51.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.689+0000 7fa1d0b92700 1 -- 172.21.15.36:0/4071784073 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa1a8053590 msgr2=0x7fa1a8055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:51.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.689+0000 7fa1d0b92700 1 --2- 172.21.15.36:0/4071784073 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa1a8053590 0x7fa1a8055a50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fa1bc00b000 tx=0x7fa1bc006df0).stop 2022-01-10T01:33:51.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.689+0000 7fa1d0b92700 1 -- 172.21.15.36:0/4071784073 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1cc0b6580 msgr2=0x7fa1cc1529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:51.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.689+0000 7fa1d0b92700 1 --2- 172.21.15.36:0/4071784073 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1cc0b6580 0x7fa1cc1529f0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7fa1c4006e00 tx=0x7fa1c40091d0).stop 2022-01-10T01:33:51.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.689+0000 7fa1d0b92700 1 -- 172.21.15.36:0/4071784073 shutdown_connections 2022-01-10T01:33:51.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.689+0000 7fa1d0b92700 1 --2- 172.21.15.36:0/4071784073 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa1a8053590 0x7fa1a8055a50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:51.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.689+0000 7fa1d0b92700 1 --2- 172.21.15.36:0/4071784073 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1cc0b6580 0x7fa1cc1529f0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:51.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.689+0000 7fa1d0b92700 1 --2- 172.21.15.36:0/4071784073 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0b43c0 0x7fa1cc152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:51.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.689+0000 7fa1d0b92700 1 --2- 172.21.15.36:0/4071784073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc061d30 0x7fa1cc148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:51.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.689+0000 7fa1d0b92700 1 -- 172.21.15.36:0/4071784073 >> 172.21.15.36:0/4071784073 conn(0x7fa1cc05c490 msgr2=0x7fa1cc142140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:51.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.689+0000 7fa1d0b92700 1 -- 172.21.15.36:0/4071784073 shutdown_connections 2022-01-10T01:33:51.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:51.689+0000 7fa1d0b92700 1 -- 172.21.15.36:0/4071784073 wait complete. 2022-01-10T01:33:51.949 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:52.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.053+0000 7ff11d92d700 1 Processor -- start 2022-01-10T01:33:52.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.053+0000 7ff11d92d700 1 -- start start 2022-01-10T01:33:52.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11d92d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff1180af3c0 0x7ff1180b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11d92d700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1180aa4a0 con 0x7ff11805c560 2022-01-10T01:33:52.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11d92d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff11805fb80 con 0x7ff1180601a0 2022-01-10T01:33:52.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11d92d700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1180b1450 con 0x7ff1180af3c0 2022-01-10T01:33:52.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11c92b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff1180af3c0 0x7ff1180b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11d12c700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff11805c560 0x7ff1180a8bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40442/0 (socket says 172.21.15.36:40442) 2022-01-10T01:33:52.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11d12c700 1 -- 172.21.15.36:0/2807719488 learned_addr learned my addr 172.21.15.36:0/2807719488 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:52.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11c92b700 1 -- 172.21.15.36:0/2807719488 >> v1:172.21.15.59:6789/0 conn(0x7ff1180601a0 legacy=0x7ff118144450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff1177fe700 1 -- 172.21.15.36:0/2807719488 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143490684 0 0) 0x7ff11805fb80 con 0x7ff1180601a0 2022-01-10T01:33:52.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11c92b700 1 -- 172.21.15.36:0/2807719488 >> v1:172.21.15.36:6789/0 conn(0x7ff11805c560 legacy=0x7ff1180a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11c92b700 1 -- 172.21.15.36:0/2807719488 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11805f6b0 con 0x7ff1180af3c0 2022-01-10T01:33:52.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11c92b700 1 --2- 172.21.15.36:0/2807719488 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1180af3c0 0x7ff1180b0cb0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7ff110001490 tx=0x7ff10c006df0).ready entity=mon.0 client_cookie=f2e989a338f43f11 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:52.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff1177fe700 1 -- 172.21.15.36:0/2807719488 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff10c00d5c0 con 0x7ff1180af3c0 2022-01-10T01:33:52.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff1177fe700 1 -- 172.21.15.36:0/2807719488 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c000e90 con 0x7ff1180af3c0 2022-01-10T01:33:52.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff1177fe700 1 -- 172.21.15.36:0/2807719488 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff10c00d910 con 0x7ff1180af3c0 2022-01-10T01:33:52.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11d92d700 1 -- 172.21.15.36:0/2807719488 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1180af3c0 msgr2=0x7ff1180b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11d92d700 1 --2- 172.21.15.36:0/2807719488 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1180af3c0 0x7ff1180b0cb0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7ff110001490 tx=0x7ff10c006df0).stop 2022-01-10T01:33:52.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11d92d700 1 -- 172.21.15.36:0/2807719488 shutdown_connections 2022-01-10T01:33:52.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11d92d700 1 --2- 172.21.15.36:0/2807719488 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff1180af3c0 0x7ff1180b0cb0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11d92d700 1 -- 172.21.15.36:0/2807719488 >> 172.21.15.36:0/2807719488 conn(0x7ff118061140 msgr2=0x7ff118062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:52.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11d92d700 1 -- 172.21.15.36:0/2807719488 shutdown_connections 2022-01-10T01:33:52.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.057+0000 7ff11d92d700 1 -- 172.21.15.36:0/2807719488 wait complete. 2022-01-10T01:33:52.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.061+0000 7ff11d92d700 1 Processor -- start 2022-01-10T01:33:52.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.061+0000 7ff11d92d700 1 -- start start 2022-01-10T01:33:52.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.061+0000 7ff11d92d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff11805c560 0x7ff1181480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.061+0000 7ff11d92d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1180601a0 0x7ff118153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.061+0000 7ff11d92d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1180af3c0 0x7ff118154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.061+0000 7ff11d92d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff118064a60 con 0x7ff11805c560 2022-01-10T01:33:52.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.061+0000 7ff11d92d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180ac680 con 0x7ff1180af3c0 2022-01-10T01:33:52.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.061+0000 7ff11d92d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1180639e0 con 0x7ff1180601a0 2022-01-10T01:33:52.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.061+0000 7ff11c92b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff11805c560 0x7ff1181480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.061+0000 7ff11c92b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff11805c560 0x7ff1181480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42650/0 (socket says 172.21.15.36:42650) 2022-01-10T01:33:52.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.061+0000 7ff11c92b700 1 -- 172.21.15.36:0/2355140516 learned_addr learned my addr 172.21.15.36:0/2355140516 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:52.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff117fff700 1 --2- 172.21.15.36:0/2355140516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1180601a0 0x7ff118153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff11d12c700 1 --2- 172.21.15.36:0/2355140516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1180af3c0 0x7ff118154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff11c92b700 1 -- 172.21.15.36:0/2355140516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1180601a0 msgr2=0x7ff118153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff11c92b700 1 --2- 172.21.15.36:0/2355140516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1180601a0 0x7ff118153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff11c92b700 1 -- 172.21.15.36:0/2355140516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1180af3c0 msgr2=0x7ff118154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff11c92b700 1 --2- 172.21.15.36:0/2355140516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1180af3c0 0x7ff118154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff11c92b700 1 -- 172.21.15.36:0/2355140516 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c00b180 con 0x7ff11805c560 2022-01-10T01:33:52.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff11c92b700 1 --2- 172.21.15.36:0/2355140516 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff11805c560 0x7ff1181480a0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7ff110001490 tx=0x7ff10c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:52.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff115ffb700 1 -- 172.21.15.36:0/2355140516 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff10c016070 con 0x7ff11805c560 2022-01-10T01:33:52.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff115ffb700 1 -- 172.21.15.36:0/2355140516 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10c00de40 con 0x7ff11805c560 2022-01-10T01:33:52.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff11d92d700 1 -- 172.21.15.36:0/2355140516 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff118063c80 con 0x7ff11805c560 2022-01-10T01:33:52.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff115ffb700 1 -- 172.21.15.36:0/2355140516 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff10c013de0 con 0x7ff11805c560 2022-01-10T01:33:52.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff11d92d700 1 -- 172.21.15.36:0/2355140516 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1181424c0 con 0x7ff11805c560 2022-01-10T01:33:52.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff115ffb700 1 -- 172.21.15.36:0/2355140516 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff10c025030 con 0x7ff11805c560 2022-01-10T01:33:52.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.065+0000 7ff101ffb700 1 -- 172.21.15.36:0/2355140516 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff118064120 con 0x7ff11805c560 2022-01-10T01:33:52.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.069+0000 7ff115ffb700 1 --2- 172.21.15.36:0/2355140516 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff0f8053680 0x7ff0f8055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.069+0000 7ff115ffb700 1 -- 172.21.15.36:0/2355140516 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff10c06cb70 con 0x7ff11805c560 2022-01-10T01:33:52.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.069+0000 7ff117fff700 1 --2- 172.21.15.36:0/2355140516 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff0f8053680 0x7ff0f8055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.069+0000 7ff117fff700 1 --2- 172.21.15.36:0/2355140516 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff0f8053680 0x7ff0f8055b40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7ff10400d000 tx=0x7ff1040079b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:52.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.073+0000 7ff115ffb700 1 -- 172.21.15.36:0/2355140516 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff10c043a70 con 0x7ff11805c560 2022-01-10T01:33:52.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.237+0000 7ff101ffb700 1 -- 172.21.15.36:0/2355140516 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff118057350 con 0x7ff11805c560 2022-01-10T01:33:52.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.237+0000 7ff115ffb700 1 -- 172.21.15.36:0/2355140516 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+2486 (secure 0 0 0) 0x7ff10c023020 con 0x7ff11805c560 2022-01-10T01:33:52.247 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:52.247 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":74,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/967641645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":967641645},{"type":"v1","addr":"172.21.15.36:6835","nonce":967641645}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/109014568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":109014568},{"type":"v1","addr":"172.21.15.36:6837","nonce":109014568}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:40.529600+0000","modified":"2022-01-10T01:33:41.697488+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8409},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8409":{"gid":8409,"name":"b","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6833/138807571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":138807571},{"type":"v1","addr":"172.21.15.59:6833","nonce":138807571}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2022-01-10T01:33:52.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.241+0000 7ff101ffb700 1 -- 172.21.15.36:0/2355140516 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff0f8053680 msgr2=0x7ff0f8055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.241+0000 7ff101ffb700 1 --2- 172.21.15.36:0/2355140516 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff0f8053680 0x7ff0f8055b40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7ff10400d000 tx=0x7ff1040079b0).stop 2022-01-10T01:33:52.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.241+0000 7ff101ffb700 1 -- 172.21.15.36:0/2355140516 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff11805c560 msgr2=0x7ff1181480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.241+0000 7ff101ffb700 1 --2- 172.21.15.36:0/2355140516 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff11805c560 0x7ff1181480a0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7ff110001490 tx=0x7ff10c014000).stop 2022-01-10T01:33:52.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.241+0000 7ff101ffb700 1 -- 172.21.15.36:0/2355140516 shutdown_connections 2022-01-10T01:33:52.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.241+0000 7ff101ffb700 1 --2- 172.21.15.36:0/2355140516 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff0f8053680 0x7ff0f8055b40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.241+0000 7ff101ffb700 1 --2- 172.21.15.36:0/2355140516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1180af3c0 0x7ff118154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.241+0000 7ff101ffb700 1 --2- 172.21.15.36:0/2355140516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1180601a0 0x7ff118153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.241+0000 7ff101ffb700 1 --2- 172.21.15.36:0/2355140516 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff11805c560 0x7ff1181480a0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.241+0000 7ff101ffb700 1 -- 172.21.15.36:0/2355140516 >> 172.21.15.36:0/2355140516 conn(0x7ff118061140 msgr2=0x7ff11813f660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:52.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.241+0000 7ff101ffb700 1 -- 172.21.15.36:0/2355140516 shutdown_connections 2022-01-10T01:33:52.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.241+0000 7ff101ffb700 1 -- 172.21.15.36:0/2355140516 wait complete. 2022-01-10T01:33:52.253 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 74 2022-01-10T01:33:52.259 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2022-01-10T01:33:52.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 Processor -- start 2022-01-10T01:33:52.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 -- start start 2022-01-10T01:33:52.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8a5c0b2580 0x7f8a5c14ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a5c0a8ac0 0x7f8a5c14b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5c0a70c0 con 0x7f8a5c0b0010 2022-01-10T01:33:52.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5c0a72f0 con 0x7f8a5c0b2580 2022-01-10T01:33:52.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c0a7590 con 0x7f8a5c0a8ac0 2022-01-10T01:33:52.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a5bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8a5c0b2580 0x7f8a5c14ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a60dae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a5c0a8ac0 0x7f8a5c14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a537fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8a5c0b0010 0x7f8a5c0a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:58130/0 (socket says 172.21.15.36:58130) 2022-01-10T01:33:52.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a537fe700 1 -- 172.21.15.36:0/2074132843 learned_addr learned my addr 172.21.15.36:0/2074132843 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:52.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a5bfff700 1 -- 172.21.15.36:0/2074132843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a5c0a8ac0 msgr2=0x7f8a5c14b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:52.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a5bfff700 1 --2- 172.21.15.36:0/2074132843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a5c0a8ac0 0x7f8a5c14b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a5bfff700 1 -- 172.21.15.36:0/2074132843 >> v1:172.21.15.59:6789/0 conn(0x7f8a5c0b0010 legacy=0x7f8a5c0a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a5bfff700 1 -- 172.21.15.36:0/2074132843 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5c0a7830 con 0x7f8a5c0b2580 2022-01-10T01:33:52.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a5bfff700 1 --2- 172.21.15.36:0/2074132843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a5c0b2580 0x7f8a5c14ae40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f8a4c002f70 tx=0x7f8a4c006df0).ready entity=mon.1 client_cookie=aad5ac4bb8f12cbf server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:52.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a5b7fe700 1 -- 172.21.15.36:0/2074132843 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a4c00d570 con 0x7f8a5c0b2580 2022-01-10T01:33:52.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a5b7fe700 1 -- 172.21.15.36:0/2074132843 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c000e90 con 0x7f8a5c0b2580 2022-01-10T01:33:52.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a5b7fe700 1 -- 172.21.15.36:0/2074132843 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a4c00d8c0 con 0x7f8a5c0b2580 2022-01-10T01:33:52.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 -- 172.21.15.36:0/2074132843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a5c0b2580 msgr2=0x7f8a5c14ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 --2- 172.21.15.36:0/2074132843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a5c0b2580 0x7f8a5c14ae40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f8a4c002f70 tx=0x7f8a4c006df0).stop 2022-01-10T01:33:52.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 -- 172.21.15.36:0/2074132843 shutdown_connections 2022-01-10T01:33:52.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 --2- 172.21.15.36:0/2074132843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a5c0a8ac0 0x7f8a5c14b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 --2- 172.21.15.36:0/2074132843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a5c0b2580 0x7f8a5c14ae40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 -- 172.21.15.36:0/2074132843 >> 172.21.15.36:0/2074132843 conn(0x7f8a5c060180 msgr2=0x7f8a5c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:52.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 -- 172.21.15.36:0/2074132843 shutdown_connections 2022-01-10T01:33:52.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.357+0000 7f8a615af700 1 -- 172.21.15.36:0/2074132843 wait complete. 2022-01-10T01:33:52.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a615af700 1 Processor -- start 2022-01-10T01:33:52.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a615af700 1 -- start start 2022-01-10T01:33:52.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a615af700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a5c0a8ac0 0x7f8a5c067380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a615af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a5c0b0010 0x7f8a5c159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a615af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a5c0b2580 0x7f8a5c15a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a615af700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c15a950 con 0x7f8a5c0a8ac0 2022-01-10T01:33:52.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a615af700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c159b10 con 0x7f8a5c0b0010 2022-01-10T01:33:52.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a615af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c0b5e70 con 0x7f8a5c0b2580 2022-01-10T01:33:52.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a5bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a5c0a8ac0 0x7f8a5c067380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a5bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a5c0a8ac0 0x7f8a5c067380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42664/0 (socket says 172.21.15.36:42664) 2022-01-10T01:33:52.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a537fe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a5c0b0010 0x7f8a5c159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a5bfff700 1 -- 172.21.15.36:0/3385901682 learned_addr learned my addr 172.21.15.36:0/3385901682 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:52.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a60dae700 1 --2- 172.21.15.36:0/3385901682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a5c0b2580 0x7f8a5c15a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a5bfff700 1 -- 172.21.15.36:0/3385901682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a5c0b2580 msgr2=0x7f8a5c15a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a5bfff700 1 --2- 172.21.15.36:0/3385901682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a5c0b2580 0x7f8a5c15a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a5bfff700 1 -- 172.21.15.36:0/3385901682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a5c0b0010 msgr2=0x7f8a5c159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a5bfff700 1 --2- 172.21.15.36:0/3385901682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a5c0b0010 0x7f8a5c159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a5bfff700 1 -- 172.21.15.36:0/3385901682 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c00b180 con 0x7f8a5c0a8ac0 2022-01-10T01:33:52.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a5bfff700 1 --2- 172.21.15.36:0/3385901682 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a5c0a8ac0 0x7f8a5c067380 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f8a5c0b6000 tx=0x7f8a4c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:52.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a59ffb700 1 -- 172.21.15.36:0/3385901682 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a4c00dea0 con 0x7f8a5c0a8ac0 2022-01-10T01:33:52.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a59ffb700 1 -- 172.21.15.36:0/3385901682 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c013da0 con 0x7f8a5c0a8ac0 2022-01-10T01:33:52.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a615af700 1 -- 172.21.15.36:0/3385901682 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5c0b5930 con 0x7f8a5c0a8ac0 2022-01-10T01:33:52.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a59ffb700 1 -- 172.21.15.36:0/3385901682 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a4c01e5f0 con 0x7f8a5c0a8ac0 2022-01-10T01:33:52.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.361+0000 7f8a615af700 1 -- 172.21.15.36:0/3385901682 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5c0b4bf0 con 0x7f8a5c0a8ac0 2022-01-10T01:33:52.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.365+0000 7f8a615af700 1 -- 172.21.15.36:0/3385901682 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a5c064020 con 0x7f8a5c0a8ac0 2022-01-10T01:33:52.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.365+0000 7f8a59ffb700 1 -- 172.21.15.36:0/3385901682 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8a4c025030 con 0x7f8a5c0a8ac0 2022-01-10T01:33:52.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.365+0000 7f8a59ffb700 1 --2- 172.21.15.36:0/3385901682 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8a34053560 0x7f8a34055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.365+0000 7f8a59ffb700 1 -- 172.21.15.36:0/3385901682 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f8a4c06c840 con 0x7f8a5c0a8ac0 2022-01-10T01:33:52.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.365+0000 7f8a537fe700 1 --2- 172.21.15.36:0/3385901682 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8a34053560 0x7f8a34055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.365+0000 7f8a537fe700 1 --2- 172.21.15.36:0/3385901682 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8a34053560 0x7f8a34055a20 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f8a4400d000 tx=0x7f8a44009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:52.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.373+0000 7f8a59ffb700 1 -- 172.21.15.36:0/3385901682 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8a5c064020 con 0x7f8a5c0a8ac0 2022-01-10T01:33:52.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.537+0000 7f8a615af700 1 -- 172.21.15.36:0/3385901682 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8a5c064020 con 0x7f8a5c0a8ac0 2022-01-10T01:33:52.769 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:33:52.765+0000 7f0b5376f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:33:52.783 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.777+0000 7f8a59ffb700 1 -- 172.21.15.36:0/3385901682 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8a5c064020 con 0x7f8a5c0a8ac0 2022-01-10T01:33:52.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.781+0000 7f8a615af700 1 -- 172.21.15.36:0/3385901682 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8a34053560 msgr2=0x7f8a34055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.781+0000 7f8a615af700 1 --2- 172.21.15.36:0/3385901682 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8a34053560 0x7f8a34055a20 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f8a4400d000 tx=0x7f8a44009040).stop 2022-01-10T01:33:52.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.781+0000 7f8a615af700 1 -- 172.21.15.36:0/3385901682 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a5c0a8ac0 msgr2=0x7f8a5c067380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.781+0000 7f8a615af700 1 --2- 172.21.15.36:0/3385901682 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a5c0a8ac0 0x7f8a5c067380 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7f8a5c0b6000 tx=0x7f8a4c014000).stop 2022-01-10T01:33:52.788 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.781+0000 7f8a615af700 1 -- 172.21.15.36:0/3385901682 shutdown_connections 2022-01-10T01:33:52.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.781+0000 7f8a615af700 1 --2- 172.21.15.36:0/3385901682 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8a34053560 0x7f8a34055a20 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.781+0000 7f8a615af700 1 --2- 172.21.15.36:0/3385901682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8a5c0b2580 0x7f8a5c15a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.781+0000 7f8a615af700 1 --2- 172.21.15.36:0/3385901682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8a5c0b0010 0x7f8a5c159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.789 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.781+0000 7f8a615af700 1 --2- 172.21.15.36:0/3385901682 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8a5c0a8ac0 0x7f8a5c067380 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.781+0000 7f8a615af700 1 -- 172.21.15.36:0/3385901682 >> 172.21.15.36:0/3385901682 conn(0x7f8a5c060180 msgr2=0x7f8a5c0aed30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:52.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.781+0000 7f8a615af700 1 -- 172.21.15.36:0/3385901682 shutdown_connections 2022-01-10T01:33:52.790 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.781+0000 7f8a615af700 1 -- 172.21.15.36:0/3385901682 wait complete. 2022-01-10T01:33:52.791 INFO:teuthology.orchestra.run.smithi036.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2022-01-10T01:33:52.805 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:52.808 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:33:52.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 Processor -- start 2022-01-10T01:33:52.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 -- start start 2022-01-10T01:33:52.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f29d80b2580 0x7f29d814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f29d80b0010 0x7f29d814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d80afbd0 0x7f29d80a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d80a70c0 con 0x7f29d80b0010 2022-01-10T01:33:52.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d80a72f0 con 0x7f29d80b2580 2022-01-10T01:33:52.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d80a7590 con 0x7f29d80afbd0 2022-01-10T01:33:52.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29dcd20700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f29d80b0010 0x7f29d814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29dcd20700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f29d80b0010 0x7f29d814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42674/0 (socket says 172.21.15.36:42674) 2022-01-10T01:33:52.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29dcd20700 1 -- 172.21.15.36:0/4058495369 learned_addr learned my addr 172.21.15.36:0/4058495369 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:52.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29ddd22700 1 --2- 172.21.15.36:0/4058495369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d80afbd0 0x7f29d80a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29dd521700 1 --2- 172.21.15.36:0/4058495369 >> v2:172.21.15.59:3300/0 conn(0x7f29d80b2580 0x7f29d814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29dcd20700 1 -- 172.21.15.36:0/4058495369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d80afbd0 msgr2=0x7f29d80a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:52.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29dcd20700 1 --2- 172.21.15.36:0/4058495369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d80afbd0 0x7f29d80a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29dcd20700 1 -- 172.21.15.36:0/4058495369 >> v2:172.21.15.59:3300/0 conn(0x7f29d80b2580 msgr2=0x7f29d814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:52.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29dcd20700 1 --2- 172.21.15.36:0/4058495369 >> v2:172.21.15.59:3300/0 conn(0x7f29d80b2580 0x7f29d814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29dcd20700 1 -- 172.21.15.36:0/4058495369 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d80a7830 con 0x7f29d80b0010 2022-01-10T01:33:52.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29dcd20700 1 --2- 172.21.15.36:0/4058495369 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29d80b0010 0x7f29d814b330 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f29d00032f0 tx=0x7f29d0009290).ready entity=mon.0 client_cookie=9256b818ad48223b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:52.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29cbfff700 1 -- 172.21.15.36:0/4058495369 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29d000b870 con 0x7f29d80b0010 2022-01-10T01:33:52.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29cbfff700 1 -- 172.21.15.36:0/4058495369 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d000b9d0 con 0x7f29d80b0010 2022-01-10T01:33:52.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29cbfff700 1 -- 172.21.15.36:0/4058495369 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29d000bb40 con 0x7f29d80b0010 2022-01-10T01:33:52.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 -- 172.21.15.36:0/4058495369 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29d80b0010 msgr2=0x7f29d814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 --2- 172.21.15.36:0/4058495369 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29d80b0010 0x7f29d814b330 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f29d00032f0 tx=0x7f29d0009290).stop 2022-01-10T01:33:52.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 -- 172.21.15.36:0/4058495369 shutdown_connections 2022-01-10T01:33:52.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 --2- 172.21.15.36:0/4058495369 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d80afbd0 0x7f29d80a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 --2- 172.21.15.36:0/4058495369 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29d80b0010 0x7f29d814b330 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 --2- 172.21.15.36:0/4058495369 >> v2:172.21.15.59:3300/0 conn(0x7f29d80b2580 0x7f29d814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 -- 172.21.15.36:0/4058495369 >> 172.21.15.36:0/4058495369 conn(0x7f29d8060180 msgr2=0x7f29d80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:52.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 -- 172.21.15.36:0/4058495369 shutdown_connections 2022-01-10T01:33:52.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.909+0000 7f29de523700 1 -- 172.21.15.36:0/4058495369 wait complete. 2022-01-10T01:33:52.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29de523700 1 Processor -- start 2022-01-10T01:33:52.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29de523700 1 -- start start 2022-01-10T01:33:52.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29de523700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d80afbd0 0x7f29d80677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29de523700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d80b0010 0x7f29d80b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29de523700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29d80b2580 0x7f29d80b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29de523700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d80b2dd0 con 0x7f29d80b2580 2022-01-10T01:33:52.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29de523700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d80b34d0 con 0x7f29d80b0010 2022-01-10T01:33:52.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29de523700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d80b3000 con 0x7f29d80afbd0 2022-01-10T01:33:52.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29ddd22700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29d80b2580 0x7f29d80b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29ddd22700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29d80b2580 0x7f29d80b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42682/0 (socket says 172.21.15.36:42682) 2022-01-10T01:33:52.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29dcd20700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d80b0010 0x7f29d80b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29ddd22700 1 -- 172.21.15.36:0/1355186775 learned_addr learned my addr 172.21.15.36:0/1355186775 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:52.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29dd521700 1 --2- 172.21.15.36:0/1355186775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d80afbd0 0x7f29d80677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29ddd22700 1 -- 172.21.15.36:0/1355186775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d80afbd0 msgr2=0x7f29d80677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29ddd22700 1 --2- 172.21.15.36:0/1355186775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d80afbd0 0x7f29d80677e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29ddd22700 1 -- 172.21.15.36:0/1355186775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d80b0010 msgr2=0x7f29d80b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:52.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29ddd22700 1 --2- 172.21.15.36:0/1355186775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d80b0010 0x7f29d80b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:52.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29ddd22700 1 -- 172.21.15.36:0/1355186775 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d0009530 con 0x7f29d80b2580 2022-01-10T01:33:52.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29ddd22700 1 --2- 172.21.15.36:0/1355186775 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29d80b2580 0x7f29d80b4690 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f29d400a000 tx=0x7f29d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:52.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29caffd700 1 -- 172.21.15.36:0/1355186775 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29d4011780 con 0x7f29d80b2580 2022-01-10T01:33:52.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29caffd700 1 -- 172.21.15.36:0/1355186775 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d40118e0 con 0x7f29d80b2580 2022-01-10T01:33:52.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29de523700 1 -- 172.21.15.36:0/1355186775 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d805cdb0 con 0x7f29d80b2580 2022-01-10T01:33:52.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29caffd700 1 -- 172.21.15.36:0/1355186775 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29d4011c40 con 0x7f29d80b2580 2022-01-10T01:33:52.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.913+0000 7f29de523700 1 -- 172.21.15.36:0/1355186775 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d80af440 con 0x7f29d80b2580 2022-01-10T01:33:52.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.917+0000 7f29de523700 1 -- 172.21.15.36:0/1355186775 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d8057350 con 0x7f29d80b2580 2022-01-10T01:33:52.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.917+0000 7f29caffd700 1 -- 172.21.15.36:0/1355186775 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f29d401c460 con 0x7f29d80b2580 2022-01-10T01:33:52.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.917+0000 7f29caffd700 1 --2- 172.21.15.36:0/1355186775 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f29b4053680 0x7f29b4055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:52.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.917+0000 7f29caffd700 1 -- 172.21.15.36:0/1355186775 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f29d406bcb0 con 0x7f29d80b2580 2022-01-10T01:33:52.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.917+0000 7f29dd521700 1 --2- 172.21.15.36:0/1355186775 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f29b4053680 0x7f29b4055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:52.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.917+0000 7f29dd521700 1 --2- 172.21.15.36:0/1355186775 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f29b4053680 0x7f29b4055b40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f29cc00c000 tx=0x7f29cc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:52.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:52.925+0000 7f29caffd700 1 -- 172.21.15.36:0/1355186775 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f29d4042a80 con 0x7f29d80b2580 2022-01-10T01:33:53.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.089+0000 7f29de523700 1 -- 172.21.15.36:0/1355186775 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29d80b3640 con 0x7f29d80b2580 2022-01-10T01:33:53.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.093+0000 7f29caffd700 1 -- 172.21.15.36:0/1355186775 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+2129 (secure 0 0 0) 0x7f29d80b3640 con 0x7f29d80b2580 2022-01-10T01:33:53.099 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:53.099 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":75,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/967641645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":967641645},{"type":"v1","addr":"172.21.15.36:6835","nonce":967641645}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/109014568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":109014568},{"type":"v1","addr":"172.21.15.36:6837","nonce":109014568}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70}],"filesystems":[{"mdsmap":{"epoch":75,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:33:40.529600+0000","modified":"2022-01-10T01:33:52.766824+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":149,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2022-01-10T01:33:53.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.093+0000 7f29de523700 1 -- 172.21.15.36:0/1355186775 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f29b4053680 msgr2=0x7f29b4055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:53.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.093+0000 7f29de523700 1 --2- 172.21.15.36:0/1355186775 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f29b4053680 0x7f29b4055b40 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f29cc00c000 tx=0x7f29cc008040).stop 2022-01-10T01:33:53.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.093+0000 7f29de523700 1 -- 172.21.15.36:0/1355186775 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29d80b2580 msgr2=0x7f29d80b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:53.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.093+0000 7f29de523700 1 --2- 172.21.15.36:0/1355186775 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29d80b2580 0x7f29d80b4690 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f29d400a000 tx=0x7f29d4008040).stop 2022-01-10T01:33:53.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.093+0000 7f29de523700 1 -- 172.21.15.36:0/1355186775 shutdown_connections 2022-01-10T01:33:53.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.093+0000 7f29de523700 1 --2- 172.21.15.36:0/1355186775 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f29b4053680 0x7f29b4055b40 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.093+0000 7f29de523700 1 --2- 172.21.15.36:0/1355186775 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f29d80b2580 0x7f29d80b4690 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.093+0000 7f29de523700 1 --2- 172.21.15.36:0/1355186775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d80b0010 0x7f29d80b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.093+0000 7f29de523700 1 --2- 172.21.15.36:0/1355186775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f29d80afbd0 0x7f29d80677e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.093+0000 7f29de523700 1 -- 172.21.15.36:0/1355186775 >> 172.21.15.36:0/1355186775 conn(0x7f29d8060180 msgr2=0x7f29d814ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:53.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.093+0000 7f29de523700 1 -- 172.21.15.36:0/1355186775 shutdown_connections 2022-01-10T01:33:53.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.093+0000 7f29de523700 1 -- 172.21.15.36:0/1355186775 wait complete. 2022-01-10T01:33:53.104 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 75 2022-01-10T01:33:53.112 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:33:53.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.213+0000 7f94eb56b700 1 Processor -- start 2022-01-10T01:33:53.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.213+0000 7f94eb56b700 1 -- start start 2022-01-10T01:33:53.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94eb56b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f94e40b2710 0x7f94e4143110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:53.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94eb56b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e40611d0 0x7f94e4143600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:53.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94eb56b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e4064910 con 0x7f94e405ff60 2022-01-10T01:33:53.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94eb56b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e4064bb0 con 0x7f94e40b2710 2022-01-10T01:33:53.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94eb56b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4064e50 con 0x7f94e40611d0 2022-01-10T01:33:53.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94e8b06700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f94e40b2710 0x7f94e4143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:53.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94e8b06700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f94e40b2710 0x7f94e4143110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42688/0 (socket says 172.21.15.36:42688) 2022-01-10T01:33:53.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94e8b06700 1 -- 172.21.15.36:0/1736377040 learned_addr learned my addr 172.21.15.36:0/1736377040 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:53.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94e9b08700 1 --2- 172.21.15.36:0/1736377040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e40611d0 0x7f94e4143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:53.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94e8b06700 1 -- 172.21.15.36:0/1736377040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e40611d0 msgr2=0x7f94e4143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:53.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94e8b06700 1 --2- 172.21.15.36:0/1736377040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e40611d0 0x7f94e4143600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94e8b06700 1 -- 172.21.15.36:0/1736377040 >> v1:172.21.15.59:6789/0 conn(0x7f94e405ff60 legacy=0x7f94e4140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:53.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94e8b06700 1 -- 172.21.15.36:0/1736377040 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e40650f0 con 0x7f94e40b2710 2022-01-10T01:33:53.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94e9b08700 1 --2- 172.21.15.36:0/1736377040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e40611d0 0x7f94e4143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:53.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94d3fff700 1 -- 172.21.15.36:0/1736377040 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368850801 0 0) 0x7f94e4064910 con 0x7f94e405ff60 2022-01-10T01:33:53.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94e8b06700 1 --2- 172.21.15.36:0/1736377040 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94e40b2710 0x7f94e4143110 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f94d4002f70 tx=0x7f94d4006eb0).ready entity=mon.0 client_cookie=5a96b27ccce6f2a7 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:53.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94d3fff700 1 -- 172.21.15.36:0/1736377040 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94d400d5c0 con 0x7f94e40b2710 2022-01-10T01:33:53.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94d3fff700 1 -- 172.21.15.36:0/1736377040 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d4000e90 con 0x7f94e40b2710 2022-01-10T01:33:53.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94d3fff700 1 -- 172.21.15.36:0/1736377040 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94d400d910 con 0x7f94e40b2710 2022-01-10T01:33:53.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94eb56b700 1 -- 172.21.15.36:0/1736377040 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94e40b2710 msgr2=0x7f94e4143110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:53.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94eb56b700 1 --2- 172.21.15.36:0/1736377040 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94e40b2710 0x7f94e4143110 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f94d4002f70 tx=0x7f94d4006eb0).stop 2022-01-10T01:33:53.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94eb56b700 1 -- 172.21.15.36:0/1736377040 shutdown_connections 2022-01-10T01:33:53.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94eb56b700 1 --2- 172.21.15.36:0/1736377040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e40611d0 0x7f94e4143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94eb56b700 1 --2- 172.21.15.36:0/1736377040 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94e40b2710 0x7f94e4143110 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94eb56b700 1 -- 172.21.15.36:0/1736377040 >> 172.21.15.36:0/1736377040 conn(0x7f94e405cf60 msgr2=0x7f94e405f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:53.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94eb56b700 1 -- 172.21.15.36:0/1736377040 shutdown_connections 2022-01-10T01:33:53.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.217+0000 7f94eb56b700 1 -- 172.21.15.36:0/1736377040 wait complete. 2022-01-10T01:33:53.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.221+0000 7f94eb56b700 1 Processor -- start 2022-01-10T01:33:53.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.221+0000 7f94eb56b700 1 -- start start 2022-01-10T01:33:53.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.221+0000 7f94eb56b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94e405ff60 0x7f94e40b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:53.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.221+0000 7f94eb56b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e40611d0 0x7f94e413d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:53.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.221+0000 7f94eb56b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e40b2710 0x7f94e40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:53.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.221+0000 7f94eb56b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e40b6960 con 0x7f94e405ff60 2022-01-10T01:33:53.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.221+0000 7f94eb56b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e40b6430 con 0x7f94e40b2710 2022-01-10T01:33:53.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.221+0000 7f94eb56b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e40b66c0 con 0x7f94e40611d0 2022-01-10T01:33:53.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.221+0000 7f94e9307700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94e405ff60 0x7f94e40b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:53.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.221+0000 7f94e9307700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94e405ff60 0x7f94e40b6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42692/0 (socket says 172.21.15.36:42692) 2022-01-10T01:33:53.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.221+0000 7f94e9307700 1 -- 172.21.15.36:0/3112991350 learned_addr learned my addr 172.21.15.36:0/3112991350 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:53.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.221+0000 7f94e8b06700 1 --2- 172.21.15.36:0/3112991350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e40611d0 0x7f94e413d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:53.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.221+0000 7f94e9b08700 1 --2- 172.21.15.36:0/3112991350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e40b2710 0x7f94e40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:53.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.225+0000 7f94e9307700 1 -- 172.21.15.36:0/3112991350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e40611d0 msgr2=0x7f94e413d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:53.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.225+0000 7f94e9307700 1 --2- 172.21.15.36:0/3112991350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e40611d0 0x7f94e413d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.225+0000 7f94e9307700 1 -- 172.21.15.36:0/3112991350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e40b2710 msgr2=0x7f94e40b5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:53.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.225+0000 7f94e9307700 1 --2- 172.21.15.36:0/3112991350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e40b2710 0x7f94e40b5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.225+0000 7f94e9307700 1 -- 172.21.15.36:0/3112991350 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d400b1e0 con 0x7f94e405ff60 2022-01-10T01:33:53.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.225+0000 7f94e9307700 1 --2- 172.21.15.36:0/3112991350 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94e405ff60 0x7f94e40b6ea0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f94e0000ed0 tx=0x7f94e0007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:53.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.225+0000 7f94d27fc700 1 -- 172.21.15.36:0/3112991350 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94e0012400 con 0x7f94e405ff60 2022-01-10T01:33:53.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.225+0000 7f94d27fc700 1 -- 172.21.15.36:0/3112991350 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e0012560 con 0x7f94e405ff60 2022-01-10T01:33:53.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.225+0000 7f94eb56b700 1 -- 172.21.15.36:0/3112991350 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e41559b0 con 0x7f94e405ff60 2022-01-10T01:33:53.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.225+0000 7f94d27fc700 1 -- 172.21.15.36:0/3112991350 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94e00128c0 con 0x7f94e405ff60 2022-01-10T01:33:53.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.225+0000 7f94eb56b700 1 -- 172.21.15.36:0/3112991350 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e413eee0 con 0x7f94e405ff60 2022-01-10T01:33:53.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.225+0000 7f94eb56b700 1 -- 172.21.15.36:0/3112991350 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e4155e50 con 0x7f94e405ff60 2022-01-10T01:33:53.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.225+0000 7f94d27fc700 1 -- 172.21.15.36:0/3112991350 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f94e0019030 con 0x7f94e405ff60 2022-01-10T01:33:53.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.225+0000 7f94d27fc700 1 --2- 172.21.15.36:0/3112991350 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94c4053620 0x7f94c4055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:53.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.229+0000 7f94d27fc700 1 -- 172.21.15.36:0/3112991350 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f94e006ae00 con 0x7f94e405ff60 2022-01-10T01:33:53.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.229+0000 7f94e8b06700 1 --2- 172.21.15.36:0/3112991350 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94c4053620 0x7f94c4055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:53.242 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.229+0000 7f94e8b06700 1 --2- 172.21.15.36:0/3112991350 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94c4053620 0x7f94c4055ae0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f94d401c000 tx=0x7f94d4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:53.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.233+0000 7f94d27fc700 1 -- 172.21.15.36:0/3112991350 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f94e4155e50 con 0x7f94e405ff60 2022-01-10T01:33:53.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.397+0000 7f94eb56b700 1 -- 172.21.15.36:0/3112991350 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f94e4155e50 con 0x7f94e405ff60 2022-01-10T01:33:53.786 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.781+0000 7f94d27fc700 1 -- 172.21.15.36:0/3112991350 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) v1 ==== 104+0+0 (secure 0 0 0) 0x7f94e4155e50 con 0x7f94e405ff60 2022-01-10T01:33:53.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.785+0000 7f94eb56b700 1 -- 172.21.15.36:0/3112991350 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94c4053620 msgr2=0x7f94c4055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:53.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.785+0000 7f94eb56b700 1 --2- 172.21.15.36:0/3112991350 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94c4053620 0x7f94c4055ae0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f94d401c000 tx=0x7f94d4015000).stop 2022-01-10T01:33:53.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.785+0000 7f94eb56b700 1 -- 172.21.15.36:0/3112991350 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94e405ff60 msgr2=0x7f94e40b6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:53.791 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.785+0000 7f94eb56b700 1 --2- 172.21.15.36:0/3112991350 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94e405ff60 0x7f94e40b6ea0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f94e0000ed0 tx=0x7f94e0007ac0).stop 2022-01-10T01:33:53.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.785+0000 7f94eb56b700 1 -- 172.21.15.36:0/3112991350 shutdown_connections 2022-01-10T01:33:53.792 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.785+0000 7f94eb56b700 1 --2- 172.21.15.36:0/3112991350 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94c4053620 0x7f94c4055ae0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.785+0000 7f94eb56b700 1 --2- 172.21.15.36:0/3112991350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94e40b2710 0x7f94e40b5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.785+0000 7f94eb56b700 1 --2- 172.21.15.36:0/3112991350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94e40611d0 0x7f94e413d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.785+0000 7f94eb56b700 1 --2- 172.21.15.36:0/3112991350 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f94e405ff60 0x7f94e40b6ea0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.785+0000 7f94eb56b700 1 -- 172.21.15.36:0/3112991350 >> 172.21.15.36:0/3112991350 conn(0x7f94e405cf60 msgr2=0x7f94e4065750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:53.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.785+0000 7f94eb56b700 1 -- 172.21.15.36:0/3112991350 shutdown_connections 2022-01-10T01:33:53.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.785+0000 7f94eb56b700 1 -- 172.21.15.36:0/3112991350 wait complete. 2022-01-10T01:33:53.810 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:33:53.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.917+0000 7f6d78f36700 1 Processor -- start 2022-01-10T01:33:53.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.917+0000 7f6d78f36700 1 -- start start 2022-01-10T01:33:53.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d78f36700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d74061700 0x7f6d74146520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:53.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d78f36700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d740aecf0 con 0x7f6d74061320 2022-01-10T01:33:53.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d78f36700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d740b6f20 con 0x7f6d740ad5c0 2022-01-10T01:33:53.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d78f36700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d740aef20 con 0x7f6d74061700 2022-01-10T01:33:53.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d737fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f6d74061320 0x7f6d740b9e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40494/0 (socket says 172.21.15.36:40494) 2022-01-10T01:33:53.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d737fe700 1 -- 172.21.15.36:0/2746790612 learned_addr learned my addr 172.21.15.36:0/2746790612 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:53.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d73fff700 1 --2- 172.21.15.36:0/2746790612 >> v2:172.21.15.59:3300/0 conn(0x7f6d74061700 0x7f6d74146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:53.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d727fc700 1 -- 172.21.15.36:0/2746790612 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604293969 0 0) 0x7f6d740aecf0 con 0x7f6d74061320 2022-01-10T01:33:53.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d727fc700 1 -- 172.21.15.36:0/2746790612 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d60003260 con 0x7f6d74061320 2022-01-10T01:33:53.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d727fc700 1 -- 172.21.15.36:0/2746790612 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298106921 0 0) 0x7f6d740b6f20 con 0x7f6d740ad5c0 2022-01-10T01:33:53.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d727fc700 1 -- 172.21.15.36:0/2746790612 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d740aecf0 con 0x7f6d740ad5c0 2022-01-10T01:33:53.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d73fff700 1 -- 172.21.15.36:0/2746790612 >> v1:172.21.15.59:6789/0 conn(0x7f6d740ad5c0 legacy=0x7f6d74140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:53.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d73fff700 1 -- 172.21.15.36:0/2746790612 >> v1:172.21.15.36:6789/0 conn(0x7f6d74061320 legacy=0x7f6d740b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:53.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d73fff700 1 -- 172.21.15.36:0/2746790612 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d740af1c0 con 0x7f6d74061700 2022-01-10T01:33:53.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d73fff700 1 --2- 172.21.15.36:0/2746790612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74061700 0x7f6d74146520 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f6d6c002f70 tx=0x7f6d6c006df0).ready entity=mon.1 client_cookie=83c6dd955ae19ec8 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:53.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d727fc700 1 -- 172.21.15.36:0/2746790612 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d6c00d540 con 0x7f6d74061700 2022-01-10T01:33:53.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d727fc700 1 -- 172.21.15.36:0/2746790612 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c000e90 con 0x7f6d74061700 2022-01-10T01:33:53.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d727fc700 1 -- 172.21.15.36:0/2746790612 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d6c00d890 con 0x7f6d74061700 2022-01-10T01:33:53.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d78f36700 1 -- 172.21.15.36:0/2746790612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74061700 msgr2=0x7f6d74146520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:53.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d78f36700 1 --2- 172.21.15.36:0/2746790612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74061700 0x7f6d74146520 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f6d6c002f70 tx=0x7f6d6c006df0).stop 2022-01-10T01:33:53.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d78f36700 1 -- 172.21.15.36:0/2746790612 shutdown_connections 2022-01-10T01:33:53.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d78f36700 1 --2- 172.21.15.36:0/2746790612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74061700 0x7f6d74146520 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d78f36700 1 -- 172.21.15.36:0/2746790612 >> 172.21.15.36:0/2746790612 conn(0x7f6d74066de0 msgr2=0x7f6d740671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:53.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d78f36700 1 -- 172.21.15.36:0/2746790612 shutdown_connections 2022-01-10T01:33:53.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.921+0000 7f6d78f36700 1 -- 172.21.15.36:0/2746790612 wait complete. 2022-01-10T01:33:53.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d78f36700 1 Processor -- start 2022-01-10T01:33:53.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d78f36700 1 -- start start 2022-01-10T01:33:53.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d78f36700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74061320 0x7f6d7409eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:53.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d78f36700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d74061700 0x7f6d7409efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:53.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d78f36700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6d740ad5c0 0x7f6d740b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:53.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d78f36700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7409f4a0 con 0x7f6d740ad5c0 2022-01-10T01:33:53.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d78f36700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d74152e20 con 0x7f6d74061320 2022-01-10T01:33:53.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d78f36700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740ad020 con 0x7f6d74061700 2022-01-10T01:33:53.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d73fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6d740ad5c0 0x7f6d740b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:53.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d73fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6d740ad5c0 0x7f6d740b23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42710/0 (socket says 172.21.15.36:42710) 2022-01-10T01:33:53.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d73fff700 1 -- 172.21.15.36:0/1950598409 learned_addr learned my addr 172.21.15.36:0/1950598409 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:53.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d72ffd700 1 --2- 172.21.15.36:0/1950598409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d74061700 0x7f6d7409efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:53.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d737fe700 1 --2- 172.21.15.36:0/1950598409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74061320 0x7f6d7409eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:53.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d73fff700 1 -- 172.21.15.36:0/1950598409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d74061700 msgr2=0x7f6d7409efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:53.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d73fff700 1 --2- 172.21.15.36:0/1950598409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d74061700 0x7f6d7409efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d73fff700 1 -- 172.21.15.36:0/1950598409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74061320 msgr2=0x7f6d7409eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:53.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d73fff700 1 --2- 172.21.15.36:0/1950598409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74061320 0x7f6d7409eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:53.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d73fff700 1 -- 172.21.15.36:0/1950598409 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c00b180 con 0x7f6d740ad5c0 2022-01-10T01:33:53.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d73fff700 1 --2- 172.21.15.36:0/1950598409 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6d740ad5c0 0x7f6d740b23b0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f6d6c002f70 tx=0x7f6d6c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:53.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d70ff9700 1 -- 172.21.15.36:0/1950598409 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d6c016070 con 0x7f6d740ad5c0 2022-01-10T01:33:53.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d70ff9700 1 -- 172.21.15.36:0/1950598409 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c0137d0 con 0x7f6d740ad5c0 2022-01-10T01:33:53.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d78f36700 1 -- 172.21.15.36:0/1950598409 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d74153050 con 0x7f6d740ad5c0 2022-01-10T01:33:53.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d70ff9700 1 -- 172.21.15.36:0/1950598409 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6d6c013b30 con 0x7f6d740ad5c0 2022-01-10T01:33:53.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.925+0000 7f6d78f36700 1 -- 172.21.15.36:0/1950598409 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d740b0960 con 0x7f6d740ad5c0 2022-01-10T01:33:53.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.929+0000 7f6d78f36700 1 -- 172.21.15.36:0/1950598409 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d74152c80 con 0x7f6d740ad5c0 2022-01-10T01:33:53.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.929+0000 7f6d70ff9700 1 -- 172.21.15.36:0/1950598409 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6d6c025030 con 0x7f6d740ad5c0 2022-01-10T01:33:53.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.929+0000 7f6d70ff9700 1 --2- 172.21.15.36:0/1950598409 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6d540535f0 0x7f6d54055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:53.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.929+0000 7f6d70ff9700 1 -- 172.21.15.36:0/1950598409 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f6d6c06cad0 con 0x7f6d740ad5c0 2022-01-10T01:33:53.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.929+0000 7f6d737fe700 1 --2- 172.21.15.36:0/1950598409 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6d540535f0 0x7f6d54055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:53.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.929+0000 7f6d737fe700 1 --2- 172.21.15.36:0/1950598409 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6d540535f0 0x7f6d54055ab0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f6d6800d000 tx=0x7f6d68009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:53.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:53.933+0000 7f6d70ff9700 1 -- 172.21.15.36:0/1950598409 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6d74152c80 con 0x7f6d740ad5c0 2022-01-10T01:33:54.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.065+0000 7f6d78f36700 1 -- 172.21.15.36:0/1950598409 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6d74152c80 con 0x7f6d740ad5c0 2022-01-10T01:33:54.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.801+0000 7f6d70ff9700 1 -- 172.21.15.36:0/1950598409 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v150) v1 ==== 185+0+0 (secure 0 0 0) 0x7f6d74152c80 con 0x7f6d740ad5c0 2022-01-10T01:33:54.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.805+0000 7f6d78f36700 1 -- 172.21.15.36:0/1950598409 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6d540535f0 msgr2=0x7f6d54055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:54.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.805+0000 7f6d78f36700 1 --2- 172.21.15.36:0/1950598409 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6d540535f0 0x7f6d54055ab0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f6d6800d000 tx=0x7f6d68009040).stop 2022-01-10T01:33:54.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.805+0000 7f6d78f36700 1 -- 172.21.15.36:0/1950598409 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6d740ad5c0 msgr2=0x7f6d740b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:54.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.805+0000 7f6d78f36700 1 --2- 172.21.15.36:0/1950598409 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6d740ad5c0 0x7f6d740b23b0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7f6d6c002f70 tx=0x7f6d6c014000).stop 2022-01-10T01:33:54.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.805+0000 7f6d78f36700 1 -- 172.21.15.36:0/1950598409 shutdown_connections 2022-01-10T01:33:54.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.805+0000 7f6d78f36700 1 --2- 172.21.15.36:0/1950598409 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6d540535f0 0x7f6d54055ab0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:54.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.805+0000 7f6d78f36700 1 --2- 172.21.15.36:0/1950598409 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6d740ad5c0 0x7f6d740b23b0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:54.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.805+0000 7f6d78f36700 1 --2- 172.21.15.36:0/1950598409 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d74061700 0x7f6d7409efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:54.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.805+0000 7f6d78f36700 1 --2- 172.21.15.36:0/1950598409 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d74061320 0x7f6d7409eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:54.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.805+0000 7f6d78f36700 1 -- 172.21.15.36:0/1950598409 >> 172.21.15.36:0/1950598409 conn(0x7f6d74066de0 msgr2=0x7f6d74141fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:54.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.805+0000 7f6d78f36700 1 -- 172.21.15.36:0/1950598409 shutdown_connections 2022-01-10T01:33:54.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.805+0000 7f6d78f36700 1 -- 172.21.15.36:0/1950598409 wait complete. 2022-01-10T01:33:54.814 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:33:54.825 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2022-01-10T01:33:54.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.933+0000 7f359ffff700 1 Processor -- start 2022-01-10T01:33:54.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.933+0000 7f359ffff700 1 -- start start 2022-01-10T01:33:54.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.933+0000 7f359ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f35a00af2c0 0x7f35a00af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:54.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.933+0000 7f359ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a00ad850 0x7f35a00a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:54.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.933+0000 7f359ffff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a00afda0 con 0x7f35a00ad320 2022-01-10T01:33:54.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.933+0000 7f359ffff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a005c610 con 0x7f35a00af2c0 2022-01-10T01:33:54.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.933+0000 7f359ffff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0140800 con 0x7f35a00ad850 2022-01-10T01:33:54.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.933+0000 7f359effd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f35a00af2c0 0x7f35a00af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:54.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.933+0000 7f359effd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f35a00af2c0 0x7f35a00af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42714/0 (socket says 172.21.15.36:42714) 2022-01-10T01:33:54.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.933+0000 7f359effd700 1 -- 172.21.15.36:0/33735031 learned_addr learned my addr 172.21.15.36:0/33735031 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:54.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.933+0000 7f359f7fe700 1 --2- 172.21.15.36:0/33735031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a00ad850 0x7f35a00a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:54.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359effd700 1 -- 172.21.15.36:0/33735031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a00ad850 msgr2=0x7f35a00a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:54.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359effd700 1 --2- 172.21.15.36:0/33735031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a00ad850 0x7f35a00a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:54.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359effd700 1 -- 172.21.15.36:0/33735031 >> v1:172.21.15.59:6789/0 conn(0x7f35a00ad320 legacy=0x7f35a0143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:54.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359effd700 1 -- 172.21.15.36:0/33735031 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a0143860 con 0x7f35a00af2c0 2022-01-10T01:33:54.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359effd700 1 --2- 172.21.15.36:0/33735031 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f35a00af2c0 0x7f35a00af6a0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f35a00ad770 tx=0x7f3590006eb0).ready entity=mon.0 client_cookie=cb78135ac2a048db server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:54.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359dffb700 1 -- 172.21.15.36:0/33735031 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f359000f970 con 0x7f35a00af2c0 2022-01-10T01:33:54.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359dffb700 1 -- 172.21.15.36:0/33735031 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3590000e90 con 0x7f35a00af2c0 2022-01-10T01:33:54.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359dffb700 1 -- 172.21.15.36:0/33735031 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f359000fd00 con 0x7f35a00af2c0 2022-01-10T01:33:54.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359ffff700 1 -- 172.21.15.36:0/33735031 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f35a00af2c0 msgr2=0x7f35a00af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:54.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359ffff700 1 --2- 172.21.15.36:0/33735031 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f35a00af2c0 0x7f35a00af6a0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7f35a00ad770 tx=0x7f3590006eb0).stop 2022-01-10T01:33:54.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359ffff700 1 -- 172.21.15.36:0/33735031 shutdown_connections 2022-01-10T01:33:54.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359ffff700 1 --2- 172.21.15.36:0/33735031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a00ad850 0x7f35a00a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:54.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359ffff700 1 --2- 172.21.15.36:0/33735031 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f35a00af2c0 0x7f35a00af6a0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:54.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359ffff700 1 -- 172.21.15.36:0/33735031 >> 172.21.15.36:0/33735031 conn(0x7f35a0061140 msgr2=0x7f35a0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:54.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359ffff700 1 -- 172.21.15.36:0/33735031 shutdown_connections 2022-01-10T01:33:54.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359ffff700 1 -- 172.21.15.36:0/33735031 wait complete. 2022-01-10T01:33:54.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359ffff700 1 Processor -- start 2022-01-10T01:33:54.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.937+0000 7f359ffff700 1 -- start start 2022-01-10T01:33:54.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a00ad320 0x7f35a013ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:54.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f35a00ad850 0x7f35a00b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:54.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35a00af2c0 0x7f35a00b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:54.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359ffff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0142b90 con 0x7f35a00ad850 2022-01-10T01:33:54.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359ffff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0142140 con 0x7f35a00af2c0 2022-01-10T01:33:54.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359ffff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a01428f0 con 0x7f35a00ad320 2022-01-10T01:33:54.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359e7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f35a00ad850 0x7f35a00b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:54.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359e7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f35a00ad850 0x7f35a00b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42722/0 (socket says 172.21.15.36:42722) 2022-01-10T01:33:54.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a00ad320 0x7f35a013ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:54.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359e7fc700 1 -- 172.21.15.36:0/456145101 learned_addr learned my addr 172.21.15.36:0/456145101 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:54.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359f7fe700 1 --2- 172.21.15.36:0/456145101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35a00af2c0 0x7f35a00b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:54.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359e7fc700 1 -- 172.21.15.36:0/456145101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a00ad320 msgr2=0x7f35a013ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:54.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359e7fc700 1 --2- 172.21.15.36:0/456145101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a00ad320 0x7f35a013ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:54.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359e7fc700 1 -- 172.21.15.36:0/456145101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35a00af2c0 msgr2=0x7f35a00b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:54.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359e7fc700 1 --2- 172.21.15.36:0/456145101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35a00af2c0 0x7f35a00b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:54.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359e7fc700 1 -- 172.21.15.36:0/456145101 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359000b1e0 con 0x7f35a00ad850 2022-01-10T01:33:54.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359f7fe700 1 --2- 172.21.15.36:0/456145101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35a00af2c0 0x7f35a00b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:54.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359e7fc700 1 --2- 172.21.15.36:0/456145101 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f35a00ad850 0x7f35a00b3b30 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f3594001fa0 tx=0x7f3594007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:54.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f358ffff700 1 -- 172.21.15.36:0/456145101 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3594007030 con 0x7f35a00ad850 2022-01-10T01:33:54.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f358ffff700 1 -- 172.21.15.36:0/456145101 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3594007190 con 0x7f35a00ad850 2022-01-10T01:33:54.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359ffff700 1 -- 172.21.15.36:0/456145101 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a006a460 con 0x7f35a00ad850 2022-01-10T01:33:54.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f358ffff700 1 -- 172.21.15.36:0/456145101 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3594006510 con 0x7f35a00ad850 2022-01-10T01:33:54.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.941+0000 7f359ffff700 1 -- 172.21.15.36:0/456145101 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a0141090 con 0x7f35a00ad850 2022-01-10T01:33:54.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.945+0000 7f359ffff700 1 -- 172.21.15.36:0/456145101 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a0142340 con 0x7f35a00ad850 2022-01-10T01:33:54.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.945+0000 7f358ffff700 1 -- 172.21.15.36:0/456145101 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f3594010030 con 0x7f35a00ad850 2022-01-10T01:33:54.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.945+0000 7f358ffff700 1 --2- 172.21.15.36:0/456145101 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f357c0536b0 0x7f357c055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:54.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.945+0000 7f358ffff700 1 -- 172.21.15.36:0/456145101 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f359406b6d0 con 0x7f35a00ad850 2022-01-10T01:33:54.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.945+0000 7f359effd700 1 --2- 172.21.15.36:0/456145101 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f357c0536b0 0x7f357c055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:54.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.945+0000 7f359effd700 1 --2- 172.21.15.36:0/456145101 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f357c0536b0 0x7f357c055b70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f359001e000 tx=0x7f3590017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:54.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:54.953+0000 7f358ffff700 1 -- 172.21.15.36:0/456145101 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f3594042730 con 0x7f35a00ad850 2022-01-10T01:33:55.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.085+0000 7f359ffff700 1 -- 172.21.15.36:0/456145101 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f35a0057350 con 0x7f35a00ad850 2022-01-10T01:33:55.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.801+0000 7f358ffff700 1 -- 172.21.15.36:0/456145101 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v151) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3594045d50 con 0x7f35a00ad850 2022-01-10T01:33:55.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.809+0000 7f359ffff700 1 -- 172.21.15.36:0/456145101 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f357c0536b0 msgr2=0x7f357c055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:55.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.809+0000 7f359ffff700 1 --2- 172.21.15.36:0/456145101 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f357c0536b0 0x7f357c055b70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f359001e000 tx=0x7f3590017000).stop 2022-01-10T01:33:55.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.809+0000 7f359ffff700 1 -- 172.21.15.36:0/456145101 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f35a00ad850 msgr2=0x7f35a00b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:55.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.809+0000 7f359ffff700 1 --2- 172.21.15.36:0/456145101 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f35a00ad850 0x7f35a00b3b30 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f3594001fa0 tx=0x7f3594007c30).stop 2022-01-10T01:33:55.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.809+0000 7f359ffff700 1 -- 172.21.15.36:0/456145101 shutdown_connections 2022-01-10T01:33:55.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.809+0000 7f359ffff700 1 --2- 172.21.15.36:0/456145101 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f357c0536b0 0x7f357c055b70 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:55.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.809+0000 7f359ffff700 1 --2- 172.21.15.36:0/456145101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35a00af2c0 0x7f35a00b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:55.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.809+0000 7f359ffff700 1 --2- 172.21.15.36:0/456145101 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f35a00ad850 0x7f35a00b3b30 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:55.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.809+0000 7f359ffff700 1 --2- 172.21.15.36:0/456145101 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35a00ad320 0x7f35a013ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:55.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.809+0000 7f359ffff700 1 -- 172.21.15.36:0/456145101 >> 172.21.15.36:0/456145101 conn(0x7f35a0061140 msgr2=0x7f35a013ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:55.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.809+0000 7f359ffff700 1 -- 172.21.15.36:0/456145101 shutdown_connections 2022-01-10T01:33:55.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.809+0000 7f359ffff700 1 -- 172.21.15.36:0/456145101 wait complete. 2022-01-10T01:33:55.819 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' removed 2022-01-10T01:33:55.829 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2022-01-10T01:33:55.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.925+0000 7fb516ecf700 1 Processor -- start 2022-01-10T01:33:55.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.925+0000 7fb516ecf700 1 -- start start 2022-01-10T01:33:55.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb516ecf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5100b6560 0x7fb5100b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:55.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb516ecf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5100b5990 0x7fb5100b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:55.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb516ecf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb510143f60 con 0x7fb51005fc00 2022-01-10T01:33:55.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb516ecf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5100ba6b0 con 0x7fb5100b5990 2022-01-10T01:33:55.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb516ecf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb51005ffe0 con 0x7fb5100b6560 2022-01-10T01:33:55.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb50ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5100b6560 0x7fb5100b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:55.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb51546c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5100b5990 0x7fb5100b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:55.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb514c6b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb51005fc00 0x7fb5100b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:58198/0 (socket says 172.21.15.36:58198) 2022-01-10T01:33:55.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb514c6b700 1 -- 172.21.15.36:0/919609945 learned_addr learned my addr 172.21.15.36:0/919609945 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:55.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb51546c700 1 -- 172.21.15.36:0/919609945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5100b6560 msgr2=0x7fb5100b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:55.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb51546c700 1 --2- 172.21.15.36:0/919609945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5100b6560 0x7fb5100b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:55.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb51546c700 1 -- 172.21.15.36:0/919609945 >> v1:172.21.15.59:6789/0 conn(0x7fb51005fc00 legacy=0x7fb5100b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:55.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb51546c700 1 -- 172.21.15.36:0/919609945 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb510143a50 con 0x7fb5100b5990 2022-01-10T01:33:55.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb50f7fe700 1 -- 172.21.15.36:0/919609945 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896392341 0 0) 0x7fb510143f60 con 0x7fb51005fc00 2022-01-10T01:33:55.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb50ffff700 1 --2- 172.21.15.36:0/919609945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5100b6560 0x7fb5100b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:55.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb51546c700 1 --2- 172.21.15.36:0/919609945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5100b5990 0x7fb5100b4a00 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fb508002f70 tx=0x7fb508006df0).ready entity=mon.1 client_cookie=eaf5cc20b285660a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:55.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb50f7fe700 1 -- 172.21.15.36:0/919609945 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb50800d570 con 0x7fb5100b5990 2022-01-10T01:33:55.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb50f7fe700 1 -- 172.21.15.36:0/919609945 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb508000e90 con 0x7fb5100b5990 2022-01-10T01:33:55.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb50f7fe700 1 -- 172.21.15.36:0/919609945 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb50800d8c0 con 0x7fb5100b5990 2022-01-10T01:33:55.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb516ecf700 1 -- 172.21.15.36:0/919609945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5100b5990 msgr2=0x7fb5100b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:55.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb516ecf700 1 --2- 172.21.15.36:0/919609945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5100b5990 0x7fb5100b4a00 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fb508002f70 tx=0x7fb508006df0).stop 2022-01-10T01:33:55.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb516ecf700 1 -- 172.21.15.36:0/919609945 shutdown_connections 2022-01-10T01:33:55.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb516ecf700 1 --2- 172.21.15.36:0/919609945 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5100b5990 0x7fb5100b4a00 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:55.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb516ecf700 1 --2- 172.21.15.36:0/919609945 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5100b6560 0x7fb5100b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:55.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb516ecf700 1 -- 172.21.15.36:0/919609945 >> 172.21.15.36:0/919609945 conn(0x7fb5100623a0 msgr2=0x7fb510066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:55.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb516ecf700 1 -- 172.21.15.36:0/919609945 shutdown_connections 2022-01-10T01:33:55.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.929+0000 7fb516ecf700 1 -- 172.21.15.36:0/919609945 wait complete. 2022-01-10T01:33:55.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb516ecf700 1 Processor -- start 2022-01-10T01:33:55.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb516ecf700 1 -- start start 2022-01-10T01:33:55.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb516ecf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb51005fc00 0x7fb5100aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:55.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb516ecf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5100b5990 0x7fb510144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:55.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb516ecf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5100b6560 0x7fb510145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:55.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb516ecf700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb510146e20 con 0x7fb51005fc00 2022-01-10T01:33:55.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb516ecf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5100afc90 con 0x7fb5100b6560 2022-01-10T01:33:55.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb516ecf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5100aff30 con 0x7fb5100b5990 2022-01-10T01:33:55.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb514c6b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb51005fc00 0x7fb5100aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:55.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb514c6b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb51005fc00 0x7fb5100aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42734/0 (socket says 172.21.15.36:42734) 2022-01-10T01:33:55.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb514c6b700 1 -- 172.21.15.36:0/3165011323 learned_addr learned my addr 172.21.15.36:0/3165011323 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:55.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb51546c700 1 --2- 172.21.15.36:0/3165011323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5100b6560 0x7fb510145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:55.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb50ffff700 1 --2- 172.21.15.36:0/3165011323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5100b5990 0x7fb510144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:55.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb514c6b700 1 -- 172.21.15.36:0/3165011323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5100b5990 msgr2=0x7fb510144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:55.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb514c6b700 1 --2- 172.21.15.36:0/3165011323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5100b5990 0x7fb510144750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:55.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb514c6b700 1 -- 172.21.15.36:0/3165011323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5100b6560 msgr2=0x7fb510145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:55.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb514c6b700 1 --2- 172.21.15.36:0/3165011323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5100b6560 0x7fb510145de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:55.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb514c6b700 1 -- 172.21.15.36:0/3165011323 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f8009470 con 0x7fb51005fc00 2022-01-10T01:33:55.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb514c6b700 1 --2- 172.21.15.36:0/3165011323 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb51005fc00 0x7fb5100aeeb0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fb500000ed0 tx=0x7fb500007ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:55.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb50dffb700 1 -- 172.21.15.36:0/3165011323 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5000070d0 con 0x7fb51005fc00 2022-01-10T01:33:55.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb50dffb700 1 -- 172.21.15.36:0/3165011323 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb500007230 con 0x7fb51005fc00 2022-01-10T01:33:55.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb516ecf700 1 -- 172.21.15.36:0/3165011323 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50800b180 con 0x7fb51005fc00 2022-01-10T01:33:55.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.933+0000 7fb50dffb700 1 -- 172.21.15.36:0/3165011323 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb500005610 con 0x7fb51005fc00 2022-01-10T01:33:55.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.937+0000 7fb516ecf700 1 -- 172.21.15.36:0/3165011323 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5100b8050 con 0x7fb51005fc00 2022-01-10T01:33:55.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.937+0000 7fb516ecf700 1 -- 172.21.15.36:0/3165011323 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5100af3f0 con 0x7fb51005fc00 2022-01-10T01:33:55.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.937+0000 7fb50dffb700 1 -- 172.21.15.36:0/3165011323 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb50001a060 con 0x7fb51005fc00 2022-01-10T01:33:55.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.937+0000 7fb50dffb700 1 --2- 172.21.15.36:0/3165011323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb4f40535f0 0x7fb4f4055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:55.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.937+0000 7fb50dffb700 1 -- 172.21.15.36:0/3165011323 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fb50006abb0 con 0x7fb51005fc00 2022-01-10T01:33:55.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.937+0000 7fb50ffff700 1 --2- 172.21.15.36:0/3165011323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb4f40535f0 0x7fb4f4055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:55.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.941+0000 7fb50ffff700 1 --2- 172.21.15.36:0/3165011323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb4f40535f0 0x7fb4f4055ab0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fb4f800b000 tx=0x7fb4f80091d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:55.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:55.945+0000 7fb50dffb700 1 -- 172.21.15.36:0/3165011323 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb500041d90 con 0x7fb51005fc00 2022-01-10T01:33:56.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.073+0000 7fb516ecf700 1 -- 172.21.15.36:0/3165011323 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb510143cc0 con 0x7fb51005fc00 2022-01-10T01:33:56.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.081+0000 7fb50dffb700 1 -- 172.21.15.36:0/3165011323 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb500018020 con 0x7fb51005fc00 2022-01-10T01:33:56.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.081+0000 7fb516ecf700 1 -- 172.21.15.36:0/3165011323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb4f40535f0 msgr2=0x7fb4f4055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:56.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.081+0000 7fb516ecf700 1 --2- 172.21.15.36:0/3165011323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb4f40535f0 0x7fb4f4055ab0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fb4f800b000 tx=0x7fb4f80091d0).stop 2022-01-10T01:33:56.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.081+0000 7fb516ecf700 1 -- 172.21.15.36:0/3165011323 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb51005fc00 msgr2=0x7fb5100aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:56.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.081+0000 7fb516ecf700 1 --2- 172.21.15.36:0/3165011323 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb51005fc00 0x7fb5100aeeb0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7fb500000ed0 tx=0x7fb500007ce0).stop 2022-01-10T01:33:56.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.081+0000 7fb516ecf700 1 -- 172.21.15.36:0/3165011323 shutdown_connections 2022-01-10T01:33:56.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.081+0000 7fb516ecf700 1 --2- 172.21.15.36:0/3165011323 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb4f40535f0 0x7fb4f4055ab0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.081+0000 7fb516ecf700 1 --2- 172.21.15.36:0/3165011323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5100b6560 0x7fb510145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.081+0000 7fb516ecf700 1 --2- 172.21.15.36:0/3165011323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb5100b5990 0x7fb510144750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.081+0000 7fb516ecf700 1 --2- 172.21.15.36:0/3165011323 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb51005fc00 0x7fb5100aeeb0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.081+0000 7fb516ecf700 1 -- 172.21.15.36:0/3165011323 >> 172.21.15.36:0/3165011323 conn(0x7fb5100623a0 msgr2=0x7fb510127d60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:56.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.081+0000 7fb516ecf700 1 -- 172.21.15.36:0/3165011323 shutdown_connections 2022-01-10T01:33:56.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.081+0000 7fb516ecf700 1 -- 172.21.15.36:0/3165011323 wait complete. 2022-01-10T01:33:56.103 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2022-01-10T01:33:56.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.193+0000 7fd391a8a700 1 Processor -- start 2022-01-10T01:33:56.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.193+0000 7fd391a8a700 1 -- start start 2022-01-10T01:33:56.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391a8a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd38c0b0b80 0x7fd38c146c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:56.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391a8a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38c0b1140 con 0x7fd38c0b03d0 2022-01-10T01:33:56.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391a8a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38c0a9570 con 0x7fd38c0a9190 2022-01-10T01:33:56.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391a8a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c0b1370 con 0x7fd38c0b0b80 2022-01-10T01:33:56.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391289700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fd38c0b03d0 0x7fd38c1401c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40540/0 (socket says 172.21.15.36:40540) 2022-01-10T01:33:56.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391289700 1 -- 172.21.15.36:0/3956372303 learned_addr learned my addr 172.21.15.36:0/3956372303 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:56.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd38bfff700 1 --2- 172.21.15.36:0/3956372303 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd38c0b0b80 0x7fd38c146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:56.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd38b7fe700 1 -- 172.21.15.36:0/3956372303 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767342169 0 0) 0x7fd38c0b1140 con 0x7fd38c0b03d0 2022-01-10T01:33:56.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd38b7fe700 1 -- 172.21.15.36:0/3956372303 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd378003260 con 0x7fd38c0b03d0 2022-01-10T01:33:56.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd38b7fe700 1 -- 172.21.15.36:0/3956372303 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159285302 0 0) 0x7fd38c0a9570 con 0x7fd38c0a9190 2022-01-10T01:33:56.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd38b7fe700 1 -- 172.21.15.36:0/3956372303 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd38c0b1140 con 0x7fd38c0a9190 2022-01-10T01:33:56.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd38bfff700 1 -- 172.21.15.36:0/3956372303 >> v1:172.21.15.59:6789/0 conn(0x7fd38c0a9190 legacy=0x7fd38c146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:56.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd38bfff700 1 -- 172.21.15.36:0/3956372303 >> v1:172.21.15.36:6789/0 conn(0x7fd38c0b03d0 legacy=0x7fd38c1401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:56.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd38bfff700 1 -- 172.21.15.36:0/3956372303 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38c0b1610 con 0x7fd38c0b0b80 2022-01-10T01:33:56.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd38bfff700 1 --2- 172.21.15.36:0/3956372303 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd38c0b0b80 0x7fd38c146c60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fd380002f70 tx=0x7fd380006df0).ready entity=mon.2 client_cookie=1820723793d3c4f1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:56.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd38b7fe700 1 -- 172.21.15.36:0/3956372303 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd38000d5c0 con 0x7fd38c0b0b80 2022-01-10T01:33:56.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd38b7fe700 1 -- 172.21.15.36:0/3956372303 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd380000e90 con 0x7fd38c0b0b80 2022-01-10T01:33:56.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd38b7fe700 1 -- 172.21.15.36:0/3956372303 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd38000d910 con 0x7fd38c0b0b80 2022-01-10T01:33:56.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391a8a700 1 -- 172.21.15.36:0/3956372303 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd38c0b0b80 msgr2=0x7fd38c146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:56.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391a8a700 1 --2- 172.21.15.36:0/3956372303 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd38c0b0b80 0x7fd38c146c60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7fd380002f70 tx=0x7fd380006df0).stop 2022-01-10T01:33:56.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391a8a700 1 -- 172.21.15.36:0/3956372303 shutdown_connections 2022-01-10T01:33:56.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391a8a700 1 --2- 172.21.15.36:0/3956372303 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd38c0b0b80 0x7fd38c146c60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391a8a700 1 -- 172.21.15.36:0/3956372303 >> 172.21.15.36:0/3956372303 conn(0x7fd38c061140 msgr2=0x7fd38c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:56.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391a8a700 1 -- 172.21.15.36:0/3956372303 shutdown_connections 2022-01-10T01:33:56.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391a8a700 1 -- 172.21.15.36:0/3956372303 wait complete. 2022-01-10T01:33:56.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391a8a700 1 Processor -- start 2022-01-10T01:33:56.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.197+0000 7fd391a8a700 1 -- start start 2022-01-10T01:33:56.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd391a8a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd38c0a9190 0x7fd38c140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:56.214 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd391a8a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd38c0b03d0 0x7fd38c0af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:56.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd391a8a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c0b0b80 0x7fd38c143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:56.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd391a8a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c0b3ea0 con 0x7fd38c0b03d0 2022-01-10T01:33:56.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd391a8a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c1423c0 con 0x7fd38c0b0b80 2022-01-10T01:33:56.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd391a8a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38c1425f0 con 0x7fd38c0a9190 2022-01-10T01:33:56.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd38bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd38c0b03d0 0x7fd38c0af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:56.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd38bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd38c0b03d0 0x7fd38c0af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42750/0 (socket says 172.21.15.36:42750) 2022-01-10T01:33:56.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd38bfff700 1 -- 172.21.15.36:0/329308285 learned_addr learned my addr 172.21.15.36:0/329308285 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:56.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd390a88700 1 --2- 172.21.15.36:0/329308285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd38c0a9190 0x7fd38c140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:56.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd391289700 1 --2- 172.21.15.36:0/329308285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c0b0b80 0x7fd38c143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:56.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd38bfff700 1 -- 172.21.15.36:0/329308285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd38c0a9190 msgr2=0x7fd38c140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:56.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd38bfff700 1 --2- 172.21.15.36:0/329308285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd38c0a9190 0x7fd38c140ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd38bfff700 1 -- 172.21.15.36:0/329308285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c0b0b80 msgr2=0x7fd38c143640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:56.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd38bfff700 1 --2- 172.21.15.36:0/329308285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c0b0b80 0x7fd38c143640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd38bfff700 1 -- 172.21.15.36:0/329308285 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38000b180 con 0x7fd38c0b03d0 2022-01-10T01:33:56.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd38bfff700 1 --2- 172.21.15.36:0/329308285 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd38c0b03d0 0x7fd38c0af3c0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7fd380002f70 tx=0x7fd380014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:56.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd389ffb700 1 -- 172.21.15.36:0/329308285 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd380013de0 con 0x7fd38c0b03d0 2022-01-10T01:33:56.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd389ffb700 1 -- 172.21.15.36:0/329308285 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38001e400 con 0x7fd38c0b03d0 2022-01-10T01:33:56.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd391a8a700 1 -- 172.21.15.36:0/329308285 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd38c142890 con 0x7fd38c0b03d0 2022-01-10T01:33:56.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd389ffb700 1 -- 172.21.15.36:0/329308285 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd38001e760 con 0x7fd38c0b03d0 2022-01-10T01:33:56.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd391a8a700 1 -- 172.21.15.36:0/329308285 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38c0ae560 con 0x7fd38c0b03d0 2022-01-10T01:33:56.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.201+0000 7fd391a8a700 1 -- 172.21.15.36:0/329308285 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd38c0ac650 con 0x7fd38c0b03d0 2022-01-10T01:33:56.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.205+0000 7fd389ffb700 1 -- 172.21.15.36:0/329308285 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd380025030 con 0x7fd38c0b03d0 2022-01-10T01:33:56.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.205+0000 7fd389ffb700 1 --2- 172.21.15.36:0/329308285 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd36c0535f0 0x7fd36c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:56.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.205+0000 7fd389ffb700 1 -- 172.21.15.36:0/329308285 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fd38006c400 con 0x7fd38c0b03d0 2022-01-10T01:33:56.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.205+0000 7fd390a88700 1 --2- 172.21.15.36:0/329308285 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd36c0535f0 0x7fd36c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:56.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.205+0000 7fd390a88700 1 --2- 172.21.15.36:0/329308285 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd36c0535f0 0x7fd36c055ab0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fd37c00d000 tx=0x7fd37c007a20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:56.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.209+0000 7fd389ffb700 1 -- 172.21.15.36:0/329308285 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd3800436f0 con 0x7fd38c0b03d0 2022-01-10T01:33:56.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.373+0000 7fd391a8a700 1 -- 172.21.15.36:0/329308285 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7fd38c057350 con 0x7fd38c0b03d0 2022-01-10T01:33:56.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.813+0000 7fd389ffb700 1 -- 172.21.15.36:0/329308285 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v445) v1 ==== 127+0+0 (secure 0 0 0) 0x7fd380023020 con 0x7fd38c0b03d0 2022-01-10T01:33:56.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.817+0000 7fd391a8a700 1 -- 172.21.15.36:0/329308285 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd36c0535f0 msgr2=0x7fd36c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:56.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.817+0000 7fd391a8a700 1 --2- 172.21.15.36:0/329308285 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd36c0535f0 0x7fd36c055ab0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fd37c00d000 tx=0x7fd37c007a20).stop 2022-01-10T01:33:56.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.817+0000 7fd391a8a700 1 -- 172.21.15.36:0/329308285 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd38c0b03d0 msgr2=0x7fd38c0af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:56.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.817+0000 7fd391a8a700 1 --2- 172.21.15.36:0/329308285 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd38c0b03d0 0x7fd38c0af3c0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7fd380002f70 tx=0x7fd380014000).stop 2022-01-10T01:33:56.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.817+0000 7fd391a8a700 1 -- 172.21.15.36:0/329308285 shutdown_connections 2022-01-10T01:33:56.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.817+0000 7fd391a8a700 1 --2- 172.21.15.36:0/329308285 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd36c0535f0 0x7fd36c055ab0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.817+0000 7fd391a8a700 1 --2- 172.21.15.36:0/329308285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd38c0b0b80 0x7fd38c143640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.817+0000 7fd391a8a700 1 --2- 172.21.15.36:0/329308285 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd38c0b03d0 0x7fd38c0af3c0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.817+0000 7fd391a8a700 1 --2- 172.21.15.36:0/329308285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd38c0a9190 0x7fd38c140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.817+0000 7fd391a8a700 1 -- 172.21.15.36:0/329308285 >> 172.21.15.36:0/329308285 conn(0x7fd38c061140 msgr2=0x7fd38c13e910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:56.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.817+0000 7fd391a8a700 1 -- 172.21.15.36:0/329308285 shutdown_connections 2022-01-10T01:33:56.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.817+0000 7fd391a8a700 1 -- 172.21.15.36:0/329308285 wait complete. 2022-01-10T01:33:56.843 INFO:tasks.cephfs_test_runner:test_root_rctime (tasks.cephfs.test_misc.TestMisc) ... ok 2022-01-10T01:33:56.843 INFO:tasks.cephfs_test_runner:Starting test: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2022-01-10T01:33:56.844 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs' 2022-01-10T01:33:56.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.941+0000 7fe10ffff700 1 Processor -- start 2022-01-10T01:33:56.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.941+0000 7fe10ffff700 1 -- start start 2022-01-10T01:33:56.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.941+0000 7fe10ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1100b0610 0x7fe1100af550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:56.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.941+0000 7fe10ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe1101475a0 0x7fe1100acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:56.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.941+0000 7fe10ffff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1101479f0 con 0x7fe1100b54a0 2022-01-10T01:33:56.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.941+0000 7fe10ffff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1101452e0 con 0x7fe1101475a0 2022-01-10T01:33:56.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.941+0000 7fe10ffff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1100adff0 con 0x7fe1100b0610 2022-01-10T01:33:56.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.941+0000 7fe10f7fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe1101475a0 0x7fe1100acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:56.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.941+0000 7fe10e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1100b0610 0x7fe1100af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:56.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10e7fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1100b0610 0x7fe1100af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:39392/0 (socket says 172.21.15.36:39392) 2022-01-10T01:33:56.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10e7fc700 1 -- 172.21.15.36:0/578866901 learned_addr learned my addr 172.21.15.36:0/578866901 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:56.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe1100b54a0 0x7fe1100675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:58226/0 (socket says 172.21.15.36:58226) 2022-01-10T01:33:56.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10f7fe700 1 -- 172.21.15.36:0/578866901 >> v2:172.21.15.59:3300/0 conn(0x7fe1100b0610 msgr2=0x7fe1100af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:56.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10f7fe700 1 --2- 172.21.15.36:0/578866901 >> v2:172.21.15.59:3300/0 conn(0x7fe1100b0610 0x7fe1100af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10f7fe700 1 -- 172.21.15.36:0/578866901 >> v1:172.21.15.59:6789/0 conn(0x7fe1100b54a0 legacy=0x7fe1100675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:56.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10f7fe700 1 -- 172.21.15.36:0/578866901 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1100b5880 con 0x7fe1101475a0 2022-01-10T01:33:56.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10f7fe700 1 --2- 172.21.15.36:0/578866901 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1101475a0 0x7fe1100acc60 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7fe108002f70 tx=0x7fe108006df0).ready entity=mon.0 client_cookie=7aed612381550519 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:56.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10dffb700 1 -- 172.21.15.36:0/578866901 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe10800d570 con 0x7fe1101475a0 2022-01-10T01:33:56.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10dffb700 1 -- 172.21.15.36:0/578866901 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe108000e90 con 0x7fe1101475a0 2022-01-10T01:33:56.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10dffb700 1 -- 172.21.15.36:0/578866901 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe10800d8c0 con 0x7fe1101475a0 2022-01-10T01:33:56.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10ffff700 1 -- 172.21.15.36:0/578866901 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1101475a0 msgr2=0x7fe1100acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:56.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10ffff700 1 --2- 172.21.15.36:0/578866901 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1101475a0 0x7fe1100acc60 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7fe108002f70 tx=0x7fe108006df0).stop 2022-01-10T01:33:56.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10ffff700 1 -- 172.21.15.36:0/578866901 shutdown_connections 2022-01-10T01:33:56.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10ffff700 1 --2- 172.21.15.36:0/578866901 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1101475a0 0x7fe1100acc60 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10ffff700 1 --2- 172.21.15.36:0/578866901 >> v2:172.21.15.59:3300/0 conn(0x7fe1100b0610 0x7fe1100af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10ffff700 1 -- 172.21.15.36:0/578866901 >> 172.21.15.36:0/578866901 conn(0x7fe110062560 msgr2=0x7fe110062940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:56.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10ffff700 1 -- 172.21.15.36:0/578866901 shutdown_connections 2022-01-10T01:33:56.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10ffff700 1 -- 172.21.15.36:0/578866901 wait complete. 2022-01-10T01:33:56.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10ffff700 1 Processor -- start 2022-01-10T01:33:56.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.945+0000 7fe10ffff700 1 -- start start 2022-01-10T01:33:56.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1100b0610 0x7fe1100a8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:56.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1100b54a0 0x7fe1100b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:56.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1101475a0 0x7fe110063240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:56.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10ffff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101573e0 con 0x7fe1100b0610 2022-01-10T01:33:56.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10ffff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe110157610 con 0x7fe1101475a0 2022-01-10T01:33:56.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10ffff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1101578b0 con 0x7fe1100b54a0 2022-01-10T01:33:56.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10effd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1100b0610 0x7fe1100a8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:56.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10effd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1100b0610 0x7fe1100a8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42764/0 (socket says 172.21.15.36:42764) 2022-01-10T01:33:56.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10effd700 1 -- 172.21.15.36:0/2085914088 learned_addr learned my addr 172.21.15.36:0/2085914088 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:56.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10f7fe700 1 --2- 172.21.15.36:0/2085914088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1101475a0 0x7fe110063240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:56.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10e7fc700 1 --2- 172.21.15.36:0/2085914088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1100b54a0 0x7fe1100b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:56.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10effd700 1 -- 172.21.15.36:0/2085914088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1100b54a0 msgr2=0x7fe1100b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:56.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10effd700 1 --2- 172.21.15.36:0/2085914088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1100b54a0 0x7fe1100b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10effd700 1 -- 172.21.15.36:0/2085914088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1101475a0 msgr2=0x7fe110063240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:56.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10effd700 1 --2- 172.21.15.36:0/2085914088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1101475a0 0x7fe110063240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:56.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10effd700 1 -- 172.21.15.36:0/2085914088 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10800b180 con 0x7fe1100b0610 2022-01-10T01:33:56.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10effd700 1 --2- 172.21.15.36:0/2085914088 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1100b0610 0x7fe1100a8280 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7fe110069d90 tx=0x7fe104007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:56.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe0fffff700 1 -- 172.21.15.36:0/2085914088 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1040070d0 con 0x7fe1100b0610 2022-01-10T01:33:56.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe0fffff700 1 -- 172.21.15.36:0/2085914088 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe104007230 con 0x7fe1100b0610 2022-01-10T01:33:56.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10ffff700 1 -- 172.21.15.36:0/2085914088 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1100a7b40 con 0x7fe1100b0610 2022-01-10T01:33:56.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe0fffff700 1 -- 172.21.15.36:0/2085914088 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe104005550 con 0x7fe1100b0610 2022-01-10T01:33:56.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.949+0000 7fe10ffff700 1 -- 172.21.15.36:0/2085914088 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1100ac070 con 0x7fe1100b0610 2022-01-10T01:33:56.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.953+0000 7fe10ffff700 1 -- 172.21.15.36:0/2085914088 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe110057350 con 0x7fe1100b0610 2022-01-10T01:33:56.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.953+0000 7fe0fffff700 1 -- 172.21.15.36:0/2085914088 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe10401a070 con 0x7fe1100b0610 2022-01-10T01:33:56.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.953+0000 7fe0fffff700 1 --2- 172.21.15.36:0/2085914088 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe0ec0535f0 0x7fe0ec055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:56.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.953+0000 7fe0fffff700 1 -- 172.21.15.36:0/2085914088 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fe10406a6b0 con 0x7fe1100b0610 2022-01-10T01:33:56.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.953+0000 7fe10e7fc700 1 --2- 172.21.15.36:0/2085914088 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe0ec0535f0 0x7fe0ec055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:56.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.953+0000 7fe10e7fc700 1 --2- 172.21.15.36:0/2085914088 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe0ec0535f0 0x7fe0ec055ab0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fe10000b000 tx=0x7fe100009290).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:56.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:56.961+0000 7fe0fffff700 1 -- 172.21.15.36:0/2085914088 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe1040419a0 con 0x7fe1100b0610 2022-01-10T01:33:57.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.133+0000 7fe10ffff700 1 -- 172.21.15.36:0/2085914088 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]} v 0) v1 -- 0x7fe11005f240 con 0x7fe1100b0610 2022-01-10T01:33:57.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.817+0000 7fe0fffff700 1 -- 172.21.15.36:0/2085914088 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]}]=0 v446) v1 ==== 139+0+0 (secure 0 0 0) 0x7fe104044fc0 con 0x7fe1100b0610 2022-01-10T01:33:57.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.821+0000 7fe10ffff700 1 -- 172.21.15.36:0/2085914088 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe0ec0535f0 msgr2=0x7fe0ec055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:57.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.821+0000 7fe10ffff700 1 --2- 172.21.15.36:0/2085914088 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe0ec0535f0 0x7fe0ec055ab0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fe10000b000 tx=0x7fe100009290).stop 2022-01-10T01:33:57.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.821+0000 7fe10ffff700 1 -- 172.21.15.36:0/2085914088 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1100b0610 msgr2=0x7fe1100a8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:57.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.821+0000 7fe10ffff700 1 --2- 172.21.15.36:0/2085914088 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1100b0610 0x7fe1100a8280 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7fe110069d90 tx=0x7fe104007c40).stop 2022-01-10T01:33:57.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.821+0000 7fe10ffff700 1 -- 172.21.15.36:0/2085914088 shutdown_connections 2022-01-10T01:33:57.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.821+0000 7fe10ffff700 1 --2- 172.21.15.36:0/2085914088 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe0ec0535f0 0x7fe0ec055ab0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:57.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.821+0000 7fe10ffff700 1 --2- 172.21.15.36:0/2085914088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1101475a0 0x7fe110063240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:57.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.821+0000 7fe10ffff700 1 --2- 172.21.15.36:0/2085914088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1100b54a0 0x7fe1100b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:57.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.821+0000 7fe10ffff700 1 --2- 172.21.15.36:0/2085914088 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1100b0610 0x7fe1100a8280 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:57.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.821+0000 7fe10ffff700 1 -- 172.21.15.36:0/2085914088 >> 172.21.15.36:0/2085914088 conn(0x7fe110062560 msgr2=0x7fe110143a00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:57.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.821+0000 7fe10ffff700 1 -- 172.21.15.36:0/2085914088 shutdown_connections 2022-01-10T01:33:57.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.821+0000 7fe10ffff700 1 -- 172.21.15.36:0/2085914088 wait complete. 2022-01-10T01:33:57.846 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2022-01-10T01:33:57.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.953+0000 7f21648f9700 1 Processor -- start 2022-01-10T01:33:57.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.953+0000 7f21648f9700 1 -- start start 2022-01-10T01:33:57.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f21648f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f21600b4710 0x7f216013fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:57.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f21648f9700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f21601439a0 0x7f2160140290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:57.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f21648f9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21600b6910 con 0x7f2160061680 2022-01-10T01:33:57.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f21648f9700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21600b9680 con 0x7f21601439a0 2022-01-10T01:33:57.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f21648f9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21600b6bb0 con 0x7f21600b4710 2022-01-10T01:33:57.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f215ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f21601439a0 0x7f2160140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:57.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f215ffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f21601439a0 0x7f2160140290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42774/0 (socket says 172.21.15.36:42774) 2022-01-10T01:33:57.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f215ffff700 1 -- 172.21.15.36:0/2657799932 learned_addr learned my addr 172.21.15.36:0/2657799932 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:57.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f215effd700 1 --2- 172.21.15.36:0/2657799932 >> v2:172.21.15.59:3300/0 conn(0x7f21600b4710 0x7f216013fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:57.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f215ffff700 1 -- 172.21.15.36:0/2657799932 >> v2:172.21.15.59:3300/0 conn(0x7f21600b4710 msgr2=0x7f216013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:57.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f215ffff700 1 --2- 172.21.15.36:0/2657799932 >> v2:172.21.15.59:3300/0 conn(0x7f21600b4710 0x7f216013fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:57.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f215ffff700 1 -- 172.21.15.36:0/2657799932 >> v1:172.21.15.59:6789/0 conn(0x7f2160061680 legacy=0x7f21600b9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:57.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f215ffff700 1 -- 172.21.15.36:0/2657799932 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21600b6e50 con 0x7f21601439a0 2022-01-10T01:33:57.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f215ffff700 1 --2- 172.21.15.36:0/2657799932 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f21601439a0 0x7f2160140290 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f21580032f0 tx=0x7f2158009290).ready entity=mon.0 client_cookie=47eb60783c689b0e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:57.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f215e7fc700 1 -- 172.21.15.36:0/2657799932 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f215800b870 con 0x7f21601439a0 2022-01-10T01:33:57.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f215e7fc700 1 -- 172.21.15.36:0/2657799932 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215800b9d0 con 0x7f21601439a0 2022-01-10T01:33:57.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f215e7fc700 1 -- 172.21.15.36:0/2657799932 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f215800bb40 con 0x7f21601439a0 2022-01-10T01:33:57.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f21648f9700 1 -- 172.21.15.36:0/2657799932 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f21601439a0 msgr2=0x7f2160140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:57.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f21648f9700 1 --2- 172.21.15.36:0/2657799932 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f21601439a0 0x7f2160140290 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f21580032f0 tx=0x7f2158009290).stop 2022-01-10T01:33:57.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f21648f9700 1 -- 172.21.15.36:0/2657799932 shutdown_connections 2022-01-10T01:33:57.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f21648f9700 1 --2- 172.21.15.36:0/2657799932 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f21601439a0 0x7f2160140290 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:57.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f21648f9700 1 --2- 172.21.15.36:0/2657799932 >> v2:172.21.15.59:3300/0 conn(0x7f21600b4710 0x7f216013fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:57.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f21648f9700 1 -- 172.21.15.36:0/2657799932 >> 172.21.15.36:0/2657799932 conn(0x7f216006adf0 msgr2=0x7f216005f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:57.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f21648f9700 1 -- 172.21.15.36:0/2657799932 shutdown_connections 2022-01-10T01:33:57.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.957+0000 7f21648f9700 1 -- 172.21.15.36:0/2657799932 wait complete. 2022-01-10T01:33:57.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f21648f9700 1 Processor -- start 2022-01-10T01:33:57.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f21648f9700 1 -- start start 2022-01-10T01:33:57.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f21648f9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2160061680 0x7f21600b8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:57.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f21648f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21601439a0 0x7f21600b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:57.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f21648f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2160146750 0x7f216013f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:57.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f21648f9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21600ad830 con 0x7f2160061680 2022-01-10T01:33:57.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f21648f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21601534b0 con 0x7f21601439a0 2022-01-10T01:33:57.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f21648f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2160147150 con 0x7f2160146750 2022-01-10T01:33:57.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f215f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2160061680 0x7f21600b8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:57.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f215f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2160061680 0x7f21600b8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42776/0 (socket says 172.21.15.36:42776) 2022-01-10T01:33:57.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f215f7fe700 1 -- 172.21.15.36:0/1844929503 learned_addr learned my addr 172.21.15.36:0/1844929503 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:57.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f215effd700 1 --2- 172.21.15.36:0/1844929503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21601439a0 0x7f21600b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:57.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f215ffff700 1 --2- 172.21.15.36:0/1844929503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2160146750 0x7f216013f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:57.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f215f7fe700 1 -- 172.21.15.36:0/1844929503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2160146750 msgr2=0x7f216013f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:57.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f215f7fe700 1 --2- 172.21.15.36:0/1844929503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2160146750 0x7f216013f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:57.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f215f7fe700 1 -- 172.21.15.36:0/1844929503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21601439a0 msgr2=0x7f21600b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:57.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f215f7fe700 1 --2- 172.21.15.36:0/1844929503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21601439a0 0x7f21600b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:57.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f215f7fe700 1 -- 172.21.15.36:0/1844929503 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158009530 con 0x7f2160061680 2022-01-10T01:33:57.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f215f7fe700 1 --2- 172.21.15.36:0/1844929503 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2160061680 0x7f21600b8850 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f21600af5d0 tx=0x7f2150007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:57.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f215cff9700 1 -- 172.21.15.36:0/1844929503 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2150007030 con 0x7f2160061680 2022-01-10T01:33:57.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f215cff9700 1 -- 172.21.15.36:0/1844929503 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2150007190 con 0x7f2160061680 2022-01-10T01:33:57.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f21648f9700 1 -- 172.21.15.36:0/1844929503 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2160156570 con 0x7f2160061680 2022-01-10T01:33:57.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f215cff9700 1 -- 172.21.15.36:0/1844929503 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2150006510 con 0x7f2160061680 2022-01-10T01:33:57.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.961+0000 7f21648f9700 1 -- 172.21.15.36:0/1844929503 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21600b8d40 con 0x7f2160061680 2022-01-10T01:33:57.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.965+0000 7f215cff9700 1 -- 172.21.15.36:0/1844929503 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2150010030 con 0x7f2160061680 2022-01-10T01:33:57.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.965+0000 7f21648f9700 1 -- 172.21.15.36:0/1844929503 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2160156700 con 0x7f2160061680 2022-01-10T01:33:57.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.965+0000 7f215cff9700 1 --2- 172.21.15.36:0/1844929503 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2140053680 0x7f2140055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:57.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.965+0000 7f215cff9700 1 -- 172.21.15.36:0/1844929503 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f215006b330 con 0x7f2160061680 2022-01-10T01:33:57.979 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.965+0000 7f215effd700 1 --2- 172.21.15.36:0/1844929503 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2140053680 0x7f2140055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:57.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.965+0000 7f215effd700 1 --2- 172.21.15.36:0/1844929503 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2140053680 0x7f2140055b40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f215400b000 tx=0x7f2154006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:57.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:57.973+0000 7f215cff9700 1 -- 172.21.15.36:0/1844929503 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2150042620 con 0x7f2160061680 2022-01-10T01:33:58.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.105+0000 7f21648f9700 1 -- 172.21.15.36:0/1844929503 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2160057350 con 0x7f2160061680 2022-01-10T01:33:58.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.113+0000 7f215cff9700 1 -- 172.21.15.36:0/1844929503 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2150045c40 con 0x7f2160061680 2022-01-10T01:33:58.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.113+0000 7f21648f9700 1 -- 172.21.15.36:0/1844929503 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2140053680 msgr2=0x7f2140055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:58.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.113+0000 7f21648f9700 1 --2- 172.21.15.36:0/1844929503 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2140053680 0x7f2140055b40 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f215400b000 tx=0x7f2154006df0).stop 2022-01-10T01:33:58.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.113+0000 7f21648f9700 1 -- 172.21.15.36:0/1844929503 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2160061680 msgr2=0x7f21600b8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:58.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.113+0000 7f21648f9700 1 --2- 172.21.15.36:0/1844929503 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2160061680 0x7f21600b8850 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f21600af5d0 tx=0x7f2150007c10).stop 2022-01-10T01:33:58.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.117+0000 7f21648f9700 1 -- 172.21.15.36:0/1844929503 shutdown_connections 2022-01-10T01:33:58.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.117+0000 7f21648f9700 1 --2- 172.21.15.36:0/1844929503 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2140053680 0x7f2140055b40 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.117+0000 7f21648f9700 1 --2- 172.21.15.36:0/1844929503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2160146750 0x7f216013f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.117+0000 7f21648f9700 1 --2- 172.21.15.36:0/1844929503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21601439a0 0x7f21600b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.117+0000 7f21648f9700 1 --2- 172.21.15.36:0/1844929503 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2160061680 0x7f21600b8850 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.117+0000 7f21648f9700 1 -- 172.21.15.36:0/1844929503 >> 172.21.15.36:0/1844929503 conn(0x7f216006adf0 msgr2=0x7f2160142360 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:58.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.117+0000 7f21648f9700 1 -- 172.21.15.36:0/1844929503 shutdown_connections 2022-01-10T01:33:58.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.117+0000 7f21648f9700 1 -- 172.21.15.36:0/1844929503 wait complete. 2022-01-10T01:33:58.137 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:33:58.138 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:58.157 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:58.177 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:58.198 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:33:58.220 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:33:58.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:58.221 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:58.221 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:33:58.228 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2022-01-10T01:33:58.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:33:58.232 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2022-01-10T01:33:58.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:33:58.233 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:33:58.233 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:33:58.269 INFO:teuthology.orchestra.run.smithi166.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2022-01-10T01:33:58.269 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:33:58.270 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2022-01-10T01:33:58.271 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:33:58.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.373+0000 7f4dc759e700 1 Processor -- start 2022-01-10T01:33:58.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.373+0000 7f4dc759e700 1 -- start start 2022-01-10T01:33:58.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.373+0000 7f4dc759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4dc80b2580 0x7f4dc814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:58.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.373+0000 7f4dc759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc80b0010 0x7f4dc814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:58.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.373+0000 7f4dc759e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc80a70c0 con 0x7f4dc80afbd0 2022-01-10T01:33:58.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.373+0000 7f4dc759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc80a72f0 con 0x7f4dc80b2580 2022-01-10T01:33:58.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.373+0000 7f4dc759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80a7590 con 0x7f4dc80b0010 2022-01-10T01:33:58.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc6d9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f4dc80afbd0 0x7f4dc80a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40582/0 (socket says 172.21.15.36:40582) 2022-01-10T01:33:58.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc6d9d700 1 -- 172.21.15.36:0/2652069564 learned_addr learned my addr 172.21.15.36:0/2652069564 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:58.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc5d9b700 1 --2- 172.21.15.36:0/2652069564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc80b0010 0x7f4dc814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:58.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc659c700 1 --2- 172.21.15.36:0/2652069564 >> v2:172.21.15.59:3300/0 conn(0x7f4dc80b2580 0x7f4dc814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:58.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc559a700 1 -- 172.21.15.36:0/2652069564 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702522244 0 0) 0x7f4dc80a70c0 con 0x7f4dc80afbd0 2022-01-10T01:33:58.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc559a700 1 -- 172.21.15.36:0/2652069564 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dac003260 con 0x7f4dc80afbd0 2022-01-10T01:33:58.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc659c700 1 -- 172.21.15.36:0/2652069564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc80b0010 msgr2=0x7f4dc814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:58.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc659c700 1 --2- 172.21.15.36:0/2652069564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc80b0010 0x7f4dc814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc659c700 1 -- 172.21.15.36:0/2652069564 >> v1:172.21.15.36:6789/0 conn(0x7f4dc80afbd0 legacy=0x7f4dc80a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:58.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc659c700 1 -- 172.21.15.36:0/2652069564 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc80a7830 con 0x7f4dc80b2580 2022-01-10T01:33:58.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc5d9b700 1 --2- 172.21.15.36:0/2652069564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc80b0010 0x7f4dc814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:58.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc659c700 1 --2- 172.21.15.36:0/2652069564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc80b2580 0x7f4dc814ae40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f4dbc002f70 tx=0x7f4dbc006df0).ready entity=mon.1 client_cookie=a8cdf51b2ff86525 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:58.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc559a700 1 -- 172.21.15.36:0/2652069564 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dbc00d4a0 con 0x7f4dc80b2580 2022-01-10T01:33:58.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc559a700 1 -- 172.21.15.36:0/2652069564 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc000e90 con 0x7f4dc80b2580 2022-01-10T01:33:58.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc559a700 1 -- 172.21.15.36:0/2652069564 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dbc00d7f0 con 0x7f4dc80b2580 2022-01-10T01:33:58.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc759e700 1 -- 172.21.15.36:0/2652069564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc80b2580 msgr2=0x7f4dc814ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:58.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc759e700 1 --2- 172.21.15.36:0/2652069564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc80b2580 0x7f4dc814ae40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f4dbc002f70 tx=0x7f4dbc006df0).stop 2022-01-10T01:33:58.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc759e700 1 -- 172.21.15.36:0/2652069564 shutdown_connections 2022-01-10T01:33:58.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc759e700 1 --2- 172.21.15.36:0/2652069564 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc80b0010 0x7f4dc814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc759e700 1 --2- 172.21.15.36:0/2652069564 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc80b2580 0x7f4dc814ae40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc759e700 1 -- 172.21.15.36:0/2652069564 >> 172.21.15.36:0/2652069564 conn(0x7f4dc8060180 msgr2=0x7f4dc80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:58.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc759e700 1 -- 172.21.15.36:0/2652069564 shutdown_connections 2022-01-10T01:33:58.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.377+0000 7f4dc759e700 1 -- 172.21.15.36:0/2652069564 wait complete. 2022-01-10T01:33:58.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc759e700 1 Processor -- start 2022-01-10T01:33:58.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc759e700 1 -- start start 2022-01-10T01:33:58.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc80afbd0 0x7f4dc80aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:58.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc80b0010 0x7f4dc80ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:58.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dc80b2580 0x7f4dc80ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:58.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc80631c0 con 0x7f4dc80b2580 2022-01-10T01:33:58.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc8156e70 con 0x7f4dc80b0010 2022-01-10T01:33:58.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc8157110 con 0x7f4dc80afbd0 2022-01-10T01:33:58.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc6d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dc80b2580 0x7f4dc80ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:58.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc6d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dc80b2580 0x7f4dc80ab800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42794/0 (socket says 172.21.15.36:42794) 2022-01-10T01:33:58.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc5d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc80b0010 0x7f4dc80ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:58.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc6d9d700 1 -- 172.21.15.36:0/3938072849 learned_addr learned my addr 172.21.15.36:0/3938072849 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:58.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc659c700 1 --2- 172.21.15.36:0/3938072849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc80afbd0 0x7f4dc80aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:58.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc6d9d700 1 -- 172.21.15.36:0/3938072849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc80afbd0 msgr2=0x7f4dc80aeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:58.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc6d9d700 1 --2- 172.21.15.36:0/3938072849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc80afbd0 0x7f4dc80aeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc6d9d700 1 -- 172.21.15.36:0/3938072849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc80b0010 msgr2=0x7f4dc80ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:58.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc6d9d700 1 --2- 172.21.15.36:0/3938072849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc80b0010 0x7f4dc80ab310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc6d9d700 1 -- 172.21.15.36:0/3938072849 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db800b180 con 0x7f4dc80b2580 2022-01-10T01:33:58.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc5d9b700 1 --2- 172.21.15.36:0/3938072849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc80b0010 0x7f4dc80ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:58.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.381+0000 7f4dc6d9d700 1 --2- 172.21.15.36:0/3938072849 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dc80b2580 0x7f4dc80ab800 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f4dc0001490 tx=0x7f4dc0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:58.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.385+0000 7f4db77fe700 1 -- 172.21.15.36:0/3938072849 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dc0005ba0 con 0x7f4dc80b2580 2022-01-10T01:33:58.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.385+0000 7f4db77fe700 1 -- 172.21.15.36:0/3938072849 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc0005d00 con 0x7f4dc80b2580 2022-01-10T01:33:58.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.385+0000 7f4dc759e700 1 -- 172.21.15.36:0/3938072849 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc00b180 con 0x7f4dc80b2580 2022-01-10T01:33:58.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.385+0000 7f4db77fe700 1 -- 172.21.15.36:0/3938072849 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4dc00072c0 con 0x7f4dc80b2580 2022-01-10T01:33:58.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.385+0000 7f4dc759e700 1 -- 172.21.15.36:0/3938072849 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc80b5be0 con 0x7f4dc80b2580 2022-01-10T01:33:58.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.385+0000 7f4db77fe700 1 -- 172.21.15.36:0/3938072849 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4dc0010070 con 0x7f4dc80b2580 2022-01-10T01:33:58.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.385+0000 7f4dc759e700 1 -- 172.21.15.36:0/3938072849 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc80b5da0 con 0x7f4dc80b2580 2022-01-10T01:33:58.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.385+0000 7f4db77fe700 1 --2- 172.21.15.36:0/3938072849 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4da40536b0 0x7f4da4055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:58.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.385+0000 7f4dc659c700 1 --2- 172.21.15.36:0/3938072849 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4da40536b0 0x7f4da4055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:58.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.385+0000 7f4db77fe700 1 -- 172.21.15.36:0/3938072849 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f4dc006b0f0 con 0x7f4dc80b2580 2022-01-10T01:33:58.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.385+0000 7f4dc659c700 1 --2- 172.21.15.36:0/3938072849 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4da40536b0 0x7f4da4055b70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f4dbc01a000 tx=0x7f4dbc014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:58.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.389+0000 7f4db77fe700 1 -- 172.21.15.36:0/3938072849 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4dc00422d0 con 0x7f4dc80b2580 2022-01-10T01:33:58.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.517+0000 7f4dc759e700 1 -- 172.21.15.36:0/3938072849 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4dc8057350 con 0x7f4dc80b2580 2022-01-10T01:33:58.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.517+0000 7f4db77fe700 1 -- 172.21.15.36:0/3938072849 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v151) v1 ==== 81+0+29227 (secure 0 0 0) 0x7f4dc00458f0 con 0x7f4dc80b2580 2022-01-10T01:33:58.527 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:58.527 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:33:58.528 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 151, 2022-01-10T01:33:58.528 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:33:58.528 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:33:58.528 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:33:55.797785+0000", 2022-01-10T01:33:58.528 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:33:58.529 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:33:58.529 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:33:58.529 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:33:58.529 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:33:58.530 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:33:58.530 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:33:58.530 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:33:58.531 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:33:58.531 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:58.531 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:33:58.531 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:33:58.531 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:33:58.532 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:33:58.532 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:33:58.532 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 28, 2022-01-10T01:33:58.532 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:33:58.533 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:33:58.533 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:33:58.533 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:33:58.533 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:33:58.533 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.534 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:33:58.534 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:33:58.534 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:33:58.534 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:58.535 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:58.535 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:58.535 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:58.535 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:58.535 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:58.536 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:58.536 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:58.536 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:33:58.536 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:33:58.536 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:33:58.537 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:33:58.537 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:33:58.537 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:58.537 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:58.538 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:58.538 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:58.538 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:58.538 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:58.538 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:58.539 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.539 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:33:58.539 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:58.539 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:58.539 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:58.540 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:58.540 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:58.540 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:58.540 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:58.541 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:58.541 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:58.541 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:58.541 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:58.541 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:58.542 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:58.542 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:58.542 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:58.542 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:58.542 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:58.543 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:58.543 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:58.543 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:58.543 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:58.544 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:58.544 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:58.544 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:58.544 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:58.544 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:58.545 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.545 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:58.545 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:58.545 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:58.545 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:58.546 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:58.546 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:58.546 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:58.546 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:58.547 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:58.547 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:58.547 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:58.547 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:33:58.547 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:33:58.548 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.548 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:58.548 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:33:58.548 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.549 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.549 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.549 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:33:58.549 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:33:58.549 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:33:58.550 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:33:58.550 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:33:58.550 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:33:58.550 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:33:58.550 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:33:58.551 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:33:58.551 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:33:58.551 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:33:58.551 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:33:58.552 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:33:58.552 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:33:58.552 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:33:58.552 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:33:58.552 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:33:58.553 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:33:58.553 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:33:58.553 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:33:58.553 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:33:58.553 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:33:58.554 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:33:58.554 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.554 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:33:58.554 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:33:58.555 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:33:58.555 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:33:58.555 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:33:58.555 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:33:58.556 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:33:58.556 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:33:58.556 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:33:58.556 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:33:58.556 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:33:58.557 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:33:58.557 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:33:58.557 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:33:58.557 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:33:58.558 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:33:58.558 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:33:58.558 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:33:58.558 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:33:58.559 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:33:58.559 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:33:58.559 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:33:58.559 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:33:58.559 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:33:58.560 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:33:58.560 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:33:58.560 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:33:58.560 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.561 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:33:58.561 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:33:58.561 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:33:58.561 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:33:58.562 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:33:58.562 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:33:58.562 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:33:58.562 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:33:58.562 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:33:58.563 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:33:58.563 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:33:58.563 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:33:58.563 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:33:58.564 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:33:58.564 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.564 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.564 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:58.565 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:33:58.565 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.565 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:33:58.565 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:33:58.566 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:58.566 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:58.566 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:58.566 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:58.566 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:58.567 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:58.567 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:58.567 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 146, 2022-01-10T01:33:58.567 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:58.567 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:58.568 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:58.568 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.568 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.568 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.569 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:33:58.569 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:58.569 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.569 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.569 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.570 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:33:58.570 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:58.570 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.570 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.570 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.571 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:58.571 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.571 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.571 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.572 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:33:58.572 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:58.572 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.572 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.572 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.573 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:33:58.573 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:58.573 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.573 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.573 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.574 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:58.574 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.574 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.574 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.575 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:33:58.575 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:58.575 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.575 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.575 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.576 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:33:58.576 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:58.576 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.576 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.577 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.577 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:58.577 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.578 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.578 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.578 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:33:58.578 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:58.579 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.579 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.579 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.579 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:33:58.579 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:33:58.580 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.580 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.580 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.580 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:33:58.580 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:33:58.581 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:33:58.581 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:33:58.581 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:58.581 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:58.582 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:58.582 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.582 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.582 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.582 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:33:58.583 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:33:58.583 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:58.583 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:58.583 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:58.584 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:58.584 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:58.584 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:58.584 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:58.584 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 146, 2022-01-10T01:33:58.585 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:58.585 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:58.585 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:58.585 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.585 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.586 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.586 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:33:58.586 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:58.586 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.587 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.587 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.587 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:33:58.587 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:58.587 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.588 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.588 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.588 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:58.588 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.588 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.589 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.589 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:33:58.589 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:58.589 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.590 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.590 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.590 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:33:58.590 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:58.590 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.591 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.591 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.591 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:58.591 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.592 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.592 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.592 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:33:58.592 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:58.592 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.593 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.593 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.593 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:33:58.593 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:58.593 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.594 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.594 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.594 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:58.594 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.595 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.595 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.595 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:33:58.595 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:58.595 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.596 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.596 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.596 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:33:58.596 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:33:58.596 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.597 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.597 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.597 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:33:58.597 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:33:58.598 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:33:58.598 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:33:58.598 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:58.598 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:58.598 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:58.599 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.599 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.599 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.599 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:33:58.599 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:33:58.600 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:58.600 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:58.600 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:58.600 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:58.601 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:58.601 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:58.601 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:58.601 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 146, 2022-01-10T01:33:58.601 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:58.602 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:58.602 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:58.602 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.602 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.602 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.603 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:33:58.603 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:58.603 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.603 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.604 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.604 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:33:58.604 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:58.604 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.604 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.605 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.605 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:58.605 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.605 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.605 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.606 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:33:58.606 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:58.606 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.607 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.607 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.607 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:33:58.607 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:58.608 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.608 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.608 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.608 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:58.609 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.609 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.609 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.609 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:33:58.609 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:58.610 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.610 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.610 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.610 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:33:58.610 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:58.611 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.611 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.611 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.611 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:58.612 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.612 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.612 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.612 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:33:58.612 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:58.613 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.613 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.613 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.613 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:33:58.613 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:33:58.614 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.614 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.614 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.614 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:33:58.615 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:33:58.615 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:33:58.615 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:33:58.615 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:58.615 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:58.616 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:58.616 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.616 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.616 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.616 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:33:58.617 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:33:58.617 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:58.617 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:58.617 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:58.618 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:58.618 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:58.618 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:58.618 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:58.618 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 145, 2022-01-10T01:33:58.619 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:58.619 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:58.619 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:58.619 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.619 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.620 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.620 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:33:58.620 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:58.620 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.620 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.621 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.621 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:33:58.621 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:58.621 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.621 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.622 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.622 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:58.622 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.622 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.623 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.623 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:33:58.623 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:58.623 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.623 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.624 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.624 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:33:58.624 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:58.624 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.624 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.625 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.625 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:58.625 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.625 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.625 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.626 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:33:58.626 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:58.626 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.626 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.627 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.627 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:33:58.627 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:58.627 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.627 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.628 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.628 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:58.628 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.628 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.629 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.629 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:33:58.629 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:58.629 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.629 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.630 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.630 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:33:58.630 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:33:58.630 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.630 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.631 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.631 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:33:58.631 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:33:58.631 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:33:58.631 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:33:58.632 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:58.632 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:58.632 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:58.632 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.633 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.633 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.633 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:33:58.633 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:33:58.633 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:58.634 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:58.634 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:58.634 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:58.634 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:58.635 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:58.635 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:58.635 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 145, 2022-01-10T01:33:58.635 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:58.635 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:58.636 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:58.636 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.636 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.636 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.636 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:33:58.637 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:58.637 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.637 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.637 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.637 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:33:58.638 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:58.638 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.638 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.638 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.639 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:58.639 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.639 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.639 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.639 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:33:58.640 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:58.640 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.640 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.640 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.641 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:33:58.641 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:58.641 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.641 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.641 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.642 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:58.642 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.642 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.642 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.643 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:33:58.643 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:58.643 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.643 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.643 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.644 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:33:58.644 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:58.644 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.644 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.644 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.645 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:58.645 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.645 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.645 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.645 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:33:58.646 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:58.646 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.646 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.646 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.647 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:33:58.647 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:33:58.647 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.647 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.648 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.648 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:33:58.648 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:33:58.648 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:33:58.648 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:33:58.649 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:58.649 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:58.649 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:58.649 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.649 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.650 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.650 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:33:58.650 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:33:58.650 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:58.651 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:58.651 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:58.651 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:58.651 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:58.651 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:58.652 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:58.652 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 146, 2022-01-10T01:33:58.652 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:58.652 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:58.652 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:58.653 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.653 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.653 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.653 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:33:58.653 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:58.654 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.654 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.654 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.654 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:33:58.655 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:58.655 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.655 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.655 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.655 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:58.656 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.656 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.656 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.656 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:33:58.656 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:58.657 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.657 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.657 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.657 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:33:58.658 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:58.658 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.658 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.658 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.658 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:58.659 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.659 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.659 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.659 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:33:58.659 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:58.660 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.660 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.660 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.660 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:33:58.661 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:58.661 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.661 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.661 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.661 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:58.662 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.662 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.662 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.662 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:33:58.662 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:58.663 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.663 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.663 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.663 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:33:58.663 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:33:58.664 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.664 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.664 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.664 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:33:58.665 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:33:58.665 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:33:58.665 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:33:58.665 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:58.665 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:58.666 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:58.666 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.666 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.666 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.666 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:33:58.667 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:33:58.667 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:58.667 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:58.667 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:58.668 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:58.668 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:58.668 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:58.668 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:58.668 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 146, 2022-01-10T01:33:58.669 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:58.669 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:58.669 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:58.669 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.669 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.670 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.670 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:33:58.670 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:58.670 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.670 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.671 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.671 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:33:58.671 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:58.671 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.672 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.672 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.672 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:58.672 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.672 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.673 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.673 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:33:58.673 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:58.673 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.673 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.674 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.674 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:33:58.674 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:58.674 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.675 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.675 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.675 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:58.675 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.675 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.676 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.676 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:33:58.676 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:58.676 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.676 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.677 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.677 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:33:58.677 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:58.678 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.678 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.678 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.678 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:58.678 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.679 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.679 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.679 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:33:58.679 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:58.679 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.680 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.680 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.680 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:33:58.680 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:33:58.681 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.681 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.681 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.681 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:33:58.681 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:33:58.682 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:33:58.682 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:33:58.682 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:58.682 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:58.682 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:58.683 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.683 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.683 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.683 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:33:58.684 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:33:58.684 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:33:58.684 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:33:58.684 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:33:58.684 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:33:58.685 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:33:58.685 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:33:58.685 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:33:58.685 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 146, 2022-01-10T01:33:58.685 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:33:58.686 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:33:58.686 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:33:58.686 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.686 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.687 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.687 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:33:58.687 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:58.687 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.687 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.688 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.688 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:33:58.688 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:58.688 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.688 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.689 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.689 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:33:58.689 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.689 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.690 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.690 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:33:58.690 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:58.690 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.690 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.691 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.691 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:33:58.691 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:58.691 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.692 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.692 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.692 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:33:58.692 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.692 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.693 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.693 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:33:58.693 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:58.693 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.694 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.694 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.694 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:33:58.694 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:58.694 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.695 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.695 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.695 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:33:58.695 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:33:58.696 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.696 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:33:58.696 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:33:58.696 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:58.696 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.697 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.697 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:33:58.697 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:33:58.697 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:33:58.697 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.698 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.698 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.698 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:33:58.698 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:33:58.699 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:33:58.699 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:33:58.699 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:33:58.699 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:33:58.699 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:33:58.700 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:33:58.700 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.700 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:58.700 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:33:58.700 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.701 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:33:58.701 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:58.701 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:58.701 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:58.701 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:58.702 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:58.702 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:33:58.702 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:58.702 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.703 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.703 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:33:58.703 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:58.703 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:58.703 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:58.704 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:58.704 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:58.704 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:33:58.704 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:58.705 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.705 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.705 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:33:58.705 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:58.705 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:58.706 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:58.706 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:58.706 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:58.706 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:33:58.707 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:58.707 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.707 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.707 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:33:58.708 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:58.708 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:58.708 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:58.708 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:58.709 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:58.709 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:33:58.709 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:58.709 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.709 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.710 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:33:58.710 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:58.710 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:58.710 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:58.710 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:58.711 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:58.711 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:33:58.711 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:58.711 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.712 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.712 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:33:58.712 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:58.712 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:58.712 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:58.713 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:58.713 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:58.713 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:33:58.713 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:58.713 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.714 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.714 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:33:58.714 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:58.714 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:58.715 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:58.715 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:58.715 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:58.715 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:33:58.715 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:58.716 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.716 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:33:58.716 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:33:58.716 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:33:58.716 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:33:58.717 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:33:58.717 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:33:58.717 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:33:58.717 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:33:58.718 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:33:58.718 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.718 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:33:58.718 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:33:58.718 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:33:58.719 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:33:58.719 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:33:58.719 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": { 2022-01-10T01:33:58.719 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.59:6833/138807571": "2022-01-11T01:33:52.541084+0000", 2022-01-10T01:33:58.720 INFO:teuthology.orchestra.run.smithi036.stdout: "172.21.15.59:6832/138807571": "2022-01-11T01:33:52.541084+0000" 2022-01-10T01:33:58.720 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.720 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:33:58.720 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:33:58.720 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:33:58.721 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:33:58.721 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:33:58.721 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:33:58.721 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:33:58.721 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:33:58.722 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:33:58.722 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:33:58.722 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:33:58.722 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:33:58.722 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.723 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:33:58.723 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:33:58.723 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:33:58.723 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:33:58.724 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:33:58.724 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:33:58.724 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:33:58.724 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:33:58.724 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:33:58.725 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:33:58.725 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:33:58.725 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:33:58.725 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:33:58.725 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:33:58.726 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:33:58.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.521+0000 7f4dc759e700 1 -- 172.21.15.36:0/3938072849 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4da40536b0 msgr2=0x7f4da4055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:58.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.521+0000 7f4dc759e700 1 --2- 172.21.15.36:0/3938072849 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4da40536b0 0x7f4da4055b70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f4dbc01a000 tx=0x7f4dbc014000).stop 2022-01-10T01:33:58.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.521+0000 7f4dc759e700 1 -- 172.21.15.36:0/3938072849 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dc80b2580 msgr2=0x7f4dc80ab800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:58.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.521+0000 7f4dc759e700 1 --2- 172.21.15.36:0/3938072849 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dc80b2580 0x7f4dc80ab800 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f4dc0001490 tx=0x7f4dc0007e00).stop 2022-01-10T01:33:58.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.521+0000 7f4dc759e700 1 -- 172.21.15.36:0/3938072849 shutdown_connections 2022-01-10T01:33:58.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.521+0000 7f4dc759e700 1 --2- 172.21.15.36:0/3938072849 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4da40536b0 0x7f4da4055b70 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.521+0000 7f4dc759e700 1 --2- 172.21.15.36:0/3938072849 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4dc80b2580 0x7f4dc80ab800 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.521+0000 7f4dc759e700 1 --2- 172.21.15.36:0/3938072849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4dc80b0010 0x7f4dc80ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.521+0000 7f4dc759e700 1 --2- 172.21.15.36:0/3938072849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4dc80afbd0 0x7f4dc80aeeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.521+0000 7f4dc759e700 1 -- 172.21.15.36:0/3938072849 >> 172.21.15.36:0/3938072849 conn(0x7f4dc8060180 msgr2=0x7f4dc8149b80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:58.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.521+0000 7f4dc759e700 1 -- 172.21.15.36:0/3938072849 shutdown_connections 2022-01-10T01:33:58.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.521+0000 7f4dc759e700 1 -- 172.21.15.36:0/3938072849 wait complete. 2022-01-10T01:33:58.732 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:58.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.829+0000 7f451ea8b700 1 Processor -- start 2022-01-10T01:33:58.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.829+0000 7f451ea8b700 1 -- start start 2022-01-10T01:33:58.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.829+0000 7f451ea8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4518060100 0x7f45180b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:58.840 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.829+0000 7f451ea8b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45180aabb0 con 0x7f4518067300 2022-01-10T01:33:58.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.829+0000 7f451ea8b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45180604e0 con 0x7f45180b4c40 2022-01-10T01:33:58.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.829+0000 7f451ea8b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4518066ea0 con 0x7f4518060100 2022-01-10T01:33:58.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.829+0000 7f4517fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f4518067300 0x7f45181438f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40594/0 (socket says 172.21.15.36:40594) 2022-01-10T01:33:58.841 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.829+0000 7f4517fff700 1 -- 172.21.15.36:0/2911776194 learned_addr learned my addr 172.21.15.36:0/2911776194 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:58.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.829+0000 7f451c827700 1 --2- 172.21.15.36:0/2911776194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4518060100 0x7f45180b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:58.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f45177fe700 1 -- 172.21.15.36:0/2911776194 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327330688 0 0) 0x7f45180604e0 con 0x7f45180b4c40 2022-01-10T01:33:58.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f45177fe700 1 -- 172.21.15.36:0/2911776194 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4504003260 con 0x7f45180b4c40 2022-01-10T01:33:58.842 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f45177fe700 1 -- 172.21.15.36:0/2911776194 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1723941602 0 0) 0x7f45180aabb0 con 0x7f4518067300 2022-01-10T01:33:58.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451c827700 1 -- 172.21.15.36:0/2911776194 >> v1:172.21.15.59:6789/0 conn(0x7f45180b4c40 legacy=0x7f451814b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:58.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451c827700 1 -- 172.21.15.36:0/2911776194 >> v1:172.21.15.36:6789/0 conn(0x7f4518067300 legacy=0x7f45181438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:58.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451c827700 1 -- 172.21.15.36:0/2911776194 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45180b33b0 con 0x7f4518060100 2022-01-10T01:33:58.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451c827700 1 --2- 172.21.15.36:0/2911776194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4518060100 0x7f45180b4750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f45100032f0 tx=0x7f45100091d0).ready entity=mon.2 client_cookie=8c9a6d14aa776131 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:58.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f45177fe700 1 -- 172.21.15.36:0/2911776194 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f451000b6c0 con 0x7f4518060100 2022-01-10T01:33:58.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f45177fe700 1 -- 172.21.15.36:0/2911776194 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451000b820 con 0x7f4518060100 2022-01-10T01:33:58.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f45177fe700 1 -- 172.21.15.36:0/2911776194 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f451000b990 con 0x7f4518060100 2022-01-10T01:33:58.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 -- 172.21.15.36:0/2911776194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4518060100 msgr2=0x7f45180b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:58.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 --2- 172.21.15.36:0/2911776194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4518060100 0x7f45180b4750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f45100032f0 tx=0x7f45100091d0).stop 2022-01-10T01:33:58.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 -- 172.21.15.36:0/2911776194 shutdown_connections 2022-01-10T01:33:58.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 --2- 172.21.15.36:0/2911776194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4518060100 0x7f45180b4750 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 -- 172.21.15.36:0/2911776194 >> 172.21.15.36:0/2911776194 conn(0x7f451805cf30 msgr2=0x7f451805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:58.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 -- 172.21.15.36:0/2911776194 shutdown_connections 2022-01-10T01:33:58.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 -- 172.21.15.36:0/2911776194 wait complete. 2022-01-10T01:33:58.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 Processor -- start 2022-01-10T01:33:58.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 -- start start 2022-01-10T01:33:58.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4518060100 0x7f45180b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:58.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4518067300 0x7f45180a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:58.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45180b4c40 0x7f4518152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:58.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45180a3bb0 con 0x7f4518060100 2022-01-10T01:33:58.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45180a3160 con 0x7f45180b4c40 2022-01-10T01:33:58.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.833+0000 7f451ea8b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4518152510 con 0x7f4518067300 2022-01-10T01:33:58.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f451c827700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4518060100 0x7f45180b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:58.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f451c827700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4518060100 0x7f45180b5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42804/0 (socket says 172.21.15.36:42804) 2022-01-10T01:33:58.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f451c827700 1 -- 172.21.15.36:0/1489420886 learned_addr learned my addr 172.21.15.36:0/1489420886 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:58.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f4517fff700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4518067300 0x7f45180a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:58.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f451d028700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45180b4c40 0x7f4518152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:58.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f451c827700 1 -- 172.21.15.36:0/1489420886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4518067300 msgr2=0x7f45180a36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:58.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f451c827700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4518067300 0x7f45180a36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f451c827700 1 -- 172.21.15.36:0/1489420886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45180b4c40 msgr2=0x7f4518152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:58.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f451c827700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45180b4c40 0x7f4518152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:58.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f451c827700 1 -- 172.21.15.36:0/1489420886 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4510009470 con 0x7f4518060100 2022-01-10T01:33:58.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f451d028700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45180b4c40 0x7f4518152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:33:58.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f451c827700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4518060100 0x7f45180b5820 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f45100032f0 tx=0x7f4510016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:58.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f4515ffb700 1 -- 172.21.15.36:0/1489420886 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f451000b990 con 0x7f4518060100 2022-01-10T01:33:58.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f4515ffb700 1 -- 172.21.15.36:0/1489420886 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451001f3f0 con 0x7f4518060100 2022-01-10T01:33:58.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f4515ffb700 1 -- 172.21.15.36:0/1489420886 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f451000b6c0 con 0x7f4518060100 2022-01-10T01:33:58.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f451ea8b700 1 -- 172.21.15.36:0/1489420886 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45181527b0 con 0x7f4518060100 2022-01-10T01:33:58.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f451ea8b700 1 -- 172.21.15.36:0/1489420886 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45180a6570 con 0x7f4518060100 2022-01-10T01:33:58.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.837+0000 7f451ea8b700 1 -- 172.21.15.36:0/1489420886 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4518057350 con 0x7f4518060100 2022-01-10T01:33:58.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.841+0000 7f4515ffb700 1 -- 172.21.15.36:0/1489420886 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f451000f070 con 0x7f4518060100 2022-01-10T01:33:58.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.841+0000 7f4515ffb700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f44f8053680 0x7f44f8055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:58.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.841+0000 7f4515ffb700 1 -- 172.21.15.36:0/1489420886 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f451006c130 con 0x7f4518060100 2022-01-10T01:33:58.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.841+0000 7f4517fff700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f44f8053680 0x7f44f8055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:58.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.841+0000 7f4517fff700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f44f8053680 0x7f44f8055b40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f450c00d000 tx=0x7f450c007c20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:58.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:58.845+0000 7f4515ffb700 1 -- 172.21.15.36:0/1489420886 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4510043290 con 0x7f4518060100 2022-01-10T01:33:59.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.009+0000 7f451ea8b700 1 -- 172.21.15.36:0/1489420886 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45180a34a0 con 0x7f4518060100 2022-01-10T01:33:59.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.013+0000 7f4515ffb700 1 -- 172.21.15.36:0/1489420886 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+1556 (secure 0 0 0) 0x7f4510024630 con 0x7f4518060100 2022-01-10T01:33:59.019 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:59.019 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/967641645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":967641645},{"type":"v1","addr":"172.21.15.36:6835","nonce":967641645}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/109014568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":109014568},{"type":"v1","addr":"172.21.15.36:6837","nonce":109014568}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1479181559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1479181559},{"type":"v1","addr":"172.21.15.59:6833","nonce":1479181559}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76}],"filesystems":[]} 2022-01-10T01:33:59.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.013+0000 7f451ea8b700 1 -- 172.21.15.36:0/1489420886 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f44f8053680 msgr2=0x7f44f8055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:59.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.013+0000 7f451ea8b700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f44f8053680 0x7f44f8055b40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f450c00d000 tx=0x7f450c007c20).stop 2022-01-10T01:33:59.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.013+0000 7f451ea8b700 1 -- 172.21.15.36:0/1489420886 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4518060100 msgr2=0x7f45180b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:59.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.013+0000 7f451ea8b700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4518060100 0x7f45180b5820 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f45100032f0 tx=0x7f4510016000).stop 2022-01-10T01:33:59.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.013+0000 7f451ea8b700 1 -- 172.21.15.36:0/1489420886 shutdown_connections 2022-01-10T01:33:59.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.013+0000 7f451ea8b700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f44f8053680 0x7f44f8055b40 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.013+0000 7f451ea8b700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45180b4c40 0x7f4518152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.013+0000 7f451ea8b700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4518067300 0x7f45180a36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.013+0000 7f451ea8b700 1 --2- 172.21.15.36:0/1489420886 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4518060100 0x7f45180b5820 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.013+0000 7f451ea8b700 1 -- 172.21.15.36:0/1489420886 >> 172.21.15.36:0/1489420886 conn(0x7f451805cf30 msgr2=0x7f451805f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:59.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.013+0000 7f451ea8b700 1 -- 172.21.15.36:0/1489420886 shutdown_connections 2022-01-10T01:33:59.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.013+0000 7f451ea8b700 1 -- 172.21.15.36:0/1489420886 wait complete. 2022-01-10T01:33:59.025 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 76 2022-01-10T01:33:59.031 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:33:59.130 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 Processor -- start 2022-01-10T01:33:59.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 -- start start 2022-01-10T01:33:59.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6380b6290 0x7fc638061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:59.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6380b4060 0x7fc638061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:59.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6380b5f50 con 0x7fc638061e50 2022-01-10T01:33:59.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6380b1f70 con 0x7fc6380b6290 2022-01-10T01:33:59.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380b2210 con 0x7fc6380b4060 2022-01-10T01:33:59.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc62f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6380b4060 0x7fc638061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:59.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc637fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc6380b6290 0x7fc638061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:59.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63c85a700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc638061e50 0x7fc638146430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:58286/0 (socket says 172.21.15.36:58286) 2022-01-10T01:33:59.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63c85a700 1 -- 172.21.15.36:0/4037160328 learned_addr learned my addr 172.21.15.36:0/4037160328 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:33:59.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc6377fe700 1 -- 172.21.15.36:0/4037160328 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475396704 0 0) 0x7fc630001490 con 0x7fc638061e50 2022-01-10T01:33:59.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc62f7fe700 1 -- 172.21.15.36:0/4037160328 >> v2:172.21.15.59:3300/0 conn(0x7fc6380b6290 msgr2=0x7fc638061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:59.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc62f7fe700 1 --2- 172.21.15.36:0/4037160328 >> v2:172.21.15.59:3300/0 conn(0x7fc6380b6290 0x7fc638061470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc62f7fe700 1 -- 172.21.15.36:0/4037160328 >> v1:172.21.15.59:6789/0 conn(0x7fc638061e50 legacy=0x7fc638146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:59.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc62f7fe700 1 -- 172.21.15.36:0/4037160328 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380b24b0 con 0x7fc6380b4060 2022-01-10T01:33:59.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc62f7fe700 1 --2- 172.21.15.36:0/4037160328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6380b4060 0x7fc638061960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fc620002f70 tx=0x7fc620006df0).ready entity=mon.2 client_cookie=a348cf63f52ed396 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:59.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc6377fe700 1 -- 172.21.15.36:0/4037160328 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc62000d570 con 0x7fc6380b4060 2022-01-10T01:33:59.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc6377fe700 1 -- 172.21.15.36:0/4037160328 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620000e90 con 0x7fc6380b4060 2022-01-10T01:33:59.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc6377fe700 1 -- 172.21.15.36:0/4037160328 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc62000d8c0 con 0x7fc6380b4060 2022-01-10T01:33:59.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 -- 172.21.15.36:0/4037160328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6380b4060 msgr2=0x7fc638061960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:59.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 --2- 172.21.15.36:0/4037160328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6380b4060 0x7fc638061960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fc620002f70 tx=0x7fc620006df0).stop 2022-01-10T01:33:59.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 -- 172.21.15.36:0/4037160328 shutdown_connections 2022-01-10T01:33:59.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 --2- 172.21.15.36:0/4037160328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6380b4060 0x7fc638061960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 --2- 172.21.15.36:0/4037160328 >> v2:172.21.15.59:3300/0 conn(0x7fc6380b6290 0x7fc638061470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 -- 172.21.15.36:0/4037160328 >> 172.21.15.36:0/4037160328 conn(0x7fc63805c490 msgr2=0x7fc63805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:59.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 -- 172.21.15.36:0/4037160328 shutdown_connections 2022-01-10T01:33:59.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.125+0000 7fc63d05b700 1 -- 172.21.15.36:0/4037160328 wait complete. 2022-01-10T01:33:59.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63d05b700 1 Processor -- start 2022-01-10T01:33:59.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63d05b700 1 -- start start 2022-01-10T01:33:59.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63d05b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc638061e50 0x7fc638127eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:59.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63d05b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6380b4060 0x7fc6381283a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:59.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63d05b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6380b6290 0x7fc638155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:59.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63d05b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380ad5b0 con 0x7fc6380b6290 2022-01-10T01:33:59.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63d05b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc638143ab0 con 0x7fc638061e50 2022-01-10T01:33:59.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63d05b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63813ef80 con 0x7fc6380b4060 2022-01-10T01:33:59.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63c85a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6380b6290 0x7fc638155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:59.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc637fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc638061e50 0x7fc638127eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:59.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc62f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6380b4060 0x7fc6381283a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:59.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63c85a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6380b6290 0x7fc638155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42822/0 (socket says 172.21.15.36:42822) 2022-01-10T01:33:59.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63c85a700 1 -- 172.21.15.36:0/2318825957 learned_addr learned my addr 172.21.15.36:0/2318825957 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:59.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63c85a700 1 -- 172.21.15.36:0/2318825957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6380b4060 msgr2=0x7fc6381283a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:59.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63c85a700 1 --2- 172.21.15.36:0/2318825957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6380b4060 0x7fc6381283a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63c85a700 1 -- 172.21.15.36:0/2318825957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc638061e50 msgr2=0x7fc638127eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:59.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63c85a700 1 --2- 172.21.15.36:0/2318825957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc638061e50 0x7fc638127eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63c85a700 1 -- 172.21.15.36:0/2318825957 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62000b180 con 0x7fc6380b6290 2022-01-10T01:33:59.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc637fff700 1 --2- 172.21.15.36:0/2318825957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc638061e50 0x7fc638127eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:33:59.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63c85a700 1 --2- 172.21.15.36:0/2318825957 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6380b6290 0x7fc638155e40 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fc63805f0b0 tx=0x7fc630007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:59.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc635ffb700 1 -- 172.21.15.36:0/2318825957 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc630005ba0 con 0x7fc6380b6290 2022-01-10T01:33:59.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc635ffb700 1 -- 172.21.15.36:0/2318825957 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc630005d00 con 0x7fc6380b6290 2022-01-10T01:33:59.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63d05b700 1 -- 172.21.15.36:0/2318825957 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc638143ce0 con 0x7fc6380b6290 2022-01-10T01:33:59.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc635ffb700 1 -- 172.21.15.36:0/2318825957 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc630004a90 con 0x7fc6380b6290 2022-01-10T01:33:59.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.129+0000 7fc63d05b700 1 -- 172.21.15.36:0/2318825957 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc638140280 con 0x7fc6380b6290 2022-01-10T01:33:59.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.133+0000 7fc63d05b700 1 -- 172.21.15.36:0/2318825957 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc638143e70 con 0x7fc6380b6290 2022-01-10T01:33:59.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.133+0000 7fc635ffb700 1 -- 172.21.15.36:0/2318825957 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc630004bf0 con 0x7fc6380b6290 2022-01-10T01:33:59.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.133+0000 7fc635ffb700 1 --2- 172.21.15.36:0/2318825957 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc61c053680 0x7fc61c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:59.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.133+0000 7fc635ffb700 1 -- 172.21.15.36:0/2318825957 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fc63006b370 con 0x7fc6380b6290 2022-01-10T01:33:59.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.133+0000 7fc637fff700 1 --2- 172.21.15.36:0/2318825957 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc61c053680 0x7fc61c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:59.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.133+0000 7fc637fff700 1 --2- 172.21.15.36:0/2318825957 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc61c053680 0x7fc61c055b40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fc62800b000 tx=0x7fc628006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:59.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.141+0000 7fc635ffb700 1 -- 172.21.15.36:0/2318825957 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc6300424d0 con 0x7fc6380b6290 2022-01-10T01:33:59.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.301+0000 7fc63d05b700 1 -- 172.21.15.36:0/2318825957 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6380b5f50 con 0x7fc6380b6290 2022-01-10T01:33:59.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.301+0000 7fc635ffb700 1 -- 172.21.15.36:0/2318825957 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+1556 (secure 0 0 0) 0x7fc6380b5f50 con 0x7fc6380b6290 2022-01-10T01:33:59.309 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:33:59.309 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8397,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.36:6835/967641645","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":967641645},{"type":"v1","addr":"172.21.15.36:6835","nonce":967641645}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":71},{"gid":8400,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6837/109014568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":109014568},{"type":"v1","addr":"172.21.15.36:6837","nonce":109014568}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":70},{"gid":8524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1479181559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1479181559},{"type":"v1","addr":"172.21.15.59:6833","nonce":1479181559}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":76}],"filesystems":[]} 2022-01-10T01:33:59.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.301+0000 7fc63d05b700 1 -- 172.21.15.36:0/2318825957 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc61c053680 msgr2=0x7fc61c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:59.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.301+0000 7fc63d05b700 1 --2- 172.21.15.36:0/2318825957 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc61c053680 0x7fc61c055b40 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fc62800b000 tx=0x7fc628006df0).stop 2022-01-10T01:33:59.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.301+0000 7fc63d05b700 1 -- 172.21.15.36:0/2318825957 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6380b6290 msgr2=0x7fc638155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:59.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.301+0000 7fc63d05b700 1 --2- 172.21.15.36:0/2318825957 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6380b6290 0x7fc638155e40 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fc63805f0b0 tx=0x7fc630007c20).stop 2022-01-10T01:33:59.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.301+0000 7fc63d05b700 1 -- 172.21.15.36:0/2318825957 shutdown_connections 2022-01-10T01:33:59.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.301+0000 7fc63d05b700 1 --2- 172.21.15.36:0/2318825957 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc61c053680 0x7fc61c055b40 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.301+0000 7fc63d05b700 1 --2- 172.21.15.36:0/2318825957 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc6380b6290 0x7fc638155e40 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.301+0000 7fc63d05b700 1 --2- 172.21.15.36:0/2318825957 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc6380b4060 0x7fc6381283a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.301+0000 7fc63d05b700 1 --2- 172.21.15.36:0/2318825957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc638061e50 0x7fc638127eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.301+0000 7fc63d05b700 1 -- 172.21.15.36:0/2318825957 >> 172.21.15.36:0/2318825957 conn(0x7fc63805c490 msgr2=0x7fc63812c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:59.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.305+0000 7fc63d05b700 1 -- 172.21.15.36:0/2318825957 shutdown_connections 2022-01-10T01:33:59.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.305+0000 7fc63d05b700 1 -- 172.21.15.36:0/2318825957 wait complete. 2022-01-10T01:33:59.313 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 76 2022-01-10T01:33:59.322 INFO:tasks.ceph.mds.a:Restarting daemon 2022-01-10T01:33:59.323 INFO:tasks.ceph.mds.a:Stopping old one... 2022-01-10T01:33:59.324 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-01-10T01:33:59.324 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:33:59.325 INFO:tasks.ceph.mds.c:Restarting daemon 2022-01-10T01:33:59.325 INFO:tasks.ceph.mds.c:Stopping old one... 2022-01-10T01:33:59.326 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-01-10T01:33:59.326 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:33:59.327 INFO:tasks.ceph.mds.b:Restarting daemon 2022-01-10T01:33:59.327 INFO:tasks.ceph.mds.b:Stopping old one... 2022-01-10T01:33:59.328 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-01-10T01:33:59.329 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T01:33:59.336 INFO:tasks.ceph.mds.a:Stopped 2022-01-10T01:33:59.337 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-01-10T01:33:59.341 INFO:tasks.ceph.mds.c:Stopped 2022-01-10T01:33:59.342 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-01-10T01:33:59.344 INFO:tasks.ceph.mds.b:Stopped 2022-01-10T01:33:59.344 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-01-10T01:33:59.346 INFO:tasks.ceph.mds.b:Started 2022-01-10T01:33:59.347 DEBUG:teuthology.parallel:result is None 2022-01-10T01:33:59.383 INFO:tasks.ceph.mds.a:Started 2022-01-10T01:33:59.384 DEBUG:teuthology.parallel:result is None 2022-01-10T01:33:59.385 INFO:tasks.ceph.mds.c:Started 2022-01-10T01:33:59.386 DEBUG:teuthology.parallel:result is None 2022-01-10T01:33:59.387 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blacklist clear 2022-01-10T01:33:59.420 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2022-01-10T01:33:59.470 INFO:tasks.ceph.mds.c.smithi036.stdout:starting mds.c at 2022-01-10T01:33:59.478 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:33:59.485 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.477+0000 7f34a7ba7700 1 Processor -- start 2022-01-10T01:33:59.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.477+0000 7f34a7ba7700 1 -- start start 2022-01-10T01:33:59.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a7ba7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a00a9060 0x7f34a00aca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:59.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a7ba7700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f34a013f800 0x7f34a013fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:59.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a7ba7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a00a9c30 con 0x7f34a00a9850 2022-01-10T01:33:59.488 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a7ba7700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a0143080 con 0x7f34a013f800 2022-01-10T01:33:59.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a7ba7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0143320 con 0x7f34a00a9060 2022-01-10T01:33:59.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a6144700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f34a013f800 0x7f34a013fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:59.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a6144700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f34a013f800 0x7f34a013fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42860/0 (socket says 172.21.15.36:42860) 2022-01-10T01:33:59.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a6144700 1 -- 172.21.15.36:0/2600897938 learned_addr learned my addr 172.21.15.36:0/2600897938 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:59.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a5142700 1 --2- 172.21.15.36:0/2600897938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a00a9060 0x7f34a00aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:59.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a6144700 1 -- 172.21.15.36:0/2600897938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a00a9060 msgr2=0x7f34a00aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:59.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a6144700 1 --2- 172.21.15.36:0/2600897938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a00a9060 0x7f34a00aca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a6144700 1 -- 172.21.15.36:0/2600897938 >> v1:172.21.15.59:6789/0 conn(0x7f34a00a9850 legacy=0x7f34a00a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:33:59.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a6144700 1 -- 172.21.15.36:0/2600897938 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a01435c0 con 0x7f34a013f800 2022-01-10T01:33:59.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a6144700 1 --2- 172.21.15.36:0/2600897938 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34a013f800 0x7f34a013fc90 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f34a00b66d0 tx=0x7f349c006eb0).ready entity=mon.0 client_cookie=f7cf3d912e6d10e3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:59.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a4941700 1 -- 172.21.15.36:0/2600897938 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f349c014070 con 0x7f34a013f800 2022-01-10T01:33:59.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a4941700 1 -- 172.21.15.36:0/2600897938 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c000e90 con 0x7f34a013f800 2022-01-10T01:33:59.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a4941700 1 -- 172.21.15.36:0/2600897938 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f349c00ea60 con 0x7f34a013f800 2022-01-10T01:33:59.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a7ba7700 1 -- 172.21.15.36:0/2600897938 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34a013f800 msgr2=0x7f34a013fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:59.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a7ba7700 1 --2- 172.21.15.36:0/2600897938 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34a013f800 0x7f34a013fc90 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f34a00b66d0 tx=0x7f349c006eb0).stop 2022-01-10T01:33:59.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a7ba7700 1 -- 172.21.15.36:0/2600897938 shutdown_connections 2022-01-10T01:33:59.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a7ba7700 1 --2- 172.21.15.36:0/2600897938 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34a013f800 0x7f34a013fc90 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a7ba7700 1 --2- 172.21.15.36:0/2600897938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a00a9060 0x7f34a00aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a7ba7700 1 -- 172.21.15.36:0/2600897938 >> 172.21.15.36:0/2600897938 conn(0x7f34a00608d0 msgr2=0x7f34a0060ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:33:59.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a7ba7700 1 -- 172.21.15.36:0/2600897938 shutdown_connections 2022-01-10T01:33:59.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a7ba7700 1 -- 172.21.15.36:0/2600897938 wait complete. 2022-01-10T01:33:59.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.481+0000 7f34a7ba7700 1 Processor -- start 2022-01-10T01:33:59.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a7ba7700 1 -- start start 2022-01-10T01:33:59.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a7ba7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a00a9060 0x7f34a00ab1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:59.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a7ba7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a00a9850 0x7f34a0064080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:59.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a7ba7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34a013f800 0x7f34a0064570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:59.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a7ba7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0064a60 con 0x7f34a013f800 2022-01-10T01:33:59.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a7ba7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a00ac210 con 0x7f34a00a9060 2022-01-10T01:33:59.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a7ba7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0142d20 con 0x7f34a00a9850 2022-01-10T01:33:59.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a6144700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34a013f800 0x7f34a0064570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:59.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a5142700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a00a9850 0x7f34a0064080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:59.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a5142700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a00a9850 0x7f34a0064080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:49146/0 (socket says 172.21.15.36:49146) 2022-01-10T01:33:59.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a5142700 1 -- 172.21.15.36:0/273222229 learned_addr learned my addr 172.21.15.36:0/273222229 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:33:59.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a5943700 1 --2- 172.21.15.36:0/273222229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a00a9060 0x7f34a00ab1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:59.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a6144700 1 -- 172.21.15.36:0/273222229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a00a9850 msgr2=0x7f34a0064080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:59.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a6144700 1 --2- 172.21.15.36:0/273222229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a00a9850 0x7f34a0064080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a6144700 1 -- 172.21.15.36:0/273222229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a00a9060 msgr2=0x7f34a00ab1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:33:59.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a6144700 1 --2- 172.21.15.36:0/273222229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a00a9060 0x7f34a00ab1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:33:59.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a6144700 1 -- 172.21.15.36:0/273222229 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c00b1e0 con 0x7f34a013f800 2022-01-10T01:33:59.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a6144700 1 --2- 172.21.15.36:0/273222229 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34a013f800 0x7f34a0064570 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f34a00b66d0 tx=0x7f349c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:59.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f348effd700 1 -- 172.21.15.36:0/273222229 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f349c010cc0 con 0x7f34a013f800 2022-01-10T01:33:59.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f348effd700 1 -- 172.21.15.36:0/273222229 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c010e20 con 0x7f34a013f800 2022-01-10T01:33:59.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a7ba7700 1 -- 172.21.15.36:0/273222229 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a01454d0 con 0x7f34a013f800 2022-01-10T01:33:59.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f348effd700 1 -- 172.21.15.36:0/273222229 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f349c01d640 con 0x7f34a013f800 2022-01-10T01:33:59.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.485+0000 7f34a7ba7700 1 -- 172.21.15.36:0/273222229 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a01458a0 con 0x7f34a013f800 2022-01-10T01:33:59.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.489+0000 7f34a7ba7700 1 -- 172.21.15.36:0/273222229 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a0145660 con 0x7f34a013f800 2022-01-10T01:33:59.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.489+0000 7f348effd700 1 -- 172.21.15.36:0/273222229 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f349c00e040 con 0x7f34a013f800 2022-01-10T01:33:59.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.489+0000 7f348effd700 1 --2- 172.21.15.36:0/273222229 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3480055770 0x7f3480057c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:33:59.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.489+0000 7f348effd700 1 -- 172.21.15.36:0/273222229 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f349c06d4e0 con 0x7f34a013f800 2022-01-10T01:33:59.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.489+0000 7f34a5943700 1 --2- 172.21.15.36:0/273222229 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3480055770 0x7f3480057c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:33:59.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.489+0000 7f34a5943700 1 --2- 172.21.15.36:0/273222229 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3480055770 0x7f3480057c30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f349800d000 tx=0x7f3498007ef0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:33:59.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.497+0000 7f348effd700 1 -- 172.21.15.36:0/273222229 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f349c044880 con 0x7f34a013f800 2022-01-10T01:33:59.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:33:59.629+0000 7f34a7ba7700 1 -- 172.21.15.36:0/273222229 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f34a0057350 con 0x7f34a013f800 2022-01-10T01:34:00.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.508+0000 7f348effd700 1 -- 172.21.15.36:0/273222229 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v155) v1 ==== 97+0+0 (secure 0 0 0) 0x7f349c047ea0 con 0x7f34a013f800 2022-01-10T01:34:00.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.512+0000 7f34a7ba7700 1 -- 172.21.15.36:0/273222229 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3480055770 msgr2=0x7f3480057c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:00.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.512+0000 7f34a7ba7700 1 --2- 172.21.15.36:0/273222229 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3480055770 0x7f3480057c30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f349800d000 tx=0x7f3498007ef0).stop 2022-01-10T01:34:00.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.512+0000 7f34a7ba7700 1 -- 172.21.15.36:0/273222229 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34a013f800 msgr2=0x7f34a0064570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:00.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.512+0000 7f34a7ba7700 1 --2- 172.21.15.36:0/273222229 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34a013f800 0x7f34a0064570 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f34a00b66d0 tx=0x7f349c016000).stop 2022-01-10T01:34:00.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.512+0000 7f34a7ba7700 1 -- 172.21.15.36:0/273222229 shutdown_connections 2022-01-10T01:34:00.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.512+0000 7f34a7ba7700 1 --2- 172.21.15.36:0/273222229 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f3480055770 0x7f3480057c30 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:00.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.512+0000 7f34a7ba7700 1 --2- 172.21.15.36:0/273222229 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f34a013f800 0x7f34a0064570 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:00.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.512+0000 7f34a7ba7700 1 --2- 172.21.15.36:0/273222229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34a00a9850 0x7f34a0064080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:00.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.512+0000 7f34a7ba7700 1 --2- 172.21.15.36:0/273222229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a00a9060 0x7f34a00ab1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:00.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.512+0000 7f34a7ba7700 1 -- 172.21.15.36:0/273222229 >> 172.21.15.36:0/273222229 conn(0x7f34a00608d0 msgr2=0x7f34a013fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:00.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.512+0000 7f34a7ba7700 1 -- 172.21.15.36:0/273222229 shutdown_connections 2022-01-10T01:34:00.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.512+0000 7f34a7ba7700 1 -- 172.21.15.36:0/273222229 wait complete. 2022-01-10T01:34:00.524 INFO:teuthology.orchestra.run.smithi036.stderr: removed all blacklist entries 2022-01-10T01:34:00.537 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2022-01-10T01:34:00.538 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2022-01-10T01:34:00.644 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.636+0000 7fc3348b6700 1 Processor -- start 2022-01-10T01:34:00.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.636+0000 7fc3348b6700 1 -- start start 2022-01-10T01:34:00.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.636+0000 7fc3348b6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc3300b2580 0x7fc33014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:00.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.636+0000 7fc3348b6700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc3300b0010 0x7fc33014b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:00.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.636+0000 7fc3348b6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3300a70c0 con 0x7fc3300afbd0 2022-01-10T01:34:00.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.636+0000 7fc3348b6700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3300a72f0 con 0x7fc3300b0010 2022-01-10T01:34:00.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.636+0000 7fc3348b6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3300a7590 con 0x7fc3300b2580 2022-01-10T01:34:00.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.636+0000 7fc32effd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc3300b0010 0x7fc33014b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:00.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.636+0000 7fc32effd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc3300b0010 0x7fc33014b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42874/0 (socket says 172.21.15.36:42874) 2022-01-10T01:34:00.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.636+0000 7fc32effd700 1 -- 172.21.15.36:0/733429159 learned_addr learned my addr 172.21.15.36:0/733429159 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:00.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.636+0000 7fc32f7fe700 1 --2- 172.21.15.36:0/733429159 >> v2:172.21.15.59:3300/0 conn(0x7fc3300b2580 0x7fc33014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:00.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc32effd700 1 -- 172.21.15.36:0/733429159 >> v2:172.21.15.59:3300/0 conn(0x7fc3300b2580 msgr2=0x7fc33014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:00.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc32effd700 1 --2- 172.21.15.36:0/733429159 >> v2:172.21.15.59:3300/0 conn(0x7fc3300b2580 0x7fc33014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:00.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc32effd700 1 -- 172.21.15.36:0/733429159 >> v1:172.21.15.59:6789/0 conn(0x7fc3300afbd0 legacy=0x7fc3300a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:00.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc32effd700 1 -- 172.21.15.36:0/733429159 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3300a7830 con 0x7fc3300b0010 2022-01-10T01:34:00.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc32effd700 1 --2- 172.21.15.36:0/733429159 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3300b0010 0x7fc33014b330 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7fc320002f70 tx=0x7fc320006eb0).ready entity=mon.0 client_cookie=e7e1123cb367faf9 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:00.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc32e7fc700 1 -- 172.21.15.36:0/733429159 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc32000d610 con 0x7fc3300b0010 2022-01-10T01:34:00.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc32e7fc700 1 -- 172.21.15.36:0/733429159 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc320000e90 con 0x7fc3300b0010 2022-01-10T01:34:00.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc32e7fc700 1 -- 172.21.15.36:0/733429159 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc32000d9a0 con 0x7fc3300b0010 2022-01-10T01:34:00.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc3348b6700 1 -- 172.21.15.36:0/733429159 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3300b0010 msgr2=0x7fc33014b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:00.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc3348b6700 1 --2- 172.21.15.36:0/733429159 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3300b0010 0x7fc33014b330 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7fc320002f70 tx=0x7fc320006eb0).stop 2022-01-10T01:34:00.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc3348b6700 1 -- 172.21.15.36:0/733429159 shutdown_connections 2022-01-10T01:34:00.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc3348b6700 1 --2- 172.21.15.36:0/733429159 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3300b0010 0x7fc33014b330 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:00.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc3348b6700 1 --2- 172.21.15.36:0/733429159 >> v2:172.21.15.59:3300/0 conn(0x7fc3300b2580 0x7fc33014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:00.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc3348b6700 1 -- 172.21.15.36:0/733429159 >> 172.21.15.36:0/733429159 conn(0x7fc330060180 msgr2=0x7fc3300b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:00.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc3348b6700 1 -- 172.21.15.36:0/733429159 shutdown_connections 2022-01-10T01:34:00.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.640+0000 7fc3348b6700 1 -- 172.21.15.36:0/733429159 wait complete. 2022-01-10T01:34:00.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc3348b6700 1 Processor -- start 2022-01-10T01:34:00.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc3348b6700 1 -- start start 2022-01-10T01:34:00.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc3348b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3300afbd0 0x7fc3300adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:00.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc3348b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3300b0010 0x7fc330146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:00.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc3348b6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3300b2580 0x7fc330146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:00.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc3348b6700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300ab550 con 0x7fc3300b2580 2022-01-10T01:34:00.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc3348b6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3300aa620 con 0x7fc3300b0010 2022-01-10T01:34:00.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc3348b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc330156460 con 0x7fc3300afbd0 2022-01-10T01:34:00.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc32ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3300b2580 0x7fc330146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:00.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc32ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3300b2580 0x7fc330146970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42884/0 (socket says 172.21.15.36:42884) 2022-01-10T01:34:00.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc32ffff700 1 -- 172.21.15.36:0/462569360 learned_addr learned my addr 172.21.15.36:0/462569360 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:00.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc32effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3300b0010 0x7fc330146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:00.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc32f7fe700 1 --2- 172.21.15.36:0/462569360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3300afbd0 0x7fc3300adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:00.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc32ffff700 1 -- 172.21.15.36:0/462569360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3300afbd0 msgr2=0x7fc3300adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:00.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc32ffff700 1 --2- 172.21.15.36:0/462569360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3300afbd0 0x7fc3300adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:00.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc32ffff700 1 -- 172.21.15.36:0/462569360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3300b0010 msgr2=0x7fc330146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:00.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc32ffff700 1 --2- 172.21.15.36:0/462569360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3300b0010 0x7fc330146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:00.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc32ffff700 1 -- 172.21.15.36:0/462569360 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32000b1e0 con 0x7fc3300b2580 2022-01-10T01:34:00.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc32ffff700 1 --2- 172.21.15.36:0/462569360 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3300b2580 0x7fc330146970 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7fc33006b7c0 tx=0x7fc328007ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:00.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc32cff9700 1 -- 172.21.15.36:0/462569360 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc32800f470 con 0x7fc3300b2580 2022-01-10T01:34:00.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc32cff9700 1 -- 172.21.15.36:0/462569360 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32800f5d0 con 0x7fc3300b2580 2022-01-10T01:34:00.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.644+0000 7fc3348b6700 1 -- 172.21.15.36:0/462569360 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc330156700 con 0x7fc3300b2580 2022-01-10T01:34:00.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.648+0000 7fc32cff9700 1 -- 172.21.15.36:0/462569360 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc32800f930 con 0x7fc3300b2580 2022-01-10T01:34:00.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.648+0000 7fc3348b6700 1 -- 172.21.15.36:0/462569360 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc330146e60 con 0x7fc3300b2580 2022-01-10T01:34:00.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.648+0000 7fc3348b6700 1 -- 172.21.15.36:0/462569360 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33005f240 con 0x7fc3300b2580 2022-01-10T01:34:00.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.648+0000 7fc32cff9700 1 -- 172.21.15.36:0/462569360 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc328019030 con 0x7fc3300b2580 2022-01-10T01:34:00.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.648+0000 7fc32cff9700 1 --2- 172.21.15.36:0/462569360 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc310053680 0x7fc310055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:00.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.648+0000 7fc32cff9700 1 -- 172.21.15.36:0/462569360 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fc32806adf0 con 0x7fc3300b2580 2022-01-10T01:34:00.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.648+0000 7fc32f7fe700 1 --2- 172.21.15.36:0/462569360 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc310053680 0x7fc310055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:00.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.648+0000 7fc32f7fe700 1 --2- 172.21.15.36:0/462569360 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc310053680 0x7fc310055b40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fc32400c000 tx=0x7fc324008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:00.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.652+0000 7fc32cff9700 1 -- 172.21.15.36:0/462569360 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc3280420a0 con 0x7fc3300b2580 2022-01-10T01:34:00.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.820+0000 7fc3348b6700 1 -- 172.21.15.36:0/462569360 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc3300aa790 con 0x7fc3300b2580 2022-01-10T01:34:00.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.820+0000 7fc32cff9700 1 -- 172.21.15.36:0/462569360 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v34) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fc3300aa790 con 0x7fc3300b2580 2022-01-10T01:34:00.829 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:00.829 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:34:00.829 INFO:teuthology.orchestra.run.smithi036.stdout: "auth_dump": [ 2022-01-10T01:34:00.830 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.830 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.a", 2022-01-10T01:34:00.830 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthuGT4IxAA5DyijS4tPjdOLn5uiLXEPg==", 2022-01-10T01:34:00.831 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.831 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:34:00.831 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:34:00.832 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:34:00.832 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:34:00.832 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.833 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.833 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.833 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.b", 2022-01-10T01:34:00.834 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthkvX0LRAAtz19usFvoObvouQeLFwicg==", 2022-01-10T01:34:00.834 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.834 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:34:00.835 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:34:00.835 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:34:00.836 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:34:00.836 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.837 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.837 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.837 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mds.c", 2022-01-10T01:34:00.837 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthbvUmKhAA0pVpDJO1AfsAzIHU1cAHiw==", 2022-01-10T01:34:00.838 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.838 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:34:00.838 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:34:00.839 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:34:00.839 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:34:00.839 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.840 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.840 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.840 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.0", 2022-01-10T01:34:00.841 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCWitthk4iKHRAAF7aFP+i24xFvXXm8j5GzVg==", 2022-01-10T01:34:00.841 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.841 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:34:00.842 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:34:00.842 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:34:00.842 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.843 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.843 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.843 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.1", 2022-01-10T01:34:00.843 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCZitthsKSXABAAb3IkNvlyLub89HwaPWZ1Bg==", 2022-01-10T01:34:00.844 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.844 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:34:00.844 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:34:00.845 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:34:00.845 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.845 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.846 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.847 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.2", 2022-01-10T01:34:00.847 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCbitthvNzhIBAAXkZ6FslnMl1gS/rOa7G+Vg==", 2022-01-10T01:34:00.847 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.848 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:34:00.848 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:34:00.848 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:34:00.849 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.849 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.849 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.850 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.3", 2022-01-10T01:34:00.850 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCeitth9P7EAxAA7KOCP7Rh5oN1yqCz9I6v3A==", 2022-01-10T01:34:00.850 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.851 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:34:00.851 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:34:00.851 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:34:00.852 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.852 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.852 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.853 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.4", 2022-01-10T01:34:00.853 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCjitth/L1UBxAAskxmSV0aE6CSvDFR8O/+SQ==", 2022-01-10T01:34:00.853 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.853 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:34:00.854 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:34:00.854 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:34:00.854 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.855 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.855 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.855 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.5", 2022-01-10T01:34:00.856 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQClitthMoY6JhAAeeIrCmMcm3MpDPtdLUf+2g==", 2022-01-10T01:34:00.856 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.857 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:34:00.857 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:34:00.858 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:34:00.858 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.858 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.859 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.859 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.6", 2022-01-10T01:34:00.859 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCoitthrUhlCxAAsYhU7Kj6HMo/kD0DezvITg==", 2022-01-10T01:34:00.860 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.860 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:34:00.860 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:34:00.861 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:34:00.861 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.862 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.862 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.862 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "osd.7", 2022-01-10T01:34:00.863 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCqitthFaLrKRAAC2g1OlcV2KTtaOXsyCrIrQ==", 2022-01-10T01:34:00.863 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.863 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:34:00.864 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:34:00.864 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:34:00.864 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.865 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.865 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.866 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.0", 2022-01-10T01:34:00.866 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthKoa/NBAADjvHh99F8YOktGID9uyttg==", 2022-01-10T01:34:00.867 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.867 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:34:00.868 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:34:00.868 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:34:00.868 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.869 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.869 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.869 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.1", 2022-01-10T01:34:00.870 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth3x76OBAAPTrw8OUmnpEflWuB7zzaHg==", 2022-01-10T01:34:00.870 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.870 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow", 2022-01-10T01:34:00.871 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow r", 2022-01-10T01:34:00.871 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow rw pool=cephfs_data" 2022-01-10T01:34:00.872 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.872 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.872 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.873 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "client.admin", 2022-01-10T01:34:00.873 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitthf9dqChAADHRsoZKuozdsqb41ztuR7w==", 2022-01-10T01:34:00.874 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.874 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:34:00.874 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr": "allow *", 2022-01-10T01:34:00.875 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow *", 2022-01-10T01:34:00.875 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:34:00.875 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.876 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.876 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.877 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.x", 2022-01-10T01:34:00.877 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth39syIRAA6pOvLWw2ADy72TWZ65MIkA==", 2022-01-10T01:34:00.877 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.878 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:34:00.878 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:34:00.878 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:34:00.878 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.878 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:00.879 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:00.879 INFO:teuthology.orchestra.run.smithi036.stdout: "entity": "mgr.y", 2022-01-10T01:34:00.879 INFO:teuthology.orchestra.run.smithi036.stdout: "key": "AQCTitth4novHRAACVMjo72kOB/T7Ti/CiN27w==", 2022-01-10T01:34:00.879 INFO:teuthology.orchestra.run.smithi036.stdout: "caps": { 2022-01-10T01:34:00.880 INFO:teuthology.orchestra.run.smithi036.stdout: "mds": "allow *", 2022-01-10T01:34:00.880 INFO:teuthology.orchestra.run.smithi036.stdout: "mon": "allow profile mgr", 2022-01-10T01:34:00.880 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": "allow *" 2022-01-10T01:34:00.880 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.880 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:00.881 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:00.881 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:34:00.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.820+0000 7fc3348b6700 1 -- 172.21.15.36:0/462569360 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc310053680 msgr2=0x7fc310055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:00.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.820+0000 7fc3348b6700 1 --2- 172.21.15.36:0/462569360 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc310053680 0x7fc310055b40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fc32400c000 tx=0x7fc324008040).stop 2022-01-10T01:34:00.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.820+0000 7fc3348b6700 1 -- 172.21.15.36:0/462569360 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3300b2580 msgr2=0x7fc330146970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:00.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.820+0000 7fc3348b6700 1 --2- 172.21.15.36:0/462569360 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3300b2580 0x7fc330146970 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7fc33006b7c0 tx=0x7fc328007ed0).stop 2022-01-10T01:34:00.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.824+0000 7fc3348b6700 1 -- 172.21.15.36:0/462569360 shutdown_connections 2022-01-10T01:34:00.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.824+0000 7fc3348b6700 1 --2- 172.21.15.36:0/462569360 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc310053680 0x7fc310055b40 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:00.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.824+0000 7fc3348b6700 1 --2- 172.21.15.36:0/462569360 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc3300b2580 0x7fc330146970 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:00.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.824+0000 7fc3348b6700 1 --2- 172.21.15.36:0/462569360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3300b0010 0x7fc330146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:00.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.824+0000 7fc3348b6700 1 --2- 172.21.15.36:0/462569360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3300afbd0 0x7fc3300adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:00.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.824+0000 7fc3348b6700 1 -- 172.21.15.36:0/462569360 >> 172.21.15.36:0/462569360 conn(0x7fc330060180 msgr2=0x7fc33014b910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:00.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.824+0000 7fc3348b6700 1 -- 172.21.15.36:0/462569360 shutdown_connections 2022-01-10T01:34:00.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.824+0000 7fc3348b6700 1 -- 172.21.15.36:0/462569360 wait complete. 2022-01-10T01:34:00.886 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:34:00.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.984+0000 7f064b59e700 1 Processor -- start 2022-01-10T01:34:00.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.984+0000 7f064b59e700 1 -- start start 2022-01-10T01:34:00.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.984+0000 7f064b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f064c0b27a0 0x7f064c147470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:00.996 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.984+0000 7f064b59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f064c05c490 0x7f064c0a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:00.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.984+0000 7f064b59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c14b8e0 con 0x7f064c0b1d10 2022-01-10T01:34:00.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.984+0000 7f064b59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c1451b0 con 0x7f064c05c490 2022-01-10T01:34:00.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.984+0000 7f064b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0b2b80 con 0x7f064c0b27a0 2022-01-10T01:34:00.997 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.984+0000 7f064a59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f064c0b27a0 0x7f064c147470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:00.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.984+0000 7f064ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f064c05c490 0x7f064c0a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:00.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.984+0000 7f0649d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f064c0b1d10 0x7f064c14b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:58360/0 (socket says 172.21.15.36:58360) 2022-01-10T01:34:01.000 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.984+0000 7f0649d9b700 1 -- 172.21.15.36:0/942240206 learned_addr learned my addr 172.21.15.36:0/942240206 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:01.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.984+0000 7f064959a700 1 -- 172.21.15.36:0/942240206 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483801389 0 0) 0x7f064c14b8e0 con 0x7f064c0b1d10 2022-01-10T01:34:01.001 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.984+0000 7f064959a700 1 -- 172.21.15.36:0/942240206 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f062c003260 con 0x7f064c0b1d10 2022-01-10T01:34:01.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064a59c700 1 -- 172.21.15.36:0/942240206 >> v2:172.21.15.59:3300/0 conn(0x7f064c05c490 msgr2=0x7f064c0a8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:01.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064a59c700 1 --2- 172.21.15.36:0/942240206 >> v2:172.21.15.59:3300/0 conn(0x7f064c05c490 0x7f064c0a8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064a59c700 1 -- 172.21.15.36:0/942240206 >> v1:172.21.15.59:6789/0 conn(0x7f064c0b1d10 legacy=0x7f064c14b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064a59c700 1 -- 172.21.15.36:0/942240206 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c14aad0 con 0x7f064c0b27a0 2022-01-10T01:34:01.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064a59c700 1 --2- 172.21.15.36:0/942240206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f064c0b27a0 0x7f064c147470 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f06340032f0 tx=0x7f06340091d0).ready entity=mon.2 client_cookie=abbcdd3fc9d23034 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:01.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064959a700 1 -- 172.21.15.36:0/942240206 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063400b600 con 0x7f064c0b27a0 2022-01-10T01:34:01.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064959a700 1 -- 172.21.15.36:0/942240206 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063400b760 con 0x7f064c0b27a0 2022-01-10T01:34:01.004 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064959a700 1 -- 172.21.15.36:0/942240206 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f063400b8d0 con 0x7f064c0b27a0 2022-01-10T01:34:01.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064b59e700 1 -- 172.21.15.36:0/942240206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f064c0b27a0 msgr2=0x7f064c147470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064b59e700 1 --2- 172.21.15.36:0/942240206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f064c0b27a0 0x7f064c147470 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f06340032f0 tx=0x7f06340091d0).stop 2022-01-10T01:34:01.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064b59e700 1 -- 172.21.15.36:0/942240206 shutdown_connections 2022-01-10T01:34:01.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064b59e700 1 --2- 172.21.15.36:0/942240206 >> v2:172.21.15.59:3300/0 conn(0x7f064c05c490 0x7f064c0a8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064b59e700 1 --2- 172.21.15.36:0/942240206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f064c0b27a0 0x7f064c147470 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064b59e700 1 -- 172.21.15.36:0/942240206 >> 172.21.15.36:0/942240206 conn(0x7f064c061140 msgr2=0x7f064c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:01.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064b59e700 1 -- 172.21.15.36:0/942240206 shutdown_connections 2022-01-10T01:34:01.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064b59e700 1 -- 172.21.15.36:0/942240206 wait complete. 2022-01-10T01:34:01.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064b59e700 1 Processor -- start 2022-01-10T01:34:01.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.988+0000 7f064b59e700 1 -- start start 2022-01-10T01:34:01.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064b59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f064c05c490 0x7f064c14cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f064c0b1d10 0x7f064c147150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064b59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f064c0b27a0 0x7f064c159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064b59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c1574f0 con 0x7f064c0b27a0 2022-01-10T01:34:01.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064b59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c145310 con 0x7f064c05c490 2022-01-10T01:34:01.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0ac430 con 0x7f064c0b1d10 2022-01-10T01:34:01.017 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064ad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f064c0b27a0 0x7f064c159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f064c05c490 0x7f064c14cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f0649d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f064c0b1d10 0x7f064c147150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f064c05c490 0x7f064c14cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:39528/0 (socket says 172.21.15.36:39528) 2022-01-10T01:34:01.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064ad9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f064c0b27a0 0x7f064c159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42898/0 (socket says 172.21.15.36:42898) 2022-01-10T01:34:01.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f0649d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f064c0b1d10 0x7f064c147150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:49178/0 (socket says 172.21.15.36:49178) 2022-01-10T01:34:01.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064ad9d700 1 -- 172.21.15.36:0/714445930 learned_addr learned my addr 172.21.15.36:0/714445930 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:01.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064ad9d700 1 -- 172.21.15.36:0/714445930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f064c0b1d10 msgr2=0x7f064c147150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064ad9d700 1 --2- 172.21.15.36:0/714445930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f064c0b1d10 0x7f064c147150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064ad9d700 1 -- 172.21.15.36:0/714445930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f064c05c490 msgr2=0x7f064c14cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064ad9d700 1 --2- 172.21.15.36:0/714445930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f064c05c490 0x7f064c14cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064ad9d700 1 -- 172.21.15.36:0/714445930 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0634009470 con 0x7f064c0b27a0 2022-01-10T01:34:01.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f0649d9b700 1 --2- 172.21.15.36:0/714445930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f064c0b1d10 0x7f064c147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:34:01.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064ad9d700 1 --2- 172.21.15.36:0/714445930 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f064c0b27a0 0x7f064c159a80 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f064400c000 tx=0x7f0644006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:01.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f06437fe700 1 -- 172.21.15.36:0/714445930 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0644011750 con 0x7f064c0b27a0 2022-01-10T01:34:01.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f06437fe700 1 -- 172.21.15.36:0/714445930 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06440118b0 con 0x7f064c0b27a0 2022-01-10T01:34:01.023 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f06437fe700 1 -- 172.21.15.36:0/714445930 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0644011c10 con 0x7f064c0b27a0 2022-01-10T01:34:01.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064b59e700 1 -- 172.21.15.36:0/714445930 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c0ac6d0 con 0x7f064c0b27a0 2022-01-10T01:34:01.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064b59e700 1 -- 172.21.15.36:0/714445930 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c156f60 con 0x7f064c0b27a0 2022-01-10T01:34:01.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.992+0000 7f064b59e700 1 -- 172.21.15.36:0/714445930 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c057350 con 0x7f064c0b27a0 2022-01-10T01:34:01.024 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.996+0000 7f06437fe700 1 -- 172.21.15.36:0/714445930 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0644011d70 con 0x7f064c0b27a0 2022-01-10T01:34:01.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.996+0000 7f06437fe700 1 --2- 172.21.15.36:0/714445930 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06300535f0 0x7f0630055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.996+0000 7f06437fe700 1 -- 172.21.15.36:0/714445930 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f064406bb30 con 0x7f064c0b27a0 2022-01-10T01:34:01.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.996+0000 7f064a59c700 1 --2- 172.21.15.36:0/714445930 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06300535f0 0x7f0630055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:00.996+0000 7f064a59c700 1 --2- 172.21.15.36:0/714445930 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06300535f0 0x7f0630055ab0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f063401b000 tx=0x7f0634016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:01.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.000+0000 7f06437fe700 1 -- 172.21.15.36:0/714445930 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0644042d70 con 0x7f064c0b27a0 2022-01-10T01:34:01.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.132+0000 7f064b59e700 1 -- 172.21.15.36:0/714445930 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f064c0698e0 con 0x7f064c0b27a0 2022-01-10T01:34:01.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.132+0000 7f06437fe700 1 -- 172.21.15.36:0/714445930 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+13424 (secure 0 0 0) 0x7f0644046390 con 0x7f064c0b27a0 2022-01-10T01:34:01.143 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:01.144 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":155,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:34:00.505832+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:34:01.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.136+0000 7f064b59e700 1 -- 172.21.15.36:0/714445930 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06300535f0 msgr2=0x7f0630055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.136+0000 7f064b59e700 1 --2- 172.21.15.36:0/714445930 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06300535f0 0x7f0630055ab0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f063401b000 tx=0x7f0634016000).stop 2022-01-10T01:34:01.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.136+0000 7f064b59e700 1 -- 172.21.15.36:0/714445930 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f064c0b27a0 msgr2=0x7f064c159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.136+0000 7f064b59e700 1 --2- 172.21.15.36:0/714445930 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f064c0b27a0 0x7f064c159a80 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f064400c000 tx=0x7f0644006df0).stop 2022-01-10T01:34:01.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.136+0000 7f064b59e700 1 -- 172.21.15.36:0/714445930 shutdown_connections 2022-01-10T01:34:01.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.136+0000 7f064b59e700 1 --2- 172.21.15.36:0/714445930 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f06300535f0 0x7f0630055ab0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.136+0000 7f064b59e700 1 --2- 172.21.15.36:0/714445930 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f064c0b27a0 0x7f064c159a80 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.136+0000 7f064b59e700 1 --2- 172.21.15.36:0/714445930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f064c0b1d10 0x7f064c147150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.136+0000 7f064b59e700 1 --2- 172.21.15.36:0/714445930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f064c05c490 0x7f064c14cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.136+0000 7f064b59e700 1 -- 172.21.15.36:0/714445930 >> 172.21.15.36:0/714445930 conn(0x7f064c061140 msgr2=0x7f064c061520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:01.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.136+0000 7f064b59e700 1 -- 172.21.15.36:0/714445930 shutdown_connections 2022-01-10T01:34:01.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.136+0000 7f064b59e700 1 -- 172.21.15.36:0/714445930 wait complete. 2022-01-10T01:34:01.162 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-01-10T01:34:01.163 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:34:01.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.264+0000 7f9eae081700 1 Processor -- start 2022-01-10T01:34:01.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.264+0000 7f9eae081700 1 -- start start 2022-01-10T01:34:01.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9eae081700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ea80b2910 0x7f9ea80b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9eae081700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea8146660 con 0x7f9ea8140a80 2022-01-10T01:34:01.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9eae081700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea8147510 con 0x7f9ea80b6380 2022-01-10T01:34:01.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9eae081700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea8061fb0 con 0x7f9ea80b2910 2022-01-10T01:34:01.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9ead880700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9ea8140a80 0x7f9ea80b11c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40698/0 (socket says 172.21.15.36:40698) 2022-01-10T01:34:01.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9ead880700 1 -- 172.21.15.36:0/861340120 learned_addr learned my addr 172.21.15.36:0/861340120 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:01.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9eac87e700 1 --2- 172.21.15.36:0/861340120 >> v2:172.21.15.59:3300/0 conn(0x7f9ea80b2910 0x7f9ea80b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767172785 0 0) 0x7f9ea8146660 con 0x7f9ea8140a80 2022-01-10T01:34:01.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e90003260 con 0x7f9ea8140a80 2022-01-10T01:34:01.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390650529 0 0) 0x7f9ea8147510 con 0x7f9ea80b6380 2022-01-10T01:34:01.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ea8146660 con 0x7f9ea80b6380 2022-01-10T01:34:01.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 492391512 0 0) 0x7f9e90003260 con 0x7f9ea8140a80 2022-01-10T01:34:01.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 >> v2:172.21.15.59:3300/0 conn(0x7f9ea80b2910 msgr2=0x7f9ea80b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:01.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 --2- 172.21.15.36:0/861340120 >> v2:172.21.15.59:3300/0 conn(0x7f9ea80b2910 0x7f9ea80b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 >> v1:172.21.15.59:6789/0 conn(0x7f9ea80b6380 legacy=0x7f9ea8140370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea8146890 con 0x7f9ea8140a80 2022-01-10T01:34:01.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f9ea00019e0 con 0x7f9ea8140a80 2022-01-10T01:34:01.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9eac87e700 1 --2- 172.21.15.36:0/861340120 >> v2:172.21.15.59:3300/0 conn(0x7f9ea80b2910 0x7f9ea80b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:34:01.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 >> v1:172.21.15.36:6789/0 conn(0x7f9ea8140a80 legacy=0x7f9ea80b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 --2- 172.21.15.36:0/861340120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e90003930 0x7f9e90003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 --2- 172.21.15.36:0/861340120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e90004500 0x7f9e90004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 --2- 172.21.15.36:0/861340120 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e90004e70 0x7f9e9000b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea8061fb0 con 0x7f9e90004e70 2022-01-10T01:34:01.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9000bd20 con 0x7f9e90004500 2022-01-10T01:34:01.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9000bee0 con 0x7f9e90003930 2022-01-10T01:34:01.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9ead07f700 1 --2- 172.21.15.36:0/861340120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e90003930 0x7f9e90003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9eac87e700 1 --2- 172.21.15.36:0/861340120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e90004500 0x7f9e90004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.268+0000 7f9ead880700 1 --2- 172.21.15.36:0/861340120 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e90004e70 0x7f9e9000b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9ead07f700 1 -- 172.21.15.36:0/861340120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e90004500 msgr2=0x7f9e90004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:01.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9ead07f700 1 --2- 172.21.15.36:0/861340120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e90004500 0x7f9e90004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9ead07f700 1 -- 172.21.15.36:0/861340120 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e90004e70 msgr2=0x7f9e9000b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:01.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9ead07f700 1 --2- 172.21.15.36:0/861340120 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9e90004e70 0x7f9e9000b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9ead07f700 1 -- 172.21.15.36:0/861340120 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e90003260 con 0x7f9e90003930 2022-01-10T01:34:01.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9ead880700 1 -- 172.21.15.36:0/861340120 reap_dead start 2022-01-10T01:34:01.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9eac87e700 1 --2- 172.21.15.36:0/861340120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e90004500 0x7f9e90004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:34:01.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9ead07f700 1 --2- 172.21.15.36:0/861340120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e90003930 0x7f9e90003d30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f9ea4001110 tx=0x7f9ea4007a00).ready entity=mon.2 client_cookie=c7403b98f713e219 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:01.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ea4007d10 con 0x7f9e90003930 2022-01-10T01:34:01.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea4007030 con 0x7f9e90003930 2022-01-10T01:34:01.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9e97fff700 1 -- 172.21.15.36:0/861340120 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ea4007390 con 0x7f9e90003930 2022-01-10T01:34:01.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9eae081700 1 -- 172.21.15.36:0/861340120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e90003930 msgr2=0x7f9e90003d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9eae081700 1 --2- 172.21.15.36:0/861340120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e90003930 0x7f9e90003d30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f9ea4001110 tx=0x7f9ea4007a00).stop 2022-01-10T01:34:01.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9eae081700 1 -- 172.21.15.36:0/861340120 shutdown_connections 2022-01-10T01:34:01.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9eae081700 1 --2- 172.21.15.36:0/861340120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e90003930 0x7f9e90003d30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9eae081700 1 -- 172.21.15.36:0/861340120 >> 172.21.15.36:0/861340120 conn(0x7f9ea8063670 msgr2=0x7f9ea8063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:01.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9eae081700 1 -- 172.21.15.36:0/861340120 shutdown_connections 2022-01-10T01:34:01.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9eae081700 1 -- 172.21.15.36:0/861340120 wait complete. 2022-01-10T01:34:01.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9eae081700 1 Processor -- start 2022-01-10T01:34:01.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.272+0000 7f9eae081700 1 -- start start 2022-01-10T01:34:01.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9eae081700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e90003930 0x7f9ea80aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9eae081700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ea80af3e0 0x7f9ea80af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9eae081700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ea8152d40 0x7f9ea80afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9eae081700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea81426c0 con 0x7f9ea8152d40 2022-01-10T01:34:01.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9eae081700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea8141ce0 con 0x7f9e90003930 2022-01-10T01:34:01.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9eae081700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea8141f80 con 0x7f9ea80af3e0 2022-01-10T01:34:01.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9ead880700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ea8152d40 0x7f9ea80afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9ead880700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ea8152d40 0x7f9ea80afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42918/0 (socket says 172.21.15.36:42918) 2022-01-10T01:34:01.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9ead880700 1 -- 172.21.15.36:0/3027439103 learned_addr learned my addr 172.21.15.36:0/3027439103 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:01.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9eac87e700 1 --2- 172.21.15.36:0/3027439103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ea80af3e0 0x7f9ea80af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9ead07f700 1 --2- 172.21.15.36:0/3027439103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e90003930 0x7f9ea80aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9ead880700 1 -- 172.21.15.36:0/3027439103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ea80af3e0 msgr2=0x7f9ea80af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9ead880700 1 --2- 172.21.15.36:0/3027439103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ea80af3e0 0x7f9ea80af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9ead880700 1 -- 172.21.15.36:0/3027439103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e90003930 msgr2=0x7f9ea80aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9ead880700 1 --2- 172.21.15.36:0/3027439103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e90003930 0x7f9ea80aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9ead880700 1 -- 172.21.15.36:0/3027439103 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea8142220 con 0x7f9ea8152d40 2022-01-10T01:34:01.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9ead880700 1 --2- 172.21.15.36:0/3027439103 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ea8152d40 0x7f9ea80afda0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f9ea806aab0 tx=0x7f9ea80648b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:01.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9e967fc700 1 -- 172.21.15.36:0/3027439103 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ea0011780 con 0x7f9ea8152d40 2022-01-10T01:34:01.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9e967fc700 1 -- 172.21.15.36:0/3027439103 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea00118e0 con 0x7f9ea8152d40 2022-01-10T01:34:01.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9eae081700 1 -- 172.21.15.36:0/3027439103 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea8141830 con 0x7f9ea8152d40 2022-01-10T01:34:01.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9e967fc700 1 -- 172.21.15.36:0/3027439103 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ea0011c40 con 0x7f9ea8152d40 2022-01-10T01:34:01.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.276+0000 7f9eae081700 1 -- 172.21.15.36:0/3027439103 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea8145060 con 0x7f9ea8152d40 2022-01-10T01:34:01.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.280+0000 7f9e967fc700 1 -- 172.21.15.36:0/3027439103 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9ea001b030 con 0x7f9ea8152d40 2022-01-10T01:34:01.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.280+0000 7f9eae081700 1 -- 172.21.15.36:0/3027439103 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea8146b30 con 0x7f9ea8152d40 2022-01-10T01:34:01.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.280+0000 7f9e967fc700 1 --2- 172.21.15.36:0/3027439103 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e880535f0 0x7f9e88055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.280+0000 7f9e967fc700 1 -- 172.21.15.36:0/3027439103 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f9ea006b070 con 0x7f9ea8152d40 2022-01-10T01:34:01.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.280+0000 7f9ead07f700 1 --2- 172.21.15.36:0/3027439103 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e880535f0 0x7f9e88055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.280+0000 7f9ead07f700 1 --2- 172.21.15.36:0/3027439103 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e880535f0 0x7f9e88055ab0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f9ea401b000 tx=0x7f9ea4016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:01.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.288+0000 7f9e967fc700 1 -- 172.21.15.36:0/3027439103 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9ea0042340 con 0x7f9ea8152d40 2022-01-10T01:34:01.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.412+0000 7f9eae081700 1 -- 172.21.15.36:0/3027439103 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9ea8057350 con 0x7f9ea8152d40 2022-01-10T01:34:01.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.412+0000 7f9e967fc700 1 -- 172.21.15.36:0/3027439103 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v155) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9ea0019020 con 0x7f9ea8152d40 2022-01-10T01:34:01.420 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:34:01.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.412+0000 7f9eae081700 1 -- 172.21.15.36:0/3027439103 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e880535f0 msgr2=0x7f9e88055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.412+0000 7f9eae081700 1 --2- 172.21.15.36:0/3027439103 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e880535f0 0x7f9e88055ab0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f9ea401b000 tx=0x7f9ea4016000).stop 2022-01-10T01:34:01.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.412+0000 7f9eae081700 1 -- 172.21.15.36:0/3027439103 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ea8152d40 msgr2=0x7f9ea80afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.412+0000 7f9eae081700 1 --2- 172.21.15.36:0/3027439103 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ea8152d40 0x7f9ea80afda0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f9ea806aab0 tx=0x7f9ea80648b0).stop 2022-01-10T01:34:01.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.412+0000 7f9eae081700 1 -- 172.21.15.36:0/3027439103 shutdown_connections 2022-01-10T01:34:01.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.412+0000 7f9eae081700 1 --2- 172.21.15.36:0/3027439103 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9e880535f0 0x7f9e88055ab0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.412+0000 7f9eae081700 1 --2- 172.21.15.36:0/3027439103 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9ea8152d40 0x7f9ea80afda0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.423 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.412+0000 7f9eae081700 1 --2- 172.21.15.36:0/3027439103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9ea80af3e0 0x7f9ea80af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.412+0000 7f9eae081700 1 --2- 172.21.15.36:0/3027439103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e90003930 0x7f9ea80aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.412+0000 7f9eae081700 1 -- 172.21.15.36:0/3027439103 >> 172.21.15.36:0/3027439103 conn(0x7f9ea8063670 msgr2=0x7f9ea8065620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:01.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.412+0000 7f9eae081700 1 -- 172.21.15.36:0/3027439103 shutdown_connections 2022-01-10T01:34:01.424 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.412+0000 7f9eae081700 1 -- 172.21.15.36:0/3027439103 wait complete. 2022-01-10T01:34:01.433 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:34:01.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81f05d7700 1 Processor -- start 2022-01-10T01:34:01.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81f05d7700 1 -- start start 2022-01-10T01:34:01.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81f05d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e80b5990 0x7f81e80b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81f05d7700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e8143f60 con 0x7f81e805fc00 2022-01-10T01:34:01.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81f05d7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e805ffe0 con 0x7f81e80b6560 2022-01-10T01:34:01.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81f05d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80ba6b0 con 0x7f81e80b5990 2022-01-10T01:34:01.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ee373700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f81e805fc00 0x7f81e80b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40716/0 (socket says 172.21.15.36:40716) 2022-01-10T01:34:01.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ee373700 1 -- 172.21.15.36:0/4261971340 learned_addr learned my addr 172.21.15.36:0/4261971340 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:01.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81eeb74700 1 --2- 172.21.15.36:0/4261971340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e80b5990 0x7f81e80b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847110805 0 0) 0x7f81e8143f60 con 0x7f81e805fc00 2022-01-10T01:34:01.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81d0003260 con 0x7f81e805fc00 2022-01-10T01:34:01.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643685135 0 0) 0x7f81e805ffe0 con 0x7f81e80b6560 2022-01-10T01:34:01.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e8143f60 con 0x7f81e80b6560 2022-01-10T01:34:01.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1684283308 0 0) 0x7f81d0003260 con 0x7f81e805fc00 2022-01-10T01:34:01.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e80b5990 msgr2=0x7f81e80b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:01.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 --2- 172.21.15.36:0/4261971340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e80b5990 0x7f81e80b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 >> v1:172.21.15.59:6789/0 conn(0x7f81e80b6560 legacy=0x7f81e80b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e8143a50 con 0x7f81e805fc00 2022-01-10T01:34:01.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f81e4001660 con 0x7f81e805fc00 2022-01-10T01:34:01.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 >> v1:172.21.15.36:6789/0 conn(0x7f81e805fc00 legacy=0x7f81e80b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 --2- 172.21.15.36:0/4261971340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d0003910 0x7f81d0003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 --2- 172.21.15.36:0/4261971340 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d0004500 0x7f81d0004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 --2- 172.21.15.36:0/4261971340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e80b5990 0x7f81d0004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80ba6b0 con 0x7f81d0004500 2022-01-10T01:34:01.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d000b780 con 0x7f81d0003910 2022-01-10T01:34:01.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d000b940 con 0x7f81e80b5990 2022-01-10T01:34:01.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.540+0000 7f81edb72700 1 --2- 172.21.15.36:0/4261971340 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d0004500 0x7f81d0004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81ee373700 1 --2- 172.21.15.36:0/4261971340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d0003910 0x7f81d0003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81eeb74700 1 --2- 172.21.15.36:0/4261971340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e80b5990 0x7f81d0004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81edb72700 1 -- 172.21.15.36:0/4261971340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e80b5990 msgr2=0x7f81d0004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:01.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81edb72700 1 --2- 172.21.15.36:0/4261971340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e80b5990 0x7f81d0004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81edb72700 1 -- 172.21.15.36:0/4261971340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d0003910 msgr2=0x7f81d0003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:01.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81edb72700 1 --2- 172.21.15.36:0/4261971340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d0003910 0x7f81d0003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81edb72700 1 -- 172.21.15.36:0/4261971340 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d0003260 con 0x7f81d0004500 2022-01-10T01:34:01.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81ee373700 1 --2- 172.21.15.36:0/4261971340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d0003910 0x7f81d0003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:34:01.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81edb72700 1 --2- 172.21.15.36:0/4261971340 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d0004500 0x7f81d0004980 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f81d8001110 tx=0x7f81d8007a00).ready entity=mon.0 client_cookie=f1d8da9ce0915298 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:01.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d8007d10 con 0x7f81d0004500 2022-01-10T01:34:01.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d8007030 con 0x7f81d0004500 2022-01-10T01:34:01.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81ed371700 1 -- 172.21.15.36:0/4261971340 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d8007390 con 0x7f81d0004500 2022-01-10T01:34:01.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81f05d7700 1 -- 172.21.15.36:0/4261971340 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d0004500 msgr2=0x7f81d0004980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81f05d7700 1 --2- 172.21.15.36:0/4261971340 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d0004500 0x7f81d0004980 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7f81d8001110 tx=0x7f81d8007a00).stop 2022-01-10T01:34:01.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81eeb74700 1 -- 172.21.15.36:0/4261971340 reap_dead start 2022-01-10T01:34:01.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81f05d7700 1 -- 172.21.15.36:0/4261971340 shutdown_connections 2022-01-10T01:34:01.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81f05d7700 1 -- 172.21.15.36:0/4261971340 >> 172.21.15.36:0/4261971340 conn(0x7f81e80623a0 msgr2=0x7f81e8066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:01.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81f05d7700 1 -- 172.21.15.36:0/4261971340 shutdown_connections 2022-01-10T01:34:01.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81f05d7700 1 -- 172.21.15.36:0/4261971340 wait complete. 2022-01-10T01:34:01.563 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81f05d7700 1 Processor -- start 2022-01-10T01:34:01.564 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81f05d7700 1 -- start start 2022-01-10T01:34:01.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81f05d7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d0004500 0x7f81e812f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81f05d7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e812ed60 0x7f81e8155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81f05d7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e812f1c0 0x7f81e81562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81f05d7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e8152500 con 0x7f81d0004500 2022-01-10T01:34:01.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81f05d7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80b2d50 con 0x7f81e812ed60 2022-01-10T01:34:01.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81f05d7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80b2ff0 con 0x7f81e812f1c0 2022-01-10T01:34:01.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81ee373700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d0004500 0x7f81e812f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81ee373700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d0004500 0x7f81e812f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42934/0 (socket says 172.21.15.36:42934) 2022-01-10T01:34:01.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81ee373700 1 -- 172.21.15.36:0/3758380765 learned_addr learned my addr 172.21.15.36:0/3758380765 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:01.569 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81edb72700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e812ed60 0x7f81e8155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.544+0000 7f81eeb74700 1 --2- 172.21.15.36:0/3758380765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e812f1c0 0x7f81e81562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.548+0000 7f81ee373700 1 -- 172.21.15.36:0/3758380765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e812f1c0 msgr2=0x7f81e81562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.570 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.548+0000 7f81ee373700 1 --2- 172.21.15.36:0/3758380765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e812f1c0 0x7f81e81562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.548+0000 7f81ee373700 1 -- 172.21.15.36:0/3758380765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e812ed60 msgr2=0x7f81e8155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.548+0000 7f81ee373700 1 --2- 172.21.15.36:0/3758380765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e812ed60 0x7f81e8155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.548+0000 7f81ee373700 1 -- 172.21.15.36:0/3758380765 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e80b3290 con 0x7f81d0004500 2022-01-10T01:34:01.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.548+0000 7f81ee373700 1 --2- 172.21.15.36:0/3758380765 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d0004500 0x7f81e812f9b0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f81e400b000 tx=0x7f81e80b9750).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:01.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.548+0000 7f81d77fe700 1 -- 172.21.15.36:0/3758380765 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e4010450 con 0x7f81d0004500 2022-01-10T01:34:01.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.548+0000 7f81d77fe700 1 -- 172.21.15.36:0/3758380765 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e40105b0 con 0x7f81d0004500 2022-01-10T01:34:01.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.548+0000 7f81f05d7700 1 -- 172.21.15.36:0/3758380765 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e8133560 con 0x7f81d0004500 2022-01-10T01:34:01.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.548+0000 7f81d77fe700 1 -- 172.21.15.36:0/3758380765 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81e4010910 con 0x7f81d0004500 2022-01-10T01:34:01.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.548+0000 7f81f05d7700 1 -- 172.21.15.36:0/3758380765 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e81567c0 con 0x7f81d0004500 2022-01-10T01:34:01.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.548+0000 7f81f05d7700 1 -- 172.21.15.36:0/3758380765 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e8143cc0 con 0x7f81d0004500 2022-01-10T01:34:01.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.548+0000 7f81d77fe700 1 -- 172.21.15.36:0/3758380765 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f81e401a020 con 0x7f81d0004500 2022-01-10T01:34:01.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.552+0000 7f81d77fe700 1 --2- 172.21.15.36:0/3758380765 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81c80534d0 0x7f81c8055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.552+0000 7f81d77fe700 1 -- 172.21.15.36:0/3758380765 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f81e406b340 con 0x7f81d0004500 2022-01-10T01:34:01.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.552+0000 7f81edb72700 1 --2- 172.21.15.36:0/3758380765 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81c80534d0 0x7f81c8055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.552+0000 7f81edb72700 1 --2- 172.21.15.36:0/3758380765 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81c80534d0 0x7f81c8055990 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f81d801a000 tx=0x7f81d8016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:01.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.552+0000 7f81d77fe700 1 -- 172.21.15.36:0/3758380765 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f81e4042630 con 0x7f81d0004500 2022-01-10T01:34:01.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.680+0000 7f81f05d7700 1 -- 172.21.15.36:0/3758380765 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f81e8057350 con 0x7f81d0004500 2022-01-10T01:34:01.687 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.680+0000 7f81d77fe700 1 -- 172.21.15.36:0/3758380765 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v155) v1 ==== 92+0+10 (secure 0 0 0) 0x7f81e4045c50 con 0x7f81d0004500 2022-01-10T01:34:01.688 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:34:01.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.680+0000 7f81f05d7700 1 -- 172.21.15.36:0/3758380765 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81c80534d0 msgr2=0x7f81c8055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.680+0000 7f81f05d7700 1 --2- 172.21.15.36:0/3758380765 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81c80534d0 0x7f81c8055990 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f81d801a000 tx=0x7f81d8016000).stop 2022-01-10T01:34:01.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.680+0000 7f81f05d7700 1 -- 172.21.15.36:0/3758380765 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d0004500 msgr2=0x7f81e812f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.680+0000 7f81f05d7700 1 --2- 172.21.15.36:0/3758380765 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d0004500 0x7f81e812f9b0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7f81e400b000 tx=0x7f81e80b9750).stop 2022-01-10T01:34:01.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.680+0000 7f81f05d7700 1 -- 172.21.15.36:0/3758380765 shutdown_connections 2022-01-10T01:34:01.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.680+0000 7f81f05d7700 1 --2- 172.21.15.36:0/3758380765 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81c80534d0 0x7f81c8055990 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.680+0000 7f81f05d7700 1 --2- 172.21.15.36:0/3758380765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81e812f1c0 0x7f81e81562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.680+0000 7f81f05d7700 1 --2- 172.21.15.36:0/3758380765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81e812ed60 0x7f81e8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.680+0000 7f81f05d7700 1 --2- 172.21.15.36:0/3758380765 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d0004500 0x7f81e812f9b0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.680+0000 7f81f05d7700 1 -- 172.21.15.36:0/3758380765 >> 172.21.15.36:0/3758380765 conn(0x7f81e80623a0 msgr2=0x7f81e8140eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:01.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.680+0000 7f81f05d7700 1 -- 172.21.15.36:0/3758380765 shutdown_connections 2022-01-10T01:34:01.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.680+0000 7f81f05d7700 1 -- 172.21.15.36:0/3758380765 wait complete. 2022-01-10T01:34:01.701 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-01-10T01:34:01.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.796+0000 7fbc1403a700 1 Processor -- start 2022-01-10T01:34:01.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.796+0000 7fbc1403a700 1 -- start start 2022-01-10T01:34:01.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbc0c0b1db0 0x7fbc0c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbc0c1483a0 0x7fbc0c0b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc0c0a70c0 0x7fbc0c144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0c0a90c0 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0c0b0350 con 0x7fbc0c1483a0 2022-01-10T01:34:01.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c0b05f0 con 0x7fbc0c0a70c0 2022-01-10T01:34:01.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc11dd6700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbc0c0b1db0 0x7fbc0c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc11dd6700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbc0c0b1db0 0x7fbc0c0b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42944/0 (socket says 172.21.15.36:42944) 2022-01-10T01:34:01.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc11dd6700 1 -- 172.21.15.36:0/978013347 learned_addr learned my addr 172.21.15.36:0/978013347 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:01.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc115d5700 1 --2- 172.21.15.36:0/978013347 >> v2:172.21.15.59:3300/0 conn(0x7fbc0c1483a0 0x7fbc0c0b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc125d7700 1 --2- 172.21.15.36:0/978013347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc0c0a70c0 0x7fbc0c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc11dd6700 1 -- 172.21.15.36:0/978013347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc0c0a70c0 msgr2=0x7fbc0c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:01.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc11dd6700 1 --2- 172.21.15.36:0/978013347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc0c0a70c0 0x7fbc0c144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc11dd6700 1 -- 172.21.15.36:0/978013347 >> v2:172.21.15.59:3300/0 conn(0x7fbc0c1483a0 msgr2=0x7fbc0c0b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:01.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc11dd6700 1 --2- 172.21.15.36:0/978013347 >> v2:172.21.15.59:3300/0 conn(0x7fbc0c1483a0 0x7fbc0c0b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc11dd6700 1 -- 172.21.15.36:0/978013347 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c0b0890 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc11dd6700 1 --2- 172.21.15.36:0/978013347 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc0c0b1db0 0x7fbc0c0b0fd0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7fbc0c147730 tx=0x7fbbfc006eb0).ready entity=mon.0 client_cookie=bc52711b9fb8d475 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:01.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc10dd4700 1 -- 172.21.15.36:0/978013347 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbfc00e610 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc10dd4700 1 -- 172.21.15.36:0/978013347 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc000e90 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc10dd4700 1 -- 172.21.15.36:0/978013347 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbfc00e9a0 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 -- 172.21.15.36:0/978013347 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc0c0b1db0 msgr2=0x7fbc0c0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 --2- 172.21.15.36:0/978013347 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc0c0b1db0 0x7fbc0c0b0fd0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7fbc0c147730 tx=0x7fbbfc006eb0).stop 2022-01-10T01:34:01.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 -- 172.21.15.36:0/978013347 shutdown_connections 2022-01-10T01:34:01.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 --2- 172.21.15.36:0/978013347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc0c0a70c0 0x7fbc0c144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 --2- 172.21.15.36:0/978013347 >> v2:172.21.15.59:3300/0 conn(0x7fbc0c1483a0 0x7fbc0c0b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 --2- 172.21.15.36:0/978013347 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc0c0b1db0 0x7fbc0c0b0fd0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 -- 172.21.15.36:0/978013347 >> 172.21.15.36:0/978013347 conn(0x7fbc0c05f6b0 msgr2=0x7fbc0c05fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:01.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 -- 172.21.15.36:0/978013347 shutdown_connections 2022-01-10T01:34:01.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.800+0000 7fbc1403a700 1 -- 172.21.15.36:0/978013347 wait complete. 2022-01-10T01:34:01.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.804+0000 7fbc1403a700 1 Processor -- start 2022-01-10T01:34:01.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.804+0000 7fbc1403a700 1 -- start start 2022-01-10T01:34:01.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.804+0000 7fbc1403a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc0c0a70c0 0x7fbc0c14a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.804+0000 7fbc1403a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc0c0b1db0 0x7fbc0c1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.804+0000 7fbc1403a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc0c1483a0 0x7fbc0c156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.804+0000 7fbc1403a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c0ad8f0 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.804+0000 7fbc1403a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c0afa40 con 0x7fbc0c1483a0 2022-01-10T01:34:01.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.804+0000 7fbc1403a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c0ae7c0 con 0x7fbc0c0a70c0 2022-01-10T01:34:01.821 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.804+0000 7fbc115d5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc0c0b1db0 0x7fbc0c1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.804+0000 7fbc115d5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc0c0b1db0 0x7fbc0c1569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42950/0 (socket says 172.21.15.36:42950) 2022-01-10T01:34:01.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.804+0000 7fbc115d5700 1 -- 172.21.15.36:0/1797048281 learned_addr learned my addr 172.21.15.36:0/1797048281 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:01.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbc125d7700 1 --2- 172.21.15.36:0/1797048281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc0c1483a0 0x7fbc0c156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbc11dd6700 1 --2- 172.21.15.36:0/1797048281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc0c0a70c0 0x7fbc0c14a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.822 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbc115d5700 1 -- 172.21.15.36:0/1797048281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc0c0a70c0 msgr2=0x7fbc0c14a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbc115d5700 1 --2- 172.21.15.36:0/1797048281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc0c0a70c0 0x7fbc0c14a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbc115d5700 1 -- 172.21.15.36:0/1797048281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc0c1483a0 msgr2=0x7fbc0c156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbc115d5700 1 --2- 172.21.15.36:0/1797048281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc0c1483a0 0x7fbc0c156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.823 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbc115d5700 1 -- 172.21.15.36:0/1797048281 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbfc00b1e0 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbc115d5700 1 --2- 172.21.15.36:0/1797048281 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc0c0b1db0 0x7fbc0c1569b0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7fbc0800c000 tx=0x7fbc08006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:01.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbbfaffd700 1 -- 172.21.15.36:0/1797048281 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc08011750 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbbfaffd700 1 -- 172.21.15.36:0/1797048281 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc080118b0 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbc1403a700 1 -- 172.21.15.36:0/1797048281 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0c0aea60 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbbfaffd700 1 -- 172.21.15.36:0/1797048281 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc08011c10 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbc1403a700 1 -- 172.21.15.36:0/1797048281 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0c0ad510 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbc1403a700 1 -- 172.21.15.36:0/1797048281 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc0c0b0b30 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.808+0000 7fbbfaffd700 1 -- 172.21.15.36:0/1797048281 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbc08011d70 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.812+0000 7fbbfaffd700 1 --2- 172.21.15.36:0/1797048281 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbec053560 0x7fbbec055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:01.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.812+0000 7fbbfaffd700 1 -- 172.21.15.36:0/1797048281 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5600+0+0 (secure 0 0 0) 0x7fbc0806ba40 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.812+0000 7fbc11dd6700 1 --2- 172.21.15.36:0/1797048281 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbec053560 0x7fbbec055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:01.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.812+0000 7fbc11dd6700 1 --2- 172.21.15.36:0/1797048281 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbec053560 0x7fbbec055a20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fbbfc01c000 tx=0x7fbbfc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:01.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.816+0000 7fbbfaffd700 1 -- 172.21.15.36:0/1797048281 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc08042d90 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.948+0000 7fbc1403a700 1 -- 172.21.15.36:0/1797048281 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbc0c057350 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.948+0000 7fbbfaffd700 1 -- 172.21.15.36:0/1797048281 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v155) v1 ==== 84+0+143 (secure 0 0 0) 0x7fbc080463b0 con 0x7fbc0c0b1db0 2022-01-10T01:34:01.956 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:01.956 INFO:teuthology.orchestra.run.smithi036.stdout:[ 2022-01-10T01:34:01.956 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 1, 2022-01-10T01:34:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "device_health_metrics" 2022-01-10T01:34:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:01.957 INFO:teuthology.orchestra.run.smithi036.stdout: "poolnum": 2, 2022-01-10T01:34:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: "poolname": "rbd" 2022-01-10T01:34:01.958 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:01.958 INFO:teuthology.orchestra.run.smithi036.stdout:] 2022-01-10T01:34:01.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.948+0000 7fbc1403a700 1 -- 172.21.15.36:0/1797048281 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbec053560 msgr2=0x7fbbec055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.948+0000 7fbc1403a700 1 --2- 172.21.15.36:0/1797048281 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbec053560 0x7fbbec055a20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fbbfc01c000 tx=0x7fbbfc015000).stop 2022-01-10T01:34:01.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.948+0000 7fbc1403a700 1 -- 172.21.15.36:0/1797048281 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc0c0b1db0 msgr2=0x7fbc0c1569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:01.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.948+0000 7fbc1403a700 1 --2- 172.21.15.36:0/1797048281 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc0c0b1db0 0x7fbc0c1569b0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7fbc0800c000 tx=0x7fbc08006df0).stop 2022-01-10T01:34:01.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.948+0000 7fbc1403a700 1 -- 172.21.15.36:0/1797048281 shutdown_connections 2022-01-10T01:34:01.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.948+0000 7fbc1403a700 1 --2- 172.21.15.36:0/1797048281 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbbec053560 0x7fbbec055a20 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.948+0000 7fbc1403a700 1 --2- 172.21.15.36:0/1797048281 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc0c1483a0 0x7fbc0c156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.948+0000 7fbc1403a700 1 --2- 172.21.15.36:0/1797048281 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc0c0b1db0 0x7fbc0c1569b0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.948+0000 7fbc1403a700 1 --2- 172.21.15.36:0/1797048281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc0c0a70c0 0x7fbc0c14a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:01.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.948+0000 7fbc1403a700 1 -- 172.21.15.36:0/1797048281 >> 172.21.15.36:0/1797048281 conn(0x7fbc0c05f6b0 msgr2=0x7fbc0c0b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:01.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.948+0000 7fbc1403a700 1 -- 172.21.15.36:0/1797048281 shutdown_connections 2022-01-10T01:34:01.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:01.948+0000 7fbc1403a700 1 -- 172.21.15.36:0/1797048281 wait complete. 2022-01-10T01:34:01.969 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-01-10T01:34:01.969 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2022-01-10T01:34:02.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.072+0000 7f795c990700 1 Processor -- start 2022-01-10T01:34:02.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f795c990700 1 -- start start 2022-01-10T01:34:02.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f795c990700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79580b4690 0x7f7958140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:02.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f795c990700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7958143b60 con 0x7f79580b4180 2022-01-10T01:34:02.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f795c990700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7958143e00 con 0x7f7958146950 2022-01-10T01:34:02.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f795c990700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7958147510 con 0x7f79580b4690 2022-01-10T01:34:02.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f794ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f79580b4180 0x7f79580b4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40752/0 (socket says 172.21.15.36:40752) 2022-01-10T01:34:02.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f794ffff700 1 -- 172.21.15.36:0/4071895926 learned_addr learned my addr 172.21.15.36:0/4071895926 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:02.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7956d9d700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79580b4690 0x7f7958140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:02.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412767641 0 0) 0x7f7958143b60 con 0x7f79580b4180 2022-01-10T01:34:02.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f793c003260 con 0x7f79580b4180 2022-01-10T01:34:02.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971577680 0 0) 0x7f7958143e00 con 0x7f7958146950 2022-01-10T01:34:02.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7958143b60 con 0x7f7958146950 2022-01-10T01:34:02.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 234264132 0 0) 0x7f793c003260 con 0x7f79580b4180 2022-01-10T01:34:02.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79580b4690 msgr2=0x7f7958140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:02.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79580b4690 0x7f7958140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:02.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 >> v1:172.21.15.59:6789/0 conn(0x7f7958146950 legacy=0x7f7958140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:02.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79580b0c90 con 0x7f79580b4180 2022-01-10T01:34:02.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f7940001660 con 0x7f79580b4180 2022-01-10T01:34:02.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 >> v1:172.21.15.36:6789/0 conn(0x7f79580b4180 legacy=0x7f79580b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:02.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793c003910 0x7f793c003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:02.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793c004500 0x7f793c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:02.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f793c004e70 0x7f793c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:02.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7958147510 con 0x7f793c004e70 2022-01-10T01:34:02.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793c00bc40 con 0x7f793c004500 2022-01-10T01:34:02.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793c00be00 con 0x7f793c003910 2022-01-10T01:34:02.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7956d9d700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79580b4690 0x7f7958140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:34:02.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f794ffff700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793c004500 0x7f793c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:02.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7956d9d700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f793c004e70 0x7f793c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:02.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f795659c700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793c003910 0x7f793c003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:02.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7956d9d700 1 -- 172.21.15.36:0/4071895926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793c003910 msgr2=0x7f793c003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:02.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7956d9d700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793c003910 0x7f793c003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:02.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7956d9d700 1 -- 172.21.15.36:0/4071895926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793c004500 msgr2=0x7f793c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:02.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7956d9d700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793c004500 0x7f793c004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:02.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f7956d9d700 1 -- 172.21.15.36:0/4071895926 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c003260 con 0x7f793c004e70 2022-01-10T01:34:02.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f795659c700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f793c003910 0x7f793c003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:34:02.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.076+0000 7f794ffff700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f793c004500 0x7f793c004980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:34:02.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.080+0000 7f7956d9d700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f793c004e70 0x7f793c00b750 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f7950000b60 tx=0x7f79500091d0).ready entity=mon.0 client_cookie=3a9b7ced01e022ec server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:02.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.080+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7950009700 con 0x7f793c004e70 2022-01-10T01:34:02.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.080+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795000e900 con 0x7f793c004e70 2022-01-10T01:34:02.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.080+0000 7f7955d9b700 1 -- 172.21.15.36:0/4071895926 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f795000ec60 con 0x7f793c004e70 2022-01-10T01:34:02.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.080+0000 7f795c990700 1 -- 172.21.15.36:0/4071895926 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f793c004e70 msgr2=0x7f793c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:02.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.080+0000 7f795c990700 1 --2- 172.21.15.36:0/4071895926 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f793c004e70 0x7f793c00b750 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f7950000b60 tx=0x7f79500091d0).stop 2022-01-10T01:34:02.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.080+0000 7f7956d9d700 1 -- 172.21.15.36:0/4071895926 reap_dead start 2022-01-10T01:34:02.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.080+0000 7f795c990700 1 -- 172.21.15.36:0/4071895926 shutdown_connections 2022-01-10T01:34:02.101 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.080+0000 7f795c990700 1 -- 172.21.15.36:0/4071895926 >> 172.21.15.36:0/4071895926 conn(0x7f795805c490 msgr2=0x7f795805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:02.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.080+0000 7f795c990700 1 -- 172.21.15.36:0/4071895926 shutdown_connections 2022-01-10T01:34:02.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.080+0000 7f795c990700 1 -- 172.21.15.36:0/4071895926 wait complete. 2022-01-10T01:34:02.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.080+0000 7f795c990700 1 Processor -- start 2022-01-10T01:34:02.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.080+0000 7f795c990700 1 -- start start 2022-01-10T01:34:02.102 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.080+0000 7f795c990700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79580b86a0 0x7f79580b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:02.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795c990700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79581562d0 0x7f7958152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:02.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795c990700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795814f750 0x7f795814fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:02.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795c990700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79580b0180 con 0x7f79580b86a0 2022-01-10T01:34:02.103 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795c990700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79580ae4c0 con 0x7f795814f750 2022-01-10T01:34:02.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795c990700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79580ae090 con 0x7f79581562d0 2022-01-10T01:34:02.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79580b86a0 0x7f79580b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:02.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795659c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79580b86a0 0x7f79580b8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42968/0 (socket says 172.21.15.36:42968) 2022-01-10T01:34:02.104 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795659c700 1 -- 172.21.15.36:0/3909785880 learned_addr learned my addr 172.21.15.36:0/3909785880 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:02.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f794ffff700 1 --2- 172.21.15.36:0/3909785880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79581562d0 0x7f7958152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:02.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f7956d9d700 1 --2- 172.21.15.36:0/3909785880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795814f750 0x7f795814fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:02.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795659c700 1 -- 172.21.15.36:0/3909785880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79581562d0 msgr2=0x7f7958152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:02.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795659c700 1 --2- 172.21.15.36:0/3909785880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79581562d0 0x7f7958152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:02.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795659c700 1 -- 172.21.15.36:0/3909785880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795814f750 msgr2=0x7f795814fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:02.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795659c700 1 --2- 172.21.15.36:0/3909785880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795814f750 0x7f795814fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:02.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795659c700 1 -- 172.21.15.36:0/3909785880 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79581500c0 con 0x7f79580b86a0 2022-01-10T01:34:02.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795659c700 1 --2- 172.21.15.36:0/3909785880 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79580b86a0 0x7f79580b8a80 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f79580ae8f0 tx=0x7f79480079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:02.106 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f794f7fe700 1 -- 172.21.15.36:0/3909785880 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f794800f660 con 0x7f79580b86a0 2022-01-10T01:34:02.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f794f7fe700 1 -- 172.21.15.36:0/3909785880 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794800f7c0 con 0x7f79580b86a0 2022-01-10T01:34:02.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795c990700 1 -- 172.21.15.36:0/3909785880 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7958156750 con 0x7f79580b86a0 2022-01-10T01:34:02.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f794f7fe700 1 -- 172.21.15.36:0/3909785880 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f794800fb20 con 0x7f79580b86a0 2022-01-10T01:34:02.107 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795c990700 1 -- 172.21.15.36:0/3909785880 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79580b03b0 con 0x7f79580b86a0 2022-01-10T01:34:02.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f795c990700 1 -- 172.21.15.36:0/3909785880 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7958152ab0 con 0x7f79580b86a0 2022-01-10T01:34:02.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.084+0000 7f794f7fe700 1 -- 172.21.15.36:0/3909785880 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f794801a030 con 0x7f79580b86a0 2022-01-10T01:34:02.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.088+0000 7f794f7fe700 1 --2- 172.21.15.36:0/3909785880 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79300536b0 0x7f7930055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:02.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.088+0000 7f794f7fe700 1 -- 172.21.15.36:0/3909785880 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5600+0+0 (secure 0 0 0) 0x7f794806b640 con 0x7f79580b86a0 2022-01-10T01:34:02.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.088+0000 7f794ffff700 1 --2- 172.21.15.36:0/3909785880 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79300536b0 0x7f7930055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:02.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.092+0000 7f794ffff700 1 --2- 172.21.15.36:0/3909785880 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79300536b0 0x7f7930055b70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f7940005000 tx=0x7f7958060cd0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:02.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.092+0000 7f794f7fe700 1 -- 172.21.15.36:0/3909785880 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7948042880 con 0x7f79580b86a0 2022-01-10T01:34:02.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:02.220+0000 7f795c990700 1 -- 172.21.15.36:0/3909785880 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f79580ae200 con 0x7f79580b86a0 2022-01-10T01:34:02.277 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:34:02.280 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:34:02.282 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:34:02.285 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:34:03.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.136+0000 7f794f7fe700 1 -- 172.21.15.36:0/3909785880 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v156) v1 ==== 133+0+0 (secure 0 0 0) 0x7f79580ae200 con 0x7f79580b86a0 2022-01-10T01:34:03.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.140+0000 7f795c990700 1 -- 172.21.15.36:0/3909785880 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79300536b0 msgr2=0x7f7930055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:03.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.140+0000 7f795c990700 1 --2- 172.21.15.36:0/3909785880 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79300536b0 0x7f7930055b70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f7940005000 tx=0x7f7958060cd0).stop 2022-01-10T01:34:03.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.140+0000 7f795c990700 1 -- 172.21.15.36:0/3909785880 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79580b86a0 msgr2=0x7f79580b8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:03.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.140+0000 7f795c990700 1 --2- 172.21.15.36:0/3909785880 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79580b86a0 0x7f79580b8a80 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f79580ae8f0 tx=0x7f79480079e0).stop 2022-01-10T01:34:03.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.140+0000 7f795c990700 1 -- 172.21.15.36:0/3909785880 shutdown_connections 2022-01-10T01:34:03.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.140+0000 7f795c990700 1 --2- 172.21.15.36:0/3909785880 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f79300536b0 0x7f7930055b70 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:03.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.140+0000 7f795c990700 1 --2- 172.21.15.36:0/3909785880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795814f750 0x7f795814fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:03.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.140+0000 7f795c990700 1 --2- 172.21.15.36:0/3909785880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79581562d0 0x7f7958152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:03.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.140+0000 7f795c990700 1 --2- 172.21.15.36:0/3909785880 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f79580b86a0 0x7f79580b8a80 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:03.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.140+0000 7f795c990700 1 -- 172.21.15.36:0/3909785880 >> 172.21.15.36:0/3909785880 conn(0x7f795805c490 msgr2=0x7f795813de10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:03.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.140+0000 7f795c990700 1 -- 172.21.15.36:0/3909785880 shutdown_connections 2022-01-10T01:34:03.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.140+0000 7f795c990700 1 -- 172.21.15.36:0/3909785880 wait complete. 2022-01-10T01:34:03.151 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' created 2022-01-10T01:34:03.161 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 2022-01-10T01:34:03.268 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.260+0000 7f2d9759e700 1 Processor -- start 2022-01-10T01:34:03.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.260+0000 7f2d9759e700 1 -- start start 2022-01-10T01:34:03.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.260+0000 7f2d9759e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2d980a9190 0x7f2d98146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:03.271 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.260+0000 7f2d9759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d980b0b80 0x7f2d98146a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:03.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.260+0000 7f2d9759e700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d980b1140 con 0x7f2d980b03d0 2022-01-10T01:34:03.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.260+0000 7f2d9759e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d980a9570 con 0x7f2d980a9190 2022-01-10T01:34:03.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.260+0000 7f2d9759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d980b1370 con 0x7f2d980b0b80 2022-01-10T01:34:03.272 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9659c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2d980a9190 0x7f2d98146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:03.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d96d9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f2d980b03d0 0x7f2d981401c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40772/0 (socket says 172.21.15.36:40772) 2022-01-10T01:34:03.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d96d9d700 1 -- 172.21.15.36:0/4258428231 learned_addr learned my addr 172.21.15.36:0/4258428231 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:03.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d95d9b700 1 --2- 172.21.15.36:0/4258428231 >> v2:172.21.15.59:3300/0 conn(0x7f2d980b0b80 0x7f2d98146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:03.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9559a700 1 -- 172.21.15.36:0/4258428231 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685871885 0 0) 0x7f2d980b1140 con 0x7f2d980b03d0 2022-01-10T01:34:03.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9559a700 1 -- 172.21.15.36:0/4258428231 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d78003260 con 0x7f2d980b03d0 2022-01-10T01:34:03.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d95d9b700 1 -- 172.21.15.36:0/4258428231 >> v2:172.21.15.36:3300/0 conn(0x7f2d980a9190 msgr2=0x7f2d98146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:03.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d95d9b700 1 --2- 172.21.15.36:0/4258428231 >> v2:172.21.15.36:3300/0 conn(0x7f2d980a9190 0x7f2d98146550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:03.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d95d9b700 1 -- 172.21.15.36:0/4258428231 >> v1:172.21.15.36:6789/0 conn(0x7f2d980b03d0 legacy=0x7f2d981401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:03.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d95d9b700 1 -- 172.21.15.36:0/4258428231 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d980b1610 con 0x7f2d980b0b80 2022-01-10T01:34:03.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9659c700 1 --2- 172.21.15.36:0/4258428231 >> v2:172.21.15.36:3300/0 conn(0x7f2d980a9190 0x7f2d98146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:34:03.277 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d95d9b700 1 --2- 172.21.15.36:0/4258428231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d980b0b80 0x7f2d98146a40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f2d88002f70 tx=0x7f2d88006df0).ready entity=mon.1 client_cookie=440d672487a8ca74 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:03.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9559a700 1 -- 172.21.15.36:0/4258428231 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d8800d4f0 con 0x7f2d980b0b80 2022-01-10T01:34:03.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9559a700 1 -- 172.21.15.36:0/4258428231 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d88000e90 con 0x7f2d980b0b80 2022-01-10T01:34:03.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9559a700 1 -- 172.21.15.36:0/4258428231 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d8800d840 con 0x7f2d980b0b80 2022-01-10T01:34:03.282 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9759e700 1 -- 172.21.15.36:0/4258428231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d980b0b80 msgr2=0x7f2d98146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:03.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9759e700 1 --2- 172.21.15.36:0/4258428231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d980b0b80 0x7f2d98146a40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f2d88002f70 tx=0x7f2d88006df0).stop 2022-01-10T01:34:03.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9759e700 1 -- 172.21.15.36:0/4258428231 shutdown_connections 2022-01-10T01:34:03.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9759e700 1 --2- 172.21.15.36:0/4258428231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d980b0b80 0x7f2d98146a40 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:03.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9759e700 1 --2- 172.21.15.36:0/4258428231 >> v2:172.21.15.36:3300/0 conn(0x7f2d980a9190 0x7f2d98146550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:03.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9759e700 1 -- 172.21.15.36:0/4258428231 >> 172.21.15.36:0/4258428231 conn(0x7f2d98061140 msgr2=0x7f2d98062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:03.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9759e700 1 -- 172.21.15.36:0/4258428231 shutdown_connections 2022-01-10T01:34:03.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.264+0000 7f2d9759e700 1 -- 172.21.15.36:0/4258428231 wait complete. 2022-01-10T01:34:03.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.268+0000 7f2d9759e700 1 Processor -- start 2022-01-10T01:34:03.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.268+0000 7f2d9759e700 1 -- start start 2022-01-10T01:34:03.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.268+0000 7f2d9759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d980a9190 0x7f2d981455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:03.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.268+0000 7f2d9759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2d980b03d0 0x7f2d98155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:03.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.268+0000 7f2d9759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d980b0b80 0x7f2d98156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:03.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.268+0000 7f2d9759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980ab100 con 0x7f2d980b03d0 2022-01-10T01:34:03.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.268+0000 7f2d9759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d98152330 con 0x7f2d980b0b80 2022-01-10T01:34:03.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.268+0000 7f2d9759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d980ab330 con 0x7f2d980a9190 2022-01-10T01:34:03.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.268+0000 7f2d95d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2d980b03d0 0x7f2d98155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:03.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.268+0000 7f2d95d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2d980b03d0 0x7f2d98155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:42982/0 (socket says 172.21.15.36:42982) 2022-01-10T01:34:03.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.268+0000 7f2d95d9b700 1 -- 172.21.15.36:0/3187591174 learned_addr learned my addr 172.21.15.36:0/3187591174 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:03.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.268+0000 7f2d9659c700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d980a9190 0x7f2d981455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:03.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.268+0000 7f2d96d9d700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d980b0b80 0x7f2d98156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:03.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.272+0000 7f2d95d9b700 1 -- 172.21.15.36:0/3187591174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d980a9190 msgr2=0x7f2d981455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:03.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.272+0000 7f2d95d9b700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d980a9190 0x7f2d981455a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:03.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.272+0000 7f2d95d9b700 1 -- 172.21.15.36:0/3187591174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d980b0b80 msgr2=0x7f2d98156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:03.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.272+0000 7f2d95d9b700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d980b0b80 0x7f2d98156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:03.289 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.272+0000 7f2d95d9b700 1 -- 172.21.15.36:0/3187591174 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8000b180 con 0x7f2d980b03d0 2022-01-10T01:34:03.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.272+0000 7f2d96d9d700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d980b0b80 0x7f2d98156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:34:03.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.272+0000 7f2d95d9b700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2d980b03d0 0x7f2d98155c80 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f2d88002f70 tx=0x7f2d88014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:03.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.272+0000 7f2d8f7fe700 1 -- 172.21.15.36:0/3187591174 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d88016070 con 0x7f2d980b03d0 2022-01-10T01:34:03.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.272+0000 7f2d8f7fe700 1 -- 172.21.15.36:0/3187591174 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d88013850 con 0x7f2d980b03d0 2022-01-10T01:34:03.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.272+0000 7f2d9759e700 1 -- 172.21.15.36:0/3187591174 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8800b180 con 0x7f2d980b03d0 2022-01-10T01:34:03.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.272+0000 7f2d8f7fe700 1 -- 172.21.15.36:0/3187591174 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d88013bb0 con 0x7f2d980b03d0 2022-01-10T01:34:03.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.272+0000 7f2d9759e700 1 -- 172.21.15.36:0/3187591174 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d980ac620 con 0x7f2d980b03d0 2022-01-10T01:34:03.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.272+0000 7f2d9759e700 1 -- 172.21.15.36:0/3187591174 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d98057350 con 0x7f2d980b03d0 2022-01-10T01:34:03.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.272+0000 7f2d8f7fe700 1 -- 172.21.15.36:0/3187591174 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2d88025030 con 0x7f2d980b03d0 2022-01-10T01:34:03.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.276+0000 7f2d8f7fe700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2d7c053590 0x7f2d7c055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:03.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.276+0000 7f2d8f7fe700 1 -- 172.21.15.36:0/3187591174 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5954+0+0 (secure 0 0 0) 0x7f2d8806c5e0 con 0x7f2d980b03d0 2022-01-10T01:34:03.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.276+0000 7f2d9659c700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2d7c053590 0x7f2d7c055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:03.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.276+0000 7f2d9659c700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2d7c053590 0x7f2d7c055a50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f2d8000b000 tx=0x7f2d80006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:03.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.284+0000 7f2d8f7fe700 1 -- 172.21.15.36:0/3187591174 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2d880437c0 con 0x7f2d980b03d0 2022-01-10T01:34:03.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:03.412+0000 7f2d9759e700 1 -- 172.21.15.36:0/3187591174 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f2d98147430 con 0x7f2d980b03d0 2022-01-10T01:34:04.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.140+0000 7f2d8f7fe700 1 -- 172.21.15.36:0/3187591174 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v157) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2d88023020 con 0x7f2d980b03d0 2022-01-10T01:34:04.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.152+0000 7f2d9759e700 1 -- 172.21.15.36:0/3187591174 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2d7c053590 msgr2=0x7f2d7c055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.152+0000 7f2d9759e700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2d7c053590 0x7f2d7c055a50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f2d8000b000 tx=0x7f2d80006df0).stop 2022-01-10T01:34:04.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.152+0000 7f2d9759e700 1 -- 172.21.15.36:0/3187591174 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2d980b03d0 msgr2=0x7f2d98155c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.161 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.152+0000 7f2d9759e700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2d980b03d0 0x7f2d98155c80 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f2d88002f70 tx=0x7f2d88014000).stop 2022-01-10T01:34:04.162 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.152+0000 7f2d9759e700 1 -- 172.21.15.36:0/3187591174 shutdown_connections 2022-01-10T01:34:04.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.152+0000 7f2d9759e700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2d7c053590 0x7f2d7c055a50 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.152+0000 7f2d9759e700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d980b0b80 0x7f2d98156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.152+0000 7f2d9759e700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2d980b03d0 0x7f2d98155c80 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.152+0000 7f2d9759e700 1 --2- 172.21.15.36:0/3187591174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d980a9190 0x7f2d981455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.152+0000 7f2d9759e700 1 -- 172.21.15.36:0/3187591174 >> 172.21.15.36:0/3187591174 conn(0x7f2d98061140 msgr2=0x7f2d9813cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:04.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.152+0000 7f2d9759e700 1 -- 172.21.15.36:0/3187591174 shutdown_connections 2022-01-10T01:34:04.164 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.152+0000 7f2d9759e700 1 -- 172.21.15.36:0/3187591174 wait complete. 2022-01-10T01:34:04.165 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' created 2022-01-10T01:34:04.175 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2022-01-10T01:34:04.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.272+0000 7f226db6d700 1 Processor -- start 2022-01-10T01:34:04.281 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.272+0000 7f226db6d700 1 -- start start 2022-01-10T01:34:04.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f226db6d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f22680b34a0 0x7f2268143d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f226db6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22680af780 0x7f2268140110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f226db6d700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22680b3880 con 0x7f22680a9f40 2022-01-10T01:34:04.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f226db6d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2268144260 con 0x7f22680b34a0 2022-01-10T01:34:04.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f226db6d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22681469b0 con 0x7f22680af780 2022-01-10T01:34:04.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f2266ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f22680a9f40 0x7f22680af070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40782/0 (socket says 172.21.15.36:40782) 2022-01-10T01:34:04.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f2266ffd700 1 -- 172.21.15.36:0/2841008958 learned_addr learned my addr 172.21.15.36:0/2841008958 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:04.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f2267fff700 1 --2- 172.21.15.36:0/2841008958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22680af780 0x7f2268140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22677fe700 1 --2- 172.21.15.36:0/2841008958 >> v2:172.21.15.59:3300/0 conn(0x7f22680b34a0 0x7f2268143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 -- 172.21.15.36:0/2841008958 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744537977 0 0) 0x7f22680b3880 con 0x7f22680a9f40 2022-01-10T01:34:04.290 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 -- 172.21.15.36:0/2841008958 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2248003260 con 0x7f22680a9f40 2022-01-10T01:34:04.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 -- 172.21.15.36:0/2841008958 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 905069535 0 0) 0x7f2248003260 con 0x7f22680a9f40 2022-01-10T01:34:04.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 -- 172.21.15.36:0/2841008958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22680af780 msgr2=0x7f2268140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:04.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 --2- 172.21.15.36:0/2841008958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22680af780 0x7f2268140110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.291 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 -- 172.21.15.36:0/2841008958 >> v2:172.21.15.59:3300/0 conn(0x7f22680b34a0 msgr2=0x7f2268143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:04.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 --2- 172.21.15.36:0/2841008958 >> v2:172.21.15.59:3300/0 conn(0x7f22680b34a0 0x7f2268143d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 -- 172.21.15.36:0/2841008958 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2268146c50 con 0x7f22680a9f40 2022-01-10T01:34:04.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 -- 172.21.15.36:0/2841008958 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7f2250001680 con 0x7f22680a9f40 2022-01-10T01:34:04.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 -- 172.21.15.36:0/2841008958 >> v1:172.21.15.36:6789/0 conn(0x7f22680a9f40 legacy=0x7f22680af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.292 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 --2- 172.21.15.36:0/2841008958 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2248003750 0x7f2248003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 --2- 172.21.15.36:0/2841008958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2248004500 0x7f2248004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 --2- 172.21.15.36:0/2841008958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22680af780 0x7f2248004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 -- 172.21.15.36:0/2841008958 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268144260 con 0x7f2248003750 2022-01-10T01:34:04.293 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 -- 172.21.15.36:0/2841008958 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22681469b0 con 0x7f2248004500 2022-01-10T01:34:04.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 -- 172.21.15.36:0/2841008958 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224800b750 con 0x7f22680af780 2022-01-10T01:34:04.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22677fe700 1 --2- 172.21.15.36:0/2841008958 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2248003750 0x7f2248003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f2266ffd700 1 --2- 172.21.15.36:0/2841008958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2248004500 0x7f2248004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f2267fff700 1 --2- 172.21.15.36:0/2841008958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22680af780 0x7f2248004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.294 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22677fe700 1 -- 172.21.15.36:0/2841008958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22680af780 msgr2=0x7f2248004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:04.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22677fe700 1 --2- 172.21.15.36:0/2841008958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22680af780 0x7f2248004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22677fe700 1 -- 172.21.15.36:0/2841008958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2248004500 msgr2=0x7f2248004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:04.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22677fe700 1 --2- 172.21.15.36:0/2841008958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2248004500 0x7f2248004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22677fe700 1 -- 172.21.15.36:0/2841008958 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248003260 con 0x7f2248003750 2022-01-10T01:34:04.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f2267fff700 1 --2- 172.21.15.36:0/2841008958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22680af780 0x7f2248004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:34:04.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22677fe700 1 --2- 172.21.15.36:0/2841008958 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2248003750 0x7f2248003b70 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f225800c000 tx=0x7f2258006df0).ready entity=mon.0 client_cookie=f2aa750b5f2dffa server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:04.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 -- 172.21.15.36:0/2841008958 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f225800e830 con 0x7f2248003750 2022-01-10T01:34:04.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 -- 172.21.15.36:0/2841008958 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225800e990 con 0x7f2248003750 2022-01-10T01:34:04.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f22667fc700 1 -- 172.21.15.36:0/2841008958 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f225800ecf0 con 0x7f2248003750 2022-01-10T01:34:04.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f226db6d700 1 -- 172.21.15.36:0/2841008958 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2248003750 msgr2=0x7f2248003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f226db6d700 1 --2- 172.21.15.36:0/2841008958 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2248003750 0x7f2248003b70 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f225800c000 tx=0x7f2258006df0).stop 2022-01-10T01:34:04.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.276+0000 7f2267fff700 1 -- 172.21.15.36:0/2841008958 reap_dead start 2022-01-10T01:34:04.297 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f226db6d700 1 -- 172.21.15.36:0/2841008958 shutdown_connections 2022-01-10T01:34:04.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f226db6d700 1 -- 172.21.15.36:0/2841008958 >> 172.21.15.36:0/2841008958 conn(0x7f22680607c0 msgr2=0x7f2268060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:04.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f226db6d700 1 -- 172.21.15.36:0/2841008958 shutdown_connections 2022-01-10T01:34:04.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f226db6d700 1 -- 172.21.15.36:0/2841008958 wait complete. 2022-01-10T01:34:04.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f226db6d700 1 Processor -- start 2022-01-10T01:34:04.298 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f226db6d700 1 -- start start 2022-01-10T01:34:04.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f226db6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22681447c0 0x7f2268156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f226db6d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22680b26a0 0x7f22681564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f226db6d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22680b2bb0 0x7f2268152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f226db6d700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268142cd0 con 0x7f22680b26a0 2022-01-10T01:34:04.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f226db6d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268144ba0 con 0x7f22680b2bb0 2022-01-10T01:34:04.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f226db6d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22681526b0 con 0x7f22681447c0 2022-01-10T01:34:04.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f2266ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22680b26a0 0x7f22681564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f22677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22681447c0 0x7f2268156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f2266ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22680b26a0 0x7f22681564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43002/0 (socket says 172.21.15.36:43002) 2022-01-10T01:34:04.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f2266ffd700 1 -- 172.21.15.36:0/3772929233 learned_addr learned my addr 172.21.15.36:0/3772929233 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:04.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f2267fff700 1 --2- 172.21.15.36:0/3772929233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22680b2bb0 0x7f2268152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f2266ffd700 1 -- 172.21.15.36:0/3772929233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22681447c0 msgr2=0x7f2268156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f2266ffd700 1 --2- 172.21.15.36:0/3772929233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22681447c0 0x7f2268156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f2266ffd700 1 -- 172.21.15.36:0/3772929233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22680b2bb0 msgr2=0x7f2268152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f2266ffd700 1 --2- 172.21.15.36:0/3772929233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22680b2bb0 0x7f2268152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f2266ffd700 1 -- 172.21.15.36:0/3772929233 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226813ebe0 con 0x7f22680b26a0 2022-01-10T01:34:04.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f2266ffd700 1 --2- 172.21.15.36:0/3772929233 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22680b26a0 0x7f22681564f0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f225000d000 tx=0x7f22680aef90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:04.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.280+0000 7f2264ff9700 1 -- 172.21.15.36:0/3772929233 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2250011780 con 0x7f22680b26a0 2022-01-10T01:34:04.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.284+0000 7f2264ff9700 1 -- 172.21.15.36:0/3772929233 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22500118e0 con 0x7f22680b26a0 2022-01-10T01:34:04.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.284+0000 7f2264ff9700 1 -- 172.21.15.36:0/3772929233 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2250011c40 con 0x7f22680b26a0 2022-01-10T01:34:04.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.284+0000 7f226db6d700 1 -- 172.21.15.36:0/3772929233 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226813ee80 con 0x7f22680b26a0 2022-01-10T01:34:04.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.284+0000 7f226db6d700 1 -- 172.21.15.36:0/3772929233 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226813e860 con 0x7f22680b26a0 2022-01-10T01:34:04.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.284+0000 7f226db6d700 1 -- 172.21.15.36:0/3772929233 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226813f320 con 0x7f22680b26a0 2022-01-10T01:34:04.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.284+0000 7f2264ff9700 1 -- 172.21.15.36:0/3772929233 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f225001c360 con 0x7f22680b26a0 2022-01-10T01:34:04.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.284+0000 7f2264ff9700 1 --2- 172.21.15.36:0/3772929233 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f224c053590 0x7f224c055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.305 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.284+0000 7f2264ff9700 1 -- 172.21.15.36:0/3772929233 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f225006b620 con 0x7f22680b26a0 2022-01-10T01:34:04.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.284+0000 7f22677fe700 1 --2- 172.21.15.36:0/3772929233 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f224c053590 0x7f224c055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.288+0000 7f22677fe700 1 --2- 172.21.15.36:0/3772929233 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f224c053590 0x7f224c055a50 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f225801b000 tx=0x7f2258019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:04.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.292+0000 7f2264ff9700 1 -- 172.21.15.36:0/3772929233 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2250042650 con 0x7f22680b26a0 2022-01-10T01:34:04.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.456+0000 7f226db6d700 1 -- 172.21.15.36:0/3772929233 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f2268057350 con 0x7f22680b26a0 2022-01-10T01:34:04.478 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.468+0000 7f2264ff9700 1 -- 172.21.15.36:0/3772929233 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 29 and data pool 30 v78) v1 ==== 189+0+0 (secure 0 0 0) 0x7f2250045c70 con 0x7f22680b26a0 2022-01-10T01:34:04.481 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.472+0000 7f226db6d700 1 -- 172.21.15.36:0/3772929233 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f224c053590 msgr2=0x7f224c055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.472+0000 7f226db6d700 1 --2- 172.21.15.36:0/3772929233 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f224c053590 0x7f224c055a50 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f225801b000 tx=0x7f2258019000).stop 2022-01-10T01:34:04.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.472+0000 7f226db6d700 1 -- 172.21.15.36:0/3772929233 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22680b26a0 msgr2=0x7f22681564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.472+0000 7f226db6d700 1 --2- 172.21.15.36:0/3772929233 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22680b26a0 0x7f22681564f0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7f225000d000 tx=0x7f22680aef90).stop 2022-01-10T01:34:04.482 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.472+0000 7f226db6d700 1 -- 172.21.15.36:0/3772929233 shutdown_connections 2022-01-10T01:34:04.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.472+0000 7f226db6d700 1 --2- 172.21.15.36:0/3772929233 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f224c053590 0x7f224c055a50 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.472+0000 7f226db6d700 1 --2- 172.21.15.36:0/3772929233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f22680b2bb0 0x7f2268152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.472+0000 7f226db6d700 1 --2- 172.21.15.36:0/3772929233 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f22680b26a0 0x7f22681564f0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.472+0000 7f226db6d700 1 --2- 172.21.15.36:0/3772929233 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f22681447c0 0x7f2268156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.483 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.472+0000 7f226db6d700 1 -- 172.21.15.36:0/3772929233 >> 172.21.15.36:0/3772929233 conn(0x7f22680607c0 msgr2=0x7f226813a040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:04.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.472+0000 7f226db6d700 1 -- 172.21.15.36:0/3772929233 shutdown_connections 2022-01-10T01:34:04.484 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.472+0000 7f226db6d700 1 -- 172.21.15.36:0/3772929233 wait complete. 2022-01-10T01:34:04.490 INFO:teuthology.orchestra.run.smithi036.stderr:new fs with metadata pool 29 and data pool 30 2022-01-10T01:34:04.500 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:34:04.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60ab59e700 1 Processor -- start 2022-01-10T01:34:04.595 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60ab59e700 1 -- start start 2022-01-10T01:34:04.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60ab59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f60ac13d820 0x7f60ac060830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60ab59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60ac0b0cd0 0x7f60ac060d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60ab59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ac066960 con 0x7f60ac0b6380 2022-01-10T01:34:04.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60ab59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ac066c00 con 0x7f60ac13d820 2022-01-10T01:34:04.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60ab59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac066ea0 con 0x7f60ac0b0cd0 2022-01-10T01:34:04.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60a9d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f60ac13d820 0x7f60ac060830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60aad9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60ac0b0cd0 0x7f60ac060d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60aa59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f60ac0b6380 0x7f60ac13d110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:58486/0 (socket says 172.21.15.36:58486) 2022-01-10T01:34:04.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60aa59c700 1 -- 172.21.15.36:0/1371936337 learned_addr learned my addr 172.21.15.36:0/1371936337 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:04.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60a9d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f60ac13d820 0x7f60ac060830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:39652/0 (socket says 172.21.15.36:39652) 2022-01-10T01:34:04.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60a959a700 1 -- 172.21.15.36:0/1371936337 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749877434 0 0) 0x7f60ac066960 con 0x7f60ac0b6380 2022-01-10T01:34:04.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60a959a700 1 -- 172.21.15.36:0/1371936337 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6090003260 con 0x7f60ac0b6380 2022-01-10T01:34:04.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60a9d9b700 1 -- 172.21.15.36:0/1371936337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60ac0b0cd0 msgr2=0x7f60ac060d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:04.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60a9d9b700 1 --2- 172.21.15.36:0/1371936337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60ac0b0cd0 0x7f60ac060d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60a9d9b700 1 -- 172.21.15.36:0/1371936337 >> v1:172.21.15.59:6789/0 conn(0x7f60ac0b6380 legacy=0x7f60ac13d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60a9d9b700 1 -- 172.21.15.36:0/1371936337 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac067140 con 0x7f60ac13d820 2022-01-10T01:34:04.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60a9d9b700 1 --2- 172.21.15.36:0/1371936337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ac13d820 0x7f60ac060830 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f6094002f70 tx=0x7f6094006df0).ready entity=mon.1 client_cookie=3db65535244fc491 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:04.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60a959a700 1 -- 172.21.15.36:0/1371936337 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609400d4a0 con 0x7f60ac13d820 2022-01-10T01:34:04.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60a959a700 1 -- 172.21.15.36:0/1371936337 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6094000e90 con 0x7f60ac13d820 2022-01-10T01:34:04.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60a959a700 1 -- 172.21.15.36:0/1371936337 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609400d7f0 con 0x7f60ac13d820 2022-01-10T01:34:04.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60ab59e700 1 -- 172.21.15.36:0/1371936337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ac13d820 msgr2=0x7f60ac060830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60ab59e700 1 --2- 172.21.15.36:0/1371936337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ac13d820 0x7f60ac060830 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f6094002f70 tx=0x7f6094006df0).stop 2022-01-10T01:34:04.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60ab59e700 1 -- 172.21.15.36:0/1371936337 shutdown_connections 2022-01-10T01:34:04.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60ab59e700 1 --2- 172.21.15.36:0/1371936337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60ac0b0cd0 0x7f60ac060d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60ab59e700 1 --2- 172.21.15.36:0/1371936337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ac13d820 0x7f60ac060830 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60ab59e700 1 -- 172.21.15.36:0/1371936337 >> 172.21.15.36:0/1371936337 conn(0x7f60ac063670 msgr2=0x7f60ac063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:04.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.588+0000 7f60ab59e700 1 -- 172.21.15.36:0/1371936337 shutdown_connections 2022-01-10T01:34:04.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60ab59e700 1 -- 172.21.15.36:0/1371936337 wait complete. 2022-01-10T01:34:04.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60ab59e700 1 Processor -- start 2022-01-10T01:34:04.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60ab59e700 1 -- start start 2022-01-10T01:34:04.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60ab59e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60ac0b0cd0 0x7f60ac0ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60ab59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ac0b6380 0x7f60ac0ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60ab59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60ac13d820 0x7f60ac0aa240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60ab59e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0ab920 con 0x7f60ac0b0cd0 2022-01-10T01:34:04.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60ab59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac0ae0d0 con 0x7f60ac0b6380 2022-01-10T01:34:04.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60ab59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac1400d0 con 0x7f60ac13d820 2022-01-10T01:34:04.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60aa59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60ac0b0cd0 0x7f60ac0ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60aa59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60ac0b0cd0 0x7f60ac0ac1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43020/0 (socket says 172.21.15.36:43020) 2022-01-10T01:34:04.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60aa59c700 1 -- 172.21.15.36:0/2564854319 learned_addr learned my addr 172.21.15.36:0/2564854319 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:04.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60a9d9b700 1 --2- 172.21.15.36:0/2564854319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ac0b6380 0x7f60ac0ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60aad9d700 1 --2- 172.21.15.36:0/2564854319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60ac13d820 0x7f60ac0aa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60aa59c700 1 -- 172.21.15.36:0/2564854319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60ac13d820 msgr2=0x7f60ac0aa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60aa59c700 1 --2- 172.21.15.36:0/2564854319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60ac13d820 0x7f60ac0aa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.612 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60aa59c700 1 -- 172.21.15.36:0/2564854319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ac0b6380 msgr2=0x7f60ac0ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60aa59c700 1 --2- 172.21.15.36:0/2564854319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ac0b6380 0x7f60ac0ac9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60aa59c700 1 -- 172.21.15.36:0/2564854319 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609400b180 con 0x7f60ac0b0cd0 2022-01-10T01:34:04.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60aa59c700 1 --2- 172.21.15.36:0/2564854319 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60ac0b0cd0 0x7f60ac0ac1e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f60ac0ae8b0 tx=0x7f609c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:04.613 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60a37fe700 1 -- 172.21.15.36:0/2564854319 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609c005ba0 con 0x7f60ac0b0cd0 2022-01-10T01:34:04.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60a37fe700 1 -- 172.21.15.36:0/2564854319 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c005d00 con 0x7f60ac0b0cd0 2022-01-10T01:34:04.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60a37fe700 1 -- 172.21.15.36:0/2564854319 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f609c004a90 con 0x7f60ac0b0cd0 2022-01-10T01:34:04.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60ab59e700 1 -- 172.21.15.36:0/2564854319 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60ac0ae340 con 0x7f60ac0b0cd0 2022-01-10T01:34:04.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.592+0000 7f60ab59e700 1 -- 172.21.15.36:0/2564854319 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac14d230 con 0x7f60ac0b0cd0 2022-01-10T01:34:04.614 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.596+0000 7f60ab59e700 1 -- 172.21.15.36:0/2564854319 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ac0ad050 con 0x7f60ac0b0cd0 2022-01-10T01:34:04.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.596+0000 7f60a37fe700 1 -- 172.21.15.36:0/2564854319 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f609c01b070 con 0x7f60ac0b0cd0 2022-01-10T01:34:04.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.596+0000 7f60a37fe700 1 --2- 172.21.15.36:0/2564854319 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60840534d0 0x7f6084055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.596+0000 7f60a37fe700 1 -- 172.21.15.36:0/2564854319 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f609c06b340 con 0x7f60ac0b0cd0 2022-01-10T01:34:04.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.596+0000 7f60a9d9b700 1 --2- 172.21.15.36:0/2564854319 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60840534d0 0x7f6084055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.596+0000 7f60a9d9b700 1 --2- 172.21.15.36:0/2564854319 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60840534d0 0x7f6084055990 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f609401a000 tx=0x7f6094014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:04.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.600+0000 7f60a37fe700 1 -- 172.21.15.36:0/2564854319 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f609c042350 con 0x7f60ac0b0cd0 2022-01-10T01:34:04.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.728+0000 7f60ab59e700 1 -- 172.21.15.36:0/2564854319 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60ac057350 con 0x7f60ac0b0cd0 2022-01-10T01:34:04.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.728+0000 7f60a37fe700 1 -- 172.21.15.36:0/2564854319 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f609c045970 con 0x7f60ac0b0cd0 2022-01-10T01:34:04.738 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:04.739 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":158,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:34:04.464648+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:34:02.282468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2022-01-10T01:34:03.465498+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:34:04.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.732+0000 7f60ab59e700 1 -- 172.21.15.36:0/2564854319 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60840534d0 msgr2=0x7f6084055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.732+0000 7f60ab59e700 1 --2- 172.21.15.36:0/2564854319 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60840534d0 0x7f6084055990 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f609401a000 tx=0x7f6094014000).stop 2022-01-10T01:34:04.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.732+0000 7f60ab59e700 1 -- 172.21.15.36:0/2564854319 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60ac0b0cd0 msgr2=0x7f60ac0ac1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.732+0000 7f60ab59e700 1 --2- 172.21.15.36:0/2564854319 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60ac0b0cd0 0x7f60ac0ac1e0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7f60ac0ae8b0 tx=0x7f609c007e00).stop 2022-01-10T01:34:04.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.732+0000 7f60ab59e700 1 -- 172.21.15.36:0/2564854319 shutdown_connections 2022-01-10T01:34:04.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.732+0000 7f60ab59e700 1 --2- 172.21.15.36:0/2564854319 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60840534d0 0x7f6084055990 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.732+0000 7f60ab59e700 1 --2- 172.21.15.36:0/2564854319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60ac13d820 0x7f60ac0aa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.732+0000 7f60ab59e700 1 --2- 172.21.15.36:0/2564854319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60ac0b6380 0x7f60ac0ac9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.732+0000 7f60ab59e700 1 --2- 172.21.15.36:0/2564854319 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f60ac0b0cd0 0x7f60ac0ac1e0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.732+0000 7f60ab59e700 1 -- 172.21.15.36:0/2564854319 >> 172.21.15.36:0/2564854319 conn(0x7f60ac063670 msgr2=0x7f60ac0b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:04.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.732+0000 7f60ab59e700 1 -- 172.21.15.36:0/2564854319 shutdown_connections 2022-01-10T01:34:04.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.732+0000 7f60ab59e700 1 -- 172.21.15.36:0/2564854319 wait complete. 2022-01-10T01:34:04.752 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:34:04.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f894a59b700 1 Processor -- start 2022-01-10T01:34:04.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f894a59b700 1 -- start start 2022-01-10T01:34:04.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f894a59b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89440b36e0 0x7f89440b3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f894a59b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f89440af070 0x7f8944144480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f894a59b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89440aa290 con 0x7f89440a9eb0 2022-01-10T01:34:04.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f894a59b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89440ae300 con 0x7f89440af070 2022-01-10T01:34:04.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f894a59b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8944148170 con 0x7f89440b36e0 2022-01-10T01:34:04.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f8948b38700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f89440af070 0x7f8944144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f8943fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f89440a9eb0 0x7f894414b560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40822/0 (socket says 172.21.15.36:40822) 2022-01-10T01:34:04.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f8943fff700 1 -- 172.21.15.36:0/1503948221 learned_addr learned my addr 172.21.15.36:0/1503948221 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:04.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f89437fe700 1 --2- 172.21.15.36:0/1503948221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89440b36e0 0x7f89440b3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f8948b38700 1 -- 172.21.15.36:0/1503948221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89440b36e0 msgr2=0x7f89440b3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:04.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f8942ffd700 1 -- 172.21.15.36:0/1503948221 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016743403 0 0) 0x7f89440aa290 con 0x7f89440a9eb0 2022-01-10T01:34:04.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f8948b38700 1 --2- 172.21.15.36:0/1503948221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89440b36e0 0x7f89440b3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f8948b38700 1 -- 172.21.15.36:0/1503948221 >> v1:172.21.15.36:6789/0 conn(0x7f89440a9eb0 legacy=0x7f894414b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f8948b38700 1 -- 172.21.15.36:0/1503948221 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8944148410 con 0x7f89440af070 2022-01-10T01:34:04.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f8948b38700 1 --2- 172.21.15.36:0/1503948221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89440af070 0x7f8944144480 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f8934002f70 tx=0x7f8934006df0).ready entity=mon.0 client_cookie=482cb00bbb035ec server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:04.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f8942ffd700 1 -- 172.21.15.36:0/1503948221 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f893400d570 con 0x7f89440af070 2022-01-10T01:34:04.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f8942ffd700 1 -- 172.21.15.36:0/1503948221 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8934000e90 con 0x7f89440af070 2022-01-10T01:34:04.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f8942ffd700 1 -- 172.21.15.36:0/1503948221 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f893400d8c0 con 0x7f89440af070 2022-01-10T01:34:04.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f894a59b700 1 -- 172.21.15.36:0/1503948221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89440af070 msgr2=0x7f8944144480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f894a59b700 1 --2- 172.21.15.36:0/1503948221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89440af070 0x7f8944144480 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7f8934002f70 tx=0x7f8934006df0).stop 2022-01-10T01:34:04.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f894a59b700 1 -- 172.21.15.36:0/1503948221 shutdown_connections 2022-01-10T01:34:04.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f894a59b700 1 --2- 172.21.15.36:0/1503948221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89440af070 0x7f8944144480 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f894a59b700 1 --2- 172.21.15.36:0/1503948221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89440b36e0 0x7f89440b3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.852+0000 7f894a59b700 1 -- 172.21.15.36:0/1503948221 >> 172.21.15.36:0/1503948221 conn(0x7f89440607c0 msgr2=0x7f8944060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:04.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.856+0000 7f894a59b700 1 -- 172.21.15.36:0/1503948221 shutdown_connections 2022-01-10T01:34:04.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.856+0000 7f894a59b700 1 -- 172.21.15.36:0/1503948221 wait complete. 2022-01-10T01:34:04.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.856+0000 7f894a59b700 1 Processor -- start 2022-01-10T01:34:04.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.856+0000 7f894a59b700 1 -- start start 2022-01-10T01:34:04.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f894a59b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89440a9eb0 0x7f894414d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f894a59b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89440af070 0x7f8944145960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f894a59b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89440b36e0 0x7f8944138e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f894a59b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894413b060 con 0x7f89440af070 2022-01-10T01:34:04.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f894a59b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894413b2d0 con 0x7f89440a9eb0 2022-01-10T01:34:04.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f894a59b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894413a220 con 0x7f89440b36e0 2022-01-10T01:34:04.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f89437fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89440af070 0x7f8944145960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f89437fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89440af070 0x7f8944145960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43036/0 (socket says 172.21.15.36:43036) 2022-01-10T01:34:04.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f89437fe700 1 -- 172.21.15.36:0/1678674000 learned_addr learned my addr 172.21.15.36:0/1678674000 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:04.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f8943fff700 1 --2- 172.21.15.36:0/1678674000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89440a9eb0 0x7f894414d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f8948b38700 1 --2- 172.21.15.36:0/1678674000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89440b36e0 0x7f8944138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f89437fe700 1 -- 172.21.15.36:0/1678674000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89440b36e0 msgr2=0x7f8944138e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f89437fe700 1 --2- 172.21.15.36:0/1678674000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89440b36e0 0x7f8944138e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f89437fe700 1 -- 172.21.15.36:0/1678674000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89440a9eb0 msgr2=0x7f894414d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:04.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f89437fe700 1 --2- 172.21.15.36:0/1678674000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89440a9eb0 0x7f894414d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:04.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f89437fe700 1 -- 172.21.15.36:0/1678674000 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893400b180 con 0x7f89440af070 2022-01-10T01:34:04.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f89437fe700 1 --2- 172.21.15.36:0/1678674000 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89440af070 0x7f8944145960 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f893c00c000 tx=0x7f893c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:04.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f89417fa700 1 -- 172.21.15.36:0/1678674000 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f893c012600 con 0x7f89440af070 2022-01-10T01:34:04.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f89417fa700 1 -- 172.21.15.36:0/1678674000 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c012760 con 0x7f89440af070 2022-01-10T01:34:04.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f894a59b700 1 -- 172.21.15.36:0/1678674000 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894413e2f0 con 0x7f89440af070 2022-01-10T01:34:04.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f89417fa700 1 -- 172.21.15.36:0/1678674000 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f893c012ac0 con 0x7f89440af070 2022-01-10T01:34:04.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f894a59b700 1 -- 172.21.15.36:0/1678674000 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89441394c0 con 0x7f89440af070 2022-01-10T01:34:04.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.860+0000 7f894a59b700 1 -- 172.21.15.36:0/1678674000 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894413a420 con 0x7f89440af070 2022-01-10T01:34:04.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.864+0000 7f89417fa700 1 -- 172.21.15.36:0/1678674000 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f893c022070 con 0x7f89440af070 2022-01-10T01:34:04.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.864+0000 7f89417fa700 1 --2- 172.21.15.36:0/1678674000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8928053620 0x7f8928055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:04.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.864+0000 7f89417fa700 1 -- 172.21.15.36:0/1678674000 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f893c06c160 con 0x7f89440af070 2022-01-10T01:34:04.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.864+0000 7f8943fff700 1 --2- 172.21.15.36:0/1678674000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8928053620 0x7f8928055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:04.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.864+0000 7f8943fff700 1 --2- 172.21.15.36:0/1678674000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8928053620 0x7f8928055ae0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f892c00d000 tx=0x7f892c007a20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:04.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:04.868+0000 7f89417fa700 1 -- 172.21.15.36:0/1678674000 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f893c042fe0 con 0x7f89440af070 2022-01-10T01:34:05.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.000+0000 7f894a59b700 1 -- 172.21.15.36:0/1678674000 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f894414bd60 con 0x7f89440af070 2022-01-10T01:34:05.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.000+0000 7f89417fa700 1 -- 172.21.15.36:0/1678674000 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+16298 (secure 0 0 0) 0x7f893c046600 con 0x7f89440af070 2022-01-10T01:34:05.009 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:05.009 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":158,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:34:04.464648+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:34:02.282468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2022-01-10T01:34:03.465498+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:34:05.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.004+0000 7f894a59b700 1 -- 172.21.15.36:0/1678674000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8928053620 msgr2=0x7f8928055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.004+0000 7f894a59b700 1 --2- 172.21.15.36:0/1678674000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8928053620 0x7f8928055ae0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f892c00d000 tx=0x7f892c007a20).stop 2022-01-10T01:34:05.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.004+0000 7f894a59b700 1 -- 172.21.15.36:0/1678674000 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89440af070 msgr2=0x7f8944145960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.004+0000 7f894a59b700 1 --2- 172.21.15.36:0/1678674000 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89440af070 0x7f8944145960 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f893c00c000 tx=0x7f893c0091d0).stop 2022-01-10T01:34:05.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.004+0000 7f894a59b700 1 -- 172.21.15.36:0/1678674000 shutdown_connections 2022-01-10T01:34:05.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.004+0000 7f894a59b700 1 --2- 172.21.15.36:0/1678674000 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8928053620 0x7f8928055ae0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.004+0000 7f894a59b700 1 --2- 172.21.15.36:0/1678674000 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89440b36e0 0x7f8944138e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.004+0000 7f894a59b700 1 --2- 172.21.15.36:0/1678674000 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f89440af070 0x7f8944145960 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.004+0000 7f894a59b700 1 --2- 172.21.15.36:0/1678674000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89440a9eb0 0x7f894414d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.004+0000 7f894a59b700 1 -- 172.21.15.36:0/1678674000 >> 172.21.15.36:0/1678674000 conn(0x7f89440607c0 msgr2=0x7f89440afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:05.013 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.004+0000 7f894a59b700 1 -- 172.21.15.36:0/1678674000 shutdown_connections 2022-01-10T01:34:05.014 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.004+0000 7f894a59b700 1 -- 172.21.15.36:0/1678674000 wait complete. 2022-01-10T01:34:05.023 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-01-10T01:34:05.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f9446e59700 1 Processor -- start 2022-01-10T01:34:05.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f9446e59700 1 -- start start 2022-01-10T01:34:05.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f9446e59700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9440065420 0x7f944014c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f9446e59700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94400604e0 con 0x7f9440144440 2022-01-10T01:34:05.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f9446e59700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94400b23b0 con 0x7f9440060100 2022-01-10T01:34:05.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f9446e59700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9440065c80 con 0x7f9440065420 2022-01-10T01:34:05.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f94453f6700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9440065420 0x7f944014c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f943ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f9440144440 0x7f9440144970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40838/0 (socket says 172.21.15.36:40838) 2022-01-10T01:34:05.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f943ffff700 1 -- 172.21.15.36:0/1514335408 learned_addr learned my addr 172.21.15.36:0/1514335408 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:05.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f943f7fe700 1 -- 172.21.15.36:0/1514335408 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730482434 0 0) 0x7f94400604e0 con 0x7f9440144440 2022-01-10T01:34:05.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f943f7fe700 1 -- 172.21.15.36:0/1514335408 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f942c003260 con 0x7f9440144440 2022-01-10T01:34:05.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f94453f6700 1 -- 172.21.15.36:0/1514335408 >> v1:172.21.15.59:6789/0 conn(0x7f9440060100 legacy=0x7f9440064d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f94453f6700 1 -- 172.21.15.36:0/1514335408 >> v1:172.21.15.36:6789/0 conn(0x7f9440144440 legacy=0x7f9440144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f94453f6700 1 -- 172.21.15.36:0/1514335408 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94400b2650 con 0x7f9440065420 2022-01-10T01:34:05.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f94453f6700 1 --2- 172.21.15.36:0/1514335408 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9440065420 0x7f944014c7f0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f94380032f0 tx=0x7f94380091d0).ready entity=mon.0 client_cookie=6704ccbb3c2890f8 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:05.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.124+0000 7f943f7fe700 1 -- 172.21.15.36:0/1514335408 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f943800b6c0 con 0x7f9440065420 2022-01-10T01:34:05.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.128+0000 7f943f7fe700 1 -- 172.21.15.36:0/1514335408 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943800b820 con 0x7f9440065420 2022-01-10T01:34:05.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.128+0000 7f943f7fe700 1 -- 172.21.15.36:0/1514335408 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f943800b990 con 0x7f9440065420 2022-01-10T01:34:05.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.128+0000 7f9446e59700 1 -- 172.21.15.36:0/1514335408 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9440065420 msgr2=0x7f944014c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.128+0000 7f9446e59700 1 --2- 172.21.15.36:0/1514335408 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9440065420 0x7f944014c7f0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f94380032f0 tx=0x7f94380091d0).stop 2022-01-10T01:34:05.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.128+0000 7f9446e59700 1 -- 172.21.15.36:0/1514335408 shutdown_connections 2022-01-10T01:34:05.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.128+0000 7f9446e59700 1 --2- 172.21.15.36:0/1514335408 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9440065420 0x7f944014c7f0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.128+0000 7f9446e59700 1 -- 172.21.15.36:0/1514335408 >> 172.21.15.36:0/1514335408 conn(0x7f944005cf60 msgr2=0x7f944005f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:05.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.128+0000 7f9446e59700 1 -- 172.21.15.36:0/1514335408 shutdown_connections 2022-01-10T01:34:05.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.128+0000 7f9446e59700 1 -- 172.21.15.36:0/1514335408 wait complete. 2022-01-10T01:34:05.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.128+0000 7f9446e59700 1 Processor -- start 2022-01-10T01:34:05.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.128+0000 7f9446e59700 1 -- start start 2022-01-10T01:34:05.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f9446e59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9440060100 0x7f94400b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f9446e59700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9440065420 0x7f9440139730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f9446e59700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f944013bb30 0x7f9440139c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.145 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f9446e59700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944013c360 con 0x7f944013bb30 2022-01-10T01:34:05.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f9446e59700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944013c600 con 0x7f9440065420 2022-01-10T01:34:05.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f9446e59700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944013dda0 con 0x7f9440060100 2022-01-10T01:34:05.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f94453f6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f944013bb30 0x7f9440139c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.146 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f94453f6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f944013bb30 0x7f9440139c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43052/0 (socket says 172.21.15.36:43052) 2022-01-10T01:34:05.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f94453f6700 1 -- 172.21.15.36:0/729189177 learned_addr learned my addr 172.21.15.36:0/729189177 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:05.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f943ffff700 1 --2- 172.21.15.36:0/729189177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9440065420 0x7f9440139730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f9444bf5700 1 --2- 172.21.15.36:0/729189177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9440060100 0x7f94400b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f94453f6700 1 -- 172.21.15.36:0/729189177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9440060100 msgr2=0x7f94400b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.147 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f94453f6700 1 --2- 172.21.15.36:0/729189177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9440060100 0x7f94400b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f94453f6700 1 -- 172.21.15.36:0/729189177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9440065420 msgr2=0x7f9440139730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f94453f6700 1 --2- 172.21.15.36:0/729189177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9440065420 0x7f9440139730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f94453f6700 1 -- 172.21.15.36:0/729189177 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9438009470 con 0x7f944013bb30 2022-01-10T01:34:05.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f94453f6700 1 --2- 172.21.15.36:0/729189177 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f944013bb30 0x7f9440139c20 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f94380032f0 tx=0x7f9438016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:05.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f943dffb700 1 -- 172.21.15.36:0/729189177 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f943800b6c0 con 0x7f944013bb30 2022-01-10T01:34:05.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f943dffb700 1 -- 172.21.15.36:0/729189177 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9438021670 con 0x7f944013bb30 2022-01-10T01:34:05.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f9446e59700 1 -- 172.21.15.36:0/729189177 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f944013e040 con 0x7f944013bb30 2022-01-10T01:34:05.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f943dffb700 1 -- 172.21.15.36:0/729189177 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94380219d0 con 0x7f944013bb30 2022-01-10T01:34:05.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.132+0000 7f9446e59700 1 -- 172.21.15.36:0/729189177 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94400abef0 con 0x7f944013bb30 2022-01-10T01:34:05.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.136+0000 7f9446e59700 1 -- 172.21.15.36:0/729189177 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9440064870 con 0x7f944013bb30 2022-01-10T01:34:05.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.136+0000 7f943dffb700 1 -- 172.21.15.36:0/729189177 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f943800f070 con 0x7f944013bb30 2022-01-10T01:34:05.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.136+0000 7f943dffb700 1 --2- 172.21.15.36:0/729189177 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94200535f0 0x7f9420055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.136+0000 7f943dffb700 1 -- 172.21.15.36:0/729189177 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f943806d010 con 0x7f944013bb30 2022-01-10T01:34:05.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.136+0000 7f9444bf5700 1 --2- 172.21.15.36:0/729189177 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94200535f0 0x7f9420055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.136+0000 7f9444bf5700 1 --2- 172.21.15.36:0/729189177 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94200535f0 0x7f9420055ab0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f943000b000 tx=0x7f9430009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:05.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.140+0000 7f943dffb700 1 -- 172.21.15.36:0/729189177 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9438044020 con 0x7f944013bb30 2022-01-10T01:34:05.317 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.308+0000 7f9446e59700 1 -- 172.21.15.36:0/729189177 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9440057350 con 0x7f944013bb30 2022-01-10T01:34:05.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.476+0000 7f943dffb700 1 -- 172.21.15.36:0/729189177 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v79) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9438015070 con 0x7f944013bb30 2022-01-10T01:34:05.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.480+0000 7f9446e59700 1 -- 172.21.15.36:0/729189177 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94200535f0 msgr2=0x7f9420055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.480+0000 7f9446e59700 1 --2- 172.21.15.36:0/729189177 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94200535f0 0x7f9420055ab0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f943000b000 tx=0x7f9430009040).stop 2022-01-10T01:34:05.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.480+0000 7f9446e59700 1 -- 172.21.15.36:0/729189177 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f944013bb30 msgr2=0x7f9440139c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.480+0000 7f9446e59700 1 --2- 172.21.15.36:0/729189177 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f944013bb30 0x7f9440139c20 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7f94380032f0 tx=0x7f9438016000).stop 2022-01-10T01:34:05.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.480+0000 7f9446e59700 1 -- 172.21.15.36:0/729189177 shutdown_connections 2022-01-10T01:34:05.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.480+0000 7f9446e59700 1 --2- 172.21.15.36:0/729189177 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f94200535f0 0x7f9420055ab0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.480+0000 7f9446e59700 1 --2- 172.21.15.36:0/729189177 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f944013bb30 0x7f9440139c20 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.480+0000 7f9446e59700 1 --2- 172.21.15.36:0/729189177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9440065420 0x7f9440139730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.480+0000 7f9446e59700 1 --2- 172.21.15.36:0/729189177 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9440060100 0x7f94400b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.480+0000 7f9446e59700 1 -- 172.21.15.36:0/729189177 >> 172.21.15.36:0/729189177 conn(0x7f944005cf60 msgr2=0x7f9440143920 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:05.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.480+0000 7f9446e59700 1 -- 172.21.15.36:0/729189177 shutdown_connections 2022-01-10T01:34:05.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.480+0000 7f9446e59700 1 -- 172.21.15.36:0/729189177 wait complete. 2022-01-10T01:34:05.506 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:34:05.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.600+0000 7fe2e57e8700 1 Processor -- start 2022-01-10T01:34:05.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.600+0000 7fe2e57e8700 1 -- start start 2022-01-10T01:34:05.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.600+0000 7fe2e57e8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe2e00af2c0 0x7fe2e00af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.600+0000 7fe2e57e8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2e00ad850 0x7fe2e00a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.600+0000 7fe2e57e8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e00afda0 con 0x7fe2e00ad320 2022-01-10T01:34:05.615 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.600+0000 7fe2e57e8700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e005c610 con 0x7fe2e00af2c0 2022-01-10T01:34:05.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.600+0000 7fe2e57e8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e0140800 con 0x7fe2e00ad850 2022-01-10T01:34:05.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2dffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe2e00af2c0 0x7fe2e00af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2dffff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe2e00af2c0 0x7fe2e00af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43058/0 (socket says 172.21.15.36:43058) 2022-01-10T01:34:05.616 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2dffff700 1 -- 172.21.15.36:0/3061563611 learned_addr learned my addr 172.21.15.36:0/3061563611 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:05.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2e4fe7700 1 --2- 172.21.15.36:0/3061563611 >> v2:172.21.15.59:3300/0 conn(0x7fe2e00ad850 0x7fe2e00a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2dffff700 1 -- 172.21.15.36:0/3061563611 >> v2:172.21.15.59:3300/0 conn(0x7fe2e00ad850 msgr2=0x7fe2e00a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:05.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2dffff700 1 --2- 172.21.15.36:0/3061563611 >> v2:172.21.15.59:3300/0 conn(0x7fe2e00ad850 0x7fe2e00a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.617 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2dffff700 1 -- 172.21.15.36:0/3061563611 >> v1:172.21.15.59:6789/0 conn(0x7fe2e00ad320 legacy=0x7fe2e0143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2df7fe700 1 -- 172.21.15.36:0/3061563611 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135632458 0 0) 0x7fe2e00afda0 con 0x7fe2e00ad320 2022-01-10T01:34:05.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2dffff700 1 -- 172.21.15.36:0/3061563611 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e0143860 con 0x7fe2e00af2c0 2022-01-10T01:34:05.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2dffff700 1 --2- 172.21.15.36:0/3061563611 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e00af2c0 0x7fe2e00af6a0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7fe2e00ad770 tx=0x7fe2d0006eb0).ready entity=mon.0 client_cookie=ddf1d07465955353 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:05.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2df7fe700 1 -- 172.21.15.36:0/3061563611 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2d000d610 con 0x7fe2e00af2c0 2022-01-10T01:34:05.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2df7fe700 1 -- 172.21.15.36:0/3061563611 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d0000e90 con 0x7fe2e00af2c0 2022-01-10T01:34:05.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2df7fe700 1 -- 172.21.15.36:0/3061563611 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2d000d960 con 0x7fe2e00af2c0 2022-01-10T01:34:05.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2e57e8700 1 -- 172.21.15.36:0/3061563611 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e00af2c0 msgr2=0x7fe2e00af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2e57e8700 1 --2- 172.21.15.36:0/3061563611 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e00af2c0 0x7fe2e00af6a0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7fe2e00ad770 tx=0x7fe2d0006eb0).stop 2022-01-10T01:34:05.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2e57e8700 1 -- 172.21.15.36:0/3061563611 shutdown_connections 2022-01-10T01:34:05.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2e57e8700 1 --2- 172.21.15.36:0/3061563611 >> v2:172.21.15.59:3300/0 conn(0x7fe2e00ad850 0x7fe2e00a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2e57e8700 1 --2- 172.21.15.36:0/3061563611 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e00af2c0 0x7fe2e00af6a0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.620 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2e57e8700 1 -- 172.21.15.36:0/3061563611 >> 172.21.15.36:0/3061563611 conn(0x7fe2e0061140 msgr2=0x7fe2e0062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:05.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2e57e8700 1 -- 172.21.15.36:0/3061563611 shutdown_connections 2022-01-10T01:34:05.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.604+0000 7fe2e57e8700 1 -- 172.21.15.36:0/3061563611 wait complete. 2022-01-10T01:34:05.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2e57e8700 1 Processor -- start 2022-01-10T01:34:05.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2e57e8700 1 -- start start 2022-01-10T01:34:05.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2e57e8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e00ad320 0x7fe2e00ac050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2e57e8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e00ad850 0x7fe2e014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2e57e8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e00af2c0 0x7fe2e0146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2e57e8700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e00b6940 con 0x7fe2e00ad850 2022-01-10T01:34:05.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2e57e8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e01467f0 con 0x7fe2e00ad320 2022-01-10T01:34:05.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2e57e8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e014efc0 con 0x7fe2e00af2c0 2022-01-10T01:34:05.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2d7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e00ad850 0x7fe2e014f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2dffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e00ad320 0x7fe2e00ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2d7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e00ad850 0x7fe2e014f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43064/0 (socket says 172.21.15.36:43064) 2022-01-10T01:34:05.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2dffff700 1 --2- 172.21.15.36:0/855956559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e00ad320 0x7fe2e00ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:39696/0 (socket says 172.21.15.36:39696) 2022-01-10T01:34:05.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2d7fff700 1 -- 172.21.15.36:0/855956559 learned_addr learned my addr 172.21.15.36:0/855956559 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:05.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2e4fe7700 1 --2- 172.21.15.36:0/855956559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e00af2c0 0x7fe2e0146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2d7fff700 1 -- 172.21.15.36:0/855956559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e00af2c0 msgr2=0x7fe2e0146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2d7fff700 1 --2- 172.21.15.36:0/855956559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e00af2c0 0x7fe2e0146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2d7fff700 1 -- 172.21.15.36:0/855956559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e00ad320 msgr2=0x7fe2e00ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2d7fff700 1 --2- 172.21.15.36:0/855956559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e00ad320 0x7fe2e00ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2d7fff700 1 -- 172.21.15.36:0/855956559 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d000b1e0 con 0x7fe2e00ad850 2022-01-10T01:34:05.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2d7fff700 1 --2- 172.21.15.36:0/855956559 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e00ad850 0x7fe2e014f9a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7fe2c8000ed0 tx=0x7fe2c8007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:05.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2ddffb700 1 -- 172.21.15.36:0/855956559 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2c8012400 con 0x7fe2e00ad850 2022-01-10T01:34:05.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2ddffb700 1 -- 172.21.15.36:0/855956559 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c8012560 con 0x7fe2e00ad850 2022-01-10T01:34:05.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2e57e8700 1 -- 172.21.15.36:0/855956559 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e014f260 con 0x7fe2e00ad850 2022-01-10T01:34:05.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2ddffb700 1 -- 172.21.15.36:0/855956559 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2c80128c0 con 0x7fe2e00ad850 2022-01-10T01:34:05.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.608+0000 7fe2e57e8700 1 -- 172.21.15.36:0/855956559 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e0146c70 con 0x7fe2e00ad850 2022-01-10T01:34:05.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.612+0000 7fe2e57e8700 1 -- 172.21.15.36:0/855956559 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e0057350 con 0x7fe2e00ad850 2022-01-10T01:34:05.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.612+0000 7fe2ddffb700 1 -- 172.21.15.36:0/855956559 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe2c8019030 con 0x7fe2e00ad850 2022-01-10T01:34:05.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.612+0000 7fe2ddffb700 1 --2- 172.21.15.36:0/855956559 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe2c4053560 0x7fe2c4055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.612+0000 7fe2ddffb700 1 -- 172.21.15.36:0/855956559 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe2c806ace0 con 0x7fe2e00ad850 2022-01-10T01:34:05.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.612+0000 7fe2dffff700 1 --2- 172.21.15.36:0/855956559 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe2c4053560 0x7fe2c4055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.612+0000 7fe2dffff700 1 --2- 172.21.15.36:0/855956559 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe2c4053560 0x7fe2c4055a20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fe2d001e000 tx=0x7fe2d0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:05.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.620+0000 7fe2ddffb700 1 -- 172.21.15.36:0/855956559 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe2c8041da0 con 0x7fe2e00ad850 2022-01-10T01:34:05.795 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.788+0000 7fe2e57e8700 1 -- 172.21.15.36:0/855956559 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2e0061990 con 0x7fe2e00ad850 2022-01-10T01:34:05.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.788+0000 7fe2ddffb700 1 -- 172.21.15.36:0/855956559 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fe2c80453c0 con 0x7fe2e00ad850 2022-01-10T01:34:05.797 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:05.797 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":79,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3964890182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3964890182},{"type":"v1","addr":"172.21.15.59:6833","nonce":3964890182}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77},{"gid":8733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3716636187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3716636187},{"type":"v1","addr":"172.21.15.36:6835","nonce":3716636187}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:34:04.465028+0000","modified":"2022-01-10T01:34:05.469086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8742":{"gid":8742,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/1997308230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1997308230},{"type":"v1","addr":"172.21.15.36:6837","nonce":1997308230}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2022-01-10T01:34:05.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.792+0000 7fe2e57e8700 1 -- 172.21.15.36:0/855956559 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe2c4053560 msgr2=0x7fe2c4055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.792+0000 7fe2e57e8700 1 --2- 172.21.15.36:0/855956559 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe2c4053560 0x7fe2c4055a20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fe2d001e000 tx=0x7fe2d0015000).stop 2022-01-10T01:34:05.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.792+0000 7fe2e57e8700 1 -- 172.21.15.36:0/855956559 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e00ad850 msgr2=0x7fe2e014f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.792+0000 7fe2e57e8700 1 --2- 172.21.15.36:0/855956559 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e00ad850 0x7fe2e014f9a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7fe2c8000ed0 tx=0x7fe2c8007ac0).stop 2022-01-10T01:34:05.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.792+0000 7fe2e57e8700 1 -- 172.21.15.36:0/855956559 shutdown_connections 2022-01-10T01:34:05.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.792+0000 7fe2e57e8700 1 --2- 172.21.15.36:0/855956559 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe2c4053560 0x7fe2c4055a20 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.792+0000 7fe2e57e8700 1 --2- 172.21.15.36:0/855956559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2e00af2c0 0x7fe2e0146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.792+0000 7fe2e57e8700 1 --2- 172.21.15.36:0/855956559 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe2e00ad850 0x7fe2e014f9a0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.792+0000 7fe2e57e8700 1 --2- 172.21.15.36:0/855956559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2e00ad320 0x7fe2e00ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.792+0000 7fe2e57e8700 1 -- 172.21.15.36:0/855956559 >> 172.21.15.36:0/855956559 conn(0x7fe2e0061140 msgr2=0x7fe2e00a8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:05.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.792+0000 7fe2e57e8700 1 -- 172.21.15.36:0/855956559 shutdown_connections 2022-01-10T01:34:05.801 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.792+0000 7fe2e57e8700 1 -- 172.21.15.36:0/855956559 wait complete. 2022-01-10T01:34:05.802 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 79 2022-01-10T01:34:05.810 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:34:05.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.904+0000 7eff90aca700 1 Processor -- start 2022-01-10T01:34:05.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.904+0000 7eff90aca700 1 -- start start 2022-01-10T01:34:05.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.904+0000 7eff90aca700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7eff8c0b2580 0x7eff8c0abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.904+0000 7eff90aca700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c0add80 con 0x7eff8c0b1260 2022-01-10T01:34:05.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.904+0000 7eff90aca700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c0ae020 con 0x7eff8c0b02e0 2022-01-10T01:34:05.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.904+0000 7eff90aca700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8c0a9390 con 0x7eff8c0b2580 2022-01-10T01:34:05.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.904+0000 7eff83fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7eff8c0b1260 0x7eff8c0afbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40864/0 (socket says 172.21.15.36:40864) 2022-01-10T01:34:05.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.904+0000 7eff83fff700 1 -- 172.21.15.36:0/1840249117 learned_addr learned my addr 172.21.15.36:0/1840249117 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:05.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.904+0000 7eff8b7fe700 1 --2- 172.21.15.36:0/1840249117 >> v2:172.21.15.36:3300/0 conn(0x7eff8c0b2580 0x7eff8c0abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647494576 0 0) 0x7eff8c0add80 con 0x7eff8c0b1260 2022-01-10T01:34:05.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff6c003260 con 0x7eff8c0b1260 2022-01-10T01:34:05.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048669591 0 0) 0x7eff8c0ae020 con 0x7eff8c0b02e0 2022-01-10T01:34:05.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff8c0add80 con 0x7eff8c0b02e0 2022-01-10T01:34:05.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 846325894 0 0) 0x7eff6c003260 con 0x7eff8c0b1260 2022-01-10T01:34:05.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 >> v2:172.21.15.36:3300/0 conn(0x7eff8c0b2580 msgr2=0x7eff8c0abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:05.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 --2- 172.21.15.36:0/1840249117 >> v2:172.21.15.36:3300/0 conn(0x7eff8c0b2580 0x7eff8c0abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 >> v1:172.21.15.59:6789/0 conn(0x7eff8c0b02e0 legacy=0x7eff8c14a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 --> v1:172.21.15.36:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c0a9830 con 0x7eff8c0b1260 2022-01-10T01:34:05.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 <== mon.0 v1:172.21.15.36:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 1091229561 0 0) 0x7eff74001660 con 0x7eff8c0b1260 2022-01-10T01:34:05.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8b7fe700 1 --2- 172.21.15.36:0/1840249117 >> v2:172.21.15.36:3300/0 conn(0x7eff8c0b2580 0x7eff8c0abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:34:05.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 >> v1:172.21.15.36:6789/0 conn(0x7eff8c0b1260 legacy=0x7eff8c0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 --2- 172.21.15.36:0/1840249117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6c0038e0 0x7eff6c003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 --2- 172.21.15.36:0/1840249117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6c004500 0x7eff6c004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 --2- 172.21.15.36:0/1840249117 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff6c004e70 0x7eff6c00b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c0a9390 con 0x7eff6c004e70 2022-01-10T01:34:05.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c00bcf0 con 0x7eff6c004500 2022-01-10T01:34:05.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c00beb0 con 0x7eff6c0038e0 2022-01-10T01:34:05.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8bfff700 1 --2- 172.21.15.36:0/1840249117 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff6c004e70 0x7eff6c00b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8b7fe700 1 --2- 172.21.15.36:0/1840249117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6c0038e0 0x7eff6c003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8bfff700 1 -- 172.21.15.36:0/1840249117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6c0038e0 msgr2=0x7eff6c003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:05.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8bfff700 1 --2- 172.21.15.36:0/1840249117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6c0038e0 0x7eff6c003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8bfff700 1 -- 172.21.15.36:0/1840249117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6c004500 msgr2=0x7eff6c004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:05.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8bfff700 1 --2- 172.21.15.36:0/1840249117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff6c004500 0x7eff6c004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-01-10T01:34:05.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8bfff700 1 -- 172.21.15.36:0/1840249117 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c003260 con 0x7eff6c004e70 2022-01-10T01:34:05.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8b7fe700 1 --2- 172.21.15.36:0/1840249117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6c0038e0 0x7eff6c003ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:34:05.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8bfff700 1 -- 172.21.15.36:0/1840249117 reap_dead start 2022-01-10T01:34:05.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8bfff700 1 --2- 172.21.15.36:0/1840249117 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff6c004e70 0x7eff6c00b750 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7eff84001490 tx=0x7eff84007d80).ready entity=mon.0 client_cookie=96e06b5473cdaa3b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:05.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff84006890 con 0x7eff6c004e70 2022-01-10T01:34:05.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff840069f0 con 0x7eff6c004e70 2022-01-10T01:34:05.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff8affd700 1 -- 172.21.15.36:0/1840249117 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff84006d50 con 0x7eff6c004e70 2022-01-10T01:34:05.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff90aca700 1 -- 172.21.15.36:0/1840249117 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff6c004e70 msgr2=0x7eff6c00b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff90aca700 1 --2- 172.21.15.36:0/1840249117 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff6c004e70 0x7eff6c00b750 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7eff84001490 tx=0x7eff84007d80).stop 2022-01-10T01:34:05.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff90aca700 1 -- 172.21.15.36:0/1840249117 shutdown_connections 2022-01-10T01:34:05.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff90aca700 1 --2- 172.21.15.36:0/1840249117 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff6c004e70 0x7eff6c00b750 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff90aca700 1 -- 172.21.15.36:0/1840249117 >> 172.21.15.36:0/1840249117 conn(0x7eff8c060180 msgr2=0x7eff8c0b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:05.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff90aca700 1 -- 172.21.15.36:0/1840249117 shutdown_connections 2022-01-10T01:34:05.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.908+0000 7eff90aca700 1 -- 172.21.15.36:0/1840249117 wait complete. 2022-01-10T01:34:05.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff90aca700 1 Processor -- start 2022-01-10T01:34:05.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff90aca700 1 -- start start 2022-01-10T01:34:05.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff90aca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6c004e70 0x7eff8c0b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff90aca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff8c0ac030 0x7eff8c13e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff90aca700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff8c155510 0x7eff8c155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff90aca700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c0ab200 con 0x7eff8c155510 2022-01-10T01:34:05.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff90aca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c13daa0 con 0x7eff8c0ac030 2022-01-10T01:34:05.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff90aca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c13dd40 con 0x7eff6c004e70 2022-01-10T01:34:05.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff8bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff8c155510 0x7eff8c155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff8bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff8c155510 0x7eff8c155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43086/0 (socket says 172.21.15.36:43086) 2022-01-10T01:34:05.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff8bfff700 1 -- 172.21.15.36:0/985050234 learned_addr learned my addr 172.21.15.36:0/985050234 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:05.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff83fff700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff8c0ac030 0x7eff8c13e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff8b7fe700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6c004e70 0x7eff8c0b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff8bfff700 1 -- 172.21.15.36:0/985050234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6c004e70 msgr2=0x7eff8c0b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff8bfff700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6c004e70 0x7eff8c0b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff8bfff700 1 -- 172.21.15.36:0/985050234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff8c0ac030 msgr2=0x7eff8c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:05.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff8bfff700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff8c0ac030 0x7eff8c13e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:05.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff8bfff700 1 -- 172.21.15.36:0/985050234 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c0aadf0 con 0x7eff8c155510 2022-01-10T01:34:05.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff83fff700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff8c0ac030 0x7eff8c13e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:34:05.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff8bfff700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff8c155510 0x7eff8c155990 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7eff84001490 tx=0x7eff84015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:05.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff897fa700 1 -- 172.21.15.36:0/985050234 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff84006890 con 0x7eff8c155510 2022-01-10T01:34:05.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff897fa700 1 -- 172.21.15.36:0/985050234 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8400c9e0 con 0x7eff8c155510 2022-01-10T01:34:05.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff90aca700 1 -- 172.21.15.36:0/985050234 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8c13e6d0 con 0x7eff8c155510 2022-01-10T01:34:05.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff897fa700 1 -- 172.21.15.36:0/985050234 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff84007b60 con 0x7eff8c155510 2022-01-10T01:34:05.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.912+0000 7eff90aca700 1 -- 172.21.15.36:0/985050234 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8c13a810 con 0x7eff8c155510 2022-01-10T01:34:05.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.916+0000 7eff90aca700 1 -- 172.21.15.36:0/985050234 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8c0ab3c0 con 0x7eff8c155510 2022-01-10T01:34:05.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.916+0000 7eff897fa700 1 -- 172.21.15.36:0/985050234 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7eff84027070 con 0x7eff8c155510 2022-01-10T01:34:05.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.916+0000 7eff897fa700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff70053620 0x7eff70055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:05.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.916+0000 7eff897fa700 1 -- 172.21.15.36:0/985050234 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7eff8406cdd0 con 0x7eff8c155510 2022-01-10T01:34:05.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.916+0000 7eff8b7fe700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff70053620 0x7eff70055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:05.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.916+0000 7eff8b7fe700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff70053620 0x7eff70055ae0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7eff7c00b000 tx=0x7eff7c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:05.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:05.920+0000 7eff897fa700 1 -- 172.21.15.36:0/985050234 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7eff84043cd0 con 0x7eff8c155510 2022-01-10T01:34:06.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.048+0000 7eff90aca700 1 -- 172.21.15.36:0/985050234 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff8c057350 con 0x7eff8c155510 2022-01-10T01:34:06.057 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.048+0000 7eff897fa700 1 -- 172.21.15.36:0/985050234 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16285 (secure 0 0 0) 0x7eff8401a030 con 0x7eff8c155510 2022-01-10T01:34:06.058 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:06.058 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":159,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:34:05.469195+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:34:02.282468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2022-01-10T01:34:03.465498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:34:06.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.052+0000 7eff90aca700 1 -- 172.21.15.36:0/985050234 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff70053620 msgr2=0x7eff70055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.052+0000 7eff90aca700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff70053620 0x7eff70055ae0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7eff7c00b000 tx=0x7eff7c008040).stop 2022-01-10T01:34:06.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.052+0000 7eff90aca700 1 -- 172.21.15.36:0/985050234 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff8c155510 msgr2=0x7eff8c155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.052+0000 7eff90aca700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff8c155510 0x7eff8c155990 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7eff84001490 tx=0x7eff84015000).stop 2022-01-10T01:34:06.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.052+0000 7eff90aca700 1 -- 172.21.15.36:0/985050234 shutdown_connections 2022-01-10T01:34:06.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.052+0000 7eff90aca700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7eff70053620 0x7eff70055ae0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.052+0000 7eff90aca700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7eff8c155510 0x7eff8c155990 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.052+0000 7eff90aca700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff8c0ac030 0x7eff8c13e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.052+0000 7eff90aca700 1 --2- 172.21.15.36:0/985050234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff6c004e70 0x7eff8c0b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.052+0000 7eff90aca700 1 -- 172.21.15.36:0/985050234 >> 172.21.15.36:0/985050234 conn(0x7eff8c060180 msgr2=0x7eff8c143050 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:06.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.052+0000 7eff90aca700 1 -- 172.21.15.36:0/985050234 shutdown_connections 2022-01-10T01:34:06.062 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.052+0000 7eff90aca700 1 -- 172.21.15.36:0/985050234 wait complete. 2022-01-10T01:34:06.072 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:34:06.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.180+0000 7ff47eff5700 1 Processor -- start 2022-01-10T01:34:06.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.180+0000 7ff47eff5700 1 -- start start 2022-01-10T01:34:06.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.180+0000 7ff47eff5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff478148860 0x7ff47814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.180+0000 7ff47eff5700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff478066ea0 con 0x7ff4780b3040 2022-01-10T01:34:06.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.180+0000 7ff47eff5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4780b3420 con 0x7ff4780a9c10 2022-01-10T01:34:06.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.180+0000 7ff47eff5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4780648e0 con 0x7ff478148860 2022-01-10T01:34:06.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.180+0000 7ff47dff3700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff4780b3040 0x7ff478065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40884/0 (socket says 172.21.15.36:40884) 2022-01-10T01:34:06.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47dff3700 1 -- 172.21.15.36:0/609532075 learned_addr learned my addr 172.21.15.36:0/609532075 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:06.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47e7f4700 1 --2- 172.21.15.36:0/609532075 >> v2:172.21.15.59:3300/0 conn(0x7ff478148860 0x7ff47814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47cff1700 1 -- 172.21.15.36:0/609532075 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657425987 0 0) 0x7ff478066ea0 con 0x7ff4780b3040 2022-01-10T01:34:06.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47cff1700 1 -- 172.21.15.36:0/609532075 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff460003260 con 0x7ff4780b3040 2022-01-10T01:34:06.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47cff1700 1 -- 172.21.15.36:0/609532075 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328799422 0 0) 0x7ff4780b3420 con 0x7ff4780a9c10 2022-01-10T01:34:06.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47cff1700 1 -- 172.21.15.36:0/609532075 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff478066ea0 con 0x7ff4780a9c10 2022-01-10T01:34:06.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47cff1700 1 -- 172.21.15.36:0/609532075 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2127658784 0 0) 0x7ff460003260 con 0x7ff4780b3040 2022-01-10T01:34:06.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47e7f4700 1 -- 172.21.15.36:0/609532075 >> v1:172.21.15.59:6789/0 conn(0x7ff4780a9c10 legacy=0x7ff4780607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47e7f4700 1 -- 172.21.15.36:0/609532075 >> v1:172.21.15.36:6789/0 conn(0x7ff4780b3040 legacy=0x7ff478065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47e7f4700 1 -- 172.21.15.36:0/609532075 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff478066960 con 0x7ff478148860 2022-01-10T01:34:06.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47e7f4700 1 --2- 172.21.15.36:0/609532075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff478148860 0x7ff47814ac50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7ff474001110 tx=0x7ff4700091d0).ready entity=mon.1 client_cookie=d933c094c485595b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:06.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47cff1700 1 -- 172.21.15.36:0/609532075 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff474001660 con 0x7ff478148860 2022-01-10T01:34:06.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47cff1700 1 -- 172.21.15.36:0/609532075 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47000f510 con 0x7ff478148860 2022-01-10T01:34:06.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47cff1700 1 -- 172.21.15.36:0/609532075 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff47000f680 con 0x7ff478148860 2022-01-10T01:34:06.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47eff5700 1 -- 172.21.15.36:0/609532075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff478148860 msgr2=0x7ff47814ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47eff5700 1 --2- 172.21.15.36:0/609532075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff478148860 0x7ff47814ac50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7ff474001110 tx=0x7ff4700091d0).stop 2022-01-10T01:34:06.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47eff5700 1 -- 172.21.15.36:0/609532075 shutdown_connections 2022-01-10T01:34:06.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47eff5700 1 --2- 172.21.15.36:0/609532075 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff478148860 0x7ff47814ac50 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47eff5700 1 -- 172.21.15.36:0/609532075 >> 172.21.15.36:0/609532075 conn(0x7ff4780636e0 msgr2=0x7ff478063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:06.200 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47eff5700 1 -- 172.21.15.36:0/609532075 shutdown_connections 2022-01-10T01:34:06.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.184+0000 7ff47eff5700 1 -- 172.21.15.36:0/609532075 wait complete. 2022-01-10T01:34:06.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47eff5700 1 Processor -- start 2022-01-10T01:34:06.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47eff5700 1 -- start start 2022-01-10T01:34:06.201 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47eff5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4780a9c10 0x7ff478135170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47eff5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4780b3040 0x7ff478146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47eff5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff478148860 0x7ff478136fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47eff5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff478145d20 con 0x7ff478148860 2022-01-10T01:34:06.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47eff5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff478145f50 con 0x7ff4780a9c10 2022-01-10T01:34:06.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47eff5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4781461f0 con 0x7ff4780b3040 2022-01-10T01:34:06.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47e7f4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff478148860 0x7ff478136fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47e7f4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff478148860 0x7ff478136fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43100/0 (socket says 172.21.15.36:43100) 2022-01-10T01:34:06.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47e7f4700 1 -- 172.21.15.36:0/253691397 learned_addr learned my addr 172.21.15.36:0/253691397 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:06.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47dff3700 1 --2- 172.21.15.36:0/253691397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4780a9c10 0x7ff478135170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47d7f2700 1 --2- 172.21.15.36:0/253691397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4780b3040 0x7ff478146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47e7f4700 1 -- 172.21.15.36:0/253691397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4780b3040 msgr2=0x7ff478146a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47e7f4700 1 --2- 172.21.15.36:0/253691397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4780b3040 0x7ff478146a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47e7f4700 1 -- 172.21.15.36:0/253691397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4780a9c10 msgr2=0x7ff478135170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47e7f4700 1 --2- 172.21.15.36:0/253691397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4780a9c10 0x7ff478135170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47e7f4700 1 -- 172.21.15.36:0/253691397 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff470009470 con 0x7ff478148860 2022-01-10T01:34:06.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.188+0000 7ff47e7f4700 1 --2- 172.21.15.36:0/253691397 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff478148860 0x7ff478136fd0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7ff474001110 tx=0x7ff470016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:06.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.192+0000 7ff466ffd700 1 -- 172.21.15.36:0/253691397 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff47000f680 con 0x7ff478148860 2022-01-10T01:34:06.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.192+0000 7ff466ffd700 1 -- 172.21.15.36:0/253691397 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4700032d0 con 0x7ff478148860 2022-01-10T01:34:06.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.192+0000 7ff47eff5700 1 -- 172.21.15.36:0/253691397 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff478132360 con 0x7ff478148860 2022-01-10T01:34:06.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.192+0000 7ff466ffd700 1 -- 172.21.15.36:0/253691397 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff470021440 con 0x7ff478148860 2022-01-10T01:34:06.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.192+0000 7ff47eff5700 1 -- 172.21.15.36:0/253691397 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4781445a0 con 0x7ff478148860 2022-01-10T01:34:06.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.192+0000 7ff466ffd700 1 -- 172.21.15.36:0/253691397 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff470027020 con 0x7ff478148860 2022-01-10T01:34:06.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.192+0000 7ff47eff5700 1 -- 172.21.15.36:0/253691397 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4781463b0 con 0x7ff478148860 2022-01-10T01:34:06.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.192+0000 7ff466ffd700 1 --2- 172.21.15.36:0/253691397 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff458053680 0x7ff458055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.192+0000 7ff466ffd700 1 -- 172.21.15.36:0/253691397 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff47006c990 con 0x7ff478148860 2022-01-10T01:34:06.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.192+0000 7ff47dff3700 1 --2- 172.21.15.36:0/253691397 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff458053680 0x7ff458055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.192+0000 7ff47dff3700 1 --2- 172.21.15.36:0/253691397 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff458053680 0x7ff458055b40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7ff47400d000 tx=0x7ff474000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:06.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.196+0000 7ff466ffd700 1 -- 172.21.15.36:0/253691397 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff4700439e0 con 0x7ff478148860 2022-01-10T01:34:06.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.364+0000 7ff47eff5700 1 -- 172.21.15.36:0/253691397 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7ff478066c00 con 0x7ff478148860 2022-01-10T01:34:06.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.376+0000 7ff466ffd700 1 -- 172.21.15.36:0/253691397 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v35) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff4700150e0 con 0x7ff478148860 2022-01-10T01:34:06.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.376+0000 7ff47eff5700 1 -- 172.21.15.36:0/253691397 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff458053680 msgr2=0x7ff458055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.376+0000 7ff47eff5700 1 --2- 172.21.15.36:0/253691397 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff458053680 0x7ff458055b40 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7ff47400d000 tx=0x7ff474000bc0).stop 2022-01-10T01:34:06.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.376+0000 7ff47eff5700 1 -- 172.21.15.36:0/253691397 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff478148860 msgr2=0x7ff478136fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.376+0000 7ff47eff5700 1 --2- 172.21.15.36:0/253691397 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff478148860 0x7ff478136fd0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7ff474001110 tx=0x7ff470016000).stop 2022-01-10T01:34:06.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.376+0000 7ff47eff5700 1 -- 172.21.15.36:0/253691397 shutdown_connections 2022-01-10T01:34:06.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.376+0000 7ff47eff5700 1 --2- 172.21.15.36:0/253691397 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff458053680 0x7ff458055b40 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.376+0000 7ff47eff5700 1 --2- 172.21.15.36:0/253691397 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff478148860 0x7ff478136fd0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.376+0000 7ff47eff5700 1 --2- 172.21.15.36:0/253691397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4780b3040 0x7ff478146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.376+0000 7ff47eff5700 1 --2- 172.21.15.36:0/253691397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4780a9c10 0x7ff478135170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.376+0000 7ff47eff5700 1 -- 172.21.15.36:0/253691397 >> 172.21.15.36:0/253691397 conn(0x7ff4780636e0 msgr2=0x7ff4780b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:06.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.376+0000 7ff47eff5700 1 -- 172.21.15.36:0/253691397 shutdown_connections 2022-01-10T01:34:06.390 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.376+0000 7ff47eff5700 1 -- 172.21.15.36:0/253691397 wait complete. 2022-01-10T01:34:06.390 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.0 2022-01-10T01:34:06.399 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2022-01-10T01:34:06.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.504+0000 7f515bfff700 1 Processor -- start 2022-01-10T01:34:06.512 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.504+0000 7f515bfff700 1 -- start start 2022-01-10T01:34:06.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.504+0000 7f515bfff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f515c0b6290 0x7f515c061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.504+0000 7f515bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c0b4060 0x7f515c061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.504+0000 7f515bfff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515c0b5f50 con 0x7f515c061e50 2022-01-10T01:34:06.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.504+0000 7f515bfff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515c0b1f70 con 0x7f515c0b6290 2022-01-10T01:34:06.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.504+0000 7f515bfff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c0b2210 con 0x7f515c0b4060 2022-01-10T01:34:06.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.504+0000 7f515affd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f515c0b6290 0x7f515c061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.504+0000 7f515affd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f515c0b6290 0x7f515c061470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43104/0 (socket says 172.21.15.36:43104) 2022-01-10T01:34:06.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.504+0000 7f515affd700 1 -- 172.21.15.36:0/2753691322 learned_addr learned my addr 172.21.15.36:0/2753691322 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:06.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.504+0000 7f515a7fc700 1 --2- 172.21.15.36:0/2753691322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c0b4060 0x7f515c061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f515affd700 1 -- 172.21.15.36:0/2753691322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c0b4060 msgr2=0x7f515c061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:06.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f515affd700 1 --2- 172.21.15.36:0/2753691322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c0b4060 0x7f515c061960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f515affd700 1 -- 172.21.15.36:0/2753691322 >> v1:172.21.15.59:6789/0 conn(0x7f515c061e50 legacy=0x7f515c146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f515affd700 1 -- 172.21.15.36:0/2753691322 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c0b24b0 con 0x7f515c0b6290 2022-01-10T01:34:06.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f515affd700 1 --2- 172.21.15.36:0/2753691322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f515c0b6290 0x7f515c061470 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f5144002f70 tx=0x7f5144006eb0).ready entity=mon.0 client_cookie=73b8b8c8f9f6040c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:06.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f5159ffb700 1 -- 172.21.15.36:0/2753691322 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f514400d570 con 0x7f515c0b6290 2022-01-10T01:34:06.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f5159ffb700 1 -- 172.21.15.36:0/2753691322 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5144000e90 con 0x7f515c0b6290 2022-01-10T01:34:06.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f5159ffb700 1 -- 172.21.15.36:0/2753691322 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f514400d900 con 0x7f515c0b6290 2022-01-10T01:34:06.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f515bfff700 1 -- 172.21.15.36:0/2753691322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f515c0b6290 msgr2=0x7f515c061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f515bfff700 1 --2- 172.21.15.36:0/2753691322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f515c0b6290 0x7f515c061470 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f5144002f70 tx=0x7f5144006eb0).stop 2022-01-10T01:34:06.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f515bfff700 1 -- 172.21.15.36:0/2753691322 shutdown_connections 2022-01-10T01:34:06.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f515bfff700 1 --2- 172.21.15.36:0/2753691322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c0b4060 0x7f515c061960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f515bfff700 1 --2- 172.21.15.36:0/2753691322 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f515c0b6290 0x7f515c061470 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f515bfff700 1 -- 172.21.15.36:0/2753691322 >> 172.21.15.36:0/2753691322 conn(0x7f515c05c490 msgr2=0x7f515c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:06.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f515bfff700 1 -- 172.21.15.36:0/2753691322 shutdown_connections 2022-01-10T01:34:06.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f515bfff700 1 -- 172.21.15.36:0/2753691322 wait complete. 2022-01-10T01:34:06.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.508+0000 7f515bfff700 1 Processor -- start 2022-01-10T01:34:06.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515bfff700 1 -- start start 2022-01-10T01:34:06.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515bfff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c061e50 0x7f515c1530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f515c0b4060 0x7f515c13e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515bfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c0b6290 0x7f515c13ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515bfff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c1535c0 con 0x7f515c0b4060 2022-01-10T01:34:06.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515bfff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c13fb90 con 0x7f515c061e50 2022-01-10T01:34:06.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515bfff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c13ef60 con 0x7f515c0b6290 2022-01-10T01:34:06.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515a7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f515c0b4060 0x7f515c13e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515a7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f515c0b4060 0x7f515c13e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43112/0 (socket says 172.21.15.36:43112) 2022-01-10T01:34:06.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515a7fc700 1 -- 172.21.15.36:0/684319337 learned_addr learned my addr 172.21.15.36:0/684319337 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:06.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515affd700 1 --2- 172.21.15.36:0/684319337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c061e50 0x7f515c1530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515b7fe700 1 --2- 172.21.15.36:0/684319337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c0b6290 0x7f515c13ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515a7fc700 1 -- 172.21.15.36:0/684319337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c0b6290 msgr2=0x7f515c13ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515a7fc700 1 --2- 172.21.15.36:0/684319337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c0b6290 0x7f515c13ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515a7fc700 1 -- 172.21.15.36:0/684319337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c061e50 msgr2=0x7f515c1530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515a7fc700 1 --2- 172.21.15.36:0/684319337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c061e50 0x7f515c1530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515a7fc700 1 -- 172.21.15.36:0/684319337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514400b1e0 con 0x7f515c0b4060 2022-01-10T01:34:06.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515a7fc700 1 --2- 172.21.15.36:0/684319337 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f515c0b4060 0x7f515c13e580 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f515c0af190 tx=0x7f514c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:06.528 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f5153fff700 1 -- 172.21.15.36:0/684319337 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f514c00c640 con 0x7f515c0b4060 2022-01-10T01:34:06.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f5153fff700 1 -- 172.21.15.36:0/684319337 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c00c7a0 con 0x7f515c0b4060 2022-01-10T01:34:06.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515bfff700 1 -- 172.21.15.36:0/684319337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515c150300 con 0x7f515c0b4060 2022-01-10T01:34:06.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f5153fff700 1 -- 172.21.15.36:0/684319337 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f514c00cb00 con 0x7f515c0b4060 2022-01-10T01:34:06.529 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.512+0000 7f515bfff700 1 -- 172.21.15.36:0/684319337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515c140300 con 0x7f515c0b4060 2022-01-10T01:34:06.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.516+0000 7f5153fff700 1 -- 172.21.15.36:0/684319337 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f514c00cc60 con 0x7f515c0b4060 2022-01-10T01:34:06.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.516+0000 7f515bfff700 1 -- 172.21.15.36:0/684319337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515c1404c0 con 0x7f515c0b4060 2022-01-10T01:34:06.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.516+0000 7f5153fff700 1 --2- 172.21.15.36:0/684319337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51400536b0 0x7f5140055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.531 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.516+0000 7f5153fff700 1 -- 172.21.15.36:0/684319337 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f514c06bb10 con 0x7f515c0b4060 2022-01-10T01:34:06.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.516+0000 7f515affd700 1 --2- 172.21.15.36:0/684319337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51400536b0 0x7f5140055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.516+0000 7f515affd700 1 --2- 172.21.15.36:0/684319337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51400536b0 0x7f5140055b70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f514401a000 tx=0x7f5144015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:06.532 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.524+0000 7f5153fff700 1 -- 172.21.15.36:0/684319337 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f514c042b20 con 0x7f515c0b4060 2022-01-10T01:34:06.697 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.688+0000 7f515bfff700 1 -- 172.21.15.36:0/684319337 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f515c0b2750 con 0x7f515c0b4060 2022-01-10T01:34:06.704 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.696+0000 7f5153fff700 1 -- 172.21.15.36:0/684319337 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v36) v1 ==== 184+0+0 (secure 0 0 0) 0x7f514c046140 con 0x7f515c0b4060 2022-01-10T01:34:06.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.700+0000 7f515bfff700 1 -- 172.21.15.36:0/684319337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51400536b0 msgr2=0x7f5140055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.707 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.700+0000 7f515bfff700 1 --2- 172.21.15.36:0/684319337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51400536b0 0x7f5140055b70 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f514401a000 tx=0x7f5144015000).stop 2022-01-10T01:34:06.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.700+0000 7f515bfff700 1 -- 172.21.15.36:0/684319337 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f515c0b4060 msgr2=0x7f515c13e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.700+0000 7f515bfff700 1 --2- 172.21.15.36:0/684319337 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f515c0b4060 0x7f515c13e580 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7f515c0af190 tx=0x7f514c006df0).stop 2022-01-10T01:34:06.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.700+0000 7f515bfff700 1 -- 172.21.15.36:0/684319337 shutdown_connections 2022-01-10T01:34:06.708 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.700+0000 7f515bfff700 1 --2- 172.21.15.36:0/684319337 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f51400536b0 0x7f5140055b70 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.700+0000 7f515bfff700 1 --2- 172.21.15.36:0/684319337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f515c0b6290 0x7f515c13ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.700+0000 7f515bfff700 1 --2- 172.21.15.36:0/684319337 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f515c0b4060 0x7f515c13e580 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.700+0000 7f515bfff700 1 --2- 172.21.15.36:0/684319337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f515c061e50 0x7f515c1530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.700+0000 7f515bfff700 1 -- 172.21.15.36:0/684319337 >> 172.21.15.36:0/684319337 conn(0x7f515c05c490 msgr2=0x7f515c0b8550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:06.709 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.700+0000 7f515bfff700 1 -- 172.21.15.36:0/684319337 shutdown_connections 2022-01-10T01:34:06.710 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.700+0000 7f515bfff700 1 -- 172.21.15.36:0/684319337 wait complete. 2022-01-10T01:34:06.710 INFO:teuthology.orchestra.run.smithi036.stderr:updated caps for client.1 2022-01-10T01:34:06.720 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:34:06.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.816+0000 7fbc97f9e700 1 Processor -- start 2022-01-10T01:34:06.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.816+0000 7fbc97f9e700 1 -- start start 2022-01-10T01:34:06.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.816+0000 7fbc97f9e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbc900b00c0 0x7fbc900b1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.816+0000 7fbc97f9e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbc900b1f10 0x7fbc900aab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.816+0000 7fbc97f9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc900a9b70 0x7fbc901415b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.816+0000 7fbc97f9e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc900aa390 con 0x7fbc900b00c0 2022-01-10T01:34:06.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.816+0000 7fbc97f9e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc900b04a0 con 0x7fbc900b1f10 2022-01-10T01:34:06.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.816+0000 7fbc97f9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc900aa0f0 con 0x7fbc900a9b70 2022-01-10T01:34:06.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc95d3a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbc900b00c0 0x7fbc900b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc95539700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbc900b1f10 0x7fbc900aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc95d3a700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fbc900b00c0 0x7fbc900b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43120/0 (socket says 172.21.15.36:43120) 2022-01-10T01:34:06.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc9653b700 1 --2- 172.21.15.36:0/2437996775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc900a9b70 0x7fbc901415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc95d3a700 1 -- 172.21.15.36:0/2437996775 learned_addr learned my addr 172.21.15.36:0/2437996775 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:06.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc9653b700 1 -- 172.21.15.36:0/2437996775 >> v2:172.21.15.59:3300/0 conn(0x7fbc900b1f10 msgr2=0x7fbc900aab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:06.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc9653b700 1 --2- 172.21.15.36:0/2437996775 >> v2:172.21.15.59:3300/0 conn(0x7fbc900b1f10 0x7fbc900aab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc9653b700 1 -- 172.21.15.36:0/2437996775 >> v2:172.21.15.36:3300/0 conn(0x7fbc900b00c0 msgr2=0x7fbc900b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:06.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc9653b700 1 --2- 172.21.15.36:0/2437996775 >> v2:172.21.15.36:3300/0 conn(0x7fbc900b00c0 0x7fbc900b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc9653b700 1 -- 172.21.15.36:0/2437996775 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc900b11e0 con 0x7fbc900a9b70 2022-01-10T01:34:06.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc9653b700 1 --2- 172.21.15.36:0/2437996775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc900a9b70 0x7fbc901415b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fbc880032f0 tx=0x7fbc880091d0).ready entity=mon.2 client_cookie=f0aa3ba12dbc6889 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:06.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc94d38700 1 -- 172.21.15.36:0/2437996775 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc8800b600 con 0x7fbc900a9b70 2022-01-10T01:34:06.835 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc94d38700 1 -- 172.21.15.36:0/2437996775 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8800b760 con 0x7fbc900a9b70 2022-01-10T01:34:06.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc94d38700 1 -- 172.21.15.36:0/2437996775 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc8800b8d0 con 0x7fbc900a9b70 2022-01-10T01:34:06.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2437996775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc900a9b70 msgr2=0x7fbc901415b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc97f9e700 1 --2- 172.21.15.36:0/2437996775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc900a9b70 0x7fbc901415b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fbc880032f0 tx=0x7fbc880091d0).stop 2022-01-10T01:34:06.836 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2437996775 shutdown_connections 2022-01-10T01:34:06.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc97f9e700 1 --2- 172.21.15.36:0/2437996775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc900a9b70 0x7fbc901415b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc97f9e700 1 --2- 172.21.15.36:0/2437996775 >> v2:172.21.15.59:3300/0 conn(0x7fbc900b1f10 0x7fbc900aab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.837 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc97f9e700 1 --2- 172.21.15.36:0/2437996775 >> v2:172.21.15.36:3300/0 conn(0x7fbc900b00c0 0x7fbc900b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2437996775 >> 172.21.15.36:0/2437996775 conn(0x7fbc900607c0 msgr2=0x7fbc90060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:06.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2437996775 shutdown_connections 2022-01-10T01:34:06.838 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.820+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2437996775 wait complete. 2022-01-10T01:34:06.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc97f9e700 1 Processor -- start 2022-01-10T01:34:06.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc97f9e700 1 -- start start 2022-01-10T01:34:06.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc97f9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc900a9b70 0x7fbc90140000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc97f9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc900b00c0 0x7fbc901536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc97f9e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc900b1f10 0x7fbc90153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc97f9e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc90142120 con 0x7fbc900b1f10 2022-01-10T01:34:06.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc97f9e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc901428d0 con 0x7fbc900a9b70 2022-01-10T01:34:06.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc97f9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc90142b70 con 0x7fbc900b00c0 2022-01-10T01:34:06.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc9653b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc900b1f10 0x7fbc90153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc9653b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc900b1f10 0x7fbc90153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43126/0 (socket says 172.21.15.36:43126) 2022-01-10T01:34:06.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc9653b700 1 -- 172.21.15.36:0/2899633565 learned_addr learned my addr 172.21.15.36:0/2899633565 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:06.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc95539700 1 --2- 172.21.15.36:0/2899633565 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc900b00c0 0x7fbc901536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc95d3a700 1 --2- 172.21.15.36:0/2899633565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc900a9b70 0x7fbc90140000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc9653b700 1 -- 172.21.15.36:0/2899633565 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc900b00c0 msgr2=0x7fbc901536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc9653b700 1 --2- 172.21.15.36:0/2899633565 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc900b00c0 0x7fbc901536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc9653b700 1 -- 172.21.15.36:0/2899633565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc900a9b70 msgr2=0x7fbc90140000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:06.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc9653b700 1 --2- 172.21.15.36:0/2899633565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc900a9b70 0x7fbc90140000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:06.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc9653b700 1 -- 172.21.15.36:0/2899633565 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc88009470 con 0x7fbc900b1f10 2022-01-10T01:34:06.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc9653b700 1 --2- 172.21.15.36:0/2899633565 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc900b1f10 0x7fbc90153bb0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7fbc880032f0 tx=0x7fbc88016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:06.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc7effd700 1 -- 172.21.15.36:0/2899633565 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc8800b600 con 0x7fbc900b1f10 2022-01-10T01:34:06.848 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc7effd700 1 -- 172.21.15.36:0/2899633565 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc88011cf0 con 0x7fbc900b1f10 2022-01-10T01:34:06.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2899633565 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc90141ca0 con 0x7fbc900b1f10 2022-01-10T01:34:06.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc7effd700 1 -- 172.21.15.36:0/2899633565 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc8801f5e0 con 0x7fbc900b1f10 2022-01-10T01:34:06.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.824+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2899633565 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc90064960 con 0x7fbc900b1f10 2022-01-10T01:34:06.849 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.828+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2899633565 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc90057350 con 0x7fbc900b1f10 2022-01-10T01:34:06.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.828+0000 7fbc7effd700 1 -- 172.21.15.36:0/2899633565 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fbc88026030 con 0x7fbc900b1f10 2022-01-10T01:34:06.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.828+0000 7fbc7effd700 1 --2- 172.21.15.36:0/2899633565 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbc70053560 0x7fbc70055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:06.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.828+0000 7fbc7effd700 1 -- 172.21.15.36:0/2899633565 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fbc8806c520 con 0x7fbc900b1f10 2022-01-10T01:34:06.850 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.828+0000 7fbc95d3a700 1 --2- 172.21.15.36:0/2899633565 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbc70053560 0x7fbc70055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:06.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.828+0000 7fbc95d3a700 1 --2- 172.21.15.36:0/2899633565 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbc70053560 0x7fbc70055a20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fbc8c008000 tx=0x7fbc8c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:06.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.832+0000 7fbc7effd700 1 -- 172.21.15.36:0/2899633565 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fbc88043570 con 0x7fbc900b1f10 2022-01-10T01:34:07.002 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.996+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2899633565 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc901422f0 con 0x7fbc900b1f10 2022-01-10T01:34:07.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.996+0000 7fbc7effd700 1 -- 172.21.15.36:0/2899633565 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fbc880249d0 con 0x7fbc900b1f10 2022-01-10T01:34:07.004 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:07.004 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":79,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3964890182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3964890182},{"type":"v1","addr":"172.21.15.59:6833","nonce":3964890182}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77},{"gid":8733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3716636187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3716636187},{"type":"v1","addr":"172.21.15.36:6835","nonce":3716636187}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:34:04.465028+0000","modified":"2022-01-10T01:34:05.469086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8742":{"gid":8742,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/1997308230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1997308230},{"type":"v1","addr":"172.21.15.36:6837","nonce":1997308230}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2022-01-10T01:34:07.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.996+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2899633565 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbc70053560 msgr2=0x7fbc70055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:07.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.996+0000 7fbc97f9e700 1 --2- 172.21.15.36:0/2899633565 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbc70053560 0x7fbc70055a20 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fbc8c008000 tx=0x7fbc8c008040).stop 2022-01-10T01:34:07.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.996+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2899633565 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc900b1f10 msgr2=0x7fbc90153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:07.006 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.996+0000 7fbc97f9e700 1 --2- 172.21.15.36:0/2899633565 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc900b1f10 0x7fbc90153bb0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7fbc880032f0 tx=0x7fbc88016000).stop 2022-01-10T01:34:07.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.996+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2899633565 shutdown_connections 2022-01-10T01:34:07.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.996+0000 7fbc97f9e700 1 --2- 172.21.15.36:0/2899633565 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fbc70053560 0x7fbc70055a20 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.996+0000 7fbc97f9e700 1 --2- 172.21.15.36:0/2899633565 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fbc900b1f10 0x7fbc90153bb0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.007 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.996+0000 7fbc97f9e700 1 --2- 172.21.15.36:0/2899633565 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc900b00c0 0x7fbc901536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.996+0000 7fbc97f9e700 1 --2- 172.21.15.36:0/2899633565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc900a9b70 0x7fbc90140000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.996+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2899633565 >> 172.21.15.36:0/2899633565 conn(0x7fbc900607c0 msgr2=0x7fbc900abf70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:07.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.996+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2899633565 shutdown_connections 2022-01-10T01:34:07.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:06.996+0000 7fbc97f9e700 1 -- 172.21.15.36:0/2899633565 wait complete. 2022-01-10T01:34:07.009 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 79 2022-01-10T01:34:07.318 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:34:04.465028+0000', 'modified': '2022-01-10T01:34:05.469086+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8742}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8742': {'gid': 8742, 'name': 'a', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6837/1997308230', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6836', 'nonce': 1997308230}, {'type': 'v1', 'addr': '172.21.15.36:6837', 'nonce': 1997308230}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:34:07.319 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:34:07.320 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-10T01:34:07.437 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":8742,"want_state":"up:active","state":"up:active","rank_uptime":2.9570038099999998,"mdsmap_epoch":79,"osdmap_epoch":159,"osdmap_epoch_barrier":158,"uptime":7.9477638099999997} 2022-01-10T01:34:07.437 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 8742, "mdsmap_epoch": 79, "osdmap_epoch": 159, "osdmap_epoch_barrier": 158, "rank_uptime": 2.95700381, "state": "up:active", "uptime": 7.94776381, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:34:07.438 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:34:07.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.532+0000 7f2b431c0700 1 Processor -- start 2022-01-10T01:34:07.542 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.532+0000 7f2b431c0700 1 -- start start 2022-01-10T01:34:07.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b431c0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2b3c0a9190 0x7f2b3c146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:07.544 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b431c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c0b0b80 0x7f2b3c146a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:07.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b431c0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c0b1140 con 0x7f2b3c0b03d0 2022-01-10T01:34:07.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b431c0700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3c0a9570 con 0x7f2b3c0a9190 2022-01-10T01:34:07.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b431c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0b1370 con 0x7f2b3c0b0b80 2022-01-10T01:34:07.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b421be700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2b3c0a9190 0x7f2b3c146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:07.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b421be700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f2b3c0a9190 0x7f2b3c146550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43134/0 (socket says 172.21.15.36:43134) 2022-01-10T01:34:07.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b421be700 1 -- 172.21.15.36:0/2779300402 learned_addr learned my addr 172.21.15.36:0/2779300402 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:07.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b419bd700 1 --2- 172.21.15.36:0/2779300402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c0b0b80 0x7f2b3c146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:07.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b421be700 1 -- 172.21.15.36:0/2779300402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c0b0b80 msgr2=0x7f2b3c146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:07.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b421be700 1 --2- 172.21.15.36:0/2779300402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c0b0b80 0x7f2b3c146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b421be700 1 -- 172.21.15.36:0/2779300402 >> v1:172.21.15.59:6789/0 conn(0x7f2b3c0b03d0 legacy=0x7f2b3c1401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:07.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b421be700 1 -- 172.21.15.36:0/2779300402 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c0b1610 con 0x7f2b3c0a9190 2022-01-10T01:34:07.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b421be700 1 --2- 172.21.15.36:0/2779300402 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b3c0a9190 0x7f2b3c146550 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f2b38002f70 tx=0x7f2b38006eb0).ready entity=mon.0 client_cookie=8c80e5c992dae469 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:07.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b411bc700 1 -- 172.21.15.36:0/2779300402 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3800d570 con 0x7f2b3c0a9190 2022-01-10T01:34:07.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b411bc700 1 -- 172.21.15.36:0/2779300402 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b38000e90 con 0x7f2b3c0a9190 2022-01-10T01:34:07.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b411bc700 1 -- 172.21.15.36:0/2779300402 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3800d900 con 0x7f2b3c0a9190 2022-01-10T01:34:07.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b431c0700 1 -- 172.21.15.36:0/2779300402 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b3c0a9190 msgr2=0x7f2b3c146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:07.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b431c0700 1 --2- 172.21.15.36:0/2779300402 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b3c0a9190 0x7f2b3c146550 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f2b38002f70 tx=0x7f2b38006eb0).stop 2022-01-10T01:34:07.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b431c0700 1 -- 172.21.15.36:0/2779300402 shutdown_connections 2022-01-10T01:34:07.553 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b431c0700 1 --2- 172.21.15.36:0/2779300402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c0b0b80 0x7f2b3c146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b431c0700 1 --2- 172.21.15.36:0/2779300402 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b3c0a9190 0x7f2b3c146550 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b431c0700 1 -- 172.21.15.36:0/2779300402 >> 172.21.15.36:0/2779300402 conn(0x7f2b3c061140 msgr2=0x7f2b3c062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:07.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b431c0700 1 -- 172.21.15.36:0/2779300402 shutdown_connections 2022-01-10T01:34:07.554 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.536+0000 7f2b431c0700 1 -- 172.21.15.36:0/2779300402 wait complete. 2022-01-10T01:34:07.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b431c0700 1 Processor -- start 2022-01-10T01:34:07.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b431c0700 1 -- start start 2022-01-10T01:34:07.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b431c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c0a9190 0x7f2b3c0676c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:07.555 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b431c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b3c0b03d0 0x7f2b3c14f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:07.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b431c0700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b3c0b0b80 0x7f2b3c14fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:07.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b431c0700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c066860 con 0x7f2b3c0b0b80 2022-01-10T01:34:07.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b431c0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0b62b0 con 0x7f2b3c0b03d0 2022-01-10T01:34:07.556 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b431c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c153340 con 0x7f2b3c0a9190 2022-01-10T01:34:07.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b429bf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b3c0b0b80 0x7f2b3c14fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:07.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b429bf700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b3c0b0b80 0x7f2b3c14fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43142/0 (socket says 172.21.15.36:43142) 2022-01-10T01:34:07.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b429bf700 1 -- 172.21.15.36:0/2569170929 learned_addr learned my addr 172.21.15.36:0/2569170929 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:07.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b421be700 1 --2- 172.21.15.36:0/2569170929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c0a9190 0x7f2b3c0676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:07.557 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b419bd700 1 --2- 172.21.15.36:0/2569170929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b3c0b03d0 0x7f2b3c14f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:07.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b429bf700 1 -- 172.21.15.36:0/2569170929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c0a9190 msgr2=0x7f2b3c0676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:07.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b429bf700 1 --2- 172.21.15.36:0/2569170929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c0a9190 0x7f2b3c0676c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b429bf700 1 -- 172.21.15.36:0/2569170929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b3c0b03d0 msgr2=0x7f2b3c14f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:07.558 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b429bf700 1 --2- 172.21.15.36:0/2569170929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b3c0b03d0 0x7f2b3c14f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b429bf700 1 -- 172.21.15.36:0/2569170929 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3800b1e0 con 0x7f2b3c0b0b80 2022-01-10T01:34:07.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b429bf700 1 --2- 172.21.15.36:0/2569170929 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b3c0b0b80 0x7f2b3c14fbc0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f2b3c0b0290 tx=0x7f2b34007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:07.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b2b7fe700 1 -- 172.21.15.36:0/2569170929 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3400e4a0 con 0x7f2b3c0b0b80 2022-01-10T01:34:07.559 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b431c0700 1 -- 172.21.15.36:0/2569170929 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3c0640a0 con 0x7f2b3c0b0b80 2022-01-10T01:34:07.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b2b7fe700 1 -- 172.21.15.36:0/2569170929 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3400e600 con 0x7f2b3c0b0b80 2022-01-10T01:34:07.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b2b7fe700 1 -- 172.21.15.36:0/2569170929 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3400e960 con 0x7f2b3c0b0b80 2022-01-10T01:34:07.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.540+0000 7f2b431c0700 1 -- 172.21.15.36:0/2569170929 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c0aed40 con 0x7f2b3c0b0b80 2022-01-10T01:34:07.560 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.544+0000 7f2b2b7fe700 1 -- 172.21.15.36:0/2569170929 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2b34019030 con 0x7f2b3c0b0b80 2022-01-10T01:34:07.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.544+0000 7f2b431c0700 1 -- 172.21.15.36:0/2569170929 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3c150250 con 0x7f2b3c0b0b80 2022-01-10T01:34:07.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.544+0000 7f2b2b7fe700 1 --2- 172.21.15.36:0/2569170929 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b1c053680 0x7f2b1c055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:07.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.544+0000 7f2b2b7fe700 1 -- 172.21.15.36:0/2569170929 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f2b3406b2f0 con 0x7f2b3c0b0b80 2022-01-10T01:34:07.561 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.544+0000 7f2b421be700 1 --2- 172.21.15.36:0/2569170929 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b1c053680 0x7f2b1c055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:07.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.544+0000 7f2b421be700 1 --2- 172.21.15.36:0/2569170929 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b1c053680 0x7f2b1c055b40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f2b3801c000 tx=0x7f2b38015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:07.562 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.552+0000 7f2b2b7fe700 1 -- 172.21.15.36:0/2569170929 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2b34042110 con 0x7f2b3c0b0b80 2022-01-10T01:34:07.686 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.676+0000 7f2b431c0700 1 -- 172.21.15.36:0/2569170929 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b3c1530e0 con 0x7f2b3c0b0b80 2022-01-10T01:34:07.688 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.680+0000 7f2b2b7fe700 1 -- 172.21.15.36:0/2569170929 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16285 (secure 0 0 0) 0x7f2b34045730 con 0x7f2b3c0b0b80 2022-01-10T01:34:07.688 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:07.688 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":159,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:34:05.469195+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:34:02.282468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2022-01-10T01:34:03.465498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:34:07.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.680+0000 7f2b431c0700 1 -- 172.21.15.36:0/2569170929 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b1c053680 msgr2=0x7f2b1c055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:07.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.680+0000 7f2b431c0700 1 --2- 172.21.15.36:0/2569170929 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b1c053680 0x7f2b1c055b40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f2b3801c000 tx=0x7f2b38015000).stop 2022-01-10T01:34:07.690 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.680+0000 7f2b431c0700 1 -- 172.21.15.36:0/2569170929 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b3c0b0b80 msgr2=0x7f2b3c14fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:07.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.680+0000 7f2b431c0700 1 --2- 172.21.15.36:0/2569170929 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b3c0b0b80 0x7f2b3c14fbc0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f2b3c0b0290 tx=0x7f2b34007f40).stop 2022-01-10T01:34:07.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.680+0000 7f2b431c0700 1 -- 172.21.15.36:0/2569170929 shutdown_connections 2022-01-10T01:34:07.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.680+0000 7f2b431c0700 1 --2- 172.21.15.36:0/2569170929 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2b1c053680 0x7f2b1c055b40 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.691 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.680+0000 7f2b431c0700 1 --2- 172.21.15.36:0/2569170929 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2b3c0b0b80 0x7f2b3c14fbc0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.680+0000 7f2b431c0700 1 --2- 172.21.15.36:0/2569170929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b3c0b03d0 0x7f2b3c14f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.680+0000 7f2b431c0700 1 --2- 172.21.15.36:0/2569170929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b3c0a9190 0x7f2b3c0676c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.680+0000 7f2b431c0700 1 -- 172.21.15.36:0/2569170929 >> 172.21.15.36:0/2569170929 conn(0x7f2b3c061140 msgr2=0x7f2b3c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:07.692 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.680+0000 7f2b431c0700 1 -- 172.21.15.36:0/2569170929 shutdown_connections 2022-01-10T01:34:07.693 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.680+0000 7f2b431c0700 1 -- 172.21.15.36:0/2569170929 wait complete. 2022-01-10T01:34:07.701 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:34:02.282468+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '158', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:34:03.465498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:34:07.702 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:34:07.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.804+0000 7ff7a913b700 1 Processor -- start 2022-01-10T01:34:07.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.804+0000 7ff7a913b700 1 -- start start 2022-01-10T01:34:07.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.804+0000 7ff7a913b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff7a4061320 0x7ff7a4061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:07.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.804+0000 7ff7a913b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff7a40ad5c0 0x7ff7a40b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:07.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.804+0000 7ff7a913b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a40aecf0 con 0x7ff7a4140440 2022-01-10T01:34:07.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.804+0000 7ff7a913b700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a40b6f20 con 0x7ff7a4061320 2022-01-10T01:34:07.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.804+0000 7ff7a913b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a40aef20 con 0x7ff7a40ad5c0 2022-01-10T01:34:07.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.804+0000 7ff7a3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7ff7a4061320 0x7ff7a4061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:07.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.804+0000 7ff7a893a700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ff7a4140440 0x7ff7a4146520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40942/0 (socket says 172.21.15.36:40942) 2022-01-10T01:34:07.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.804+0000 7ff7a893a700 1 -- 172.21.15.36:0/3724231504 learned_addr learned my addr 172.21.15.36:0/3724231504 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:07.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.804+0000 7ff7a37fe700 1 --2- 172.21.15.36:0/3724231504 >> v2:172.21.15.59:3300/0 conn(0x7ff7a40ad5c0 0x7ff7a40b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:07.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.804+0000 7ff7a2ffd700 1 -- 172.21.15.36:0/3724231504 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656828138 0 0) 0x7ff7a40aecf0 con 0x7ff7a4140440 2022-01-10T01:34:07.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.804+0000 7ff7a2ffd700 1 -- 172.21.15.36:0/3724231504 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff784003260 con 0x7ff7a4140440 2022-01-10T01:34:07.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.804+0000 7ff7a3fff700 1 -- 172.21.15.36:0/3724231504 >> v2:172.21.15.59:3300/0 conn(0x7ff7a40ad5c0 msgr2=0x7ff7a40b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:07.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a3fff700 1 --2- 172.21.15.36:0/3724231504 >> v2:172.21.15.59:3300/0 conn(0x7ff7a40ad5c0 0x7ff7a40b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a3fff700 1 -- 172.21.15.36:0/3724231504 >> v1:172.21.15.36:6789/0 conn(0x7ff7a4140440 legacy=0x7ff7a4146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:07.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a3fff700 1 -- 172.21.15.36:0/3724231504 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a40af1c0 con 0x7ff7a4061320 2022-01-10T01:34:07.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a3fff700 1 --2- 172.21.15.36:0/3724231504 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7a4061320 0x7ff7a4061700 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7ff7a40aeba0 tx=0x7ff78c006df0).ready entity=mon.0 client_cookie=92688e6e531e192a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:07.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a2ffd700 1 -- 172.21.15.36:0/3724231504 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff78c00d4f0 con 0x7ff7a4061320 2022-01-10T01:34:07.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a2ffd700 1 -- 172.21.15.36:0/3724231504 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c000e90 con 0x7ff7a4061320 2022-01-10T01:34:07.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a2ffd700 1 -- 172.21.15.36:0/3724231504 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff78c00d840 con 0x7ff7a4061320 2022-01-10T01:34:07.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 -- 172.21.15.36:0/3724231504 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7a4061320 msgr2=0x7ff7a4061700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:07.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 --2- 172.21.15.36:0/3724231504 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7a4061320 0x7ff7a4061700 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7ff7a40aeba0 tx=0x7ff78c006df0).stop 2022-01-10T01:34:07.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 -- 172.21.15.36:0/3724231504 shutdown_connections 2022-01-10T01:34:07.824 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 --2- 172.21.15.36:0/3724231504 >> v2:172.21.15.59:3300/0 conn(0x7ff7a40ad5c0 0x7ff7a40b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 --2- 172.21.15.36:0/3724231504 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7a4061320 0x7ff7a4061700 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 -- 172.21.15.36:0/3724231504 >> 172.21.15.36:0/3724231504 conn(0x7ff7a4066de0 msgr2=0x7ff7a40671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:07.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 -- 172.21.15.36:0/3724231504 shutdown_connections 2022-01-10T01:34:07.825 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 -- 172.21.15.36:0/3724231504 wait complete. 2022-01-10T01:34:07.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 Processor -- start 2022-01-10T01:34:07.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 -- start start 2022-01-10T01:34:07.826 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7a4061320 0x7ff7a40b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:07.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7a40ad5c0 0x7ff7a40abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:07.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7a4140440 0x7ff7a40ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:07.827 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a4152d50 con 0x7ff7a40ad5c0 2022-01-10T01:34:07.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a4141200 con 0x7ff7a4140440 2022-01-10T01:34:07.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a913b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a41418d0 con 0x7ff7a4061320 2022-01-10T01:34:07.828 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a37fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7a40ad5c0 0x7ff7a40abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:07.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a37fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7a40ad5c0 0x7ff7a40abf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43154/0 (socket says 172.21.15.36:43154) 2022-01-10T01:34:07.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a37fe700 1 -- 172.21.15.36:0/582282315 learned_addr learned my addr 172.21.15.36:0/582282315 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:07.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a893a700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7a4140440 0x7ff7a40ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:07.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a3fff700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7a4061320 0x7ff7a40b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:07.829 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a37fe700 1 -- 172.21.15.36:0/582282315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7a4061320 msgr2=0x7ff7a40b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:07.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a37fe700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7a4061320 0x7ff7a40b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a37fe700 1 -- 172.21.15.36:0/582282315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7a4140440 msgr2=0x7ff7a40ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:07.830 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a37fe700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7a4140440 0x7ff7a40ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a37fe700 1 -- 172.21.15.36:0/582282315 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c00b180 con 0x7ff7a40ad5c0 2022-01-10T01:34:07.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a893a700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7a4140440 0x7ff7a40ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:34:07.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.808+0000 7ff7a3fff700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7a4061320 0x7ff7a40b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:34:07.831 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.812+0000 7ff7a37fe700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7a40ad5c0 0x7ff7a40abf80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7ff7a41523f0 tx=0x7ff794006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:07.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.812+0000 7ff7a17fa700 1 -- 172.21.15.36:0/582282315 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff79400c830 con 0x7ff7a40ad5c0 2022-01-10T01:34:07.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.812+0000 7ff7a17fa700 1 -- 172.21.15.36:0/582282315 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79400c990 con 0x7ff7a40ad5c0 2022-01-10T01:34:07.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.812+0000 7ff7a913b700 1 -- 172.21.15.36:0/582282315 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a4152f50 con 0x7ff7a40ad5c0 2022-01-10T01:34:07.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.812+0000 7ff7a17fa700 1 -- 172.21.15.36:0/582282315 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff79400ccf0 con 0x7ff7a40ad5c0 2022-01-10T01:34:07.832 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.812+0000 7ff7a913b700 1 -- 172.21.15.36:0/582282315 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a4141430 con 0x7ff7a40ad5c0 2022-01-10T01:34:07.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.812+0000 7ff7a913b700 1 -- 172.21.15.36:0/582282315 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a4149710 con 0x7ff7a40ad5c0 2022-01-10T01:34:07.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.812+0000 7ff7a17fa700 1 -- 172.21.15.36:0/582282315 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ff79401c460 con 0x7ff7a40ad5c0 2022-01-10T01:34:07.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.812+0000 7ff7a17fa700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff7880535f0 0x7ff788055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:07.833 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.816+0000 7ff7a3fff700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff7880535f0 0x7ff788055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:07.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.816+0000 7ff7a17fa700 1 -- 172.21.15.36:0/582282315 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7ff79406bfb0 con 0x7ff7a40ad5c0 2022-01-10T01:34:07.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.816+0000 7ff7a3fff700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff7880535f0 0x7ff788055ab0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7ff78c015000 tx=0x7ff78c014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:07.834 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.820+0000 7ff7a17fa700 1 -- 172.21.15.36:0/582282315 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ff794042f60 con 0x7ff7a40ad5c0 2022-01-10T01:34:07.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.944+0000 7ff7a913b700 1 -- 172.21.15.36:0/582282315 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff7a41415c0 con 0x7ff7a40ad5c0 2022-01-10T01:34:07.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.944+0000 7ff7a17fa700 1 -- 172.21.15.36:0/582282315 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v159) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff794046580 con 0x7ff7a40ad5c0 2022-01-10T01:34:07.954 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:34:07.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.948+0000 7ff7a913b700 1 -- 172.21.15.36:0/582282315 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff7880535f0 msgr2=0x7ff788055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:07.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.948+0000 7ff7a913b700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff7880535f0 0x7ff788055ab0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7ff78c015000 tx=0x7ff78c014000).stop 2022-01-10T01:34:07.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.948+0000 7ff7a913b700 1 -- 172.21.15.36:0/582282315 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7a40ad5c0 msgr2=0x7ff7a40abf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:07.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.948+0000 7ff7a913b700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7a40ad5c0 0x7ff7a40abf80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7ff7a41523f0 tx=0x7ff794006df0).stop 2022-01-10T01:34:07.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.948+0000 7ff7a913b700 1 -- 172.21.15.36:0/582282315 shutdown_connections 2022-01-10T01:34:07.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.948+0000 7ff7a913b700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ff7880535f0 0x7ff788055ab0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.948+0000 7ff7a913b700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7a4140440 0x7ff7a40ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.948+0000 7ff7a913b700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ff7a40ad5c0 0x7ff7a40abf80 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.948+0000 7ff7a913b700 1 --2- 172.21.15.36:0/582282315 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7a4061320 0x7ff7a40b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:07.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.948+0000 7ff7a913b700 1 -- 172.21.15.36:0/582282315 >> 172.21.15.36:0/582282315 conn(0x7ff7a4066de0 msgr2=0x7ff7a405cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:07.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.948+0000 7ff7a913b700 1 -- 172.21.15.36:0/582282315 shutdown_connections 2022-01-10T01:34:07.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:07.948+0000 7ff7a913b700 1 -- 172.21.15.36:0/582282315 wait complete. 2022-01-10T01:34:07.967 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:34:08.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.068+0000 7f0aaec53700 1 Processor -- start 2022-01-10T01:34:08.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.068+0000 7f0aaec53700 1 -- start start 2022-01-10T01:34:08.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.068+0000 7f0aaec53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0aa805fc00 0x7f0aa80b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.068+0000 7f0aaec53700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0aa80b5990 0x7f0aa80b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.068+0000 7f0aaec53700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa8143f60 con 0x7f0aa80b6560 2022-01-10T01:34:08.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.068+0000 7f0aaec53700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa80ba6b0 con 0x7f0aa80b5990 2022-01-10T01:34:08.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.068+0000 7f0aaec53700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa805ffe0 con 0x7f0aa805fc00 2022-01-10T01:34:08.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aad1f0700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0aa80b5990 0x7f0aa80b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aa7fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f0aa80b6560 0x7f0aa80b9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:40958/0 (socket says 172.21.15.36:40958) 2022-01-10T01:34:08.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aa7fff700 1 -- 172.21.15.36:0/3441457169 learned_addr learned my addr 172.21.15.36:0/3441457169 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:08.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aac9ef700 1 --2- 172.21.15.36:0/3441457169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0aa805fc00 0x7f0aa80b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.082 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aa77fe700 1 -- 172.21.15.36:0/3441457169 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426616154 0 0) 0x7f0aa8143f60 con 0x7f0aa80b6560 2022-01-10T01:34:08.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aad1f0700 1 -- 172.21.15.36:0/3441457169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0aa805fc00 msgr2=0x7f0aa80b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:08.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aad1f0700 1 --2- 172.21.15.36:0/3441457169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0aa805fc00 0x7f0aa80b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aad1f0700 1 -- 172.21.15.36:0/3441457169 >> v1:172.21.15.36:6789/0 conn(0x7f0aa80b6560 legacy=0x7f0aa80b9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.083 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aad1f0700 1 -- 172.21.15.36:0/3441457169 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa8143a50 con 0x7f0aa80b5990 2022-01-10T01:34:08.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aad1f0700 1 --2- 172.21.15.36:0/3441457169 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0aa80b5990 0x7f0aa80b4a00 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f0aa00032f0 tx=0x7f0aa00091d0).ready entity=mon.0 client_cookie=a640ad5ba76aa6ac server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:08.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aa77fe700 1 -- 172.21.15.36:0/3441457169 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0aa000b6c0 con 0x7f0aa80b5990 2022-01-10T01:34:08.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aa77fe700 1 -- 172.21.15.36:0/3441457169 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa000b820 con 0x7f0aa80b5990 2022-01-10T01:34:08.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aa77fe700 1 -- 172.21.15.36:0/3441457169 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0aa000b990 con 0x7f0aa80b5990 2022-01-10T01:34:08.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 -- 172.21.15.36:0/3441457169 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0aa80b5990 msgr2=0x7f0aa80b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 --2- 172.21.15.36:0/3441457169 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0aa80b5990 0x7f0aa80b4a00 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7f0aa00032f0 tx=0x7f0aa00091d0).stop 2022-01-10T01:34:08.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 -- 172.21.15.36:0/3441457169 shutdown_connections 2022-01-10T01:34:08.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 --2- 172.21.15.36:0/3441457169 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0aa80b5990 0x7f0aa80b4a00 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 --2- 172.21.15.36:0/3441457169 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0aa805fc00 0x7f0aa80b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 -- 172.21.15.36:0/3441457169 >> 172.21.15.36:0/3441457169 conn(0x7f0aa80623a0 msgr2=0x7f0aa8066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:08.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 -- 172.21.15.36:0/3441457169 shutdown_connections 2022-01-10T01:34:08.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 -- 172.21.15.36:0/3441457169 wait complete. 2022-01-10T01:34:08.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 Processor -- start 2022-01-10T01:34:08.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 -- start start 2022-01-10T01:34:08.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0aa805fc00 0x7f0aa8142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0aa80b5990 0x7f0aa80ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa80b6560 0x7f0aa80adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa8128570 con 0x7f0aa805fc00 2022-01-10T01:34:08.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa813d720 con 0x7f0aa80b6560 2022-01-10T01:34:08.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aaec53700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa813d110 con 0x7f0aa80b5990 2022-01-10T01:34:08.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aac9ef700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0aa805fc00 0x7f0aa8142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aac9ef700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0aa805fc00 0x7f0aa8142180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43166/0 (socket says 172.21.15.36:43166) 2022-01-10T01:34:08.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.072+0000 7f0aac9ef700 1 -- 172.21.15.36:0/1148689647 learned_addr learned my addr 172.21.15.36:0/1148689647 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:08.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aad1f0700 1 --2- 172.21.15.36:0/1148689647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa80b6560 0x7f0aa80adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aa7fff700 1 --2- 172.21.15.36:0/1148689647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0aa80b5990 0x7f0aa80ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aac9ef700 1 -- 172.21.15.36:0/1148689647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0aa80b5990 msgr2=0x7f0aa80ad620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aac9ef700 1 --2- 172.21.15.36:0/1148689647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0aa80b5990 0x7f0aa80ad620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aac9ef700 1 -- 172.21.15.36:0/1148689647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa80b6560 msgr2=0x7f0aa80adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aac9ef700 1 --2- 172.21.15.36:0/1148689647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa80b6560 0x7f0aa80adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aac9ef700 1 -- 172.21.15.36:0/1148689647 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa0009470 con 0x7f0aa805fc00 2022-01-10T01:34:08.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aac9ef700 1 --2- 172.21.15.36:0/1148689647 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0aa805fc00 0x7f0aa8142180 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f0a9000c000 tx=0x7f0a90006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:08.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aa5ffb700 1 -- 172.21.15.36:0/1148689647 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a90011750 con 0x7f0aa805fc00 2022-01-10T01:34:08.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aa5ffb700 1 -- 172.21.15.36:0/1148689647 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a900118b0 con 0x7f0aa805fc00 2022-01-10T01:34:08.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aaec53700 1 -- 172.21.15.36:0/1148689647 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa80afdc0 con 0x7f0aa805fc00 2022-01-10T01:34:08.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aa5ffb700 1 -- 172.21.15.36:0/1148689647 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a90011c10 con 0x7f0aa805fc00 2022-01-10T01:34:08.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aaec53700 1 -- 172.21.15.36:0/1148689647 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa813d340 con 0x7f0aa805fc00 2022-01-10T01:34:08.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aaec53700 1 -- 172.21.15.36:0/1148689647 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa8143cc0 con 0x7f0aa805fc00 2022-01-10T01:34:08.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aa5ffb700 1 -- 172.21.15.36:0/1148689647 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0a90011d70 con 0x7f0aa805fc00 2022-01-10T01:34:08.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aa5ffb700 1 --2- 172.21.15.36:0/1148689647 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0a8c0535f0 0x7f0a8c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.076+0000 7f0aa5ffb700 1 -- 172.21.15.36:0/1148689647 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f0a9006bf10 con 0x7f0aa805fc00 2022-01-10T01:34:08.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.080+0000 7f0aa7fff700 1 --2- 172.21.15.36:0/1148689647 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0a8c0535f0 0x7f0a8c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.080+0000 7f0aa7fff700 1 --2- 172.21.15.36:0/1148689647 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0a8c0535f0 0x7f0a8c055ab0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f0a9800d000 tx=0x7f0a98007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:08.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.084+0000 7f0aa5ffb700 1 -- 172.21.15.36:0/1148689647 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0a90042e20 con 0x7f0aa805fc00 2022-01-10T01:34:08.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.208+0000 7f0aaec53700 1 -- 172.21.15.36:0/1148689647 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0aa8057350 con 0x7f0aa805fc00 2022-01-10T01:34:08.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.212+0000 7f0aa5ffb700 1 -- 172.21.15.36:0/1148689647 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v159) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0a90046440 con 0x7f0aa805fc00 2022-01-10T01:34:08.219 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:34:08.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.212+0000 7f0aaec53700 1 -- 172.21.15.36:0/1148689647 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0a8c0535f0 msgr2=0x7f0a8c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.212+0000 7f0aaec53700 1 --2- 172.21.15.36:0/1148689647 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0a8c0535f0 0x7f0a8c055ab0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f0a9800d000 tx=0x7f0a98007a00).stop 2022-01-10T01:34:08.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.212+0000 7f0aaec53700 1 -- 172.21.15.36:0/1148689647 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0aa805fc00 msgr2=0x7f0aa8142180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.212+0000 7f0aaec53700 1 --2- 172.21.15.36:0/1148689647 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0aa805fc00 0x7f0aa8142180 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f0a9000c000 tx=0x7f0a90006df0).stop 2022-01-10T01:34:08.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.212+0000 7f0aaec53700 1 -- 172.21.15.36:0/1148689647 shutdown_connections 2022-01-10T01:34:08.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.212+0000 7f0aaec53700 1 --2- 172.21.15.36:0/1148689647 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0a8c0535f0 0x7f0a8c055ab0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.212+0000 7f0aaec53700 1 --2- 172.21.15.36:0/1148689647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0aa80b6560 0x7f0aa80adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.212+0000 7f0aaec53700 1 --2- 172.21.15.36:0/1148689647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0aa80b5990 0x7f0aa80ad620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.212+0000 7f0aaec53700 1 --2- 172.21.15.36:0/1148689647 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0aa805fc00 0x7f0aa8142180 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.212+0000 7f0aaec53700 1 -- 172.21.15.36:0/1148689647 >> 172.21.15.36:0/1148689647 conn(0x7f0aa80623a0 msgr2=0x7f0aa812c160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:08.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.212+0000 7f0aaec53700 1 -- 172.21.15.36:0/1148689647 shutdown_connections 2022-01-10T01:34:08.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.212+0000 7f0aaec53700 1 -- 172.21.15.36:0/1148689647 wait complete. 2022-01-10T01:34:08.232 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:34:08.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.336+0000 7fd50759e700 1 Processor -- start 2022-01-10T01:34:08.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.336+0000 7fd50759e700 1 -- start start 2022-01-10T01:34:08.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd5080b0010 0x7fd5080a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd5080afbd0 0x7fd5080a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5080a70c0 con 0x7fd5080b2580 2022-01-10T01:34:08.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5080a72f0 con 0x7fd5080b0010 2022-01-10T01:34:08.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5080a7590 con 0x7fd5080afbd0 2022-01-10T01:34:08.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd505d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd5080b0010 0x7fd5080a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd505d9b700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fd5080b0010 0x7fd5080a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43176/0 (socket says 172.21.15.36:43176) 2022-01-10T01:34:08.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd505d9b700 1 -- 172.21.15.36:0/1485775297 learned_addr learned my addr 172.21.15.36:0/1485775297 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:08.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd506d9d700 1 --2- 172.21.15.36:0/1485775297 >> v2:172.21.15.59:3300/0 conn(0x7fd5080afbd0 0x7fd5080a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd505d9b700 1 -- 172.21.15.36:0/1485775297 >> v2:172.21.15.59:3300/0 conn(0x7fd5080afbd0 msgr2=0x7fd5080a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:08.351 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd505d9b700 1 --2- 172.21.15.36:0/1485775297 >> v2:172.21.15.59:3300/0 conn(0x7fd5080afbd0 0x7fd5080a88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd505d9b700 1 -- 172.21.15.36:0/1485775297 >> v1:172.21.15.59:6789/0 conn(0x7fd5080b2580 legacy=0x7fd50814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd505d9b700 1 -- 172.21.15.36:0/1485775297 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5080a7830 con 0x7fd5080b0010 2022-01-10T01:34:08.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd505d9b700 1 --2- 172.21.15.36:0/1485775297 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5080b0010 0x7fd5080a83b0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fd4f8002f70 tx=0x7fd4f8006eb0).ready entity=mon.0 client_cookie=e8c752a9c8ee6267 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:08.352 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50559a700 1 -- 172.21.15.36:0/1485775297 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4f800d5c0 con 0x7fd5080b0010 2022-01-10T01:34:08.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50559a700 1 -- 172.21.15.36:0/1485775297 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f8000e90 con 0x7fd5080b0010 2022-01-10T01:34:08.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50559a700 1 -- 172.21.15.36:0/1485775297 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4f800d950 con 0x7fd5080b0010 2022-01-10T01:34:08.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 -- 172.21.15.36:0/1485775297 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5080b0010 msgr2=0x7fd5080a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 --2- 172.21.15.36:0/1485775297 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5080b0010 0x7fd5080a83b0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fd4f8002f70 tx=0x7fd4f8006eb0).stop 2022-01-10T01:34:08.353 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 -- 172.21.15.36:0/1485775297 shutdown_connections 2022-01-10T01:34:08.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 --2- 172.21.15.36:0/1485775297 >> v2:172.21.15.59:3300/0 conn(0x7fd5080afbd0 0x7fd5080a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 --2- 172.21.15.36:0/1485775297 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5080b0010 0x7fd5080a83b0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 -- 172.21.15.36:0/1485775297 >> 172.21.15.36:0/1485775297 conn(0x7fd508060180 msgr2=0x7fd5080b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:08.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 -- 172.21.15.36:0/1485775297 shutdown_connections 2022-01-10T01:34:08.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 -- 172.21.15.36:0/1485775297 wait complete. 2022-01-10T01:34:08.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 Processor -- start 2022-01-10T01:34:08.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.340+0000 7fd50759e700 1 -- start start 2022-01-10T01:34:08.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd50759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5080afbd0 0x7fd508063e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd50759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5080b0010 0x7fd508064310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd50759e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5080b2580 0x7fd508066bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd50759e700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080b4310 con 0x7fd5080b2580 2022-01-10T01:34:08.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd50759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080b3540 con 0x7fd5080afbd0 2022-01-10T01:34:08.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd50759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080b3fc0 con 0x7fd5080b0010 2022-01-10T01:34:08.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd506d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5080b2580 0x7fd508066bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd506d9d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5080b2580 0x7fd508066bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43184/0 (socket says 172.21.15.36:43184) 2022-01-10T01:34:08.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd506d9d700 1 -- 172.21.15.36:0/2877544190 learned_addr learned my addr 172.21.15.36:0/2877544190 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:08.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd505d9b700 1 --2- 172.21.15.36:0/2877544190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5080b0010 0x7fd508064310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd50659c700 1 --2- 172.21.15.36:0/2877544190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5080afbd0 0x7fd508063e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd506d9d700 1 -- 172.21.15.36:0/2877544190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5080b0010 msgr2=0x7fd508064310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd506d9d700 1 --2- 172.21.15.36:0/2877544190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5080b0010 0x7fd508064310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd506d9d700 1 -- 172.21.15.36:0/2877544190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5080afbd0 msgr2=0x7fd508063e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd506d9d700 1 --2- 172.21.15.36:0/2877544190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5080afbd0 0x7fd508063e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd506d9d700 1 -- 172.21.15.36:0/2877544190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f800b1e0 con 0x7fd5080b2580 2022-01-10T01:34:08.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd506d9d700 1 --2- 172.21.15.36:0/2877544190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5080b2580 0x7fd508066bd0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7fd50814acd0 tx=0x7fd5000091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:08.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd4f77fe700 1 -- 172.21.15.36:0/2877544190 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd500012600 con 0x7fd5080b2580 2022-01-10T01:34:08.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd4f77fe700 1 -- 172.21.15.36:0/2877544190 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd500012760 con 0x7fd5080b2580 2022-01-10T01:34:08.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd50759e700 1 -- 172.21.15.36:0/2877544190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5080b3790 con 0x7fd5080b2580 2022-01-10T01:34:08.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd4f77fe700 1 -- 172.21.15.36:0/2877544190 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd500012ac0 con 0x7fd5080b2580 2022-01-10T01:34:08.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.344+0000 7fd50759e700 1 -- 172.21.15.36:0/2877544190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5081574f0 con 0x7fd5080b2580 2022-01-10T01:34:08.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.348+0000 7fd50759e700 1 -- 172.21.15.36:0/2877544190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd508057350 con 0x7fd5080b2580 2022-01-10T01:34:08.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.348+0000 7fd4f77fe700 1 -- 172.21.15.36:0/2877544190 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fd500022070 con 0x7fd5080b2580 2022-01-10T01:34:08.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.348+0000 7fd4f77fe700 1 --2- 172.21.15.36:0/2877544190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4e40536b0 0x7fd4e4055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.348+0000 7fd4f77fe700 1 -- 172.21.15.36:0/2877544190 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fd50006c0e0 con 0x7fd5080b2580 2022-01-10T01:34:08.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.348+0000 7fd50659c700 1 --2- 172.21.15.36:0/2877544190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4e40536b0 0x7fd4e4055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.348+0000 7fd50659c700 1 --2- 172.21.15.36:0/2877544190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4e40536b0 0x7fd4e4055b70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fd4fc00d000 tx=0x7fd4fc007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:08.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.356+0000 7fd4f77fe700 1 -- 172.21.15.36:0/2877544190 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fd500042fe0 con 0x7fd5080b2580 2022-01-10T01:34:08.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.484+0000 7fd50759e700 1 -- 172.21.15.36:0/2877544190 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd50814b0f0 con 0x7fd5080b2580 2022-01-10T01:34:08.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.484+0000 7fd4f77fe700 1 -- 172.21.15.36:0/2877544190 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v159) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd500016070 con 0x7fd5080b2580 2022-01-10T01:34:08.493 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:34:08.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.488+0000 7fd50759e700 1 -- 172.21.15.36:0/2877544190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4e40536b0 msgr2=0x7fd4e4055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.488+0000 7fd50759e700 1 --2- 172.21.15.36:0/2877544190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4e40536b0 0x7fd4e4055b70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fd4fc00d000 tx=0x7fd4fc007b90).stop 2022-01-10T01:34:08.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.488+0000 7fd50759e700 1 -- 172.21.15.36:0/2877544190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5080b2580 msgr2=0x7fd508066bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.488+0000 7fd50759e700 1 --2- 172.21.15.36:0/2877544190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5080b2580 0x7fd508066bd0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7fd50814acd0 tx=0x7fd5000091d0).stop 2022-01-10T01:34:08.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.488+0000 7fd50759e700 1 -- 172.21.15.36:0/2877544190 shutdown_connections 2022-01-10T01:34:08.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.488+0000 7fd50759e700 1 --2- 172.21.15.36:0/2877544190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fd4e40536b0 0x7fd4e4055b70 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.488+0000 7fd50759e700 1 --2- 172.21.15.36:0/2877544190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fd5080b2580 0x7fd508066bd0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.488+0000 7fd50759e700 1 --2- 172.21.15.36:0/2877544190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5080b0010 0x7fd508064310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.488+0000 7fd50759e700 1 --2- 172.21.15.36:0/2877544190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5080afbd0 0x7fd508063e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.497 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.488+0000 7fd50759e700 1 -- 172.21.15.36:0/2877544190 >> 172.21.15.36:0/2877544190 conn(0x7fd508060180 msgr2=0x7fd508148b30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:08.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.488+0000 7fd50759e700 1 -- 172.21.15.36:0/2877544190 shutdown_connections 2022-01-10T01:34:08.498 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.488+0000 7fd50759e700 1 -- 172.21.15.36:0/2877544190 wait complete. 2022-01-10T01:34:08.507 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:34:08.618 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe58580f700 1 Processor -- start 2022-01-10T01:34:08.619 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe58580f700 1 -- start start 2022-01-10T01:34:08.621 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe58580f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe580146950 0x7fe580140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe58580f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5800b4690 0x7fe5800b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe58580f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe580143b60 con 0x7fe5800b4180 2022-01-10T01:34:08.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe58580f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe580147510 con 0x7fe5800b4690 2022-01-10T01:34:08.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe58580f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe580143e00 con 0x7fe580146950 2022-01-10T01:34:08.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe57f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5800b4690 0x7fe5800b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe57e7fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe5800b4180 0x7fe580140720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:58660/0 (socket says 172.21.15.36:58660) 2022-01-10T01:34:08.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe57effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe580146950 0x7fe580140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe57e7fc700 1 -- 172.21.15.36:0/2780374314 learned_addr learned my addr 172.21.15.36:0/2780374314 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:08.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe57f7fe700 1 -- 172.21.15.36:0/2780374314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe580146950 msgr2=0x7fe580140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:08.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe57f7fe700 1 --2- 172.21.15.36:0/2780374314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe580146950 0x7fe580140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe57f7fe700 1 -- 172.21.15.36:0/2780374314 >> v1:172.21.15.59:6789/0 conn(0x7fe5800b4180 legacy=0x7fe580140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe57f7fe700 1 -- 172.21.15.36:0/2780374314 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5800b0c90 con 0x7fe5800b4690 2022-01-10T01:34:08.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe57f7fe700 1 --2- 172.21.15.36:0/2780374314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5800b4690 0x7fe5800b4ed0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fe5780032f0 tx=0x7fe5780091d0).ready entity=mon.1 client_cookie=bf4927a53a71f7be server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:08.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe57dffb700 1 -- 172.21.15.36:0/2780374314 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe57800b6c0 con 0x7fe5800b4690 2022-01-10T01:34:08.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe57dffb700 1 -- 172.21.15.36:0/2780374314 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57800b820 con 0x7fe5800b4690 2022-01-10T01:34:08.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.612+0000 7fe57dffb700 1 -- 172.21.15.36:0/2780374314 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe57800b990 con 0x7fe5800b4690 2022-01-10T01:34:08.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 -- 172.21.15.36:0/2780374314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5800b4690 msgr2=0x7fe5800b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 --2- 172.21.15.36:0/2780374314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5800b4690 0x7fe5800b4ed0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7fe5780032f0 tx=0x7fe5780091d0).stop 2022-01-10T01:34:08.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 -- 172.21.15.36:0/2780374314 shutdown_connections 2022-01-10T01:34:08.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 --2- 172.21.15.36:0/2780374314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5800b4690 0x7fe5800b4ed0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 --2- 172.21.15.36:0/2780374314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe580146950 0x7fe580140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.629 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 -- 172.21.15.36:0/2780374314 >> 172.21.15.36:0/2780374314 conn(0x7fe58005c490 msgr2=0x7fe58005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:08.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 -- 172.21.15.36:0/2780374314 shutdown_connections 2022-01-10T01:34:08.630 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 -- 172.21.15.36:0/2780374314 wait complete. 2022-01-10T01:34:08.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 Processor -- start 2022-01-10T01:34:08.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 -- start start 2022-01-10T01:34:08.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5800b4180 0x7fe5800b8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5800b4690 0x7fe5800b90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.631 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe580146950 0x7fe5800ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5800b7df0 con 0x7fe5800b4690 2022-01-10T01:34:08.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5801531b0 con 0x7fe5800b4180 2022-01-10T01:34:08.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe58580f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe580153450 con 0x7fe580146950 2022-01-10T01:34:08.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe57e7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5800b4690 0x7fe5800b90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.632 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe57e7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5800b4690 0x7fe5800b90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43196/0 (socket says 172.21.15.36:43196) 2022-01-10T01:34:08.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe57e7fc700 1 -- 172.21.15.36:0/136423693 learned_addr learned my addr 172.21.15.36:0/136423693 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:08.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe57effd700 1 --2- 172.21.15.36:0/136423693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5800b4180 0x7fe5800b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe57f7fe700 1 --2- 172.21.15.36:0/136423693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe580146950 0x7fe5800ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.633 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe57e7fc700 1 -- 172.21.15.36:0/136423693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe580146950 msgr2=0x7fe5800ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe57e7fc700 1 --2- 172.21.15.36:0/136423693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe580146950 0x7fe5800ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe57e7fc700 1 -- 172.21.15.36:0/136423693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5800b4180 msgr2=0x7fe5800b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe57e7fc700 1 --2- 172.21.15.36:0/136423693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5800b4180 0x7fe5800b8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.616+0000 7fe57e7fc700 1 -- 172.21.15.36:0/136423693 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe578009470 con 0x7fe5800b4690 2022-01-10T01:34:08.634 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.620+0000 7fe57e7fc700 1 --2- 172.21.15.36:0/136423693 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5800b4690 0x7fe5800b90d0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fe580060c50 tx=0x7fe574007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:08.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.620+0000 7fe56ffff700 1 -- 172.21.15.36:0/136423693 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5740070d0 con 0x7fe5800b4690 2022-01-10T01:34:08.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.620+0000 7fe56ffff700 1 -- 172.21.15.36:0/136423693 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574007230 con 0x7fe5800b4690 2022-01-10T01:34:08.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.620+0000 7fe58580f700 1 -- 172.21.15.36:0/136423693 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe580142fb0 con 0x7fe5800b4690 2022-01-10T01:34:08.635 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.620+0000 7fe56ffff700 1 -- 172.21.15.36:0/136423693 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe574005610 con 0x7fe5800b4690 2022-01-10T01:34:08.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.620+0000 7fe58580f700 1 -- 172.21.15.36:0/136423693 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5800b7870 con 0x7fe5800b4690 2022-01-10T01:34:08.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.620+0000 7fe56ffff700 1 -- 172.21.15.36:0/136423693 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe574010070 con 0x7fe5800b4690 2022-01-10T01:34:08.636 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.620+0000 7fe58580f700 1 -- 172.21.15.36:0/136423693 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe580152fa0 con 0x7fe5800b4690 2022-01-10T01:34:08.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.620+0000 7fe56ffff700 1 --2- 172.21.15.36:0/136423693 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe55c053620 0x7fe55c055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.638 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.620+0000 7fe57effd700 1 --2- 172.21.15.36:0/136423693 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe55c053620 0x7fe55c055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.620+0000 7fe56ffff700 1 -- 172.21.15.36:0/136423693 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe57406aeb0 con 0x7fe5800b4690 2022-01-10T01:34:08.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.620+0000 7fe57effd700 1 --2- 172.21.15.36:0/136423693 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe55c053620 0x7fe55c055ae0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fe57000b000 tx=0x7fe570006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:08.639 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.624+0000 7fe56ffff700 1 -- 172.21.15.36:0/136423693 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe574041ec0 con 0x7fe5800b4690 2022-01-10T01:34:08.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.756+0000 7fe58580f700 1 -- 172.21.15.36:0/136423693 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe580057350 con 0x7fe5800b4690 2022-01-10T01:34:08.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.756+0000 7fe56ffff700 1 -- 172.21.15.36:0/136423693 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v159) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe5740454e0 con 0x7fe5800b4690 2022-01-10T01:34:08.766 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:34:08.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.760+0000 7fe58580f700 1 -- 172.21.15.36:0/136423693 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe55c053620 msgr2=0x7fe55c055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.760+0000 7fe58580f700 1 --2- 172.21.15.36:0/136423693 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe55c053620 0x7fe55c055ae0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fe57000b000 tx=0x7fe570006df0).stop 2022-01-10T01:34:08.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.760+0000 7fe58580f700 1 -- 172.21.15.36:0/136423693 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5800b4690 msgr2=0x7fe5800b90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.760+0000 7fe58580f700 1 --2- 172.21.15.36:0/136423693 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5800b4690 0x7fe5800b90d0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7fe580060c50 tx=0x7fe574007bd0).stop 2022-01-10T01:34:08.770 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.760+0000 7fe58580f700 1 -- 172.21.15.36:0/136423693 shutdown_connections 2022-01-10T01:34:08.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.760+0000 7fe58580f700 1 --2- 172.21.15.36:0/136423693 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe55c053620 0x7fe55c055ae0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.760+0000 7fe58580f700 1 --2- 172.21.15.36:0/136423693 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe580146950 0x7fe5800ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.771 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.760+0000 7fe58580f700 1 --2- 172.21.15.36:0/136423693 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe5800b4690 0x7fe5800b90d0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.760+0000 7fe58580f700 1 --2- 172.21.15.36:0/136423693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5800b4180 0x7fe5800b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.760+0000 7fe58580f700 1 -- 172.21.15.36:0/136423693 >> 172.21.15.36:0/136423693 conn(0x7fe58005c490 msgr2=0x7fe58013b250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:08.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.760+0000 7fe58580f700 1 -- 172.21.15.36:0/136423693 shutdown_connections 2022-01-10T01:34:08.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.760+0000 7fe58580f700 1 -- 172.21.15.36:0/136423693 wait complete. 2022-01-10T01:34:08.779 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:34:08.780 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:34:08.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.876+0000 7f9d1f4fb700 1 Processor -- start 2022-01-10T01:34:08.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.876+0000 7f9d1f4fb700 1 -- start start 2022-01-10T01:34:08.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.876+0000 7f9d1f4fb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9d180b2580 0x7f9d1814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.876+0000 7f9d1f4fb700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9d180b0010 0x7f9d1814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.888 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.876+0000 7f9d1f4fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180afbd0 0x7f9d180a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.876+0000 7f9d1f4fb700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d180a70c0 con 0x7f9d180b0010 2022-01-10T01:34:08.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.876+0000 7f9d1f4fb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d180a72f0 con 0x7f9d180b2580 2022-01-10T01:34:08.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.876+0000 7f9d1f4fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d180a7590 con 0x7f9d180afbd0 2022-01-10T01:34:08.889 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.876+0000 7f9d1dcf8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9d180b0010 0x7f9d1814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.876+0000 7f9d1dcf8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f9d180b0010 0x7f9d1814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43202/0 (socket says 172.21.15.36:43202) 2022-01-10T01:34:08.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.876+0000 7f9d1dcf8700 1 -- 172.21.15.36:0/3479909865 learned_addr learned my addr 172.21.15.36:0/3479909865 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:08.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.876+0000 7f9d1e4f9700 1 --2- 172.21.15.36:0/3479909865 >> v2:172.21.15.59:3300/0 conn(0x7f9d180b2580 0x7f9d1814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.890 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.876+0000 7f9d1ecfa700 1 --2- 172.21.15.36:0/3479909865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180afbd0 0x7f9d180a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1dcf8700 1 -- 172.21.15.36:0/3479909865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180afbd0 msgr2=0x7f9d180a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:08.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1dcf8700 1 --2- 172.21.15.36:0/3479909865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180afbd0 0x7f9d180a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1dcf8700 1 -- 172.21.15.36:0/3479909865 >> v2:172.21.15.59:3300/0 conn(0x7f9d180b2580 msgr2=0x7f9d1814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:08.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1dcf8700 1 --2- 172.21.15.36:0/3479909865 >> v2:172.21.15.59:3300/0 conn(0x7f9d180b2580 0x7f9d1814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1dcf8700 1 -- 172.21.15.36:0/3479909865 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d180a7830 con 0x7f9d180b0010 2022-01-10T01:34:08.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1ecfa700 1 --2- 172.21.15.36:0/3479909865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180afbd0 0x7f9d180a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:34:08.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1dcf8700 1 --2- 172.21.15.36:0/3479909865 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d180b0010 0x7f9d1814b330 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f9d14002f70 tx=0x7f9d14006eb0).ready entity=mon.0 client_cookie=2f6f1ddd9267ae7b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:08.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1d4f7700 1 -- 172.21.15.36:0/3479909865 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d1400d570 con 0x7f9d180b0010 2022-01-10T01:34:08.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1d4f7700 1 -- 172.21.15.36:0/3479909865 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d14000e90 con 0x7f9d180b0010 2022-01-10T01:34:08.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1d4f7700 1 -- 172.21.15.36:0/3479909865 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d1400d900 con 0x7f9d180b0010 2022-01-10T01:34:08.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/3479909865 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d180b0010 msgr2=0x7f9d1814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 --2- 172.21.15.36:0/3479909865 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d180b0010 0x7f9d1814b330 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f9d14002f70 tx=0x7f9d14006eb0).stop 2022-01-10T01:34:08.893 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/3479909865 shutdown_connections 2022-01-10T01:34:08.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 --2- 172.21.15.36:0/3479909865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180afbd0 0x7f9d180a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 --2- 172.21.15.36:0/3479909865 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d180b0010 0x7f9d1814b330 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 --2- 172.21.15.36:0/3479909865 >> v2:172.21.15.59:3300/0 conn(0x7f9d180b2580 0x7f9d1814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/3479909865 >> 172.21.15.36:0/3479909865 conn(0x7f9d18060180 msgr2=0x7f9d180b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:08.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/3479909865 shutdown_connections 2022-01-10T01:34:08.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/3479909865 wait complete. 2022-01-10T01:34:08.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 Processor -- start 2022-01-10T01:34:08.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 -- start start 2022-01-10T01:34:08.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180afbd0 0x7f9d18148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d180b0010 0x7f9d18156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d180b2580 0x7f9d18156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d180a9b00 con 0x7f9d180b0010 2022-01-10T01:34:08.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d180a9d60 con 0x7f9d180b2580 2022-01-10T01:34:08.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.880+0000 7f9d1f4fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d180aa000 con 0x7f9d180afbd0 2022-01-10T01:34:08.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d1dcf8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d180b0010 0x7f9d18156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d1dcf8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d180b0010 0x7f9d18156580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43210/0 (socket says 172.21.15.36:43210) 2022-01-10T01:34:08.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d1dcf8700 1 -- 172.21.15.36:0/995922014 learned_addr learned my addr 172.21.15.36:0/995922014 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:08.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d1e4f9700 1 --2- 172.21.15.36:0/995922014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180afbd0 0x7f9d18148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d1ecfa700 1 --2- 172.21.15.36:0/995922014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d180b2580 0x7f9d18156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d1dcf8700 1 -- 172.21.15.36:0/995922014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180afbd0 msgr2=0x7f9d18148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d1dcf8700 1 --2- 172.21.15.36:0/995922014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180afbd0 0x7f9d18148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d1dcf8700 1 -- 172.21.15.36:0/995922014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d180b2580 msgr2=0x7f9d18156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:08.901 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d1dcf8700 1 --2- 172.21.15.36:0/995922014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d180b2580 0x7f9d18156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:08.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d1dcf8700 1 -- 172.21.15.36:0/995922014 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1400b1e0 con 0x7f9d180b0010 2022-01-10T01:34:08.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d1dcf8700 1 --2- 172.21.15.36:0/995922014 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d180b0010 0x7f9d18156580 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f9d14002f70 tx=0x7f9d14015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:08.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d077fe700 1 -- 172.21.15.36:0/995922014 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d14006be0 con 0x7f9d180b0010 2022-01-10T01:34:08.902 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d077fe700 1 -- 172.21.15.36:0/995922014 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d14011b80 con 0x7f9d180b0010 2022-01-10T01:34:08.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/995922014 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1815a710 con 0x7f9d180b0010 2022-01-10T01:34:08.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d077fe700 1 -- 172.21.15.36:0/995922014 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d1401e460 con 0x7f9d180b0010 2022-01-10T01:34:08.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/995922014 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1815a2e0 con 0x7f9d180b0010 2022-01-10T01:34:08.903 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.884+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/995922014 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d18057350 con 0x7f9d180b0010 2022-01-10T01:34:08.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.888+0000 7f9d077fe700 1 -- 172.21.15.36:0/995922014 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f9d1401a040 con 0x7f9d180b0010 2022-01-10T01:34:08.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.888+0000 7f9d077fe700 1 --2- 172.21.15.36:0/995922014 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cf8053680 0x7f9cf8055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:08.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.888+0000 7f9d077fe700 1 -- 172.21.15.36:0/995922014 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f9d1406c810 con 0x7f9d180b0010 2022-01-10T01:34:08.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.888+0000 7f9d1e4f9700 1 --2- 172.21.15.36:0/995922014 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cf8053680 0x7f9cf8055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:08.904 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.888+0000 7f9d1e4f9700 1 --2- 172.21.15.36:0/995922014 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cf8053680 0x7f9cf8055b40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f9d0800b000 tx=0x7f9d08006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:08.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:08.892+0000 7f9d077fe700 1 -- 172.21.15.36:0/995922014 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9d14043860 con 0x7f9d180b0010 2022-01-10T01:34:09.060 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:09.052+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/995922014 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d180698e0 con 0x7f9d180b0010 2022-01-10T01:34:09.061 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:09.052+0000 7f9d077fe700 1 -- 172.21.15.36:0/995922014 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f9d14023090 con 0x7f9d180b0010 2022-01-10T01:34:09.062 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:09.062 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":79,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3964890182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3964890182},{"type":"v1","addr":"172.21.15.59:6833","nonce":3964890182}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77},{"gid":8733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3716636187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3716636187},{"type":"v1","addr":"172.21.15.36:6835","nonce":3716636187}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:34:04.465028+0000","modified":"2022-01-10T01:34:05.469086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8742":{"gid":8742,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/1997308230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1997308230},{"type":"v1","addr":"172.21.15.36:6837","nonce":1997308230}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2022-01-10T01:34:09.063 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:09.056+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/995922014 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cf8053680 msgr2=0x7f9cf8055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:09.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:09.056+0000 7f9d1f4fb700 1 --2- 172.21.15.36:0/995922014 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cf8053680 0x7f9cf8055b40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f9d0800b000 tx=0x7f9d08006df0).stop 2022-01-10T01:34:09.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:09.056+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/995922014 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d180b0010 msgr2=0x7f9d18156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:09.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:09.056+0000 7f9d1f4fb700 1 --2- 172.21.15.36:0/995922014 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d180b0010 0x7f9d18156580 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f9d14002f70 tx=0x7f9d14015000).stop 2022-01-10T01:34:09.064 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:09.056+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/995922014 shutdown_connections 2022-01-10T01:34:09.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:09.056+0000 7f9d1f4fb700 1 --2- 172.21.15.36:0/995922014 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f9cf8053680 0x7f9cf8055b40 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:09.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:09.056+0000 7f9d1f4fb700 1 --2- 172.21.15.36:0/995922014 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d180b2580 0x7f9d18156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:09.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:09.056+0000 7f9d1f4fb700 1 --2- 172.21.15.36:0/995922014 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f9d180b0010 0x7f9d18156580 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:09.065 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:09.056+0000 7f9d1f4fb700 1 --2- 172.21.15.36:0/995922014 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d180afbd0 0x7f9d18148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:09.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:09.056+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/995922014 >> 172.21.15.36:0/995922014 conn(0x7f9d18060180 msgr2=0x7f9d1814a040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:09.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:09.056+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/995922014 shutdown_connections 2022-01-10T01:34:09.066 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:09.056+0000 7f9d1f4fb700 1 -- 172.21.15.36:0/995922014 wait complete. 2022-01-10T01:34:09.067 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 79 2022-01-10T01:34:09.376 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:34:04.465028+0000', 'modified': '2022-01-10T01:34:05.469086+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8742}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8742': {'gid': 8742, 'name': 'a', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6837/1997308230', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6836', 'nonce': 1997308230}, {'type': 'v1', 'addr': '172.21.15.36:6837', 'nonce': 1997308230}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:34:09.377 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:34:09.378 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-10T01:34:09.496 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":8742,"want_state":"up:active","state":"up:active","rank_uptime":5.0148437540000002,"mdsmap_epoch":79,"osdmap_epoch":159,"osdmap_epoch_barrier":158,"uptime":10.005600335} 2022-01-10T01:34:09.496 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 8742, "mdsmap_epoch": 79, "osdmap_epoch": 159, "osdmap_epoch_barrier": 158, "rank_uptime": 5.014843754, "state": "up:active", "uptime": 10.005600335, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:34:09.497 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:34:09.497 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2022-01-10T01:34:09.498 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi139.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2022-01-10T01:34:09.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:09.499 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:34:09.508 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:34:09.569 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:34:09.569 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:34:09.583 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:34:09.584 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:34:09.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:09.586 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:34:09.591 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:34:09.592 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:34:09.594 DEBUG:teuthology.orchestra.run.smithi139:> sudo modprobe fuse 2022-01-10T01:34:09.612 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:34:09.612 DEBUG:teuthology.orchestra.run.smithi139:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:34:09.667 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:2022-01-10T01:34:09.662+0000 7f6b34192080 -1 init, newargv = 0x5602eefa4ce0 newargc=9 2022-01-10T01:34:09.668 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[15375]: starting ceph client 2022-01-10T01:34:09.672 INFO:teuthology.orchestra.run.smithi139.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:34:09.672 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:34:09.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:09.674 DEBUG:teuthology.orchestra.run.smithi139:> ls /sys/fs/fuse/connections 2022-01-10T01:34:09.678 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi139.stderr:ceph-fuse[15375]: starting fuse 2022-01-10T01:34:09.679 INFO:teuthology.orchestra.run.smithi139.stdout:52 2022-01-10T01:34:09.679 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:34:09.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:09.680 DEBUG:teuthology.orchestra.run.smithi139:> sudo python3 -c ' 2022-01-10T01:34:09.681 DEBUG:teuthology.orchestra.run.smithi139:> import glob 2022-01-10T01:34:09.681 DEBUG:teuthology.orchestra.run.smithi139:> import re 2022-01-10T01:34:09.682 DEBUG:teuthology.orchestra.run.smithi139:> import os 2022-01-10T01:34:09.682 DEBUG:teuthology.orchestra.run.smithi139:> import subprocess 2022-01-10T01:34:09.682 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:34:09.683 DEBUG:teuthology.orchestra.run.smithi139:> def find_socket(client_name): 2022-01-10T01:34:09.683 DEBUG:teuthology.orchestra.run.smithi139:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2022-01-10T01:34:09.684 DEBUG:teuthology.orchestra.run.smithi139:> files = glob.glob(asok_path) 2022-01-10T01:34:09.684 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:34:09.685 DEBUG:teuthology.orchestra.run.smithi139:> # Given a non-glob path, it better be there 2022-01-10T01:34:09.685 DEBUG:teuthology.orchestra.run.smithi139:> if "*" not in asok_path: 2022-01-10T01:34:09.685 DEBUG:teuthology.orchestra.run.smithi139:> assert(len(files) == 1) 2022-01-10T01:34:09.686 DEBUG:teuthology.orchestra.run.smithi139:> return files[0] 2022-01-10T01:34:09.686 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:34:09.687 DEBUG:teuthology.orchestra.run.smithi139:> for f in files: 2022-01-10T01:34:09.687 DEBUG:teuthology.orchestra.run.smithi139:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:34:09.687 DEBUG:teuthology.orchestra.run.smithi139:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:34:09.688 DEBUG:teuthology.orchestra.run.smithi139:> return f 2022-01-10T01:34:09.688 DEBUG:teuthology.orchestra.run.smithi139:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:34:09.689 DEBUG:teuthology.orchestra.run.smithi139:> 2022-01-10T01:34:09.689 DEBUG:teuthology.orchestra.run.smithi139:> print(find_socket("client.0")) 2022-01-10T01:34:09.689 DEBUG:teuthology.orchestra.run.smithi139:> ' 2022-01-10T01:34:09.729 INFO:teuthology.orchestra.run.smithi139.stdout:/var/run/ceph/ceph-client.0.15375.asok 2022-01-10T01:34:09.734 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.15375.asok 2022-01-10T01:34:09.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:09.735 DEBUG:teuthology.orchestra.run.smithi139:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.15375.asok status 2022-01-10T01:34:09.870 INFO:teuthology.orchestra.run.smithi139.stdout:{ 2022-01-10T01:34:09.870 INFO:teuthology.orchestra.run.smithi139.stdout: "metadata": { 2022-01-10T01:34:09.871 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:34:09.871 INFO:teuthology.orchestra.run.smithi139.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:34:09.871 INFO:teuthology.orchestra.run.smithi139.stdout: "entity_id": "0", 2022-01-10T01:34:09.871 INFO:teuthology.orchestra.run.smithi139.stdout: "hostname": "smithi139", 2022-01-10T01:34:09.872 INFO:teuthology.orchestra.run.smithi139.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2022-01-10T01:34:09.872 INFO:teuthology.orchestra.run.smithi139.stdout: "pid": "15375", 2022-01-10T01:34:09.872 INFO:teuthology.orchestra.run.smithi139.stdout: "root": "/" 2022-01-10T01:34:09.872 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:34:09.872 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_count": 0, 2022-01-10T01:34:09.873 INFO:teuthology.orchestra.run.smithi139.stdout: "dentry_pinned_count": 0, 2022-01-10T01:34:09.873 INFO:teuthology.orchestra.run.smithi139.stdout: "id": 37547, 2022-01-10T01:34:09.873 INFO:teuthology.orchestra.run.smithi139.stdout: "inst": { 2022-01-10T01:34:09.873 INFO:teuthology.orchestra.run.smithi139.stdout: "name": { 2022-01-10T01:34:09.874 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "client", 2022-01-10T01:34:09.874 INFO:teuthology.orchestra.run.smithi139.stdout: "num": 37547 2022-01-10T01:34:09.874 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:34:09.874 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:34:09.874 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:34:09.875 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:34:09.875 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 188746048 2022-01-10T01:34:09.875 INFO:teuthology.orchestra.run.smithi139.stdout: } 2022-01-10T01:34:09.875 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:34:09.876 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": { 2022-01-10T01:34:09.876 INFO:teuthology.orchestra.run.smithi139.stdout: "type": "v1", 2022-01-10T01:34:09.876 INFO:teuthology.orchestra.run.smithi139.stdout: "addr": "172.21.15.139:0", 2022-01-10T01:34:09.876 INFO:teuthology.orchestra.run.smithi139.stdout: "nonce": 188746048 2022-01-10T01:34:09.876 INFO:teuthology.orchestra.run.smithi139.stdout: }, 2022-01-10T01:34:09.877 INFO:teuthology.orchestra.run.smithi139.stdout: "inst_str": "client.37547 172.21.15.139:0/188746048", 2022-01-10T01:34:09.877 INFO:teuthology.orchestra.run.smithi139.stdout: "addr_str": "172.21.15.139:0/188746048", 2022-01-10T01:34:09.877 INFO:teuthology.orchestra.run.smithi139.stdout: "inode_count": 1, 2022-01-10T01:34:09.877 INFO:teuthology.orchestra.run.smithi139.stdout: "mds_epoch": 79, 2022-01-10T01:34:09.877 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch": 159, 2022-01-10T01:34:09.878 INFO:teuthology.orchestra.run.smithi139.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:34:09.878 INFO:teuthology.orchestra.run.smithi139.stdout: "blacklisted": false, 2022-01-10T01:34:09.878 INFO:teuthology.orchestra.run.smithi139.stdout: "fs_name": "cephfs" 2022-01-10T01:34:09.878 INFO:teuthology.orchestra.run.smithi139.stdout:} 2022-01-10T01:34:09.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:09.880 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:34:09.881 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:34:09.888 INFO:teuthology.orchestra.run.smithi139.stdout:fuseblk 2022-01-10T01:34:09.889 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2022-01-10T01:34:09.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:09.890 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:34:09.905 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T01:34:10.015 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe17dbe8700 1 Processor -- start 2022-01-10T01:34:10.016 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe17dbe8700 1 -- start start 2022-01-10T01:34:10.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe17dbe8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1780b43c0 0x7fe1780b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe17dbe8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780b6960 0x7fe17812ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe17dbe8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1781440b0 con 0x7fe1780b6580 2022-01-10T01:34:10.018 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe17dbe8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe178143b70 con 0x7fe1780b43c0 2022-01-10T01:34:10.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe17dbe8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe178143e10 con 0x7fe1780b6960 2022-01-10T01:34:10.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe176ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1780b43c0 0x7fe1780b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe177fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780b6960 0x7fe17812ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.019 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe176ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1780b43c0 0x7fe1780b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:39850/0 (socket says 172.21.15.36:39850) 2022-01-10T01:34:10.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe176ffd700 1 -- 172.21.15.36:0/2499812712 learned_addr learned my addr 172.21.15.36:0/2499812712 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:10.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe1777fe700 1 --1- 172.21.15.36:0/2499812712 >> v1:172.21.15.59:6789/0 conn(0x7fe1780b6580 0x7fe178061d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:58686/0 (socket says 172.21.15.36:58686) 2022-01-10T01:34:10.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe176ffd700 1 -- 172.21.15.36:0/2499812712 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780b6960 msgr2=0x7fe17812ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:10.020 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe176ffd700 1 --2- 172.21.15.36:0/2499812712 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780b6960 0x7fe17812ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe176ffd700 1 -- 172.21.15.36:0/2499812712 >> v1:172.21.15.59:6789/0 conn(0x7fe1780b6580 legacy=0x7fe178061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe176ffd700 1 -- 172.21.15.36:0/2499812712 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1780615f0 con 0x7fe1780b43c0 2022-01-10T01:34:10.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe177fff700 1 --2- 172.21.15.36:0/2499812712 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780b6960 0x7fe17812ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:34:10.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe176ffd700 1 --2- 172.21.15.36:0/2499812712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1780b43c0 0x7fe1780b5bf0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fe178143120 tx=0x7fe16c006eb0).ready entity=mon.1 client_cookie=fc4c4c177901da39 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:10.021 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe1767fc700 1 -- 172.21.15.36:0/2499812712 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe16c00d5c0 con 0x7fe1780b43c0 2022-01-10T01:34:10.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe1767fc700 1 -- 172.21.15.36:0/2499812712 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c000e90 con 0x7fe1780b43c0 2022-01-10T01:34:10.022 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.008+0000 7fe1767fc700 1 -- 172.21.15.36:0/2499812712 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe16c00d950 con 0x7fe1780b43c0 2022-01-10T01:34:10.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.012+0000 7fe17dbe8700 1 -- 172.21.15.36:0/2499812712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1780b43c0 msgr2=0x7fe1780b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.025 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.012+0000 7fe17dbe8700 1 --2- 172.21.15.36:0/2499812712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1780b43c0 0x7fe1780b5bf0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fe178143120 tx=0x7fe16c006eb0).stop 2022-01-10T01:34:10.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.012+0000 7fe17dbe8700 1 -- 172.21.15.36:0/2499812712 shutdown_connections 2022-01-10T01:34:10.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.012+0000 7fe17dbe8700 1 --2- 172.21.15.36:0/2499812712 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780b6960 0x7fe17812ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.012+0000 7fe17dbe8700 1 --2- 172.21.15.36:0/2499812712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1780b43c0 0x7fe1780b5bf0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.026 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.012+0000 7fe17dbe8700 1 -- 172.21.15.36:0/2499812712 >> 172.21.15.36:0/2499812712 conn(0x7fe17805c490 msgr2=0x7fe17805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:10.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.012+0000 7fe17dbe8700 1 -- 172.21.15.36:0/2499812712 shutdown_connections 2022-01-10T01:34:10.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.012+0000 7fe17dbe8700 1 -- 172.21.15.36:0/2499812712 wait complete. 2022-01-10T01:34:10.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.012+0000 7fe17dbe8700 1 Processor -- start 2022-01-10T01:34:10.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.012+0000 7fe17dbe8700 1 -- start start 2022-01-10T01:34:10.027 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe17dbe8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1780b43c0 0x7fe178129ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe17dbe8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780b6580 0x7fe1781558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe17dbe8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1780b6960 0x7fe178155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe17dbe8700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17812aab0 con 0x7fe1780b6960 2022-01-10T01:34:10.028 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe17dbe8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17812b600 con 0x7fe1780b43c0 2022-01-10T01:34:10.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe17dbe8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17812b860 con 0x7fe1780b6580 2022-01-10T01:34:10.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe177fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1780b6960 0x7fe178155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe177fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1780b6960 0x7fe178155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43226/0 (socket says 172.21.15.36:43226) 2022-01-10T01:34:10.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe177fff700 1 -- 172.21.15.36:0/3555327804 learned_addr learned my addr 172.21.15.36:0/3555327804 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:10.029 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe1777fe700 1 --2- 172.21.15.36:0/3555327804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1780b43c0 0x7fe178129ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe176ffd700 1 --2- 172.21.15.36:0/3555327804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780b6580 0x7fe1781558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe177fff700 1 -- 172.21.15.36:0/3555327804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780b6580 msgr2=0x7fe1781558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe177fff700 1 --2- 172.21.15.36:0/3555327804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780b6580 0x7fe1781558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.030 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe177fff700 1 -- 172.21.15.36:0/3555327804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1780b43c0 msgr2=0x7fe178129ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe177fff700 1 --2- 172.21.15.36:0/3555327804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1780b43c0 0x7fe178129ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe177fff700 1 -- 172.21.15.36:0/3555327804 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe170009470 con 0x7fe1780b6960 2022-01-10T01:34:10.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe177fff700 1 --2- 172.21.15.36:0/3555327804 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1780b6960 0x7fe178155da0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7fe17000c000 tx=0x7fe1700091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:10.031 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe174ff9700 1 -- 172.21.15.36:0/3555327804 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17000c850 con 0x7fe1780b6960 2022-01-10T01:34:10.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe174ff9700 1 -- 172.21.15.36:0/3555327804 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17000c9b0 con 0x7fe1780b6960 2022-01-10T01:34:10.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe17dbe8700 1 -- 172.21.15.36:0/3555327804 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16c00b1e0 con 0x7fe1780b6960 2022-01-10T01:34:10.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe174ff9700 1 -- 172.21.15.36:0/3555327804 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe17000cd10 con 0x7fe1780b6960 2022-01-10T01:34:10.032 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe17dbe8700 1 -- 172.21.15.36:0/3555327804 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe178153210 con 0x7fe1780b6960 2022-01-10T01:34:10.033 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe17dbe8700 1 -- 172.21.15.36:0/3555327804 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe178061890 con 0x7fe1780b6960 2022-01-10T01:34:10.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.016+0000 7fe174ff9700 1 -- 172.21.15.36:0/3555327804 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe170022070 con 0x7fe1780b6960 2022-01-10T01:34:10.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.020+0000 7fe174ff9700 1 --2- 172.21.15.36:0/3555327804 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe1580534d0 0x7fe158055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.020+0000 7fe174ff9700 1 -- 172.21.15.36:0/3555327804 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fe17006c290 con 0x7fe1780b6960 2022-01-10T01:34:10.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.020+0000 7fe1777fe700 1 --2- 172.21.15.36:0/3555327804 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe1580534d0 0x7fe158055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.020+0000 7fe1777fe700 1 --2- 172.21.15.36:0/3555327804 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe1580534d0 0x7fe158055990 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fe16800d000 tx=0x7fe168007b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:10.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.024+0000 7fe174ff9700 1 -- 172.21.15.36:0/3555327804 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fe170043200 con 0x7fe1780b6960 2022-01-10T01:34:10.163 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.156+0000 7fe17dbe8700 1 -- 172.21.15.36:0/3555327804 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe178057350 con 0x7fe1780b6960 2022-01-10T01:34:10.165 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.156+0000 7fe174ff9700 1 -- 172.21.15.36:0/3555327804 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16285 (secure 0 0 0) 0x7fe170046820 con 0x7fe1780b6960 2022-01-10T01:34:10.166 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:10.166 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":159,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:34:05.469195+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2022-01-10T01:34:02.282468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2022-01-10T01:34:03.465498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T01:34:10.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.160+0000 7fe17dbe8700 1 -- 172.21.15.36:0/3555327804 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe1580534d0 msgr2=0x7fe158055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.160+0000 7fe17dbe8700 1 --2- 172.21.15.36:0/3555327804 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe1580534d0 0x7fe158055990 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fe16800d000 tx=0x7fe168007b80).stop 2022-01-10T01:34:10.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.160+0000 7fe17dbe8700 1 -- 172.21.15.36:0/3555327804 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1780b6960 msgr2=0x7fe178155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.160+0000 7fe17dbe8700 1 --2- 172.21.15.36:0/3555327804 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1780b6960 0x7fe178155da0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7fe17000c000 tx=0x7fe1700091d0).stop 2022-01-10T01:34:10.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.160+0000 7fe17dbe8700 1 -- 172.21.15.36:0/3555327804 shutdown_connections 2022-01-10T01:34:10.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.160+0000 7fe17dbe8700 1 --2- 172.21.15.36:0/3555327804 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe1580534d0 0x7fe158055990 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.169 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.160+0000 7fe17dbe8700 1 --2- 172.21.15.36:0/3555327804 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1780b6960 0x7fe178155da0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.160+0000 7fe17dbe8700 1 --2- 172.21.15.36:0/3555327804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780b6580 0x7fe1781558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.160+0000 7fe17dbe8700 1 --2- 172.21.15.36:0/3555327804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1780b43c0 0x7fe178129ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.160+0000 7fe17dbe8700 1 -- 172.21.15.36:0/3555327804 >> 172.21.15.36:0/3555327804 conn(0x7fe17805c490 msgr2=0x7fe178128940 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:10.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.160+0000 7fe17dbe8700 1 -- 172.21.15.36:0/3555327804 shutdown_connections 2022-01-10T01:34:10.170 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.160+0000 7fe17dbe8700 1 -- 172.21.15.36:0/3555327804 wait complete. 2022-01-10T01:34:10.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-01-10T01:24:08.421647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-01-10T01:24:17.709769+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2022-01-10T01:34:02.282468+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '158', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2022-01-10T01:34:03.465498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-01-10T01:34:10.180 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-01-10T01:34:10.295 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15ed283700 1 Processor -- start 2022-01-10T01:34:10.296 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15ed283700 1 -- start start 2022-01-10T01:34:10.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15ed283700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f15e80a8ac0 0x7f15e8152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15ed283700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e80a70c0 con 0x7f15e80b2580 2022-01-10T01:34:10.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15ed283700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e80a72f0 con 0x7f15e80b0010 2022-01-10T01:34:10.299 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15ed283700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e80a7590 con 0x7f15e80a8ac0 2022-01-10T01:34:10.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15eca82700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f15e80a8ac0 0x7f15e8152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15e7fff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f15e80b2580 0x7f15e814ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:41024/0 (socket says 172.21.15.36:41024) 2022-01-10T01:34:10.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15e7fff700 1 -- 172.21.15.36:0/1118149548 learned_addr learned my addr 172.21.15.36:0/1118149548 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:10.300 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15eca82700 1 -- 172.21.15.36:0/1118149548 >> v1:172.21.15.59:6789/0 conn(0x7f15e80b0010 legacy=0x7f15e80a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15eca82700 1 -- 172.21.15.36:0/1118149548 >> v1:172.21.15.36:6789/0 conn(0x7f15e80b2580 legacy=0x7f15e814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15eca82700 1 -- 172.21.15.36:0/1118149548 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e80a7830 con 0x7f15e80a8ac0 2022-01-10T01:34:10.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15eca82700 1 --2- 172.21.15.36:0/1118149548 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15e80a8ac0 0x7f15e8152be0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f15e0002f70 tx=0x7f15e0006df0).ready entity=mon.0 client_cookie=292ad8db535b6dd4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:10.301 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15e6ffd700 1 -- 172.21.15.36:0/1118149548 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e000d610 con 0x7f15e80a8ac0 2022-01-10T01:34:10.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15e6ffd700 1 -- 172.21.15.36:0/1118149548 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e0000e90 con 0x7f15e80a8ac0 2022-01-10T01:34:10.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.288+0000 7f15e6ffd700 1 -- 172.21.15.36:0/1118149548 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e000d960 con 0x7f15e80a8ac0 2022-01-10T01:34:10.302 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 -- 172.21.15.36:0/1118149548 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15e80a8ac0 msgr2=0x7f15e8152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 --2- 172.21.15.36:0/1118149548 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15e80a8ac0 0x7f15e8152be0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f15e0002f70 tx=0x7f15e0006df0).stop 2022-01-10T01:34:10.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 -- 172.21.15.36:0/1118149548 shutdown_connections 2022-01-10T01:34:10.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 --2- 172.21.15.36:0/1118149548 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15e80a8ac0 0x7f15e8152be0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.303 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 -- 172.21.15.36:0/1118149548 >> 172.21.15.36:0/1118149548 conn(0x7f15e8060180 msgr2=0x7f15e80b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:10.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 -- 172.21.15.36:0/1118149548 shutdown_connections 2022-01-10T01:34:10.304 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 -- 172.21.15.36:0/1118149548 wait complete. 2022-01-10T01:34:10.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 Processor -- start 2022-01-10T01:34:10.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 -- start start 2022-01-10T01:34:10.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e80a8ac0 0x7f15e8066130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15e80b0010 0x7f15e8066620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e80b2580 0x7f15e80b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.309 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8066b10 con 0x7f15e80b0010 2022-01-10T01:34:10.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e80b5fe0 con 0x7f15e80a8ac0 2022-01-10T01:34:10.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15ed283700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e81570c0 con 0x7f15e80b2580 2022-01-10T01:34:10.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15e77fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15e80b0010 0x7f15e8066620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.310 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15e7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e80a8ac0 0x7f15e8066130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15eca82700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e80b2580 0x7f15e80b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15e7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e80a8ac0 0x7f15e8066130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:39870/0 (socket says 172.21.15.36:39870) 2022-01-10T01:34:10.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.292+0000 7f15e7fff700 1 -- 172.21.15.36:0/4177153857 learned_addr learned my addr 172.21.15.36:0/4177153857 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:10.311 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15eca82700 1 -- 172.21.15.36:0/4177153857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e80a8ac0 msgr2=0x7f15e8066130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15eca82700 1 --2- 172.21.15.36:0/4177153857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e80a8ac0 0x7f15e8066130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15eca82700 1 -- 172.21.15.36:0/4177153857 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15e80b0010 msgr2=0x7f15e8066620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15eca82700 1 --2- 172.21.15.36:0/4177153857 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15e80b0010 0x7f15e8066620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.312 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15eca82700 1 -- 172.21.15.36:0/4177153857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e000b180 con 0x7f15e80b2580 2022-01-10T01:34:10.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15e77fe700 1 --2- 172.21.15.36:0/4177153857 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15e80b0010 0x7f15e8066620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:34:10.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15eca82700 1 --2- 172.21.15.36:0/4177153857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e80b2580 0x7f15e80b3de0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f15e8065d40 tx=0x7f15e0015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:10.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15e57fa700 1 -- 172.21.15.36:0/4177153857 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e000d990 con 0x7f15e80b2580 2022-01-10T01:34:10.313 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15e57fa700 1 -- 172.21.15.36:0/4177153857 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e0011b40 con 0x7f15e80b2580 2022-01-10T01:34:10.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15ed283700 1 -- 172.21.15.36:0/4177153857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e8066d20 con 0x7f15e80b2580 2022-01-10T01:34:10.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15e57fa700 1 -- 172.21.15.36:0/4177153857 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f15e0011ea0 con 0x7f15e80b2580 2022-01-10T01:34:10.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15ed283700 1 -- 172.21.15.36:0/4177153857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e81575c0 con 0x7f15e80b2580 2022-01-10T01:34:10.314 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15ed283700 1 -- 172.21.15.36:0/4177153857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e8057350 con 0x7f15e80b2580 2022-01-10T01:34:10.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15e57fa700 1 -- 172.21.15.36:0/4177153857 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f15e001a040 con 0x7f15e80b2580 2022-01-10T01:34:10.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15e57fa700 1 --2- 172.21.15.36:0/4177153857 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15cc053680 0x7f15cc055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15e57fa700 1 -- 172.21.15.36:0/4177153857 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f15e006cae0 con 0x7f15e80b2580 2022-01-10T01:34:10.315 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.296+0000 7f15e7fff700 1 --2- 172.21.15.36:0/4177153857 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15cc053680 0x7f15cc055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.300+0000 7f15e7fff700 1 --2- 172.21.15.36:0/4177153857 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15cc053680 0x7f15cc055b40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f15d800d000 tx=0x7f15d8007f90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:10.316 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.304+0000 7f15e57fa700 1 -- 172.21.15.36:0/4177153857 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f15e0043a70 con 0x7f15e80b2580 2022-01-10T01:34:10.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.436+0000 7f15ed283700 1 -- 172.21.15.36:0/4177153857 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f15e80698e0 con 0x7f15e80b2580 2022-01-10T01:34:10.447 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.440+0000 7f15e57fa700 1 -- 172.21.15.36:0/4177153857 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v159) v1 ==== 110+0+10 (secure 0 0 0) 0x7f15e0047090 con 0x7f15e80b2580 2022-01-10T01:34:10.447 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 1 2022-01-10T01:34:10.449 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.440+0000 7f15ed283700 1 -- 172.21.15.36:0/4177153857 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15cc053680 msgr2=0x7f15cc055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.440+0000 7f15ed283700 1 --2- 172.21.15.36:0/4177153857 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15cc053680 0x7f15cc055b40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f15d800d000 tx=0x7f15d8007f90).stop 2022-01-10T01:34:10.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.440+0000 7f15ed283700 1 -- 172.21.15.36:0/4177153857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e80b2580 msgr2=0x7f15e80b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.450 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.440+0000 7f15ed283700 1 --2- 172.21.15.36:0/4177153857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e80b2580 0x7f15e80b3de0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f15e8065d40 tx=0x7f15e0015000).stop 2022-01-10T01:34:10.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.440+0000 7f15ed283700 1 -- 172.21.15.36:0/4177153857 shutdown_connections 2022-01-10T01:34:10.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.440+0000 7f15ed283700 1 --2- 172.21.15.36:0/4177153857 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f15cc053680 0x7f15cc055b40 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.440+0000 7f15ed283700 1 --2- 172.21.15.36:0/4177153857 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15e80b2580 0x7f15e80b3de0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.451 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.440+0000 7f15ed283700 1 --2- 172.21.15.36:0/4177153857 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15e80b0010 0x7f15e8066620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.440+0000 7f15ed283700 1 --2- 172.21.15.36:0/4177153857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15e80a8ac0 0x7f15e8066130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.440+0000 7f15ed283700 1 -- 172.21.15.36:0/4177153857 >> 172.21.15.36:0/4177153857 conn(0x7f15e8060180 msgr2=0x7f15e8067550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:10.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.440+0000 7f15ed283700 1 -- 172.21.15.36:0/4177153857 shutdown_connections 2022-01-10T01:34:10.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.440+0000 7f15ed283700 1 -- 172.21.15.36:0/4177153857 wait complete. 2022-01-10T01:34:10.460 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-01-10T01:34:10.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.564+0000 7fc2c6129700 1 Processor -- start 2022-01-10T01:34:10.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.564+0000 7fc2c6129700 1 -- start start 2022-01-10T01:34:10.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.564+0000 7fc2c6129700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc2c00638d0 0x7fc2c0061ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.564+0000 7fc2c6129700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc2c00b17b0 0x7fc2c013df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.564+0000 7fc2c6129700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c013e420 0x7fc2c0141330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.564+0000 7fc2c6129700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c00b0f40 con 0x7fc2c00638d0 2022-01-10T01:34:10.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.564+0000 7fc2c6129700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c0063cb0 con 0x7fc2c00b17b0 2022-01-10T01:34:10.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.564+0000 7fc2c6129700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c0060070 con 0x7fc2c013e420 2022-01-10T01:34:10.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.564+0000 7fc2c5127700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc2c00638d0 0x7fc2c0061ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.564+0000 7fc2c5127700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fc2c00638d0 0x7fc2c0061ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43244/0 (socket says 172.21.15.36:43244) 2022-01-10T01:34:10.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.564+0000 7fc2c5127700 1 -- 172.21.15.36:0/1450199120 learned_addr learned my addr 172.21.15.36:0/1450199120 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:10.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.564+0000 7fc2c5928700 1 --2- 172.21.15.36:0/1450199120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c013e420 0x7fc2c0141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.564+0000 7fc2c4926700 1 --2- 172.21.15.36:0/1450199120 >> v2:172.21.15.59:3300/0 conn(0x7fc2c00b17b0 0x7fc2c013df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.578 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c5127700 1 -- 172.21.15.36:0/1450199120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c013e420 msgr2=0x7fc2c0141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:10.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c5127700 1 --2- 172.21.15.36:0/1450199120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c013e420 0x7fc2c0141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c5127700 1 -- 172.21.15.36:0/1450199120 >> v2:172.21.15.59:3300/0 conn(0x7fc2c00b17b0 msgr2=0x7fc2c013df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:10.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c5127700 1 --2- 172.21.15.36:0/1450199120 >> v2:172.21.15.59:3300/0 conn(0x7fc2c00b17b0 0x7fc2c013df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.579 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c5127700 1 -- 172.21.15.36:0/1450199120 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c00b1170 con 0x7fc2c00638d0 2022-01-10T01:34:10.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c5127700 1 --2- 172.21.15.36:0/1450199120 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2c00638d0 0x7fc2c0061ec0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7fc2bc002f70 tx=0x7fc2bc006eb0).ready entity=mon.0 client_cookie=2db54a20fb5a169 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:10.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2b7fff700 1 -- 172.21.15.36:0/1450199120 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2bc00d570 con 0x7fc2c00638d0 2022-01-10T01:34:10.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2b7fff700 1 -- 172.21.15.36:0/1450199120 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc000e90 con 0x7fc2c00638d0 2022-01-10T01:34:10.580 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2b7fff700 1 -- 172.21.15.36:0/1450199120 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2bc00d900 con 0x7fc2c00638d0 2022-01-10T01:34:10.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c6129700 1 -- 172.21.15.36:0/1450199120 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2c00638d0 msgr2=0x7fc2c0061ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c6129700 1 --2- 172.21.15.36:0/1450199120 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2c00638d0 0x7fc2c0061ec0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7fc2bc002f70 tx=0x7fc2bc006eb0).stop 2022-01-10T01:34:10.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c6129700 1 -- 172.21.15.36:0/1450199120 shutdown_connections 2022-01-10T01:34:10.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c6129700 1 --2- 172.21.15.36:0/1450199120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c013e420 0x7fc2c0141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c6129700 1 --2- 172.21.15.36:0/1450199120 >> v2:172.21.15.59:3300/0 conn(0x7fc2c00b17b0 0x7fc2c013df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c6129700 1 --2- 172.21.15.36:0/1450199120 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2c00638d0 0x7fc2c0061ec0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c6129700 1 -- 172.21.15.36:0/1450199120 >> 172.21.15.36:0/1450199120 conn(0x7fc2c005c490 msgr2=0x7fc2c005c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:10.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c6129700 1 -- 172.21.15.36:0/1450199120 shutdown_connections 2022-01-10T01:34:10.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.568+0000 7fc2c6129700 1 -- 172.21.15.36:0/1450199120 wait complete. 2022-01-10T01:34:10.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c6129700 1 Processor -- start 2022-01-10T01:34:10.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c6129700 1 -- start start 2022-01-10T01:34:10.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c6129700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2c00638d0 0x7fc2c013af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c6129700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c00b17b0 0x7fc2c0139d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c6129700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2c013e420 0x7fc2c0138bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c6129700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c0065a20 con 0x7fc2c013e420 2022-01-10T01:34:10.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c6129700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c00618e0 con 0x7fc2c00638d0 2022-01-10T01:34:10.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c6129700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c0155970 con 0x7fc2c00b17b0 2022-01-10T01:34:10.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c5928700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2c013e420 0x7fc2c0138bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c5928700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2c013e420 0x7fc2c0138bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43254/0 (socket says 172.21.15.36:43254) 2022-01-10T01:34:10.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c5928700 1 -- 172.21.15.36:0/102515905 learned_addr learned my addr 172.21.15.36:0/102515905 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:10.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c5127700 1 --2- 172.21.15.36:0/102515905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2c00638d0 0x7fc2c013af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c4926700 1 --2- 172.21.15.36:0/102515905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c00b17b0 0x7fc2c0139d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c5928700 1 -- 172.21.15.36:0/102515905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c00b17b0 msgr2=0x7fc2c0139d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c5928700 1 --2- 172.21.15.36:0/102515905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c00b17b0 0x7fc2c0139d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c5928700 1 -- 172.21.15.36:0/102515905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2c00638d0 msgr2=0x7fc2c013af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c5928700 1 --2- 172.21.15.36:0/102515905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2c00638d0 0x7fc2c013af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c5928700 1 -- 172.21.15.36:0/102515905 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc00b1e0 con 0x7fc2c013e420 2022-01-10T01:34:10.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c5928700 1 --2- 172.21.15.36:0/102515905 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2c013e420 0x7fc2c0138bc0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7fc2c0152450 tx=0x7fc2b80091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:10.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2b67fc700 1 -- 172.21.15.36:0/102515905 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2b800ee70 con 0x7fc2c013e420 2022-01-10T01:34:10.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2b67fc700 1 -- 172.21.15.36:0/102515905 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b800c7f0 con 0x7fc2c013e420 2022-01-10T01:34:10.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2b67fc700 1 -- 172.21.15.36:0/102515905 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2b800cb50 con 0x7fc2c013e420 2022-01-10T01:34:10.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c6129700 1 -- 172.21.15.36:0/102515905 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c0066540 con 0x7fc2c013e420 2022-01-10T01:34:10.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.572+0000 7fc2c6129700 1 -- 172.21.15.36:0/102515905 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c0066d20 con 0x7fc2c013e420 2022-01-10T01:34:10.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.576+0000 7fc2c6129700 1 -- 172.21.15.36:0/102515905 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c00b1410 con 0x7fc2c013e420 2022-01-10T01:34:10.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.576+0000 7fc2b67fc700 1 -- 172.21.15.36:0/102515905 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fc2b8022070 con 0x7fc2c013e420 2022-01-10T01:34:10.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.576+0000 7fc2b67fc700 1 --2- 172.21.15.36:0/102515905 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc2a80536b0 0x7fc2a8055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.576+0000 7fc2b67fc700 1 -- 172.21.15.36:0/102515905 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fc2b806c170 con 0x7fc2c013e420 2022-01-10T01:34:10.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.576+0000 7fc2c5127700 1 --2- 172.21.15.36:0/102515905 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc2a80536b0 0x7fc2a8055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.576+0000 7fc2c5127700 1 --2- 172.21.15.36:0/102515905 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc2a80536b0 0x7fc2a8055b70 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7fc2bc01c000 tx=0x7fc2bc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:10.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.584+0000 7fc2b67fc700 1 -- 172.21.15.36:0/102515905 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fc2b8042ff0 con 0x7fc2c013e420 2022-01-10T01:34:10.722 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.712+0000 7fc2c6129700 1 -- 172.21.15.36:0/102515905 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc2c0057350 con 0x7fc2c013e420 2022-01-10T01:34:10.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.716+0000 7fc2b67fc700 1 -- 172.21.15.36:0/102515905 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v159) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc2b80160a0 con 0x7fc2c013e420 2022-01-10T01:34:10.723 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:34:10.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.716+0000 7fc2c6129700 1 -- 172.21.15.36:0/102515905 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc2a80536b0 msgr2=0x7fc2a8055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.716+0000 7fc2c6129700 1 --2- 172.21.15.36:0/102515905 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc2a80536b0 0x7fc2a8055b70 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7fc2bc01c000 tx=0x7fc2bc015000).stop 2022-01-10T01:34:10.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.716+0000 7fc2c6129700 1 -- 172.21.15.36:0/102515905 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2c013e420 msgr2=0x7fc2c0138bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.716+0000 7fc2c6129700 1 --2- 172.21.15.36:0/102515905 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2c013e420 0x7fc2c0138bc0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7fc2c0152450 tx=0x7fc2b80091d0).stop 2022-01-10T01:34:10.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.716+0000 7fc2c6129700 1 -- 172.21.15.36:0/102515905 shutdown_connections 2022-01-10T01:34:10.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.716+0000 7fc2c6129700 1 --2- 172.21.15.36:0/102515905 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fc2a80536b0 0x7fc2a8055b70 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.716+0000 7fc2c6129700 1 --2- 172.21.15.36:0/102515905 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fc2c013e420 0x7fc2c0138bc0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.716+0000 7fc2c6129700 1 --2- 172.21.15.36:0/102515905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c00b17b0 0x7fc2c0139d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.716+0000 7fc2c6129700 1 --2- 172.21.15.36:0/102515905 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2c00638d0 0x7fc2c013af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.716+0000 7fc2c6129700 1 -- 172.21.15.36:0/102515905 >> 172.21.15.36:0/102515905 conn(0x7fc2c005c490 msgr2=0x7fc2c0146030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:10.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.716+0000 7fc2c6129700 1 -- 172.21.15.36:0/102515905 shutdown_connections 2022-01-10T01:34:10.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.716+0000 7fc2c6129700 1 -- 172.21.15.36:0/102515905 wait complete. 2022-01-10T01:34:10.736 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-01-10T01:34:10.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e20dd1700 1 Processor -- start 2022-01-10T01:34:10.843 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e20dd1700 1 -- start start 2022-01-10T01:34:10.844 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e20dd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c0b3080 0x7f6e1c14df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e20dd1700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1c0ae650 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e20dd1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e1c0b17d0 con 0x7f6e1c0b13f0 2022-01-10T01:34:10.845 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e20dd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0b22e0 con 0x7f6e1c0b3080 2022-01-10T01:34:10.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e19d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f6e1c0b1d60 0x7f6e1c1472c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:41052/0 (socket says 172.21.15.36:41052) 2022-01-10T01:34:10.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e19d9b700 1 -- 172.21.15.36:0/929653281 learned_addr learned my addr 172.21.15.36:0/929653281 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:10.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e1ad9d700 1 --2- 172.21.15.36:0/929653281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c0b3080 0x7f6e1c14df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.846 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e1959a700 1 -- 172.21.15.36:0/929653281 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147057235 0 0) 0x7f6e1c0ae650 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.847 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e1959a700 1 -- 172.21.15.36:0/929653281 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e00003260 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e1959a700 1 -- 172.21.15.36:0/929653281 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222143015 0 0) 0x7f6e1c0b17d0 con 0x7f6e1c0b13f0 2022-01-10T01:34:10.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e1959a700 1 -- 172.21.15.36:0/929653281 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e1c0ae650 con 0x7f6e1c0b13f0 2022-01-10T01:34:10.851 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e1959a700 1 -- 172.21.15.36:0/929653281 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3498329656 0 0) 0x7f6e00003260 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e1ad9d700 1 -- 172.21.15.36:0/929653281 >> v1:172.21.15.59:6789/0 conn(0x7f6e1c0b13f0 legacy=0x7f6e1c146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e1ad9d700 1 -- 172.21.15.36:0/929653281 >> v1:172.21.15.36:6789/0 conn(0x7f6e1c0b1d60 legacy=0x7f6e1c1472c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e1ad9d700 1 -- 172.21.15.36:0/929653281 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c0b2580 con 0x7f6e1c0b3080 2022-01-10T01:34:10.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e1ad9d700 1 --2- 172.21.15.36:0/929653281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c0b3080 0x7f6e1c14df70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f6e10001110 tx=0x7f6e140091d0).ready entity=mon.2 client_cookie=b57ba2e33a1a479c server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:10.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e1959a700 1 -- 172.21.15.36:0/929653281 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e10001660 con 0x7f6e1c0b3080 2022-01-10T01:34:10.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e1959a700 1 -- 172.21.15.36:0/929653281 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1400f510 con 0x7f6e1c0b3080 2022-01-10T01:34:10.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.836+0000 7f6e1959a700 1 -- 172.21.15.36:0/929653281 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e1400f680 con 0x7f6e1c0b3080 2022-01-10T01:34:10.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 -- 172.21.15.36:0/929653281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c0b3080 msgr2=0x7f6e1c14df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 --2- 172.21.15.36:0/929653281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c0b3080 0x7f6e1c14df70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f6e10001110 tx=0x7f6e140091d0).stop 2022-01-10T01:34:10.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 -- 172.21.15.36:0/929653281 shutdown_connections 2022-01-10T01:34:10.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 --2- 172.21.15.36:0/929653281 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c0b3080 0x7f6e1c14df70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 -- 172.21.15.36:0/929653281 >> 172.21.15.36:0/929653281 conn(0x7f6e1c0607c0 msgr2=0x7f6e1c060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:10.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 -- 172.21.15.36:0/929653281 shutdown_connections 2022-01-10T01:34:10.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 -- 172.21.15.36:0/929653281 wait complete. 2022-01-10T01:34:10.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 Processor -- start 2022-01-10T01:34:10.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 -- start start 2022-01-10T01:34:10.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e1c0b13f0 0x7f6e1c0b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6e1c0b1d60 0x7f6e1c066f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c0b3080 0x7f6e1c0673f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c064ef0 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c0639e0 con 0x7f6e1c0b13f0 2022-01-10T01:34:10.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e20dd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1c063c80 con 0x7f6e1c0b3080 2022-01-10T01:34:10.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e19d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6e1c0b1d60 0x7f6e1c066f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e19d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6e1c0b1d60 0x7f6e1c066f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43266/0 (socket says 172.21.15.36:43266) 2022-01-10T01:34:10.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e19d9b700 1 -- 172.21.15.36:0/780871316 learned_addr learned my addr 172.21.15.36:0/780871316 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:10.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e1a59c700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e1c0b13f0 0x7f6e1c0b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.840+0000 7f6e1ad9d700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c0b3080 0x7f6e1c0673f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e19d9b700 1 -- 172.21.15.36:0/780871316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c0b3080 msgr2=0x7f6e1c0673f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e19d9b700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c0b3080 0x7f6e1c0673f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e19d9b700 1 -- 172.21.15.36:0/780871316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e1c0b13f0 msgr2=0x7f6e1c0b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e19d9b700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e1c0b13f0 0x7f6e1c0b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e19d9b700 1 -- 172.21.15.36:0/780871316 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e14009470 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e1a59c700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e1c0b13f0 0x7f6e1c0b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:34:10.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e1ad9d700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c0b3080 0x7f6e1c0673f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:34:10.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e19d9b700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6e1c0b1d60 0x7f6e1c066f00 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f6e10001840 tx=0x7f6e10001ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:10.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e0b7fe700 1 -- 172.21.15.36:0/780871316 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e10007170 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e0b7fe700 1 -- 172.21.15.36:0/780871316 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e100072d0 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e20dd1700 1 -- 172.21.15.36:0/780871316 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1c063f20 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e0b7fe700 1 -- 172.21.15.36:0/780871316 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e10004920 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e20dd1700 1 -- 172.21.15.36:0/780871316 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1c1526b0 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e20dd1700 1 -- 172.21.15.36:0/780871316 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e1c0b2820 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.862 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e0b7fe700 1 -- 172.21.15.36:0/780871316 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6e1001b070 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e0b7fe700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6df80536b0 0x7f6df8055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:10.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e0b7fe700 1 -- 172.21.15.36:0/780871316 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f6e1006b3a0 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.844+0000 7f6e1a59c700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6df80536b0 0x7f6df8055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:10.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.848+0000 7f6e1a59c700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6df80536b0 0x7f6df8055b70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f6e0c00b000 tx=0x7f6e0c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:10.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.852+0000 7f6e0b7fe700 1 -- 172.21.15.36:0/780871316 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6e100423b0 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.987 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.980+0000 7f6e20dd1700 1 -- 172.21.15.36:0/780871316 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e1c057350 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.988 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.980+0000 7f6e0b7fe700 1 -- 172.21.15.36:0/780871316 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v159) v1 ==== 104+0+10 (secure 0 0 0) 0x7f6e100459d0 con 0x7f6e1c0b1d60 2022-01-10T01:34:10.988 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:34:10.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.980+0000 7f6e20dd1700 1 -- 172.21.15.36:0/780871316 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6df80536b0 msgr2=0x7f6df8055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.990 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.980+0000 7f6e20dd1700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6df80536b0 0x7f6df8055b70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f6e0c00b000 tx=0x7f6e0c009040).stop 2022-01-10T01:34:10.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.980+0000 7f6e20dd1700 1 -- 172.21.15.36:0/780871316 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6e1c0b1d60 msgr2=0x7f6e1c066f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:10.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.980+0000 7f6e20dd1700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6e1c0b1d60 0x7f6e1c066f00 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f6e10001840 tx=0x7f6e10001ae0).stop 2022-01-10T01:34:10.991 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.980+0000 7f6e20dd1700 1 -- 172.21.15.36:0/780871316 shutdown_connections 2022-01-10T01:34:10.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.980+0000 7f6e20dd1700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6df80536b0 0x7f6df8055b70 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.980+0000 7f6e20dd1700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e1c0b3080 0x7f6e1c0673f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.980+0000 7f6e20dd1700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6e1c0b1d60 0x7f6e1c066f00 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.980+0000 7f6e20dd1700 1 --2- 172.21.15.36:0/780871316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e1c0b13f0 0x7f6e1c0b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:10.992 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.980+0000 7f6e20dd1700 1 -- 172.21.15.36:0/780871316 >> 172.21.15.36:0/780871316 conn(0x7f6e1c0607c0 msgr2=0x7f6e1c149670 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:10.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.984+0000 7f6e20dd1700 1 -- 172.21.15.36:0/780871316 shutdown_connections 2022-01-10T01:34:10.993 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:10.984+0000 7f6e20dd1700 1 -- 172.21.15.36:0/780871316 wait complete. 2022-01-10T01:34:11.001 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-01-10T01:34:11.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.108+0000 7fa1d2442700 1 Processor -- start 2022-01-10T01:34:11.117 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.108+0000 7fa1d2442700 1 -- start start 2022-01-10T01:34:11.119 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d2442700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1cc0af2c0 0x7fa1cc0af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:11.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d2442700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1cc0afda0 con 0x7fa1cc0ad320 2022-01-10T01:34:11.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d2442700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1cc05c610 con 0x7fa1cc0ad850 2022-01-10T01:34:11.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d2442700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1cc140800 con 0x7fa1cc0af2c0 2022-01-10T01:34:11.120 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d0c3f700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fa1cc0ad320 0x7fa1cc143150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:41068/0 (socket says 172.21.15.36:41068) 2022-01-10T01:34:11.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d0c3f700 1 -- 172.21.15.36:0/2600698331 learned_addr learned my addr 172.21.15.36:0/2600698331 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:11.121 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d1440700 1 --2- 172.21.15.36:0/2600698331 >> v2:172.21.15.59:3300/0 conn(0x7fa1cc0af2c0 0x7fa1cc0af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:11.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1bbfff700 1 -- 172.21.15.36:0/2600698331 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710794132 0 0) 0x7fa1cc0afda0 con 0x7fa1cc0ad320 2022-01-10T01:34:11.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1bbfff700 1 -- 172.21.15.36:0/2600698331 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1b4003260 con 0x7fa1cc0ad320 2022-01-10T01:34:11.123 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d1440700 1 -- 172.21.15.36:0/2600698331 >> v1:172.21.15.59:6789/0 conn(0x7fa1cc0ad850 legacy=0x7fa1cc0a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:11.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d1440700 1 -- 172.21.15.36:0/2600698331 >> v1:172.21.15.36:6789/0 conn(0x7fa1cc0ad320 legacy=0x7fa1cc143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:11.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d1440700 1 -- 172.21.15.36:0/2600698331 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc143860 con 0x7fa1cc0af2c0 2022-01-10T01:34:11.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d1440700 1 --2- 172.21.15.36:0/2600698331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc0af2c0 0x7fa1cc0af6a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fa1cc0ad770 tx=0x7fa1c8006df0).ready entity=mon.1 client_cookie=4ab6e3932f5354ba server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:11.124 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1bbfff700 1 -- 172.21.15.36:0/2600698331 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1c800d610 con 0x7fa1cc0af2c0 2022-01-10T01:34:11.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1bbfff700 1 -- 172.21.15.36:0/2600698331 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c8000e90 con 0x7fa1cc0af2c0 2022-01-10T01:34:11.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1bbfff700 1 -- 172.21.15.36:0/2600698331 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1c800d960 con 0x7fa1cc0af2c0 2022-01-10T01:34:11.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d2442700 1 -- 172.21.15.36:0/2600698331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc0af2c0 msgr2=0x7fa1cc0af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:11.125 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d2442700 1 --2- 172.21.15.36:0/2600698331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc0af2c0 0x7fa1cc0af6a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fa1cc0ad770 tx=0x7fa1c8006df0).stop 2022-01-10T01:34:11.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d2442700 1 -- 172.21.15.36:0/2600698331 shutdown_connections 2022-01-10T01:34:11.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d2442700 1 --2- 172.21.15.36:0/2600698331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc0af2c0 0x7fa1cc0af6a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d2442700 1 -- 172.21.15.36:0/2600698331 >> 172.21.15.36:0/2600698331 conn(0x7fa1cc061140 msgr2=0x7fa1cc062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:11.126 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d2442700 1 -- 172.21.15.36:0/2600698331 shutdown_connections 2022-01-10T01:34:11.127 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.112+0000 7fa1d2442700 1 -- 172.21.15.36:0/2600698331 wait complete. 2022-01-10T01:34:11.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d2442700 1 Processor -- start 2022-01-10T01:34:11.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d2442700 1 -- start start 2022-01-10T01:34:11.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d2442700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc0ad320 0x7fa1cc063a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:11.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d2442700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0ad850 0x7fa1cc0670f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:11.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d2442700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1cc0af2c0 0x7fa1cc0675e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:11.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d2442700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc1534f0 con 0x7fa1cc0af2c0 2022-01-10T01:34:11.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d2442700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc152fe0 con 0x7fa1cc0ad320 2022-01-10T01:34:11.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d2442700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc153250 con 0x7fa1cc0ad850 2022-01-10T01:34:11.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d1c41700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1cc0af2c0 0x7fa1cc0675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:11.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d0c3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0ad850 0x7fa1cc0670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:11.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d1440700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc0ad320 0x7fa1cc063a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:11.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d0c3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0ad850 0x7fa1cc0670f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:49562/0 (socket says 172.21.15.36:49562) 2022-01-10T01:34:11.133 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d1c41700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1cc0af2c0 0x7fa1cc0675e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43282/0 (socket says 172.21.15.36:43282) 2022-01-10T01:34:11.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d0c3f700 1 -- 172.21.15.36:0/129974748 learned_addr learned my addr 172.21.15.36:0/129974748 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:11.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d0c3f700 1 -- 172.21.15.36:0/129974748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc0ad320 msgr2=0x7fa1cc063a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:11.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d0c3f700 1 --2- 172.21.15.36:0/129974748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc0ad320 0x7fa1cc063a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.134 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d0c3f700 1 -- 172.21.15.36:0/129974748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1cc0af2c0 msgr2=0x7fa1cc0675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:11.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d0c3f700 1 --2- 172.21.15.36:0/129974748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1cc0af2c0 0x7fa1cc0675e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d0c3f700 1 -- 172.21.15.36:0/129974748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c800b180 con 0x7fa1cc0ad850 2022-01-10T01:34:11.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.116+0000 7fa1d1440700 1 --2- 172.21.15.36:0/129974748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc0ad320 0x7fa1cc063a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T01:34:11.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.120+0000 7fa1d0c3f700 1 --2- 172.21.15.36:0/129974748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0ad850 0x7fa1cc0670f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa1cc153170 tx=0x7fa1bc007b60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:11.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.120+0000 7fa1ba7fc700 1 -- 172.21.15.36:0/129974748 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1bc0072e0 con 0x7fa1cc0ad850 2022-01-10T01:34:11.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.120+0000 7fa1ba7fc700 1 -- 172.21.15.36:0/129974748 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1bc007440 con 0x7fa1cc0ad850 2022-01-10T01:34:11.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.120+0000 7fa1d2442700 1 -- 172.21.15.36:0/129974748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1cc0ab880 con 0x7fa1cc0ad850 2022-01-10T01:34:11.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.120+0000 7fa1ba7fc700 1 -- 172.21.15.36:0/129974748 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1bc005800 con 0x7fa1cc0ad850 2022-01-10T01:34:11.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.120+0000 7fa1d2442700 1 -- 172.21.15.36:0/129974748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1cc147370 con 0x7fa1cc0ad850 2022-01-10T01:34:11.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.120+0000 7fa1d2442700 1 -- 172.21.15.36:0/129974748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1cc0aba10 con 0x7fa1cc0ad850 2022-01-10T01:34:11.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.120+0000 7fa1ba7fc700 1 -- 172.21.15.36:0/129974748 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa1bc005960 con 0x7fa1cc0ad850 2022-01-10T01:34:11.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.120+0000 7fa1ba7fc700 1 --2- 172.21.15.36:0/129974748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa1ac0535f0 0x7fa1ac055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:11.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.120+0000 7fa1ba7fc700 1 -- 172.21.15.36:0/129974748 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa1bc06de90 con 0x7fa1cc0ad850 2022-01-10T01:34:11.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.120+0000 7fa1d1440700 1 --2- 172.21.15.36:0/129974748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa1ac0535f0 0x7fa1ac055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:11.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.120+0000 7fa1d1440700 1 --2- 172.21.15.36:0/129974748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa1ac0535f0 0x7fa1ac055ab0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fa1c801a000 tx=0x7fa1c8014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:11.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.132+0000 7fa1ba7fc700 1 -- 172.21.15.36:0/129974748 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa1bc044e00 con 0x7fa1cc0ad850 2022-01-10T01:34:11.269 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.260+0000 7fa1d2442700 1 -- 172.21.15.36:0/129974748 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa1cc057350 con 0x7fa1cc0ad850 2022-01-10T01:34:11.270 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.260+0000 7fa1ba7fc700 1 -- 172.21.15.36:0/129974748 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v159) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa1bc048420 con 0x7fa1cc0ad850 2022-01-10T01:34:11.270 INFO:teuthology.orchestra.run.smithi036.stdout:pg_num: 8 2022-01-10T01:34:11.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.264+0000 7fa1d2442700 1 -- 172.21.15.36:0/129974748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa1ac0535f0 msgr2=0x7fa1ac055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:11.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.264+0000 7fa1d2442700 1 --2- 172.21.15.36:0/129974748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa1ac0535f0 0x7fa1ac055ab0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fa1c801a000 tx=0x7fa1c8014000).stop 2022-01-10T01:34:11.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.264+0000 7fa1d2442700 1 -- 172.21.15.36:0/129974748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0ad850 msgr2=0x7fa1cc0670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:11.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.264+0000 7fa1d2442700 1 --2- 172.21.15.36:0/129974748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0ad850 0x7fa1cc0670f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fa1cc153170 tx=0x7fa1bc007b60).stop 2022-01-10T01:34:11.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.264+0000 7fa1d2442700 1 -- 172.21.15.36:0/129974748 shutdown_connections 2022-01-10T01:34:11.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.264+0000 7fa1d2442700 1 --2- 172.21.15.36:0/129974748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa1ac0535f0 0x7fa1ac055ab0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.274 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.264+0000 7fa1d2442700 1 --2- 172.21.15.36:0/129974748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa1cc0af2c0 0x7fa1cc0675e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.264+0000 7fa1d2442700 1 --2- 172.21.15.36:0/129974748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1cc0ad850 0x7fa1cc0670f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.264+0000 7fa1d2442700 1 --2- 172.21.15.36:0/129974748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1cc0ad320 0x7fa1cc063a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.264+0000 7fa1d2442700 1 -- 172.21.15.36:0/129974748 >> 172.21.15.36:0/129974748 conn(0x7fa1cc061140 msgr2=0x7fa1cc13cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:11.275 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.264+0000 7fa1d2442700 1 -- 172.21.15.36:0/129974748 shutdown_connections 2022-01-10T01:34:11.276 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.264+0000 7fa1d2442700 1 -- 172.21.15.36:0/129974748 wait complete. 2022-01-10T01:34:11.288 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2022-01-10T01:34:11.288 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:34:11.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c27efa700 1 Processor -- start 2022-01-10T01:34:11.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c27efa700 1 -- start start 2022-01-10T01:34:11.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c27efa700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7c201483a0 0x7f7c200b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:11.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c27efa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c200a70c0 0x7f7c20144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:11.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c27efa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c200b0350 con 0x7f7c200b1db0 2022-01-10T01:34:11.391 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c27efa700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c200a90c0 con 0x7f7c201483a0 2022-01-10T01:34:11.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c27efa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200b05f0 con 0x7f7c200a70c0 2022-01-10T01:34:11.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c25495700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7c201483a0 0x7f7c200b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:11.392 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c25495700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f7c201483a0 0x7f7c200b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43288/0 (socket says 172.21.15.36:43288) 2022-01-10T01:34:11.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c25495700 1 -- 172.21.15.36:0/3809386317 learned_addr learned my addr 172.21.15.36:0/3809386317 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:11.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c26497700 1 --2- 172.21.15.36:0/3809386317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c200a70c0 0x7f7c20144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:11.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c25495700 1 -- 172.21.15.36:0/3809386317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c200a70c0 msgr2=0x7f7c20144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:11.393 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c25495700 1 --2- 172.21.15.36:0/3809386317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c200a70c0 0x7f7c20144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c25495700 1 -- 172.21.15.36:0/3809386317 >> v1:172.21.15.59:6789/0 conn(0x7f7c200b1db0 legacy=0x7f7c200b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:11.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c25495700 1 -- 172.21.15.36:0/3809386317 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c200b0890 con 0x7f7c201483a0 2022-01-10T01:34:11.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c25495700 1 --2- 172.21.15.36:0/3809386317 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c201483a0 0x7f7c200b0fd0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f7c20147730 tx=0x7f7c1c006eb0).ready entity=mon.0 client_cookie=4208f8a92dd7a62f server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:11.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c24c94700 1 -- 172.21.15.36:0/3809386317 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c1c00d5c0 con 0x7f7c201483a0 2022-01-10T01:34:11.394 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c24c94700 1 -- 172.21.15.36:0/3809386317 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c000e90 con 0x7f7c201483a0 2022-01-10T01:34:11.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.380+0000 7f7c24c94700 1 -- 172.21.15.36:0/3809386317 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c1c00d950 con 0x7f7c201483a0 2022-01-10T01:34:11.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 -- 172.21.15.36:0/3809386317 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c201483a0 msgr2=0x7f7c200b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:11.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 --2- 172.21.15.36:0/3809386317 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c201483a0 0x7f7c200b0fd0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7f7c20147730 tx=0x7f7c1c006eb0).stop 2022-01-10T01:34:11.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 -- 172.21.15.36:0/3809386317 shutdown_connections 2022-01-10T01:34:11.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 --2- 172.21.15.36:0/3809386317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c200a70c0 0x7f7c20144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 --2- 172.21.15.36:0/3809386317 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c201483a0 0x7f7c200b0fd0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 -- 172.21.15.36:0/3809386317 >> 172.21.15.36:0/3809386317 conn(0x7f7c2005f6b0 msgr2=0x7f7c2005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:11.396 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 -- 172.21.15.36:0/3809386317 shutdown_connections 2022-01-10T01:34:11.397 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 -- 172.21.15.36:0/3809386317 wait complete. 2022-01-10T01:34:11.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 Processor -- start 2022-01-10T01:34:11.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 -- start start 2022-01-10T01:34:11.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a70c0 0x7f7c200ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:11.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c200b1db0 0x7f7c20156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:11.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c201483a0 0x7f7c200ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:11.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200ab5c0 con 0x7f7c200b1db0 2022-01-10T01:34:11.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200ab860 con 0x7f7c200a70c0 2022-01-10T01:34:11.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c27efa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200abe50 con 0x7f7c201483a0 2022-01-10T01:34:11.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c25495700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c200b1db0 0x7f7c20156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:11.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c25c96700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a70c0 0x7f7c200ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:11.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c25495700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c200b1db0 0x7f7c20156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43294/0 (socket says 172.21.15.36:43294) 2022-01-10T01:34:11.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c26497700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c201483a0 0x7f7c200ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:11.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c25c96700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a70c0 0x7f7c200ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:39926/0 (socket says 172.21.15.36:39926) 2022-01-10T01:34:11.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.384+0000 7f7c25495700 1 -- 172.21.15.36:0/4055531567 learned_addr learned my addr 172.21.15.36:0/4055531567 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:11.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c25495700 1 -- 172.21.15.36:0/4055531567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c201483a0 msgr2=0x7f7c200ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:11.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c25495700 1 --2- 172.21.15.36:0/4055531567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c201483a0 0x7f7c200ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.404 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c25495700 1 -- 172.21.15.36:0/4055531567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a70c0 msgr2=0x7f7c200ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:11.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c25495700 1 --2- 172.21.15.36:0/4055531567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a70c0 0x7f7c200ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c25495700 1 -- 172.21.15.36:0/4055531567 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c00b1e0 con 0x7f7c200b1db0 2022-01-10T01:34:11.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c25495700 1 --2- 172.21.15.36:0/4055531567 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c200b1db0 0x7f7c20156a90 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7f7c20147730 tx=0x7f7c1c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:11.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c0effd700 1 -- 172.21.15.36:0/4055531567 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c1c0116e0 con 0x7f7c200b1db0 2022-01-10T01:34:11.405 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c0effd700 1 -- 172.21.15.36:0/4055531567 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c011840 con 0x7f7c200b1db0 2022-01-10T01:34:11.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c27efa700 1 -- 172.21.15.36:0/4055531567 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c200af5a0 con 0x7f7c200b1db0 2022-01-10T01:34:11.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c0effd700 1 -- 172.21.15.36:0/4055531567 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c1c011ba0 con 0x7f7c200b1db0 2022-01-10T01:34:11.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c27efa700 1 -- 172.21.15.36:0/4055531567 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c200ac7e0 con 0x7f7c200b1db0 2022-01-10T01:34:11.406 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c27efa700 1 -- 172.21.15.36:0/4055531567 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c200ac010 con 0x7f7c200b1db0 2022-01-10T01:34:11.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c0effd700 1 -- 172.21.15.36:0/4055531567 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7c1c00f070 con 0x7f7c200b1db0 2022-01-10T01:34:11.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c0effd700 1 --2- 172.21.15.36:0/4055531567 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7c00053620 0x7f7c00055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:11.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c0effd700 1 -- 172.21.15.36:0/4055531567 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f7c1c06d2b0 con 0x7f7c200b1db0 2022-01-10T01:34:11.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.388+0000 7f7c25c96700 1 --2- 172.21.15.36:0/4055531567 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7c00053620 0x7f7c00055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:11.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.392+0000 7f7c25c96700 1 --2- 172.21.15.36:0/4055531567 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7c00053620 0x7f7c00055ae0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f7c1000d000 tx=0x7f7c10007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:11.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.396+0000 7f7c0effd700 1 -- 172.21.15.36:0/4055531567 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7c1c044300 con 0x7f7c200b1db0 2022-01-10T01:34:11.567 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.560+0000 7f7c27efa700 1 -- 172.21.15.36:0/4055531567 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c20057350 con 0x7f7c200b1db0 2022-01-10T01:34:11.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.560+0000 7f7c0effd700 1 -- 172.21.15.36:0/4055531567 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f7c1c0478e0 con 0x7f7c200b1db0 2022-01-10T01:34:11.569 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:11.569 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":79,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3964890182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3964890182},{"type":"v1","addr":"172.21.15.59:6833","nonce":3964890182}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77},{"gid":8733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3716636187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3716636187},{"type":"v1","addr":"172.21.15.36:6835","nonce":3716636187}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:34:04.465028+0000","modified":"2022-01-10T01:34:05.469086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8742":{"gid":8742,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/1997308230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1997308230},{"type":"v1","addr":"172.21.15.36:6837","nonce":1997308230}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2022-01-10T01:34:11.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.564+0000 7f7c27efa700 1 -- 172.21.15.36:0/4055531567 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7c00053620 msgr2=0x7f7c00055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:11.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.564+0000 7f7c27efa700 1 --2- 172.21.15.36:0/4055531567 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7c00053620 0x7f7c00055ae0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f7c1000d000 tx=0x7f7c10007b90).stop 2022-01-10T01:34:11.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.564+0000 7f7c27efa700 1 -- 172.21.15.36:0/4055531567 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c200b1db0 msgr2=0x7f7c20156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:11.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.564+0000 7f7c27efa700 1 --2- 172.21.15.36:0/4055531567 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c200b1db0 0x7f7c20156a90 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7f7c20147730 tx=0x7f7c1c015000).stop 2022-01-10T01:34:11.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.564+0000 7f7c27efa700 1 -- 172.21.15.36:0/4055531567 shutdown_connections 2022-01-10T01:34:11.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.564+0000 7f7c27efa700 1 --2- 172.21.15.36:0/4055531567 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7c00053620 0x7f7c00055ae0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.564+0000 7f7c27efa700 1 --2- 172.21.15.36:0/4055531567 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c201483a0 0x7f7c200ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.564+0000 7f7c27efa700 1 --2- 172.21.15.36:0/4055531567 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c200b1db0 0x7f7c20156a90 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.564+0000 7f7c27efa700 1 --2- 172.21.15.36:0/4055531567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a70c0 0x7f7c200ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:11.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.564+0000 7f7c27efa700 1 -- 172.21.15.36:0/4055531567 >> 172.21.15.36:0/4055531567 conn(0x7f7c2005f6b0 msgr2=0x7f7c20144c50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:11.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.564+0000 7f7c27efa700 1 -- 172.21.15.36:0/4055531567 shutdown_connections 2022-01-10T01:34:11.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:11.564+0000 7f7c27efa700 1 -- 172.21.15.36:0/4055531567 wait complete. 2022-01-10T01:34:11.574 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 79 2022-01-10T01:34:11.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-01-10T01:34:04.465028+0000', 'modified': '2022-01-10T01:34:05.469086+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8742}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8742': {'gid': 8742, 'name': 'a', 'rank': 0, 'incarnation': 78, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.36:6837/1997308230', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.36:6836', 'nonce': 1997308230}, {'type': 'v1', 'addr': '172.21.15.36:6837', 'nonce': 1997308230}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-01-10T01:34:11.884 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2022-01-10T01:34:11.885 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2022-01-10T01:34:12.002 INFO:teuthology.orchestra.run.smithi036.stdout:{"cluster_fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","whoami":0,"id":8742,"want_state":"up:active","state":"up:active","rank_uptime":7.5210125659999996,"mdsmap_epoch":79,"osdmap_epoch":159,"osdmap_epoch_barrier":158,"uptime":12.51177334} 2022-01-10T01:34:12.002 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", "id": 8742, "mdsmap_epoch": 79, "osdmap_epoch": 159, "osdmap_epoch_barrier": 158, "rank_uptime": 7.521012566, "state": "up:active", "uptime": 12.51177334, "want_state": "up:active", "whoami": 0 } 2022-01-10T01:34:12.003 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2022-01-10T01:34:12.003 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2022-01-10T01:34:12.004 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi166.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2022-01-10T01:34:12.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:12.004 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:34:12.013 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:34:12.031 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:34:12.031 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:34:12.089 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:34:12.090 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:34:12.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:12.092 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:34:12.096 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2022-01-10T01:34:12.097 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:34:12.099 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:34:12.115 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:34:12.116 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:34:12.171 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:34:12.172 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:34:12.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:12.173 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:34:12.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:2022-01-10T01:34:12.173+0000 7f92f458c080 -1 init, newargv = 0x5642c9c28a30 newargc=9 2022-01-10T01:34:12.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14874]: starting ceph client 2022-01-10T01:34:12.186 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14874]: starting fuse 2022-01-10T01:34:13.280 DEBUG:teuthology.orchestra.run.smithi166:> sudo modprobe fuse 2022-01-10T01:34:13.299 INFO:teuthology.orchestra.run:Running command with timeout 30 2022-01-10T01:34:13.300 DEBUG:teuthology.orchestra.run.smithi166:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2022-01-10T01:34:13.357 INFO:teuthology.orchestra.run.smithi166.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2022-01-10T01:34:13.358 DEBUG:teuthology.orchestra.run:got remote process result: 32 2022-01-10T01:34:13.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:13.360 DEBUG:teuthology.orchestra.run.smithi166:> ls /sys/fs/fuse/connections 2022-01-10T01:34:13.367 INFO:teuthology.orchestra.run.smithi166.stdout:52 2022-01-10T01:34:13.367 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2022-01-10T01:34:13.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:13.368 DEBUG:teuthology.orchestra.run.smithi166:> sudo python3 -c ' 2022-01-10T01:34:13.369 DEBUG:teuthology.orchestra.run.smithi166:> import glob 2022-01-10T01:34:13.369 DEBUG:teuthology.orchestra.run.smithi166:> import re 2022-01-10T01:34:13.370 DEBUG:teuthology.orchestra.run.smithi166:> import os 2022-01-10T01:34:13.370 DEBUG:teuthology.orchestra.run.smithi166:> import subprocess 2022-01-10T01:34:13.370 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:34:13.371 DEBUG:teuthology.orchestra.run.smithi166:> def find_socket(client_name): 2022-01-10T01:34:13.371 DEBUG:teuthology.orchestra.run.smithi166:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2022-01-10T01:34:13.372 DEBUG:teuthology.orchestra.run.smithi166:> files = glob.glob(asok_path) 2022-01-10T01:34:13.372 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:34:13.373 DEBUG:teuthology.orchestra.run.smithi166:> # Given a non-glob path, it better be there 2022-01-10T01:34:13.373 DEBUG:teuthology.orchestra.run.smithi166:> if "*" not in asok_path: 2022-01-10T01:34:13.374 DEBUG:teuthology.orchestra.run.smithi166:> assert(len(files) == 1) 2022-01-10T01:34:13.374 DEBUG:teuthology.orchestra.run.smithi166:> return files[0] 2022-01-10T01:34:13.375 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:34:13.375 DEBUG:teuthology.orchestra.run.smithi166:> for f in files: 2022-01-10T01:34:13.376 DEBUG:teuthology.orchestra.run.smithi166:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2022-01-10T01:34:13.376 DEBUG:teuthology.orchestra.run.smithi166:> if os.path.exists("/proc/{0}".format(pid)): 2022-01-10T01:34:13.377 DEBUG:teuthology.orchestra.run.smithi166:> return f 2022-01-10T01:34:13.377 DEBUG:teuthology.orchestra.run.smithi166:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2022-01-10T01:34:13.377 DEBUG:teuthology.orchestra.run.smithi166:> 2022-01-10T01:34:13.378 DEBUG:teuthology.orchestra.run.smithi166:> print(find_socket("client.1")) 2022-01-10T01:34:13.378 DEBUG:teuthology.orchestra.run.smithi166:> ' 2022-01-10T01:34:13.423 INFO:teuthology.orchestra.run.smithi166.stdout:/var/run/ceph/ceph-client.1.14874.asok 2022-01-10T01:34:13.428 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.14874.asok 2022-01-10T01:34:13.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:13.429 DEBUG:teuthology.orchestra.run.smithi166:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.14874.asok status 2022-01-10T01:34:13.564 INFO:teuthology.orchestra.run.smithi166.stdout:{ 2022-01-10T01:34:13.565 INFO:teuthology.orchestra.run.smithi166.stdout: "metadata": { 2022-01-10T01:34:13.565 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_sha1": "cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be", 2022-01-10T01:34:13.565 INFO:teuthology.orchestra.run.smithi166.stdout: "ceph_version": "ceph version 15.2.14 (cd3bb7e87a2f62c1b862ff3fd8b1eec13391a5be) octopus (stable)", 2022-01-10T01:34:13.566 INFO:teuthology.orchestra.run.smithi166.stdout: "entity_id": "1", 2022-01-10T01:34:13.566 INFO:teuthology.orchestra.run.smithi166.stdout: "hostname": "smithi166", 2022-01-10T01:34:13.566 INFO:teuthology.orchestra.run.smithi166.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2022-01-10T01:34:13.566 INFO:teuthology.orchestra.run.smithi166.stdout: "pid": "14874", 2022-01-10T01:34:13.566 INFO:teuthology.orchestra.run.smithi166.stdout: "root": "/" 2022-01-10T01:34:13.567 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:34:13.567 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_count": 0, 2022-01-10T01:34:13.567 INFO:teuthology.orchestra.run.smithi166.stdout: "dentry_pinned_count": 0, 2022-01-10T01:34:13.567 INFO:teuthology.orchestra.run.smithi166.stdout: "id": 37583, 2022-01-10T01:34:13.568 INFO:teuthology.orchestra.run.smithi166.stdout: "inst": { 2022-01-10T01:34:13.568 INFO:teuthology.orchestra.run.smithi166.stdout: "name": { 2022-01-10T01:34:13.568 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "client", 2022-01-10T01:34:13.568 INFO:teuthology.orchestra.run.smithi166.stdout: "num": 37583 2022-01-10T01:34:13.569 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:34:13.569 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:34:13.569 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:34:13.569 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:34:13.570 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 280871279 2022-01-10T01:34:13.570 INFO:teuthology.orchestra.run.smithi166.stdout: } 2022-01-10T01:34:13.570 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:34:13.570 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": { 2022-01-10T01:34:13.571 INFO:teuthology.orchestra.run.smithi166.stdout: "type": "v1", 2022-01-10T01:34:13.571 INFO:teuthology.orchestra.run.smithi166.stdout: "addr": "172.21.15.166:0", 2022-01-10T01:34:13.571 INFO:teuthology.orchestra.run.smithi166.stdout: "nonce": 280871279 2022-01-10T01:34:13.571 INFO:teuthology.orchestra.run.smithi166.stdout: }, 2022-01-10T01:34:13.572 INFO:teuthology.orchestra.run.smithi166.stdout: "inst_str": "client.37583 172.21.15.166:0/280871279", 2022-01-10T01:34:13.572 INFO:teuthology.orchestra.run.smithi166.stdout: "addr_str": "172.21.15.166:0/280871279", 2022-01-10T01:34:13.572 INFO:teuthology.orchestra.run.smithi166.stdout: "inode_count": 1, 2022-01-10T01:34:13.572 INFO:teuthology.orchestra.run.smithi166.stdout: "mds_epoch": 79, 2022-01-10T01:34:13.572 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch": 159, 2022-01-10T01:34:13.573 INFO:teuthology.orchestra.run.smithi166.stdout: "osd_epoch_barrier": 0, 2022-01-10T01:34:13.573 INFO:teuthology.orchestra.run.smithi166.stdout: "blacklisted": false, 2022-01-10T01:34:13.573 INFO:teuthology.orchestra.run.smithi166.stdout: "fs_name": "cephfs" 2022-01-10T01:34:13.573 INFO:teuthology.orchestra.run.smithi166.stdout:} 2022-01-10T01:34:13.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:13.575 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:34:13.575 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:34:13.582 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:34:13.583 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:34:13.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:13.584 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:34:13.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:13.644 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:34:13.644 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:34:13.652 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:34:13.653 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:34:13.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:13.654 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:34:13.655 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:34:13.662 INFO:teuthology.orchestra.run.smithi166.stdout:fuseblk 2022-01-10T01:34:13.663 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2022-01-10T01:34:13.664 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi166.front.sepia.ceph.com... 2022-01-10T01:34:13.664 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-01-10T01:34:13.664 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:34:13.678 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi166.stderr:ceph-fuse[14874]: fuse finished with error 0 and tester_r 0 2022-01-10T01:34:13.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:13.681 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:34:13.681 DEBUG:teuthology.orchestra.run.smithi166:> ' -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:34:13.687 INFO:teuthology.orchestra.run.smithi166.stdout:ext2/ext3 2022-01-10T01:34:13.688 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2022-01-10T01:34:13.688 INFO:teuthology.orchestra.run:waiting for 900 2022-01-10T01:34:13.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-01-10T01:34:13.770 DEBUG:teuthology.orchestra.run.smithi166:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2022-01-10T01:34:13.778 INFO:teuthology.orchestra.run:Running command with timeout 10800 2022-01-10T01:34:13.779 DEBUG:teuthology.orchestra.run.smithi139:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2022-01-10T01:34:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: File: "." 2022-01-10T01:34:13.800 INFO:teuthology.orchestra.run.smithi139.stdout: ID: 0 Namelen: 255 Type: fuseblk 2022-01-10T01:34:13.800 INFO:teuthology.orchestra.run.smithi139.stdout:Block size: 4194304 Fundamental block size: 4194304 2022-01-10T01:34:13.801 INFO:teuthology.orchestra.run.smithi139.stdout:Blocks: Total: 86526 Free: 86526 Available: 86526 2022-01-10T01:34:13.801 INFO:teuthology.orchestra.run.smithi139.stdout:Inodes: Total: 1 Free: 0 2022-01-10T01:34:13.802 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2022-01-10T01:34:13.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.904+0000 7fb4ed09f700 1 Processor -- start 2022-01-10T01:34:13.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.904+0000 7fb4ed09f700 1 -- start start 2022-01-10T01:34:13.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ed09f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb4e80b6380 0x7fb4e8140370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:13.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ed09f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e80612f0 0x7fb4e80b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:13.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ed09f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e8146660 con 0x7fb4e80b2910 2022-01-10T01:34:13.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ed09f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e8061fb0 con 0x7fb4e80b6380 2022-01-10T01:34:13.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ed09f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8065520 con 0x7fb4e80612f0 2022-01-10T01:34:13.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4e7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb4e80b6380 0x7fb4e8140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:13.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4e7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fb4e80b6380 0x7fb4e8140370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43302/0 (socket says 172.21.15.36:43302) 2022-01-10T01:34:13.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4e7fff700 1 -- 172.21.15.36:0/174244038 learned_addr learned my addr 172.21.15.36:0/174244038 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:13.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ec89e700 1 --2- 172.21.15.36:0/174244038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e80612f0 0x7fb4e80b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:13.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4e7fff700 1 -- 172.21.15.36:0/174244038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e80612f0 msgr2=0x7fb4e80b13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:13.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4e77fe700 1 -- 172.21.15.36:0/174244038 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387957570 0 0) 0x7fb4e8146660 con 0x7fb4e80b2910 2022-01-10T01:34:13.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4e7fff700 1 --2- 172.21.15.36:0/174244038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e80612f0 0x7fb4e80b13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:13.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4e7fff700 1 -- 172.21.15.36:0/174244038 >> v1:172.21.15.59:6789/0 conn(0x7fb4e80b2910 legacy=0x7fb4e80b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:13.920 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4e7fff700 1 -- 172.21.15.36:0/174244038 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8147510 con 0x7fb4e80b6380 2022-01-10T01:34:13.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ec89e700 1 --2- 172.21.15.36:0/174244038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e80612f0 0x7fb4e80b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:34:13.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4e7fff700 1 --2- 172.21.15.36:0/174244038 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4e80b6380 0x7fb4e8140370 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7fb4d8002f70 tx=0x7fb4d8006eb0).ready entity=mon.0 client_cookie=4f28d8cd48c12bb3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:13.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4e77fe700 1 -- 172.21.15.36:0/174244038 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4d800d5c0 con 0x7fb4e80b6380 2022-01-10T01:34:13.921 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4e77fe700 1 -- 172.21.15.36:0/174244038 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d8000e90 con 0x7fb4e80b6380 2022-01-10T01:34:13.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4e77fe700 1 -- 172.21.15.36:0/174244038 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4d800d910 con 0x7fb4e80b6380 2022-01-10T01:34:13.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ed09f700 1 -- 172.21.15.36:0/174244038 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4e80b6380 msgr2=0x7fb4e8140370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:13.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ed09f700 1 --2- 172.21.15.36:0/174244038 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4e80b6380 0x7fb4e8140370 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7fb4d8002f70 tx=0x7fb4d8006eb0).stop 2022-01-10T01:34:13.922 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ed09f700 1 -- 172.21.15.36:0/174244038 shutdown_connections 2022-01-10T01:34:13.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ed09f700 1 --2- 172.21.15.36:0/174244038 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e80612f0 0x7fb4e80b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:13.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ed09f700 1 --2- 172.21.15.36:0/174244038 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4e80b6380 0x7fb4e8140370 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:13.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ed09f700 1 -- 172.21.15.36:0/174244038 >> 172.21.15.36:0/174244038 conn(0x7fb4e8063670 msgr2=0x7fb4e8063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:13.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ed09f700 1 -- 172.21.15.36:0/174244038 shutdown_connections 2022-01-10T01:34:13.923 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.908+0000 7fb4ed09f700 1 -- 172.21.15.36:0/174244038 wait complete. 2022-01-10T01:34:13.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4ed09f700 1 Processor -- start 2022-01-10T01:34:13.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4ed09f700 1 -- start start 2022-01-10T01:34:13.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4ed09f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4e80612f0 0x7fb4e8147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:13.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4ed09f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e80b2910 0x7fb4e80ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:13.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4ed09f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e80aeba0 0x7fb4e8145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:13.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4ed09f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80adcf0 con 0x7fb4e80612f0 2022-01-10T01:34:13.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4ed09f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8066e90 con 0x7fb4e80aeba0 2022-01-10T01:34:13.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4ed09f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80ae3c0 con 0x7fb4e80b2910 2022-01-10T01:34:13.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4e7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4e80612f0 0x7fb4e8147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:13.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4e7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4e80612f0 0x7fb4e8147ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43306/0 (socket says 172.21.15.36:43306) 2022-01-10T01:34:13.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4e7fff700 1 -- 172.21.15.36:0/1922167748 learned_addr learned my addr 172.21.15.36:0/1922167748 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:13.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4ec89e700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e80aeba0 0x7fb4e8145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:13.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4dffff700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e80b2910 0x7fb4e80ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:13.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4e7fff700 1 -- 172.21.15.36:0/1922167748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e80b2910 msgr2=0x7fb4e80ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:13.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4e7fff700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e80b2910 0x7fb4e80ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:13.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4e7fff700 1 -- 172.21.15.36:0/1922167748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e80aeba0 msgr2=0x7fb4e8145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:13.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4e7fff700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e80aeba0 0x7fb4e8145420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:13.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4e7fff700 1 -- 172.21.15.36:0/1922167748 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d800b1e0 con 0x7fb4e80612f0 2022-01-10T01:34:13.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4ec89e700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e80aeba0 0x7fb4e8145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:34:13.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4e7fff700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4e80612f0 0x7fb4e8147ae0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fb4d8002f70 tx=0x7fb4d8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:13.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4e5ffb700 1 -- 172.21.15.36:0/1922167748 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4d800d940 con 0x7fb4e80612f0 2022-01-10T01:34:13.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4e5ffb700 1 -- 172.21.15.36:0/1922167748 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d8006b40 con 0x7fb4e80612f0 2022-01-10T01:34:13.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4ed09f700 1 -- 172.21.15.36:0/1922167748 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e8143e10 con 0x7fb4e80612f0 2022-01-10T01:34:13.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4e5ffb700 1 -- 172.21.15.36:0/1922167748 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4d8011e90 con 0x7fb4e80612f0 2022-01-10T01:34:13.932 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4ed09f700 1 -- 172.21.15.36:0/1922167748 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e80b5d50 con 0x7fb4e80612f0 2022-01-10T01:34:13.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.912+0000 7fb4ed09f700 1 -- 172.21.15.36:0/1922167748 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e80ae120 con 0x7fb4e80612f0 2022-01-10T01:34:13.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.916+0000 7fb4e5ffb700 1 -- 172.21.15.36:0/1922167748 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fb4d8025030 con 0x7fb4e80612f0 2022-01-10T01:34:13.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.916+0000 7fb4e5ffb700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb4cc053680 0x7fb4cc055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:13.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.916+0000 7fb4e5ffb700 1 -- 172.21.15.36:0/1922167748 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fb4d806cdb0 con 0x7fb4e80612f0 2022-01-10T01:34:13.933 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.916+0000 7fb4dffff700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb4cc053680 0x7fb4cc055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:13.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.916+0000 7fb4dffff700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb4cc053680 0x7fb4cc055b40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fb4d000b000 tx=0x7fb4d0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:13.934 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:13.924+0000 7fb4e5ffb700 1 -- 172.21.15.36:0/1922167748 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fb4e80ae120 con 0x7fb4e80612f0 2022-01-10T01:34:14.055 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.048+0000 7fb4ed09f700 1 -- 172.21.15.36:0/1922167748 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb4e80ae120 con 0x7fb4e80612f0 2022-01-10T01:34:14.056 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.048+0000 7fb4e5ffb700 1 -- 172.21.15.36:0/1922167748 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v159) v1 ==== 81+0+34051 (secure 0 0 0) 0x7fb4e80ae120 con 0x7fb4e80612f0 2022-01-10T01:34:14.057 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:14.058 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T01:34:14.058 INFO:teuthology.orchestra.run.smithi036.stdout: "epoch": 159, 2022-01-10T01:34:14.058 INFO:teuthology.orchestra.run.smithi036.stdout: "fsid": "5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762", 2022-01-10T01:34:14.059 INFO:teuthology.orchestra.run.smithi036.stdout: "created": "2022-01-10T01:24:05.534504+0000", 2022-01-10T01:34:14.059 INFO:teuthology.orchestra.run.smithi036.stdout: "modified": "2022-01-10T01:34:05.469195+0000", 2022-01-10T01:34:14.059 INFO:teuthology.orchestra.run.smithi036.stdout: "last_up_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:34:14.059 INFO:teuthology.orchestra.run.smithi036.stdout: "last_in_change": "2022-01-10T01:24:13.640947+0000", 2022-01-10T01:34:14.060 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2022-01-10T01:34:14.060 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_num": 5799936, 2022-01-10T01:34:14.060 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_set": [ 2022-01-10T01:34:14.060 INFO:teuthology.orchestra.run.smithi036.stdout: "pglog_hardlimit", 2022-01-10T01:34:14.060 INFO:teuthology.orchestra.run.smithi036.stdout: "purged_snapdirs", 2022-01-10T01:34:14.061 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_deletes", 2022-01-10T01:34:14.061 INFO:teuthology.orchestra.run.smithi036.stdout: "sortbitwise" 2022-01-10T01:34:14.061 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:34:14.061 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_version": 5, 2022-01-10T01:34:14.062 INFO:teuthology.orchestra.run.smithi036.stdout: "full_ratio": 0.94999998807907104, 2022-01-10T01:34:14.062 INFO:teuthology.orchestra.run.smithi036.stdout: "backfillfull_ratio": 0.89999997615814209, 2022-01-10T01:34:14.062 INFO:teuthology.orchestra.run.smithi036.stdout: "nearfull_ratio": 0.85000002384185791, 2022-01-10T01:34:14.062 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_snapshot": "", 2022-01-10T01:34:14.063 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_max": 30, 2022-01-10T01:34:14.063 INFO:teuthology.orchestra.run.smithi036.stdout: "max_osd": 8, 2022-01-10T01:34:14.063 INFO:teuthology.orchestra.run.smithi036.stdout: "require_min_compat_client": "jewel", 2022-01-10T01:34:14.063 INFO:teuthology.orchestra.run.smithi036.stdout: "min_compat_client": "jewel", 2022-01-10T01:34:14.063 INFO:teuthology.orchestra.run.smithi036.stdout: "require_osd_release": "octopus", 2022-01-10T01:34:14.064 INFO:teuthology.orchestra.run.smithi036.stdout: "pools": [ 2022-01-10T01:34:14.064 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.064 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 1, 2022-01-10T01:34:14.064 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "device_health_metrics", 2022-01-10T01:34:14.065 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:08.421647+0000", 2022-01-10T01:34:14.065 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:34:14.065 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:34:14.065 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:34:14.065 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:34:14.066 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:34:14.066 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:34:14.066 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:34:14.066 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:34:14.067 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 1, 2022-01-10T01:34:14.067 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 1, 2022-01-10T01:34:14.067 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 1, 2022-01-10T01:34:14.067 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 1, 2022-01-10T01:34:14.068 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 1, 2022-01-10T01:34:14.068 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:34:14.068 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:34:14.068 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:34:14.069 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:34:14.069 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:34:14.069 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:34:14.069 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:34:14.069 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.070 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "15", 2022-01-10T01:34:14.070 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:34:14.070 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:34:14.070 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:34:14.071 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:34:14.071 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:34:14.071 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:34:14.071 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:34:14.071 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:34:14.072 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:34:14.072 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:34:14.072 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:34:14.072 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:34:14.073 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:34:14.073 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:34:14.073 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:34:14.073 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:34:14.073 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:34:14.074 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:34:14.074 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:34:14.074 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:34:14.074 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:34:14.075 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:34:14.075 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:34:14.075 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:34:14.075 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:34:14.076 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:34:14.076 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.076 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:34:14.076 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:34:14.076 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:34:14.077 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:34:14.077 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:34:14.077 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:34:14.077 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:34:14.078 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:34:14.078 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:34:14.078 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:34:14.078 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:34:14.079 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:34:14.079 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 1 2022-01-10T01:34:14.079 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.079 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:34:14.079 INFO:teuthology.orchestra.run.smithi036.stdout: "mgr_devicehealth": {} 2022-01-10T01:34:14.080 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.080 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.080 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.081 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 2, 2022-01-10T01:34:14.081 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "rbd", 2022-01-10T01:34:14.081 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:24:17.709769+0000", 2022-01-10T01:34:14.081 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:34:14.082 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:34:14.082 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:34:14.082 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:34:14.082 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:34:14.082 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:34:14.083 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:34:14.083 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:34:14.083 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:34:14.083 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:34:14.084 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:34:14.084 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:34:14.084 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:34:14.084 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:34:14.084 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:34:14.085 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:34:14.085 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:34:14.085 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:34:14.085 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:34:14.086 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:34:14.086 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.086 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "18", 2022-01-10T01:34:14.086 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:34:14.087 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:34:14.087 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:34:14.087 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:34:14.087 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:34:14.087 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:34:14.088 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:34:14.088 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:34:14.088 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:34:14.088 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:34:14.089 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:34:14.089 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:34:14.089 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:34:14.089 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:34:14.089 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:34:14.090 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:34:14.090 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:34:14.090 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:34:14.090 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:34:14.091 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:34:14.091 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:34:14.091 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:34:14.091 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:34:14.092 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:34:14.092 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:34:14.092 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:34:14.092 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.093 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:34:14.093 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:34:14.093 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:34:14.093 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:34:14.094 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:34:14.094 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:34:14.094 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:34:14.094 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:34:14.094 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:34:14.095 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:34:14.095 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:34:14.095 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:34:14.095 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:34:14.096 INFO:teuthology.orchestra.run.smithi036.stdout: "rbd": {} 2022-01-10T01:34:14.096 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.096 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.096 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.096 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 29, 2022-01-10T01:34:14.097 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_metadata", 2022-01-10T01:34:14.097 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:34:02.282468+0000", 2022-01-10T01:34:14.097 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:34:14.097 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:34:14.098 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:34:14.098 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:34:14.098 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:34:14.098 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:34:14.099 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:34:14.099 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:34:14.099 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:34:14.099 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:34:14.099 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:34:14.100 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:34:14.100 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:34:14.100 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:34:14.100 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:34:14.101 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:34:14.101 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:34:14.101 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:34:14.101 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:34:14.102 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:34:14.102 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.102 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "158", 2022-01-10T01:34:14.102 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:34:14.102 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:34:14.103 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:34:14.103 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:34:14.103 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:34:14.103 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:34:14.104 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:34:14.104 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:34:14.104 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:34:14.104 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:34:14.104 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:34:14.105 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:34:14.105 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:34:14.105 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:34:14.105 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:34:14.106 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:34:14.106 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:34:14.106 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:34:14.106 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:34:14.106 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:34:14.107 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:34:14.107 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:34:14.107 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:34:14.107 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:34:14.107 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:34:14.108 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:34:14.108 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.108 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:34:14.108 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:34:14.109 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:34:14.109 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:34:14.109 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:34:14.109 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:34:14.109 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:34:14.110 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:34:14.110 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:34:14.110 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:34:14.110 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:34:14.111 INFO:teuthology.orchestra.run.smithi036.stdout: "options": { 2022-01-10T01:34:14.111 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_bias": 4, 2022-01-10T01:34:14.111 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_min": 16, 2022-01-10T01:34:14.111 INFO:teuthology.orchestra.run.smithi036.stdout: "recovery_priority": 5 2022-01-10T01:34:14.111 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.112 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:34:14.112 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:34:14.112 INFO:teuthology.orchestra.run.smithi036.stdout: "metadata": "cephfs" 2022-01-10T01:34:14.112 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.113 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.113 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.113 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.113 INFO:teuthology.orchestra.run.smithi036.stdout: "pool": 30, 2022-01-10T01:34:14.113 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_name": "cephfs_data", 2022-01-10T01:34:14.114 INFO:teuthology.orchestra.run.smithi036.stdout: "create_time": "2022-01-10T01:34:03.465498+0000", 2022-01-10T01:34:14.114 INFO:teuthology.orchestra.run.smithi036.stdout: "flags": 1, 2022-01-10T01:34:14.114 INFO:teuthology.orchestra.run.smithi036.stdout: "flags_names": "hashpspool", 2022-01-10T01:34:14.114 INFO:teuthology.orchestra.run.smithi036.stdout: "type": 1, 2022-01-10T01:34:14.115 INFO:teuthology.orchestra.run.smithi036.stdout: "size": 2, 2022-01-10T01:34:14.115 INFO:teuthology.orchestra.run.smithi036.stdout: "min_size": 1, 2022-01-10T01:34:14.115 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_rule": 0, 2022-01-10T01:34:14.115 INFO:teuthology.orchestra.run.smithi036.stdout: "object_hash": 2, 2022-01-10T01:34:14.115 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_autoscale_mode": "off", 2022-01-10T01:34:14.116 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num": 8, 2022-01-10T01:34:14.116 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num": 8, 2022-01-10T01:34:14.116 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_placement_num_target": 8, 2022-01-10T01:34:14.116 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_target": 8, 2022-01-10T01:34:14.117 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_num_pending": 8, 2022-01-10T01:34:14.117 INFO:teuthology.orchestra.run.smithi036.stdout: "last_pg_merge_meta": { 2022-01-10T01:34:14.117 INFO:teuthology.orchestra.run.smithi036.stdout: "source_pgid": "0.0", 2022-01-10T01:34:14.117 INFO:teuthology.orchestra.run.smithi036.stdout: "ready_epoch": 0, 2022-01-10T01:34:14.117 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_started": 0, 2022-01-10T01:34:14.118 INFO:teuthology.orchestra.run.smithi036.stdout: "last_epoch_clean": 0, 2022-01-10T01:34:14.118 INFO:teuthology.orchestra.run.smithi036.stdout: "source_version": "0'0", 2022-01-10T01:34:14.118 INFO:teuthology.orchestra.run.smithi036.stdout: "target_version": "0'0" 2022-01-10T01:34:14.118 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.118 INFO:teuthology.orchestra.run.smithi036.stdout: "last_change": "159", 2022-01-10T01:34:14.119 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend": "0", 2022-01-10T01:34:14.119 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_prenautilus": "0", 2022-01-10T01:34:14.119 INFO:teuthology.orchestra.run.smithi036.stdout: "last_force_op_resend_preluminous": "0", 2022-01-10T01:34:14.119 INFO:teuthology.orchestra.run.smithi036.stdout: "auid": 0, 2022-01-10T01:34:14.120 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_mode": "selfmanaged", 2022-01-10T01:34:14.120 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_seq": 0, 2022-01-10T01:34:14.120 INFO:teuthology.orchestra.run.smithi036.stdout: "snap_epoch": 0, 2022-01-10T01:34:14.120 INFO:teuthology.orchestra.run.smithi036.stdout: "pool_snaps": [], 2022-01-10T01:34:14.121 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps": "[]", 2022-01-10T01:34:14.121 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_bytes": 0, 2022-01-10T01:34:14.121 INFO:teuthology.orchestra.run.smithi036.stdout: "quota_max_objects": 0, 2022-01-10T01:34:14.121 INFO:teuthology.orchestra.run.smithi036.stdout: "tiers": [], 2022-01-10T01:34:14.121 INFO:teuthology.orchestra.run.smithi036.stdout: "tier_of": -1, 2022-01-10T01:34:14.122 INFO:teuthology.orchestra.run.smithi036.stdout: "read_tier": -1, 2022-01-10T01:34:14.122 INFO:teuthology.orchestra.run.smithi036.stdout: "write_tier": -1, 2022-01-10T01:34:14.122 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_mode": "none", 2022-01-10T01:34:14.122 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_bytes": 0, 2022-01-10T01:34:14.123 INFO:teuthology.orchestra.run.smithi036.stdout: "target_max_objects": 0, 2022-01-10T01:34:14.123 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_ratio_micro": 400000, 2022-01-10T01:34:14.123 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2022-01-10T01:34:14.123 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_target_full_ratio_micro": 800000, 2022-01-10T01:34:14.123 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_flush_age": 0, 2022-01-10T01:34:14.124 INFO:teuthology.orchestra.run.smithi036.stdout: "cache_min_evict_age": 0, 2022-01-10T01:34:14.124 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profile": "", 2022-01-10T01:34:14.124 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_params": { 2022-01-10T01:34:14.124 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "none" 2022-01-10T01:34:14.124 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.125 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_period": 0, 2022-01-10T01:34:14.125 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_count": 0, 2022-01-10T01:34:14.125 INFO:teuthology.orchestra.run.smithi036.stdout: "use_gmt_hitset": true, 2022-01-10T01:34:14.125 INFO:teuthology.orchestra.run.smithi036.stdout: "min_read_recency_for_promote": 0, 2022-01-10T01:34:14.126 INFO:teuthology.orchestra.run.smithi036.stdout: "min_write_recency_for_promote": 0, 2022-01-10T01:34:14.126 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_grade_decay_rate": 0, 2022-01-10T01:34:14.126 INFO:teuthology.orchestra.run.smithi036.stdout: "hit_set_search_last_n": 0, 2022-01-10T01:34:14.126 INFO:teuthology.orchestra.run.smithi036.stdout: "grade_table": [], 2022-01-10T01:34:14.127 INFO:teuthology.orchestra.run.smithi036.stdout: "stripe_width": 0, 2022-01-10T01:34:14.127 INFO:teuthology.orchestra.run.smithi036.stdout: "expected_num_objects": 0, 2022-01-10T01:34:14.127 INFO:teuthology.orchestra.run.smithi036.stdout: "fast_read": false, 2022-01-10T01:34:14.127 INFO:teuthology.orchestra.run.smithi036.stdout: "options": {}, 2022-01-10T01:34:14.127 INFO:teuthology.orchestra.run.smithi036.stdout: "application_metadata": { 2022-01-10T01:34:14.128 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs": { 2022-01-10T01:34:14.128 INFO:teuthology.orchestra.run.smithi036.stdout: "data": "cephfs" 2022-01-10T01:34:14.128 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.128 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.129 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.129 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:34:14.129 INFO:teuthology.orchestra.run.smithi036.stdout: "osds": [ 2022-01-10T01:34:14.129 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.129 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:34:14.130 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a2c54e57-d684-47f3-9881-521ca63b1599", 2022-01-10T01:34:14.130 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:34:14.130 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:34:14.130 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:34:14.130 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:34:14.131 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:34:14.131 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:34:14.131 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:34:14.131 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 157, 2022-01-10T01:34:14.132 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:34:14.132 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:34:14.132 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:34:14.132 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.133 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.133 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.133 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6802", 2022-01-10T01:34:14.133 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:34:14.133 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.134 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.134 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.134 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6803", 2022-01-10T01:34:14.134 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:34:14.135 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.135 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.135 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.135 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:34:14.135 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.136 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.136 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.136 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6804", 2022-01-10T01:34:14.136 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:34:14.136 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.137 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.137 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.137 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6805", 2022-01-10T01:34:14.137 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:34:14.138 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.138 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.138 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.138 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:34:14.138 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.139 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.139 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.139 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6808", 2022-01-10T01:34:14.139 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:34:14.140 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.140 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.140 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.140 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6809", 2022-01-10T01:34:14.140 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:34:14.141 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.141 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.141 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.141 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:34:14.142 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.142 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.142 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.142 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6806", 2022-01-10T01:34:14.142 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:34:14.143 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.143 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.143 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.143 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6807", 2022-01-10T01:34:14.144 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14818 2022-01-10T01:34:14.144 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.144 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.144 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.144 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6803/14818", 2022-01-10T01:34:14.145 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6805/14818", 2022-01-10T01:34:14.145 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6809/14818", 2022-01-10T01:34:14.145 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6807/14818", 2022-01-10T01:34:14.145 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:34:14.146 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:34:14.146 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:34:14.146 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.146 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.146 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.147 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:34:14.147 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "0cfbf9a2-d507-48e2-b6e5-dfec71376624", 2022-01-10T01:34:14.147 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:34:14.147 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:34:14.148 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:34:14.148 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:34:14.148 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:34:14.148 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:34:14.148 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:34:14.149 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 157, 2022-01-10T01:34:14.149 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:34:14.149 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:34:14.149 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:34:14.149 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.150 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.150 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.150 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6826", 2022-01-10T01:34:14.150 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:34:14.151 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.151 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.151 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.151 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6827", 2022-01-10T01:34:14.151 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:34:14.152 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.152 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.152 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.153 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:34:14.153 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.153 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.153 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.154 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6828", 2022-01-10T01:34:14.154 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:34:14.154 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.154 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.154 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.155 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6829", 2022-01-10T01:34:14.155 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:34:14.155 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.155 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.156 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.156 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:34:14.156 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.156 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.156 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.157 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6832", 2022-01-10T01:34:14.157 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:34:14.157 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.157 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.158 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.158 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6833", 2022-01-10T01:34:14.158 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:34:14.158 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.158 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.159 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.159 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:34:14.159 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.159 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.160 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.160 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6830", 2022-01-10T01:34:14.160 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:34:14.160 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.161 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.161 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.161 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6831", 2022-01-10T01:34:14.161 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14819 2022-01-10T01:34:14.162 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.162 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.162 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.162 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6827/14819", 2022-01-10T01:34:14.163 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6829/14819", 2022-01-10T01:34:14.163 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6833/14819", 2022-01-10T01:34:14.163 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6831/14819", 2022-01-10T01:34:14.163 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:34:14.163 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:34:14.164 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:34:14.164 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.164 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.164 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.165 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:34:14.165 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "7143a0cb-c0a4-4546-9c0a-98466a260cbe", 2022-01-10T01:34:14.165 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:34:14.165 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:34:14.165 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:34:14.166 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:34:14.166 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:34:14.166 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:34:14.166 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:34:14.167 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 157, 2022-01-10T01:34:14.167 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:34:14.167 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:34:14.167 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:34:14.168 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.168 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.168 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.168 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6810", 2022-01-10T01:34:14.168 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:34:14.169 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.169 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.169 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.169 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6812", 2022-01-10T01:34:14.170 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:34:14.170 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.170 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.170 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.171 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:34:14.171 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.171 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.171 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.171 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6814", 2022-01-10T01:34:14.172 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:34:14.172 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.172 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.172 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.173 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6816", 2022-01-10T01:34:14.173 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:34:14.173 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.173 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.174 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.174 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:34:14.174 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.174 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.175 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.175 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6822", 2022-01-10T01:34:14.175 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:34:14.175 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.176 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.176 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.176 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6824", 2022-01-10T01:34:14.176 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:34:14.177 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.177 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.177 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.177 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:34:14.177 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.178 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.178 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.178 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6818", 2022-01-10T01:34:14.178 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:34:14.179 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.179 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.179 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.179 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6820", 2022-01-10T01:34:14.179 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14817 2022-01-10T01:34:14.180 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.180 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.180 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.180 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6812/14817", 2022-01-10T01:34:14.181 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6816/14817", 2022-01-10T01:34:14.181 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6824/14817", 2022-01-10T01:34:14.181 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6820/14817", 2022-01-10T01:34:14.181 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:34:14.182 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:34:14.182 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:34:14.182 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.182 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.182 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.183 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:34:14.183 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658", 2022-01-10T01:34:14.183 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:34:14.183 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:34:14.184 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:34:14.184 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:34:14.184 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:34:14.184 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:34:14.185 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:34:14.185 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 145, 2022-01-10T01:34:14.185 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:34:14.185 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:34:14.185 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:34:14.186 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.186 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.186 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.186 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6811", 2022-01-10T01:34:14.187 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:34:14.187 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.187 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.187 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.187 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6813", 2022-01-10T01:34:14.188 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:34:14.188 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.188 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.188 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.189 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:34:14.189 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.189 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.189 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.190 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6815", 2022-01-10T01:34:14.190 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:34:14.190 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.190 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.190 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.191 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6817", 2022-01-10T01:34:14.191 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:34:14.191 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.191 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.192 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.192 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:34:14.192 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.192 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.193 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.193 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6823", 2022-01-10T01:34:14.193 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:34:14.193 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.194 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.194 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.194 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6825", 2022-01-10T01:34:14.194 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:34:14.194 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.195 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.195 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.195 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:34:14.195 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.196 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.196 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.196 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6819", 2022-01-10T01:34:14.196 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:34:14.197 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.197 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.197 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.197 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.36:6821", 2022-01-10T01:34:14.197 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 14836 2022-01-10T01:34:14.198 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.198 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.198 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.198 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.36:6813/14836", 2022-01-10T01:34:14.199 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.36:6817/14836", 2022-01-10T01:34:14.199 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.36:6825/14836", 2022-01-10T01:34:14.199 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.36:6821/14836", 2022-01-10T01:34:14.199 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:34:14.200 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:34:14.200 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:34:14.200 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.200 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.200 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.201 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:34:14.201 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "350c419b-492c-49e8-aaff-2aeae92df740", 2022-01-10T01:34:14.201 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:34:14.201 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:34:14.202 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:34:14.202 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:34:14.202 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:34:14.202 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:34:14.203 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:34:14.203 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 157, 2022-01-10T01:34:14.203 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:34:14.203 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:34:14.204 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:34:14.204 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.204 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.204 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.204 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6800", 2022-01-10T01:34:14.205 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:34:14.205 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.205 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.205 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.205 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6801", 2022-01-10T01:34:14.206 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:34:14.206 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.206 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.206 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.207 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:34:14.207 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.207 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.207 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.207 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6802", 2022-01-10T01:34:14.208 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:34:14.208 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.208 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.208 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.209 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6803", 2022-01-10T01:34:14.209 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:34:14.209 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.209 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.210 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.210 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:34:14.210 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.210 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.210 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.211 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6806", 2022-01-10T01:34:14.211 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:34:14.211 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.212 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.212 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.212 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6807", 2022-01-10T01:34:14.212 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:34:14.213 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.213 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.213 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.213 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:34:14.213 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.214 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.214 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.214 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6804", 2022-01-10T01:34:14.214 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:34:14.215 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.215 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.215 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.215 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6805", 2022-01-10T01:34:14.216 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15004 2022-01-10T01:34:14.216 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.216 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.216 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.216 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6801/15004", 2022-01-10T01:34:14.217 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6803/15004", 2022-01-10T01:34:14.217 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6807/15004", 2022-01-10T01:34:14.217 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6805/15004", 2022-01-10T01:34:14.217 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:34:14.218 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:34:14.218 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:34:14.218 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.218 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.219 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.219 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:34:14.219 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "cf1bcd16-ec47-48e8-a02d-4584906a733c", 2022-01-10T01:34:14.224 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:34:14.224 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:34:14.224 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:34:14.225 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:34:14.225 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:34:14.225 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:34:14.225 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:34:14.226 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 157, 2022-01-10T01:34:14.226 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:34:14.226 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:34:14.226 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:34:14.227 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.227 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.227 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.227 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6816", 2022-01-10T01:34:14.227 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:34:14.228 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.228 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.228 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.228 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6817", 2022-01-10T01:34:14.229 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:34:14.229 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.229 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.229 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.230 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:34:14.230 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.230 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.230 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.230 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6818", 2022-01-10T01:34:14.231 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:34:14.231 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.231 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.231 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.232 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6819", 2022-01-10T01:34:14.232 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:34:14.232 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.232 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.233 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.233 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:34:14.233 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.233 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.233 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.234 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6822", 2022-01-10T01:34:14.234 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:34:14.234 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.234 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.235 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.235 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6823", 2022-01-10T01:34:14.235 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:34:14.235 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.235 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.236 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.236 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:34:14.236 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.236 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.237 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.237 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6820", 2022-01-10T01:34:14.237 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:34:14.237 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.238 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.238 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.238 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6821", 2022-01-10T01:34:14.238 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15003 2022-01-10T01:34:14.238 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.239 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.239 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.239 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6817/15003", 2022-01-10T01:34:14.239 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6819/15003", 2022-01-10T01:34:14.240 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6823/15003", 2022-01-10T01:34:14.240 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6821/15003", 2022-01-10T01:34:14.240 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:34:14.240 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:34:14.240 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:34:14.241 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.241 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.241 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.241 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:34:14.242 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "422dfc5a-d338-4a98-aaea-9bfccaaa81bb", 2022-01-10T01:34:14.242 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:34:14.242 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:34:14.242 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:34:14.243 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:34:14.243 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:34:14.243 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:34:14.243 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:34:14.243 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 157, 2022-01-10T01:34:14.244 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:34:14.244 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:34:14.244 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:34:14.245 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.245 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.245 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.245 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6808", 2022-01-10T01:34:14.245 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:34:14.246 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.246 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.246 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.246 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6809", 2022-01-10T01:34:14.247 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:34:14.247 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.247 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.247 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.248 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:34:14.248 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.248 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.248 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.249 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6810", 2022-01-10T01:34:14.249 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:34:14.249 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.249 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.249 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.250 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6811", 2022-01-10T01:34:14.250 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:34:14.250 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.250 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.251 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.251 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:34:14.251 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.251 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.251 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.252 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6814", 2022-01-10T01:34:14.252 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:34:14.252 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.253 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.253 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.253 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6815", 2022-01-10T01:34:14.253 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:34:14.254 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.254 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.254 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.254 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:34:14.255 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.255 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.255 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.255 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6812", 2022-01-10T01:34:14.255 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:34:14.256 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.256 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.256 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.256 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6813", 2022-01-10T01:34:14.257 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15005 2022-01-10T01:34:14.257 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.257 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.257 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.257 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6809/15005", 2022-01-10T01:34:14.258 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6811/15005", 2022-01-10T01:34:14.258 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6815/15005", 2022-01-10T01:34:14.258 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6813/15005", 2022-01-10T01:34:14.258 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:34:14.259 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:34:14.259 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:34:14.259 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.259 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.260 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.260 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:34:14.260 INFO:teuthology.orchestra.run.smithi036.stdout: "uuid": "192022a0-7ba3-469e-a84e-f9ec7c31ac51", 2022-01-10T01:34:14.260 INFO:teuthology.orchestra.run.smithi036.stdout: "up": 1, 2022-01-10T01:34:14.261 INFO:teuthology.orchestra.run.smithi036.stdout: "in": 1, 2022-01-10T01:34:14.261 INFO:teuthology.orchestra.run.smithi036.stdout: "weight": 1, 2022-01-10T01:34:14.261 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_affinity": 1, 2022-01-10T01:34:14.261 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_begin": 0, 2022-01-10T01:34:14.262 INFO:teuthology.orchestra.run.smithi036.stdout: "last_clean_end": 0, 2022-01-10T01:34:14.262 INFO:teuthology.orchestra.run.smithi036.stdout: "up_from": 13, 2022-01-10T01:34:14.262 INFO:teuthology.orchestra.run.smithi036.stdout: "up_thru": 157, 2022-01-10T01:34:14.262 INFO:teuthology.orchestra.run.smithi036.stdout: "down_at": 0, 2022-01-10T01:34:14.262 INFO:teuthology.orchestra.run.smithi036.stdout: "lost_at": 0, 2022-01-10T01:34:14.263 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addrs": { 2022-01-10T01:34:14.263 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.263 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.263 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.264 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6824", 2022-01-10T01:34:14.264 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:34:14.264 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.264 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.264 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.265 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6825", 2022-01-10T01:34:14.265 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:34:14.265 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.265 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.266 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.266 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addrs": { 2022-01-10T01:34:14.266 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.266 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.266 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.267 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6826", 2022-01-10T01:34:14.267 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:34:14.267 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.267 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.268 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.268 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6827", 2022-01-10T01:34:14.268 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:34:14.268 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.268 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.269 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.269 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addrs": { 2022-01-10T01:34:14.269 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.269 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.270 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.270 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6830", 2022-01-10T01:34:14.270 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:34:14.270 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.271 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.271 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.271 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6831", 2022-01-10T01:34:14.271 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:34:14.271 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.272 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.272 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.272 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addrs": { 2022-01-10T01:34:14.272 INFO:teuthology.orchestra.run.smithi036.stdout: "addrvec": [ 2022-01-10T01:34:14.273 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.273 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v2", 2022-01-10T01:34:14.273 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6828", 2022-01-10T01:34:14.273 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:34:14.273 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.274 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.274 INFO:teuthology.orchestra.run.smithi036.stdout: "type": "v1", 2022-01-10T01:34:14.274 INFO:teuthology.orchestra.run.smithi036.stdout: "addr": "172.21.15.59:6829", 2022-01-10T01:34:14.274 INFO:teuthology.orchestra.run.smithi036.stdout: "nonce": 15006 2022-01-10T01:34:14.275 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.275 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.275 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.275 INFO:teuthology.orchestra.run.smithi036.stdout: "public_addr": "172.21.15.59:6825/15006", 2022-01-10T01:34:14.275 INFO:teuthology.orchestra.run.smithi036.stdout: "cluster_addr": "172.21.15.59:6827/15006", 2022-01-10T01:34:14.276 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_back_addr": "172.21.15.59:6831/15006", 2022-01-10T01:34:14.276 INFO:teuthology.orchestra.run.smithi036.stdout: "heartbeat_front_addr": "172.21.15.59:6829/15006", 2022-01-10T01:34:14.276 INFO:teuthology.orchestra.run.smithi036.stdout: "state": [ 2022-01-10T01:34:14.276 INFO:teuthology.orchestra.run.smithi036.stdout: "exists", 2022-01-10T01:34:14.277 INFO:teuthology.orchestra.run.smithi036.stdout: "up" 2022-01-10T01:34:14.277 INFO:teuthology.orchestra.run.smithi036.stdout: ] 2022-01-10T01:34:14.277 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.277 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:34:14.277 INFO:teuthology.orchestra.run.smithi036.stdout: "osd_xinfo": [ 2022-01-10T01:34:14.278 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.278 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 0, 2022-01-10T01:34:14.278 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:34:14.278 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:34:14.279 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:34:14.279 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:34:14.279 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:34:14.279 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.768821+0000", 2022-01-10T01:34:14.279 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:34:14.280 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.280 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.280 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 1, 2022-01-10T01:34:14.280 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:34:14.281 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:34:14.281 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:34:14.281 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:34:14.281 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:34:14.281 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.996718+0000", 2022-01-10T01:34:14.282 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:34:14.282 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.282 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.282 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 2, 2022-01-10T01:34:14.283 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:34:14.283 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:34:14.283 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:34:14.283 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:34:14.284 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:34:14.284 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.976603+0000", 2022-01-10T01:34:14.284 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:34:14.284 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.284 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.285 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 3, 2022-01-10T01:34:14.285 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:34:14.285 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:34:14.285 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:34:14.286 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:34:14.286 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:34:14.286 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.013480+0000", 2022-01-10T01:34:14.286 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:34:14.286 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.287 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.287 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 4, 2022-01-10T01:34:14.287 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:34:14.287 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:34:14.288 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:34:14.288 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:34:14.288 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:34:14.288 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.739592+0000", 2022-01-10T01:34:14.289 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:34:14.289 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.289 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.289 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 5, 2022-01-10T01:34:14.290 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:34:14.290 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:34:14.290 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:34:14.290 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:34:14.290 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:34:14.291 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.944559+0000", 2022-01-10T01:34:14.291 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:34:14.291 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.291 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.292 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 6, 2022-01-10T01:34:14.292 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:34:14.292 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:34:14.292 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:34:14.293 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:34:14.293 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:34:14.293 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:11.992632+0000", 2022-01-10T01:34:14.293 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:34:14.294 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.294 INFO:teuthology.orchestra.run.smithi036.stdout: { 2022-01-10T01:34:14.294 INFO:teuthology.orchestra.run.smithi036.stdout: "osd": 7, 2022-01-10T01:34:14.294 INFO:teuthology.orchestra.run.smithi036.stdout: "down_stamp": "0.000000", 2022-01-10T01:34:14.295 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_probability": 0, 2022-01-10T01:34:14.295 INFO:teuthology.orchestra.run.smithi036.stdout: "laggy_interval": 0, 2022-01-10T01:34:14.295 INFO:teuthology.orchestra.run.smithi036.stdout: "features": 4540138292840890367, 2022-01-10T01:34:14.295 INFO:teuthology.orchestra.run.smithi036.stdout: "old_weight": 0, 2022-01-10T01:34:14.295 INFO:teuthology.orchestra.run.smithi036.stdout: "last_purged_snaps_scrub": "2022-01-10T01:24:12.066260+0000", 2022-01-10T01:34:14.296 INFO:teuthology.orchestra.run.smithi036.stdout: "dead_epoch": 0 2022-01-10T01:34:14.296 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.296 INFO:teuthology.orchestra.run.smithi036.stdout: ], 2022-01-10T01:34:14.296 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap": [], 2022-01-10T01:34:14.297 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_upmap_items": [], 2022-01-10T01:34:14.297 INFO:teuthology.orchestra.run.smithi036.stdout: "pg_temp": [], 2022-01-10T01:34:14.297 INFO:teuthology.orchestra.run.smithi036.stdout: "primary_temp": [], 2022-01-10T01:34:14.297 INFO:teuthology.orchestra.run.smithi036.stdout: "blacklist": {}, 2022-01-10T01:34:14.297 INFO:teuthology.orchestra.run.smithi036.stdout: "erasure_code_profiles": { 2022-01-10T01:34:14.298 INFO:teuthology.orchestra.run.smithi036.stdout: "cephfs_data": { 2022-01-10T01:34:14.298 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-device-class": "", 2022-01-10T01:34:14.298 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:34:14.298 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-root": "default", 2022-01-10T01:34:14.299 INFO:teuthology.orchestra.run.smithi036.stdout: "jerasure-per-chunk-alignment": "false", 2022-01-10T01:34:14.299 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:34:14.299 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "2", 2022-01-10T01:34:14.299 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:34:14.300 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:34:14.300 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van", 2022-01-10T01:34:14.300 INFO:teuthology.orchestra.run.smithi036.stdout: "w": "8" 2022-01-10T01:34:14.300 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.300 INFO:teuthology.orchestra.run.smithi036.stdout: "default": { 2022-01-10T01:34:14.301 INFO:teuthology.orchestra.run.smithi036.stdout: "crush-failure-domain": "osd", 2022-01-10T01:34:14.301 INFO:teuthology.orchestra.run.smithi036.stdout: "k": "2", 2022-01-10T01:34:14.301 INFO:teuthology.orchestra.run.smithi036.stdout: "m": "1", 2022-01-10T01:34:14.301 INFO:teuthology.orchestra.run.smithi036.stdout: "plugin": "jerasure", 2022-01-10T01:34:14.302 INFO:teuthology.orchestra.run.smithi036.stdout: "ruleset-failure-domain": "osd", 2022-01-10T01:34:14.302 INFO:teuthology.orchestra.run.smithi036.stdout: "technique": "reed_sol_van" 2022-01-10T01:34:14.302 INFO:teuthology.orchestra.run.smithi036.stdout: } 2022-01-10T01:34:14.302 INFO:teuthology.orchestra.run.smithi036.stdout: }, 2022-01-10T01:34:14.303 INFO:teuthology.orchestra.run.smithi036.stdout: "removed_snaps_queue": [], 2022-01-10T01:34:14.303 INFO:teuthology.orchestra.run.smithi036.stdout: "new_removed_snaps": [], 2022-01-10T01:34:14.303 INFO:teuthology.orchestra.run.smithi036.stdout: "new_purged_snaps": [], 2022-01-10T01:34:14.303 INFO:teuthology.orchestra.run.smithi036.stdout: "crush_node_flags": {}, 2022-01-10T01:34:14.303 INFO:teuthology.orchestra.run.smithi036.stdout: "device_class_flags": {} 2022-01-10T01:34:14.304 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T01:34:14.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.052+0000 7fb4ed09f700 1 -- 172.21.15.36:0/1922167748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb4cc053680 msgr2=0x7fb4cc055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:14.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.052+0000 7fb4ed09f700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb4cc053680 0x7fb4cc055b40 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7fb4d000b000 tx=0x7fb4d0009040).stop 2022-01-10T01:34:14.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.052+0000 7fb4ed09f700 1 -- 172.21.15.36:0/1922167748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4e80612f0 msgr2=0x7fb4e8147ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:14.306 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.052+0000 7fb4ed09f700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4e80612f0 0x7fb4e8147ae0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fb4d8002f70 tx=0x7fb4d8015000).stop 2022-01-10T01:34:14.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.052+0000 7fb4ed09f700 1 -- 172.21.15.36:0/1922167748 shutdown_connections 2022-01-10T01:34:14.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.052+0000 7fb4ed09f700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fb4cc053680 0x7fb4cc055b40 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.052+0000 7fb4ed09f700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4e80aeba0 0x7fb4e8145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.307 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.052+0000 7fb4ed09f700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4e80b2910 0x7fb4e80ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.052+0000 7fb4ed09f700 1 --2- 172.21.15.36:0/1922167748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fb4e80612f0 0x7fb4e8147ae0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.052+0000 7fb4ed09f700 1 -- 172.21.15.36:0/1922167748 >> 172.21.15.36:0/1922167748 conn(0x7fb4e8063670 msgr2=0x7fb4e813ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:14.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.052+0000 7fb4ed09f700 1 -- 172.21.15.36:0/1922167748 shutdown_connections 2022-01-10T01:34:14.308 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.052+0000 7fb4ed09f700 1 -- 172.21.15.36:0/1922167748 wait complete. 2022-01-10T01:34:14.309 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:34:14.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.412+0000 7f81de9a5700 1 Processor -- start 2022-01-10T01:34:14.422 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.412+0000 7f81de9a5700 1 -- start start 2022-01-10T01:34:14.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81de9a5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f81d80b6290 0x7f81d8061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:14.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81de9a5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81d80b4060 0x7f81d8061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:14.425 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81de9a5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d80b5f50 con 0x7f81d8061e50 2022-01-10T01:34:14.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81de9a5700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d80b1f70 con 0x7f81d80b6290 2022-01-10T01:34:14.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81de9a5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d80b2210 con 0x7f81d80b4060 2022-01-10T01:34:14.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81dd9a3700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f81d80b6290 0x7f81d8061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:14.426 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81dd9a3700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f81d80b6290 0x7f81d8061470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43314/0 (socket says 172.21.15.36:43314) 2022-01-10T01:34:14.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81dd9a3700 1 -- 172.21.15.36:0/888936772 learned_addr learned my addr 172.21.15.36:0/888936772 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:14.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81dd1a2700 1 --2- 172.21.15.36:0/888936772 >> v2:172.21.15.59:3300/0 conn(0x7f81d80b4060 0x7f81d8061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:14.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81dd9a3700 1 -- 172.21.15.36:0/888936772 >> v2:172.21.15.59:3300/0 conn(0x7f81d80b4060 msgr2=0x7f81d8061960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:14.427 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81dd9a3700 1 --2- 172.21.15.36:0/888936772 >> v2:172.21.15.59:3300/0 conn(0x7f81d80b4060 0x7f81d8061960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81dd9a3700 1 -- 172.21.15.36:0/888936772 >> v1:172.21.15.59:6789/0 conn(0x7f81d8061e50 legacy=0x7f81d8146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:14.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81dd9a3700 1 -- 172.21.15.36:0/888936772 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d80b24b0 con 0x7f81d80b6290 2022-01-10T01:34:14.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81dd9a3700 1 --2- 172.21.15.36:0/888936772 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d80b6290 0x7f81d8061470 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f81d4002f70 tx=0x7f81d4006eb0).ready entity=mon.0 client_cookie=2e5f11f48dac010a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:14.428 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81dc9a1700 1 -- 172.21.15.36:0/888936772 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d400d610 con 0x7f81d80b6290 2022-01-10T01:34:14.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81dc9a1700 1 -- 172.21.15.36:0/888936772 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d4000e90 con 0x7f81d80b6290 2022-01-10T01:34:14.429 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81dc9a1700 1 -- 172.21.15.36:0/888936772 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d400d9a0 con 0x7f81d80b6290 2022-01-10T01:34:14.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81de9a5700 1 -- 172.21.15.36:0/888936772 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d80b6290 msgr2=0x7f81d8061470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:14.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81de9a5700 1 --2- 172.21.15.36:0/888936772 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d80b6290 0x7f81d8061470 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f81d4002f70 tx=0x7f81d4006eb0).stop 2022-01-10T01:34:14.432 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81de9a5700 1 -- 172.21.15.36:0/888936772 shutdown_connections 2022-01-10T01:34:14.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81de9a5700 1 --2- 172.21.15.36:0/888936772 >> v2:172.21.15.59:3300/0 conn(0x7f81d80b4060 0x7f81d8061960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81de9a5700 1 --2- 172.21.15.36:0/888936772 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d80b6290 0x7f81d8061470 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81de9a5700 1 -- 172.21.15.36:0/888936772 >> 172.21.15.36:0/888936772 conn(0x7f81d805c490 msgr2=0x7f81d805c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:14.433 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81de9a5700 1 -- 172.21.15.36:0/888936772 shutdown_connections 2022-01-10T01:34:14.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.416+0000 7f81de9a5700 1 -- 172.21.15.36:0/888936772 wait complete. 2022-01-10T01:34:14.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de9a5700 1 Processor -- start 2022-01-10T01:34:14.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de9a5700 1 -- start start 2022-01-10T01:34:14.434 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de9a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81d8061e50 0x7f81d80afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:14.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de9a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d80b4060 0x7f81d80b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:14.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de9a5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d80b6290 0x7f81d80ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:14.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de9a5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8153380 con 0x7f81d80b6290 2022-01-10T01:34:14.435 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de9a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8153620 con 0x7f81d80b4060 2022-01-10T01:34:14.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de9a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d8143970 con 0x7f81d8061e50 2022-01-10T01:34:14.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de1a4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d80b6290 0x7f81d80ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:14.436 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de1a4700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d80b6290 0x7f81d80ad3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43324/0 (socket says 172.21.15.36:43324) 2022-01-10T01:34:14.437 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de1a4700 1 -- 172.21.15.36:0/1704651090 learned_addr learned my addr 172.21.15.36:0/1704651090 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:14.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81dd9a3700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81d8061e50 0x7f81d80afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:14.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81dd1a2700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d80b4060 0x7f81d80b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:14.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de1a4700 1 -- 172.21.15.36:0/1704651090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81d8061e50 msgr2=0x7f81d80afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:14.438 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de1a4700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81d8061e50 0x7f81d80afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de1a4700 1 -- 172.21.15.36:0/1704651090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d80b4060 msgr2=0x7f81d80b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:14.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.420+0000 7f81de1a4700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d80b4060 0x7f81d80b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.424+0000 7f81de1a4700 1 -- 172.21.15.36:0/1704651090 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d400b1e0 con 0x7f81d80b6290 2022-01-10T01:34:14.439 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.424+0000 7f81dd9a3700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81d8061e50 0x7f81d80afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:34:14.440 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.424+0000 7f81de1a4700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d80b6290 0x7f81d80ad3b0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f81d80b2ad0 tx=0x7f81d0007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:14.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.428+0000 7f81c6ffd700 1 -- 172.21.15.36:0/1704651090 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d000e4a0 con 0x7f81d80b6290 2022-01-10T01:34:14.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.428+0000 7f81de9a5700 1 -- 172.21.15.36:0/1704651090 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d81530a0 con 0x7f81d80b6290 2022-01-10T01:34:14.442 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.428+0000 7f81c6ffd700 1 -- 172.21.15.36:0/1704651090 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d000e600 con 0x7f81d80b6290 2022-01-10T01:34:14.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.428+0000 7f81c6ffd700 1 -- 172.21.15.36:0/1704651090 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d000e960 con 0x7f81d80b6290 2022-01-10T01:34:14.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.428+0000 7f81de9a5700 1 -- 172.21.15.36:0/1704651090 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d8143e10 con 0x7f81d80b6290 2022-01-10T01:34:14.443 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.428+0000 7f81de9a5700 1 -- 172.21.15.36:0/1704651090 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d80b0b50 con 0x7f81d80b6290 2022-01-10T01:34:14.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.428+0000 7f81c6ffd700 1 -- 172.21.15.36:0/1704651090 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f81d0010030 con 0x7f81d80b6290 2022-01-10T01:34:14.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.428+0000 7f81c6ffd700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81b8053620 0x7f81b8055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:14.444 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.428+0000 7f81c6ffd700 1 -- 172.21.15.36:0/1704651090 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7f81d006bb60 con 0x7f81d80b6290 2022-01-10T01:34:14.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.428+0000 7f81dd9a3700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81b8053620 0x7f81b8055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:14.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.428+0000 7f81dd9a3700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81b8053620 0x7f81b8055ae0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f81d401a000 tx=0x7f81d4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:14.445 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.432+0000 7f81c6ffd700 1 -- 172.21.15.36:0/1704651090 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f81d0042ad0 con 0x7f81d80b6290 2022-01-10T01:34:14.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.596+0000 7f81de9a5700 1 -- 172.21.15.36:0/1704651090 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81d80b5f50 con 0x7f81d80b6290 2022-01-10T01:34:14.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.600+0000 7f81c6ffd700 1 -- 172.21.15.36:0/1704651090 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f81d80b5f50 con 0x7f81d80b6290 2022-01-10T01:34:14.607 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:14.607 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":79,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3964890182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3964890182},{"type":"v1","addr":"172.21.15.59:6833","nonce":3964890182}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77},{"gid":8733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3716636187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3716636187},{"type":"v1","addr":"172.21.15.36:6835","nonce":3716636187}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:34:04.465028+0000","modified":"2022-01-10T01:34:05.469086+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8742},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8742":{"gid":8742,"name":"a","rank":0,"incarnation":78,"state":"up:active","state_seq":3,"addr":"172.21.15.36:6837/1997308230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6836","nonce":1997308230},{"type":"v1","addr":"172.21.15.36:6837","nonce":1997308230}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2022-01-10T01:34:14.608 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.600+0000 7f81de9a5700 1 -- 172.21.15.36:0/1704651090 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81b8053620 msgr2=0x7f81b8055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:14.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.600+0000 7f81de9a5700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81b8053620 0x7f81b8055ae0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f81d401a000 tx=0x7f81d4015000).stop 2022-01-10T01:34:14.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.600+0000 7f81de9a5700 1 -- 172.21.15.36:0/1704651090 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d80b6290 msgr2=0x7f81d80ad3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:14.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.600+0000 7f81de9a5700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d80b6290 0x7f81d80ad3b0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7f81d80b2ad0 tx=0x7f81d0007f40).stop 2022-01-10T01:34:14.609 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.600+0000 7f81de9a5700 1 -- 172.21.15.36:0/1704651090 shutdown_connections 2022-01-10T01:34:14.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.600+0000 7f81de9a5700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f81b8053620 0x7f81b8055ae0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.600+0000 7f81de9a5700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f81d80b6290 0x7f81d80ad3b0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.600+0000 7f81de9a5700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81d80b4060 0x7f81d80b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.610 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.600+0000 7f81de9a5700 1 --2- 172.21.15.36:0/1704651090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81d8061e50 0x7f81d80afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.600+0000 7f81de9a5700 1 -- 172.21.15.36:0/1704651090 >> 172.21.15.36:0/1704651090 conn(0x7f81d805c490 msgr2=0x7f81d80b7260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:14.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.600+0000 7f81de9a5700 1 -- 172.21.15.36:0/1704651090 shutdown_connections 2022-01-10T01:34:14.611 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.600+0000 7f81de9a5700 1 -- 172.21.15.36:0/1704651090 wait complete. 2022-01-10T01:34:14.612 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 79 2022-01-10T01:34:14.620 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2022-01-10T01:34:14.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa245713700 1 Processor -- start 2022-01-10T01:34:14.721 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa245713700 1 -- start start 2022-01-10T01:34:14.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa245713700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2400b1db0 0x7fa2400b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:14.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa245713700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa2401483a0 0x7fa2400b2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:14.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa245713700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa2400a70c0 0x7fa240144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:14.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa245713700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2400a90c0 con 0x7fa2401483a0 2022-01-10T01:34:14.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa245713700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2400b0350 con 0x7fa2400a70c0 2022-01-10T01:34:14.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa245713700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2400b05f0 con 0x7fa2400b1db0 2022-01-10T01:34:14.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa23e7fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa2401483a0 0x7fa2400b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:14.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa23e7fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fa2401483a0 0x7fa2400b2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43330/0 (socket says 172.21.15.36:43330) 2022-01-10T01:34:14.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa23e7fc700 1 -- 172.21.15.36:0/1488411734 learned_addr learned my addr 172.21.15.36:0/1488411734 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:14.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa23f7fe700 1 --2- 172.21.15.36:0/1488411734 >> v2:172.21.15.59:3300/0 conn(0x7fa2400a70c0 0x7fa240144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:14.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa23effd700 1 --2- 172.21.15.36:0/1488411734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2400b1db0 0x7fa2400b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:14.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa23e7fc700 1 -- 172.21.15.36:0/1488411734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2400b1db0 msgr2=0x7fa2400b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:14.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa23e7fc700 1 --2- 172.21.15.36:0/1488411734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2400b1db0 0x7fa2400b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa23e7fc700 1 -- 172.21.15.36:0/1488411734 >> v2:172.21.15.59:3300/0 conn(0x7fa2400a70c0 msgr2=0x7fa240144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:14.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa23e7fc700 1 --2- 172.21.15.36:0/1488411734 >> v2:172.21.15.59:3300/0 conn(0x7fa2400a70c0 0x7fa240144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.712+0000 7fa23e7fc700 1 -- 172.21.15.36:0/1488411734 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2400b0890 con 0x7fa2401483a0 2022-01-10T01:34:14.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa23e7fc700 1 --2- 172.21.15.36:0/1488411734 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa2401483a0 0x7fa2400b2190 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fa228002f70 tx=0x7fa228006eb0).ready entity=mon.0 client_cookie=e2458c0afec7d66a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:14.728 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa23dffb700 1 -- 172.21.15.36:0/1488411734 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa22800d570 con 0x7fa2401483a0 2022-01-10T01:34:14.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa23dffb700 1 -- 172.21.15.36:0/1488411734 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa228000e90 con 0x7fa2401483a0 2022-01-10T01:34:14.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa23dffb700 1 -- 172.21.15.36:0/1488411734 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa22800d900 con 0x7fa2401483a0 2022-01-10T01:34:14.729 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 -- 172.21.15.36:0/1488411734 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa2401483a0 msgr2=0x7fa2400b2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:14.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 --2- 172.21.15.36:0/1488411734 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa2401483a0 0x7fa2400b2190 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7fa228002f70 tx=0x7fa228006eb0).stop 2022-01-10T01:34:14.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 -- 172.21.15.36:0/1488411734 shutdown_connections 2022-01-10T01:34:14.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 --2- 172.21.15.36:0/1488411734 >> v2:172.21.15.59:3300/0 conn(0x7fa2400a70c0 0x7fa240144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.730 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 --2- 172.21.15.36:0/1488411734 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa2401483a0 0x7fa2400b2190 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 --2- 172.21.15.36:0/1488411734 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2400b1db0 0x7fa2400b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 -- 172.21.15.36:0/1488411734 >> 172.21.15.36:0/1488411734 conn(0x7fa24005f6b0 msgr2=0x7fa24005fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:14.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 -- 172.21.15.36:0/1488411734 shutdown_connections 2022-01-10T01:34:14.731 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 -- 172.21.15.36:0/1488411734 wait complete. 2022-01-10T01:34:14.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 Processor -- start 2022-01-10T01:34:14.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 -- start start 2022-01-10T01:34:14.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2400a70c0 0x7fa240141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:14.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa2400b1db0 0x7fa24013a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:14.735 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2401483a0 0x7fa24013ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:14.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa240156880 con 0x7fa2400b1db0 2022-01-10T01:34:14.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24013d490 con 0x7fa2400a70c0 2022-01-10T01:34:14.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa245713700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24013d730 con 0x7fa2401483a0 2022-01-10T01:34:14.736 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa23e7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa2400b1db0 0x7fa24013a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:14.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa23f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2401483a0 0x7fa24013ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:14.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.716+0000 7fa23effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2400a70c0 0x7fa240141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:14.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa23e7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa2400b1db0 0x7fa24013a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43338/0 (socket says 172.21.15.36:43338) 2022-01-10T01:34:14.737 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa23f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2401483a0 0x7fa24013ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.36:49618/0 (socket says 172.21.15.36:49618) 2022-01-10T01:34:14.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa23f7fe700 1 -- 172.21.15.36:0/3208036190 learned_addr learned my addr 172.21.15.36:0/3208036190 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:14.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa23effd700 1 -- 172.21.15.36:0/3208036190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2401483a0 msgr2=0x7fa24013ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:14.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa23effd700 1 --2- 172.21.15.36:0/3208036190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2401483a0 0x7fa24013ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa23effd700 1 -- 172.21.15.36:0/3208036190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa2400b1db0 msgr2=0x7fa24013a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:14.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa23effd700 1 --2- 172.21.15.36:0/3208036190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa2400b1db0 0x7fa24013a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:14.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa23effd700 1 -- 172.21.15.36:0/3208036190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22800b1e0 con 0x7fa2400a70c0 2022-01-10T01:34:14.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa23effd700 1 --2- 172.21.15.36:0/3208036190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2400a70c0 0x7fa240141d70 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fa23000c000 tx=0x7fa2300091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:14.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa237fff700 1 -- 172.21.15.36:0/3208036190 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa23000ee00 con 0x7fa2400a70c0 2022-01-10T01:34:14.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa237fff700 1 -- 172.21.15.36:0/3208036190 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23000c850 con 0x7fa2400a70c0 2022-01-10T01:34:14.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa245713700 1 -- 172.21.15.36:0/3208036190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24013d9d0 con 0x7fa2400a70c0 2022-01-10T01:34:14.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa237fff700 1 -- 172.21.15.36:0/3208036190 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa23000cbb0 con 0x7fa2400a70c0 2022-01-10T01:34:14.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa245713700 1 -- 172.21.15.36:0/3208036190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24013b200 con 0x7fa2400a70c0 2022-01-10T01:34:14.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa245713700 1 -- 172.21.15.36:0/3208036190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2400b0b30 con 0x7fa2400a70c0 2022-01-10T01:34:14.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.720+0000 7fa237fff700 1 -- 172.21.15.36:0/3208036190 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fa230022070 con 0x7fa2400a70c0 2022-01-10T01:34:14.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.724+0000 7fa237fff700 1 --2- 172.21.15.36:0/3208036190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa224053680 0x7fa224055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:14.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.724+0000 7fa237fff700 1 -- 172.21.15.36:0/3208036190 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6420+0+0 (secure 0 0 0) 0x7fa23006c230 con 0x7fa2400a70c0 2022-01-10T01:34:14.741 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.724+0000 7fa23e7fc700 1 --2- 172.21.15.36:0/3208036190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa224053680 0x7fa224055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:14.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.724+0000 7fa23e7fc700 1 --2- 172.21.15.36:0/3208036190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa224053680 0x7fa224055b40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fa22801c000 tx=0x7fa228015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:14.742 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.732+0000 7fa237fff700 1 -- 172.21.15.36:0/3208036190 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fa2300430d0 con 0x7fa2400a70c0 2022-01-10T01:34:14.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:14.900+0000 7fa245713700 1 -- 172.21.15.36:0/3208036190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa240057350 con 0x7fa2400a70c0 2022-01-10T01:34:15.431 INFO:tasks.ceph.mon.a.smithi036.stderr:2022-01-10T01:34:15.424+0000 7f0b5376f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-01-10T01:34:15.448 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.440+0000 7fa237fff700 1 -- 172.21.15.36:0/3208036190 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v80) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa230016020 con 0x7fa2400a70c0 2022-01-10T01:34:15.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.444+0000 7fa245713700 1 -- 172.21.15.36:0/3208036190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa224053680 msgr2=0x7fa224055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:15.452 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.444+0000 7fa245713700 1 --2- 172.21.15.36:0/3208036190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa224053680 0x7fa224055b40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7fa22801c000 tx=0x7fa228015000).stop 2022-01-10T01:34:15.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.444+0000 7fa245713700 1 -- 172.21.15.36:0/3208036190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2400a70c0 msgr2=0x7fa240141d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:15.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.444+0000 7fa245713700 1 --2- 172.21.15.36:0/3208036190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2400a70c0 0x7fa240141d70 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7fa23000c000 tx=0x7fa2300091d0).stop 2022-01-10T01:34:15.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.444+0000 7fa245713700 1 -- 172.21.15.36:0/3208036190 shutdown_connections 2022-01-10T01:34:15.453 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.444+0000 7fa245713700 1 --2- 172.21.15.36:0/3208036190 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fa224053680 0x7fa224055b40 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.444+0000 7fa245713700 1 --2- 172.21.15.36:0/3208036190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2401483a0 0x7fa24013ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.444+0000 7fa245713700 1 --2- 172.21.15.36:0/3208036190 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fa2400b1db0 0x7fa24013a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.444+0000 7fa245713700 1 --2- 172.21.15.36:0/3208036190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2400a70c0 0x7fa240141d70 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.454 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.444+0000 7fa245713700 1 -- 172.21.15.36:0/3208036190 >> 172.21.15.36:0/3208036190 conn(0x7fa24005f6b0 msgr2=0x7fa240147bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:15.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.444+0000 7fa245713700 1 -- 172.21.15.36:0/3208036190 shutdown_connections 2022-01-10T01:34:15.455 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.444+0000 7fa245713700 1 -- 172.21.15.36:0/3208036190 wait complete. 2022-01-10T01:34:15.455 INFO:teuthology.orchestra.run.smithi036.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2022-01-10T01:34:15.468 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-01-10T01:34:15.471 INFO:tasks.ceph.mds.a.smithi036.stdout:starting mds.a at 2022-01-10T01:34:15.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2aa517a700 1 Processor -- start 2022-01-10T01:34:15.568 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2aa517a700 1 -- start start 2022-01-10T01:34:15.571 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2aa517a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa0061700 0x7f2aa0146520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:15.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2aa517a700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa00aecf0 con 0x7f2aa00ad5c0 2022-01-10T01:34:15.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2aa517a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa00b6f20 con 0x7f2aa0061320 2022-01-10T01:34:15.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2aa517a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00aef20 con 0x7f2aa0061700 2022-01-10T01:34:15.572 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2a9f7fe700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f2aa00ad5c0 0x7f2aa0140440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:41150/0 (socket says 172.21.15.36:41150) 2022-01-10T01:34:15.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2a9f7fe700 1 -- 172.21.15.36:0/27909460 learned_addr learned my addr 172.21.15.36:0/27909460 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:15.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2aa4979700 1 --2- 172.21.15.36:0/27909460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa0061700 0x7f2aa0146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:15.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2a9effd700 1 -- 172.21.15.36:0/27909460 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038919177 0 0) 0x7f2aa00aecf0 con 0x7f2aa00ad5c0 2022-01-10T01:34:15.573 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2a9effd700 1 -- 172.21.15.36:0/27909460 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a8c003260 con 0x7f2aa00ad5c0 2022-01-10T01:34:15.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2a9effd700 1 -- 172.21.15.36:0/27909460 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215917063 0 0) 0x7f2aa00b6f20 con 0x7f2aa0061320 2022-01-10T01:34:15.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2a9effd700 1 -- 172.21.15.36:0/27909460 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aa00aecf0 con 0x7f2aa0061320 2022-01-10T01:34:15.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2aa4979700 1 -- 172.21.15.36:0/27909460 >> v1:172.21.15.59:6789/0 conn(0x7f2aa0061320 legacy=0x7f2aa00b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:15.574 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2aa4979700 1 -- 172.21.15.36:0/27909460 >> v1:172.21.15.36:6789/0 conn(0x7f2aa00ad5c0 legacy=0x7f2aa0140440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:15.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2aa4979700 1 -- 172.21.15.36:0/27909460 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00af1c0 con 0x7f2aa0061700 2022-01-10T01:34:15.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.560+0000 7f2aa4979700 1 --2- 172.21.15.36:0/27909460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa0061700 0x7f2aa0146520 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f2a90002f70 tx=0x7f2a90006df0).ready entity=mon.2 client_cookie=bffabbce4c97c74e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:15.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2a9effd700 1 -- 172.21.15.36:0/27909460 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9000d5c0 con 0x7f2aa0061700 2022-01-10T01:34:15.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2a9effd700 1 -- 172.21.15.36:0/27909460 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a90000e90 con 0x7f2aa0061700 2022-01-10T01:34:15.575 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2a9effd700 1 -- 172.21.15.36:0/27909460 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a9000d910 con 0x7f2aa0061700 2022-01-10T01:34:15.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 -- 172.21.15.36:0/27909460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa0061700 msgr2=0x7f2aa0146520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:15.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 --2- 172.21.15.36:0/27909460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa0061700 0x7f2aa0146520 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f2a90002f70 tx=0x7f2a90006df0).stop 2022-01-10T01:34:15.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 -- 172.21.15.36:0/27909460 shutdown_connections 2022-01-10T01:34:15.576 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 --2- 172.21.15.36:0/27909460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa0061700 0x7f2aa0146520 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 -- 172.21.15.36:0/27909460 >> 172.21.15.36:0/27909460 conn(0x7f2aa0066de0 msgr2=0x7f2aa00671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:15.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 -- 172.21.15.36:0/27909460 shutdown_connections 2022-01-10T01:34:15.577 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 -- 172.21.15.36:0/27909460 wait complete. 2022-01-10T01:34:15.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 Processor -- start 2022-01-10T01:34:15.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 -- start start 2022-01-10T01:34:15.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2aa0061320 0x7f2aa00b8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:15.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa0061700 0x7f2aa00aa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:15.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa00ad5c0 0x7f2aa00aacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:15.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00ab8f0 con 0x7f2aa0061320 2022-01-10T01:34:15.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00b1c30 con 0x7f2aa0061700 2022-01-10T01:34:15.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa517a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa00b1ed0 con 0x7f2aa00ad5c0 2022-01-10T01:34:15.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2a9ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2aa0061320 0x7f2aa00b8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:15.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2a9ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2aa0061320 0x7f2aa00b8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43360/0 (socket says 172.21.15.36:43360) 2022-01-10T01:34:15.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2a9ffff700 1 -- 172.21.15.36:0/2108737587 learned_addr learned my addr 172.21.15.36:0/2108737587 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:15.583 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2aa4979700 1 --2- 172.21.15.36:0/2108737587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa00ad5c0 0x7f2aa00aacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:15.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2a9f7fe700 1 --2- 172.21.15.36:0/2108737587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa0061700 0x7f2aa00aa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:15.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2a9ffff700 1 -- 172.21.15.36:0/2108737587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa00ad5c0 msgr2=0x7f2aa00aacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:15.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2a9ffff700 1 --2- 172.21.15.36:0/2108737587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa00ad5c0 0x7f2aa00aacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.584 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2a9ffff700 1 -- 172.21.15.36:0/2108737587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa0061700 msgr2=0x7f2aa00aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:15.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2a9ffff700 1 --2- 172.21.15.36:0/2108737587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa0061700 0x7f2aa00aa7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2a9ffff700 1 -- 172.21.15.36:0/2108737587 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9000b180 con 0x7f2aa0061320 2022-01-10T01:34:15.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.564+0000 7f2a9ffff700 1 --2- 172.21.15.36:0/2108737587 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2aa0061320 0x7f2aa00b8ba0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f2a98001490 tx=0x7f2a98007e60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:15.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.568+0000 7f2a9d7fa700 1 -- 172.21.15.36:0/2108737587 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a98002310 con 0x7f2aa0061320 2022-01-10T01:34:15.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.568+0000 7f2a9d7fa700 1 -- 172.21.15.36:0/2108737587 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a98002470 con 0x7f2aa0061320 2022-01-10T01:34:15.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.568+0000 7f2aa517a700 1 -- 172.21.15.36:0/2108737587 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa00ac730 con 0x7f2aa0061320 2022-01-10T01:34:15.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.568+0000 7f2a9d7fa700 1 -- 172.21.15.36:0/2108737587 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a98001840 con 0x7f2aa0061320 2022-01-10T01:34:15.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.568+0000 7f2aa517a700 1 -- 172.21.15.36:0/2108737587 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa00aa5f0 con 0x7f2aa0061320 2022-01-10T01:34:15.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.568+0000 7f2aa517a700 1 -- 172.21.15.36:0/2108737587 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa00b2090 con 0x7f2aa0061320 2022-01-10T01:34:15.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.568+0000 7f2a9d7fa700 1 -- 172.21.15.36:0/2108737587 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f2a98019030 con 0x7f2aa0061320 2022-01-10T01:34:15.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.568+0000 7f2a9d7fa700 1 --2- 172.21.15.36:0/2108737587 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2a80053670 0x7f2a80055b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:15.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.568+0000 7f2a9d7fa700 1 -- 172.21.15.36:0/2108737587 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f2a9806b380 con 0x7f2aa0061320 2022-01-10T01:34:15.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.568+0000 7f2a9f7fe700 1 --2- 172.21.15.36:0/2108737587 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2a80053670 0x7f2a80055b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:15.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.568+0000 7f2a9f7fe700 1 --2- 172.21.15.36:0/2108737587 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2a80053670 0x7f2a80055b30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f2a9400b000 tx=0x7f2a94009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:15.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.576+0000 7f2a9d7fa700 1 -- 172.21.15.36:0/2108737587 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f2a98042340 con 0x7f2aa0061320 2022-01-10T01:34:15.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.736+0000 7f2aa517a700 1 -- 172.21.15.36:0/2108737587 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2aa00af460 con 0x7f2aa0061320 2022-01-10T01:34:15.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.736+0000 7f2a9d7fa700 1 -- 172.21.15.36:0/2108737587 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f2a98045960 con 0x7f2aa0061320 2022-01-10T01:34:15.745 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T01:34:15.745 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":80,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":8608,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/3964890182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3964890182},{"type":"v1","addr":"172.21.15.59:6833","nonce":3964890182}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77},{"gid":8733,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.36:6835/3716636187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6834","nonce":3716636187},{"type":"v1","addr":"172.21.15.36:6835","nonce":3716636187}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":77}],"filesystems":[{"mdsmap":{"epoch":80,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-01-10T01:34:04.465028+0000","modified":"2022-01-10T01:34:15.428605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":160,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2022-01-10T01:34:15.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.740+0000 7f2aa517a700 1 -- 172.21.15.36:0/2108737587 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2a80053670 msgr2=0x7f2a80055b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:15.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.740+0000 7f2aa517a700 1 --2- 172.21.15.36:0/2108737587 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2a80053670 0x7f2a80055b30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f2a9400b000 tx=0x7f2a94009040).stop 2022-01-10T01:34:15.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.740+0000 7f2aa517a700 1 -- 172.21.15.36:0/2108737587 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2aa0061320 msgr2=0x7f2aa00b8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:15.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.740+0000 7f2aa517a700 1 --2- 172.21.15.36:0/2108737587 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2aa0061320 0x7f2aa00b8ba0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f2a98001490 tx=0x7f2a98007e60).stop 2022-01-10T01:34:15.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.740+0000 7f2aa517a700 1 -- 172.21.15.36:0/2108737587 shutdown_connections 2022-01-10T01:34:15.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.740+0000 7f2aa517a700 1 --2- 172.21.15.36:0/2108737587 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f2a80053670 0x7f2a80055b30 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.740+0000 7f2aa517a700 1 --2- 172.21.15.36:0/2108737587 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa00ad5c0 0x7f2aa00aacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.740+0000 7f2aa517a700 1 --2- 172.21.15.36:0/2108737587 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa0061700 0x7f2aa00aa7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.740+0000 7f2aa517a700 1 --2- 172.21.15.36:0/2108737587 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f2aa0061320 0x7f2aa00b8ba0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.740+0000 7f2aa517a700 1 -- 172.21.15.36:0/2108737587 >> 172.21.15.36:0/2108737587 conn(0x7f2aa0066de0 msgr2=0x7f2aa005bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:15.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.740+0000 7f2aa517a700 1 -- 172.21.15.36:0/2108737587 shutdown_connections 2022-01-10T01:34:15.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.740+0000 7f2aa517a700 1 -- 172.21.15.36:0/2108737587 wait complete. 2022-01-10T01:34:15.750 INFO:teuthology.orchestra.run.smithi036.stderr:dumped fsmap epoch 80 2022-01-10T01:34:15.759 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2022-01-10T01:34:15.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9228ae5700 1 Processor -- start 2022-01-10T01:34:15.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9228ae5700 1 -- start start 2022-01-10T01:34:15.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9228ae5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92240b0010 0x7f92240a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:15.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9228ae5700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f92240afbd0 0x7f92240a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:15.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9228ae5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92240a70c0 con 0x7f92240b2580 2022-01-10T01:34:15.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9228ae5700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92240a72f0 con 0x7f92240afbd0 2022-01-10T01:34:15.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9228ae5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92240a7590 con 0x7f92240b0010 2022-01-10T01:34:15.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9223fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f92240afbd0 0x7f92240a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:15.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9222ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92240b0010 0x7f92240a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:15.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9223fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f92240afbd0 0x7f92240a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43372/0 (socket says 172.21.15.36:43372) 2022-01-10T01:34:15.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f92237fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f92240b2580 0x7f922414ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:58838/0 (socket says 172.21.15.36:58838) 2022-01-10T01:34:15.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9223fff700 1 -- 172.21.15.36:0/3527938221 learned_addr learned my addr 172.21.15.36:0/3527938221 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:15.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9223fff700 1 -- 172.21.15.36:0/3527938221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92240b0010 msgr2=0x7f92240a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:15.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9223fff700 1 --2- 172.21.15.36:0/3527938221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92240b0010 0x7f92240a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9223fff700 1 -- 172.21.15.36:0/3527938221 >> v1:172.21.15.59:6789/0 conn(0x7f92240b2580 legacy=0x7f922414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:15.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9223fff700 1 -- 172.21.15.36:0/3527938221 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92240a7830 con 0x7f92240afbd0 2022-01-10T01:34:15.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9223fff700 1 --2- 172.21.15.36:0/3527938221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f92240afbd0 0x7f92240a88a0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f921c0032f0 tx=0x7f921c009290).ready entity=mon.0 client_cookie=c02d5ac0c29012c2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:15.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f92227fc700 1 -- 172.21.15.36:0/3527938221 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f921c00b8a0 con 0x7f92240afbd0 2022-01-10T01:34:15.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f92227fc700 1 -- 172.21.15.36:0/3527938221 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c00ba00 con 0x7f92240afbd0 2022-01-10T01:34:15.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f92227fc700 1 -- 172.21.15.36:0/3527938221 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f921c00bb70 con 0x7f92240afbd0 2022-01-10T01:34:15.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9228ae5700 1 -- 172.21.15.36:0/3527938221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f92240afbd0 msgr2=0x7f92240a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:15.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.856+0000 7f9228ae5700 1 --2- 172.21.15.36:0/3527938221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f92240afbd0 0x7f92240a88a0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f921c0032f0 tx=0x7f921c009290).stop 2022-01-10T01:34:15.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.860+0000 7f9228ae5700 1 -- 172.21.15.36:0/3527938221 shutdown_connections 2022-01-10T01:34:15.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.860+0000 7f9228ae5700 1 --2- 172.21.15.36:0/3527938221 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f92240afbd0 0x7f92240a88a0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.860+0000 7f9228ae5700 1 --2- 172.21.15.36:0/3527938221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92240b0010 0x7f92240a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.860+0000 7f9228ae5700 1 -- 172.21.15.36:0/3527938221 >> 172.21.15.36:0/3527938221 conn(0x7f9224060180 msgr2=0x7f92240b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:15.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.860+0000 7f9228ae5700 1 -- 172.21.15.36:0/3527938221 shutdown_connections 2022-01-10T01:34:15.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.860+0000 7f9228ae5700 1 -- 172.21.15.36:0/3527938221 wait complete. 2022-01-10T01:34:15.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.860+0000 7f9228ae5700 1 Processor -- start 2022-01-10T01:34:15.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.860+0000 7f9228ae5700 1 -- start start 2022-01-10T01:34:15.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9228ae5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92240afbd0 0x7f9224144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:15.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9228ae5700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f92240b0010 0x7f9224142070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:15.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9228ae5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92240b2580 0x7f922415a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:15.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9228ae5700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92240b3640 con 0x7f92240b0010 2022-01-10T01:34:15.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9228ae5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92240b38e0 con 0x7f92240b2580 2022-01-10T01:34:15.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9228ae5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9224159d30 con 0x7f92240afbd0 2022-01-10T01:34:15.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9222ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f92240b0010 0x7f9224142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:15.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9222ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f92240b0010 0x7f9224142070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43376/0 (socket says 172.21.15.36:43376) 2022-01-10T01:34:15.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9222ffd700 1 -- 172.21.15.36:0/2209249342 learned_addr learned my addr 172.21.15.36:0/2209249342 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:15.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f92237fe700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92240afbd0 0x7f9224144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:15.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9223fff700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92240b2580 0x7f922415a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:15.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9222ffd700 1 -- 172.21.15.36:0/2209249342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92240afbd0 msgr2=0x7f9224144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:15.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9222ffd700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92240afbd0 0x7f9224144290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9222ffd700 1 -- 172.21.15.36:0/2209249342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92240b2580 msgr2=0x7f922415a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:15.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9222ffd700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92240b2580 0x7f922415a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:15.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9222ffd700 1 -- 172.21.15.36:0/2209249342 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c009530 con 0x7f92240b0010 2022-01-10T01:34:15.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f92237fe700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92240afbd0 0x7f9224144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T01:34:15.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9222ffd700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f92240b0010 0x7f9224142070 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f921400c000 tx=0x7f9214006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:15.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9220ff9700 1 -- 172.21.15.36:0/2209249342 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f921400c830 con 0x7f92240b0010 2022-01-10T01:34:15.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9220ff9700 1 -- 172.21.15.36:0/2209249342 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921400c990 con 0x7f92240b0010 2022-01-10T01:34:15.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9228ae5700 1 -- 172.21.15.36:0/2209249342 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9224144780 con 0x7f92240b0010 2022-01-10T01:34:15.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9220ff9700 1 -- 172.21.15.36:0/2209249342 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f921400ccf0 con 0x7f92240b0010 2022-01-10T01:34:15.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9228ae5700 1 -- 172.21.15.36:0/2209249342 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922414d750 con 0x7f92240b0010 2022-01-10T01:34:15.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9220ff9700 1 -- 172.21.15.36:0/2209249342 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f921401c460 con 0x7f92240b0010 2022-01-10T01:34:15.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9228ae5700 1 -- 172.21.15.36:0/2209249342 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9224159ef0 con 0x7f92240b0010 2022-01-10T01:34:15.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9220ff9700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91fc053560 0x7f91fc055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:15.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f9220ff9700 1 -- 172.21.15.36:0/2209249342 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f921406bf40 con 0x7f92240b0010 2022-01-10T01:34:15.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.864+0000 7f92237fe700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91fc053560 0x7f91fc055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:15.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.868+0000 7f92237fe700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91fc053560 0x7f91fc055a20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f920c008000 tx=0x7f920c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:15.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:15.872+0000 7f9220ff9700 1 -- 172.21.15.36:0/2209249342 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f9214042ea0 con 0x7f92240b0010 2022-01-10T01:34:16.043 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.036+0000 7f9228ae5700 1 -- 172.21.15.36:0/2209249342 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f92240b3aa0 con 0x7f92240b0010 2022-01-10T01:34:16.712 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.704+0000 7f9220ff9700 1 -- 172.21.15.36:0/2209249342 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v81) v1 ==== 104+0+0 (secure 0 0 0) 0x7f92140464c0 con 0x7f92240b0010 2022-01-10T01:34:16.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.708+0000 7f9228ae5700 1 -- 172.21.15.36:0/2209249342 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91fc053560 msgr2=0x7f91fc055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:16.716 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.708+0000 7f9228ae5700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91fc053560 0x7f91fc055a20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f920c008000 tx=0x7f920c009040).stop 2022-01-10T01:34:16.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.708+0000 7f9228ae5700 1 -- 172.21.15.36:0/2209249342 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f92240b0010 msgr2=0x7f9224142070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:16.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.708+0000 7f9228ae5700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f92240b0010 0x7f9224142070 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f921400c000 tx=0x7f9214006df0).stop 2022-01-10T01:34:16.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.708+0000 7f9228ae5700 1 -- 172.21.15.36:0/2209249342 shutdown_connections 2022-01-10T01:34:16.717 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.708+0000 7f9228ae5700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f91fc053560 0x7f91fc055a20 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:16.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.708+0000 7f9228ae5700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92240b2580 0x7f922415a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:16.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.708+0000 7f9228ae5700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f92240b0010 0x7f9224142070 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:16.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.708+0000 7f9228ae5700 1 --2- 172.21.15.36:0/2209249342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92240afbd0 0x7f9224144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:16.718 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.708+0000 7f9228ae5700 1 -- 172.21.15.36:0/2209249342 >> 172.21.15.36:0/2209249342 conn(0x7f9224060180 msgr2=0x7f92241487e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:16.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.708+0000 7f9228ae5700 1 -- 172.21.15.36:0/2209249342 shutdown_connections 2022-01-10T01:34:16.719 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.708+0000 7f9228ae5700 1 -- 172.21.15.36:0/2209249342 wait complete. 2022-01-10T01:34:16.732 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2022-01-10T01:34:16.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.844+0000 7f8fa7fff700 1 Processor -- start 2022-01-10T01:34:16.853 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.844+0000 7f8fa7fff700 1 -- start start 2022-01-10T01:34:16.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa80b3000 0x7f8fa8060b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:16.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa7fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8fa80b25a0 0x7f8fa8061000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:16.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa7fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa8065330 con 0x7f8fa8066520 2022-01-10T01:34:16.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa7fff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa8062000 con 0x7f8fa80b25a0 2022-01-10T01:34:16.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa7fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80b33e0 con 0x7f8fa80b3000 2022-01-10T01:34:16.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8f9e7fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8fa80b25a0 0x7f8fa8061000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:16.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8f9e7fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f8fa80b25a0 0x7f8fa8061000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43384/0 (socket says 172.21.15.36:43384) 2022-01-10T01:34:16.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8f9e7fc700 1 -- 172.21.15.36:0/1492957821 learned_addr learned my addr 172.21.15.36:0/1492957821 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:16.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa80b3000 0x7f8fa8060b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:16.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8f9e7fc700 1 -- 172.21.15.36:0/1492957821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa80b3000 msgr2=0x7f8fa8060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T01:34:16.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8f9e7fc700 1 --2- 172.21.15.36:0/1492957821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa80b3000 0x7f8fa8060b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:16.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8f9e7fc700 1 -- 172.21.15.36:0/1492957821 >> v1:172.21.15.59:6789/0 conn(0x7f8fa8066520 legacy=0x7f8fa8066990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:16.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8f9e7fc700 1 -- 172.21.15.36:0/1492957821 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa805fa60 con 0x7f8fa80b25a0 2022-01-10T01:34:16.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8f9e7fc700 1 --2- 172.21.15.36:0/1492957821 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8fa80b25a0 0x7f8fa8061000 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f8f90002f70 tx=0x7f8f90006eb0).ready entity=mon.0 client_cookie=a0f3dd9250e2747d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:16.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa67fc700 1 -- 172.21.15.36:0/1492957821 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f9000d570 con 0x7f8fa80b25a0 2022-01-10T01:34:16.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa67fc700 1 -- 172.21.15.36:0/1492957821 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f90000e90 con 0x7f8fa80b25a0 2022-01-10T01:34:16.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa67fc700 1 -- 172.21.15.36:0/1492957821 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f9000d900 con 0x7f8fa80b25a0 2022-01-10T01:34:16.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa7fff700 1 -- 172.21.15.36:0/1492957821 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8fa80b25a0 msgr2=0x7f8fa8061000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:16.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa7fff700 1 --2- 172.21.15.36:0/1492957821 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8fa80b25a0 0x7f8fa8061000 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f8f90002f70 tx=0x7f8f90006eb0).stop 2022-01-10T01:34:16.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa7fff700 1 -- 172.21.15.36:0/1492957821 shutdown_connections 2022-01-10T01:34:16.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa7fff700 1 --2- 172.21.15.36:0/1492957821 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8fa80b25a0 0x7f8fa8061000 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:16.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa7fff700 1 --2- 172.21.15.36:0/1492957821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa80b3000 0x7f8fa8060b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:16.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa7fff700 1 -- 172.21.15.36:0/1492957821 >> 172.21.15.36:0/1492957821 conn(0x7f8fa80636e0 msgr2=0x7f8fa8063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:16.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.848+0000 7f8fa7fff700 1 -- 172.21.15.36:0/1492957821 shutdown_connections 2022-01-10T01:34:16.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa7fff700 1 -- 172.21.15.36:0/1492957821 wait complete. 2022-01-10T01:34:16.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa7fff700 1 Processor -- start 2022-01-10T01:34:16.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa7fff700 1 -- start start 2022-01-10T01:34:16.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa7fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8fa8066520 0x7f8fa80ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:16.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa80b25a0 0x7f8fa80ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:16.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa80b3000 0x7f8fa80ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:16.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa7fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa81521b0 con 0x7f8fa8066520 2022-01-10T01:34:16.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa7fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80acb60 con 0x7f8fa80b25a0 2022-01-10T01:34:16.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa7fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80ace00 con 0x7f8fa80b3000 2022-01-10T01:34:16.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa6ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8fa8066520 0x7f8fa80ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:16.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa6ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8fa8066520 0x7f8fa80ac380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43388/0 (socket says 172.21.15.36:43388) 2022-01-10T01:34:16.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa6ffd700 1 -- 172.21.15.36:0/3970888618 learned_addr learned my addr 172.21.15.36:0/3970888618 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:16.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa77fe700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa80b3000 0x7f8fa80ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:16.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8f9e7fc700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa80b25a0 0x7f8fa80ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:16.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa6ffd700 1 -- 172.21.15.36:0/3970888618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa80b3000 msgr2=0x7f8fa80ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:16.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa6ffd700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa80b3000 0x7f8fa80ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:16.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa6ffd700 1 -- 172.21.15.36:0/3970888618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa80b25a0 msgr2=0x7f8fa80ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:16.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa6ffd700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa80b25a0 0x7f8fa80ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:16.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa6ffd700 1 -- 172.21.15.36:0/3970888618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9000b1e0 con 0x7f8fa8066520 2022-01-10T01:34:16.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8f9e7fc700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa80b25a0 0x7f8fa80ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T01:34:16.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa6ffd700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8fa8066520 0x7f8fa80ac380 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f8f9800c000 tx=0x7f8f98006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:16.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa4ff9700 1 -- 172.21.15.36:0/3970888618 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f98010780 con 0x7f8fa8066520 2022-01-10T01:34:16.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa4ff9700 1 -- 172.21.15.36:0/3970888618 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f980108e0 con 0x7f8fa8066520 2022-01-10T01:34:16.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa7fff700 1 -- 172.21.15.36:0/3970888618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa8149f40 con 0x7f8fa8066520 2022-01-10T01:34:16.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa4ff9700 1 -- 172.21.15.36:0/3970888618 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8f98010c40 con 0x7f8fa8066520 2022-01-10T01:34:16.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.852+0000 7f8fa7fff700 1 -- 172.21.15.36:0/3970888618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa80b07f0 con 0x7f8fa8066520 2022-01-10T01:34:16.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.856+0000 7f8fa7fff700 1 -- 172.21.15.36:0/3970888618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa805fd00 con 0x7f8fa8066520 2022-01-10T01:34:16.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.856+0000 7f8fa4ff9700 1 -- 172.21.15.36:0/3970888618 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8f9801c460 con 0x7f8fa8066520 2022-01-10T01:34:16.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.856+0000 7f8fa4ff9700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f8c053560 0x7f8f8c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:16.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.856+0000 7f8fa4ff9700 1 -- 172.21.15.36:0/3970888618 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6506+0+0 (secure 0 0 0) 0x7f8f9806bed0 con 0x7f8fa8066520 2022-01-10T01:34:16.873 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.856+0000 7f8f9e7fc700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f8c053560 0x7f8f8c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:16.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.856+0000 7f8f9e7fc700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f8c053560 0x7f8f8c055a20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f8f9001a000 tx=0x7f8f90015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:16.874 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.864+0000 7f8fa4ff9700 1 -- 172.21.15.36:0/3970888618 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8f98042e30 con 0x7f8fa8066520 2022-01-10T01:34:16.999 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:16.992+0000 7f8fa7fff700 1 -- 172.21.15.36:0/3970888618 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8fa8057350 con 0x7f8fa8066520 2022-01-10T01:34:17.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.712+0000 7f8fa4ff9700 1 -- 172.21.15.36:0/3970888618 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v161) v1 ==== 185+0+0 (secure 0 0 0) 0x7f8f98046450 con 0x7f8fa8066520 2022-01-10T01:34:17.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.716+0000 7f8fa7fff700 1 -- 172.21.15.36:0/3970888618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f8c053560 msgr2=0x7f8f8c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:17.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.716+0000 7f8fa7fff700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f8c053560 0x7f8f8c055a20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f8f9001a000 tx=0x7f8f90015000).stop 2022-01-10T01:34:17.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.716+0000 7f8fa7fff700 1 -- 172.21.15.36:0/3970888618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8fa8066520 msgr2=0x7f8fa80ac380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:17.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.716+0000 7f8fa7fff700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8fa8066520 0x7f8fa80ac380 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7f8f9800c000 tx=0x7f8f98006df0).stop 2022-01-10T01:34:17.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.716+0000 7f8fa7fff700 1 -- 172.21.15.36:0/3970888618 shutdown_connections 2022-01-10T01:34:17.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.716+0000 7f8fa7fff700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f8f8c053560 0x7f8f8c055a20 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:17.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.716+0000 7f8fa7fff700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fa80b3000 0x7f8fa80ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:17.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.716+0000 7f8fa7fff700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa80b25a0 0x7f8fa80ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:17.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.716+0000 7f8fa7fff700 1 --2- 172.21.15.36:0/3970888618 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f8fa8066520 0x7f8fa80ac380 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:17.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.716+0000 7f8fa7fff700 1 -- 172.21.15.36:0/3970888618 >> 172.21.15.36:0/3970888618 conn(0x7f8fa80636e0 msgr2=0x7f8fa8145fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:17.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.716+0000 7f8fa7fff700 1 -- 172.21.15.36:0/3970888618 shutdown_connections 2022-01-10T01:34:17.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.716+0000 7f8fa7fff700 1 -- 172.21.15.36:0/3970888618 wait complete. 2022-01-10T01:34:17.727 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_metadata' removed 2022-01-10T01:34:17.739 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2022-01-10T01:34:17.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.844+0000 7f7c1ffff700 1 Processor -- start 2022-01-10T01:34:17.852 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.844+0000 7f7c1ffff700 1 -- start start 2022-01-10T01:34:17.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.844+0000 7f7c1ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c200a9190 0x7f7c20146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:17.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.844+0000 7f7c1ffff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c200b1140 con 0x7f7c200b0b80 2022-01-10T01:34:17.854 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.844+0000 7f7c1ffff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c200a9570 con 0x7f7c200b03d0 2022-01-10T01:34:17.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.844+0000 7f7c1ffff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c200b1370 con 0x7f7c200a9190 2022-01-10T01:34:17.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.844+0000 7f7c1e7fc700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f7c200b0b80 0x7f7c20146a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:41190/0 (socket says 172.21.15.36:41190) 2022-01-10T01:34:17.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.844+0000 7f7c1e7fc700 1 -- 172.21.15.36:0/2532279218 learned_addr learned my addr 172.21.15.36:0/2532279218 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T01:34:17.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.844+0000 7f7c1effd700 1 --2- 172.21.15.36:0/2532279218 >> v2:172.21.15.59:3300/0 conn(0x7f7c200a9190 0x7f7c20146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:17.855 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.844+0000 7f7c1dffb700 1 -- 172.21.15.36:0/2532279218 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961048609 0 0) 0x7f7c200b1140 con 0x7f7c200b0b80 2022-01-10T01:34:17.856 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.844+0000 7f7c1dffb700 1 -- 172.21.15.36:0/2532279218 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c04003260 con 0x7f7c200b0b80 2022-01-10T01:34:17.857 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1effd700 1 -- 172.21.15.36:0/2532279218 >> v1:172.21.15.59:6789/0 conn(0x7f7c200b03d0 legacy=0x7f7c201401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:17.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1effd700 1 -- 172.21.15.36:0/2532279218 >> v1:172.21.15.36:6789/0 conn(0x7f7c200b0b80 legacy=0x7f7c20146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:17.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1dffb700 1 -- 172.21.15.36:0/2532279218 <== mon.0 v1:172.21.15.36:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1543859956 0 0) 0x7f7c04003260 con 0x7f7c200b0b80 2022-01-10T01:34:17.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1effd700 1 -- 172.21.15.36:0/2532279218 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c200b1610 con 0x7f7c200a9190 2022-01-10T01:34:17.858 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1effd700 1 --2- 172.21.15.36:0/2532279218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a9190 0x7f7c20146550 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f7c14001800 tx=0x7f7c10006df0).ready entity=mon.1 client_cookie=8156afd4bf1f66 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:17.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1dffb700 1 -- 172.21.15.36:0/2532279218 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c14001660 con 0x7f7c200a9190 2022-01-10T01:34:17.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1dffb700 1 -- 172.21.15.36:0/2532279218 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c10000e90 con 0x7f7c200a9190 2022-01-10T01:34:17.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1dffb700 1 -- 172.21.15.36:0/2532279218 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c1000d4f0 con 0x7f7c200a9190 2022-01-10T01:34:17.859 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1ffff700 1 -- 172.21.15.36:0/2532279218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a9190 msgr2=0x7f7c20146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:17.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1ffff700 1 --2- 172.21.15.36:0/2532279218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a9190 0x7f7c20146550 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f7c14001800 tx=0x7f7c10006df0).stop 2022-01-10T01:34:17.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1ffff700 1 -- 172.21.15.36:0/2532279218 shutdown_connections 2022-01-10T01:34:17.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1ffff700 1 --2- 172.21.15.36:0/2532279218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a9190 0x7f7c20146550 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:17.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1ffff700 1 -- 172.21.15.36:0/2532279218 >> 172.21.15.36:0/2532279218 conn(0x7f7c20061140 msgr2=0x7f7c20062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:17.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1ffff700 1 -- 172.21.15.36:0/2532279218 shutdown_connections 2022-01-10T01:34:17.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1ffff700 1 -- 172.21.15.36:0/2532279218 wait complete. 2022-01-10T01:34:17.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1ffff700 1 Processor -- start 2022-01-10T01:34:17.861 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.848+0000 7f7c1ffff700 1 -- start start 2022-01-10T01:34:17.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1ffff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a9190 0x7f7c200b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:17.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c200b03d0 0x7f7c20145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:17.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c200b0b80 0x7f7c20145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:17.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1ffff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20152ff0 con 0x7f7c200b03d0 2022-01-10T01:34:17.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1ffff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201452f0 con 0x7f7c200a9190 2022-01-10T01:34:17.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1ffff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c20145590 con 0x7f7c200b0b80 2022-01-10T01:34:17.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1e7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c200b03d0 0x7f7c20145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:17.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1e7fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c200b03d0 0x7f7c20145a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43402/0 (socket says 172.21.15.36:43402) 2022-01-10T01:34:17.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1e7fc700 1 -- 172.21.15.36:0/1774255881 learned_addr learned my addr 172.21.15.36:0/1774255881 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T01:34:17.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1effd700 1 --2- 172.21.15.36:0/1774255881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a9190 0x7f7c200b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:17.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1f7fe700 1 --2- 172.21.15.36:0/1774255881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c200b0b80 0x7f7c20145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:17.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1e7fc700 1 -- 172.21.15.36:0/1774255881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c200b0b80 msgr2=0x7f7c20145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:17.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1e7fc700 1 --2- 172.21.15.36:0/1774255881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c200b0b80 0x7f7c20145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:17.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1e7fc700 1 -- 172.21.15.36:0/1774255881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a9190 msgr2=0x7f7c200b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:17.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1e7fc700 1 --2- 172.21.15.36:0/1774255881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a9190 0x7f7c200b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:17.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1e7fc700 1 -- 172.21.15.36:0/1774255881 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1000b180 con 0x7f7c200b03d0 2022-01-10T01:34:17.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1e7fc700 1 --2- 172.21.15.36:0/1774255881 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c200b03d0 0x7f7c20145a30 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f7c14001840 tx=0x7f7c14001920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:17.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c0ffff700 1 -- 172.21.15.36:0/1774255881 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c14007170 con 0x7f7c200b03d0 2022-01-10T01:34:17.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c0ffff700 1 -- 172.21.15.36:0/1774255881 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c140072d0 con 0x7f7c200b03d0 2022-01-10T01:34:17.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c0ffff700 1 -- 172.21.15.36:0/1774255881 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c14004710 con 0x7f7c200b03d0 2022-01-10T01:34:17.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1ffff700 1 -- 172.21.15.36:0/1774255881 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c20152c40 con 0x7f7c200b03d0 2022-01-10T01:34:17.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1ffff700 1 -- 172.21.15.36:0/1774255881 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c200b57c0 con 0x7f7c200b03d0 2022-01-10T01:34:17.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.852+0000 7f7c1ffff700 1 -- 172.21.15.36:0/1774255881 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c201531f0 con 0x7f7c200b03d0 2022-01-10T01:34:17.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.856+0000 7f7c0ffff700 1 -- 172.21.15.36:0/1774255881 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f7c14004870 con 0x7f7c200b03d0 2022-01-10T01:34:17.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.856+0000 7f7c0ffff700 1 --2- 172.21.15.36:0/1774255881 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7bfc0535f0 0x7f7bfc055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T01:34:17.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.856+0000 7f7c0ffff700 1 -- 172.21.15.36:0/1774255881 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6068+0+0 (secure 0 0 0) 0x7f7c1406b310 con 0x7f7c200b03d0 2022-01-10T01:34:17.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.856+0000 7f7c1effd700 1 --2- 172.21.15.36:0/1774255881 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7bfc0535f0 0x7f7bfc055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T01:34:17.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.856+0000 7f7c1effd700 1 --2- 172.21.15.36:0/1774255881 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7bfc0535f0 0x7f7bfc055ab0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f7c1001a000 tx=0x7f7c10014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T01:34:17.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.860+0000 7f7c0ffff700 1 -- 172.21.15.36:0/1774255881 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f7c14042480 con 0x7f7c200b03d0 2022-01-10T01:34:17.998 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:17.988+0000 7f7c1ffff700 1 -- 172.21.15.36:0/1774255881 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c20057350 con 0x7f7c200b03d0 2022-01-10T01:34:18.734 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:18.724+0000 7f7c0ffff700 1 -- 172.21.15.36:0/1774255881 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v162) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7c14045aa0 con 0x7f7c200b03d0 2022-01-10T01:34:18.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:18.728+0000 7f7c1ffff700 1 -- 172.21.15.36:0/1774255881 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7bfc0535f0 msgr2=0x7f7bfc055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:18.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:18.728+0000 7f7c1ffff700 1 --2- 172.21.15.36:0/1774255881 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7bfc0535f0 0x7f7bfc055ab0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f7c1001a000 tx=0x7f7c10014000).stop 2022-01-10T01:34:18.738 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:18.728+0000 7f7c1ffff700 1 -- 172.21.15.36:0/1774255881 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c200b03d0 msgr2=0x7f7c20145a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T01:34:18.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:18.728+0000 7f7c1ffff700 1 --2- 172.21.15.36:0/1774255881 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c200b03d0 0x7f7c20145a30 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7f7c14001840 tx=0x7f7c14001920).stop 2022-01-10T01:34:18.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:18.728+0000 7f7c1ffff700 1 -- 172.21.15.36:0/1774255881 shutdown_connections 2022-01-10T01:34:18.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:18.728+0000 7f7c1ffff700 1 --2- 172.21.15.36:0/1774255881 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f7bfc0535f0 0x7f7bfc055ab0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:18.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:18.728+0000 7f7c1ffff700 1 --2- 172.21.15.36:0/1774255881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7c200b0b80 0x7f7c20145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:18.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:18.728+0000 7f7c1ffff700 1 --2- 172.21.15.36:0/1774255881 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f7c200b03d0 0x7f7c20145a30 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:18.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:18.728+0000 7f7c1ffff700 1 --2- 172.21.15.36:0/1774255881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c200a9190 0x7f7c200b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T01:34:18.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:18.728+0000 7f7c1ffff700 1 -- 172.21.15.36:0/1774255881 >> 172.21.15.36:0/1774255881 conn(0x7f7c20061140 msgr2=0x7f7c200b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T01:34:18.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:18.728+0000 7f7c1ffff700 1 -- 172.21.15.36:0/1774255881 shutdown_connections 2022-01-10T01:34:18.740 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T01:34:18.728+0000 7f7c1ffff700 1 -- 172.21.15.36:0/1774255881 wait complete. 2022-01-10T01:34:18.741 INFO:teuthology.orchestra.run.smithi036.stderr:pool 'cephfs_data' removed 2022-01-10T01:34:18.753 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-01-10T01:34:18.753 DEBUG:teuthology.orchestra.run.smithi139:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2022-01-10T01:34:32.339 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:34:32.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:34:32.344 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:34:32.347 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:34:48.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:34:48.858 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:34:48.859 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:35:02.407 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:35:02.410 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:35:02.413 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:35:02.415 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:35:18.759 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-01-10T01:35:18.767 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2022-01-10T01:35:32.471 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:35:32.474 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:35:32.477 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:35:32.480 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:36:02.536 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:36:02.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:36:02.542 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:36:02.545 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:36:32.596 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:36:32.600 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:36:32.603 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:36:32.605 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:37:02.665 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:37:02.669 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:37:02.671 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:37:02.674 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:37:32.751 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:37:32.754 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:37:32.757 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:37:32.760 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:38:02.863 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:38:02.872 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:38:02.876 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:38:02.880 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:38:32.945 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:38:32.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:38:32.951 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:38:32.954 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:39:03.023 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:39:03.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:39:03.029 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:39:03.031 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:39:33.094 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:39:33.097 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:39:33.100 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:39:33.103 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:40:03.152 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:40:03.156 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:40:03.159 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:40:03.161 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:40:33.217 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:40:33.220 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:40:33.223 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:40:33.225 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:41:03.280 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:41:03.283 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:41:03.286 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:41:03.289 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:41:33.344 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:41:33.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:41:33.349 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:41:33.352 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:42:03.438 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:42:03.442 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:42:03.444 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:42:03.447 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:42:33.496 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:42:33.499 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:42:33.502 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:42:33.504 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:43:03.612 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:43:03.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:43:03.618 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:43:03.621 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:43:33.684 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:43:33.687 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:43:33.690 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:43:33.693 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:44:03.762 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:44:03.765 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:44:03.768 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:44:03.770 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:44:33.824 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:44:33.827 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:44:33.830 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:44:33.832 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:45:03.922 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:45:03.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:45:03.928 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:45:03.931 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:45:34.002 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:45:34.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:45:34.008 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:45:34.011 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:46:04.071 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:46:04.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:46:04.077 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:46:04.080 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:46:34.135 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:46:34.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:46:34.141 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:46:34.143 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:47:04.233 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:47:04.237 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:47:04.240 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:47:04.242 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:47:34.300 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:47:34.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:47:34.306 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:47:34.309 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:48:04.398 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:48:04.401 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:48:04.404 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:48:04.406 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:48:34.495 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:48:34.500 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:48:34.504 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:48:34.507 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:49:04.573 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:49:04.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:49:04.579 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:49:04.581 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:49:34.633 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:49:34.637 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:49:34.640 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:49:34.643 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:49:48.863 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-01-10T01:49:48.864 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2022-01-10T01:49:48.869 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T01:49:48.871 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2022-01-10T01:49:48.871 DEBUG:teuthology.orchestra.run.smithi036:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:49:48.890 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:49:48.912 DEBUG:teuthology.orchestra.run.smithi139:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:49:48.933 DEBUG:teuthology.orchestra.run.smithi166:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2022-01-10T01:49:48.955 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2022-01-10T01:49:48.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T01:49:48.956 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T01:49:48.956 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T01:50:04.696 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:50:04.699 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:50:04.702 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:50:04.705 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:50:34.763 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:50:34.766 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:50:34.769 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:50:34.772 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:51:04.833 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:51:04.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:51:04.840 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:51:04.844 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:51:34.897 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:51:34.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:51:34.903 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:51:34.906 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:52:04.962 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:52:04.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:52:04.969 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:52:04.971 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:52:35.025 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:52:35.028 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:52:35.032 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:52:35.034 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:53:05.106 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:53:05.109 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:53:05.112 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:53:05.114 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:53:35.200 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:53:35.204 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:53:35.207 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:53:35.210 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:54:05.265 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:54:05.269 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:54:05.272 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:54:05.274 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:54:35.337 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:54:35.341 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:54:35.343 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:54:35.346 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:55:05.407 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:55:05.410 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:55:05.412 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:55:05.415 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:55:35.579 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:55:35.594 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:55:35.601 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:55:35.607 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:56:05.719 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:56:05.723 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:56:05.726 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:56:05.728 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:56:35.776 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:56:35.779 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:56:35.782 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:56:35.785 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:57:05.858 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:57:05.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:57:05.864 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:57:05.867 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:57:35.927 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:57:35.930 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:57:35.933 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:57:35.936 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:58:06.025 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:58:06.028 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:58:06.031 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:58:06.034 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:58:36.095 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:58:36.098 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:58:36.101 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:58:36.103 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:59:06.175 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:59:06.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:59:06.181 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:59:06.183 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:59:36.239 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:59:36.242 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:59:36.245 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T01:59:36.247 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:00:06.311 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:00:06.315 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:00:06.318 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:00:06.320 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:00:36.402 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:00:36.405 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:00:36.408 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:00:36.410 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:01:06.464 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:01:06.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:01:06.471 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:01:06.474 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:01:36.527 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:01:36.530 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:01:36.533 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:01:36.535 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:02:06.592 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:02:06.596 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:02:06.598 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:02:06.601 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:02:36.655 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:02:36.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:02:36.661 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:02:36.664 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:03:06.745 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:03:06.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:03:06.751 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:03:06.754 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:03:36.810 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:03:36.814 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:03:36.817 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:03:36.819 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:04:06.877 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:04:06.880 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:04:06.883 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:04:06.886 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:04:36.976 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:04:36.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:04:36.982 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:04:36.985 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:04:48.977 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-01-10T02:04:48.978 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2022-01-10T02:04:48.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T02:04:48.988 INFO:tasks.cephfs_test_runner:test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) ... ERROR 2022-01-10T02:04:48.989 INFO:tasks.cephfs_test_runner:ERROR 2022-01-10T02:04:48.989 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:48.990 INFO:tasks.cephfs_test_runner:====================================================================== 2022-01-10T02:04:48.990 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2022-01-10T02:04:48.990 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2022-01-10T02:04:48.991 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2022-01-10T02:04:48.991 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2022-01-10T02:04:48.991 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2022-01-10T02:04:48.992 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2022-01-10T02:04:48.992 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2022-01-10T02:04:48.992 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2022-01-10T02:04:48.992 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:48.993 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2022-01-10T02:04:48.993 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:48.993 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2022-01-10T02:04:48.994 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2022-01-10T02:04:48.994 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2022-01-10T02:04:48.994 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2022-01-10T02:04:48.995 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2022-01-10T02:04:48.995 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2022-01-10T02:04:48.995 INFO:tasks.cephfs_test_runner: proc.wait() 2022-01-10T02:04:48.996 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 148, in wait 2022-01-10T02:04:48.996 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2022-01-10T02:04:48.996 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2022-01-10T02:04:48.997 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2022-01-10T02:04:48.997 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2022-01-10T02:04:48.997 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2022-01-10T02:04:48.998 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2022-01-10T02:04:48.998 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to 2022-01-10T02:04:48.998 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2022-01-10T02:04:48.998 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log 2022-01-10T02:04:48.999 INFO:tasks.cephfs_test_runner: for line in f: 2022-01-10T02:04:48.999 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2022-01-10T02:04:48.999 INFO:tasks.cephfs_test_runner: line = self.readline() 2022-01-10T02:04:49.000 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2022-01-10T02:04:49.000 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2022-01-10T02:04:49.000 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2022-01-10T02:04:49.001 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2022-01-10T02:04:49.001 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2022-01-10T02:04:49.001 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2022-01-10T02:04:49.001 INFO:tasks.cephfs_test_runner:socket.timeout 2022-01-10T02:04:49.002 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:49.002 INFO:tasks.cephfs_test_runner:====================================================================== 2022-01-10T02:04:49.002 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2022-01-10T02:04:49.003 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2022-01-10T02:04:49.003 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2022-01-10T02:04:49.003 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2022-01-10T02:04:49.004 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2022-01-10T02:04:49.004 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2022-01-10T02:04:49.004 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2022-01-10T02:04:49.005 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2022-01-10T02:04:49.005 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:49.005 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2022-01-10T02:04:49.005 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:49.006 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2022-01-10T02:04:49.006 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2022-01-10T02:04:49.006 INFO:tasks.cephfs_test_runner: m.teardown() 2022-01-10T02:04:49.007 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2022-01-10T02:04:49.007 INFO:tasks.cephfs_test_runner: self.umount() 2022-01-10T02:04:49.007 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2022-01-10T02:04:49.008 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2022-01-10T02:04:49.008 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2022-01-10T02:04:49.008 INFO:tasks.cephfs_test_runner: proc.wait() 2022-01-10T02:04:49.008 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 148, in wait 2022-01-10T02:04:49.009 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2022-01-10T02:04:49.009 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2022-01-10T02:04:49.009 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2022-01-10T02:04:49.010 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2022-01-10T02:04:49.010 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2022-01-10T02:04:49.010 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2022-01-10T02:04:49.010 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to 2022-01-10T02:04:49.011 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2022-01-10T02:04:49.011 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log 2022-01-10T02:04:49.011 INFO:tasks.cephfs_test_runner: for line in f: 2022-01-10T02:04:49.012 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2022-01-10T02:04:49.012 INFO:tasks.cephfs_test_runner: line = self.readline() 2022-01-10T02:04:49.012 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2022-01-10T02:04:49.013 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2022-01-10T02:04:49.013 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2022-01-10T02:04:49.013 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2022-01-10T02:04:49.013 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2022-01-10T02:04:49.014 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2022-01-10T02:04:49.014 INFO:tasks.cephfs_test_runner:socket.timeout 2022-01-10T02:04:49.014 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:49.015 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2022-01-10T02:04:49.015 INFO:tasks.cephfs_test_runner:Ran 12 tests in 2398.922s 2022-01-10T02:04:49.015 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:49.015 INFO:tasks.cephfs_test_runner:FAILED (errors=2) 2022-01-10T02:04:49.016 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:49.016 INFO:tasks.cephfs_test_runner:====================================================================== 2022-01-10T02:04:49.016 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2022-01-10T02:04:49.017 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2022-01-10T02:04:49.017 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2022-01-10T02:04:49.017 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2022-01-10T02:04:49.018 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2022-01-10T02:04:49.018 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2022-01-10T02:04:49.018 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2022-01-10T02:04:49.018 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2022-01-10T02:04:49.019 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:49.019 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2022-01-10T02:04:49.019 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:49.020 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2022-01-10T02:04:49.020 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/test_misc.py", line 28, in test_statfs_on_deleted_fs 2022-01-10T02:04:49.020 INFO:tasks.cephfs_test_runner: self.mount_a.umount_wait(force=True) 2022-01-10T02:04:49.020 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait 2022-01-10T02:04:49.021 INFO:tasks.cephfs_test_runner: if not (self.is_mounted() and self.fuse_daemon): 2022-01-10T02:04:49.021 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2022-01-10T02:04:49.021 INFO:tasks.cephfs_test_runner: proc.wait() 2022-01-10T02:04:49.022 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 148, in wait 2022-01-10T02:04:49.022 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2022-01-10T02:04:49.022 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2022-01-10T02:04:49.023 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2022-01-10T02:04:49.023 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2022-01-10T02:04:49.023 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2022-01-10T02:04:49.023 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2022-01-10T02:04:49.024 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to 2022-01-10T02:04:49.024 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2022-01-10T02:04:49.024 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log 2022-01-10T02:04:49.025 INFO:tasks.cephfs_test_runner: for line in f: 2022-01-10T02:04:49.025 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2022-01-10T02:04:49.025 INFO:tasks.cephfs_test_runner: line = self.readline() 2022-01-10T02:04:49.025 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2022-01-10T02:04:49.026 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2022-01-10T02:04:49.026 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2022-01-10T02:04:49.026 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2022-01-10T02:04:49.026 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2022-01-10T02:04:49.027 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2022-01-10T02:04:49.027 INFO:tasks.cephfs_test_runner:socket.timeout 2022-01-10T02:04:49.027 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:49.028 INFO:tasks.cephfs_test_runner:====================================================================== 2022-01-10T02:04:49.028 INFO:tasks.cephfs_test_runner:ERROR: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2022-01-10T02:04:49.028 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2022-01-10T02:04:49.029 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2022-01-10T02:04:49.029 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr 2022-01-10T02:04:49.029 INFO:tasks.cephfs_test_runner: out = self.in_stderr_buffer.read(nbytes, self.timeout) 2022-01-10T02:04:49.029 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read 2022-01-10T02:04:49.030 INFO:tasks.cephfs_test_runner: raise PipeTimeout() 2022-01-10T02:04:49.030 INFO:tasks.cephfs_test_runner:paramiko.buffered_pipe.PipeTimeout 2022-01-10T02:04:49.030 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:49.031 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2022-01-10T02:04:49.031 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:49.031 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2022-01-10T02:04:49.031 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/cephfs_test_case.py", line 175, in tearDown 2022-01-10T02:04:49.032 INFO:tasks.cephfs_test_runner: m.teardown() 2022-01-10T02:04:49.032 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 408, in teardown 2022-01-10T02:04:49.032 INFO:tasks.cephfs_test_runner: self.umount() 2022-01-10T02:04:49.033 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 261, in umount 2022-01-10T02:04:49.033 INFO:tasks.cephfs_test_runner: if not self.is_mounted(): 2022-01-10T02:04:49.033 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted 2022-01-10T02:04:49.034 INFO:tasks.cephfs_test_runner: proc.wait() 2022-01-10T02:04:49.034 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 148, in wait 2022-01-10T02:04:49.034 INFO:tasks.cephfs_test_runner: greenlet.get(block=True,timeout=60) 2022-01-10T02:04:49.034 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get 2022-01-10T02:04:49.035 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception 2022-01-10T02:04:49.035 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise 2022-01-10T02:04:49.035 INFO:tasks.cephfs_test_runner: raise value.with_traceback(tb) 2022-01-10T02:04:49.036 INFO:tasks.cephfs_test_runner: File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run 2022-01-10T02:04:49.036 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to 2022-01-10T02:04:49.036 INFO:tasks.cephfs_test_runner: copy_to_log(src, logger, capture=stream, quiet=quiet) 2022-01-10T02:04:49.037 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log 2022-01-10T02:04:49.037 INFO:tasks.cephfs_test_runner: for line in f: 2022-01-10T02:04:49.037 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ 2022-01-10T02:04:49.037 INFO:tasks.cephfs_test_runner: line = self.readline() 2022-01-10T02:04:49.038 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline 2022-01-10T02:04:49.038 INFO:tasks.cephfs_test_runner: new_data = self._read(n) 2022-01-10T02:04:49.038 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read 2022-01-10T02:04:49.039 INFO:tasks.cephfs_test_runner: return self.channel.recv_stderr(size) 2022-01-10T02:04:49.039 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr 2022-01-10T02:04:49.039 INFO:tasks.cephfs_test_runner: raise socket.timeout() 2022-01-10T02:04:49.039 INFO:tasks.cephfs_test_runner:socket.timeout 2022-01-10T02:04:49.040 INFO:tasks.cephfs_test_runner: 2022-01-10T02:04:49.040 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2022-01-10T02:04:49.145 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=670d43bfdcad406abcaea76fa304578e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc), test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2022-01-10T02:04:49.148 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2022-01-10T02:04:49.156 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2022-01-10T02:04:49.183 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2022-01-10T02:04:49.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T02:04:49.185 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T02:04:49.185 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T02:05:07.071 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:05:07.074 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:05:07.077 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:05:07.079 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:05:37.151 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:05:37.155 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:05:37.157 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:05:37.160 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:06:07.215 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:06:07.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:06:07.221 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:06:07.223 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:06:37.316 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:06:37.320 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:06:37.323 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:06:37.326 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:07:07.383 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:07:07.400 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:07:07.404 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:07:07.408 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:07:37.487 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:07:37.491 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:07:37.494 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:07:37.498 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:08:07.577 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:08:07.581 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:08:07.583 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:08:07.586 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:08:37.648 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:08:37.652 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:08:37.654 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:08:37.657 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:09:07.707 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:09:07.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:09:07.714 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:09:07.716 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:09:37.769 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:09:37.772 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:09:37.775 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:09:37.778 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:10:07.838 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:10:07.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:10:07.845 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:10:07.847 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:10:37.945 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:10:37.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:10:37.952 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:10:37.955 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:11:08.021 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:11:08.025 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:11:08.027 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:11:08.030 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:11:38.088 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:11:38.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:11:38.094 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:11:38.097 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:12:08.157 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:12:08.160 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:12:08.163 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:12:08.166 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:12:38.222 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:12:38.225 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:12:38.228 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:12:38.231 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:13:08.304 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:13:08.308 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:13:08.311 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:13:08.313 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:13:38.376 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:13:38.379 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:13:38.382 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:13:38.384 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:14:08.497 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:14:08.501 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:14:08.504 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:14:08.506 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:14:38.636 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:14:38.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:14:38.642 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:14:38.644 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:15:08.691 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:15:08.695 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:15:08.698 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:15:08.701 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:15:38.977 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:15:38.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:15:38.983 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:15:38.986 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:16:09.114 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:16:09.117 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:16:09.120 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:16:09.123 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:16:39.247 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:16:39.251 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:16:39.253 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:16:39.256 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:17:09.385 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:17:09.418 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:17:09.425 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:17:09.434 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:17:39.565 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:17:39.573 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:17:39.576 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:17:39.579 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:18:09.839 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:18:09.843 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:18:09.846 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:18:09.848 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:18:39.974 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:18:39.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:18:39.980 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:18:39.983 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:19:10.163 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:19:10.166 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:19:10.169 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:19:10.171 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:19:40.310 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:19:40.314 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:19:40.317 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:19:40.319 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:19:49.192 INFO:teuthology.orchestra.run.smithi139.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Connection timed out 2022-01-10T02:19:49.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T02:19:49.195 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2022-01-10T02:19:49.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2022-01-10T02:19:49.196 DEBUG:teuthology.orchestra.run.smithi139:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2022-01-10T02:19:49.197 DEBUG:teuthology.orchestra.run.smithi139:> ' -- /home/ubuntu/cephtest/mnt.0) 2022-01-10T02:20:10.407 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:20:10.410 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:20:10.414 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:20:10.416 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:20:40.527 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:20:40.531 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:20:40.535 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:20:40.538 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:21:10.673 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:21:10.677 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:21:10.679 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:21:10.682 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:21:40.842 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:21:40.931 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:21:40.934 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:21:40.936 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:22:11.115 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:22:11.118 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:22:11.121 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:22:11.123 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:22:41.254 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:22:41.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:22:41.260 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:22:41.263 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:23:11.409 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:23:11.412 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:23:11.415 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:23:11.419 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:23:41.539 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:23:41.544 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:23:41.547 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:23:41.550 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:24:11.606 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:24:11.610 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:24:11.613 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:24:11.615 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:24:41.690 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:24:41.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:24:41.696 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:24:41.700 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:25:11.820 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:25:11.823 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:25:11.827 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:25:11.829 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:25:41.941 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:25:41.945 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:25:41.948 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:25:41.951 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:26:12.155 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:26:12.159 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:26:12.162 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:26:12.164 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:26:42.292 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:26:42.296 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:26:42.298 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:26:42.301 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:27:12.523 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:27:12.526 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:27:12.530 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:27:12.533 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:27:42.644 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:27:42.648 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:27:42.651 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:27:42.654 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:28:12.973 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:28:12.977 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:28:12.979 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:28:12.982 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:28:43.045 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:28:43.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:28:43.051 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:28:43.054 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:29:13.182 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:29:13.185 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:29:13.188 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:29:13.191 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:29:43.534 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:29:43.538 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:29:43.541 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:29:43.543 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:30:13.675 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:30:13.679 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:30:13.681 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:30:13.684 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:30:43.805 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:30:43.809 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:30:43.811 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:30:43.814 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:31:13.951 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:31:13.955 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:31:13.957 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:31:13.960 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:31:44.090 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:31:44.093 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:31:44.096 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:31:44.099 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:32:14.328 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:32:14.332 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:32:14.335 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:32:14.337 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:32:44.474 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:32:44.477 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:32:44.480 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:32:44.483 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:33:14.686 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:33:14.690 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:33:14.692 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:33:14.696 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:33:44.808 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:33:44.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:33:44.814 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:33:44.817 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:34:14.921 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:34:14.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:34:14.927 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:34:14.930 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:34:45.049 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:34:45.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:34:45.055 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:34:45.058 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:34:49.201 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-01-10T02:34:49.216 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2022-01-10T02:34:49.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T02:34:49.245 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-01-10T02:34:49.258 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2022-01-10T02:34:49.273 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2022-01-10T02:34:49.274 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T02:34:49.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.391+0000 7f889def8700 1 Processor -- start 2022-01-10T02:34:49.395 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.391+0000 7f889def8700 1 -- start start 2022-01-10T02:34:49.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f889def8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f88980b6580 0x7f88980b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.398 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f889def8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88980b6960 0x7f889812ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f889def8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88981440b0 con 0x7f88980b43c0 2022-01-10T02:34:49.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f889def8700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8898143b70 con 0x7f88980b6580 2022-01-10T02:34:49.399 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f889def8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8898143e10 con 0x7f88980b6960 2022-01-10T02:34:49.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f88977fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f88980b6580 0x7f88980b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f88977fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f88980b6580 0x7f88980b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43498/0 (socket says 172.21.15.36:43498) 2022-01-10T02:34:49.400 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f88977fe700 1 -- 172.21.15.36:0/207839506 learned_addr learned my addr 172.21.15.36:0/207839506 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:49.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f8897fff700 1 --2- 172.21.15.36:0/207839506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88980b6960 0x7f889812ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f88977fe700 1 -- 172.21.15.36:0/207839506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88980b6960 msgr2=0x7f889812ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:49.401 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f88977fe700 1 --2- 172.21.15.36:0/207839506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88980b6960 0x7f889812ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f88977fe700 1 -- 172.21.15.36:0/207839506 >> v1:172.21.15.59:6789/0 conn(0x7f88980b43c0 legacy=0x7f8898061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f88977fe700 1 -- 172.21.15.36:0/207839506 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980615f0 con 0x7f88980b6580 2022-01-10T02:34:49.402 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f88977fe700 1 --2- 172.21.15.36:0/207839506 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88980b6580 0x7f88980b5bf0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f8898143120 tx=0x7f8888006eb0).ready entity=mon.0 client_cookie=3734b1c1ec326401 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:49.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f88967fc700 1 -- 172.21.15.36:0/207839506 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888800d5c0 con 0x7f88980b6580 2022-01-10T02:34:49.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f88967fc700 1 -- 172.21.15.36:0/207839506 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8888000e90 con 0x7f88980b6580 2022-01-10T02:34:49.403 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f88967fc700 1 -- 172.21.15.36:0/207839506 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888800d950 con 0x7f88980b6580 2022-01-10T02:34:49.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f889def8700 1 -- 172.21.15.36:0/207839506 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88980b6580 msgr2=0x7f88980b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f889def8700 1 --2- 172.21.15.36:0/207839506 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88980b6580 0x7f88980b5bf0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7f8898143120 tx=0x7f8888006eb0).stop 2022-01-10T02:34:49.407 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f889def8700 1 -- 172.21.15.36:0/207839506 shutdown_connections 2022-01-10T02:34:49.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f889def8700 1 --2- 172.21.15.36:0/207839506 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88980b6960 0x7f889812ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f889def8700 1 --2- 172.21.15.36:0/207839506 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88980b6580 0x7f88980b5bf0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.408 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f889def8700 1 -- 172.21.15.36:0/207839506 >> 172.21.15.36:0/207839506 conn(0x7f889805c490 msgr2=0x7f889805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:49.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f889def8700 1 -- 172.21.15.36:0/207839506 shutdown_connections 2022-01-10T02:34:49.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.395+0000 7f889def8700 1 -- 172.21.15.36:0/207839506 wait complete. 2022-01-10T02:34:49.409 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f889def8700 1 Processor -- start 2022-01-10T02:34:49.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f889def8700 1 -- start start 2022-01-10T02:34:49.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f889def8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88980b43c0 0x7f88981522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.410 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f889def8700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88980b6580 0x7f88980b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f889def8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88980b6960 0x7f889814a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f889def8700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88981532b0 con 0x7f88980b6580 2022-01-10T02:34:49.411 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f889def8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8898156700 con 0x7f88980b43c0 2022-01-10T02:34:49.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f889def8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88980b7520 con 0x7f88980b6960 2022-01-10T02:34:49.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f8896ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88980b6580 0x7f88980b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.412 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f8896ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88980b6580 0x7f88980b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43504/0 (socket says 172.21.15.36:43504) 2022-01-10T02:34:49.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f8896ffd700 1 -- 172.21.15.36:0/205167676 learned_addr learned my addr 172.21.15.36:0/205167676 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:49.413 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f8897fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88980b6960 0x7f889814a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f88977fe700 1 --2- 172.21.15.36:0/205167676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88980b43c0 0x7f88981522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f8896ffd700 1 -- 172.21.15.36:0/205167676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88980b6960 msgr2=0x7f889814a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.414 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f8896ffd700 1 --2- 172.21.15.36:0/205167676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88980b6960 0x7f889814a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f8896ffd700 1 -- 172.21.15.36:0/205167676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88980b43c0 msgr2=0x7f88981522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f8896ffd700 1 --2- 172.21.15.36:0/205167676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88980b43c0 0x7f88981522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.415 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f8896ffd700 1 -- 172.21.15.36:0/205167676 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888800b1e0 con 0x7f88980b6580 2022-01-10T02:34:49.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f8896ffd700 1 --2- 172.21.15.36:0/205167676 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88980b6580 0x7f88980b0210 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f88980608b0 tx=0x7f8880001400).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:49.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.399+0000 7f8894ff9700 1 -- 172.21.15.36:0/205167676 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888000f470 con 0x7f88980b6580 2022-01-10T02:34:49.416 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.403+0000 7f8894ff9700 1 -- 172.21.15.36:0/205167676 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888000f5d0 con 0x7f88980b6580 2022-01-10T02:34:49.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.403+0000 7f8894ff9700 1 -- 172.21.15.36:0/205167676 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888000f930 con 0x7f88980b6580 2022-01-10T02:34:49.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.403+0000 7f889def8700 1 -- 172.21.15.36:0/205167676 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88980b0700 con 0x7f88980b6580 2022-01-10T02:34:49.417 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.403+0000 7f889def8700 1 -- 172.21.15.36:0/205167676 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88980b77c0 con 0x7f88980b6580 2022-01-10T02:34:49.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.403+0000 7f889def8700 1 -- 172.21.15.36:0/205167676 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889812c240 con 0x7f88980b6580 2022-01-10T02:34:49.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.403+0000 7f8894ff9700 1 -- 172.21.15.36:0/205167676 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f8880019030 con 0x7f88980b6580 2022-01-10T02:34:49.418 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.403+0000 7f8894ff9700 1 --2- 172.21.15.36:0/205167676 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f887c0535f0 0x7f887c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.403+0000 7f8894ff9700 1 -- 172.21.15.36:0/205167676 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f888006af20 con 0x7f88980b6580 2022-01-10T02:34:49.419 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.403+0000 7f88977fe700 1 --2- 172.21.15.36:0/205167676 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f887c0535f0 0x7f887c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.407+0000 7f88977fe700 1 --2- 172.21.15.36:0/205167676 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f887c0535f0 0x7f887c055ab0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f888801c000 tx=0x7f8888015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:49.420 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.411+0000 7f8894ff9700 1 -- 172.21.15.36:0/205167676 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f8880042100 con 0x7f88980b6580 2022-01-10T02:34:49.541 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.539+0000 7f889def8700 1 -- 172.21.15.36:0/205167676 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8898061890 con 0x7f88980b6580 2022-01-10T02:34:49.543 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.539+0000 7f8894ff9700 1 -- 172.21.15.36:0/205167676 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+13553 (secure 0 0 0) 0x7f8880045720 con 0x7f88980b6580 2022-01-10T02:34:49.543 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T02:34:49.544 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":162,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:34:18.710404+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.36:6837/1997308230":"2022-01-11T01:34:14.906987+0000","172.21.15.36:6836/1997308230":"2022-01-11T01:34:14.906987+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T02:34:49.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.543+0000 7f889def8700 1 -- 172.21.15.36:0/205167676 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f887c0535f0 msgr2=0x7f887c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.545 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.543+0000 7f889def8700 1 --2- 172.21.15.36:0/205167676 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f887c0535f0 0x7f887c055ab0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f888801c000 tx=0x7f8888015000).stop 2022-01-10T02:34:49.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.543+0000 7f889def8700 1 -- 172.21.15.36:0/205167676 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88980b6580 msgr2=0x7f88980b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.543+0000 7f889def8700 1 --2- 172.21.15.36:0/205167676 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88980b6580 0x7f88980b0210 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7f88980608b0 tx=0x7f8880001400).stop 2022-01-10T02:34:49.546 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.543+0000 7f889def8700 1 -- 172.21.15.36:0/205167676 shutdown_connections 2022-01-10T02:34:49.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.543+0000 7f889def8700 1 --2- 172.21.15.36:0/205167676 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f887c0535f0 0x7f887c055ab0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.543+0000 7f889def8700 1 --2- 172.21.15.36:0/205167676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88980b6960 0x7f889814a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.547 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.543+0000 7f889def8700 1 --2- 172.21.15.36:0/205167676 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f88980b6580 0x7f88980b0210 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.543+0000 7f889def8700 1 --2- 172.21.15.36:0/205167676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88980b43c0 0x7f88981522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.543+0000 7f889def8700 1 -- 172.21.15.36:0/205167676 >> 172.21.15.36:0/205167676 conn(0x7f889805c490 msgr2=0x7f8898061c50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:49.548 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.543+0000 7f889def8700 1 -- 172.21.15.36:0/205167676 shutdown_connections 2022-01-10T02:34:49.549 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.543+0000 7f889def8700 1 -- 172.21.15.36:0/205167676 wait complete. 2022-01-10T02:34:49.555 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-01-10T02:34:49.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.655+0000 7f28ca8f9700 1 Processor -- start 2022-01-10T02:34:49.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.655+0000 7f28ca8f9700 1 -- start start 2022-01-10T02:34:49.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.655+0000 7f28ca8f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28c40b2580 0x7f28c4140050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.655+0000 7f28ca8f9700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f28c40ac6f0 0x7f28c4140540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.655+0000 7f28ca8f9700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c4067880 con 0x7f28c40b00e0 2022-01-10T02:34:49.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.655+0000 7f28ca8f9700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c40ad5b0 con 0x7f28c40ac6f0 2022-01-10T02:34:49.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.655+0000 7f28ca8f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c4067b20 con 0x7f28c40b2580 2022-01-10T02:34:49.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.655+0000 7f28ca0f8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f28c40ac6f0 0x7f28c4140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.655+0000 7f28ca0f8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f28c40ac6f0 0x7f28c4140540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43514/0 (socket says 172.21.15.36:43514) 2022-01-10T02:34:49.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.655+0000 7f28c90f6700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f28c40b00e0 0x7f28c4142e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:41304/0 (socket says 172.21.15.36:41304) 2022-01-10T02:34:49.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.655+0000 7f28ca0f8700 1 -- 172.21.15.36:0/2635537209 learned_addr learned my addr 172.21.15.36:0/2635537209 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:49.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.655+0000 7f28c98f7700 1 --2- 172.21.15.36:0/2635537209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28c40b2580 0x7f28c4140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca0f8700 1 -- 172.21.15.36:0/2635537209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28c40b2580 msgr2=0x7f28c4140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:49.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28c88f5700 1 -- 172.21.15.36:0/2635537209 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625718770 0 0) 0x7f28c4067880 con 0x7f28c40b00e0 2022-01-10T02:34:49.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca0f8700 1 --2- 172.21.15.36:0/2635537209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28c40b2580 0x7f28c4140050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca0f8700 1 -- 172.21.15.36:0/2635537209 >> v1:172.21.15.36:6789/0 conn(0x7f28c40b00e0 legacy=0x7f28c4142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca0f8700 1 -- 172.21.15.36:0/2635537209 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c4146fd0 con 0x7f28c40ac6f0 2022-01-10T02:34:49.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca0f8700 1 --2- 172.21.15.36:0/2635537209 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28c40ac6f0 0x7f28c4140540 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f28bc0032f0 tx=0x7f28bc009290).ready entity=mon.0 client_cookie=7231e8910c712a4b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:49.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28c88f5700 1 -- 172.21.15.36:0/2635537209 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28bc00b8a0 con 0x7f28c40ac6f0 2022-01-10T02:34:49.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28c88f5700 1 -- 172.21.15.36:0/2635537209 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc00ba00 con 0x7f28c40ac6f0 2022-01-10T02:34:49.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28c88f5700 1 -- 172.21.15.36:0/2635537209 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28bc00bb70 con 0x7f28c40ac6f0 2022-01-10T02:34:49.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 -- 172.21.15.36:0/2635537209 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28c40ac6f0 msgr2=0x7f28c4140540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 --2- 172.21.15.36:0/2635537209 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28c40ac6f0 0x7f28c4140540 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f28bc0032f0 tx=0x7f28bc009290).stop 2022-01-10T02:34:49.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 -- 172.21.15.36:0/2635537209 shutdown_connections 2022-01-10T02:34:49.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 --2- 172.21.15.36:0/2635537209 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28c40ac6f0 0x7f28c4140540 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 --2- 172.21.15.36:0/2635537209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28c40b2580 0x7f28c4140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 -- 172.21.15.36:0/2635537209 >> 172.21.15.36:0/2635537209 conn(0x7f28c4060180 msgr2=0x7f28c40b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:49.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 -- 172.21.15.36:0/2635537209 shutdown_connections 2022-01-10T02:34:49.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 -- 172.21.15.36:0/2635537209 wait complete. 2022-01-10T02:34:49.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 Processor -- start 2022-01-10T02:34:49.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 -- start start 2022-01-10T02:34:49.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28c40ac6f0 0x7f28c413f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28c40b00e0 0x7f28c4155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28c40b2580 0x7f28c4155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c4144dc0 con 0x7f28c40b00e0 2022-01-10T02:34:49.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c4145060 con 0x7f28c40b2580 2022-01-10T02:34:49.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28ca8f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c4140eb0 con 0x7f28c40ac6f0 2022-01-10T02:34:49.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.659+0000 7f28c90f6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28c40b00e0 0x7f28c4155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28c98f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28c40ac6f0 0x7f28c413f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28c90f6700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28c40b00e0 0x7f28c4155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43518/0 (socket says 172.21.15.36:43518) 2022-01-10T02:34:49.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28c90f6700 1 -- 172.21.15.36:0/874864243 learned_addr learned my addr 172.21.15.36:0/874864243 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:49.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28ca0f8700 1 --2- 172.21.15.36:0/874864243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28c40b2580 0x7f28c4155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28c90f6700 1 -- 172.21.15.36:0/874864243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28c40ac6f0 msgr2=0x7f28c413f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28c90f6700 1 --2- 172.21.15.36:0/874864243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28c40ac6f0 0x7f28c413f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28c90f6700 1 -- 172.21.15.36:0/874864243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28c40b2580 msgr2=0x7f28c4155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28c90f6700 1 --2- 172.21.15.36:0/874864243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28c40b2580 0x7f28c4155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28c90f6700 1 -- 172.21.15.36:0/874864243 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc009530 con 0x7f28c40b00e0 2022-01-10T02:34:49.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28c90f6700 1 --2- 172.21.15.36:0/874864243 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28c40b00e0 0x7f28c4155830 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f28c0000ed0 tx=0x7f28c0007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:49.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28b2ffd700 1 -- 172.21.15.36:0/874864243 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28c00070d0 con 0x7f28c40b00e0 2022-01-10T02:34:49.680 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28b2ffd700 1 -- 172.21.15.36:0/874864243 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c0007230 con 0x7f28c40b00e0 2022-01-10T02:34:49.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28ca8f9700 1 -- 172.21.15.36:0/874864243 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c4143b50 con 0x7f28c40b00e0 2022-01-10T02:34:49.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28b2ffd700 1 -- 172.21.15.36:0/874864243 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28c0005740 con 0x7f28c40b00e0 2022-01-10T02:34:49.681 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28ca8f9700 1 -- 172.21.15.36:0/874864243 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c4145d50 con 0x7f28c40b00e0 2022-01-10T02:34:49.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28ca8f9700 1 -- 172.21.15.36:0/874864243 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c4145220 con 0x7f28c40b00e0 2022-01-10T02:34:49.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.663+0000 7f28b2ffd700 1 -- 172.21.15.36:0/874864243 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f28c001a060 con 0x7f28c40b00e0 2022-01-10T02:34:49.682 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.667+0000 7f28b2ffd700 1 --2- 172.21.15.36:0/874864243 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f28a40534d0 0x7f28a4055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.667+0000 7f28b2ffd700 1 -- 172.21.15.36:0/874864243 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f28c006aff0 con 0x7f28c40b00e0 2022-01-10T02:34:49.683 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.667+0000 7f28c98f7700 1 --2- 172.21.15.36:0/874864243 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f28a40534d0 0x7f28a4055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.667+0000 7f28c98f7700 1 --2- 172.21.15.36:0/874864243 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f28a40534d0 0x7f28a4055990 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f28b400b000 tx=0x7f28b4006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:49.684 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.671+0000 7f28b2ffd700 1 -- 172.21.15.36:0/874864243 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f28c00422e0 con 0x7f28c40b00e0 2022-01-10T02:34:49.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.795+0000 7f28ca8f9700 1 -- 172.21.15.36:0/874864243 --> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28c4057350 con 0x7f28a40534d0 2022-01-10T02:34:49.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.803+0000 7f28b2ffd700 1 -- 172.21.15.36:0/874864243 <== mgr.4101 v2:172.21.15.36:6800/14596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67980 (secure 0 0 0) 0x7f28c4057350 con 0x7f28a40534d0 2022-01-10T02:34:49.806 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T02:34:49.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.803+0000 7f28ca8f9700 1 -- 172.21.15.36:0/874864243 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f28a40534d0 msgr2=0x7f28a4055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.803+0000 7f28ca8f9700 1 --2- 172.21.15.36:0/874864243 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f28a40534d0 0x7f28a4055990 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f28b400b000 tx=0x7f28b4006df0).stop 2022-01-10T02:34:49.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.803+0000 7f28ca8f9700 1 -- 172.21.15.36:0/874864243 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28c40b00e0 msgr2=0x7f28c4155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.803+0000 7f28ca8f9700 1 --2- 172.21.15.36:0/874864243 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28c40b00e0 0x7f28c4155830 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f28c0000ed0 tx=0x7f28c0007a90).stop 2022-01-10T02:34:49.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.803+0000 7f28ca8f9700 1 -- 172.21.15.36:0/874864243 shutdown_connections 2022-01-10T02:34:49.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.803+0000 7f28ca8f9700 1 --2- 172.21.15.36:0/874864243 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f28a40534d0 0x7f28a4055990 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.803+0000 7f28ca8f9700 1 --2- 172.21.15.36:0/874864243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28c40b2580 0x7f28c4155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.803+0000 7f28ca8f9700 1 --2- 172.21.15.36:0/874864243 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f28c40b00e0 0x7f28c4155830 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.803+0000 7f28ca8f9700 1 --2- 172.21.15.36:0/874864243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28c40ac6f0 0x7f28c413f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.803+0000 7f28ca8f9700 1 -- 172.21.15.36:0/874864243 >> 172.21.15.36:0/874864243 conn(0x7f28c4060180 msgr2=0x7f28c405bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:49.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.803+0000 7f28ca8f9700 1 -- 172.21.15.36:0/874864243 shutdown_connections 2022-01-10T02:34:49.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.803+0000 7f28ca8f9700 1 -- 172.21.15.36:0/874864243 wait complete. 2022-01-10T02:34:49.813 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2022-01-10T02:34:49.820 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":2276,"stamp":"2022-01-10T02:34:49.559562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8404792,"kb_used_data":16120,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569928,"statfs":{"total":773094113280,"available":764487606272,"internally_reserved":8589934592,"allocated":16506880,"data_stored":8079964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003448"},"pg_stats":[{"pgid":"1.0","version":"14'2","reported_seq":143,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.802567+0000","last_change":"2022-01-10T01:24:14.937125+0000","last_active":"2022-01-10T01:34:17.802567+0000","last_peered":"2022-01-10T01:34:17.802567+0000","last_clean":"2022-01-10T01:34:17.802567+0000","last_became_active":"2022-01-10T01:24:14.935715+0000","last_became_peered":"2022-01-10T01:24:14.935715+0000","last_unstale":"2022-01-10T01:34:17.802567+0000","last_undegraded":"2022-01-10T01:34:17.802567+0000","last_fullsized":"2022-01-10T01:34:17.802567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:08.543721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:08.543721+0000","last_clean_scrub_stamp":"2022-01-10T01:24:08.543721+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":146,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.715314+0000","last_change":"2022-01-10T01:24:19.114295+0000","last_active":"2022-01-10T01:34:17.715314+0000","last_peered":"2022-01-10T01:34:17.715314+0000","last_clean":"2022-01-10T01:34:17.715314+0000","last_became_active":"2022-01-10T01:24:19.113327+0000","last_became_peered":"2022-01-10T01:24:19.113327+0000","last_unstale":"2022-01-10T01:34:17.715314+0000","last_undegraded":"2022-01-10T01:34:17.715314+0000","last_fullsized":"2022-01-10T01:34:17.715314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.715226+0000","last_change":"2022-01-10T01:24:18.787713+0000","last_active":"2022-01-10T01:34:17.715226+0000","last_peered":"2022-01-10T01:34:17.715226+0000","last_clean":"2022-01-10T01:34:17.715226+0000","last_became_active":"2022-01-10T01:24:18.787183+0000","last_became_peered":"2022-01-10T01:24:18.787183+0000","last_unstale":"2022-01-10T01:34:17.715226+0000","last_undegraded":"2022-01-10T01:34:17.715226+0000","last_fullsized":"2022-01-10T01:34:17.715226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":138,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.802209+0000","last_change":"2022-01-10T01:24:18.786166+0000","last_active":"2022-01-10T01:34:17.802209+0000","last_peered":"2022-01-10T01:34:17.802209+0000","last_clean":"2022-01-10T01:34:17.802209+0000","last_became_active":"2022-01-10T01:24:18.785296+0000","last_became_peered":"2022-01-10T01:24:18.785296+0000","last_unstale":"2022-01-10T01:34:17.802209+0000","last_undegraded":"2022-01-10T01:34:17.802209+0000","last_fullsized":"2022-01-10T01:34:17.802209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":146,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.715262+0000","last_change":"2022-01-10T01:24:19.115873+0000","last_active":"2022-01-10T01:34:17.715262+0000","last_peered":"2022-01-10T01:34:17.715262+0000","last_clean":"2022-01-10T01:34:17.715262+0000","last_became_active":"2022-01-10T01:24:19.114993+0000","last_became_peered":"2022-01-10T01:24:19.114993+0000","last_unstale":"2022-01-10T01:34:17.715262+0000","last_undegraded":"2022-01-10T01:34:17.715262+0000","last_fullsized":"2022-01-10T01:34:17.715262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.717913+0000","last_change":"2022-01-10T01:24:19.116632+0000","last_active":"2022-01-10T01:34:17.717913+0000","last_peered":"2022-01-10T01:34:17.717913+0000","last_clean":"2022-01-10T01:34:17.717913+0000","last_became_active":"2022-01-10T01:24:19.115547+0000","last_became_peered":"2022-01-10T01:24:19.115547+0000","last_unstale":"2022-01-10T01:34:17.717913+0000","last_undegraded":"2022-01-10T01:34:17.717913+0000","last_fullsized":"2022-01-10T01:34:17.717913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.715293+0000","last_change":"2022-01-10T01:24:18.790281+0000","last_active":"2022-01-10T01:34:17.715293+0000","last_peered":"2022-01-10T01:34:17.715293+0000","last_clean":"2022-01-10T01:34:17.715293+0000","last_became_active":"2022-01-10T01:24:18.789645+0000","last_became_peered":"2022-01-10T01:24:18.789645+0000","last_unstale":"2022-01-10T01:34:17.715293+0000","last_undegraded":"2022-01-10T01:34:17.715293+0000","last_fullsized":"2022-01-10T01:34:17.715293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":149,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.716052+0000","last_change":"2022-01-10T01:24:19.666159+0000","last_active":"2022-01-10T01:34:17.716052+0000","last_peered":"2022-01-10T01:34:17.716052+0000","last_clean":"2022-01-10T01:34:17.716052+0000","last_became_active":"2022-01-10T01:24:19.665292+0000","last_became_peered":"2022-01-10T01:24:19.665292+0000","last_unstale":"2022-01-10T01:34:17.716052+0000","last_undegraded":"2022-01-10T01:34:17.716052+0000","last_fullsized":"2022-01-10T01:34:17.716052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.715487+0000","last_change":"2022-01-10T01:24:19.664491+0000","last_active":"2022-01-10T01:34:17.715487+0000","last_peered":"2022-01-10T01:34:17.715487+0000","last_clean":"2022-01-10T01:34:17.715487+0000","last_became_active":"2022-01-10T01:24:19.663966+0000","last_became_peered":"2022-01-10T01:24:19.663966+0000","last_unstale":"2022-01-10T01:34:17.715487+0000","last_undegraded":"2022-01-10T01:34:17.715487+0000","last_fullsized":"2022-01-10T01:34:17.715487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575696,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.89800000000000002,"15min":0.89500000000000002},"min":{"1min":0.60399999999999998,"5min":0.57999999999999996,"15min":0.503},"max":{"1min":1.111,"5min":1.131,"15min":1.224},"last":1.014},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94099999999999995,"15min":0.93400000000000005},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.55300000000000005},"max":{"1min":1.2,"5min":1.2010000000000001,"15min":1.2509999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81499999999999995},"min":{"1min":0.58299999999999996,"5min":0.53300000000000003,"15min":0.497},"max":{"1min":1.0680000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.60799999999999998,"5min":0.56499999999999995,"15min":0.54300000000000004},"max":{"1min":1.1020000000000001,"5min":1.1870000000000001,"15min":1.244},"last":0.95799999999999996}]},{"osd":2,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.66800000000000004,"5min":0.59699999999999998,"15min":0.58199999999999996},"max":{"1min":1.1619999999999999,"5min":1.252,"15min":1.379},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84999999999999998,"15min":0.83499999999999996},"min":{"1min":0.64900000000000002,"5min":0.61599999999999999,"15min":0.58499999999999996},"max":{"1min":1.0589999999999999,"5min":1.113,"15min":1.1279999999999999},"last":1.026}]},{"osd":3,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.876,"15min":0.872},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.59399999999999997},"max":{"1min":1.117,"5min":1.117,"15min":1.2749999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.89500000000000002,"15min":0.91800000000000004},"min":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.623},"max":{"1min":1.165,"5min":1.1739999999999999,"15min":1.2929999999999999},"last":0.89700000000000002}]},{"osd":4,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80300000000000005,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0489999999999999,"5min":1.163,"15min":1.2170000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.86399999999999999,"15min":0.874},"min":{"1min":0.67100000000000004,"5min":0.55600000000000005,"15min":0.52400000000000002},"max":{"1min":1.1930000000000001,"5min":1.2090000000000001,"15min":1.234},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.89000000000000001,"15min":0.89800000000000002},"min":{"1min":0.62,"5min":0.55000000000000004,"15min":0.54600000000000004},"max":{"1min":1.165,"5min":1.256,"15min":1.319},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.92700000000000005,"15min":0.91800000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.298},"last":0.85199999999999998}]},{"osd":6,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.96999999999999997,"15min":0.96199999999999997},"min":{"1min":0.65600000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1699999999999999,"5min":1.228,"15min":1.2569999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0049999999999999,"15min":0.99399999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.24,"5min":1.415,"15min":1.415},"last":1.0900000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575697,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.90800000000000003,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.49099999999999999},"max":{"1min":1.117,"5min":1.141,"15min":1.1619999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.874,"15min":0.876},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.093,"5min":1.093,"15min":1.218},"last":0.99099999999999999}]},{"osd":1,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.51100000000000001},"max":{"1min":0.98699999999999999,"5min":1.169,"15min":1.169},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.55200000000000005},"max":{"1min":0.99099999999999999,"5min":1.1180000000000001,"15min":1.264},"last":0.83599999999999997}]},{"osd":2,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.877,"15min":0.88300000000000001},"min":{"1min":0.59199999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.139,"15min":1.27},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.88200000000000001,"15min":0.88600000000000001},"min":{"1min":0.73799999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.3879999999999999},"last":0.86699999999999999}]},{"osd":3,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.90500000000000003,"15min":0.878},"min":{"1min":0.63900000000000001,"5min":0.58699999999999997,"15min":0.55900000000000005},"max":{"1min":1.1759999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90500000000000003,"15min":0.92100000000000004},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.59399999999999997},"max":{"1min":1.115,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.67700000000000005}]},{"osd":4,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.58899999999999997,"5min":0.54900000000000004,"15min":0.44500000000000001},"max":{"1min":1.038,"5min":1.133,"15min":1.212},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.89800000000000002,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.52700000000000002,"15min":0.50800000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.91000000000000003}]},{"osd":5,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.95099999999999996,"15min":0.94099999999999995},"min":{"1min":0.71799999999999997,"5min":0.58299999999999996,"15min":0.56999999999999995},"max":{"1min":1.1859999999999999,"5min":1.2569999999999999,"15min":1.2649999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.86599999999999999,"15min":0.89400000000000002},"min":{"1min":0.66200000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.206,"5min":1.246,"15min":1.306},"last":0.73199999999999998}]},{"osd":7,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.875,"15min":0.89300000000000002},"min":{"1min":0.70399999999999996,"5min":0.628,"15min":0.441},"max":{"1min":1.22,"5min":1.22,"15min":1.3200000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0329999999999999,"15min":1.028},"min":{"1min":0.82399999999999995,"5min":0.623,"15min":0.59599999999999997},"max":{"1min":1.234,"5min":1.3360000000000001,"15min":1.4319999999999999},"last":1.014}]}]},{"osd":5,"up_from":13,"seq":55834575697,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050596,"kb_used_data":2012,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321244,"statfs":{"total":96636764160,"available":95560953856,"internally_reserved":1073741824,"allocated":2060288,"data_stored":1009562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73699999999999999,"15min":0.74199999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.95299999999999996,"5min":1.1060000000000001,"15min":1.137},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.78800000000000003,"15min":0.79700000000000004},"min":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.50700000000000001},"max":{"1min":1.036,"5min":1.1639999999999999,"15min":1.3100000000000001},"last":0.73199999999999998}]},{"osd":1,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.58799999999999997,"5min":0.52400000000000002,"15min":0.50700000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.524},"last":0.627},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80300000000000005,"15min":0.78500000000000003},"min":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.55700000000000005},"max":{"1min":1.101,"5min":1.23,"15min":1.23},"last":0.60299999999999998}]},{"osd":2,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.92300000000000004,"15min":0.91300000000000003},"min":{"1min":0.71399999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.3089999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83299999999999996,"15min":0.82499999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57099999999999995},"max":{"1min":1.002,"5min":1.0589999999999999,"15min":1.0800000000000001},"last":0.92700000000000005}]},{"osd":3,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.64700000000000002,"5min":0.59499999999999997,"15min":0.58399999999999996},"max":{"1min":1.1519999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93899999999999995,"15min":0.95399999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1359999999999999,"5min":1.262,"15min":1.373},"last":0.71799999999999997}]},{"osd":4,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.752,"15min":0.751},"min":{"1min":0.59199999999999997,"5min":0.51600000000000001,"15min":0.48499999999999999},"max":{"1min":1.014,"5min":1.0309999999999999,"15min":1.115},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.008,"5min":0.98199999999999998,"15min":0.97899999999999998},"min":{"1min":0.89200000000000002,"5min":0.746,"15min":0.66100000000000003},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.28},"last":1.0489999999999999}]},{"osd":6,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.876,"15min":0.88800000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.55600000000000005},"max":{"1min":1.1559999999999999,"5min":1.2649999999999999,"15min":1.4219999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.88300000000000001,"15min":0.90200000000000002},"min":{"1min":0.55200000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.105,"5min":1.196,"15min":1.208},"last":0.80100000000000005}]},{"osd":7,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.89300000000000002,"15min":0.90800000000000003},"min":{"1min":0.67000000000000004,"5min":0.54500000000000004,"15min":0.54400000000000004},"max":{"1min":1.4810000000000001,"5min":1.4850000000000001,"15min":1.6220000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.92800000000000005,"15min":0.95199999999999996},"min":{"1min":0.70699999999999996,"5min":0.58099999999999996,"15min":0.57399999999999995},"max":{"1min":1.2050000000000001,"5min":1.3089999999999999,"15min":1.732},"last":0.78400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575697,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93100000000000005,"15min":0.92400000000000004},"min":{"1min":0.69499999999999995,"5min":0.55800000000000005,"15min":0.47299999999999998},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88300000000000001,"15min":0.89300000000000002},"min":{"1min":0.70499999999999996,"5min":0.69499999999999995,"15min":0.65800000000000003},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.86099999999999999}]},{"osd":1,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.82199999999999995,"15min":0.83599999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.54900000000000004},"max":{"1min":1.0549999999999999,"5min":1.133,"15min":1.1599999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88,"15min":0.879},"min":{"1min":0.60299999999999998,"5min":0.58299999999999996,"15min":0.57299999999999995},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.216},"last":1.012}]},{"osd":2,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.80100000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.071,"5min":1.075,"15min":1.214},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.88600000000000001,"15min":0.89900000000000002},"min":{"1min":0.61699999999999999,"5min":0.61199999999999999,"15min":0.57199999999999995},"max":{"1min":1.1319999999999999,"5min":1.155,"15min":1.2430000000000001},"last":0.77300000000000002}]},{"osd":3,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81299999999999994,"15min":0.82599999999999996},"min":{"1min":0.64000000000000001,"5min":0.61399999999999999,"15min":0.58699999999999997},"max":{"1min":1.147,"5min":1.147,"15min":1.2549999999999999},"last":0.753},{"interface":"front","average":{"1min":0.879,"5min":0.873,"15min":0.86399999999999999},"min":{"1min":0.70299999999999996,"5min":0.68899999999999995,"15min":0.58499999999999996},"max":{"1min":1.1200000000000001,"5min":1.1779999999999999,"15min":1.181},"last":0.91300000000000003}]},{"osd":5,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.86299999999999999,"15min":0.85599999999999998},"min":{"1min":0.66000000000000003,"5min":0.55500000000000005,"15min":0.53700000000000003},"max":{"1min":1.1379999999999999,"5min":1.2130000000000001,"15min":1.2549999999999999},"last":0.622},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.85299999999999998,"15min":0.85399999999999998},"min":{"1min":0.63200000000000001,"5min":0.55700000000000005,"15min":0.52500000000000002},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.79500000000000004}]},{"osd":6,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.85799999999999998,"15min":0.84899999999999998},"min":{"1min":0.69499999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1739999999999999,"5min":1.216,"15min":1.222},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.002,"5min":1.0009999999999999,"15min":1.002},"min":{"1min":0.65800000000000003,"5min":0.63,"15min":0.62},"max":{"1min":1.23,"5min":1.23,"15min":1.302},"last":0.876}]},{"osd":7,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.94699999999999995,"15min":0.93700000000000006},"min":{"1min":0.75,"5min":0.63800000000000001,"15min":0.59299999999999997},"max":{"1min":1.226,"5min":1.3120000000000001,"15min":1.4830000000000001},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.042,"5min":0.97799999999999998,"15min":0.97599999999999998},"min":{"1min":0.77000000000000002,"5min":0.68799999999999994,"15min":0.68000000000000005},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.389},"last":0.73299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575697,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.46999999999999997,"5min":0.46000000000000002,"15min":0.41399999999999998},"max":{"1min":0.77200000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.47499999999999998,"5min":0.46800000000000003,"15min":0.46200000000000002},"max":{"1min":0.84399999999999997,"5min":1.1220000000000001,"15min":1.1519999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65800000000000003,"15min":0.64700000000000002},"min":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.44400000000000001},"max":{"1min":1.0509999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74099999999999999,"15min":0.72999999999999998},"min":{"1min":0.59199999999999997,"5min":0.498,"15min":0.498},"max":{"1min":0.97899999999999998,"5min":1.081,"15min":1.081},"last":0.59899999999999998}]},{"osd":2,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.77600000000000002,"15min":0.76100000000000001},"min":{"1min":0.60599999999999998,"5min":0.56399999999999995,"15min":0.54400000000000004},"max":{"1min":1.0089999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.876},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79700000000000004,"15min":0.80600000000000005},"min":{"1min":0.59999999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.216},"last":0.65800000000000003}]},{"osd":4,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.88800000000000001,"15min":0.875},"min":{"1min":0.68000000000000005,"5min":0.60299999999999998,"15min":0.58399999999999996},"max":{"1min":1.1140000000000001,"5min":1.321,"15min":1.321},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.95299999999999996,"15min":0.95599999999999996},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.167,"5min":1.272,"15min":1.444},"last":1.028}]},{"osd":5,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.97399999999999998,"15min":0.96799999999999997},"min":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.212,"5min":1.28,"15min":1.3939999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.89900000000000002,"15min":0.90100000000000002},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.60599999999999998},"max":{"1min":1.1899999999999999,"5min":1.236,"15min":1.3260000000000001},"last":0.90300000000000002}]},{"osd":6,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.96999999999999997,"15min":0.97199999999999998},"min":{"1min":0.75,"5min":0.72799999999999998,"15min":0.66400000000000003},"max":{"1min":1.2509999999999999,"5min":1.268,"15min":1.494},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.044,"5min":1.04,"15min":1.0309999999999999},"min":{"1min":0.78300000000000003,"5min":0.75600000000000001,"15min":0.69099999999999995},"max":{"1min":1.351,"5min":1.351,"15min":1.3899999999999999},"last":0.92900000000000005}]},{"osd":7,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98399999999999999,"15min":0.99299999999999999},"min":{"1min":0.72199999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":1},{"interface":"front","average":{"1min":1.089,"5min":1.0620000000000001,"15min":1.0569999999999999},"min":{"1min":0.82799999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.1859999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575697,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050596,"kb_used_data":2012,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321244,"statfs":{"total":96636764160,"available":95560953856,"internally_reserved":1073741824,"allocated":2060288,"data_stored":1009562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:33:50 2022","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61199999999999999,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.438,"15min":0.433},"max":{"1min":0.79200000000000004,"5min":0.95699999999999996,"15min":1.0289999999999999},"last":0.499},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.51600000000000001,"5min":0.499,"15min":0.436},"max":{"1min":0.90100000000000002,"5min":1.093,"15min":1.145},"last":1.0309999999999999}]},{"osd":1,"last update":"Mon Jan 10 02:33:50 2022","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69599999999999995,"15min":0.68200000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.47499999999999998},"max":{"1min":0.98999999999999999,"5min":1.0209999999999999,"15min":1.0349999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.57199999999999995,"5min":0.505,"15min":0.47199999999999998},"max":{"1min":0.82099999999999995,"5min":1.038,"15min":1.1459999999999999},"last":1.1060000000000001}]},{"osd":3,"last update":"Mon Jan 10 02:33:50 2022","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69799999999999995,"15min":0.68500000000000005},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.84399999999999997,"5min":1.0640000000000001,"15min":1.1659999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80300000000000005,"15min":0.80000000000000004},"min":{"1min":0.61099999999999999,"5min":0.54700000000000004,"15min":0.52600000000000002},"max":{"1min":1.069,"5min":1.089,"15min":1.1399999999999999},"last":0.81899999999999995}]},{"osd":4,"last update":"Mon Jan 10 02:33:50 2022","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.92100000000000004,"15min":0.91100000000000003},"min":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.58899999999999997},"max":{"1min":1.143,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.90100000000000002,"15min":0.88900000000000001},"min":{"1min":0.71399999999999997,"5min":0.68400000000000005,"15min":0.65500000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2889999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Mon Jan 10 02:33:50 2022","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95799999999999996,"15min":0.95099999999999996},"min":{"1min":0.76500000000000001,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.321,"5min":1.3480000000000001,"15min":1.4670000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.038,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.73799999999999999,"5min":0.68600000000000005,"15min":0.68300000000000005},"max":{"1min":1.2210000000000001,"5min":1.349,"15min":1.4350000000000001},"last":0.95899999999999996}]},{"osd":6,"last update":"Mon Jan 10 02:33:50 2022","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.96199999999999997,"15min":0.93999999999999995},"min":{"1min":0.75900000000000001,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.2350000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.028,"15min":1.0129999999999999},"min":{"1min":0.78900000000000003,"5min":0.745,"15min":0.66200000000000003},"max":{"1min":1.2689999999999999,"5min":1.47,"15min":1.5249999999999999},"last":1.002}]},{"osd":7,"last update":"Mon Jan 10 02:33:50 2022","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0469999999999999,"15min":1.0229999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.70899999999999996},"max":{"1min":1.292,"5min":1.629,"15min":1.629},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0409999999999999,"15min":1.0229999999999999},"min":{"1min":0.86899999999999999,"5min":0.80500000000000005,"15min":0.72699999999999998},"max":{"1min":1.2,"5min":1.3240000000000001,"15min":1.52},"last":0.92000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575698,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.504,"5min":0.46800000000000003,"15min":0.44700000000000001},"max":{"1min":1.095,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64500000000000002,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.439},"max":{"1min":0.78900000000000003,"5min":0.95699999999999996,"15min":1.143},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.54600000000000004},"max":{"1min":0.92800000000000005,"5min":1.137,"15min":1.137},"last":0.91100000000000003}]},{"osd":3,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.55000000000000004},"max":{"1min":1.01,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":1.002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.66100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.93700000000000006,"5min":1.095,"15min":1.1950000000000001},"last":0.66100000000000003}]},{"osd":4,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.60499999999999998},"max":{"1min":1.1180000000000001,"5min":1.2529999999999999,"15min":1.4299999999999999},"last":0.88},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.94199999999999995,"15min":0.93200000000000005},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"max":{"1min":1.1060000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.0609999999999999}]},{"osd":5,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.91700000000000004,"15min":0.90800000000000003},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2010000000000001,"5min":1.3799999999999999,"15min":1.4710000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.93300000000000005,"15min":0.93400000000000005},"min":{"1min":0.70999999999999996,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.087,"5min":1.3680000000000001,"15min":1.4930000000000001},"last":0.97499999999999998}]},{"osd":6,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.78400000000000003,"5min":0.69199999999999995,"15min":0.67800000000000005},"max":{"1min":1.2470000000000001,"5min":1.474,"15min":1.54},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.96099999999999997,"15min":0.98999999999999999},"min":{"1min":0.79000000000000004,"5min":0.72599999999999998,"15min":0.72299999999999998},"max":{"1min":1.05,"5min":1.4750000000000001,"15min":1.512},"last":0.80200000000000005}]},{"osd":7,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0289999999999999,"15min":1.024},"min":{"1min":0.81599999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.2869999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.996},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.03,"15min":1.0429999999999999},"min":{"1min":0.81699999999999995,"5min":0.72299999999999998,"15min":0.69399999999999995},"max":{"1min":1.1859999999999999,"5min":1.446,"15min":1.5840000000000001},"last":1.0249999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575696,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61599999999999999,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.42099999999999999},"max":{"1min":0.90400000000000003,"5min":1.105,"15min":1.105},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.441},"max":{"1min":1.056,"5min":1.1299999999999999,"15min":1.246},"last":0.57799999999999996}]},{"osd":2,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.69899999999999995,"15min":0.69499999999999995},"min":{"1min":0.52200000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98499999999999999,"5min":1.0800000000000001,"15min":1.131},"last":0.747},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.54000000000000004,"5min":0.53600000000000003,"15min":0.45400000000000001},"max":{"1min":1.0940000000000001,"5min":1.171,"15min":1.171},"last":0.78300000000000003}]},{"osd":3,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.55700000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86799999999999999,"5min":1.016,"15min":1.016},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79700000000000004,"15min":0.79000000000000004},"min":{"1min":0.61199999999999999,"5min":0.56299999999999994,"15min":0.498},"max":{"1min":0.92500000000000004,"5min":1.0580000000000001,"15min":1.105},"last":0.80900000000000005}]},{"osd":4,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88500000000000001,"15min":0.89200000000000002},"min":{"1min":0.68000000000000005,"5min":0.67200000000000004,"15min":0.64200000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.393},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.89500000000000002,"15min":0.89600000000000002},"min":{"1min":0.70999999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.282,"5min":1.343,"15min":1.343},"last":0.90700000000000003}]},{"osd":5,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.71799999999999997,"5min":0.69399999999999995,"15min":0.66100000000000003},"max":{"1min":1.264,"5min":1.321,"15min":1.321},"last":1.071},{"interface":"front","average":{"1min":1.018,"5min":0.998,"15min":0.98099999999999998},"min":{"1min":0.76600000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.296,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.98999999999999999}]},{"osd":6,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0309999999999999,"15min":1.0049999999999999},"min":{"1min":0.85499999999999998,"5min":0.71699999999999997,"15min":0.66900000000000004},"max":{"1min":1.347,"5min":1.3819999999999999,"15min":1.399},"last":1.05},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1,"15min":0.995},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.69499999999999995},"max":{"1min":1.2589999999999999,"5min":1.337,"15min":1.4319999999999999},"last":1.012}]},{"osd":7,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0209999999999999,"15min":1.0129999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.72899999999999998},"max":{"1min":1.2390000000000001,"5min":1.389,"15min":1.468},"last":1.109},{"interface":"front","average":{"1min":1.071,"5min":1.026,"15min":1.008},"min":{"1min":0.82199999999999995,"5min":0.749,"15min":0.72599999999999998},"max":{"1min":1.3500000000000001,"5min":1.401,"15min":1.4219999999999999},"last":1.157}]}]}]}} 2022-01-10T02:34:49.824 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-01-10T02:34:49.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0889c42700 1 Processor -- start 2022-01-10T02:34:49.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0889c42700 1 -- start start 2022-01-10T02:34:49.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0889c42700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f08840b2580 0x7f088414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0889c42700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f08840b0010 0x7f088414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0889c42700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08840a70c0 con 0x7f08840afbd0 2022-01-10T02:34:49.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0889c42700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08840a72f0 con 0x7f08840b0010 2022-01-10T02:34:49.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0889c42700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08840a7590 con 0x7f08840b2580 2022-01-10T02:34:49.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0883fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f08840b0010 0x7f088414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0883fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f08840b0010 0x7f088414b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43524/0 (socket says 172.21.15.36:43524) 2022-01-10T02:34:49.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0883fff700 1 -- 172.21.15.36:0/1935594748 learned_addr learned my addr 172.21.15.36:0/1935594748 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:49.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0888c40700 1 --2- 172.21.15.36:0/1935594748 >> v2:172.21.15.59:3300/0 conn(0x7f08840b2580 0x7f088414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0883fff700 1 -- 172.21.15.36:0/1935594748 >> v2:172.21.15.59:3300/0 conn(0x7f08840b2580 msgr2=0x7f088414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:49.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0883fff700 1 --2- 172.21.15.36:0/1935594748 >> v2:172.21.15.59:3300/0 conn(0x7f08840b2580 0x7f088414ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0883fff700 1 -- 172.21.15.36:0/1935594748 >> v1:172.21.15.59:6789/0 conn(0x7f08840afbd0 legacy=0x7f08840a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:49.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0883fff700 1 -- 172.21.15.36:0/1935594748 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08840a7830 con 0x7f08840b0010 2022-01-10T02:34:49.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0888c40700 1 --2- 172.21.15.36:0/1935594748 >> v2:172.21.15.59:3300/0 conn(0x7f08840b2580 0x7f088414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T02:34:49.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f0883fff700 1 --2- 172.21.15.36:0/1935594748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08840b0010 0x7f088414b330 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f088406b7c0 tx=0x7f0870006eb0).ready entity=mon.0 client_cookie=7a2255ea5fe59acf server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:49.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.927+0000 7f08837fe700 1 -- 172.21.15.36:0/1935594748 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f087000d5c0 con 0x7f08840b0010 2022-01-10T02:34:49.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f08837fe700 1 -- 172.21.15.36:0/1935594748 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870000e90 con 0x7f08840b0010 2022-01-10T02:34:49.953 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f08837fe700 1 -- 172.21.15.36:0/1935594748 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f087000d910 con 0x7f08840b0010 2022-01-10T02:34:49.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 -- 172.21.15.36:0/1935594748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08840b0010 msgr2=0x7f088414b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 --2- 172.21.15.36:0/1935594748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08840b0010 0x7f088414b330 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7f088406b7c0 tx=0x7f0870006eb0).stop 2022-01-10T02:34:49.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 -- 172.21.15.36:0/1935594748 shutdown_connections 2022-01-10T02:34:49.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 --2- 172.21.15.36:0/1935594748 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08840b0010 0x7f088414b330 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 --2- 172.21.15.36:0/1935594748 >> v2:172.21.15.59:3300/0 conn(0x7f08840b2580 0x7f088414ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 -- 172.21.15.36:0/1935594748 >> 172.21.15.36:0/1935594748 conn(0x7f0884060180 msgr2=0x7f08840b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:49.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 -- 172.21.15.36:0/1935594748 shutdown_connections 2022-01-10T02:34:49.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 -- 172.21.15.36:0/1935594748 wait complete. 2022-01-10T02:34:49.959 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 Processor -- start 2022-01-10T02:34:49.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 -- start start 2022-01-10T02:34:49.960 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08840afbd0 0x7f088414c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08840b0010 0x7f0884156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.961 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08840b2580 0x7f0884157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.962 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08841565f0 con 0x7f08840b0010 2022-01-10T02:34:49.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08840aa750 con 0x7f08840afbd0 2022-01-10T02:34:49.963 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889c42700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08840aa980 con 0x7f08840b2580 2022-01-10T02:34:49.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0883fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08840b0010 0x7f0884156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.964 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0883fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08840b0010 0x7f0884156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43530/0 (socket says 172.21.15.36:43530) 2022-01-10T02:34:49.965 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0883fff700 1 -- 172.21.15.36:0/3485536990 learned_addr learned my addr 172.21.15.36:0/3485536990 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:49.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.931+0000 7f0889441700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08840b2580 0x7f0884157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.966 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0883fff700 1 -- 172.21.15.36:0/3485536990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08840b2580 msgr2=0x7f0884157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.967 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0888c40700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08840afbd0 0x7f088414c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0883fff700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08840b2580 0x7f0884157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.968 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0883fff700 1 -- 172.21.15.36:0/3485536990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08840afbd0 msgr2=0x7f088414c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:49.969 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0883fff700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08840afbd0 0x7f088414c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:49.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0883fff700 1 -- 172.21.15.36:0/3485536990 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087000b1e0 con 0x7f08840b0010 2022-01-10T02:34:49.970 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0889441700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08840b2580 0x7f0884157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T02:34:49.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0888c40700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08840afbd0 0x7f088414c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T02:34:49.971 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0883fff700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08840b0010 0x7f0884156c80 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f088406b7c0 tx=0x7f0870015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:49.972 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0881ffb700 1 -- 172.21.15.36:0/3485536990 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f087000d940 con 0x7f08840b0010 2022-01-10T02:34:49.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0881ffb700 1 -- 172.21.15.36:0/3485536990 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870011ca0 con 0x7f08840b0010 2022-01-10T02:34:49.973 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0889c42700 1 -- 172.21.15.36:0/3485536990 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08840aac20 con 0x7f08840b0010 2022-01-10T02:34:49.974 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0881ffb700 1 -- 172.21.15.36:0/3485536990 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f087001e460 con 0x7f08840b0010 2022-01-10T02:34:49.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0889c42700 1 -- 172.21.15.36:0/3485536990 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08840652a0 con 0x7f08840b0010 2022-01-10T02:34:49.975 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0881ffb700 1 -- 172.21.15.36:0/3485536990 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0870025030 con 0x7f08840b0010 2022-01-10T02:34:49.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0889c42700 1 -- 172.21.15.36:0/3485536990 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0884057350 con 0x7f08840b0010 2022-01-10T02:34:49.976 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0881ffb700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0864053680 0x7f0864055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:49.977 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0881ffb700 1 -- 172.21.15.36:0/3485536990 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f087006ca60 con 0x7f08840b0010 2022-01-10T02:34:49.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.935+0000 7f0888c40700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0864053680 0x7f0864055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:49.978 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.939+0000 7f0888c40700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0864053680 0x7f0864055b40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f0878008000 tx=0x7f0878008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:49.980 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:49.943+0000 7f0881ffb700 1 -- 172.21.15.36:0/3485536990 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f0870043d50 con 0x7f08840b0010 2022-01-10T02:34:50.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:50.067+0000 7f0889c42700 1 -- 172.21.15.36:0/3485536990 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0884148900 con 0x7f08840b0010 2022-01-10T02:34:50.069 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:50.067+0000 7f0881ffb700 1 -- 172.21.15.36:0/3485536990 <== mon.0 v2:172.21.15.36:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+13553 (secure 0 0 0) 0x7f0870023020 con 0x7f08840b0010 2022-01-10T02:34:50.070 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T02:34:50.071 INFO:teuthology.orchestra.run.smithi036.stdout:{"epoch":162,"fsid":"5a8424a8-ae3f-4adc-8c8f-db9e3e1e2762","created":"2022-01-10T01:24:05.534504+0000","modified":"2022-01-10T01:34:18.710404+0000","last_up_change":"2022-01-10T01:24:13.640947+0000","last_in_change":"2022-01-10T01:24:13.640947+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-01-10T01:24:08.421647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-01-10T01:24:17.709769+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a2c54e57-d684-47f3-9881-521ca63b1599","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6802","nonce":14818},{"type":"v1","addr":"172.21.15.36:6803","nonce":14818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6804","nonce":14818},{"type":"v1","addr":"172.21.15.36:6805","nonce":14818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6808","nonce":14818},{"type":"v1","addr":"172.21.15.36:6809","nonce":14818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6806","nonce":14818},{"type":"v1","addr":"172.21.15.36:6807","nonce":14818}]},"public_addr":"172.21.15.36:6803/14818","cluster_addr":"172.21.15.36:6805/14818","heartbeat_back_addr":"172.21.15.36:6809/14818","heartbeat_front_addr":"172.21.15.36:6807/14818","state":["exists","up"]},{"osd":1,"uuid":"0cfbf9a2-d507-48e2-b6e5-dfec71376624","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6826","nonce":14819},{"type":"v1","addr":"172.21.15.36:6827","nonce":14819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6828","nonce":14819},{"type":"v1","addr":"172.21.15.36:6829","nonce":14819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6832","nonce":14819},{"type":"v1","addr":"172.21.15.36:6833","nonce":14819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6830","nonce":14819},{"type":"v1","addr":"172.21.15.36:6831","nonce":14819}]},"public_addr":"172.21.15.36:6827/14819","cluster_addr":"172.21.15.36:6829/14819","heartbeat_back_addr":"172.21.15.36:6833/14819","heartbeat_front_addr":"172.21.15.36:6831/14819","state":["exists","up"]},{"osd":2,"uuid":"7143a0cb-c0a4-4546-9c0a-98466a260cbe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6810","nonce":14817},{"type":"v1","addr":"172.21.15.36:6812","nonce":14817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6814","nonce":14817},{"type":"v1","addr":"172.21.15.36:6816","nonce":14817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6822","nonce":14817},{"type":"v1","addr":"172.21.15.36:6824","nonce":14817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6818","nonce":14817},{"type":"v1","addr":"172.21.15.36:6820","nonce":14817}]},"public_addr":"172.21.15.36:6812/14817","cluster_addr":"172.21.15.36:6816/14817","heartbeat_back_addr":"172.21.15.36:6824/14817","heartbeat_front_addr":"172.21.15.36:6820/14817","state":["exists","up"]},{"osd":3,"uuid":"a3f501c4-c90e-47fd-9c2e-b4d5fc0ba658","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6811","nonce":14836},{"type":"v1","addr":"172.21.15.36:6813","nonce":14836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6815","nonce":14836},{"type":"v1","addr":"172.21.15.36:6817","nonce":14836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6823","nonce":14836},{"type":"v1","addr":"172.21.15.36:6825","nonce":14836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.36:6819","nonce":14836},{"type":"v1","addr":"172.21.15.36:6821","nonce":14836}]},"public_addr":"172.21.15.36:6813/14836","cluster_addr":"172.21.15.36:6817/14836","heartbeat_back_addr":"172.21.15.36:6825/14836","heartbeat_front_addr":"172.21.15.36:6821/14836","state":["exists","up"]},{"osd":4,"uuid":"350c419b-492c-49e8-aaff-2aeae92df740","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":15004},{"type":"v1","addr":"172.21.15.59:6801","nonce":15004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":15004},{"type":"v1","addr":"172.21.15.59:6803","nonce":15004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":15004},{"type":"v1","addr":"172.21.15.59:6807","nonce":15004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":15004},{"type":"v1","addr":"172.21.15.59:6805","nonce":15004}]},"public_addr":"172.21.15.59:6801/15004","cluster_addr":"172.21.15.59:6803/15004","heartbeat_back_addr":"172.21.15.59:6807/15004","heartbeat_front_addr":"172.21.15.59:6805/15004","state":["exists","up"]},{"osd":5,"uuid":"cf1bcd16-ec47-48e8-a02d-4584906a733c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":15003},{"type":"v1","addr":"172.21.15.59:6817","nonce":15003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":15003},{"type":"v1","addr":"172.21.15.59:6819","nonce":15003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":15003},{"type":"v1","addr":"172.21.15.59:6823","nonce":15003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":15003},{"type":"v1","addr":"172.21.15.59:6821","nonce":15003}]},"public_addr":"172.21.15.59:6817/15003","cluster_addr":"172.21.15.59:6819/15003","heartbeat_back_addr":"172.21.15.59:6823/15003","heartbeat_front_addr":"172.21.15.59:6821/15003","state":["exists","up"]},{"osd":6,"uuid":"422dfc5a-d338-4a98-aaea-9bfccaaa81bb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":15005},{"type":"v1","addr":"172.21.15.59:6809","nonce":15005}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6810","nonce":15005},{"type":"v1","addr":"172.21.15.59:6811","nonce":15005}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":15005},{"type":"v1","addr":"172.21.15.59:6815","nonce":15005}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":15005},{"type":"v1","addr":"172.21.15.59:6813","nonce":15005}]},"public_addr":"172.21.15.59:6809/15005","cluster_addr":"172.21.15.59:6811/15005","heartbeat_back_addr":"172.21.15.59:6815/15005","heartbeat_front_addr":"172.21.15.59:6813/15005","state":["exists","up"]},{"osd":7,"uuid":"192022a0-7ba3-469e-a84e-f9ec7c31ac51","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":15006},{"type":"v1","addr":"172.21.15.59:6825","nonce":15006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":15006},{"type":"v1","addr":"172.21.15.59:6827","nonce":15006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":15006},{"type":"v1","addr":"172.21.15.59:6831","nonce":15006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":15006},{"type":"v1","addr":"172.21.15.59:6829","nonce":15006}]},"public_addr":"172.21.15.59:6825/15006","cluster_addr":"172.21.15.59:6827/15006","heartbeat_back_addr":"172.21.15.59:6831/15006","heartbeat_front_addr":"172.21.15.59:6829/15006","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.768821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.996718+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.976603+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.013480+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.739592+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.944559+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:11.992632+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2022-01-10T01:24:12.066260+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.36:6837/1997308230":"2022-01-11T01:34:14.906987+0000","172.21.15.36:6836/1997308230":"2022-01-11T01:34:14.906987+0000"},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2022-01-10T02:34:50.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:50.067+0000 7f0889c42700 1 -- 172.21.15.36:0/3485536990 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0864053680 msgr2=0x7f0864055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:50.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:50.067+0000 7f0889c42700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0864053680 0x7f0864055b40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f0878008000 tx=0x7f0878008040).stop 2022-01-10T02:34:50.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:50.067+0000 7f0889c42700 1 -- 172.21.15.36:0/3485536990 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08840b0010 msgr2=0x7f0884156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:50.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:50.067+0000 7f0889c42700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08840b0010 0x7f0884156c80 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7f088406b7c0 tx=0x7f0870015000).stop 2022-01-10T02:34:50.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:50.067+0000 7f0889c42700 1 -- 172.21.15.36:0/3485536990 shutdown_connections 2022-01-10T02:34:50.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:50.067+0000 7f0889c42700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0864053680 0x7f0864055b40 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:50.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:50.067+0000 7f0889c42700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08840b2580 0x7f0884157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:50.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:50.067+0000 7f0889c42700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f08840b0010 0x7f0884156c80 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:50.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:50.067+0000 7f0889c42700 1 --2- 172.21.15.36:0/3485536990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08840afbd0 0x7f088414c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:50.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:50.067+0000 7f0889c42700 1 -- 172.21.15.36:0/3485536990 >> 172.21.15.36:0/3485536990 conn(0x7f0884060180 msgr2=0x7f08840adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:50.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:50.067+0000 7f0889c42700 1 -- 172.21.15.36:0/3485536990 shutdown_connections 2022-01-10T02:34:50.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:50.067+0000 7f0889c42700 1 -- 172.21.15.36:0/3485536990 wait complete. 2022-01-10T02:34:51.084 INFO:tasks.ceph:Scrubbing osd.0 2022-01-10T02:34:51.085 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2022-01-10T02:34:51.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cb488b700 1 Processor -- start 2022-01-10T02:34:51.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cb488b700 1 -- start start 2022-01-10T02:34:51.206 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cb488b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6cb00b25a0 0x7f6cb0066520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cb488b700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb0065330 con 0x7f6cb00b3000 2022-01-10T02:34:51.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cb488b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cb00b33e0 con 0x7f6cb0066a10 2022-01-10T02:34:51.207 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cb488b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb0062000 con 0x7f6cb00b25a0 2022-01-10T02:34:51.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6caed9d700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f6cb00b3000 0x7f6cb0060b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:41332/0 (socket says 172.21.15.36:41332) 2022-01-10T02:34:51.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6caed9d700 1 -- 172.21.15.36:0/2673563887 learned_addr learned my addr 172.21.15.36:0/2673563887 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T02:34:51.208 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cae59c700 1 --2- 172.21.15.36:0/2673563887 >> v2:172.21.15.59:3300/0 conn(0x7f6cb00b25a0 0x7f6cb0066520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cadd9b700 1 -- 172.21.15.36:0/2673563887 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433640050 0 0) 0x7f6cb0065330 con 0x7f6cb00b3000 2022-01-10T02:34:51.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cadd9b700 1 -- 172.21.15.36:0/2673563887 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c94003260 con 0x7f6cb00b3000 2022-01-10T02:34:51.209 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cae59c700 1 -- 172.21.15.36:0/2673563887 >> v1:172.21.15.59:6789/0 conn(0x7f6cb0066a10 legacy=0x7f6cb014d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cae59c700 1 -- 172.21.15.36:0/2673563887 >> v1:172.21.15.36:6789/0 conn(0x7f6cb00b3000 legacy=0x7f6cb0060b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cae59c700 1 -- 172.21.15.36:0/2673563887 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb005fa60 con 0x7f6cb00b25a0 2022-01-10T02:34:51.210 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cae59c700 1 --2- 172.21.15.36:0/2673563887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb00b25a0 0x7f6cb0066520 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f6ca0002f70 tx=0x7f6ca0006df0).ready entity=mon.1 client_cookie=bcc7022267a1144d server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:51.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cadd9b700 1 -- 172.21.15.36:0/2673563887 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ca000d610 con 0x7f6cb00b25a0 2022-01-10T02:34:51.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cadd9b700 1 -- 172.21.15.36:0/2673563887 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca0000e90 con 0x7f6cb00b25a0 2022-01-10T02:34:51.211 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.203+0000 7f6cadd9b700 1 -- 172.21.15.36:0/2673563887 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ca000d960 con 0x7f6cb00b25a0 2022-01-10T02:34:51.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 -- 172.21.15.36:0/2673563887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb00b25a0 msgr2=0x7f6cb0066520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 --2- 172.21.15.36:0/2673563887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb00b25a0 0x7f6cb0066520 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f6ca0002f70 tx=0x7f6ca0006df0).stop 2022-01-10T02:34:51.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 -- 172.21.15.36:0/2673563887 shutdown_connections 2022-01-10T02:34:51.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 --2- 172.21.15.36:0/2673563887 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb00b25a0 0x7f6cb0066520 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 -- 172.21.15.36:0/2673563887 >> 172.21.15.36:0/2673563887 conn(0x7f6cb00636e0 msgr2=0x7f6cb0063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:51.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 -- 172.21.15.36:0/2673563887 shutdown_connections 2022-01-10T02:34:51.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 -- 172.21.15.36:0/2673563887 wait complete. 2022-01-10T02:34:51.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 Processor -- start 2022-01-10T02:34:51.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 -- start start 2022-01-10T02:34:51.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cb0066a10 0x7f6cb00b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cb00b25a0 0x7f6cb00ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb00b3000 0x7f6cb00ab640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00abb30 con 0x7f6cb00b25a0 2022-01-10T02:34:51.220 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb0152c00 con 0x7f6cb00b3000 2022-01-10T02:34:51.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cb488b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb0152ea0 con 0x7f6cb0066a10 2022-01-10T02:34:51.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cae59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cb00b25a0 0x7f6cb00ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.221 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6caed9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cb0066a10 0x7f6cb00b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cae59c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cb00b25a0 0x7f6cb00ab150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43546/0 (socket says 172.21.15.36:43546) 2022-01-10T02:34:51.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6cae59c700 1 -- 172.21.15.36:0/479359411 learned_addr learned my addr 172.21.15.36:0/479359411 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:51.222 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.207+0000 7f6caf59e700 1 --2- 172.21.15.36:0/479359411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb00b3000 0x7f6cb00ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.211+0000 7f6caed9d700 1 -- 172.21.15.36:0/479359411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb00b3000 msgr2=0x7f6cb00ab640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.211+0000 7f6caed9d700 1 --2- 172.21.15.36:0/479359411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cb00b3000 0x7f6cb00ab640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.223 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.211+0000 7f6caed9d700 1 -- 172.21.15.36:0/479359411 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cb00b25a0 msgr2=0x7f6cb00ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.211+0000 7f6caed9d700 1 --2- 172.21.15.36:0/479359411 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6cb00b25a0 0x7f6cb00ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.211+0000 7f6caed9d700 1 -- 172.21.15.36:0/479359411 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca000b180 con 0x7f6cb0066a10 2022-01-10T02:34:51.224 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.211+0000 7f6caed9d700 1 --2- 172.21.15.36:0/479359411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cb0066a10 0x7f6cb00b0bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f6cb00b0020 tx=0x7f6ca4007a20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:51.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.211+0000 7f6c9ffff700 1 -- 172.21.15.36:0/479359411 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ca400cd40 con 0x7f6cb0066a10 2022-01-10T02:34:51.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.211+0000 7f6c9ffff700 1 -- 172.21.15.36:0/479359411 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca40070d0 con 0x7f6cb0066a10 2022-01-10T02:34:51.225 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.211+0000 7f6c9ffff700 1 -- 172.21.15.36:0/479359411 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6ca400cea0 con 0x7f6cb0066a10 2022-01-10T02:34:51.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.211+0000 7f6cb488b700 1 -- 172.21.15.36:0/479359411 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb0145f00 con 0x7f6cb0066a10 2022-01-10T02:34:51.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.211+0000 7f6cb488b700 1 -- 172.21.15.36:0/479359411 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb01463a0 con 0x7f6cb0066a10 2022-01-10T02:34:51.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.211+0000 7f6cb488b700 1 -- 172.21.15.36:0/479359411 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6cb0145d80 con 0x7f6cb0066a10 2022-01-10T02:34:51.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.211+0000 7f6c9ffff700 1 -- 172.21.15.36:0/479359411 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6ca4010070 con 0x7f6cb0066a10 2022-01-10T02:34:51.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.211+0000 7f6c9ffff700 1 --2- 172.21.15.36:0/479359411 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6c8c0535f0 0x7f6c8c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.215+0000 7f6c9ffff700 1 -- 172.21.15.36:0/479359411 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f6ca406ac80 con 0x7f6cb0066a10 2022-01-10T02:34:51.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.215+0000 7f6cae59c700 1 --2- 172.21.15.36:0/479359411 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6c8c0535f0 0x7f6c8c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.215+0000 7f6c9ffff700 1 --2- 172.21.15.36:0/479359411 >> [v2:172.21.15.36:6802/14818,v1:172.21.15.36:6803/14818] conn(0x7f6c8c05a380 0x7f6c8c05c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.228 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.215+0000 7f6c9ffff700 1 -- 172.21.15.36:0/479359411 --> [v2:172.21.15.36:6802/14818,v1:172.21.15.36:6803/14818] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c8c05cd60 con 0x7f6c8c05a380 2022-01-10T02:34:51.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.215+0000 7f6c9ffff700 1 -- 172.21.15.36:0/479359411 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ca406f220 con 0x7f6cb0066a10 2022-01-10T02:34:51.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.215+0000 7f6caf59e700 1 --2- 172.21.15.36:0/479359411 >> [v2:172.21.15.36:6802/14818,v1:172.21.15.36:6803/14818] conn(0x7f6c8c05a380 0x7f6c8c05c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.229 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.215+0000 7f6cae59c700 1 --2- 172.21.15.36:0/479359411 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6c8c0535f0 0x7f6c8c055ab0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f6ca001a000 tx=0x7f6ca0014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:51.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.215+0000 7f6caf59e700 1 --2- 172.21.15.36:0/479359411 >> [v2:172.21.15.36:6802/14818,v1:172.21.15.36:6803/14818] conn(0x7f6c8c05a380 0x7f6c8c05c7a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:51.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.215+0000 7f6c9ffff700 1 -- 172.21.15.36:0/479359411 <== osd.0 v2:172.21.15.36:6802/14818 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f6c8c05cd60 con 0x7f6c8c05a380 2022-01-10T02:34:51.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.231+0000 7f6cb488b700 1 -- 172.21.15.36:0/479359411 --> [v2:172.21.15.36:6802/14818,v1:172.21.15.36:6803/14818] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6cb0146090 con 0x7f6c8c05a380 2022-01-10T02:34:51.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.231+0000 7f6c9ffff700 1 -- 172.21.15.36:0/479359411 <== osd.0 v2:172.21.15.36:6802/14818 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f6cb0146090 con 0x7f6c8c05a380 2022-01-10T02:34:51.236 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T02:34:51.236 INFO:teuthology.orchestra.run.smithi036.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-01-10T02:34:51.236 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T02:34:51.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.235+0000 7f6cb488b700 1 -- 172.21.15.36:0/479359411 >> [v2:172.21.15.36:6802/14818,v1:172.21.15.36:6803/14818] conn(0x7f6c8c05a380 msgr2=0x7f6c8c05c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.235+0000 7f6cb488b700 1 --2- 172.21.15.36:0/479359411 >> [v2:172.21.15.36:6802/14818,v1:172.21.15.36:6803/14818] conn(0x7f6c8c05a380 0x7f6c8c05c7a0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.235+0000 7f6cb488b700 1 -- 172.21.15.36:0/479359411 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6c8c0535f0 msgr2=0x7f6c8c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.235+0000 7f6cb488b700 1 --2- 172.21.15.36:0/479359411 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6c8c0535f0 0x7f6c8c055ab0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f6ca001a000 tx=0x7f6ca0014000).stop 2022-01-10T02:34:51.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.235+0000 7f6cb488b700 1 -- 172.21.15.36:0/479359411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cb0066a10 msgr2=0x7f6cb00b0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.235+0000 7f6cb488b700 1 --2- 172.21.15.36:0/479359411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cb0066a10 0x7f6cb00b0bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f6cb00b0020 tx=0x7f6ca4007a20).stop 2022-01-10T02:34:51.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.235+0000 7f6caf59e700 1 -- 172.21.15.36:0/479359411 reap_dead start 2022-01-10T02:34:51.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.235+0000 7f6cb488b700 1 -- 172.21.15.36:0/479359411 shutdown_connections 2022-01-10T02:34:51.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.235+0000 7f6cb488b700 1 -- 172.21.15.36:0/479359411 >> 172.21.15.36:0/479359411 conn(0x7f6cb00636e0 msgr2=0x7f6cb0143590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:51.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.235+0000 7f6cb488b700 1 -- 172.21.15.36:0/479359411 shutdown_connections 2022-01-10T02:34:51.241 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.235+0000 7f6cb488b700 1 -- 172.21.15.36:0/479359411 wait complete. 2022-01-10T02:34:51.247 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2022-01-10T02:34:51.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.359+0000 7f07ba199700 1 Processor -- start 2022-01-10T02:34:51.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.359+0000 7f07ba199700 1 -- start start 2022-01-10T02:34:51.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.359+0000 7f07ba199700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f07b40b1280 0x7f07b40b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.359+0000 7f07ba199700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f07b40aedc0 0x7f07b40b2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.359+0000 7f07ba199700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b4140310 con 0x7f07b4140cf0 2022-01-10T02:34:51.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.359+0000 7f07ba199700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b41405b0 con 0x7f07b40b1280 2022-01-10T02:34:51.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07ba199700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b4140850 con 0x7f07b40aedc0 2022-01-10T02:34:51.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07b37fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f07b40b1280 0x7f07b40b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07b37fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f07b40b1280 0x7f07b40b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43554/0 (socket says 172.21.15.36:43554) 2022-01-10T02:34:51.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07b37fe700 1 -- 172.21.15.36:0/574151586 learned_addr learned my addr 172.21.15.36:0/574151586 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:51.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07b3fff700 1 --2- 172.21.15.36:0/574151586 >> v2:172.21.15.59:3300/0 conn(0x7f07b40aedc0 0x7f07b40b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07b37fe700 1 -- 172.21.15.36:0/574151586 >> v2:172.21.15.59:3300/0 conn(0x7f07b40aedc0 msgr2=0x7f07b40b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:51.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07b37fe700 1 --2- 172.21.15.36:0/574151586 >> v2:172.21.15.59:3300/0 conn(0x7f07b40aedc0 0x7f07b40b2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07b37fe700 1 -- 172.21.15.36:0/574151586 >> v1:172.21.15.59:6789/0 conn(0x7f07b4140cf0 legacy=0x7f07b40ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07b37fe700 1 -- 172.21.15.36:0/574151586 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b4140000 con 0x7f07b40b1280 2022-01-10T02:34:51.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07b3fff700 1 --2- 172.21.15.36:0/574151586 >> v2:172.21.15.59:3300/0 conn(0x7f07b40aedc0 0x7f07b40b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T02:34:51.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07b37fe700 1 --2- 172.21.15.36:0/574151586 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07b40b1280 0x7f07b40b1c70 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f07b40b2680 tx=0x7f07a4006eb0).ready entity=mon.0 client_cookie=2e7852eb81372d8a server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:51.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07b2ffd700 1 -- 172.21.15.36:0/574151586 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07a400d610 con 0x7f07b40b1280 2022-01-10T02:34:51.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07b2ffd700 1 -- 172.21.15.36:0/574151586 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a4000e90 con 0x7f07b40b1280 2022-01-10T02:34:51.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07b2ffd700 1 -- 172.21.15.36:0/574151586 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07a400d960 con 0x7f07b40b1280 2022-01-10T02:34:51.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07ba199700 1 -- 172.21.15.36:0/574151586 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07b40b1280 msgr2=0x7f07b40b1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07ba199700 1 --2- 172.21.15.36:0/574151586 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07b40b1280 0x7f07b40b1c70 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f07b40b2680 tx=0x7f07a4006eb0).stop 2022-01-10T02:34:51.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07ba199700 1 -- 172.21.15.36:0/574151586 shutdown_connections 2022-01-10T02:34:51.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07ba199700 1 --2- 172.21.15.36:0/574151586 >> v2:172.21.15.59:3300/0 conn(0x7f07b40aedc0 0x7f07b40b2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07ba199700 1 --2- 172.21.15.36:0/574151586 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07b40b1280 0x7f07b40b1c70 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07ba199700 1 -- 172.21.15.36:0/574151586 >> 172.21.15.36:0/574151586 conn(0x7f07b405f6b0 msgr2=0x7f07b405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:51.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07ba199700 1 -- 172.21.15.36:0/574151586 shutdown_connections 2022-01-10T02:34:51.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.363+0000 7f07ba199700 1 -- 172.21.15.36:0/574151586 wait complete. 2022-01-10T02:34:51.378 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.367+0000 7f07ba199700 1 Processor -- start 2022-01-10T02:34:51.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.367+0000 7f07ba199700 1 -- start start 2022-01-10T02:34:51.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.367+0000 7f07ba199700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07b40aedc0 0x7f07b40b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.379 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.367+0000 7f07ba199700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07b40b1280 0x7f07b41545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.367+0000 7f07ba199700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07b4140cf0 0x7f07b40affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.367+0000 7f07ba199700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b414e530 con 0x7f07b40aedc0 2022-01-10T02:34:51.380 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.367+0000 7f07ba199700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b4153ef0 con 0x7f07b40b1280 2022-01-10T02:34:51.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.367+0000 7f07ba199700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b413a950 con 0x7f07b4140cf0 2022-01-10T02:34:51.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.367+0000 7f07b37fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07b40aedc0 0x7f07b40b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.381 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.367+0000 7f07b37fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07b40aedc0 0x7f07b40b3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43560/0 (socket says 172.21.15.36:43560) 2022-01-10T02:34:51.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07b37fe700 1 -- 172.21.15.36:0/565864139 learned_addr learned my addr 172.21.15.36:0/565864139 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:51.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07abfff700 1 --2- 172.21.15.36:0/565864139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07b40b1280 0x7f07b41545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.382 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07b3fff700 1 --2- 172.21.15.36:0/565864139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07b4140cf0 0x7f07b40affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07b37fe700 1 -- 172.21.15.36:0/565864139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07b4140cf0 msgr2=0x7f07b40affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.383 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07b37fe700 1 --2- 172.21.15.36:0/565864139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07b4140cf0 0x7f07b40affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07b37fe700 1 -- 172.21.15.36:0/565864139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07b40b1280 msgr2=0x7f07b41545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07b37fe700 1 --2- 172.21.15.36:0/565864139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07b40b1280 0x7f07b41545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.384 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07b37fe700 1 -- 172.21.15.36:0/565864139 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a400b1e0 con 0x7f07b40aedc0 2022-01-10T02:34:51.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07b37fe700 1 --2- 172.21.15.36:0/565864139 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07b40aedc0 0x7f07b40b3b00 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7f07b40b45d0 tx=0x7f07a4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:51.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07b17fa700 1 -- 172.21.15.36:0/565864139 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07a4011610 con 0x7f07b40aedc0 2022-01-10T02:34:51.385 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07b17fa700 1 -- 172.21.15.36:0/565864139 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a4011770 con 0x7f07b40aedc0 2022-01-10T02:34:51.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07ba199700 1 -- 172.21.15.36:0/565864139 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b413a6b0 con 0x7f07b40aedc0 2022-01-10T02:34:51.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07b17fa700 1 -- 172.21.15.36:0/565864139 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07a4011ad0 con 0x7f07b40aedc0 2022-01-10T02:34:51.386 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07ba199700 1 -- 172.21.15.36:0/565864139 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b4144310 con 0x7f07b40aedc0 2022-01-10T02:34:51.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.371+0000 7f07ba199700 1 -- 172.21.15.36:0/565864139 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b40aa390 con 0x7f07b40aedc0 2022-01-10T02:34:51.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.375+0000 7f07b17fa700 1 -- 172.21.15.36:0/565864139 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f07a4025030 con 0x7f07b40aedc0 2022-01-10T02:34:51.387 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.375+0000 7f07b17fa700 1 --2- 172.21.15.36:0/565864139 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07980534d0 0x7f0798055990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.375+0000 7f07b17fa700 1 -- 172.21.15.36:0/565864139 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f07a406c870 con 0x7f07b40aedc0 2022-01-10T02:34:51.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.375+0000 7f07abfff700 1 --2- 172.21.15.36:0/565864139 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07980534d0 0x7f0798055990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.388 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.375+0000 7f07abfff700 1 --2- 172.21.15.36:0/565864139 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07980534d0 0x7f0798055990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f079c00d000 tx=0x7f079c007b90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:51.389 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.379+0000 7f07b17fa700 1 -- 172.21.15.36:0/565864139 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f07a4043b60 con 0x7f07b40aedc0 2022-01-10T02:34:51.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.507+0000 7f07ba199700 1 -- 172.21.15.36:0/565864139 --> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f07b4154350 con 0x7f07980534d0 2022-01-10T02:34:51.511 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.511+0000 7f07b17fa700 1 -- 172.21.15.36:0/565864139 <== mgr.4101 v2:172.21.15.36:6800/14596 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f079c015410 con 0x7f07980534d0 2022-01-10T02:34:51.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.511+0000 7f07ba199700 1 -- 172.21.15.36:0/565864139 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07980534d0 msgr2=0x7f0798055990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.511+0000 7f07ba199700 1 --2- 172.21.15.36:0/565864139 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07980534d0 0x7f0798055990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f079c00d000 tx=0x7f079c007b90).stop 2022-01-10T02:34:51.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.511+0000 7f07ba199700 1 -- 172.21.15.36:0/565864139 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07b40aedc0 msgr2=0x7f07b40b3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.511+0000 7f07ba199700 1 --2- 172.21.15.36:0/565864139 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07b40aedc0 0x7f07b40b3b00 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7f07b40b45d0 tx=0x7f07a4015000).stop 2022-01-10T02:34:51.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.511+0000 7f07ba199700 1 -- 172.21.15.36:0/565864139 shutdown_connections 2022-01-10T02:34:51.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.511+0000 7f07ba199700 1 --2- 172.21.15.36:0/565864139 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f07980534d0 0x7f0798055990 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.511+0000 7f07ba199700 1 --2- 172.21.15.36:0/565864139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07b4140cf0 0x7f07b40affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.511+0000 7f07ba199700 1 --2- 172.21.15.36:0/565864139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07b40b1280 0x7f07b41545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.511+0000 7f07ba199700 1 --2- 172.21.15.36:0/565864139 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f07b40aedc0 0x7f07b40b3b00 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.511+0000 7f07ba199700 1 -- 172.21.15.36:0/565864139 >> 172.21.15.36:0/565864139 conn(0x7f07b405f6b0 msgr2=0x7f07b40b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:51.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.511+0000 7f07ba199700 1 -- 172.21.15.36:0/565864139 shutdown_connections 2022-01-10T02:34:51.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.511+0000 7f07ba199700 1 -- 172.21.15.36:0/565864139 wait complete. 2022-01-10T02:34:51.519 INFO:teuthology.orchestra.run.smithi036.stderr:instructed osd(s) 0 to deep-scrub 2022-01-10T02:34:51.531 INFO:tasks.ceph:Scrubbing osd.1 2022-01-10T02:34:51.532 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2022-01-10T02:34:51.642 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.639+0000 7f0fbfc81700 1 Processor -- start 2022-01-10T02:34:51.643 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.639+0000 7f0fbfc81700 1 -- start start 2022-01-10T02:34:51.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbfc81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b6580 0x7f0fb80b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.645 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbfc81700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0fb80b6960 0x7f0fb812ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbfc81700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb81440b0 con 0x7f0fb80b43c0 2022-01-10T02:34:51.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbfc81700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb8143b70 con 0x7f0fb80b6960 2022-01-10T02:34:51.646 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbfc81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb8143e10 con 0x7f0fb80b6580 2022-01-10T02:34:51.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbe21e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0fb80b6960 0x7f0fb812ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbe21e700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f0fb80b6960 0x7f0fb812ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43572/0 (socket says 172.21.15.36:43572) 2022-01-10T02:34:51.647 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbe21e700 1 -- 172.21.15.36:0/4244141293 learned_addr learned my addr 172.21.15.36:0/4244141293 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:51.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbda1d700 1 --2- 172.21.15.36:0/4244141293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b6580 0x7f0fb80b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbca1b700 1 -- 172.21.15.36:0/4244141293 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085917821 0 0) 0x7f0fb81440b0 con 0x7f0fb80b43c0 2022-01-10T02:34:51.648 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbca1b700 1 -- 172.21.15.36:0/4244141293 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa0003260 con 0x7f0fb80b43c0 2022-01-10T02:34:51.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbe21e700 1 -- 172.21.15.36:0/4244141293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b6580 msgr2=0x7f0fb80b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:51.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbe21e700 1 --2- 172.21.15.36:0/4244141293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b6580 0x7f0fb80b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.649 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbe21e700 1 -- 172.21.15.36:0/4244141293 >> v1:172.21.15.59:6789/0 conn(0x7f0fb80b43c0 legacy=0x7f0fb8061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbe21e700 1 -- 172.21.15.36:0/4244141293 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb80615f0 con 0x7f0fb80b6960 2022-01-10T02:34:51.650 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbe21e700 1 --2- 172.21.15.36:0/4244141293 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80b6960 0x7f0fb812ba00 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f0fb00032f0 tx=0x7f0fb0009290).ready entity=mon.0 client_cookie=4f5f3beb2d31eaf1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:51.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbca1b700 1 -- 172.21.15.36:0/4244141293 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fb000b6c0 con 0x7f0fb80b6960 2022-01-10T02:34:51.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbca1b700 1 -- 172.21.15.36:0/4244141293 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb000b820 con 0x7f0fb80b6960 2022-01-10T02:34:51.651 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbca1b700 1 -- 172.21.15.36:0/4244141293 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fb000b990 con 0x7f0fb80b6960 2022-01-10T02:34:51.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbfc81700 1 -- 172.21.15.36:0/4244141293 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80b6960 msgr2=0x7f0fb812ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.655 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbfc81700 1 --2- 172.21.15.36:0/4244141293 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80b6960 0x7f0fb812ba00 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7f0fb00032f0 tx=0x7f0fb0009290).stop 2022-01-10T02:34:51.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbfc81700 1 -- 172.21.15.36:0/4244141293 shutdown_connections 2022-01-10T02:34:51.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbfc81700 1 --2- 172.21.15.36:0/4244141293 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80b6960 0x7f0fb812ba00 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbfc81700 1 --2- 172.21.15.36:0/4244141293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b6580 0x7f0fb80b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbfc81700 1 -- 172.21.15.36:0/4244141293 >> 172.21.15.36:0/4244141293 conn(0x7f0fb805c490 msgr2=0x7f0fb805c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:51.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbfc81700 1 -- 172.21.15.36:0/4244141293 shutdown_connections 2022-01-10T02:34:51.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.643+0000 7f0fbfc81700 1 -- 172.21.15.36:0/4244141293 wait complete. 2022-01-10T02:34:51.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.647+0000 7f0fbfc81700 1 Processor -- start 2022-01-10T02:34:51.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.647+0000 7f0fbfc81700 1 -- start start 2022-01-10T02:34:51.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.647+0000 7f0fbfc81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b43c0 0x7f0fb8123670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbfc81700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b6580 0x7f0fb8140360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbfc81700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80b6960 0x7f0fb8140850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbfc81700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb80b2270 con 0x7f0fb80b6960 2022-01-10T02:34:51.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbfc81700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb81202e0 con 0x7f0fb80b6580 2022-01-10T02:34:51.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbfc81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb8120040 con 0x7f0fb80b43c0 2022-01-10T02:34:51.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbe21e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80b6960 0x7f0fb8140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbd21c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b6580 0x7f0fb8140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbe21e700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80b6960 0x7f0fb8140850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43578/0 (socket says 172.21.15.36:43578) 2022-01-10T02:34:51.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbda1d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b43c0 0x7f0fb8123670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbd21c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b6580 0x7f0fb8140360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:40210/0 (socket says 172.21.15.36:40210) 2022-01-10T02:34:51.662 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbe21e700 1 -- 172.21.15.36:0/2396782086 learned_addr learned my addr 172.21.15.36:0/2396782086 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:51.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbe21e700 1 -- 172.21.15.36:0/2396782086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b43c0 msgr2=0x7f0fb8123670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbe21e700 1 --2- 172.21.15.36:0/2396782086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0fb80b43c0 0x7f0fb8123670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.663 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbe21e700 1 -- 172.21.15.36:0/2396782086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b6580 msgr2=0x7f0fb8140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbe21e700 1 --2- 172.21.15.36:0/2396782086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b6580 0x7f0fb8140360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbe21e700 1 -- 172.21.15.36:0/2396782086 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb0009530 con 0x7f0fb80b6960 2022-01-10T02:34:51.664 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbd21c700 1 --2- 172.21.15.36:0/2396782086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fb80b6580 0x7f0fb8140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T02:34:51.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbe21e700 1 --2- 172.21.15.36:0/2396782086 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80b6960 0x7f0fb8140850 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f0fb00032f0 tx=0x7f0fb0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:51.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0faaffd700 1 -- 172.21.15.36:0/2396782086 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fb000b990 con 0x7f0fb80b6960 2022-01-10T02:34:51.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0faaffd700 1 -- 172.21.15.36:0/2396782086 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb0021670 con 0x7f0fb80b6960 2022-01-10T02:34:51.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbfc81700 1 -- 172.21.15.36:0/2396782086 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb80b24d0 con 0x7f0fb80b6960 2022-01-10T02:34:51.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0faaffd700 1 -- 172.21.15.36:0/2396782086 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fb000b6c0 con 0x7f0fb80b6960 2022-01-10T02:34:51.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbfc81700 1 -- 172.21.15.36:0/2396782086 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb811dcc0 con 0x7f0fb80b6960 2022-01-10T02:34:51.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.651+0000 7f0fbfc81700 1 -- 172.21.15.36:0/2396782086 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0fb80b2690 con 0x7f0fb80b6960 2022-01-10T02:34:51.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.655+0000 7f0faaffd700 1 -- 172.21.15.36:0/2396782086 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f0fb0028070 con 0x7f0fb80b6960 2022-01-10T02:34:51.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.655+0000 7f0faaffd700 1 --2- 172.21.15.36:0/2396782086 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f980535f0 0x7f0f98055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.655+0000 7f0faaffd700 1 -- 172.21.15.36:0/2396782086 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f0fb006c410 con 0x7f0fb80b6960 2022-01-10T02:34:51.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.655+0000 7f0fbda1d700 1 --2- 172.21.15.36:0/2396782086 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f980535f0 0x7f0f98055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.655+0000 7f0faaffd700 1 --2- 172.21.15.36:0/2396782086 >> [v2:172.21.15.36:6826/14819,v1:172.21.15.36:6827/14819] conn(0x7f0f9805a380 0x7f0f9805c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.655+0000 7f0faaffd700 1 -- 172.21.15.36:0/2396782086 --> [v2:172.21.15.36:6826/14819,v1:172.21.15.36:6827/14819] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f9805cd60 con 0x7f0f9805a380 2022-01-10T02:34:51.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.655+0000 7f0faaffd700 1 -- 172.21.15.36:0/2396782086 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fb006eaa0 con 0x7f0fb80b6960 2022-01-10T02:34:51.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.655+0000 7f0fbd21c700 1 --2- 172.21.15.36:0/2396782086 >> [v2:172.21.15.36:6826/14819,v1:172.21.15.36:6827/14819] conn(0x7f0f9805a380 0x7f0f9805c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.655+0000 7f0fbda1d700 1 --2- 172.21.15.36:0/2396782086 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f980535f0 0x7f0f98055ab0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f0fac00b000 tx=0x7f0fac006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:51.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.655+0000 7f0fbd21c700 1 --2- 172.21.15.36:0/2396782086 >> [v2:172.21.15.36:6826/14819,v1:172.21.15.36:6827/14819] conn(0x7f0f9805a380 0x7f0f9805c7a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:51.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.655+0000 7f0faaffd700 1 -- 172.21.15.36:0/2396782086 <== osd.1 v2:172.21.15.36:6826/14819 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f0f9805cd60 con 0x7f0f9805a380 2022-01-10T02:34:51.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.671+0000 7f0fbfc81700 1 -- 172.21.15.36:0/2396782086 --> [v2:172.21.15.36:6826/14819,v1:172.21.15.36:6827/14819] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0fb81272d0 con 0x7f0f9805a380 2022-01-10T02:34:51.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.671+0000 7f0faaffd700 1 -- 172.21.15.36:0/2396782086 <== osd.1 v2:172.21.15.36:6826/14819 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0fb81272d0 con 0x7f0f9805a380 2022-01-10T02:34:51.674 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T02:34:51.674 INFO:teuthology.orchestra.run.smithi036.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-01-10T02:34:51.675 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T02:34:51.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.671+0000 7f0fbfc81700 1 -- 172.21.15.36:0/2396782086 >> [v2:172.21.15.36:6826/14819,v1:172.21.15.36:6827/14819] conn(0x7f0f9805a380 msgr2=0x7f0f9805c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.671+0000 7f0fbfc81700 1 --2- 172.21.15.36:0/2396782086 >> [v2:172.21.15.36:6826/14819,v1:172.21.15.36:6827/14819] conn(0x7f0f9805a380 0x7f0f9805c7a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.671+0000 7f0fbfc81700 1 -- 172.21.15.36:0/2396782086 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f980535f0 msgr2=0x7f0f98055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.671+0000 7f0fbfc81700 1 --2- 172.21.15.36:0/2396782086 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f0f980535f0 0x7f0f98055ab0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f0fac00b000 tx=0x7f0fac006df0).stop 2022-01-10T02:34:51.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.671+0000 7f0fbfc81700 1 -- 172.21.15.36:0/2396782086 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80b6960 msgr2=0x7f0fb8140850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.671+0000 7f0fbfc81700 1 --2- 172.21.15.36:0/2396782086 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f0fb80b6960 0x7f0fb8140850 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7f0fb00032f0 tx=0x7f0fb0016000).stop 2022-01-10T02:34:51.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.671+0000 7f0fbe21e700 1 -- 172.21.15.36:0/2396782086 reap_dead start 2022-01-10T02:34:51.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.671+0000 7f0fbfc81700 1 -- 172.21.15.36:0/2396782086 shutdown_connections 2022-01-10T02:34:51.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.671+0000 7f0fbfc81700 1 -- 172.21.15.36:0/2396782086 >> 172.21.15.36:0/2396782086 conn(0x7f0fb805c490 msgr2=0x7f0fb8143160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:51.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.671+0000 7f0fbfc81700 1 -- 172.21.15.36:0/2396782086 shutdown_connections 2022-01-10T02:34:51.679 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.671+0000 7f0fbfc81700 1 -- 172.21.15.36:0/2396782086 wait complete. 2022-01-10T02:34:51.685 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2022-01-10T02:34:51.793 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.791+0000 7f4622e9f700 1 Processor -- start 2022-01-10T02:34:51.794 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.791+0000 7f4622e9f700 1 -- start start 2022-01-10T02:34:51.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f4622e9f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f461c0b6580 0x7f461c0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.796 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f4622e9f700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f461c0b6960 0x7f461c12ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f4622e9f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c1440b0 con 0x7f461c0b43c0 2022-01-10T02:34:51.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f4622e9f700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c143b70 con 0x7f461c0b6960 2022-01-10T02:34:51.797 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f4622e9f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c143e10 con 0x7f461c0b6580 2022-01-10T02:34:51.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f462143c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f461c0b6960 0x7f461c12ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f462143c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f461c0b6960 0x7f461c12ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43588/0 (socket says 172.21.15.36:43588) 2022-01-10T02:34:51.798 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f462143c700 1 -- 172.21.15.36:0/3704268905 learned_addr learned my addr 172.21.15.36:0/3704268905 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:51.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f4620c3b700 1 --2- 172.21.15.36:0/3704268905 >> v2:172.21.15.59:3300/0 conn(0x7f461c0b6580 0x7f461c0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f462143c700 1 -- 172.21.15.36:0/3704268905 >> v2:172.21.15.59:3300/0 conn(0x7f461c0b6580 msgr2=0x7f461c0b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:51.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f462143c700 1 --2- 172.21.15.36:0/3704268905 >> v2:172.21.15.59:3300/0 conn(0x7f461c0b6580 0x7f461c0b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f462143c700 1 -- 172.21.15.36:0/3704268905 >> v1:172.21.15.59:6789/0 conn(0x7f461c0b43c0 legacy=0x7f461c061d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f462143c700 1 -- 172.21.15.36:0/3704268905 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c0615f0 con 0x7f461c0b6960 2022-01-10T02:34:51.800 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f462143c700 1 --2- 172.21.15.36:0/3704268905 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f461c0b6960 0x7f461c12ba00 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f461c143120 tx=0x7f4614009290).ready entity=mon.0 client_cookie=62704e3aec8039a0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:51.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f461b7fe700 1 -- 172.21.15.36:0/3704268905 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f461400b860 con 0x7f461c0b6960 2022-01-10T02:34:51.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f461b7fe700 1 -- 172.21.15.36:0/3704268905 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461400b9c0 con 0x7f461c0b6960 2022-01-10T02:34:51.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f461b7fe700 1 -- 172.21.15.36:0/3704268905 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f461400bb30 con 0x7f461c0b6960 2022-01-10T02:34:51.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f4622e9f700 1 -- 172.21.15.36:0/3704268905 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f461c0b6960 msgr2=0x7f461c12ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f4622e9f700 1 --2- 172.21.15.36:0/3704268905 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f461c0b6960 0x7f461c12ba00 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7f461c143120 tx=0x7f4614009290).stop 2022-01-10T02:34:51.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f4622e9f700 1 -- 172.21.15.36:0/3704268905 shutdown_connections 2022-01-10T02:34:51.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f4622e9f700 1 --2- 172.21.15.36:0/3704268905 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f461c0b6960 0x7f461c12ba00 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.807 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f4622e9f700 1 --2- 172.21.15.36:0/3704268905 >> v2:172.21.15.59:3300/0 conn(0x7f461c0b6580 0x7f461c0b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f4622e9f700 1 -- 172.21.15.36:0/3704268905 >> 172.21.15.36:0/3704268905 conn(0x7f461c05c490 msgr2=0x7f461c05c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:51.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f4622e9f700 1 -- 172.21.15.36:0/3704268905 shutdown_connections 2022-01-10T02:34:51.808 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.795+0000 7f4622e9f700 1 -- 172.21.15.36:0/3704268905 wait complete. 2022-01-10T02:34:51.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.799+0000 7f4622e9f700 1 Processor -- start 2022-01-10T02:34:51.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.799+0000 7f4622e9f700 1 -- start start 2022-01-10T02:34:51.809 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.799+0000 7f4622e9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c0b43c0 0x7f461c1275f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.799+0000 7f4622e9f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f461c0b6580 0x7f461c129780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.799+0000 7f4622e9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c0b6960 0x7f461c129c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.810 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.799+0000 7f4622e9f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c1254c0 con 0x7f461c0b6580 2022-01-10T02:34:51.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.799+0000 7f4622e9f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c1260f0 con 0x7f461c0b43c0 2022-01-10T02:34:51.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.799+0000 7f4622e9f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c126390 con 0x7f461c0b6960 2022-01-10T02:34:51.811 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.799+0000 7f461bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f461c0b6580 0x7f461c129780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.799+0000 7f4620c3b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c0b43c0 0x7f461c1275f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.799+0000 7f461bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f461c0b6580 0x7f461c129780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43592/0 (socket says 172.21.15.36:43592) 2022-01-10T02:34:51.812 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f4620c3b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c0b43c0 0x7f461c1275f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.36:40224/0 (socket says 172.21.15.36:40224) 2022-01-10T02:34:51.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f461bfff700 1 -- 172.21.15.36:0/2416967289 learned_addr learned my addr 172.21.15.36:0/2416967289 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:51.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f462143c700 1 --2- 172.21.15.36:0/2416967289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c0b6960 0x7f461c129c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.813 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f4620c3b700 1 -- 172.21.15.36:0/2416967289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c0b6960 msgr2=0x7f461c129c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f4620c3b700 1 --2- 172.21.15.36:0/2416967289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c0b6960 0x7f461c129c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f4620c3b700 1 -- 172.21.15.36:0/2416967289 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f461c0b6580 msgr2=0x7f461c129780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.814 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f4620c3b700 1 --2- 172.21.15.36:0/2416967289 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f461c0b6580 0x7f461c129780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f4620c3b700 1 -- 172.21.15.36:0/2416967289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4614009530 con 0x7f461c0b43c0 2022-01-10T02:34:51.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f4620c3b700 1 --2- 172.21.15.36:0/2416967289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c0b43c0 0x7f461c1275f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f461000a000 tx=0x7f4610008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:51.815 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f4619ffb700 1 -- 172.21.15.36:0/2416967289 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4610011590 con 0x7f461c0b43c0 2022-01-10T02:34:51.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f4619ffb700 1 -- 172.21.15.36:0/2416967289 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46100116f0 con 0x7f461c0b43c0 2022-01-10T02:34:51.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f4622e9f700 1 -- 172.21.15.36:0/2416967289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461c126630 con 0x7f461c0b43c0 2022-01-10T02:34:51.816 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f4619ffb700 1 -- 172.21.15.36:0/2416967289 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4610011a50 con 0x7f461c0b43c0 2022-01-10T02:34:51.817 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f4622e9f700 1 -- 172.21.15.36:0/2416967289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c0ae050 con 0x7f461c0b43c0 2022-01-10T02:34:51.818 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f4622e9f700 1 -- 172.21.15.36:0/2416967289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461c061890 con 0x7f461c0b43c0 2022-01-10T02:34:51.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.803+0000 7f4619ffb700 1 -- 172.21.15.36:0/2416967289 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4610011bb0 con 0x7f461c0b43c0 2022-01-10T02:34:51.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.807+0000 7f4619ffb700 1 --2- 172.21.15.36:0/2416967289 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f45fc053680 0x7f45fc055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:51.819 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.807+0000 7f4619ffb700 1 -- 172.21.15.36:0/2416967289 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f461006b4c0 con 0x7f461c0b43c0 2022-01-10T02:34:51.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.807+0000 7f461bfff700 1 --2- 172.21.15.36:0/2416967289 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f45fc053680 0x7f45fc055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:51.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.807+0000 7f461bfff700 1 --2- 172.21.15.36:0/2416967289 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f45fc053680 0x7f45fc055b40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f460800d000 tx=0x7f4608000bc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:51.820 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.815+0000 7f4619ffb700 1 -- 172.21.15.36:0/2416967289 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f46100426b0 con 0x7f461c0b43c0 2022-01-10T02:34:51.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.943+0000 7f4622e9f700 1 -- 172.21.15.36:0/2416967289 --> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f461c126ad0 con 0x7f45fc053680 2022-01-10T02:34:51.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.943+0000 7f4619ffb700 1 -- 172.21.15.36:0/2416967289 <== mgr.4101 v2:172.21.15.36:6800/14596 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4608015410 con 0x7f45fc053680 2022-01-10T02:34:51.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.943+0000 7f4622e9f700 1 -- 172.21.15.36:0/2416967289 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f45fc053680 msgr2=0x7f45fc055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.943+0000 7f4622e9f700 1 --2- 172.21.15.36:0/2416967289 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f45fc053680 0x7f45fc055b40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7f460800d000 tx=0x7f4608000bc0).stop 2022-01-10T02:34:51.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.943+0000 7f4622e9f700 1 -- 172.21.15.36:0/2416967289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c0b43c0 msgr2=0x7f461c1275f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:51.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.943+0000 7f4622e9f700 1 --2- 172.21.15.36:0/2416967289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c0b43c0 0x7f461c1275f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f461000a000 tx=0x7f4610008040).stop 2022-01-10T02:34:51.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.943+0000 7f4622e9f700 1 -- 172.21.15.36:0/2416967289 shutdown_connections 2022-01-10T02:34:51.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.943+0000 7f4622e9f700 1 --2- 172.21.15.36:0/2416967289 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f45fc053680 0x7f45fc055b40 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.943+0000 7f4622e9f700 1 --2- 172.21.15.36:0/2416967289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f461c0b6960 0x7f461c129c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.943+0000 7f4622e9f700 1 --2- 172.21.15.36:0/2416967289 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f461c0b6580 0x7f461c129780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.943+0000 7f4622e9f700 1 --2- 172.21.15.36:0/2416967289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f461c0b43c0 0x7f461c1275f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:51.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.943+0000 7f4622e9f700 1 -- 172.21.15.36:0/2416967289 >> 172.21.15.36:0/2416967289 conn(0x7f461c05c490 msgr2=0x7f461c061fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:51.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.947+0000 7f4622e9f700 1 -- 172.21.15.36:0/2416967289 shutdown_connections 2022-01-10T02:34:51.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:51.947+0000 7f4622e9f700 1 -- 172.21.15.36:0/2416967289 wait complete. 2022-01-10T02:34:51.951 INFO:teuthology.orchestra.run.smithi036.stderr:instructed osd(s) 1 to deep-scrub 2022-01-10T02:34:51.958 INFO:tasks.ceph:Scrubbing osd.2 2022-01-10T02:34:51.959 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2022-01-10T02:34:52.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.071+0000 7f5727fff700 1 Processor -- start 2022-01-10T02:34:52.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.071+0000 7f5727fff700 1 -- start start 2022-01-10T02:34:52.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.071+0000 7f5727fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f57280a9190 0x7f5728146550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.071+0000 7f5727fff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57280b1140 con 0x7f57280b03d0 2022-01-10T02:34:52.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.071+0000 7f5727fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57280a9570 con 0x7f57280b0b80 2022-01-10T02:34:52.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.071+0000 7f5727fff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57280b1370 con 0x7f57280a9190 2022-01-10T02:34:52.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.071+0000 7f5726ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f57280a9190 0x7f5728146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.071+0000 7f5726ffd700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f57280a9190 0x7f5728146550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43598/0 (socket says 172.21.15.36:43598) 2022-01-10T02:34:52.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.071+0000 7f5726ffd700 1 -- 172.21.15.36:0/1145790456 learned_addr learned my addr 172.21.15.36:0/1145790456 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:52.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.071+0000 7f5726ffd700 1 -- 172.21.15.36:0/1145790456 >> v1:172.21.15.59:6789/0 conn(0x7f57280b0b80 legacy=0x7f5728146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.071+0000 7f5726ffd700 1 -- 172.21.15.36:0/1145790456 >> v1:172.21.15.36:6789/0 conn(0x7f57280b03d0 legacy=0x7f57281401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5725ffb700 1 -- 172.21.15.36:0/1145790456 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955836530 0 0) 0x7f57280b1140 con 0x7f57280b03d0 2022-01-10T02:34:52.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5726ffd700 1 -- 172.21.15.36:0/1145790456 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57280b1610 con 0x7f57280a9190 2022-01-10T02:34:52.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5726ffd700 1 --2- 172.21.15.36:0/1145790456 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57280a9190 0x7f5728146550 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f5718002f70 tx=0x7f5718006eb0).ready entity=mon.0 client_cookie=d005bc9c9130009b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5725ffb700 1 -- 172.21.15.36:0/1145790456 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f571800d660 con 0x7f57280a9190 2022-01-10T02:34:52.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5725ffb700 1 -- 172.21.15.36:0/1145790456 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5718000e90 con 0x7f57280a9190 2022-01-10T02:34:52.081 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5725ffb700 1 -- 172.21.15.36:0/1145790456 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f571800d9b0 con 0x7f57280a9190 2022-01-10T02:34:52.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5727fff700 1 -- 172.21.15.36:0/1145790456 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57280a9190 msgr2=0x7f5728146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5727fff700 1 --2- 172.21.15.36:0/1145790456 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57280a9190 0x7f5728146550 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7f5718002f70 tx=0x7f5718006eb0).stop 2022-01-10T02:34:52.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5727fff700 1 -- 172.21.15.36:0/1145790456 shutdown_connections 2022-01-10T02:34:52.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5727fff700 1 --2- 172.21.15.36:0/1145790456 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57280a9190 0x7f5728146550 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5727fff700 1 -- 172.21.15.36:0/1145790456 >> 172.21.15.36:0/1145790456 conn(0x7f5728061140 msgr2=0x7f5728062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:52.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5727fff700 1 -- 172.21.15.36:0/1145790456 shutdown_connections 2022-01-10T02:34:52.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5727fff700 1 -- 172.21.15.36:0/1145790456 wait complete. 2022-01-10T02:34:52.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5727fff700 1 Processor -- start 2022-01-10T02:34:52.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.075+0000 7f5727fff700 1 -- start start 2022-01-10T02:34:52.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5727fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57280a9190 0x7f572813f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5727fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57280b03d0 0x7f57281521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5727fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57280b0b80 0x7f57281526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5727fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5728152bd0 con 0x7f57280a9190 2022-01-10T02:34:52.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5727fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5728155820 con 0x7f57280b0b80 2022-01-10T02:34:52.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5727fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5728155ac0 con 0x7f57280b03d0 2022-01-10T02:34:52.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5726ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57280a9190 0x7f572813f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5726ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57280a9190 0x7f572813f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43604/0 (socket says 172.21.15.36:43604) 2022-01-10T02:34:52.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5726ffd700 1 -- 172.21.15.36:0/1923817714 learned_addr learned my addr 172.21.15.36:0/1923817714 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:52.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f57267fc700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57280b03d0 0x7f57281521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f57277fe700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57280b0b80 0x7f57281526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5726ffd700 1 -- 172.21.15.36:0/1923817714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57280b03d0 msgr2=0x7f57281521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5726ffd700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57280b03d0 0x7f57281521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5726ffd700 1 -- 172.21.15.36:0/1923817714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57280b0b80 msgr2=0x7f57281526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5726ffd700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57280b0b80 0x7f57281526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5726ffd700 1 -- 172.21.15.36:0/1923817714 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571800b1e0 con 0x7f57280a9190 2022-01-10T02:34:52.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f57267fc700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57280b03d0 0x7f57281521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T02:34:52.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5726ffd700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57280a9190 0x7f572813f010 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f5718002f70 tx=0x7f5718015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5717fff700 1 -- 172.21.15.36:0/1923817714 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57180118a0 con 0x7f57280a9190 2022-01-10T02:34:52.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5717fff700 1 -- 172.21.15.36:0/1923817714 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5718011a00 con 0x7f57280a9190 2022-01-10T02:34:52.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5727fff700 1 -- 172.21.15.36:0/1923817714 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5728155d60 con 0x7f57280a9190 2022-01-10T02:34:52.095 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5717fff700 1 -- 172.21.15.36:0/1923817714 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5718011d60 con 0x7f57280a9190 2022-01-10T02:34:52.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.079+0000 7f5727fff700 1 -- 172.21.15.36:0/1923817714 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5728149020 con 0x7f57280a9190 2022-01-10T02:34:52.096 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.083+0000 7f5727fff700 1 -- 172.21.15.36:0/1923817714 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5728156200 con 0x7f57280a9190 2022-01-10T02:34:52.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.083+0000 7f5717fff700 1 -- 172.21.15.36:0/1923817714 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5718025030 con 0x7f57280a9190 2022-01-10T02:34:52.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.083+0000 7f5717fff700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5704053620 0x7f5704055ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.097 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.083+0000 7f5717fff700 1 -- 172.21.15.36:0/1923817714 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f571806c9f0 con 0x7f57280a9190 2022-01-10T02:34:52.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.083+0000 7f57267fc700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5704053620 0x7f5704055ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.083+0000 7f5717fff700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.36:6810/14817,v1:172.21.15.36:6812/14817] conn(0x7f570405a3b0 0x7f570405c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.098 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.083+0000 7f5717fff700 1 -- 172.21.15.36:0/1923817714 --> [v2:172.21.15.36:6810/14817,v1:172.21.15.36:6812/14817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f570405cd90 con 0x7f570405a3b0 2022-01-10T02:34:52.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.083+0000 7f5717fff700 1 -- 172.21.15.36:0/1923817714 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5718071240 con 0x7f57280a9190 2022-01-10T02:34:52.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.083+0000 7f57277fe700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.36:6810/14817,v1:172.21.15.36:6812/14817] conn(0x7f570405a3b0 0x7f570405c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.099 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.083+0000 7f57267fc700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5704053620 0x7f5704055ae0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f571c00d000 tx=0x7f571c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.083+0000 7f57277fe700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.36:6810/14817,v1:172.21.15.36:6812/14817] conn(0x7f570405a3b0 0x7f570405c7d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.100 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.083+0000 7f5717fff700 1 -- 172.21.15.36:0/1923817714 <== osd.2 v2:172.21.15.36:6810/14817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f570405cd90 con 0x7f570405a3b0 2022-01-10T02:34:52.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.103+0000 7f5727fff700 1 -- 172.21.15.36:0/1923817714 --> [v2:172.21.15.36:6810/14817,v1:172.21.15.36:6812/14817] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f57281495a0 con 0x7f570405a3b0 2022-01-10T02:34:52.105 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.103+0000 7f5717fff700 1 -- 172.21.15.36:0/1923817714 <== osd.2 v2:172.21.15.36:6810/14817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f57281495a0 con 0x7f570405a3b0 2022-01-10T02:34:52.106 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T02:34:52.106 INFO:teuthology.orchestra.run.smithi036.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-01-10T02:34:52.107 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T02:34:52.108 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.103+0000 7f5727fff700 1 -- 172.21.15.36:0/1923817714 >> [v2:172.21.15.36:6810/14817,v1:172.21.15.36:6812/14817] conn(0x7f570405a3b0 msgr2=0x7f570405c7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.103+0000 7f5727fff700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.36:6810/14817,v1:172.21.15.36:6812/14817] conn(0x7f570405a3b0 0x7f570405c7d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.103+0000 7f5727fff700 1 -- 172.21.15.36:0/1923817714 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5704053620 msgr2=0x7f5704055ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.109 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.103+0000 7f5727fff700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5704053620 0x7f5704055ae0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f571c00d000 tx=0x7f571c009040).stop 2022-01-10T02:34:52.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.103+0000 7f5727fff700 1 -- 172.21.15.36:0/1923817714 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57280a9190 msgr2=0x7f572813f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.103+0000 7f5727fff700 1 --2- 172.21.15.36:0/1923817714 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f57280a9190 0x7f572813f010 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f5718002f70 tx=0x7f5718015000).stop 2022-01-10T02:34:52.110 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.103+0000 7f57277fe700 1 -- 172.21.15.36:0/1923817714 reap_dead start 2022-01-10T02:34:52.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.103+0000 7f5727fff700 1 -- 172.21.15.36:0/1923817714 shutdown_connections 2022-01-10T02:34:52.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.103+0000 7f5727fff700 1 -- 172.21.15.36:0/1923817714 >> 172.21.15.36:0/1923817714 conn(0x7f5728061140 msgr2=0x7f5728140ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:52.111 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.103+0000 7f5727fff700 1 -- 172.21.15.36:0/1923817714 shutdown_connections 2022-01-10T02:34:52.112 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.103+0000 7f5727fff700 1 -- 172.21.15.36:0/1923817714 wait complete. 2022-01-10T02:34:52.118 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2022-01-10T02:34:52.226 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.223+0000 7ffb92977700 1 Processor -- start 2022-01-10T02:34:52.227 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.223+0000 7ffb92977700 1 -- start start 2022-01-10T02:34:52.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.223+0000 7ffb92977700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb8c0ad4e0 0x7ffb8c0b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.230 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.223+0000 7ffb92977700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8c0aef90 0x7ffb8c0b1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.223+0000 7ffb92977700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c0b0ab0 con 0x7ffb8c05f6b0 2022-01-10T02:34:52.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.223+0000 7ffb92977700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8c0b0d50 con 0x7ffb8c0ad4e0 2022-01-10T02:34:52.231 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.223+0000 7ffb92977700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0ae850 con 0x7ffb8c0aef90 2022-01-10T02:34:52.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb92176700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7ffb8c05f6b0 0x7ffb8c05fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:41412/0 (socket says 172.21.15.36:41412) 2022-01-10T02:34:52.232 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb92176700 1 -- 172.21.15.36:0/288438140 learned_addr learned my addr 172.21.15.36:0/288438140 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T02:34:52.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb91174700 1 --2- 172.21.15.36:0/288438140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8c0aef90 0x7ffb8c0b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb91975700 1 --2- 172.21.15.36:0/288438140 >> v2:172.21.15.59:3300/0 conn(0x7ffb8c0ad4e0 0x7ffb8c0b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.233 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb90973700 1 -- 172.21.15.36:0/288438140 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090435840 0 0) 0x7ffb8c0b0ab0 con 0x7ffb8c05f6b0 2022-01-10T02:34:52.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb90973700 1 -- 172.21.15.36:0/288438140 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb74003260 con 0x7ffb8c05f6b0 2022-01-10T02:34:52.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb91174700 1 -- 172.21.15.36:0/288438140 >> v2:172.21.15.59:3300/0 conn(0x7ffb8c0ad4e0 msgr2=0x7ffb8c0b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:52.234 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb91174700 1 --2- 172.21.15.36:0/288438140 >> v2:172.21.15.59:3300/0 conn(0x7ffb8c0ad4e0 0x7ffb8c0b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb91174700 1 -- 172.21.15.36:0/288438140 >> v1:172.21.15.36:6789/0 conn(0x7ffb8c05f6b0 legacy=0x7ffb8c05fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb91174700 1 -- 172.21.15.36:0/288438140 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0aeaf0 con 0x7ffb8c0aef90 2022-01-10T02:34:52.235 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb91174700 1 --2- 172.21.15.36:0/288438140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8c0aef90 0x7ffb8c0b1110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7ffb880032f0 tx=0x7ffb880091d0).ready entity=mon.2 client_cookie=842ba9bc8c7cd91b server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb90973700 1 -- 172.21.15.36:0/288438140 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb8800b600 con 0x7ffb8c0aef90 2022-01-10T02:34:52.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb90973700 1 -- 172.21.15.36:0/288438140 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8800b760 con 0x7ffb8c0aef90 2022-01-10T02:34:52.236 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb90973700 1 -- 172.21.15.36:0/288438140 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb8800b8d0 con 0x7ffb8c0aef90 2022-01-10T02:34:52.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb92977700 1 -- 172.21.15.36:0/288438140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8c0aef90 msgr2=0x7ffb8c0b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb92977700 1 --2- 172.21.15.36:0/288438140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8c0aef90 0x7ffb8c0b1110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7ffb880032f0 tx=0x7ffb880091d0).stop 2022-01-10T02:34:52.237 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb92977700 1 -- 172.21.15.36:0/288438140 shutdown_connections 2022-01-10T02:34:52.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb92977700 1 --2- 172.21.15.36:0/288438140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8c0aef90 0x7ffb8c0b1110 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb92977700 1 --2- 172.21.15.36:0/288438140 >> v2:172.21.15.59:3300/0 conn(0x7ffb8c0ad4e0 0x7ffb8c0b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.238 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb92977700 1 -- 172.21.15.36:0/288438140 >> 172.21.15.36:0/288438140 conn(0x7ffb8c0611d0 msgr2=0x7ffb8c062df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:52.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb92977700 1 -- 172.21.15.36:0/288438140 shutdown_connections 2022-01-10T02:34:52.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb92977700 1 -- 172.21.15.36:0/288438140 wait complete. 2022-01-10T02:34:52.239 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb92977700 1 Processor -- start 2022-01-10T02:34:52.240 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.227+0000 7ffb92977700 1 -- start start 2022-01-10T02:34:52.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb92977700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb8c05f6b0 0x7ffb8c142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb92977700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8c0ad4e0 0x7ffb8c1598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.243 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb92977700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8c0aef90 0x7ffb8c156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb92977700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0a9ba0 con 0x7ffb8c05f6b0 2022-01-10T02:34:52.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb92977700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0a9e40 con 0x7ffb8c0ad4e0 2022-01-10T02:34:52.244 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb92977700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c156450 con 0x7ffb8c0aef90 2022-01-10T02:34:52.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb91975700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb8c05f6b0 0x7ffb8c142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb91975700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb8c05f6b0 0x7ffb8c142310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43620/0 (socket says 172.21.15.36:43620) 2022-01-10T02:34:52.245 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb91975700 1 -- 172.21.15.36:0/4096514471 learned_addr learned my addr 172.21.15.36:0/4096514471 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:52.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb92176700 1 --2- 172.21.15.36:0/4096514471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8c0aef90 0x7ffb8c156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb91174700 1 --2- 172.21.15.36:0/4096514471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8c0ad4e0 0x7ffb8c1598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.246 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb91975700 1 -- 172.21.15.36:0/4096514471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8c0aef90 msgr2=0x7ffb8c156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb91975700 1 --2- 172.21.15.36:0/4096514471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8c0aef90 0x7ffb8c156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb91975700 1 -- 172.21.15.36:0/4096514471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8c0ad4e0 msgr2=0x7ffb8c1598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.247 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb91975700 1 --2- 172.21.15.36:0/4096514471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8c0ad4e0 0x7ffb8c1598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb91975700 1 -- 172.21.15.36:0/4096514471 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb88009470 con 0x7ffb8c05f6b0 2022-01-10T02:34:52.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb91975700 1 --2- 172.21.15.36:0/4096514471 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb8c05f6b0 0x7ffb8c142310 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7ffb7c00c000 tx=0x7ffb7c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.248 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb7affd700 1 -- 172.21.15.36:0/4096514471 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb7c010780 con 0x7ffb8c05f6b0 2022-01-10T02:34:52.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb7affd700 1 -- 172.21.15.36:0/4096514471 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c0108e0 con 0x7ffb8c05f6b0 2022-01-10T02:34:52.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb92977700 1 -- 172.21.15.36:0/4096514471 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8c1566f0 con 0x7ffb8c05f6b0 2022-01-10T02:34:52.249 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb7affd700 1 -- 172.21.15.36:0/4096514471 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb7c010c40 con 0x7ffb8c05f6b0 2022-01-10T02:34:52.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb92977700 1 -- 172.21.15.36:0/4096514471 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8c0a9820 con 0x7ffb8c05f6b0 2022-01-10T02:34:52.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb7affd700 1 -- 172.21.15.36:0/4096514471 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7ffb7c01c460 con 0x7ffb8c05f6b0 2022-01-10T02:34:52.250 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.231+0000 7ffb92977700 1 -- 172.21.15.36:0/4096514471 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8c156880 con 0x7ffb8c05f6b0 2022-01-10T02:34:52.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.235+0000 7ffb7affd700 1 --2- 172.21.15.36:0/4096514471 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffb6c0535f0 0x7ffb6c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.235+0000 7ffb7affd700 1 -- 172.21.15.36:0/4096514471 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7ffb7c06bc10 con 0x7ffb8c05f6b0 2022-01-10T02:34:52.251 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.235+0000 7ffb91174700 1 --2- 172.21.15.36:0/4096514471 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffb6c0535f0 0x7ffb6c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.235+0000 7ffb91174700 1 --2- 172.21.15.36:0/4096514471 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffb6c0535f0 0x7ffb6c055ab0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7ffb8801c000 tx=0x7ffb88016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.252 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.239+0000 7ffb7affd700 1 -- 172.21.15.36:0/4096514471 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7ffb7c042d90 con 0x7ffb8c05f6b0 2022-01-10T02:34:52.368 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.367+0000 7ffb92977700 1 -- 172.21.15.36:0/4096514471 --> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb8c0b3350 con 0x7ffb6c0535f0 2022-01-10T02:34:52.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.367+0000 7ffb7affd700 1 -- 172.21.15.36:0/4096514471 <== mgr.4101 v2:172.21.15.36:6800/14596 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ffb8c0b3350 con 0x7ffb6c0535f0 2022-01-10T02:34:52.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.371+0000 7ffb92977700 1 -- 172.21.15.36:0/4096514471 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffb6c0535f0 msgr2=0x7ffb6c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.371+0000 7ffb92977700 1 --2- 172.21.15.36:0/4096514471 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffb6c0535f0 0x7ffb6c055ab0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7ffb8801c000 tx=0x7ffb88016000).stop 2022-01-10T02:34:52.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.371+0000 7ffb92977700 1 -- 172.21.15.36:0/4096514471 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb8c05f6b0 msgr2=0x7ffb8c142310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.371+0000 7ffb92977700 1 --2- 172.21.15.36:0/4096514471 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb8c05f6b0 0x7ffb8c142310 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7ffb7c00c000 tx=0x7ffb7c006df0).stop 2022-01-10T02:34:52.374 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.371+0000 7ffb92977700 1 -- 172.21.15.36:0/4096514471 shutdown_connections 2022-01-10T02:34:52.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.371+0000 7ffb92977700 1 --2- 172.21.15.36:0/4096514471 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7ffb6c0535f0 0x7ffb6c055ab0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.371+0000 7ffb92977700 1 --2- 172.21.15.36:0/4096514471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8c0aef90 0x7ffb8c156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.375 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.371+0000 7ffb92977700 1 --2- 172.21.15.36:0/4096514471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8c0ad4e0 0x7ffb8c1598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.371+0000 7ffb92977700 1 --2- 172.21.15.36:0/4096514471 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7ffb8c05f6b0 0x7ffb8c142310 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.371+0000 7ffb92977700 1 -- 172.21.15.36:0/4096514471 >> 172.21.15.36:0/4096514471 conn(0x7ffb8c0611d0 msgr2=0x7ffb8c05bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:52.376 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.371+0000 7ffb92977700 1 -- 172.21.15.36:0/4096514471 shutdown_connections 2022-01-10T02:34:52.377 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.371+0000 7ffb92977700 1 -- 172.21.15.36:0/4096514471 wait complete. 2022-01-10T02:34:52.377 INFO:teuthology.orchestra.run.smithi036.stderr:instructed osd(s) 2 to deep-scrub 2022-01-10T02:34:52.388 INFO:tasks.ceph:Scrubbing osd.3 2022-01-10T02:34:52.389 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2022-01-10T02:34:52.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9623fff700 1 Processor -- start 2022-01-10T02:34:52.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9623fff700 1 -- start start 2022-01-10T02:34:52.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9623fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96240b0010 0x7f96240a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9623fff700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96240a70c0 con 0x7f96240b2580 2022-01-10T02:34:52.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9623fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96240a72f0 con 0x7f96240afbd0 2022-01-10T02:34:52.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9623fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96240a7590 con 0x7f96240b0010 2022-01-10T02:34:52.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9622ffd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f96240b2580 0x7f962414ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:41422/0 (socket says 172.21.15.36:41422) 2022-01-10T02:34:52.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9622ffd700 1 -- 172.21.15.36:0/22973450 learned_addr learned my addr 172.21.15.36:0/22973450 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T02:34:52.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f96227fc700 1 --2- 172.21.15.36:0/22973450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96240b0010 0x7f96240a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9621ffb700 1 -- 172.21.15.36:0/22973450 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907095878 0 0) 0x7f96240a72f0 con 0x7f96240afbd0 2022-01-10T02:34:52.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9621ffb700 1 -- 172.21.15.36:0/22973450 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9604003260 con 0x7f96240afbd0 2022-01-10T02:34:52.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9621ffb700 1 -- 172.21.15.36:0/22973450 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032485488 0 0) 0x7f96240a70c0 con 0x7f96240b2580 2022-01-10T02:34:52.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9621ffb700 1 -- 172.21.15.36:0/22973450 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96240a72f0 con 0x7f96240b2580 2022-01-10T02:34:52.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f96227fc700 1 -- 172.21.15.36:0/22973450 >> v1:172.21.15.59:6789/0 conn(0x7f96240afbd0 legacy=0x7f9624151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f96227fc700 1 -- 172.21.15.36:0/22973450 >> v1:172.21.15.36:6789/0 conn(0x7f96240b2580 legacy=0x7f962414ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f96227fc700 1 -- 172.21.15.36:0/22973450 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96240a7830 con 0x7f96240b0010 2022-01-10T02:34:52.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f96227fc700 1 --2- 172.21.15.36:0/22973450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96240b0010 0x7f96240a83b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f96140032f0 tx=0x7f96140091d0).ready entity=mon.2 client_cookie=3f4e3cddd5c3f668 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9621ffb700 1 -- 172.21.15.36:0/22973450 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f961400b640 con 0x7f96240b0010 2022-01-10T02:34:52.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9621ffb700 1 -- 172.21.15.36:0/22973450 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961400b7a0 con 0x7f96240b0010 2022-01-10T02:34:52.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.499+0000 7f9621ffb700 1 -- 172.21.15.36:0/22973450 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f961400b910 con 0x7f96240b0010 2022-01-10T02:34:52.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 -- 172.21.15.36:0/22973450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96240b0010 msgr2=0x7f96240a83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.513 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 --2- 172.21.15.36:0/22973450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96240b0010 0x7f96240a83b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f96140032f0 tx=0x7f96140091d0).stop 2022-01-10T02:34:52.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 -- 172.21.15.36:0/22973450 shutdown_connections 2022-01-10T02:34:52.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 --2- 172.21.15.36:0/22973450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96240b0010 0x7f96240a83b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.514 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 -- 172.21.15.36:0/22973450 >> 172.21.15.36:0/22973450 conn(0x7f9624060180 msgr2=0x7f96240b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:52.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 -- 172.21.15.36:0/22973450 shutdown_connections 2022-01-10T02:34:52.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 -- 172.21.15.36:0/22973450 wait complete. 2022-01-10T02:34:52.515 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 Processor -- start 2022-01-10T02:34:52.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 -- start start 2022-01-10T02:34:52.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96240afbd0 0x7f96240a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.516 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96240b0010 0x7f96240af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96240b2580 0x7f96240ab070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96240b6090 con 0x7f96240b0010 2022-01-10T02:34:52.517 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96240a9140 con 0x7f96240b2580 2022-01-10T02:34:52.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9623fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96240b59c0 con 0x7f96240afbd0 2022-01-10T02:34:52.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f96227fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96240b0010 0x7f96240af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f96227fc700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96240b0010 0x7f96240af040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43636/0 (socket says 172.21.15.36:43636) 2022-01-10T02:34:52.518 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f96227fc700 1 -- 172.21.15.36:0/2767534306 learned_addr learned my addr 172.21.15.36:0/2767534306 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:52.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f9622ffd700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96240afbd0 0x7f96240a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.503+0000 7f96237fe700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96240b2580 0x7f96240ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.519 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f96227fc700 1 -- 172.21.15.36:0/2767534306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96240afbd0 msgr2=0x7f96240a9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f96227fc700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96240afbd0 0x7f96240a9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f96227fc700 1 -- 172.21.15.36:0/2767534306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96240b2580 msgr2=0x7f96240ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.520 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f96227fc700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96240b2580 0x7f96240ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f96227fc700 1 -- 172.21.15.36:0/2767534306 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9614009470 con 0x7f96240b0010 2022-01-10T02:34:52.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f96237fe700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96240b2580 0x7f96240ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T02:34:52.521 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f96227fc700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96240b0010 0x7f96240af040 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f96140032f0 tx=0x7f9614016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f961bfff700 1 -- 172.21.15.36:0/2767534306 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f961400b910 con 0x7f96240b0010 2022-01-10T02:34:52.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f961bfff700 1 -- 172.21.15.36:0/2767534306 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961401f3f0 con 0x7f96240b0010 2022-01-10T02:34:52.522 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f9623fff700 1 -- 172.21.15.36:0/2767534306 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962414ce00 con 0x7f96240b0010 2022-01-10T02:34:52.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f961bfff700 1 -- 172.21.15.36:0/2767534306 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f961400b640 con 0x7f96240b0010 2022-01-10T02:34:52.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f9623fff700 1 -- 172.21.15.36:0/2767534306 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96240a9610 con 0x7f96240b0010 2022-01-10T02:34:52.523 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f961bfff700 1 -- 172.21.15.36:0/2767534306 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f961400f070 con 0x7f96240b0010 2022-01-10T02:34:52.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f9623fff700 1 -- 172.21.15.36:0/2767534306 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9624057350 con 0x7f96240b0010 2022-01-10T02:34:52.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f961bfff700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96080536b0 0x7f9608055b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.524 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f961bfff700 1 -- 172.21.15.36:0/2767534306 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f961406bec0 con 0x7f96240b0010 2022-01-10T02:34:52.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f9622ffd700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96080536b0 0x7f9608055b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f961bfff700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.36:6811/14836,v1:172.21.15.36:6813/14836] conn(0x7f960805a440 0x7f960805c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.525 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.507+0000 7f961bfff700 1 -- 172.21.15.36:0/2767534306 --> [v2:172.21.15.36:6811/14836,v1:172.21.15.36:6813/14836] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f960805ce20 con 0x7f960805a440 2022-01-10T02:34:52.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.511+0000 7f961bfff700 1 -- 172.21.15.36:0/2767534306 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96140431c0 con 0x7f96240b0010 2022-01-10T02:34:52.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.511+0000 7f96237fe700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.36:6811/14836,v1:172.21.15.36:6813/14836] conn(0x7f960805a440 0x7f960805c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.526 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.511+0000 7f9622ffd700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96080536b0 0x7f9608055b70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f960c00d000 tx=0x7f960c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.511+0000 7f96237fe700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.36:6811/14836,v1:172.21.15.36:6813/14836] conn(0x7f960805a440 0x7f960805c860 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.527 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.511+0000 7f961bfff700 1 -- 172.21.15.36:0/2767534306 <== osd.3 v2:172.21.15.36:6811/14836 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f960805ce20 con 0x7f960805a440 2022-01-10T02:34:52.533 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.531+0000 7f9623fff700 1 -- 172.21.15.36:0/2767534306 --> [v2:172.21.15.36:6811/14836,v1:172.21.15.36:6813/14836] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f96240b35e0 con 0x7f960805a440 2022-01-10T02:34:52.534 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.531+0000 7f961bfff700 1 -- 172.21.15.36:0/2767534306 <== osd.3 v2:172.21.15.36:6811/14836 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f96240b35e0 con 0x7f960805a440 2022-01-10T02:34:52.535 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T02:34:52.535 INFO:teuthology.orchestra.run.smithi036.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-01-10T02:34:52.535 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T02:34:52.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.531+0000 7f9623fff700 1 -- 172.21.15.36:0/2767534306 >> [v2:172.21.15.36:6811/14836,v1:172.21.15.36:6813/14836] conn(0x7f960805a440 msgr2=0x7f960805c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.537 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.531+0000 7f9623fff700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.36:6811/14836,v1:172.21.15.36:6813/14836] conn(0x7f960805a440 0x7f960805c860 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.531+0000 7f9623fff700 1 -- 172.21.15.36:0/2767534306 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96080536b0 msgr2=0x7f9608055b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.531+0000 7f9623fff700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96080536b0 0x7f9608055b70 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f960c00d000 tx=0x7f960c009040).stop 2022-01-10T02:34:52.538 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.531+0000 7f9623fff700 1 -- 172.21.15.36:0/2767534306 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96240b0010 msgr2=0x7f96240af040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.531+0000 7f9623fff700 1 --2- 172.21.15.36:0/2767534306 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96240b0010 0x7f96240af040 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f96140032f0 tx=0x7f9614016000).stop 2022-01-10T02:34:52.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.531+0000 7f96237fe700 1 -- 172.21.15.36:0/2767534306 reap_dead start 2022-01-10T02:34:52.539 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.531+0000 7f9623fff700 1 -- 172.21.15.36:0/2767534306 shutdown_connections 2022-01-10T02:34:52.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.531+0000 7f9623fff700 1 -- 172.21.15.36:0/2767534306 >> 172.21.15.36:0/2767534306 conn(0x7f9624060180 msgr2=0x7f9624149730 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:52.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.535+0000 7f9623fff700 1 -- 172.21.15.36:0/2767534306 shutdown_connections 2022-01-10T02:34:52.540 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.535+0000 7f9623fff700 1 -- 172.21.15.36:0/2767534306 wait complete. 2022-01-10T02:34:52.546 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2022-01-10T02:34:52.653 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.651+0000 7f5dea982700 1 Processor -- start 2022-01-10T02:34:52.654 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.651+0000 7f5dea982700 1 -- start start 2022-01-10T02:34:52.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.651+0000 7f5dea982700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5de4148860 0x7f5de414ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.656 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.651+0000 7f5dea982700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de4066ea0 con 0x7f5de40b3040 2022-01-10T02:34:52.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.651+0000 7f5dea982700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de40b3420 con 0x7f5de40a9c10 2022-01-10T02:34:52.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.651+0000 7f5dea982700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de40648e0 con 0x7f5de4148860 2022-01-10T02:34:52.657 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5de9980700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f5de40b3040 0x7f5de4065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:41438/0 (socket says 172.21.15.36:41438) 2022-01-10T02:34:52.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5de9980700 1 -- 172.21.15.36:0/1810196108 learned_addr learned my addr 172.21.15.36:0/1810196108 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T02:34:52.658 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5dea181700 1 --2- 172.21.15.36:0/1810196108 >> v2:172.21.15.59:3300/0 conn(0x7f5de4148860 0x7f5de414ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5de897e700 1 -- 172.21.15.36:0/1810196108 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804253593 0 0) 0x7f5de4066ea0 con 0x7f5de40b3040 2022-01-10T02:34:52.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5de897e700 1 -- 172.21.15.36:0/1810196108 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dcc003260 con 0x7f5de40b3040 2022-01-10T02:34:52.659 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5dea181700 1 -- 172.21.15.36:0/1810196108 >> v1:172.21.15.59:6789/0 conn(0x7f5de40a9c10 legacy=0x7f5de40607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5dea181700 1 -- 172.21.15.36:0/1810196108 >> v1:172.21.15.36:6789/0 conn(0x7f5de40b3040 legacy=0x7f5de4065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5dea181700 1 -- 172.21.15.36:0/1810196108 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de4066960 con 0x7f5de4148860 2022-01-10T02:34:52.660 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5dea181700 1 --2- 172.21.15.36:0/1810196108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5de4148860 0x7f5de414ac50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f5ddc0032f0 tx=0x7f5ddc0091d0).ready entity=mon.1 client_cookie=9ce604a70ee17b67 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5de897e700 1 -- 172.21.15.36:0/1810196108 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ddc00b6c0 con 0x7f5de4148860 2022-01-10T02:34:52.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5de897e700 1 -- 172.21.15.36:0/1810196108 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc00b820 con 0x7f5de4148860 2022-01-10T02:34:52.661 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5de897e700 1 -- 172.21.15.36:0/1810196108 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ddc00b990 con 0x7f5de4148860 2022-01-10T02:34:52.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5dea982700 1 -- 172.21.15.36:0/1810196108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5de4148860 msgr2=0x7f5de414ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5dea982700 1 --2- 172.21.15.36:0/1810196108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5de4148860 0x7f5de414ac50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f5ddc0032f0 tx=0x7f5ddc0091d0).stop 2022-01-10T02:34:52.665 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5dea982700 1 -- 172.21.15.36:0/1810196108 shutdown_connections 2022-01-10T02:34:52.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5dea982700 1 --2- 172.21.15.36:0/1810196108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5de4148860 0x7f5de414ac50 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5dea982700 1 -- 172.21.15.36:0/1810196108 >> 172.21.15.36:0/1810196108 conn(0x7f5de40636e0 msgr2=0x7f5de4063af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:52.666 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5dea982700 1 -- 172.21.15.36:0/1810196108 shutdown_connections 2022-01-10T02:34:52.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.655+0000 7f5dea982700 1 -- 172.21.15.36:0/1810196108 wait complete. 2022-01-10T02:34:52.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.659+0000 7f5dea982700 1 Processor -- start 2022-01-10T02:34:52.667 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.659+0000 7f5dea982700 1 -- start start 2022-01-10T02:34:52.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.659+0000 7f5dea982700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5de40a9c10 0x7f5de405f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.659+0000 7f5dea982700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5de40b3040 0x7f5de4153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.668 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.659+0000 7f5dea982700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5de4148860 0x7f5de4152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.659+0000 7f5dea982700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4153900 con 0x7f5de4148860 2022-01-10T02:34:52.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.659+0000 7f5dea982700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de40ada70 con 0x7f5de40a9c10 2022-01-10T02:34:52.669 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.659+0000 7f5dea982700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de41524a0 con 0x7f5de40b3040 2022-01-10T02:34:52.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.659+0000 7f5dea181700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5de4148860 0x7f5de4152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.659+0000 7f5dea181700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5de4148860 0x7f5de4152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43654/0 (socket says 172.21.15.36:43654) 2022-01-10T02:34:52.670 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.659+0000 7f5dea181700 1 -- 172.21.15.36:0/1219526425 learned_addr learned my addr 172.21.15.36:0/1219526425 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:52.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.659+0000 7f5de917f700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5de40b3040 0x7f5de4153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.659+0000 7f5de9980700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5de40a9c10 0x7f5de405f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.671 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dea181700 1 -- 172.21.15.36:0/1219526425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5de40b3040 msgr2=0x7f5de4153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dea181700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5de40b3040 0x7f5de4153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dea181700 1 -- 172.21.15.36:0/1219526425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5de40a9c10 msgr2=0x7f5de405f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.672 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dea181700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5de40a9c10 0x7f5de405f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dea181700 1 -- 172.21.15.36:0/1219526425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc009470 con 0x7f5de4148860 2022-01-10T02:34:52.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5de917f700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5de40b3040 0x7f5de4153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T02:34:52.673 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dea181700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5de4148860 0x7f5de4152be0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f5ddc0032f0 tx=0x7f5ddc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dd2ffd700 1 -- 172.21.15.36:0/1219526425 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ddc011d70 con 0x7f5de4148860 2022-01-10T02:34:52.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dd2ffd700 1 -- 172.21.15.36:0/1219526425 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc021440 con 0x7f5de4148860 2022-01-10T02:34:52.674 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dd2ffd700 1 -- 172.21.15.36:0/1219526425 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ddc0217a0 con 0x7f5de4148860 2022-01-10T02:34:52.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dea982700 1 -- 172.21.15.36:0/1219526425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de4152740 con 0x7f5de4148860 2022-01-10T02:34:52.675 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dea982700 1 -- 172.21.15.36:0/1219526425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de41530d0 con 0x7f5de4148860 2022-01-10T02:34:52.676 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dd2ffd700 1 -- 172.21.15.36:0/1219526425 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f5ddc027020 con 0x7f5de4148860 2022-01-10T02:34:52.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dea982700 1 -- 172.21.15.36:0/1219526425 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de41528d0 con 0x7f5de4148860 2022-01-10T02:34:52.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dd2ffd700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5dc4053680 0x7f5dc4055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.677 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5dd2ffd700 1 -- 172.21.15.36:0/1219526425 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f5ddc06cb40 con 0x7f5de4148860 2022-01-10T02:34:52.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.663+0000 7f5de9980700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5dc4053680 0x7f5dc4055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.667+0000 7f5de9980700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5dc4053680 0x7f5dc4055b40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f5de000d000 tx=0x7f5de0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.678 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.671+0000 7f5dd2ffd700 1 -- 172.21.15.36:0/1219526425 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f5ddc043d20 con 0x7f5de4148860 2022-01-10T02:34:52.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.795+0000 7f5dea982700 1 -- 172.21.15.36:0/1219526425 --> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5de4066c00 con 0x7f5dc4053680 2022-01-10T02:34:52.799 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.799+0000 7f5dd2ffd700 1 -- 172.21.15.36:0/1219526425 <== mgr.4101 v2:172.21.15.36:6800/14596 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5de4066c00 con 0x7f5dc4053680 2022-01-10T02:34:52.802 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.799+0000 7f5dea982700 1 -- 172.21.15.36:0/1219526425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5dc4053680 msgr2=0x7f5dc4055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.799+0000 7f5dea982700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5dc4053680 0x7f5dc4055b40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f5de000d000 tx=0x7f5de0009040).stop 2022-01-10T02:34:52.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.799+0000 7f5dea982700 1 -- 172.21.15.36:0/1219526425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5de4148860 msgr2=0x7f5de4152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.803 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.799+0000 7f5dea982700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5de4148860 0x7f5de4152be0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f5ddc0032f0 tx=0x7f5ddc016000).stop 2022-01-10T02:34:52.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.799+0000 7f5dea982700 1 -- 172.21.15.36:0/1219526425 shutdown_connections 2022-01-10T02:34:52.804 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.799+0000 7f5dea982700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f5dc4053680 0x7f5dc4055b40 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.799+0000 7f5dea982700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f5de4148860 0x7f5de4152be0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.799+0000 7f5dea982700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5de40b3040 0x7f5de4153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.805 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.799+0000 7f5dea982700 1 --2- 172.21.15.36:0/1219526425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5de40a9c10 0x7f5de405f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.799+0000 7f5dea982700 1 -- 172.21.15.36:0/1219526425 >> 172.21.15.36:0/1219526425 conn(0x7f5de40636e0 msgr2=0x7f5de413d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:52.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.799+0000 7f5dea982700 1 -- 172.21.15.36:0/1219526425 shutdown_connections 2022-01-10T02:34:52.806 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.799+0000 7f5dea982700 1 -- 172.21.15.36:0/1219526425 wait complete. 2022-01-10T02:34:52.807 INFO:teuthology.orchestra.run.smithi036.stderr:instructed osd(s) 3 to deep-scrub 2022-01-10T02:34:52.817 INFO:tasks.ceph:Scrubbing osd.4 2022-01-10T02:34:52.818 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2022-01-10T02:34:52.924 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed98ba7700 1 Processor -- start 2022-01-10T02:34:52.925 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed98ba7700 1 -- start start 2022-01-10T02:34:52.926 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed98ba7700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fed940b0fd0 0x7fed94144720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed98ba7700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed940b0350 con 0x7fed941483a0 2022-01-10T02:34:52.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed98ba7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed940b05f0 con 0x7fed940b1db0 2022-01-10T02:34:52.927 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed98ba7700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed940a90c0 con 0x7fed940b0fd0 2022-01-10T02:34:52.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed92d9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fed940b0fd0 0x7fed94144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed91d9b700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fed941483a0 0x7fed940a70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:41454/0 (socket says 172.21.15.36:41454) 2022-01-10T02:34:52.928 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed91d9b700 1 -- 172.21.15.36:0/2353045519 learned_addr learned my addr 172.21.15.36:0/2353045519 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T02:34:52.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed9159a700 1 -- 172.21.15.36:0/2353045519 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973101679 0 0) 0x7fed940b0350 con 0x7fed941483a0 2022-01-10T02:34:52.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed9159a700 1 -- 172.21.15.36:0/2353045519 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed74003260 con 0x7fed941483a0 2022-01-10T02:34:52.929 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed92d9d700 1 -- 172.21.15.36:0/2353045519 >> v1:172.21.15.59:6789/0 conn(0x7fed940b1db0 legacy=0x7fed940b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed92d9d700 1 -- 172.21.15.36:0/2353045519 >> v1:172.21.15.36:6789/0 conn(0x7fed941483a0 legacy=0x7fed940a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed92d9d700 1 -- 172.21.15.36:0/2353045519 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed940b0890 con 0x7fed940b0fd0 2022-01-10T02:34:52.930 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed92d9d700 1 --2- 172.21.15.36:0/2353045519 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed940b0fd0 0x7fed94144720 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7fed94147730 tx=0x7fed8c006df0).ready entity=mon.0 client_cookie=c3804cc32a61527 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed9159a700 1 -- 172.21.15.36:0/2353045519 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8c00d610 con 0x7fed940b0fd0 2022-01-10T02:34:52.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed9159a700 1 -- 172.21.15.36:0/2353045519 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c000e90 con 0x7fed940b0fd0 2022-01-10T02:34:52.931 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.923+0000 7fed9159a700 1 -- 172.21.15.36:0/2353045519 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8c00d960 con 0x7fed940b0fd0 2022-01-10T02:34:52.935 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 -- 172.21.15.36:0/2353045519 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed940b0fd0 msgr2=0x7fed94144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 --2- 172.21.15.36:0/2353045519 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed940b0fd0 0x7fed94144720 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7fed94147730 tx=0x7fed8c006df0).stop 2022-01-10T02:34:52.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 -- 172.21.15.36:0/2353045519 shutdown_connections 2022-01-10T02:34:52.936 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 --2- 172.21.15.36:0/2353045519 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed940b0fd0 0x7fed94144720 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 -- 172.21.15.36:0/2353045519 >> 172.21.15.36:0/2353045519 conn(0x7fed9405f6b0 msgr2=0x7fed9405fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:52.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 -- 172.21.15.36:0/2353045519 shutdown_connections 2022-01-10T02:34:52.937 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 -- 172.21.15.36:0/2353045519 wait complete. 2022-01-10T02:34:52.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 Processor -- start 2022-01-10T02:34:52.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 -- start start 2022-01-10T02:34:52.938 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed940b0fd0 0x7fed9414a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed940b1db0 0x7fed9414ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed941483a0 0x7fed9414aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.939 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed94148a00 con 0x7fed940b0fd0 2022-01-10T02:34:52.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed94148c60 con 0x7fed940b1db0 2022-01-10T02:34:52.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed98ba7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed940ade10 con 0x7fed941483a0 2022-01-10T02:34:52.940 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed9259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed940b0fd0 0x7fed9414a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed9259c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed940b0fd0 0x7fed9414a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43664/0 (socket says 172.21.15.36:43664) 2022-01-10T02:34:52.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed9259c700 1 -- 172.21.15.36:0/2726245721 learned_addr learned my addr 172.21.15.36:0/2726245721 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:52.941 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed91d9b700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed940b1db0 0x7fed9414ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed92d9d700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed941483a0 0x7fed9414aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed9259c700 1 -- 172.21.15.36:0/2726245721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed941483a0 msgr2=0x7fed9414aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.942 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed9259c700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed941483a0 0x7fed9414aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed9259c700 1 -- 172.21.15.36:0/2726245721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed940b1db0 msgr2=0x7fed9414ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed9259c700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed940b1db0 0x7fed9414ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.943 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed9259c700 1 -- 172.21.15.36:0/2726245721 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c00b180 con 0x7fed940b0fd0 2022-01-10T02:34:52.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed92d9d700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed941483a0 0x7fed9414aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T02:34:52.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed91d9b700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed940b1db0 0x7fed9414ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T02:34:52.944 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.927+0000 7fed9259c700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed940b0fd0 0x7fed9414a330 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fed940b3170 tx=0x7fed7c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed8b7fe700 1 -- 172.21.15.36:0/2726245721 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed7c00ce30 con 0x7fed940b0fd0 2022-01-10T02:34:52.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed8b7fe700 1 -- 172.21.15.36:0/2726245721 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c00f470 con 0x7fed940b0fd0 2022-01-10T02:34:52.945 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed98ba7700 1 -- 172.21.15.36:0/2726245721 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9414a820 con 0x7fed940b0fd0 2022-01-10T02:34:52.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed8b7fe700 1 -- 172.21.15.36:0/2726245721 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed7c00f7d0 con 0x7fed940b0fd0 2022-01-10T02:34:52.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed98ba7700 1 -- 172.21.15.36:0/2726245721 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed940acd10 con 0x7fed940b0fd0 2022-01-10T02:34:52.946 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed98ba7700 1 -- 172.21.15.36:0/2726245721 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fed940adc90 con 0x7fed940b0fd0 2022-01-10T02:34:52.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed8b7fe700 1 -- 172.21.15.36:0/2726245721 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fed7c019030 con 0x7fed940b0fd0 2022-01-10T02:34:52.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed8b7fe700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed780535f0 0x7fed78055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.947 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed8b7fe700 1 -- 172.21.15.36:0/2726245721 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fed7c06b340 con 0x7fed940b0fd0 2022-01-10T02:34:52.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed91d9b700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed780535f0 0x7fed78055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed8b7fe700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.59:6800/15004,v1:172.21.15.59:6801/15004] conn(0x7fed7805a380 0x7fed7805c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:52.948 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed8b7fe700 1 -- 172.21.15.36:0/2726245721 --> [v2:172.21.15.59:6800/15004,v1:172.21.15.59:6801/15004] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fed7805cd60 con 0x7fed7805a380 2022-01-10T02:34:52.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed8b7fe700 1 -- 172.21.15.36:0/2726245721 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed7c06b720 con 0x7fed940b0fd0 2022-01-10T02:34:52.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed92d9d700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.59:6800/15004,v1:172.21.15.59:6801/15004] conn(0x7fed7805a380 0x7fed7805c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:52.949 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.931+0000 7fed91d9b700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed780535f0 0x7fed78055ab0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fed8400b000 tx=0x7fed84009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.950 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.935+0000 7fed92d9d700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.59:6800/15004,v1:172.21.15.59:6801/15004] conn(0x7fed7805a380 0x7fed7805c7a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:52.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.935+0000 7fed8b7fe700 1 -- 172.21.15.36:0/2726245721 <== osd.4 v2:172.21.15.59:6800/15004 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fed7805cd60 con 0x7fed7805a380 2022-01-10T02:34:52.951 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.947+0000 7fed98ba7700 1 -- 172.21.15.36:0/2726245721 --> [v2:172.21.15.59:6800/15004,v1:172.21.15.59:6801/15004] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fed940ada70 con 0x7fed7805a380 2022-01-10T02:34:52.952 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.951+0000 7fed8b7fe700 1 -- 172.21.15.36:0/2726245721 <== osd.4 v2:172.21.15.59:6800/15004 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fed940ada70 con 0x7fed7805a380 2022-01-10T02:34:52.952 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T02:34:52.953 INFO:teuthology.orchestra.run.smithi036.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-01-10T02:34:52.953 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T02:34:52.954 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.951+0000 7fed98ba7700 1 -- 172.21.15.36:0/2726245721 >> [v2:172.21.15.59:6800/15004,v1:172.21.15.59:6801/15004] conn(0x7fed7805a380 msgr2=0x7fed7805c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.951+0000 7fed98ba7700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.59:6800/15004,v1:172.21.15.59:6801/15004] conn(0x7fed7805a380 0x7fed7805c7a0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:52.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.951+0000 7fed98ba7700 1 -- 172.21.15.36:0/2726245721 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed780535f0 msgr2=0x7fed78055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.955 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.951+0000 7fed98ba7700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fed780535f0 0x7fed78055ab0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fed8400b000 tx=0x7fed84009040).stop 2022-01-10T02:34:52.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.951+0000 7fed98ba7700 1 -- 172.21.15.36:0/2726245721 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed940b0fd0 msgr2=0x7fed9414a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:52.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.951+0000 7fed98ba7700 1 --2- 172.21.15.36:0/2726245721 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fed940b0fd0 0x7fed9414a330 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7fed940b3170 tx=0x7fed7c007c50).stop 2022-01-10T02:34:52.956 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.951+0000 7fed92d9d700 1 -- 172.21.15.36:0/2726245721 reap_dead start 2022-01-10T02:34:52.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.951+0000 7fed98ba7700 1 -- 172.21.15.36:0/2726245721 shutdown_connections 2022-01-10T02:34:52.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.951+0000 7fed98ba7700 1 -- 172.21.15.36:0/2726245721 >> 172.21.15.36:0/2726245721 conn(0x7fed9405f6b0 msgr2=0x7fed940a70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:52.957 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.951+0000 7fed98ba7700 1 -- 172.21.15.36:0/2726245721 shutdown_connections 2022-01-10T02:34:52.958 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:52.951+0000 7fed98ba7700 1 -- 172.21.15.36:0/2726245721 wait complete. 2022-01-10T02:34:52.963 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2022-01-10T02:34:53.067 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.063+0000 7f1514f53700 1 Processor -- start 2022-01-10T02:34:53.068 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.063+0000 7f1514f53700 1 -- start start 2022-01-10T02:34:53.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f1514f53700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15100b2580 0x7f1510140050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.071 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f1514f53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15100ac6f0 0x7f1510140540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f1514f53700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1510067880 con 0x7f15100b00e0 2022-01-10T02:34:53.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f1514f53700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15100ad5b0 con 0x7f15100b2580 2022-01-10T02:34:53.072 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f1514f53700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1510067b20 con 0x7f15100ac6f0 2022-01-10T02:34:53.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150effd700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f15100b00e0 0x7f1510142e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:41468/0 (socket says 172.21.15.36:41468) 2022-01-10T02:34:53.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150effd700 1 -- 172.21.15.36:0/2771612045 learned_addr learned my addr 172.21.15.36:0/2771612045 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T02:34:53.073 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150f7fe700 1 --2- 172.21.15.36:0/2771612045 >> v2:172.21.15.59:3300/0 conn(0x7f15100b2580 0x7f1510140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150ffff700 1 --2- 172.21.15.36:0/2771612045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15100ac6f0 0x7f1510140540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150e7fc700 1 -- 172.21.15.36:0/2771612045 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912328431 0 0) 0x7f1510067880 con 0x7f15100b00e0 2022-01-10T02:34:53.074 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150e7fc700 1 -- 172.21.15.36:0/2771612045 --> v1:172.21.15.36:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14fc003260 con 0x7f15100b00e0 2022-01-10T02:34:53.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150ffff700 1 -- 172.21.15.36:0/2771612045 >> v2:172.21.15.59:3300/0 conn(0x7f15100b2580 msgr2=0x7f1510140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:53.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150ffff700 1 --2- 172.21.15.36:0/2771612045 >> v2:172.21.15.59:3300/0 conn(0x7f15100b2580 0x7f1510140050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.075 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150ffff700 1 -- 172.21.15.36:0/2771612045 >> v1:172.21.15.36:6789/0 conn(0x7f15100b00e0 legacy=0x7f1510142e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150ffff700 1 -- 172.21.15.36:0/2771612045 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1510146fd0 con 0x7f15100ac6f0 2022-01-10T02:34:53.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150f7fe700 1 --2- 172.21.15.36:0/2771612045 >> v2:172.21.15.59:3300/0 conn(0x7f15100b2580 0x7f1510140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T02:34:53.076 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150ffff700 1 --2- 172.21.15.36:0/2771612045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15100ac6f0 0x7f1510140540 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f15080032f0 tx=0x7f15080091d0).ready entity=mon.2 client_cookie=a7b0b17963e732d2 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150e7fc700 1 -- 172.21.15.36:0/2771612045 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f150800b600 con 0x7f15100ac6f0 2022-01-10T02:34:53.077 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150e7fc700 1 -- 172.21.15.36:0/2771612045 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150800b760 con 0x7f15100ac6f0 2022-01-10T02:34:53.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f150e7fc700 1 -- 172.21.15.36:0/2771612045 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f150800b8d0 con 0x7f15100ac6f0 2022-01-10T02:34:53.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f1514f53700 1 -- 172.21.15.36:0/2771612045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15100ac6f0 msgr2=0x7f1510140540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.078 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f1514f53700 1 --2- 172.21.15.36:0/2771612045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15100ac6f0 0x7f1510140540 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f15080032f0 tx=0x7f15080091d0).stop 2022-01-10T02:34:53.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f1514f53700 1 -- 172.21.15.36:0/2771612045 shutdown_connections 2022-01-10T02:34:53.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f1514f53700 1 --2- 172.21.15.36:0/2771612045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15100ac6f0 0x7f1510140540 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.079 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f1514f53700 1 --2- 172.21.15.36:0/2771612045 >> v2:172.21.15.59:3300/0 conn(0x7f15100b2580 0x7f1510140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f1514f53700 1 -- 172.21.15.36:0/2771612045 >> 172.21.15.36:0/2771612045 conn(0x7f1510060180 msgr2=0x7f15100b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:53.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.067+0000 7f1514f53700 1 -- 172.21.15.36:0/2771612045 shutdown_connections 2022-01-10T02:34:53.080 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f1514f53700 1 -- 172.21.15.36:0/2771612045 wait complete. 2022-01-10T02:34:53.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f1514f53700 1 Processor -- start 2022-01-10T02:34:53.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f1514f53700 1 -- start start 2022-01-10T02:34:53.084 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f1514f53700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15100ac6f0 0x7f15101427f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f1514f53700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15100b00e0 0x7f15100aa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f1514f53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15100b2580 0x7f151013d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.085 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f1514f53700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151009e940 con 0x7f15100ac6f0 2022-01-10T02:34:53.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f1514f53700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15101562e0 con 0x7f15100b00e0 2022-01-10T02:34:53.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f1514f53700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1510156580 con 0x7f15100b2580 2022-01-10T02:34:53.086 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f150f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15100ac6f0 0x7f15101427f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f150f7fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15100ac6f0 0x7f15101427f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43680/0 (socket says 172.21.15.36:43680) 2022-01-10T02:34:53.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f150f7fe700 1 -- 172.21.15.36:0/1515708377 learned_addr learned my addr 172.21.15.36:0/1515708377 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:53.087 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f150effd700 1 --2- 172.21.15.36:0/1515708377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15100b00e0 0x7f15100aa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f150ffff700 1 --2- 172.21.15.36:0/1515708377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15100b2580 0x7f151013d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f150f7fe700 1 -- 172.21.15.36:0/1515708377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15100b2580 msgr2=0x7f151013d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.088 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f150f7fe700 1 --2- 172.21.15.36:0/1515708377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15100b2580 0x7f151013d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f150f7fe700 1 -- 172.21.15.36:0/1515708377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15100b00e0 msgr2=0x7f15100aa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.089 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f150f7fe700 1 --2- 172.21.15.36:0/1515708377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15100b00e0 0x7f15100aa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f150f7fe700 1 -- 172.21.15.36:0/1515708377 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150400b180 con 0x7f15100ac6f0 2022-01-10T02:34:53.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.071+0000 7f150f7fe700 1 --2- 172.21.15.36:0/1515708377 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15100ac6f0 0x7f15101427f0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f150400c000 tx=0x7f1504006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.090 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.075+0000 7f150cff9700 1 -- 172.21.15.36:0/1515708377 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1504010780 con 0x7f15100ac6f0 2022-01-10T02:34:53.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.075+0000 7f150cff9700 1 -- 172.21.15.36:0/1515708377 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15040108e0 con 0x7f15100ac6f0 2022-01-10T02:34:53.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.075+0000 7f1514f53700 1 -- 172.21.15.36:0/1515708377 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1508009470 con 0x7f15100ac6f0 2022-01-10T02:34:53.091 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.075+0000 7f150cff9700 1 -- 172.21.15.36:0/1515708377 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1504010c40 con 0x7f15100ac6f0 2022-01-10T02:34:53.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.075+0000 7f1514f53700 1 -- 172.21.15.36:0/1515708377 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15100aa5c0 con 0x7f15100ac6f0 2022-01-10T02:34:53.092 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.075+0000 7f1514f53700 1 -- 172.21.15.36:0/1515708377 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15101433a0 con 0x7f15100ac6f0 2022-01-10T02:34:53.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.075+0000 7f150cff9700 1 -- 172.21.15.36:0/1515708377 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f150401c460 con 0x7f15100ac6f0 2022-01-10T02:34:53.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.075+0000 7f150cff9700 1 --2- 172.21.15.36:0/1515708377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f14f00535f0 0x7f14f0055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.093 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.075+0000 7f150cff9700 1 -- 172.21.15.36:0/1515708377 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f150406bc00 con 0x7f15100ac6f0 2022-01-10T02:34:53.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.075+0000 7f150effd700 1 --2- 172.21.15.36:0/1515708377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f14f00535f0 0x7f14f0055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.075+0000 7f150effd700 1 --2- 172.21.15.36:0/1515708377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f14f00535f0 0x7f14f0055ab0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f150000d000 tx=0x7f1500009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.094 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.079+0000 7f150cff9700 1 -- 172.21.15.36:0/1515708377 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f1504071020 con 0x7f15100ac6f0 2022-01-10T02:34:53.212 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.211+0000 7f1514f53700 1 -- 172.21.15.36:0/1515708377 --> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1510142550 con 0x7f14f00535f0 2022-01-10T02:34:53.213 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.211+0000 7f150cff9700 1 -- 172.21.15.36:0/1515708377 <== mgr.4101 v2:172.21.15.36:6800/14596 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1510142550 con 0x7f14f00535f0 2022-01-10T02:34:53.215 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.211+0000 7f1514f53700 1 -- 172.21.15.36:0/1515708377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f14f00535f0 msgr2=0x7f14f0055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.211+0000 7f1514f53700 1 --2- 172.21.15.36:0/1515708377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f14f00535f0 0x7f14f0055ab0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f150000d000 tx=0x7f1500009040).stop 2022-01-10T02:34:53.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.215+0000 7f1514f53700 1 -- 172.21.15.36:0/1515708377 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15100ac6f0 msgr2=0x7f15101427f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.216 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.215+0000 7f1514f53700 1 --2- 172.21.15.36:0/1515708377 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15100ac6f0 0x7f15101427f0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f150400c000 tx=0x7f1504006df0).stop 2022-01-10T02:34:53.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.215+0000 7f1514f53700 1 -- 172.21.15.36:0/1515708377 shutdown_connections 2022-01-10T02:34:53.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.215+0000 7f1514f53700 1 --2- 172.21.15.36:0/1515708377 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f14f00535f0 0x7f14f0055ab0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.217 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.215+0000 7f1514f53700 1 --2- 172.21.15.36:0/1515708377 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15100b2580 0x7f151013d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.215+0000 7f1514f53700 1 --2- 172.21.15.36:0/1515708377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15100b00e0 0x7f15100aa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.215+0000 7f1514f53700 1 --2- 172.21.15.36:0/1515708377 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f15100ac6f0 0x7f15101427f0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.218 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.215+0000 7f1514f53700 1 -- 172.21.15.36:0/1515708377 >> 172.21.15.36:0/1515708377 conn(0x7f1510060180 msgr2=0x7f1510140310 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:53.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.215+0000 7f1514f53700 1 -- 172.21.15.36:0/1515708377 shutdown_connections 2022-01-10T02:34:53.219 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.215+0000 7f1514f53700 1 -- 172.21.15.36:0/1515708377 wait complete. 2022-01-10T02:34:53.220 INFO:teuthology.orchestra.run.smithi036.stderr:instructed osd(s) 4 to deep-scrub 2022-01-10T02:34:53.227 INFO:tasks.ceph:Scrubbing osd.5 2022-01-10T02:34:53.227 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2022-01-10T02:34:53.335 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe176c63700 1 Processor -- start 2022-01-10T02:34:53.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe176c63700 1 -- start start 2022-01-10T02:34:53.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe176c63700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe170061320 0x7fe170061700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe176c63700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe1700ad5c0 0x7fe1700b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe176c63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe170140440 0x7fe1701408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe176c63700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1700aecf0 con 0x7fe1700ad5c0 2022-01-10T02:34:53.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe176c63700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1700b6f20 con 0x7fe170061320 2022-01-10T02:34:53.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe176c63700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1700aef20 con 0x7fe170140440 2022-01-10T02:34:53.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe175460700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe1700ad5c0 0x7fe1700b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe175c61700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe170061320 0x7fe170061700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe175460700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fe1700ad5c0 0x7fe1700b9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43692/0 (socket says 172.21.15.36:43692) 2022-01-10T02:34:53.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe175460700 1 -- 172.21.15.36:0/2360675995 learned_addr learned my addr 172.21.15.36:0/2360675995 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:53.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe176462700 1 --2- 172.21.15.36:0/2360675995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe170140440 0x7fe1701408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe175460700 1 -- 172.21.15.36:0/2360675995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe170140440 msgr2=0x7fe1701408f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:53.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe175460700 1 --2- 172.21.15.36:0/2360675995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe170140440 0x7fe1701408f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe175460700 1 -- 172.21.15.36:0/2360675995 >> v2:172.21.15.59:3300/0 conn(0x7fe170061320 msgr2=0x7fe170061700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:53.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe175460700 1 --2- 172.21.15.36:0/2360675995 >> v2:172.21.15.59:3300/0 conn(0x7fe170061320 0x7fe170061700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe175460700 1 -- 172.21.15.36:0/2360675995 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1700af1c0 con 0x7fe1700ad5c0 2022-01-10T02:34:53.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe175c61700 1 --2- 172.21.15.36:0/2360675995 >> v2:172.21.15.59:3300/0 conn(0x7fe170061320 0x7fe170061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T02:34:53.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe175460700 1 --2- 172.21.15.36:0/2360675995 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1700ad5c0 0x7fe1700b9e60 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7fe1700aeba0 tx=0x7fe160006eb0).ready entity=mon.0 client_cookie=2a8594faa5d9eed3 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe174c5f700 1 -- 172.21.15.36:0/2360675995 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe16000e610 con 0x7fe1700ad5c0 2022-01-10T02:34:53.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe174c5f700 1 -- 172.21.15.36:0/2360675995 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe160000e90 con 0x7fe1700ad5c0 2022-01-10T02:34:53.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.335+0000 7fe174c5f700 1 -- 172.21.15.36:0/2360675995 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe16000e9a0 con 0x7fe1700ad5c0 2022-01-10T02:34:53.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 -- 172.21.15.36:0/2360675995 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1700ad5c0 msgr2=0x7fe1700b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 --2- 172.21.15.36:0/2360675995 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1700ad5c0 0x7fe1700b9e60 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7fe1700aeba0 tx=0x7fe160006eb0).stop 2022-01-10T02:34:53.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 -- 172.21.15.36:0/2360675995 shutdown_connections 2022-01-10T02:34:53.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 --2- 172.21.15.36:0/2360675995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe170140440 0x7fe1701408f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.348 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 --2- 172.21.15.36:0/2360675995 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1700ad5c0 0x7fe1700b9e60 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 --2- 172.21.15.36:0/2360675995 >> v2:172.21.15.59:3300/0 conn(0x7fe170061320 0x7fe170061700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 -- 172.21.15.36:0/2360675995 >> 172.21.15.36:0/2360675995 conn(0x7fe170066de0 msgr2=0x7fe1700671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:53.349 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 -- 172.21.15.36:0/2360675995 shutdown_connections 2022-01-10T02:34:53.350 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 -- 172.21.15.36:0/2360675995 wait complete. 2022-01-10T02:34:53.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 Processor -- start 2022-01-10T02:34:53.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 -- start start 2022-01-10T02:34:53.354 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe170061320 0x7fe1700b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1700ad5c0 0x7fe170152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe170140440 0x7fe1700abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.355 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1700b2de0 con 0x7fe1700ad5c0 2022-01-10T02:34:53.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1700b0030 con 0x7fe170140440 2022-01-10T02:34:53.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176c63700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1700af930 con 0x7fe170061320 2022-01-10T02:34:53.356 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe175460700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1700ad5c0 0x7fe170152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe175460700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1700ad5c0 0x7fe170152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43698/0 (socket says 172.21.15.36:43698) 2022-01-10T02:34:53.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176462700 1 --2- 172.21.15.36:0/2671474877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe170140440 0x7fe1700abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.357 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe175460700 1 -- 172.21.15.36:0/2671474877 learned_addr learned my addr 172.21.15.36:0/2671474877 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:53.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe175c61700 1 --2- 172.21.15.36:0/2671474877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe170061320 0x7fe1700b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176462700 1 -- 172.21.15.36:0/2671474877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe170061320 msgr2=0x7fe1700b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.358 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176462700 1 --2- 172.21.15.36:0/2671474877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe170061320 0x7fe1700b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176462700 1 -- 172.21.15.36:0/2671474877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1700ad5c0 msgr2=0x7fe170152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176462700 1 --2- 172.21.15.36:0/2671474877 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fe1700ad5c0 0x7fe170152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.359 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.339+0000 7fe176462700 1 -- 172.21.15.36:0/2671474877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c00b180 con 0x7fe170140440 2022-01-10T02:34:53.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe176462700 1 --2- 172.21.15.36:0/2671474877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe170140440 0x7fe1700abdc0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fe16800c000 tx=0x7fe1680091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe15effd700 1 -- 172.21.15.36:0/2671474877 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe168012600 con 0x7fe170140440 2022-01-10T02:34:53.360 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe15effd700 1 -- 172.21.15.36:0/2671474877 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe168012760 con 0x7fe170140440 2022-01-10T02:34:53.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe15effd700 1 -- 172.21.15.36:0/2671474877 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe168012ac0 con 0x7fe170140440 2022-01-10T02:34:53.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe176c63700 1 -- 172.21.15.36:0/2671474877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16000b1e0 con 0x7fe170140440 2022-01-10T02:34:53.361 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe176c63700 1 -- 172.21.15.36:0/2671474877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1700b0920 con 0x7fe170140440 2022-01-10T02:34:53.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe176c63700 1 -- 172.21.15.36:0/2671474877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe1700afd30 con 0x7fe170140440 2022-01-10T02:34:53.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe15effd700 1 -- 172.21.15.36:0/2671474877 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fe168022070 con 0x7fe170140440 2022-01-10T02:34:53.362 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe15effd700 1 --2- 172.21.15.36:0/2671474877 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe150053500 0x7fe1500559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe15effd700 1 -- 172.21.15.36:0/2671474877 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fe16806bf10 con 0x7fe170140440 2022-01-10T02:34:53.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe175c61700 1 --2- 172.21.15.36:0/2671474877 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe150053500 0x7fe1500559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.363 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe15effd700 1 --2- 172.21.15.36:0/2671474877 >> [v2:172.21.15.59:6816/15003,v1:172.21.15.59:6817/15003] conn(0x7fe15005a330 0x7fe15005c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe15effd700 1 -- 172.21.15.36:0/2671474877 --> [v2:172.21.15.59:6816/15003,v1:172.21.15.59:6817/15003] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe15005cdb0 con 0x7fe15005a330 2022-01-10T02:34:53.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe15effd700 1 -- 172.21.15.36:0/2671474877 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe16806c220 con 0x7fe170140440 2022-01-10T02:34:53.364 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe175460700 1 --2- 172.21.15.36:0/2671474877 >> [v2:172.21.15.59:6816/15003,v1:172.21.15.59:6817/15003] conn(0x7fe15005a330 0x7fe15005c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.343+0000 7fe175c61700 1 --2- 172.21.15.36:0/2671474877 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe150053500 0x7fe1500559c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fe16c00b000 tx=0x7fe16c006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.347+0000 7fe175460700 1 --2- 172.21.15.36:0/2671474877 >> [v2:172.21.15.59:6816/15003,v1:172.21.15.59:6817/15003] conn(0x7fe15005a330 0x7fe15005c750 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.365 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.347+0000 7fe15effd700 1 -- 172.21.15.36:0/2671474877 <== osd.5 v2:172.21.15.59:6816/15003 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fe15005cdb0 con 0x7fe15005a330 2022-01-10T02:34:53.366 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.363+0000 7fe176c63700 1 -- 172.21.15.36:0/2671474877 --> [v2:172.21.15.59:6816/15003,v1:172.21.15.59:6817/15003] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe1700af460 con 0x7fe15005a330 2022-01-10T02:34:53.367 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.363+0000 7fe15effd700 1 -- 172.21.15.36:0/2671474877 <== osd.5 v2:172.21.15.59:6816/15003 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe1700af460 con 0x7fe15005a330 2022-01-10T02:34:53.367 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T02:34:53.368 INFO:teuthology.orchestra.run.smithi036.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-01-10T02:34:53.368 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T02:34:53.369 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.367+0000 7fe176c63700 1 -- 172.21.15.36:0/2671474877 >> [v2:172.21.15.59:6816/15003,v1:172.21.15.59:6817/15003] conn(0x7fe15005a330 msgr2=0x7fe15005c750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.367+0000 7fe176c63700 1 --2- 172.21.15.36:0/2671474877 >> [v2:172.21.15.59:6816/15003,v1:172.21.15.59:6817/15003] conn(0x7fe15005a330 0x7fe15005c750 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.367+0000 7fe176c63700 1 -- 172.21.15.36:0/2671474877 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe150053500 msgr2=0x7fe1500559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.370 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.367+0000 7fe176c63700 1 --2- 172.21.15.36:0/2671474877 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fe150053500 0x7fe1500559c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fe16c00b000 tx=0x7fe16c006df0).stop 2022-01-10T02:34:53.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.367+0000 7fe176c63700 1 -- 172.21.15.36:0/2671474877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe170140440 msgr2=0x7fe1700abdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.371 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.367+0000 7fe176c63700 1 --2- 172.21.15.36:0/2671474877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe170140440 0x7fe1700abdc0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fe16800c000 tx=0x7fe1680091d0).stop 2022-01-10T02:34:53.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.367+0000 7fe176462700 1 -- 172.21.15.36:0/2671474877 reap_dead start 2022-01-10T02:34:53.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.367+0000 7fe176c63700 1 -- 172.21.15.36:0/2671474877 shutdown_connections 2022-01-10T02:34:53.372 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.367+0000 7fe176c63700 1 -- 172.21.15.36:0/2671474877 >> 172.21.15.36:0/2671474877 conn(0x7fe170066de0 msgr2=0x7fe1700671c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:53.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.367+0000 7fe176c63700 1 -- 172.21.15.36:0/2671474877 shutdown_connections 2022-01-10T02:34:53.373 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.367+0000 7fe176c63700 1 -- 172.21.15.36:0/2671474877 wait complete. 2022-01-10T02:34:53.379 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2022-01-10T02:34:53.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.483+0000 7f4b15b57700 1 Processor -- start 2022-01-10T02:34:53.486 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.483+0000 7f4b15b57700 1 -- start start 2022-01-10T02:34:53.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.483+0000 7f4b15b57700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4b100a8ac0 0x7f4b10152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.483+0000 7f4b15b57700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b100a70c0 con 0x7f4b100b0010 2022-01-10T02:34:53.489 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.483+0000 7f4b15b57700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b100a72f0 con 0x7f4b100b2580 2022-01-10T02:34:53.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.483+0000 7f4b15b57700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b100a7590 con 0x7f4b100a8ac0 2022-01-10T02:34:53.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.483+0000 7f4b0ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7f4b100b0010 0x7f4b100a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:41500/0 (socket says 172.21.15.36:41500) 2022-01-10T02:34:53.490 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.483+0000 7f4b15356700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f4b100a8ac0 0x7f4b10152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.483+0000 7f4b0ffff700 1 -- 172.21.15.36:0/2455388668 learned_addr learned my addr 172.21.15.36:0/2455388668 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T02:34:53.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b15356700 1 -- 172.21.15.36:0/2455388668 >> v1:172.21.15.59:6789/0 conn(0x7f4b100b2580 legacy=0x7f4b1014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.491 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b0f7fe700 1 -- 172.21.15.36:0/2455388668 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160798722 0 0) 0x7f4b100a72f0 con 0x7f4b100b2580 2022-01-10T02:34:53.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b15356700 1 -- 172.21.15.36:0/2455388668 >> v1:172.21.15.36:6789/0 conn(0x7f4b100b0010 legacy=0x7f4b100a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b15356700 1 -- 172.21.15.36:0/2455388668 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b100a7830 con 0x7f4b100a8ac0 2022-01-10T02:34:53.492 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b15356700 1 --2- 172.21.15.36:0/2455388668 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b100a8ac0 0x7f4b10152be0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f4af8001110 tx=0x7f4b00006df0).ready entity=mon.0 client_cookie=1881c544fd75afbc server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b0f7fe700 1 -- 172.21.15.36:0/2455388668 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b0000d5c0 con 0x7f4b100a8ac0 2022-01-10T02:34:53.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b0f7fe700 1 -- 172.21.15.36:0/2455388668 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b00000e90 con 0x7f4b100a8ac0 2022-01-10T02:34:53.493 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b0f7fe700 1 -- 172.21.15.36:0/2455388668 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b0000d910 con 0x7f4b100a8ac0 2022-01-10T02:34:53.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b15b57700 1 -- 172.21.15.36:0/2455388668 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b100a8ac0 msgr2=0x7f4b10152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b15b57700 1 --2- 172.21.15.36:0/2455388668 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b100a8ac0 0x7f4b10152be0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f4af8001110 tx=0x7f4b00006df0).stop 2022-01-10T02:34:53.494 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b15b57700 1 -- 172.21.15.36:0/2455388668 shutdown_connections 2022-01-10T02:34:53.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b15b57700 1 --2- 172.21.15.36:0/2455388668 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b100a8ac0 0x7f4b10152be0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b15b57700 1 -- 172.21.15.36:0/2455388668 >> 172.21.15.36:0/2455388668 conn(0x7f4b10060180 msgr2=0x7f4b100b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:53.495 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b15b57700 1 -- 172.21.15.36:0/2455388668 shutdown_connections 2022-01-10T02:34:53.496 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b15b57700 1 -- 172.21.15.36:0/2455388668 wait complete. 2022-01-10T02:34:53.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b15b57700 1 Processor -- start 2022-01-10T02:34:53.499 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.487+0000 7f4b15b57700 1 -- start start 2022-01-10T02:34:53.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b15b57700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b100a8ac0 0x7f4b1011d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b15b57700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b100b0010 0x7f4b1015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.500 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b15b57700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b100b2580 0x7f4b10063f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b15b57700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100b2eb0 con 0x7f4b100b0010 2022-01-10T02:34:53.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b15b57700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100b3410 con 0x7f4b100a8ac0 2022-01-10T02:34:53.501 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b15b57700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b10067280 con 0x7f4b100b2580 2022-01-10T02:34:53.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b0ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b100b0010 0x7f4b1015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b0ffff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b100b0010 0x7f4b1015a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43712/0 (socket says 172.21.15.36:43712) 2022-01-10T02:34:53.502 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b0ffff700 1 -- 172.21.15.36:0/2762769784 learned_addr learned my addr 172.21.15.36:0/2762769784 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:53.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b14b55700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b100a8ac0 0x7f4b1011d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b15356700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b100b2580 0x7f4b10063f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.503 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b0ffff700 1 -- 172.21.15.36:0/2762769784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b100b2580 msgr2=0x7f4b10063f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b0ffff700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b100b2580 0x7f4b10063f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b0ffff700 1 -- 172.21.15.36:0/2762769784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b100a8ac0 msgr2=0x7f4b1011d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.504 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b0ffff700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b100a8ac0 0x7f4b1011d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b0ffff700 1 -- 172.21.15.36:0/2762769784 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0000b180 con 0x7f4b100b0010 2022-01-10T02:34:53.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b15356700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b100b2580 0x7f4b10063f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T02:34:53.505 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b0ffff700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b100b0010 0x7f4b1015a380 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f4af80011d0 tx=0x7f4af8007b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b0dffb700 1 -- 172.21.15.36:0/2762769784 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4af80072e0 con 0x7f4b100b0010 2022-01-10T02:34:53.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b0dffb700 1 -- 172.21.15.36:0/2762769784 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af8007440 con 0x7f4b100b0010 2022-01-10T02:34:53.506 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b15b57700 1 -- 172.21.15.36:0/2762769784 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b101599a0 con 0x7f4b100b0010 2022-01-10T02:34:53.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b0dffb700 1 -- 172.21.15.36:0/2762769784 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4af8005800 con 0x7f4b100b0010 2022-01-10T02:34:53.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b15b57700 1 -- 172.21.15.36:0/2762769784 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b10159ee0 con 0x7f4b100b0010 2022-01-10T02:34:53.507 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b15b57700 1 -- 172.21.15.36:0/2762769784 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b10066ff0 con 0x7f4b100b0010 2022-01-10T02:34:53.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b0dffb700 1 -- 172.21.15.36:0/2762769784 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f4af8010070 con 0x7f4b100b0010 2022-01-10T02:34:53.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.491+0000 7f4b0dffb700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4af4053590 0x7f4af4055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.508 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.495+0000 7f4b0dffb700 1 -- 172.21.15.36:0/2762769784 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f4af806af90 con 0x7f4b100b0010 2022-01-10T02:34:53.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.495+0000 7f4b14b55700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4af4053590 0x7f4af4055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.495+0000 7f4b14b55700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4af4053590 0x7f4af4055a50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f4b0800b000 tx=0x7f4b08009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.509 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.499+0000 7f4b0dffb700 1 -- 172.21.15.36:0/2762769784 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f4af80421e0 con 0x7f4b100b0010 2022-01-10T02:34:53.622 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.619+0000 7f4b15b57700 1 -- 172.21.15.36:0/2762769784 --> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b10057350 con 0x7f4af4053590 2022-01-10T02:34:53.623 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.619+0000 7f4b0dffb700 1 -- 172.21.15.36:0/2762769784 <== mgr.4101 v2:172.21.15.36:6800/14596 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4b10057350 con 0x7f4af4053590 2022-01-10T02:34:53.624 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.623+0000 7f4b15b57700 1 -- 172.21.15.36:0/2762769784 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4af4053590 msgr2=0x7f4af4055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.623+0000 7f4b15b57700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4af4053590 0x7f4af4055a50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f4b0800b000 tx=0x7f4b08009040).stop 2022-01-10T02:34:53.625 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.623+0000 7f4b15b57700 1 -- 172.21.15.36:0/2762769784 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b100b0010 msgr2=0x7f4b1015a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.623+0000 7f4b15b57700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b100b0010 0x7f4b1015a380 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f4af80011d0 tx=0x7f4af8007b60).stop 2022-01-10T02:34:53.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.623+0000 7f4b15b57700 1 -- 172.21.15.36:0/2762769784 shutdown_connections 2022-01-10T02:34:53.626 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.623+0000 7f4b15b57700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f4af4053590 0x7f4af4055a50 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.623+0000 7f4b15b57700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b100b2580 0x7f4b10063f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.623+0000 7f4b15b57700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f4b100b0010 0x7f4b1015a380 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.627 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.623+0000 7f4b15b57700 1 --2- 172.21.15.36:0/2762769784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b100a8ac0 0x7f4b1011d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.623+0000 7f4b15b57700 1 -- 172.21.15.36:0/2762769784 >> 172.21.15.36:0/2762769784 conn(0x7f4b10060180 msgr2=0x7f4b100b49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:53.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.623+0000 7f4b15b57700 1 -- 172.21.15.36:0/2762769784 shutdown_connections 2022-01-10T02:34:53.628 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.623+0000 7f4b15b57700 1 -- 172.21.15.36:0/2762769784 wait complete. 2022-01-10T02:34:53.629 INFO:teuthology.orchestra.run.smithi036.stderr:instructed osd(s) 5 to deep-scrub 2022-01-10T02:34:53.635 INFO:tasks.ceph:Scrubbing osd.6 2022-01-10T02:34:53.636 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2022-01-10T02:34:53.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.735+0000 7f96d3fff700 1 Processor -- start 2022-01-10T02:34:53.739 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.735+0000 7f96d3fff700 1 -- start start 2022-01-10T02:34:53.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d40b6290 0x7f96d4061470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d3fff700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f96d40b4060 0x7f96d4061960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.743 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d3fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d40b5f50 con 0x7f96d4061e50 2022-01-10T02:34:53.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d3fff700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d40b1f70 con 0x7f96d40b4060 2022-01-10T02:34:53.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d3fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d40b2210 con 0x7f96d40b6290 2022-01-10T02:34:53.744 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96ca7fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f96d40b4060 0x7f96d4061960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96ca7fc700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f96d40b4060 0x7f96d4061960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43718/0 (socket says 172.21.15.36:43718) 2022-01-10T02:34:53.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96ca7fc700 1 -- 172.21.15.36:0/3583812213 learned_addr learned my addr 172.21.15.36:0/3583812213 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:53.745 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d2ffd700 1 --2- 172.21.15.36:0/3583812213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d40b6290 0x7f96d4061470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96ca7fc700 1 -- 172.21.15.36:0/3583812213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d40b6290 msgr2=0x7f96d4061470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:53.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96ca7fc700 1 --2- 172.21.15.36:0/3583812213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d40b6290 0x7f96d4061470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.746 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96ca7fc700 1 -- 172.21.15.36:0/3583812213 >> v1:172.21.15.59:6789/0 conn(0x7f96d4061e50 legacy=0x7f96d4146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96ca7fc700 1 -- 172.21.15.36:0/3583812213 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d40b24b0 con 0x7f96d40b4060 2022-01-10T02:34:53.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96ca7fc700 1 --2- 172.21.15.36:0/3583812213 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d40b4060 0x7f96d4061960 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f96bc002f70 tx=0x7f96bc006eb0).ready entity=mon.0 client_cookie=89a5dd40aa2c4ee1 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.747 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d27fc700 1 -- 172.21.15.36:0/3583812213 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96bc00d5c0 con 0x7f96d40b4060 2022-01-10T02:34:53.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d27fc700 1 -- 172.21.15.36:0/3583812213 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc000e90 con 0x7f96d40b4060 2022-01-10T02:34:53.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d27fc700 1 -- 172.21.15.36:0/3583812213 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96bc00d950 con 0x7f96d40b4060 2022-01-10T02:34:53.748 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d3fff700 1 -- 172.21.15.36:0/3583812213 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d40b4060 msgr2=0x7f96d4061960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d3fff700 1 --2- 172.21.15.36:0/3583812213 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d40b4060 0x7f96d4061960 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f96bc002f70 tx=0x7f96bc006eb0).stop 2022-01-10T02:34:53.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d3fff700 1 -- 172.21.15.36:0/3583812213 shutdown_connections 2022-01-10T02:34:53.749 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d3fff700 1 --2- 172.21.15.36:0/3583812213 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d40b4060 0x7f96d4061960 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d3fff700 1 --2- 172.21.15.36:0/3583812213 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d40b6290 0x7f96d4061470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d3fff700 1 -- 172.21.15.36:0/3583812213 >> 172.21.15.36:0/3583812213 conn(0x7f96d405c490 msgr2=0x7f96d405c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:53.750 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d3fff700 1 -- 172.21.15.36:0/3583812213 shutdown_connections 2022-01-10T02:34:53.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.739+0000 7f96d3fff700 1 -- 172.21.15.36:0/3583812213 wait complete. 2022-01-10T02:34:53.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d3fff700 1 Processor -- start 2022-01-10T02:34:53.751 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d3fff700 1 -- start start 2022-01-10T02:34:53.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d3fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d4061e50 0x7f96d40b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.755 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d40b4060 0x7f96d4152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96d40b6290 0x7f96d41529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d3fff700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d40afe80 con 0x7f96d4061e50 2022-01-10T02:34:53.756 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d3fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d4152ee0 con 0x7f96d40b6290 2022-01-10T02:34:53.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d3fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d4156860 con 0x7f96d40b4060 2022-01-10T02:34:53.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d2ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d4061e50 0x7f96d40b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.757 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d2ffd700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d4061e50 0x7f96d40b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43724/0 (socket says 172.21.15.36:43724) 2022-01-10T02:34:53.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d2ffd700 1 -- 172.21.15.36:0/669769091 learned_addr learned my addr 172.21.15.36:0/669769091 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:53.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96ca7fc700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d40b4060 0x7f96d4152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.758 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d37fe700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96d40b6290 0x7f96d41529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d2ffd700 1 -- 172.21.15.36:0/669769091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d40b4060 msgr2=0x7f96d4152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.759 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d2ffd700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d40b4060 0x7f96d4152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d2ffd700 1 -- 172.21.15.36:0/669769091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96d40b6290 msgr2=0x7f96d41529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d2ffd700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96d40b6290 0x7f96d41529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.760 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d2ffd700 1 -- 172.21.15.36:0/669769091 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc00b1e0 con 0x7f96d4061e50 2022-01-10T02:34:53.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96ca7fc700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96d40b4060 0x7f96d4152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T02:34:53.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d2ffd700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d4061e50 0x7f96d40b4830 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f96c40030b0 tx=0x7f96c4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.761 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d0ff9700 1 -- 172.21.15.36:0/669769091 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96c4011780 con 0x7f96d4061e50 2022-01-10T02:34:53.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d0ff9700 1 -- 172.21.15.36:0/669769091 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c40118e0 con 0x7f96d4061e50 2022-01-10T02:34:53.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d3fff700 1 -- 172.21.15.36:0/669769091 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d40b00b0 con 0x7f96d4061e50 2022-01-10T02:34:53.762 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d0ff9700 1 -- 172.21.15.36:0/669769091 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96c4011c40 con 0x7f96d4061e50 2022-01-10T02:34:53.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d3fff700 1 -- 172.21.15.36:0/669769091 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d413cf00 con 0x7f96d4061e50 2022-01-10T02:34:53.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d3fff700 1 -- 172.21.15.36:0/669769091 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f96d40b0550 con 0x7f96d4061e50 2022-01-10T02:34:53.763 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d0ff9700 1 -- 172.21.15.36:0/669769091 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f96c401c460 con 0x7f96d4061e50 2022-01-10T02:34:53.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.743+0000 7f96d0ff9700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96b8053680 0x7f96b8055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.747+0000 7f96d0ff9700 1 -- 172.21.15.36:0/669769091 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f96c406b990 con 0x7f96d4061e50 2022-01-10T02:34:53.764 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.747+0000 7f96ca7fc700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96b8053680 0x7f96b8055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.747+0000 7f96d0ff9700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x7f96b805a410 0x7f96b805c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.747+0000 7f96d0ff9700 1 -- 172.21.15.36:0/669769091 --> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96b805cdf0 con 0x7f96b805a410 2022-01-10T02:34:53.765 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.747+0000 7f96d0ff9700 1 -- 172.21.15.36:0/669769091 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96c4070240 con 0x7f96d4061e50 2022-01-10T02:34:53.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.747+0000 7f96ca7fc700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96b8053680 0x7f96b8055b40 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f96bc01a000 tx=0x7f96bc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.747+0000 7f96d37fe700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x7f96b805a410 0x7f96b805c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.766 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.747+0000 7f96d37fe700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x7f96b805a410 0x7f96b805c830 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.767 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.747+0000 7f96d0ff9700 1 -- 172.21.15.36:0/669769091 <== osd.6 v2:172.21.15.59:6808/15005 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7f96b805cdf0 con 0x7f96b805a410 2022-01-10T02:34:53.768 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.767+0000 7f96d3fff700 1 -- 172.21.15.36:0/669769091 --> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f96d40b2750 con 0x7f96b805a410 2022-01-10T02:34:53.769 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.767+0000 7f96d0ff9700 1 -- 172.21.15.36:0/669769091 <== osd.6 v2:172.21.15.59:6808/15005 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f96d40b2750 con 0x7f96b805a410 2022-01-10T02:34:53.770 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T02:34:53.770 INFO:teuthology.orchestra.run.smithi036.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-01-10T02:34:53.771 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T02:34:53.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.767+0000 7f96d3fff700 1 -- 172.21.15.36:0/669769091 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x7f96b805a410 msgr2=0x7f96b805c830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.772 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.767+0000 7f96d3fff700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.59:6808/15005,v1:172.21.15.59:6809/15005] conn(0x7f96b805a410 0x7f96b805c830 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.767+0000 7f96d3fff700 1 -- 172.21.15.36:0/669769091 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96b8053680 msgr2=0x7f96b8055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.767+0000 7f96d3fff700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f96b8053680 0x7f96b8055b40 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f96bc01a000 tx=0x7f96bc015000).stop 2022-01-10T02:34:53.773 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.767+0000 7f96d3fff700 1 -- 172.21.15.36:0/669769091 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d4061e50 msgr2=0x7f96d40b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.767+0000 7f96d3fff700 1 --2- 172.21.15.36:0/669769091 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f96d4061e50 0x7f96d40b4830 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f96c40030b0 tx=0x7f96c4008040).stop 2022-01-10T02:34:53.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.767+0000 7f96d37fe700 1 -- 172.21.15.36:0/669769091 reap_dead start 2022-01-10T02:34:53.774 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.767+0000 7f96d3fff700 1 -- 172.21.15.36:0/669769091 shutdown_connections 2022-01-10T02:34:53.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.767+0000 7f96d3fff700 1 -- 172.21.15.36:0/669769091 >> 172.21.15.36:0/669769091 conn(0x7f96d405c490 msgr2=0x7f96d4146950 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:53.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.767+0000 7f96d3fff700 1 -- 172.21.15.36:0/669769091 shutdown_connections 2022-01-10T02:34:53.775 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.767+0000 7f96d3fff700 1 -- 172.21.15.36:0/669769091 wait complete. 2022-01-10T02:34:53.782 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2022-01-10T02:34:53.891 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610f474700 1 Processor -- start 2022-01-10T02:34:53.892 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610f474700 1 -- start start 2022-01-10T02:34:53.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610f474700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61080b2580 0x7f610814ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610f474700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61080b0010 0x7f610814b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.894 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610f474700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f61080afbd0 0x7f61080a83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610f474700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61080a70c0 con 0x7f61080afbd0 2022-01-10T02:34:53.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610f474700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61080a72f0 con 0x7f61080b2580 2022-01-10T02:34:53.895 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610f474700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61080a7590 con 0x7f61080b0010 2022-01-10T02:34:53.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610ec73700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f61080afbd0 0x7f61080a83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610ec73700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f61080afbd0 0x7f61080a83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43738/0 (socket says 172.21.15.36:43738) 2022-01-10T02:34:53.896 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610ec73700 1 -- 172.21.15.36:0/3834061269 learned_addr learned my addr 172.21.15.36:0/3834061269 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:53.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610dc71700 1 --2- 172.21.15.36:0/3834061269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61080b0010 0x7f610814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610e472700 1 --2- 172.21.15.36:0/3834061269 >> v2:172.21.15.59:3300/0 conn(0x7f61080b2580 0x7f610814ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.897 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610dc71700 1 -- 172.21.15.36:0/3834061269 >> v2:172.21.15.59:3300/0 conn(0x7f61080b2580 msgr2=0x7f610814ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:53.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610dc71700 1 --2- 172.21.15.36:0/3834061269 >> v2:172.21.15.59:3300/0 conn(0x7f61080b2580 0x7f610814ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610dc71700 1 -- 172.21.15.36:0/3834061269 >> v2:172.21.15.36:3300/0 conn(0x7f61080afbd0 msgr2=0x7f61080a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:53.898 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610dc71700 1 --2- 172.21.15.36:0/3834061269 >> v2:172.21.15.36:3300/0 conn(0x7f61080afbd0 0x7f61080a83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610dc71700 1 -- 172.21.15.36:0/3834061269 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61080a7830 con 0x7f61080b0010 2022-01-10T02:34:53.899 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610ec73700 1 --2- 172.21.15.36:0/3834061269 >> v2:172.21.15.36:3300/0 conn(0x7f61080afbd0 0x7f61080a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T02:34:53.900 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610dc71700 1 --2- 172.21.15.36:0/3834061269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61080b0010 0x7f610814b330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f60f8002f70 tx=0x7f60f8006df0).ready entity=mon.2 client_cookie=c9bbc078e3c6ed65 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610d470700 1 -- 172.21.15.36:0/3834061269 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60f800d4a0 con 0x7f61080b0010 2022-01-10T02:34:53.905 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610d470700 1 -- 172.21.15.36:0/3834061269 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f8000e90 con 0x7f61080b0010 2022-01-10T02:34:53.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.891+0000 7f610d470700 1 -- 172.21.15.36:0/3834061269 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60f800d7f0 con 0x7f61080b0010 2022-01-10T02:34:53.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 -- 172.21.15.36:0/3834061269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61080b0010 msgr2=0x7f610814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.906 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 --2- 172.21.15.36:0/3834061269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61080b0010 0x7f610814b330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f60f8002f70 tx=0x7f60f8006df0).stop 2022-01-10T02:34:53.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 -- 172.21.15.36:0/3834061269 shutdown_connections 2022-01-10T02:34:53.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 --2- 172.21.15.36:0/3834061269 >> v2:172.21.15.36:3300/0 conn(0x7f61080afbd0 0x7f61080a83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.907 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 --2- 172.21.15.36:0/3834061269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61080b0010 0x7f610814b330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 --2- 172.21.15.36:0/3834061269 >> v2:172.21.15.59:3300/0 conn(0x7f61080b2580 0x7f610814ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 -- 172.21.15.36:0/3834061269 >> 172.21.15.36:0/3834061269 conn(0x7f6108060180 msgr2=0x7f61080b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:53.908 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 -- 172.21.15.36:0/3834061269 shutdown_connections 2022-01-10T02:34:53.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 -- 172.21.15.36:0/3834061269 wait complete. 2022-01-10T02:34:53.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 Processor -- start 2022-01-10T02:34:53.909 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 -- start start 2022-01-10T02:34:53.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61080afbd0 0x7f610805c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61080b0010 0x7f6108063560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.910 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61080b2580 0x7f6108063a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61080b5180 con 0x7f61080b0010 2022-01-10T02:34:53.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61080656a0 con 0x7f61080afbd0 2022-01-10T02:34:53.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610f474700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6108065940 con 0x7f61080b2580 2022-01-10T02:34:53.911 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610dc71700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61080b0010 0x7f6108063560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610dc71700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61080b0010 0x7f6108063560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43742/0 (socket says 172.21.15.36:43742) 2022-01-10T02:34:53.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610dc71700 1 -- 172.21.15.36:0/405886667 learned_addr learned my addr 172.21.15.36:0/405886667 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:53.912 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610e472700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61080afbd0 0x7f610805c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.895+0000 7f610ec73700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61080b2580 0x7f6108063a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.899+0000 7f610dc71700 1 -- 172.21.15.36:0/405886667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61080b2580 msgr2=0x7f6108063a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.913 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.899+0000 7f610dc71700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61080b2580 0x7f6108063a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.899+0000 7f610dc71700 1 -- 172.21.15.36:0/405886667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61080afbd0 msgr2=0x7f610805c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:53.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.899+0000 7f610dc71700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61080afbd0 0x7f610805c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:53.914 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.899+0000 7f610dc71700 1 -- 172.21.15.36:0/405886667 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6100009530 con 0x7f61080b0010 2022-01-10T02:34:53.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.899+0000 7f610e472700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61080afbd0 0x7f610805c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T02:34:53.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.899+0000 7f610dc71700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61080b0010 0x7f6108063560 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f60f8002f70 tx=0x7f60f8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.899+0000 7f60f77fe700 1 -- 172.21.15.36:0/405886667 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60f8013ca0 con 0x7f61080b0010 2022-01-10T02:34:53.915 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.899+0000 7f60f77fe700 1 -- 172.21.15.36:0/405886667 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f8013e00 con 0x7f61080b0010 2022-01-10T02:34:53.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.899+0000 7f610f474700 1 -- 172.21.15.36:0/405886667 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f800b180 con 0x7f61080b0010 2022-01-10T02:34:53.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.899+0000 7f60f77fe700 1 -- 172.21.15.36:0/405886667 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60f801e5f0 con 0x7f61080b0010 2022-01-10T02:34:53.916 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.899+0000 7f610f474700 1 -- 172.21.15.36:0/405886667 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6108065390 con 0x7f61080b0010 2022-01-10T02:34:53.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.899+0000 7f610f474700 1 -- 172.21.15.36:0/405886667 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61080632a0 con 0x7f61080b0010 2022-01-10T02:34:53.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.899+0000 7f60f77fe700 1 -- 172.21.15.36:0/405886667 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f60f8025030 con 0x7f61080b0010 2022-01-10T02:34:53.917 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.903+0000 7f60f77fe700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60e8053680 0x7f60e8055b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:53.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.903+0000 7f610e472700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60e8053680 0x7f60e8055b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:53.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.903+0000 7f60f77fe700 1 -- 172.21.15.36:0/405886667 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f60f806c4a0 con 0x7f61080b0010 2022-01-10T02:34:53.918 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.903+0000 7f610e472700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60e8053680 0x7f60e8055b40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f610400b000 tx=0x7f6104008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:53.919 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:53.907+0000 7f60f77fe700 1 -- 172.21.15.36:0/405886667 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f61080632a0 con 0x7f61080b0010 2022-01-10T02:34:54.034 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.031+0000 7f610f474700 1 -- 172.21.15.36:0/405886667 --> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f610805d010 con 0x7f60e8053680 2022-01-10T02:34:54.035 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.031+0000 7f60f77fe700 1 -- 172.21.15.36:0/405886667 <== mgr.4101 v2:172.21.15.36:6800/14596 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f610400b720 con 0x7f60e8053680 2022-01-10T02:34:54.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.035+0000 7f610f474700 1 -- 172.21.15.36:0/405886667 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60e8053680 msgr2=0x7f60e8055b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.035+0000 7f610f474700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60e8053680 0x7f60e8055b40 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f610400b000 tx=0x7f6104008040).stop 2022-01-10T02:34:54.038 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.035+0000 7f610f474700 1 -- 172.21.15.36:0/405886667 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61080b0010 msgr2=0x7f6108063560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.035+0000 7f610f474700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61080b0010 0x7f6108063560 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f60f8002f70 tx=0x7f60f8014000).stop 2022-01-10T02:34:54.039 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.035+0000 7f610f474700 1 -- 172.21.15.36:0/405886667 shutdown_connections 2022-01-10T02:34:54.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.035+0000 7f610f474700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f60e8053680 0x7f60e8055b40 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.035+0000 7f610f474700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61080b2580 0x7f6108063a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.040 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.035+0000 7f610f474700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f61080b0010 0x7f6108063560 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.035+0000 7f610f474700 1 --2- 172.21.15.36:0/405886667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61080afbd0 0x7f610805c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.035+0000 7f610f474700 1 -- 172.21.15.36:0/405886667 >> 172.21.15.36:0/405886667 conn(0x7f6108060180 msgr2=0x7f61080ad230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:54.041 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.035+0000 7f610f474700 1 -- 172.21.15.36:0/405886667 shutdown_connections 2022-01-10T02:34:54.042 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.035+0000 7f610f474700 1 -- 172.21.15.36:0/405886667 wait complete. 2022-01-10T02:34:54.042 INFO:teuthology.orchestra.run.smithi036.stderr:instructed osd(s) 6 to deep-scrub 2022-01-10T02:34:54.052 INFO:tasks.ceph:Scrubbing osd.7 2022-01-10T02:34:54.053 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2022-01-10T02:34:54.167 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.163+0000 7fef95529700 1 Processor -- start 2022-01-10T02:34:54.168 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef95529700 1 -- start start 2022-01-10T02:34:54.171 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef95529700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef900b2910 0x7fef900b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef95529700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fef90140a80 0x7fef900b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef95529700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef90146660 con 0x7fef900b6380 2022-01-10T02:34:54.172 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef95529700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef90061fb0 con 0x7fef90140a80 2022-01-10T02:34:54.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef95529700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef90065520 con 0x7fef900b2910 2022-01-10T02:34:54.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef94d28700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fef90140a80 0x7fef900b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.173 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef8ffff700 1 --1- >> v1:172.21.15.36:6789/0 conn(0x7fef900b6380 0x7fef90140370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.36:6789/0 says I am v1:172.21.15.36:41542/0 (socket says 172.21.15.36:41542) 2022-01-10T02:34:54.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef94d28700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fef90140a80 0x7fef900b11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43750/0 (socket says 172.21.15.36:43750) 2022-01-10T02:34:54.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef8ffff700 1 -- 172.21.15.36:0/409129510 learned_addr learned my addr 172.21.15.36:0/409129510 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T02:34:54.174 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef877fe700 1 --2- 172.21.15.36:0/409129510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef900b2910 0x7fef900b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef94d28700 1 -- 172.21.15.36:0/409129510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef900b2910 msgr2=0x7fef900b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:54.175 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef94d28700 1 --2- 172.21.15.36:0/409129510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef900b2910 0x7fef900b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef94d28700 1 -- 172.21.15.36:0/409129510 >> v1:172.21.15.36:6789/0 conn(0x7fef900b6380 legacy=0x7fef90140370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef8f7fe700 1 -- 172.21.15.36:0/409129510 <== mon.0 v1:172.21.15.36:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573837228 0 0) 0x7fef90146660 con 0x7fef900b6380 2022-01-10T02:34:54.176 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef94d28700 1 -- 172.21.15.36:0/409129510 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef90147510 con 0x7fef90140a80 2022-01-10T02:34:54.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef94d28700 1 --2- 172.21.15.36:0/409129510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef90140a80 0x7fef900b11c0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7fef880032f0 tx=0x7fef880091d0).ready entity=mon.0 client_cookie=7b36109c4822a95e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:54.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef8f7fe700 1 -- 172.21.15.36:0/409129510 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef8800b6c0 con 0x7fef90140a80 2022-01-10T02:34:54.177 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef8f7fe700 1 -- 172.21.15.36:0/409129510 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8800b820 con 0x7fef90140a80 2022-01-10T02:34:54.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef8f7fe700 1 -- 172.21.15.36:0/409129510 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef8800b990 con 0x7fef90140a80 2022-01-10T02:34:54.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef95529700 1 -- 172.21.15.36:0/409129510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef90140a80 msgr2=0x7fef900b11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.178 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef95529700 1 --2- 172.21.15.36:0/409129510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef90140a80 0x7fef900b11c0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7fef880032f0 tx=0x7fef880091d0).stop 2022-01-10T02:34:54.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef95529700 1 -- 172.21.15.36:0/409129510 shutdown_connections 2022-01-10T02:34:54.179 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef95529700 1 --2- 172.21.15.36:0/409129510 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef90140a80 0x7fef900b11c0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef95529700 1 --2- 172.21.15.36:0/409129510 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef900b2910 0x7fef900b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef95529700 1 -- 172.21.15.36:0/409129510 >> 172.21.15.36:0/409129510 conn(0x7fef90063670 msgr2=0x7fef90063a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:54.180 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef95529700 1 -- 172.21.15.36:0/409129510 shutdown_connections 2022-01-10T02:34:54.181 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.167+0000 7fef95529700 1 -- 172.21.15.36:0/409129510 wait complete. 2022-01-10T02:34:54.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef95529700 1 Processor -- start 2022-01-10T02:34:54.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef95529700 1 -- start start 2022-01-10T02:34:54.185 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef95529700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef900b2910 0x7fef900ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef95529700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef900b6380 0x7fef90141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef95529700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef90140a80 0x7fef9013f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.186 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef95529700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef90141a80 con 0x7fef900b6380 2022-01-10T02:34:54.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef95529700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef90141c60 con 0x7fef90140a80 2022-01-10T02:34:54.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef95529700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef90141fb0 con 0x7fef900b2910 2022-01-10T02:34:54.187 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef877fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef900b6380 0x7fef90141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef877fe700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef900b6380 0x7fef90141590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43756/0 (socket says 172.21.15.36:43756) 2022-01-10T02:34:54.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef877fe700 1 -- 172.21.15.36:0/3627989244 learned_addr learned my addr 172.21.15.36:0/3627989244 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:54.188 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef8ffff700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef900b2910 0x7fef900ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef94d28700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef90140a80 0x7fef9013f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef877fe700 1 -- 172.21.15.36:0/3627989244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef900b2910 msgr2=0x7fef900ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.189 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef877fe700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef900b2910 0x7fef900ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef877fe700 1 -- 172.21.15.36:0/3627989244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef90140a80 msgr2=0x7fef9013f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef877fe700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef90140a80 0x7fef9013f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.190 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef877fe700 1 -- 172.21.15.36:0/3627989244 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef88009470 con 0x7fef900b6380 2022-01-10T02:34:54.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.171+0000 7fef8ffff700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef900b2910 0x7fef900ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T02:34:54.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.175+0000 7fef877fe700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef900b6380 0x7fef90141590 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7fef7800c000 tx=0x7fef78006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:54.191 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.175+0000 7fef8dffb700 1 -- 172.21.15.36:0/3627989244 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef78010780 con 0x7fef900b6380 2022-01-10T02:34:54.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.175+0000 7fef8dffb700 1 -- 172.21.15.36:0/3627989244 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef780108e0 con 0x7fef900b6380 2022-01-10T02:34:54.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.175+0000 7fef95529700 1 -- 172.21.15.36:0/3627989244 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef90142250 con 0x7fef900b6380 2022-01-10T02:34:54.192 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.175+0000 7fef8dffb700 1 -- 172.21.15.36:0/3627989244 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef78010c40 con 0x7fef900b6380 2022-01-10T02:34:54.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.175+0000 7fef95529700 1 -- 172.21.15.36:0/3627989244 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef90142990 con 0x7fef900b6380 2022-01-10T02:34:54.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.175+0000 7fef95529700 1 -- 172.21.15.36:0/3627989244 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef901426f0 con 0x7fef900b6380 2022-01-10T02:34:54.193 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.175+0000 7fef8dffb700 1 -- 172.21.15.36:0/3627989244 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fef7801c460 con 0x7fef900b6380 2022-01-10T02:34:54.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.175+0000 7fef8dffb700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fef74053560 0x7fef74055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.175+0000 7fef8ffff700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fef74053560 0x7fef74055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.194 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.175+0000 7fef8dffb700 1 -- 172.21.15.36:0/3627989244 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fef7806bae0 con 0x7fef900b6380 2022-01-10T02:34:54.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.179+0000 7fef8dffb700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.59:6824/15006,v1:172.21.15.59:6825/15006] conn(0x7fef7405a2f0 0x7fef7405c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.179+0000 7fef8dffb700 1 -- 172.21.15.36:0/3627989244 --> [v2:172.21.15.59:6824/15006,v1:172.21.15.59:6825/15006] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef7405cd70 con 0x7fef7405a2f0 2022-01-10T02:34:54.195 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.179+0000 7fef8dffb700 1 -- 172.21.15.36:0/3627989244 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_get_version_reply(handle=1 version=162) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef78070240 con 0x7fef900b6380 2022-01-10T02:34:54.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.179+0000 7fef8ffff700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fef74053560 0x7fef74055a20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7fef8000d000 tx=0x7fef80007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:54.196 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.179+0000 7fef94d28700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.59:6824/15006,v1:172.21.15.59:6825/15006] conn(0x7fef7405a2f0 0x7fef7405c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.179+0000 7fef94d28700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.59:6824/15006,v1:172.21.15.59:6825/15006] conn(0x7fef7405a2f0 0x7fef7405c710 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:54.197 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.179+0000 7fef8dffb700 1 -- 172.21.15.36:0/3627989244 <== osd.7 v2:172.21.15.59:6824/15006 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (crc 0 0 0) 0x7fef7405cd70 con 0x7fef7405a2f0 2022-01-10T02:34:54.198 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.195+0000 7fef95529700 1 -- 172.21.15.36:0/3627989244 --> [v2:172.21.15.59:6824/15006,v1:172.21.15.59:6825/15006] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fef9013ffd0 con 0x7fef7405a2f0 2022-01-10T02:34:54.199 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.199+0000 7fef8dffb700 1 -- 172.21.15.36:0/3627989244 <== osd.7 v2:172.21.15.59:6824/15006 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fef9013ffd0 con 0x7fef7405a2f0 2022-01-10T02:34:54.200 INFO:teuthology.orchestra.run.smithi036.stdout:{ 2022-01-10T02:34:54.200 INFO:teuthology.orchestra.run.smithi036.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2022-01-10T02:34:54.200 INFO:teuthology.orchestra.run.smithi036.stdout:} 2022-01-10T02:34:54.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.199+0000 7fef95529700 1 -- 172.21.15.36:0/3627989244 >> [v2:172.21.15.59:6824/15006,v1:172.21.15.59:6825/15006] conn(0x7fef7405a2f0 msgr2=0x7fef7405c710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.202 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.199+0000 7fef95529700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.59:6824/15006,v1:172.21.15.59:6825/15006] conn(0x7fef7405a2f0 0x7fef7405c710 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.199+0000 7fef95529700 1 -- 172.21.15.36:0/3627989244 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fef74053560 msgr2=0x7fef74055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.199+0000 7fef95529700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fef74053560 0x7fef74055a20 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7fef8000d000 tx=0x7fef80007a00).stop 2022-01-10T02:34:54.203 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.199+0000 7fef95529700 1 -- 172.21.15.36:0/3627989244 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef900b6380 msgr2=0x7fef90141590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.199+0000 7fef95529700 1 --2- 172.21.15.36:0/3627989244 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fef900b6380 0x7fef90141590 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7fef7800c000 tx=0x7fef78006df0).stop 2022-01-10T02:34:54.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.199+0000 7fef94d28700 1 -- 172.21.15.36:0/3627989244 reap_dead start 2022-01-10T02:34:54.204 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.199+0000 7fef95529700 1 -- 172.21.15.36:0/3627989244 shutdown_connections 2022-01-10T02:34:54.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.199+0000 7fef95529700 1 -- 172.21.15.36:0/3627989244 >> 172.21.15.36:0/3627989244 conn(0x7fef90063670 msgr2=0x7fef900b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:54.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.199+0000 7fef95529700 1 -- 172.21.15.36:0/3627989244 shutdown_connections 2022-01-10T02:34:54.205 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.199+0000 7fef95529700 1 -- 172.21.15.36:0/3627989244 wait complete. 2022-01-10T02:34:54.211 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2022-01-10T02:34:54.323 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f676975c700 1 Processor -- start 2022-01-10T02:34:54.324 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f676975c700 1 -- start start 2022-01-10T02:34:54.326 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f676975c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f67640b0b80 0x7f6764146c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f676975c700 1 -- --> v1:172.21.15.36:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67640b1140 con 0x7f67640b03d0 2022-01-10T02:34:54.327 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f676975c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67640a9570 con 0x7f67640a9190 2022-01-10T02:34:54.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f676975c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67640b1370 con 0x7f67640b0b80 2022-01-10T02:34:54.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f67637fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f67640b0b80 0x7f6764146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.328 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f67637fe700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7f67640b0b80 0x7f6764146c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43766/0 (socket says 172.21.15.36:43766) 2022-01-10T02:34:54.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f67637fe700 1 -- 172.21.15.36:0/981255623 learned_addr learned my addr 172.21.15.36:0/981255623 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:54.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f67637fe700 1 -- 172.21.15.36:0/981255623 >> v1:172.21.15.59:6789/0 conn(0x7f67640a9190 legacy=0x7f6764146550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:54.329 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f67637fe700 1 -- 172.21.15.36:0/981255623 >> v1:172.21.15.36:6789/0 conn(0x7f67640b03d0 legacy=0x7f67641401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f67637fe700 1 -- 172.21.15.36:0/981255623 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640b1610 con 0x7f67640b0b80 2022-01-10T02:34:54.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f67637fe700 1 --2- 172.21.15.36:0/981255623 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67640b0b80 0x7f6764146c60 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f674c002f70 tx=0x7f674c006eb0).ready entity=mon.0 client_cookie=7cc7506d0fc71064 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:54.330 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f6762ffd700 1 -- 172.21.15.36:0/981255623 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674c00d660 con 0x7f67640b0b80 2022-01-10T02:34:54.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f6762ffd700 1 -- 172.21.15.36:0/981255623 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674c000e90 con 0x7f67640b0b80 2022-01-10T02:34:54.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f6762ffd700 1 -- 172.21.15.36:0/981255623 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f674c00d9f0 con 0x7f67640b0b80 2022-01-10T02:34:54.331 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f676975c700 1 -- 172.21.15.36:0/981255623 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67640b0b80 msgr2=0x7f6764146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f676975c700 1 --2- 172.21.15.36:0/981255623 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67640b0b80 0x7f6764146c60 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f674c002f70 tx=0x7f674c006eb0).stop 2022-01-10T02:34:54.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f676975c700 1 -- 172.21.15.36:0/981255623 shutdown_connections 2022-01-10T02:34:54.332 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f676975c700 1 --2- 172.21.15.36:0/981255623 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67640b0b80 0x7f6764146c60 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f676975c700 1 -- 172.21.15.36:0/981255623 >> 172.21.15.36:0/981255623 conn(0x7f6764061140 msgr2=0x7f6764062e10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:54.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f676975c700 1 -- 172.21.15.36:0/981255623 shutdown_connections 2022-01-10T02:34:54.333 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.323+0000 7f676975c700 1 -- 172.21.15.36:0/981255623 wait complete. 2022-01-10T02:34:54.336 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f676975c700 1 Processor -- start 2022-01-10T02:34:54.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f676975c700 1 -- start start 2022-01-10T02:34:54.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f676975c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67640a9190 0x7f67640b6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.337 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f676975c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67640b03d0 0x7f676413f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f676975c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67640b0b80 0x7f67640b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f676975c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640b5820 con 0x7f67640a9190 2022-01-10T02:34:54.338 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f676975c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6764146230 con 0x7f67640b0b80 2022-01-10T02:34:54.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f676975c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67640b5a50 con 0x7f67640b03d0 2022-01-10T02:34:54.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f6763fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67640a9190 0x7f67640b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.339 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f6763fff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67640a9190 0x7f67640b6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43770/0 (socket says 172.21.15.36:43770) 2022-01-10T02:34:54.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f6763fff700 1 -- 172.21.15.36:0/1372180054 learned_addr learned my addr 172.21.15.36:0/1372180054 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:54.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f6768f5b700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67640b0b80 0x7f67640b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.340 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f67637fe700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67640b03d0 0x7f676413f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f6763fff700 1 -- 172.21.15.36:0/1372180054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67640b03d0 msgr2=0x7f676413f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f6763fff700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67640b03d0 0x7f676413f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.341 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f6763fff700 1 -- 172.21.15.36:0/1372180054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67640b0b80 msgr2=0x7f67640b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f6763fff700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67640b0b80 0x7f67640b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f6763fff700 1 -- 172.21.15.36:0/1372180054 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f674c00b1e0 con 0x7f67640a9190 2022-01-10T02:34:54.342 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f67637fe700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67640b03d0 0x7f676413f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-01-10T02:34:54.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.327+0000 7f6763fff700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67640a9190 0x7f67640b6500 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f67640b0290 tx=0x7f6754007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:54.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.331+0000 7f67617fa700 1 -- 172.21.15.36:0/1372180054 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f675400ce30 con 0x7f67640a9190 2022-01-10T02:34:54.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.331+0000 7f67617fa700 1 -- 172.21.15.36:0/1372180054 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675400f470 con 0x7f67640a9190 2022-01-10T02:34:54.343 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.331+0000 7f676975c700 1 -- 172.21.15.36:0/1372180054 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67640b5cf0 con 0x7f67640a9190 2022-01-10T02:34:54.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.331+0000 7f67617fa700 1 -- 172.21.15.36:0/1372180054 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f675400f7d0 con 0x7f67640a9190 2022-01-10T02:34:54.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.331+0000 7f676975c700 1 -- 172.21.15.36:0/1372180054 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67640ab050 con 0x7f67640a9190 2022-01-10T02:34:54.344 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.331+0000 7f67617fa700 1 -- 172.21.15.36:0/1372180054 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6754019030 con 0x7f67640a9190 2022-01-10T02:34:54.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.331+0000 7f676975c700 1 -- 172.21.15.36:0/1372180054 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67640b6190 con 0x7f67640a9190 2022-01-10T02:34:54.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.335+0000 7f67617fa700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6748053560 0x7f6748055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.345 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.335+0000 7f67617fa700 1 -- 172.21.15.36:0/1372180054 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f675406ab30 con 0x7f67640a9190 2022-01-10T02:34:54.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.335+0000 7f67637fe700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6748053560 0x7f6748055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.346 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.335+0000 7f67637fe700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6748053560 0x7f6748055a20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f674c017000 tx=0x7f674c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:54.347 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.339+0000 7f67617fa700 1 -- 172.21.15.36:0/1372180054 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f67640b6190 con 0x7f67640a9190 2022-01-10T02:34:54.466 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.463+0000 7f676975c700 1 -- 172.21.15.36:0/1372180054 --> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f67640ab300 con 0x7f6748053560 2022-01-10T02:34:54.467 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.463+0000 7f67617fa700 1 -- 172.21.15.36:0/1372180054 <== mgr.4101 v2:172.21.15.36:6800/14596 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f674c00de60 con 0x7f6748053560 2022-01-10T02:34:54.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.467+0000 7f676975c700 1 -- 172.21.15.36:0/1372180054 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6748053560 msgr2=0x7f6748055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.467+0000 7f676975c700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6748053560 0x7f6748055a20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f674c017000 tx=0x7f674c015000).stop 2022-01-10T02:34:54.469 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.467+0000 7f676975c700 1 -- 172.21.15.36:0/1372180054 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67640a9190 msgr2=0x7f67640b6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.467+0000 7f676975c700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67640a9190 0x7f67640b6500 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7f67640b0290 tx=0x7f6754007c50).stop 2022-01-10T02:34:54.470 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.467+0000 7f676975c700 1 -- 172.21.15.36:0/1372180054 shutdown_connections 2022-01-10T02:34:54.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.467+0000 7f676975c700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6748053560 0x7f6748055a20 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.467+0000 7f676975c700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67640b0b80 0x7f67640b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.471 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.467+0000 7f676975c700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67640b03d0 0x7f676413f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.467+0000 7f676975c700 1 --2- 172.21.15.36:0/1372180054 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f67640a9190 0x7f67640b6500 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.467+0000 7f676975c700 1 -- 172.21.15.36:0/1372180054 >> 172.21.15.36:0/1372180054 conn(0x7f6764061140 msgr2=0x7f6764141bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:54.472 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.467+0000 7f676975c700 1 -- 172.21.15.36:0/1372180054 shutdown_connections 2022-01-10T02:34:54.473 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.467+0000 7f676975c700 1 -- 172.21.15.36:0/1372180054 wait complete. 2022-01-10T02:34:54.473 INFO:teuthology.orchestra.run.smithi036.stderr:instructed osd(s) 7 to deep-scrub 2022-01-10T02:34:54.480 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-01-10T02:34:54.581 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.579+0000 7f6a9a19f700 1 Processor -- start 2022-01-10T02:34:54.582 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.579+0000 7f6a9a19f700 1 -- start start 2022-01-10T02:34:54.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.579+0000 7f6a9a19f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a940b2580 0x7f6a9414ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.579+0000 7f6a9a19f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a940b0010 0x7f6a9414b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.585 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.579+0000 7f6a9a19f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a940a70c0 con 0x7f6a940afbd0 2022-01-10T02:34:54.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.579+0000 7f6a9a19f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a940a72f0 con 0x7f6a940b0010 2022-01-10T02:34:54.586 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.579+0000 7f6a9a19f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a940a7590 con 0x7f6a940b2580 2022-01-10T02:34:54.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.579+0000 7f6a9919d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a940b2580 0x7f6a9414ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.579+0000 7f6a9899c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a940b0010 0x7f6a9414b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.587 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.579+0000 7f6a9999e700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6a940afbd0 0x7f6a940a83b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:59252/0 (socket says 172.21.15.36:59252) 2022-01-10T02:34:54.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.579+0000 7f6a9999e700 1 -- 172.21.15.36:0/1013140489 learned_addr learned my addr 172.21.15.36:0/1013140489 (peer_addr_for_me v1:172.21.15.36:0/0) 2022-01-10T02:34:54.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a8bfff700 1 -- 172.21.15.36:0/1013140489 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613257042 0 0) 0x7f6a940a70c0 con 0x7f6a940afbd0 2022-01-10T02:34:54.588 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a8bfff700 1 -- 172.21.15.36:0/1013140489 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a78003260 con 0x7f6a940afbd0 2022-01-10T02:34:54.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9919d700 1 -- 172.21.15.36:0/1013140489 >> v2:172.21.15.59:3300/0 conn(0x7f6a940b0010 msgr2=0x7f6a9414b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:34:54.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9919d700 1 --2- 172.21.15.36:0/1013140489 >> v2:172.21.15.59:3300/0 conn(0x7f6a940b0010 0x7f6a9414b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9919d700 1 -- 172.21.15.36:0/1013140489 >> v1:172.21.15.59:6789/0 conn(0x7f6a940afbd0 legacy=0x7f6a940a83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.589 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9919d700 1 -- 172.21.15.36:0/1013140489 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a940a7830 con 0x7f6a940b2580 2022-01-10T02:34:54.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9919d700 1 --2- 172.21.15.36:0/1013140489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a940b2580 0x7f6a9414ae40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f6a8c0032f0 tx=0x7f6a8c0091d0).ready entity=mon.2 client_cookie=f9379199799574a4 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:54.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a8bfff700 1 -- 172.21.15.36:0/1013140489 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8c00b600 con 0x7f6a940b2580 2022-01-10T02:34:54.590 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a8bfff700 1 -- 172.21.15.36:0/1013140489 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c00b760 con 0x7f6a940b2580 2022-01-10T02:34:54.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a8bfff700 1 -- 172.21.15.36:0/1013140489 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8c00b8d0 con 0x7f6a940b2580 2022-01-10T02:34:54.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9a19f700 1 -- 172.21.15.36:0/1013140489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a940b2580 msgr2=0x7f6a9414ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.591 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9a19f700 1 --2- 172.21.15.36:0/1013140489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a940b2580 0x7f6a9414ae40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f6a8c0032f0 tx=0x7f6a8c0091d0).stop 2022-01-10T02:34:54.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9a19f700 1 -- 172.21.15.36:0/1013140489 shutdown_connections 2022-01-10T02:34:54.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9a19f700 1 --2- 172.21.15.36:0/1013140489 >> v2:172.21.15.59:3300/0 conn(0x7f6a940b0010 0x7f6a9414b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.592 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9a19f700 1 --2- 172.21.15.36:0/1013140489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a940b2580 0x7f6a9414ae40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9a19f700 1 -- 172.21.15.36:0/1013140489 >> 172.21.15.36:0/1013140489 conn(0x7f6a94060180 msgr2=0x7f6a940b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:54.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9a19f700 1 -- 172.21.15.36:0/1013140489 shutdown_connections 2022-01-10T02:34:54.593 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9a19f700 1 -- 172.21.15.36:0/1013140489 wait complete. 2022-01-10T02:34:54.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9a19f700 1 Processor -- start 2022-01-10T02:34:54.597 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.583+0000 7f6a9a19f700 1 -- start start 2022-01-10T02:34:54.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9a19f700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a940afbd0 0x7f6a940b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9a19f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a940b0010 0x7f6a940b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.598 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9a19f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a940b2580 0x7f6a940b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9a19f700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a940ac6c0 con 0x7f6a940afbd0 2022-01-10T02:34:54.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9a19f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a940b39a0 con 0x7f6a940b0010 2022-01-10T02:34:54.599 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9a19f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a940b3bd0 con 0x7f6a940b2580 2022-01-10T02:34:54.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9919d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a940afbd0 0x7f6a940b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.600 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9919d700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a940afbd0 0x7f6a940b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43784/0 (socket says 172.21.15.36:43784) 2022-01-10T02:34:54.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9919d700 1 -- 172.21.15.36:0/3954917356 learned_addr learned my addr 172.21.15.36:0/3954917356 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:34:54.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9899c700 1 --2- 172.21.15.36:0/3954917356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a940b0010 0x7f6a940b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.601 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9999e700 1 --2- 172.21.15.36:0/3954917356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a940b2580 0x7f6a940b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9919d700 1 -- 172.21.15.36:0/3954917356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a940b2580 msgr2=0x7f6a940b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9919d700 1 --2- 172.21.15.36:0/3954917356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a940b2580 0x7f6a940b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.602 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9919d700 1 -- 172.21.15.36:0/3954917356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a940b0010 msgr2=0x7f6a940b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9919d700 1 --2- 172.21.15.36:0/3954917356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a940b0010 0x7f6a940b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9919d700 1 -- 172.21.15.36:0/3954917356 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c009470 con 0x7f6a940afbd0 2022-01-10T02:34:54.603 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9919d700 1 --2- 172.21.15.36:0/3954917356 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a940afbd0 0x7f6a940b31c0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f6a8c0032f0 tx=0x7f6a8c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:54.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a8a7fc700 1 -- 172.21.15.36:0/3954917356 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8c00b8d0 con 0x7f6a940afbd0 2022-01-10T02:34:54.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a8a7fc700 1 -- 172.21.15.36:0/3954917356 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c01f3f0 con 0x7f6a940afbd0 2022-01-10T02:34:54.604 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9a19f700 1 -- 172.21.15.36:0/3954917356 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a940af010 con 0x7f6a940afbd0 2022-01-10T02:34:54.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a8a7fc700 1 -- 172.21.15.36:0/3954917356 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8c00b600 con 0x7f6a940afbd0 2022-01-10T02:34:54.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9a19f700 1 -- 172.21.15.36:0/3954917356 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a940af550 con 0x7f6a940afbd0 2022-01-10T02:34:54.605 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.587+0000 7f6a9a19f700 1 -- 172.21.15.36:0/3954917356 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a940af710 con 0x7f6a940afbd0 2022-01-10T02:34:54.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.591+0000 7f6a8a7fc700 1 -- 172.21.15.36:0/3954917356 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7f6a8c026030 con 0x7f6a940afbd0 2022-01-10T02:34:54.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.591+0000 7f6a8a7fc700 1 --2- 172.21.15.36:0/3954917356 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a7c0535f0 0x7f6a7c055ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:34:54.606 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.591+0000 7f6a8a7fc700 1 -- 172.21.15.36:0/3954917356 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7f6a8c06c3f0 con 0x7f6a940afbd0 2022-01-10T02:34:54.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.591+0000 7f6a9899c700 1 --2- 172.21.15.36:0/3954917356 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a7c0535f0 0x7f6a7c055ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:34:54.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.591+0000 7f6a9899c700 1 --2- 172.21.15.36:0/3954917356 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a7c0535f0 0x7f6a7c055ab0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f6a8400b000 tx=0x7f6a84006df0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:34:54.607 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.595+0000 7f6a8a7fc700 1 -- 172.21.15.36:0/3954917356 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7f6a8c043570 con 0x7f6a940afbd0 2022-01-10T02:34:54.714 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.711+0000 7f6a9a19f700 1 -- 172.21.15.36:0/3954917356 --> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6a94057350 con 0x7f6a7c0535f0 2022-01-10T02:34:54.720 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.719+0000 7f6a8a7fc700 1 -- 172.21.15.36:0/3954917356 <== mgr.4101 v2:172.21.15.36:6800/14596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68053 (secure 0 0 0) 0x7f6a94057350 con 0x7f6a7c0535f0 2022-01-10T02:34:54.722 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T02:34:54.723 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.719+0000 7f6a9a19f700 1 -- 172.21.15.36:0/3954917356 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a7c0535f0 msgr2=0x7f6a7c055ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.719+0000 7f6a9a19f700 1 --2- 172.21.15.36:0/3954917356 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a7c0535f0 0x7f6a7c055ab0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f6a8400b000 tx=0x7f6a84006df0).stop 2022-01-10T02:34:54.724 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.719+0000 7f6a9a19f700 1 -- 172.21.15.36:0/3954917356 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a940afbd0 msgr2=0x7f6a940b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:34:54.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.719+0000 7f6a9a19f700 1 --2- 172.21.15.36:0/3954917356 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a940afbd0 0x7f6a940b31c0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7f6a8c0032f0 tx=0x7f6a8c016000).stop 2022-01-10T02:34:54.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.719+0000 7f6a9a19f700 1 -- 172.21.15.36:0/3954917356 shutdown_connections 2022-01-10T02:34:54.725 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.719+0000 7f6a9a19f700 1 --2- 172.21.15.36:0/3954917356 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7f6a7c0535f0 0x7f6a7c055ab0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.719+0000 7f6a9a19f700 1 --2- 172.21.15.36:0/3954917356 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a940b2580 0x7f6a940b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.719+0000 7f6a9a19f700 1 --2- 172.21.15.36:0/3954917356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a940b0010 0x7f6a940b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.726 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.719+0000 7f6a9a19f700 1 --2- 172.21.15.36:0/3954917356 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7f6a940afbd0 0x7f6a940b31c0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:34:54.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.719+0000 7f6a9a19f700 1 -- 172.21.15.36:0/3954917356 >> 172.21.15.36:0/3954917356 conn(0x7f6a94060180 msgr2=0x7f6a94144a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:34:54.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.719+0000 7f6a9a19f700 1 -- 172.21.15.36:0/3954917356 shutdown_connections 2022-01-10T02:34:54.727 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:34:54.719+0000 7f6a9a19f700 1 -- 172.21.15.36:0/3954917356 wait complete. 2022-01-10T02:34:54.728 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2022-01-10T02:34:54.734 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":2278,"stamp":"2022-01-10T02:34:53.560515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8404792,"kb_used_data":16120,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569928,"statfs":{"total":773094113280,"available":764487606272,"internally_reserved":8589934592,"allocated":16506880,"data_stored":8079964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003197"},"pg_stats":[{"pgid":"1.0","version":"14'2","reported_seq":143,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.802567+0000","last_change":"2022-01-10T01:24:14.937125+0000","last_active":"2022-01-10T01:34:17.802567+0000","last_peered":"2022-01-10T01:34:17.802567+0000","last_clean":"2022-01-10T01:34:17.802567+0000","last_became_active":"2022-01-10T01:24:14.935715+0000","last_became_peered":"2022-01-10T01:24:14.935715+0000","last_unstale":"2022-01-10T01:34:17.802567+0000","last_undegraded":"2022-01-10T01:34:17.802567+0000","last_fullsized":"2022-01-10T01:34:17.802567+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:08.543721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:08.543721+0000","last_clean_scrub_stamp":"2022-01-10T01:24:08.543721+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":146,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.715314+0000","last_change":"2022-01-10T01:24:19.114295+0000","last_active":"2022-01-10T01:34:17.715314+0000","last_peered":"2022-01-10T01:34:17.715314+0000","last_clean":"2022-01-10T01:34:17.715314+0000","last_became_active":"2022-01-10T01:24:19.113327+0000","last_became_peered":"2022-01-10T01:24:19.113327+0000","last_unstale":"2022-01-10T01:34:17.715314+0000","last_undegraded":"2022-01-10T01:34:17.715314+0000","last_fullsized":"2022-01-10T01:34:17.715314+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":146,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.715226+0000","last_change":"2022-01-10T01:24:18.787713+0000","last_active":"2022-01-10T01:34:17.715226+0000","last_peered":"2022-01-10T01:34:17.715226+0000","last_clean":"2022-01-10T01:34:17.715226+0000","last_became_active":"2022-01-10T01:24:18.787183+0000","last_became_peered":"2022-01-10T01:24:18.787183+0000","last_unstale":"2022-01-10T01:34:17.715226+0000","last_undegraded":"2022-01-10T01:34:17.715226+0000","last_fullsized":"2022-01-10T01:34:17.715226+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":138,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.802209+0000","last_change":"2022-01-10T01:24:18.786166+0000","last_active":"2022-01-10T01:34:17.802209+0000","last_peered":"2022-01-10T01:34:17.802209+0000","last_clean":"2022-01-10T01:34:17.802209+0000","last_became_active":"2022-01-10T01:24:18.785296+0000","last_became_peered":"2022-01-10T01:24:18.785296+0000","last_unstale":"2022-01-10T01:34:17.802209+0000","last_undegraded":"2022-01-10T01:34:17.802209+0000","last_fullsized":"2022-01-10T01:34:17.802209+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":146,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.715262+0000","last_change":"2022-01-10T01:24:19.115873+0000","last_active":"2022-01-10T01:34:17.715262+0000","last_peered":"2022-01-10T01:34:17.715262+0000","last_clean":"2022-01-10T01:34:17.715262+0000","last_became_active":"2022-01-10T01:24:19.114993+0000","last_became_peered":"2022-01-10T01:24:19.114993+0000","last_unstale":"2022-01-10T01:34:17.715262+0000","last_undegraded":"2022-01-10T01:34:17.715262+0000","last_fullsized":"2022-01-10T01:34:17.715262+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.717913+0000","last_change":"2022-01-10T01:24:19.116632+0000","last_active":"2022-01-10T01:34:17.717913+0000","last_peered":"2022-01-10T01:34:17.717913+0000","last_clean":"2022-01-10T01:34:17.717913+0000","last_became_active":"2022-01-10T01:24:19.115547+0000","last_became_peered":"2022-01-10T01:24:19.115547+0000","last_unstale":"2022-01-10T01:34:17.717913+0000","last_undegraded":"2022-01-10T01:34:17.717913+0000","last_fullsized":"2022-01-10T01:34:17.717913+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":146,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.715293+0000","last_change":"2022-01-10T01:24:18.790281+0000","last_active":"2022-01-10T01:34:17.715293+0000","last_peered":"2022-01-10T01:34:17.715293+0000","last_clean":"2022-01-10T01:34:17.715293+0000","last_became_active":"2022-01-10T01:24:18.789645+0000","last_became_peered":"2022-01-10T01:24:18.789645+0000","last_unstale":"2022-01-10T01:34:17.715293+0000","last_undegraded":"2022-01-10T01:34:17.715293+0000","last_fullsized":"2022-01-10T01:34:17.715293+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":149,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.716052+0000","last_change":"2022-01-10T01:24:19.666159+0000","last_active":"2022-01-10T01:34:17.716052+0000","last_peered":"2022-01-10T01:34:17.716052+0000","last_clean":"2022-01-10T01:34:17.716052+0000","last_became_active":"2022-01-10T01:24:19.665292+0000","last_became_peered":"2022-01-10T01:24:19.665292+0000","last_unstale":"2022-01-10T01:34:17.716052+0000","last_undegraded":"2022-01-10T01:34:17.716052+0000","last_fullsized":"2022-01-10T01:34:17.716052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":146,"reported_epoch":161,"state":"active+clean","last_fresh":"2022-01-10T01:34:17.715487+0000","last_change":"2022-01-10T01:24:19.664491+0000","last_active":"2022-01-10T01:34:17.715487+0000","last_peered":"2022-01-10T01:34:17.715487+0000","last_clean":"2022-01-10T01:34:17.715487+0000","last_became_active":"2022-01-10T01:24:19.663966+0000","last_became_peered":"2022-01-10T01:24:19.663966+0000","last_unstale":"2022-01-10T01:34:17.715487+0000","last_undegraded":"2022-01-10T01:34:17.715487+0000","last_fullsized":"2022-01-10T01:34:17.715487+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T01:24:17.760014+0000","last_clean_scrub_stamp":"2022-01-10T01:24:17.760014+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575697,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.89800000000000002,"15min":0.89500000000000002},"min":{"1min":0.60399999999999998,"5min":0.57999999999999996,"15min":0.503},"max":{"1min":1.111,"5min":1.131,"15min":1.224},"last":1.024},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94099999999999995,"15min":0.93400000000000005},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.55300000000000005},"max":{"1min":1.2,"5min":1.2010000000000001,"15min":1.2509999999999999},"last":0.83299999999999996}]},{"osd":1,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81499999999999995},"min":{"1min":0.58299999999999996,"5min":0.53300000000000003,"15min":0.497},"max":{"1min":1.0680000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.60799999999999998,"5min":0.56499999999999995,"15min":0.54300000000000004},"max":{"1min":1.1020000000000001,"5min":1.1870000000000001,"15min":1.244},"last":0.88700000000000001}]},{"osd":2,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.66800000000000004,"5min":0.59699999999999998,"15min":0.58199999999999996},"max":{"1min":1.1619999999999999,"5min":1.252,"15min":1.379},"last":1.046},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84999999999999998,"15min":0.83499999999999996},"min":{"1min":0.64900000000000002,"5min":0.61599999999999999,"15min":0.58499999999999996},"max":{"1min":1.0589999999999999,"5min":1.113,"15min":1.1279999999999999},"last":0.78000000000000003}]},{"osd":3,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.876,"15min":0.872},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.59399999999999997},"max":{"1min":1.117,"5min":1.117,"15min":1.2749999999999999},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.89500000000000002,"15min":0.91800000000000004},"min":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.623},"max":{"1min":1.165,"5min":1.1739999999999999,"15min":1.2929999999999999},"last":0.96699999999999997}]},{"osd":4,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80300000000000005,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0489999999999999,"5min":1.163,"15min":1.2170000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.86399999999999999,"15min":0.874},"min":{"1min":0.67100000000000004,"5min":0.55600000000000005,"15min":0.52400000000000002},"max":{"1min":1.1930000000000001,"5min":1.2090000000000001,"15min":1.234},"last":0.81299999999999994}]},{"osd":5,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.89000000000000001,"15min":0.89800000000000002},"min":{"1min":0.62,"5min":0.55000000000000004,"15min":0.54600000000000004},"max":{"1min":1.165,"5min":1.256,"15min":1.319},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.92700000000000005,"15min":0.91800000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.298},"last":0.92300000000000004}]},{"osd":6,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.96999999999999997,"15min":0.96199999999999997},"min":{"1min":0.65600000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1699999999999999,"5min":1.228,"15min":1.2569999999999999},"last":0.999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0049999999999999,"15min":0.99399999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.24,"5min":1.415,"15min":1.415},"last":1.109}]}]},{"osd":6,"up_from":13,"seq":55834575697,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.90800000000000003,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.49099999999999999},"max":{"1min":1.117,"5min":1.141,"15min":1.1619999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.874,"15min":0.876},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.093,"5min":1.093,"15min":1.218},"last":0.99099999999999999}]},{"osd":1,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.51100000000000001},"max":{"1min":0.98699999999999999,"5min":1.169,"15min":1.169},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.55200000000000005},"max":{"1min":0.99099999999999999,"5min":1.1180000000000001,"15min":1.264},"last":0.83599999999999997}]},{"osd":2,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.877,"15min":0.88300000000000001},"min":{"1min":0.59199999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.139,"15min":1.27},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.88200000000000001,"15min":0.88600000000000001},"min":{"1min":0.73799999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.3879999999999999},"last":0.86699999999999999}]},{"osd":3,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.90500000000000003,"15min":0.878},"min":{"1min":0.63900000000000001,"5min":0.58699999999999997,"15min":0.55900000000000005},"max":{"1min":1.1759999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90500000000000003,"15min":0.92100000000000004},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.59399999999999997},"max":{"1min":1.115,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.67700000000000005}]},{"osd":4,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.58899999999999997,"5min":0.54900000000000004,"15min":0.44500000000000001},"max":{"1min":1.038,"5min":1.133,"15min":1.212},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.89800000000000002,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.52700000000000002,"15min":0.50800000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.91000000000000003}]},{"osd":5,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.95099999999999996,"15min":0.94099999999999995},"min":{"1min":0.71799999999999997,"5min":0.58299999999999996,"15min":0.56999999999999995},"max":{"1min":1.1859999999999999,"5min":1.2569999999999999,"15min":1.2649999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.86599999999999999,"15min":0.89400000000000002},"min":{"1min":0.66200000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.206,"5min":1.246,"15min":1.306},"last":0.73199999999999998}]},{"osd":7,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.875,"15min":0.89300000000000002},"min":{"1min":0.70399999999999996,"5min":0.628,"15min":0.441},"max":{"1min":1.22,"5min":1.22,"15min":1.3200000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0329999999999999,"15min":1.028},"min":{"1min":0.82399999999999995,"5min":0.623,"15min":0.59599999999999997},"max":{"1min":1.234,"5min":1.3360000000000001,"15min":1.4319999999999999},"last":1.014}]}]},{"osd":5,"up_from":13,"seq":55834575697,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050596,"kb_used_data":2012,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321244,"statfs":{"total":96636764160,"available":95560953856,"internally_reserved":1073741824,"allocated":2060288,"data_stored":1009562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73699999999999999,"15min":0.74199999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.95299999999999996,"5min":1.1060000000000001,"15min":1.137},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.78800000000000003,"15min":0.79700000000000004},"min":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.50700000000000001},"max":{"1min":1.036,"5min":1.1639999999999999,"15min":1.3100000000000001},"last":0.73199999999999998}]},{"osd":1,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.58799999999999997,"5min":0.52400000000000002,"15min":0.50700000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.524},"last":0.627},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80300000000000005,"15min":0.78500000000000003},"min":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.55700000000000005},"max":{"1min":1.101,"5min":1.23,"15min":1.23},"last":0.60299999999999998}]},{"osd":2,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.92300000000000004,"15min":0.91300000000000003},"min":{"1min":0.71399999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.3089999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83299999999999996,"15min":0.82499999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57099999999999995},"max":{"1min":1.002,"5min":1.0589999999999999,"15min":1.0800000000000001},"last":0.92700000000000005}]},{"osd":3,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.64700000000000002,"5min":0.59499999999999997,"15min":0.58399999999999996},"max":{"1min":1.1519999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93899999999999995,"15min":0.95399999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1359999999999999,"5min":1.262,"15min":1.373},"last":0.71799999999999997}]},{"osd":4,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.752,"15min":0.751},"min":{"1min":0.59199999999999997,"5min":0.51600000000000001,"15min":0.48499999999999999},"max":{"1min":1.014,"5min":1.0309999999999999,"15min":1.115},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.008,"5min":0.98199999999999998,"15min":0.97899999999999998},"min":{"1min":0.89200000000000002,"5min":0.746,"15min":0.66100000000000003},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.28},"last":1.0489999999999999}]},{"osd":6,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.876,"15min":0.88800000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.55600000000000005},"max":{"1min":1.1559999999999999,"5min":1.2649999999999999,"15min":1.4219999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.88300000000000001,"15min":0.90200000000000002},"min":{"1min":0.55200000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.105,"5min":1.196,"15min":1.208},"last":0.80100000000000005}]},{"osd":7,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.89300000000000002,"15min":0.90800000000000003},"min":{"1min":0.67000000000000004,"5min":0.54500000000000004,"15min":0.54400000000000004},"max":{"1min":1.4810000000000001,"5min":1.4850000000000001,"15min":1.6220000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.92800000000000005,"15min":0.95199999999999996},"min":{"1min":0.70699999999999996,"5min":0.58099999999999996,"15min":0.57399999999999995},"max":{"1min":1.2050000000000001,"5min":1.3089999999999999,"15min":1.732},"last":0.78400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575698,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93100000000000005,"15min":0.92400000000000004},"min":{"1min":0.69499999999999995,"5min":0.55800000000000005,"15min":0.47299999999999998},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88300000000000001,"15min":0.89300000000000002},"min":{"1min":0.70499999999999996,"5min":0.69499999999999995,"15min":0.65800000000000003},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.73799999999999999}]},{"osd":1,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.82199999999999995,"15min":0.83599999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.54900000000000004},"max":{"1min":1.0549999999999999,"5min":1.133,"15min":1.1599999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88,"15min":0.879},"min":{"1min":0.60299999999999998,"5min":0.58299999999999996,"15min":0.57299999999999995},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.216},"last":0.89600000000000002}]},{"osd":2,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.80100000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.071,"5min":1.075,"15min":1.214},"last":0.876},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.88600000000000001,"15min":0.89900000000000002},"min":{"1min":0.61699999999999999,"5min":0.61199999999999999,"15min":0.57199999999999995},"max":{"1min":1.1319999999999999,"5min":1.155,"15min":1.2430000000000001},"last":0.94499999999999995}]},{"osd":3,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81299999999999994,"15min":0.82599999999999996},"min":{"1min":0.64000000000000001,"5min":0.61399999999999999,"15min":0.58699999999999997},"max":{"1min":1.147,"5min":1.147,"15min":1.2549999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.879,"5min":0.873,"15min":0.86399999999999999},"min":{"1min":0.70299999999999996,"5min":0.68899999999999995,"15min":0.58499999999999996},"max":{"1min":1.1200000000000001,"5min":1.1779999999999999,"15min":1.181},"last":0.79500000000000004}]},{"osd":5,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.86299999999999999,"15min":0.85599999999999998},"min":{"1min":0.66000000000000003,"5min":0.55500000000000005,"15min":0.53700000000000003},"max":{"1min":1.1379999999999999,"5min":1.2130000000000001,"15min":1.2549999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.85299999999999998,"15min":0.85399999999999998},"min":{"1min":0.63200000000000001,"5min":0.55700000000000005,"15min":0.52500000000000002},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.85799999999999998,"15min":0.84899999999999998},"min":{"1min":0.69499999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1739999999999999,"5min":1.216,"15min":1.222},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.002,"5min":1.0009999999999999,"15min":1.002},"min":{"1min":0.65800000000000003,"5min":0.63,"15min":0.62},"max":{"1min":1.23,"5min":1.23,"15min":1.302},"last":0.752}]},{"osd":7,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.94699999999999995,"15min":0.93700000000000006},"min":{"1min":0.75,"5min":0.63800000000000001,"15min":0.59299999999999997},"max":{"1min":1.226,"5min":1.3120000000000001,"15min":1.4830000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.042,"5min":0.97799999999999998,"15min":0.97599999999999998},"min":{"1min":0.77000000000000002,"5min":0.68799999999999994,"15min":0.68000000000000005},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.389},"last":0.95399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575697,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.46999999999999997,"5min":0.46000000000000002,"15min":0.41399999999999998},"max":{"1min":0.77200000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.47499999999999998,"5min":0.46800000000000003,"15min":0.46200000000000002},"max":{"1min":0.84399999999999997,"5min":1.1220000000000001,"15min":1.1519999999999999},"last":0.80300000000000005}]},{"osd":1,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65800000000000003,"15min":0.64700000000000002},"min":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.44400000000000001},"max":{"1min":1.0509999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74099999999999999,"15min":0.72999999999999998},"min":{"1min":0.59199999999999997,"5min":0.498,"15min":0.498},"max":{"1min":0.97899999999999998,"5min":1.081,"15min":1.081},"last":0.59899999999999998}]},{"osd":2,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.77600000000000002,"15min":0.76100000000000001},"min":{"1min":0.60599999999999998,"5min":0.56399999999999995,"15min":0.54400000000000004},"max":{"1min":1.0089999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.876},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79700000000000004,"15min":0.80600000000000005},"min":{"1min":0.59999999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.216},"last":0.65800000000000003}]},{"osd":4,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.88800000000000001,"15min":0.875},"min":{"1min":0.68000000000000005,"5min":0.60299999999999998,"15min":0.58399999999999996},"max":{"1min":1.1140000000000001,"5min":1.321,"15min":1.321},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.95299999999999996,"15min":0.95599999999999996},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.167,"5min":1.272,"15min":1.444},"last":1.028}]},{"osd":5,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.97399999999999998,"15min":0.96799999999999997},"min":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.212,"5min":1.28,"15min":1.3939999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.88,"5min":0.89900000000000002,"15min":0.90100000000000002},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.60599999999999998},"max":{"1min":1.1899999999999999,"5min":1.236,"15min":1.3260000000000001},"last":0.90300000000000002}]},{"osd":6,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.96999999999999997,"15min":0.97199999999999998},"min":{"1min":0.75,"5min":0.72799999999999998,"15min":0.66400000000000003},"max":{"1min":1.2509999999999999,"5min":1.268,"15min":1.494},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.044,"5min":1.04,"15min":1.0309999999999999},"min":{"1min":0.78300000000000003,"5min":0.75600000000000001,"15min":0.69099999999999995},"max":{"1min":1.351,"5min":1.351,"15min":1.3899999999999999},"last":0.92900000000000005}]},{"osd":7,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98399999999999999,"15min":0.99299999999999999},"min":{"1min":0.72199999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":1},{"interface":"front","average":{"1min":1.089,"5min":1.0620000000000001,"15min":1.0569999999999999},"min":{"1min":0.82799999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":1.1859999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575697,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050596,"kb_used_data":2012,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321244,"statfs":{"total":96636764160,"available":95560953856,"internally_reserved":1073741824,"allocated":2060288,"data_stored":1009562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:33:50 2022","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61199999999999999,"15min":0.59899999999999998},"min":{"1min":0.44600000000000001,"5min":0.438,"15min":0.433},"max":{"1min":0.79200000000000004,"5min":0.95699999999999996,"15min":1.0289999999999999},"last":0.499},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.51600000000000001,"5min":0.499,"15min":0.436},"max":{"1min":0.90100000000000002,"5min":1.093,"15min":1.145},"last":1.0309999999999999}]},{"osd":1,"last update":"Mon Jan 10 02:33:50 2022","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69599999999999995,"15min":0.68200000000000005},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.47499999999999998},"max":{"1min":0.98999999999999999,"5min":1.0209999999999999,"15min":1.0349999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71699999999999997,"15min":0.71599999999999997},"min":{"1min":0.57199999999999995,"5min":0.505,"15min":0.47199999999999998},"max":{"1min":0.82099999999999995,"5min":1.038,"15min":1.1459999999999999},"last":1.1060000000000001}]},{"osd":3,"last update":"Mon Jan 10 02:33:50 2022","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.69799999999999995,"15min":0.68500000000000005},"min":{"1min":0.51900000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.84399999999999997,"5min":1.0640000000000001,"15min":1.1659999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80300000000000005,"15min":0.80000000000000004},"min":{"1min":0.61099999999999999,"5min":0.54700000000000004,"15min":0.52600000000000002},"max":{"1min":1.069,"5min":1.089,"15min":1.1399999999999999},"last":0.81899999999999995}]},{"osd":4,"last update":"Mon Jan 10 02:33:50 2022","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.92100000000000004,"15min":0.91100000000000003},"min":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.58899999999999997},"max":{"1min":1.143,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.0700000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.90100000000000002,"15min":0.88900000000000001},"min":{"1min":0.71399999999999997,"5min":0.68400000000000005,"15min":0.65500000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2889999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Mon Jan 10 02:33:50 2022","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95799999999999996,"15min":0.95099999999999996},"min":{"1min":0.76500000000000001,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.321,"5min":1.3480000000000001,"15min":1.4670000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.038,"5min":0.97099999999999997,"15min":0.96899999999999997},"min":{"1min":0.73799999999999999,"5min":0.68600000000000005,"15min":0.68300000000000005},"max":{"1min":1.2210000000000001,"5min":1.349,"15min":1.4350000000000001},"last":0.95899999999999996}]},{"osd":6,"last update":"Mon Jan 10 02:33:50 2022","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.96199999999999997,"15min":0.93999999999999995},"min":{"1min":0.75900000000000001,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.2350000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.028,"15min":1.0129999999999999},"min":{"1min":0.78900000000000003,"5min":0.745,"15min":0.66200000000000003},"max":{"1min":1.2689999999999999,"5min":1.47,"15min":1.5249999999999999},"last":1.002}]},{"osd":7,"last update":"Mon Jan 10 02:33:50 2022","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0469999999999999,"15min":1.0229999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.70899999999999996},"max":{"1min":1.292,"5min":1.629,"15min":1.629},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0409999999999999,"15min":1.0229999999999999},"min":{"1min":0.86899999999999999,"5min":0.80500000000000005,"15min":0.72699999999999998},"max":{"1min":1.2,"5min":1.3240000000000001,"15min":1.52},"last":0.92000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575698,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.504,"5min":0.46800000000000003,"15min":0.44700000000000001},"max":{"1min":1.095,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996}]},{"osd":2,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64500000000000002,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.439},"max":{"1min":0.78900000000000003,"5min":0.95699999999999996,"15min":1.143},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.54600000000000004},"max":{"1min":0.92800000000000005,"5min":1.137,"15min":1.137},"last":0.91100000000000003}]},{"osd":3,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.55000000000000004},"max":{"1min":1.01,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":1.002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.66100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.93700000000000006,"5min":1.095,"15min":1.1950000000000001},"last":0.66100000000000003}]},{"osd":4,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.60499999999999998},"max":{"1min":1.1180000000000001,"5min":1.2529999999999999,"15min":1.4299999999999999},"last":0.88},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.94199999999999995,"15min":0.93200000000000005},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"max":{"1min":1.1060000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.0609999999999999}]},{"osd":5,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.91700000000000004,"15min":0.90800000000000003},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2010000000000001,"5min":1.3799999999999999,"15min":1.4710000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.93300000000000005,"15min":0.93400000000000005},"min":{"1min":0.70999999999999996,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.087,"5min":1.3680000000000001,"15min":1.4930000000000001},"last":0.97499999999999998}]},{"osd":6,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.78400000000000003,"5min":0.69199999999999995,"15min":0.67800000000000005},"max":{"1min":1.2470000000000001,"5min":1.474,"15min":1.54},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.96099999999999997,"15min":0.98999999999999999},"min":{"1min":0.79000000000000004,"5min":0.72599999999999998,"15min":0.72299999999999998},"max":{"1min":1.05,"5min":1.4750000000000001,"15min":1.512},"last":0.80200000000000005}]},{"osd":7,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0289999999999999,"15min":1.024},"min":{"1min":0.81599999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.2869999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.996},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.03,"15min":1.0429999999999999},"min":{"1min":0.81699999999999995,"5min":0.72299999999999998,"15min":0.69399999999999995},"max":{"1min":1.1859999999999999,"5min":1.446,"15min":1.5840000000000001},"last":1.0249999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575697,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61599999999999999,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.42099999999999999},"max":{"1min":0.90400000000000003,"5min":1.105,"15min":1.105},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.441},"max":{"1min":1.056,"5min":1.1299999999999999,"15min":1.246},"last":0.65600000000000003}]},{"osd":2,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.69899999999999995,"15min":0.69499999999999995},"min":{"1min":0.52200000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98499999999999999,"5min":1.0800000000000001,"15min":1.131},"last":0.498},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.54000000000000004,"5min":0.53600000000000003,"15min":0.45400000000000001},"max":{"1min":1.0940000000000001,"5min":1.171,"15min":1.171},"last":0.54200000000000004}]},{"osd":3,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.55700000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86799999999999999,"5min":1.016,"15min":1.016},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79700000000000004,"15min":0.79000000000000004},"min":{"1min":0.61199999999999999,"5min":0.56299999999999994,"15min":0.498},"max":{"1min":0.92500000000000004,"5min":1.0580000000000001,"15min":1.105},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88500000000000001,"15min":0.89200000000000002},"min":{"1min":0.68000000000000005,"5min":0.67200000000000004,"15min":0.64200000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.393},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.89500000000000002,"15min":0.89600000000000002},"min":{"1min":0.70999999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.282,"5min":1.343,"15min":1.343},"last":0.89200000000000002}]},{"osd":5,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.71799999999999997,"5min":0.69399999999999995,"15min":0.66100000000000003},"max":{"1min":1.264,"5min":1.321,"15min":1.321},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.018,"5min":0.998,"15min":0.98099999999999998},"min":{"1min":0.76600000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.296,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.81699999999999995}]},{"osd":6,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0309999999999999,"15min":1.0049999999999999},"min":{"1min":0.85499999999999998,"5min":0.71699999999999997,"15min":0.66900000000000004},"max":{"1min":1.347,"5min":1.3819999999999999,"15min":1.399},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1,"15min":0.995},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.69499999999999995},"max":{"1min":1.2589999999999999,"5min":1.337,"15min":1.4319999999999999},"last":0.83499999999999996}]},{"osd":7,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0209999999999999,"15min":1.0129999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.72899999999999998},"max":{"1min":1.2390000000000001,"5min":1.389,"15min":1.468},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.071,"5min":1.026,"15min":1.008},"min":{"1min":0.82199999999999995,"5min":0.749,"15min":0.72599999999999998},"max":{"1min":1.3500000000000001,"5min":1.401,"15min":1.4219999999999999},"last":0.98799999999999999}]}]}]}} 2022-01-10T02:34:54.740 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2022-01-10T01:24:08.543721+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=1, tm_min=24, tm_sec=8, tm_wday=0, tm_yday=10, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=2, tm_min=34, tm_sec=50, tm_wday=0, tm_yday=10, tm_isdst=0) 2022-01-10T02:34:54.741 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2022-01-10T01:24:17.760014+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=1, tm_min=24, tm_sec=17, tm_wday=0, tm_yday=10, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=2, tm_min=34, tm_sec=50, tm_wday=0, tm_yday=10, tm_isdst=0) 2022-01-10T02:34:54.742 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2022-01-10T01:24:17.760014+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=1, tm_min=24, tm_sec=17, tm_wday=0, tm_yday=10, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=2, tm_min=34, tm_sec=50, tm_wday=0, tm_yday=10, tm_isdst=0) 2022-01-10T02:34:54.743 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2022-01-10T01:24:17.760014+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=1, tm_min=24, tm_sec=17, tm_wday=0, tm_yday=10, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=2, tm_min=34, tm_sec=50, tm_wday=0, tm_yday=10, tm_isdst=0) 2022-01-10T02:34:54.743 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2022-01-10T01:24:17.760014+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=1, tm_min=24, tm_sec=17, tm_wday=0, tm_yday=10, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=2, tm_min=34, tm_sec=50, tm_wday=0, tm_yday=10, tm_isdst=0) 2022-01-10T02:34:54.744 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2022-01-10T01:24:17.760014+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=1, tm_min=24, tm_sec=17, tm_wday=0, tm_yday=10, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=2, tm_min=34, tm_sec=50, tm_wday=0, tm_yday=10, tm_isdst=0) 2022-01-10T02:34:54.745 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2022-01-10T01:24:17.760014+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=1, tm_min=24, tm_sec=17, tm_wday=0, tm_yday=10, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=2, tm_min=34, tm_sec=50, tm_wday=0, tm_yday=10, tm_isdst=0) 2022-01-10T02:34:54.745 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2022-01-10T01:24:17.760014+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=1, tm_min=24, tm_sec=17, tm_wday=0, tm_yday=10, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=2, tm_min=34, tm_sec=50, tm_wday=0, tm_yday=10, tm_isdst=0) 2022-01-10T02:34:54.746 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2022-01-10T01:24:17.760014+0000 time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=1, tm_min=24, tm_sec=17, tm_wday=0, tm_yday=10, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=1, tm_mday=10, tm_hour=2, tm_min=34, tm_sec=50, tm_wday=0, tm_yday=10, tm_isdst=0) 2022-01-10T02:34:54.747 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2022-01-10T02:35:14.749 DEBUG:teuthology.orchestra.run.smithi036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-01-10T02:35:14.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 Processor -- start 2022-01-10T02:35:14.860 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 -- start start 2022-01-10T02:35:14.863 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc4c0aa120 0x7efc4c0ae440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:35:14.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7efc4c0b0880 0x7efc4c1405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:35:14.864 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4c0b2af0 con 0x7efc4c0b04a0 2022-01-10T02:35:14.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4c0b2770 con 0x7efc4c0b0880 2022-01-10T02:35:14.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4c0b2d20 con 0x7efc4c0aa120 2022-01-10T02:35:14.865 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc4ad9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7efc4c0b0880 0x7efc4c1405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:35:14.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc4ad9d700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7efc4c0b0880 0x7efc4c1405a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43796/0 (socket says 172.21.15.36:43796) 2022-01-10T02:35:14.866 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc4ad9d700 1 -- 172.21.15.36:0/3413586890 learned_addr learned my addr 172.21.15.36:0/3413586890 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:35:14.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc49d9b700 1 --2- 172.21.15.36:0/3413586890 >> v2:172.21.15.59:3300/0 conn(0x7efc4c0aa120 0x7efc4c0ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:35:14.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc4ad9d700 1 -- 172.21.15.36:0/3413586890 >> v2:172.21.15.59:3300/0 conn(0x7efc4c0aa120 msgr2=0x7efc4c0ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:35:14.867 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc4ad9d700 1 --2- 172.21.15.36:0/3413586890 >> v2:172.21.15.59:3300/0 conn(0x7efc4c0aa120 0x7efc4c0ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:14.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc4ad9d700 1 -- 172.21.15.36:0/3413586890 >> v1:172.21.15.59:6789/0 conn(0x7efc4c0b04a0 legacy=0x7efc4c0add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:35:14.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc4ad9d700 1 -- 172.21.15.36:0/3413586890 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c0a9b70 con 0x7efc4c0b0880 2022-01-10T02:35:14.868 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc4ad9d700 1 --2- 172.21.15.36:0/3413586890 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc4c0b0880 0x7efc4c1405a0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7efc44002f70 tx=0x7efc44006eb0).ready entity=mon.0 client_cookie=bff3217f666ebf70 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:35:14.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc4959a700 1 -- 172.21.15.36:0/3413586890 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc4400d5c0 con 0x7efc4c0b0880 2022-01-10T02:35:14.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc4959a700 1 -- 172.21.15.36:0/3413586890 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc44000e90 con 0x7efc4c0b0880 2022-01-10T02:35:14.869 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc4959a700 1 -- 172.21.15.36:0/3413586890 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc4400d950 con 0x7efc4c0b0880 2022-01-10T02:35:14.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 -- 172.21.15.36:0/3413586890 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc4c0b0880 msgr2=0x7efc4c1405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:35:14.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 --2- 172.21.15.36:0/3413586890 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc4c0b0880 0x7efc4c1405a0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7efc44002f70 tx=0x7efc44006eb0).stop 2022-01-10T02:35:14.870 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 -- 172.21.15.36:0/3413586890 shutdown_connections 2022-01-10T02:35:14.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 --2- 172.21.15.36:0/3413586890 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc4c0b0880 0x7efc4c1405a0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:14.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 --2- 172.21.15.36:0/3413586890 >> v2:172.21.15.59:3300/0 conn(0x7efc4c0aa120 0x7efc4c0ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:14.871 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 -- 172.21.15.36:0/3413586890 >> 172.21.15.36:0/3413586890 conn(0x7efc4c0607c0 msgr2=0x7efc4c060ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:35:14.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 -- 172.21.15.36:0/3413586890 shutdown_connections 2022-01-10T02:35:14.872 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.859+0000 7efc50a4c700 1 -- 172.21.15.36:0/3413586890 wait complete. 2022-01-10T02:35:14.875 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc50a4c700 1 Processor -- start 2022-01-10T02:35:14.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc50a4c700 1 -- start start 2022-01-10T02:35:14.876 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc50a4c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc4c0aa120 0x7efc4c134320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:35:14.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc50a4c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc4c0b04a0 0x7efc4c155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:35:14.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc50a4c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc4c0b0880 0x7efc4c1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:35:14.877 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc50a4c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c12e6b0 con 0x7efc4c0b04a0 2022-01-10T02:35:14.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc50a4c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c1362c0 con 0x7efc4c0b0880 2022-01-10T02:35:14.878 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc50a4c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c136560 con 0x7efc4c0aa120 2022-01-10T02:35:14.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc49d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc4c0b04a0 0x7efc4c155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:35:14.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc49d9b700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc4c0b04a0 0x7efc4c155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43800/0 (socket says 172.21.15.36:43800) 2022-01-10T02:35:14.879 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc49d9b700 1 -- 172.21.15.36:0/2276740305 learned_addr learned my addr 172.21.15.36:0/2276740305 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:35:14.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc4ad9d700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc4c0b0880 0x7efc4c1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:35:14.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc4a59c700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc4c0aa120 0x7efc4c134320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:35:14.880 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc49d9b700 1 -- 172.21.15.36:0/2276740305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc4c0aa120 msgr2=0x7efc4c134320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:35:14.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc49d9b700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc4c0aa120 0x7efc4c134320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:14.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc49d9b700 1 -- 172.21.15.36:0/2276740305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc4c0b0880 msgr2=0x7efc4c1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:35:14.881 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc49d9b700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc4c0b0880 0x7efc4c1561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:14.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc49d9b700 1 -- 172.21.15.36:0/2276740305 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4400b1e0 con 0x7efc4c0b04a0 2022-01-10T02:35:14.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc4ad9d700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc4c0b0880 0x7efc4c1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T02:35:14.882 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc49d9b700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc4c0b04a0 0x7efc4c155ce0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7efc3c00c000 tx=0x7efc3c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:35:14.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc437fe700 1 -- 172.21.15.36:0/2276740305 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc3c00c850 con 0x7efc4c0b04a0 2022-01-10T02:35:14.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc437fe700 1 -- 172.21.15.36:0/2276740305 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c00c9b0 con 0x7efc4c0b04a0 2022-01-10T02:35:14.883 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc50a4c700 1 -- 172.21.15.36:0/2276740305 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4c136800 con 0x7efc4c0b04a0 2022-01-10T02:35:14.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.863+0000 7efc437fe700 1 -- 172.21.15.36:0/2276740305 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc3c00cd10 con 0x7efc4c0b04a0 2022-01-10T02:35:14.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.867+0000 7efc50a4c700 1 -- 172.21.15.36:0/2276740305 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4c12e3a0 con 0x7efc4c0b04a0 2022-01-10T02:35:14.884 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.867+0000 7efc50a4c700 1 -- 172.21.15.36:0/2276740305 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4c057350 con 0x7efc4c0b04a0 2022-01-10T02:35:14.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.867+0000 7efc437fe700 1 -- 172.21.15.36:0/2276740305 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7efc3c022070 con 0x7efc4c0b04a0 2022-01-10T02:35:14.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.867+0000 7efc437fe700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efc30053590 0x7efc30055a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:35:14.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.867+0000 7efc437fe700 1 -- 172.21.15.36:0/2276740305 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7efc3c06be90 con 0x7efc4c0b04a0 2022-01-10T02:35:14.885 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.867+0000 7efc4a59c700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efc30053590 0x7efc30055a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:35:14.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.867+0000 7efc4a59c700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efc30053590 0x7efc30055a50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7efc3400b000 tx=0x7efc34009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:35:14.886 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.875+0000 7efc437fe700 1 -- 172.21.15.36:0/2276740305 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7efc3c043180 con 0x7efc4c0b04a0 2022-01-10T02:35:15.003 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:14.999+0000 7efc50a4c700 1 -- 172.21.15.36:0/2276740305 --> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc4c044650 con 0x7efc30053590 2022-01-10T02:35:15.005 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.003+0000 7efc437fe700 1 -- 172.21.15.36:0/2276740305 <== mgr.4101 v2:172.21.15.36:6800/14596 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+67964 (secure 0 0 0) 0x7efc4c044650 con 0x7efc30053590 2022-01-10T02:35:15.007 INFO:teuthology.orchestra.run.smithi036.stdout: 2022-01-10T02:35:15.008 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.007+0000 7efc50a4c700 1 -- 172.21.15.36:0/2276740305 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efc30053590 msgr2=0x7efc30055a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:35:15.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.007+0000 7efc50a4c700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efc30053590 0x7efc30055a50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7efc3400b000 tx=0x7efc34009040).stop 2022-01-10T02:35:15.009 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.007+0000 7efc50a4c700 1 -- 172.21.15.36:0/2276740305 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc4c0b04a0 msgr2=0x7efc4c155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:35:15.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.007+0000 7efc50a4c700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc4c0b04a0 0x7efc4c155ce0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7efc3c00c000 tx=0x7efc3c0091d0).stop 2022-01-10T02:35:15.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.007+0000 7efc50a4c700 1 -- 172.21.15.36:0/2276740305 shutdown_connections 2022-01-10T02:35:15.010 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.007+0000 7efc50a4c700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7efc30053590 0x7efc30055a50 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:15.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.007+0000 7efc50a4c700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc4c0b0880 0x7efc4c1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:15.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.007+0000 7efc50a4c700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7efc4c0b04a0 0x7efc4c155ce0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:15.011 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.007+0000 7efc50a4c700 1 --2- 172.21.15.36:0/2276740305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc4c0aa120 0x7efc4c134320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:15.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.007+0000 7efc50a4c700 1 -- 172.21.15.36:0/2276740305 >> 172.21.15.36:0/2276740305 conn(0x7efc4c0607c0 msgr2=0x7efc4c0b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:35:15.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.007+0000 7efc50a4c700 1 -- 172.21.15.36:0/2276740305 shutdown_connections 2022-01-10T02:35:15.012 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.007+0000 7efc50a4c700 1 -- 172.21.15.36:0/2276740305 wait complete. 2022-01-10T02:35:15.013 INFO:teuthology.orchestra.run.smithi036.stderr:dumped all 2022-01-10T02:35:15.020 INFO:teuthology.orchestra.run.smithi036.stdout:{"pg_ready":true,"pg_map":{"version":2288,"stamp":"2022-01-10T02:35:13.566015+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9694,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8404792,"kb_used_data":16120,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746569928,"statfs":{"total":773094113280,"available":764487606272,"internally_reserved":8589934592,"allocated":16506880,"data_stored":8079964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003244"},"pg_stats":[{"pgid":"1.0","version":"162'4","reported_seq":148,"reported_epoch":162,"state":"active+clean","last_fresh":"2022-01-10T02:34:53.331367+0000","last_change":"2022-01-10T02:34:53.331458+0000","last_active":"2022-01-10T02:34:53.331367+0000","last_peered":"2022-01-10T02:34:53.331367+0000","last_clean":"2022-01-10T02:34:53.331367+0000","last_became_active":"2022-01-10T01:24:14.935715+0000","last_became_peered":"2022-01-10T01:24:14.935715+0000","last_unstale":"2022-01-10T02:34:53.331367+0000","last_undegraded":"2022-01-10T02:34:53.331367+0000","last_fullsized":"2022-01-10T02:34:53.331367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"162'4","last_scrub_stamp":"2022-01-10T02:34:53.331367+0000","last_deep_scrub":"162'4","last_deep_scrub_stamp":"2022-01-10T02:34:53.331367+0000","last_clean_scrub_stamp":"2022-01-10T02:34:53.331367+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9694,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":149,"reported_epoch":162,"state":"active+clean","last_fresh":"2022-01-10T02:35:02.668161+0000","last_change":"2022-01-10T02:35:02.668412+0000","last_active":"2022-01-10T02:35:02.668161+0000","last_peered":"2022-01-10T02:35:02.668161+0000","last_clean":"2022-01-10T02:35:02.668161+0000","last_became_active":"2022-01-10T01:24:19.113327+0000","last_became_peered":"2022-01-10T01:24:19.113327+0000","last_unstale":"2022-01-10T02:35:02.668161+0000","last_undegraded":"2022-01-10T02:35:02.668161+0000","last_fullsized":"2022-01-10T02:35:02.668161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T02:35:02.668160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T02:35:02.668160+0000","last_clean_scrub_stamp":"2022-01-10T02:35:02.668160+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":149,"reported_epoch":162,"state":"active+clean","last_fresh":"2022-01-10T02:34:55.645051+0000","last_change":"2022-01-10T02:34:55.645249+0000","last_active":"2022-01-10T02:34:55.645051+0000","last_peered":"2022-01-10T02:34:55.645051+0000","last_clean":"2022-01-10T02:34:55.645051+0000","last_became_active":"2022-01-10T01:24:18.787183+0000","last_became_peered":"2022-01-10T01:24:18.787183+0000","last_unstale":"2022-01-10T02:34:55.645051+0000","last_undegraded":"2022-01-10T02:34:55.645051+0000","last_fullsized":"2022-01-10T02:34:55.645051+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T02:34:55.645050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T02:34:55.645050+0000","last_clean_scrub_stamp":"2022-01-10T02:34:55.645050+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":141,"reported_epoch":162,"state":"active+clean","last_fresh":"2022-01-10T02:34:55.231108+0000","last_change":"2022-01-10T02:34:55.231215+0000","last_active":"2022-01-10T02:34:55.231108+0000","last_peered":"2022-01-10T02:34:55.231108+0000","last_clean":"2022-01-10T02:34:55.231108+0000","last_became_active":"2022-01-10T01:24:18.785296+0000","last_became_peered":"2022-01-10T01:24:18.785296+0000","last_unstale":"2022-01-10T02:34:55.231108+0000","last_undegraded":"2022-01-10T02:34:55.231108+0000","last_fullsized":"2022-01-10T02:34:55.231108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T02:34:55.231107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T02:34:55.231107+0000","last_clean_scrub_stamp":"2022-01-10T02:34:55.231107+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":149,"reported_epoch":162,"state":"active+clean","last_fresh":"2022-01-10T02:34:59.712112+0000","last_change":"2022-01-10T02:34:59.712306+0000","last_active":"2022-01-10T02:34:59.712112+0000","last_peered":"2022-01-10T02:34:59.712112+0000","last_clean":"2022-01-10T02:34:59.712112+0000","last_became_active":"2022-01-10T01:24:19.114993+0000","last_became_peered":"2022-01-10T01:24:19.114993+0000","last_unstale":"2022-01-10T02:34:59.712112+0000","last_undegraded":"2022-01-10T02:34:59.712112+0000","last_fullsized":"2022-01-10T02:34:59.712112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T02:34:59.712111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T02:34:59.712111+0000","last_clean_scrub_stamp":"2022-01-10T02:34:59.712111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":147,"reported_epoch":162,"state":"active+clean","last_fresh":"2022-01-10T02:34:53.934328+0000","last_change":"2022-01-10T02:34:53.934516+0000","last_active":"2022-01-10T02:34:53.934328+0000","last_peered":"2022-01-10T02:34:53.934328+0000","last_clean":"2022-01-10T02:34:53.934328+0000","last_became_active":"2022-01-10T01:24:19.115547+0000","last_became_peered":"2022-01-10T01:24:19.115547+0000","last_unstale":"2022-01-10T02:34:53.934328+0000","last_undegraded":"2022-01-10T02:34:53.934328+0000","last_fullsized":"2022-01-10T02:34:53.934328+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T02:34:53.934327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T02:34:53.934327+0000","last_clean_scrub_stamp":"2022-01-10T02:34:53.934327+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":149,"reported_epoch":162,"state":"active+clean","last_fresh":"2022-01-10T02:35:03.640112+0000","last_change":"2022-01-10T02:35:03.640307+0000","last_active":"2022-01-10T02:35:03.640112+0000","last_peered":"2022-01-10T02:35:03.640112+0000","last_clean":"2022-01-10T02:35:03.640112+0000","last_became_active":"2022-01-10T01:24:18.789645+0000","last_became_peered":"2022-01-10T01:24:18.789645+0000","last_unstale":"2022-01-10T02:35:03.640112+0000","last_undegraded":"2022-01-10T02:35:03.640112+0000","last_fullsized":"2022-01-10T02:35:03.640112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T02:35:03.640111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T02:35:03.640111+0000","last_clean_scrub_stamp":"2022-01-10T02:35:03.640111+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":152,"reported_epoch":162,"state":"active+clean","last_fresh":"2022-01-10T02:34:59.000481+0000","last_change":"2022-01-10T02:34:59.000563+0000","last_active":"2022-01-10T02:34:59.000481+0000","last_peered":"2022-01-10T02:34:59.000481+0000","last_clean":"2022-01-10T02:34:59.000481+0000","last_became_active":"2022-01-10T01:24:19.665292+0000","last_became_peered":"2022-01-10T01:24:19.665292+0000","last_unstale":"2022-01-10T02:34:59.000481+0000","last_undegraded":"2022-01-10T02:34:59.000481+0000","last_fullsized":"2022-01-10T02:34:59.000481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T02:34:59.000481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T02:34:59.000481+0000","last_clean_scrub_stamp":"2022-01-10T02:34:59.000481+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":149,"reported_epoch":162,"state":"active+clean","last_fresh":"2022-01-10T02:35:04.620889+0000","last_change":"2022-01-10T02:35:04.621020+0000","last_active":"2022-01-10T02:35:04.620889+0000","last_peered":"2022-01-10T02:35:04.620889+0000","last_clean":"2022-01-10T02:35:04.620889+0000","last_became_active":"2022-01-10T01:24:19.663966+0000","last_became_peered":"2022-01-10T01:24:19.663966+0000","last_unstale":"2022-01-10T02:35:04.620889+0000","last_undegraded":"2022-01-10T02:35:04.620889+0000","last_fullsized":"2022-01-10T02:35:04.620889+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-01-10T02:35:04.620889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-01-10T02:35:04.620889+0000","last_clean_scrub_stamp":"2022-01-10T02:35:04.620889+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9694,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.89800000000000002,"15min":0.89500000000000002},"min":{"1min":0.60399999999999998,"5min":0.57999999999999996,"15min":0.503},"max":{"1min":1.111,"5min":1.131,"15min":1.224},"last":0.999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.94099999999999995,"15min":0.93400000000000005},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.55300000000000005},"max":{"1min":1.2,"5min":1.2010000000000001,"15min":1.2509999999999999},"last":0.93000000000000005}]},{"osd":1,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81499999999999995},"min":{"1min":0.58299999999999996,"5min":0.53300000000000003,"15min":0.497},"max":{"1min":1.0680000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.081},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.60799999999999998,"5min":0.56499999999999995,"15min":0.54300000000000004},"max":{"1min":1.1020000000000001,"5min":1.1870000000000001,"15min":1.244},"last":0.70199999999999996}]},{"osd":2,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.66800000000000004,"5min":0.59699999999999998,"15min":0.58199999999999996},"max":{"1min":1.1619999999999999,"5min":1.252,"15min":1.379},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84999999999999998,"15min":0.83499999999999996},"min":{"1min":0.64900000000000002,"5min":0.61599999999999999,"15min":0.58499999999999996},"max":{"1min":1.0589999999999999,"5min":1.113,"15min":1.1279999999999999},"last":0.82399999999999995}]},{"osd":3,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.876,"15min":0.872},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.59399999999999997},"max":{"1min":1.117,"5min":1.117,"15min":1.2749999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.89500000000000002,"15min":0.91800000000000004},"min":{"1min":0.67000000000000004,"5min":0.63800000000000001,"15min":0.623},"max":{"1min":1.165,"5min":1.1739999999999999,"15min":1.2929999999999999},"last":1.0229999999999999}]},{"osd":4,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80300000000000005,"15min":0.79400000000000004},"min":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0489999999999999,"5min":1.163,"15min":1.2170000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.86399999999999999,"15min":0.874},"min":{"1min":0.67100000000000004,"5min":0.55600000000000005,"15min":0.52400000000000002},"max":{"1min":1.1930000000000001,"5min":1.2090000000000001,"15min":1.234},"last":0.73599999999999999}]},{"osd":5,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.89000000000000001,"15min":0.89800000000000002},"min":{"1min":0.62,"5min":0.55000000000000004,"15min":0.54600000000000004},"max":{"1min":1.165,"5min":1.256,"15min":1.319},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.92700000000000005,"15min":0.91800000000000004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.298},"last":0.876}]},{"osd":6,"last update":"Mon Jan 10 02:34:34 2022","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.96999999999999997,"15min":0.96199999999999997},"min":{"1min":0.65600000000000003,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.1699999999999999,"5min":1.228,"15min":1.2569999999999999},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0049999999999999,"15min":0.99399999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.24,"5min":1.415,"15min":1.415},"last":1.143}]}]},{"osd":6,"up_from":13,"seq":55834575701,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.90800000000000003,"15min":0.88800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.49099999999999999},"max":{"1min":1.117,"5min":1.141,"15min":1.1619999999999999},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.874,"15min":0.876},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.093,"5min":1.093,"15min":1.218},"last":0.871}]},{"osd":1,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.56100000000000005,"5min":0.55800000000000005,"15min":0.51100000000000001},"max":{"1min":0.98699999999999999,"5min":1.169,"15min":1.169},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.55200000000000005},"max":{"1min":0.99099999999999999,"5min":1.1180000000000001,"15min":1.264},"last":0.71899999999999997}]},{"osd":2,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.877,"15min":0.88300000000000001},"min":{"1min":0.59199999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.139,"15min":1.27},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.88200000000000001,"15min":0.88600000000000001},"min":{"1min":0.73799999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.3879999999999999},"last":1.0149999999999999}]},{"osd":3,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.90500000000000003,"15min":0.878},"min":{"1min":0.63900000000000001,"5min":0.58699999999999997,"15min":0.55900000000000005},"max":{"1min":1.1759999999999999,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.75},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90500000000000003,"15min":0.92100000000000004},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.59399999999999997},"max":{"1min":1.115,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.135}]},{"osd":4,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.76200000000000001,"15min":0.78800000000000003},"min":{"1min":0.58899999999999997,"5min":0.54900000000000004,"15min":0.44500000000000001},"max":{"1min":1.038,"5min":1.133,"15min":1.212},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.89800000000000002,"15min":0.89000000000000001},"min":{"1min":0.60899999999999999,"5min":0.52700000000000002,"15min":0.50800000000000001},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":1.1040000000000001}]},{"osd":5,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.95099999999999996,"15min":0.94099999999999995},"min":{"1min":0.71799999999999997,"5min":0.58299999999999996,"15min":0.56999999999999995},"max":{"1min":1.1859999999999999,"5min":1.2569999999999999,"15min":1.2649999999999999},"last":1.05},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.86599999999999999,"15min":0.89400000000000002},"min":{"1min":0.66200000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.206,"5min":1.246,"15min":1.306},"last":1.198}]},{"osd":7,"last update":"Mon Jan 10 02:34:16 2022","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.875,"15min":0.89300000000000002},"min":{"1min":0.70399999999999996,"5min":0.628,"15min":0.441},"max":{"1min":1.22,"5min":1.22,"15min":1.3200000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0329999999999999,"15min":1.028},"min":{"1min":0.82399999999999995,"5min":0.623,"15min":0.59599999999999997},"max":{"1min":1.234,"5min":1.3360000000000001,"15min":1.4319999999999999},"last":1.159}]}]},{"osd":5,"up_from":13,"seq":55834575701,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050596,"kb_used_data":2012,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321244,"statfs":{"total":96636764160,"available":95560953856,"internally_reserved":1073741824,"allocated":2060288,"data_stored":1009562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.73699999999999999,"15min":0.74199999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.95299999999999996,"5min":1.1060000000000001,"15min":1.137},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.78800000000000003,"15min":0.79700000000000004},"min":{"1min":0.55000000000000004,"5min":0.51000000000000001,"15min":0.50700000000000001},"max":{"1min":1.036,"5min":1.1639999999999999,"15min":1.3100000000000001},"last":0.63}]},{"osd":1,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.58799999999999997,"5min":0.52400000000000002,"15min":0.50700000000000001},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.524},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80300000000000005,"15min":0.78500000000000003},"min":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.55700000000000005},"max":{"1min":1.101,"5min":1.23,"15min":1.23},"last":0.66200000000000003}]},{"osd":2,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.92300000000000004,"15min":0.91300000000000003},"min":{"1min":0.71399999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.3089999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83299999999999996,"15min":0.82499999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57099999999999995},"max":{"1min":1.002,"5min":1.0589999999999999,"15min":1.0800000000000001},"last":0.95599999999999996}]},{"osd":3,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.86399999999999999,"15min":0.86599999999999999},"min":{"1min":0.64700000000000002,"5min":0.59499999999999997,"15min":0.58399999999999996},"max":{"1min":1.1519999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93899999999999995,"15min":0.95399999999999996},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.1359999999999999,"5min":1.262,"15min":1.373},"last":0.877}]},{"osd":4,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.752,"15min":0.751},"min":{"1min":0.59199999999999997,"5min":0.51600000000000001,"15min":0.48499999999999999},"max":{"1min":1.014,"5min":1.0309999999999999,"15min":1.115},"last":1.101},{"interface":"front","average":{"1min":1.008,"5min":0.98199999999999998,"15min":0.97899999999999998},"min":{"1min":0.89200000000000002,"5min":0.746,"15min":0.66100000000000003},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.28},"last":0.86299999999999999}]},{"osd":6,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.876,"15min":0.88800000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.55600000000000005},"max":{"1min":1.1559999999999999,"5min":1.2649999999999999,"15min":1.4219999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.88300000000000001,"15min":0.90200000000000002},"min":{"1min":0.55200000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.105,"5min":1.196,"15min":1.208},"last":1.1399999999999999}]},{"osd":7,"last update":"Mon Jan 10 02:34:35 2022","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.89300000000000002,"15min":0.90800000000000003},"min":{"1min":0.67000000000000004,"5min":0.54500000000000004,"15min":0.54400000000000004},"max":{"1min":1.4810000000000001,"5min":1.4850000000000001,"15min":1.6220000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.92800000000000005,"15min":0.95199999999999996},"min":{"1min":0.70699999999999996,"5min":0.58099999999999996,"15min":0.57399999999999995},"max":{"1min":1.2050000000000001,"5min":1.3089999999999999,"15min":1.732},"last":1.0149999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575702,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.93100000000000005,"15min":0.92400000000000004},"min":{"1min":0.69499999999999995,"5min":0.55800000000000005,"15min":0.47299999999999998},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88300000000000001,"15min":0.89300000000000002},"min":{"1min":0.70499999999999996,"5min":0.69499999999999995,"15min":0.65800000000000003},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.0029999999999999}]},{"osd":1,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.82199999999999995,"15min":0.83599999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.54900000000000004},"max":{"1min":1.0549999999999999,"5min":1.133,"15min":1.1599999999999999},"last":0.877},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.88,"15min":0.879},"min":{"1min":0.60299999999999998,"5min":0.58299999999999996,"15min":0.57299999999999995},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.216},"last":1.079}]},{"osd":2,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79400000000000004,"15min":0.80100000000000005},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.55800000000000005},"max":{"1min":1.071,"5min":1.075,"15min":1.214},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.88600000000000001,"15min":0.89900000000000002},"min":{"1min":0.61699999999999999,"5min":0.61199999999999999,"15min":0.57199999999999995},"max":{"1min":1.1319999999999999,"5min":1.155,"15min":1.2430000000000001},"last":1.0229999999999999}]},{"osd":3,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.81299999999999994,"15min":0.82599999999999996},"min":{"1min":0.64000000000000001,"5min":0.61399999999999999,"15min":0.58699999999999997},"max":{"1min":1.147,"5min":1.147,"15min":1.2549999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.879,"5min":0.873,"15min":0.86399999999999999},"min":{"1min":0.70299999999999996,"5min":0.68899999999999995,"15min":0.58499999999999996},"max":{"1min":1.1200000000000001,"5min":1.1779999999999999,"15min":1.181},"last":0.77200000000000002}]},{"osd":5,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.86299999999999999,"15min":0.85599999999999998},"min":{"1min":0.66000000000000003,"5min":0.55500000000000005,"15min":0.53700000000000003},"max":{"1min":1.1379999999999999,"5min":1.2130000000000001,"15min":1.2549999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.85299999999999998,"15min":0.85399999999999998},"min":{"1min":0.63200000000000001,"5min":0.55700000000000005,"15min":0.52500000000000002},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":1.089}]},{"osd":6,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.85799999999999998,"15min":0.84899999999999998},"min":{"1min":0.69499999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1739999999999999,"5min":1.216,"15min":1.222},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.002,"5min":1.0009999999999999,"15min":1.002},"min":{"1min":0.65800000000000003,"5min":0.63,"15min":0.62},"max":{"1min":1.23,"5min":1.23,"15min":1.302},"last":1.117}]},{"osd":7,"last update":"Mon Jan 10 02:34:25 2022","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.94699999999999995,"15min":0.93700000000000006},"min":{"1min":0.75,"5min":0.63800000000000001,"15min":0.59299999999999997},"max":{"1min":1.226,"5min":1.3120000000000001,"15min":1.4830000000000001},"last":1.048},{"interface":"front","average":{"1min":1.042,"5min":0.97799999999999998,"15min":0.97599999999999998},"min":{"1min":0.77000000000000002,"5min":0.68799999999999994,"15min":0.68000000000000005},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.389},"last":0.97899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575701,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.61799999999999999,"15min":0.60599999999999998},"min":{"1min":0.46999999999999997,"5min":0.46000000000000002,"15min":0.41399999999999998},"max":{"1min":0.77200000000000002,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66400000000000003,"15min":0.66100000000000003},"min":{"1min":0.47499999999999998,"5min":0.46800000000000003,"15min":0.46200000000000002},"max":{"1min":0.84399999999999997,"5min":1.1220000000000001,"15min":1.1519999999999999},"last":0.67300000000000004}]},{"osd":1,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.65800000000000003,"15min":0.64700000000000002},"min":{"1min":0.46700000000000003,"5min":0.46200000000000002,"15min":0.44400000000000001},"max":{"1min":1.0509999999999999,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.74099999999999999,"15min":0.72999999999999998},"min":{"1min":0.59199999999999997,"5min":0.498,"15min":0.498},"max":{"1min":0.97899999999999998,"5min":1.081,"15min":1.081},"last":0.77000000000000002}]},{"osd":2,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.77600000000000002,"15min":0.76100000000000001},"min":{"1min":0.60599999999999998,"5min":0.56399999999999995,"15min":0.54400000000000004},"max":{"1min":1.0089999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79700000000000004,"15min":0.80600000000000005},"min":{"1min":0.59999999999999998,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.216},"last":0.86199999999999999}]},{"osd":4,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.88800000000000001,"15min":0.875},"min":{"1min":0.68000000000000005,"5min":0.60299999999999998,"15min":0.58399999999999996},"max":{"1min":1.1140000000000001,"5min":1.321,"15min":1.321},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.95299999999999996,"15min":0.95599999999999996},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.167,"5min":1.272,"15min":1.444},"last":0.83799999999999997}]},{"osd":5,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.97399999999999998,"15min":0.96799999999999997},"min":{"1min":0.70799999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.212,"5min":1.28,"15min":1.3939999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.89900000000000002,"15min":0.90100000000000002},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.60599999999999998},"max":{"1min":1.1899999999999999,"5min":1.236,"15min":1.3260000000000001},"last":0.89600000000000002}]},{"osd":6,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":0.96999999999999997,"15min":0.97199999999999998},"min":{"1min":0.75,"5min":0.72799999999999998,"15min":0.66400000000000003},"max":{"1min":1.2509999999999999,"5min":1.268,"15min":1.494},"last":0.747},{"interface":"front","average":{"1min":1.044,"5min":1.04,"15min":1.0309999999999999},"min":{"1min":0.78300000000000003,"5min":0.75600000000000001,"15min":0.69099999999999995},"max":{"1min":1.351,"5min":1.351,"15min":1.3899999999999999},"last":1.2030000000000001}]},{"osd":7,"last update":"Mon Jan 10 02:34:37 2022","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98399999999999999,"15min":0.99299999999999999},"min":{"1min":0.72199999999999998,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.089,"5min":1.0620000000000001,"15min":1.0569999999999999},"min":{"1min":0.82799999999999996,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.94999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050596,"kb_used_data":2012,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321244,"statfs":{"total":96636764160,"available":95560953856,"internally_reserved":1073741824,"allocated":2060288,"data_stored":1009562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:54 2022","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.60199999999999998},"min":{"1min":0.47499999999999998,"5min":0.438,"15min":0.433},"max":{"1min":0.85799999999999998,"5min":0.95699999999999996,"15min":1.0289999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.436},"max":{"1min":1.0309999999999999,"5min":1.0920000000000001,"15min":1.145},"last":1.016}]},{"osd":1,"last update":"Mon Jan 10 02:34:54 2022","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.47499999999999998},"max":{"1min":0.92100000000000004,"5min":1.0209999999999999,"15min":1.0349999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.73399999999999999,"15min":0.72199999999999998},"min":{"1min":0.53300000000000003,"5min":0.505,"15min":0.47199999999999998},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1459999999999999},"last":0.54500000000000004}]},{"osd":3,"last update":"Mon Jan 10 02:34:54 2022","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82699999999999996,"5min":1.0640000000000001,"15min":1.1659999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81899999999999995,"15min":0.80100000000000005},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.52600000000000002},"max":{"1min":1.069,"5min":1.089,"15min":1.1399999999999999},"last":0.72699999999999998}]},{"osd":4,"last update":"Mon Jan 10 02:34:54 2022","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.93300000000000005,"15min":0.91600000000000004},"min":{"1min":0.71399999999999997,"5min":0.70799999999999996,"15min":0.58899999999999997},"max":{"1min":1.276,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.88800000000000001,"15min":0.88500000000000001},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.02,"5min":1.2749999999999999,"15min":1.2889999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Mon Jan 10 02:34:54 2022","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.96999999999999997,"15min":0.95099999999999996},"min":{"1min":0.68700000000000006,"5min":0.67600000000000005,"15min":0.67000000000000004},"max":{"1min":1.266,"5min":1.3480000000000001,"15min":1.4670000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.94199999999999995,"5min":0.97699999999999998,"15min":0.96699999999999997},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.224,"5min":1.349,"15min":1.4350000000000001},"last":0.77800000000000002}]},{"osd":6,"last update":"Mon Jan 10 02:34:54 2022","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.95199999999999996,"15min":0.93700000000000006},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.198,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0469999999999999,"15min":1.0129999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.66200000000000003},"max":{"1min":1.26,"5min":1.47,"15min":1.5249999999999999},"last":0.86799999999999999}]},{"osd":7,"last update":"Mon Jan 10 02:34:54 2022","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.054,"15min":1.0269999999999999},"min":{"1min":0.72499999999999998,"5min":0.72299999999999998,"15min":0.70899999999999996},"max":{"1min":1.4139999999999999,"5min":1.629,"15min":1.629},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0369999999999999,"15min":1.022},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.72699999999999998},"max":{"1min":1.256,"5min":1.3240000000000001,"15min":1.52},"last":0.89500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.433},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.64500000000000002,"15min":0.63800000000000001},"min":{"1min":0.504,"5min":0.46800000000000003,"15min":0.44700000000000001},"max":{"1min":1.095,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.745}]},{"osd":2,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64500000000000002,"15min":0.65400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.439},"max":{"1min":0.78900000000000003,"5min":0.95699999999999996,"15min":1.143},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.63700000000000001,"5min":0.59499999999999997,"15min":0.54600000000000004},"max":{"1min":0.92800000000000005,"5min":1.137,"15min":1.137},"last":0.80200000000000005}]},{"osd":3,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.55000000000000004},"max":{"1min":1.01,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.66100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.93700000000000006,"5min":1.095,"15min":1.1950000000000001},"last":0.95099999999999996}]},{"osd":4,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.90000000000000002,"15min":0.90300000000000002},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.60499999999999998},"max":{"1min":1.1180000000000001,"5min":1.2529999999999999,"15min":1.4299999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.94199999999999995,"15min":0.93200000000000005},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67700000000000005},"max":{"1min":1.1060000000000001,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.86499999999999999}]},{"osd":5,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.91700000000000004,"15min":0.90800000000000003},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2010000000000001,"5min":1.3799999999999999,"15min":1.4710000000000001},"last":1.028},{"interface":"front","average":{"1min":0.875,"5min":0.93300000000000005,"15min":0.93400000000000005},"min":{"1min":0.70999999999999996,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.087,"5min":1.3680000000000001,"15min":1.4930000000000001},"last":0.83299999999999996}]},{"osd":6,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.78400000000000003,"5min":0.69199999999999995,"15min":0.67800000000000005},"max":{"1min":1.2470000000000001,"5min":1.474,"15min":1.54},"last":1.099},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.96099999999999997,"15min":0.98999999999999999},"min":{"1min":0.79000000000000004,"5min":0.72599999999999998,"15min":0.72299999999999998},"max":{"1min":1.05,"5min":1.4750000000000001,"15min":1.512},"last":0.90700000000000003}]},{"osd":7,"last update":"Mon Jan 10 02:34:31 2022","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0289999999999999,"15min":1.024},"min":{"1min":0.81599999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.2869999999999999,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.88},{"interface":"front","average":{"1min":0.95599999999999996,"5min":1.03,"15min":1.0429999999999999},"min":{"1min":0.81699999999999995,"5min":0.72299999999999998,"15min":0.69399999999999995},"max":{"1min":1.1859999999999999,"5min":1.446,"15min":1.5840000000000001},"last":0.97899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575701,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1050600,"kb_used_data":2016,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93321240,"statfs":{"total":96636764160,"available":95560949760,"internally_reserved":1073741824,"allocated":2064384,"data_stored":1010140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61599999999999999,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.42099999999999999},"max":{"1min":0.90400000000000003,"5min":1.105,"15min":1.105},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71099999999999997,"15min":0.69699999999999995},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.441},"max":{"1min":1.056,"5min":1.1299999999999999,"15min":1.246},"last":0.48099999999999998}]},{"osd":2,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.69899999999999995,"15min":0.69499999999999995},"min":{"1min":0.52200000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98499999999999999,"5min":1.0800000000000001,"15min":1.131},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69099999999999995,"15min":0.70399999999999996},"min":{"1min":0.54000000000000004,"5min":0.53600000000000003,"15min":0.45400000000000001},"max":{"1min":1.0940000000000001,"5min":1.171,"15min":1.171},"last":0.61899999999999999}]},{"osd":3,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68600000000000005,"15min":0.67800000000000005},"min":{"1min":0.55700000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86799999999999999,"5min":1.016,"15min":1.016},"last":0.628},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79700000000000004,"15min":0.79000000000000004},"min":{"1min":0.61199999999999999,"5min":0.56299999999999994,"15min":0.498},"max":{"1min":0.92500000000000004,"5min":1.0580000000000001,"15min":1.105},"last":0.59699999999999998}]},{"osd":4,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88500000000000001,"15min":0.89200000000000002},"min":{"1min":0.68000000000000005,"5min":0.67200000000000004,"15min":0.64200000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.393},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.89500000000000002,"15min":0.89600000000000002},"min":{"1min":0.70999999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.282,"5min":1.343,"15min":1.343},"last":0.98199999999999998}]},{"osd":5,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.90800000000000003,"15min":0.89800000000000002},"min":{"1min":0.71799999999999997,"5min":0.69399999999999995,"15min":0.66100000000000003},"max":{"1min":1.264,"5min":1.321,"15min":1.321},"last":0.745},{"interface":"front","average":{"1min":1.018,"5min":0.998,"15min":0.98099999999999998},"min":{"1min":0.76600000000000001,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.296,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.89400000000000002}]},{"osd":6,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.0309999999999999,"15min":1.0049999999999999},"min":{"1min":0.85499999999999998,"5min":0.71699999999999997,"15min":0.66900000000000004},"max":{"1min":1.347,"5min":1.3819999999999999,"15min":1.399},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1,"15min":0.995},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.69499999999999995},"max":{"1min":1.2589999999999999,"5min":1.337,"15min":1.4319999999999999},"last":0.86699999999999999}]},{"osd":7,"last update":"Mon Jan 10 02:34:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0209999999999999,"15min":1.0129999999999999},"min":{"1min":0.753,"5min":0.753,"15min":0.72899999999999998},"max":{"1min":1.2390000000000001,"5min":1.389,"15min":1.468},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.071,"5min":1.026,"15min":1.008},"min":{"1min":0.82199999999999995,"5min":0.749,"15min":0.72599999999999998},"max":{"1min":1.3500000000000001,"5min":1.401,"15min":1.4219999999999999},"last":0.83899999999999997}]}]}]}} 2022-01-10T02:35:15.023 DEBUG:teuthology.orchestra.run.smithi036:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2022-01-10T02:35:15.131 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.127+0000 7fad6305c700 1 Processor -- start 2022-01-10T02:35:15.132 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad6305c700 1 -- start start 2022-01-10T02:35:15.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad6305c700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fad5c146950 0x7fad5c140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:35:15.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad6305c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad5c0b4690 0x7fad5c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-01-10T02:35:15.135 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad6305c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5c143b60 con 0x7fad5c0b4180 2022-01-10T02:35:15.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad6305c700 1 -- --> v2:172.21.15.36:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c147510 con 0x7fad5c146950 2022-01-10T02:35:15.136 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad6305c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5c143e00 con 0x7fad5c0b4690 2022-01-10T02:35:15.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad60df8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fad5c146950 0x7fad5c140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:35:15.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad615f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad5c0b4690 0x7fad5c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:35:15.137 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad60df8700 1 --2- >> v2:172.21.15.36:3300/0 conn(0x7fad5c146950 0x7fad5c140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43808/0 (socket says 172.21.15.36:43808) 2022-01-10T02:35:15.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad60df8700 1 -- 172.21.15.36:0/1418482291 learned_addr learned my addr 172.21.15.36:0/1418482291 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:35:15.138 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad5bfff700 1 --1- 172.21.15.36:0/1418482291 >> v1:172.21.15.59:6789/0 conn(0x7fad5c0b4180 0x7fad5c140720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.36:59280/0 (socket says 172.21.15.36:59280) 2022-01-10T02:35:15.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad60df8700 1 -- 172.21.15.36:0/1418482291 >> v2:172.21.15.59:3300/0 conn(0x7fad5c0b4690 msgr2=0x7fad5c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-01-10T02:35:15.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad60df8700 1 --2- 172.21.15.36:0/1418482291 >> v2:172.21.15.59:3300/0 conn(0x7fad5c0b4690 0x7fad5c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:15.139 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad60df8700 1 -- 172.21.15.36:0/1418482291 >> v1:172.21.15.59:6789/0 conn(0x7fad5c0b4180 legacy=0x7fad5c140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:35:15.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad60df8700 1 -- 172.21.15.36:0/1418482291 --> v2:172.21.15.36:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c0b0c90 con 0x7fad5c146950 2022-01-10T02:35:15.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad615f9700 1 --2- 172.21.15.36:0/1418482291 >> v2:172.21.15.59:3300/0 conn(0x7fad5c0b4690 0x7fad5c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-01-10T02:35:15.140 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad60df8700 1 --2- 172.21.15.36:0/1418482291 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad5c146950 0x7fad5c140230 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fad50002f70 tx=0x7fad50006eb0).ready entity=mon.0 client_cookie=e3d6c67dc3ab549e server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:35:15.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad5b7fe700 1 -- 172.21.15.36:0/1418482291 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad5000d5c0 con 0x7fad5c146950 2022-01-10T02:35:15.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad5b7fe700 1 -- 172.21.15.36:0/1418482291 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad50000e90 con 0x7fad5c146950 2022-01-10T02:35:15.141 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad5b7fe700 1 -- 172.21.15.36:0/1418482291 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad5000d950 con 0x7fad5c146950 2022-01-10T02:35:15.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad6305c700 1 -- 172.21.15.36:0/1418482291 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad5c146950 msgr2=0x7fad5c140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:35:15.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad6305c700 1 --2- 172.21.15.36:0/1418482291 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad5c146950 0x7fad5c140230 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fad50002f70 tx=0x7fad50006eb0).stop 2022-01-10T02:35:15.142 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad6305c700 1 -- 172.21.15.36:0/1418482291 shutdown_connections 2022-01-10T02:35:15.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad6305c700 1 --2- 172.21.15.36:0/1418482291 >> v2:172.21.15.59:3300/0 conn(0x7fad5c0b4690 0x7fad5c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:15.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad6305c700 1 --2- 172.21.15.36:0/1418482291 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad5c146950 0x7fad5c140230 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:15.143 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad6305c700 1 -- 172.21.15.36:0/1418482291 >> 172.21.15.36:0/1418482291 conn(0x7fad5c05c490 msgr2=0x7fad5c05c870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:35:15.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad6305c700 1 -- 172.21.15.36:0/1418482291 shutdown_connections 2022-01-10T02:35:15.144 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.131+0000 7fad6305c700 1 -- 172.21.15.36:0/1418482291 wait complete. 2022-01-10T02:35:15.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad6305c700 1 Processor -- start 2022-01-10T02:35:15.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad6305c700 1 -- start start 2022-01-10T02:35:15.148 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad6305c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad5c0b4180 0x7fad5c0b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:35:15.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad6305c700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad5c0b4690 0x7fad5c1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:35:15.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad6305c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad5c0ae620 0x7fad5c0b8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:35:15.149 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad6305c700 1 -- --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0b8510 con 0x7fad5c0b4690 2022-01-10T02:35:15.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad6305c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0add10 con 0x7fad5c0b4180 2022-01-10T02:35:15.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad6305c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5c0adfb0 con 0x7fad5c0ae620 2022-01-10T02:35:15.150 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad5bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad5c0b4690 0x7fad5c1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:35:15.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad5bfff700 1 --2- >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad5c0b4690 0x7fad5c1559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.36:3300/0 says I am v2:172.21.15.36:43812/0 (socket says 172.21.15.36:43812) 2022-01-10T02:35:15.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad5bfff700 1 -- 172.21.15.36:0/4215404447 learned_addr learned my addr 172.21.15.36:0/4215404447 (peer_addr_for_me v2:172.21.15.36:0/0) 2022-01-10T02:35:15.151 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad615f9700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad5c0ae620 0x7fad5c0b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:35:15.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad60df8700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad5c0b4180 0x7fad5c0b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:35:15.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad5bfff700 1 -- 172.21.15.36:0/4215404447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad5c0ae620 msgr2=0x7fad5c0b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:35:15.152 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad5bfff700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad5c0ae620 0x7fad5c0b8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:15.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad5bfff700 1 -- 172.21.15.36:0/4215404447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad5c0b4180 msgr2=0x7fad5c0b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:35:15.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad5bfff700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad5c0b4180 0x7fad5c0b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:15.153 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad5bfff700 1 -- 172.21.15.36:0/4215404447 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad54009470 con 0x7fad5c0b4690 2022-01-10T02:35:15.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad60df8700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad5c0b4180 0x7fad5c0b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-01-10T02:35:15.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad5bfff700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad5c0b4690 0x7fad5c1559f0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7fad5c060c50 tx=0x7fad4c007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:35:15.154 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.135+0000 7fad59ffb700 1 -- 172.21.15.36:0/4215404447 <== mon.0 v2:172.21.15.36:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad4c00ce30 con 0x7fad5c0b4690 2022-01-10T02:35:15.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.139+0000 7fad59ffb700 1 -- 172.21.15.36:0/4215404447 <== mon.0 v2:172.21.15.36:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c0072e0 con 0x7fad5c0b4690 2022-01-10T02:35:15.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.139+0000 7fad6305c700 1 -- 172.21.15.36:0/4215404447 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5000b1e0 con 0x7fad5c0b4690 2022-01-10T02:35:15.155 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.139+0000 7fad59ffb700 1 -- 172.21.15.36:0/4215404447 <== mon.0 v2:172.21.15.36:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad4c007450 con 0x7fad5c0b4690 2022-01-10T02:35:15.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.139+0000 7fad6305c700 1 -- 172.21.15.36:0/4215404447 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5c0b3700 con 0x7fad5c0b4690 2022-01-10T02:35:15.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.139+0000 7fad6305c700 1 -- 172.21.15.36:0/4215404447 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5c057350 con 0x7fad5c0b4690 2022-01-10T02:35:15.156 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.139+0000 7fad59ffb700 1 -- 172.21.15.36:0/4215404447 <== mon.0 v2:172.21.15.36:3300/0 4 ==== mgrmap(e 4) v1 ==== 65684+0+0 (secure 0 0 0) 0x7fad4c010070 con 0x7fad5c0b4690 2022-01-10T02:35:15.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.139+0000 7fad59ffb700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad3c053560 0x7fad3c055a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-01-10T02:35:15.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.139+0000 7fad59ffb700 1 -- 172.21.15.36:0/4215404447 <== mon.0 v2:172.21.15.36:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5686+0+0 (secure 0 0 0) 0x7fad4c06af00 con 0x7fad5c0b4690 2022-01-10T02:35:15.157 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.139+0000 7fad60df8700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad3c053560 0x7fad3c055a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-01-10T02:35:15.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.139+0000 7fad60df8700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad3c053560 0x7fad3c055a20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fad5001a000 tx=0x7fad50015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-01-10T02:35:15.158 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.143+0000 7fad59ffb700 1 -- 172.21.15.36:0/4215404447 <== mon.0 v2:172.21.15.36:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138877 (secure 0 0 0) 0x7fad4c042170 con 0x7fad5c0b4690 2022-01-10T02:35:15.190 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:35:15.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:35:15.196 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:35:15.199 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:35:15.273 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.271+0000 7fad6305c700 1 -- 172.21.15.36:0/4215404447 --> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fad5c0b8660 con 0x7fad5c0b4690 2022-01-10T02:35:15.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.275+0000 7fad59ffb700 1 -- 172.21.15.36:0/4215404447 <== mon.0 v2:172.21.15.36:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fad4c042170 con 0x7fad5c0b4690 2022-01-10T02:35:15.279 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.279+0000 7fad59ffb700 1 -- 172.21.15.36:0/4215404447 <== mon.0 v2:172.21.15.36:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v25)=0 v25) v1 ==== 123+0+0 (secure 0 0 0) 0x7fad4c045790 con 0x7fad5c0b4690 2022-01-10T02:35:15.283 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.283+0000 7fad6305c700 1 -- 172.21.15.36:0/4215404447 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad3c053560 msgr2=0x7fad3c055a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:35:15.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.283+0000 7fad6305c700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad3c053560 0x7fad3c055a20 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fad5001a000 tx=0x7fad50015000).stop 2022-01-10T02:35:15.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.283+0000 7fad6305c700 1 -- 172.21.15.36:0/4215404447 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad5c0b4690 msgr2=0x7fad5c1559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-01-10T02:35:15.284 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.283+0000 7fad6305c700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad5c0b4690 0x7fad5c1559f0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7fad5c060c50 tx=0x7fad4c007c10).stop 2022-01-10T02:35:15.285 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.283+0000 7fad6305c700 1 -- 172.21.15.36:0/4215404447 shutdown_connections 2022-01-10T02:35:15.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.283+0000 7fad6305c700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.36:6800/14596,v1:172.21.15.36:6801/14596] conn(0x7fad3c053560 0x7fad3c055a20 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:15.286 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.283+0000 7fad6305c700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad5c0ae620 0x7fad5c0b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:15.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.283+0000 7fad6305c700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.36:3300/0,v1:172.21.15.36:6789/0] conn(0x7fad5c0b4690 0x7fad5c1559f0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:15.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.283+0000 7fad6305c700 1 --2- 172.21.15.36:0/4215404447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad5c0b4180 0x7fad5c0b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-01-10T02:35:15.287 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.283+0000 7fad6305c700 1 -- 172.21.15.36:0/4215404447 >> 172.21.15.36:0/4215404447 conn(0x7fad5c05c490 msgr2=0x7fad5c13e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-01-10T02:35:15.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.283+0000 7fad6305c700 1 -- 172.21.15.36:0/4215404447 shutdown_connections 2022-01-10T02:35:15.288 INFO:teuthology.orchestra.run.smithi036.stderr:2022-01-10T02:35:15.283+0000 7fad6305c700 1 -- 172.21.15.36:0/4215404447 wait complete. 2022-01-10T02:35:15.297 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/ceph.py", line 1839, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-01-10T02:35:15.300 INFO:teuthology.misc:Shutting down mds daemons... 2022-01-10T02:35:15.301 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2022-01-10T02:35:15.302 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:15.315 INFO:tasks.ceph.mds.a:Stopped 2022-01-10T02:35:15.316 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2022-01-10T02:35:15.317 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:15.332 INFO:tasks.ceph.mds.c:Stopped 2022-01-10T02:35:15.332 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2022-01-10T02:35:15.333 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:15.350 INFO:tasks.ceph.mds.b:Stopped 2022-01-10T02:35:15.351 INFO:teuthology.misc:Shutting down osd daemons... 2022-01-10T02:35:15.352 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2022-01-10T02:35:15.352 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:15.453 INFO:tasks.ceph.osd.0:Stopped 2022-01-10T02:35:15.454 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2022-01-10T02:35:15.454 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:15.532 INFO:tasks.ceph.osd.1:Stopped 2022-01-10T02:35:15.533 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2022-01-10T02:35:15.534 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:15.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2022-01-10T02:35:15.609 INFO:tasks.ceph.osd.2:Stopped 2022-01-10T02:35:15.610 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2022-01-10T02:35:15.610 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:15.678 INFO:tasks.ceph.osd.3:Stopped 2022-01-10T02:35:15.679 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2022-01-10T02:35:15.680 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:15.755 INFO:tasks.ceph.osd.4:Stopped 2022-01-10T02:35:15.756 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2022-01-10T02:35:15.757 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:15.825 INFO:tasks.ceph.osd.5:Stopped 2022-01-10T02:35:15.826 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2022-01-10T02:35:15.827 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:15.897 INFO:tasks.ceph.osd.6:Stopped 2022-01-10T02:35:15.898 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2022-01-10T02:35:15.898 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:15.983 INFO:tasks.ceph.osd.7:Stopped 2022-01-10T02:35:15.984 INFO:teuthology.misc:Shutting down mgr daemons... 2022-01-10T02:35:15.985 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2022-01-10T02:35:15.985 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:16.016 INFO:tasks.ceph.mgr.y:Stopped 2022-01-10T02:35:16.017 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2022-01-10T02:35:16.018 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:16.045 INFO:tasks.ceph.mgr.x:Stopped 2022-01-10T02:35:16.046 INFO:teuthology.misc:Shutting down mon daemons... 2022-01-10T02:35:16.047 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2022-01-10T02:35:16.048 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:16.074 INFO:tasks.ceph.mon.a:Stopped 2022-01-10T02:35:16.075 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2022-01-10T02:35:16.076 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:16.100 INFO:tasks.ceph.mon.b:Stopped 2022-01-10T02:35:16.101 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2022-01-10T02:35:16.101 INFO:teuthology.orchestra.run:waiting for 300 2022-01-10T02:35:16.121 INFO:tasks.ceph.mon.c:Stopped 2022-01-10T02:35:16.122 INFO:tasks.ceph:Checking cluster log for badness... 2022-01-10T02:35:16.124 DEBUG:teuthology.orchestra.run.smithi036:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'evicting unresponsive client' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'has not responded to cap revoke by MDS for over' | egrep -v MDS_CLIENT_LATE_RELEASE | egrep -v 'responding to mclientcaps' | head -n 1 2022-01-10T02:35:16.148 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi036.front.sepia.ceph.com 2022-01-10T02:35:16.148 DEBUG:teuthology.orchestra.run.smithi036:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2022-01-10T02:35:16.482 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi036.front.sepia.ceph.com 2022-01-10T02:35:16.483 DEBUG:teuthology.orchestra.run.smithi036:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2022-01-10T02:35:16.831 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi036.front.sepia.ceph.com 2022-01-10T02:35:16.832 DEBUG:teuthology.orchestra.run.smithi036:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2022-01-10T02:35:17.000 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi036.front.sepia.ceph.com 2022-01-10T02:35:17.001 DEBUG:teuthology.orchestra.run.smithi036:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2022-01-10T02:35:17.176 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi059.front.sepia.ceph.com 2022-01-10T02:35:17.177 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2022-01-10T02:35:17.432 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi059.front.sepia.ceph.com 2022-01-10T02:35:17.433 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2022-01-10T02:35:17.778 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi059.front.sepia.ceph.com 2022-01-10T02:35:17.779 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2022-01-10T02:35:18.105 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi059.front.sepia.ceph.com 2022-01-10T02:35:18.106 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2022-01-10T02:35:18.294 INFO:tasks.ceph:Archiving mon data... 2022-01-10T02:35:18.296 DEBUG:teuthology.misc:Transferring archived files from smithi036:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/data/mon.a.tgz 2022-01-10T02:35:18.297 DEBUG:teuthology.orchestra.run.smithi036:> mktemp 2022-01-10T02:35:18.304 INFO:teuthology.orchestra.run.smithi036.stdout:/tmp/tmp.g7Ecxz8rKF 2022-01-10T02:35:18.305 DEBUG:teuthology.orchestra.run.smithi036:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.g7Ecxz8rKF 2022-01-10T02:35:18.514 DEBUG:teuthology.orchestra.run.smithi036:> sudo chmod 0666 /tmp/tmp.g7Ecxz8rKF 2022-01-10T02:35:18.539 DEBUG:teuthology.orchestra.remote:smithi036:/tmp/tmp.g7Ecxz8rKF is 517KB 2022-01-10T02:35:18.605 DEBUG:teuthology.orchestra.run.smithi036:> rm -fr /tmp/tmp.g7Ecxz8rKF 2022-01-10T02:35:18.613 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/data/mon.b.tgz 2022-01-10T02:35:18.613 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2022-01-10T02:35:18.620 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.hnS8j2Yujr 2022-01-10T02:35:18.621 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.hnS8j2Yujr 2022-01-10T02:35:18.855 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.hnS8j2Yujr 2022-01-10T02:35:18.921 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.hnS8j2Yujr is 619KB 2022-01-10T02:35:18.989 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.hnS8j2Yujr 2022-01-10T02:35:18.996 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/data/mon.c.tgz 2022-01-10T02:35:18.997 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2022-01-10T02:35:19.005 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.xSvNCEqdWB 2022-01-10T02:35:19.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.xSvNCEqdWB 2022-01-10T02:35:19.272 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.xSvNCEqdWB 2022-01-10T02:35:19.295 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.xSvNCEqdWB is 621KB 2022-01-10T02:35:19.405 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.xSvNCEqdWB 2022-01-10T02:35:19.413 INFO:tasks.ceph:Cleaning ceph cluster... 2022-01-10T02:35:19.413 DEBUG:teuthology.orchestra.run.smithi036:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2022-01-10T02:35:19.416 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2022-01-10T02:35:19.419 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2022-01-10T02:35:19.422 DEBUG:teuthology.orchestra.run.smithi166:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2022-01-10T02:35:19.439 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2022-01-10T02:35:19.440 DEBUG:teuthology.orchestra.run.smithi036:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2022-01-10T02:35:19.473 DEBUG:teuthology.orchestra.run.smithi059:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2022-01-10T02:35:19.476 DEBUG:teuthology.orchestra.run.smithi139:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2022-01-10T02:35:19.479 DEBUG:teuthology.orchestra.run.smithi166:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2022-01-10T02:35:19.501 INFO:teuthology.orchestra.run.smithi036.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2022-01-10T02:35:19.501 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2022-01-10T02:35:19.558 INFO:teuthology.orchestra.run.smithi139.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2022-01-10T02:35:19.586 INFO:teuthology.orchestra.run.smithi166.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2022-01-10T02:35:19.595 INFO:tasks.ceph:Archiving crash dumps... 2022-01-10T02:35:19.598 DEBUG:teuthology.misc:Transferring archived files from smithi036:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/remote/smithi036/crash 2022-01-10T02:35:19.599 DEBUG:teuthology.orchestra.run.smithi036:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2022-01-10T02:35:19.620 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/remote/smithi059/crash 2022-01-10T02:35:19.622 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2022-01-10T02:35:19.643 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/remote/smithi139/crash 2022-01-10T02:35:19.645 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2022-01-10T02:35:19.665 DEBUG:teuthology.misc:Transferring archived files from smithi166:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/remote/smithi166/crash 2022-01-10T02:35:19.667 DEBUG:teuthology.orchestra.run.smithi166:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2022-01-10T02:35:19.687 INFO:tasks.ceph:Shutting down logrotate 2022-01-10T02:35:19.688 DEBUG:teuthology.orchestra.run.smithi036:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:35:19.691 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:35:19.693 DEBUG:teuthology.orchestra.run.smithi139:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:35:19.710 DEBUG:teuthology.orchestra.run.smithi166:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-01-10T02:35:19.773 DEBUG:teuthology.orchestra.run.smithi036:> sudo rm /etc/logrotate.d/ceph-test.conf 2022-01-10T02:35:19.790 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm /etc/logrotate.d/ceph-test.conf 2022-01-10T02:35:19.807 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm /etc/logrotate.d/ceph-test.conf 2022-01-10T02:35:19.823 DEBUG:teuthology.orchestra.run.smithi166:> sudo rm /etc/logrotate.d/ceph-test.conf 2022-01-10T02:35:19.839 INFO:tasks.ceph:Compressing logs... 2022-01-10T02:35:19.840 DEBUG:teuthology.orchestra.run.smithi036:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2022-01-10T02:35:19.843 DEBUG:teuthology.orchestra.run.smithi059:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2022-01-10T02:35:19.846 DEBUG:teuthology.orchestra.run.smithi139:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2022-01-10T02:35:19.848 DEBUG:teuthology.orchestra.run.smithi166:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2022-01-10T02:35:20.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2022-01-10T02:35:32.784 INFO:tasks.ceph:Archiving logs... 2022-01-10T02:35:32.786 DEBUG:teuthology.misc:Transferring archived files from smithi036:/var/log/ceph to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/remote/smithi036/log 2022-01-10T02:35:32.788 DEBUG:teuthology.orchestra.run.smithi036:> sudo tar cz -f - -C /var/log/ceph -- . 2022-01-10T02:35:36.035 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/remote/smithi059/log 2022-01-10T02:35:36.037 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/log/ceph -- . 2022-01-10T02:35:38.972 DEBUG:teuthology.misc:Transferring archived files from smithi139:/var/log/ceph to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/remote/smithi139/log 2022-01-10T02:35:38.974 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar cz -f - -C /var/log/ceph -- . 2022-01-10T02:35:39.384 DEBUG:teuthology.misc:Transferring archived files from smithi166:/var/log/ceph to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/remote/smithi166/log 2022-01-10T02:35:39.387 DEBUG:teuthology.orchestra.run.smithi166:> sudo tar cz -f - -C /var/log/ceph -- . 2022-01-10T02:35:39.437 DEBUG:teuthology.run_tasks:Unwinding manager install 2022-01-10T02:35:39.449 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/task/install/__init__.py", line 619, in task yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/run_tasks.py", line 176, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/ceph_fuse.py", line 160, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 326, in umount_wait if not (self.is_mounted() and self.fuse_daemon): File "/home/teuthworker/src/github.com_ceph_ceph_f6d564868a58503a158361f4a4d03aeb91ddeca2/qa/tasks/cephfs/fuse_mount.py", line 205, in is_mounted proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 148, in wait greenlet.get(block=True,timeout=60) File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-01-10T02:35:39.453 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2022-01-10T02:35:39.454 DEBUG:teuthology.orchestra.run.smithi036:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2022-01-10T02:35:39.457 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2022-01-10T02:35:39.460 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2022-01-10T02:35:39.463 DEBUG:teuthology.orchestra.run.smithi166:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2022-01-10T02:35:39.579 DEBUG:teuthology.run_tasks:Unwinding manager clock 2022-01-10T02:35:39.592 INFO:teuthology.task.clock:Checking final clock skew... 2022-01-10T02:35:39.593 DEBUG:teuthology.orchestra.run.smithi036:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-01-10T02:35:39.596 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-01-10T02:35:39.598 DEBUG:teuthology.orchestra.run.smithi139:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-01-10T02:35:39.601 DEBUG:teuthology.orchestra.run.smithi166:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-01-10T02:35:39.617 INFO:teuthology.orchestra.run.smithi036.stdout: remote refid st t when poll reach delay offset jitter 2022-01-10T02:35:39.617 INFO:teuthology.orchestra.run.smithi036.stdout:============================================================================== 2022-01-10T02:35:39.617 INFO:teuthology.orchestra.run.smithi036.stdout:-hv01.front.sepi 216.240.36.24 3 u 49 64 377 0.111 5.207 0.600 2022-01-10T02:35:39.618 INFO:teuthology.orchestra.run.smithi036.stdout:*hv02.front.sepi 163.237.218.18 2 u 53 64 377 0.080 1.679 0.586 2022-01-10T02:35:39.618 INFO:teuthology.orchestra.run.smithi036.stdout:+hv03.front.sepi 216.229.4.69 3 u 1 64 377 0.095 1.262 0.836 2022-01-10T02:35:39.618 INFO:teuthology.orchestra.run.smithi036.stdout:+hv04.front.sepi 96.245.170.99 3 u 57 64 377 0.086 0.420 0.788 2022-01-10T02:35:39.620 INFO:teuthology.orchestra.run.smithi059.stdout: remote refid st t when poll reach delay offset jitter 2022-01-10T02:35:39.621 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================== 2022-01-10T02:35:39.621 INFO:teuthology.orchestra.run.smithi059.stdout:-hv01.front.sepi 216.240.36.24 3 u 124 128 377 0.185 6.469 0.810 2022-01-10T02:35:39.621 INFO:teuthology.orchestra.run.smithi059.stdout:*hv02.front.sepi 163.237.218.18 2 u 43 128 377 0.168 3.064 1.157 2022-01-10T02:35:39.622 INFO:teuthology.orchestra.run.smithi059.stdout:+hv03.front.sepi 216.229.4.69 3 u 30 128 377 0.175 4.291 1.048 2022-01-10T02:35:39.622 INFO:teuthology.orchestra.run.smithi059.stdout:+hv04.front.sepi 96.245.170.99 3 u 113 128 377 0.146 1.020 0.917 2022-01-10T02:35:39.623 INFO:teuthology.orchestra.run.smithi139.stdout: remote refid st t when poll reach delay offset jitter 2022-01-10T02:35:39.623 INFO:teuthology.orchestra.run.smithi139.stdout:============================================================================== 2022-01-10T02:35:39.623 INFO:teuthology.orchestra.run.smithi139.stdout:-hv01.front.sepi 216.240.36.24 3 u 53 64 377 0.113 4.358 0.174 2022-01-10T02:35:39.624 INFO:teuthology.orchestra.run.smithi139.stdout:*hv02.front.sepi 163.237.218.18 2 u 41 64 377 0.079 1.559 0.114 2022-01-10T02:35:39.624 INFO:teuthology.orchestra.run.smithi139.stdout:+hv03.front.sepi 216.229.4.69 3 u 62 64 377 0.088 1.723 0.167 2022-01-10T02:35:39.624 INFO:teuthology.orchestra.run.smithi139.stdout:+hv04.front.sepi 96.245.170.99 3 u 37 64 377 0.106 -0.734 0.155 2022-01-10T02:35:39.626 INFO:teuthology.orchestra.run.smithi166.stdout: remote refid st t when poll reach delay offset jitter 2022-01-10T02:35:39.626 INFO:teuthology.orchestra.run.smithi166.stdout:============================================================================== 2022-01-10T02:35:39.627 INFO:teuthology.orchestra.run.smithi166.stdout:-hv01.front.sepi 216.240.36.24 3 u 103 128 377 0.150 6.283 0.740 2022-01-10T02:35:39.627 INFO:teuthology.orchestra.run.smithi166.stdout:*hv02.front.sepi 163.237.218.18 2 u 113 128 377 0.140 3.277 0.819 2022-01-10T02:35:39.627 INFO:teuthology.orchestra.run.smithi166.stdout:+hv03.front.sepi 216.229.4.69 3 u 128 128 377 0.148 5.005 1.574 2022-01-10T02:35:39.628 INFO:teuthology.orchestra.run.smithi166.stdout:+hv04.front.sepi 96.245.170.99 3 u 109 128 377 0.116 2.638 1.465 2022-01-10T02:35:39.629 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2022-01-10T02:35:39.641 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2022-01-10T02:35:39.641 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2022-01-10T02:35:39.664 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2022-01-10T02:35:39.680 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2022-01-10T02:35:39.697 INFO:teuthology.task.internal:Duration was 4668.695589 seconds 2022-01-10T02:35:39.698 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2022-01-10T02:35:39.720 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2022-01-10T02:35:39.721 DEBUG:teuthology.orchestra.run.smithi036:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2022-01-10T02:35:39.724 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2022-01-10T02:35:39.727 DEBUG:teuthology.orchestra.run.smithi139:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2022-01-10T02:35:39.730 DEBUG:teuthology.orchestra.run.smithi166:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2022-01-10T02:35:39.781 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2022-01-10T02:35:39.782 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi036.front.sepia.ceph.com 2022-01-10T02:35:39.783 DEBUG:teuthology.orchestra.run.smithi036:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2022-01-10T02:35:39.796 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2022-01-10T02:35:39.797 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2022-01-10T02:35:39.814 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi139.front.sepia.ceph.com 2022-01-10T02:35:39.815 DEBUG:teuthology.orchestra.run.smithi139:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2022-01-10T02:35:39.832 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi166.front.sepia.ceph.com 2022-01-10T02:35:39.833 DEBUG:teuthology.orchestra.run.smithi166:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2022-01-10T02:35:39.848 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2022-01-10T02:35:39.849 DEBUG:teuthology.orchestra.run.smithi036:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2022-01-10T02:35:39.852 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2022-01-10T02:35:39.855 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2022-01-10T02:35:39.858 DEBUG:teuthology.orchestra.run.smithi166:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2022-01-10T02:35:39.922 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2022-01-10T02:35:39.923 DEBUG:teuthology.orchestra.run.smithi036:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2022-01-10T02:35:39.936 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2022-01-10T02:35:39.939 DEBUG:teuthology.orchestra.run.smithi139:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2022-01-10T02:35:39.942 DEBUG:teuthology.orchestra.run.smithi166:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2022-01-10T02:35:40.016 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2022-01-10T02:35:40.030 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2022-01-10T02:35:40.031 DEBUG:teuthology.orchestra.run.smithi036:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2022-01-10T02:35:40.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2022-01-10T02:35:40.064 DEBUG:teuthology.orchestra.run.smithi139:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2022-01-10T02:35:40.081 DEBUG:teuthology.orchestra.run.smithi166:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2022-01-10T02:35:40.098 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2022-01-10T02:35:40.112 DEBUG:teuthology.orchestra.run.smithi036:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2022-01-10T02:35:40.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2022-01-10T02:35:40.118 DEBUG:teuthology.orchestra.run.smithi139:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2022-01-10T02:35:40.120 DEBUG:teuthology.orchestra.run.smithi166:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2022-01-10T02:35:40.127 INFO:teuthology.orchestra.run.smithi036.stdout:kernel.core_pattern = core 2022-01-10T02:35:40.130 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2022-01-10T02:35:40.132 INFO:teuthology.orchestra.run.smithi139.stdout:kernel.core_pattern = core 2022-01-10T02:35:40.135 INFO:teuthology.orchestra.run.smithi166.stdout:kernel.core_pattern = core 2022-01-10T02:35:40.159 DEBUG:teuthology.orchestra.run.smithi036:> test -e /home/ubuntu/cephtest/archive/coredump 2022-01-10T02:35:40.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T02:35:40.206 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2022-01-10T02:35:40.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T02:35:40.214 DEBUG:teuthology.orchestra.run.smithi139:> test -e /home/ubuntu/cephtest/archive/coredump 2022-01-10T02:35:40.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T02:35:40.222 DEBUG:teuthology.orchestra.run.smithi166:> test -e /home/ubuntu/cephtest/archive/coredump 2022-01-10T02:35:40.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-01-10T02:35:40.229 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2022-01-10T02:35:40.242 INFO:teuthology.task.internal:Transferring archived files... 2022-01-10T02:35:40.244 DEBUG:teuthology.misc:Transferring archived files from smithi036:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/remote/smithi036 2022-01-10T02:35:40.245 DEBUG:teuthology.orchestra.run.smithi036:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2022-01-10T02:35:40.286 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/remote/smithi059 2022-01-10T02:35:40.287 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2022-01-10T02:35:40.326 DEBUG:teuthology.misc:Transferring archived files from smithi139:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/remote/smithi139 2022-01-10T02:35:40.327 DEBUG:teuthology.orchestra.run.smithi139:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2022-01-10T02:35:40.365 DEBUG:teuthology.misc:Transferring archived files from smithi166:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2022-01-07_04:10:02-fs-octopus-distro-default-smithi/6600546/remote/smithi166 2022-01-10T02:35:40.366 DEBUG:teuthology.orchestra.run.smithi166:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2022-01-10T02:35:40.404 INFO:teuthology.task.internal:Removing archive directory... 2022-01-10T02:35:40.405 DEBUG:teuthology.orchestra.run.smithi036:> rm -rf -- /home/ubuntu/cephtest/archive 2022-01-10T02:35:40.408 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2022-01-10T02:35:40.411 DEBUG:teuthology.orchestra.run.smithi139:> rm -rf -- /home/ubuntu/cephtest/archive 2022-01-10T02:35:40.415 DEBUG:teuthology.orchestra.run.smithi166:> rm -rf -- /home/ubuntu/cephtest/archive 2022-01-10T02:35:40.446 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2022-01-10T02:35:40.461 INFO:teuthology.task.internal:Not uploading archives. 2022-01-10T02:35:40.462 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2022-01-10T02:35:40.503 INFO:teuthology.task.internal:Tidying up after the test... 2022-01-10T02:35:40.505 DEBUG:teuthology.orchestra.run.smithi036:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2022-01-10T02:35:40.508 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2022-01-10T02:35:40.511 DEBUG:teuthology.orchestra.run.smithi139:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2022-01-10T02:35:40.514 INFO:teuthology.orchestra.run.smithi036.stdout: 655394 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 10 02:35 /home/ubuntu/cephtest 2022-01-10T02:35:40.515 DEBUG:teuthology.orchestra.run.smithi166:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2022-01-10T02:35:40.517 INFO:teuthology.orchestra.run.smithi059.stdout: 655380 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 10 02:35 /home/ubuntu/cephtest 2022-01-10T02:35:40.523 INFO:teuthology.orchestra.run.smithi166.stdout: 655382 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 10 02:35 /home/ubuntu/cephtest 2022-01-10T13:15:10.006 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-01-10T13:15:10.306 DEBUG:teuthology.task.console_log:Killing console logger for smithi036 2022-01-10T13:15:10.310 DEBUG:teuthology.task.console_log:Killing console logger for smithi059 2022-01-10T13:15:10.310 DEBUG:teuthology.task.console_log:Killing console logger for smithi139 2022-01-10T13:15:10.312 DEBUG:teuthology.task.console_log:Killing console logger for smithi166 2022-01-10T13:15:10.313 DEBUG:teuthology.exit:Finished running handlers